How do we know what we know? Who can we trust?
It’s bad enough that an American President constantly attacks reputable sources of information; when Trump asserts that reports unflattering to him are “fake news,” those assertions join–and bolster– widely-held doubts about the reliability of contemporary media. Those doubts are understandable; it is increasingly difficult to separate out the conspiracy-theory websites from legitimate digital newcomers, to recognize and discount sources trafficking in spin and outright propaganda, and even to distinguish between objective reporting and satire.
The unremitting assault on fact, on objective reality, makes the reliability of the information we get from government agencies more important than ever. When Scott Pruitt scrubs accurate science from the EPA website, he does more than degrade our efforts to protect the environment–he adds to the Alice-In-Wonderland nature of our shared reality.
Unfortunately, it isn’t just Scott Pruitt. The problem isn’t even limited to the Trump cabinet.
According to the Guardian (a very reputable source)
Over half of all police killings in 2015 were wrongly classified as not having been the result of interactions with officers, a new Harvard study based on Guardian data has found.
The finding is just the latest to show government databases seriously undercounting the number of people killed by police.
“Right now the data quality is bad and unacceptable,” said lead researcher Justin Feldman. “To effectively address the problem of law enforcement-related deaths, the public needs better data about who is being killed, where, and under what circumstances.”
This article underscores the importance of good journalism–the Harvard study used data compiled in the Guardian’s investigative reporting. It also illustrates the consequences of relying upon bad data.
Feldman used data from the Guardian’s 2015 investigation into police killings, The Counted, and compared it with data from the National Vital Statistics System (NVSS). That dataset, which is kept by the Centers for Disease Control and Prevention (CDC), was found to have misclassified 55.2% of all police killings, with the errors occurring disproportionately in low-income jurisdictions.
“As with any public health outcome or exposure, the only way to understand the magnitude of the problem, and whether it is getting better or worse, requires that data be uniformly, validly, and reliably obtained throughout the US,” said Nancy Krieger, professor of social epidemiology at Harvard’s Chan School of Public Health and senior author of the study. “Our results show our country is falling short of accurately monitoring deaths due to law enforcement and work is needed to remedy this problem.”
Interestingly, the researchers found that the accuracy of the data varied wildly by state, “with just 17.6% misclassification in Washington, but a startling 100% in Oklahoma.”
In 2015 the Guardian launched The Counted, an interactive, crowdsourced database attempting to track police killings throughout the US. The project was intended to help remedy the lack of reliable data on police killings, a lack that became especially visible after the 2014 unrest in Ferguson put policing in the national spotlight.
Other federal databases, including the Bureau of Justice Statistics’ (BJS) arrest-related death count and the FBI’s supplementary homicide reports were similarly criticised for severely undercounting police-related deaths. Both programs have been dramatically reworked since The Counted and similar media/open source databases forced officials such as the former FBI director James Comey to admit that newspapers had more accurate data than the government on police violence.
To state the obvious, policymakers cannot craft good laws or regulations in the absence of sound data. Citizens confronted with experiences at odds with government’s descriptions lose confidence in that government. Discrepancies between reality and government reporting feed conspiracy theories.
When we don’t know what we know, we cannot act.
Other than patronizing news sites we know to be trustworthy, there’s not much we can do about the proliferating media wannabes spouting fantasies and disinformation. But we should be able to insist that government agencies charged with compiling and disseminating factual data do so accurately. We aren’t likely to get that done in the Age of Trumpian Fantasy, but when the time comes to clean up the incredible chaos he is creating, a commitment to accurate data collection by government should be high on our cleanup list.
Comments