Ellington

After countless scandals in recent years, the problems with America's forensics system are finally getting some national attention. In December, Sen. Patrick Leahy (D-Vt.) introduced a bill to reform the country's crime labs. In January, ProPublica and Frontline teamed up for a year-long investigation into the ways criminal autopsies are conducted across the country.

In North Carolina, the state legislature is considering reforms to that state's crime lab. The state attorney general commissioned a damning 2010 investigation that rocked North Carolina's crime lab. The Raleigh News and Observer follow-up report uncovered widespread corruption, hiding of exculpatory findings, and a pro-prosecution bias among crime lab workers. All of this comes on the heels of a congressionally commissioned 2009 report from the National Academy of Sciences that found expert witnesses in many areas of forensics routinely give testimony that good science doesn't back.

So the good news is that we are starting to see some skepticism, even some outrage, about the way forensic science is used in criminal cases. The bad news is that the solutions politicians and policy makers are proposing, while better than nothing, do not really address the primary problem. That problem is perverse incentives.

To be sure, there are other problems with the forensics system. For starters, scientists have not rigorously tested many forensic disciplines, such as hair and carpet-fiber analysis, blood spatter analysis, and especially bite mark analysis,. Even fingerprint analysis is not the sure thing it was once thought to be. Law enforcement agencies either invented many of these fields or honed and refined them. No researchers did peer reviews and the methods a carpet-fiber or ballistics analyst uses to produce a "match" are not blind. On the contrary, the analyst often knows the details of the crime and which sample implicates the suspect. When done this way, these analyses are not science, but they are often presented in court as if they were.

Some of the policies now under consideration at the state and federal levels could help with these problems. Leahy's bill would require any crime lab that receives federal funding to be accredited and to make sure all of its analysts are certified. (It isn't clear who would do the accrediting and certifying.) The bill would also provide funding for scientific research into the various forensic fields to establish best practices and standards and to ascertain the scientific validity and accuracy of those fields. The North Carolina legislature is considering a bill that would create an advisory panel to oversee the state crime lab. The bill also would make it a felony for a crime lab worker to willfully withhold exculpatory information. The fact that such misconduct is not already considered a crime speaks volumes.

These laws would help ensure that only forensics backed by science gets into the courtroom, and they would at least cut down on blatant corruption in crime labs. But the main problem driving nearly all the recent forensics scandals is a built-in bias in favor of winning convictions. In too many jurisdictions, medical examiners report to the attorney general or to the state official who oversees law enforcement. In states like Mississippi, where for most of the last 25 years prosecutors contracted criminal autopsies out to private doctors, the incentive for medical examiners was to produce results beneficial to the prosecutor's case. If they brought back results the prosecutor did not like, they risked losing future referrals. As I've reported during the last several years, that system produced the travesty of justice that was Steven Hayne, a physician who testified in thousands of cases despite serious questions about his qualifications, credibility and practices. But if it hadn't been Hayne, it would have been someone else.

Although states where medical examiners work directly for the state are better, incentive problems still exist. There is always pressure, blatant or implied, to deliver results the state needs to win a prosecution. That does not mean all or most or even a significant percentage of medical examiners are corrupt. But having a medical examiner and his staff ultimately report to the head of a law enforcement agency introduces subtle pressures that can influence even the most conscientious doctors.

The pressures can be even greater for serologists, ballistics experts, fingerprint analysts and other nonmedical forensic experts, many of whom are actually sworn law enforcement officers. In a 2008 paper (PDF) published by the Reason Foundation (which publishes Reason magazine and Reason.com), Roger Koppl, director of the Institute for Forensic Science Administration at Farleigh Dickinson University, explains the myriad ways in which unintentional bias can creep into an analyst's work.

In an article that appeared in the January 2002 California Law Review, for example, a research team Seton Hall law professor Michael Risinger led identified five stages of scientific analysis that can be corrupted by unintentional bias. They include how the analyst observes the initial data, how he records the data, how he makes calculations, and how he remembers and reinterprets his notes when preparing for trial. Koppl also cites a 2006 British study by researchers at the University of Southampton who found that the error rate of fingerprint analysts doubled when they were told the details of the case they were analyzing.

Establishing blue ribbon commissions, best standards and practices and various oversight boards won't do much to combat cognitive bias. It is not even clear these steps will prevent outright corruption. In Mississippi, professional groups such as the National Association of Medical Examiners (NAME) received numerous complaints about Steven Hayne, going back at least to the early 1990s. They did not act until 2009, despite the fact that Hayne routinely, flagrantly and admittedly violated NAME's guidelines. The North Carolina crime lab was accredited by the the American Society of Crime Laboratory Directors' Laboratory Accreditation Board, which failed to notice a litany of repeated violations.

Radley Balko is senior editor of Reason magazine where this column originally appeared. The JFP Daily features his column every Tuesday.