proadn.com

How DNA became evidence: the method, the record, and the limits of a profile.

The Record/Entry 3.05/One technique, and what it can and cannot carry

The 2016 review

A national review examined which forensic methods had been validated and which had not.

FIG. 01A printed report open at a page of numbered findings, desk lamp
A national review examined which forensic methods had been validated and which had not.

A presidential science council found that DNA profiling stood on solid ground — and that most other forensic disciplines did not.

A records room of bound case files on metal shelving, fluorescent light
The record is paper: bound case files, retained exhibits, and the reviews that reopened them.

What the council found

In September 2016, the President's Council of Advisors on Science and Technology released a report titled Forensic Science in Criminal Courts: Ensuring Scientific Validity of Feature-Comparison Methods. The council — scientists, not practitioners — examined whether the forensic disciplines routinely admitted as evidence had been properly validated. The answer, for most of them, was no.

Bite-mark analysis, footwear comparison, and hair microscopy all failed the council's test for foundational validity. The report did not find that these methods were always wrong; it found that the research establishing their error rates, reproducibility, and reliability under realistic conditions had never been done ↗. That absence of evidence, the council argued, should matter to courts deciding what to admit.

CROSS-REFA university laboratory corridor with doors and noticeboards, institutional light
The first exoneration — The technique's first use in a criminal investigation cleared a man who had already confessed, which is the reason it was trusted afterwards. Read the entry

DNA profiling occupied a different category. Single-source profiles and simple two-person mixtures, the council concluded, met the standard for foundational validity: the underlying biology is understood, the chemistry has been independently replicated, error rates can be measured, and NIST ↗ maintains the reference data behind the core loci. That endorsement was not unconditional. The report drew a firm line at complex mixtures — three or more contributors, or low-template samples — where it found that probabilistic genotyping software had not yet been sufficiently validated for the full range of conditions in which it was being used.

The distinction matters because courts had been admitting complex-mixture interpretations on the strength of DNA's broader reputation, rather than on evidence that the specific computational methods applied to those samples had been tested. The council's position was that the reputation of the technique and the validity of a particular application of it are two separate questions.

SWGDAM and the broader forensic science community pushed back on parts of the report, arguing that the council had set a validation standard higher than was workable in practice. That disagreement has not been fully resolved. What the 2016 review did establish, beyond argument, is a framework: foundational validity first, applied validity second, and the burden of demonstrating both sits with the proponent of the evidence, not with the defence attempting to challenge it.

From the register

The core distinction

Foundational validity
whether a method's scientific basis has been independently established at all
Applied validity
whether a specific technique, as actually used, has been tested under realistic conditions
Simple profiles
found to meet foundational validity in the 2016 review
Complex mixtures
flagged as insufficiently validated for the full range of casework applications

Related entries