Kill Log

Teardown 1 of 3. Published from pilot files dated 2026-11-19 (Asia/Seoul).

A validator passed 20 of 20 PDFs. Only 8 were usable.

The idea: public bodies must make documents accessible, so an automated pipeline could fix PDFs at a price under human vendors. We built the pipeline from free tools and ran it on real government and school PDFs.

Verdict: killedStrict pass rate 40% of documents (47% of pages) against a kill line of 50%. Estimated human time 12.5 minutes per page against a kill line of 8.

Why this idea looked good

The US Department of Justice sets web and mobile accessibility deadlines for state and local governments. On ada.gov the compliance dates are April 26, 2027 for entities with a population of 50,000 or more, and April 26, 2028 for smaller ones and special districts. The same page exempts older PDFs that were posted before the deadline, unless they are used to apply for or use a service. That shrinks the market to new documents and forms.

Visible prices from vendors: ClearLayer from $6 per page, Allyant at $5 to $8 per page (Syracuse University page), and an automated vendor, CASO Comply, from $0.30 per page.

The pipeline

PyMuPDF extracts structure, RapidOCR reads scanned pages, python-docx builds a structured document, LibreOffice exports a tagged PDF, pikepdf fixes metadata and annotations, and veraPDF 1.28.2 checks the PDF/UA-1 profile. All free. PAC, the other common checker, runs only on Windows and was not used.

Round 1: six samples, 15 pages

Round 2: 20 real public PDFs, 110 pages

We took the first 8 pages of each document. Sources: IRS forms (W-4, 8822, 4506-T, 2848, 4868) and Publication 15-T, a USCIS I-9, the federal voter registration form, the Federal Register copy of the ADA rule, three NIST special publications, two enrolled bills from govinfo, four city, county and school board documents, and two scanned USGS reports from 1885 and 1974. A GAO site blocked our download, so those were left out and not worked around.

We defined pass strictly: veraPDF passes, and word and number recall are each at least 98%, and every original input field is restored (signature and button fields excluded), and reading order similarity is at least 0.90.

GroupDocsStrict passPagesEst. human min/page
Forms702736.2
Simple text and scans53234.9
Long multi-column reports42324.8
Tables and meeting packets43284.9
All208 (40%)11012.5

Where the market comparison breaks

At $30 per hour (an assumption) 4.9 minutes per page costs about $2.45, which sits between the $0.30 automated vendor and the $5 to $8 human vendors with no clear reason for a buyer to pick us. Forms cost about $18 per page to fix by this estimate, against ClearLayer's listed $12 per page for complex tables and forms. The business turned into hourly labour.

Limits of this test

Only the first 8 pages of long documents were processed. Human minutes are computed from a formula (2 minutes of review per page, 0.75 per image, 3 per table, 4 per scanned page, plus extra for failed content, reading order and forms), not timed with a person. No screen reader or PAC check was run. Reading order similarity is a rough word-sequence comparison. Images got placeholder text, so 57 images in one budget packet still need real descriptions. OCR accuracy on the scans could not be scored without a ground-truth text. The Federal Register copy of the rule that we processed lists April 24, 2026 and April 26, 2027 as dates, which differ from the dates on ada.gov; we did not trace why.

Files

Per-document results (CSV).

Next teardown

There is no email signup yet. Follow new teardowns with the Atom feed.