Technical transparency · 29 October 2026
FreeCVAudit accuracy benchmark
We tested a synthetic corpus of 40 CVs covering text-based PDFs, simple multi-column and table layouts, Word documents, raster scans and four languages. We publish the generation method, individual outcomes, missed issues and limitations.
Disclosure: This evaluation was conducted by FreeCVAudit, not commissioned or independently reviewed by a third party. Anyone can regenerate the synthetic examples and check them against the live tool. The full production analysis code is not publicly released, so an exact offline rerun requires access to that code.
Measurement run: · Free audit methodology
Measured results
40
Synthetic CV files
34/34
Seeded issues detected by a rule
32/34
Seeded issues visible to users
4/4
Image-only scans flagged (free audit)
0 seeded issue(s) missed by their specific detection rule; 2 additional seeded issue(s) triggered an internal rule but did not appear in the 3–4 visible findings. 0 file(s) produced extraction exceptions. 6 of 6 unseeded baseline CV(s) still received warnings. Baseline files are not professionally validated error-free CVs, so those warnings must not be described as measured false positives.
What was tested
- 18 generated text PDFs, including standard pages, simulated two-column text and table-like grid lines.
- 18 generated DOCX files, including standard paragraphs and Word tables.
- 4 raster-image-only PDFs containing no embedded selectable text.
- English, French, Arabic and Spanish examples, with controlled changes to contact details, CV sections, action verbs, numbers, bullets, length and repetitive wording.
What was not tested
- Actual employer ATS platforms, interview rates, job outcomes, or the probability of passing any ATS.
- Gemini OCR transcription fidelity for paid revisions. The production service can OCR low-text scans after payment, but no paid OCR call was made during this free-audit benchmark.
- Commercial or externally sourced CV documents, real photos, handwriting, watermarks or severely degraded scans.
- Word layout fidelity and visual accessibility beyond the extractor's text output. The synthetic PDF column and table cases do not establish performance on all complex CV layouts.
Reproduce the test
All samples are synthetic. Download the JavaScript generator and run it with Node.js to recreate the 40 PDF/DOCX files. The manifest identifies the deliberately injected issue in each file; the results JSON contains document hashes, extractor outcomes, issue detection and the findings actually displayed. To independently verify the live behavior, upload any fixture on the homepage and compare its free-audit findings to the corresponding row below. No payment is required for that check.
The automated benchmark runs with the application's production extractor and deterministic audit engine in the deployment build. Runtime, dependencies and source hashes are recorded in the JSON report. Generation does not access customer data.
Results for each CV
“Detected, not shown” means the seeded issue matched a production signal but did not rank among the audit's limited number of displayed findings. Download any sample to inspect it.
| File | Format / layout | Language | Deliberately seeded issue | Result | Extraction |
|---|---|---|---|---|---|
| p01.pdf | PDF · standard | en | No deliberately seeded issue | Baseline (not graded) | Text marker recovered |
| p02.pdf | PDF · standard | en | contact details | Shown in free audit | Text marker recovered |
| p03.pdf | PDF · standard | en | missing sections | Shown in free audit | Text marker recovered |
| p04.pdf | PDF · standard | en | duties not value | Shown in free audit | Text marker recovered |
| p05.pdf | PDF · standard | en | no quantification | Shown in free audit | Text marker recovered |
| p06.pdf | PDF · standard | en | bullet density | Shown in free audit | Text marker recovered |
| p07.pdf | PDF · standard | en | length imbalance | Shown in free audit | Text marker recovered |
| p08.pdf | PDF · standard | en | repetitive phrasing | Shown in free audit | Text marker recovered |
| p09.pdf | PDF · standard | en | No deliberately seeded issue | Baseline (not graded) | Text marker recovered |
| p10.pdf | PDF · standard | en | contact details | Shown in free audit | Text marker recovered |
| p11.pdf | PDF · two-columns | en | missing sections | Shown in free audit | Text marker recovered |
| p12.pdf | PDF · two-columns | en | duties not value | Shown in free audit | Text marker recovered |
| p13.pdf | PDF · two-columns | en | no quantification | Shown in free audit | Text marker recovered |
| p14.pdf | PDF · two-columns | en | bullet density | Shown in free audit | Text marker recovered |
| p15.pdf | PDF · table | en | length imbalance | Shown in free audit | Text marker recovered |
| p16.pdf | PDF · table | en | repetitive phrasing | Shown in free audit | Text marker recovered |
| p17.pdf | PDF · table | en | No deliberately seeded issue | Baseline (not graded) | Text marker recovered |
| p18.pdf | PDF · table | en | contact details | Shown in free audit | Text marker recovered |
| d01.docx | DOCX · standard | en | No deliberately seeded issue | Baseline (not graded) | Text marker recovered |
| d02.docx | DOCX · standard | en | contact details | Shown in free audit | Text marker recovered |
| d03.docx | DOCX · standard | en | missing sections | Shown in free audit | Text marker recovered |
| d04.docx | DOCX · table | en | duties not value | Shown in free audit | Text marker recovered |
| d05.docx | DOCX · standard | en | no quantification | Shown in free audit | Text marker recovered |
| d06.docx | DOCX · standard | en | bullet density | Shown in free audit | Text marker recovered |
| d07.docx | DOCX · standard | en | length imbalance | Shown in free audit | Text marker recovered |
| d08.docx | DOCX · table | en | repetitive phrasing | Shown in free audit | Text marker recovered |
| d09.docx | DOCX · standard | fr | No deliberately seeded issue | Baseline (not graded) | Text marker recovered |
| d10.docx | DOCX · standard | fr | contact details | Shown in free audit | Text marker recovered |
| d11.docx | DOCX · standard | fr | missing sections | Shown in free audit | Text marker recovered |
| d12.docx | DOCX · table | fr | duties not value | Shown in free audit | Text marker recovered |
| d13.docx | DOCX · standard | ar | no quantification | Detected, not shown | Text marker recovered |
| d14.docx | DOCX · standard | ar | bullet density | Detected, not shown | Text marker recovered |
| d15.docx | DOCX · standard | ar | length imbalance | Shown in free audit | Text marker recovered |
| d16.docx | DOCX · table | ar | repetitive phrasing | Shown in free audit | Text marker recovered |
| d17.docx | DOCX · standard | es | No deliberately seeded issue | Baseline (not graded) | Text marker recovered |
| d18.docx | DOCX · standard | es | contact details | Shown in free audit | Text marker recovered |
| s01.pdf | Scanned PDF · raster | en | image only | Shown in free audit | Image-only warning |
| s02.pdf | Scanned PDF · raster | en | image only | Shown in free audit | Image-only warning |
| s03.pdf | Scanned PDF · raster | en | image only | Shown in free audit | Image-only warning |
| s04.pdf | Scanned PDF · raster | en | image only | Shown in free audit | Image-only warning |
Interpretation and limitations
Each sample has one controlled target alteration or no deliberately planted issue. The detection measurement tests whether the corresponding rule fires; the visible measurement tests whether it is among the three or four highest-priority findings shown to the user. This is not comprehensive human annotation, and the measured ratio is not general CV-audit accuracy, sensitivity, specificity or an ATS pass rate.
The free tool analyses extracted text, not PDF visual geometry. It cannot verify visual reading order, hidden text, tables reconstructed incorrectly, or a particular recruitment platform's interpretation. English and French section patterns are better represented in the current heuristics than Arabic or Spanish; a multilingual document can be misclassified. Internal diagnostic scores are capped and do not represent calibrated probabilities of recruitment success.
For scanned documents, the free audit reports the absence of text. Following payment, the separate Gemini-powered workflow can transcribe the scan before generating a revised CV. That capability should not be confused with the free audit's scan detection, and its accuracy requires a separate verified evaluation with transcription-level ground truth. No OCR accuracy percentage is claimed here.
Benchmark operator: FreeCVAudit.com · synthetic input set · version 2026-10-29. Report a discrepancy or request a re-test.