Cover vs the best local Ai engines
Leaking private PDFs (or client files) to an online Ai is bad. Luckily the offline Ai's can run locally without sharing your private info to the Internet. But they're much dumber. We wanted to know how well the best local Ai engines can handle redacting PDFs. So we launched a bake-off competition: Cover vs local Ai engines. See what we're learning with each bake-off competition below.
Local LLM Ai over-redacts. Cover auto redact properly & offers 1-click redaction edits.
When a local Ai buries your PDFs in over-redactions, you're stuck. There's no quick way to correct its errors. Cover is the opposite: Hold ⌥ Option and drag across any redactions you want removed.
The full bake-off data proof
Cover's automatic engine is fast and clean. And it's edit tool allows you to quickly touch up anything missed.
Adobe Acrobat and Preview don't have a smart redaction engine to do 80% of the work for you. And local LLM Ai engines don't have a way to touch up the mess they make over-redacting regular words in your PDF. Imagine removing 78 extra redactions by Gemma, the best performing LLM!
| Engine | Personal info caught | Wrongly hidden | Avg time / PDF |
|---|---|---|---|
| Cover | 91% | 22 | 11s |
| Gemma 4 12B Google | 90% | 79 | 1.4m |
| qwen3 | 85% | 131 | 7.8m |
| gemma4_31b-it-q4_k_m | 84% | 55 | 15.6m |
| gemma4_31b-nvfp4 | 78% | 53 | 16.9m |
| Gemma 3 Google | 78% | 724 | 48s |
| Phi-4 Microsoft | 70% | 71 | 1.3m |
| Qwen 2.5 Alibaba | 68% | 157 | 50s |
| Llama 3.1 Meta | 59% | 228 | 46s |
| openmed-privacy-filter-nemotron | 57% | 1061 | 14s |
| openai-privacy-filter | 37% | 267 | 32s |
| Cover | Preview | Acrobat | |
|---|---|---|---|
| Finds personal info on its own | ✓ | ✗ | Partial |
| Zero setup, no checkboxes | ✓ | N/A | ✗ |
| Works without the internet | ✓ | ✓ | Partial |
| Click a word to redact it | ✓ | ✗ | ✗ |
| Click a redaction to remove it | ✓ | ✗ | ✗ |
| Remove a whole group of redactions at once | ✓ | ✗ | ✗ |
| Un-redact whole pages at once | ✓ | ✗ | ✗ |
| Works on scans and photos | ✓ | ✗ | ✓ |
| Handles a whole folder | ✓ | ✗ | ✓ |
| Output still usable when shared | ✓ | ✓ | ✓ |
| Price | $39 once | Free | $23.99/mo |
Preview and Acrobat never read the document for you. Everything they hide, you found by hand.
Last updated July 7, 2026 · Cover v0.15.1. Every engine redacted the same 15 real-world documents. Real PDFs, scored against a gold standard. Cover has the #2 best automatic engine, doesn't leave you with a mess of 78+ over-redactions to clean-up and is blistering fast.