Leaking private PDFs (or client files) to an online Ai is bad. Luckily the offline Ai's can run locally without sharing your private info to the Internet. But they're much dumber. We wanted to know how well the best local Ai engines can handle redacting PDFs. So we launched a bake-off competition: Cover vs local Ai engines. See what we're learning with each bake-off competition below.
When a local Ai buries your PDFs in over-redactions, you're stuck. There's no quick way to correct its errors. Cover is the opposite: Hold ⌥ Option and drag across any redactions you want removed.
Cover's automatic engine is fast and clean. And it's edit tool allows you to quickly touch up anything missed.
Adobe Acrobat and Preview don't have a smart redaction engine to do 80% of the work for you. And local LLM Ai engines don't have a way to touch up the mess they make over-redacting regular words in your PDF. Imagine removing 78 extra redactions by Gemma, the best performing LLM!
| Engine | Personal info caught | Wrongly hidden | Median time / PDF |
|---|---|---|---|
| Cover | 98% | 26 | 6.7s |
| Gemma 4 12B Google | 95% | 123 | 30s |
| Qwen 3 Alibaba | 82% | 182 | 4.5m |
| Phi-4 Microsoft | 81% | 150 | 37s |
| Gemma 3 Google | 78% | 692 | 24s |
| Qwen 2.5 Alibaba | 73% | 163 | 23s |
| DeepSeek R1 14B DeepSeek | 73% | 122 | 4.2m |
| Privacy Filter OpenAI | 72% | 711 | 13s |
| Llama 3.1 Meta | 72% | 271 | 23s |
| Privacy Filter Nemotron OpenMed | 64% | 1297 | 4.4s |
| Apple on-device Apple | 20% | 717 | 1.1m |
| Cover | Preview | Acrobat | |
|---|---|---|---|
| Finds personal info on its own | ✓ | ✗ | Partial |
| Zero setup, no checkboxes | ✓ | N/A | ✗ |
| Works without the internet | ✓ | ✓ | Partial |
| Click a word to redact it | ✓ | ✗ | ✗ |
| Click a redaction to remove it | ✓ | ✗ | ✗ |
| Remove a whole group of redactions at once | ✓ | ✗ | ✗ |
| Un-redact whole pages at once | ✓ | ✗ | ✗ |
| Works on scans and photos | ✓ | ✗ | ✓ |
| Handles a whole folder | ✓ | ✗ | ✓ |
| Output still usable when shared | ✓ | ✓ | ✓ |
| Verifies removed info is really gone before saving | ✓ | ✗ | ✗ |
| Redaction certificate & log with every save | ✓ | ✗ | ✗ |
| Price | $99/yr | Free | $23.99/mo |
Preview and Acrobat never read the document for you. Everything they hide, you found by hand. And neither one checks its own work: Cover re-reads the finished file and confirms the removed text is actually gone, byte by byte, or it refuses to save. Every row here is in every Cover plan.
Last updated July 18, 2026 · Cover v0.16.6. Every engine redacted the same 15 real-world documents. Real PDFs, scored against a gold standard. Cover has the best automatic engine in the field, doesn't leave you with a mess of 123+ over-redactions to clean-up and is blistering fast.
Sent setup tips to your inbox too.
Opening checkout with your email filled in.