Deep Researcher: Reports Where Every Claim Cites a Verified Quote
AI products · Creator, sole engineer · prototype
Ask a question, get a report where every claim points at a quote that really exists in a source.
The detail
A report can look well cited while the sources say something else. This engine keeps the evidence attached to each claim from retrieval to the final page, and stops when it cannot back something up.
A planner splits the question into bounded workstreams, searches iteratively, and extracts full pages and PDFs. A claim ledger stores each claim with its source, quoted passage, document location and a provenance hash. Checkpoints in SQLite, cancel and restart, live progress events, a REST API, a dashboard and a CLI.
Two gates, not one: the quote must exist verbatim in the retrieved text, and the claim must be supported by that quote in context. Passages are picked for relevance to the sub-question instead of truncating documents from the top. When an evidence gate fails, the pipeline stops and keeps the rejected material for inspection rather than papering over it.
Tests exercise evidence persistence, fabricated-quote rejection, passage selection and PDF extraction with controlled fixtures.
Python, FastAPI, Pydantic, SQLite, HTTPX, pytest.
What I did
- Designed a claim ledger linking every claim to source, quoted passage, location and provenance hash
- Built two evidence gates: verbatim quote existence and claim support in context
- Built the planner, iterative search and full-page and PDF extraction
- Added SQLite checkpoints, cancel and restart, live progress, a REST API, a dashboard and a CLI
- Wrote tests for fabricated-quote rejection, passage selection and PDF extraction
Stack
Python, FastAPI, Pydantic, SQLite, HTTPX, pytest, AI Agent Development, Retrieval-Augmented Generation, Hallucination Mitigation, Document Processing
Case study: https://www.siddhvasudev.com/projects/deep-researcher-reports-where-every-claim