LLM Citation Fact Fetcher

Catch hallucinated sources. Fetch every citation URL, verify every quoted snippet actually appears in the source, return a trust score 0-1.

URL-200 + Body-Match

Doesn't just check the URL is reachable. Fetches the page, normalizes the text, and verifies the quote is there.

Fuzzy Snippet Match

Exact substring + token-overlap sliding window. Tolerates LLM paraphrase and punctuation drift.

Hallucination Score

0-1 per citation, aggregate 0-1 per answer. Cut LLM responses at threshold = 0.6. Surface red dots in UI.

Edge-Speed Fetch

Concurrent fetch from Cloudflare's edge. 6s timeout per URL. 2.5MB body cap. Sub-2s for 8-citation answers.

curl -X POST https://api.lazy-mac.com/llm-citation-fact-fetcher/check \ -H "content-type: application/json" \ -d '{"citations":[{"url":"https://en.wikipedia.org/wiki/Cloudflare","quote":"founded in 2009"}]}'
View OpenAPI Spec