Guide

A real citation can still support the wrong claim

Audit a short AI-generated answer at the claim, passage and source-family levels. A working link is only the beginning.

4 min estimated readStart hereEvidence baseline

THE SHORT ANSWER

Check what a source supports, not just whether the source exists.

Why it matters

An answer may cite the right paper while enlarging its conclusion, omitting a condition or treating a preliminary result as settled. Another common problem is apparent consensus: several articles can all repeat one announcement. More links do not necessarily mean more independent evidence.

Read the evidence

ALCE, first submitted in May 2023 and revised that October, evaluates factual correctness and citation quality separately. The C2PA 2.3 explainer makes a related but narrower distinction for media: provenance alone cannot establish factual truth. Together they motivate a careful separation between traceability and support; neither validates a specific answer for us.

How to use this resource

Take one paragraph and create a three-column review: claim, supporting passage, remaining limit. The following is a proposed manual process, not a newly validated scoring system.

  • Split sentences that contain more than one factual claim.
  • Open the original source and find the passage that actually supports each claim.
  • Check the population, date, version, conditions and strength of the wording.
  • Mark support as complete, partial, absent or contradicted.
  • Group sources that depend on the same announcement or dataset, then seek a genuinely independent check.

Limits and evidence

This checklist helps expose unsupported writing but does not guarantee truth or replace specialist review. The linked research concerns its own tasks and models. CooScope has not measured a current citation error rate, and no private collection or third-party article is reproduced here.

Put it to work.

  • Find a passage, not just a link.
  • Preserve the original scope and date.
  • Count independent source families.
  • Rewrite or remove unsupported claims.

Go to the source.

Original material, with its own scope and publication date. This note is an explanation, not a CooScope performance test.

  1. Gao et al. — Enabling LLMs to Generate Text with Citations (2023; revised 31 October)Link / source review: 2026-10-04
  2. C2PA — Content Credentials Explainer, version 2.3Link / source review: 2026-10-04
Evidence baseline and source-review dates are different. A recent link check does not make an older study a current product test. Read our method →

Keep the thread going.

Explore this topic →