Sensitive Questions · Reliability guide
How to Check an AI Answer Before You Act on It
Verify the claim that could change your decision first. Trace it to a primary source, check the date and scope, and reproduce any calculation.
Direct answer
The short answer
To check an AI answer, extract its factual claims, rank them by the harm of being wrong, and verify the most consequential claim against a primary or authoritative source. Check the date, jurisdiction, definitions, and assumptions; reproduce calculations; and confirm that every citation supports the exact sentence.
This guide is for checking ordinary AI answers before you rely on them. It is not a substitute for a clinician, lawyer, accountant, engineer, or other qualified professional who can examine the evidence and accept responsibility for high-stakes advice.
Not every sentence deserves the same effort. A fictional name suggestion and a medication interaction do not carry the same consequence. Verification should be proportional to risk, recency, reversibility, and how much the claim affects your decision.
Triage
Verify by consequence, not by paragraph order
Highlight the smallest claim that would change what you do. “This contract can be cancelled within 14 days” matters more than the answer’s general explanation of consumer rights. “The recommended dose is safe with your medication” matters more than the surrounding description of side effects.
- High consequenceHealth, law, money, safety, security, reputation, and irreversible actions require independent expert or authoritative confirmation.
- Time sensitivePrices, policies, officeholders, software behavior, schedules, and regulations may have changed after the model’s knowledge or source date.
- Precision dependentExact numbers, units, quotations, citations, and eligibility rules are easy to state plausibly and easy to get subtly wrong.
- Low consequenceBrainstorming, wording options, and fictional ideation can be evaluated mainly by usefulness—unless they introduce factual claims.
Checklist
A seven-step AI answer verification checklist
- Extract the claimsSeparate checkable facts from advice, opinion, assumptions, and generated examples.
- Rank the riskIdentify which error would most change the decision or harm someone.
- Choose the right authorityUse the law or regulator for rules, official product documentation for features, and original research for study findings.
- Check scope and dateConfirm country, population, product version, plan, model, and publication or update date.
- Trace the exact supportFind the sentence, table, dataset, or rule that supports the claim. Topic similarity is not evidence.
- Reproduce the resultFor numbers, write down inputs, units, formula, assumptions, and rounding. Recalculate independently.
- Record uncertaintyNote conflicting sources, missing evidence, and what additional fact would change the conclusion.
Source matching
What to check for different kinds of claims
- Medical: official public-health guidance, drug labeling, clinical guidelines, and a qualified clinician who knows the person’s history.
- Legal: current statutes, regulations, court or agency sources, correct jurisdiction, and a qualified lawyer for application to facts.
- Product: current official documentation, pricing, status pages, release notes, and the exact plan or version.
- Scientific: the original paper, methods, sample, outcome measured, limitations, retractions or corrections, and later evidence.
- Current event: event date rather than only publication date, direct statements or records, and multiple independent reports when facts remain disputed.
- Quotation: the original transcript or document, exact wording, speaker, date, and surrounding context.
An answer that links to a source is easier to audit, but a link alone does not establish support. Open it. A hallucinated citation may have an invented title, while a subtler failure uses a real source that never makes the claimed assertion.
Use the model carefully
Ask AI to expose uncertainty—not to certify itself
“List the factual claims in your answer. For each, state the assumption, date sensitivity, relevant jurisdiction or product version, and the best primary source type. Quote nothing you cannot trace. Mark any claim you cannot verify as uncertain.”
This prompt can reveal what needs checking, but it does not perform independent verification. Follow the links, inspect the originals, and reproduce important calculations outside the model. If the issue is high stakes, take both the question and the source material to a qualified person.
Good verification does not mean proving every sentence true. It means knowing which claims are supported, which remain uncertain, and whether the remaining uncertainty is acceptable for the decision you are about to make.
Ask a follow-up
Turn an answer into a verification plan
Paste only the non-sensitive claim you need to check. Ask for assumptions, source types, dates, and a reproducible calculation—not a second confident guess.
Need a place to start?
FAQ
Questions about this topic
Sources
Sources and references
- Why language models hallucinateOpenAI
- AI Risk Management Framework Playbook: MeasureNational Institute of Standards and Technology
- Artificial Intelligence Risk Management Framework (AI RMF 1.0)National Institute of Standards and Technology
Editorial note
How this guide is maintained
The SayAll Product Team reviews product-specific statements against the current application and dates the latest check. Category guidance is educational rather than a promise that every model response will behave in a particular way.
Found an error or a product fact that changed? Email support@sayall.ai.