Who Hallucinates More: ChatGPT or Claude?

The available evidence gives no overall hallucination winner between ChatGPT and Claude. Compare specific model versions on the same task and scoring rule. A source consistency test checks whether an answer stays within supplied material, a factual recall test checks answers without supplied sources, and a domain rubric checks performance on a specialized task.

Written by MCP Scraper
Published · Updated ·14 min read
Two answer documents are checked against the same source, with unverified statements highlighted equally.
Editorial schematic; illustrates the article concept rather than a verified product result.
01

AI hallucination and confabulation.

AI hallucination means plausible false or unsupported generated content. This guide uses confabulation for plausible invented detail, while each benchmark retains its own definition.

Terminology

Name the failure you can check.

For a fabricated citation, check whether the cited work exists. For a disputed date, inspect the original record. For a summary, compare each material claim with its source passage. These checks examine observable errors without assuming a particular internal training cause. See how the benchmark results differ.

what is AI hallucination

AI hallucination is plausible generated content that is false or unsupported, such as an invented citation or an incorrect date. Fluent wording can make an error difficult to notice. Check the factual claim against evidence and record whether the model answered, declined or expressed uncertainty. Those outcomes tell you more about a research workflow than confidence of presentation alone.

why do AI chatbots hallucinate

Language models can hallucinate because predicting plausible text does not ensure that every generated statement is true. Rare or arbitrary facts may be difficult to infer from training patterns. Training and evaluation can also reward guessing when an unanswered question receives no credit. Supplying relevant documents changes the available evidence, but the generated answer still needs to be checked against them.

what is confabulation in AI

Confabulation is used here to describe plausible invented detail that fills a gap in an AI-generated answer. An invented paper title assembled from credible-looking author and journal names illustrates the pattern. This descriptive label does not identify the model's internal cause or establish a clinical analogy. Verify that the cited work exists and that it supports the claim.

what is the difference between AI hallucination and confabulation

In this guide, hallucination names false or unsupported generated content, while confabulation emphasizes plausible fabrication. These labels can overlap, and their use varies across discussions. A wrong date alone does not reveal whether an error came from training data, inference or another stage. Choose a check for the actual failure, such as citation existence, source consistency or missing evidence, rather than assuming a particular training fix from the label.

are AI hallucinations the same as lying

An AI-generated factual error alone does not establish deliberate lying. A hallucination describes the relationship between the answer and the evidence. A claim about deception additionally concerns intent or behavior that this factual comparison does not measure. For a research review, identify the unsupported statement, locate the relevant evidence and correct or withhold the claim.

why does ChatGPT make things up

ChatGPT can produce plausible details when its generated answer is insufficiently grounded in reliable evidence. Next-word prediction and incentives that reward guessing help explain why this failure can persist. An explanation of training incentives does not establish the cause of every error or an opposite training signal for Claude. Ask for the evidence behind a specific claim and inspect it before use.

Reference: openai.com

02

Reading hallucination benchmarks.

Compare exact model versions under a defined task and scoring rule. The evidence here separates source consistency, factual recall and health-response rubrics.

Benchmark scope

Match the task, version and denominator.

Read whether tools or source documents were provided and how the evaluation treats wrong answers and abstentions. A score from one setup does not establish the behavior of every product mode or a permanent vendor ranking.

who hallucinates more ChatGPT or Claude

A ChatGPT-versus-Claude hallucination winner requires a defined task and matched model comparison. A useful comparison fixes the exact model versions, task, prompt, tool access and scoring rule. Evaluate both systems on the same representative questions and record correct answers, wrong answers and abstentions, meaning cases where the model declines to supply an answer. Keep source-supported summarization separate from factual recall without tools.

Reference: openai.com

does Claude hallucinate less than ChatGPT

Claude does not score lower in every measured setting. A November 7, 2026 capture of Vectara’s leaderboard reports a hallucination rate of 5.6% for openai/gpt-4.1-2025-04-14 and 10.6% for anthropic/claude-sonnet-4-6 in its supplied-document summarization evaluation. Vectara used HHEM-2.3 to check summaries against their source articles. The private input dataset contained over 7,700 articles. After filtering refusals and unusable answers, Vectara scored only documents every evaluated model summarized. The linked README gives the input corpus size. It does not report an exact count for the scored subset. The table reports a separate 99.9% answer rate for each of these two models. Use the linked revision to check the exact rows. Those figures apply to the tested model versions and summarization task.

Reference: github.com

which AI is more accurate ChatGPT or Claude

Which system is more accurate depends on the exact task and definition of accuracy. For factual questions, distinguish the fraction of all questions answered correctly from the error rate and the rate of declining to answer. For summarization, check whether the output preserves the supplied document's facts. Compare the same metric under matched conditions before choosing a model for a research workflow.

Reference: openai.com

what is the hallucination rate of ChatGPT in 2026

There is no single verified rate here that describes every ChatGPT interaction in 2026. A dated example shows why the model and protocol matter. OpenAI's September 5, 2025 discussion reports a 26% error rate and 52% abstention rate, meaning no specific answer was supplied, for gpt-5-thinking-mini on the cited SimpleQA factual-question evaluation. Those are separate outcomes for that historical setup, not a rate for every ChatGPT product mode or a forecast for your prompts.

Reference: openai.com

what is the hallucination rate of Claude in 2026

A Claude rate must be tied to a named version, evaluation and denominator. The November 2025 AA-Omniscience v1 paper reports 36% accuracy and an Omniscience Index of 4.8 for Claude 4.1 Opus on its 6,000-question, no-tool factual-recall evaluation. The prompt encouraged abstention when uncertain. The Omniscience Index rewards correct answers and penalizes incorrect guesses while accounting for abstention, meaning a declined answer. Accuracy and the Index are different metrics, and the reported model still gave wrong answers. Neither value means zero hallucinations across Claude use.

Reference: arxiv.org

which AI has the lowest hallucination rate in 2026

A lowest hallucination score can be named only within a specified benchmark table and dated model set. A source-consistency leaderboard cannot supply a universal lowest-rate model for every task in 2026. Select a benchmark that resembles your task, check which exact model rows were evaluated and read how the evaluator treats refusals. Then test the shortlisted models on the evidence and outputs your own workflow requires.

Reference: openai.com

how is AI hallucination measured

Hallucination measurements compare answers with a reference, but the reference and scoring rule differ by evaluation. Source-consistency tests compare a summary with its input document. Factual-recall tests assess answers to questions without supplying the source. Rubric evaluations assess whether responses satisfy specified criteria. Record the task, model, date, denominator and treatment of abstentions before comparing percentages across these types.

Reference: openai.com

03

Claude’s training and uncertainty.

Constitutional AI uses critiques, revisions and AI feedback in training. Factual reliability and uncertainty require model-specific, task-specific evaluation.

Training evidence

A method description is not a causal comparison.

Constitutional AI describes critique, revision and AI feedback in training. Claims that this method gives every Claude model better uncertainty calibration than every ChatGPT model require a matched experiment that isolates the training change.

what is Constitutional AI and does it reduce hallucinations

Constitutional AI is a training approach that uses stated principles, model-generated critiques and revisions, and AI feedback. The original research describes training a harmless, non-evasive assistant. That method description alone cannot quantify factual-error reduction for a particular Claude version. To evaluate factual reliability, examine the named model's task results and error definitions separately from this description of its training method.

Reference: www.anthropic.com

why does Claude hallucinate less than ChatGPT

A lower error score for a Claude version does not by itself explain why that version scored lower. Establishing a training cause would require an experiment that isolates the relevant change while holding other conditions fixed. A training-method description and an independently run factual-recall benchmark do not isolate that cause. Compare the observed errors and abstentions without attributing the difference to a universal Claude-versus-ChatGPT training contrast.

Reference: www.anthropic.com

why does Claude say I don't know more than ChatGPT

Whether Claude says 'I don't know' more often requires a matched comparison of exact model versions and prompts. Count how often each system answers, declines to answer or asks for clarification on the same questions. A higher abstention rate can reduce attempted answers, but it does not show that every refusal identifies a genuine knowledge gap. Inspect both useful coverage and wrong answers before changing the workflow.

why does Claude admit uncertainty more than ChatGPT

More expressions of uncertainty establish better calibration only if they correspond to observed accuracy. Calibration means how well expressed confidence matches correctness. Check confident answers and uncertain answers against references under the same task conditions. A universal claim about which product gives more reliable uncertainty signals requires evidence beyond how confidently either answer is phrased.

does Claude refuse to answer questions it doesn't know

Claude can decline to answer, but it can also answer incorrectly. Treat a non-answer as a workflow state to inspect. If the required evidence is missing, collect another source or route the question for review. Measure abstentions alongside correct and incorrect responses for the exact configuration. A refusal alone does not establish safety for medical, legal or compliance work.

Reference: arxiv.org

04

Checking consequential AI claims.

Check consequential AI claims against the original record and the specific context in which the answer will be used. Keep model, date, task and scoring conditions with any benchmark figure.

Source checks

Agreement between answers still needs evidence.

Several AI answers repeating a claim do not by themselves establish that the claim is true. Find the underlying record and inspect the relevant passage. A claim about cross-model error correlation additionally needs a study that measures it.

what are examples of ChatGPT hallucinations

A documented example is the submission of nonexistent ChatGPT-generated judicial opinions in Mata v. Avianca. The opening of the court's June 22, 2023 opinion describes fake quotations and citations as well as continued reliance after their existence was questioned. Invented paper titles or dates are other examples of the type of error to check, without a claimed incidence rate here. A plausible format is insufficient evidence that a cited work exists.

Reference: www.nhd.uscourts.gov

has ChatGPT hallucinated in court

Yes. The June 22, 2023 Mata v. Avianca opinion describes nonexistent judicial opinions created by ChatGPT being submitted to a federal court. The opening pages also describe the respondents continuing to stand by the opinions after court orders questioned them.

Reference: www.nhd.uscourts.gov

did ChatGPT make up fake legal cases

Yes. The Mata v. Avianca opinion states that submitted judicial opinions contained fake quotations and citations created by ChatGPT. To check a generated legal citation, locate the actual opinion and compare the court, parties, citation and quoted passage. A citation that looks conventionally formatted has not passed that check.

Reference: www.nhd.uscourts.gov

what happened in the Mata v. Avianca ChatGPT hallucination case

The Mata v. Avianca court imposed sanctions after nonexistent ChatGPT-generated opinions were submitted and defended. In the opening of its June 22, 2023 opinion, the court identifies bad faith based on conscious avoidance and false or misleading statements. It also states that sanctions would be imposed on the individual respondents and jointly on the firm.

Reference: www.nhd.uscourts.gov

can ChatGPT hallucinate medical information

AI-generated medical information can contain errors and requires checks appropriate to its intended use. OpenAI's 2025 HealthBench uses 5,000 conversations with physician-written weighted rubrics. Its Consensus subset contains 3,671 examples and reports a separate error measure. Those scores do not supply a universal ChatGPT medical-hallucination rate. Match any claimed improvement to the exact model, rubric subset and evaluation configuration.

Reference: openai.com

does ChatGPT hallucinate more on academic citations

An academic-citation error rate can be compared with general-text errors only under a defined evaluation. Evaluating that claim would require matched tasks and a defined denominator. For an individual reference, verify the title, authors, publication details and identifier in the actual publication record. Then read the cited passage. A working DOI or URL proves less than confirmation that the paper supports the generated statement.

05

Choosing a model and checking its answers.

Define the cost of wrong answers and missing answers, then test the exact configuration on representative work. Preserve the evidence behind an answer before reusing it.

Research inputs

Inspect what the collection actually returned.

For a research task, collect the relevant pages, check source identity and coverage, and compare the generated claim with the cited passage. Search results can help locate evidence, while the page content supports the check. A successful collection alone does not establish a correct conclusion. Try the recorded search and extraction example. If you have only the snippet, the freshness condition is missing evidence. If the model receives the extracted passage and drops the condition, flag its summary for correction. Preserve the publisher’s qualification in the brief and leave actual API freshness unmeasured.

how do you stop ChatGPT from hallucinating

Build checks around ChatGPT's answers instead of assuming one prompt will prevent every hallucination. Define the claim and acceptable sources, supply relevant evidence, allow abstention when evidence is missing, and inspect the generated result before reuse. Record unsupported claims and incomplete outputs. These are evaluation and verification steps, not a measured ranking of interventions for every model or task.

how to reduce AI hallucinations with prompt engineering

Use prompt instructions as testable constraints, then measure whether they improve your actual outputs. Specify the allowed sources, request supporting passages and ask the model to identify missing evidence rather than fill gaps. Compare results against checked references and include unsuccessful runs. Claim a measured reduction only after testing the prompts on the actual model and task, including cases with missing evidence.

does asking ChatGPT to cite sources reduce hallucinations

A request for citations can make an answer easier to inspect, but the citations still need verification. Check whether each URL or identifier resolves to the intended work and whether the cited passage supports the claim. Keep failed links, irrelevant sources and unsupported statements visible in the review. Measure any error reduction on the actual model and task before relying on citation instructions as a control. For example, suppose a generated brief claims GPT-4.1 hallucinates in 5.6% of chats. Open the pinned benchmark and exact model row. The figure applies to the supplied-document summaries Vectara scored for openai/gpt-4.1-2025-04-14. Rewrite the claim with that scope and retain the source URL, model row and test task.

what is retrieval-augmented generation and does it stop hallucinations

Retrieval-augmented generation, or RAG, supplies retrieved documents as context for a model's answer. The workflow can make source material available for checking, but retrieval may miss the relevant passage and the generated text may still depart from the source. Evaluate retrieval relevance and answer consistency separately. Source-consistency testing can expose unsupported statements even when a document was supplied to the model.

which AI is more trustworthy ChatGPT or Claude

Trust ChatGPT or Claude according to evidence from the job you need completed. Define acceptable errors, necessary coverage, source quality and the review required before use. Check whether expressed uncertainty corresponds to observed correctness and whether the system reports missing evidence. User opinion and observed correctness answer different questions. A perception survey needs its own defined sample and method.

Reference: openai.com

which AI is safer to use for high-stakes tasks

High-stakes model selection requires evidence for the specific decision and its consequences. Set requirements for specialist review, missing-evidence handling and escalation before selecting a system. Evaluate the exact configuration with representative cases, including wrong answers, missed context and non-answers. A model's refusal behavior or a general factuality score alone does not authorize a medical, legal or financial decision.

Reference: openai.com

which AI hallucinates less for enterprise use

Enterprise model selection needs an evaluation that represents the enterprise workflow. A supplied-document summary test can inform source-consistency checks, while a no-tool factual-recall test asks a different question. Test required fields, factual support, abstentions and recovery on the same inputs and configurations. Choose from the configurations that meet those requirements in the workload test, rather than extrapolating a universal enterprise winner.

Reference: github.com

can you trust ChatGPT for medical or legal advice

Use an AI-generated medical or legal answer as material requiring verification and appropriate professional review. Inspect the relevant authoritative record, clinical reference or original legal authority before relying on a consequential claim. The source must support the specific statement and apply to the decision's context. The health-response rubric and court example explain different evaluation and accountability questions. Neither supplies a clinical reliability rate or a model-specific standard of care.

Reference: openai.com

Collect the sources. Check the claims.

Use the worked example to go from a search result to the source page, then compare the generated claim with the underlying evidence.

Check the source-page example

MS
Written by

MCP Scraper

Editorial team

About MCP Scraper

See our editorial note for how we prepare guides and handle corrections.

Quick citation guide

Select a citation to automatically copy it to your clipboard.

About our guides · Suggest a correction