humanflow
AI detection · The HumanFlow team · 13 min read

Can AI Detectors Detect Claude? What the Evidence Shows — and What It Doesn't

Yes. Detectors flag Claude's unedited output about as often as ChatGPT's, because they detect machine-typical statistics, not brands. Editing is what changes scores.

Yes, usually. AI detectors flag unedited Claude output at rates broadly similar to ChatGPT, Gemini, or any other major model, because they don't recognize brands — they measure the statistical fingerprint of machine-generated prose, which every frontier model shares. Claude's reputation for natural-sounding writing changes how its text reads, not how it scores.

That's the answer most people searching this question don't want, so let's earn it properly. The question deserves better than a one-word yes, because buried inside it are three separate claims worth testing against published evidence: that detectors know which model wrote something, that some models are inherently harder to detect, and that Claude in particular slips through. Two of those are mostly false. One is partly true, in a way that probably won't help you.

We build a detector and a humanizer ourselves, so we have a stake in this market — read our editorial policy and judge accordingly.

Detectors flag statistics, not logos

Start with what an AI detector actually does, because the "can it detect Claude" framing smuggles in a wrong mental model — the antivirus model, where each threat gets a signature and new threats need new definitions.

Detectors don't work that way. A statistical detector splits your text into segments and asks two questions of each one. First: how predictable is every next word, given the words before it? That's perplexity, and language models — which are literally machines for choosing probable next words — produce text with much less of it than people do. Second: how much do sentences vary in length, structure, and rhythm? That's burstiness, and humans have far more of it. A tired human writer produces a four-word sentence, then a rambling thirty-word one with a digression they didn't plan. A model at default settings produces sentence after sentence of eerily consistent shape. The detector scores those two signals against a threshold the vendor chose, and out comes your percentage. Our explainer on how AI detectors work walks through the mechanics with examples.

Notice what never appears in that pipeline: any check for which company's model produced the text. Claude, GPT-5, Gemini, Llama, Mistral — all transformer models, trained on overlapping data, tuned with similar human-feedback methods, all optimizing toward fluent, high-probability prose. They differ in personality. They converge in statistics. A classifier trained on "LLM output in general" catches most of them for the same reason a scale doesn't care which bakery made the bread.

There's a sharper version of this point. The training process that gives Claude its distinctive warmth — reinforcement learning from human feedback — tends to narrow a model's output distribution, because the model is rewarded for the kinds of responses people rate highly. Researchers have repeatedly observed that this tuning makes model text more statistically regular, not less. The mechanism that makes Claude pleasant to read is a cousin of the mechanism that makes it detectable.

Do detectors literally train on Claude? Yes — vendors say so themselves

If you want direct evidence that detection vendors treat Claude as a first-class target rather than an exotic edge case, they'll tell you. When GPTZero published its GPT-5 benchmark in August 2025, it disclosed that its then-current model (3.7b) had been trained on output from "GPT-4.1, o3, Gemini 2.5, Claude Sonnet 4" (GPTZero, August 14, 2025). Claude is in the training diet, by name, at the same table as OpenAI's models. Other commercial vendors describe similar multi-model training sets. Whatever else is uncertain in this field, "detectors haven't seen Claude text" is not a live theory.

This matters for a practical reason. Even if a brand-new Claude version shipped tomorrow with a genuinely novel style, the detectors would be retrained on its output within weeks — that's the standard cycle, and we document it in detail in our companion piece on whether detectors can catch the newest AI models. The per-model question and the model-freshness question are different questions. This article is about the first. If your real question is "what about a model the detectors haven't trained on yet," that piece is your answer.

What published evidence says about per-model differences

Here is where honesty requires some care, because the answer is not "models are identical."

The best independent evidence that detection rates vary by generator model comes from the RAID benchmark (Dugan et al., ACL 2024) — over six million text generations spanning eleven generator models, eight domains, and eleven adversarial attacks, scored by twelve detectors. RAID found that detection accuracy really does swing by generator. One example from its results: the Binoculars detector, at a fixed 5% false-positive rate, caught 99.6% of ChatGPT output but only 91.9% of GPT-4 output — and just 62.3% of output from the base (non-chat) Mistral 7B model. Detectors also proved sensitive to decoding settings; adding a repetition penalty at generation time cut accuracy by up to 38 points. Per-model and per-setting differences are real, measurable, and published.

Now the part that matters for this article's question: Claude was not among RAID's eleven generator models. The benchmark covered GPT-2, GPT-3, ChatGPT, GPT-4, Cohere, Mistral, MPT, and Llama 2 variants. So the strongest public evidence that per-model gaps exist tells us nothing specific about Claude's position in the ranking. And no rigorous public study measures Claude's detectability against other frontier models across major commercial detectors. RAID, the largest benchmark of its kind, spans eleven generative models — GPT-4, ChatGPT, Cohere, MPT-30B, Mistral-7B and LLaMA 2 70B among them, in base and chat variants — and Claude is not one of them. What fills that vacuum instead is a cottage industry of blog posts — many published by companies selling humanizers or detectors — running a handful of samples through a few tools and declaring a winner. Sample sizes of ten. No human control texts. No disclosed prompts. Those aren't studies; they're marketing with a table.

Two patterns from the credible evidence are worth holding onto. First, which chatbot produced the text matters far less than what happened to the text afterward. Perkins et al. watched seven detectors fall from 39.5% accuracy to 22.2% once adversarial editing was applied — a swing no choice of model comes close to producing. Second, where per-model gaps do show up (as in RAID), they tend to be gaps between model generations and configurations — base versus chat-tuned, old versus new, default versus penalized sampling — not stable advantages that a user can bank on by picking a brand. A gap that a vendor closes in its next monthly retrain is not a strategy. It's a countdown.

"Claude sounds more human" is true. It's also beside the point.

Claude's reputation is not imaginary. Plenty of writers find its default output warmer, less mechanical, and less addicted to the intro-three-bullets-conclusion scaffold than its competitors. If you judge by reading, "Claude writes more naturally" is a defensible opinion.

But sounding human and scoring human are different tests, graded by different judges. Your reading brain rewards tone, idiom, and personality. A detector rewards none of that — it computes token probabilities. A paragraph can be charming and statistically immaculate at the same time: every word close to what a language model would predict, every sentence inside a narrow band of length and structure. Charm is not perplexity. Style is not burstiness. The qualities that make Claude's prose pleasant live on a different axis from the quantities a classifier measures, which is why "it reads like a person wrote it" and "a detector flagged it at 98%" are routinely true of the same document.

If you want the argument in one sentence: detectors were built precisely because humans can't reliably tell AI text from human text by reading it — so "it reads human to me" cannot be evidence about what a detector will say.

What's documented versus what's marketing

Claim you'll see onlineStatusWhat the evidence actually supports
"Detectors can't detect Claude"FalseVendors train on Claude output by name (GPTZero, Aug 2025); unedited output from major models is flagged at high rates
"Detection rates differ between models"True, with caveatsRAID (ACL 2024) documents real per-model and per-setting gaps — but gaps shift as vendors retrain
"Claude is the hardest major model to detect"UnprovenNo rigorous public study includes Claude in a per-model detectability ranking — RAID's eleven models do not include it
"Claude sounds more human, so it scores more human"Non sequiturReading impressions and statistical scores measure different things
"Detection depends on which detector you use"TrueSame text scores differently across tools because each vendor picks its own threshold
"Editing the output changes the score more than the model choice does"Best-supported claim of allDocumented across benchmarks and vendor tests; see below

The last row is the useful one, so let's spend real time on it.

What actually moves the needle

If per-model differences are small, shifting, and unbankable, what's large and durable? Two things: how much a human rewrote the text, and whose voice ended up in it.

Editing depth changes exactly the statistics detectors measure. When you rewrite a Claude paragraph in your own words — restructure the argument, swap its vocabulary for yours, break its even rhythm with your habits — you raise perplexity (your word choices are less probable than a model's) and raise burstiness (your sentences don't come in matched sets). This isn't a trick played on the classifier. The document is genuinely becoming more yours, and the measurement follows the reality. The deeper story of what happens to detection as human editing deepens — including the blended-document problem that detectors handle worst — is the subject of our piece on whether detectors catch edited AI text, which is where this article's question ultimately leads.

Voice is the compounding version of the same effect. A writer with strong habits — favorite constructions, a tolerance for fragments, a signature way of opening paragraphs — imposes those habits when they revise, and those habits are statistically idiosyncratic in a way no model's defaults are. This is also why the false-positive problem cuts where it does: writers with flattened personal variance get burned. The Liang et al. study in Patterns (2023) found seven detectors falsely flagged an average of 61.22% of essays by real non-native English speakers — 89 of 91 TOEFL essays flagged by at least one tool — while sailing essays by US eighth-graders through nearly untouched. Formulaic, low-variance human writing reads as machine-typical. The detector doesn't know who you are. It only knows what your statistics look like, and that blade cuts both directions — more on that in our false positives explainer.

So the honest hierarchy of what determines your score, from most to least influential: how much of the final text a human actually wrote or rewrote; how distinctive that human's voice is; which detector and threshold you're facing; text length and language; and — well below all of those — which brand of model produced the first draft.

What we have not done

We have not run our own hands-on test of these detectors on Claude output. Everything above rests on vendor claims and published research, and that is exactly how you should weight it. We would rather say so than publish a table of numbers we did not measure — and it is why the next section hands you the method instead of asking you to trust ours.

Where this leaves you

If you're asking "can AI detectors detect Claude" because you're deciding which model to use for work someone will screen: the model choice won't save you, and picking a model in order to evade screening is the wrong project anyway. If AI use is prohibited in your context, disguising it violates the rules regardless of which logo is on the chat window — we say that plainly because pretending otherwise would make everything else on this page suspect.

If you're asking because you use Claude legitimately — drafting, brainstorming, editing support where it's allowed — the practical takeaway is that unedited paste-throughs of any model's output are likely to be flagged, and that the flag tracks your editing, not your model. Checking your own work before someone else does is reasonable due diligence; our AI detector shows sentence-level results so you can see which passages read as machine-typical rather than getting one opaque number. It doesn't promise to predict any other tool's verdict or to help you beat one, because nobody can honestly promise that — different vendors, different thresholds, different answers. The full picture of how much any of these scores can be trusted lives at our detector accuracy hub.

The model question, it turns out, was never really about Claude. It was about a mental model of detection that doesn't match how detection works. Detectors don't hunt brands. They measure how machine-typical your final text is — and the only person who controls that is the one doing the final writing.

FAQ

Can GPTZero detect Claude? Yes. GPTZero has disclosed that it trains on Claude output by name — its 2025 model listed Claude Sonnet 4 in its training set alongside GPT-4.1, o3, and Gemini 2.5. Unedited Claude text is flagged at rates broadly comparable to other frontier models, though exact rates vary by detector and text type.

Is Claude harder to detect than ChatGPT? No published, rigorous study demonstrates a stable Claude advantage. The main independent benchmark showing per-model differences (RAID, ACL 2024) didn't include Claude at all. Small blog tests claiming a winner typically use a handful of samples and no human controls, which makes them marketing rather than evidence.

Does Turnitin detect Claude specifically? Turnitin's classifier targets machine-typical statistics rather than specific models, so unedited Claude output is treated like any other LLM output. Its headline 98% accuracy claim applies only to documents where more than 20% of text is flagged, and scores of 1–19% display as an asterisk rather than a number.

Why does Claude "sound more human" if it's still detectable? Because your reading brain and a detector grade different things. You evaluate tone, warmth, and idiom; a detector computes word-level predictability and sentence-level variation. Text can be charming and statistically machine-typical at the same time — that combination is common, not rare.

Will a brand-new Claude version be undetectable for a while? Possibly less detectable for a short window, since detectors train on existing models — that's the lag dynamic, and it's documented after major releases. But vendors retrain within weeks, so any launch-window gap closes quickly. We cover that cycle in detail in the companion article on new-model detection.

What changes a detection score more: the model or the editing? The editing, by a wide margin. Rewriting AI output in your own words raises the exact statistics detectors measure — word unpredictability and sentence variation — because the text genuinely becomes more yours. Model brand differences are small and shift with every vendor retrain.

Can a detector tell me which model wrote a text? Mostly no. Standard commercial detectors output a human-versus-AI judgment, not a model attribution. Some research systems attempt model attribution, but it's a harder problem and not what the tools most people encounter are doing.

If I edit Claude's output heavily, is the result "AI text"? That's the mixed-authorship problem, and it's genuinely hard — for detectors and for policy. Statistically, deep editing moves text toward human-typical ranges. Ethically, what matters is your context's rules and honest disclosure. Our article on edited AI text takes the whole question apart.

Key facts

  • Detectors measure perplexity (next-word predictability) and burstiness (sentence variation) against a vendor-chosen threshold — no step identifies the model's brand (see /ai-detection/how-detectors-work).
  • GPTZero disclosed in August 2025 that its detection model was trained on output from GPT-4.1, o3, Gemini 2.5, and Claude Sonnet 4 — Claude is explicitly in vendors' training data.
  • The RAID benchmark (ACL 2024): 6M+ generations, 11 generator models, 12 detectors; detection accuracy varied by generator (e.g., Binoculars: 99.6% on ChatGPT vs 91.9% on GPT-4 at 5% FPR) and a repetition penalty cut accuracy by up to 38 points — but Claude was not among the models tested.
  • Liang et al., Patterns (2023): 7 detectors falsely flagged an average of 61.22% of 91 human-written TOEFL essays; 89 of 91 were flagged by at least one detector — formulaic human writing reads as machine-typical.
  • OpenAI retired its own AI text classifier in July 2023 after it caught only 26% of AI text and falsely flagged 9% of human text — the maker of the models couldn't reliably detect them either.
  • Editing depth swamps model brand: Perkins et al. (2024) recorded seven detectors falling from 39.5% to 22.2% accuracy under adversarial editing.

Sources

  1. Dugan et al., "RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectors," ACL 2024 (aclanthology.org/2024.acl-long.674; arxiv.org/abs/2405.07940).
  2. GPTZero, "GPT-5 detection benchmark," August 14, 2025 (gptzero.me/news/gpt5) — training-set disclosure including Claude Sonnet 4.
  3. Liang et al., "GPT detectors are biased against non-native English writers," Patterns (Cell Press), 2023.
  4. OpenAI, "New AI classifier for indicating AI-written text" — update announcing retirement, July 2023.
  5. Turnitin, AI writing detection FAQ / transparency page (98% claim conditions, asterisk range).
All postsPublished by The HumanFlow team