humanflow
AI detection · The HumanFlow team · 13 min read

Burstiness in AI Detection: What the Rhythm Test Actually Measures

Burstiness is how much your sentence lengths vary. Humans write in bursts; AI keeps even rhythm. Here's how detectors use it — and where it misreads.

Burstiness is the variation in your writing's rhythm — mainly how much sentence length and structure change from one sentence to the next. Human writing runs in bursts: short jabs, then long winding sentences, then short again. AI writing tends to keep an even, medium stride. Detectors measure that difference and treat flat rhythm as evidence of machine authorship.

Burstiness (n.) — In AI text detection, a measure of variation across a passage: chiefly the spread of sentence lengths, and secondarily the variety of sentence structures. High burstiness (uneven, spiky rhythm) is treated as human-typical; low burstiness (uniform rhythm) is treated as AI-typical. Like every statistical detection signal, it measures a property of the text, not the identity of its author.

If perplexity is about which words you choose, burstiness is about how the sentences carrying them are built. The two get bundled together in every explainer — usually in one breathless sentence — but they are different measurements with different failure modes, and if a detector has ever misjudged your writing, the odds are decent that one of these two numbers is why. This article is about the second one.

A number you can compute with a pencil

Burstiness needs no neural network. The simplest version: count the words in each sentence of a passage, then compute how much those counts spread around their average — the standard deviation, if you want the formal term. A paragraph whose sentences run 4, 22, 15, 2, 23 words has high spread. A paragraph running 12, 12, 13, 12, 12 has almost none. Real detectors compute fancier variants (they also look at clause depth, punctuation habits, and how structures repeat), but sentence-length spread is the heart of it, and it's the part you can check yourself.

The premise is older than AI detection. Stylometrists — the people who argue about who really wrote disputed Federalist Papers — have used sentence-length distributions as an authorship fingerprint for over a century. What's new is the specific contrast: not this human versus that human, but humans in general versus a text generator that never gets tired, excited, or bored.

Because that's what rhythm variation mostly is, in human prose. It's affect leaking into structure. You write short when you're being emphatic. You write long when a thought keeps unfolding and you ride it. You fragment when annoyed. A language model has none of these states. It has a probability distribution.

See it: two paragraphs, same topic

Both passages below were written by us, for this article, as illustrations — the first drafted the way a person actually writes, the second deliberately imitating the even stride of unedited chatbot prose. Neither is output from any AI tool. Read them aloud if you can; the difference lives in the ear.

Illustration A — human-style rhythm (written by us):

The deadline was Thursday. I'd known that for a month, obviously, the way you know a dentist appointment exists — abstractly, painlessly, right up until it doesn't. Wednesday night I made coffee at eleven and told myself the outline counted as progress. It didn't. By two in the morning I had four hundred words, three of them good, and a browser history that would embarrass a raccoon. Then something clicked. The argument I'd been circling for days turned out to fit in one sentence, and once it was down, the rest came fast — messy, over-caffeinated, alive.

Illustration B — machine-style rhythm (also written by us, imitating typical AI output):

Meeting deadlines is an important part of academic success. Many students struggle to manage their time effectively when assignments are due. Working late at night can make it difficult to produce quality writing. Creating an outline is a helpful strategy for organizing ideas before drafting. Breaking large tasks into smaller steps can reduce stress and improve results. With careful planning, students can complete their essays on time and feel confident.

Now the pencil math. These are the real counts from the two passages above:

MeasureIllustration A (human-style)Illustration B (machine-style)
Sentence lengths (words)4, 22, 15, 2, 23, 3, 269, 12, 12, 12, 12, 13
Shortest / longest2 / 269 / 13
Average length~13.6 words~11.7 words
Spread (standard deviation)~9.7 words~1.2 words

Look at the averages first: nearly identical. If you only measured mean sentence length, these paragraphs would be twins. The spread is where they diverge — by a factor of eight. Passage A lurches from a 2-word sentence to a 26-word one. Passage B never strays more than a couple of words from its comfortable middle. That spread, roughly, is burstiness, and Passage B's flatness is what a detector reads as machine-typical.

Notice also what Passage B is not: it isn't wrong, ungrammatical, or even badly written by most rubrics. Every sentence is complete, clear, and on topic. It would get a decent grade. It just has no pulse. Hold that thought — because plenty of humans are specifically trained to write this way, and we'll get to them.

Why language models keep an even stride

The flat rhythm isn't a bug someone forgot to fix. It falls out of how generation works, in at least three ways.

First, a model writes one token at a time by favoring probable continuations, and the most probable way to continue English prose is at moderate length with standard structure. Extremely short sentences are statistically unusual. So are 40-word sentences with nested clauses. The safe middle wins, token after token, sentence after sentence — the same favor-the-likely dynamic that produces low perplexity at the word level produces uniformity at the sentence level. One process, two fingerprints.

Second, models are trained on averages. A model that has absorbed millions of writers doesn't reproduce any one writer's lopsided rhythm; it regresses toward the aggregate, and the aggregate of many uneven rhythms is an even one. Individual humans are spiky in individual ways. The average of all spikes is smooth.

Third, chat models are tuned after training to be helpful, complete, and polite — and tuned prose has a committee's cadence. Every idea gets a full sentence of its own. Nothing is dashed off. A human writer decides some thoughts deserve two words and others deserve thirty; a tuned assistant gives everything the same measured attention, like a tour guide who refuses to walk faster past the boring rooms.

One honest caveat: this is a tendency, not a law. Ask a current chatbot to "vary your sentence length dramatically" and it will comply, at least for a while. Newer models drift less monotone than their 2023 ancestors even unprompted. Burstiness was a stronger tell in the GPT-3.5 era than it is now, which is one reason detectors treat it as a supporting signal rather than the headline act.

Burstiness vs. perplexity: keep them straight

The two-sentence version. Perplexity asks: would a language model have guessed your next word? It's a word-choice measurement — vocabulary, phrasing, predictability of content. Burstiness asks: do your sentences all weigh the same? It's a structure measurement — length, shape, rhythm. A passage can be predictable in wording yet spiky in rhythm, or full of surprising vocabulary delivered in metronome sentences. Detectors measure both precisely because they can disagree.

They fail differently, too. Perplexity punishes common word choices, which is why it stumbles on non-native English writers reaching for safe vocabulary. Burstiness punishes uniform structure, which is why it stumbles on anyone taught to write in patterns — and that failure mode gets less attention than it deserves.

In the actual pipeline, neither number reaches you raw. Statistical detectors fold perplexity, burstiness, and other features into a classifier, then compare its output against a threshold the vendor chose — a business decision balancing false accusations against missed AI text, which is why identical essays score differently across tools. The full pipeline is mapped in how AI detectors work, and what those diverging scores mean for reliability is the subject of our detector accuracy guide.

The people whose honest writing scores flat

Run down the list of writers whose genuine, unassisted prose has low burstiness, and it starts to look like a roster of people detectors already treat unfairly.

Students drilled on the five-paragraph essay, where every paragraph opens with a topic sentence of similar weight and closes with a transition of similar weight. Writers educated in systems that teach fixed sentence patterns — a common feature of English instruction worldwide, and part of why the 2023 Patterns study by Liang et al. found detectors falsely flagging an average of 61.22% of human-written TOEFL essays. Scientists, whose journals actively enforce uniform declarative structure. Lawyers and technical writers, for whom rhythmic flair is a liability. Neurodivergent writers who have built consistent sentence templates as a deliberate, hard-won strategy. None of these people are doing anything wrong. They are doing exactly what they were taught, and the statistics can't tell discipline from generation. If that's you, the documented patterns — and what to do about them — are covered in our guide to false positives.

How self-editing flattens your own burstiness

Here's the quietly maddening part: careful revision — the thing writing teachers beg for — can lower your burstiness and make your honest work read as more machine-like.

Think about what conscientious editing does. You find your 34-word sentence and split it, because a style checker flagged it as hard to read. You find your two-word fragment and complete it, because fragments feel risky in formal work. You smooth the abrupt transition. You break up the run-on. Every one of those edits is individually defensible, and every one of them moves a sentence toward the middle of the length distribution. Do it across a whole essay and you've sanded off your own spikes. The draft you sweated over now has the even stride of Passage B — not because a machine wrote it, but because you carefully removed everything a rhythm metric would recognize as you.

Grammar tools accelerate this. Their suggestions overwhelmingly push toward moderate sentence length and standard structure; accept enough of them and your prose converges on the same statistical middle that models regress to, for the same underlying reason — the suggestions are trained on aggregate norms. A human plus a style checker and a model alone can arrive at eerily similar rhythm from opposite directions.

We are not telling you to stop editing. We're telling you the metric can't see effort, and that "this essay reads as uniform" and "this essay was generated" are claims a detector cannot actually distinguish between. The fix, if you're worried, isn't to game your rhythm — it's to keep drafts and version history, which prove process in a way no statistic can.

Measurable rhythm vs. felt rhythm

One more distinction worth keeping, because it explains cases the numbers get wrong in both directions.

What detectors measure is spread — variance in sentence length and structure. What readers experience is voice — and the two overlap less than you'd think. A skilled writer working in deliberate staccato can produce a passage with tiny length variance that nonetheless crackles, because the tension lives in word choice and content, not in sentence shape. Flat numbers, alive prose. Conversely, alternating long and short sentences mechanically — long, short, long, short — produces high measured burstiness and a rhythm that feels like a metronome anyway, because predictable alternation is its own kind of uniformity. Spiky numbers, dead prose.

Felt rhythm comes from variation with purpose: the short sentence lands because the three before it built pressure. A standard-deviation calculation has no concept of pressure. This is the general lesson of statistical detection wearing a specific hat: the measurable proxy correlates with the human reality, and correlates is all it does.

What to actually do with this

If you write and worry about scores: don't contort your prose to hit a variance target — writing to satisfy a statistic is how you end up with the mechanical alternation described above. Write with intent, keep your receipts (drafts, outlines, version history), and if a tool flags you, remember that sentence-level readouts are more useful than a single percentage because they show you where the text reads as uniform. Our AI detector is built around that kind of readout, and — same disclosure we attach everywhere — it doesn't promise to beat or out-judge any other detector, because nobody can honestly promise that. If you're editing an AI draft you're permitted to use, an AI humanizer can help move phrasing toward your own register; if AI is banned in your course, no rewriting tool changes what the text is, and we'd rather lose the sale than pretend otherwise.

If you evaluate other people's writing: a flat rhythm score identifies prose that is uniform, and uniform prose has many mothers — training, genre, revision, translation, temperament, and yes, generation. Treat the score as a reason to look closer, never as the conclusion.

And if you just came here to understand the machinery: you now have two-thirds of it. Perplexity checks the words. Burstiness checks the rhythm. The third approach doesn't inspect the text at all — it marks text at birth, inside the generator. That's watermarking, and it's the subject of the next piece in this series.

FAQ

What is burstiness in AI detection? Burstiness is a measure of variation in writing rhythm — primarily how much sentence lengths differ across a passage, secondarily how varied the sentence structures are. Detectors treat high variation as human-typical and low variation as machine-typical, because language models tend to produce sentences of consistent, moderate length.

Is burstiness the same as perplexity? No. Perplexity measures word-level predictability — how likely each next word was. Burstiness measures structural variation — how much sentence length and shape change. Detectors typically combine both signals, and a text can score human-like on one and machine-like on the other.

Can a human have low burstiness? Easily. Scientific writing, legal drafting, technical documentation, exam-formula essays, and much non-native English prose are uniform by training or by design. Heavy self-editing also flattens rhythm, since most revision pushes outlier sentences toward moderate length. Low burstiness indicates uniformity, not machine authorship.

Does high burstiness prove I wrote something myself? No — it's evidence in one direction, not proof in either. Current chatbots will vary sentence length when prompted to, and a person can mechanically alternate long and short sentences in generated text. Authorship is a fact about process, which is why drafts and version history remain stronger evidence than any statistic.

How do detectors combine burstiness with other signals? Statistical detectors feed burstiness, perplexity, and related features into a trained classifier, then apply a vendor-chosen threshold to decide what counts as "likely AI." Because each vendor picks its own features and threshold, the same text routinely gets different scores from different tools.

Can I measure my own burstiness? The rough version, yes: count words per sentence in a paragraph and look at the spread around the average. A wide spread (fragments alongside 25-word sentences) is high burstiness; a tight cluster near the mean is low. Real detectors use more elaborate versions, but the pencil math captures the concept.

Should I deliberately vary my sentence lengths to avoid AI flags? Vary them because it makes writing better — the emphasis of a short sentence after long ones is a real rhetorical tool. Don't vary them for the metric: mechanical alternation reads as its own kind of uniformity, and chasing detector scores solves nothing a folder of dated drafts doesn't solve better.

Key facts

  • Burstiness in AI detection refers to variation in sentence length and structure; low variation is treated as evidence of machine generation (per Turnitin's and GPTZero's public technical explanations).
  • Sentence-length distribution has been used in stylometry — statistical authorship analysis — since long before AI detection existed; the AI-era twist is contrasting humans in general against generator uniformity.
  • In this article's own worked example, a human-style paragraph and a machine-style paragraph had nearly identical average sentence lengths (~13.6 vs. ~11.7 words) but an eightfold difference in spread (standard deviation ~9.7 vs. ~1.2) — the spread, not the average, is the fingerprint.
  • Liang et al., Patterns (Cell Press), 2023: detectors falsely flagged an average of 61.22% of 91 human-written TOEFL essays, with formulaic and pattern-trained writing among the reasons statistical signals misfire on real people.
  • Turnitin displays AI scores of 1–19% as an asterisk rather than a number, acknowledging that its statistical signals — perplexity and burstiness among them — are unreliable at low ranges.
  • Documented groups whose honest writing tends toward low burstiness include non-native English speakers, students taught rigid essay structures, technical/legal/scientific writers, heavy self-editors, and neurodivergent writers.
  • Burstiness is a supporting signal, not a standalone test: modern chatbots vary rhythm when prompted, and no mainstream detector publishes a burstiness threshold that separates human from machine.

Sources

  1. Liang, W., et al. "GPT detectors are biased against non-native English writers." Patterns (Cell Press), 2023.
  2. Turnitin. AI writing detection FAQ / transparency documentation (detection approach, asterisk policy, score interpretation).
  3. GPTZero. Public documentation and founder interviews describing perplexity and burstiness as core detection signals (January 2023 launch, Edward Tian).
  4. Fowler, G. "We tested a new ChatGPT-detector for teachers. It flagged an innocent student." The Washington Post, April 2023.
  5. OpenAI. "New AI classifier for indicating AI-written text" — retirement announcement, July 2023 (26% true-positive, 9% false-positive rates).
All postsPublished by The HumanFlow team