Which Parts of an AI-Written Article Give It Away

The giveaway in an AI article is less a word than a shape. The opening teaser, the myth-vs-fact block, the decision framework with its tidy options and recommendation: in our data these fixed rhetorical moves read machine-like far more consistently than any vocabulary did.

Writers who study this from the reading side describe the same thing. John R. Gallagher calls large language models genre machines, systems that reproduce the conventions of the genres they learned. Practitioners on r/content_marketing report that AI articles "humanized" by synonym replacement still read AI. The shape survives the word swap.

Why would the shape persist? One plausible explanation is instruction tuning, which rewards certain answer formats until a model reaches for them by default: an opening that sets broad context, parallel supporting sections, an outlook that ends on a confident claim. Our data cannot prove that mechanism. It shows where the shapes concentrate, and that removing shared phrasing did not remove the signal.

Does the Shape Signal Also Flag Well-Organized Human Writing?

Rarely. Of 4,546 verified human documents scored by our detector, none were called AI, and across 9,963 verified human documents in total it called 4 AI (0.04%).

That result matters because the obvious counterargument is straightforward: maybe the detector just penalizes organized prose. A skilled human essayist who writes clean, structured paragraphs with consistent transitions could, in theory, look like whatever the model has learned. If that were true, the section findings above would be useless.

We tested that worry directly. On the 4,546-document pool, spanning 17 kinds of writing, none scored 0.998 or above. Across the full set of 9,963 verified human documents, including pre-2021 Medium posts and US federal agency prose, it called 4 AI. The human writing it did misread was formal and institutional: the previous version of the detector called 8 of 637 agency documents AI before we retrained it with 100 public-domain agency documents, and the current version calls 2 of the same 637.

We also ran control tests using human-authored chunks from Medium posts. Passages of 100, 200 and 300 words were called AI 0% of the time, and 50-word chunks 1.0%. Short human passages were not flagged just for being short, which is what lets us score sections one at a time.

The contrast with unaided human judgment is sharp. According to Hancock et al. (Stanford HAI, March 2023), people asked to distinguish human from AI text in dating, professional and hospitality profiles did so with 50-52% accuracy. That is not meaningfully different from a coin flip.

The same study shows why. Participants leaned on cues such as grammatical correctness, first-person pronouns, references to family life and informal language, and wrongly read them as human. Those cues are easy for a model to produce and common in human writing, so they cannot separate the two.

The practical consequence runs in both directions. An editor who reads an AI-drafted section and feels it "seems fine" is working from a signal that did not beat chance in controlled settings. An editor who reads a tidy human section and suspects AI has no better basis. Confident eyeball judgment is close to a coin flip. A measured reading, with its false-positive rate stated, is a better basis for the call.

Why Do Sections Built on First-Hand Data Read Human More Often?

On one manufacturer's site, sections built on its own sales and shipping records read AI 37% of the time, against 71% for the other sections of the same articles.

This came out of the same September 2026 scoring, looking inside one website's articles. That company's articles drew on its own records, such as orders per state and models shipped per county, and the record-heavy sections read AI about half as often as the rest. It is the most actionable finding from the study.

The effect has a limit. For a payments company whose articles used general industry figures, the same comparison came out at 98% against 100%, essentially no difference. Numbers alone did not do it. First-hand records did.

Across all body sections, the ones that read human carried 7.9 numbers per 100 words, against 2.5 in sections that read AI. That is a correlation, not a recipe: the payments comparison shows that adding general figures does not move the reading. The numbers that mattered were ones only that company could publish.

A plausible reason is that a paragraph built around a specific count from a company's own database is harder to fit into a default template. Our data shows the correlation. It does not prove that mechanism.

Reused phrases shared across websites made up 0.5% or less of every prose section. Phrase-level copying was essentially gone, yet generated prose still read AI, which is why we look at section shapes and evidence rather than at word choice.

I find this distinction practically important because most editing advice targets the phrase level: replace overused words, vary sentence openers, remove clichés. In our data that level was already clean, and all 16 decision frameworks still read AI. The lever that moved sections was evidence the model could not have written from general knowledge.

A review order for AI drafts, based on where the tells sat

The section scores suggest an order of work for anyone editing AI-assisted drafts. What follows is guidance drawn from where the machine-like passages concentrated in our 2,625 sections, not a separately measured procedure.

1. Start with the opening. First passages read AI 87% of the time, against 64 to 75% for later passages. Replace a context-setting opener with the most specific fact the article has, ideally one only your organization could publish.
2. Question every fixed-format block. Decision frameworks read AI in all 16 cases, outlook charts 99% of the time, before-and-after comparisons 94% and myth-vs-fact boxes 87%. Keep a block only if it carries information readers need, and build it from your own cases rather than a generic template.
3. Check for a double introduction. Intro teasers read AI 87% of the time and opening paragraphs 86%. Two stacked introductions give the same template two chances to show.
4. Bring in first-hand records before rewriting sentences. On the one site built on its own sales and shipping records, those sections read AI 37% of the time against 71% for the rest. General industry figures did not move the reading (98% against 100%).
5. Use real people and real choices. Author bios built from a real profile read human 51% of the time, calls to action 33% and curated resource lists 21%. A named author with a real background and sources a person actually chose are parts of the page the model did not write from scratch.
6. Leave word lists for last. Shared phrases were already down to 0.5% or less of each section, and the prose still read AI. Word-level cleanup is worth doing, but it is not the step that changes the reading.

None of these steps makes a draft untraceable, and they are not meant to. A detector trained on a specific pipeline can still recognize that pipeline's output. The point is a better article: one built on evidence a reader cannot find anywhere else.

What Will Determine Whether AI Content Reads Human in the Next 12-24 Months?

We expect fixed section shapes to stay a stronger tell than vocabulary, first-hand evidence to stay the main lever, and unaided reading to stay unreliable. None of this is certain.

• Prediction: Structural shape outlasts vocabulary as a marker.

  Our data already points that way. Shared phrases were down to 0.5% or less of each section, yet every generated prose section type read AI 81-100% of the time. Word lists also misfire in the other direction: one writer on Medium found that many phrases popular guides flag as AI are ones real writers use all the time.

  Weak signal: Guides that promise to name the giveaway words end up flagging ordinary human phrasing. Why it matters: Teams still editing for word choice rather than section shape will keep producing drafts that read machine-written.

• Prediction: Specific, verifiable detail becomes the clearest dividing line.

  On one manufacturer's site, sections built on its own sales and shipping records read AI 37% of the time, against 71% for the rest of the same articles. Where articles used general industry figures, the split was 98% against 100%. Detail that only one company could publish is harder to produce from general knowledge than polish is.

  Weak signal: Models can generate plausible-sounding specifics, but invented figures fail as soon as someone checks them. Why it matters: Evidence sourcing becomes a content quality decision, not just a research step.

• Prediction: Intuition-based review stays unreliable through the forecast window.

  In the Stanford study, readers told human from AI text with 50-52% accuracy and wrongly read grammatical correctness, first-person pronouns and informal language as signs of a human writer. Those cues are easy for a model to produce and common in human writing.

  Weak signal: Rising public awareness of AI writing does not by itself give readers a better cue to rely on. Why it matters: Editorial gut calls on authorship sit close to chance in controlled tests, however experienced the reviewer feels.

One open question is whether newer models will shed these default shapes. Nothing in our September 2026 data settles that. It shows the shapes are there today, and that removing shared phrasing did not remove their signal.

How We Measured Which Sections Flag as AI-Written

We scored 2,625 visible sections across 146 AI-drafted articles and found a 92-point spread between section types inside the same articles.

Between September 1 and 13, 2026, our pipeline wrote 146 long-form articles for 13 different websites. Every visible section of 40 words or more was scored separately with our AI detector, a ModernBERT classifier paired with a separate predictability check running on a pair of open Qwen2.5 models. Passages scoring 0.998 or above were called AI, passages below 0.5 were called human, and everything in between was not called. The detector was trained on our pipeline's earlier output, so it recognizes that pipeline's fingerprint by construction. This is an internal evaluation of our own articles, not a general detector benchmark, as of September 2026.

Across the articles, 73% of passages read AI, 16% were not called, and 11% read human. That last number is not nothing: more than 1 in 10 passages in our AI-drafted articles scored below the human threshold. The question is which ones.

The answer is sharp. First passages read AI 87% of the time, compared with 64 to 75% for later passages in the same articles. Decision frameworks read AI in all 16 cases, outlook charts 99% of the time and before-and-after comparisons 94%. At the other end, author bios built from a real profile read AI only 8% of the time and read human in 51% of cases.

The position effect deserves a name: call it the opening penalty. The first passage of an article is where a default frame is most likely to sit, a context-setting claim about why the topic matters and a smooth transition into the body, and it is the part that read most machine-like in our data.

Practitioners describe the same pattern. One commenter on r/content_marketing put it plainly: "AI tends to be super formulaic - intro, 3 main points, conclusion, every single time. Real writers are messier."

Human-reading passages do not rescue an article. 56 of 146 articles contained at least one, yet 144 of 146 were still called AI overall, because the article-level call follows the most machine-like passage.

The practical consequence is specific: if you are editing an AI draft, the opening and the fixed-format blocks are where the tells concentrate. Fixing word choice elsewhere while leaving those untouched is the wrong order of operations.

The shape signal held across our September 2026 sample. On the one site whose articles were built on its own sales and shipping records, record-heavy sections read AI 37% of the time against 71% for the rest.

What changes when you know this: the checklist for reviewing an AI draft shifts from vocabulary to architecture. The question stops being "does this word sound AI?" and starts being "is this section a default template, and does it carry anything only we could publish?" Those are different questions and they lead to different edits.

For content teams using AI assistance at scale, that makes evidence sourcing the first step, before editing. That is where the AEO Content Engine starts: articles grounded in each company's own records, written to read like expert human writing and structured so AI answer engines can cite them. To see which passages of a draft read machine-written, run it through the free AEO Content AI Detector.

This article is part of our research series on how AI writes and how humans write. The overview of the whole series is How AI Writes vs How Humans Write.