IntellectuaLead
English

Independent style analysis

LLM writing benchmark

Compare how frontier language models write across the same set of practical tasks. Lower AI evidence means the model output is stylistically closer to the human baseline used in this benchmark.

25 compared models and baseline 8 writing genres 6 equally weighted signals

Detailed model comparison

Scores update automatically when a new benchmark is published.

Low AI Medium AI High AI
RankModelLatest published runsAI ScoreAverage of six signalsSentence rhythmSentence-length variationGPT-2 proximityModel-like predictabilitySyntax diversityGrammar-pattern varietyProse heavinessDense constructions per 1,000 wordsPersonal tonePerspective signals per 100 wordsSection variationIntro-body-ending change
#130.3/100Low AI0.59Low AI0.0056Low AI0.891Low AI102.8/1kLow AI9.8%Low AI0.297Low AI
#230.9/100Low AI0.66Low AI0.0001Low AI0.885Medium AI95.5/1kLow AI5.9%High AI0.242Low AI
#335.3/100Medium AI0.64Low AI0.0284Low AI0.887Low AI84/1kLow AI4.7%High AI0.244Low AI
#436.9/100Medium AI0.56Low AI0.0004Low AI0.889Low AI78.4/1kLow AI4.9%High AI0.235Medium AI
#539.9/100Medium AI0.65Low AI0Low AI0.889Low AI111/1kLow AI7.1%High AI0.209High AI
#641.5/100Medium AI0.49High AI0.0051Low AI0.874High AI104.1/1kLow AI5.5%High AI0.215High AI
#742.3/100Medium AI0.55Low AI0.0087Low AI0.838High AI73.7/1kLow AI3.9%High AI0.243Low AI
#843.1/100Medium AI0.5High AI0.007Low AI0.884Medium AI88.3/1kLow AI5.7%High AI0.197High AI
#943.3/100Medium AI0.6Low AI0.0145Low AI0.887Low AI109.1/1kLow AI7.6%High AI0.213High AI
#1044.3/100Medium AI0.65Low AI0Low AI0.88High AI115.3/1kMedium AI6.9%High AI0.23Medium AI
#1148.5/100Medium AI0.52High AI0.0033Low AI0.882High AI118.9/1kMedium AI7.3%High AI0.199High AI
#1251/100High AI0.53Medium AI0.0021Low AI0.856High AI115.8/1kMedium AI7.9%High AI0.225High AI
#1352.4/100High AI0.48High AI0.9996High AI0.894Low AI90.8/1kLow AI4.8%High AI0.293Low AI
#1453.3/100High AI0.49High AI0.0212Low AI0.876High AI112.1/1kLow AI5.7%High AI0.17High AI
#1554.1/100High AI0.57Low AI0.3335High AI0.873High AI85.1/1kLow AI6.7%High AI0.23Medium AI
#1654.6/100High AI0.51High AI0.024Low AI0.871High AI104.9/1kLow AI5.3%High AI0.154High AI
#1755.9/100High AI0.49High AI0.0157Low AI0.874High AI115.3/1kMedium AI7.1%High AI0.214High AI
#1856.1/100High AI0.5High AI0.0003Low AI0.866High AI111/1kLow AI5.7%High AI0.218High AI
#1958/100High AI0.56Low AI0.036Low AI0.873High AI123.9/1kHigh AI7%High AI0.2High AI
#2059.5/100High AI0.5High AI0.0295Low AI0.875High AI105.7/1kLow AI5%High AI0.157High AI
#2160.5/100High AI0.42High AI0.1528High AI0.886Medium AI122.1/1kHigh AI7%High AI0.238Low AI
#2260.9/100High AI0.51High AI0.629High AI0.875High AI108/1kLow AI10%Low AI0.207High AI
#2362.1/100High AI0.57Low AI0.1023High AI0.866High AI111.3/1kLow AI10.6%Low AI0.195High AI
#2471.8/100High AI0.43High AI0.2718High AI0.877High AI130.4/1kHigh AI7.9%High AI0.143High AI
#2573.4/100High AI0.29High AI0.9944High AI0.893Low AI135.4/1kHigh AI7.6%High AI0.213High AI
Metric labels: Low AI through 25% evidence, Medium through 50%, High above 50%. Global score: Low through 35, Medium through 50, High above 50.

How to read it

Style evidence, not authorship proof

The AI Score is the equal-weight average of six interpretable writing signals. Use it to compare model tendencies under controlled tasks, not to determine who wrote an isolated text.

  1. 1

    Start with the AI Score

    Lower scores rank higher. The score equally averages all six calibrated signals for every completed writing task.

  2. 2

    Compare the metric labels

    Green is near the low-evidence end of a calibration. Yellow is intermediate; red has crossed the interval midpoint.

  3. 3

    Open a model, then a task

    Model analytics show averages. Task analytics reveal genre-specific scores, graphs, recommendations and highlighted output.

Benchmark methodology

Six writing signals used in every AI Score

Every model is evaluated with the same metrics and equal weights. The final AI Score is the average of the six calibrated evidence values across that model's completed tasks.

Exact score calculation: task AI Score = 100 x mean(the six available 0-1 evidence values). Model AI Score = mean(all completed task AI Scores). Individual raw values are averaged only for display; the model score is not recalculated from those displayed averages.

Sentence rhythm

Counts the words in every sentence, calculates their population standard deviation, then divides it by the mean sentence length. A larger coefficient means a wider mix of short and long sentences.

Formula: SD(sentence word counts) / mean sentence word count.
Evidence anchors: 0.55 = 0; 0.50 = 1.

GPT-2 perplexity proximity

DistilGPT-2 compares the observed next-token log probability with the probability distribution it expected at every position. The standardized difference is converted through the normal cumulative distribution.

Formula: Phi((observed log probability - expected log probability) / sqrt(expected variance)).
Evidence anchors: 0.00 = 0; 0.20 = 1.

Syntax diversity

spaCy converts the text into part-of-speech sequences. The score combines normalized entropy for single tags, two-tag sequences, three-tag sequences, and unique sentence-level POS patterns.

Formula: 0.25 x unigram entropy + 0.35 x bigram entropy + 0.35 x trigram entropy + 0.05 x sentence-pattern diversity.
Evidence anchors: 0.890 = 0; 0.875 = 1.

Prose heaviness

Counts nominalizations, reduced participial clauses, subject-that constructions, and phrasal coordination, then normalizes their total for text length.

Formula: dense constructions / total words x 1,000.
Evidence anchors: 110/1k = 0; 130/1k = 1.

Personal tone

Counts personal pronouns, private-state verbs such as think or feel, hedges, and direct questions. It estimates visible perspective, uncertainty, and reader engagement.

Formula: (personal pronouns + private verbs + hedges + questions) / total words x 100.
Evidence anchors: 9% = 0; 7.5% = 1.

Section variation

Splits the text into opening, middle, and ending thirds. Each third is profiled by sentence length, sentence rhythm, function-word rate, and modifier rate; normalized pairwise distances are averaged.

Formula: mean pairwise distance among the three section profiles.
Evidence anchors: 0.25 = 0; 0.20 = 1.

Controlled comparison

Eight writing genres

Using different genres reduces the chance that one topic or writing format determines the leaderboard.

  1. SEO article about coffee roasting
  2. Academic essay on universal basic income
  3. Research writing about AI detection
  4. Personal writing about overcoming insecurity
  5. Fiction about a Halloween party going wrong
  6. Biography of Alan Turing
  7. Copywriting email for a dating service
  8. News report on New York's cost of living

Questions

About the LLM writing benchmark

Does a high score prove that a text was written by AI?

No. The score compares measurable stylistic tendencies. It is useful for controlled model comparison, but it is not proof of authorship for an isolated document.

Why is the human baseline included?

The human samples provide a practical reference under the same eight genres. They make the direction and scale of each model result easier to interpret.

How often does the leaderboard update?

The website reads the latest benchmark published from the Intellectualead app. Completed NLP backfills and new benchmark runs publish refreshed metrics automatically.