Why we stopped trusting content grades and started measuring answers: what the expired 2023 GEO effect sizes changed in our audits

The 2023 GEO effect sizes just expired, and it changed how we run AI visibility audits. We used to open client engagements with an engine-free content grade: a deterministic score computed from the page's text alone, no model call, no engine, grading how citable a page looked. The September 2026 validation study (Bajemon and Rochet, arXiv:2609.07559) removed the premise underneath it. Their best content-only predictor, eleven deterministic text features, correlated with actual citation at a within-query Spearman of about 0.11, roughly one percent of variance. A grade computed from the page cannot carry a prediction about retrieval, because retrieval is where the outcome lives.

So our audits now separate the two jobs explicitly. The content grade survives, but only as a quality filter: catching duplication, padding, thin rewrites, and incoherence at corpus scale. The study's own framing is exactly this, a score survives as a floor check, never a forecast. What we stopped doing is selling the grade as a visibility prediction, and we stopped spending content budget to move a score from 78 to 92, which the paper's adversarial benchmark shows is optimizing the proxy, not the outcome. The practical replacement is measuring answers directly: run the prompts your buyers actually ask against the engines they use, on a schedule, and record which pages get cited and which brands get named. It is expensive and noisy, and the cited domains churn 60 to 70 percent day to day, which is exactly why a static grade on the page cannot substitute for it.

This is also why our onboarding still says we do not guarantee citations. The 2023 numbers that made guarantees tempting were never causal for discovery: Martinez's survey of 45 studies (arXiv:2607.14035) is blunt that no reviewed technique shows a stable cross-platform causal effect on organic discoverability. We promise measurement, maintenance, and honest interpretation instead. When the evidence moves, the process moves with it, and this month the evidence moved.