AEO Insights·10 min read

Before You Call It "Measured" — How Marketing Tools Should Label Estimates Honestly

We audited our own tools and found gaps in how they labeled estimates: estimates that looked measured, a name that caused a malfunction, and data that was labeled but never used in the calculation. Here are the labeling principles and a checklist for anyone who builds or reads marketing scores.

D

Dohak Kim

Marketing Architect · Ph.D. in International Marketing (UIBE)

Published

2026-11-06

Before You Call It "Measured" — How Marketing Tools Should Label Estimates Honestly

Summary

A score or number borrows trust. Here are the cases where our own tools showed estimates that looked like measurements, plus labeling principles to check when you build or read marketing figures.

A Score Borrows Trust

The scores marketing tools produce work on the premise that the reader will not recompute the basis. That is why scores carry responsibility. While building diagnostic tools like AEGIS Insight and C³ Cube, we spent recent months checking ourselves on how well we keep that responsibility. A fair amount of what we found was embarrassing, which is why we are publishing it. The same problems are common both among those who build scores and among those who read them.

The Labeling Gaps We Found

Problem FoundWhat Was OffFix
GEO scoreIt was an estimate: one Gemini model summarizing signals it observed through search, yet the wording about stability across repeated runs did not match the methodAdded a notice on the GEO tab that it is an estimate, not an actual AI citation test
The name "measured value"Calling the static scan result a measured value led the model to skip searching for items not in that data and fall back to defaultsStated in the prompt that the data applies only to structural items and the rest must be searched before scoring
Content generation promptAn instruction to use industry-average estimates when no figure exists could put unsupported statistics into generated postsChanged to describe qualitatively instead of inventing figures
Page speed itemScored by a model estimate with no measured dataSwitched to PageSpeed Insights measurement (CrUX or Lighthouse)
Naver search volume scoreReal data was collected and labeled, but matching failed so the score was filled with an AI-inferred valueFixed the matching logic; measured values now take priority when present
Trend direction valueA value hard-coded to "rising" regardless of the real direction was entering the calculationNow takes direction from actual trend data
AI citation measurement (SOV)Empty responses were counted as "no mention," understating the mention rate; a single engine could be read as the wholeEmpty responses handled separately; screen states it is Gemini-based
Homepage copyUnverifiable superlatives such as "the only way"Replaced with verifiable statements

What this list has in common is that these were problems born of inertia, not bad intent. Names and defaults that looked reasonable at first drifted away from actual behavior over time.

Three Labeling Principles

First, label the source type of a value. Directly collected values, model-inferred values, and pre-publication self-assessments are different kinds of information. We attached a reproducibility tier to each item, rating structural items checkable in code highest and items dependent on external signals lower. To be honest, the percentages in those tiers are approximate labels we assigned, not statistically guaranteed values, and that should be stated too.

Second, do not let a name overstate the method. The moment the name "measured value" is attached, people stop questioning it and the model reading the prompt judges that data to be enough. This is what actually happened to us. A name changes behavior, not just labeling.

Third, do not fill in a value you could not obtain. The moment you fill a gap with a plausible value because you dislike a report looking empty, the tool starts producing performance instead of information. Leaving it blank or writing "could not be measured" is better.

A Label Alone Is Not Enough

The most instructive case was Naver search volume. Our pipeline already had a tag and a screen badge for whether a value was measured. But the step that computed the score was not actually reading that measured data. The label said "measured" while the calculation was using an inferred value. Labeling becomes false not only when a label is wrong but also when the label is right and the data flow is broken. So when auditing labels, you have to follow the path the data takes to the score, not just look at the screen.

From the Reader's Side

These principles are not only for those who build tools. If you receive a marketing score or ranking, you can ask three things. Where did this value come from? If measured again, would it give the same value? How was it handled when the value could not be obtained? If a tool cannot answer, it is safer to double-check before copying the number into a report.

What Still Remains

We are not perfect either. The AEGIS Index gives the largest weight to the GEO axis to reflect priorities in the AI era, but GEO depends heavily on external signals and is relatively the least certain axis. We documented this trade-off with its rationale on screen and in docs, but the structure itself has not gone away. And for Google-side search volume in C³ Cube, we have not yet secured a reliable measured source, so some reliance on estimation remains. Our standard is to make visible where we are incomplete rather than claim perfection.

Self-Check -- Where to Start Right Now

Pick the one number you rely on most in your current marketing dashboard and ask it the three questions above. For site-structure readiness, AEGIS Insight lets you see on screen which items are measured and which are estimated. That a score does not substitute for citations themselves is covered in our AEO KPI design post.

Closing Thoughts

A number's value comes not only from its accuracy but from how visible it is how it was obtained. Calling an estimate an estimate does not diminish a tool's value; it protects it. If there is a number you are about to copy into a report today, start by checking whether its name overstates the method.

Frequently Asked Questions

Q.Is using estimates a problem in itself?

A.No. Where perfect measurement is impossible, estimates serve as useful directional indicators. The problem is presenting an estimate so it looks measured, or leaving it unclear by what method a value was obtained. An estimate that is labeled as one, with its basis shown, is honest information.

Q.How can I tell whether a marketing score is measured or estimated?

A.Ask three questions. Where did the value come from (collected directly or inferred by a model)? If you rerun it with the same input, does it give the same value? When a value could not be obtained, is it left blank or filled with something else? A score that answers none of these is fair to question.

Q.Can I not trust scores produced by an AI model?

A.It depends on the use. A value summarizing signals a model observed through search grounding is useful for direction but should not be read as a precise measurement. Even the same model can vary between runs, so honest labeling uses the median of repeated measurements and states the variation range.

Q.Doesn't leaving a blank make the report look incomplete?

A.In the short term it can. But if a report filled with unsupported values later turns out to be wrong, even the other accurate figures in it come under suspicion. Writing "could not be measured" protects trust over the long run.

Q.Are your own tools still imperfect?

A.Yes. As this post discloses, limitations remain: a structure that gives the largest weight to the least certain axis, and some metrics with no reliable measured source. Our standard is to make visible where we are incomplete rather than claim perfection.

How to Apply This — Step by Step

  1. 1

    Label the source type of every value

    Mark each figure on screens and in reports as directly collected, model-inferred, or a pre-publication self-assessment. If a single score mixes them, state the composition too.

  2. 2

    Check that names do not overstate the method

    Use names like measured value or precision analysis only when the value was actually obtained by that kind of method. A name can change the behavior not only of people but of the models that read your prompts.

  3. 3

    Verify behavior when a value cannot be obtained

    Induce a failure yourself and check whether the system leaves a blank or marks it unmeasurable, or fills it with a plausible default or an AI-inferred value.

  4. 4

    Trace whether labels are actually used in calculation

    Follow the code or pipeline to confirm that data labeled as measured is really read in the final score calculation. A label without the calculation behind it makes the labeling false.

  5. 5

    Show limitations on the same screen as the number

    Put limitations such as single-model estimation, sample size, and the variation of repeated measurements right where the figure appears, not in a separate document.

Estimate LabelingMeasurement ReliabilityData TransparencyMarketing MetricsAEOGEOMarketingPivotProjectAEGIS
🌐 Prefer to read this in Korean?한국어로 보기 →