How to tell a real SEO report from a vanity-metrics slideshow

Why bad SEO reports look so good

A monthly report has one job: tell you whether the money you spent turned into work you can verify and leads you can count. At a lot of agencies it has a different job. It exists to justify the next invoice, and it is built backwards from that goal.

Quick disclosure before we start swinging: this page lives on an SEO agency's site. We sell the thing we are teaching you to inspect. That is exactly why we publish our client work at /results/ from day one, baseline first, so you can hold us to the same standard this page describes.

Here is the pattern to watch for. When results are strong, reports get short. The agency leads with calls and booked jobs because that is the best story available. When results are thin, reports get thick. More charts, more green arrows, more numbers with impressive commas in them, and somehow no answer to the only question a Naples roofer or Cape Coral plumber actually has: did the phone ring more than it did before I hired you?

The vanity metrics, decoded

None of these numbers are fake. Each one measures something. The trick is that they can all climb for months while your revenue sits still, which makes them perfect cover for a campaign that is not working.

• Impressions. An impression is counted every time your site appears anywhere on a results page, including positions nobody scrolls to and searches from three states away. Tens of thousands of impressions can coexist with a silent phone. Impressions are a useful early signal that Google is testing your pages. They are not a result, and a report that headlines them for six straight months is stalling.
• Total keywords ranking. "You now rank for hundreds of keywords" usually means a rank tracker found your site somewhere in the top hundred results for hundreds of phrases, most of which no customer in Collier County has ever typed. What matters is a short money list: the searches someone types the day they need a seawall repaired or a crown for a cracked tooth. Movement on twenty of those beats presence on a thousand strays.
• Average position. An average across every tracked keyword is trivially easy to game. Add a pile of zero-competition phrases the site already ranks for and the average improves while the money keywords never move. If a report shows an average, ask for the list behind it.
• Traffic without source or intent. Sessions went up. From where, on which pages, searching for what? Blog visits from hobbyists in other time zones do not book med spa appointments in Naples. Honest traffic reporting separates local, commercial-intent visits from everything else, and admits the difference.
• Authority scores. Domain Authority and similar numbers are estimates invented by SEO software vendors. Google does not use them. They can be inflated with junk links, which is exactly what cheap link sellers do. A rising authority score paired with a flat lead count means someone bought decoration.
• Ranking screenshots. Local map rankings change with the searcher's location. A screenshot proves what one device saw from one spot at one moment, and that spot is often chosen kindly. Check from where your customers actually are, with a tool like our local rank checker, before you accept the framed version.

One near-miss worth naming: activity lists. A checklist of citations built, pages touched, and posts published is not a vanity metric, because you should absolutely see the work you paid for. It becomes one when it is presented as the result instead of the input. Work done is the receipt. Leads are the product.

What an honest monthly report contains

You can evaluate any agency's sample report against this list in five minutes.

1. A baseline, recorded before work started. Rankings, traffic, calls, and form fills as they stood on day one. Without a baseline, every future number floats free, and the agency gets to take credit for whatever happens, including snowbird season arriving on schedule.
2. Leads, counted by machines rather than vibes. Call tracking numbers that log each call and its source. Forms tagged by landing page. Google Business Profile calls and direction requests. If lead tracking is not set up yet, the honest sentence is "we cannot count leads yet, and here is when we will."
3. Movement on keywords you chose together. A short list of searches that describe your actual services in your actual service area, agreed on before the campaign starts so it cannot be quietly swapped later.
4. The work, and the reasoning. What was published, fixed, or built this month, and why those choices over others. This is where you catch an agency coasting.
5. Next month's plan. One paragraph is enough. Its absence is how set-and-forget retainers hide.
6. The flat months, unretouched. Included, explained, and owned.

Format matters too, though less than content. A report a business owner can read over coffee beats a forty-page PDF export designed to exhaust you into trusting it.

The flat-month test

Here is the fastest single check we know. Ask any agency you are vetting to show you a redacted report from a month where things went sideways, and what they told the client that month.

Every real campaign has those months. Rankings wobble when Google updates. Content takes time to index and links take time to age, which is why the early stretch of a campaign is often quiet; we lay out the honest timeline in how long SEO takes. Southwest Florida adds its own rhythm on top: a Marco Island charter captain or a Naples pool builder watches search demand swell in season and thin out through late summer no matter how good the SEO is.

An honest report names those forces. A vanity report hides them by switching headline metrics after looking at the data, leading each month with whichever number happened to go up. So if a year of sample reports is uniformly up and to the right, you are not looking at measurement. You are looking at marketing.

Six reporting questions to ask before you sign

1. Can I see a sample monthly report from a current client, redacted?
2. What baseline do you record before work starts, and do I get a copy?
3. How exactly do you count a lead? Which tool, which phone numbers, which forms?
4. Which keywords will appear in my report, and who picks them?
5. What does the report look like in a month where nothing moved?
6. Who owns the tracking data and dashboards if I leave?

That last question crosses into contract territory, and reporting is only half the paper trail. Ownership of your site, content, and tracking accounts on exit is its own set of traps, and we walk through those in SEO contract red flags.

One newer wrinkle: if the agency sells AI search work, reporting discipline matters double, because AI visibility claims are even easier to fudge than rankings. We cover how to pressure-test those claims in verifying an agency's AI citability claims.

And if you want the full vetting sequence rather than just the reporting slice, start with how to choose an SEO company, which puts every check in order.

How we report, so you can hold us to it

We are not going to pretend to be neutral here, so we will be inspectable instead.

We have exactly two clients as of July 2026, and both case studies went up the week they signed, baseline first: SWFL Media Blasters and Pediatric Dentistry of Florida. Publishing from day one means there is nowhere to hide. If a month is flat, the page will say the month was flat. We never publish invented results and we never promise rankings, because nobody can honestly promise either.

Every plan we sell includes a monthly ranking and traffic report against that baseline. Our Growth plan adds call tracking with a live lead dashboard, so the lead count in your report is a log of real phone calls you can listen to, not an estimate. The month-by-month walkthrough of what we deliver and how to read our report lives at what you get each month.

Whether you hire us or someone else, keep the standard. A report that starts from a baseline, counts calls, shows the work, and includes the bad months is not a lot to ask. It is the minimum for handing someone money every month.

Frequently asked questions