Vanity Metrics: The Numbers to Stop Steering By
A vanity metric is a number that looks good in a report and changes no decision, such as total sign-ups, followers or page views. Most only climb, or they lack a denominator, so they can rise while the business weakens. A startup replaces each one with a rate, or a count of customer value, that a named owner can move.
Picture a gym in the second week of January. A line forms at the sign-up table, and the whiteboard behind the front desk says 1,400 members, up 300 since New Year's. By March the parking lot has open spaces again. The whiteboard still says 1,400, because almost nobody cancels a membership they've quietly stopped using.
Startups keep the same whiteboard. Total sign-ups since launch go up nearly every week, and so do followers. Both make a good slide. Meanwhile the customers who arrived in the spring may already be drifting away, and the slide can't show it.
A vanity metric is the number on that whiteboard. Two questions sort the rest of your numbers. Could this one rise while the business gets worse, and would anyone act differently if it fell?
What makes a vanity metric
The gym's member count fails for a reason you can name. Most vanity metrics share one of four traits, and any one of them should make you suspicious:
- Only climbs: a running total since launch can't fall, so it can never warn you about anything.
- No denominator: 2,000 visitors means little until you know how many became leads. A count without the group it came from is missing half its meaning.
- Moves without you: a giveaway or a wave of bot sign-ups can lift it. The number alone can't tell those apart from real growth.
- Feeds no decision: if it jumped or dropped next week, nobody would do anything differently.
The fourth trait decides the case. A number that changes no decision is trivia, however good the chart looks.
Vanity metrics and their replacements
The gym has an honest number too: check-ins per member each week. It falls in February while the whiteboard holds steady, which is exactly when the owner needs to know. Most vanity metrics have a cousin like that, a rate or a count of value that tells you what to do next.
| Vanity metric | Problem | Replace with |
|---|---|---|
| Total sign-ups | Counts everyone who never came back | Share of new sign-ups who reach the core action in week one |
| Page views | Measures attention alone | Visits that become leads, as a rate |
| Followers | A giveaway can inflate it overnight | Conversations or leads that started on the channel |
| Email opens | Says nothing about interest | Replies, or clicks that turn into meetings |
| Lead count | Rises whenever the bar drops | The share of leads that sales accepts |
Put the replacement on the report and move the original to a supporting list. The last row needs agreed definitions before it means anything, because a lead count climbs fastest when someone loosens what a lead is. MQL vs SQL sets those definitions.
Running the action test
The table covers the usual suspects. Your own reports hold others, and one test finds them. Run it once a quarter:
- List every number in your dashboards and your board deck.
- For each one, ask what you'd do differently if it moved sharply next week, in either direction.
- If the honest answer is "nothing, we'd just note it," move the number to the supporting list.
- Check each survivor for a denominator and a time window, and add whichever is missing.
- Give each remaining number one named owner and the decision it feeds.
Demoting a number doesn't mean deleting it. Total sign-ups still help you plan support staffing. They just stop sharing a page with the numbers that steer. The executive dashboard holds the handful that survive, and the weekly scorecard gives each one a meeting.
When a vanity metric earns its place: some customers pay for the number itself. A sponsor prices a newsletter on its subscriber count, and a podcast sells ads on downloads. When the count is what the buyer pays for, it drives revenue, so track it like any other revenue driver.
Vanity metrics in disguise
Rates pass the action test more often than totals, which makes them easy to trust too soon. A rate can mislead in quieter ways:
- Blended averages: a steady churn rate can hide a new group of customers leaving twice as fast as the old ones. Split the number by signup month before you call it stable.
- Tiny samples: a landing-page test with a thousand visitors per version can't tell 3.6 percent from 4 percent. A gap that small takes tens of thousands of visitors per version to confirm.
- No volume shown: a 50 percent reply rate on four emails reads like a breakthrough. Put the count beside the rate.
- Moved goalposts: a conversion rate rises the week someone changes what counts as a conversion. Write the definition down, and date every change to it.
A written definition catches most of these. A measurement plan fixes the definitions before a channel launches, so nobody can move the goalposts after the results come in.
Retiring your vanity metrics
A gym owner who counts check-ins sees February coming in time to call the members who stopped showing up. Your reports should give you the same warning. Run the action test on your next board deck, and keep only the numbers that would change what you do. Then tie each one to the north star it feeds.
Someone has to own those definitions, and RevOps is usually the role that does. If nobody on your team has the time, my fractional CMO work starts with a free diagnostic that ends in a written roadmap, and you can run the roadmap yourself.
Count the people on the treadmills.
Common questions
What's the difference between a vanity metric and an actionable metric?
The difference between a vanity metric and an actionable metric is whether a change in the number calls for a specific response. An actionable metric, such as week-one activation rate, points to a step to fix when it drops. A vanity metric, such as total registered users, can move for reasons nobody controls and leaves the team with nothing to do.
Is revenue a vanity metric?
Revenue counts as a vanity metric only when it's reported without its costs. Gross revenue can climb while margin shrinks, for instance when deep discounts or an expensive channel drive the growth. Reported beside gross margin, or as net revenue retention, revenue becomes one of the most decision-ready numbers a startup has.
Are social media followers always a vanity metric?
Social media followers are a vanity metric for most B2B startups, because a giveaway or a follow-back campaign can inflate the count without adding a buyer. Followers become a useful number when the business sells that audience directly, as a sponsored newsletter does, or when the count sits beside the leads the channel produces.
How do you get a board to stop asking about a vanity metric?
Getting a board to stop asking about a vanity metric works best with the replacement ready. Show the vanity number beside the rate it hides, such as total sign-ups next to week-one activation, and name the decision the new number will drive. Most boards accept the swap once they see what it lets the company catch early.