Vanity vs Actionable SaaS Metrics: How to Tell Them Apart
What Is a Vanity Metric?
Let me get one thing out of the way first: every metric looked at in isolation is a vanity metric.
Signups up 300%, traffic up 50%, MRR up 10%. None of it means anything until you add context and compare it with other data.
Vanity metrics are easy to track, look big and make you feel good. But they give no real insight into the business, and they keep rising almost no matter what you do.
Eric Ries made the contrast in a 2009 guest post on Tim Ferriss's blog: vanity metrics can make you feel good, but "they don't offer clear guidance for what to do." Actionable metrics tie a specific change to a result, so you know what to do next.
The classic example is total customers since launch. It goes up with every new customer, whatever your churn, and tells you nothing about how the business is doing.
Click-through rate is a less obvious one. A higher CTR means nothing if the extra clicks don't turn into users or revenue.
Why Vanity Metrics Are Dangerous
The metrics a company tracks flow down from its leaders. If the CEO or a VP judges the growth team on vanity metrics, the team will work to improve those numbers, not growth.
Ries describes the other side of it: when vanity numbers go up, everyone credits whatever they were working on, and when they go down, everyone blames someone else. Each person ends up living in their own version of reality.
It's the job of founders and VPs to build a culture where real growth matters more than good-looking numbers.
Watch both percentages and absolute numbers, too. "MRR grew 10%" and "MRR grew by $10K" tell different stories depending on where you started.
Common Vanity Metrics in SaaS
These are the vanity metrics I've seen most often in B2B SaaS, and cross-checked with other experienced marketers:
It sounds crazy at first, but traffic is the most common vanity metric. For a media site, traffic and pageviews are the business; for a SaaS, conversions, MRR and churn matter far more.
You might get 100,000 visitors a month, but if the path from visitor to user doesn't work, more traffic changes nothing. Visitors who aren't your target customers don't count either.
If you lack traffic, go get it. Otherwise, fix the conversion funnel first.
A running total of users or paying accounts keeps rising as long as you add more than you lose. It looks great on a slide and says little about health.
Still, keep a rough number in mind. Some growth tactics only work once you have a minimum base of paying users.
Yes, I said it: list size is one of the most overvalued metrics out there. Marketer Justin Brooke put it well years ago: you can have hundreds of thousands of subscribers and make peanuts, or a few hundred and make six or seven figures.
What matters is who the subscribers are, whether they trust you, and whether they actually read.
When I ran my old growth blog, WeeklyGrowth, the list was small, but it was full of founders and marketers from serious startups. That was worth more than a bigger, random list.
The same goes for your SaaS. If you target busy executives, don't write huge posts just because they might rank.
Write tight, useful posts they'll actually read and subscribe for.
Impressions are a staple of big-company reports, and nothing to get excited about on their own.
Read them next to clicks, cost and conversions, though, and they help you judge an ad's angle and placement.
A free plan can pile up signups fast. If few of them ever pay, the signup count is a vanity number.
Track how many free users become paying customers, and what each free user costs you to serve. Our freemium vs free trial guide covers the benchmarks.
Every Metric Can Be a Vanity Metric
Conversions, paying users, ARPU, traffic, MRR: almost any metric becomes a vanity metric when you look at it alone. Two examples:
| The headline | What it can hide |
|---|---|
| "MRR grew by 50%" | MRR went from $1,000 to $1,500, and it took $10,000 of spend to get there. Not a good move. |
| "Conversions rose by 30%" | Less traffic, better targeted, on a lower budget: the conversion rate went up, but the number of new customers and the revenue per user both fell. |
A good growth lead keeps the whole picture in view. Judge every new activity by how it moved the metrics around it, not just the one it was meant to move.
Three Ways to Make Metrics Actionable
We've seen what vanity metrics look like, and how even good metrics turn into vanity metrics in isolation. Here are three tools that keep them honest.
1. Cohort analysis
Strictly, it's a method more than a metric. ChartMogul describes its cohorts as grouping customers by when they started their first subscription, then tracking churn, retention and conversion for each group over time.
Don't read every cell. Look at the big picture and find the patterns.
In the chart above, the February and April 2014 cohorts churn the most from month four onwards. So ask why: did a feature ship or disappear, did pricing change, did a different kind of customer sign up?
Find the cause, then see whether you can influence it.
2. Month-by-month comparisons
The view I've found most useful is a simple 12-month sheet: one row per month, with these columns.
| Column | What it shows |
|---|---|
| Free trials or signups | How many people entered the funnel |
| New customers | How many of them started paying |
| Signup-to-paid rate | The share of trials or signups that became paying customers |
| Lost customers | How many paying accounts left |
| Active customers | Paying accounts at the end of the month |
| Revenue | What the month brought in |
| Churn | The share of customers or revenue lost |
| ARPU | Average revenue per paying account |
| LTV | What a customer is worth over their lifetime |
Read across the rows to spot what changed and why. If traffic rose 50% over five months but signups rose only 5%, something is broken: the signup flow, the audience, or both.
Fix that before you buy more traffic.
3. Experiments you write down first
Running growth experiments and documenting them is one of the best habits you can build. I modeled my process on Referral SaaSquatch's growth-experiment template and adapted it over time.
Each experiment gets four parts, written before it starts:
| Part | Example |
|---|---|
| Hypothesis | A signup form with 5 required fields discourages people from signing up. |
| Test | Cut the required fields to 2. Run it for at least 2,000 signups and 4 weeks, at 99%+ statistical significance, and watch signup-to-paid conversion too. |
| Goal | Increase signups by 10% without reducing signup-to-paid conversion. |
| Minimum success | Signups up at least 5% at 99% significance, with signup-to-paid conversion down by 0.3% or less. |
Writing the success line before the test starts stops you from moving the goalposts afterwards.
The Same Trap in E-commerce Pricing
The same habit shows up in e-commerce pricing, the world we work in at Altosight. A few common pairs:
| Vanity | Actionable instead |
|---|---|
| Competitors or URLs tracked | Where your prices sit against the competitors that matter, product by product. That's the job of competitor price monitoring. |
| Price changes made | Margin and sales on the products you repriced, before and after |
| MAP violations found | Violations resolved, how fast, and which resellers keep repeating them. That's where MAP enforcement earns its keep. |
Judge your pricing data by the decisions it changes, not by how much of it you collect.
The Bottom Line
Every metric is a vanity metric when you look at it alone, without context. The usual culprits are traffic and subscriber counts; the fixes are cohorts, comparisons and experiments written down in advance.
Being data-driven is great, but you still need judgment and experience. Most companies gather data and few act on it, so make acting on it, and tracking what happens next, a habit.
FAQ
A vanity metric is a number that looks impressive and feels good but doesn't tell you what to do next.
Total signups since launch is the classic example: it rises with every new customer, whatever your churn.
An actionable metric ties a specific change to a result, so you know what to do next: an A/B test result, a cohort's churn, a signup-to-paid rate.
A vanity metric just goes up or down without telling you why.
The usual suspects:
- Website traffic
- Total users or customers since launch
- Email subscribers and social followers
- Ad impressions
- Free signups that rarely convert
On its own, yes, for most SaaS companies. Traffic only matters if visitors turn into users and customers, so track the conversion funnel and revenue next to it.
For media sites, traffic is the business, so there it's a core metric.
Cohort analysis groups customers by when they started, usually by signup month, and tracks churn, retention or revenue for each group over time.
It shows patterns a single average hides, such as one month's cohort churning much faster than the rest.
Eric Ries laid out the contrast between vanity and actionable metrics in a 2009 guest post on Tim Ferriss's blog.
Instead of vanity numbers, he recommended split tests, per-customer metrics, and funnel and cohort analysis.
Boost Your Retail Pricing!
In just 10 minutes, learn how Altosight's automated monitoring and repricing tools can boost your competitive edge.
- 41 Agiou Dimitriou, Piraeus, 18546, Greece
- +30 210 444 7186
Popular
Subscribe to our Newsletter
© 2026, Altosight. All Rights Reserved.
GO TOP