Every analytics tool displays dozens of numbers. Page views, users, sessions, average duration, countries, browsers, screen resolutions. The risk is not having too little data but confusing the numbers that are pleasant to look at with the ones that help you decide. The distinction now has a widely used name: vanity metrics versus actionable metrics.
What a vanity metric is
A vanity metric has three typical traits:
- it tends to grow on its own, for instance a cumulative total of subscribers or downloads;
- it does not tell you what to do: whether it goes up or down, the action to take is unclear;
- it is easy to inflate without creating value, by buying traffic or publishing clickbait.
Total page views are the classic example. Doubling them with a viral article may not bring a single extra customer, while halving them by removing useless pages may improve everything else.
What an actionable metric is
An actionable metric links a change to a cause and suggests an intervention. It is usually:
- a ratio or rate, not a total: requests per hundred visits, percentage of completed checkouts;
- segmentable: it can be broken down by channel, page or device to find where to act;
- tied to a goal: you know which way it should move and why.
| Vanity metric | Actionable alternative |
|---|---|
| Total page views | Visits that reach a service page |
| Newsletter subscribers since launch | New subscribers per month and unsubscribe rate |
| Social media followers | Visits from social that complete an action |
| Average time on site | Share of readers who reach the end of an article |
| Total app downloads | Users still active after thirty days |
How many KPIs to choose
KPI stands for key performance indicator: if you have twenty, none of them is really key. For a small or medium site a three-tier structure works well:
- One primary KPI, tied to the purpose of the site: contact requests, sales, sign-ups.
- Two or three supporting KPIs that explain the primary one: conversion rate by channel, average order value, share of visits from organic search.
- Guardrail metrics, which prevent you from improving one number by making another worse.
Guardrail metrics
This tier is often forgotten. If the goal is more newsletter sign-ups, it is easy to achieve with an aggressive popup. But what happens to the people who were reading? Guardrail metrics answer that question:
- sign-ups up, but unsubscribes within a week as well?
- conversions up, but returns or refunds rising too?
- more contact requests, but of lower quality and never turned into work?
In my work, when a client asks to improve a KPI, I always suggest choosing together at least one metric that must not get worse. It is the simplest way to avoid optimisations that harm the site.
Context metrics
Some numbers are not KPIs but help interpret them: total traffic, the split between devices, seasonality. If requests drop thirty per cent in August, context tells you whether that is a problem or the usual summer lull. Context metrics should be watched, but not turned into targets.
How to test a KPI
Before adopting an indicator, put a few questions to it:
- If this number doubled tomorrow, would the organisation genuinely be better off?
- Can I name at least one action that would raise it in a healthy way?
- Can I measure it consistently, without the definition changing every month?
- Does the person looking at it have the power to act on it?
If any answer is no, the indicator should be rethought or demoted to a context metric.
Written definitions
Every KPI needs a written, shared definition. "Conversion" can mean form submitted, form submitted and confirmed, or a contact turned into a contract. If marketing uses one definition and management another, the numbers will never reconcile and discussions will revolve around the data rather than the decisions.
In short
- Vanity metrics grow easily but do not indicate what to do.
- Actionable metrics are often ratios, segmentable and tied to a goal.
- Choose one primary KPI, a few supporting KPIs and at least one guardrail metric.
- Context metrics help with interpretation but should not become targets.
- Every KPI needs a written definition and an owner who can act on it.
