The Question of Reach as a Viable Metric

172 Shares 172 Shares ×

hopes for good metrics

Last week, I posted the following update across a couple of networks:

Please don’t use “Reach” as a viable metric. It’s a BS number to get clients to pay more for data: don’t go down that road

The update resulted in some great discussion on both sides, with agreement and counterpoints on how viable reach is as a metric.

These included:

Let’s not be so quick to disregard Reach. After all, big companies buy Superbowl spots exactly for the Reach it gives them. – Dino Dogan.

Reach has 2 parts. How many people saw something (actual reach) and how many potentially could see something (fictitious reach). If I have a reach of 2 million but at the time I post every day only 3 people see the post what is the real reach? 3. – Howie Goldfarb.

Reach is definitely ephemeral because reach doesn’t really matter. Action does. Click throughs, downloads, sticky site traffic, purchases, that kind of thing is what really matters. – Shelly Kramer.

But what about quantifiable reach? Meaning, reach is tracked against response & metrics? – Mitch Arno.

All good points – yet (for me personally, anyhoo), I’d disagree on Dino and Mitch’s points on when reach could be used as a viable metric. Here’s why.

The Attraction of Reach

By definition, reach is simply a potential number. It can be broken down a few ways:

  • On social networks, reach can be the amount of people that may interact with your content, through either seeing it directly, or through one of their connections, or even a social ad;
  • On blogs, reach can be the amount of people that interacted with your post, through direct readership, a shared link, or a forwarded email;
  • On media, reach can be the amount of people that could see a TV show, a print ad, billboards, etc, through direct contact or shared discussion later.

Marketers like to use reach as a client metric because it sounds impressive. Instead of having to be restricted by real actionable data, reach can be used instead.

  • “Twitter User X has 1,000 followers, but a reach of 100,000. That’s 100,000 new customers just waiting for us.”
  • “Blogger Y has 10,000 subscribers as well as 1,000 followers. Even more new customers just waiting for us.”
  • Free Local Newspaper Z has a reach of 50,000 homes delivered to. That’s 50,000 new customers waiting for us.”

And so on, and so on. Which would all be great and dandy if reach was a viable metric, but it’s not.

The Problem With Reach

The reason reach isn’t truly viable as a metric is simple – it’s based on the hope that eyeballs are available.

On Twitter, for example, reach is defined by the potential audience of a user you’re connecting with. So, someone may have 1,000 followers, but the followers of these connections combined may equal 100,000 (at least).

When User X with the 1,000 followers tweets something, the hope is that person’s followers will see the tweet and reshare with their audience. If a follower has 100 followers themselves, that’s now another 100 eyeballs to potentially see the share. Potentially being the key word.

Because no-one is online all the time, just waiting for a tweet. And that’s just the live, organic stuff – when you add bots and fake followers into the equation, things become even less impressive, as we can see by the following example of the same Twitter power user.

Twitter Reach

In the image above (click to expand), I used TweetReach to gauge the potential reach and visibility a certain power user could offer. The user in question has over 217,000 followers.

As you can see from the image, the estimated reach is just short of 200,000, with potential exposure (followers of followers) at just over 2.6 million. Impressive, right?

But this is where reach as a metric falls down, as we can see in the next image.

Status People Fake Follower Check

Using the Fake Follower Check software from Status People, I entered the same user’s details, to see how many of his 217,000+ followers were real. The definition of “real” here is simple – active and not bots or fake accounts.

As you can see by the image above, there’s a huge disconnect between how many of this user’s 217,000 followers are classed as real, active followers.

Suddenly, instead of having access to a potential 2.6 million impressions (which is what the potential reach of the followers pre-fake check would give), you’re now down to 182,000. Still impressive, but a hell of a lot less than 2.6 million.

And that’s assuming that each of the 182,000 “real” numbers are around when this power user sends out a tweet.

This is why reach is such a crappy metric to be using – and yet many marketers use it to increase their rates when charging clients for audience size.

The Real “Reach” Metrics

To Dino and Mitch’s earlier points at the start of this post – I agree, to a small degree, where reach is used by the likes of the Super Bowl ad buy agencies, as well as quantifying the reach. But there’s still the overarching problem that it’s a hit-and-hope metric.

In the Super Bowl example, companies use data from Nielsen, one of the world’s leading audience measurement companies – but it’s aggregated data based on average audience behaviour, versus specific targeted individual behaviour. This means it doesn’t take into account people getting up during ads to grab more beer, food, etc.

With Mitch’s example of quantifying reach, this gets closer to viable metrics, but it’s still relying on the bigger number that can’t be quantified. If we move the conversation over to quantifiable metrics based on more in-depth filtering, then we can get more actionable insights.

  • Ignore the big number and target the demographic instead – male/female, locale, language, age;
  • Use search history to identify common keywords and themes relevant to your brand;
  • Use software like oneQube to identify when users are on Twitter, for instance, and who they’re talking to. Do the same with software relevant to the platform you’re interested in;
  • Collate this information with Google Analytics or similar to understand what content is attractive and what content was physically shared and acted upon;
  • Set goals based on real action (as Shelly mentioned in her examples) – click throughs, recommendations, downloads/purchases, referrals, etc;
  • Compare these actions to the target audience size to determine reach vs. actual ratio.

By doing this, you’re now beginning to bypass reach alone and get to the real nitty gritty –  your true audience size, as well as the real numbers to filter and use as a proper business metric.

Reach itself can be a starting point when it comes to social proof and how many eyeballs could be reached – but only as a starting point. You need to then do the legwork to define your captive audience.

Otherwise you’re constantly just reaching for what could be – and few businesses, if any, can live on that alone.

Join over 11,000 smart subscribers

Get my latest updates delivered straight to your Inbox as soon as they're published (I respect your privacy and will never spam you)

172 Shares Twitter 98 Facebook 0 Google+ 38 Buffer 23 Buffer LinkedIn 13 Email -- Email to a friend 172 Shares ×
About Danny

Danny Brown is Chief Technologist at ArCompany and an award-winning marketer and blogger. His blog is recognized as the #1 marketing blog in the world by HubSpot. Danny is also co-author of Influence Marketing: How to Create, Manage and Measure Brand Influencers in Social Media Marketing.

57 comments
Dennis Galayda
Dennis Galayda like.author.displayName 1 Like

"What can be measured doesn't always matter, what matters can't always be measured" - Einstein. Here's the scenario: Customer X stops in the same coffee shop every morning, gets a  $4 dollar beverage all the time, then is out the door, you can measure that in spreadsheet, no problem. Customer Y stops in the same coffee shop only once a week, gets a 1 buck coffee, but, Y always hangs out, chatting it up with others in shop, talks to friends on his phone, tells them to stop in at the coffee shop Y is hanging out at, has business meetings there, and yada, yada. That is tough to measure. Because now you measuring the "depth/value" of a "brand champion" of that coffee shop. Here's another: Give a little kid all the best equipment and things for her games each and every time - but, you're not at any of her games, you can measure that in line item on what you bought her. Give the little kid just the equipment she needs for the games, but, this time, you're there at her games, cheering her on - how do you measure that? 

Danny Brown
Danny Brown moderator

@Dennis Galayda Great points, Dennis, and ones that tie directly to the situational impact on influence our book talks about. There are ways to measure, but you need to be aware of each factor first and build personas, scenarios and actions for each one. If a business like the coffee example isn't aware of each of its customers and what value it's bringing, it's missing a huge opportunity. There are some simple things that can be done; there are complex things that can be done. Which one is right depends on the scenarios built.

janlgordon
janlgordon

@2morrowknight @DannyBrown @AnnTran_ @pramitjnathan Thank you Sean, this was a great article Danny is the best!!

HughAnderson
HughAnderson like.author.displayName 1 Like

Hi Danny, I've been meaning to chime in on this for a week now! Most of it has already been said as I agree with the general sentiment that reach can be a dangerous metric, particularly if viewed in isolation and not extended to a more meaningful business metric.

As you know, in Inkybee we are quoting an audience reach metric as part of the of the mix and doing some maths to get to "potential unique viewers of a story in the active period consisting of the days immediately following its publication". It's a range and it's always flawed to some extent, but should be helpful.

Also, just to add to your reading, have you read @kdpaine 's post on "The State of Measurement Standards"? There's a lot of good work going on here to standardise a number of definitions including reach. I would imagine the section on "influence and relevance" might interest you too :) 

http://kdpaine.blogs.com/themeasurementstandard/2013/01/the-state-of-measurement-standards-january-2013-its-a-bridge-its-a-bridge-.html 

Danny Brown
Danny Brown moderator

@HughAnderson Hi mate,

Great point, and one that @Derek Skaletsky from @Traackr makes well in his comment too. Perhaps I should have quantified the standalone reach use I meant to convey in the post. The background would also add more context - it was primarily based off a Twitter bio I saw, where the user was promoting his Triberr reach as a measure of influence.

Um... I love what Dino and Dan are doing over at Triberr when it comes to bloggers getting more eyeballs on their content, but the Tribes can consist of multiple topic blogs as well as ones that are very specific in the type of content they share.

So, a vegan blogger isn't going to a appeal to a meat recipe blogger's audience (as a base example). So to say the Triberr reach in such a scattered category is worth using as a measure of someone's influence? Yeah, okay... ;-)

Cheers for KD's link, I'll check it out for sure.

Latest blog post: The Third Wave of Influence

Anthony_Rodriguez
Anthony_Rodriguez like.author.displayName 1 Like

I think that the "metrics" social media provide is part of the problem. The other is the old mindset that eyeball potential is a relevant measurement. And since a lot of businesses out there still have an old guard installation, it's their requirements some are appeasing. It has to be our job to get past the superficial and into the meaningful measurements that are truly making a difference and showing the value of marketing.

Danny Brown
Danny Brown moderator

@Anthony_Rodriguez When you say "the metrics social media provide" as being the problem, Anthony, are there ones you specifically feel are weak?

Completely agree in showing value in all that we do, just curious what metrics you feel work, and which don't (currently)?

Cheers!

Latest blog post: The Third Wave of Influence

Anthony_Rodriguez
Anthony_Rodriguez like.author.displayName 1 Like

@Danny Brown Well reach for one. I think it's just as pointless as impressions and ad equivalency. But really a lot of the metrics are confusing in their descriptions. You have to go with the measurements that resulted in actual views to determine its true impact. 

Jon Loomer
Jon Loomer like.author.displayName 1 Like

Holy crap, how did I miss this? I've been fighting this fight in regards to Facebook.

Wrote this:

 http://www.jonloomer.com/2013/02/24/facebook-reach-insights-reporting-bug/

And then I invited Emeric Ernoult to post his response because he disagrees:

http://www.jonloomer.com/2013/03/06/response-facebook-reach-is-the-most-important-performance-metric/

Regarding Facebook, I prefer the "Consumer" and "Consumption" metrics since they count everyone who has clicked ANYWHERE within a post. While that may not include everyone who has seen it, it gives me the minimal number of people who saw it. It's a much more accurate gage than Reach, which is based on "could have."

Danny Brown
Danny Brown moderator

@Jon Loomer Hey there Jon,

Cheers for the links, mate, I haven't had a chance to read those yet. But, yes, based on what you quantify at the end of your comment, I think I'll probably be agreeing with your take. Look forward to reading.

Latest blog post: The Third Wave of Influence

webtechman
webtechman

Examining the Question of Reach as a Viable Metric bit.ly\/16taStz9L@DannyBrownown v@AnnTran_a@janlgordondon

janlgordon
janlgordon

@webtechman @DannyBrown Thank you Daniel for the RT, we can always count on Danny for great articles!!

ClayMorgan
ClayMorgan like.author.displayName 1 Like

I have a free paper among my company's products. It "reaches" 54,000 homes in our county. That's a lot of potential eyeballs. But I know that not everyone reads the free paper. Yes, we have testimonials to our success, but I can't come out and honestly say that people in 54,000 homes read the free paper. We are careful to explain to people that we do throw 54,000 into driveways and that is what the number means.

It amuses me....we have an "old school" editor we finally got on Twitter. He'll send a tweet then come to my office and ask if I read his tweet. He doesn't seem to understand if I'm not on Twitter at the time, and it gets too far down the feed, I'm going to miss it! It's a shame that we can't ask every follower if they saw our tweets.

Latest blog post: Livefyre Conversation

Joshua Wilner/A Writer Writes
Joshua Wilner/A Writer Writes like.author.displayName 1 Like

"Reach" really messes with conversion rates too. What is the point of saying you have a reach of 1 billion when your "actual" reach is far less. If you start crunching numbers based upon what the former and not the latter you run into unnecessary problems.

Howie Goldfarb
Howie Goldfarb like.author.displayName like.author.displayName 2 Like

It doesn't matter what reality says or the math. People want to believe this crap so they do. Most Social Media agencies and evangelists are still pushing it as a direct marketing channel to make you rich for pretty much just a few mins a day of your own time.

Pretty sad.

Derek Skaletsky
Derek Skaletsky like.author.displayName 1 Like

Ahhh...a great topic and post, @Danny Brown   One after my own heart.  A few comments:

#1 - I don't think that Reach, as a concept, is terrible. The first place it gets ugly is when people focus on the raw, quantitative measures of Reach and try to drive some real value (or worse, truth) in them.  Because the raw numbers are always wrong.  1B viewers, 200k listeners, 10k unique visitors, etc. They are all wrong. 'Relative' Reach is a better approach.  The raw numbers may be wrong, but comparing Reach metrics of the same type can offer some insights. Point is - exact reach is a unicorn. It shouldn't even be considered as something real. 

#2 - The second place Reach becomes an ugly topic is when it is viewed in a vaccum. Or as an end-all metric. In some ways, I think Reach gets a bum rap.  Reach itself shouldn't bear the blame for people's misuse and skewed interpretations of its meaning/value.  (I am speaking for Traackr here) We think (relative) Reach is one of the bricks in understanding what we are all looking for - impact (or really, scalable impact).  We happen to use the word influence, instead of impact, but that is just a matter of semantics. Reach, in a vacuum, has very little (if any) value. A certain web page may generate a lot of eyeballs b/c it is very good at pulling search traffic to it. But if everyone that visits the page quickly moves off it and doesn't engage at all, does its Reach matter? Obviously, no. So for us, Reach is a brick. The other bricks are Resonance (engagement) and, most importantly Relevance. It's those three bricks taken together that gets us close to what we what.  Which is, again, impact.  

The analogy I like to use is with late night talk show hosts.  If you are trying to make an impact on the global warming policy conversation, you can choose to appear on:

Jay Leno - High Reach; Low Resonance (NO ONE talks about Jay Leno at the water cooler); zero Relevance

David Letterman - Medium Reach; Medium Resonance; zero Relevance

John Stewart - Low Reach; High Resonance; High Relevance

Obviously an appearance with John Stewart with generate the highest impact.  The one with the highest Reach (Jay Leno) will have the lowest impact on the stated goal.  It's a very simplistic example, but I think you get the point...

#3 - Your point on POTENTIAL Reach is a very important one.  The word POTENTIAL really reframes the thinking around the topic of Reach - and for us, influence.  I have a lot to say about that and said it a while ago in this post on Potential Influence:  http://traackr.com/blog/2011/08/potential-influence/


Again...great post, @Danny Brown.  Wish I had more time to discuss...


Danny Brown
Danny Brown moderator

@Derek Skaletsky Hey there mate, always good to hear the views from the developer side of things. :)

That's the biggest thing right there, in your opening sentence: "Reach, as a concept, is not terrible." Like you say, it's when used as a standalone metric that things get dumb. I really don't care if someone has a million reach - as @HowieG mentions, it the true reach is only 3, then why do I care about all the other potential eyeballs. 

Potential is great, as long as these folks are actual potentials, versus potentially potentials. ;-)

Got your post open to check soon, cheers mate.

ExtremelyAvg
ExtremelyAvg like.author.displayName 1 Like

I love the fake follower place!!!

I have always been a proponent of blocking the garbage. People always question me as to why I bother and I say that I want to know how many real followers I have. I'm pleased to announce (read brag) I just ran ExtremelyAvg and got a 96% Good!

Danny Brown
Danny Brown moderator

@ExtremelyAvg Exactly, mate - what's the point in building on a house of straw? it's not as is it's actually going to get you anything in the long run, and isn't that the most important thing?

ExtremelyAvg
ExtremelyAvg like.author.displayName 1 Like

@Danny Brown @ExtremelyAvg I've used a metric I created, the listed:follower ratio to decided who I follow back and who I block and don't let follow me. In general, people who have a ratio above 5% are active and willing to engage in discussions about things like...well...I don't know...bacon? If the person's ratio is below 2%, then I usually block them. Between 2 and 5 and I let them follow, but I don't follow back until they've given me reason to believe they are going to discuss silly things with me. (Note: Guinea Pigs and Cats always get followed back...because...well...they're awesome!)

ExtremelyAvg
ExtremelyAvg like.author.displayName 1 Like

@Danny Brown @ExtremelyAvg I have a huge guinea pig readership of my books. The ROI on them is so high that I don't even bother to measure it because I know that is an important demographic. Not only do they buy my books, they send me pictures of themselves with the books. I post them on my blog. It is very cute.


Latest blog post: Underwood Scotch and Wry Ch 38


172 Shares Twitter 98 Facebook 0 Google+ 38 Buffer 23 Buffer LinkedIn 13 Email -- Email to a friend 172 Shares ×