Which Facebook metrics flub are you? Ad buyers rate Facebook’s 10 measurement errors
You can almost set your watch to it. Yesterday, in the heat of an upfronts season in which TV stalwarts are taking pots at digital media, Facebook announced its 10th measurement error since September. Per usual, Facebook’s mistake elicited demands from ad buyers for more third-party verification on the platform. And the collective effective of the errors is getting on buyers’ nerves.
“There is a general sense of ‘what could be next,’” said Jessica Baum, media director at Traction. “Even though the last error was smaller in scope, it still impacts overall trust.”
Facebook’s latest error stems from a bug that led it to miscalculate how often users clicked through its carousel ad units, which let brands show multiple images and link to their properties. Facebook declined interview requests for this story.
The error comes during the upfronts, which TV networks are using to push back against their digital competitors. For example, during a Fox presentation on Monday, Family Guy creator Seth MacFarlane made a joke about YouTube ads “shown on ISIS vids.” Buyers said the error will give networks ammo for their presentations, but it won’t impact budgets.
“I’m sure there will be keynotes at the upfront who bring this up,” said an ad buyer requesting anonymity. “But Facebook has such scale. As long as people keep visiting the platform, advertisers will still have an appetite for Facebook regardless of what gets said this week.”
Facebook claims that the error, which only occurred within the mobile web, affected just 0.04 percent of its ad impressions. But it went undiscovered for nearly a year, and Facebook is refunding affected advertisers, which it hasn’t done after its other errors.
“If there are mishaps, we want to address them with Facebook,” said Jake Rosenberg, senior digital media strategist at Red Tettemer O’Connell + Partners. “It is better [for Facebook] to address it head on and control a narrative because it works in their best interest to call it out and say this is what we’re doing to fix it.”
Digiday asked buyers to anonymously rate each of Facebook’s measurement errors on a scale of 1 to 10, with higher numbers representing more egregious errors. The errors are ordered by recency.
Wrongly charged advertisers for video carousel clicks, reported in May
A bug caused Facebook to miscalculate how often users clicked through its carousel ads. But the error applied to just 0.04 percent of the platform’s impressions, according to Facebook. One ad buyer called the carousel units “fringe.”
Undercounted iPhone traffic for Instant Articles, reported in December
From Sept. 20 to Nov. 30, Facebook was undercutting iPhone traffic for Instant Articles publishers who had not yet moved to HTTPS protocol. “This is more detrimental to publishers,” said an ad buyer. “It is not much of a concern of ours.”
Miscalculated likes for Live videos, reported in December
Users were only supposed to be counted once whenever they engaged with a video, but people who responded with multiple likes to shared videos were counted multiple times. “While reactions are a nice metric to have, they are not the base of success for any of our campaigns,” said an ad buyer.
Inflated like and share counts for links posted on Facebook, reported in December
Facebook miscalculated how often users reacted to Live videos and how often users liked and shared links posted on Facebook. “The errors were ridiculous by this point, but the metrics are fluff,” said an ad buyer.
Overestimated referral traffic, reported in November
Rather than only measuring how often Facebook users were driven to an advertiser’s own properties, Facebook also counted clicks that were driven to the advertiser’s Facebook page. “When they got referral traffic wrong, they messed up metrics that really matter to our clients,” said an ad buyer.
Inflated average time spent on Instant Articles, reported in November
Facebook had trouble properly calculating how much time users were spending on Instant Articles per visit, which led the platform to overestimate average time spent by about 7 percent. “It is a value metric for publishers, but it doesn’t hold much weight for us,” an ad buyer said.
Overstated video ad completion rates, reported in November
Facebook didn’t properly the sync the length of its video ads, which led the platform to undercount “video watches at 100 percent.” One buyer said, “If you were running video ads, you severely misled.”
Organic users counted multiple times, reported in November
Facebook counted users multiple times when they were viewing a page’s organic posts. For some Facebook pages, this went on for 28 days. Buyers said they were not affected by the error.
Organic users counted before content was on screen, reported in November
While already counting users multiple times while they viewed organic posts, Facebook also counted users before the organic posts appeared on their screens. Like the other organic-page error, buyers were not affected.
Inflated video views, reported in September
For two years, Facebook overestimated the average time users spent watching video on Facebook. In some cases, Facebook’s numbers were 80 percent off. “In terms of the magnitude of the discrepancy, no platform should be that off,” said an ad buyer.
Member ExclusiveMarketing Briefing: As socializing returns, marketers will ‘adopt a hybrid model’ adding OOH, pop-ups back to the mix
Marketers and media buyers say that the next few months will see a hybrid approach from marketers with a rise in advertising and marketing that had dipped (i.e. out-of-home and experiential) due to the pandemic as well as a continued push for virtual and live audio options.
‘Sustainability makes good business sense’: Companies ramp up eco-friendly efforts for office returns
During the pandemic, as firms dramatically curbed their energy and paper usage and reduced their office footprint, sustainability has become a whole new rallying cry.
It’s deja vu for marketers as Apple’s ATT causes consent headache
Marketers are again in limbo as gaining people’s consent to be tracked via pop-up rears its head around Apple’s latest privacy push -- just as it did for the General Data Protection Regulation three years ago.
SponsoredHow The Company Store is reimagining customer experiences for pandemic-era growth
Throughout the pandemic, some retail categories have been inherently successful. Home furnishings and décor are among them; with consumers spending so much more time at home, updates and renovations flourished. Criteo data from the first half of 2020 showed sales for items like outdoor furniture sets up 434% year over year, with other home items […]
Member ExclusiveMedia Buying Briefing: Attention metrics vie for the industry’s, well, attention. Will it take root?
Proponents of attention metrics in media planning say it will reduce waste in buying, especially for CPG brands.
COVID-19 scam ads decline, but AI systems risk catching legitimate vaccine messages in their traps
Around 31% of all coronavirus-related ads assessed by The Media Trust in February 2021 were labeled as "coronavirus suspicious."