Which Facebook metrics flub are you? Ad buyers rate Facebook’s 10 measurement errors
You can almost set your watch to it. Yesterday, in the heat of an upfronts season in which TV stalwarts are taking pots at digital media, Facebook announced its 10th measurement error since September. Per usual, Facebook’s mistake elicited demands from ad buyers for more third-party verification on the platform. And the collective effective of the errors is getting on buyers’ nerves.
“There is a general sense of ‘what could be next,’” said Jessica Baum, media director at Traction. “Even though the last error was smaller in scope, it still impacts overall trust.”
Facebook’s latest error stems from a bug that led it to miscalculate how often users clicked through its carousel ad units, which let brands show multiple images and link to their properties. Facebook declined interview requests for this story.
The error comes during the upfronts, which TV networks are using to push back against their digital competitors. For example, during a Fox presentation on Monday, Family Guy creator Seth MacFarlane made a joke about YouTube ads “shown on ISIS vids.” Buyers said the error will give networks ammo for their presentations, but it won’t impact budgets.
“I’m sure there will be keynotes at the upfront who bring this up,” said an ad buyer requesting anonymity. “But Facebook has such scale. As long as people keep visiting the platform, advertisers will still have an appetite for Facebook regardless of what gets said this week.”
Facebook claims that the error, which only occurred within the mobile web, affected just 0.04 percent of its ad impressions. But it went undiscovered for nearly a year, and Facebook is refunding affected advertisers, which it hasn’t done after its other errors.
“If there are mishaps, we want to address them with Facebook,” said Jake Rosenberg, senior digital media strategist at Red Tettemer O’Connell + Partners. “It is better [for Facebook] to address it head on and control a narrative because it works in their best interest to call it out and say this is what we’re doing to fix it.”
Digiday asked buyers to anonymously rate each of Facebook’s measurement errors on a scale of 1 to 10, with higher numbers representing more egregious errors. The errors are ordered by recency.
Wrongly charged advertisers for video carousel clicks, reported in May
A bug caused Facebook to miscalculate how often users clicked through its carousel ads. But the error applied to just 0.04 percent of the platform’s impressions, according to Facebook. One ad buyer called the carousel units “fringe.”
Undercounted iPhone traffic for Instant Articles, reported in December
From Sept. 20 to Nov. 30, Facebook was undercutting iPhone traffic for Instant Articles publishers who had not yet moved to HTTPS protocol. “This is more detrimental to publishers,” said an ad buyer. “It is not much of a concern of ours.”
Miscalculated likes for Live videos, reported in December
Users were only supposed to be counted once whenever they engaged with a video, but people who responded with multiple likes to shared videos were counted multiple times. “While reactions are a nice metric to have, they are not the base of success for any of our campaigns,” said an ad buyer.
Inflated like and share counts for links posted on Facebook, reported in December
Facebook miscalculated how often users reacted to Live videos and how often users liked and shared links posted on Facebook. “The errors were ridiculous by this point, but the metrics are fluff,” said an ad buyer.
Overestimated referral traffic, reported in November
Rather than only measuring how often Facebook users were driven to an advertiser’s own properties, Facebook also counted clicks that were driven to the advertiser’s Facebook page. “When they got referral traffic wrong, they messed up metrics that really matter to our clients,” said an ad buyer.
Inflated average time spent on Instant Articles, reported in November
Facebook had trouble properly calculating how much time users were spending on Instant Articles per visit, which led the platform to overestimate average time spent by about 7 percent. “It is a value metric for publishers, but it doesn’t hold much weight for us,” an ad buyer said.
Overstated video ad completion rates, reported in November
Facebook didn’t properly the sync the length of its video ads, which led the platform to undercount “video watches at 100 percent.” One buyer said, “If you were running video ads, you severely misled.”
Organic users counted multiple times, reported in November
Facebook counted users multiple times when they were viewing a page’s organic posts. For some Facebook pages, this went on for 28 days. Buyers said they were not affected by the error.
Organic users counted before content was on screen, reported in November
While already counting users multiple times while they viewed organic posts, Facebook also counted users before the organic posts appeared on their screens. Like the other organic-page error, buyers were not affected.
Inflated video views, reported in September
For two years, Facebook overestimated the average time users spent watching video on Facebook. In some cases, Facebook’s numbers were 80 percent off. “In terms of the magnitude of the discrepancy, no platform should be that off,” said an ad buyer.
‘Agile muscle memory’: How the pandemic’s delta variant made marketers and agencies apply newly learned flexibility
The focus on flexibility that has been built into ad deals as well as ad strategies over the last year-and-a-half has remained, making it easier for marketers and agency execs to adjust on the fly as consumer sentiment changes.
Why Facebook’s limits on teen targeting are all part of its algorithmic ad playbook
As Facebook puts new targeting restrictions on reaching teens, marketers say Facebook's ad targeting algorithm could do a better job of targeting ads to them anyway.
With the Metaverse hype cycle at full blast, experts take the long view
The newfound prominence of the Metaverse has led to heightened scrutiny, with some observers rolling their eyes at what they perceive to be the tech industry’s latest buzzword of the month.
SponsoredVideo: How publishers are preparing for 2022 — and the future
From shifts in audience content consumption to the rising tide of contextual targeting, publishers are preparing for 2022 and beyond. Following a year of transformation, and within the ever-changing timeline of the third-party cookie’s demise, Digiday and Responsive MTS teamed up at the Digiday Publisher Golf Outing in July 2021 to ask publishers about what […]
As gaming expands, endemic and non-endemic creative agencies emphasize their strengths
Though gaming-endemic agencies have a head start, non-endemic creative agencies are looking to muscle their way into the space using their advantages as larger and more established firms.
Member ExclusiveMarketing Briefing: Zenni’s vp of growth marketing on making the switch to ‘bite-sized’ planning windows due to Covid
To get a sense of how one brand marketer managed those shifts for a growing brand, Digiday caught up with direct-to-consumer eyewear brand Zenni’s vp of growth marketing, Courtney Fadjo Biro.