Help, my algorithm is a racist

Nate Carter is managing director of eEffective, a digital trading desk.

The other week I found out that my algorithm is a racist.

Don’t get me wrong, it wasn’t birthed this way. In fact, we can be sure that in this case the racism is a product of nurture, not nature. You see, I was running two creative sets. Both were pictures of children, their mere image beckoning the web browser to click on them. Click on them people did. The problem is that, over time, they clicked on one creative more than the other, and when they converted on the landing page, they converted on that same creative with higher frequency. Doing what it was designed to do, my algorithm jumped in, optimizing the campaign to the better-performing creative: the one with the white child, not the black child.

An awkward moment arose. What do we do? After all, this is a results business and the Caucasian creative was bring in the goods. Still something didn’t feel quite right. It also made me wonder, are we racist? Had our racism poisoned my algorithm and turned it into a monster?

These were difficult ethical questions. On the surface it appeared that I may have uncovered statistical proof of underlying racism. But what if the motives of the audience clicking were less devious? What if the creative with the Caucasian child was simply more appealing, without regard to skin color? Also there was the question of, now what? Do I reprogram my algorithm? Do we take the learnings and run with the better-performing creative? What are the ethical ramifications of the latter?

Overall it was a healthy conversation to have. It also showcased that in an age where it is easy to let the machine make all of the decisions, there are things which are worth debating, considering and pondering which go beyond simple numerical analysis. You see, there is a danger that our algorithms can end up racist or bigoted, for they are by their very function prejudiced. If we allow them to optimize, unencumbered they become a reflection of us, all of our best and all of our worst.

As we continue to make strides in customization and individualization of our messaging it is important that we are looking at what we are telling people, giving clients insights into campaign bias and considering the ethical ramifications.

https://digiday.com/?p=83617

More in Media

How The New York Times is using visuals to boost podcast discovery and grow listenership

To grow podcast listenership and help people discover new shows, The New York Times is experimenting with visuals on platforms like YouTube and its own audio app this year.

Media Briefing: Publishers search for new ways to grow (and authenticate) audiences, overheard at the Digiday Publishing Summit

“[Advertisers] already pay data providers for data. So why not pay the publisher?”

Research Briefing: Publishers’ revenue sources are top of mind at Digiday Publishing Summit

In this week’s Digiday+ Research Briefing, we examine which revenue streams were top of mind for publishers at the Digiday Publishing Summit, how TikTok is getting even more marketing spend from brands and retailers despite facing a potential U.S. ban, and how Disney is rolling out DRAX Direct, a direct integration with the industry’s largest DSPs, as seen in recent data from Digiday+ Research.