Help, my algorithm is a racist

Nate Carter is managing director of eEffective, a digital trading desk.

The other week I found out that my algorithm is a racist.

Don’t get me wrong, it wasn’t birthed this way. In fact, we can be sure that in this case the racism is a product of nurture, not nature. You see, I was running two creative sets. Both were pictures of children, their mere image beckoning the web browser to click on them. Click on them people did. The problem is that, over time, they clicked on one creative more than the other, and when they converted on the landing page, they converted on that same creative with higher frequency. Doing what it was designed to do, my algorithm jumped in, optimizing the campaign to the better-performing creative: the one with the white child, not the black child.

An awkward moment arose. What do we do? After all, this is a results business and the Caucasian creative was bring in the goods. Still something didn’t feel quite right. It also made me wonder, are we racist? Had our racism poisoned my algorithm and turned it into a monster?

These were difficult ethical questions. On the surface it appeared that I may have uncovered statistical proof of underlying racism. But what if the motives of the audience clicking were less devious? What if the creative with the Caucasian child was simply more appealing, without regard to skin color? Also there was the question of, now what? Do I reprogram my algorithm? Do we take the learnings and run with the better-performing creative? What are the ethical ramifications of the latter?

Overall it was a healthy conversation to have. It also showcased that in an age where it is easy to let the machine make all of the decisions, there are things which are worth debating, considering and pondering which go beyond simple numerical analysis. You see, there is a danger that our algorithms can end up racist or bigoted, for they are by their very function prejudiced. If we allow them to optimize, unencumbered they become a reflection of us, all of our best and all of our worst.

As we continue to make strides in customization and individualization of our messaging it is important that we are looking at what we are telling people, giving clients insights into campaign bias and considering the ethical ramifications.

More in Media

Publisher strategies: Condé Nast, Forbes, The Atlantic, The Guardian and The Independent on key revenue trends

Digiday recently spoke with executives at Condé Nast, Forbes, The Atlantic, The Guardian and The Independent about their current revenue strategies for our two-part series on how publishers are optimizing revenue streams. In this second installment, we highlight their thoughts on affiliate commerce, diversification of revenue streams and global business expansion.

How sending fewer emails and content previews improved The New Yorker’s newsletter engagement

The New Yorker is sending newsletters less frequently and giving paid subscribers early access to content in their inboxes in an effort to retain its cohort of 1.2 million paid subscribers and grow its audience beyond that.

The Rundown: How Amazon is wooing publishers to bolster its $50 billion ad business

Enhancements to Amazon Publisher Cloud and debut of Signal IQ represent the triopolist’s latest adland overture.