12 passes left to attend the Digiday Publishing Summit
WTF is Retrieval Augmented Generation for AI chatbots and large language models?
This article is a WTF explainer, in which we break down media and marketing’s most confusing terms. More from the series →
AI-powered chatbots are scary smart, thanks to the large language models undergirding them. But they’re only as smart as the data they’re trained on.
Two major factors can inhibit the AI chatbots being created by brands and publishers: the timeliness of the bots’ training data and the inclusion of proprietary information in that data set. In the first case, a company would need a way to pass information in real time to an LLM powering its chatbot. And in the second case, the company would need to be able to safeguard that information so that the LLM is just provided whatever necessary context to respond someone’s prompt. In both cases, a system called “retrieval augmented generation” would provide a framework for bridging the gap, as explained in the video below.
“There is a difference between being trained on public and licensed data and knowing what sits in the cloud environment of a brand,” said Hugo Loriot, head of data and technology integration at The Brandtech Group. He added, “All of the data that is very specific to a brand, this is off-limits for a [large language] model — unless you have a way to feed that data into the model, which is exactly what RAG does.”
More in Marketing
Inside Estée Lauder’s $14 billion reset: AI, brand trouble and a travel retail retreat
Estée Lauder’s $14 billion turnaround is underway, driven by AI, e-commerce expansion and a strategic brand reset. Here’s what’s working — and what’s still at risk.
Ignoring political noise, TikTok works to shore up place in organic social hierarchy
The platform wants to remain a key tool for organic activity of brands like McDonald’s and Poppi, even as it helps to draw paid investment.
Walmart finds its cushion in advertising as tariffs bite
Walmart has a plan to stay profitable as President Donald Trump’s tariffs push up costs. It’s called advertising. In the second quarter, Walmart’s ad revenue jumped 46% year over year, a number padded by the addition of Vizio, the smart TV maker it picked up last year. Strip that out, and the U.S. business still […]