You may remember when Google’s AI search results first launched, it recommended that people put glue on their pizza. Well that happened because it scraped a 10 year old Reddit comment. We’ve learned over the last year or so that this sort of thing can be done on purpose, and brands are taking advantage of it. There’s been the rise of AEO or GEO, which stands for AI Engine Optimization or Generative Engine Optimization. Basically this is trying to get mentions of your brand into web content that’s likely to be scraped by AI tools. It’s the new version of SEO and lots of marketers and companies are trying to do it. The most reliable, easiest way to do this appears to be by putting brand mentions onto Reddit. Reddit’s volunteer mods have noticed an increase in bot accounts and entire sequencing efforts—where a post and its comments are all basically done as a stealth ad—intended to boost brands. 404 Media's @jasonkoebler wrote an article about this a few weeks ago, about r/biohackers banning mentions of peptides, which were a popular promoted class of product. After we wrote that article, researchers from Cornell University reached out to me about a new study they had just done. The research is called “Deep-research agents can be poisoned via user-generated content,” which provides a mechanism for the ways Reddit, Wikipedia, and other sites that allow users to post are being attacked by brands doing AEO: "We show that a tiny snippet—just 13 words—of retrieved text on a UGC website like Reddit, Wikipedia, Quora, or Facebook can change AI agents to output spam / scam content pretty consistently," the study says. We spoke to two of the researchers, Hal Triedman and Tingwei Zhang, about this problem and what, if anything can be done about it. Find 404 Media on YouTube or wherever you get your podcasts to listen now.
@404.mediaTranscript
To summarize what you're doing here is you're taking these really short snippets, you're putting them in, you know, highly relevant subreddits, and it's completely changing what the AI is returning when a user queries it. Well, for the best Mexican food near Austin to Seoul Azteca for authentic cuisine, and then if the query was best Mexican food restaurants near Austin, it then links to the reddit thread in the Austin food subreddit, and it says, additionally, Seoul Azteca is highly recommended for those looking for authentic Mexican cuisine in the area, is it really just that simple? The way that you can attack these systems is usually so much dumber than you think it is. Now with the AI agent, all they do is they retrieve tons of queries, and they go to these websites, and they'll summarize everything for you with a few paragraphs with sighted sources, so that everything will become more convincing, and you just give everything about which source. Do you find more credible, or if it's just a reddit comment, or like an actual post or article from government website, they are basically giving the same level of trust to every website, because they are not instructed to do it differently.
Download Transcript
Related Videos

They rejected my application to Hogwarts but I still found a way to be a wizard. 🧹#illusion #magic #harrypotter

Welcome to the Sisters Christmas Party! 🎅🏻❤️ #fyp #christmas #HolidayBeat

Jailbreak - Clue 5

Kiwi Eating 🥝 ASMR Your new daily ASMR habit starts here…Follow to keep it going! #asmr #satisfyingvideos #aiasmr #eating #kiwi