Claude Chats Indexed by Google Despite robots.txt — SkimNews
Get the Tech newsletter
Daily tech — startups, AI labs, chips, the launches that shape the next decade. Free.
- Anthropic's Claude chatbot shared chats appeared in Google and Bing search results despite Anthropic's robots.txt directing crawlers not to index them, per Wired's Maddy Varner.
- The root cause was likely Anthropic omitting a "noindex" meta tag on shared chat pages — an oversight Wired and editor Katie Drummond both flagged on Bluesky as the missing safeguard.
- Coverage spanned 15+ outlets including 404 Media, TechCrunch, ZDNET, PCMag, BBC, Fortune, Gizmodo, Mashable, Hackread, and Neowin, with Reddit threads on r/ClaudeAI and r/Anthropic amplifying the discovery.
- Protos reported that search engines subsequently fixed the Claude leak — but noted Perplexity users' files remained exposed in the same window.
- Decrypt characterized the issue as Anthropic's share button "quietly publishing" chats to Google without user awareness, framing it as a silent, undisclosed publishing flow.
Why it matters: For Anthropic — which competes on AI safety and trust — the gap between a robots.txt directive and a missing noindex meta tag is a reputationally costly miss: the everyday "share a chat" workflow was inadvertently broadcasting private conversations to the world's two largest search engines. Protos's follow-up extends the damage across the AI chatbot category, showing Perplexity users faced the same exposure that search engines just patched for Claude.
Ask SkimNews
