DoorDash Automates Food Metadata With LLM Juries

Get the Tech newsletter
Daily tech — startups, AI labs, chips, the launches that shape the next decade. Free.
- DoorDash developed an LLM jury system that evaluates food metadata with roughly 20% higher accuracy than human annotators by aggregating consensus from multiple large language models.
- DoorDash implemented context-optimization agents that use failure signals to refine prompts autonomously, increasing model precision by over 20% and accelerating prompt development tenfold.
- DoorDash deployed distributed computing to reduce LLM backfill time from over a month to just days, enabling scalable inference across millions of menu items.
- DoorDash created an AI-led annotation system that generates high-quality training data without human effort, achieving frontier LLM performance at 10% of the cost.
- DoorDash uses multimodal AI combining text, images, and web data to infer dish attributes like spiciness or cuisine type, addressing the challenge of non-standardized, culturally varied menu descriptions.
Why it matters: DoorDash’s system cuts metadata generation time from weeks to days while improving accuracy and slashing costs, enabling faster, more reliable personalization and search for users — a material edge in a high-volume, low-margin delivery market where even small efficiency gains affect millions of daily decisions.



