DRAM Prices Surge 7×, AI Memory Management Becomes Critical
Get the Tech newsletter
Daily tech — startups, AI labs, chips, the launches that shape the next decade. Free.
- DRAM chip prices have risen roughly sevenfold over the last year as hyperscalers plan to spend billions on new data centers.
- Memory management is becoming a critical discipline for AI infrastructure, with firms that master it able to run queries with fewer tokens, affecting business viability.
- Doug O’Laughlin discussed the importance of memory chips on his Substack, interviewing Val Bercovici, chief AI officer at Weka.
- Anthropic’s prompt‑caching pricing page has evolved from a simple “use caching, it’s cheaper” to an extensive guide on pre‑buying cache writes.
- Anthropic now offers 5‑minute and 1‑hour cache tiers, creating arbitrage opportunities based on cache read pricing and pre‑purchased writes.
Why it matters: AI providers and hyperscalers face steep cost pressure from a sevenfold DRAM price surge, making efficient memory orchestration essential to keep query costs low; firms that master caching can stay profitable, while those that don’t risk folding in a competitive market.
Ask SkimNews
