This chip startup just raised $135M on a bet that AI’s biggest bottleneck isn’t compute — it’s memory
TechCrunch ·

Every time you ask ChatGPT a question, your request triggers a data relay race. Information leaves memory, passes through a CPU for preprocessing, travels to a GPU for heavy computation, and then …
Every time you ask ChatGPT a question, your request triggers a data relay race. Information leaves memory, passes through a CPU for preprocessing, travels to a GPU for heavy computation, and then makes its way back — and that entire journey repeats for every single word the AI generates. The bottleneck is structural — it means routing through some of the most expensive and power-intensive chips in the industry on every single request. …
Original source: TechCrunch
Mentioned
Nvidia · Marvell · Samsung · SK Hynix · techcrunch · South Korea