AI memory startup focused on cutting token costs raises $98 million

CNBC Top News ·

AI memory startup focused on cutting token costs raises $98 million

(l to r) Jack Morris, Sabri Eyuboglu, Dan Biderman, Scott Linderman, and Jessy Lin of Engram. Courtesy: Natalie Biderman With corporate America finally starting to crack down on untamed AI usage by …

(l to r) Jack Morris, Sabri Eyuboglu, Dan Biderman, Scott Linderman, and Jessy Lin of Engram. Courtesy: Natalie Biderman With corporate America finally starting to crack down on untamed AI usage by developers, an 8-month-old startup called Engram sees a big business opportunity in helping companies save money. Engram on Tuesday announced that it raised $98 million from investors including General Catalyst, Kleiner Perkins and Sequoia, as well as OpenAI co-founder Andrej Karpathy, who recently joined Anthropic . The startup, which dubs itself the "learned memory" of AI, says its models can recall organization-specific workflows and context to anticipate questions and give smarter responses with cheaper output. The company claims its models can match or outperform frontier labs using up to 100 times fewer tokens , which are the currency for running AI queries. New and more sophisticated AI models are proving pricier than previous iterations, challenging the conventional view that greater scale would lead to lower costs. "You've got this explosion of data, explosion of cost," said Leigh Marie Braswell, a partner at Kleiner. "Engram comes in and basically maps out your organization and offers orders of magnitude cheaper output." Less than a year after its founding, the 13-person company has accrued a client roster that includes Microsoft , Notion and legal AI startup Harvey. …

Original source: CNBC Top News

Mentioned

Microsoft · Anthropic · Columbia University · Stanford University