'Let chaos reign': AI inference costs are about to plummet

SambaNova Systems; Ramsey Cardy; Foundry; Groq

Jared Quincy Davis and his AI computing startup Foundry sell inference. They don't make chips or build large language models. Foundry has a unique method of making cloud computing more efficient. Instead of selling its technology to cloud providers, the Foundry team decided to become one and use its tech to operate a more efficient cloud.