Furiosa's AI chip is dubbed "RNGD" — short for renegade — and slated to start mass production this month. Valued at nearly $700 million based on its most recent fundraising, Furiosa has attracted interest from big tech firms. Last year, Meta Platforms attempted to acquire it, though the startup declined the offer. OpenAI used a Furiosa chip for a recent demonstration in Seoul. LG's AI research unit is testing the chip and said it offered "excellent real-world performance." Furiosa said it is engaged in talks with potential customers.
Nvidia's graphic processing units, or GPUs, dominated the initial push to train AI models. But companies like Furiosa are betting that for the next stage — referred to as "inference," or using AI models after they're trained — their specialty chips can be competitive. Furiosa makes chips called neural processing units, or NPUs, which are a rising class of chips designed specifically to handle the type of computing calculations underpinning AI and use less energy than GPUs. [Founder/CEO June] Paik said Furiosa's chips can provide similar performance as Nvidia's advanced GPUs with less electricity usage. That would drive down the total costs of deploying AI. The tech world, Paik says, shouldn't be so reliant on one chip maker for AI computing. "A market dominated by a single player — that's not a healthy ecosystem, is it?" Paik said...
In 2024, at Stanford's prestigious Hot Chips conference, Paik debuted Furiosa's RNGD chip as a solution for what he called "sustainable AI computing" in a keynote speech. Paik presented data showing how the chip could run the then-latest version of Meta's Llama large language model with more than twice the power efficiency of Nvidia's high-end chips. Furiosa's booth was swarmed with engineers from big tech firms, including Google, Meta and Amazon.com, wanting to see a live demo of the chip. "It was a moment where we felt we could really move forward with our chip with confidence," Paik said.
Read more of this story at Slashdot.