AI chip startup Tsavorite Scalable Intelligence has emerged from stealth, having secured more than $100 million in pre-orders for its Omni Processing Unit (OPU), the company announced.
Founded by veterans from the chip and software industries, the company said its approach seeks to overcome performance and cost bottlenecks currently facing AI deployments to deliver “breakthrough performance for AI inference, training, and reinforcement learning.”
While the company did not name any of its customers, it said they include Fortune Global 500 companies, sovereign cloud providers, and leading systems integrators across the US, Asia, and Europe.
In a statement, Tsavorite described its OPU offering as a single device that “unifies CPU, GPU, memory, and scale up/scale out connectivity,” and said it has been built using “several industry-first technologies” developed by the company in-house.
This includes Tsavorite’s MultiPlexus fabric interconnect that offers petabyte-scale bandwidth – the “industry’s first AI compute catalyst” that connects chiplets, packages, systems, and racks to form unified pods that “maximize compute utilization,” the company said.
The OPU also provides petabyte-scale memory, an open software platform, and a modular chip architecture that allows the OPU to be optimized for markets and applications with different power, performance, and scaling requirements across Edge, on-premises, data center, and cloud deployments.
Early performance data has demonstrated gains of 90 percent lower power and cost, the company claims, although it did not provide a benchmark for these results. Tsavorite’s OPU also includes a compute subsystem built on Arm Neoverse to support the delivery of high performance-per-watt and software compatibility across varying deployments.
“With the Omni Processing Unit and our MultiPlexus fabric, we’ve built the first truly composable, developer-friendly, AI platform that delivers step-change gains in efficiency, cost, and scale from edge to hyperscale,” said Shalesh Thusoo, founder and CEO of Tsavorite.
The company is planning to start mass-producing its OPU chiplets and a Helix AI data center appliance by early next year, Thusoo said.
Comments