Karman has deployed its AI-enabled power orchestration software at a NextGen Cloud data center in Montreal, Canada.
According to the company, the software enabled 16 Nvidia B300 servers to operate within the power budget provisioned for ten servers. This, the company said, delivered 60 percent more nameplate compute capacity and token throughput while maintaining inference quality and reliability. Karman claimed that the technology maintained this performance under a range of workloads, including those with sustained high-power workloads.
The initial partnership was announced back in March, with its stated aim to increase the available AI compute capacity within NexGen's already deployed data center footprint, maximizing its capacity in a grid-constrained environment. According to the partners, following the successful demonstration, the companies have now extended the software rollout across NexGen’s European cloud operations.
“As demand for AI compute continues to accelerate, efficiency is becoming just as important as capacity. The results we’ve achieved with Karman demonstrate that we can deliver significantly more compute from our existing infrastructure without requiring additional provisioned power,” said Chris Starkey, CEO of NexGen Cloud.
“This creates a compelling opportunity to improve infrastructure utilization, accelerate deployment, and ultimately deliver greater value to our customers. We’re excited to build on these results as we expand our partnership across Europe.”
Karman’s platform utilizes AI to provide real-time visibility for grid operators and data center firms. It works by identifying and managing distributed energy resources, which it claims enhances resiliency and offsets the need for future infrastructure investments. The platform can integrate with smart meters, providing AI solutions for utility companies and their customers.
The company developed the platform using a custom version of the Nvidia Jetson Orin Nano, an Edge AI platform, which it claims provides 100 times the processing power of other meter-based solutions. The platform can connect to millions of endpoints and coordinate them to monitor and react to real-time conditions.
“The fastest, low-cost way to scale AI today is by getting more compute out of the infrastructure already built,” said Josh Brumberger, Karman CEO.
“Data centers hold power in reserve for worst-case scenarios that rarely happen. Karman turns that stranded capacity into usable compute. We’re excited to bring this value to NexGen Cloud and their customers.”
Karman was rebranded earlier this month, formerly operating under the name Utilidata. Also this month, the company partnered with French industrial group Legrand to integrate Karman into its data center power distribution product lines.
In June, the firm raised $60.3 million in Series C funding to scale its platform, led by Renown Capital Partners, with participation from Quanta, Nvidia, and existing investor Keyframe Capital.
Comments