In a compute world dominated by Nvidia, hyperscalers are looking to build out their own semiconductor infrastructure capable of training and inference workloads at scale.

We chat to senior director for customer and product engineering at AWS’s Annapurna Labs Gadi Hutt about his company's approach, based on its 2015 Annapurna acquisition. We talk about Trainium and Inferentia, how the company balances against its GPU fleet, and what it's cooking with Anthropic and Rainier.