Designing high-density compute for AI and HPC

  • Watch on-demand now
  • The Compute, Storage & Networking Channel
Speakers

You can now ask questions directly within our broadcasts using our new AskAI feature.

While data centers take on increasingly compute-intensive workloads such as AI and ML training, HPC, and large-scale analytics, traditional server and system designs start to fall short. This episode explores what it means to design high-density compute systems built around CPUs, GPUs, memory, storage, and high-speed networking, where data movement, interconnect bandwidth, accelerator utilization, and reliability become the defining constraints. It examines the hardware and system-level choices that improve throughput and latency, as well as the decisions that quietly degrade performance at scale. Join this episode to learn:

  • Hidden pitfalls in data movement, scheduling, and workload placement
  • Patterns that improve throughput, latency, GPU and accelerator utilization
  • Why scale-out strategies fall short at high density
  • Practical guidelines for assessing readiness and planning next-generation infrastructure

Related Episodes