Connect | Virginia // DCD>Debate: The latency dilemma - How much is too much Generative AI?

As the "inference era" of AI takes center stage, the need for low-latency connections between AI models and end-users is reshaping the data center landscape.

While AI training ideally takes place in areas with cheap and available electricity, inference operations are increasingly concentrated in regions like Virginia. With fiber connectivity, bandwidth demands, and edge computing evolving rapidly, how can data center providers adapt? This debate explores whether the race for the largest infrastructure is truly necessary or if the industry should focus on the fundamentals, such as optimizing latency and connectivity to meet AI’s growing needs.

Held under Chatham House Rule, DCD>Debates are open discussions led by a panel of experts, on the biggest issues to face the industry.