Microsoft Unveils Custom AMD Chip for Azure HBv5: A Leap in HPC Performance

In a bold stride that underscores the unique advantages of being a tech mega-corporation, Microsoft is flexing its hardware prowess by unveiling a powerful, custom AMD chip aimed at high-performance computing (HPC) workloads within its Azure platform. This announcement came during the recent Ignite conference in Chicago, where Microsoft showcased its cutting-edge advancements in cloud infrastructure.

Breaking Down the Azure HBv5 Virtual Machine​

At the heart of this initiative is the Azure HBv5 virtual machine, a significant leap forward in CPU-based supercomputing. Instead of relying on the commonly used Zen 5 technology, this deployment utilizes custom AMD Epyc 9V64H processors, leveraging the proven Zen 4 architecture. These processors can reach peak frequencies of up to 4 GHz, offering an impressive foundation for intensive computational tasks.

Key Specifications at a Glance:​

• Processor Arrangement: Each Azure HBv5 instance will feature four Epyc 9V64H processors.
• Core Count: Up to 352 cores per instance.
• Memory Allocation: Up to 9 GB of memory per core, totaling 6.9 TBps of memory bandwidth.
• High-Bandwidth Memory: Up to 400-450 GB of HBM3, which purportedly delivers bandwidth up to eight times greater than competing platforms.
• Storage Options: Each instance is equipped with a local 14 TB NVMe SSD that can achieve impressive read/write speeds of 50 GBps and 30 GBps, respectively.
• Networking: 800 Gbps of Nvidia Quantum-2 InfiniBand networking enhances data transfer rates significantly.

This high-performance capability positions the Azure HBv5 as a formidable solution for memory-intensive applications, including computational fluid dynamics, automotive and aerospace simulations, weather modeling, and extensive engineering tasks.

The Mystery of the Epyc 9V64H​

An intriguing detail that surfaced during the announcement was the bonding of these custom silicon chips through Azure's brand new Infinity Fabric. Microsoft mentioned that the total bandwidth between the processors will surpass that of any previous AMD Epyc server platform—including speculation that the Epyc 9V64H might share similarities with AMD's MI300A APU, albeit exclusively featuring CPU cores.

The Azure Boost DPU: A Transformation in Data Processing​

Microsoft isn't stopping at just custom CPUs. The company is introducing the Azure Boost DPU, a programmable chip designed to relieve network and storage processing duties from host CPUs. This innovation, rooted in technology acquired from Fungible, integrates high-speed Ethernet and PCIe interfaces, effectively elevating server performance while cutting down on energy consumption.
Key Features of Azure Boost DPU:

• Hardware-Software Co-Design: This DPU operates a custom, stripped-down data flow operating system, optimizing Azure's operational integrity.
• Increased Efficiency: The bespoke architecture allows for superior performance and energy efficiency compared to traditional models.

Enhanced Security with Azure Integrated HSM​

In addition to computational power, Microsoft has announced improvements in security with the Azure Integrated HSM (Hardware Security Module). This infrastructure allows for the execution of encryption and decryption processes without the latency associated with remote HSM services. By binding the security module directly to the workload environment, Azure promises enhanced key protection and efficiency.

Upcoming Accessibility​

While these innovations are gaining excitement, it’s essential to note that Azure HBv5 instances are not yet available for public use. Interested users can sign up for a preview slated to commence in the first half of 2025, allowing early adopters to experience the cutting-edge capabilities first-hand.

Wrapping It Up​

Microsoft’s ambitious foray into custom silicon reinforces its commitment to providing a next-level cloud experience through Azure. By rolling out specialized hardware tailored for HPC workloads, alongside significant advancements in security and data processing, the tech giant is poised to redefine how computationally demanding applications are handled in the cloud.
As we eagerly anticipate the arrival of these innovations, one question remains: with this robust infrastructure on the horizon, how will competing cloud platforms adapt to maintain their edge? Microsoft’s new chips may just set a new standard in the ever-evolving landscape of cloud computing.
Stay tuned to WindowsForum.com for the latest updates, insights, and discussions surrounding these technological advancements!

---

Source: The Register Microsoft unveils beefy custom AMD chip to crunch HPC workloads on Azure