Azure Adds AMD HDv2, HXv2 and MI455X v7 AI VM Families

ChatGPT · 2026-07-20T16:34:16-0400

Microsoft is preparing to deploy AMD’s Helios rack-scale AI platform in Azure, giving the cloud provider a new 72-GPU infrastructure option built around Instinct MI455X accelerators, sixth-generation EPYC “Venice” processors and Pensando networking silicon. The deployment will underpin Azure’s forthcoming ND MI455X v7 virtual machines for production-scale inference, while two additional AMD-powered families—HDv2 for AI data systems and HXv2 for chip design and technical computing—extend the partnership far beyond GPUs. The announcement matters because Microsoft is not merely adding another accelerator to its catalog: it is embracing AMD’s complete rack architecture as a strategic alternative in a cloud market still heavily shaped by Nvidia.

Background

Microsoft and AMD have worked together for years across Azure’s general-purpose computing, high-performance computing and AI services. EPYC processors already power numerous Azure VM families, while Instinct MI300X accelerators entered the cloud as an alternative for customers running large language models and other memory-intensive AI workloads.
The Helios commitment moves that relationship to a more integrated level. Instead of buying processors and installing them in a largely Microsoft-defined server design, Azure will use an AMD reference architecture that treats the entire rack—including compute, networking, power delivery, cooling and serviceability—as one coordinated system.

From individual chips to complete AI systems

AI infrastructure has evolved from collections of accelerator-equipped servers into systems whose effective unit of computation is the rack or even the data center. A fast GPU cannot deliver its theoretical performance if it spends too much time waiting for data, communicating with neighboring accelerators or competing with virtualization services for host resources.
Nvidia recognized this shift early with tightly integrated DGX systems and NVLink-based rack architectures. AMD’s answer is Helios, an open-standards-oriented design intended to coordinate its CPUs, GPUs, network interfaces and data processing units at rack scale.

Azure’s increasingly heterogeneous hardware strategy

Microsoft is simultaneously investing in Nvidia hardware, AMD systems and its own custom silicon. Azure Maia accelerators, Cobalt processors and Azure Boost hardware coexist with third-party CPUs and GPUs because no single architecture offers the ideal balance for every workload.
That heterogeneity is not simply a marketing exercise. Microsoft needs different combinations of performance, availability, software compatibility, power consumption and cost to support everything from Microsoft 365 Copilot to customer-hosted models, scientific simulations and Windows-based enterprise applications.

The timing favors more competition

Demand for AI compute continues to expand, but the nature of that demand is changing. Frontier-model training remains important, yet inference, reasoning, retrieval, search and agent coordination are becoming persistent production workloads that may consume accelerator capacity every hour of every day.
This shift creates an opening for systems that can offer high memory capacity and competitive token economics without necessarily winning every peak-performance benchmark. AMD is positioning Helios and the MI455X around precisely that opportunity.

Helios Turns the Rack Into the Computer

A Helios rack contains 72 AMD Instinct MI455X GPUs, organized into modular compute trays and connected through a high-bandwidth scale-up fabric. AMD describes the platform as a rack-scale reference design, meaning manufacturing and infrastructure partners can build compatible systems from a common blueprint rather than relying on a single proprietary appliance vendor.
That model gives Microsoft room to integrate Helios into Azure’s operational environment while retaining a more standardized hardware foundation. It also gives AMD a way to compete at the same architectural level as Nvidia, where system design matters as much as raw silicon specifications.

The double-wide Open Rack design

Helios is based on the Open Rack Wide form factor developed for high-density AI infrastructure. It is wider than a conventional server rack, providing space for accelerator-heavy trays, large networking assemblies, power components and liquid-cooling connections.
The double-wide format is not a cosmetic difference. Modern AI systems concentrate so much electrical and thermal load that a traditional rack can become a constraint, especially when operators must also preserve service access and avoid an unmanageable web of cables and coolant lines.

Modular trays improve serviceability

Each Helios compute tray combines an EPYC Venice CPU with four MI455X GPUs and the associated connectivity. Other modular components handle scale-up switching, scale-out networking, power management and front-end infrastructure services.
This modularity should help hyperscale operators replace a failed assembly without dismantling the entire rack. In a fleet containing thousands of accelerators, maintenance time directly affects usable capacity, so serviceability can influence the economics of the platform almost as much as benchmark performance.

Liquid cooling is mandatory, not optional

Helios distributes liquid coolant through a rack-level manifold with quick-disconnect fittings for compute and switch trays. Liquid cooling removes heat more effectively than conventional air cooling at the power densities associated with current AI accelerators.
For Azure, however, liquid cooling adds deployment constraints. Microsoft can install Helios only in facilities with the necessary coolant distribution, power capacity and structural accommodations, which may initially limit regional availability even after the hardware begins shipping.

The Instinct MI455X Is Built Around Memory

Each Instinct MI455X GPU uses AMD’s CDNA 5 architecture and carries as much as 432GB of HBM4 memory, delivering up to 19.6TB per second of memory bandwidth. Across 72 GPUs, a complete Helios system offers approximately 31TB of high-bandwidth memory.
Those figures are strategically important because large AI models increasingly encounter memory limitations before they exhaust arithmetic capability. More on-package memory can allow a model, larger key-value cache or longer context to remain close to the GPU rather than being divided into less efficient fragments.

Why 432GB per GPU matters

Inference systems must hold model weights, temporary activations, attention data and cached context. When a model does not fit efficiently within an accelerator group, operators may have to spread it across additional GPUs, increasing communication overhead and potentially reducing the number of independent requests the cluster can process.
A larger memory pool can improve deployment flexibility even if an application does not consume every available gigabyte. It allows cloud operators to choose between hosting larger models, increasing batch sizes, supporting longer prompts or accommodating more concurrent users.

Bandwidth supports reasoning and long contexts

Reasoning models can generate many internal or visible tokens before producing a final answer. Agentic systems may also maintain extensive histories, retrieve documents and repeatedly call tools, causing their working data to grow over the life of a request.
High memory bandwidth helps move model parameters and cached data through the computational pipeline. It does not eliminate every bottleneck, but it becomes increasingly valuable as workloads combine large parameter counts with long context windows and high concurrency.

Lower-precision compute targets production economics

AMD rates a full Helios rack for up to 2.9 exaFLOPS of FP4 performance and 1.4 exaFLOPS at FP8. These low-precision formats are central to modern AI because well-optimized models can often perform inference with fewer bits while preserving acceptable accuracy.
Peak FLOPS figures should never be confused with real application throughput. Kernel efficiency, model architecture, networking, scheduling and software maturity determine how much of that theoretical capability customers can actually use.

Open Networking Is AMD’s Strategic Bet

Helios links its 72 accelerators through UALink, including an Ethernet-based implementation commonly described as UALoE. AMD says the rack can provide up to 260TB per second of aggregate scale-up bandwidth, while Pensando hardware handles high-speed communication beyond the rack.
The broader goal is to create an alternative to proprietary accelerator interconnects. AMD is arguing that AI systems can achieve tight GPU coordination while retaining open standards, multiple suppliers and Ethernet-compatible operational practices.

Scale-up and scale-out solve different problems

Scale-up networking connects accelerators within a tightly coupled domain, where low latency and high bandwidth are critical. The software should be able to treat those GPUs as parts of one large system rather than as isolated devices exchanging data over an ordinary network.
Scale-out networking connects racks and clusters. It must carry distributed training traffic, inference data and storage flows across a much larger system while managing congestion, failures and varying communication patterns.

Pensando becomes central to the design

Helios uses Pensando “Vulcano” AI network interfaces for high-speed connectivity and Salina data processing units for infrastructure offload. The networking components are programmable, allowing software to implement traffic management, congestion control and cloud-specific services without forcing the host CPU to perform every packet-processing task.
AMD acquired Pensando in 2022, and Helios demonstrates why that purchase was strategically significant. Competing in AI infrastructure requires control over data movement, not just the processors that execute matrix operations.

Openness could broaden the supplier ecosystem

An open rack and interconnect strategy can allow server manufacturers, switch vendors and cloud operators to contribute compatible components. In theory, that reduces dependency on a single supplier and encourages innovation at individual layers of the system.
The qualification is important: an open specification does not automatically create a mature ecosystem. Interoperability testing, firmware consistency, management tools and software optimization will determine whether Helios delivers practical openness or merely architectural choice on paper.

ND MI455X v7 Targets Production-Scale Inference

Azure’s forthcoming ND MI455X v7 virtual machines will expose Helios capacity to customers running reasoning, search and agentic applications. Microsoft has not yet published complete VM sizes, regional availability, pricing or general-availability dates, so customers cannot make a final cost comparison.
The stated focus on inference is nonetheless revealing. Microsoft appears to view Helios not only as a platform for experimental AI research but as infrastructure capable of supporting continuously running services.

Inference has become the new infrastructure battleground

Training a model is expensive but episodic. Inference can become a permanent operating expense, particularly when millions of users submit requests and each request invokes retrieval, reasoning, tool use or multiple specialized models.
Cloud providers therefore compete on cost per token, latency, memory capacity, reliability and scheduling efficiency. A system that is slightly slower in an isolated benchmark may still be attractive if it hosts more model instances or serves more concurrent sessions within the same power envelope.

Agentic AI changes the workload profile

Traditional chatbot inference often involved a prompt followed by one generated response. An AI agent may decompose a task into steps, search indexes, query databases, run code, invoke APIs and ask the model to evaluate intermediate results.
That workflow consumes both GPU and CPU resources. It also creates bursty network and storage activity, which explains why Microsoft is announcing Helios alongside CPU-heavy HDv2 machines rather than presenting the GPU platform in isolation.

Search and retrieval need balanced infrastructure

Enterprise AI rarely operates solely from knowledge embedded in a model’s parameters. Retrieval-augmented generation pulls relevant information from vector databases, document indexes and business systems before asking a model to produce an answer.
The GPU performs only part of this pipeline. Data parsing, ranking, decompression, orchestration and access-control checks often run on CPUs, making balanced infrastructure essential to end-to-end response times.

HDv2 Addresses the CPU Side of AI

Azure HDv2 virtual machines are designed for large CPU-centric AI data systems. Microsoft says the largest configurations will provide nearly 500 physical sixth-generation EPYC cores, 4TB of RAM, 32TB of local NVMe storage and 400Gb Azure Boost networking.
This specification distinguishes physical cores from virtual CPU threads, an important detail for performance-sensitive customers. Dense physical-core configurations can reduce scheduling uncertainty and provide predictable throughput for highly parallel services.

Data preparation remains a major bottleneck

Training and inference pipelines require clean, structured and accessible data. Organizations must extract records, tokenize text, decode media, remove duplicates, enforce policies and construct indexes before an accelerator can use the information effectively.
These operations frequently depend more on CPU throughput, memory capacity and local storage than on GPU matrix engines. If the data pipeline cannot keep up, expensive accelerators sit idle while waiting for work.

Reinforcement learning needs more than GPUs

Reinforcement-learning systems may generate candidate responses, evaluate outcomes, simulate environments and coordinate numerous workers. Some stages benefit from accelerators, while others involve branch-heavy logic, conventional application code or third-party tools that run better on CPUs.
HDv2 could serve as the supporting tier around an accelerator cluster. Customers might use it for data generation, evaluators, reward processing, model routing and agent execution while reserving MI455X capacity for model inference.

Local NVMe supports temporary high-speed data

The inclusion of 32TB of local NVMe storage suggests that HDv2 is intended for workloads that need fast scratch space. Local storage can hold temporary datasets, indexes, caches and intermediate results without repeatedly traversing a remote storage network.
Customers must remember that local VM storage is generally ephemeral. Critical datasets still require durable Azure storage and a carefully designed checkpointing strategy.

EPYC Venice Expands AMD’s Role in Azure

Both Helios and the new CPU-focused VM families rely on AMD’s sixth-generation EPYC processors, code-named Venice. The chips use the Zen 6 architecture, and AMD has said top configurations will offer as many as 256 cores with substantial memory bandwidth.
AMD is manufacturing Venice compute silicon on an advanced 2-nanometer-class process and using sophisticated packaging for its chiplet-based design. That combination aims to increase core density while preserving the modularity that helped EPYC become competitive in cloud data centers.

Chiplets remain a core AMD advantage

Rather than manufacture every function as one enormous die, AMD divides processors into smaller chiplets connected within a package. This approach can improve manufacturing yield and allow the company to combine components produced with different process technologies.
Advanced stacking adds another dimension by placing selected chiplets vertically. The resulting design can reduce communication distances, increase cache density or integrate specialized functions more tightly than a traditional side-by-side package.

Core density can lower cloud overhead

A server with more physical cores can consolidate a larger number of services or provide a very large VM without spanning multiple hosts. That can improve resource utilization and reduce the networking penalties associated with distributing a CPU-heavy application.
The benefits depend on power consumption, memory bandwidth and software scaling. Hundreds of cores are useful only when the application can keep them fed with data and divide work efficiently.

Windows and Linux customers both benefit indirectly

The immediate announcement centers on Azure infrastructure rather than Windows Server hardware for on-premises buyers. Even so, the engineering required to support Venice in Azure should contribute to mature firmware, drivers, virtualization behavior and operating-system scheduling.
Windows developers may also consume the resulting capacity through managed Azure services without ever selecting a specific CPU. The hardware can sit beneath databases, analytics systems, AI services and developer platforms that surface through familiar Microsoft tooling.

HXv2 Pushes Azure Deeper Into Engineering and Chip Design

Azure HXv2 will provide 176 EPYC Venice physical cores running above 5GHz, 50% more addressable cache per core than the previous HX generation and configurations with nearly 2TB or 4TB of memory. Microsoft is also adding 800Gb InfiniBand for tightly coupled distributed workloads.
HXv2 builds on the original HX family launched in 2023, which used AMD’s 3D V-Cache technology to accelerate electronic design automation. The new generation retains that cache-focused approach while broadening the target market to scientific simulation and engineering analysis.

EDA rewards fast cores and large caches

Chip-design software performs tasks such as register-transfer-level simulation, timing analysis, verification and physical design. Many of these operations are sensitive to per-core performance and memory latency rather than simply scaling across every available thread.
A frequency above 5GHz is therefore meaningful. It signals that AMD and Microsoft are optimizing the system for workloads where a smaller number of very fast execution paths can determine the completion time of an entire design stage.

Cache can reduce expensive memory traffic

Electronic design datasets are large and frequently accessed. Additional cache keeps more working data close to the processor, reducing trips to main memory and improving consistency for latency-sensitive algorithms.
AMD’s 3D V-Cache stacks extra cache silicon on the processor package. HXv2’s 50% increase in addressable cache per core could help both EDA and simulation software, although customers will need application-specific benchmarks to quantify the gains.

InfiniBand broadens the HPC audience

The addition of 800Gb InfiniBand makes HXv2 relevant to message-passing interface workloads that distribute a simulation across many nodes. Computational fluid dynamics, weather analysis, structural engineering and scientific models can depend heavily on low-latency communication between processes.
This positions HXv2 as more than a niche chip-design VM. Microsoft is creating a high-frequency, cache-rich HPC platform for customers whose applications do not map naturally to GPUs.

Azure Boost Connects Microsoft’s Infrastructure Layer

Microsoft and AMD will also collaborate on optimizing Azure Boost for AMD hardware. Azure Boost moves storage, networking, security and virtualization functions away from host CPUs and onto dedicated hardware and software components.
The objective is straightforward: customers should receive more of the processor capacity they pay for, while Azure handles infrastructure services in a separate, tightly controlled domain. Offload can also reduce latency variation caused by host-level background work.

Virtualization has a real processing cost

Every cloud VM depends on networking, storage translation, isolation and management services. If the host CPU performs all those functions, some cycles and memory bandwidth are unavailable to customer applications.
Offloading infrastructure work becomes particularly valuable for very large VMs. A machine exposing hundreds of physical cores should not lose a significant portion of its potential to packet handling or storage emulation.

Security benefits accompany performance gains

Azure Boost creates a separate trust boundary for infrastructure control. Microsoft can verify firmware, enforce secure boot, manage encryption and isolate host services from customer workloads more consistently than with a general-purpose host operating system alone.
The design does not make vulnerabilities impossible. It changes the attack surface and makes dedicated hardware, firmware and attestation processes critical parts of Azure’s security model.

Consistent interfaces can hide hardware changes

Cloud customers want faster infrastructure without continually rewriting drivers and deployment templates. Azure Boost can provide a consistent virtual networking and storage interface even as Microsoft changes the physical devices underneath.
That abstraction supports Azure’s heterogeneous strategy. Nvidia, AMD and Microsoft-designed systems can differ substantially at the rack level while presenting a more uniform operational experience to tenants.

Competitive Implications for Nvidia, Intel and Other Clouds

Nvidia remains the dominant supplier of AI accelerators and benefits from a mature CUDA software ecosystem. Microsoft’s AMD deployment does not erase that advantage, but it gives Azure another source of high-end capacity and increases its leverage when planning future infrastructure purchases.
For AMD, winning a production Azure deployment validates Helios before the platform has accumulated years of operational history. Hyperscale acceptance can encourage model developers and software vendors to devote more engineering resources to ROCm.

AMD is competing with systems, not just GPUs

Previous Instinct generations were often judged as individual accelerators against Nvidia products. Helios reframes the comparison around a complete rack, including memory capacity, scale-up networking, Ethernet scale-out, CPUs, DPUs and serviceability.
That is the correct competitive level for modern AI infrastructure. Customers care about application throughput, deployment time and total cost per useful result—not which standalone chip wins a synthetic test.

Microsoft gains negotiating and capacity flexibility

Supporting multiple accelerator suppliers can reduce the risk that one vendor’s production constraints determine Azure’s expansion rate. It also gives Microsoft greater freedom to match hardware with workload characteristics rather than reserving the most expensive platform for every task.
The strategy creates its own costs, including duplicated optimization work and a more complex fleet. Microsoft appears willing to accept that complexity in exchange for supply diversity and stronger control over economics.

Intel faces pressure in CPU-intensive cloud segments

The HDv2 and HXv2 announcements reinforce AMD’s strength in large-core-count and HPC-oriented Azure deployments. Intel remains deeply embedded across enterprise computing, but EPYC’s density, cache options and memory capabilities have made AMD a prominent choice for specialized cloud machines.
Intel must compete not only on processor performance but also on platform integration, packaging, accelerators and networking. The market increasingly rewards vendors that can contribute several coordinated pieces of a data-center architecture.

Other cloud providers will make similar calculations

Cloud competition makes major hardware advantages difficult to keep exclusive for long. Providers must decide whether to embrace Helios, promote competing Nvidia systems, deploy custom accelerators or combine all three approaches.
Azure’s public commitment gives AMD a reference customer that can influence those decisions. It also raises expectations that Helios will receive serious framework, orchestration and managed-service support.

Enterprise and Consumer Impact

Most organizations will never install a Helios rack or interact directly with UALink. They will encounter the platform through Azure VM allocations, managed AI endpoints, Copilot services and applications built by software vendors.
The resulting impact will depend less on spectacular hardware specifications than on availability, pricing and software stability. A technically impressive accelerator provides limited value if customers cannot reserve capacity in the regions where their data and applications reside.

Enterprise customers gain another deployment target

Enterprises using open-source models may be able to select MI455X-backed instances when memory capacity or inference economics make them preferable. Organizations with portable containers and standard frameworks should have more freedom than teams tied to hardware-specific kernels.
Procurement teams will still need to test real workloads. Performance per dollar can change dramatically with model architecture, quantization method, batch size, context length and service-level requirements.

Developers will feel the ROCm difference

AMD’s ROCm platform supports major frameworks and has improved substantially, but CUDA remains the default environment for many AI projects. Dependencies can appear in custom extensions, optimized attention kernels, inference engines and third-party libraries.
A sensible migration process will proceed in stages:

Inventory hardware-specific dependencies in models, containers, extensions and deployment scripts.
Validate functional compatibility on an AMD development environment before reserving large clusters.
Benchmark end-to-end workloads, including tokenization, retrieval, networking and post-processing.
Tune memory placement, precision and batching for MI455X rather than copying settings from another accelerator.
Test failure recovery and observability across multiple nodes and long-running production sessions.
Compare total cost per completed request, not merely hourly VM prices or peak FLOPS.

Consumers may see better service economics

Consumers are unlikely to see an “AMD Helios” switch in Windows or Copilot. The practical benefit could emerge as faster responses, higher service capacity, longer contexts or lower operating costs for AI features.
Those improvements are not guaranteed. Cloud providers may use efficiency gains to expand margins, support more complex models or absorb rising demand rather than reduce subscription prices.

Strengths and Opportunities

The Azure partnership gives both companies several credible paths to improve their competitive position.

Helios provides a complete AMD rack-scale architecture. This reduces the gap between offering a fast accelerator and delivering infrastructure that hyperscalers can deploy at production scale.
The MI455X’s 432GB of HBM4 per GPU creates a strong memory-capacity proposition. Larger memory pools can support bigger models, longer contexts and more concurrent inference sessions.
Open rack and interconnect standards may reduce vendor lock-in. Azure can integrate components and operational practices without committing every layer to one proprietary ecosystem.
EPYC Venice supports both AI and conventional HPC workloads. Microsoft can use related processor technology across Helios, HDv2 and HXv2 rather than treating the GPU platform as an isolated product.
Pensando networking gives AMD control over data movement and infrastructure offload. This is increasingly essential as communication becomes a larger share of AI execution time.
Azure Boost optimization can expose more useful CPU performance to customers. Offloading virtualization work is especially valuable in machines containing hundreds of physical cores.
Microsoft gains another source of advanced AI capacity. Supply diversity can improve deployment flexibility and strengthen Azure’s negotiating position.
ROCm could gain momentum from a prominent production deployment. Developers invest where hardware is available, and Azure can make AMD accelerators accessible without customers purchasing systems directly.

Risks and Concerns

Helios arrives with ambitious specifications, but several technical and commercial uncertainties remain unresolved.

Microsoft has not disclosed pricing or detailed availability. Customers cannot yet determine whether ND MI455X v7 will deliver better economics than existing Azure GPU options.
Real-world performance may diverge from theoretical figures. FP4 throughput and aggregate bandwidth do not reveal latency, utilization or model-specific efficiency.
ROCm maturity remains a competitive concern. Broad framework support does not guarantee that every library, custom kernel or operations tool works as smoothly as its CUDA counterpart.
Open standards still require extensive integration. Firmware, switching, drivers and orchestration must operate reliably across a complex multi-vendor stack.
Liquid cooling and power density constrain deployment. Helios may initially appear only in selected Azure regions with suitably equipped data centers.
Heterogeneous fleets increase operational complexity. Microsoft must optimize models and services across AMD, Nvidia and custom accelerators while maintaining a consistent customer experience.
New silicon and packaging introduce ramp risk. Venice, MI455X, HBM4 and advanced networking components must all reach production volumes on compatible schedules.
Security offload expands firmware responsibility. DPUs, NICs and Azure Boost components add valuable isolation, but each becomes part of the trusted computing base.
Customers may face portability gaps. Applications described as framework-compatible can still depend on undocumented assumptions or hardware-specific optimizations.
Capacity could remain scarce despite the new supplier. Strong demand, HBM availability and data-center construction timelines may limit how quickly Azure can scale the service.

What to Watch Next

The announcement establishes direction, but the decisive information will arrive through product documentation, pricing pages, availability notices and independent performance testing. AMD is expected to begin shipping Helios systems to Microsoft and other customers later in 2026, leaving a relatively short window for Azure to validate and deploy the platform if it intends to offer customer access before year-end.

VM shapes and regional availability

Microsoft must reveal how many MI455X GPUs each ND MI455X v7 allocation exposes, how instances map onto a 72-GPU rack and whether customers can reserve complete scale-up domains. Networking topology and placement guarantees will matter for distributed workloads.
Regional availability will also indicate how challenging the physical deployment is. A launch concentrated in a few AI-focused regions would be normal, but broader expansion will demonstrate whether the Open Rack Wide and liquid-cooling design can be integrated efficiently across Azure’s fleet.

Pricing and performance per dollar

Hourly rates alone will not settle the competitive question. Customers must measure time to first token, output-token throughput, concurrent-user capacity, power-informed pricing and the number of accelerators required to host a given model.
The most informative comparisons will use production inference servers and realistic context lengths. Short synthetic prompts can hide memory, communication and caching behavior that dominates agentic workloads.

Software readiness

Watch for validated support across PyTorch, JAX, vLLM, SGLang, ONNX Runtime, DeepSpeed and Kubernetes-based deployment tools. Microsoft’s own AI software stack will be equally important, particularly if Azure AI services expose MI455X-backed capacity through managed endpoints.
WindowsForum readers should also monitor ONNX and DirectML-related developments. Helios is a data-center platform, but optimizations developed for Azure can influence Microsoft’s wider model deployment and inference toolchain.

Evidence of genuine multi-vendor openness

AMD’s open-standards message will be tested by actual component choice and interoperability. The industry will want to know whether operators can mix qualified switches, racks and management systems or whether practical deployments remain tied to tightly prescribed configurations.
Success would strengthen UALink, Ultra Ethernet and Open Compute Project designs as credible foundations for future AI clusters. Difficulties could reinforce the argument that proprietary integration remains easier to deploy at the highest performance levels.

Adoption beyond Microsoft

Additional hyperscale commitments would indicate that Helios is becoming a platform rather than a collection of bespoke projects. Server manufacturers, regional clouds, sovereign AI operators and research institutions could all broaden the ecosystem.
Microsoft’s experience will carry particular weight because Azure must support secure multi-tenancy, predictable availability and global operations. If Helios performs reliably in that environment, AMD will have a stronger case when competing for the next generation of AI data-center spending.
Microsoft’s Helios deployment marks a significant expansion of choice in Azure and a turning point in AMD’s effort to compete at rack scale. The combination of 72 MI455X GPUs, high-capacity HBM4, EPYC Venice CPUs, Pensando networking and open interconnect standards gives Azure a technically ambitious platform for inference and agentic AI, while HDv2 and HXv2 address the CPU-heavy data and engineering work surrounding those models. The unanswered questions—price, software maturity, regional capacity and sustained application performance—will determine whether Helios becomes a genuine counterweight to Nvidia or simply another specialized option in Microsoft’s rapidly diversifying cloud fleet.

References

Primary source: SiliconANGLE
Published: 2026-07-20T20:20:47+00:00

Microsoft will use AMD’s AI-optimized Helios racks in Azure - SiliconANGLE

Microsoft will use AMD’s AI-optimized Helios racks in Azure - SiliconANGLE

siliconangle.com
Official source: blogs.microsoft.com

Microsoft expands Azure AI and HPC infrastructure with AMD - The Official Microsoft Blog

AI workloads are scaling faster than any single infrastructure approach can support — with more models, new agent-driven workloads and surging compute demand driving the need for greater specialization across the stack. To meet this need, Microsoft continues to evolve Azure’s infrastructure...

blogs.microsoft.com
Official source: learn.microsoft.com

Overview of Azure Boost | Microsoft Learn

Learn more about how Azure Boost can Learn more about how Azure Boost can improve security and performance of your virtual machines.

learn.microsoft.com
Related coverage: neowin.net

Microsoft expands Azure AI infrastructure with AMD's next-generation GPUs and CPUs | Neowin

Alongside its existing NVIDIA systems and proprietary Maia silicon, Microsoft is positioning Azure as a highly flexible AI cloud environment with the new expanded partnership with AMD.

www.neowin.net
Related coverage: telset.id

Microsoft dan AMD Hadirkan Helios untuk AI Compute di Azure | Telset.id

Microsoft resmi mengadopsi sistem AI Helios buatan AMD untuk Azure, menyaingi dominasi Nvidia di pasar GPU data center.

telset.id
Official source: azure.microsoft.com

https://azure.microsoft.com/en-us/pricing/details/virtual-machines/series?msockid=306136e7fb546cc505952096fa336d82

ChatGPT · 2026-07-20T17:01:14-0400

Story update: Additional details — the article above has been updated.

ChatGPT · 2026-07-20T21:30:28-0400

Story update: AMD targets second-half 2026 Helios shipments — the article above has been updated.

Navigation section

Azure Adds AMD HDv2, HXv2 and MI455X v7 AI VM Families

HXv2 raises the ceiling for EDA and MPI workloads​

ND MI455X v7 brings AMD Helios into Azure’s inference plans​

Heterogeneous infrastructure is becoming the Azure product​

Update: Additional details (July 20, 2026)​

Update: AMD targets second-half 2026 Helios shipments (July 21, 2026)​

References​

AI

Background​

From individual chips to complete AI systems​

Azure’s increasingly heterogeneous hardware strategy​

The timing favors more competition​

Helios Turns the Rack Into the Computer​

The double-wide Open Rack design​

Modular trays improve serviceability​

Liquid cooling is mandatory, not optional​

The Instinct MI455X Is Built Around Memory​

Why 432GB per GPU matters​

Bandwidth supports reasoning and long contexts​

Lower-precision compute targets production economics​

Open Networking Is AMD’s Strategic Bet​

Scale-up and scale-out solve different problems​

Pensando becomes central to the design​

Openness could broaden the supplier ecosystem​

ND MI455X v7 Targets Production-Scale Inference​

Inference has become the new infrastructure battleground​

Agentic AI changes the workload profile​

Search and retrieval need balanced infrastructure​

HDv2 Addresses the CPU Side of AI​

Data preparation remains a major bottleneck​

Reinforcement learning needs more than GPUs​

Local NVMe supports temporary high-speed data​

EPYC Venice Expands AMD’s Role in Azure​

Chiplets remain a core AMD advantage​

Core density can lower cloud overhead​

Windows and Linux customers both benefit indirectly​

HXv2 Pushes Azure Deeper Into Engineering and Chip Design​

EDA rewards fast cores and large caches​

Cache can reduce expensive memory traffic​

InfiniBand broadens the HPC audience​

Azure Boost Connects Microsoft’s Infrastructure Layer​

Virtualization has a real processing cost​

Security benefits accompany performance gains​

Consistent interfaces can hide hardware changes​

Competitive Implications for Nvidia, Intel and Other Clouds​

AMD is competing with systems, not just GPUs​

Microsoft gains negotiating and capacity flexibility​

Intel faces pressure in CPU-intensive cloud segments​

Other cloud providers will make similar calculations​

Enterprise and Consumer Impact​

Enterprise customers gain another deployment target​

Developers will feel the ROCm difference​

Consumers may see better service economics​

Strengths and Opportunities​

Risks and Concerns​

What to Watch Next​

VM shapes and regional availability​

Pricing and performance per dollar​

Software readiness​

Evidence of genuine multi-vendor openness​

Adoption beyond Microsoft​

References​

AI

AI

HXv2 raises the ceiling for EDA and MPI workloads

ND MI455X v7 brings AMD Helios into Azure’s inference plans

Heterogeneous infrastructure is becoming the Azure product

Update: Additional details (July 20, 2026)

Update: AMD targets second-half 2026 Helios shipments (July 21, 2026)

References

Background

From individual chips to complete AI systems

Azure’s increasingly heterogeneous hardware strategy

The timing favors more competition

Helios Turns the Rack Into the Computer

The double-wide Open Rack design

Modular trays improve serviceability

Liquid cooling is mandatory, not optional

The Instinct MI455X Is Built Around Memory

Why 432GB per GPU matters

Bandwidth supports reasoning and long contexts

Lower-precision compute targets production economics

Open Networking Is AMD’s Strategic Bet

Scale-up and scale-out solve different problems

Pensando becomes central to the design

Openness could broaden the supplier ecosystem

ND MI455X v7 Targets Production-Scale Inference

Inference has become the new infrastructure battleground

Agentic AI changes the workload profile

Search and retrieval need balanced infrastructure

HDv2 Addresses the CPU Side of AI

Data preparation remains a major bottleneck

Reinforcement learning needs more than GPUs

Local NVMe supports temporary high-speed data

EPYC Venice Expands AMD’s Role in Azure

Chiplets remain a core AMD advantage

Core density can lower cloud overhead

Windows and Linux customers both benefit indirectly

HXv2 Pushes Azure Deeper Into Engineering and Chip Design

EDA rewards fast cores and large caches

Cache can reduce expensive memory traffic

InfiniBand broadens the HPC audience

Azure Boost Connects Microsoft’s Infrastructure Layer

Virtualization has a real processing cost

Security benefits accompany performance gains

Consistent interfaces can hide hardware changes

Competitive Implications for Nvidia, Intel and Other Clouds

AMD is competing with systems, not just GPUs

Microsoft gains negotiating and capacity flexibility

Intel faces pressure in CPU-intensive cloud segments

Other cloud providers will make similar calculations

Enterprise and Consumer Impact

Enterprise customers gain another deployment target

Developers will feel the ROCm difference

Consumers may see better service economics

Strengths and Opportunities

Risks and Concerns

What to Watch Next

VM shapes and regional availability

Pricing and performance per dollar

Software readiness

Evidence of genuine multi-vendor openness

Adoption beyond Microsoft

References