AMD Announces Threadripper Halo Station: A High-End AI-Centric Developer Workstation

As part of an AI-centric opening keynote for this year’s IFA tech convention in Berlin, AMD has announced that the company is adding another Halo-branded developer device to their lineup of systems with the Threadripper Halo Station. The forthcoming dev system is a full tower system based on a pairing of a Threadripper Pro CPU and Instinct MI350P accelerators, with the purpose of offering a high-end, high-throughput system for local AI inference and development.

Announced by Jack Huynh, AMD’s Senior VP and GM of their Computing and Graphics system, the Threadripper Halo Station is intended to augment AMD’s existing Ryzen AI Halo box, which was their initial Halo system based around the company’s Ryzen AI Max+ (Strix Halo) processors. In the case of the Threadripper Halo Station, the use of a Threadripper Pro processor and discrete AI accelerator cards is essentially AMD going for the other end of the market, with a high-performance system that can offer far better performance than what the petite Ryzen AI Halo boxes can offer. Diving right in to the hardware itself, the Threadripper Halo Station briefly demoed by AMD at IFA appears to be a tower system assembled from existing commercial-on-the-shelf AMD components. At the heart of the system is a Threadripper Pro processor. Huynh explicitly mentioned that the system on display featured a 96-core processor (and with no qualification of “up to”), which would be AMD’s flagship workstation Ryzen Threadripper PRO 9995WX processor. This is a 96 core Zen 5 chip with 8 channels of DDR5 memory and 128 lanes of PCIe Gen5 connectivity. According to AMD, the Halo Station systems will ship with up to 2GB of memory. Meanwhile the bulk of the heavy lifting in terms of AI workloads is provided by AMD’s Instinct MI350P accelerator cards. Launched a bit earlier this year, the MI350P is a cut-down version of AMD’s CDNA 4 architecture MI350X accelerator that is designed to fit in a PCIe form factor. Each one of these cards comes with 144GB of HBM3E memory, and enough of AMD’s matrix cores to offer 2.3 PFLOPS of MXFP8 performance. The base Threadripper Halo Station configuration will come with two of these accelerators, giving the system a total of 288GB of GPU memory. According to AMD there is “a path” to installing 4 of them for even more performance and local memory capacity (576GB), though it is unclear at the moment if the company is talking about selling systems with that configuration, or that as a PCIe-based system customers could install more accelerators. Notably here, these are not standard MI350P cards: the cards in the Halo Station are liquid cooled cards. In fact, all of the major processors on the system are liquid cooled, as AMD is looking to maximize cooling capacity and minimize noise generation. With that said, the showcase system was using closed loop radiators for each processor rather than a shared loop across the entire system, underscoring how this system is assembled from COTS hardware rather than being a more customized and optimized design.