AMD Ryzen AI Max PRO 400 Series and Ryzen AI Halo Platform Enable Local Enterprise AI Processing and High Performance Workstation Computing
The domain of enterprise workstation computing is shifting from its reliance on the centralized cloud infrastructure, towards the local hardware platform, while taking on the heavy workload of AI processing locally. Towards achieving this transition, AMD has introduced the brand new Ryzen AI Max PRO 400 series processors, in addition to its Ryzen AI Halo developer platform. These systems are aimed at providing a localized execution layer to handle the vast memory requirements, and low latency expectations, of an autonomous digital agent.
The senior vice president and general manager of the Computing and Graphics Group, Jack Huynh, underlined the significance of the move towards localized hardware. Mr Huynh said that:
"AI is no longer a cloud play and it is something that developers can now build, train, and execute locally."
According to Mr Huynh, the Ryzen AI Halo and Ryzen AI Max PRO 400 series offer the processing power, memory space, and open software stack to enable advanced agent system in local workstations.
The newly launched Ryzen AI Max PRO 400 series offers the worlds first x86 client processors capable of running 300,000,000,000 parameter models locally on its own silicon. Built on the AMD Zen 5 CPU architecture with an RDNA 3.5 graphic solution, the processors incorporate the XDNA 2 neural processing unit to enable the immense memory usage and low latency of intelligent agents. To provide the system with the capacity for vast datasets and concurrent agent usage, the higher tier models, are offering up to 192GB of unified system memory and 160GB of dedicated VRAM, essentially creating a single monolithic system of high performance compute and visualization.
The product family consists of 3 different models aimed at mobile workstations, and small form factor desktops.
- Ryzen AI Max+ PRO 495: The flagship processor that offers 16 CPU cores and 32 threads with a base and boost frequency respectively of 3.1GHz and up to 5.2GHz. Its cache is of 80MB while the graphics offered include Radeon 8065S graphics with 40 compute units, and the NPU is capable of 55 TOPS. It has a thermal design power (TDP) between 45 120W.
- Ryzen AI Max PRO 490: It has 12 CPU cores and 24 threads that run between 3.2GHz base, and boost to 5.0GHz. The cache is 76MB and the integrated graphics are Radeon 8050S with 32 compute units. Its NPU offers up to 50 TOPS. Its TDP range is 45 120W.
- Ryzen AI Max PRO 485: With 8 CPU cores and 16 threads. Its frequencies range from 3.6GHz to 5.0GHz boost, with a 40MB cache. The graphics feature Radeon 8030S with 32 compute units. The NPU offers 50 TOPS, with the same TDP as above.
To help software engineers develop the necessary applications for the new intelligent agents, the Ryzen AI Halo developer platform has been introduced. It offers an on premises sandbox to allow the development, testing, and execution of generative applications. The first available development kits will be running on the Ryzen AI Max+ 395, with 128GB of system memory, an ample amount to run 200,000,000,000 parameter models locally. It provides a unified framework which supports easy transition from prototyping on the Linux OS to actual production with Windows, without affecting performance. The platform supports widely used frameworks such as PyTorch, vLLM, llama.cpp, Ollama, ComfyUI, and LM Studio and comes optimized to run with the open source AMD ROCm software stack.
Major hardware manufacturers are already making efforts to incorporate these processors in their commercial offerings. Ketan Patel, the president of Personal Systems at HP Inc. Said that:
"HP is creating new solutions for customers that combine local execution capabilities and high performance with the ultimate security afforded by local data processing," adding that "HP is also expanding its workstation portfolio to include the AMD Ryzen AI Halo Platform, empowering our customers to bridge the gap between experimentation and active production."
Luca Rossi, the president of Intelligent Devices Group at Lenovo, also stated that the ability of systems to "process and respond instantly" in local, and consequently "keep sensitive data protected within enterprise boundaries," is facilitated by the convergence of the hardware and software stack in the system.
Pre orders for the Ryzen AI Halo developer platform will be launched solely on Micro Center mid year, whereas the highly anticipated commercial workstations with the Ryzen AI Max PRO 400 series processors are expected to become available from OEMs including HP, and Lenovo by the end of the year.
