AMD has shared more details on its new Radeon AI PRO R9700 GPU, a RDNA 4-based card made to push AI work much more than its current Radeon PRO W7800.
Radeon AI PRO R9700 Main Specs and AI Focus
The Radeon AI PRO R9700 is a key part of AMD's plan to grow AI speed across many types of products, fitting in for multi-GPU edge guesswork and dealing with small to medium big talk models (LLMs). This joins with AMD's new ROCm 7 software set growth.
Main specs of the Radeon AI PRO R9700 include:
- GPU Build Navi 48 (RDNA 4)
- Compute Units 64 (4096 Stream Processors)
- AI Speed-ups 128
- Memory 32 GB GDDR6 on a 256-bit bus (twice the VRAM of the W7900 XT).
- TBP (Full Board Power) Up to 300W.
- FP16 Compute 96 TFLOPs.
- INT4 TOPS (Sparse) 1531.
The 32 GB VRAM is seen as best for top local AI tasks, including models like DeepSeek R1 Distill Qwen 32B Q6 and Mistral Small 3.1 24B.
Big Gains and Matches
AMD claims the Radeon AI PRO R9700 shows big gains in its work:
- vs. Radeon PRO W7800 (32GB) Twice as fast on DeepSeek R1.
- FP16 Compute A 2x boost over the Radeon PRO W7800.
- INT8/INT4 Rates A 4x gain when matched to the W7800.
- vs. RTX 5080 (16GB) AMD points out up to 5x quicker work in AI tasks that need more memory than the 16GB VRAM of the other card.
Full compute details for the R9700 are:
- FP32 47.8 TFLOPs
- FP16 / BF16 191.4 TFLOPs
- FP8 382.7 TFLOPs
- INT8 382.7 TOPS
- INT4 765.5 TOPS (1531 TOPS with Sparsity)
The GPU will work with Wave Matrix Multiply Add (WMMA) steps and Structured Sparsity.
Need for Bigger Model Help and Multi-GPU Growth
AMD underlines that more VRAM and help for larger AI models bring out high-quality results, like in image-making from text (8B model vs. 1B model) and thinking jobs (32B model vs. 8B model). In one GPU match for FP16 AI work, the R9700 shows over a 2x boost in DeepSeek R1 Distill Llama (8B) over the W7800.
Also, the Radeon AI PRO R9700 backs 4-way multi-GPU setups on PCIe 5.0 set-ups. This makes for a total 128 GB VRAM pool, good to manage very big models like Mistral 123B and DeepSeek R1 70B, which may use up to 112-116 GB of VRAM.
When to get it and Design
The AMD Radeon AI PRO R9700 GPU is set to be out in July this year. It will come out through AMD's friends like ASUS, ASRock, Gigabyte, PowerColor, Sapphire, XFX, and Yeston. The card will have a dual-slot look with a blower-style cooler.
