Mistral AI
Can the Radeon AI Pro R9700 run Mistral Small 3.2 24B?
We earn from qualifying purchases via affiliate links. Disclosure.
Yes. Mistral Small 3.2 24B is a 15 GB download (Q4_K_M). The Radeon AI Pro R9700 gives the GPU 32 GB, leaving about 17 GB for context and runtime (our arithmetic).
Does it fit?
| Mistral Small 3.2 24B memory | 15 GB at Q4_K_M (Ollama: mistral-small3.2 tags) |
|---|---|
| Radeon AI Pro R9700 GPU memory | 32 GB of VRAM (product listing). |
| Left over | About 17 GB (our arithmetic) |
| Verdict | Fits 4 GB or more to spare (our estimate bands) |
Recommended quantization and context
Use the Q4_K_M build that Ollama's tag downloads; the memory figure above is for that build. The model supports up to 128K of context, but longer context uses more memory. Ollama starts at a 4096-token context by default (Ollama FAQ).
With about 17 GB spare you have room to raise the context. Raise it in steps and re-check with ollama ps.
Run it
ollama run mistral-small3.2:24bThen check it's on the GPU:
ollama psThe PROCESSOR column should read 100% GPU. Driver setup for AMD cards on Windows, Linux and macOS, plus common fixes, is in the install and run section.
Where to buy the Radeon AI Pro R9700
ASUS Turbo Radeon AI Pro R9700 32GB
$1,999.99 Newegg · checked Oct 27, 2026, about 12:35 PM CT
Out of stock / unavailable
OUT OF STOCK when checked (search page)
Check price at Newegg (opens in a new tab)FAQ
Can the Radeon AI Pro R9700 run Mistral Small 3.2 24B?
Yes: Mistral Small 3.2 24B needs 15 GB (Q4_K_M, Ollama library) and the Radeon AI Pro R9700 gives the GPU 32 GB, leaving about 17 GB. That leaves room to raise the context above the 4096-token default. The fit bands are our estimate.
How much VRAM does Mistral Small 3.2 24B need?
15 GB for the Q4_K_M build in the Ollama library, plus roughly 1–4 GB for context and runtime (our estimate). See the 16 GB page for other models that fit.
What command runs Mistral Small 3.2 24B?
ollama run mistral-small3.2:24b. Then run "ollama ps" and check the PROCESSOR column reads 100% GPU.
How fast is Mistral Small 3.2 24B on the Radeon AI Pro R9700?
We don't list a speed because we have no sourced measurement for this pairing. Speed depends on memory bandwidth, quantization and context length.