Run Mistral Small 3.2 24B on a VPS.
prices as of · Contabo as of · 82 of 524 plans fit, disk included · re-ranked daily
Dense 24B with vision and function calling; the practical ceiling for a 24 GB box. On a CPU-only VPS it needs about 17.1 GB of RAM: 14.3 GB of Q4_K_M weights, 1.3 GB of KV cache for an 8,192-token context and 1.5 GB for the OS and runtime. 82 of the 524 plans in our index fit and include a disk; the cheapest comfortable pick is OVHcloud's VPS-4 2027 · 8 vCPU / 24 GB · EU at $27.11/mo, streaming an estimated 1.3–2.6 tok/s.
The cheapest VPS that runs Mistral Small 3.2 24B is OVHcloud VPS-4 2027 at $27.11/mo, 24 GB of RAM against the 17.1 GB the model needs, checked 16 Sept 2026.
Best VPS plans for Mistral Small 3.2 24B
ranked by estimated tokens/s per dollar, comfortable fits first
- 1runs comfortably~2.5–4.9 tok/s$38.71/moView at netcup ↗
- 2runs comfortably~1.3–2.6 tok/s$16.15/mochecked 10 days agoView at Contabo ↗
- 3runs comfortably~1.6–3.3 tok/s$28.85/mochecked 10 days agoView at Contabo ↗
- 4runs comfortably~1.6–3.3 tok/s$31.43/moView at netcup ↗
- 5runs comfortably~1.3–2.6 tok/s$27.11/moView at OVHcloud ↗
- 6runs comfortably~1.3–2.6 tok/s$27.50/moView at OVHcloud ↗
Speed = effective memory bandwidth ÷ active weight bytes (4 GB/s per shared vCPU, 6 per dedicated), shown as a band. Real numbers depend on the host CPU generation, AVX-512/AMX support and how noisy the neighbors are, so treat these as order-of-magnitude estimates.
RAM needed · CPU inference
17.1 GB
- weights · Q4_K_M
- 14.3 GB
- KV cache · 8K context
- 1.3 GB
- OS + runtime headroom
- 1.5 GB
Other quants: Q8_0 weights 25.1 GB (near-lossless, about half of F16); F16 47.2 GB. Comfortable = 20% headroom over the total.
Model card
- Size
- 24B parameters
- Context
- 128K tokens
- Kind
- chat · vision
- Released
- 2025-06
- License
- Apache-2.0
Facts fetched from Hugging Face on 7 Sept 2026: exact GGUF file sizes, KV geometry from the GGUF header · 124,606 downloads.
Or rent it as an API · 16 providers sell Mistral Small 3.2 24B
every price for Mistral Small 3.2 24B →Mistral AI list price
$0.53/M tokens
Cheapest price we can explain
$0.43/M tokens
DeepInfra, read 16 Sept 2026
What the VPS price buys
64M tokens/mo
at $27.11/mo
Token prices are per million, three parts input to one part output, and exclude tax. A rented box costs the same whether or not you use it and runs whatever else you put on it; an API charges for what you send and nothing when you stop.
Or buy hardware · 9 reference machines fit
all machines →- Mac mini (M6, 32 GB)32 GB · 153 GB/s · ~5.5–8.5 tok/s$1,299= 48 mo of VPS
- Framework Desktop (Ryzen AI Max+ 395, 64 GB)64 GB · 256 GB/s · ~9.2–14 tok/s$1,659*= 61 mo of VPS
- Mac mini (M5 Pro, 24 GB)24 GB · 307 GB/s · ~11–17 tok/s$1,699= 63 mo of VPS
- Mac mini (M5 Pro, 64 GB)64 GB · 307 GB/s · ~11–17 tok/s$2,299= 85 mo of VPS
- Mac Studio (M5 Max, 36 GB)36 GB · 460 GB/s · ~17–25 tok/s$2,499= 92 mo of VPS
- Framework Desktop (Ryzen AI Max+ 395, 128 GB)128 GB · 256 GB/s · ~9.2–14 tok/s$3,149*= 116 mo of VPS
Buy · per month
$37.45
$36.08 hardware + $1.36 power
Rent · per month
$27.11
OVHcloud VPS-4 2027 · 8 vCPU / 24 GB · EU
Break-even
The Mac mini (M6, 32 GB) pays for itself after 50 months of replacing the VPS, and it streams an estimated 5.5–8.5 tok/s against the VPS's CPU-only pace.
* approximate: August 2026 US retail median rather than list price. Local speed = peak bandwidth × 0.7 efficiency (0.35 on CPU-only boards) ÷ active weight bytes; unified-memory machines are assumed to give models 75% of their RAM. GPU cards need a host PC that is not included in the price.
Frequently asked
- How much RAM does Mistral Small 3.2 24B need?
- About 17.1 GB for CPU inference at Q4_K_M: 14.3 GB of weights, 1.3 GB of KV cache at 8,192 tokens of context, and 1.5 GB of headroom. Longer contexts need more KV cache (160 KB per token for this model).
- What is the cheapest VPS that can run Mistral Small 3.2 24B?
- OVHcloud VPS-4 2027 · 8 vCPU / 24 GB · EU (24 GB RAM, 8 vCPU) at $27.11/mo excl. VAT runs it comfortably as of 16 Sept 2026.
- How fast will Mistral Small 3.2 24B run on a VPS without a GPU?
- Roughly 2.5–4.9 tok/s on the top pick. Token generation is limited by memory bandwidth, because each new token reads all of the weights once. More vCPUs help, dedicated ones most, but a GPU or an Apple silicon machine is 10 to 50 times faster.