GLM-5.2 (744B-A40B MoE) has 744 billion parameters. At standard 4-bit quantization with 8K context, it needs roughly 500.5 GB of VRAM — weights plus cache and runtime overhead.
VRAM by quantization
| Precision | Weights | Cache/Buffer | Total VRAM |
|---|---|---|---|
| 2-bit (IQ2_XXS) | 238.1 GB | 89.3 GB | 329.4 GB |
| 4-bit (Q4_K_M) | 409.2 GB | 89.3 GB | 500.5 GB |
| 8-bit (Q8_0) | 781.2 GB | 89.3 GB | 872.5 GB |
| 16-bit (FP16) | 1488.0 GB | 89.3 GB | 1579.3 GB |
Which GPU can run GLM-5.2 (744B-A40B MoE) (at 4-bit)?
| GPU class | VRAM | GLM-5.2 (744B-A40B MoE) (500.5 GB) |
|---|---|---|
| 8 GB · RTX 5060 / 4060 | 8 GB | Won’t fit |
| 12 GB · RTX 5070 / 3060 | 12 GB | Won’t fit |
| 16 GB · RTX 5070 Ti / 4080 | 16 GB | Won’t fit |
| 24 GB · RTX 4090 / 3090 | 24 GB | Won’t fit |
| 32 GB · RTX 5090 | 32 GB | Won’t fit |
| 48 GB · 2×24 / RTX 6000 Ada | 48 GB | Won’t fit |
| 128 GB · M-series / RTX Spark | 128 GB | Won’t fit |
Jun 2026 SOTA open-weight MoE (40B active). 1M context. Tops open-weight leaderboards.
Get the exact number for your setup
Pick your model, quantization, and context length — the calculator shows the full VRAM math and tells you precisely which hardware fits.
Open the Local AI Calculator →
VRAM figures are reproducible estimates (weights + KV cache + overhead) and vary by runtime and quant format. Data current as of 2026-07-05.