GLM-4.7 comes in hardware classes that are easy to confuse. The official GLM-4.7-Flash BF16 checkpoint is 62.444GB, while the full GLM-4.7 model is 362.064GB in the official FP8 repository and 716.681GB in BF16. Those are checkpoint-file totals before KV cache, framework allocations, temporary buffers, batch or concurrency.
Short answer
- GLM-4.7-Flash BF16: 62.444GB of official safetensors. A nominal 64GB device leaves only 1.556GB before runtime overhead, so 64GB is not a credible fully resident target. An 80GB device leaves 17.556GB.
- GLM-4.7 FP8: 362.064GB of official safetensors. Four 80GB GPUs do not fit the files; four 96GB devices leave only 21.936GB aggregate file-only margin.
- GLM-4.7 BF16: 716.681GB of official safetensors. Eight 80GB GPUs do not fit the files; eight 96GB devices leave 51.319GB aggregate file-only margin.
A positive aggregate margin is necessary, not sufficient. Each device needs a viable shard and runtime headroom, and separate GPUs do not become one automatic memory pool.
Use the LLM VRAM calculator and hardware recommender for a first-pass estimate. For these MoE checkpoints, plan from the exact artifact, per-device placement and workload—not just the active-parameter label.
Official checkpoint facts
| Official repository | Model metadata / card | Maximum positions | Safetensors bytes | Decimal GB |
|---|---|---|---|---|
| zai-org/GLM-4.7-Flash | 30B-A3B MoE; BF16 files | 202,752 | 62,444,175,504 | 62.444GB |
| zai-org/GLM-4.7-FP8 | 358,337,791,296 parameters in repository metadata; FP8-compressed files | 202,752 | 362,063,524,792 | 362.064GB |
| zai-org/GLM-4.7 | 358,337,791,296 parameters in repository metadata; BF16 files | 202,752 | 716,681,196,792 | 716.681GB |
Z.ai describes Flash as a 30B-A3B mixture-of-experts model: roughly 30B total parameters, with about 3B active per token. The full GLM-4.7 repositories report about 358.338B parameters. MoE routing reduces the parameters used in each token’s computation, but a normal resident deployment still needs the full checkpoint available across accelerator memory, host memory or an explicitly documented offload plan.
File-only capacity boundaries
| Nominal aggregate memory | Flash BF16, 62.444GB | GLM-4.7 FP8, 362.064GB | GLM-4.7 BF16, 716.681GB |
|---|---|---|---|
| 48GB | Does not fit by files | Does not fit by files | Does not fit by files |
| 64GB | 1.556GB file-only margin; not credible for a resident runtime | Does not fit by files | Does not fit by files |
| 80GB | 17.556GB file-only margin | Does not fit by files | Does not fit by files |
| 96GB | 33.556GB file-only margin | Does not fit by files | Does not fit by files |
| 320GB (4×80GB) | 257.556GB file-only margin | Does not fit by files | Does not fit by files |
| 384GB (4×96GB) | 321.556GB file-only margin | 21.936GB file-only margin | Does not fit by files |
| 480GB | 417.556GB file-only margin | 117.936GB file-only margin | Does not fit by files |
| 640GB (8×80GB) | 577.556GB file-only margin | 277.936GB file-only margin | Does not fit by files |
| 768GB (8×96GB) | 705.556GB file-only margin | 405.936GB file-only margin | 51.319GB file-only margin |
| 864GB | 801.556GB file-only margin | 501.936GB file-only margin | 147.319GB file-only margin |
Why 64GB is a trap for GLM-4.7-Flash
The 62.444GB checkpoint technically fits inside a nominal 64GB number by decimal subtraction, but only 1.556GB remains. The runtime still needs memory for weights that may be represented differently after loading, KV cache, activations, workspaces and allocator fragmentation. Capacity is also often marketed in decimal units while software reports binary GiB. Treat 64GB as a file-transfer boundary, not a responsible promise of a fully resident inference setup.
An 80GB-class accelerator leaves 17.556GB before runtime allocations and is the first common single-device class worth testing for the official Flash BF16 artifact. Whether the desired context, batch and speed fit must still be measured. A quantized community artifact may fit smaller hardware, but its repository, quantization method and measured quality belong in a separate claim.
Context can dominate the remaining margin
All three official configs declare max_position_embeddings: 202752. That is an architecture limit, not proof that 202,752 tokens fit on the minimum weight-capacity configuration. KV-cache memory grows with live sequence length and concurrency; long generations also require output headroom. Test the actual input length, output budget, batch, cache precision and number of simultaneous users.
See the KV-cache guide for the hidden memory term and the multi-GPU guide for tensor parallelism, placement and interconnect caveats.
Deployment checklist
- Name the exact repository and revision: Flash BF16, full FP8 and full BF16 differ by hundreds of gigabytes.
- Record every device: exact model, exposed memory and topology.
- Choose supported software: Z.ai’s model cards list vLLM, SGLang and Transformers instructions, including development or nightly requirements at publication time.
- Define placement: tensor, pipeline or expert parallelism; list CPU, host-memory or storage offload separately.
- Describe the workload: prompt length, output length, batch, concurrency and cache precision.
- Measure per-device peaks: aggregate memory can hide one overloaded shard.
- Report speed and memory separately: loading successfully is not the same as a useful tokens-per-second result.
Sources
- Official GLM-4.7-Flash model card
- Official GLM-4.7-FP8 model card
- Official GLM-4.7 model card
- Official Flash repository API with blob sizes
- Official FP8 repository API with blob sizes
- Official BF16 repository API with blob sizes
Reviewed October 25, 2026. File-size arithmetic is not an independent benchmark. Vendor architecture and capability statements are labeled as Z.ai claims.
Choosing hardware for the official Flash BF16 checkpoint? The GLM-4.7-Flash hardware guide maps the exact 62.444GB files onto A100, H100, RTX PRO 6000, H200, B200 and B300 paths without turning capacity into a speed ranking.