Llama 4 Scout and Maverick are mixture-of-experts models, so the “17B active” label does not describe how much memory is needed to store the full model. Scout has 109B total parameters and Maverick has 400B total parameters. Every expert’s weights must remain available even though each token activates only part of the network.
Short answer
- Llama 4 Scout official BF16 checkpoint: 217.284GB of safetensors before runtime memory. It does not fit wholly in 192GB; 240GB is only a 22.716GB file-only margin.
- Llama 4 Maverick official FP8 checkpoint: 416.756GB of safetensors before runtime memory. It exceeds four 96GB accelerators by files; five provide a 63.244GB file-only margin.
- Llama 4 Maverick official BF16 checkpoint: 803.168GB of safetensors. Eight 96GB accelerators provide only 768GB, so the files alone do not fit.
These are checkpoint-file boundaries, not measured peak memory or speed. Context cache, vision processing, framework allocations, communication buffers and placement can materially raise the requirement.
Use the LLM VRAM calculator and hardware recommender for smaller dense models. For Llama 4, start from the complete official artifact and a documented distributed-runtime plan rather than multiplying 17B active parameters by a bytes-per-weight shortcut.
Official model and checkpoint facts
| Model / official artifact | Total / active parameters | Published context | Safetensors bytes | Decimal GB |
|---|---|---|---|---|
| Llama 4 Scout 17B-16E Instruct, BF16 | 109B / 17B | 10M tokens | 217,283,738,720 | 217.284GB |
| Llama 4 Maverick 17B-128E Instruct, FP8 | 400B / 17B | 1M tokens | 416,755,504,016 | 416.756GB |
| Llama 4 Maverick 17B-128E Instruct, BF16 | 400B / 17B | 1M tokens | 803,167,703,320 | 803.168GB |
Meta describes Scout as 17B active parameters across 16 experts and 109B total parameters. Maverick has 17B active parameters across 128 experts and 400B total parameters. Meta says Scout supports a 10-million-token context and Maverick a 1-million-token context.[1][2] Those maximum context claims do not mean the full window is practical on the minimum hardware: KV-cache format, sequence length, batch, concurrency and runtime implementation determine the additional memory and compute cost.
File-only capacity boundaries
| Aggregate accelerator memory | Scout BF16, 217.284GB | Maverick FP8, 416.756GB | Maverick BF16, 803.168GB |
|---|---|---|---|
| 192GB | Does not fit by files | Does not fit by files | Does not fit by files |
| 240GB | 22.716GB file-only margin | Does not fit by files | Does not fit by files |
| 288GB | 70.716GB file-only margin | Does not fit by files | Does not fit by files |
| 384GB | 166.716GB file-only margin | Does not fit by files | Does not fit by files |
| 480GB | 262.716GB file-only margin | 63.244GB file-only margin | Does not fit by files |
| 640GB | 422.716GB file-only margin | 223.244GB file-only margin | Does not fit by files |
| 768GB | 550.716GB file-only margin | 351.244GB file-only margin | Does not fit by files |
| 864GB | 646.716GB file-only margin | 447.244GB file-only margin | 60.832GB file-only margin |
Why 17B active does not mean a 17B memory footprint
Mixture-of-experts routing reduces how many expert parameters participate in each token’s computation. It does not let a standard deployment discard the inactive experts. Scout’s 109B total parameters and Maverick’s 400B total parameters still have to be stored somewhere—accelerator memory, host memory, storage-backed offload or a distributed combination. Offload can make a model load on a smaller accelerator configuration, but it changes placement and usually changes performance. Report it explicitly rather than calling the result a resident fit.
Meta’s statement that Scout fits on a single NVIDIA H100 refers to Int4 quantization.[1] It must not be applied to the official 217.284GB BF16 artifact in the table. Likewise, Meta says Maverick can run on a single H100 DGX host; that describes a multi-accelerator host class, not one 80GB GPU.[1]
Context and multimodal memory are separate
The published context limit is a capability ceiling, not a promise that the maximum window fits beside the weights on a minimum configuration. Long context adds KV-cache and attention-state costs. Image inputs add preprocessing and vision-token work. Batch and concurrency multiply live state. Before buying hardware, record the real prompt length, output budget, modality, cache precision, batch and concurrent-user target.
The KV-cache guide explains why weight fit is only the first boundary. The multi-GPU guide covers placement, interconnect and why aggregate capacity is not automatic pooling.
A reproducible deployment checklist
- Name the exact artifact: repository, revision and precision—not only “Llama 4.”
- Record every device: exact accelerator, exposed memory, interconnect and topology.
- Record placement: tensor, pipeline or expert parallelism and the layers or experts assigned per device.
- Separate memory categories: peak per-device accelerator memory, host or unified memory, and any storage or CPU offload.
- Describe the workload: text or image inputs, actual context, input/output token counts, batch and concurrency.
- Pin the software: runtime, version, kernels, driver, operating system and launch flags.
- Define the measurement: prompt processing, generation, time to first token and memory peaks are different observations.
Sources
- Meta: The Llama 4 herd
- Meta Llama 4 Maverick official model card
- Official Scout repository API with blob sizes
- Official Maverick BF16 repository API with blob sizes
- Official Maverick FP8 repository API with blob sizes
Reviewed October 25, 2026. File-size arithmetic is not an independent benchmark. Vendor capability and fit statements are labeled as Meta claims.