Post

New gpt-oss-120b Hardware Guide: 64GB, H100, 96GB or Multi-GPU?

HighVRAM’s new gpt-oss-120b hardware guide turns OpenAI’s published memory boundary into six practical deployment paths. The core evidence is specific: gpt-oss-120b needs at least 60GB of VRAM in the cited MXFP4 Transformers path, or a multi-GPU setup, and OpenAI says it fits on one H100.

What that guidance does—and does not—prove

PathWhy it belongs in the decisionWhat still needs proof
64GBFirst common label above the ≥60GB floorOnly 4GB nominal margin before cache and runtime state
H100 80GBOpenAI’s cited single-GPU classExact PCIe/SXM/NVL identity, host, context and concurrency
RTX PRO 6000 96GBOne large current-generation CUDA poolMXFP4 kernel support, measured peak and whole-system requirements
DGX Spark / GB10128GB shared memory in a compact Blackwell systemArm64 runtime support, host sharing and measured throughput
Large-memory MacCapacity for compatible converted artifactsA separate MLX/Metal/llama.cpp path—not the cited CUDA path
Multi-GPUOpenAI documents tensor and expert parallelismPlacement, topology and each device’s peak allocation
Decision paths, not a performance ranking. Capacity labels do not establish software support or speed.

Three safeguards before buying

  • Active parameters are not stored weights: 5.1B active describes MoE routing; gpt-oss-120b has 117B total parameters.
  • Maximum context is not a fit guarantee: the 131,072-token capability still requires cache, buffers and workload-specific headroom.
  • Multiple cards do not become one automatic pool: tensor/expert parallelism, per-device capacity and interconnect must be planned.

Follow the decision path

  1. Read the complete 120B hardware guide.
  2. Review the gpt-oss-20b versus 120b requirements.
  3. Compare 48GB through 96GB capacity paths and the GPU comparison directory.
  4. Use the VRAM calculator as a planning range, then validate in the intended runtime.
  5. Inspect the benchmark database or submit a controlled result.
  6. Stage the new private gpt-oss-120b watchlist preset before checking current hardware.

Published October 25, 2026. The ≥60GB and single-H100 statements are OpenAI guidance for the cited MXFP4 path. HighVRAM has not independently benchmarked every system. Inclusion is not endorsement or ranking.