Post

HighVRAM Weekly Digest #6: DGX Spark vs A100, H100 and H200

This week’s practical question: when does a compact 128GB DGX Spark make more sense than a used A100, a qualified H100 platform, or an H200 system? The answer depends on the exact artifact, usable memory boundary, runtime architecture, deployment platform, and measured workload—not the largest specification number.

Four paths, four different constraints

PathAdvertised memoryWhat decides the purchase
DGX Spark128GB coherent shared LPDDR5xOne compact complete Arm/DGX OS system; verify Arm64 runtime support and shared-memory headroom.
A100 versus Spark40GB or 80GB dedicated HBMQualified PCIe/SXM server, passive airflow, MIG state, exact used identity and complete host cost.
H100 versus Spark80GB PCIe/SXM or 94GB NVLExact Hopper variant, host, cooling, MIG and software stack; 94GB NVL is not interchangeable with 80GB H100.
H200 versus Spark141GB dedicated HBM3eOnly 13GB more advertised capacity than Spark, but a radically different HBM, server, power and acquisition path.

The exact boundaries worth remembering

  • Qwen3.5-35B-A3B BF16, 71.904GB: one A100 80GB leaves an 8.096GB file-only device margin; DGX Spark leaves a 56.096GB nominal shared-system-memory margin.
  • Qwen3.5-122B-A10B official GPTQ, 78.864GB: one A100 80GB leaves an unsafe 1.136GB file-only margin; H100 80GB has the same nominal boundary; H100 NVL 94GB leaves 15.136GB.
  • Qwen3.5-122B-A10B Q4_K_M plus projector, 77.446GB: one 80GB accelerator leaves 2.554GB before runtime overhead; Spark leaves 50.554GB nominal shared-memory space.
  • Qwen3.5-122B-A10B FP8, 127.163GB: Spark’s 128GB headline leaves only 0.837GB before the OS and runtime—an unsafe boundary. H200’s 141GB headline leaves 13.837GB, which still requires runtime validation.

These are arithmetic gates against listed file sizes, not measured peak memory and not speed claims. Start with the exact 35B and 122B artifact guides before selecting hardware.

Capacity is not the platform

DGX Spark’s 128GB is coherent shared system memory for its integrated CPU and GPU. A100, H100 and H200 advertise dedicated accelerator memory, and MIG can expose only a slice of it to a workload. NVIDIA’s published 273GB/s Spark bandwidth and the accelerators’ HBM bandwidth figures describe different memory systems; they do not predict application throughput by themselves.

A bare A100 or SXM module is not a working desktop. Price the server, CPU, RAM, storage, power, airflow, firmware and driver path. Conversely, do not assume a CUDA project has an Arm64-ready package or container merely because DGX Spark runs CUDA.

A defensible selection sequence

  1. Choose the exact artifact, revision, projector and runtime.
  2. Pass the file-size gate, then budget OS/runtime, KV cache, workspace, concurrency and allocator headroom.
  3. Verify Arm64 versus x86 support, exact CUDA generation and required kernels.
  4. For an accelerator, verify PCIe/SXM/NVL identity, qualified host, cooling, power and MIG state.
  5. Run the same prompt set, context, concurrency, timing definition, warm-ups and repetitions.
  6. Record both exposed capacity and measured peak memory rather than copying a product headline.

Turn the comparison into evidence

The public benchmark database remains a fixed snapshot of 43 metric observations from seven sources; it does not yet contain a controlled DGX Spark-versus-A100/H100/H200 series. That absence is a reason to collect comparable evidence, not to manufacture a ranking.

Follow the decision

Use the DGX Spark alternatives hub, inspect screened offers, or stage a browser-private record on Follow the high-VRAM market. The watchlist remains in your browser; RSS delivery is available without an account, while email signup and delivery are not active.

Browse the Weekly Digest archive for earlier decision maps.

Sources and limits

Checked October 25, 2026. Published specifications are not measured HighVRAM performance. Marketplace price, condition and availability change independently. Some marketplace links may be affiliate links; that does not affect editorial ranking.

Consumer-GPU companion: DGX Spark vs RTX 4090 maps the same exact Qwen3.5 evidence to a 24GB dedicated desktop card and 128GB shared complete system.

Used-market companion: DGX Spark vs RTX 3090 maps the same model evidence to a common used 24GB card and preserves two-GPU/NVLink limits.