Magnitude
NVIDIA logo

Nemotron 3.5 Bolt 74B-A9B

by NVIDIA · Released · OpenMDW 1.1

Compressed hybrid MoE vision model with 2-bit expert weights, sized for 24GB machines.

Parameters
74B · 9B active
Context
256K tokens
Input
Text + image
Speculative decoding
LiLiCorr
Intelligence
33%
License
OpenMDW 1.1
Variants
IQ2 QAT
Source
Hugging Face ↗

Downloads

Sizes include the vision projector and speculative draft Magnitude installs. Every file is pinned to an immutable Hugging Face commit.

Variant Format Download Fidelity
IQ2 QAT IQ2_XXSQAT 24.8 GB 38/100

How it compares

Intelligence across every model in the catalog: each model's Artificial Analysis Intelligence Index score as a percentage of the top model on v4.3.2, as of Sep 29, 2026.

  1. Qwen3.8 Flash Next 69%
  2. Qwen3.8 27B 59%
  3. Nemotron 3.5 Super VL 120B-A12B 46%
  4. Gemma 4 31B 33%
  5. MiniCPM-V 4.7 35B-A3B 33%
  6. Nemotron 3.5 Bolt 74B-A9B 33%
  7. Qwen3.6 35B-A3B 32%
  8. Muse Glimmer 30B 30%
  9. Gemma 4 26B-A4B 29%
  10. Liquid LFM2.5 24B-A2B 27%
  11. Gemma 4 12B 25%
  12. Liquid LFM3 1.7B 24%
  13. Qwen3.5 4B 23%
  14. Liquid LFM3-VL 2B 22%
  15. MiniCPM5 2B 22%
  16. Nemotron 3.5 Lightning 30B-A3B 22%
  17. Qwen3.5 9B 19%
  18. Gemma 4 E4B 15%
  19. Liquid LFM2.5 2.6B 15%
  20. MiniCPM5 1B 15%
  21. Gemma 4 E2B 14%
  22. Liquid LFM2.5 8B-A1B 13%
  23. MiniCPM-V 4.7 1B 10%

Works with your agent

One click in Magnitude connects Nemotron 3.5 Bolt 74B-A9B to any of these harnesses.

  • Pi
  • OpenCode
  • Hermes
  • OpenClaw
  • Codex
  • Claude Code
  • Oh My Pi
  • Cline

Related models

FAQ

How much memory does Nemotron 3.5 Bolt 74B-A9B need?

The smallest download is 24.8 GB. Plan for the weights plus a few gigabytes for context. Magnitude measures your free memory and only recommends variants that fit with room to work.

Can I run Nemotron 3.5 Bolt 74B-A9B on a Mac?

Yes. Magnitude runs GGUF models on Apple Silicon through Metal, and on NVIDIA, AMD, and CPU-only machines on Windows and Linux. The app estimates tokens per second for your exact chip before you download.

Which variant should I pick?

Magnitude picks for you: the highest-fidelity variant that fits your memory. If you choose manually, IQ2 QAT keeps the most fidelity.

Catalog data from magnitudedev/magnitude, updated Oct 28, 2026.

Run Nemotron 3.5 Bolt 74B-A9B on your machine

Download Magnitude