Magnitude
NVIDIA logo

Nemotron 3.5 Lightning 30B-A3B

by NVIDIA · Released · OpenMDW 1.1

Efficient hybrid MoE model for local reasoning, coding, and agentic workflows.

Parameters
30B · 3B active
Context
1M tokens
Input
Text
Speculative decoding
DFlash
Intelligence
22%
License
OpenMDW 1.1
Variants
NVFP4 QAT · Q4 · Q8
Source
Hugging Face ↗

Downloads

Sizes include the speculative draft Magnitude installs. Every file is pinned to an immutable Hugging Face commit.

Variant Format Download Fidelity
NVFP4 QAT NVFP4QAT 23.6 GB 60/100
Q4 Q4_K_M 26.6 GB 40/100
Q8 Q8_0 36.2 GB 80/100

How it compares

Intelligence across every model in the catalog: each model's Artificial Analysis Intelligence Index score as a percentage of the top model on v4.3.2, as of Sep 29, 2026.

  1. Qwen3.8 27B 59%
  2. Gemma 4 31B 33%
  3. Qwen3.6 35B-A3B 32%
  4. Muse Glimmer 30B 30%
  5. Gemma 4 26B-A4B 29%
  6. Gemma 4 12B 25%
  7. Qwen3.5 4B 23%
  8. MiniCPM5 2B 22%
  9. Nemotron 3.5 Lightning 30B-A3B 22%
  10. Qwen3.5 9B 19%
  11. Gemma 4 E4B 15%
  12. Liquid LFM2.5 2.6B 15%
  13. MiniCPM5 1B 15%
  14. Gemma 4 E2B 14%
  15. Liquid LFM2.5 8B-A1B 13%

Works with your agent

One click in Magnitude connects Nemotron 3.5 Lightning 30B-A3B to any of these harnesses.

  • Pi
  • OpenCode
  • Hermes
  • OpenClaw
  • Codex
  • Claude Code
  • Oh My Pi
  • Cline

Related models

FAQ

How much memory does Nemotron 3.5 Lightning 30B-A3B need?

The smallest download is 23.6 GB and the largest is 36.2 GB. Plan for the weights plus a few gigabytes for context. Magnitude measures your free memory and only recommends variants that fit with room to work.

Can I run Nemotron 3.5 Lightning 30B-A3B on a Mac?

Yes. Magnitude runs GGUF models on Apple Silicon through Metal, and on NVIDIA, AMD, and CPU-only machines on Windows and Linux. The app estimates tokens per second for your exact chip before you download.

Which variant should I pick?

Magnitude picks for you: the highest-fidelity variant that fits your memory. If you choose manually, Q8 keeps the most fidelity, and NVFP4 QAT is the smallest at 23.6 GB.

Catalog data from magnitudedev/magnitude, updated Sep 29, 2026.

Run Nemotron 3.5 Lightning 30B-A3B on your machine

Other platforms