Nemotron 3.5 Lightning’s Switchyard Router Can Double Inference Costs
Nvidia’s new Nemotron 3.5 Lightning runs a 30 B MoE model with only 3 B active parameters, but its NeMo Switchyard routing layer can discard cached prompts when swapping models, effectively doubling the cost of a single inference request.