The Bot Shelf

Nvfp4

1 article

Futuristic server room with holographic AI neural network visualizations, representing NVIDIA's NVFP4 4-bit pretraining technology.
Research & Breakthroughs

NVIDIA unveils NVFP4 4-bit pretraining methodology for efficient AI

NVIDIA has successfully pretrained a 12-billion-parameter Mamba-Transformer model on 10 trillion tokens using a new 4-bit precision method.

David Katzman·May 18, 2026