Information Center
en

All messages

Epoch AI @epochai.bsky.social

Nvidia's Groq 3 LPX system excels at fast decode of small models (>3,400 tok/s), according to new benchmarks of Gemma 4 31B. LPX does this by using a small amount (128 GB) of ultrafast SRAM in place of HBM.

Bluesky