Nvidia's Groq 3 LPX system excels at fast decode of small models (>3,400 tok/s), according to new benchmarks of Gemma 4 31B. LPX does this by using a small amount (128 GB) of ultrafast SRAM in place of HBM.
Private to this visit. Text and context are processed by AI.