Information Center
en

All messages

Epoch AI @epochai.bsky.social

We studied time to first token (TTFT) and how it scales with increasing context length for GPT and Claude models. We found a significant difference, with GPT showing a noticeable quadratic component, while Claude models remain closer to linear.

Bluesky