[bkitano19]

Time to first token is as important to know for many use cases, rarely are people reporting it

[Gcam]

See here for our TTFT metric benchmarks: https://artificialanalysis.ai/models/llama-3-1-instruct-70b/...