Hacker News new | ask | show | jobs
by EMM_386 1150 days ago
> Hardware sure isn't getting faster in a hurry

How is it not?

These LLMs were recently trained using NVidia A100 GPUs.

Now NVidia has H100 GPUs.

The H100 is up to nine times faster for AI training and 30 times faster for inference than the A100.