Hacker News new | ask | show | jobs
by Inufu 1524 days ago
Yes, parameters are usually stored as float32, activations as bfloat16 or float16.