Hacker News new | ask | show | jobs
by Inufu 1571 days ago
Yes, parameters are usually stored as float32, activations as bfloat16 or float16.