Hacker News new | ask | show | jobs
by p1esk 1218 days ago
Almost no one uses ReLU anymore. It's usually GeLU for llms, and Swish for images.