Hacker News new | ask | show | jobs
by nullc 4066 days ago
In a great many real world problems, including most of the most expensive ones gradients are _not_ available, or can only be expensively computable... even if your objective is differentiable, automatic differentiation isn't cheap on non-trivial functions.

Experiences differ, but in mine the most common place to find objectives with gradients is in optimizer challenges.

That said; sure, there should be a track that gives you the gradients. I agree that it would be nice if there were another track.