[throwlaplace]

>I would argue most machine learning papers that use public datasets have code available and are often also reproduced independently

lol have you ever tried? i have several github issues on published models because i couldn't recreate that have responses like "i don't remember the parameters i used and we've moved on".

[currymj]

i’ve only run into stuff like that trying to get RL agents to train. Maybe GANs and other “hard to train” models are bad too idk. But generally things do actually seem to be reproducible.

[throwlaplace]

>Maybe GANs and other “hard to train” models

yes GANs are definitely one of the places i've run into this but also with almost bog-standard resnets i've had issues.