[theobreuerweil]

The models may be writing the code but I would be surprised if they were contributing to the underlying science, which feels like the hard part

[Davidzheng]

it's hardly science it's mostly experimentation + ablations on new ideas. but yeah idk if they are asking llms to generate these ideas. probably not good enough as is. though it doesn't seem outo f reach to RL on generating ideas for AI research

[yberreby]

I'm curious what you think qualifies as science.

[Davidzheng]

haha touché but I don't think they are trying to understand the underlying theory etc or do hypothesis testing? I think it's more like engineering tbh