Hacker News new | ask | show | jobs
by tsimionescu 1305 days ago
As far as I understand (and reading their Limitations page also), the system is quite likely to simply invent facts, particularly in niche fields - which may well mislead you and lead on a wild goose chase.
2 comments

Yes , and that's great. Science is about inventing ideas and testing them, it's literally about chasing wild geese.

A typical scientific review paper or perspective contains tons of such speculation. But right now the process of hunting down citations is excruciating and most often done lazily. Even the best review papers contain erroneous citations to irrelevant papers, or improperly cited results , papers etc. Peer review can only do so much. This is why this tool is useful, it accelerates those things. It's not like anyone will cite Galactica.org

> Yes , and that's great. Science is about inventing ideas and testing them, it's literally about chasing wild geese.

There are an infinity of ideas we can test. The large majority of them are either obviously wrong or completely useless. The reason why researchers spend so much time embedded in a field is to enable them to come up with ideas that are more likely to be worth investigating than another idea.

And again, if the goal is to generate hypotheses then the output should be a hypothesis - not a paper that presents the hypothesis and claims to evaluate it.

If you're a) believing the output wholesale or b) not occasionally going down random rabbit holes to explore new ideas (even ones that seemed silly or wasteful on the surface) you're probably doing something wrong as it is.