|
|
|
|
|
|
by nneonneo
1 day ago
|
|
|
Rejection works when there are multiple tiers of venues; authors often “give up” on a venue if it seems like their work isn’t getting in, which allows higher-tier conferences to maintain a lower accept rate and take only the “best” research. Reviewers know what venues they are reviewing for, and attentive ones will adapt their review based on the prestige of the venue. Of course, there’s lots of room for subjectivity here; what constitutes the “best” research is still at the whim of reviewers. |
|
|
I don't think it's constable that luck plays a big role. Do we need you do a third NeruIPS study to convince people?
The real problem is that we don't actually know if an idea is good or not until it's had more time to be explored and studied. A great example of this is diffusion models. There's 6 years between Sohl-Dickstein's paper and Jonathan Ho's. All because GANs got popular, so only a few people kept looking at diffusion until one person scaled it. There's hundreds of cases like that, including attention and resnets (I'll defend Schmidhuber's Highway Nets here). So much fruitful research gets cast away for no good reason.
A reviewer can't ever determine if research is good or impactful. It's impossible to do by just reading a paper. So that needs to be taken out of the equation. What a reviewer can do, though, is determine if a paper is bad or fraudulent. So IMO, we should publish anything that isn't fraudulent. Let time tell us the impact, because history tells us we're not very good at figuring that out ourselves