Hacker News new | ask | show | jobs
by whimsicalism 1059 days ago
Critiques of omission are the easiest ones to levy and are informationally asymmetric in that the person leveling them will typically have more information on the topic being omitted than the person being critiqued. Hopfield networks & Metaformers are largely irrelevant in the domain of potential transformer replacements for LLM. Unless they have been shown to be relevant in any way, I don't see why the paper need cite them (and thus build some recursive case that future papers must cite these papers).

I'll just say I'm glad that I'm not submitting papers to be reviewed any more :)

1 comments

> Unless they have been shown to be relevant in any way, I don't see why the paper need cite them.

Fair. Your argument then falls precisely into category (C) of the four mutually exclusive options I outlined above.

But you'd then need to argue why the 6 models you compared against is the comprehensive model sample to test against, that contains -- and not just some arbitrary set of recent models that happen to be dominated by the newly proposed model. (And maybe that is indeed the case; then it should be easy enough to update the arxiv draft by incorporating a section where you argue along those lines.)