[mindcrime]

Wait for what exactly? Talking about this? Implementing and testing it? Experimenting with it, trying to replicate results, trying to extend the ideas? Etc? I'd argue that all of this is peer-review, if not in the traditional / formal sense. And CS (especially ML/AI) seems to be moving in this direction over the past few years and that's not necessarily a bad thing.

Also, keep in mind that peer-review or not, if you look at this from a Bayesian point-of-view, the prior on this work being important / meaningful is going to be pretty high for a lot of people - just because it is Hinton. And that's a reasonable position given his past work.

[Mmrnmhrm]

We have double blind peer review precisely to avoid the bias that you express in your second sentence.

[mindcrime]

I feel like you're missing my point. Bayesian reasoning of that nature is totally reasonable and isn't something to be avoided just for the sake of avoiding it. What is is, is useful as a guide for where to direct energy and focus. And what it is is faster than sitting around playing with your pud waiting for review for a journal submission.

Again, what's going on now is a form of peer-review. Double blind? No, but that's not really relevant in this context anyway.

ML is really more of an empirical field in this day and age and people are going to read pre-prints on ArXiv, and use various Bayesian weighting schemes to decide what to direct time and energy towards. This process complements, not replaces, the kind of formal peer review you're demanding. There will still be plenty of room, and time, for that stuff, but there's no real reason to wait for all that to happen before starting to look into something.

[dnautics]

Is peer review generally done double blind? Who in the field has not heard of hinton s capsule proposal that would be a blind reviewer? Hell I'm not even in the field and I've heard of it.

[dr_zoidberg]

It was already reviewed when they published the arxiv preprint, so there would be no bias in this paper in particular. And as now, everyone and his/her cat has heard about capsules, you'd expect that some others than Hinton et al might write about capsules, so you shouldn't be able to say "hey, it's Hinton because capsules!".