[Kydlaw]

Interesting line of work, but as (too?) often on LessWrong, there is no literature review or even a related work section to go back to seminal research or dig deeper into the topic. It might just be me, but I find this really frustrating when I'm unable to hop references to skim a field.

Does anyone have cool links or references to share about related work?

[marmaduke]

The lack of review can be obviated by googling, tho it's exacerbated by lack of publishing in general for this domain, likely cause it's not work done at a classic academic department, and no motive to publish for citation / impact factor reasons.

Also I find it refreshing that it's a very direct and practical approach to presenting results, which is missing in the scientific formula these days.

[semi-extrinsic]

This is a blog post, not a paper. Of course it does not have literature review etc.

Now I don't work in the field of transformers, but generally when I see a piece of original work being presented as a blog post, the most reasonable conclusion is that the work is not sufficiently interesting to be a paper.

Good scientific blogs are the ones that summarize papers after they have been published, or at least written up and posted in full technical detail on a preprint server.