Huge props to A16Z for supporting lucidrains' work! His prolific output was instrumental to my self-teaching process when learning about Transformers, as he probably has the largest collection of publicly available implementations of Transformer-related papers in PyTorch.
I think a large amount of people who get interested in implementing deep learning papers end up referencing lucidrains' work.
When my GPU is under strain, my monitor makes weird noises - and so it does on this page! And then I checked my GPU util, are they mining bitcoin or training models using my GPU? :)
Very nice to see LLaVA there, IMO it's one of the last puzzle pieces for a proper open source infrastructure in AI (e.g. filtering/classification after something like artspew).
A bit surprised about common crawl, is the financial cost there due to the massively bloated scale of the modern web they're (presumably) still trying to crawl?
I think a large amount of people who get interested in implementing deep learning papers end up referencing lucidrains' work.