[eachro]

How do they pay for their compute?

[stellaathena]

We have a number of donors including Hugging Face, Stability AI, Nat Friedman, Lambda Labs, and Canva that make our work possible. We also have some orgs that provide sponsorship for computing resources specifically: Stability AI, CoreWeave, and Google Research.

[ftxbro]

are you bottlenecked by engineering

[stellaathena]

Yes, we are currently bottlenecked primarily by engineering manpower.

[mcbits]

Have you reached the point of dogfooding your own models to augment work that would normally be considered engineering?

If so, I wonder about the implications of black-box models helping to study and develop solutions for interpretability. It gives me "reflections on trusting trust" vibes.

[ENGNR]

I can only imagine the more successful that activity was, the worse the bottleneck would become

[Taek]

Not access to GPUs for training? What would it take to get a 65B model out of eleuther?

[stellaathena]

Our policy is to not comment on timelines for future models, as our ability to meet those timelines is heavily influenced by factors outside of our control and we don’t want to lead people on.

[stellaathena]

A cr q

[ronsor]

Donations and sponsors such as Stability AI, based on the announcement in their Discord server

[mperham]

With money. A non-profit can still have plenty of revenue.