[stellaathena]

Yes, we are currently bottlenecked primarily by engineering manpower.

[mcbits]

Have you reached the point of dogfooding your own models to augment work that would normally be considered engineering?

If so, I wonder about the implications of black-box models helping to study and develop solutions for interpretability. It gives me "reflections on trusting trust" vibes.

[ENGNR]

I can only imagine the more successful that activity was, the worse the bottleneck would become

[Taek]

Not access to GPUs for training? What would it take to get a 65B model out of eleuther?

[stellaathena]

Our policy is to not comment on timelines for future models, as our ability to meet those timelines is heavily influenced by factors outside of our control and we don’t want to lead people on.

[stellaathena]

A cr q