[ainch]

The fact it's still Jan 2025 is weird to me. Have they not have a successful pretrain in over a year?

[throwaway314155]

They likely won’t have a full pretrain for awhile. Just like everyone else, the name of the game now is to finetune existing models.