[learndeeply]

PyTorch has been a darling of almost every noteworthy open source model for the past 3-4 years (BLOOM, GPT-J, StyleGAN3, detectron, etc). Personally, I've only seen people use TensorFlow/XLA if they got free TPU credits from Google (gpt-neo), or if it was released by Google (t5).

[hustwindmaple1]

GPT-J is actually JAX

[learndeeply]

My mistake, I was thinking of gpt-neox. Thanks for the correction.