[svara]

... but not in deep learning or am I missing something important here?

[qeternity]

Yes, absolutely in deep learning. Custom fused CUDA kernels everywhere.

[Scene_Cast2]

Yep. MoE, FlashAttention, or sparse retrieval architectures for example.