[xrd]

Any CUDA primer you recommend in particular? I had this same question.

[winwang]

Here's an article on syncing in CUDA via cooperative groups: https://developer.nvidia.com/blog/cooperative-groups/

There's also explicit warp synchronization, i.e. __syncwarp(). More on warp primitives here: https://developer.nvidia.com/blog/using-cuda-warp-level-prim...

[cavisne]

Probably https://www.youtube.com/watch?v=nOxKexn3iBo (or just skimming the attached colab).

[xrd]

This is terrific, thanks!