[synergy20]

That's pretty much how that works, and they sync threads inside warp, I have been groping in the dark for a while, and always hoped someone can write up some details to help me to get the idea straight.

Intel, AMD, Google(TPU) all have their own way to schedule 'kernel's which are very different from CUDA, there are no details about them, I was just curious like 'how do they work across CPU|GPU'?

Thanks for the reply.

[maxgio92]

Thank you all for this. Scheduling on GPUs is a topic in the dark for me, to be discovered

[astrange]

GPU "threads" aren't exactly CPU threads, and GPU "cores" aren't really CPU cores. It's better to think of threads as SIMD instructions and cores as ALUs.

GPU execution order is typically either "immediate mode" or "tile mode", where tiles are more common on mobile GPUs, but Nvidia has also used them.

https://www.realworldtech.com/tile-based-rasterization-nvidi...

[maxgio92]

thank you for the details!