[Legend2440]

Article doesn’t mention this, but I’d consider neural networks a form of branchless programming. It’s all a bunch of multiply and threshold operations.

[david-gpu]

> It’s all a bunch of multiply and threshold operations.

Real-world high-performance matrix multiplication functions do contain branches internally, even on GPUs. If you are ever curious about what that looks like, NVidia maintains an open-source library called CUTLASS.

[abyesilyurt]

Thresholding requires branching no?

[WJW]

No, you can do that without branching. See https://en.algorithmica.org/hpc/pipelining/branchless/#predi... for example.

[bqmjjx0kac]

As demonstrated in the article, you can compute clamp(x, min, max) with straight-line code.

[Legend2440]

No, it’s just a math operation and can be applied to any amount of data in parallel.