[ilaksh]

This is a dumb question but I guess this means that you can't make something like a LoRA in software, right? Because the network is physically hardcoded?

[ddalex]

No, the network is not hardcoded, you can build any network you want. Only the expensive step, the matmul, is hardcoded.