It's really interesting and a great piece of work that you have put in what looks like a huge amount of effort.
You should definitely be proud of this.
Thank you :) The open source community is great, the core is a confluence of the awesome work of others. I'm just a orchestrator. I wish I had more time to make it into something like llama.cpp and an OS around it.