This is a great new development, llama.cpp is the ffmpeg of the AI world. The vast majority of "Local AI" tools just take it and put a front end on, delivering little value. Bringing users close to the core project is a big win for everyone.