[rao-v]

This really should be in the blogpost. It’s both useful info and basic courtesy to be explicit about which underlying inferencing engine you are using

[sig_kill]

We didnt post it, we use a library (iroh) who featured us - so we are here answering any Q’s instead :)