Anyway for UI you could look at chainlit, for API some of the models are already getting wrapped up in an open ai compatible rest interface.
See https://github.com/go-skynet/LocalAI