Hi HN!

I posted Dalai on HN yesterday (https://news.ycombinator.com/item?id=35127020) and I have been spending the last 24 hours trying to listen to all the feedback and incorporate all the incoming pull requests and make a new release.

  1. If you had trouble installing and they were just not installing for some reason, make sure you try this version.
  2. If you had trouble working with models other than the 7B one, yes it was my fault, only the 7B one was working, and now this has been fixed, and now ALL models should work with this new version
  3. Use existing workspace: If you already have an existing llama.cpp workspace folder, now Dalai can connect to it programmatically instead of creating its own repository under ~/dalai. Remember, while the easy installation is important, the most important aspect of Dalai is that it lets you interact with llama.cpp with JavaScript. So even if you already have an existing llama.cpp and just want to play with it using JS, you can use Dalai.
  4. New Web UI

I don't want to ramble on and on here so will link a thread where I discussed this in more detail, for those who are interested in learning more: https://twitter.com/cocktailpeanut/status/163539451761565286...

Finally, like 90% of the code for this release came from people other than myself and it's amazing how this happened. Thank you everyone who contributed.

There are some further issues I think need to be addressed. If you have any feedback that hasn't been addressed with this release, please let me know!

and if you want to follow along with the development, you can find me on Twitter https://twitter.com/cocktailpeanut

can I run this on Windows?

does it require CUDA or any hardware acceleration like Stable Diffusion?

Thanks for the work you've put into it!