[jonplackett]

I’ve been playing with some of the same ideas. Choose your own adventure games, old style adventure games and also found it really amazing - but the same problem mentioned that it gets sooooo expensive so fast that economically it doesn’t make any sense to make a game with ChatGPT

Has anyone had any luck with the open source versions working well enough to do this kind of thing? How does the cost to run these compare?

[varunramesh]

I had some good results with Vicuna, but haven't tried it for gaming/fantasy roleplay yet.

[xrd]

What specs do you need for vicuna? Can you run it on regular hardware, or are you using a cloud GPU?

[simonw]

I've run Vicuna 7B directly in my web browser - https://simonwillison.net/2023/Apr/16/web-llm/ - and on my iPhone: https://simonwillison.net/2023/May/1/lets-be-bear-or-bunny/

[xrd]

Hi Simon. How do I ask questions about that post? I didn't see comments enabled.

[simonw]

Asking them here works fine! I decided not to deal with the moderation overhead of managing comments on my own blog.

[xrd]

Totally get it.

Basically I've tried running the demos (the linked demo page) from that project inside Chrome 113. I keep getting a network error. Appears to me that huggingface LFS download, the model obviously, isn't available.

I also tried to clone the repository locally but the instructions aren't entirely clear on how to get the models installed.

Did you clone and run locally? Or are you using the demo site? Or perhaps in something like Colab?

[justrealist]

Is it too expensive for you, personally, enjoying the game, or building a product on it?