[knowaveragejoe]

Is this downloading a ~5gb model to my machine and storing it locally for subsequent use?

[abi]

Yes, it only starts the download after you send the first message so visiting the site won’t use up any space.

Approx sizes are listed in the GitHub README.

Models are stored in indexeddb and will be managed by the browser. Might get evicted.

[kamikazeturtles]

I thought browser tabs only had access to ~400mb

How do you have access to 5gb?

[zamadatix]

A lot of the more modern options allow for many gigabytes for typical user setups https://developer.mozilla.org/en-US/docs/Web/API/Storage_API....

[kamikazeturtles]

Very interesting! Thank you so much

I was always under the impression that the max blob size was 400mb and so you couldn't store files any bigger than that. Google gives so many different answers to these questions.

Do you know any other resources I can go more in depth on browser storage limits?

[simonw]

I see you have Phi1.5-q4f16_1-1k - any chance you could add Phi-3?

[FL33TW00D]

Phi3 is already available in browser here: https://huggingface.co/spaces/FL33TW00D-HF/ratchet-phi

Disclaimer: I am the author.

[abi]

Would love to. It uses MLC AIs webllm so just need to convert it to that format.

[sp332]

Models sizes are listed here https://github.com/abi/secret-llama but yeah, > 4GB for the Llama 3 model.