Hacker News new | ask | show | jobs
by bsima 1261 days ago
Very cool tech stack. How do you run t5-small in the browser?
1 comments

I load the 90mb model into memory from IndexDB, and then some rust code compiled down to WASM does calculations with the model.