[selfhoster11]

Try quantised models. They perform reasonably well, although you probably want to run some benchmarks if you really want to get it done properly.