Hacker News new | ask | show | jobs
by ml_hardware 1095 days ago
Mosaic's MPT models are already supported in GGML: https://github.com/ggerganov/ggml

Here's MPT-30B running in 4-bit precision on CPU :) https://twitter.com/abacaj/status/1673133443339763712?s=20

1 comments

Oh I didn't realize this. Everything is moving so fast that I can't even keep up with the features.