|
|
|
|
|
by lelag
1015 days ago
|
|
Another GGML model port that I'm pretty excited about is https://github.com/PABannier/bark.cpp. The Bark python model is very compute intensive and require a powerful GPU to get bearable inference speed. I really hope that bark.cpp with GPU/Metal support and quanticized model can bring useful inference speed on a laptop in the near future. |
|