[liuliu]

The comparison table from the ts_server site looks awesome though. I wish we could generate one for llama.cpp, unfortunately too busy with other things at the moment.

[ggerganov]

Hey liuliu, would love if you join the project when you find the time - your work is really inspiring!

[liuliu]

Thank you for the compliment! Definitely would love to contribute in some ways, once we have the benchmark, I have some ideas :)