[busfahrer]

Great, thanks! :-) and to mirror another poster: what kind of prompt parsing (prefill) speed do you get for that model? Also how is the speed for the 27B model?

[egorfine]

35B: 1300-1800 t/s on both Q4 and Q6.

27B: give me 20 minutes

[busfahrer]

Thank you, good sir!