[diggan]

I'd love to see more Very-Large-Memory Mac Studio benchmarks for prompt processing and inference. The few benchmarks I've seem either missed to take prompt processing into account, didn't share exact weights+setup that were used or showed really abysmal performance.

[chisleu]

Oh I plan to produce a ton of that. I'll post a blog on it to HN and /r/localllama when I'm done.