Hacker News new | ask | show | jobs
by joseferben 576 days ago
@simonw what is the token/s like on your 64gb m2 mbp?
1 comments

With MLX:

    Prompt: 49 tokens, 95.691 tokens-per-sec
    Generation: 723 tokens, 10.016 tokens-per-sec
    Peak memory: 32.685 GB
so quite usable, thanks!