Hacker News new | ask | show | jobs
by yolo-auto 45 days ago
So on mi 300x we run FP8 and that was original plan.

We are doing some weird q4 on 3090s now that is surprisingly good (for qwen) .

will people pay for it? Yeah, sometimes. Some dude just burned 80mil tokens in 24 hr and posted it to our discord. I'd say he's getting 600 pennies worth.

I think the best part is that no one is watching what your doing, you don't worry, and it's fun.

Also just as divided as people are to whether it's a good deal or not, people are divided on liking/hating the name and brand.