[gessha]

I built a very crude app sourcing comments from the HN firehose, classifying them using Gemma 4 and a prompt made from the comment guidelines. It had some amusing results.

The app did a decent job at surfacing problematic comments that a mod can do something about.

It was cool to optimize llama-cpp arguments for throughput. During the slightly off-peak hours the post processing was pretty much real time. I suspect a second 3090 would’ve be enough for peak posting hours too.

[modeless]

Yes I think there's huge potential in this direction. Forum moderation could be made far more scalable this way. If I didn't have another project I was already working on I'd be trying it right now.