[spencer9714]

That BitTorrent analogy is spot on. For Runfra, I’m mostly focusing on the orchestration and inference pipeline. Trying to fix the waiting problem, but also thinking a lot about yield, like how many actually usable outputs you get per run. Right now, I’m just dogfooding a small cluster of my own 3x 4060s. Since these are basically idle home GPUs, I have the luxury to bias toward quality over latency. If this ever turns into a marketplace, something like Mycellm for node reputation would be a lifesaver. Honesty is definitely the hardest nut to crack in decentralized compute. The batch first idea is really my attempt to kill that “slot machine” workflow where you have to babysit every single prompt. Instead, you just fire off a bunch and walk away. The scoring layer (CLIP / aesthetic filters) acts as an automated quality gate, quietly filtering out the "AI slop" in the background and only surfacing the winners.

Since I need $Temperature > 0$ for that creative randomness, I inevitably get a lot of junk. So I’m essentially treating these idle GPUs as a distributed filtration layer, and trading idle time for guaranteed better outputs.