|
|
|
|
|
by mijkal
70 days ago
|
|
Good question. Mycellm is the protocol layer: identity, routing, credits, reputation. Similar to how BitTorrent verifies pieces match their hash but doesn't judge whether the content is any good (that's left to trackers, communities, external tools). Mycellm can verify that inference happened: signed receipts, reputation tracking (success rate, speed, contribution history), admission control that cuts off freeloaders. Each network sets its own policies on top; a private group might trust everything, a public network might add spot-checks or consensus routing. Directions I'm exploring for public verification: fast-of-N routing, spot-checking with known outputs, consensus at temperature=0 where inference is deterministic. But the verification logic should be pluggable — different networks, different standards. That's a design area where I'd welcome input. Curious about Runfra — when you say 'Uber for GPU', is that an orchestration/marketplace layer where independent GPU owners sell compute time? And what does 'batch-first creative workflows' look like — image gen pipelines, video, or broader? |
|
Since I need $Temperature > 0$ for that creative randomness, I inevitably get a lot of junk. So I’m essentially treating these idle GPUs as a distributed filtration layer, and trading idle time for guaranteed better outputs.