Hacker News new | ask | show | jobs
by loa_observer 1145 days ago
I'm really enjoying the Superus-101 playground for newbies! I've been playing around with it for a while now, and I find it really helpful for brainstorming. However, I did notice that the waiting time for a response can be a bit long. Do you think it would be possible to implement streaming and concurrent modes for generating new nodes in the graph?
1 comments

Hey! Glad you're enjoying the Superus-101 playground ! The waiting time (ragard a single thread) is actually dependent on OpenAI, with avg wait around 8-15 sec , not much I can do there. But, concurrent threads? Cool idea, definitely worth exploring! Thanks!
The first tokens start coming back sooner though if you can stream content.