Hacker News new | ask | show | jobs
Show HN: SynapseKit – Async-native Python framework for LLM pipelines and agents (github.com)
4 points by aminau 70 days ago
2 comments

Async is definitely the right approach for this, but how are you handling the event loop blocking if a local model takes way too long to generate a heavy sequence?