Hacker News new | ask | show | jobs
by bdcp 495 days ago
yea but i think the point is they can still filter it server side before streaming it
1 comments

They have already streamed the first part of the response before the filtered phrase has even been generated.
Could you stream the raw tokens into a server side filter which then streams censored tokens at near real time?