Hacker News new | ask | show | jobs
by dardarbinks 656 days ago
I don't think I mean to indict RAG + chat in general! I think it's totally possible that, if we put more work in, we'd get a great bot out.

But the bar is so, so high though. It's gotta be a truly great bot for us to not be scared of misleading our new users. And I'm still worried that "truly great" is going to take a LOT of work.

And for now, that's the problem. We're still a startup with limited resources. This tool isn't ready for us because we don't have the bandwidth to put the work in.

I can't wait til that bar drops, though. GPT 4o is a really solid step in that direction.

2 comments

That much I will concede. I said we’ve had good results, but we’ve still been a bit scared to roll it out, more for potential cost and polish reasons than baseline quality, but of course I’m still worried about it saying something wrong.
Oh yeah, and I was worried about the "supervised/unsupervised" comment you made.

I'm not talking about supervised training. I think I mean to say that the OUTPUT is supervised/unsupervised. Like, I'm an experienced programmer, so I can supervise the output of Copilot, unlike our unexperienced docs users.

That's on me for not making that train of thought clear enough, and unfortunately choosing a term that's already in use by the AI/ML industry.

Added a footnote to clarify