Hacker News new | ask | show | jobs
by execveat 1129 days ago
Not even close. I'd prefer local WizardLM/Vicuna to this Artificial Idiot.

The funniest to me is that one of the examples they suggest you try is asking questions about google/jax repo, which kinda suggest that Bart can index source code from GitHub. Well, it fails even at listing directory structure and completely hallucinates all following answers!

I'm not sure why Google would bother releasing Bart in this state. It's made me lose respect for their AI competency.

1 comments

Best to worst, I'd rate them in the order of GPT-4, Wizard/Vicuna mix, then Bard.

Maybe I'm prompting differently than other people, but I find them all give satisfactory answers.

Bard does seem to be getting confused during conversations and has trouble following, but improvements are noticeable from a few weeks ago. For some prompts I'd say its similar to GPT-4, and it has much newer information (appears to be semi-connected to the internet) which is really handy, but it definitely needs some work still.

Example of "semi-connected to the internet": I asked Bard the about the current weather in one place and it gave me accurate current info, but for somewhere else it gave me "as of 10AM EST".