[trb]

Same here, I was curious about Kagis low ranking, and couldn't replicate the search results. Also saw ublock Origin on #3, good results for tires, transitors and snow, etc. I've never used any of the Kagi search result weighing features.

Ctrl+F on the page for "System prompt" doesn't show any hits. Given how important those are for ChatGPT (another thought - was the author testing GPT3.5 or 4?) I'm not sure how much weight to put into the ChatGPT results either.

Not sure how much I can take away from this comparison.

[spaceman_2020]

I asked GPT-4 about Youtube Downloader and it rambled on about how downloading videos is against Youtube’s TOS and I should buy YouTube premium which has the download feature.

Getting any useful data from GPT-4 about anything even remotely “illegal” is a waste of time.

[Semaphor]

With a better prompt, you can get it to list some, but it’s very annoying to do so.

Mistral showed that their medium model is far better (yet not good), and the same prompt as in the article gives only one instead of 3 paragraphs of rambling about copyright, and then lists 3 categories of options with examples for each (not good, because ytdl is not one of those listed).

Funnily enough, both mistral and GPT4 apologize profoundly and almost with the same wording when asked "Why did you not mention the very popular, free and open source "youtube-dl" software?" and then mention how/where to get it and how to use it.

[freediver]

> Funnily enough, both mistral and GPT4 apologize profoundly and almost with the same wording when asked "Why did you not mention the very popular, free and open source "youtube-dl" software?"

Likely because they were optimized for general population, which would not have a use for command line python utility.

[Semaphor]

I’m clear why they didn’t include it, I wanted them to tell me why, though. And I thought that both of them apologized in almost the same way, was funny.

[DominikPeters]

It's plausible that mistral trained on GPT-4 output and therefore has similar mannerisms.

[okasaki]

Works fine IMO

https://chat.openai.com/share/7dfd22d2-975c-4e6d-ba4b-c6b99e...

https://chat.openai.com/share/90fae0dc-f8fd-4603-835c-5f3a57...

[Huppie]

The author already alludes to the fact that you can probably prompt-engineer around this and indeed, as soon as I added a blurb like "these are my own videos that I own the copyright to" it did suggest a bunch of third-party tools and let me ask it about what third-party tools I could use.

It suggested '4K Video Downloader', 'YTD Video Downloader', 'JDownloader' and 'Clipgrab' at first and when I asked for cli tools it came with 'youtube-dl', 'yt-dlp', and 'ffmpeg'

Those seem pretty reasonable results to me but I'll readily admit I don't know (yet) if 'most users' would ask these follow-up questions.

[UberFly]

So it has also become one of the glitterati. That didn't take long.

[alextingle]

claude.ai produced pretty reasonable results.