[steve_adams_86]

It's so absurdly sensitive. It bailed out earlier today working on a TypeScript client for a sensor network API which happens to include some temperature and pH sensors for tanks, which yes, are used for biology experiments. But wow, we're degrees of separation from the actual biology work.

It's making it very hard to justify even trying to use Fable. When it works, awesome; it's legitimately good. But I can't trust it to do a task without deferring to Opus and that's really annoying at times. I want to know what I'm getting up front, not after the fact.

[transcriptase]

It refused to give me plant care instructions for an ornamental sold at my local Home Depot because it decided it was highly invasive and dangerous to grow in my region.

(It’s not)

[someguyiguess]

Why would you waste tokens on that? Just do a google search?

[drusepth]

Is a google search actually easier than asking a model?

[steve_adams_86]

In their defence, google searching anything about plants these days leads to awful results. It’s saturated with slop. A response from an LLM might be slightly more reasoned and targeted. It’s hard to tell. This is a category of knowledge that’s being destroyed by people gaming google and dumping huge amounts of bad LLM and image generation onto the web.

[frostiness]

This is also true for pretty much any other category of search that you do as a layman. Specific, targeted queries for official documentation or research are fine, but if you look up basic information about cars, health, or basic computer troubleshooting a massive portion of the results are AI-generated.

If I'm going to be getting AI-generated results, I'd rather read the output of a model that has all the context of my specific situation than slop generated in bulk with a cheap model from six months ago.

[econ]

I envision a <model> html tag for SEO so that the publisher can make false claims of authorship.

[wraptile]

I asked whether an outdoors mosquito trap product (via a screenshot) would negatively impact other insect species in my garden and it refused. Though quick internet search did reveal that it would harm and trap many other species of harmless insects.

[nolok]

I asked him about sharks to be able to answer my kids question and it got triggered somehow. Then again when I asked it if my code had bugs or vulnerabilities before I commit.

At some point just kill the thing, it's not able to work properly as it is.

[igravious]

(subjective i know but) it's better than legitimately good