[true_religion]

I agree. I was using an LLM to test some assumptions I was making about a chemical combination, and although it's reasoning was logical it made an error about how pH works when you combine two acids of similar strength then it held onto that incorrect conclusion for the rest of the chat.

Since I wasn't asking anything related to pH, I skimmed past that section and didn't notice the error until much later in the chat when the LLM decided to build upon erroneous reasoning.

I think someone who hadn't studied chemistry would've relied on its' answer since all the rest of the logic would've been correct if the solution really did become more acidic.