[yigitkonur35]

People are really freaked out about hallucinations, but you can totally tackle that with solid prompts. The one in the repo right now is doing a pretty good job. Keep in mind though, this project is all about maxing out context for LLMs in products that need PDF input.

We're not talking about some hardcore archiving system for the Library of Congress here. The goal is to boost consistency whenever you're feeding PDF context into an LLM-powered tool. Appreciate the feedback, I'll be sure to add that in.

[williamdclt]

I don’t think any prompting skill guarantees the absence of hallucination. And if hallucination is possible, you will usually need to worry about it

[Foobar8568]

As soon as you have something else than a paragraph in a single column layout, you will get hallucinations, random stuff, cut off etc even if you say which pages to look at, LLM will just do what ever.

[AdieuToLogic]

> People are really freaked out about hallucinations, but you can totally tackle that with solid prompts.

> The goal is to boost consistency whenever you're feeding PDF context into an LLM-powered tool.

These two assertions are contradictory.

There are no "solid prompts" which obviate anthropomorphic "LLM hallucinations." Also, there is no deterministic consistency when "feeding PDF context" into an intrinsically non-deterministic algorithm, as any "LLM-powered tool" is by definition.

[freedomben]

Can you give some examples of prompts that you use that will tackle hallucinations?

[smusamashah]

> hallucinations, but you can totally tackle that with solid prompts.

This is so wrong. This so much sound as if you have not used LLMs to do any real work.