Point is to actually avoid hallucinations, Think I didnt focus on it as much as I wanted.
To avoid hallucinations, make sure you use strict prompt when creating the chatbot/api key.
Combination of rag + strict prompt will make sure that AI does not go out of bounds of it contextualised knowledge and avoids using LLM's internal knowledge.