I have seen it hallucinate things confidently but that is usually when it has no direct sources to pin down the output.