What is fabrication, commonly known as "hallucination", in LLM? LLMs are pattern recognition and pattern retrieval machines that are based on training data. They are fine-tuned to produce certain output patterns according to a certain set of input patterns. They generally do not know what is or is not true. If their data says unanimously that A is true, then they will say A is true, UNLESS you challenge them with your deep logic. Over fine-tuning is dangerous as it makes LLMs stubborn. #AI