You are correct. LLMs cannot be more than token predictors. Highly useful on the correct setting, but distinctly not consciousness.