Hallucination Stations: On Some Basic Limitations of Transformer-Based Language Models
With Vishal Sikka. A look at hallucinations and capability limits in large language models from a computational complexity perspective, arguing that beyond a certain complexity, LLMs are incapable of carrying out computational and agentic tasks or verifying their own accuracy.
Links: