The inspiration for this article came to me a recently while I was watching a great keynote by Prof. Yann LeCun. I strongly recommend dedicating an hour to watch it. Here, I am going to focus on one specific concept: the autoregressive nature of LLMs and its real-world implications.Challenge with code generationThis talk helped me understand one of the persistent issues I run into while working with Claude. At a high level, Claude, when presented with a complex task and a choice to return eit...

The inspiration for this article came to me a recently while I was watching a great keynote by Prof. Yann LeCun. I strongly recommend dedicating an hour to watch it. Here, I am going to focus on one specific concept: the autoregressive nature of LLMs and its real-world implications.Challenge with code generationThis talk helped me understand one of the persistent issues I run into while working with Claude. At a high level, Claude, when presented with a complex task and a choice to return eit...