What is the Attention Mechanism in Deep Learning?

The attention mechanism lets neural networks focus on the most relevant parts of their input when producing each output — similar to how you re-read a specific paragraph of a contract before answering a question about it. It's the core innovation that made transformers, and therefore modern LLMs, possible.