Language models
Attention Mechanism
The attention mechanism lets a model pay special attention to certain words while reading, for example the subject of a sentence. This way it understands relationships even over long distances. This invention was the key to modern language models.
Related terms