Intuition Behind Self-Attention in Transformers
Self-Attention is a mechanism used to adjust embeddings based on the specific context of a phrase, allowing the meaning of a word to adapt according to where it is used.
November 7, 2024
NLP Foundations: text as a vector, cosine and dot-product similarities
Each year, humanity generates an immense volume of knowledge, much of which is
typically locked within various forms of text: scientific articles, Wikipedia entries,
reports, books, and even handwritten health records.
September 8, 2023