That word vectors represent much of the information available in a dictionary definition is a convenient and almost miraculous side effect of trying to predict the context of a word. - article

• text vector - sum of token to get meanings

There is a strong conceptual relation between bag-of-word representations of old days and word2vec. - compare evolutio from document vectors and term vectors to dense vector similar to word2vec. - Neural Word Embedding as Implicit Matrix Factorization

• Transforming everything to vectors with Deep Learning: from Word2Vec, Node2Vec, to Code2Vec and Data2Vec

• word2vec

• code2vec

• chess2vec

  • Learning Vector Representations for Chess

see also

• How might LLMs store facts - DL7
• The secret ingredients of word2vec (2016) - Word2vec is a pervasive tool for learning word embeddings. Its success, however, is mostly due to particular architecture choices. Transferring these choices to traditional distributional methods makes them competitive with popular word embedding methods.