A Gentle Introduction to Skip-gram (word2vec) Model — AllenNLP ver.
Posted on Sat 02 February 2019 in Word Embeddings • Tagged with Word Embeddings, word2vec, AllenNLP
The Skip-gram model (so called "word2vec") is one of the most important concepts in modern NLP, yet many people simply use its implementation and/or pre-trained embeddings, and few people fully understand how the model is actually built. In this article, I'll cover:
- What the Skip-gram model is
- How to …