Skip-gram Word2Vec implemented from scratch using PyTorch, trained on Wikipedia (enwik8). Includes negative sampling, cosine similarity comparison with Gensim, word analogy evaluation, and bias detection in word embeddings.

enwik8 char-level prediction with local-global hybrid attention

MWE comparing MEGALODON w/ Llama-style Transformers on enwik8