15.06.2026//
#python#pytorch#transformers#gpt#deep-learning#nlp
Building Kabir GPT a GPT-3 like model from Scratch
How I built a small character-level GPT-style transformer in PyTorch, trained on Kabir Das ke dohe. I start from a simple tokenizer and a bigram model, then slowly add context, positions, self-attention, multiple heads, transformer blocks, checkpointing, and text generation.
→ ACCESS