Reference

Learning

  • 38 links
  • Checked 22 September 2026

Places to go further than this guide does: explanations drawn by hand, videos, pages that run a model in front of you, courses, books, writing that keeps up with the field, and code small enough to read. Every one is somebody else’s work, chosen because it made something clearer.

The list is picked, not gathered, and it will grow. Some of it asks for no more than curiosity and some of it asks for code, so each card says what it is. Each link was checked on the date above, and each opens in a new tab.

Reference

Writing that explains one idea thoroughly, with the pictures to go with it.

Videos

Explanations that move, for when an idea is easier watched than read.

Visualisers

Pages that run or draw a real model, so you can see each step happen.

  • Transformer Explainer (opens in a new tab)

    Polo Club of Data Science, Georgia Tech

    GPT-2 small running in the browser. Type a prompt and watch it become tokens, attention and a choice of next word, with temperature and sampling to play with.

    poloclub.github.io

  • LLM Visualization (opens in a new tab)

    Brendan Bycroft

    A model drawn in three dimensions, every weight and sum in place, walked through one layer at a time from a tiny nano-GPT up to the scale of GPT-3.

    bbycroft.net

  • Tiktokenizer (opens in a new tab)

    David Duong

    Type anything and see it cut into the tokens a model actually reads, and how many there are. It makes sense of token prices and limits at a glance.

    tiktokenizer.vercel.app

  • Diffusion Explainer (opens in a new tab)

    Polo Club of Data Science, Georgia Tech

    Stable Diffusion in the browser, from prompt to picture, with the noise taken away one step at a time. By the team behind Transformer Explainer.

    poloclub.github.io

  • AnimatedLLM (opens in a new tab)

    Zdeněk Kasner and Ondřej Dušek

    Step-by-step animations of open models working on real inputs, from how the next token is chosen down to what each layer does to it. Made for teaching.

    animatedllm.github.io

  • A Neural Network Playground (opens in a new tab)

    Daniel Smilkov and Shan Carter

    Train a tiny network by hand and watch it learn to separate two colours of dot. The oldest page here, and still the quickest feel for what training is.

    playground.tensorflow.org

  • Neuronpedia (opens in a new tab)

    Neuronpedia

    Browse the features researchers have found inside real models, and what switches each one on. Advanced, and the nearest thing to looking inside a model yourself.

    neuronpedia.org

Courses

Free courses with a beginning, a middle and an end, from no maths at all to building a model yourself.

Books

Whole textbooks, free to read online, for when a page is not enough.

Blogs and newsletters

People who write about the field as it moves, which this guide cannot do.

  • Simon Willison’s Weblog (opens in a new tab)

    Simon Willison

    The most useful day-to-day record of using models well: what each new release is good for, prompt injection, and tools built in an afternoon.

    simonwillison.net

  • One Useful Thing (opens in a new tab)

    Ethan Mollick

    A professor at Wharton on what AI changes at work and in teaching, written for people who use it rather than build it.

    oneusefulthing.org

  • Lil’Log (opens in a new tab)

    Lilian Weng

    Long technical surveys, each the best single page on its subject, among them agents, hallucination and how models are made to reason.

    lilianweng.github.io

  • Chip Huyen’s blog (opens in a new tab)

    Chip Huyen

    Building real products on models: evaluation, agents, and what goes wrong between a demo and something people rely on.

    huyenchip.com

Repositories

Code written to be read, where the clearest explanation of a model is one small enough to run yourself.

  • nanochat (opens in a new tab)

    Andrej Karpathy · October 2025

    A complete small chat model, from tokeniser and training to a web page to talk to it, in about eight thousand lines meant to be read. It calls itself “the best ChatGPT that $100 can buy”.

    github.com

  • nanoGPT (opens in a new tab)

    Andrej Karpathy

    The full version of the model built in the Let’s build GPT video: small enough to read in an evening, and able to reproduce the smallest GPT-2. Its author now calls it old and points to nanochat, but it is the shorter read.

    github.com

  • LLMs-from-scratch (opens in a new tab)

    Sebastian Raschka

    The code for his book Build a Large Language Model (From Scratch), a chapter at a time in notebooks: tokenising, attention, pretraining, then fine-tuning to follow instructions. The code is free; the book is not.

    github.com

  • Prompt Engineering Interactive Tutorial (opens in a new tab)

    Anthropic

    Nine chapters of notebooks with exercises, from the shape of a good prompt to avoiding hallucination. It was written around Claude 3 Haiku, an older model, and needs an API key to run; the lessons still hold.

    github.com