Topic 1 of 4

Foundations

The concepts everything else builds on: what separates a program from a model, and what's behind probabilities, vectors, hardware and neural networks.

0 of 9 readable lessons completed9 of 9 lessons readableStart

What this topic covers

This topic establishes the shared vocabulary for everything that follows. Its lessons begin with familiar computer programs and lead step by step toward the numerical structures, probabilities, and technical foundations of modern AI models.

You can read every lesson on its own. The displayed order is still deliberate: new terms build on ideas already explained, without turning the knowledge base into a rigid course.

Topic 1 of 4

Lessons in this topic

Every lesson stands on its own. In this order, the ideas connect especially clearly.

  1. Program, Algorithm, Model Compared

    How do program, algorithm and model differ? Classic software follows rules a person writes down. An AI model consists of a fixed calculation and numbers set during training.

    Read≈ 16 min
  2. Input and Output: How a Function "Thinks"

    What goes into an AI model, and what comes out? From spam filters to chatbots, the output is often a list of scores.

    Read≈ 14 min
  3. Tokenizers: How Text Breaks into Tokens

    Shows how a tokenizer splits text into pieces that it learned earlier by counting, and why the number of tokens is not the number of words.

    Read≈ 16 min
  4. Token IDs: What a Number Means

    Shows what a token ID is: a number that only has meaning within its tokenizer’s vocabulary. It also explains why each model must use the tokenizer it was trained with, and why the number itself reveals nothing about the piece.

    Read≈ 7 min
  5. Scalar, Vector, Matrix, Tensor: The Building Blocks of the Numbers

    From the weather app to the chatbot: how number, list, table and stack of tables relate, and why your chat is exactly such a block of numbers for a model.

    Read≈ 14 min
  6. Probability and Softmax: How a Model Decides

    How a language model turns its scores into shares, why it sometimes picks the obvious choice and sometimes something else, and how temperature changes that.

    Read≈ 16 min
  7. Parameters, Training and Use: How a Model Learns

    What is inside a model file, what people decide before training, how training uses the error to find each fader’s direction and why learning costs more than using.

    Read≈ 16 min
  8. Model Size and Hardware: Where a Model Fits

    How much memory an AI model needs, why space, not speed, is the first limit, how quantization shrinks models and why training needs far more memory still.

    Read≈ 14 min
  9. The Artificial Neuron: How a Sum Becomes an Output

    What an artificial neuron calculates: weights, bias and a lower limit. Follow the spam-filter example from the first lesson and work through every step by hand.

    Read≈ 8 min

Look it up

Terms from this topic

Short explanations of the technical terms used by the lessons already available.