Chapter 02 · Week 2

How AI Models Actually Work

What is a machine that predicts the next word but does not know what it means — words, and the Word?

Chapter 2 — How AI Models Actually Work

“All models are wrong, but some are useful.” — George E. P. Box (statistician)

“In the beginning was the Word, and the Word was with God, and the Word was God.” — John 1:1 (ESV)


Why This Matters

Last week you learned where AI lives and what kinds there are. This week we open the hood. Not to make you an engineer — you will not write a line of code all term — but because the single biggest cause of AI disasters at work is a professional who trusts a tool they do not understand.

Here is the thing almost nobody tells you, and it is the whole chapter in one sentence: the machine that just wrote you a fluent, confident paragraph does not know what any of it means. It is not looking things up. It is not reasoning the way you reason. It is predicting the next chunk of text, one chunk at a time, based on patterns it absorbed from an enormous pile of human writing. That is not an insult to the technology — it is the most useful thing you can know about it. Once you understand how it produces words, you understand exactly when to trust it and when to check.

So we are going to demystify five words you have heard tossed around — token, context window, parameter, training, inference — and we are going to do it with zero math and a lot of everyday analogy. By the end you will be able to explain to a skeptical colleague, in plain English, why a chatbot can write a beautiful email and then invent a court case that never happened. Both come from the same machinery. Understanding the machinery is how you keep the first and catch the second.

And I want you to carry the spine rule of this whole course into the engine room with you. Say it with me, because you will hear it in every chapter:

You choose the tool. You own the verdict. AI drafts, generates, and accelerates. The professional decides, verifies, and is accountable. AI is an assistant, not an authority.

This week that rule stops being a slogan and starts being mechanical. By the end of the chapter you will see, in the actual design of the thing, why the verdict has to stay with you: the model was built to produce plausible text, not true text, and it has no idea which one it just handed you.

Which sets up this week’s real question — not a technical one, a human one. What is a machine that predicts the next word but has no idea what any word means? What is the difference between shuffling words and grasping meaning — between statistics and understanding? We will earn that question honestly, with the engineering first, and then we will sit with it under John’s opening line, where the Word is not a token at all but the ground of all meaning. Hold it. We will get there.

Coach’s Note — You do not need to understand a car’s engine to drive to work — until the day the dashboard lights up and a stranger at the garage tells you it will cost $4,000. Then the little you know is the only thing standing between you and being taken. AI is the same. You will use it either way. The professionals who understand it are the ones who do not get taken.


2.1 — What a Large Language Model Actually Is (no math, I promise)

“LLM” stands for Large Language Model. Let us take those three words backward, because it is clearer that way.

A model, in this world, is a program that has learned the patterns in a huge collection of examples. Not the examples themselves — the patterns. Show a system millions of photos of cats and dogs and it learns the pattern that distinguishes them; that pattern is the model.

A language model, then, has learned the patterns of human language — which words tend to follow which, in which situations, in which order and tone. Nothing more exotic than that.

And large means the pile of text it learned from was enormous — a huge slice of the public internet, books, articles, conversations — and the model itself is huge, holding billions of those learned patterns (we will get to what that means in §2.4).

Put it together and here is the honest, deflating, empowering truth of what a chatbot is: it is a program that, given some text, predicts what text most plausibly comes next — and then does that again, and again, one chunk at a time, until it has written a whole answer. You type a question. To the model, your question is just “text so far,” and its entire job is to produce a likely continuation. It does this so well, at such scale, that the continuation looks like thought. But under the hood there is no looking-up of facts in a filing cabinet, no belief, no intention. There is a staggeringly good next-chunk predictor.

Think of the most well-read person you have ever met — someone who has read nearly everything and can finish your sentences in any style. Now imagine that person remembers none of it as facts. They cannot tell you what is true. They can only tell you what sounds like the kind of thing that gets written next. That is closer to an LLM than “a computer that knows things.” Keep that picture. Everything else in this chapter hangs on it.

Coach’s Note — People say “the AI told me.” The AI did not tell you anything, in the way a colleague tells you something they know. It generated the most probable-sounding continuation of your prompt. Nine times out of ten that continuation is useful and even correct. The tenth time it is a beautifully-worded fiction. Same machine, same confidence, both times.


2.2 — Tokens: The Currency of AI

Here is the first surprise. The model does not read words, and it certainly does not read letters. It reads tokens — chunks of text, usually a few characters long, that are the actual units it processes.

A token is often a whole common word (“the,” “office,” “run”), but longer or rarer words get broken into pieces. “Unbelievable” might split into un + believ + able. “Tokenization” might be token + ization. Spaces and punctuation count too. You will see this happen with your own eyes in this chapter’s lab.

The rule of thumb worth memorizing, for English:

~1 token ≈ 4 characters ≈ ¾ of a word. So ~750 words ≈ 1,000 tokens.

A one-page memo is roughly 500–700 tokens. This chapter is several thousand. A long contract is tens of thousands.

Why should a non-technical professional care about an invisible unit of text? Two very concrete, money-and-time reasons:

  1. Tokens are how AI is billed and limited. When a company pays to use these models through the “back door” (the API), it pays per token — and, as of mid-2026, the text the model writes back typically costs several times more than the text you send in (often on the order of 4–8×). Even on a consumer chat plan, your usage limits are counted in tokens under the surface. Longer prompts and longer answers cost more, full stop.
  2. Tokens set the ceiling on length. Everything the model can handle at once — your question, the document you pasted, the whole conversation, and its reply — is measured in tokens against a fixed budget (that is the context window, next section). When people say “the AI cut off my long document,” they are hitting a token ceiling.

A few facts that trip people up: other languages and code use more tokens per word than English (many languages simply weren’t as heavily represented when the tokenizer was built, so they fragment into more pieces). And numbers, unusual names, and typos also fragment. So “make it shorter” is not just a style request — it is a cost-and-capacity lever.

Coach’s Note — When someone on your team says “we’ll just feed the whole 400-page manual into the AI,” the right first question is not “will it understand it?” It is “how many tokens is that, and does it fit?” You just became the person in the room who asks the useful question.


2.3 — The Context Window: The Model’s Working Memory

The context window is the amount of text — measured in tokens — that the model can “see” at one time. It is the model’s working memory: your prompt, the documents you pasted, the entire back-and-forth of the conversation so far, and the answer it is currently writing, all live inside this one window, all counting against the same budget.

The everyday analogy I want stuck in your head is a whiteboard of fixed size. The model can read and use anything currently on the whiteboard. When the whiteboard fills up and you keep writing, the oldest notes at the top get erased to make room. The model does not “remember” them anymore, because for the model, to remember is simply to have it on the whiteboard. There is no separate long-term memory of your conversation. When the window overflows, the beginning is gone.

This one idea explains a dozen confusing AI behaviors:

  • “It forgot what I told it ten messages ago.” The conversation grew past the window; the early messages scrolled off the whiteboard.
  • “It contradicted the instructions I gave at the start.” Same thing — those instructions aged out of the window.
  • “It’s confidently discussing a document I never gave it.” If it is not on the whiteboard (you did not paste or upload it), the model cannot see it — so it fills the gap with a plausible guess.
  • Starting a fresh chat wipes the whiteboard clean. The model does not know you from yesterday. New session, empty window. (One mid-2026 wrinkle: some apps — ChatGPT’s Memory feature, for example — quietly re-paste remembered notes about you onto the new whiteboard. That is the app remembering, not the model learning; turn the feature off, or use a temporary/incognito chat, when you want a truly blank slate.)

As of mid-2026, the flagship models from labs like Anthropic and Google reach context windows of roughly 1 million tokens — enough to hold a large book, or a stack of them, at once. That is genuinely new and powerful. But bigger is not free: a bigger window is slower and more expensive to process, and models can still lose track of details buried in the middle of a very long context (a well-known effect informally called “lost in the middle”). Big memory is a tool, not a cure.

Coach’s Note — Treat a long AI conversation like a meeting with no minutes. If something matters, do not assume it is still “in the room” twenty exchanges later — restate it, or paste it again. The model is not being forgetful. It literally cannot see what fell off the whiteboard.


2.4 — Parameters: What “Billions of Parameters” Means

You will hear a model described as having “eight billion parameters” or “hundreds of billions of parameters,” said in the same reverent tone people use for horsepower. Let us make it concrete and drain the mystique.

A parameter is a single adjustable number inside the model — one tiny dial. During training (next section), the system turns these dials, billions of them, until the whole arrangement gets good at predicting the next token. The final settings of all those dials are the model. That is where the learned patterns live: not in a database of facts, but distributed across billions of numeric dials.

Two analogies, pick whichever sticks:

  • A mixing board in a recording studio the size of a stadium — billions of little sliders, each nudged to just the right level so that, together, they produce fluent language.
  • The connections between brain cells. A human brain has something like 80–100 billion neurons wired by many trillions of connections whose strengths get tuned by experience. A large model’s parameters are a loose, artificial echo of that idea — connection strengths, learned. (A loose echo. Do not oversell it.)

“More parameters” loosely means “more capacity to capture patterns,” the way a bigger mixing board can handle a richer sound. But — and write this down — bigger is not simply better. A smaller model trained well, on cleaner data, with better fine-tuning, routinely beats a larger model trained carelessly. More parameters also cost more to run: more memory, more electricity, more money per answer. This is exactly why the labs ship a ladder of sizes — a big flagship, a mid tier, a small fast one — which is the entire subject of Chapter 3.

Here is the one place the number becomes practical for you. Parameters largely determine how much memory a model needs to run — which matters enormously the day you want to run one privately on your own laptop (our Week 11 lab). As a rough mid-2026 rule of thumb, a compressed model needs on the order of half a gigabyte of memory per billion parameters. So an 8-billion-parameter model fits comfortably on a normal laptop; a 70-billion one needs serious hardware. You do not need the math today. You need the instinct: “parameters” is mostly a statement about size, cost, and memory — not a magic intelligence score.

Coach’s Note — When a vendor brags about parameter count, hear it the way you would hear a car salesman bragging about engine size. It tells you something about power and cost. It tells you almost nothing about whether the car is right for your commute. The right question is never “how big?” It is “how good at my task, for what price?“


2.5 — Training, Fine-Tuning, Inference: Three Very Different Days

Three words get used interchangeably by people who should not. They name three completely different events in a model’s life. Get these straight and you will understand AI news better than most executives.

Training is the model’s education — the long, staggeringly expensive process of reading that enormous pile of text and slowly tuning all those billions of parameters until it can predict language well. This happens once, up front, over weeks or months, on massive banks of specialized computers, at a cost that runs into the millions of dollars. Analogy: a decade of school and reading everything in the library. When training finishes, the model’s knowledge is frozen at that moment — which is why every model has a knowledge cutoff and cannot, on its own, know what happened last week.

Fine-tuning is specialized follow-up training. You take an already-trained model and give it focused extra practice on a narrower goal — a particular tone, a specific profession’s vocabulary, a set of safety and helpfulness behaviors. It is far cheaper and faster than training from scratch. Analogy: the on-the-job training a new hire gets after graduating — same education, now pointed at this company’s way of doing things.

Inference is what happens every single time you use the model. You type a prompt; the model runs its frozen parameters over your text and generates a continuation, token by token. That is inference. It is comparatively fast and cheap, it happens billions of times a day worldwide, and — crucially — it does not change the model. The dials do not move when you chat. The model does not “learn” your name because you told it. Inference reads the parameters; it never rewrites them.

TrainingFine-tuningInference
WhenOnce, up frontOccasionally, after trainingEvery time you use it
CostEnormous (millions)ModerateSmall, per use
What changesAll the parameters are setSome parameters nudgedNothing — parameters are read, not changed
Everyday analogySchool + reading the whole libraryOn-the-job training for a roleDoing the actual job

That last row is the one professionals get wrong, so let me nail it down. Your chat does not train the model. In a normal consumer session, telling the assistant a fact does not teach it that fact for tomorrow, and — separately, and importantly — whether your words are later used to train a future model depends entirely on the vendor’s data policy, which you must check (we cover this in Chapter 14 and Appendix C). Two different things. “It didn’t remember” is about inference and the context window. “Did my data get used?” is about policy. Never blur them.

Coach’s Note — “Knowledge cutoff” is the single most useful piece of vocabulary in this chapter for avoiding embarrassment. If you ask a model about a product that launched last month, an election held yesterday, or a price that changed this morning, and it does not have a live tool turned on, it will answer from its frozen training — confidently, and possibly wrongly. Always ask yourself: is this a question about the fresh world? If so, the model needs a live source, not just its memory.


2.6 — “Autocomplete on Steroids”: The Analogy and Where It Breaks

You have probably heard someone dismiss all of this as “just fancy autocomplete.” Your phone guesses your next word; an LLM guesses the next chunk, but bigger. That analogy is worth taking seriously — because it is exactly right in one way and dangerously wrong in two others.

Where it is right: mechanically, that is precisely what is happening. The model predicts the next token, appends it, and repeats. There is no grand plan drafted in advance, no goal it is steering toward, no belief about the world. One token at a time, most-plausible-next. So far, “autocomplete on steroids” is fair.

Where it undersells the machine: here is the twist that makes 2022-and-after different from your phone’s keyboard. To get genuinely good at predicting the next word across billions of examples — to correctly continue “The French word for the animal that says ‘moo’ is ___” or “Here is that contract clause rewritten in plain English: ___” — the model had to build rich internal machinery: rough representations of grammar, translation, summarization, tone, even multi-step reasoning. Those capabilities emerged as a side effect of getting really, really good at the prediction game at enormous scale. So “just autocomplete” badly undersells what falls out of the process. It can translate, summarize a report, draft a policy, and walk through a problem — capabilities your phone’s keyboard will never have. Same mechanism, wildly different behavior, because of scale.

Where it oversells the machine — and this is the one that will bite you: autocomplete optimizes for plausible, not true. Your phone does not care whether “I’ll be there at” is followed by “5” or “6” — only which is more likely. Scale that up and you get a system that produces the most plausible-sounding continuation, which is usually accurate and occasionally a confident, well-formatted fabrication. The model has no separate step where it checks reality. Plausibility is the product. Truth is a frequent, welcome, un-guaranteed side effect.

So carry a three-part verdict on the analogy: mechanically, yes — it is next-word prediction. Behaviorally, far more — real emergent skills. Epistemically, still just plausibility — never mistake fluent for true. Hold all three at once and you understand the tool better than the person who says “it’s just autocomplete” and better than the person who says “it understands me.”


2.7 — Why a Model Can Be Fluent, Confident, and Flat Wrong

Now we can answer the question that sends people running to the newspaper in disbelief: how can something this articulate be so wrong, so confidently?

Because — trace it straight back through this chapter — the model was built to generate plausible text, and confidence is a feature of the writing style it learned, not a signal about accuracy. When you or I are unsure, we hedge, we slow down, we say “I think.” The model learned the surface of confident human writing without the underlying thing that earns it: actually knowing. So it hands you a fabricated statistic in the same crisp, assured tone as a real one. There is no internal “I’m not sure about this” light wired to the output. In a language model, confidence and correctness are simply uncorrelated.

The industry’s word for the confident fabrication is a hallucination — a fluent, plausible, well-structured output that is simply false. A made-up legal citation. A quote the person never said. A statistic with a real-sounding source that does not exist. A feature in your software that was never built. These are not bugs someone forgot to fix; they fall out of the very design. A system whose entire job is “produce the most plausible next words” will sometimes produce plausible words that happen not to be true — and it will do so wearing the exact same confident face as when it is right.

This is the mechanical bottom of the spine rule, and it is why I made you say it twice. You own the verdict not as a nice motto but because the tool structurally cannot own it: it cannot tell true from plausible, it cannot flag its own uncertainty reliably, and it cannot be held accountable for a mistake. Those three jobs — discern, verify, answer for it — are exactly the jobs the machine cannot do and you can. AI drafts. You decide. Not because someone made a rule, but because that is where the two of you are actually different.

The practical habit for the rest of your career, and the rest of this course: treat every checkable claim as unverified until you check it. Names, numbers, dates, quotes, citations, prices, legal and medical specifics — these are where hallucinations live, and they are precisely the things a busy professional is tempted to paste straight into a report. Fluency earned your attention. It did not earn your trust. Trust is verified, against a real source, one claim at a time.

Coach’s Note — The most dangerous AI output is not the one that is obviously wrong — you will catch that. It is the one that is 95% right, beautifully written, and wrong in exactly the one place that matters: the dosage, the deadline, the dollar figure, the citation. Fluent-and-mostly-right is a harder thing to fact-check than clumsy-and-wrong, not an easier one. Slow down exactly where the writing is smoothest.


2.x — Interactive Lab: Tokenizer

Below this chapter, on the website, you will find an interactive panel called the Tokenizer. Go use it now — this is not decoration, it is the rep that turns §2.2 and §2.3 from words on a page into something you have seen with your own eyes.

Type into it. Start with a plain English sentence and watch it split into tokens with a live count. Then break it on purpose: type a long rare word (“antidisestablishmentarianism”), a made-up word, a string of emoji, a phone number, a sentence in another language, a snippet that looks like code. Watch which ones shatter into many little tokens and which stay whole. You are seeing, directly, why “make it shorter” is a cost lever and why some inputs are far more expensive than they look.

Then watch the context-window meter. Paste in a big block of text and see the meter climb toward the ceiling. That meter is the whiteboard from §2.3. When it fills, you are watching, in miniature, the exact moment a long conversation would start forgetting its own beginning.

What this teaches is not a trivia fact about tokenization. It is an instinct: text is not free, length has a price, memory has an edge, and the model sees the world in chunks that do not line up with your words. Once you have felt that in your fingers, “count the tokens” and “will it fit?” stop being jargon and become the reflexes of someone who actually understands the tool.


2.8 — Words and the Word

Now the week’s question, given its due — and it is the deepest one we will ask all term. What is a machine that predicts the next word but does not know what any word means?

We have spent the whole chapter establishing, mechanically, that this is exactly what a language model is: a system of extraordinary fluency and no comprehension. It moves words — tokens — with breathtaking skill, and it grasps meaning not at all. It is, if you like, the purest possible separation of the two things we usually assume come together: language and understanding. The model has the first in overflowing abundance and the second not even a little. It is all surface. There is no one home.

Sit with what that reveals, because it is easy to miss in the noise of a useful tool. We had quietly assumed that if something could use words this well, it must understand them — that fluency implies a mind. The language model is the large-scale demonstration that this is false. You can have the statistics of meaning — which word follows which, in which register, with what rhythm — perfectly, and have none of the meaning itself. Syntax without semantics. The map’s contour lines with no territory underneath. Prediction is not comprehension, and no amount of scaling the one has yet produced the other.

Which is why John’s opening line lands with such force in this chapter of all chapters: “In the beginning was the Word, and the Word was with God, and the Word was God” (John 1:1, ESV). The Greek behind “Word” is logos — and it means far more than a token. It means reason, meaning, the intelligible order of things, the very ground on which anything is true or false at all. Scripture does not open with meaning as a lucky by-product of enough data. It opens with meaning as a Person — present at the beginning, with God, being God, and — the next verses insist — the One through whom all things were made. Meaning is not emergent here. It is original. It is the source.

Set the two side by side and the contrast is almost unbearable in its exactness. The language model is word without Word — it produces the shape of speech drained of the logos, the surface of meaning with the meaning removed. The Word of John 1 is the reverse and the answer: meaning that is prior to any sentence, understanding that does not depend on prediction, a Person who does not merely arrange true statements but is the truth they point to (John 14:6). And then the line the whole Gospel turns on: “the Word became flesh and dwelt among us” (John 1:14, ESV). The logos is not an abstraction to be computed. It came near, spoke, was understood, and can be known.

Here is why this is not a detour from your professional training but the center of it. We LCMS Lutherans confess that a human being is made in the image of God — that your capacity to mean something, to grasp truth, to weigh it, to be responsible for a word you speak, is a gift that reflects the God who is the Word. That is precisely the capacity the machine does not have and you do. The model can generate a flawless paragraph about grace and be no closer to grace than the paper it prints on. It can define love and never mean a thing by it. This is not a knock on a useful tool; it is right-sizing it. The chatbot is a mirror of human language — a stunningly polished one — and not a mind, not a knower, not a neighbor.

And now the spine rule is no longer a workplace policy; it is a statement about what you are. You own the verdict because you are the kind of creature who can mean, discern, and answer for a word — an image-bearer, not a token-predictor. The temptation of a tool this fluent is to hand it the one thing it can never carry: the understanding, the judgment, the accountability that make you responsible before your neighbor and before God. Do not outsource the logos in you to a machine that only ever had the words. Use the words it gives you. Keep the meaning as your own.


2.9 — Common Pitfalls

Pitfall: Counting tokens as if they were words. Example: You promise your boss the AI can “fit the whole 200-page handbook plus our questions in one go,” size it as if pages were free, and the tool truncates the document silently — answering about a manual it only half-read. Fix: Estimate in tokens (~750 words ≈ 1,000 tokens), remember the answer eats budget too, and confirm the material actually fits the window before you rely on it. Watch the meter in this chapter’s lab until the instinct is automatic.


Pitfall: Assuming the model remembers everything you have said. Example: Forty messages into a planning chat, the assistant contradicts a hard constraint you gave it at the very start — and you assume it is being careless. Fix: It is not careless; your early instructions scrolled off the whiteboard (§2.3). Restate anything load-bearing, or paste it again. For anything that must persist, keep it in your document, not the model’s memory.


Pitfall: Treating “billions of parameters” as an intelligence score. Example: You pick the biggest, most expensive model for every task, including summarizing short emails, and burn budget for no gain — or you dismiss a capable smaller model because its number is lower. Fix: Parameters mostly signal size, cost, and memory — not fitness for your task. Match the model to the job (Chapter 3), not to the bragging number.


Pitfall: Believing the model looked it up or knows today’s news. Example: You ask for “the current price” or “this month’s regulation change,” get a crisp confident answer, and put it in a client deck — but it came from frozen training data with a knowledge cutoff. Fix: For anything about the fresh world, the model needs a live tool (web search) turned on, or you must supply the current source yourself. Assume its built-in knowledge is dated until proven otherwise.


Pitfall: Reading confidence as correctness. Example: The assistant cites a study, a statute, or a quotation in a flawless authoritative tone; you trust the tone and never check the source, which turns out not to exist. Fix: Confidence and correctness are uncorrelated in an LLM (§2.7). Verify every checkable claim — names, numbers, dates, quotes, citations — against a real source, especially when the writing is smoothest.


Pitfall: Thinking your chat “trains” the model — or, conversely, that it never touches your data. Example: You assume telling the assistant a fact teaches it for next time (it does not); or you assume nothing you type is ever used to improve future models (that depends entirely on the vendor’s policy). Fix: Keep the two separate. Inference does not change the model, so it will not “remember” your fact tomorrow (§2.5). Whether your data may later train a future model is a policy question — check it before pasting anything sensitive (Chapter 14, Appendix C).


Pitfall: Mistaking fluent for finished. Example: The draft reads so well you ship it, and the one hallucinated figure in an otherwise flawless report is the thing your client catches. Fix: Fluency is where you start verifying, not where you stop. The smoother the prose, the more deliberately you check the facts inside it.


2.10 — Reps

The work is in the exercises, and this week the reps are mostly observation reps — you are training your eyes and your instincts on a real assistant, not writing code. The keyboard is still the gym. A preview of what is waiting:

  • Feel the tokens in the Tokenizer lab — English vs. another language vs. a code snippet vs. emoji — and predict the counts before you look.
  • Fill the context window on purpose and watch the meter climb, then have a long enough conversation that the model visibly forgets its own beginning.
  • Probe the knowledge cutoff — ask about something genuinely recent and see whether the model hedges, guesses, or reaches for a live tool.
  • Prove inference doesn’t learn — teach the model a fact, start a fresh chat, and watch it come back a blank slate.
  • Bait a hallucination — ask for specific citations or statistics, then verify every one against the real source and record the hit rate.

This week’s AI usage note (the discipline you keep all term): you are using AI this week — that is the point — but every rep that uses it ends with one honest line: what you asked, what it got right, what it got wrong, and what you verified. You are not grading the machine to flatter it or to trash it. You are learning to see it clearly. The human owns the verdict.

A short Check Your Reps quiz is embedded on this page, right under the chapter. Take it before you move on — five questions, straight from what you just read.


2.11 — This Week’s Project

Your project is P2 — “Three Models, One Prompt,” specified in Project 2. You will take one carefully chosen prompt, send it — unedited — to three different assistants (ChatGPT, Claude, and Gemini), and score all three on the same rubric: accuracy, usefulness, tone, and format. Then you will do the part that separates a professional from a fan: independently verify the factual claims, declare a winner, and defend the call in writing.

We ship two starter files for it in code/: a scoring worksheet, code/model-compare-rubric.txt, and a set of five ready-to-paste benchmark prompts, code/benchmark-prompts.txt, each built to stress a different one of the four dimensions. Normal tier runs the comparison and scores it honestly. Medium tier pushes further — add a fourth model, run the same prompt twice to see run-to-run variation, stress the context window with a long document, or run the full five-prompt battery and watch the ranking shift by task type. Hard tier is the judgment no model can make for you: a one-page memo recommending which model to reach for by kind of task — a decision with tradeoffs, a defense, and your name on it.


2.12 — Coach’s Final Word

Here is what I want you to walk out of Week 2 owning. You now know what is actually under the hood: a next-token predictor, reading the world in tokens, thinking on a fixed-size whiteboard, its patterns frozen into billions of parameters at training time, generating plausible text at inference — and unable, structurally, to tell you whether that text is true. That is not a disappointing picture. It is a liberating one. You will never again be mystified by a chatbot that writes like an angel and invents a court case, because you know both come from the same machine.

And that same picture is why the spine rule holds all the way down. You choose the tool; you own the verdict. Not because a syllabus says so, but because the tool moves words and you are the one who can weigh meaning. Fluency is the machine’s gift to you. Discernment, verification, and accountability are yours to keep — and this week you saw, in the very design of the thing, why they can be no one else’s.

The words are cheap now; the machine makes them by the million. What stays scarce, and what your whole career now rests on, is the meaning — knowing what is true, what matters, and what you will put your name to. “In the beginning was the Word.” Keep the Word. Delegate the words.

Now go do the reps. The Tokenizer is waiting right below this page, the benchmark prompts are in code/, and Project 2 is where you put three of the world’s best models on trial and cast the deciding vote yourself.

See you on Monday.


Up next: Read the exercises and do all of Week 2’s reps, then build Project 2 — Project P2: Three Models, One Prompt. If you have not set up your free accounts yet, do it now in Appendix A; keep Appendix B open as your tool directory, Appendix C for what you may never paste into a public chatbot, and Appendix D for the glossary of every term in this chapter. Then Chapter 3 — The Model Landscape: Providers, Families, and Tradeoffs.

Interactive Lab — Week 2
Tokenizer

A model does not read words or letters — it reads tokens, chunks of text a few characters long. Type below and watch your sentence shatter into the units the model actually processes, then see how much of a context window it fills.

Try:
0
tokens (approx.)
0
characters
0
words
chars / token
Context-window meter
Imagine pasting this
Approximation only. Real tokenizers differ by model; this is a teaching estimate (~4 characters per token). Notice how a rare word, a phone number, or emoji shatter into many tokens — that is why length is a cost lever and why some inputs are far more expensive than they look.
Check Your Reps

Check Your Reps — How AI Models Work

Question 1 of 5
What is a "token," the unit an AI language model actually processes?
Why: The chapter defines a token as a chunk of text a few characters long — the model reads tokens, not individual letters or whole words.
Question 2 of 5
Which description best fits a model's "context window"?
Why: Section 2.3 compares the context window to a fixed-size whiteboard; when it fills up, the oldest text scrolls off and the model can no longer see it.
Question 3 of 5
A coworker says, "Just tell the chatbot our new policy once and it'll remember it in every future chat." Why is that wrong?
Why: Section 2.5 explains that inference reads the parameters but does not rewrite them, so the model will not 'learn' your fact for tomorrow, and a fresh chat wipes the whiteboard clean.
Question 4 of 5
When a vendor brags that a model has "billions of parameters," what does that number mainly tell you?
Why: Section 2.4 frames parameters as adjustable dials that signal size, cost, and memory; bigger is not simply better, and a well-trained smaller model can beat a carelessly trained larger one.
Question 5 of 5
In AI terms, what is a "hallucination"?
Why: Section 2.7 shows that because the model optimizes for plausible rather than true — and its confidence is a learned writing style — it can produce fabricated but fluent output, since confidence and correctness are uncorrelated.
YOU FINISHED. NICE WORK.