Skip to module content
Module 01 ยท ~12 min

How AI Actually Works (The 20% You Need)

You don't need a computer science degree. You need just enough to predict when AI will be brilliant and when it will confidently lie to you.

Reading progress
0/4 ยท 0%

The big idea

๐Ÿ’กKey idea
Large language models are fundamentally pattern-completion engines: they predict what text should come next, and at scale that produces something that looks like reasoning. That means they're fluent first and accurate second โ€” hallucination isn't a bug to be fixed, it's a property of how the technology works, so your job is knowing when to trust an answer and when to verify it.
Quick check
1 question ยท instant feedback
0/1
  1. Why does an LLM sometimes state false information confidently?

Deep dive

5/5 open

ChatGPT, Claude, Gemini โ€” these are all large language models (LLMs). Strip away the branding, and an LLM is a system trained on an enormous amount of text that learned one skill extraordinarily well: predicting what text should come next. When you ask "What's the capital of France?", the model isn't looking up a database entry โ€” it's completing a pattern, because text starting with that question is overwhelmingly followed by "Paris" in everything it has read. Scale that up across trillions of words, and something remarkable emerges: the ability to reason, summarize, translate, write code, and hold a conversation.

Three practical consequences follow. First, **LLMs are fluent first, accurate second** โ€” the model is optimized to produce plausible text, and usually plausible and true overlap, but sometimes they don't, and the model will state a wrong answer with exactly the same confident tone as a right one. This is called hallucination, and it's not a bug that will be fully "fixed" โ€” it's a property of how the technology works.

Second, **LLMs don't "know" today's news by default** โ€” models are trained up to a cutoff date, and anything after that requires web search or connected tools. Third, **quality in, quality out** โ€” the model completes *your* text, so a vague prompt gets a generic completion and a prompt rich in context gets a completion shaped by that context.

LLMs read and write in tokens โ€” chunks of roughly ยพ of a word. Every model has a context window: the maximum amount of text it can pay attention to at once, including your conversation history, uploaded files, and its own replies. Think of it as the model's working memory or desk space.

Two things matter even with today's large windows. Everything competes for attention โ€” if you paste a 90-page PDF and ask one question, that answer is fighting for attention with 89 irrelevant pages, so point the model at the relevant part. And long conversations degrade โ€” after dozens of turns, contradictions and stale instructions pile up, and if a chat starts feeling confused, the fix is to start a fresh chat and paste in a short summary of where you got to. Rule of thumb: one chat, one task.

Inside each product you'll usually find multiple models or modes: fast/light models that are near-instant and great for rewriting or quick questions; frontier/flagship models that are slower but dramatically better at complex reasoning and nuanced writing; reasoning or "extended thinking" modes where the model thinks step by step before answering, best for math, planning, and multi-step analysis; and Deep Research modes where the model autonomously searches and reads dozens of sources over 5โ€“30 minutes.

The practical rule: default to the best model you have access to for anything that matters. The cost difference is pennies; the quality difference is often the difference between usable and unusable.

Use a mental triage for every AI output. Brainstorming, drafts, and rewording deserve high trust โ€” use directly. Summaries of documents you provided deserve high-medium trust โ€” spot-check key numbers. General knowledge and stable facts deserve medium trust. Specific numbers, dates, prices, laws, and citations deserve low trust โ€” always verify. Anything you'll publish, send to a client, or file with a government deserves low trust โ€” verify every factual claim.

Two verification habits take seconds: ask for sources ("search the web and give me linked sources for each claim") and then click one or two, or ask the model to argue against itself ("what might be wrong or outdated in your answer above?"). Models are surprisingly good at catching their own errors when explicitly asked. Never file, sign, publish, or pay based on an unverified AI answer โ€” AI is your analyst, not your accountant, lawyer, or doctor.

Until recently, AI was a chatbot: you talk, it talks back, you do the work. The big shift of 2025โ€“2026 is toward agents: AI that can take actions โ€” search the web, read and write files, use your calendar, run programs, browse websites, execute multi-step plans โ€” and keep going until a task is done.

The same underlying model behaves completely differently depending on what it's connected to: Claude in a browser tab with no connections is a very smart text box; Claude connected to your Gmail, Calendar, and Notion via MCP is an assistant that can actually check and update things; Claude Code or Codex on your computer is an agent that can organize thousands of files or build you a working tool. This course walks you up that ladder deliberately: chat skills first, then agents, then connections, then full systems.

Quick check
1 question ยท instant feedback
0/1
  1. Your 60-message chat is giving confused answers. Best fix?

Pitfalls & takeaways

Failure modes

  • Trusting confident-sounding answers on specific facts, numbers, dates, or citations without verifying
  • Letting one chat run for dozens of turns until it gets confused instead of starting fresh
  • Assuming the model knows today's news or prices without it actually searching the web
  • Using a fast/light model for complex reasoning tasks that deserve the flagship model or a thinking mode
  • Filing, signing, publishing, or paying based on an unverified AI answer

Durable takeaways

  • LLMs predict text; they are fluent first and accurate second โ€” hallucination is a property, not a bug
  • One chat = one task; long messy conversations degrade quality
  • Use the strongest model and reasoning modes for anything that matters
  • Verify specific facts, numbers, and anything with real-world consequences
  • The frontier has moved from chatbots (talk) to agents (act) โ€” that's where the leverage is
Quick check
1 question ยท instant feedback
0/1
  1. Which output needs verification before use?

Do the work

๐Ÿ‹๏ธProve you learned it

Open ChatGPT or Claude and ask it to explain what a context window is using an analogy from your own job. Then ask for the current price of a product you know well, and check whether it actually searched the web or answered from memory โ€” and whether it's right. Finally, ask what in its previous answer you should double-check and why. Notice how differently the model behaves across these three interactions.

0 chars
Quick check
1 question ยท instant feedback
0/1
  1. What distinguishes an "agent" from a "chatbot"?