Track group: Understand AI Track: How AI Works

Tokens

How AI breaks words into pieces.

◷ 5 minBeginnerFoundations

What is it?

A token is a small piece of text that an AI model reads. A token can be a word, part of a word, a space, or punctuation. You may see a sentence. The model sees pieces. This matters because AI tools do not measure your input only by pages or words. They also measure how many tokens they need to process. Long documents, messy instructions, repeated text, and pasted email chains can all use up tokens quickly.

Why it matters

Tokens explain why AI tools sometimes feel limited. A short question is easy. A large board pack, ten policies, and a long instruction list are heavier. The model has to hold those pieces while trying to answer. If the input is cluttered, the AI may waste space on things that do not matter. For work, this means you should not paste everything and hope for the best. Give the AI the right material, not every material.

How it works

The AI turns your text into tokens before it responds. Then it uses those tokens to look for patterns and generate the next part of the answer. More tokens usually means more material to process. But more is not always better. A clean one page brief can be more useful than twenty pages of mixed notes. The goal is not to feed the model the most text. The goal is to feed it the most useful text.

InputWork or question enters the tool.
ProcessThe AI or team follows a pattern.
OutputThe result is reviewed before use.

Analogy

Think of tokens like luggage space for a business trip. You can take only what fits. If you fill the bag with old receipts, random cables, and three jackets you will never wear, there is less room for the things you actually need. AI works in a similar way. The available space should be used for the task, the facts, and the instructions that matter.

Example usage

A manager wants an AI tool to summarize a project. Instead of pasting every email from the last month, she pastes the latest project note, the key risks, the open decisions, and the audience for the summary. The AI now has fewer distractions. The output is cleaner because the input is cleaner. Tokens are not just a technical limit. They are a reminder to prepare the brief.

How to use this

Before pasting a large amount of text, pause. Ask what the AI truly needs to answer well. Remove duplicate text. Remove old discussion that is no longer relevant. Put the newest and most important context near the instruction. If you need the AI to use a long document, tell it which sections matter most. A smaller but sharper input often beats a bigger and noisier input.

Common mistake

The common mistake is assuming more text always creates a better answer. It often does the opposite. The AI may pay attention to old details, side comments, or repeated information. That can make the answer less useful. Do not treat the prompt box like a storage room. Treat it like a briefing note.

Question to ask

Prompt cleanup

What text can I remove because it does not help this task?

Long document

Which sections must the AI pay attention to first?

Executive use

Can I turn this into a shorter brief before asking for the final answer?

Quality check

Did extra context make the answer better, or just longer?

Quick quiz

What is a token?

Flashcard

Learn this another way

Audio brief, podcast version, mind map, and visual summary.

Audio briefPrompt cleanup exampleOne page visual map