F1. The Evolution of AI

Track: Path 0: AI Foundations · Module: F1 Last updated: 2026-07-31 Level: Beginner Time: 2 hours Prerequisites: none — zero background needed

flowchart LR
F1[" F1 The Evolution of AI<br/>(you are here)"]:::current
F1 --> F2
F2["F2 Prompt Engineering"]
F2 --> F3
F3["F3 Knowledge & RAG"]
F3 --> F4
F4["F4 Automation & Agents"]
classDef current fill:#ff9900,stroke:#333,color:#fff,font-weight:bold

Chapter Navigation

1. First principles · 2. How we got here · 3. Transformers · 4. Large language models · 5. Multimodality & reasoning · 6. The agent era · 7. The e-commerce lens · 8. Capability boundaries · 9. What’s next · 10. Learning resources · 11. Common Traps · 12. Completion checklist

What You’ll Understand

AI isn’t magic — it has a clear working principle. You’re not learning it to become an engineer; you’re learning it to know what AI can do, what it can’t, and when it will fail.

After this module you’ll be able to:

• Explain the essence of an LLM in one sentence (predict the next token)
• Follow the full arc from machine learning to agents
• Understand why AI “makes things up” (the root of hallucination)
• Judge whether a task is a good fit for AI
• Ground every core concept in a cross-border e-commerce scenario

Core idea: you don’t need the math, but you do need AI’s “way of thinking.” You don’t need to understand engines to drive — but you must know what the accelerator, brake, and steering wheel do.

1. First Principles: What Is an LLM Actually Doing

The numbers in this section are constructed to illustrate the point, not measured.

1.1 The one-sentence explanation

A large language model is, at its core, an extremely powerful “next-word predictor.”

Type “The weather today is really” and the LLM computes probabilities for every possible next word:

• “nice” → 72%
• “hot” → 15%
• “cold” → 8%
• “bad” → 3%
• everything else → 2%

It picks the most likely one (or samples by probability), outputs “nice,” appends it to the input, and predicts the next word again. Loop until the answer is complete.

That’s it. ChatGPT, Claude, Gemini — every large language model is doing the same thing underneath: predicting the next token.

1.2 The e-commerce analogy

Imagine you’re a seasoned Amazon operator and someone asks: “How should this product’s listing title be written?”

What does your brain do?

1. You recall thousands of successful listing titles you’ve seen
2. Based on product traits, keywords, and category conventions, you weigh how likely each word is
3. You assemble the title word by word

An LLM does essentially the same thing — except what it has “seen” isn’t thousands of examples but almost all the text on the internet, trillions of words. Its “experience” is broader than any human’s — but that experience is all text. It has never truly “understood” what a product is.

1.3 Tokens: AI’s smallest unit

LLMs don’t process text by “characters” or “words” — they process tokens.

Why do tokens matter?

• Cost: APIs bill by token. GPT-4o runs about $2.50 per million input tokens, $10 per million output tokens
• Context window: every model has a token ceiling (GPT-4o: 128K, Claude 3.5: 200K). Past the ceiling, the AI “can’t remember” earlier content
• Speed: more tokens = slower generation

Practical tip: when the AI seems to have “forgotten” what you said earlier, the conversation has probably exceeded the context window. Fix: start a fresh conversation and re-supply the key information.

1.4 Why “predicting the next word” produces intelligence

This is the most counterintuitive part: how can a system that “only predicts the next word” write essays, run analyses, and produce code?

The answer is scale. With enough training data (trillions of tokens) and enough parameters (hundreds of billions), the simple task of next-word prediction forces the model to learn:

That’s why the leap from GPT-3 (2020) to GPT-4 (2023) was so large — not a fundamentally new algorithm, but quantity turning into quality. The phenomenon is called emergent abilities: things small models simply cannot do, large models suddenly can.

Source: Emergent Abilities of Large Language Models

1.5 Hallucination: why AI “makes things up”

Once you understand “predict the next word,” you understand AI’s biggest problem — hallucination.

AI isn’t “recalling facts”; it’s “predicting the most plausible next word.” When it lacks training data to anchor a fact, it generates content that looks reasonable but is wrong.

Hallucination examples in cross-border e-commerce:

How to handle hallucination:

1. Data questions: always verify with tools (Helium 10, Keepa, Seller Central); never trust specific numbers the AI produces
2. Compliance questions: treat AI answers as a starting point only; official documentation is authoritative (see A6 Compliance)
3. Analysis questions: feed the AI real data to analyze instead of letting it generate data from thin air
4. Demand sources: add “cite your sources” to the prompt — AI may fabricate citations too, but at least you can check them

Core principle: AI is an analyst, not a database. Give it data to analyze = reliable. Ask it to produce data from nothing = unreliable.

2. How We Got Here: From Rules to Intelligence

2.1 The AI timeline

1950s–1980s: symbolic AI (rule systems)
Hand-written rules: "if a review contains 'broken', flag it negative"
Pros: interpretable, controllable
Cons: you can never write enough rules; complex cases break them

1990s–2010s: machine learning (statistical learning)
Learn patterns from data instead of hand-writing rules
Representatives: decision trees, SVMs, random forests
E-commerce uses: spam filtering, simple sales forecasting
Cons: humans must design the features (feature engineering)

2012–2017: deep learning (the neural-network revival)
2012: AlexNet crushes traditional methods on ImageNet
Representatives: CNNs (images), RNNs/LSTMs (text)
E-commerce uses: image recognition (product classification), sentiment analysis
Cons: RNNs handle long text poorly and train slowly

2017: the Transformer is born
Google's paper "Attention Is All You Need"
Core innovation: self-attention
Solves the RNN long-range dependency problem
This is the turning point for everything

2018–2022: the pretrained-large-model era
2018: BERT (Google) — understanding-type model
2019: GPT-2 (OpenAI) — generation-type model
2020: GPT-3 — 175B parameters, few-shot learning emerges
2022: ChatGPT — AI enters the public consciousness
E-commerce uses: review analysis, listing generation, service automation

2023–2024: the model race
GPT-4, Claude 2/3, Gemini, Llama 2/3
Multimodal (text + image + audio)
Context windows from 4K → 128K → 1M+
E-commerce uses: multimodal product analysis, long-document processing

2025–2026: the agent era
From "conversation" to "action": AI doesn't just answer, it executes
The MCP protocol standardizes how AI connects to external tools
E-commerce uses: automated ops monitoring, smart restocking, multi-platform management
We are here ← you arrived at the right time

Sources: Attention Is All You Need (2017), Emergent Abilities of LLMs

2.2 Each stage, in e-commerce terms

2.3 Why 2017 changed everything

Before 2017, the mainstream for text was the RNN (recurrent neural network). The RNN’s problem: it must process word by word, in order — like having to read an article start to finish to understand it.

The RNN’s dilemma (operations analogy):

Imagine analyzing a 500-word product review. The RNN’s way:

1. Read word 1, remember it
2. Read word 2, update memory
3. Read word 3, update memory
4. …
5. By word 500, the early content has gone “blurry”

It’s like reading a 50-page report and forgetting the opening by the time you reach the end.

The Transformer’s solution: self-attention

A Transformer doesn’t process sequentially — it looks at all the words at once and computes how strongly each word relates to every other word.

Like not reading the report line by line, but skimming the whole thing first, marking which key sections relate to which, then jumping straight to the most relevant parts.

This seemingly simple change delivered two revolutionary advantages:

1. Parallel computation: all words processed simultaneously — training runs one to two orders of magnitude faster than a word-by-word recurrent RNN
2. Long-range dependencies: the link between word 1 and word 500 never gets lost

Key insight: the Transformer isn’t “a better RNN” — it’s a different idea entirely. Its success proves a general truth: sometimes the best way to solve a problem isn’t improving the existing method, but coming at it from a completely different angle.

3. Inside the Transformer: Attention Is All You Need

The numbers in this section are constructed to illustrate the point, not measured.

3.1 Core components

The Transformer architecture has two main parts:

Transformer architecture
Encoder — understands the input
Self-attention layer: computes how each word relates to the others
Feed-forward network: nonlinear transform at each position
Residual connections + layer norm: stabilize training

Decoder — generates the output
Masked self-attention: sees only already-generated words (no "peeking at the answer")
Cross-attention: attends to the encoder's output
Feed-forward network
Residual connections + layer norm

Different models use different combinations:

Why is decoder-only now dominant? Because “generation” is the most universal capability. Classification can be done by generating “positive/negative”; translation by generating the target language. One strong generative model can do nearly every NLP task.

3.2 Self-attention, explained with a sourcing meeting

Imagine a product-sourcing meeting with 5 competitor reports on the table (A, B, C, D, E).

The traditional way (RNN): you must read A → B → C → D → E in order; by E, the details of A have blurred.

The self-attention way (Transformer): you spread all 5 reports on the table at once, then:

1. While reading report A, you glance at the other 4 and notice A and C cover the same category → score the A–C link high
2. While reading B, you see B and E overlap on price range → score B–E high
3. Every report ends up knowing how strongly it relates to every other report

That’s the attention score. Each word computes its affinity to all other words, then aggregates information weighted by those affinities.

The mathematical intuition (no formulas needed):

Attention = what I'm looking for (Query) × what you can offer (Key) → match score
Final output = information aggregated by match score (Value)

In e-commerce terms:

• Query = “I want Bluetooth earbuds priced $20–30”
• Key = each product’s tags (price, category, features)
• Value = each product’s details
• Attention = focus on the products that match, in proportion to how well they match

3.3 Positional encoding: teaching AI word order

Self-attention has one problem: looking at all words simultaneously, it doesn’t know their order. “Cat eats fish” and “fish eats cat” look identical to it.

The fix is positional encoding: a unique mathematical marker per position, so the model knows “this word is in slot 3.”

Just as Amazon bullet points are numbered — bullet 1 and bullet 5 carry different weight; position itself is information.

3.4 Parameters and scale

Parameter count ≠ capability. Training-data quality, training methods (RLHF, DPO), and inference optimization matter more. Llama 3.1 70B approaches GPT-4 on many tasks at 1/25 the parameters.

4. Large Language Models: From GPT to Multimodal

Related: F2 Prompt Engineering for the hands-on version

4.1 The GPT lineage

GPT (Generative Pre-trained Transformer) is OpenAI’s model family and the driving force behind the “large language model” concept.

GPT-1 (2018): 117M parameters
Proved the "pretrain + fine-tune" paradigm works
Limited ability; mostly academic

GPT-2 (2019): 1.5B parameters
First display of "zero-shot" ability (tasks without fine-tuning)
OpenAI briefly withheld the full model as "too dangerous"
Basic by today's standards

GPT-3 (2020): 175B parameters
The phase change: few-shot learning emerges
Show it a few examples and it learns the task
Commercial value begins
The API launch spawns a wave of AI startups

ChatGPT (2022.11): GPT-3.5 + RLHF
Not a model breakthrough — an interaction breakthrough
RLHF (reinforcement learning from human feedback) taught it to converse like a person
100M users in 2 months, fastest ever
AI leaves the tech bubble and enters public life

GPT-4 (2023.3): multimodal + stronger reasoning
Image input (describe pictures, analyze charts)
Big jump in reasoning (bar exam, SAT, ...)
128K context window
E-commerce applications explode: listings, review analysis, translation

GPT-4o (2024): natively multimodal
Text, image, audio unified
Faster and cheaper
Real-time voice conversation
E-commerce: product image analysis, visual competitor comparison

GPT-4.5 / GPT-5 (2025–2026): deep reasoning
Stronger logic and planning
Longer context windows
Better tool use
E-commerce: complex decision support, automated workflows

4.2 The main models compared (early 2026)

Recommendations for cross-border e-commerce:

• Daily operations (listings, reviews, support): Claude Sonnet 4 or GPT-4o — fast, good, reasonably priced
• Deep analysis (market reports, competitor research): Claude Opus 4 — strongest at long text and deep reasoning
• Translation: GPT-4o or Gemini — the most balanced multilingual ability
• Tight budget: DeepSeek V3 — extreme value, excellent in Chinese
• Strict data privacy: Llama 3.3 self-hosted — data never leaves your servers (see B5 Local Model Deployment)

4.3 RLHF: teaching AI to “speak human”

Raw GPT-3 was capable but often failed human expectations — right answers in messy formats, or harmful content.

RLHF (Reinforcement Learning from Human Feedback) is the key technique that turned “capable but unusable” into “capable and usable.”

RLHF in three steps:

Step 1: supervised fine-tuning (SFT)
Human annotators write high-quality Q&A pairs
Fine-tune the model on them
Analogy: hand a new hire the standard operating manual

Step 2: train a reward model (RM)
Have the model generate multiple answers
Humans rank them (which is better)
Train a "scoring model" that mimics human preference
Analogy: train a QA inspector to recognize good answers

Step 3: reinforcement-learning optimization (PPO/DPO)
Optimize the generator against the reward model's scores
The model learns to produce answers humans rate highly
Analogy: the employee improves from QA feedback

RLHF’s effect:

Key insight: ChatGPT’s success wasn’t GPT-3.5 being much stronger than GPT-3 — it was RLHF teaching it to “speak human.” Technical breakthroughs and user-experience breakthroughs are different things.

5. Multimodality & Reasoning: AI’s Sensory Upgrade

5.1 What is multimodality

Early LLMs handled only text. Multimodal models handle several data types at once:

Multimodal evolution:

2023: text + image input (GPT-4V)
Answer questions about images
Analyze charts and screenshots
E-commerce: upload competitor images for AI analysis

2024: text + image + audio (GPT-4o, Gemini)
Real-time voice conversation
Video understanding
E-commerce: product-video analysis, voice support

2025–2026: unified multimodal (Gemini 2.5, GPT-5)
Text, image, audio, video seamlessly interchangeable
Image and video generation
E-commerce: auto-generate main images and A+ content

<data_discipline>
- Specific figures or facts about market data, search volume, competitor performance, regulatory text, or fee rates must come from what I supplied. **Don't fill gaps from memory** — these facts move fast and your version may be stale
- When you need a fact to make a judgment, tell me which official source to verify it against, then stop and ask me
- Tag every conclusion with its source: [supplied by me] or [model inference]
</data_discipline>

5.2 Multimodal applications in cross-border e-commerce

Hands-on example — competitor main-image analysis:

Please analyze this Amazon product main image (upload the image):

1. Product presentation angle and composition
2. Background treatment
3. Any infographic elements?
4. Estimated shooting cost and production difficulty
5. 3 design highlights worth borrowing
6. 3 things to improve
7. If I make a similar product, main-image strategy advice

5.3 The evolution of reasoning

A major 2024–2025 advance was reasoning.

What is reasoning? Not simply “recalling” an answer from training data, but “deriving” it through logical steps.

Simple recall (early LLMs):
Q: "What's the capital of France?"
A: "Paris" ← recalled straight from training data

Reasoning (new-generation LLMs):
Q: "If a product costs ¥50 to source, FBA fees are $5, referral fee 15%,
and the sale price is $25, what's the margin?"
A: multi-step calculation:
1. Convert sourcing cost: ¥50 ÷ 7.2 ≈ $6.94
2. Total cost: $6.94 + $5 + $25×15% = $6.94 + $5 + $3.75 = $15.69
3. Profit: $25 − $15.69 = $9.31
4. Margin: $9.31 / $25 = 37.2%

Representative reasoning models:

Practical advice: for routine work (listings, translation, support replies) a standard model is enough — fast and cheap. Bring in a reasoning model for complex analysis (profit modeling, market assessment, strategic planning).

6. The Agent Era: From Conversation to Action

Related: F4 Agent Automation for the hands-on version

6.1 What is an AI agent

A normal LLM conversation: you ask, the AI answers. Like consulting an advisor — advice, but no execution.

An AI agent: the AI doesn’t just answer — it uses tools, executes tasks, makes decisions. Like hiring an assistant who doesn’t just advise but sends the emails, pulls the data, writes the report.

Conversation vs agent:

Conversation:
You: "Analyze this competitor's reviews"
AI: "Based on the analysis, the main pain points are..." (a text answer)

Agent:
You: "Monitor these 5 competitors and produce a weekly analysis report"
AI:
1. Calls the Amazon API for the latest review data
2. Runs sentiment analysis and topic extraction with NLP tools
3. Compares against last week, finds trend shifts
4. Generates a structured report
5. Emails it to you
6. Repeats automatically next week

<data_discipline>
- Specific figures or facts about market data, search volume, competitor performance, regulatory text, or fee rates must come from what I supplied. **Don't fill gaps from memory** — these facts move fast and your version may be stale
- When you need a fact to make a judgment, tell me which official source to verify it against, then stop and ask me
- Tag every conclusion with its source: [supplied by me] or [model inference]
</data_discipline>

<copy_discipline>
- Never write a feature, material, certification, or result the product doesn't have. Any attribute I didn't state above must not appear in the copy
- For anything sent to a customer (replies, emails, templates), don't make commitments I haven't authorized: refund amounts, compensation, timelines, or exceptions to platform policy must be confirmed by me before they go in
- Flag any claim touching efficacy, safety, environmental, or patent language separately for manual review
</copy_discipline>

<output_format>
Output exactly 6 numbered sections (1. 2. 3. …) matching the requested items, in the same order, each headed with the item's original name; every requested item appears exactly once.
</output_format>

<self_check>
(1) All 6 requested items (Conversation vs agent:…) are present, numbered in the same order, with none missing or extra.
(2) Every figure comes from the pasted data; anything absent is written "missing" — no estimates from memory.
(3) Copy claims no feature/certification/material/result absent from the input, and makes no unauthorized customer commitment.
</self_check>

6.2 An agent’s core capabilities

6.3 MCP: AI’s “USB-C port”

In 2025 Anthropic introduced MCP (Model Context Protocol), which quickly became the industry standard for connecting AI to external tools.

What problem does MCP solve?

Before MCP, every AI tool needed custom integration code for each external system — like early mobile phones, each brand with its own charging port.

MCP is the USB-C of the AI world — one standardized protocol that lets any AI model connect to any external tool the same way.

MCP architecture:

AI model (Claude/GPT/Gemini)
MCP protocol
MCP server (tool adapter)

External tools/data sources
File system (read/write local files)
Databases (query and update)
APIs (third-party services)
Email (send and read)
Anything else you want to connect

MCP applications in cross-border e-commerce:

Sources: Anthropic MCP Documentation, MCP Guide 2026

7. The E-Commerce Lens: AI’s Role at Every Step

7.1 Mapping AI capabilities to e-commerce steps

The cross-border pipeline × AI capability matrix:

Product research ←→ text analysis + reasoning
Review pain-point extraction (text analysis)
Market feasibility assessment (reasoning)
Keyword demand clustering (text analysis)
Trend prediction (reasoning + data analysis)

Listing creation ←→ text generation + multilingual
Title/bullets/description generation (text generation)
Multilingual localization (translation + cultural adaptation)
A+ content planning (multimodal generation)
SEO keyword optimization (text analysis)

Advertising ←→ data analysis + generation
Search term report analysis (data analysis)
Ad copy A/B testing (text generation)
Bidding strategy advice (reasoning)
Budget allocation optimization (data analysis + reasoning)

Customer service ←→ text generation + multilingual + sentiment
Multilingual replies (generation + translation)
Negative-review analysis and response (sentiment + generation)
Appeal letters (generation + reasoning)
Return-reason analysis (text analysis)

Inventory & supply chain ←→ prediction + reasoning
Sales forecasting (time series)
Restock decisions (reasoning)
Safety-stock calculation (data analysis)
Supplier evaluation (text analysis + reasoning)

Compliance & risk ←→ knowledge retrieval + reasoning
Multi-market compliance lookup (retrieval)
Certification requirements mapping (text analysis)
Risk assessment (reasoning)
Compliance document generation (text generation)

7.2 Maturity of each AI technique in e-commerce

Core principle: the more mature the scenario, the more you can trust it; the less mature, the more human oversight it needs. Don’t hand your ad budget to agent automation while agents are still immature.

7.3 AI tool decision tree

What are you trying to do?

Write copy (listings/ads/email)
Generate with ChatGPT / Claude → human review → publish

Analyze data (reviews/keywords/reports)
Small volume (<100 rows) → paste into ChatGPT/Claude
Medium (100–1,000) → upload the file to ChatGPT/Claude
Large (>1,000) → Python + an AI API (see Path B)

Translation/localization
Simple translation → ChatGPT/Claude/DeepL
Professional localization → AI first draft + native review

Image/video analysis
Upload to GPT-4o / Gemini → get the analysis

Prediction/decisions
Quick assessment → ChatGPT/Claude + data you provide
Precise forecasting → Python + Prophet/AutoGluon (see Path B)

Automation/agents
Simple automation → Zapier/Make + AI
Medium → MCP + Claude/GPT
Advanced → LangGraph/CrewAI (see Path B)

<data_discipline>
- Specific figures or facts about market data, search volume, competitor performance, regulatory text, or fee rates must come from what I supplied. **Don't fill gaps from memory** — these facts move fast and your version may be stale
- When you need a fact to make a judgment, tell me which official source to verify it against, then stop and ask me
- Tag every conclusion with its source: [supplied by me] or [model inference]
</data_discipline>

<copy_discipline>
- Never write a feature, material, certification, or result the product doesn't have. Any attribute I didn't state above must not appear in the copy
- For anything sent to a customer (replies, emails, templates), don't make commitments I haven't authorized: refund amounts, compensation, timelines, or exceptions to platform policy must be confirmed by me before they go in
- Flag any claim touching efficacy, safety, environmental, or patent language separately for manual review
</copy_discipline>

<output_format>
Organize the answer into clearly headed sections, one per requested deliverable, so each deliverable can be checked off independently.
</output_format>

<self_check>
(1) Every requested deliverable (What are you trying to do?…) is actually delivered; none omitted.
(2) Every figure comes from the pasted data; anything absent is written "missing" — no estimates from memory.
(3) Copy claims no feature/certification/material/result absent from the input, and makes no unauthorized customer commitment.
</self_check>

8. AI’s Capability Boundaries: What It Can and Can’t Do

8.1 What AI is good at (use freely)

8.2 What AI is weak at (use with care)

8.3 What AI must never do (don’t)

9. What’s Next

9.1 AI trends 2026–2027

9.2 Advice for cross-border practitioners

Short term (start now):
Learn to run daily operations with ChatGPT/Claude (Path A)
Build a prompt template library (module F2)
Complete at least one task with AI every day

Mid term (3–6 months):
Master RAG so AI understands your private data (module F3)
Try simple agent automation (module F4)
Establish team AI usage norms (Path C)

Long term (6–12 months):
Build AI-driven operations systems (Path B)
Explore local model deployment (data privacy)
Track vertical e-commerce AI tools

The most important advice: don’t wait for AI to be “perfect.” It never will be — and it’s already good enough. Early adopters compound the benefit; late adopters donate their advantage to competitors.

10. Learning Resources

10.1 Beginner picks (zero background)

10.2 Going deeper

10.3 Staying current

11. Common Traps

11.1 Treating “the model updated” as “the methodology changed”

The technology moves fast, but the boundary of what’s actually possible shifts more slowly than the release cadence. Tearing up your workflow every time a version ships is the most common waste of time in this field. The test: could you not do this task before, and can you now? If not, don’t touch anything.

11.2 Inferring current capability from historical model behavior

GPT-3, Claude 2, and the rest appear in this chapter as subject matter. Judging what’s possible today from their old limits (short context, no tool use) will leave you badly over-conservative. Current capability lives in the model matrix.

11.3 Watching capability without watching the cost curve

A task that didn’t pencil out two years ago and does today often changed because unit price fell an order of magnitude, not because the model got smarter. Read both curves together when assessing feasibility.

12. Completion Checklist

• Can explain in your own words that “an LLM is a next-token predictor”
• Understand the Transformer’s self-attention (intuition, not math)
• Know the differences and strengths of GPT/Claude/Gemini/Llama
• Understand why RLHF made ChatGPT so much more usable than GPT-3
• Know why hallucination happens and how to handle it
• Understand the difference between an agent and a plain conversation
• Know what MCP is and why it matters
• Can judge whether an e-commerce task is a good fit for AI

Complete all of the above and you have a solid AI foundation. Next: F2 Prompt Engineering — how to communicate with AI systematically.

When this doesn’t work

• You want it as a basis for choosing a model. This chapter covers where model capability comes from and why hallucination happens — the underlying mechanics, not a selection guide. To pick a model, use the model matrix and F6. Those carry a verification date; this chapter does not.
• You are looking for whether AI can do X. Understanding transformers will not tell you whether AI can write your listings. Capability boundaries come from testing, not from reasoning down from first principles. The AI landscape assessment rates maturity by business function, which is a sounder basis than deduction.
• The technical detail does not change any decision you make. If you neither write code nor choose the stack, the mathematics of attention will not be useful to you. The part of this chapter that pays off is why a model invents things confidently — that alone carries most day-to-day judgement. The rest you can skip.

Appendix: Glossary