AIQ AIQ
World 5: Is AI Fair? · Lesson 5.1.2

Privacy & AI

Everything a teacher needs to deliver this lesson — pick your grade's script below once you've read the background.

Learning Objectives

This lesson runs across all four AIQ age modes, and the gap between the Explorer and Architect versions is larger here than in most lessons — a 6-year-old needs to know "ask a grown-up before sharing," while an 18-year-old needs to reason about GDPR and federated learning. Every version, though, is built around the same core idea: AI makes personal data valuable in a way it wasn't before, which changes who wants to collect it and how much of it gets collected. By the end of the lesson, a student should be able to:

Teacher Background

You don't need a technical background to teach this lesson well, but it helps to understand why AI is the reason this topic exists in its current form at all. Data collection about people is old — loyalty cards, phone books, credit bureaus all predate AI by decades. What changed is that modern machine learning is very good at finding patterns in huge, messy piles of personal data and turning those patterns into predictions: what you'll buy next, what mood you're in, who you know, where you'll be tomorrow. That predictive power is what makes personal data commercially valuable at a scale it never was before, and it's why "AI and privacy" is treated as its own topic rather than folded into general internet-safety advice.

Start from what's concrete and verifiable. A smartphone can log GPS location continuously; a voice assistant like a smart speaker records audio to process a spoken command, and some companies have historically retained those recordings, sometimes reviewed by human contractors for quality checks; a camera app or social platform can run facial-recognition or photo-tagging AI over images you upload; a browser or app can log every page you visit, every search you type, and every product you linger on. None of this requires anything exotic — it's mostly just logging, at a scale a human could never review manually, which is exactly the scale AI is built to handle.

Key point: The honest, defensible framing for this lesson is "a lot of ordinary apps collect more data than most people realize, mostly to personalize the product or sell advertising — this is a business model, not a conspiracy." Avoid framing this as sinister spying by name-brand companies; the more useful and more accurate lesson is that data collection is the default architecture of most free digital products, and the real skill is knowing it's happening and making informed choices about it.

The economics matter for the older age bands especially. A free app has to make money somehow, and for a huge share of the ad-supported internet, that "somehow" is: collect data about what users do, build a profile, and sell targeted advertising (or sell the data itself to a third party called a data broker) based on that profile. This is sometimes summarized as "if the product is free, you are the product" — a slight oversimplification, but a genuinely useful one for students meeting this idea for the first time. Data brokers are companies whose entire business is buying, aggregating, and reselling personal data profiles; they are legal in most jurisdictions and mostly invisible to the people whose data they hold, which is part of why regulation in this area has become a live political topic.

Two regulatory frameworks are worth knowing by name for the 11+ age bands, because the lesson's quiz tests them directly. The EU's General Data Protection Regulation (GDPR) gives people rights over data companies hold about them: the right to see what's collected, correct it, delete it, and object to being profiled by automated systems. California's equivalent, the CCPA (California Consumer Privacy Act), gives California residents the right to know what's collected, request deletion, and opt out of having their data sold. Neither law directly protects a student in the Philippines, but both matter for two reasons: many services students use are built to comply with GDPR/CCPA globally rather than maintain different products per region, and both laws are frequently cited as models for privacy legislation elsewhere, including ongoing conversations around the Philippines' own Data Privacy Act (RA 10173).

If a sharp student asks "does any of this actually protect me here in the Philippines?" — the honest answer is: the Philippines has its own Data Privacy Act (RA 10173) enforced by the National Privacy Commission, which grants broadly similar rights to know, access, and request correction or deletion of your data, though enforcement and public awareness are less mature than in the EU. It's a fair and accurate answer that doesn't require pretending GDPR applies locally.

For the oldest students, the lesson also introduces genuine technical privacy protections, and it's worth being precise about what each one actually does so you can correct a confident wrong answer. Differential privacy adds carefully calibrated random noise to a dataset so that analysts can learn accurate aggregate patterns (like "40% of users in this city like this song") without being able to reliably pinpoint any one individual's actual record — it's a mathematical guarantee, not just "hiding" data. Federated learning trains an AI model across many users' devices without their raw data ever leaving those devices — only model updates (not the underlying photos, messages, or voice recordings) get sent back to a central server, which is how a company can improve a keyboard's next-word prediction without uploading everything anyone ever typed. Homomorphic encryption is a more exotic and still mostly research/early-deployment technique that allows computation directly on encrypted data, producing an encrypted result that decrypts to the correct answer — meaningfully different from ordinary encryption, which has to be decrypted before you can do anything useful with it.

Finally, it's fair to be candid with older students that this is a genuinely unresolved tension, not a solved problem with an obvious right answer. Personalization — the recommendation that's actually useful, the map that knows where you parked, the assistant that recognizes your voice — comes from the same data collection that also enables tracking, profiling, and misuse. There's no purely technical fix that makes this tradeoff disappear; there's only better and worse ways to manage it, which is exactly the debate GDPR, CCPA, and RA 10173 are each trying to referee in their own way.

Materials & Prep

Like most AIQ lessons, this one is light to prep. You need:

Common Misconceptions

"Only shady or low-quality apps collect your data — trustworthy, well-known apps don't."
Data collection for personalization and advertising is the default business model for most free apps, including many well-known, legitimate ones. The meaningful difference between a "good" and "bad" app usually isn't whether it collects data, but whether it discloses that clearly, limits what it collects to what it actually needs, secures it properly, and gives users real control over it.
"Deleting an app from your phone deletes the data it already collected about you."
Uninstalling an app usually just removes the app itself from the device — data already sent to the company's servers typically stays there unless you take a separate action, like using an in-app "delete my account" option or, where laws like GDPR or the Philippines' Data Privacy Act apply, formally requesting deletion.
"If I didn't type or upload anything personal, an app can't really know much about me."
A huge amount of what's collected is passive, not typed — background location pings, how long you look at something before scrolling past it, which app icons you tap and in what order, what your voice sounds like when a smart speaker is triggered. Passive behavioral data is often more revealing, and more valuable to advertisers, than anything a user consciously typed in.
"Privacy settings, once I set them, stay the way I left them forever."
Apps regularly update their privacy policies and default settings, sometimes resetting a permission a user had turned off, or introducing a new data-collection feature that's opted in by default. Treat privacy settings as something to periodically re-check, not a one-time setup task — this is true for adults managing their own accounts just as much as for students.

Pick your grade's script

← All lesson plans ← When AI Isn't Fair Deepfakes & Misinfo →