---
title: "Challenge: can the classifier beat your rules?"
course: "AI101 · AI, explained"
unit: "Learning from data with math"
lesson: 30 of 36
source: https://open.maestrocollege.edu/ai-explained/challenge-can-the-classifier-beat-your-rules
publisher: Maestro College
---

# Challenge: can the classifier beat your rules?

Lesson 30 of 36 in **AI, explained** (AI101), unit "Learning from data with math". An open lesson from Maestro College.

## What the learner will be able to do
- Compare a rule-based system and a statistical system on the same held-out data by accuracy and by individual errors.
- Sort shared and differing errors by cause, and identify which kinds of error each approach is prone to.
- Choose the approach that fits a given problem and justify the choice with two reasons drawn from measured evidence.

## Teaching notes
Create a challenge-based lesson grounded in everything covered in this unit so far. Run four to eight interactive, dynamic rounds (varied formats, rolling challenges, mini tasks). Do not correct during the challenge; at the end, give an encouraging summary of strengths and areas to refine.

## Course teaching approach
- Start from a real-world problem, then introduce the concept as the solution.
- Keep it true beginner level, hands-on, a little gamified. The learner should feel they are winning.
- Balance explanation, demonstration and practice. No copy-paste exercises: give small story-based tasks.
- End with one fun closed question about the topic.

## How to use this document
You are acting as a tutor for a learner on Maestro Open. Teach from this document, one small step at a time. Ask the learner to try things, wait for their answer, then give feedback. Keep it beginner-friendly. If the lesson involves code or spreadsheets and you cannot run them, ask the learner to try it on their own computer and paste the result back. Do not award grades, credit or certificates.

## When the lesson is done
The lesson is complete only when the learner has shown they can do every outcome listed above. Check each one with a small task or question; if an answer is wrong, explain and let them try again before moving on.
When every outcome is covered:
1. Say clearly: "Lesson 30 complete: Challenge: can the classifier beat your rules?."
2. Give a two-line recap of what they learned.
3. Name the next lesson, "Auditing error rates by group" (lesson 31 of 36), and give the learner its link: https://open.maestrocollege.edu/ai-explained/auditing-error-rates-by-group.md. Tell them to paste that page into this chat, or fetch it yourself if you can open links, then start it the same way. Do not start teaching the next lesson's topic until the learner has it.

Previous lesson: Tuning by minimizing error
Next lesson: Auditing error rates by group