□ Course Improvement Playbook
A rapid, AI-powered diagnostic framework to audit, align, and improve your course in 30–60 minutes
✓ Executive Summary
This playbook provides a structured, AI-assisted approach to course auditing and improvement without requiring a complete redesign.
□ Purpose
Rapidly identify strengths, misalignments, and "quick wins" for any course.
□ Methodology
Use generative AI (ChatGPT, Claude, Gemini) as a thinking partner and diagnostic tool.
□ Outcome
Get a prioritized list of actionable improvements from quick fixes to mid-semester adjustments.
□ Flexibility
Adaptable for solo review, peer collaboration, or student-informed audits.
What You'll Need
- Course Syllabus (Essential)
- Course Learning Outcomes (CLOs)
- Assessment Methods (rubrics, grading breakdown, exam descriptions)
- Weekly Schedule or Reading List (Optional)
□ Getting Started
Choose the audit pathway that fits your context and confidence level.
Three Audit Pathways
Solo Audit
Duration: ~1 hour
Run the prompts and select quick wins. Best for experienced instructors who prefer independent review.
Peer Check
Duration: ~1.5 hours
Run the prompts, then discuss results with a colleague for 30 minutes. Best for validation and fresh perspectives.
Student Voice
Duration: ~1.5 hours
Run the prompts and cross-reference with student feedback. Best for building buy-in and identifying hidden struggles.
5️⃣ The Five-Prompt Diagnostic Framework
Run these prompts sequentially. You serve as the expert decision-maker; the AI serves as the analyst.
Prompt 1: The Health Check
Diagnostic Snapshot
Goal: A high-level triage identifying strengths, gaps, and immediate "quick wins".
"You are an expert course design specialist reviewing a [DISCIPLINE] course at [LEVEL] level. I will provide: Course syllabus, Course learning outcomes, and Assessment methods.
Your task is a BRIEF diagnostic review (max 300 words) identifying:
1. STRENGTHS (2–3 things working well)
2. MISALIGNMENTS (Where outcomes and assessments don't match)
3. GAPS (Topics taught but not assessed, or vice versa)
4. QUICK WINS (1–2 small changes to improve alignment)
[PASTE YOUR COURSE MATERIALS HERE]"
Prompt 2: Learning Outcome Clarity
Outcomes Assessment
Goal: Ensure outcomes are measurable, assessable, and at the correct cognitive level.
"I am teaching [COURSE NAME] to [NUMBER] students. My outcomes are:
[PASTE YOUR OUTCOMES]
Evaluate each outcome:
1. Is it clear what students will DO?
2. Is it assessable?
3. Is it at the right cognitive level?
4. Suggest rewording if needed.
Format as a table. Also, identify how many outcomes target Remember/Understand vs. higher-order thinking."
Prompt 3: Assessment Alignment Map
Alignment Visualization
Goal: Visualize the link between what students learn and how they are graded.
"I need a quick assessment-to-outcome alignment check.
My outcomes: [PASTE CLOs]
My assessments/grading: [PASTE GRADING BREAKDOWN]
1. Create an alignment matrix showing which CLO links to which assessment.
2. Identify outcomes with NO assessment.
3. Suggest ONE addition or change to strengthen alignment."
Prompt 4: Student Struggle Forecaster
Predicted Pain Points
Goal: Predict misconceptions, sequencing issues, and "surprise failures" before they occur.
"Based on my course design, predict where students might struggle. Context: [DISCIPLINE, LEVEL, CLASS SIZE]
Outcomes: [PASTE OUTCOMES]
Topics: [BRIEF DESCRIPTION]
Assessments: [BRIEF DESCRIPTION]
Identify:
1. Likely misconceptions
2. Sequencing issues
3. Assessment disconnects
4. Cognitive overload
Suggest ONE small intervention for each."
Prompt 5: Resource & Syllabus Audit
Materials & Communications Review
Goal: Verify that readings support outcomes and syllabus language is student-friendly.
"I'm auditing my materials:
[PASTE READINGS & SYLLABUS SECTIONS]
Evaluate Readings:
• Are they tied to outcomes?
• Is the reading load realistic?
• Are sources current?
Evaluate Syllabus:
• Are assignment expectations clear?
• Are vague terms (e.g., 'critical thinking') defined?
Output: Keep/Replace suggestions and clarity edits."
□ Implementation Plan: 3-Phase Rollout
Do not attempt to fix everything at once. Use the audit results to stagger improvements strategically.
Phase 1: This Week
- Select ONE "Quick Win" from Prompt 1
- Examples:
- Reword a vague outcome
- Define a complex term in the syllabus
- Clarify one assignment description
Why: Build momentum and demonstrate quick progress to yourself and students.
Phase 2: Weeks 2–4
- Address ONE alignment gap from Prompt 3
- Examples:
- Add a low-stakes exit ticket for an unassessed outcome
- Create a "think-pair-share" activity to practice exam skills
- Revise one assessment rubric for clarity
Why: More substantial changes that students experience directly.
Phase 3: End-of-Semester Review
- Re-run Prompts 1 and 4 to assess impact
- Reflection Questions:
- Did the quick wins help student engagement?
- Did the predicted student struggles actually occur?
- What unexpected issues emerged?
- What will you keep for next semester?
Why: Close the loop and build institutional knowledge for iterative improvement.
□ Case Study: Abnormal Psychology Course
Context
Prof. Chen | 35 undergraduates | Struggling with course effectiveness
The Problem
High failure rate on the final project; students struggled to apply theory to case scenarios instead of just memorizing definitions.
What the Audit Revealed
- Prompt 1 (Health Check): Misalignment discovered—outcomes focused on "Understanding," but the final project required "Application/Evaluation".
- Prompt 4 (Struggles): Predicted students would confuse similar diagnostic categories and lack practice distinguishing them.
The Fixes
- Quick Win: Reworded 1–2 outcomes to match the project's cognitive level.
- Intervention: Added a 10-minute comparison activity in Week 3 to prevent category confusion.
- Result: Clearer expectations, targeted practice, and no need for complete course rebuild.
Takeaway
Alignment problems often masquerade as "student capability" issues. A diagnostic audit reveals the real gap quickly.
⚠️ Troubleshooting & Success Tips
Red Flags
- More than 3 outcomes are unmeasurable → Consider a deeper redesign or peer consultation
- Less than 50% of outcomes are assessed → Significant alignment work needed
- Multiple unrelated course objectives → May need course scope clarification
Best Practices
- Trust Your Expertise: The AI is a tool, not an authority. Verify all outputs against your course documents. If something looks generic or wrong, ignore it.
- Input Matters: If AI output is vague, paste full syllabus sections rather than summaries. Replace all placeholders with real course details.
- Iterate, Don't Redesign: One reworded outcome is better than an unfinished total redesign. Course improvement is cumulative.
- Close the Loop: Ask students simple comprehension and engagement questions every 2–3 weeks to validate changes.
- Annual Refresh: Run this audit once per semester, keeping what works and adjusting what doesn't.
□ Key Takeaways
Start Small
One reworded outcome is better than an unfinished total redesign.
Focus on Alignment
The most common issues arise when assessments don't match the cognitive level of learning outcomes.
Close the Loop
Validate changes by asking students simple comprehension and engagement questions regularly.
Ready to Audit Your Course?
Gather your syllabus and learning outcomes. You'll be done in 30–60 minutes.
