Teach a 40-Minute Gesture Synth Lesson

Set Clear, Observable Lesson Objectives

By the end of the session, learners should be able to explain the separate roles of the two hands, demonstrate at least three scale degrees, compare a basic triad with one alternate chord quality and describe one way height or wrist angle changes the sound.

Treat those as observable tasks, not promises about musical development. Adjust the number of gestures, tempo and speaking vocabulary for the group. A learner can participate by observing, naming a target, operating visible controls or taking a playing turn.

• Identify left-hand degree and right-hand expression roles.
• Produce a stable I, IV or V target with both hands visible.
• Describe volume, filter or octave as an expressive control.
• Reflect on how camera input becomes browser-generated sound.

Prepare the Device, Space and Privacy Explanation

Before the lesson, test the exact browser, camera and audio output. Place the device so the active player can stand or sit about one arm's length away without blocking the display. Use front light and mark a comfortable playing zone that keeps wrists and fingertips visible.

Explain that the site requests video camera access for local hand-landmark detection and does not request a microphone. It does not save or upload camera recordings. Follow the institution's own device, consent, accessibility and supervision policies; this page does not replace them.

Check webcam setup before class → · Read webcam hand-tracking privacy →

Run the 40-Minute Lesson Sequence

Minutes 0–5: demonstrate Start, camera permission and Stop. Minutes 5–12: model left-hand degrees I, IV and V with a basic right-hand triad. Minutes 12–20: let pairs alternate between performer and observer, with the observer naming the degree and checking whether both hands stay visible.

Minutes 20–30: open Learn mode and choose Twinkle Twinkle Little Star for a guided public-domain chord exercise. Minutes 30–36: compare one inversion or seventh target with the basic triad. Minutes 36–40: stop the camera, review the mapping and collect a one-sentence exit reflection.

Use a Simple Formative Check, Not a High-Stakes Score

Ask each learner or pair to show one stable degree, change one right-hand quality and explain which hand controls volume. A correct response is visible in the on-screen labels and audible result. If recognition fails, let the learner diagnose framing or lighting instead of treating the camera result as a musical grade.

The practice overlay records matched and skipped targets in the local session. Use those counts only as feedback about the activity. They are affected by device performance, camera angle and recognition quality and should not be treated as an assessment of ability.

Open the printable gesture chart → · Review stable hand positions →

Extend the Lesson with Rhythm, Harmony or Technology

For a harmony extension, ask learners to label a I–V–vi–IV progression before recording it in the four-track sequencer. For a rhythm extension, compare 3/4 and 4/4 grid groupings at a slow tempo. For a technology extension, trace the path from webcam frames to hand landmarks, gesture mapping and Web Audio synthesis.

Keep each extension tied to a working feature and provide alternatives for learners who cannot or do not want to use camera gestures. The activity is not a sign-language lesson, therapy system or substitute for a dedicated accessible instrument.

Build a four-chord progression → · Explain the hand-tracking synthesizer pipeline →