Play a Hand Gesture Music Game

Choose a Song and Start Playing

Press Start, approve camera access and choose a song, chord study or technique drill. Position your left hand clearly in frame and match the displayed scale degree. Hold the recognized target for roughly 350 milliseconds so a brief tracking fluctuation does not count as an intentional note.

The current step advances after a successful hold. If a shape is difficult, use Skip and continue the run rather than losing the entire session. The results summarize completed and skipped targets so you can choose what to practice next.

Read the Targets and Hand Feedback

Song targets use scale degrees rather than a scrolling piano keyboard. Your left-hand shape selects the requested degree; the right hand remains available for chord quality, volume and tone. Keep the right hand at a comfortable height so a correct target is audible without being too loud.

Look at the live recognition display when a pose does not register. Separate fingers, keep the wrist visible and pause long enough for the label to settle. Repeated fast guesses usually make recognition less reliable than one deliberate shape.

Study the full hand-control map →

Use the Metronome and Repeat Short Runs

Turn on the practice metronome after you can form the required shapes without rushing. Begin at a comfortable level, listen for a steady pulse and let each new gesture arrive before the next beat. The goal is clean coordination, not maximum speed.

Repeat the same song and compare which steps are skipped. If one transition keeps failing, practice those two shapes outside the song view, then restart. A short accurate run builds a better motor pattern than repeatedly completing the song with uncertain poses.

Treat the result as a diagnostic, not a high score. Before choosing Skip, note the current target and any property chips that do not match. After the run, use that note to recreate the preceding target, pause, then change only the differing properties. For example, when degree stays I but quality changes from a triad to an inversion, freeze the left hand and practise the right-hand finger change five times. When a target moves from V major to VI minor, rehearse the degree and world together without the click. Return to the song only after both labels settle. This property-by-property method uses your note and the live match chips to choose a precise drill instead of repeating every successful target again.

• Learn the required left-hand shapes before adding the right-hand controls.
• Use Skip to identify weak transitions without ending the run.
• Add the metronome only after recognition is stable.
• Restart the same song and aim to reduce skipped targets.

Game Scope, Privacy and Safe Practice

The practice score exists only to describe the current run. There is no public ranking, multiplayer mode, profile or permanent cloud history. Camera frames are used for live hand tracking and are not needed as song or analytics uploads.

Take breaks if your shoulders, wrists or eyes feel strained, and keep speaker volume moderate. The game is for casual musical practice and entertainment; it is not a clinical rehabilitation program or a substitute for guidance from a qualified professional.

Read the step-by-step tutorial → · Review privacy details →