GestureSynth.me

Phone and tablet setup guide

Play Gesture Synth on Mobile

Open the real instrument on your phone or tablet, then use this guide to set camera access, landscape orientation, audio and performance expectations before you raise both hands.

gesture synth mobile

Set Up Gesture Synth for a Phone or Tablet

Gesture Synth mobile play uses the same local hand-tracking and Web Audio instrument as the desktop page. There is no mobile app to install and no account to create. A recent browser, a working front camera and enough space to keep both wrists in view are the important requirements.

Chrome on Android is the primary supported mobile path. Safari on iPhone and iPad can depend on the camera, WebAssembly, graphics and audio features available in the installed iOS version, so this page describes honest checks and fallbacks instead of promising identical behaviour on every device.

Play the instrument ↑
Best mobile path
Recent Chrome on Android
Layout
Landscape on a stable stand
Permissions
Camera only, no microphone
Processing
On the device

Choose a Supported Mobile Browser

On Android, begin with an up-to-date Chrome browser in a normal top-level tab. The page needs camera access, JavaScript, WebAssembly and Web Audio. Avoid opening the instrument inside an in-app social-media preview because embedded browsers can hide permission controls or suspend audio differently from the full browser.

On iPhone or iPad, try current Safari first. Camera and audio policies change across iOS releases, and some devices may use compatibility fallbacks. If Start cannot open the camera or the audio export path is unavailable, the page reports the missing capability rather than uploading the performance to another service.

Use Landscape Orientation and a Stable Stand

Rotate the device to landscape before pressing Start and place it on a stand. Holding the phone consumes one or both hands and makes the camera move whenever you change a gesture. A fixed device also keeps the left and right sides of the mirrored preview predictable.

Move back until fingertips, palms and wrists remain visible at a comfortable height. Keep browser controls from covering the instrument and lock orientation when the operating system allows it. Soft front light and a quiet background help more than moving the hands rapidly near the lens.

  • Place the phone or tablet near eye or upper-chest height.
  • Leave horizontal space between the two hands.
  • Keep the charging cable clear of the stand and camera.
  • Use a landscape viewport before granting camera access.

Allow Camera Access and Unlock Mobile Audio

Select Start and allow video camera access when the browser asks. GestureSynth does not request microphone permission. If permission was denied earlier, open the browser site controls, allow the camera for gesturesynth.me, reload the page and press Start again.

Mobile browsers require a deliberate tap before Web Audio can run. Press Start after returning from a background tab so the AudioContext can resume. Begin at a modest device volume, confirm the in-app mute is off and raise the right hand gradually after both hand indicators become active.

Reduce Heat, Battery and Bluetooth Delay

Hand tracking, camera capture, animation and audio synthesis run at the same time. Close video calls and graphics-heavy tabs, connect power for a longer session and enable Low-performance mode in Settings if the device becomes hot or landmark updates begin to skip.

Bluetooth headphones can add audio buffering even when hand tracking is responsive. Compare the built-in speaker or wired headphones when the visual chord changes before the sound. Returning from the background may also pause the camera or audio; use Stop, then Start, rather than repeatedly opening more tabs.

Answers before you play

Gesture Synth Mobile FAQ

Is there a Gesture Synth mobile app?

No app is required. The instrument runs in a supported mobile browser and processes camera frames on the device.

Does Gesture Synth work on Android?

Recent Chrome on Android is the primary supported mobile path. Use landscape orientation, a stable stand, good light and a normal browser tab.

Does Gesture Synth work on iPhone or iPad?

Current Safari may work, but camera, WebAssembly, graphics, audio and export support vary by iOS version and device. The page reports unavailable capabilities instead of promising full parity.

Why did the sound stop after I changed apps?

Mobile operating systems can suspend camera and audio work in background tabs. Return to the page and use Stop, then Start again to resume the session.