Mapping — pick what drives each part

Feel

Extra sensors (enable to use as sources)

Note: true CPU/battery temperature and depth sensors aren't exposed to web pages — the CPU source is a load/throttle proxy.

Done

Hand Synth — how to play

Point the camera at your hand and shape the air:

• Raise / lower your hand → pitch
• Thumb ↔ index finger distance → volume (open = louder, together = quiet)
• Rotate your hand → tone / brightness
• Tap thumb to MIDDLE finger → 👊 kick drum
• Tap thumb to RING finger → 🥁 snare drum
• Pick the voice (Strings / Guitar / Bass / Lead / Bells) in the toolbar.

Face Synth — how to play

Look into the camera and sing with your face:

• Open your mouth → volume (closed = silence, wide = loud — sing it!)
• Tilt your head left / right → pitch — it slides along the scale
• 😑 Close both eyes (hold a beat) → 🧲 snap to exact notes; open to slide again
• Nod up / down → jump an octave up / down (hold your head level at start — that sets neutral)
• Turn your head sharply left / right → previous / next voice
• Lip shape → vowel: pucker "oo" ↔ relaxed "ah" ↔ wide smile "ee"
• Smirk (raise one mouth corner) → pan the sound toward that side
• Raise your eyebrows → vibrato + sparkle
• 😉 Wink left → 👊 kick · wink right → 🥁 snare (two-eye blinks are ignored)
• 🐡 Puff your cheeks → growl

Face Choir — how to play

Your emotion is the harmony. Face the camera and conduct a choir of chords:

• Open your mouth → volume — the choir swells as you open wide
• Turn your head left / right → walk the chords I–VII in the key
• Chin up / down → raise the voicing an octave & brighten / drop it & darken (hold level at start — that sets neutral)
• 🙂 Smile = major · ☹️ frown = minor · 😗 pucker = sus4
• Raise your eyebrows → add a 9th voice (color)
• Smirk (one corner only) → shift the chord inversion up / down
• 😉 Wink left → bass drone on/off · wink right → 🎶 harp strum
• 🐡 Puff your cheeks → tremolo · tilt your head → shimmer

Maestro — how to play

A duet: your hand plays the notes, your face gives them a voice. Get both in frame:

• ✋ Raise / lower your hand → pitch (snapped to the scale)
• ✋ Slide your hand left / right → pan
• ✋ Pinch thumb ↔ index → tone (open = bright, pinched = soft)
• 😮 Open your mouth → volume — no mouth, no sound
• 👄 Lip shape → vowel: pucker "oo" ↔ relaxed "ah" ↔ smile "ee"
• Raise your eyebrows → vibrato + sparkle
• 😉 Wink left → 👊 kick · wink right → 🥁 snare (blinks are ignored)
• 🐡 Puff your cheeks → growl

Runs two trackers at once — happiest on a recent phone. Prop the phone up at arm's length so your face and raised hand both fit.

HS2 — a two-handed duet

• 🫱 Right hand = melody. Raise / lower your hand to change pitch (snapped to the key). Pinch thumb + index together for louder. Rotate the hand for a brighter or darker tone.
• 🫲 Left hand = chords. Raise / lower to move through the chords of the key. Open your hand to swell the chord; make a fist to mute it.
• 🎶 Both hands share one key & scale, so the melody always fits the chords.
• 📸 Best strapped to your chest with the rear camera facing your hands. Use Swap hands if the roles feel reversed.

Got it

HS3 — a two-handed duet, refined

• 🫱 Right hand = melody. Raise / lower = pitch (snapped to the key). Spread thumb + index = brighter tone. Rotate the hand = vibrato.
• 🫲 Left hand = chords. Raise / lower = move through the chords. Make a fist to mute.
• ✋ Distance = volume: reach a hand away from the camera to get louder (bring it close = softer). Slide left/right to pan & brighten.
• 🎶 Both hands share one key & scale. Smoother, richer sound with steadier tracking than HS2.
• 📸 Best chest-mounted with the rear camera facing your hands. Use Swap hands if roles feel reversed.

Got it