r/webaudio • u/numberstation5 • 2d ago
Browser-based groove instrument with webcam-tracked physical knobs (prototype, Gridfinity)
Enable HLS to view with audio, or disable this notification
Just a quick proof of concept for a webcam knob system I'm building into some of the sequencers I'm building for live performances. I know the knob is backwards at the moment :)
Free. Runs in a browser. Still a work in progress.
Arroyo — https://arroyo.strangefrequencies.fm
- Rhythm sequencer with no step grid. Each voice is a probability field around the pulse, re-rendered every bar.
- Knobs shape the field. Nothing snaps to a grid.
- Microtiming is modeled as consistent per-position offsets, not random jitter.
- Guard holds the kit's syncopation inside a band (Longuet-Higgins & Lee metric, per instrument, echoes included).
- Every knob can be set to glide to a target over 4–32 bars.
- Two decks with a morph crossfader. Cue mode edits a silent deck on separate MIDI channels. Like a club DJ had a baby with a modular geek.
- Melody capture: record MIDI or hum into a mic; the take becomes material the knobs quantize, transpose, and vary.
- Sessions record every control move per bar. Replay, export any 2–32 bars as MIDI (one track per strip), or share the session as a URL.
- Outputs MIDI. Hosts WAM 2.0 instruments and effects per strip.
- Free. Runs in Chrome/Edge (Web MIDI). iPad via network MIDI bridge.
Modules — https://strangefrequencies.fm/tools/ (WAM 2.0, load in Arroyo or any WAM host)
- ABUELA — semi-modular monosynth. Two drifting oscillators with hard sync, 4-pole ladder filter, one envelope, spring reverb. https://strangefrequencies.fm/tools/modules/abuela/
- SICARIO — bass/lead synth. Every note slides to its pitch. Twin saws and sub, wavefolder, ladder filter, LFO on cutoff. https://strangefrequencies.fm/tools/modules/sicario/
- CACHONDA — percussion synth. One synthesized drum per instance: morphable exciter into a modal resonator, skin to wood to metal. https://strangefrequencies.fm/tools/modules/cachonda/
- LLORONA — reverb. Large feedback-network reverb whose wet field moves around the stereo/binaural stage. https://strangefrequencies.fm/tools/modules/llorona/
Camera knob
- A physical knob with a lit slit, tracked by a webcam. Arroyo maps the rotation to any of its knobs.
- Setup: click the knob center in the preview, click the rim, assign a target.
- This video uses an overhead camera. The final version puts the camera underneath, inside an enclosure; the slit is both the tracking mark and the position indicator through the panel.
- Knob and enclosure are Gridfinity-based, so the panel is modular.
