Understanding External Audio Modulation

External audio modulation is a technique that allows you to use any audio signal — from a field recording, a vocal phrase, or even a live microphone feed — to control parameters of a synthesizer in real time. Instead of relying solely on internal LFOs, envelopes, or step sequencers, you feed an audio signal into a modulation input on your synth. The amplitude, frequency, or spectral content of that external signal then drives changes in parameters like filter cutoff, oscillator pitch, wave table position, or effect depth. This approach bridges the gap between acoustic and electronic sound worlds, enabling patches that respond organically to external stimuli. The result is often more unpredictable and expressive than static internal modulation, making it a favorite among experimental producers, film scorers, and live performers.

The Technical Foundation: How External Audio Modulation Works

To understand external audio modulation, you first need to grasp how synthesizers interpret incoming signals. A typical synthesizer generates sound using oscillators, shapes it with filters and envelopes, and adds effects. Modulation comes from internal sources like LFOs and envelopes, which produce control voltages that vary over time. When you introduce external audio, the synthesizer must convert that audio into a usable control signal. This happens via an envelope follower or a dedicated modulation input.

An envelope follower extracts the amplitude envelope of an incoming audio signal — it tracks how loud the signal is at any given moment and outputs a corresponding control voltage. That voltage can then be routed to any modulation destination. Some synthesizers also allow audio-rate modulation, where the actual waveform of the external signal directly modulates a parameter at audio speeds, producing sideband artifacts and complex timbral shifts. This is especially common in modular synthesizers, where any signal — audio or control — can patch anywhere.

For a deeper dive into envelope followers and their applications, check out this excellent primer on Sound On Sound's guide to envelope followers. Understanding this core concept will unlock the full potential of external audio modulation.

Essential Tools and Equipment

Before you can start modulating with external audio, you need the right gear. The specific tools depend on whether you use a hardware synthesizer, a modular system, or a software environment.

Hardware Synthesizers with External Modulation Inputs

Many modern polysynths and flagship monosynths include dedicated external audio inputs that can be routed to modulation destinations. Instruments like the Moog Subsequent 37, Arturia MicroFreak, and Sequential Prophet-6 offer CV or assignable modulation inputs. Always consult your synth's manual to confirm whether the external input can be used as a modulation source or only as a direct audio input for processing. For an overview of synths with external modulation capabilities, MusicRadar's roundup of synths with audio inputs is a helpful resource.

Modular Synthesizers and Eurorack

Modular systems are where external audio modulation truly shines. Any Eurorack module can accept audio signals as modulation sources. An envelope follower module like the Mutable Instruments Stages or Doepfer A-119 extracts control voltages from audio. You can also use utility modules like comparators, S&H circuits, or logic processors to further shape how the external audio modulates your patch. The modular approach gives you maximum flexibility but requires careful gain staging and patching.

Software Synthesizers and DAW Routing

In the box, external audio modulation is handled with sidechain inputs or routing within a sampler or synth plugin. Synthesizers like Native Instruments Massive X, Ableton Live's Operator, and Arturia's Pigments allow you to route an audio track as a modulation source. You typically load an audio clip or assign a live input to the modulation matrix, then adjust depth and response curves. This is often the easiest way to experiment because no patch cables are required, and you can save presets instantly.

Essential Accessories

  • Balanced or unbalanced cables: Use TS or TRS cables to connect your audio source to the synth's input. Keep cable runs short to avoid noise.
  • Audio interface with multiple outputs: If using a hardware synth without a dedicated input, you can route audio from your DAW through an interface output into the synth's CV input.
  • Preamp or gain stage: External audio signals from microphones or guitars may need preamplification to reach line level or modular voltage levels. A small mixer or preamp helps ensure clean signals.
  • Patch cables for modular systems: For Eurorack, use 3.5mm patch cables. Having a variety of lengths helps manage messy patches.

Step-by-Step Setup Guide

Follow these expanded steps to set up external audio modulation on your system. The exact process varies by instrument, but the principles remain consistent.

Step 1: Prepare Your External Audio Source

Decide on your source material. It can be a looped sample, a live microphone input, a field recording, or even another synthesizer. Ensure the audio is at a consistent level — use compression or normalization if needed — so the modulation response stays predictable. If you are using a microphone, position it close to the sound source to capture detail, and apply a high-pass filter to remove rumble that could cause unwanted low-frequency modulation.

Step 2: Connect the Audio to Your Synthesizer

Route the output of your audio source into the external input of your synthesizer. For hardware synths, use the correct input jack (often labeled EXT IN, AUDIO IN, or CV IN). For modular setups, patch the audio signal into an envelope follower module's input. For software, create an audio track containing your source and route it into the synth's sidechain or modulation input within your DAW.

Step 3: Set Up the Modulation Path

On your synthesizer, navigate to the modulation matrix. Select the external input as the modulation source. Then choose your destination — filter cutoff is a classic starting point because it produces a clear, responsive effect. Set the modulation depth to a moderate value, such as 30% to 50%, and play a sustained note. You should hear the filter opening and closing in response to the dynamics of your external audio.

Step 4: Tune the Envelope Follower Response

If your synth or modular module has an envelope follower, adjust its attack and release times. Faster attack times capture transients like drum hits or spoken consonants. Slower release times produce smoother modulation that works well with pad sounds or ambient textures. For envelope followers with a threshold or sensitivity control, adjust until the modulation responds cleanly without self-oscillation or noise.

Step 5: Experiment with Depth and Polarity

Modulation depth determines how much the external signal influences the destination parameter. Low depth values add subtle movement; high values create dramatic sweeps or wild pitch shifts. Some modulation inputs allow bipolar modulation — positive values increase the parameter, negative values decrease it. Try inverting the modulation polarity to create inverse responses, such as the filter closing when the audio signal gets louder.

Step 6: Layer with Internal Modulation

External audio modulation does not have to replace internal modulation. Combine it with LFOs, envelopes, or sequencers for richer, more complex patches. For example, use an LFO to modulate the depth of the external modulation, creating variation over time. Or route the external audio to modulate oscillator pitch while an envelope simultaneously shapes the filter.

Advanced Routing and Signal Flow

Once you master basic external modulation, you can explore more advanced routing strategies. Signal flow becomes critical when working with multiple modulation sources and destinations.

Multi-Destination Modulation

Some synthesizers allow you to route one external audio source to multiple destinations simultaneously. For instance, you can modulate filter cutoff, amplifier level, and reverb mix all from the same audio track. This creates a cohesive response where all parameters move together with the dynamics of the source. Be mindful of modulation depth stacking — too much modulation on multiple parameters can result in chaos. Start with low depths and increase gradually.

Audio-Rate Modulation

When the external signal modulates at audio rates (frequencies above 20 Hz), the effect shifts from rhythmic to timbral. Audio-rate modulation of oscillator pitch produces frequency modulation (FM) synthesis effects, while modulating filter cutoff at audio rates generates sidebands and metallic tones. This technique requires careful tuning because the results can be harsh if modulation depth is too high. For a deeper exploration of audio-rate modulation, see Attack Magazine's tutorial on audio-rate modulation.

Using CV Processors and Utilities

In modular or semi-modular setups, you can process the external modulation signal before it reaches its destination. A slew limiter smooths out rapid changes, creating portamento-like effects on the modulation. A sample-and-hold module quantizes the signal into stepped values, producing rhythmic, grid-based modulation. A comparator can be used to generate gates when the audio signal exceeds a threshold, turning your external audio into a trigger source for envelopes or sequencers.

Sidechain and Ducking Applications

External audio modulation is closely related to sidechain compression. Instead of using a compressor to duck audio, you can use the external signal to modulate any synth parameter. For example, route a kick drum track to modulate the filter cutoff of a pad sound, creating a pumping effect without compression artifacts. You can also use a vocal track to modulate the reverb mix on a synth, making the reverb swell in sync with the vocal phrasing.

Creative Applications and Sound Design Techniques

The true power of external audio modulation lies in its creative potential. Here are several expanded techniques to inspire your sound design.

Vocal-Driven Synthesizer Textures

Route a vocal recording or live microphone into the modulation input of your synth. Use it to modulate filter cutoff or oscillator pitch. As the singer changes pitch or intensity, the synthesizer responds dynamically, creating a hybrid voice-synth texture. For more pronounced effects, layer multiple destinations: filter, amplitude, and an effect like chorus or delay. The result sounds almost like the synth is singing along with the vocal.

Rhythmic Modulation from Percussion

Feed a drum loop or individual drum hits into your synth's external input. Use an envelope follower with a fast attack to capture each transient. Route that to modulate the filter cutoff or wave table position. The synth will pulse in sync with the drum pattern, creating rhythmic filter sweeps that lock to your groove. You can also use a snare hit to trigger a burst of modulation that decays quickly, adding accents to your patch.

Field Recordings as Evolving Textures

Ambient sounds like rain, wind, or traffic contain subtle, unpredictable variations. Use a field recording as a modulation source for a drone or pad sound. The natural ebb and flow of the recording will modulate the synth parameters, creating an evolving, organic texture that never repeats exactly. This technique works well for film scoring, ambient music, or generative soundscapes.

Live Instrument Modulation

Connect a guitar, bass, or other instrument through an audio interface into your synth's modulation input. The instrument's dynamics, timbre, and phrasing directly shape the synth's output. A guitarist can play a chord, and the synth's filter opens in response to the attack, then closes as the chord decays. This creates a responsive, interactive performance where the live instrument and synth become one voice.

Modulating Effects Parameters

Do not limit external modulation to oscillator and filter parameters. Apply it to effects like reverb decay, delay feedback, or distortion drive. For example, modulate the reverb decay time with a vocal recording — longer decay on louder phrases, shorter decay on quieter moments. This creates a dynamic, spatial quality that evolves with the source material.

Troubleshooting Common Issues

External audio modulation can introduce challenges. Here are solutions to frequent problems.

No Modulation Response

If the synthesizer does not respond to the external signal, check that the input is active and properly selected in the modulation matrix. Confirm that the audio source is producing signal (use a meter to verify). Ensure the modulation depth is set above zero. Some synths require you to enable the external input globally before it appears as a modulation source — consult the manual.

Distorted or Noisy Modulation

If the modulation sounds harsh or noisy, the input gain is likely too high. Reduce the level of your external audio signal. For modular systems, use attenuator modules to scale the voltage before it reaches the modulation destination. For software, apply a utility plugin to reduce gain. If using a microphone, check for background noise and apply a noise gate or expander.

Latency in Modulation Response

Digital systems can introduce latency between the external signal and the modulation output. This is most noticeable when using external audio from a DAW routed through an audio interface. Minimize buffer sizes and use direct monitoring if possible. In hardware setups, keep signal paths analog to avoid conversion delays. For software, use a synth that supports low-latency sidechain processing.

Unpredictable or Unstable Modulation

If the modulation behaves erratically, the envelope follower settings may not suit the source material. Adjust attack and release times to better match the transients of your audio. For sources with wide dynamic range, apply compression before routing to the synthesizer to even out the levels. You can also use a utility module or plugin to apply a slew limiter, smoothing out rapid fluctuations.

Pushing Further: Modular and Hybrid Setups

For experienced sound designers, combining hardware and software approaches yields the most flexibility. A hybrid setup might use a hardware synthesizer with CV inputs, alongside a Eurorack envelope follower, while also routing audio from a DAW. This allows you to process external audio with modular utilities — comparators, logic modules, and sequential switches — before it reaches the synth's modulation input. The possibilities expand dramatically when you can re-patch signal flow dynamically.

Modular synthesizer users can also explore modules specifically designed for external audio processing. The Make Noise Morphagene, for example, allows you to record and manipulate audio snippets that can then modulate other modules. The Intellijel Rainmaker uses external audio to drive comb filter effects and spectral processing. These advanced tools reward experimentation and deep patching knowledge.

For those new to modular, a simple envelope follower module combined with a VCA and a quad attenuator provides a solid foundation for external audio modulation. As you grow comfortable, add utilities like comparators, sample-and-holds, and logic modules to process the modulation signal in more complex ways.

Conclusion

Using external audio as a modulation source in synthesizers transforms your sound design process by introducing real-world unpredictability and expressiveness. Whether you use a hardware synth with CV inputs, a modular Eurorack system, or a software instrument in your DAW, the technique bridges the gap between acoustic and electronic sound. From vocal-driven filter movements to rhythmic modulation from drum loops and evolving textures from field recordings, the creative applications are vast. By understanding the technical foundation — envelope followers, audio-rate modulation, and signal routing — and through careful setup and troubleshooting, you can harness external audio to create patches that feel alive, responsive, and unique. Experiment with different sources, destinations, and modulation depths to discover sounds that no static LFO or envelope could ever produce.