Auditory Feedback Modulation
AFM setup.
Auditory Feedback Modulation (AFM) is a real-time approach used to investigate how speakers respond to alterations in the auditory feedback of their own voice. During speech or sustained phonation, the acoustic signal is captured by a microphone, processed in real time, and played back to the speaker through headphones. This allows specific characteristics of the auditory feedback, such as pitch, intensity, or voice quality, to be systematically modified while the speaker continues vocalizing. As a result, the speaker perceives an altered version of their own voice and may adapt their vocal production in response to these changes.
By manipulating selected properties of the auditory feedback, AFM provides a valuable method for studying the interaction between auditory perception and vocal motor control. The auditory system continuously monitors the produced voice and compares the perceived feedback with the expected auditory outcome. When discrepancies are introduced through modulation, speakers may produce compensatory vocal adjustments to counteract the perceived changes. These responses offer insights into the mechanisms underlying auditory-motor integration, feedback-based vocal regulation, and the maintenance of voice quality. The resulting changes in vocal production can be recorded and analyzed using acoustic measurements, allowing the characteristics and magnitude of these responses to be investigated objectively.
To enable the experimental investigation of these processes, the AFM concept was implemented in KiRAT as a real-time signal processing chain. The implementation allows the incoming microphone signal to be processed and modified before being returned to the speaker via headphones, thereby providing the technical basis for controlled auditory feedback experiments. The corresponding processing chain can be accessed in the main KiRAT window under Medical Signal Processing – Logopedic Signal Processing – Objective Speech Analysis – Feedback. Its configuration and individual processing components are illustrated in the screenshot below.

Screenshot of signal processing chain in KiRAT.
The AFM processing is based on a simplified model of speech production. The speech signal can be separated into an excitation component and the acoustic filtering effects of the vocal tract. Linear predictive coding (LPC) is used to estimate the vocal-tract characteristics and obtain the corresponding residual signal.
The residual signal obtained from the LPC analysis is used as the basis for the auditory feedback modulation. Additional noise is introduced into the residual signal to modify the perceived voice quality and create characteristics such as a more hoarse or breathy voice.
To adapt the added noise to the speech signal, four different noise-shaping approaches were implemented:
- Windowing based on pitch frequency
- Inverted windowing based on pitch frequency
- Shaping based on the residual signal envelope
- Pitch-based windowing combined with a constant noise component
The amount of added noise is controlled using the signal-to-noise ratio (SNR), allowing the strength of the modulation to be adjusted and compared across different conditions.
In addition to noise modulation, spectral decay is applied to control the distribution of the added noise across frequencies. A spectral decay of 2 dB per octave was used in the implemented system. Higher spectral decay values result in a more subdued and muted perception of the modified voice.

Signal processing overview.
The AFM demo can be operated through a user interface that provides different options for conducting and analyzing auditory feedback modulation experiments. During a live experiment, the selected modulation condition is applied while the current status and progress of the measurement are displayed.
In addition, the analysis view provides a visualization of the recorded speech signal and the extracted acoustic features. This allows the vocal response to the applied auditory perturbation to be observed and evaluated over time.
Previously recorded measurements can also be loaded and processed. The resulting data and analysis parameters can be visualized and summarized, allowing individual measurements as well as multiple recordings to be compared.

Screenshot of user interface of KiRAT.