Is it possible to Intercept and postprocess all audio streams coming from any app or process running on Windows device?

Sumit Kumar 0 Microsoft Employee

We want to build some app ( C++/Python) for intercepting and processing all audio streams coming from any applications/process like Youtube in browser, inbuilt music app on Windows Device .

The program should apply some filters to audio first and then only send it to respective audio devices for output.

Castorix31 84,546 Reputation points

2024-09-17T07:02:36.58+00:00

I did some tests with WASAPI (loopback mode) and I could modify sound from Youtube videos (but the resulting sound was garbage, as I don't know how to add a correct filter from audio data (KSDATAFORMAT_SUBTYPE_IEEE_FLOAT subformat))
Sumit Kumar 0 Reputation points Microsoft Employee

2024-09-17T07:47:50.6333333+00:00

@Castorix31 Could you please help me with some boilerplate code or point me to useful resources .

In your test, I hope actual audio from youtube was not getting played and only garbage audio data is played in output .

Castorix31 84,546

I'm not sure if it is not played, then garbage added above , which would not be good (I tried to remove completely the sound with an empty buffer but I could not...)

I used code from https://learn.microsoft.com/en-us/windows/win32/coreaudio/loopback-recording

then at same time a Render client (I generated the following function from ChatGPT) , then GetBuffer to replace audio data with new modified audio data)

HRESULT InitializeRenderClient(IMMDevice** ppDevice, IAudioClient** ppAudioClient, IAudioRenderClient** ppRenderClient, WAVEFORMATEX* pwfx)
{
    HRESULT hr;
    IMMDeviceEnumerator* pEnumerator = nullptr;
    hr = CoCreateInstance(__uuidof(MMDeviceEnumerator), nullptr, CLSCTX_ALL, IID_PPV_ARGS(&pEnumerator));
    if (FAILED(hr)) return hr;

    // Get the default output audio device (or specify another device)
    hr = pEnumerator->GetDefaultAudioEndpoint(eRender, eConsole, ppDevice);
    if (FAILED(hr)) return hr;

    // Activate the audio client for the render device
    hr = (*ppDevice)->Activate(__uuidof(IAudioClient), CLSCTX_ALL, nullptr, (void**)ppAudioClient);
    if (FAILED(hr)) return hr;

    // Initialize the audio client for rendering (output)
    hr = (*ppAudioClient)->Initialize(AUDCLNT_SHAREMODE_SHARED, 0, 10000000, 0, pwfx, nullptr);
    if (FAILED(hr)) return hr;

    // Get the render client
    hr = (*ppAudioClient)->GetService(IID_PPV_ARGS(ppRenderClient));
    return hr;
}

1 answer

Tong Xu - MSFT 2,456 Reputation points Microsoft Vendor

2024-09-17T02:23:06.3366667+00:00

No, you can't.
MediaFoundation only deals with different audio files. It can't capture and process the audio stream of Web Aplication.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Is it possible to Intercept and postprocess all audio streams coming from any app or process running on Windows device?

1 answer

Your answer