Audio is delayed from video when switching

[thegobot]

When I change the MicrophoneSource to a InternalAudioSource or MixAudioSource, the audio lags behind the video. If you stop the stream and do the prepareAudio & prepareVideo again, it's fine.

Any ideas?

[pedroSG94]

Hello,

Can you tell me if you are using setTimestampMode method and which values are you using?
Can you reproduce it in my app example? in which example?

[thegobot]

No, I don't use setTimestampMode

I checked it on your app - the audio is also lagging. The audio comes before the video. For example, I switch the screen, then clap my hands. But in the stream, I see the audio first, then the video change. This is after changing the audio source on the fly.

[pedroSG94]

Thank you for the report. I will check it.

[floriangbh]

Hello
Same issue after upgrading from 2.6.6 to 2.7.2 in our production app if it can help

[pedroSG94]

Hello,

I was no able to reproduce this case. I will need more info.

Are you using StreamBase class to stream? (GenericStream, RtmpStream, etc).

Which stream protocol are you using?

Can you tell me platform used to stream, stream configuration and steps to reproduce it? If possible try to reproduce the case using app example.

[floriangbh]

Hello,

Library version: com.github.pedroSG94.RootEncoder:library:2.7.2
Class: RtmpCamera2 (the legacy Camera2Base API, not StreamBase / RtmpStream / GenericStream)
Protocol: RTMP (endpoint is rtmp://..., no RTMPS, no SRT) on Youtube
Rendering: OpenGlView as the camera preview, one filter active (ImageObjectFilterRender used for an overlay logo)

Exemple : https://www.youtube.com/watch?v=gOYiy8bkUI0&t=1129s

Should I migrate to StreamBase to fix this ?

Thanks

[pedroSG94]

It is recommended. In your case RtmpStream is the equivalent.
But, how are you doing to change the audio source on fly using RtmpCamera2?
That class hasn't that feature.

If you are not doing it. Let me know the way to reproduce the case

[floriangbh]

Thanks !
We never switch the audio source at runtime. It's a vanilla RtmpCamera2 session: mic → AAC → RTMP, with a software video encoder, that's it.
I opened my report here only because the symptom (audio ahead of video on RTMP) looked identical but I can move this to a new issue if you prefer, when I found how to reproduce it every time.