Synchronizing multiple live streams with dynamic bitrate

[derekw0311]

Hi,

I'm working on building a custom Exoplayer that allows user to stream multiple live video in synchronize matter. I used the solution in #2855 which works great if all streams has the same bitrate; however if the bitrate start to fluctuate (some of the stream has dynamic bitrate), all streams will start to buffer frequent and becomes unwatchable.

Is there a flag I can set to have player to render frames as fast as they can without buffering?
My assumption is, as long as all streams start at the same time; the fps should stays the same across all streams.

Thanks in advance!

[AquilesCanta]

You mean you'd like the playback speed to depend on the available buffer?

This is not a supported feature, but I suppose you could try implementing this yourself.

My assumption is, as long as all streams start at the same time; the fps should stays the same across all streams.

The fps don't depend on the player or the start time, it depends on the stream you are playing. On the other hand, if you mean playback speed, synchronization should not be affected by an altered playback speed (speed is a player attribute, not a renderer attribute). Does this answer your question?

[derekw0311]

I'm not sure about changing playback speed would help me with this. The issue I'm trying to resolve is that the player have difficulty synchronizing two stream that have different bitrate using mergingMediaSource. (The bitrate isn't constant, it varies depends on the content of the video)

Thank you for the quick response.

[AquilesCanta]

Sounds like a bug to me, but in order to look into it we will need the information requested in the issue template

[derekw0311]

• Description
  Player having difficulty streaming multiple live streams (with different bitrate) simultaneously; the player tent to buffers frequent when there is a spike with the bitrate and eventually stuck at the buffering state.

• Reproduction steps
  Implement the solution proposed by @ojw28 in Synchronizing Multiple ExoPlayers #2855 and try to stream 3 or 4 live videos with different bitrate using MergingMediaSource.

1. Build a custom RenderersFactory that builds multiple video renderers.
2. Create multiple ExtractorMediaSources and combine them use MergingMediaSource
3. Build a custom TrackSelector to select correct tracks for each of the video renderers
4. Map textureSurface to the corresponding renderers using 'blockingSendMessages'

• Link to test content
  Unfortunately I could not provide the video links

• Version of Exoplayer: 2.7.1

Please let me know if you need more info, thanks

[AquilesCanta]

Does this reproduce locally?

Have you ruled out the possibilty of bandwidth just not being enough to handle that many videos?

eventually stuck at the buffering state

Stuck for how long? Endlessly or for a brief period of time?

Please let me know if you need more info, thanks

Please provide content that reproduces the issue, you can do this at dev.exoplayer@gmail.com if you'd like it to remain undisclosed. It is not convenient for us to spend time searching for content that reproduces the issue, without the guarantee of it having the correct characteristics.

[derekw0311]

Does this reproduce locally?
Have you ruled out the possibility of bandwidth just not being enough to handle that many videos?

I tried streaming 4 identical live streams and it works pretty well so the bandwidth should not be the problem. It tend to happen when streaming multiple live stream with different source.

Stuck for how long? Endlessly or for a brief period of time?
The playback stuck indefinitely but in some cases it would resume but increase the delay from real time. (Since it's a live stream, we try to minimize the delay)

Do you think it has something to do with the allocator size that cause the infinite buffering?

I'm working on providing content for this, will email to you as soon as possible.

[derekw0311]

@AquilesCanta I have sent the content & sample project to dev.exoplayer@gmail.com

Thanks

[derekw0311]

@AquilesCanta, just wanted to follow up with you on this issue, thanks!

[AquilesCanta]

I will do my best to look at this late next week. There are a few things I need to do with some urgency, first. Thanks for your patience!

[derekw0311]

Not a problem, thanks for looking into this.

[derekw0311]

Hi @AquilesCanta, I just sent another email to dev.exoplayer@gmail.com with an updated project and streaming url; however the session with the url might expire, please let me know if it is and I will provide a new one.

Thanks