NewPipeExtractor icon indicating copy to clipboard operation
NewPipeExtractor copied to clipboard

Improve handling of HLS/DASH/Progressive HTTP streaming data

Open litetex opened this issue 3 years ago • 4 comments

Followup issue of #810

Currently Stream is dependent on service specific stuff (like YT's itag). This is a big problem because sooner or later this class will blow up. It's already confusing enough and this PR makes it worse by adding stuff for the delivery/transmission-method (currently the Stream class can only contain progressive HTTP streaming data).

It's also currently hard to say which service uses which type of streaming and it's not possible to use different delivery methods for the same stream (not sure if this is possible/useful in the first place...).

Also when looking at the PR for NewPipe: We can't just create a specific playbackresolver/mediasource foreach stream type or service, that will be unmaintainable in the long run.

My ideas how to resolve these problems:

What should be fixed anyway

  1. isVideoOnly inside VideoStream should be removed. It's either a VideoStream or a AudioStream or a VideoAudioStream which contains the data of both.
  2. Move the YT specific stuff out of the stream classes. Example resolution could be a YouTubeVideoStream which extends VideoStream. However this may be solved (see below) in an even better way.
  3. I'm not sure how SubtitleStream is supposed to fit into the below constructs, there may be changes required. As far as I have seen subtitles can be delivered e.g. via DASH or in other ways.

Idea 1

Move everything that is delivery specific from Stream-like classes to a separate StreamDeliveryData-like classes: Example proposal: NPStreamingArch2 drawio

Idea 2

If - due to currently unknown reasons to me - it's not possible to do Idea 1 we could - instead of nesting (as done in Idea 1) StreamDeliveryData into Stream - simply create them side by side and derive the corresponding implementations from them. Example proposal: NPStreamingArch3 drawio

Overview how the delivery methods work: DeliveryMethods drawio

litetex avatar Jun 04 '22 15:06 litetex

If anyone is interested in the current progress / what I have done so far, take a look at: https://github.com/litetex/NewPipeExtractor/tree/delivery-methods-without-design-flaws Warning: It's currently not compiling 😆

litetex avatar Jun 10 '22 13:06 litetex

There is no automatic video quality option.

ghost avatar Dec 07 '22 22:12 ghost