Re: [Bier] WGLC: draft-ietf-bier-multicast-http-response

Dirk Trossen <dirk.trossen@huawei.com> Thu, 23 December 2021 09:24 UTC

Return-Path: <dirk.trossen@huawei.com>
X-Original-To: bier@ietfa.amsl.com
Delivered-To: bier@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 265F33A1492; Thu, 23 Dec 2021 01:24:24 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.899
X-Spam-Level:
X-Spam-Status: No, score=-1.899 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Plb6qKjCZXgG; Thu, 23 Dec 2021 01:24:19 -0800 (PST)
Received: from frasgout.his.huawei.com (frasgout.his.huawei.com [185.176.79.56]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 62C6F3A1491; Thu, 23 Dec 2021 01:24:18 -0800 (PST)
Received: from fraeml742-chm.china.huawei.com (unknown [172.18.147.201]) by frasgout.his.huawei.com (SkyGuard) with ESMTP id 4JKPpF5qM9z67PGL; Thu, 23 Dec 2021 17:21:41 +0800 (CST)
Received: from lhreml708-chm.china.huawei.com (10.201.108.57) by fraeml742-chm.china.huawei.com (10.206.15.223) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256) id 15.1.2308.20; Thu, 23 Dec 2021 10:24:14 +0100
Received: from lhreml701-chm.china.huawei.com (10.201.108.50) by lhreml708-chm.china.huawei.com (10.201.108.57) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.2308.20; Thu, 23 Dec 2021 09:24:14 +0000
Received: from lhreml701-chm.china.huawei.com ([10.201.68.196]) by lhreml701-chm.china.huawei.com ([10.201.68.196]) with mapi id 15.01.2308.020; Thu, 23 Dec 2021 09:24:13 +0000
From: Dirk Trossen <dirk.trossen@huawei.com>
To: Gyan Mishra <hayabusagsm@gmail.com>, Toerless Eckert <tte@cs.fau.de>
CC: "bier-chairs@ietf.org" <bier-chairs@ietf.org>, BIER WG <bier@ietf.org>, Alvaro Retana <aretana.ietf@gmail.com>
Thread-Topic: [Bier] WGLC: draft-ietf-bier-multicast-http-response
Thread-Index: AQHX38B7OMpe0iYIiE2+Rqhl1pCTz6wqgh6AgAxNDwCABS1PAIADV16AgACiV2A=
Date: Thu, 23 Dec 2021 09:24:13 +0000
Message-ID: <e9c84ca1fc1e4be1bb82d0a29e8099f1@huawei.com>
References: <CABFReBoAV=joxZQkUT3HDMC4uFpRVgrABr5TeVhJC1s3vZXUow@mail.gmail.com> <CABFReBq1SW9UBG5b562w-NVadMRHBGcrnzKEJaX6DSUYc7_dgw@mail.gmail.com> <CAMMESsxMqKwYc7OHmFXC_ws_QhgUv9pY7ZNinhBOBTR6D=uO-g@mail.gmail.com> <YcDj0Lgz+d+YGk3K@faui48e.informatik.uni-erlangen.de> <CABNhwV2Aizy9XdYqzhEaML5qsHtYPN-tUOHtc6Ob+feYsoWoHg@mail.gmail.com>
In-Reply-To: <CABNhwV2Aizy9XdYqzhEaML5qsHtYPN-tUOHtc6Ob+feYsoWoHg@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [10.81.202.246]
Content-Type: multipart/alternative; boundary="_000_e9c84ca1fc1e4be1bb82d0a29e8099f1huaweicom_"
MIME-Version: 1.0
X-CFilter-Loop: Reflected
Archived-At: <https://mailarchive.ietf.org/arch/msg/bier/Tf-AhqKjL2KC3GwqUtIiMB9KGv8>
Subject: Re: [Bier] WGLC: draft-ietf-bier-multicast-http-response
X-BeenThere: bier@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "\"Bit Indexed Explicit Replication discussion list\"" <bier.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bier>, <mailto:bier-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bier/>
List-Post: <mailto:bier@ietf.org>
List-Help: <mailto:bier-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bier>, <mailto:bier-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 23 Dec 2021 09:24:25 -0000

Hi Gyan,

Many thanks for supporting this draft and its continuation as well as good to see your interest in collaborate on the continued draft.

See more inline.

Best,

Dirk

From: BIER [mailto:bier-bounces@ietf.org] On Behalf Of Gyan Mishra
Sent: 23 December 2021 00:15
To: Toerless Eckert <tte@cs.fau.de>
Cc: bier-chairs@ietf.org; BIER WG <bier@ietf.org>; Alvaro Retana <aretana.ietf@gmail.com>
Subject: Re: [Bier] WGLC: draft-ietf-bier-multicast-http-response


Dear BIER WG,

I support publication  of this informational draft which provides the framework and basis of how stateless BIER infrastructure can eliminate state and bandwidth usage with an aggregate http response when many client join a stream.  I would be happy to collaborate on the draft.
[DOT] Key here is that, unlike in IP multicast, there is no direct notion of a stream but a joint interest (expressed in the request for a specific chunk, for instance), expressed as individual unicast requests but replied to as a single multicast response (there may be the same interest albeit express some time later, resulting in a the different response albeit with likely same content). This is key since it makes the multicast nature more instantaneous, not following a longer-lived group-like semantic. Take an example of clients pulling video chunks. The lack of synchronization in the unicast requests for chunks leads inevitably (due to processing and packet latencies) to changing batches of requests that may be responded to with relevant content, although the content itself may be the same across several responses. The batches likely change in membership since clients may encounter different relevant latencies etc.

[DOT] This aspect is important in several technical aspects, such as timing used to create the multicast response (therefore combining a certain number of incoming requests), how to handle the congestion on multicast relations that possible differ in nature from one response to another (since possibly different clients are ‘combined’ into the individual responses). To me, those questions need dealing with although not in this draft IMO. What the draft provides is a base capability, as you also outline it, to allow for this aggregation and the resulting multicast delivery of aggregated responses.

I have some comments on the draft based on my experience working with multicast video delivery:

Is the waste in transmission bandwidth due to PIM Assert and double stream when multiple first hop routers are connected to the source?

Can you comment on the increase in signaling when there are a few subscribers?  I assume you are referring to IGMP join last hop router chatter.
[DOT] When comparing with IP multicast, its explicit group membership constitutes waste compared to the proposed mechanism since in the latter, the ‘group’ is defined through batching requests (for the same semantic content) at the server. The request for the content is here the ‘signaling’ to compare against. Of course, for static groups, you can argue that the joining happens once and the sender can simply stream, while the proposed mechanism signals for every chunk, so to speak. But the objectives are, of course, different since the underlying chunk retrieval aims at a different semantic, not limited to a live stream. If you want to move to such ‘individual viewing experiences’, the proposed solution still yields in multicast delivery due to the mere statistical synchronicity of chunk requests (particular for the short tail of a catalogue). Also, if you do live event but provision them over an HTTP-based platform, you are simply pushed into the unicast request/reply pattern – this draft proposes a mechanism that is based on the pattern in the forward direction but not the return one.

The goal of BIER is to eliminate state in the core for MVPN P-tree and C-Tree tree building technologies and not the last hop router as that is on the customer side signaling.

I read through this RFC related to IRTF ICN deployments scenario discussed related to 80 nodes test, however not much detail is provided related to the adaptive multicast streaming testing.

https://datatracker.ietf.org/doc/html/rfc8763
[DOT] Right, RFC8763 mentions this scenario but indeed lacks details. The test here was done as part of past efforts I led. The content was not live but stored content.

I read through this draft section 3.10 and it also does not provide details into how multicast adaptive video delivery works without having a gateway or server that does an ingest of the adaptive video to source the multicast distribution stream over UDP transport.

https://datatracker.ietf.org/doc/html/draft-ietf-bier-use-cases-12#section-3.10
[DOT] You seem to assume a live streaming type of scenario, sourced from an ingest point (over UDP) and relayed via this mechanism? But the draft outlines something more akin to an HLS/DASH model, i.e., clients individually request chunks and the server replies albeit aggregating several same content responses into multicast ones – see also below.

[DOT] the aspects below are indeed all valid but it’s this part where I would expect input and positions from the application (protocol) community since the draft is merely meant to provide a base delivery mechanism, not an application level solution. In my past work, we had some insights into the aspects you outline below but it’s not captured in this draft for the reasons already mentioned.

The key point I am missing is how adaptive video is natively possible over UDP transport.

Comments below are related to multicast and adaptive streaming.  The problem with multicast is it uses UDP transport and is a one way stream and not bidirectional so no feedback mechanism exists for adaptive rate limiting.  I believe QUIC with sideband TCP channel  is a possibility which I have investigated as an alternate transport to UDP.  PGM pragmatic multicast is another possibility.

https://datatracker.ietf.org/doc/html/rfc3208


My understanding and experience with HLS and DASH adaptive streaming which uses chunks and segments natively both video delivery methods only support Unicast video delivery.  Does not support native delivery via multicast.
[DOT] It is the HLS/DASH type of delivery mechanism. The lack of support for multicast here motivated the draft initially but still leaves questions open on issues like timing of aggregation, interaction with upper layer mechanism, how to handle congestion control on the return path (if at all)…
[DOT] as an example: DASH adaptive streaming mimics TCP in the sense of using latency information as an indication for network conditions, thereby lowering the stream quality when such latency occurs. If you look into the idea of aggregated chunk responses (as in the draft here), you may notice quickly that ‘delaying’ chunk responses is beneficial here since doing so increases your window to ‘catch’ more incoming client requests for the same content, thereby increasing the size of the response group. How long to delay? Well, could be something like 75% of the chunk length (just to give a number) since it gives you a good delay budget for returning the response and playing it out (with chunk length of 4 or more seconds). Problem is that if you do that, DASH adaptive stream will kick in and reduce your streaming quality…so there are interactions that need to be understood.

Most all modern web browsers Chrome, Firefox and Safari etc do not support NPAPI plug in and thus cannot play multicast natively.  That is a major industry wide problem.

There are standard solutions that exist that involve a UDP wrapper at the source multicast gateway that ingests unicast and distributes  multicast.

Ramp is one vendor that provides such a solution.
Ramp uses a source sender that ingests HLS or DASH unicast stream and packages in UDP envelope and at the host receiver endpoint Window or Mac it strips UDP encapsulation and plays out HLS or DASH video natively on loopback 127.0.0.1.

https://www.rampecdn.com/

Wowza is another vendor that does support multicast streaming but requires ingest as well of adaptive steam and then sources multicast distribution stream.

https://www.wowza.com/community/t/multicast-options-with-wowza-streaming-engine/44969


There has been development work done with WebRTC messaging that has the ability to provide a similar solution to natively play out multicast in a web browser.

https://www.w3.org/2020/09/webrtc-charter.html

https://datatracker.ietf.org/wg/rtcweb/documents/

This is the only link below I could find on DASH multicast.

https://res-www.zte.com.cn/mediares/magazine/publication/com_en/article/201803/PARK.pdf

Some history on DVB:

DVB is basically MPEG video delivery over an IP network.  There was a DVB IETF WG which concluded decades ago and since had been a standards forum for digital video delivery.

https://datatracker.ietf.org/wg/ipdvb/documents/


https://dvb.org/

This document was published in 2018 and talks about adaptive streaming over IP multicast.

This document talks about how ingest occurs if adaptive video source stream done by a multicast server which encapsulated and delivers the multicast over the network.

https://dvb.org/wp-content/uploads/2019/12/a176_adaptive_media_streaming_over_ip_multicast_2018-02-16_draft_bluebook.pdf

3GPP 5G to support MBS Multicast and Broadcast Services with release 17 adaptive video delivery MPEG DASH

https://www.smpte.org/webcast/an-introduction-to-3gpp-5g-multicast-and-broadcast-services?hsLang=en

https://dashif.org/docs/workshop-2019/12-Stockhammer%20Multicast%20December%202019.pdf

https://www.etsi.org/deliver/etsi_ts/103700_103799/103720/01.01.01_60/ts_103720v010101p.pdf

This solution to use BIER could apply to any network that utilizes adaptive video on FBB, MBB as well as an other network so  could have ubiquitous use cases.
[DOT] Note again, that the point here is that the solution is based on a request/response semantic with the former in unicast and the latter possibly in multicast (if more than one request to the  same content). Most of the solutions you outline above are joining an explicit group for a stream. Now you could, of course, model this via an HTTP/2 request and a stream of HTTP DATA frames. So this would make the forward request your explicit group membership signaling.

I can provide a further review of the draft and input to help advance the document.
[DOT] Great, thanks! Your email was already extremely helpful.

Many Thanks!

Gyan

On Mon, Dec 20, 2021 at 3:13 PM Toerless Eckert <tte@cs.fau.de<mailto:tte@cs.fau.de>> wrote:
Dear BIER WG-chairs

a) As authors, we are pinging other WG members to ask for more reviews within BIER-WG.

b) Picking up on Alvaros suggestion (thanks a lot), i would like to request
  on behalf of the authors a TSVART (Transport Area Review Team).

(we will ask for Application Area review later.. working ourselves up the stack).

Here is the suggested text for the datatracker form through which
you WG chairs could reques

Deadline:

  02-15-2022

Document revision:

  draft-ietf-bier-multicast-http-response-06

Requester's comments and instructions

  The authors are requesting early review of the document from transport area.

  The following is a motivational summary of the purpose of this document:

  Adaptive bitrate streaming (such as today DASH) for live-streaming or short-tail can
  use Multicast to improve network efficiency by eliminating duplicate transmission
  of the same data segments to multiple users requiring the same bitrate. This
  was shown and used in products as early as 200x (e.g.: Digital Fountain).
  These solutions never proliferated because of the intrinsic signaling problems
  of IP Multicast causing severe performance/scale/operational issues.

  These IP Multicast limitations can today be overcome with the novel BIER
  multicast mechanism. This document describes an application solution layer
  architecture in which BIER is used as the multicast mechanism for HTTP
  adaptive bitrate streaming including the use of BIER-TE for including
  path steering optimizations into the solution. This document is solely
  informational and does not intend to establish any standards for the IETF.

Thank you so much
    Toerless (for the authors)

On Fri, Dec 17, 2021 at 05:09:36AM -0800, Alvaro Retana wrote:
> Greg:
>
> Hi!
>
> It is important in light of rfc8789, which requires that all IETF documents
> reach consensus, to demonstrate that the WG cares and has reviewed,
> commented, etc.  Silence is not a good indicator of consensus. Thanks for
> following up on this!
>
> If there is interest in the WG, and given that this document deals with
> HTTP level multicast, please request an early review from both the ART and
> Transport areas review teams before sending it off for publication.
>
>
> A couple of quick comments for the authors.  Please use the rfc8174
> template (not rfc2119).  I am surprised that there are no Normative
> references (
> https://www.ietf.org/about/groups/iesg/statements/normative-informative-references/
> ).
>
> Thanks!
>
> Alvaro.
>
> On December 9, 2021 at 12:19:05 PM, Greg Shepherd (gjshep@gmail.com<mailto:gjshep@gmail.com>) wrote:
>
> Zero response for this WGLC, not even from the authors. Is this work still
> of interest to anyone in the WG?
>
> - Shep
>
> On Mon, Nov 22, 2021 at 8:45 AM Greg Shepherd <gjshep@gmail.com<mailto:gjshep@gmail.com>> wrote:
>
> > This email starts a 2 week WGLC timer for
> > draft-ietf-bier-multicast-http-response. Please read and review:
> >
> > https://datatracker.ietf.org/doc/draft-ietf-bier-multicast-http-response/
> >
> > We also need a doc Shepherd before we can progress this work. Can someone
> > please step up to help.
> >
> > Thanks,
> > - Shep
> > (Chairs)
> >
> _______________________________________________
> BIER mailing list
> BIER@ietf.org<mailto:BIER@ietf.org>
> https://www.ietf.org/mailman/listinfo/bier

> _______________________________________________
> BIER mailing list
> BIER@ietf.org<mailto:BIER@ietf.org>
> https://www.ietf.org/mailman/listinfo/bier


--
---
tte@cs.fau.de<mailto:tte@cs.fau.de>

_______________________________________________
BIER mailing list
BIER@ietf.org<mailto:BIER@ietf.org>
https://www.ietf.org/mailman/listinfo/bier
--

[http://ss7.vzw.com/is/image/VerizonWireless/vz-logo-email]<http://www.verizon.com/>

Gyan Mishra

Network Solutions Architect

Email gyan.s.mishra@verizon.com<mailto:gyan.s.mishra@verizon.com>

M 301 502-1347