Re: [AVTCORE] Multiplexing in RTP over QUIC

Bernard Aboba <bernard.aboba@gmail.com> Wed, 21 December 2022 18:56 UTC

Return-Path: <bernard.aboba@gmail.com>
X-Original-To: avt@ietfa.amsl.com
Delivered-To: avt@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 669CEC14F72F for <avt@ietfa.amsl.com>; Wed, 21 Dec 2022 10:56:44 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.093
X-Spam-Level:
X-Spam-Status: No, score=-2.093 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Gqbu5V8oqTUf for <avt@ietfa.amsl.com>; Wed, 21 Dec 2022 10:56:40 -0800 (PST)
Received: from mail-ej1-x630.google.com (mail-ej1-x630.google.com [IPv6:2a00:1450:4864:20::630]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 6E1DAC14F6E5 for <avt@ietf.org>; Wed, 21 Dec 2022 10:56:40 -0800 (PST)
Received: by mail-ej1-x630.google.com with SMTP id jo4so30079394ejb.7 for <avt@ietf.org>; Wed, 21 Dec 2022 10:56:40 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=KeeN5wLMK04Krt6ecYMLUHnVW63hYll1eJxaxp6htuM=; b=SAbjupoY+Wgw9UIcIJQnGB7ajhxJzvQgX736N1CKGR9xnTQI0wb2gw4rxM9w07+pKU Z2Ax/6JWw7m8x9zkaMTBH3U8+Xq9QzO3EPy2vP5w9JjAVcwMcYj2JzLrId0YkBd1b0lJ 0beEq6lCk15VFeXUfaS3g33ZazAuI9QcYCQEzyNVWNkBBAxtt2aul0zFG9JZ8VXBgfr3 CPRmpyFIsV5yhpNp67V03qg6C4c77JLOSV7itHOwH3Bq2SkXU5AK2FZP76CeN9HSdwUf JDkTfjstn1EGxfHeJRJ9fcWUHrF8YDkLCwIdgo+zr8wdkBODdkoPnZrsanuaH+uiLTIk qJdw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=KeeN5wLMK04Krt6ecYMLUHnVW63hYll1eJxaxp6htuM=; b=67FAtzmjbISvlbjG1PDcCVfVOoFvzNDYxvcBs+DMl6JJLgTbeG35+n+B10t5RGsJGb mbw6PkfhL+O5dnxuftWyaWU91Z+rZqZH4GVDEIaGt0h3HxVkiAduI+2NjDiXCXvRW/J8 bdHhbLHWmdWvQ7WCqXChM/YUVK29rPKdLyf7FHoHSx4NeRX8izNXJi5kQF0Wlzw2b4NS 1racn7jmDSDuljQ54fUyRQxvA2RIiGUH9U5vNPBP5ZUTeqmD9yrI9m7tjwKWQ4qnswyf bntM4/UZUCCJK9GVCGKqBBIzsDVNy3mAsP1cIPl8Urzhd7CKXQkX8oYGm3yw6Hu2kPU4 HSAA==
X-Gm-Message-State: AFqh2krVfU/WyEywibK3E1VzNgc+hnVAHIxEIgEHUEr14sLQRDkQQ5hQ PIhLinTu8AoJ7HuKr6L9w7o1xHjmj1irROnTbVI=
X-Google-Smtp-Source: AMrXdXs13N6wVAilhsHx5bgT73BG7QjUD8C7TGnokhFqQxfHUOAd1aKCHhhdVgJ0G/ssJRL9AeR3t2mLqHq4UuEiXGE=
X-Received: by 2002:a17:906:b084:b0:7c1:98e:b910 with SMTP id x4-20020a170906b08400b007c1098eb910mr222229ejy.81.1671648998732; Wed, 21 Dec 2022 10:56:38 -0800 (PST)
MIME-Version: 1.0
References: <df6592aa-58d8-4858-b10b-3468d867f49e@tum.de> <10ffea42-f2e6-588e-0e4f-bb9456899a91@tum.de> <CAD5OKxsZC=OZ6LHjoMcnQzKM0DxOO-HrPzmXQGfNFcMi49DBQw@mail.gmail.com> <572fab07-6deb-7cc9-da17-b5b273ea1c78@tum.de>
In-Reply-To: <572fab07-6deb-7cc9-da17-b5b273ea1c78@tum.de>
From: Bernard Aboba <bernard.aboba@gmail.com>
Date: Wed, 21 Dec 2022 13:56:27 -0500
Message-ID: <CAOW+2dvwRuz6oWXqNwESnidoXEd-pudN-W0-ntj4PXq8spxS+Q@mail.gmail.com>
To: Mathis Engelbart <mathis.engelbart@tum.de>
Cc: Roman Shpount <roman@telurix.com>, avt@ietf.org
Content-Type: multipart/alternative; boundary="000000000000c2364705f05b1c63"
Archived-At: <https://mailarchive.ietf.org/arch/msg/avt/b0u8ox8-zbaG_be6gNHqccyCn-8>
Subject: Re: [AVTCORE] Multiplexing in RTP over QUIC
X-BeenThere: avt@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Audio/Video Transport Core Maintenance <avt.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/avt>, <mailto:avt-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/avt/>
List-Post: <mailto:avt@ietf.org>
List-Help: <mailto:avt-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/avt>, <mailto:avt-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 21 Dec 2022 18:56:44 -0000

Mathis said:

"BUNDLE, it allows multiplexing multiple media
streams in a single RTP session, which is supported in RTP over QUIC
using BUNDLE and a single flow identifier. Multiple RTP sessions cannot
be multiplexed using BUNDLE and must also use different flow identifiers
in RTP over QUIC."

[BA] Indeed, RFC 8843 Section 1.2 says:
"All RTP-based bundled media associated with a given BUNDLE group belong to
a single RTP session [RFC3550
<https://www.rfc-editor.org/rfc/rfc8843#RFC3550>]."

However, this does raise the obvious question:  "Why is it necessary to be
able to multiplex multiple RTP sessions over a single QUIC connection"?

With respect to WebTransport, "pooling" is considered an optimization which
is not completely under the control of the application.





On Wed, Dec 21, 2022 at 12:48 PM Mathis Engelbart <mathis.engelbart@tum.de>
wrote:

> Hi Roman,
>
> As far as I understand BUNDLE, it allows multiplexing multiple media
> streams in a single RTP session, which is supported in RTP over QUIC
> using BUNDLE and a single flow identifier. Multiple RTP sessions cannot
> be multiplexed using BUNDLE and must also use different flow identifiers
> in RTP over QUIC.
> Using a single flow identifier for bundled RTP streams and separate flow
> identifiers for signaling and data channel replacements should work fine.
>
> Best,
> Mathis
>
> On 12/21/22 17:35, Roman Shpount wrote:
> > Mathis,
> >
> > Is RTP-bundle supported by RTP over QUIC? If it is supported, then more
> > than one RTP session should be able to share the same flow identifier.
> > My expectation would be to use one QUIC flow for bundled RTP sessions,
> > and separate QUIC flows for signaling and data channel replacements.
> >
> > Thank You,
> > _____________
> > Roman Shpount
> >
> >
> > On Wed, Dec 21, 2022 at 10:59 AM Mathis Engelbart
> > <mathis.engelbart@tum.de <mailto:mathis.engelbart@tum.de>> wrote:
> >
> >     Hi,
> >
> >     Thank you for your feedback regarding multiplexing in RTP over QUIC.
> >
> >     Following the feedback, we wrote some text to clarify how the
> approach
> >     using flow identifiers can support all of the requirements listed in
> my
> >     first mail. Flow identifiers will act as the multiplexing layer on
> top
> >     of QUIC that can be used equally for RTP/RTCP and non-RTP streams. We
> >     would appreciate it if you read the new text and provide feedback on
> >     this approach.
> >
> >     The new text can be found as a pull request in [1], or if you prefer
> to
> >     read the compiled document, you can find it in section 6 of [2].
> >
> >     [1] https://github.com/mengelbart/rtp-over-quic-draft/pull/54
> >     <https://github.com/mengelbart/rtp-over-quic-draft/pull/54>
> >     [2]
> >
> https://mengelbart.github.io/rtp-over-quic-draft/feat/flow-id-multiplexing/draft-ietf-avtcore-rtp-over-quic.html#section-6
> <
> https://mengelbart.github.io/rtp-over-quic-draft/feat/flow-id-multiplexing/draft-ietf-avtcore-rtp-over-quic.html#section-6
> >
> >
> >     Best,
> >     Mathis
> >
> >     On 12/16/22 18:04, Mathis Engelbart wrote:
> >      > Hello Everyone,
> >      >
> >      > In yesterday’s interim meeting, we decided to move the
> multiplexing
> >      > discussion for RTP over QUIC to the mailing list. To keep this
> mail
> >      > short, we decided to split the discussion into smaller pieces.
> >     First, we
> >      > would like to understand what types of multiplexing are required
> >     in RTP
> >      > over QUIC. We would like to use this thread to ask for your
> >     opinion on
> >      > which requirements the document should support.
> >      >
> >      > We see the following four requirements we could aim to support:
> >      >
> >      > 1. A single RTP session in one QUIC connection. Multiple RTP
> sessions
> >      > and RTCP will need separate QUIC connections.
> >      >
> >      > 2. Multiplex RTP and RTCP in one QUIC connection. (Note that this
> >      > implies that an implementer may still choose option 1.)
> >      >
> >      > 3. Multiplex many RTP sessions and RTCP in one QUIC connection.
> >      > Following RTP's original design, senders usually sent different
> media
> >      > streams in separate RTP sessions, which had to run over distinct
> >      > transport layer flows. The restriction was updated to allow
> multiple
> >      > media types in a single RTP session in RFC 8860. Thus, requiring
> >      > multiplexing of multiple RTP sessions may not be the most
> >     important, but
> >      > if RTP over QUIC can support multiplexing sessions, it would
> >     allow using
> >      > either multiple media types in a single session or multiple
> >     sessions for
> >      > different media types.
> >      >
> >      > 4. Multiplex RTP/RTCP and potentially other protocols in one QUIC
> >      > connection. Multiplexing non-RTP protocols could be used to do
> >     signaling
> >      > on the same connection or to enable use cases such as WebRTC data
> >     channels.
> >      >
> >      > Please let us know what you think about these options,
> >     specifically if
> >      > you think any of these options must or must not be included in
> >     RTP over
> >      > QUIC. Please also let us know if we made a mistake in the list
> >     above or
> >      > missed another requirement entirely.
> >      >
> >      > We hope it will be easier to discuss solutions to the multiplexing
> >      > problem when it becomes clear which kind of multiplexing we plan
> >     to support.
> >      >
> >      > Best,
> >      > Mathis
> >      >
> >      > _______________________________________________
> >      > Audio/Video Transport Core Maintenance
> >      > avt@ietf.org <mailto:avt@ietf.org>
> >      > https://www.ietf.org/mailman/listinfo/avt
> >     <https://www.ietf.org/mailman/listinfo/avt>
> >
> >     _______________________________________________
> >     Audio/Video Transport Core Maintenance
> >     avt@ietf.org <mailto:avt@ietf.org>
> >     https://www.ietf.org/mailman/listinfo/avt
> >     <https://www.ietf.org/mailman/listinfo/avt>
> >
>
> _______________________________________________
> Audio/Video Transport Core Maintenance
> avt@ietf.org
> https://www.ietf.org/mailman/listinfo/avt
>