Re: [AVTCORE] [MMUSIC] BUNDLE: a single stream with multiple MIDs?

Peter Thatcher <pthatcher@google.com> Wed, 13 July 2016 18:15 UTC

Return-Path: <pthatcher@google.com>
X-Original-To: avt@ietfa.amsl.com
Delivered-To: avt@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8540E12D1B7 for <avt@ietfa.amsl.com>; Wed, 13 Jul 2016 11:15:19 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.987
X-Spam-Level:
X-Spam-Status: No, score=-3.987 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, RP_MATCHES_RCVD=-1.287, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=google.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id gq2ubwjBXi-2 for <avt@ietfa.amsl.com>; Wed, 13 Jul 2016 11:15:16 -0700 (PDT)
Received: from mail-qt0-x22c.google.com (mail-qt0-x22c.google.com [IPv6:2607:f8b0:400d:c0d::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4D91312B01A for <avt@ietf.org>; Wed, 13 Jul 2016 11:15:16 -0700 (PDT)
Received: by mail-qt0-x22c.google.com with SMTP id j35so30330585qtj.2 for <avt@ietf.org>; Wed, 13 Jul 2016 11:15:16 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=9AYysBnuviTZkJ/9xn72f4vOZfMwR+8Ei070Jp807ws=; b=WEH/bNYbDb9WXDDN70qe+ETzrICC1s2Z4cLE+okgtfsdEKbC7lXpjDDJ3moR7vB7sb U2VwoHqhcVuKpAfiepY8yKhYqw/MAzq/Uvt5dQ0Gu0EdlEeLzxG0BqiFAmuswKAJdjap lHYXsymtoJ6ssSHiK0T6kfbmywZQ6ngsszWkhW4KqiZH6PYxyKow2nc6k0HGlId6iDP7 7ne0Grk+FZwVSxgO1bXngxVoC3OwfiTB/kkydSJP7+oa/4khs98xwWi4k1ioZYnFJpC9 LPWXG2CAlG4BkCTRQi45X1LUUjy9UL/dO0U3MWxnXUqDx6n5TqRXoWmiVc+OkuCPHeDQ fiXw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=9AYysBnuviTZkJ/9xn72f4vOZfMwR+8Ei070Jp807ws=; b=GCN9oeh9nyAJBSBEs1Urff6PLZUhiV09tyq71ws33aijImNcHgvZadKyFkm6O0Rm2g q18CApoVkuEwW/tCCxC887MnI64Tl1EndzLlM/l757YGUFLpqLiJ5Mha6ss9XPnC+Z6a EI9zQInZrI7it764PB19IsWb2ckuOaN8ldQtgKbouxffw2DleB7+EEaN0F/b/I4lK5Mi zDUyZehLfHETyR6Plz7nP9cNmVK8YbQ50hc2bBq+rtG3JqtivPbkuU1MHwqb93Y9w36i eF6WSSr9NpaaCg0uzlAWumhaH4tKXY7ZbzIPBB5hF15C1HRiJIT6Uvl68e3EE6PFu2HC XYWw==
X-Gm-Message-State: ALyK8tJfhHMdg1hP9oT8LWjBg5npNtH5sM4akU4TlVe3oJPQOVfbB0EY1POwwjW18G7teXDDgv1UeiBTv4S+30mE
X-Received: by 10.237.36.38 with SMTP id r35mr14351955qtc.3.1468433715288; Wed, 13 Jul 2016 11:15:15 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.55.46.4 with HTTP; Wed, 13 Jul 2016 11:14:35 -0700 (PDT)
In-Reply-To: <3BECBA70-B73C-4E87-8A69-55AAA406A8B9@vidyo.com>
References: <6C642BD1-679B-4CCA-9148-DD4A7ACB48A4@vidyo.com> <CAMRcRGRMp-tehSjwaXh4rzwedsHHjXaxhJ=pd0-9XiSCiLG_2Q@mail.gmail.com> <7E00EB16-72FE-4A1E-A268-66674361FB2B@vidyo.com> <CAJrXDUFpkVegw_hb4hFVP0Bme=6avVC8J3hucuhHDbvOamn-2w@mail.gmail.com> <3BECBA70-B73C-4E87-8A69-55AAA406A8B9@vidyo.com>
From: Peter Thatcher <pthatcher@google.com>
Date: Wed, 13 Jul 2016 11:14:35 -0700
Message-ID: <CAJrXDUETxAbt4pP2ShAKuYSaDdRk5u_c1antpVATE+NinAaiVA@mail.gmail.com>
To: Jonathan Lennox <jonathan@vidyo.com>
Content-Type: multipart/alternative; boundary="001a113d3aacfa2b3a0537885d92"
Archived-At: <https://mailarchive.ietf.org/arch/msg/avt/jvPJok6B59E0j4jKrZWyEYEC9tM>
Cc: IETF AVTCore WG <avt@ietf.org>, mmusic <mmusic@ietf.org>
Subject: Re: [AVTCORE] [MMUSIC] BUNDLE: a single stream with multiple MIDs?
X-BeenThere: avt@ietf.org
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: Audio/Video Transport Core Maintenance <avt.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/avt>, <mailto:avt-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/avt/>
List-Post: <mailto:avt@ietf.org>
List-Help: <mailto:avt-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/avt>, <mailto:avt-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 13 Jul 2016 18:15:20 -0000

On Tue, Jul 12, 2016 at 9:42 AM, Jonathan Lennox <jonathan@vidyo.com> wrote:

>
> On Jul 11, 2016, at 1:42 PM, Peter Thatcher <pthatcher@google.com<mailto:
> pthatcher@google.com>> wrote:
>
> Basically what your're asking for is header extension that says "Not only
> am I MID X, but I'm also, temporarily, MID Y"?   Why not just have a
> second, separate, header extension for "I'm also temporarily MID Y"?   Then
> the existing semantics of BUNDLE and MID (and RIDs, which are scoped to
> MIDs) need not change, but you get the information you need (I think).
>
> The thing is, all MID values are, conceptually, temporary — they can
> change at any time.  So is it really meaningful to distinguish short-term
> temporary from long-term temporary?  Where do you draw the line?
>

​That doesn't match my mental model of MIDs.   I've always thought of an
RTP stream as being bound to a particular MID, not able to change between
various MIDs.  I might be wrong, but it seems like there are weird edge
cases with switching MIDs, such as how RIDs play into it (since they are
scoped to MIDs).  Another is the demux algorithm in WebRTC/ORTC which
"locks on" to SSRCs and only looks at MIDs if the SSRCs are unknown (the
demux algorithm certainly does not take into account demuxing a packet into
multiple RtpReceivers).

So it sounds like you are asking for two things:
1.  Be able to switch MIDs
2.  Be able to have > 1 MIDs.

And both of those blow up my mental model of MIDs and could cause problems
with other things.


I think it would be less risky to define a separate header extension for
"multiplicity of changable MIDs" rather than re-using the existing header
extension, when the semantics seems so much different (than my mental
model, at least).



>
> On Fri, Jul 8, 2016 at 8:51 AM, Jonathan Lennox <jonathan@vidyo.com
> <mailto:jonathan@vidyo.com>> wrote:
> The intention of my proposal is that these could indeed be (temporarily)
> the same RTP media source, even though they’re two separate m-lines.
>
> On Jul 7, 2016, at 8:52 PM, Suhas Nandakumar <suhasietf@gmail.com<mailto:
> suhasietf@gmail.com>> wrote:
>
> Hi Jonathan
>
>   Clarification question :
>
>    if we have 2 m=lines
>
> m = ...
> a=mid1
> <manager>
>
> m=...
> a=mid2
> <loudest speaker>
>
> does these 2 correspond to same media source ? It felt so from the
> duplicate design you mentioned but wanted to confirm
>
> Thanks
> Suhas
>
>
>
> On Fri, Jul 8, 2016 at 4:06 AM, Jonathan Lennox <jonathan@vidyo.com
> <mailto:jonathan@vidyo.com>> wrote:
> Hi, all —
>
> (This was an issue I raised in AVTCORE in Buenos Aires — I promised to
> send e-mail to the list but hadn’t remembered to get around to it until
> now.)
>
> When finishing up the CLUE RTP mapping draft, I realized that one of
> CLUE’s RTP requirements didn’t actually end up getting satisfied by BUNDLE
> (which is the solution CLUE converged on).  This isn’t a CLUE-specific
> issue, so I’m raising it here.
>
> The issue is whether we want to support a use case, in BUNDLE, where a
> single RTP stream corresponds to more than media description (and thus has
> more than one MID value)?
>
> The use case is where one m-line has a semantic of “always view this
> person” (my boss, say, or my customer); and another m-line has a semantic
> of “the current loudest speaker”. (In CLUE, these would be a single content
> capture in the former case, and a switched capture for the latter.)
> Whenever the boss *is* the current loudest speaker, the same content would
> be sent for both m-lines.
>
> A naive implementation would simply duplicate all the packets for the two
> m-lines, with different MID values, but this has two problems.  First off
> all, it obviously wastes bandwidth.  Potentially more seriously, it
> precludes any RTP middlebox topology which doesn’t rewrite SSRC values,
> since the same content (arriving with a single SSRC value at the middlebox)
> would need to be sent with two different SSRC values down from the
> middlebox.  If PERC goes with its current consensus of no SSRC rewriting,
> this will particularly be a problem for PERC.
>
> I certainly don’t think this is something that should block BUNDLE’s
> completion, but I think it could be a pretty easy extension.
>
> (My initial design proposal was to allow multiple SDES values of the same
> type, and multiple SDES header extensions items of the same type, to be
> sent simultaneously in RTP — protocol-syntactically this is trivial, you’d
> just need to negotiate that you support it.  But I’m not wedded to this
> solution.)
>
> What do people think — is this worth working on?  Is there interest in
> discussing it in Berlin, and if so, in what venue?
> _______________________________________________
> mmusic mailing list
> mmusic@ietf.org<mailto:mmusic@ietf.org>
> https://www.ietf.org/mailman/listinfo/mmusic
>
>
>
> _______________________________________________
> mmusic mailing list
> mmusic@ietf.org<mailto:mmusic@ietf.org>
> https://www.ietf.org/mailman/listinfo/mmusic
>
>
>
>