Re: [payload] Adam Roach's Discuss on draft-ietf-payload-rtp-ancillary-10: (with DISCUSS and COMMENT)

Colin Perkins <csp@csperkins.org> Tue, 03 October 2017 18:46 UTC

Return-Path: <csp@csperkins.org>
X-Original-To: payload@ietfa.amsl.com
Delivered-To: payload@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2E5A613302A; Tue, 3 Oct 2017 11:46:42 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.2
X-Spam-Level:
X-Spam-Status: No, score=-4.2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id VO_sePVcGn2k; Tue, 3 Oct 2017 11:46:39 -0700 (PDT)
Received: from haggis.mythic-beasts.com (haggis.mythic-beasts.com [IPv6:2a00:1098:0:86:1000:0:2:1]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id AD6BC133090; Tue, 3 Oct 2017 11:46:38 -0700 (PDT)
Received: from [81.187.2.149] (port=38131 helo=[192.168.0.71]) by haggis.mythic-beasts.com with esmtpsa (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.89) (envelope-from <csp@csperkins.org>) id 1dzSD6-0004bw-4V; Tue, 03 Oct 2017 19:46:31 +0100
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\))
From: Colin Perkins <csp@csperkins.org>
In-Reply-To: <6E58094ECC8D8344914996DAD28F1CCD810BCC@DGGEMM506-MBX.china.huawei.com>
Date: Tue, 03 Oct 2017 19:46:22 +0100
Cc: Thomas Edwards <Thomas.Edwards@fox.com>, Adam Roach <adam@nostrum.com>, "payload-chairs@ietf.org" <payload-chairs@ietf.org>, "draft-ietf-payload-rtp-ancillary@ietf.org" <draft-ietf-payload-rtp-ancillary@ietf.org>, "payload@ietf.org" <payload@ietf.org>, "acbegen@gmail.com" <acbegen@gmail.com>
Content-Transfer-Encoding: quoted-printable
Message-Id: <C8401812-5599-4257-BC34-58679B1ECE4A@csperkins.org>
References: <150285025423.12514.106587665039751833.idtracker@ietfa.amsl.com> <3B259563-1075-4C41-A832-D7633C39173B@foxeg.com> <61440eb5-32c3-3696-be38-8dc7c4eaf72f@nostrum.com> <863974D7-E112-4794-AD4D-C39C99BD40C9@foxeg.com> <b601dc36-8aee-75db-7159-6d4d5b6e684e@nostrum.com> <0C6F1364-DAB5-4AA3-8450-84771EF0ED1E@foxeg.com> <6E58094ECC8D8344914996DAD28F1CCD80FC21@DGGEMM506-MBX.china.huawei.com> <CCDB366F-E713-4D03-B14E-B973BA925A55@foxeg.com> <6E58094ECC8D8344914996DAD28F1CCD810751@DGGEMM506-MBX.china.huawei.com> <4D3BF24A-2927-4F9A-A435-7DA6A9F777D7@csperkins.org> <6E58094ECC8D8344914996DAD28F1CCD810BCC@DGGEMM506-MBX.china.huawei.com>
To: Roni Even <roni.even@huawei.com>
X-Mailer: Apple Mail (2.3273)
X-BlackCat-Spam-Score: 4
Archived-At: <https://mailarchive.ietf.org/arch/msg/payload/YESIfOri0CqpW5sOhjg0NMx2g30>
Subject: Re: [payload] Adam Roach's Discuss on draft-ietf-payload-rtp-ancillary-10: (with DISCUSS and COMMENT)
X-BeenThere: payload@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Audio/Video Transport Payloads working group discussion list <payload.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/payload>, <mailto:payload-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/payload/>
List-Post: <mailto:payload@ietf.org>
List-Help: <mailto:payload-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/payload>, <mailto:payload-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 03 Oct 2017 18:46:42 -0000

No, I think it’s orthogonal to grouping. If the CNAME was sufficient, then we wouldn’t need the LS grouping method.

Colin



> On 3 Oct 2017, at 19:00, Roni Even <roni.even@huawei.com> wrote:
> 
> Hi Colin,
> So maybe the right direction is that there is no need for grouping at all in this case and  just use the same CNAME in RTCP.
> Roni
> 
>> -----Original Message-----
>> From: Colin Perkins [mailto:csp@csperkins.org]
>> Sent: יום ג 03 אוקטובר 2017 19:59
>> To: Roni Even
>> Cc: Thomas Edwards; Adam Roach; payload-chairs@ietf.org; draft-ietf-
>> payload-rtp-ancillary@ietf.org; payload@ietf.org; acbegen@gmail.com
>> Subject: Re: [payload] Adam Roach's Discuss on draft-ietf-payload-rtp-
>> ancillary-10: (with DISCUSS and COMMENT)
>> 
>> Roni,
>> 
>> The requirement for RTP, in general, is that streams that are to be
>> synchronised MUST have the same RTCP CNAME. It might be appropriate to
>> remind readers of that, but it’s independent on the grouping framework.
>> 
>> How that CNAME is chosen doesn’t matter for the purposes of
>> synchronisation, provided the SSRCs that are to be synchronised use the
>> same CNAME. The suggestions in RFC 7022 are appropriate, but there’s no
>> reason to mandate them, or require a particular one of those suggestions be
>> used.
>> 
>> Colin
>> 
>> 
>> 
>>> On 1 Oct 2017, at 12:25, Roni Even <roni.even@huawei.com> wrote:
>>> 
>>> Hi Thomas,
>>> I think that you should also have in the grouping section a
>>> recommendation to use the same persistent CNAME (maybe short term?)
>>> for the ANC and video stream see RFC 7022 this is required in RTCP if
>>> these RTP streams need to be synchronized (RFC3550) Roni
>>> 
>>> 
>>>> -----Original Message-----
>>>> From: Thomas Edwards [mailto:Thomas.Edwards@fox.com]
>>>> Sent: יום ד 27 ספטמבר 2017 18:47
>>>> To: Roni Even; Adam Roach; The IESG
>>>> Cc: payload-chairs@ietf.org;
>>>> draft-ietf-payload-rtp-ancillary@ietf.org;
>>>> payload@ietf.org; acbegen@gmail.com
>>>> Subject: Re: Adam Roach's Discuss on draft-ietf-payload-rtp-ancillary-10:
>>>> (with DISCUSS and COMMENT)
>>>> 
>>>> Roni, thanks for the feedback on LS!
>>>> 
>>>> I’m still not sure if it is appropriate to include the hierarchical
>>>> grouping SDP example in draft-ietf-payload-rtp-ancillary.  I suspect it could
>> be confusing.
>>>> 
>>>> However, I will note that the Alliance for IP Media Solutions
>>>> (http://aimsalliance.org) Technical Committee is considering work on
>>>> documenting different SDP groupings for live television production
>>>> scenarios, so it is possible that a future I-D will be submitted that
>>>> could include a range of SDP applications in this area, perhaps
>>>> including documentation of Adam Roach’s scenario.
>>>> 
>>>> I can go ahead and upload a draft-ietf-payload-rtp-ancillary-11 based
>>>> on the IESG feedback.
>>>> 
>>>> -Thomas
>>>> 
>>>> --
>>>> Thomas Edwards
>>>> FOX Networks Engineering & Operations VP Engineering & Development
>>>> thomas.edwards@fox.com
>>>> +1-310-369-6696
>>>> 10201 W Pico Blvd
>>>> Los Angeles, CA 90035
>>>> 
>>>> 
>>>> On 9/27/17, 4:07 AM, "Roni Even" <roni.even@huawei.com> wrote:
>>>> 
>>>>   Hi,
>>>> 
>>>>   I agree that LS is better fit for ANC
>>>> 
>>>> 
>>>> 
>>>>   As for Adam's example it is allowed by RFC5888 to specify
>>>> 
>>>>           a=group:LS V1 V2 M1 M2
>>>> 
>>>>           a=group:LS V1 M1
>>>> 
>>>>           a=group:LS V2  M2
>>>> 
>>>>   this is similar to RFC5956  which replaced RFC4756
>>>> 
>>>> 
>>>> 
>>>>   this is not a clean way but  is allowed otherwise there is a need
>>>> to specify some SDP attribute for specifying dependencies.
>>>> 
>>>> 
>>>> 
>>>>   Roni Even
>>>> 
>>>> 
>>>> 
>>>> 
>>>> 
>>>>> -----Original Message-----
>>>> 
>>>>> From: Thomas Edwards [mailto:Thomas.Edwards@fox.com]
>>>> 
>>>>> Sent: יום ד 27 ספטמבר 2017 04:13
>>>> 
>>>>> To: Adam Roach; The IESG
>>>> 
>>>>> Cc: payload-chairs@ietf.org;
>>>>> draft-ietf-payload-rtp-ancillary@ietf.org;
>>>> 
>>>>> payload@ietf.org; acbegen@gmail.com
>>>> 
>>>>> Subject: Re: Adam Roach's Discuss on draft-ietf-payload-rtp-ancillary-10:
>>>> 
>>>>> (with DISCUSS and COMMENT)
>>>> 
>>>>> 
>>>> 
>>>>> Regarding draft-ietf-payload-rtp-ancillary-10, on further thought I
>>>>> believe
>>>> 
>>>>> that FID grouping is NOT appropriate for Section 4.1 “Grouping ANC
>>>> Streams
>>>> 
>>>>> with other Media Streams”.
>>>> 
>>>>> 
>>>> 
>>>>> RFC 5888 Section 8.4. (“FID Semantics”) states:
>>>> 
>>>>> 
>>>> 
>>>>>      “It is assumed that the application uses only one codec at a
>>>>> time to
>>>> 
>>>>> encode the media produced.  This codec MAY change dynamically during
>>>> the
>>>> 
>>>>> session, but at any particular moment, only one codec is in use.”
>>>> 
>>>>> 
>>>> 
>>>>> RFC 5888 Section 8.5.1 states:
>>>> 
>>>>> 
>>>> 
>>>>> 	“FID semantics are useful when the application only uses one codec
>>>> 
>>>>> at a time.  An application that encodes the same media using
>>>>> different
>>>> 
>>>>> codecs simultaneously MUST NOT use FID to group those media lines.”
>>>> 
>>>>> 
>>>> 
>>>>> When we have one video stream and one ancillary data stream, senders
>>>> are
>>>> 
>>>>> not switching between codecs.  FID really sounds to me like a
>>>>> situation
>>>> where
>>>> 
>>>>> you have one media stream, but senders could send that stream one of
>>>> 
>>>>> multiple codecs, but not at the same time.
>>>> 
>>>>> 
>>>> 
>>>>> Compare with RFC 5888 Section 7:
>>>> 
>>>>> 
>>>> 
>>>>> 	“Note that LS semantics apply not only to a video stream that has
>>>>> to
>>>> 
>>>>> be synchronized with an audio stream; the playout of two streams of
>>>>> the
>>>> 
>>>>> same type can be synchronized as well.”
>>>> 
>>>>> 
>>>> 
>>>>> Synchronized presentation to the user of an audio, video, and of
>>>>> course
>>>> 
>>>>> ancillary data flow is generally what we need for production
>>>>> television
>>>> 
>>>>> workflows.
>>>> 
>>>>> 
>>>> 
>>>>> draft-ietf-payload-rtp-ancillary-10 Section 4.1 has the example:
>>>> 
>>>>> 
>>>> 
>>>>>       v=0
>>>> 
>>>>>       o=Al 123456 11 IN IP4
>>>> https://urldefense.proofpoint.com/v2/url?u=http-
>>>> 
>> 3A__host.example.com&d=DwIGaQ&c=uw6TLu4hwhHdiGJOgwcWD4AjKQx
>>>> 6zvFcGEsbfiY9-
>>>> 
>> EI&r=lekNOOM5noV61zrPH3rwPyhtNnLLWoLEHgd0quQxly8&m=mmtyLXtya
>>>> 
>> WHEg3JYcq3xSVLXzRqkIVgWAJDgqyIgreU&s=UuOwClXoGCvGP2qksiV3h85H
>>>> NgQRo_Z7b0HgU2qVwzQ&e=
>>>> 
>>>>>       s=Professional Networked Media Test
>>>> 
>>>>>       i=A test of synchronized video and ANC data
>>>> 
>>>>>       t=0 0
>>>> 
>>>>>       a=group:LS V1 M1
>>>> 
>>>>>       m=video 50000 RTP/AVP 96
>>>> 
>>>>>       c=IN IP4 https://urldefense.proofpoint.com/v2/url?u=http-
>>>> 
>> 3A__233.252.0.1_255&d=DwIGaQ&c=uw6TLu4hwhHdiGJOgwcWD4AjKQx6zv
>>>> FcGEsbfiY9-
>>>> 
>> EI&r=lekNOOM5noV61zrPH3rwPyhtNnLLWoLEHgd0quQxly8&m=mmtyLXtya
>>>> 
>> WHEg3JYcq3xSVLXzRqkIVgWAJDgqyIgreU&s=mDjccdFR8MWnfQcP_xiMhb-
>>>> bh-Wef_2tKhRDyRilYUM&e=
>>>> 
>>>>>       a=rtpmap:96 raw/90000
>>>> 
>>>>>       a=fmtp:96 sampling=YCbCr-4:2:2; width=1280; height=720;
>>>>> depth=10
>>>> 
>>>>>       a=mid:V1
>>>> 
>>>>>       m=video 50010 RTP/AVP 97
>>>> 
>>>>>       c=IN IP4 https://urldefense.proofpoint.com/v2/url?u=http-
>>>> 
>> 3A__233.252.0.2_255&d=DwIGaQ&c=uw6TLu4hwhHdiGJOgwcWD4AjKQx6zv
>>>> FcGEsbfiY9-
>>>> 
>> EI&r=lekNOOM5noV61zrPH3rwPyhtNnLLWoLEHgd0quQxly8&m=mmtyLXtya
>>>> 
>> WHEg3JYcq3xSVLXzRqkIVgWAJDgqyIgreU&s=7e66ewQVAuL1YUq2FzASyEJp
>>>> qw7Tc5p8fO8lZbZ4tUo&e=
>>>> 
>>>>>       a=rtpmap:97 smpte291/90000
>>>> 
>>>>>       a=fmtp:97 DID_SDID={0x61,0x02};DID_SDID={0x41,0x05}
>>>> 
>>>>>       a=mid:M1
>>>> 
>>>>> 
>>>> 
>>>>> As some have pointed out, RTP timestamps and RTCP provide inherent
>>>> 
>>>>> synchronization between “m” lines, but of course as RFC 5888 Section
>>>>> 1
>>>> says
>>>> 
>>>>> without grouping: “When a session description contains more than one
>>>> "m"
>>>> 
>>>>> line, SDP does not provide any means to express a particular
>>>>> relationship
>>>> 
>>>>> between two or more of them.”  “LS” grouping makes it pretty clear
>>>>> that
>>>> 
>>>>> these streams are intended for synchronized presentation.
>>>> 
>>>>> 
>>>> 
>>>>> An alternative to “LS” grouping is to drop all grouping in the
>>>>> example, and
>>>> be
>>>> 
>>>>> unclear about what these “m” lines are doing together in the same file:
>>>> 
>>>>> 
>>>> 
>>>>>       v=0
>>>> 
>>>>>       o=Al 123456 11 IN IP4
>>>> https://urldefense.proofpoint.com/v2/url?u=http-
>>>> 
>> 3A__host.example.com&d=DwIGaQ&c=uw6TLu4hwhHdiGJOgwcWD4AjKQx
>>>> 6zvFcGEsbfiY9-
>>>> 
>> EI&r=lekNOOM5noV61zrPH3rwPyhtNnLLWoLEHgd0quQxly8&m=mmtyLXtya
>>>> 
>> WHEg3JYcq3xSVLXzRqkIVgWAJDgqyIgreU&s=UuOwClXoGCvGP2qksiV3h85H
>>>> NgQRo_Z7b0HgU2qVwzQ&e=
>>>> 
>>>>>       s=Professional Networked Media Test
>>>> 
>>>>>       i=A test of synchronized video and ANC data
>>>> 
>>>>>       t=0 0
>>>> 
>>>>>       m=video 50000 RTP/AVP 96
>>>> 
>>>>>       c=IN IP4 https://urldefense.proofpoint.com/v2/url?u=http-
>>>> 
>> 3A__233.252.0.1_255&d=DwIGaQ&c=uw6TLu4hwhHdiGJOgwcWD4AjKQx6zv
>>>> FcGEsbfiY9-
>>>> 
>> EI&r=lekNOOM5noV61zrPH3rwPyhtNnLLWoLEHgd0quQxly8&m=mmtyLXtya
>>>> 
>> WHEg3JYcq3xSVLXzRqkIVgWAJDgqyIgreU&s=mDjccdFR8MWnfQcP_xiMhb-
>>>> bh-Wef_2tKhRDyRilYUM&e=
>>>> 
>>>>>       a=rtpmap:96 raw/90000
>>>> 
>>>>>       a=fmtp:96 sampling=YCbCr-4:2:2; width=1280; height=720;
>>>>> depth=10
>>>> 
>>>>>       m=video 50010 RTP/AVP 97
>>>> 
>>>>>       c=IN IP4 https://urldefense.proofpoint.com/v2/url?u=http-
>>>> 
>> 3A__233.252.0.2_255&d=DwIGaQ&c=uw6TLu4hwhHdiGJOgwcWD4AjKQx6zv
>>>> FcGEsbfiY9-
>>>> 
>> EI&r=lekNOOM5noV61zrPH3rwPyhtNnLLWoLEHgd0quQxly8&m=mmtyLXtya
>>>> 
>> WHEg3JYcq3xSVLXzRqkIVgWAJDgqyIgreU&s=7e66ewQVAuL1YUq2FzASyEJp
>>>> qw7Tc5p8fO8lZbZ4tUo&e=
>>>> 
>>>>>       a=rtpmap:97 smpte291/90000
>>>> 
>>>>>       a=fmtp:97 DID_SDID={0x61,0x02};DID_SDID={0x41,0x05}
>>>> 
>>>>> 
>>>> 
>>>>> But I’m still more comfortable with keeping the “LS” grouping in the
>>>> example
>>>> 
>>>>> unless there are objections.
>>>> 
>>>>> 
>>>> 
>>>>> This brings us to the main point of Adam Roach’s DISCUSS item, how
>>>>> do
>>>> you
>>>> 
>>>>> provide multi-level hierarchical grouping in SDP.  Imagine a group
>>>>> of (a
>>>> group
>>>> 
>>>>> of video and ancillary data) and (a group of video and ancillary data).
>>>> There
>>>> 
>>>>> actually is a case of this in production television, the multiviewer
>>>>> (e.g. see
>>>> 
>>>>> https://urldefense.proofpoint.com/v2/url?u=https-
>>>> 
>> 3A__www.blackmagicdesign.com_products_multiview&d=DwIGaQ&c=uw6T
>>>> Lu4hwhHdiGJOgwcWD4AjKQx6zvFcGEsbfiY9-
>>>> 
>> EI&r=lekNOOM5noV61zrPH3rwPyhtNnLLWoLEHgd0quQxly8&m=mmtyLXtya
>>>> 
>> WHEg3JYcq3xSVLXzRqkIVgWAJDgqyIgreU&s=IdKozSZWbohK0Fg_CvZcmeNO
>>>> 6JxjGZvwknrCRLaQVX8&e=).
>>>> 
>>>>> 
>>>> 
>>>>> Unfortunately, I really can’t find any SDP mechanism to describe
>>>>> multi-
>>>> level
>>>> 
>>>>> hierarchy.  RFC 4796 “The Session Description Protocol (SDP) Content
>>>> 
>>>>> Attribute” is about the best I can find, where synchronized
>>>>> multimedia
>>>> (such
>>>> 
>>>>> as “slides”, “speaker”, “main”, etc.) is presented.  But this is a
>>>>> very limited
>>>> set
>>>> 
>>>>> of values.  RFC 5583 “Signaling Media Decoding Dependency in the
>>>> Session
>>>> 
>>>>> Description Protocol (SDP)” has various dependencies of streams, but
>>>> this is
>>>> 
>>>>> for layered or multiple descriptive media coding.  Neither of these
>>>>> seems
>>>> 
>>>>> appropriate.
>>>> 
>>>>> 
>>>> 
>>>>> Perhaps this issue needs to be brought up in Multiparty Multimedia
>>>> Session
>>>> 
>>>>> Control (mmusic) WG, but I’m not sure that it is wise to hold up the
>>>>> ANC
>>>> RTP
>>>> 
>>>>> Payload over this.
>>>> 
>>>>> 
>>>> 
>>>>> Thanks everyone!
>>>> 
>>>>> 
>>>> 
>>>>> -Thomas
>>>> 
>>>>> 
>>>> 
>>>>> --
>>>> 
>>>>> Thomas Edwards
>>>> 
>>>>> FOX Networks Engineering & Operations
>>>> 
>>>>> VP Engineering & Development
>>>> 
>>>>> thomas.edwards@fox.com
>>>> 
>>>>> +1-310-369-6696
>>>> 
>>>>> 10201 W Pico Blvd
>>>> 
>>>>> Los Angeles, CA 90035
>>>> 
>>>>> 
>>>> 
>>>>> 
>>>> 
>>>>> 
>>>> 
>>>>> 
>>>> 
>>>> 
>>>> 
>>>> 
>>> 
>>> _______________________________________________
>>> payload mailing list
>>> payload@ietf.org
>>> https://www.ietf.org/mailman/listinfo/payload
>> 
>> 
>> 
>> --
>> Colin Perkins
>> https://csperkins.org/
>> 
>> 
>> 
> 



-- 
Colin Perkins
https://csperkins.org/