Re: [rtcweb] Proposal for API mapping for RTP

Harald Alvestrand <harald@alvestrand.no> Fri, 22 November 2013 12:39 UTC

Return-Path: <harald@alvestrand.no>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 922B11ADF7B for <rtcweb@ietfa.amsl.com>; Fri, 22 Nov 2013 04:39:11 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -5.911
X-Spam-Level:
X-Spam-Status: No, score=-5.911 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_HI=-5, RP_MATCHES_RCVD=-0.525, URIBL_RHS_DOB=1.514] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 5JDUuZeq5Jhe for <rtcweb@ietfa.amsl.com>; Fri, 22 Nov 2013 04:39:08 -0800 (PST)
Received: from eikenes.alvestrand.no (eikenes.alvestrand.no [158.38.152.233]) by ietfa.amsl.com (Postfix) with ESMTP id 818A71AD9B8 for <rtcweb@ietf.org>; Fri, 22 Nov 2013 04:39:07 -0800 (PST)
Received: from localhost (localhost [127.0.0.1]) by eikenes.alvestrand.no (Postfix) with ESMTP id E517739E4C2; Fri, 22 Nov 2013 13:38:58 +0100 (CET)
X-Virus-Scanned: Debian amavisd-new at eikenes.alvestrand.no
Received: from eikenes.alvestrand.no ([127.0.0.1]) by localhost (eikenes.alvestrand.no [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id TVL-WhOl4AWE; Fri, 22 Nov 2013 13:38:54 +0100 (CET)
Received: from hta-hippo.lul.corp.google.com (unknown [IPv6:2620:0:1043:1:7646:a0ff:fe90:e2bb]) by eikenes.alvestrand.no (Postfix) with ESMTPSA id AAAF139E240; Fri, 22 Nov 2013 13:38:54 +0100 (CET)
Message-ID: <528F505C.30200@alvestrand.no>
Date: Fri, 22 Nov 2013 13:38:52 +0100
From: Harald Alvestrand <harald@alvestrand.no>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.1.0
MIME-Version: 1.0
To: "Lijing (Jessie)" <lijing80@huawei.com>, Magnus Westerlund <magnus.westerlund@ericsson.com>, "rtcweb@ietf.org" <rtcweb@ietf.org>
References: <527BD94C.2070900@ericsson.com> <A3045C90BB645147BC99159AA47ABAC7495DA51A@SZXEMA510-MBX.china.huawei.com>
In-Reply-To: <A3045C90BB645147BC99159AA47ABAC7495DA51A@SZXEMA510-MBX.china.huawei.com>
Content-Type: text/plain; charset="ISO-8859-1"; format="flowed"
Content-Transfer-Encoding: 8bit
Subject: Re: [rtcweb] Proposal for API mapping for RTP
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb/>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 22 Nov 2013 12:39:11 -0000

On 11/22/2013 04:21 AM, Lijing (Jessie) wrote:
> A MediaStream contains multiple MediaStreamTrack, and different MediaStreams can share the same MediaStreamTrack. MediaStreamTrack within one MediaStream is synchronized.
>
> -----Does anywhere define how to describe same MST in different mediastreams in SDP? As I know, the current unified plan defines" One m-line == one MediaStreamTrack", so how can we mark multiple mediastreams in msid attribute?
> Allow msid carry more mediastream id?
> m=video1
> a=msid: ma ta; mb ta
>
> or have multiple msid attribute in one m line?
> m=vido1
> a=msid: ma ta
> a=msid: mb ta
>
> or we should expand other attribute?

My thinking is that the last one is the one to use; I have not defined 
special semantics for semicolons in MSID values, but the spec 
(draft-ietf-mmusic-msid-02) does say that there can be multiple msid 
attributes on a single m-line, and it seems logical to go that route.


>
>
> -----Original Message-----
> From: rtcweb-bounces@ietf.org [mailto:rtcweb-bounces@ietf.org] On Behalf Of Magnus Westerlund
> Sent: Friday, November 08, 2013 2:18 AM
> To: rtcweb@ietf.org
> Subject: [rtcweb] Proposal for API mapping for RTP
>
> WG,
> (As draft-ietf-rtcweb-rtp-usage Editor)
>
> There was discussion yesterday afternoon on the W3C MediaStream to RTP mapping. This did arrive on some conclusions that I here try to word into a proposal for everyones review.
>
> A MediaStreamTrack is sent over a source packet stream (one SSRC) and can have additionally redundancy packet streams (SSRCs). These redundnacy streams are RTP retranmission streams or FEC.
>
> When multiple MediaStreamTracks have the same Media Source, then the fact that one has creaeted multiple MediaStreamTracks and added these through a MediaStream to the PeerConnection is going to result in that each MediaStreamTrack will have its own source packet stream (one SSRC).
> This will be true, even if there are no difference in the configuration of the MediaStreamTrack. Thus no optimizations in regards to collapsing or aggregating multiple MediaStreamTrack onto a single source packet stream (SSRC). This is done for keeping things simple and straightforward.
>
> When it comes to the use of CNAME, an RTCWEB end-point shall within the context of one origin, i.e. a particular JS creating PeerConnections, use the same CNAME in all these PeerConnections, for all outgoing mediaStreamTracks. However, a end-point MUST be capable of receiving multiple different CNAMEs both within and between different RTP sessions and PeerConnections. This definition comes from the following observations.
>
> A MediaStream contains multiple MediaStreamTrack, and different MediaStreams can share the same MediaStreamTrack. MediaStreamTrack within one MediaStream is synchronized. Thus, at any point the JS application can create a new MediaStream that includes MediaStreamTrack from different context. To avoid needing to change all SSRC and put the SSRCs into a single CNAME at that point, we ensure that this can't happen.
>
> MediaStreamTracks that are being received in one PeerConnection and then forward by being added to another one will need to be re-synchronzied into the endpoints outgoing. We discussed and came to the agreement on Monday that forwarding would need to be done equivalent of decoding and recoding when forwarding. Implementations may do other things, but must function equivalent to this.
>
> The above have some forward interoperability properties. If one like to be able to use multiple CNAMEs that can be added given that W3C API ensures that you don't cause issue with what CNAME a particular SSRC belongs to. In addition if one like to optimize the cases where multiple MediaStreamTrack have a common media source that can be added.
>
> Disagreements, requests for clarifications?
>
>
> Cheers
>
> Magnus Westerlund
>
> ----------------------------------------------------------------------
> Multimedia Technologies, Ericsson Research EAB/TVM
> ----------------------------------------------------------------------
> Ericsson AB                | Phone  +46 10 7148287
> Färögatan 6                | Mobile +46 73 0949079
> SE-164 80 Stockholm, Sweden| mailto: magnus.westerlund@ericsson.com
> ----------------------------------------------------------------------
>
> _______________________________________________
> rtcweb mailing list
> rtcweb@ietf.org
> https://www.ietf.org/mailman/listinfo/rtcweb
> _______________________________________________
> rtcweb mailing list
> rtcweb@ietf.org
> https://www.ietf.org/mailman/listinfo/rtcweb