Re: [rtcweb] non-media data

David Singer <singer@apple.com> Tue, 12 April 2011 18:28 UTC

Return-Path: <singer@apple.com>
X-Original-To: rtcweb@ietfc.amsl.com
Delivered-To: rtcweb@ietfc.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfc.amsl.com (Postfix) with ESMTP id A0786E07E4 for <rtcweb@ietfc.amsl.com>; Tue, 12 Apr 2011 11:28:55 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -106.599
X-Spam-Level:
X-Spam-Status: No, score=-106.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([208.66.40.236]) by localhost (ietfc.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id UYM-KV5D8e2a for <rtcweb@ietfc.amsl.com>; Tue, 12 Apr 2011 11:28:54 -0700 (PDT)
Received: from mail-out.apple.com (mail-out.apple.com [17.151.62.50]) by ietfc.amsl.com (Postfix) with ESMTP id 9BD65E065C for <rtcweb@ietf.org>; Tue, 12 Apr 2011 11:28:54 -0700 (PDT)
MIME-version: 1.0
Content-transfer-encoding: 7bit
Content-type: text/plain; CHARSET="US-ASCII"
Received: from relay11.apple.com ([17.128.113.48]) by mail-out.apple.com (Oracle Communications Messaging Exchange Server 7u4-20.01 64bit (built Nov 21 2010)) with ESMTPS id <0LJJ00CINXZOAUF0@mail-out.apple.com> for rtcweb@ietf.org; Tue, 12 Apr 2011 11:28:53 -0700 (PDT)
X-AuditID: 11807130-b7c15ae000005aca-30-4da499e51737
Received: from [17.153.54.227] (Unknown_Domain [17.153.54.227]) by relay11.apple.com (Apple SCV relay) with SMTP id CB.18.23242.5E994AD4; Tue, 12 Apr 2011 11:28:53 -0700 (PDT)
From: David Singer <singer@apple.com>
In-reply-to: <1D64F821-8D2B-4983-9989-F3EE076583E3@phonefromhere.com>
Date: Tue, 12 Apr 2011 11:28:53 -0700
Message-id: <215B243F-B6F6-4A52-9770-B276157E4860@apple.com>
References: <4D9EF7D3.1040806@alvestrand.no> <F4467DDA-816F-4DDD-B66F-8A48F9A0A16C@apple.com> <A444A0F8084434499206E78C106220CA0875E32DED@MCHP058A.global-ad.net> <1D64F821-8D2B-4983-9989-F3EE076583E3@phonefromhere.com>
To: Tim Panton <tim@phonefromhere.com>
X-Mailer: Apple Mail (2.1084)
X-Brightmail-Tracker: AAAAAA==
Cc: "rtcweb@ietf.org" <rtcweb@ietf.org>
Subject: Re: [rtcweb] non-media data
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 12 Apr 2011 18:28:55 -0000

On Apr 12, 2011, at 1:40 , Tim Panton wrote:

> Although we should aim to limit scope, it is also a good plan to listen to experience in the field.
> Our experience is that direct, reliable, sequenced transmission of small messages between 
> endpoints hugely adds to the value of a web-embedded RTC component.
> 
> Typically these messages are intimately tied to events in the media engine (change of speaker,
> end of message playback, transcription or recording available). (dynamic media meta-data if you like)
> 
> They are used to change the visual state of the web page (via javascript) so that (for example) the 
> web displayed IVR prompts stay in sync with the audio.
> 
> Whilst all of these are achievable via a more circuitous route (mediaserver->signalingserver->webserver->long poll-> browser)
> the added latency will make the visual changes lag the audio which undermines the user experience.
> 
> The value in RTC-web isn't the realtime audio/video itself, it's the fact that it is an integral part of
> the web-page, that integration is aided by non-media data.
> Tim.
> 

OK, this is fine, but having arbitrary numbers of streams of arbitrary media types is different from designing chat sessions or file transfer as 'part of' the tool.

> 
> On 12 Apr 2011, at 08:19, Elwell, John wrote:
> 
>> It is always good to try to limit scope, and I think this is indeed a case where we can useful limit scope to RTP-based media (audio, video, real-time text...).
>> 
>> John
>> 
>> 
>>> -----Original Message-----
>>> From: rtcweb-bounces@ietf.org 
>>> [mailto:rtcweb-bounces@ietf.org] On Behalf Of David Singer
>>> Sent: 08 April 2011 19:19
>>> To: rtcweb@ietf.org
>>> Subject: [rtcweb] non-media data
>>> 
>>> 
>>> On Apr 8, 2011, at 4:56 , Harald Alvestrand wrote:
>>> 
>>>> 
>>>> - Non-media data: RTP, UDP-without-RTP, TCP, or "something else"?
>>>> Congestion control is obviously needed - both for this and 
>>> for media, naturally.
>>>> 
>>> 
>>> My feeling is that we should not forget we're designing 
>>> something to sit in a browser or browser-like context.  We 
>>> *have* text chat tools, file upload and download tools, and 
>>> so on, today, working in browsers.  Yes, they typically go 
>>> through a server, and going point to point might be an 
>>> optimization.  But that's the rub; I don't think we should 
>>> spend a lot of time optimizing tools that are ancillary to 
>>> the core problem of doing real-time a/v between two users. If 
>>> someone wants to start a group looking at real-time 
>>> point-to-point text chat, well, OK, but I think it's a 
>>> distraction for us, at least initially.
>>> 
>>> David Singer
>>> Multimedia and Software Standards, Apple Inc.
>>> 
>>> _______________________________________________
>>> rtcweb mailing list
>>> rtcweb@ietf.org
>>> https://www.ietf.org/mailman/listinfo/rtcweb
>>> 
>> _______________________________________________
>> rtcweb mailing list
>> rtcweb@ietf.org
>> https://www.ietf.org/mailman/listinfo/rtcweb
> 

David Singer
Multimedia and Software Standards, Apple Inc.