Re: [clue] 2 draft covering real-time text relevant for conferencing/ multiple participants and telepresence

"Mike Hammer (hmmr)" <hmmr@cisco.com> Wed, 01 June 2011 14:15 UTC

Return-Path: <hmmr@cisco.com>
X-Original-To: clue@ietfa.amsl.com
Delivered-To: clue@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id C09A5E06C8 for <clue@ietfa.amsl.com>; Wed, 1 Jun 2011 07:15:43 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.964
X-Spam-Level:
X-Spam-Status: No, score=-9.964 tagged_above=-999 required=5 tests=[AWL=0.635, BAYES_00=-2.599, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YtCCW8C7o5Ma for <clue@ietfa.amsl.com>; Wed, 1 Jun 2011 07:15:43 -0700 (PDT)
Received: from sj-iport-5.cisco.com (sj-iport-5.cisco.com [171.68.10.87]) by ietfa.amsl.com (Postfix) with ESMTP id 1E08BE0699 for <clue@ietf.org>; Wed, 1 Jun 2011 07:15:43 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=hmmr@cisco.com; l=4056; q=dns/txt; s=iport; t=1306937742; x=1308147342; h=mime-version:content-transfer-encoding:subject:date: message-id:in-reply-to:references:from:to; bh=zKPJNxWZUWFW9X2ZgQ3HEJKtGAn/Gmax/4gWNWviQgQ=; b=aJ85h9u9zO1JTBh3rbBZ88WOgsCjxIg4G5kytmFFhp76IizKtowWRYY5 4jpvisg2jEglW2FUC/LoJiRyxmEsUx8mULXJ/QHpqunNf0roi6fskoU5W 2+DYq+lqaLH1vXKTJueKwcjxiEIVmjHYbtOIEwQyECFr6F7BMWWCMTVI9 4=;
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: AgsBANBI5k2tJXHA/2dsb2JhbABFDpdQjlR3qhqdUoMXgwkEhmWOPIp9
X-IronPort-AV: E=Sophos;i="4.65,303,1304294400"; d="scan'208";a="357438945"
Received: from rcdn-core2-5.cisco.com ([173.37.113.192]) by sj-iport-5.cisco.com with ESMTP; 01 Jun 2011 14:15:42 +0000
Received: from xbh-rcd-302.cisco.com (xbh-rcd-302.cisco.com [72.163.63.9]) by rcdn-core2-5.cisco.com (8.14.3/8.14.3) with ESMTP id p51EFgNd031219; Wed, 1 Jun 2011 14:15:42 GMT
Received: from xmb-rcd-111.cisco.com ([72.163.62.153]) by xbh-rcd-302.cisco.com with Microsoft SMTPSVC(6.0.3790.4675); Wed, 1 Jun 2011 09:15:42 -0500
X-MimeOLE: Produced By Microsoft Exchange V6.5
Content-class: urn:content-classes:message
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Date: Wed, 01 Jun 2011 09:15:41 -0500
Message-ID: <C4064AF1C9EC1F40868C033DB94958C704A3479F@XMB-RCD-111.cisco.com>
In-Reply-To: <4DE60A5E.105@realtimetext.org>
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
Thread-Topic: [clue] 2 draft covering real-time text relevant for conferencing/ multiple participants and telepresence
Thread-Index: AcwgQMkAZMhjCg7IRlG8VXTAcDPwIgAI94Jw
References: <CA05517C.2C3BB%stewe@stewe.org><4DE0083A.3040102@cisco.com> <7F2072F1E0DE894DA4B517B93C6A0585194E2A65D7@ESESSCMS0356.eemea.ericsson.se><4DE4E7BF.8070301@cisco.com> <4DE60A5E.105@realtimetext.org>
From: "Mike Hammer (hmmr)" <hmmr@cisco.com>
To: arnoud.vanwijk@realtimetext.org, clue@ietf.org
X-OriginalArrivalTime: 01 Jun 2011 14:15:42.0176 (UTC) FILETIME=[63E75600:01CC2066]
Subject: Re: [clue] 2 draft covering real-time text relevant for conferencing/ multiple participants and telepresence
X-BeenThere: clue@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: CLUE - ControLling mUltiple streams for TElepresence <clue.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/clue>, <mailto:clue-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/clue>
List-Post: <mailto:clue@ietf.org>
List-Help: <mailto:clue-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/clue>, <mailto:clue-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 01 Jun 2011 14:15:43 -0000

Arnoud,

Is that keyboard left and keyboard right?  :)

I took a quick look through the referenced ID and did not see reference
to audio and video feeds in a multi-party situation.  With TP, the
system may be designed to select one of multiple cameras to display when
there are more participants than displays.  So, is your intent that when
a 'texter' is 'speaking' that the keyboard input should direct the
camera on him/her to be the one selected for display?

How do you identify the text-speaker from someone just doing email?

Does the rate of texting translate to volume for selection of video
feed?

Is the text intended to be overwritten on the screen, or is there a
separate screen?

If there is a separate display screen, do all 'text-speakers' get equal
time, or does an algorithm select which one is displayed there?

If there is a conflict between an audio feed and a text feed for
attention, how do you decide which video is displayed?

Are there signers or text to audio speakers possible?

Lots of questions.

I think you should contribute to CLUE.

However, I would question bolting on a solution after the fact with
separate drafts.

Perhaps, all input and output devices should be integrated into the base
drafts.

Mike



-----Original Message-----
From: clue-bounces@ietf.org [mailto:clue-bounces@ietf.org] On Behalf Of
Arnoud van Wijk
Sent: Wednesday, June 01, 2011 5:46 AM
To: clue@ietf.org
Subject: [clue] 2 draft covering real-time text relevant for
conferencing/ multiple participants and telepresence

Hi all,
I am getting a clue about CLUE. :-)
This is an excellent WG covering what we need for a good telePRESENCE 
without hurdles.
If I communicate remote with other persons, I'd like to "forget" that I 
participate remote. There should be no limitations in the ability to 
communicate.

The focus is at this moment on audio and video, lets make real-time text

also a standard media to be used in all the work and scenarios as well 
with CLUE.
The use of Total Conversation, where audio, video and real-time text are

presented and available simultaneously will actually optimize the 
communication with others.
As a deaf person, I need lipreading and real-time text together, others 
sign language, others having real-time text as support if the language 
used in the conference is not your native language and have the text in 
your own language.
Or even to talk and discuss with others during the conference with 
real-time text while listening to the main conference.

More about real-time text can be found at: http://www.realtimetext.org 
but most of you are already familiar with it.

It is not only for persons with a hearing disability, it is for all 
breathing humans who want to communicate (and for a few robots out here 
:-) )
But using Total Conversation will remove the biggest Internet 
(telephony/conferencing) communication hurdle for persons who are deaf, 
hard of hearing or have a speech impairment. And that is not a joke.

We have submitted now 2 drafts that are what I feel quite valuable for
CLUE.

Text media handling in RTP based real-time conferences
https://datatracker.ietf.org/doc/draft-hellstrom-text-conference/

and
Presentation of Text Conversation in real-time and en-bloc form
https://datatracker.ietf.org/doc/draft-hellstrom-textpreview/

How would you feel about continuing these drafts under the CLUE banner?
I am looking forward to your feedback and comments and well...anything 
that you throw at me and my fellow authors :-)

Thank you.

Sincerely

Arnoud van Wijk

PS we can also help with more insight on Total Conversation regarding 
quality of the video, camera position and the angle of the view (for 
example head for lipreading, upper body and sufficient area around the 
person for sign language etc.).

_______________________________________________
clue mailing list
clue@ietf.org
https://www.ietf.org/mailman/listinfo/clue