Re: [Slim] Extended functionality for the real-time language negotiation

Natasha Rooney <nrooney@gsma.com> Tue, 14 March 2017 11:02 UTC

Return-Path: <nrooney@gsma.com>
X-Original-To: slim@ietfa.amsl.com
Delivered-To: slim@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id EEAE612943B for <slim@ietfa.amsl.com>; Tue, 14 Mar 2017 04:02:09 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.902
X-Spam-Level:
X-Spam-Status: No, score=-1.902 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=gsmasso.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id oVf84UdTODhv for <slim@ietfa.amsl.com>; Tue, 14 Mar 2017 04:02:05 -0700 (PDT)
Received: from EUR03-DB5-obe.outbound.protection.outlook.com (mail-eopbgr40043.outbound.protection.outlook.com [40.107.4.43]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BC940129535 for <slim@ietf.org>; Tue, 14 Mar 2017 04:02:04 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=GSMASSO.onmicrosoft.com; s=selector1-gsma-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=fxPavT2lBN2QS2cTeDHmHZyYFEb2W2XD+XiumUJ7p8k=; b=X1mzZGWQMQd/C1rWjhVHEjQBGolOFbDpowUW2Cd3imMAlEpzFifrlzXQLjWrB2BWMcPEu9+SUkFqjuC0XjE7QoXDjNJhJfL72zN312XerelgXhItVHqVo+U1CvcC6FIotTBv10JojN/xWwnwiSXaPQq5nx2v8fTDbzc9nblxy9Y=
Received: from HE1PR04MB3113.eurprd04.prod.outlook.com (10.171.196.31) by HE1PR04MB3113.eurprd04.prod.outlook.com (10.171.196.31) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.947.12; Tue, 14 Mar 2017 11:02:02 +0000
Received: from HE1PR04MB3113.eurprd04.prod.outlook.com ([10.171.196.31]) by HE1PR04MB3113.eurprd04.prod.outlook.com ([10.171.196.31]) with mapi id 15.01.0947.022; Tue, 14 Mar 2017 11:02:02 +0000
From: Natasha Rooney <nrooney@gsma.com>
To: Randall Gellens <rg+ietf@randy.pensive.org>
Thread-Topic: [Slim] Extended functionality for the real-time language negotiation
Thread-Index: AQHSl45tj3XHCrxq9EGVI7oeYSQZkKGOaFsAgAAFtQCABQq3gIAAvOyA
Date: Tue, 14 Mar 2017 11:02:02 +0000
Message-ID: <642B8F42-1648-4B22-AB14-45980A2104A2@gsma.com>
References: <084a066e-ea68-d614-58e1-08c904f477ea@omnitor.se> <60797269-4dad-5f48-3184-b8fbca42c30c@realtimetext.org> <FFABE6D6-316E-40E1-B923-4C44A05F39B7@brianrosen.net> <p06240605d4ecde5d7a64@[99.111.97.136]>
In-Reply-To: <p06240605d4ecde5d7a64@[99.111.97.136]>
Accept-Language: en-GB, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-mailer: Apple Mail (2.3259)
authentication-results: randy.pensive.org; dkim=none (message not signed) header.d=none; randy.pensive.org; dmarc=none action=none header.from=gsma.com;
x-ms-exchange-messagesentrepresentingtype: 1
x-originating-ip: [146.198.144.67]
x-ms-office365-filtering-correlation-id: 58a87c6e-1b95-4d25-eefc-08d46ac98b37
x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001);SRVR:HE1PR04MB3113;
x-microsoft-exchange-diagnostics: 1; HE1PR04MB3113; 7:X5LA+DAJzAdtutqwaZSuJzraeWe+oZb74wnO4fSXnUmVJngjSNOA7IXO1nlH/siWWlv4Zk12HHEeyfXj3s+qULJImRb1rAEWE/1KdmM4IEHDeeEEWlWblTP0b6bDHxttTnsKFAavqj7Ltqn3kQSDNYe63e3PgvaD5zVAdzK/uMCuoWNiHT2JJkCxSCqPEAdKQb0nvm0gb7090bKfrrZ4d26F17yCkU5YBeWRybVQjWiOMB1ujcPdJyZX7yf4+XrjETsHiHzhOv0XhIVI3f6tO82f6vpBUNsS9jgNmc4uqmZ3RHN3Mcbkk7RBM0v9Bq6rgCZxoNF8LV2IFIfnB8j1cg==
x-microsoft-antispam-prvs: <HE1PR04MB31132BF3DDFA746476DA1DB7C3240@HE1PR04MB3113.eurprd04.prod.outlook.com>
x-exchange-antispam-report-test: UriScan:;
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040375)(601004)(2401047)(8121501046)(5005006)(3002001)(10201501046)(6041248)(20161123558025)(20161123564025)(20161123562025)(20161123560025)(20161123555025)(6072148); SRVR:HE1PR04MB3113; BCL:0; PCL:0; RULEID:; SRVR:HE1PR04MB3113;
x-forefront-prvs: 02462830BE
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(39450400003)(51444003)(24454002)(377454003)(561944003)(6246003)(7736002)(81166006)(93886004)(122556002)(86362001)(50226002)(5660300001)(57306001)(33656002)(53546007)(54896002)(5890100001)(236005)(6306002)(6512007)(2900100001)(54906002)(8676002)(53936002)(3846002)(110136004)(102836003)(38730400002)(6116002)(4326008)(7906003)(99286003)(3660700001)(50986999)(229853002)(8936002)(106116001)(3280700002)(6506006)(76176999)(2906002)(189998001)(6436002)(66066001)(2950100002)(25786008)(6486002)(77096006)(36756003)(606005)(104396002); DIR:OUT; SFP:1101; SCL:1; SRVR:HE1PR04MB3113; H:HE1PR04MB3113.eurprd04.prod.outlook.com; FPR:; SPF:None; MLV:sfv; LANG:en;
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/alternative; boundary="_000_642B8F4216484B22AB1445980A2104A2gsmacom_"
MIME-Version: 1.0
X-OriginatorOrg: gsma.com
X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Mar 2017 11:02:02.1502 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 72a4ff82-fec3-469d-aafb-ac8276216699
X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR04MB3113
X-MS-Exchange-CrossPremises-AuthAs: Internal
X-MS-Exchange-CrossPremises-AuthMechanism: 04
X-MS-Exchange-CrossPremises-AuthSource: HE1PR04MB3113.eurprd04.prod.outlook.com
X-MS-Exchange-CrossPremises-SCL: 1
X-MS-Exchange-CrossPremises-messagesource: StoreDriver
X-MS-Exchange-CrossPremises-BCC:
X-MS-Exchange-CrossPremises-originalclientipaddress: 146.198.144.67
X-MS-Exchange-CrossPremises-avstamp-service: 1.0
X-MS-Exchange-CrossPremises-disclaimer-hash: 78ca8040c6722e32c2f5b0a45bf37e74b9409d645a53be96aa19958e0cee0f00
X-MS-Exchange-CrossPremises-antispam-scancontext: DIR:Originating; SFV:NSPM; SKIP:0;
X-MS-Exchange-CrossPremises-processed-by-journaling: Journal Agent
X-OrganizationHeadersPreserved: HE1PR04MB3113.eurprd04.prod.outlook.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/slim/3mMy0DAJAfDWLRMNH9uW_b51TTo>
Cc: "arnoud.vanwijk@realtimetext.org" <arnoud.vanwijk@realtimetext.org>, "slim@ietf.org" <slim@ietf.org>, Gunnar Hellström <gunnar.hellstrom@omnitor.se>, Brian Rosen <br@brianrosen.net>
Subject: Re: [Slim] Extended functionality for the real-time language negotiation
X-BeenThere: slim@ietf.org
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: Selection of Language for Internet Media <slim.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/slim>, <mailto:slim-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/slim/>
List-Post: <mailto:slim@ietf.org>
List-Help: <mailto:slim-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/slim>, <mailto:slim-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 14 Mar 2017 11:02:10 -0000

Myself and Bernard are discussing this situation currently in an effort to solve the outstanding issues and get the draft pushed through. We have heard opinions from a number of people, which is great. We’ll get back to everyone shortly on how we will proceed.

Natasha Rooney | Internet Engineering Director | Internet and Web Team | Technology | GSMA | nrooney@gsma.com<mailto:nrooney@gsma.com> | +44 (0) 7730 219 765 | @thisNatasha | Skype: nrooney@gsm.org<mailto:nrooney@gsm.org>

On 13 Mar 2017, at 23:45, Randall Gellens <rg+ietf@randy.pensive.org<mailto:rg+ietf@randy.pensive.org>> wrote:

I agree with Brian.  The draft defines a very simple mechanism, as agreed in the WG.  The draft has been through WG discussion, WG last call, and IETF last call.  I would object to reopening the draft to add q-values or anything else.

We can advance the current draft and start work on a more complex mechanism.  This would mean we have something that is simple and useful published.  Or we can revert the draft back into the WG, and spend months discussing it.  Not only would this needlessly add major delay to the draft, but there is a real risk that we all get sick of it and the AD shuts down the WG.

At 1:46 PM -0500 3/10/17, Brian Rosen wrote:

We seem to be running in circles.

The work group has discussed the idea of indicating media & language combination preferences and DECLINED, at this time to do that.  We decided our first effort would be to label language preferences per media, with no cross media preferences.  That doesn't mean we won't ever do it.  It means our first document on SDP negotiation won't cover that case.

Yet you keep trying to get it in the current document.

I don't want to revisit our decision, and I don't want to see any linkage between media in this document.  I accept there are requirements to have such linkages, but think there are many. many uses for a simpler mechanism such as what the current document discusses.

If you want to write a draft that proposes an extension to the current mechanism, please write it, and I'll review it.  But I would like to see this document published with the simple per-media preference.

Brian


On Mar 10, 2017, at 1:25 PM, Arnoud van Wijk <<mailto:arnoud.vanwijk@realtimetext.org>arnoud.vanwijk@realtimetext.org<mailto:arnoud.vanwijk@realtimetext.org>> wrote:

Hi Gunnar,

I also prefer solution 1.2 and 2.2

I like the use of q values here. I think that is better then adding a new attribute.


Good proposal.


/Arnoud



On 07/03/2017 14:01, Gunnar Hellström wrote:

This is a slightly improved extract from the summary of the LC period for the real-time SLIM draft about two discussed functionality extensions. (Some of the examples had copy-paste errors.)

The intention is to discuss this topic as far as needed to decide if any or both these functionality enhancements could go into the current draft before publication, and if not included then decide if any changes are required in the current draft in order to accommodate for the extensions.

(see the summary sent on March 4 for e.g. references to the other summary points.

----------------------------------------------------------------------------------------------------------

n). Indication of preference between media, and of simultanous versus alternative languages.

This is a summary of the remaining issues related to items e), f), j) and m) above.

Issue e) proposes changes to enable indication of preference for language in different media.
Issue f) requests possibility to indicate request or offering of text captions of spoken language.
Issue j) proposes use of the Accept-Language syntax, that could both solve the functional needs
of e) and f) and sort out the syntax and semantics problems of the asterisk parameter.
Issue m) just indicates that issue e) is not yet resolved.

Randall has proposed to resolve the functional needs in a new draft, and not accept the Accept-Language syntax.
I have proposed a simple way to resolve issue e) - the preference between media, at the same time improving the definition of the semantics of the asterisk parameter.
No real solution to issue f) - the simultaneity indication  has been discussed.
Issue j) - the proposal to use the Accept-Language syntax can potentially be used to resolve issues e) and f).

 Discussion:
Issue e) says that there is a need to be able indicate which of a set of language/media indications are more preferred alternatives than others.
Examples are:
1. A want to get written English in text, A can as a less preferred alternative accept to get spoken English.  An answering party B who can use text will then respond with written text and get good satisfaction, while another answering user C without text capability will answer in spoken English and have a possibility for a reasonably successful call.
Without this indication, the first answering party B may have seen the spoken and written alternatives as true equal preference alternatives and answered with spoken English that will result in less satisfied users.
2. A Prefer to receive spoken language, and can accept to receive text.   When answering party B can use spoken language, that will be satisfied, otherwise written language will be used.
3. A Prefer to use spoken language in both directions, and can accept to use sign language in video in both directions. Answering party B has a clear indication of why both signed and written is indicated and can answer according to its capabilities trying to satisfy the preference for spoken language.
4. A Prefer to use  sign language in both directions and can accept to use written language in both directions. Sign language users will use sign language, others will use text.
5. Prefer to send sign language and receive text (deaf-blind user), can accept to send text.  In a call with a person with similar prefeences, text will be used both ways, otherwise sign one way and text the other.

etc.

Issue f) requires a way to indicate use of captioning and other situations where use of simultaneous languages in different modalities are needed:

1. Preference for hearing spoken language and simultaneously read written language in text. ( captioning) .   The time is here when this can be provided automatically in some settings, but also traditionally by a manned service.
2. Preference for hearing spoken language and simultaneously seeing the speaker in video. (lip-reading).  Easily and naturally provided once the need is known.
3. Preference for seeing sign language and simultaneously hear spoken language in audio. ( for multiple users at the terminal )    One of the streams is provided by an interpreter.
4. Preference for hearing spoken language and simultaneously view written language in video. (captioning if we accept to specify text as overlay on video, otherwise it is same as number 1.)
Some of these can be acceptable also if just one of the language/media combinations can be provided, but is much more preferred if both can be provided together. In other cases it is essential to get both simultaneously. There is a need to differentiate in the indication that this preference for getting the languages together is preferred.

Alternative coding proposals:
1. Preference between language/modality
1.1 Based on draft -08, add the coding of an asterisk last in an attribute to mean lower preference for a lanugage/media combination than the one(s) without an asterisk.
example
m=audio
a=hlang-recv:en*
m=text
a=hlang-recv:en

Audio and text are alternatives and text preferred

1.2. Change to the Accept-Language syntax and let the q-values have scope over the whole SDP.
 m=video 51372 RTP/AVP 31 32
 a=hlang-recv:ase;q=0.9
 a=hlang-send:ase;q=0.9


 m=text 49250 RTP/AVP 98,99
 a=hlang-send:en;q=0.5,*;q=0.1
 a=hlang-recv:en;q=0.5,*;q=0.1

Sign language is higher preferred than text.





1.3. Introduce a new a=modality attribute on media level, with parameters: <modality>, <direction>, <preference>     example:

m=text
a=modality:written,recv,hi
a=hlang-recv:en*
m=audio
a=modality:spoken,recv,med
a=hlang-recv:en*



2. Preference for simultaneous languages vs alternative languages:

2.1. Based on draft -08, add another notation to the use of the asterisk, e.g. an optional character to be used together with the asterisk to mark media that are wanted together. (ugly)   example:

m=audio
a=hlang-recv:en*$c
m=text
a=hlang-recv:en$c

The $ is a simultaneity indication, the c is a groouping indicator telling that all modalities marked with the $c are wanted together. (we might be able to restrict the indication to just one set of languages that are wanted simultaneously.


2.2. Use the Accept-Language syntax and add the usage rules that q-values with less than .1 difference mean languages with a preference to be used together. Higher differences indicate that they are alternatives.  Thereby it is both possible to indicate simultaneity and preference if the simultaneity cannot be satisfied.

 m=audio 51372 RTP/AVP 0
 a=hlang-recv:ase;q=0.5
 a=hlang-send:ase;q=0.5


 m=text 49250 RTP/AVP 98,99
 a=hlang-send:en;q=0.51,*;q=0.1
 a=hlang-recv:en;q=0.51,*;q=0.1

The q-values differences are within 0.1 so it is a preference for getting both together, but if that is not possible, text is preferred.


2.3. Add to the new a=modality attribute a fourth, optional parameter [simultaneity] with value any single letter, indicating a preference for having that modality simultaneously with another modality indicated with the same value in the [simultaneity] parameter.   Without this parameter, the modalities are alternatives.

m=text
a=modality:written,recv,hi,d
a=hlang-recv:en*
m=audio
a=modality:spoken,recv,hi,d
a=hlang-recv:en*



Status: Not solved. Conclusion needed on how to handle these issues e, f, and j,  both regarding which solution and what procedure to take to apply it.

I have a slight preference for solution 1.2 and 2.2 ,

Your views?

Regards
Gunnar
--
-----------------------------------------
Gunnar Hellström
Omnitor
<mailto:gunnar.hellstrom@omnitor.se>gunnar.hellstrom@omnitor.se<mailto:gunnar.hellstrom@omnitor.se>
+46 708 204 288


_______________________________________________
SLIM mailing list
<mailto:SLIM@ietf.org>SLIM@ietf.org<mailto:SLIM@ietf.org>
<https://www.ietf.org/mailman/listinfo/slim>https://www.ietf.org/mailman/listinfo/slim


_______________________________________________
SLIM mailing list
<mailto:SLIM@ietf.org>SLIM@ietf.org<mailto:SLIM@ietf.org>
https://www.ietf.org/mailman/listinfo/slim



_______________________________________________
SLIM mailing list
SLIM@ietf.org<mailto:SLIM@ietf.org>
https://www.ietf.org/mailman/listinfo/slim


--
Randall Gellens
Opinions are personal;    facts are suspect;    I speak for myself only
-------------- Randomly selected tag: ---------------
You never finish a program, you just stop working on it.

_______________________________________________
SLIM mailing list
SLIM@ietf.org<mailto:SLIM@ietf.org>
https://www.ietf.org/mailman/listinfo/slim


This email and its attachments are intended for the above named only and may be confidential. If they have come to you in error you must take no action based on them, nor must you copy or show them to anyone; please reply to this email or call +44 207 356 0600 and highlight the error.