Re: [Ltru] Re: Remove extlang from ABNF?

"Mark Davis" <mark.davis@icu-project.org> Tue, 11 December 2007 15:45 UTC

Return-path: <ltru-bounces@ietf.org>
Received: from [127.0.0.1] (helo=stiedprmman1.va.neustar.com) by megatron.ietf.org with esmtp (Exim 4.43) id 1J27Ie-0005fi-4u; Tue, 11 Dec 2007 10:45:36 -0500
Received: from ltru by megatron.ietf.org with local (Exim 4.43) id 1J27Ic-0005SL-Lh for ltru-confirm+ok@megatron.ietf.org; Tue, 11 Dec 2007 10:45:34 -0500
Received: from [10.91.34.44] (helo=ietf-mx.ietf.org) by megatron.ietf.org with esmtp (Exim 4.43) id 1J27Ic-0005SD-Bs for ltru@ietf.org; Tue, 11 Dec 2007 10:45:34 -0500
Received: from nz-out-0506.google.com ([64.233.162.229]) by ietf-mx.ietf.org with esmtp (Exim 4.43) id 1J27IZ-0002x9-Lq for ltru@ietf.org; Tue, 11 Dec 2007 10:45:34 -0500
Received: by nz-out-0506.google.com with SMTP id n1so855192nzf for <ltru@ietf.org>; Tue, 11 Dec 2007 07:45:31 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:references:x-google-sender-auth; bh=80CdNxb719KnOYGyvaKsl/b87IlpVjsre2q0STI5UyU=; b=AVMV5/8hAy40s7MIE0CGxAbiC0jkfWbhxMH0TiAB9ey41IlqiWI8ofLuD71Tov1eZS8xYPpBCru5Xfc7kiaO6Cnqz6bOizk3GNTpRbTZbSvLqeywEvGDULjpVi61egd6ZHarPMdCo01bp+O+UUxYUiYGBqpYR+dtLWSbN1xiAmc=
DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:references:x-google-sender-auth; b=OIlCeXvIN9xUnMq3Pe/C66o5LnNfU4IuNv+wWC9vEcErmSabJPGwo6ZDW4hbV9751d6sFwjLK8TYjmpZ/52ZL1Tx49PLyK/90GyAHDd8ECr6xmxOnOOfza8v1QSECgeOL1MoFf+KuKIpjYfAd/nTWGfiDtbo6xrgsgPsfE/1h5k=
Received: by 10.142.131.18 with SMTP id e18mr1075552wfd.1197387929875; Tue, 11 Dec 2007 07:45:29 -0800 (PST)
Received: by 10.142.128.8 with HTTP; Tue, 11 Dec 2007 07:45:29 -0800 (PST)
Message-ID: <30b660a20712110745g711046acw1cb0f58859d5f574@mail.gmail.com>
Date: Tue, 11 Dec 2007 07:45:29 -0800
From: Mark Davis <mark.davis@icu-project.org>
To: Martin Duerst <duerst@it.aoyama.ac.jp>
Subject: Re: [Ltru] Re: Remove extlang from ABNF?
In-Reply-To: <6.0.0.20.2.20071211163740.0a090850@localhost>
MIME-Version: 1.0
References: <E1J01vI-0003cW-Rd@megatron.ietf.org> <019601c83818$b06c3070$6601a8c0@DGBP7M81> <DDB6DE6E9D27DD478AE6D1BBBB83579561E51429AA@NA-EXMSG-C117.redmond.corp.microsoft.com> <6.0.0.20.2.20071211163740.0a090850@localhost>
X-Google-Sender-Auth: c9328021d133eb87
X-Spam-Score: 0.0 (/)
X-Scan-Signature: 29dc808194f5fb921c09d0040806d6eb
Cc: LTRU Working Group <ltru@ietf.org>
X-BeenThere: ltru@ietf.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Language Tag Registry Update working group discussion list <ltru.ietf.org>
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/ltru>, <mailto:ltru-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www1.ietf.org/pipermail/ltru>
List-Post: <mailto:ltru@ietf.org>
List-Help: <mailto:ltru-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/ltru>, <mailto:ltru-request@ietf.org?subject=subscribe>
Content-Type: multipart/mixed; boundary="===============1977146885=="
Errors-To: ltru-bounces@ietf.org

I agree with Peter that it'd be better to remove extlang. However, I think
we can also live with option #2: leave the extlang in the ABNF, but in
normative text make it absolutely clear that that part of the ABNF is
OBSOLETE; no valid tag will ever have extlangs. That makes the people who
want stability of the ABNF (no matter how that relates to valid tags) happy,
while allowing the rest of us to remove extlang from our code and APIs.

Mark

On Dec 10, 2007 11:48 PM, Martin Duerst <duerst@it.aoyama.ac.jp> wrote:

> At 01:16 07/12/07, Peter Constable wrote:
> >Content-Language: en-US
> >Content-Type: text/plain; charset="utf-8"
> >
> >> From: Doug Ewell [mailto:dewell@roadrunner.com]
> >
> >> >> That's my whole point - the danger that specs writers might look at
> >> >> the dropped extlang and say "they are dropping features between
> >> >> versions of  BCP 47, so we better refer to an RFC *only* and even
> >> >> leave 'or its successor' out".
> >> >
> >> > But this is a key: we are *not* dropping any features. We are
> >> dropping
> >> > the possibility of a future feature. The change to the ABNF (whether
> >> > by removing the extlang subtag entirely or by renaming and/or
> >> > comments) is to clean it up so that implementers do not implement for
> >> > non-and-never-to-be-features.
> >>
> >> I think what Felix meant was not that we are dropping features, but
> >> that
> >> it may appear to the outside observer that we are dropping features.
> >
> >I understood that. But I think it's significant that we are *not*
> removing
> >any features, and it seems to me that could be explained easily enough.
>
> [chairs hat OFF]
>
> It looks like this could be explained easily enough, but I'm quite
> sure that this won't be the case. XML, and XML Schema, are very
> strictly defined languages. Fortunately, we managed to get XML
> away from including a grammar for language tags in an early erratum/
> corrigendum. But if XML Schema has indeed used RFC 4646 for defining
> the syntactic range of language tags, then we should not remove
> some productions. It is clear to us as well as to them that there
> cannot be any valid language tags of the form ab-cde-fgh. But
> these tags, in RFC 4646 and therefore in XML Schema version foo,
> are well-formed. If they change to be non-wellformed in a new
> version of XML Schema, that essentially means that there are
> potentially some documents that conform to a schema in one
> version of XML Schema, but not in a newer one. Even if these
> language tags have not been valid, and don't make sense, that's
> a very bad idea. As an extreme example, such a tag may by accident
> be part of a document used for managing a nuclear plant. With
> a software update, the document could suddently become non-conforming,
> triggering some error.
>
> Peter, I recommend that you talk to some XML Schema folks inside
> Microsoft to understand some of their thinking. I'm sure Felix
> can provide some points of reference if needed.
>
> As for implementation effort, I agree that leaving the extlang
> production in increases implementation effort. But quite a bit
> of it can be saved by knowing that these aren't really used anymore
> (i.e. implementations only have to do the parsing for them,
> they don't have to provide any additional functionality).
> Also, we already have a long list of tests and some regular
> expressions out there which cover extlangs, which both can help
> implementers.
>
> Regards,    Martin.
>
> >The only real stability concern is that some existing parsers would
> >recognize certain hypothetical tags they might encounter as being well
> >formed when in fact they are not well formed. What possible malicious
> >effect could this have? Is this a tag in a query statement? It very
> likely
> >won't match any content. Is this a tag attributed to content? There
> likely
> >won't be any requests for it. Only in some closed system in which
> somebody
> >decided to use proprietary extlang subtags are both going to exist by
> >design. If the parser is encountering a tag somehow constructed such that
> >it has a not-by-design extlang, it won't be catching an condition that
> >could be considered an error, but the error will still be reflected in a
> >failure to match anything, and the essential fix must be in the process
> >*constructing* that tag rather than in the parser.
> >
> >
> >Peter
> >_______________________________________________
> >Ltru mailing list
> >Ltru@ietf.org
> >https://www1.ietf.org/mailman/listinfo/ltru
>
>
> #-#-#  Martin J. Du"rst, Assoc. Professor, Aoyama Gakuin University
> #-#-#  http://www.sw.it.aoyama.ac.jp       mailto:duerst@it.aoyama.ac.jp
>
>
>
> _______________________________________________
> Ltru mailing list
> Ltru@ietf.org
> https://www1.ietf.org/mailman/listinfo/ltru
>



-- 
Mark
_______________________________________________
Ltru mailing list
Ltru@ietf.org
https://www1.ietf.org/mailman/listinfo/ltru