Re: [Tools-discuss] [rfc-i] Update: The transition to xml2rfc v3 (today!) (fwd) Heather Flanagan: Update: The transition to xml2rfc v3 (today!)

Julian Reschke <julian.reschke@gmx.de> Mon, 21 October 2019 16:47 UTC

Return-Path: <julian.reschke@gmx.de>
X-Original-To: tools-discuss@ietfa.amsl.com
Delivered-To: tools-discuss@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 762C0120108 for <tools-discuss@ietfa.amsl.com>; Mon, 21 Oct 2019 09:47:22 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.899
X-Spam-Level:
X-Spam-Status: No, score=-1.899 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_FROM=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=gmx.net
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id tJuMZDowXy7X for <tools-discuss@ietfa.amsl.com>; Mon, 21 Oct 2019 09:47:19 -0700 (PDT)
Received: from mout.gmx.net (mout.gmx.net [212.227.15.18]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id CE286120071 for <tools-discuss@ietf.org>; Mon, 21 Oct 2019 09:47:18 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1571676377; bh=mqiXb1atcq7QmbituJJk7tWQhf1sSdSHK/A6R6F4PTM=; h=X-UI-Sender-Class:Subject:To:Cc:References:From:Date:In-Reply-To; b=jHiQRR/2nBT2ur3RNBsCHyJLtWF4qmfvzZciNf7sLQV3iNILNZ8DxwPCE69PmDWYM fUwkhf1zlzH7x7L36cYFVv5s9tKMcr1Dkwh78v4QGzsxE7qHatTB25ny5qnjlzUnYl RcwomsifK44cO53wM4oV7nU5Hwy+TuQO/RJ1rzmU=
X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c
Received: from [192.168.178.124] ([217.251.143.142]) by mail.gmx.com (mrgmx005 [212.227.17.190]) with ESMTPSA (Nemesis) id 1MKbkM-1iapsr0xI4-00KwI6; Mon, 21 Oct 2019 18:46:17 +0200
To: Dave Rice <dave@dericed.com>, Henrik Levkowetz <henrik@levkowetz.com>
Cc: rfc-interest <rfc-interest@rfc-editor.org>, tools-discuss@ietf.org
References: <20285.1568652805@localhost> <705AA16B-68B1-4B5E-AE47-0714F6781C1A@dericed.com> <26105.1568818137@localhost> <E70CD0FF-0294-47E5-873F-5E184A248577@dericed.com> <1268.1568828850@localhost> <B4047303-E2B9-4B9D-B368-2ACC85A06D15@dericed.com> <15814.1569013442@localhost> <3a8f5865-9f5c-8c65-63be-bca31c5f1c86@levkowetz.com> <3650B5EF-A442-4291-928A-2FCB2144134C@dericed.com> <06122b6d-d5f9-30b9-2db4-a2427d299a1f@levkowetz.com> <CB32A50B-D6F2-41C4-8AC7-750E35F4941D@dericed.com>
From: Julian Reschke <julian.reschke@gmx.de>
Message-ID: <97e68838-ac0c-25e4-67a9-a2a998b6e8af@gmx.de>
Date: Mon, 21 Oct 2019 18:46:12 +0200
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.9.0
MIME-Version: 1.0
In-Reply-To: <CB32A50B-D6F2-41C4-8AC7-750E35F4941D@dericed.com>
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Language: en-US
Content-Transfer-Encoding: quoted-printable
X-Provags-ID: V03:K1:EDXn6lIAOmmZJGjmYsDlPZ0ZF5ZKg75UcsSFW5yyA26Suc/XmC5 q39Kv4uc5gdiw/fSi+iViT19Nl903bu82RYWP0XvsGPBuFV9xnZTLWIjcaC6V9MThyJeMwM xVfzwAm8eTPE7YLLuV8dukV1xcqeS9zWzd2UcEcmEUDk9Q48X8pxCJClLeWRjdp3m4TeY7o YePCAL+iRik/aBUoF2NOQ==
X-UI-Out-Filterresults: notjunk:1;V03:K0:xely+8TkLuU=:/3198vzXce1SVMwC6aqjpk GijO7rP0vnAcqPH8QFBczkoWZcfD5E+QgceNWfTd+vtykQl6PHp0ZwIN0mxQcjnqCj+XZuMBz KllvfilkjI1l8JAKjrks7NWMalCQadMAg8Tx9qqQTtuJF9wlYWU2VT2FrQsLK7OCtSS7tzaJE BFy6uYWqLFcImTqnx/ExN1F09R09yksBVPh9LYegJMKcUWE+3LfMN1LANSzJdZ8W6nXqM2JfP XUghXCom+xrla0ZnKv3tDj8B1e7pbjZQZxQOnXO0wLwECauZKHe6P9h9nEG3YbOc2zvt67we8 +mva8MpNqtdplwds+qgE/ICOQ94rAcAsn8xqW8xkfG2xFswyYhLdIbim8N1MAKcWsiByPq39N E80uEhiKOXLrzmjrWX4VN5sAP9nW0yQjap52AtgWQuqRuxmHcXstxE0MeoFjd1ZydWd5qimDq LqmEhw+rMMkaL56vTP3NMEqJwULQ3gwVxmBxknRS+Hj/jvkgzKgwzMT6O/Bexup1Nde1qwRXT lJExOfbU8iZkYI8MFwp4vpfKwqwMKikamtr3FuiLE47MXLq4VTZHn4HJ1KxZ5VWG44UTeawBs 7YlyI09RkQoM9IDkmZgoHsyGiTqN3Y5iIo4sv/R6t4ZvaMDJlbLjsfuLkGtcPnEon8vWZFYzg Um9myxnHL34bWDM840Si+ACyLwJG2UAbqCuGj7fEv2nnpxH+7Z9yEETP8J5bx5SUAY/EtmWAV 3+CSQ1v1eoIJUHl2pCYoQgS4dASxEpksgqll/nzRu8aqnomFYKcOQj5F2dA+U0wwOTF0/rHYE epdKJvMEwBLSLzy6FWTkaw6bpW2vymN8aaI9UCwWda3EbzLllHRIkSsNPSrQYKbicIHYjFzD4 g12X/iPAu4TjjXSFOjQrdwpPuP2MFv40oRBUwrFr1/D3GaGUkUm1rTSyhdpzS4pbgqC7bznd+ 5U9lzkn9fTth2u5uylUWqFCtNsTKf372tNQElZgS+YmGTvDnEpmolY0xm4DN00W9yZeq/u1YJ pfZam+tsqT+dKNUFJDG0AfcE+4sauDrzuyKUhpu/bLlTgKtWKrVwa+lWF2CJXQosjbx3qSinX L0BbuTOM2j1/S6QjZ91PmeGVDlh73/5Oir5qOpM0mW7iNls5z7hB8jSy0EuBIEgeBGBSfvElt BYek8xCKVYBXM6Z+3Q5V+m6cBBVd94xACOMr6wgd+THXR4f7R9v4TctheJ3q/nBl2UWAN5Hvr 3u/OBH2E4wv0YOhBfvnc9tBg9LAE/AY7iI3umqGMPN/fYesJwwH6nRPQbPY4=
Archived-At: <https://mailarchive.ietf.org/arch/msg/tools-discuss/Khff-OveCsN9OfKVU3LuvWF9RAY>
Subject: Re: [Tools-discuss] [rfc-i] Update: The transition to xml2rfc v3 (today!) (fwd) Heather Flanagan: Update: The transition to xml2rfc v3 (today!)
X-BeenThere: tools-discuss@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF Tools Discussion <tools-discuss.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tools-discuss>, <mailto:tools-discuss-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tools-discuss/>
List-Post: <mailto:tools-discuss@ietf.org>
List-Help: <mailto:tools-discuss-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-discuss>, <mailto:tools-discuss-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 21 Oct 2019 16:47:22 -0000

On 21.10.2019 18:14, Dave Rice wrote:
> Hi all,
>
>> On Oct 9, 2019, at 1:38 PM, Henrik Levkowetz <henrik@levkowetz.com
>> <mailto:henrik@levkowetz.com>> wrote:
>>
>> Hi David,
>>
>> On 2019-10-09 17:32, Dave Rice wrote:
>>> Thanks Henrik,
>>>
>>>> On Sep 20, 2019, at 5:26 PM, Henrik Levkowetz <henrik@levkowetz.com
>>>> <mailto:henrik@levkowetz.com>> wrote:
>>>>
>>>> Hi Michael, David,
>>>>
>>>> On 2019-09-20 23:04, Michael Richardson wrote:
>>>>>
>>>>> Dave Rice <dave@dericed.com <mailto:dave@dericed.com>> wrote:
>>>>>> Another annoyance here is the the xml processor in the submission tool
>>>>>> and the xml processor at
>>>>>> https://xml2rfc.tools.ietf.org/experimental.html
>>>>>> <https://xml2rfc.tools.ietf.org/experimental.html> perform
>>>>>> differently,
>>>>>> so there’s effectively no test environment to use before submitting.
>>>>>> Dave
>>>>>
>>>>> Dave, can you please try xml2rfc.ietf.org
>>>>> <http://xml2rfc.ietf.org>, which is a different installation,
>>>>> supported by a different entity?
>>>>
>>>> Michael:  Umm, no, that redirects to tools.ietf.org
>>>> <http://tools.ietf.org>, too, and the processor
>>>> behind that, and behind
>>>> https://xml2rfc.tools.ietf.org/experimental.html,
>>>> _and_ behind the submission tool are all the latest release of xml2rfc.
>>>>
>>>> David: I'd be happy to look into any discrepancies you see, but I
>>>> can only
>>>> do so if you provide observations and input XML files for me to work
>>>> with.  It won't happen if I don't know about it :-)
>>>
>>
>>> When I use the tool at https://xml2rfc.tools.ietf.org or
>>> https://xml2rfc.tools.ietf.org/experimental.html, the plain text
>>> output appears ok, but when I use
>>> https://datatracker.ietf.org/submit/
>>> <https://datatracker.ietf.org/submit/>, the contents of the
>>> <sourcecode> elements (which are new in xml2rfc version 3) have their
>>> line breaks stripped out and thus cause an error when the line length
>>> limits are exceeded.
>>
>> That sounds like a bug.
>>
>>> For the moment, I’m proposing a find and replace to convert the newer
>>> <sourcecode> elements back to <artwork> elements as in
>>> https://github.com/FFmpeg/FFV1/pull/171/commits/a018f091534678f45cc157bfd154518ad6267c7e
>>> <https://github.com/FFmpeg/FFV1/pull/171/commits/a018f091534678f45cc157bfd154518ad6267c7e>,
>>> thus an xml2rfc version 2 processor or version 3 processor should
>>> proceed accurate results though not as semantically clear in the
>>> xml.
>>>
>>>> FWIW, if you have atools.ietf.org <http://tools.ietf.org/>login, you
>>>> can use the xml2rfc
>>>> issue
>>>> tracker athttps://trac.tools.ietf.org/tools/xml2rfc/trac/newticket, for
>>>> xml2rfc issues, andhttps://trac.tools.ietf.org/tools/ietfdb/newticket
>>>> for datatracker issues.
>>>
>>> I don’t have a login, but I’ll see if I can make a tiny test file for
>>> this issue and file a concise ticket.
>>
>> Please don't put time into this; I'm perfectly happy to work from the xml
>> file you found problematic on submission.  Just let me know the name
>> of the
>> draft in question, so I can pull it.
>
> I just uploaded this new version of the EBML specification to the
> datatracker.
>
>
> On lines 559-609 and 824-939 there are <sourcecode> nodes that contain
> multi-line xml expressions. During the upload the idnit test showed no
> issues or nits at all.  However in the resulting files at
> https://datatracker.ietf.org/doc/draft-ietf-cellar-ebml/12/ the outputs
> remove the line-breaks of the multi-line xml within the <sourcecode>
> nodes. So in the HTML version the <sourcecode> is shown as a single
> line, see
> https://www.ietf.org/id/draft-ietf-cellar-ebml-12.html#name-ebml-schema-example,
> and in the plain text as well, see Section 11.1.1 of
> https://www.ietf.org/id/draft-ietf-cellar-ebml-12.txt.
>
> In another document, I have been find/replacing the <sourcecode> node
> with the older <artwork> node as a workaround.
>
> Best Regards,
>
> Dave Rice
> ...

I had the same problem and reported it as
<https://trac.tools.ietf.org/tools/xml2rfc/trac/ticket/444>.

Best regards, Julian