Re: [precis] draft-whited-precis-test-vectors-00

Martin J. Dürst <duerst@it.aoyama.ac.jp> Tue, 11 December 2018 08:57 UTC

Return-Path: <duerst@it.aoyama.ac.jp>
X-Original-To: precis@ietfa.amsl.com
Delivered-To: precis@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6153412F1A5 for <precis@ietfa.amsl.com>; Tue, 11 Dec 2018 00:57:02 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.381
X-Spam-Level:
X-Spam-Status: No, score=-2.381 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-1.459, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FROM_EXCESS_BASE64=0.979, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=itaoyama.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id PVi5X6R7DnaH for <precis@ietfa.amsl.com>; Tue, 11 Dec 2018 00:57:00 -0800 (PST)
Received: from JPN01-TY1-obe.outbound.protection.outlook.com (mail-eopbgr1400107.outbound.protection.outlook.com [40.107.140.107]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id E2BD712F18C for <precis@ietf.org>; Tue, 11 Dec 2018 00:56:59 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=itaoyama.onmicrosoft.com; s=selector1-it-aoyama-ac-jp; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=+m0lRfT/fFy6XIioeAhMxolDfUkQNDoIXexZMwiJkho=; b=IxI3KkoKc1f+XHOtCo8AuE2/01hwPGfPlX5DhQmBjGKg6gK9H62mfmCaGX4Oov5Wk5lbgG/dIpdzmDDzvjqz4OYw4hWixGnaigiy6RNmxWL7+aDT85CeLSG25ffTd6CiCwmNElQIVrF+M5NNyi88QFPq0BvFZALU34+X76vWNmQ=
Received: from OSAPR01MB4434.jpnprd01.prod.outlook.com (20.179.176.23) by OSAPR01MB1651.jpnprd01.prod.outlook.com (52.134.231.18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1404.19; Tue, 11 Dec 2018 08:56:58 +0000
Received: from OSAPR01MB4434.jpnprd01.prod.outlook.com ([fe80::7847:bb06:297e:c78b]) by OSAPR01MB4434.jpnprd01.prod.outlook.com ([fe80::7847:bb06:297e:c78b%5]) with mapi id 15.20.1404.026; Tue, 11 Dec 2018 08:56:58 +0000
From: "Martin J. Dürst" <duerst@it.aoyama.ac.jp>
To: Sam Whited <sam@samwhited.com>, Tom Worster <fsb@thefsb.org>
CC: "precis@ietf.org" <precis@ietf.org>, Marc Blanchet <246aberdeen@gmail.com>
Thread-Topic: [precis] draft-whited-precis-test-vectors-00
Thread-Index: AQHUkS94AALd8sM/uUmywpt/H6ocyQ==
Date: Tue, 11 Dec 2018 08:56:57 +0000
Message-ID: <85bee3a9-091c-b6f8-7a51-45a84dee37b8@it.aoyama.ac.jp>
References: <1537293673.1189998.1512476568.041D4D88@webmail.messagingengine.com> <2A356330-3E79-40CC-8A62-25790BFE049E@gmail.com> <1544109351.3157581.1600994568.3C5C4DD0@webmail.messagingengine.com> <6760B800-B1C4-4F77-907B-2F671CA39775@thefsb.org> <1544113632.3179679.1601079352.0B318044@webmail.messagingengine.com>
In-Reply-To: <1544113632.3179679.1601079352.0B318044@webmail.messagingengine.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-clientproxiedby: KAWPR01CA0077.jpnprd01.prod.outlook.com (2603:1096:402:c::13) To OSAPR01MB4434.jpnprd01.prod.outlook.com (2603:1096:604:60::23)
authentication-results: spf=none (sender IP is ) smtp.mailfrom=duerst@it.aoyama.ac.jp;
x-ms-exchange-messagesentrepresentingtype: 1
x-originating-ip: [133.2.210.64]
x-ms-publictraffictype: Email
x-microsoft-exchange-diagnostics: 1; OSAPR01MB1651; 6:DHecehjaZSdHiyT6ApjCbpddSSzN8oEBq51A+Xa28AUmHygYITvzTPSrp6P4Mp/fgWn29g4pbgyMD/hRd+ZAYbQX2DJshThCNHp9PEKUr82HNYntS0gk5P9xij+wnNOlz6D/6GmgMM11Cq0nynOrlTyT74mgYGFDsuDFclONSZn1vDdqfnk2vcmMEkro8xzmYjzg1iY5qjAOqckmRgWhySCeHeoMXjQy39Popn7qQq28E7Hq3LRJHfIREU5GtJBV1B4tCwPWG4w/0MwP3uB6A17uVHxZWrkPok16hhZ4jSdCP9SDkDskCU3a4/vpYz4gHQsGBAQWKX03+6nbNW6BIwBsiwgOZ5DosgwF1PpDNJoSg4/+YOqRdqTh1XYeSHPcPBot5Ht3hTmhdZ27AkhMihHhqkJKnlbbNfzDAN+B3juSIMPYdubDuVLkVSIsobeXJuEROYzg1DjkLqlfdEiucA==; 5:WNLmzySjUjz6Zzkiux2U7hRYwP/+07ML95LLn4Fe682jfE/YkotKwu+dpxZGJnZSD/GjxF9pfdG7Fk4wxa3O00H2KT7/Zfta9qYUVdG4iascej5gyIOzeDGWfV45NsQSe2xoCr96F6z18jsGj1WT8/eDYG/Z4NtB7/twnQghEMU=; 7:9XkerYCDr6cmNI9Qqdn57I6jrL+ZD5w3Ypjm77bq260+1z03r3/gIS5rAWOKz4Tql+JgB4C/LxJgVIxb0TgpYf1cw2L6CnCnHRyQ+U29HjMKmUydx7GzxCP4Vsg+QX3rtszZt2i5lmK8lL40/d9V9w==
x-ms-office365-filtering-correlation-id: fe92d8ac-1a9f-4cb0-ef00-08d65f469b54
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390098)(7020095)(4652040)(7021145)(8989299)(4534185)(7022145)(4603075)(4627221)(201702281549075)(8990200)(7048125)(7025125)(7024125)(7027125)(7023125)(5600074)(711020)(2017052603328)(7153060)(7193020); SRVR:OSAPR01MB1651;
x-ms-traffictypediagnostic: OSAPR01MB1651:
x-microsoft-antispam-prvs: <OSAPR01MB16512B0D0693894763420A07CAA60@OSAPR01MB1651.jpnprd01.prod.outlook.com>
x-ms-exchange-senderadcheck: 1
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(3230017)(999002)(6040522)(2401047)(8121501046)(5005006)(93006095)(93001095)(10201501046)(3231472)(944501520)(52105112)(3002001)(148016)(149066)(150057)(6041310)(20161123564045)(20161123560045)(20161123558120)(2016111802025)(20161123562045)(6043046)(201708071742011)(7699051)(76991095); SRVR:OSAPR01MB1651; BCL:0; PCL:0; RULEID:; SRVR:OSAPR01MB1651;
x-forefront-prvs: 08831F51DC
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(376002)(136003)(39840400004)(396003)(346002)(366004)(189003)(13624006)(199004)(786003)(316002)(256004)(76176011)(6512007)(6246003)(8676002)(53936002)(486006)(446003)(31696002)(52116002)(229853002)(31686004)(6506007)(386003)(66066001)(74482002)(39060400002)(86362001)(6436002)(305945005)(7736002)(102836004)(53546011)(26005)(508600001)(105586002)(2906002)(186003)(99286004)(11346002)(4326008)(6486002)(3846002)(85182001)(14454004)(81156014)(110136005)(71190400001)(8936002)(81166006)(85202003)(2616005)(106356001)(97736004)(25786009)(71200400001)(93886005)(68736007)(54906003)(6116002)(476003)(5660300001); DIR:OUT; SFP:1102; SCL:1; SRVR:OSAPR01MB1651; H:OSAPR01MB4434.jpnprd01.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:0;
received-spf: None (protection.outlook.com: it.aoyama.ac.jp does not designate permitted sender hosts)
x-microsoft-antispam-message-info: aeNx/4AaJQUbchyO2NCuZIQhM3sYczA/nwMAz2gZBO5xRiR96EPxUbB+xB+jq9jE/QFb8wVqibMUIJvV1w3VDq4PrsuvbnP5rCrCdOZ/1ZjiYuP6Xu5cxreyWDJ+JPejHNJTAYwrVKMtMp0cAzJ9OA5s5TtkZSxaTxdcvCQ+DyEHvMyCVFHHxL8oQl/QceUv+e/4W5iV8TlkXfpkN5c9MyWnPEvTbudO/Sb/q4nRQYtFbJu61eWNS9IiwMjw5xUnIoZZSOv79eF0mGrD9bWhQMyWG4HukY7gVS20ZU6X7h5GP6UKarZ0/tcURkLg4lhf
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: text/plain; charset="utf-8"
Content-ID: <36BC173E489C654C873F29760234CD5F@jpnprd01.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: it.aoyama.ac.jp
X-MS-Exchange-CrossTenant-Network-Message-Id: fe92d8ac-1a9f-4cb0-ef00-08d65f469b54
X-MS-Exchange-CrossTenant-originalarrivaltime: 11 Dec 2018 08:56:57.9606 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: e02030e7-4d45-463e-a968-0290e738c18e
X-MS-Exchange-Transport-CrossTenantHeadersStamped: OSAPR01MB1651
Archived-At: <https://mailarchive.ietf.org/arch/msg/precis/_9Kugxnc2LQLz2QI94I9-LQIH-c>
Subject: Re: [precis] draft-whited-precis-test-vectors-00
X-BeenThere: precis@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Preparation and Comparison of Internationalized Strings <precis.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/precis>, <mailto:precis-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/precis/>
List-Post: <mailto:precis@ietf.org>
List-Help: <mailto:precis-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/precis>, <mailto:precis-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 11 Dec 2018 08:57:03 -0000


On 2018/12/07 01:27, Sam Whited wrote:
> On Thu, Dec 6, 2018, at 10:12, Tom Worster wrote:
>> First, I also think this work is valuable but I don't understand how the
>> ID is supposed to proceed. The point of bringing it to IETF is to get
>> its authority behind the statement that these specific vectors test
>> conformance to the PRECIS RFCs. How can the IETF give this without
>> restarting the WG to push the ID forwards as a Standards Track RFC? I
>> don't think the independent submission review process can.
> 
> I don't really understand the process, but this makes sense to me and I think you're probably right. I'd be curious to hear if other IETF people who actually understand how any of this works agree or not though.

Based on my past own experience, I understand some of this, but not all 
of it. Besides Standards Track RFCs created by a WG, there's also the 
concept of a draft being sponsored by an Area Director for Standards 
Track. But this isn't used very much these days.

>> Second, my experience is that formatting of test vectors is kinda all
>> over the place in RFCs. I would not look there for guidance. Idk what
>> XML format you refer to but I wouldn't want to go down any XML road as
>> either producer or consumer.
> 
> Sorry, I meant the rfc2xml format; I'm not really sure if there's a name for that.

I'd think there is, it's 'rfc2xml format' or some such. There are 
actually several versions, but that's besides the point by now.

The fact that there's no consistent formatting for test vectors in RFCs 
is probably related to the fact that the IETF *as an organization* is 
not much into testing.

That doesn't mean that most of the people involved wouldn't understand 
the benefit of testing and use testing when developing or deploying 
protocols and similar stuff.

Regards,   Martin.