Re: [arch-d] draft-iab-rfc7500-bis-00 - new principle of measureability

Geoff Huston <gih@apnic.net> Wed, 26 June 2019 23:02 UTC

Return-Path: <gih@apnic.net>
X-Original-To: architecture-discuss@ietfa.amsl.com
Delivered-To: architecture-discuss@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0204D12064A for <architecture-discuss@ietfa.amsl.com>; Wed, 26 Jun 2019 16:02:29 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.9
X-Spam-Level:
X-Spam-Status: No, score=-1.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=apnic.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 8TieU3A0DiYU for <architecture-discuss@ietfa.amsl.com>; Wed, 26 Jun 2019 16:02:26 -0700 (PDT)
Received: from APC01-HK2-obe.outbound.protection.outlook.com (mail-eopbgr1300077.outbound.protection.outlook.com [40.107.130.77]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id DEF4112060A for <architecture-discuss@ietf.org>; Wed, 26 Jun 2019 16:02:25 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=apnic.onmicrosoft.com; s=selector1-apnic-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=R/h6SsWRDsWRbQj1gPtpPr3jmjxkvXsbDvTTWQRnmtA=; b=ZHRvkiQI0GstNL7+sYn2GnmVQh8gvD490550srG2g32JXgxAGG2rVO0c+25ovp/yWQ0PyGGbtbw4DYa+B9DFUafxEy72DrvzGepCMZ9zfPW0e/jIbUcSSpjLASmYvO2rvXAhy0iagBdcpcltfcsG3LzBGE4fbbSDC4QPmZqB48A=
Received: from PS1PR04MB2839.apcprd04.prod.outlook.com (52.133.231.81) by PS1PR04MB2725.apcprd04.prod.outlook.com (20.177.132.17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2008.16; Wed, 26 Jun 2019 23:02:22 +0000
Received: from PS1PR04MB2839.apcprd04.prod.outlook.com ([fe80::ed76:a0e6:bdc4:e2c8]) by PS1PR04MB2839.apcprd04.prod.outlook.com ([fe80::ed76:a0e6:bdc4:e2c8%3]) with mapi id 15.20.2008.014; Wed, 26 Jun 2019 23:02:21 +0000
From: Geoff Huston <gih@apnic.net>
To: Jay Daley <jay@daley.org.nz>
CC: "architecture-discuss@ietf.org" <architecture-discuss@ietf.org>, "iab@iab.org" <iab@iab.org>
Thread-Topic: [arch-d] draft-iab-rfc7500-bis-00 - new principle of measureability
Thread-Index: AQHVLGhfOJfrTfS/ZE2zKN2XTP4GAKaujZOA
Date: Wed, 26 Jun 2019 23:02:21 +0000
Message-ID: <E7428B2B-2E90-4962-B5D1-75DD2E4ADD62@apnic.net>
References: <69EAE468-64DC-40C8-9D49-BEAEA0E7EDF3@daley.org.nz>
In-Reply-To: <69EAE468-64DC-40C8-9D49-BEAEA0E7EDF3@daley.org.nz>
Accept-Language: en-AU, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-clientproxiedby: SYBPR01CA0140.ausprd01.prod.outlook.com (2603:10c6:10:5::32) To PS1PR04MB2839.apcprd04.prod.outlook.com (2603:1096:803:40::17)
x-originating-ip: [2001:44b8:110b:5100:d417:dbe3:db5d:4f28]
authentication-results: spf=none (sender IP is ) smtp.mailfrom=gih@apnic.net;
x-ms-exchange-messagesentrepresentingtype: 1
x-mailer: Apple Mail (2.3445.104.11)
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 1eb01a3f-7193-4b1a-f8d3-08d6fa8a5853
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600148)(711020)(4605104)(1401327)(2017052603328)(7193020); SRVR:PS1PR04MB2725;
x-ms-traffictypediagnostic: PS1PR04MB2725:
x-ms-exchange-purlcount: 1
x-microsoft-antispam-prvs: <PS1PR04MB2725B78896F93717A6F53E20B8E20@PS1PR04MB2725.apcprd04.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-forefront-prvs: 00808B16F3
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(366004)(396003)(346002)(376002)(39840400004)(136003)(189003)(199004)(6486002)(316002)(66556008)(6512007)(46003)(11346002)(102836004)(4326008)(476003)(305945005)(6916009)(66476007)(2616005)(478600001)(2906002)(86362001)(6116002)(486006)(446003)(966005)(25786009)(68736007)(36756003)(71190400001)(71200400001)(33656002)(6436002)(256004)(64756008)(6306002)(53546011)(14454004)(229853002)(53936002)(6246003)(99286004)(50226002)(81166006)(81156014)(186003)(386003)(8936002)(5660300002)(73956011)(6506007)(76176011)(66946007)(7736002)(66446008)(8676002)(57306001)(52116002)(54906003); DIR:OUT; SFP:1101; SCL:1; SRVR:PS1PR04MB2725; H:PS1PR04MB2839.apcprd04.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: apnic.net does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: PJ87WyEvazbRrj7tYY247ASttQTDuFLExppHJu7OV6dEQDiQnX7kRDd9QTQS6DeSRyI+Sb75LDdZQiAgOCdWUXRyzIL395DzEFkwVUcslSb4hwEuFfzJlbW7X1w7A81BHhYTW6WP1o6Sys0goqPs1kRRJv+FYKsSkSrlTvi4l5qQRTPJh8nvlvqs3D452LiyOM4IFij7qR4fQeip+uJzGTCb7O2J2hEa2Bbaont2JVQz+W3i1NjXbmm34NKksC8qakuUmbi2uS9EQyQ8s9xwMquNRBJHMCOp4n5CT0BGJTETxy3v0xYYIFYt2VZiGF/v323asQCUflwQ0LV45SBAGtbCuXGahkIbWic4i+K+qxiOxFgt+ctu/Cl3uEYsnQxRAsxDhGK0PzBnW0lUQDoyk2uJirUzQGCz64NqWwwSfLY=
Content-Type: text/plain; charset="utf-8"
Content-ID: <0D0B2EF955712841A0D207858D36E09B@apcprd04.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: apnic.net
X-MS-Exchange-CrossTenant-Network-Message-Id: 1eb01a3f-7193-4b1a-f8d3-08d6fa8a5853
X-MS-Exchange-CrossTenant-originalarrivaltime: 26 Jun 2019 23:02:21.7131 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 127d8d0d-7ccf-473d-ab09-6e44ad752ded
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: gih@apnic.net
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PS1PR04MB2725
Archived-At: <https://mailarchive.ietf.org/arch/msg/architecture-discuss/Hv2oYwhA53uzfiulmnZ8KYholEw>
Subject: Re: [arch-d] draft-iab-rfc7500-bis-00 - new principle of measureability
X-BeenThere: architecture-discuss@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: open discussion forum for long/wide-range architectural issues <architecture-discuss.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/architecture-discuss>, <mailto:architecture-discuss-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/architecture-discuss/>
List-Post: <mailto:architecture-discuss@ietf.org>
List-Help: <mailto:architecture-discuss-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/architecture-discuss>, <mailto:architecture-discuss-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 26 Jun 2019 23:02:36 -0000

OK, I’ll bite.

What _exactly_ do you mean by "the performance of an IANA registry”?


> On 27 Jun 2019, at 7:44 am, Jay Daley <jay@daley.org.nz> wrote:
> 
> I support the principles as documented but feel that there is one more that needs to be added:
> 
> * Measurability
> The operations of IANA registries must include the collection and publication of sufficient data, in accordance with the other principles of openness and transparency, to allow their performance, both current and historical, to be measured and to assess whether they are  delivering their services in accordance with the other principles and the registry policies.
> 
> 
> My reasoning to add this as a specific principle is because any assessment of the performance of an IANA registry requires data.  However, I have too often come across the situation where openness, transparency and even accountability are insufficient to ensure that this happens.  Common excuses include "we don’t collect the data", "the data belongs to our customers not us", "the data is unreliable", "the data we collect doesn’t measure our performance" and so on.  Adding this as an explicit principle ensures that data is collected and that it is fit for purpose and collected under the terms that allow it to be used for this purpose. 
> 
> 
> As a background to this comment I should note that I was part of the team that designed the naming functions SLA for PTI and an inaugural member of the Customer Standing Committee within ICANN that assesses and reports on PTI’s delivery of the IANA naming function in accordance with the SLA.
> 
> cheers
> Jay
> 
> 
> -- 
> Jay Daley
> jay@daley.org.nz
> +64 21 678840
> skype: jaydaley
> twitter: @jay_daley
> 
> _______________________________________________
> Architecture-discuss mailing list
> Architecture-discuss@ietf.org
> https://www.ietf.org/mailman/listinfo/architecture-discuss