Re: [arch-d] [IAB] Review of: draft-iab-protocol-transitions-05

Dave Thaler <dthaler@microsoft.com> Tue, 21 February 2017 23:39 UTC

Return-Path: <dthaler@microsoft.com>
X-Original-To: architecture-discuss@ietfa.amsl.com
Delivered-To: architecture-discuss@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6D73E1293DF for <architecture-discuss@ietfa.amsl.com>; Tue, 21 Feb 2017 15:39:00 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.021
X-Spam-Level:
X-Spam-Status: No, score=-2.021 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=microsoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id gX_ascrtm7KI for <architecture-discuss@ietfa.amsl.com>; Tue, 21 Feb 2017 15:38:57 -0800 (PST)
Received: from NAM01-BN3-obe.outbound.protection.outlook.com (mail-bn3nam01on0115.outbound.protection.outlook.com [104.47.33.115]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 888FA1204D9 for <architecture-discuss@ietf.org>; Tue, 21 Feb 2017 15:38:57 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=KsTw0bFdE3MQFrVUO3rDFuCwYTWnxbvQ39aFCnGCWgE=; b=lfLt5TpBayFqPcGiqXv7FxCB+fJ8qvMDv5IeHDCfyuSiIetQXSEj2886DNT2rnnKITN2NPy23NiDvg17eh5uhgqqwdsHt1ZcXe8aAlf627mYOUASrA5ubBtjx+Zms/lYP+M4GidMP3/m8jm4/cq3gKB+v9/sIMO0aikxsp/hnec=
Received: from CY1PR03MB2265.namprd03.prod.outlook.com (10.166.207.17) by CY1PR03MB2265.namprd03.prod.outlook.com (10.166.207.17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.919.13; Tue, 21 Feb 2017 23:38:55 +0000
Received: from CY1PR03MB2265.namprd03.prod.outlook.com ([10.166.207.17]) by CY1PR03MB2265.namprd03.prod.outlook.com ([10.166.207.17]) with mapi id 15.01.0919.018; Tue, 21 Feb 2017 23:38:55 +0000
From: Dave Thaler <dthaler@microsoft.com>
To: "dcrocker@bbiw.net" <dcrocker@bbiw.net>
Thread-Topic: [IAB] Review of: draft-iab-protocol-transitions-05
Thread-Index: AQHScNl1qYf98Gy9+UeZm6opVlvecKF0T/lQ
Date: Tue, 21 Feb 2017 23:38:55 +0000
Message-ID: <CY1PR03MB2265F13AFF92042F98B0F378A3510@CY1PR03MB2265.namprd03.prod.outlook.com>
References: <80f3ae1d-b303-7d58-7b14-495dc09e6f05@dcrocker.net>
In-Reply-To: <80f3ae1d-b303-7d58-7b14-495dc09e6f05@dcrocker.net>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=dthaler@microsoft.com;
x-originating-ip: [2001:4898:80e8:7::452]
x-ms-office365-filtering-correlation-id: 621392e9-8292-4d4b-50c1-08d45ab2cd37
x-ms-office365-filtering-ht: Tenant
x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001)(48565401081); SRVR:CY1PR03MB2265;
x-microsoft-exchange-diagnostics: 1; CY1PR03MB2265; 7:qghFLayUjGFaISRkiqm7E9mBXNp4h48oG2+7u7/M/CxJvlc5dwdLhlWtWrYiHSKwjaI8tIlsmzKEAOuxlMdGJgUTuqpVd0RfwSus0Zrri2BR5AESIkZ61iGOn4ST9S5OqTSEBsJHGqgErhN3hK6sLbHcZhd0HMxAq7CigI/Mqfqq7g3mc94y1kndGsnvPgmLCwHWnClZoT9K8Ooh4SEdy2tE9SaNAyBV+Bu+D3UeZw2qpM4wT5XswkLdx2XEQmDWWApT7yCl89UK0TXITKXBodYFcnboaN7UCmhQwsBX88OUEMKB1uCoQUGuw0FQwacvZWXbMvXAhU4I+OdGTU7NFiKXPyh3kDjs1P4SASaqL3c=
x-microsoft-antispam-prvs: <CY1PR03MB22658EFA096A1A45A88AB223A3510@CY1PR03MB2265.namprd03.prod.outlook.com>
x-exchange-antispam-report-test: UriScan:(788757137089)(100405760836317)(155532106045638)(21748063052155)(148717330147763);
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(61425038)(6040375)(601004)(2401047)(8121501046)(5005006)(10201501046)(3002001)(6055026)(61426038)(61427038)(6041248)(20161123560025)(20161123558025)(20161123564025)(20161123562025)(20161123555025)(6072148); SRVR:CY1PR03MB2265; BCL:0; PCL:0; RULEID:; SRVR:CY1PR03MB2265;
x-forefront-prvs: 0225B0D5BC
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(6009001)(7916002)(39850400002)(39860400002)(39840400002)(39410400002)(39450400003)(189002)(199003)(6116002)(2906002)(230783001)(97736004)(6246003)(53936002)(3660700001)(6916009)(2950100002)(102836003)(50986999)(54356999)(38730400002)(2501003)(790700001)(110136004)(229853002)(76176999)(5005710100001)(189998001)(105586002)(122556002)(5630700001)(10090500001)(106356001)(8990500004)(106116001)(2351001)(74316002)(101416001)(5660300001)(68736007)(4326007)(55016002)(25786008)(92566002)(5640700003)(7696004)(99286003)(8936002)(33656002)(10290500002)(81166006)(9686003)(7736002)(1730700003)(77096006)(86612001)(6306002)(81156014)(54896002)(86362001)(3280700002)(2900100001)(8676002)(6506006)(6436002); DIR:OUT; SFP:1102; SCL:1; SRVR:CY1PR03MB2265; H:CY1PR03MB2265.namprd03.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en;
received-spf: None (protection.outlook.com: microsoft.com does not designate permitted sender hosts)
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/alternative; boundary="_000_CY1PR03MB2265F13AFF92042F98B0F378A3510CY1PR03MB2265namp_"
MIME-Version: 1.0
X-OriginatorOrg: microsoft.com
X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Feb 2017 23:38:55.7543 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY1PR03MB2265
Archived-At: <https://mailarchive.ietf.org/arch/msg/architecture-discuss/shMdD8xrU_ei3nVHpiYA2f0OTuc>
Cc: "architecture-discuss@ietf.org" <architecture-discuss@ietf.org>
Subject: Re: [arch-d] [IAB] Review of: draft-iab-protocol-transitions-05
X-BeenThere: architecture-discuss@ietf.org
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: open discussion forum for long/wide-range architectural issues <architecture-discuss.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/architecture-discuss>, <mailto:architecture-discuss-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/architecture-discuss/>
List-Post: <mailto:architecture-discuss@ietf.org>
List-Help: <mailto:architecture-discuss-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/architecture-discuss>, <mailto:architecture-discuss-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 21 Feb 2017 23:39:00 -0000

Thanks Dave for the detailed review!



I have accepted the editorial nits, and made other changes as noted below.



    The document is well-organized and well-written.  There are some clarifications and expansions worth considering, as noted below, and some basic points cited here:



    The document tends to merely mention essential issues, such as incentives, without giving much insight into either methods for adequately assessing incentives or deciding how to consider them in protocol design.



Unfortunately we may not have a lot of experience with such methods.  However, I have made several notable changes in response to this and others’ comments.

An Extensibility section now discusses extensibility in more detail and refers to the IAB’s recent RFC 6709 regarding protocol design.

A Conclusions section now encourages the community to share such insights and future experiences, on the architecture-discuss list.



    The document also seems to conflate "adoption" with "transition".

Much of the content of the document applies to initial adoption of a protocol, as well as to later transitions to revisions.  While transitions carry significant additional burdens, beyond initial adoption, the IETF needs attention to initial adoption issues every bit as much as it needs attention to transition issues.



Added terminology point to the Introduction saying that transition is generic, with four types of transition (adoption of a new protocol with no precedent, transitioning from an old to a new protocol, transitioning from an old to a new version of a protocol, and decommissioning of an obsolete protocol).  Of course some points in the doc apply more strongly to certain types of transition.



    Although the document references open source implementations and the challenges of having a timeline, it should emphasize the role of the former more and the severe problems with the latter.



I rewrote the section about timelines and criteria for phrases based on your feedback.



    Might be worth adding some examples of highly successful transitions.  MIME is, predictably, my favorite example.  There had been multiple attempts to replace existing, text-based email with a new version that supported multi-media.  MIME instead created an overlay that required no change to the infrastructure.



When the discussed it, the consensus was that additional case studies in the doc were not necessary.  Unless of course there’s a key point that would be called out that isn’t captured at all in the other case studies.



    These above suggestions are in line with Eliot's call for more 'meat'.  The document touches on essential issues.  But for the IETF to deal with the issues well, there needs to be more detailed basis giving guidance for how to attend to them. This is particularly important for issues such as incentives analysis and aligning to incentives, since they are topics not normally within the purview of Internet engineers.

(If the feeling is that the meat should be added via later documents then there should at least, now, be development of some plan for those

documents.)



    Stewart's call for considering the requirement of transition considerations -- I'd suggest 'adoption considerations' -- would press working groups to do far more due diligence about the barriers to adoption that is typically done now.



Perhaps, but that’s feedback for the IESG to consider, rather than the IAB’s purview per se.



Detailed:



I believe I’ve incorporated your various detailed points into the new draft, soon to be posted…



BTW, the case studies were written by others (I’m the editor) and so there may still be
additional changes after that to address some of your points in the IPv6 case study.



Dave