Re: [PANRG] [irsg] IRSG review request draft-irtf-panrg-what-not-to-do-13

Colin Perkins <csp@csperkins.org> Tue, 20 October 2020 22:44 UTC

Return-Path: <csp@csperkins.org>
X-Original-To: panrg@ietfa.amsl.com
Delivered-To: panrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4C6473A1447; Tue, 20 Oct 2020 15:44:31 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level:
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_BLOCKED=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=csperkins.org
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id alN6qZVWyOFC; Tue, 20 Oct 2020 15:44:29 -0700 (PDT)
Received: from balrog.mythic-beasts.com (balrog.mythic-beasts.com [IPv6:2a00:1098:0:82:1000:0:2:1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 10D733A1466; Tue, 20 Oct 2020 15:44:29 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=csperkins.org; s=mythic-beasts-k1; h=To:Date:From:Subject; bh=o1lRP9Ezvk2RwwzEsUwKu5EnPX99drqnTwp34VuCLac=; b=qyTyo8ZUK8H/yJpqxmoLoR7PPn tAFJZudKPEDXcbGKP5eVvl2VDD0juHlDKH22UrNSY/nheBVPYcPUz6Ekff0ZrxMgiG/rTbn1YzCLb WHom7WUx72jMXW2S/lG8mdofdYHL8rljMdlAsVDYXxm6chZl7dO+Q+0iqywmbSB0JJmtJZwgKN5LG kqLkCKoA8E/8ugbl2IWubElNGgQh7ve/3QhnGnbadl2vgTj/zICV1j5Svb7v8V9lVsMJRuNUUjHhP KcpEKjaBQ407o/x/qUi7n9PWuM92R3Kr5+nJEST0j0rgTQAuzPAUOBP9bSTGEoq/p3oDJiFBCFFeL K4Nvl1Qw==;
Received: from [81.187.2.149] (port=43129 helo=[192.168.0.67]) by balrog.mythic-beasts.com with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92.3) (envelope-from <csp@csperkins.org>) id 1kV0Mg-0003bj-TE; Tue, 20 Oct 2020 23:44:27 +0100
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.17\))
From: Colin Perkins <csp@csperkins.org>
In-Reply-To: <86ae7b43-c3af-f233-4027-7341509bae34@cdt.org>
Date: Tue, 20 Oct 2020 23:44:19 +0100
Cc: The IRSG <irsg@irtf.org>, Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com>, panrg@irtf.org
Content-Transfer-Encoding: quoted-printable
Message-Id: <5E9B27E0-031A-440B-8403-3DF01B042205@csperkins.org>
References: <383122CA-DB74-4E34-B7C9-B8E629871E98@csperkins.org> <86ae7b43-c3af-f233-4027-7341509bae34@cdt.org>
To: Mallory Knodel <mknodel@cdt.org>
X-Mailer: Apple Mail (2.3445.104.17)
X-BlackCat-Spam-Score: 4
Archived-At: <https://mailarchive.ietf.org/arch/msg/panrg/ctsNuDu-TqG665kn1lP-E_2n0IA>
Subject: Re: [PANRG] [irsg] IRSG review request draft-irtf-panrg-what-not-to-do-13
X-BeenThere: panrg@irtf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Path Aware Networking \(Proposed\) Research Group discussion list" <panrg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/panrg>, <mailto:panrg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/panrg/>
List-Post: <mailto:panrg@irtf.org>
List-Help: <mailto:panrg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/panrg>, <mailto:panrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Tue, 20 Oct 2020 22:44:35 -0000

Thanks for the review, Mallory!

Colin



> On 20 Oct 2020, at 20:47, Mallory Knodel <mknodel@cdt.org> wrote:
> 
> Dear Spencer, panrg and irsg:
> 
> It was my pleasure to read this document as it was a thorough compendium of Path Aware Networking in the IETF and serves as a great primer!
> 
> My main comments on the draft are really to increase accessibility and readability of what surely is thorough, complete and clear documentation of a high quality appropriate for IRTF documents. I also realise that because my suggested edits are quite structural, that it's very likely you've had these conversations in the RG already and so if this walks back a previous agreement, feel free to disregard.
> 
> While I read, I did a lot of flipping back and forth, particularly between Sections 2 and 5. I usually do a lot of flipping anyway; this review was uniquely flip-heavy. You also have a lot of internal references. I'd suggest a restructure thusly:
> 
>  * Section 1: Pairing down mostly meta information about the RG (documented elsewhere), doc (not all the background is pertienent context), etc so that the reader gets to the lessons quicker.
> 
>  * Section 4: Make this a methodology section right after the introduction, also to potentially guide future contributions. You can then explain how you first collected contributions and then extracted the important details, drew lessons learned and conclusions. You can explain here categories for Table 1.
> 
>  * Compress Sections 2, 3 and 5. I can see value in just getting the lessons upfront, but if you perhaps nest the various contributions wisely you can create sub-sections and even sub-sub-sections here, allowing you to give the reader the highest points (Section 3), followed by generalisations (Section 2), followed by Sub-sections (Section 5). Your headings are well phrased, such that if one doesn't want to read the details of Section 5, they can stop reading and/or skip. This also allows your Section 5 to be sparse-- perhaps there's sufficient documentation elsewhere on the internet that you could simply reference and leave in just a summary/abstract of lessons learned without the burden of having to include the data of a full contribution.
> 
> If you take my last suggestion, you might want to add to your template for contributions that you'd like a summary/abstract (a la Section 2) and a suggested category (a la Table 1).
> 
> Lastly I'll point out that "What Not To Do" is a terrific framing, but then you need to ensure that your Section 2 headings/section titles have the same value frame (positive vs negative). Eg "DO Justify Deployment" or "DON'T React to Distant Signals". Whatever it is, just pick one and then adjust the rest. Or spell it out in each sub-section title.
> 
> Nits:
> 
>  * Someone like me needs just one sentence in the introduction about the problem that PAN solves. It's probably just so obvious to you all!
> 
>  * The first paragraph of 1.1. seems to be missing a specific reference to "path aware networking" otherwise it's quite generic a statement.
> 
>  * RFC 5218 seems like an appropriate reference for 2.1, 2.2 and 2.3? Again, pretty generic and not PAN specific, seemingly.
> 
>  * 2.1 would suggest "_U.S._ American English" since most of America (the hemisphere) doesn't even speak English, and we also appreciate Canadian Anglophones who may or may not use this phrase.
> 
>  * 2.6 last sentence: You might have meant "These _changes_ may make deployment..."
> 
>  * 2.7 Needs perhaps another sentence that answers "Why?".
> 
>  * 1.4, 2.12 there are sometimes notes about what might be done to mitigate the problem faced. These might be out of scope? But probably they are extra valuable and should be emphasized in a separate sub-section or summary, somewhere.
> 
> -Mallory
> 
> On 9/6/20 2:45 PM, Colin Perkins wrote:
>> IRSG members,
>> 
>> The Path Aware Networking Research Group has requested that draft-irtf-panrg-what-not-to-do-13 be considered for publication as an IRTF RFC. To progress this draft, we now need *at least one* IRSG member to volunteer to provide a detailed review of the draft, as follows:
>> 
>>> The purpose of the IRSG review is to ensure consistent editorial and technical quality for IRTF publications. IRSG review is not a deep technical review. (This should take place within the RG.) At least one IRSG member other than the chair of the RG bringing the work forth must review the document and the RG’s editorial process.
>>> 
>>> IRSG reviewers should look for clear, cogent, and consistent writing. An important aspect of the review is to gain a critical reading from reviewers who are not subject matter experts and, in the process, assure the document will be accessible to those beyond the authoring research group. Also, reviewers should assess whether sufficient editorial and technical review has been conducted and the requirements for publication described in RFC 5743  have been met. Finally, reviewers should check that appropriate citations to related research literature have been made.
>>> 
>>> Reviews should be written to be public. Review comments should be sent to the IRSG and RG mailing lists and entered into the tracker. All IRSG review comments must be addressed. However, the RG need not accept every comment. It is the responsibility of the shepherd to understand the comments and ensure that the RG considers them including adequate dialog between the reviewer and the author and/or RG. Reviews and their resolution should be entered into the tracker by the document shepherd.
>>> 
>>> The IRSG review often results in the document being revised. Once the reviewer(s), authors, and shepherd have converged on review comments, the shepherd starts the IRSG Poll on whether the document should be published.
>> Please respond to this message if you’re able to perform such a review, and indicate the approximate time-frame by which you’ll be able to complete it. The document shepherd write-up is available at  https://datatracker.ietf.org/doc/draft-irtf-panrg-what-not-to-do/shepherdwriteup/
>> 
>> Thanks!
>> 
>> Colin (as IRTF chair)
> 
> -- 
> Mallory Knodel
> CTO, Center for Democracy and Technology
> gpg fingerprint :: E3EB 63E0 65A3 B240 BCD9 B071 0C32 A271 BD3C C780
> 
> 



-- 
Colin Perkins
https://csperkins.org/