Re: [Gendispatch] Fwd: New Version Notification for draft-nottingham-iesg-review-workload-00.txt

Adrian Farrel <adrian@olddog.co.uk> Fri, 31 March 2023 00:53 UTC

Return-Path: <adrian@olddog.co.uk>
X-Original-To: gendispatch@ietfa.amsl.com
Delivered-To: gendispatch@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A7253C14CE4A for <gendispatch@ietfa.amsl.com>; Thu, 30 Mar 2023 17:53:36 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.792
X-Spam-Level:
X-Spam-Status: No, score=-2.792 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=olddog.co.uk
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id HiXrVkX1uQo7 for <gendispatch@ietfa.amsl.com>; Thu, 30 Mar 2023 17:53:32 -0700 (PDT)
Received: from mta8.iomartmail.com (mta8.iomartmail.com [62.128.193.158]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id F10EDC14CEF9 for <gendispatch@ietf.org>; Thu, 30 Mar 2023 17:53:31 -0700 (PDT)
Received: from vs3.iomartmail.com (vs3.iomartmail.com [10.12.10.124]) by mta8.iomartmail.com (8.14.7/8.14.7) with ESMTP id 32V0rT3b017020; Fri, 31 Mar 2023 01:53:29 +0100
Received: from vs3.iomartmail.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id EF24E4604B; Fri, 31 Mar 2023 01:53:28 +0100 (BST)
Received: from vs3.iomartmail.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id D9CD74604A; Fri, 31 Mar 2023 01:53:28 +0100 (BST)
Received: from asmtp2.iomartmail.com (unknown [10.12.10.249]) by vs3.iomartmail.com (Postfix) with ESMTPS; Fri, 31 Mar 2023 01:53:28 +0100 (BST)
Received: from LAPTOPK7AS653V (dhcp-8a91.meeting.ietf.org [31.133.138.145]) (authenticated bits=0) by asmtp2.iomartmail.com (8.14.7/8.14.7) with ESMTP id 32V0rPdj022806 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Fri, 31 Mar 2023 01:53:27 +0100
Reply-To: adrian@olddog.co.uk
From: Adrian Farrel <adrian@olddog.co.uk>
To: 'Martin Thomson' <mt@lowentropy.net>, gendispatch@ietf.org
References: <168016566375.62790.7482502869993780606@ietfa.amsl.com> <180F04B6-DD6F-4034-9318-E5975570229A@mnot.net> <89babe8e-1022-e6bd-22f2-137b4189e678@joelhalpern.com> <fec8ee0c-e252-41d7-b27c-dd4891f639f3@app.fastmail.com>
In-Reply-To: <fec8ee0c-e252-41d7-b27c-dd4891f639f3@app.fastmail.com>
Date: Fri, 31 Mar 2023 01:53:23 +0100
Organization: Old Dog Consulting
Message-ID: <065c01d9636b$3467d210$9d377630$@olddog.co.uk>
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Mailer: Microsoft Outlook 16.0
Thread-Index: AQEvgcQaJWE1RqpNtId3NH4qELAaKwJkh4+aAj2TOBwBmppiorA15M7A
Content-Language: en-gb
X-Originating-IP: 31.133.138.145
X-Thinkmail-Auth: adrian@olddog.co.uk
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed; d=olddog.co.uk; h=reply-to :from:to:references:in-reply-to:subject:date:message-id :mime-version:content-type:content-transfer-encoding; s= 20221128; bh=g8NpMJruukJMY7Ag236NBSvvU/ly3fJlehjcrexFSgs=; b=wxH sMIr5g4p8XpaGz5xKiwLvAZ+Ajalxzes8PLfV2j+SxNPhpoWGUmnhU+zgvyrkmOb jgjlNAHw8iItL7xGrOvDo5E/jRL3dc9la7GxFoW8RJGWlfEz5aiSIF0VVQngzXan c4JVkcrqQsi7vu8YhayD5HK5zHA1Mrn0I3mytRu1SSxE41h58Khzbv1XXRwyXwPA CgInjKZQptzqqI8N6HYSWB5gQ8ZP43Bg+J6t2eihVTb4JQmW7t8iM3kueB4JGqgL Ete8Fe7w3kJOXsjxoVtYV0mQi9stgmAfN/ftHvVh8v0EYEkvDQFkgIRQZRwIxPG5 junJdAjVpzUDGKChgkw==
X-TM-AS-GCONF: 00
X-TM-AS-Product-Ver: IMSVA-9.1.0.2090-9.0.0.1002-27536.003
X-TM-AS-Result: No--43.568-10.0-31-10
X-imss-scan-details: No--43.568-10.0-31-10
X-TMASE-Version: IMSVA-9.1.0.2090-9.0.1002-27536.003
X-TMASE-Result: 10--43.568000-10.000000
X-TMASE-MatchedRID: yebcs53SkkDH1DfC+QNQxHFPUrVDm6jtT5ysQDj6eFk8a+/GjoiAqoCu qghmtWfXO2tkv7yhGRh9H7jaVSoagJsvf4playkmqug9vIA2WOB2ZYwNBqM6IgMSY7fRnXWmilJ mlF8p4QdoBTbHAuitAZlMTUqmcwNN/hJqnvjq3yRtvgnIwr6TMHFmRH67eyYF23s+ayc5uyDlA7 g/sXkwnLZL+//Kmaihzn8eesnlZ61GfA2m7eIM7lgXNZMUqXg/V2y0V2O63Z6h4s/17FYH2+ZkX qvcLVUN569lf1pI1cY1B26nOjZSiOvw27dAZl0TX9knSHW8uXU5zptjhyYKWOyf6HZjZM2q7OlO YVK73jpCUd+qZJ6IfEDLpuSjvE/0C8rqoD4fFj7mnV13DpXhG+BxDG9RMJ9KtQ/LVkvyRl1xEW0 uzmaRA1dieYFU91OPQshhOzwPKUUjQvIpMtTP/w2bPyoJqnZLj5wsq7eXg6cIR2QTo4pVcLF8aD C4k1nfQZ6svIellgPHL92FxcRP9swrDggcQ6d1CtzGvPCy/m4L//VMxXlyExOkPFv9O23Kjdx5F dhImgPoDqj7gGcE5nM8f9tDu/DuDtBt+r/CzCoapIb9znReA1x5UEiF/A71nqTMYg6eO4aHRuQ3 ss9jrZgPHP4Y2vwV+6AJSQgSFRI7kso8D8hMBbPx3rO+jk2QAp6lsfTM3hkVG/fse7bPPMbpeiJ XjA4MK1OIo1kOJjMwcyw/JIpenZFN+B8oJZ5aKwi7MItzaY3pKYVp5Qz2974T+A10ZW/s5wMPMq dPNSwQsAd5ZaEQ+JGTpe1iiCJqtD9qpBlNF8qWwBC0tiSzK5uTdmBzA9G/DMq3z/Y/gtW8QIu4z 6HhEH7cGd19dSFd
X-TMASE-SNAP-Result: 1.821001.0001-0-1-22:0,33:0,34:0-0
Archived-At: <https://mailarchive.ietf.org/arch/msg/gendispatch/AOr1s4Xz3ycBizNWLQK2LBj2jtg>
Subject: Re: [Gendispatch] Fwd: New Version Notification for draft-nottingham-iesg-review-workload-00.txt
X-BeenThere: gendispatch@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: General Area Dispatch <gendispatch.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/gendispatch>, <mailto:gendispatch-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/gendispatch/>
List-Post: <mailto:gendispatch@ietf.org>
List-Help: <mailto:gendispatch-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/gendispatch>, <mailto:gendispatch-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 31 Mar 2023 00:53:36 -0000

There's a great risk in perpetuating the status quo by saying, "When I was
on the IESG..." So, yes, having the discussion "outside the ivory tower" is
important.
Of course, the current IESG can tell us what process they follow and what
they hope will be the interaction with the community. And they can also
explain what they feel to be the conflicting pressures on their time.
I think the community can suggest ways of operating that might improve
things, but that is probably verging on frustrating for the IESG who know
what work methods work for them.

But the big points have to be:
- How does the community receive communications from the IESG?
- What tasks are the IESG prioritising, and what is the impact on the
community?
- What elements of the work flow appear, to the community, to cause
friction?

Mark's draft seems, to me, to be a good starting point for allowing the
community to coherently tell the IESG what it thinks. If Rich produces
another draft capturing other ideas and views, all to the good. Although
(perhaps) the IESG will get a clearer message if we are able to merge our
thoughts into a single document.

To the direct point about the communications during IESG evaluation...
1. If Directorate reviews completed during IETF last call, then the ADs
would not need to "support" the reviews and make them part of their
Discusses. The reviews would simply be treated as part of IETF last call and
handled accordingly. (The boilerplate on the review might usefully change
the tone from "this is a review for the FOO AD" to "the FOO AD has asked me
to do this review as part of IETF last call.")
2. The "game of telephone" really does take place. I don't think it shows
any malice or incompetence, but it might be a symptom of overwork. It is
easily cured by all Comments and Discusses automatically going to the WG
mailing list so that all follow-up communications also go there. The drafts
are a product of the WG (not just the front-page authors), and while the
authors hold the pen and have an interest in negotiating progress for the
document, the WG has a right to know what is going on and why their work is
being changed.

To the much debated point that, "the ADs are not overloaded, just a bit
behind"...
I continue to think that a draft that goes to an AD as "publication
requested" needs to complete AD review within a month. Of course there are
blips, but I think that the blips are what take the time up to a month from
a shorter time.
Of course the "sponsoring AD" feels a responsibility to approve the content
of the document, and maybe this is one of their higher priorities. If so,
they need to treat it as a priority by saying to themselves, "This draft is
going for IETF last call in 2 weeks' time, and if I have not reviewed it by
then, I will be letting myself down." [*]
I would note that the enforced agenda of IESG telechats *does* cause ADs to
review documents.

So, and back to Mark's draft, if the ADs don't have enough resource to meet
the desires/expectations of the community, they must be bold and say so. The
community cannot help or manage the IESG if the IESG is not clear and open
about the problems. The IESG does not need to feel that it must fix the
problems (although it is welcome to do so) - this is a problem for the
community, and the community must tell the IESG what it wants to see happen.

Cheers,
Adrian

[*] Previously, when I have raised concerns about documents waiting for AD
review for more than 200 days, individual ADs have asked, "Do you mean me?"
By all means go ahead and feel guilty! But I am not targeting any one AD:
this is an IESG problem that the community must help the IESG solve.


-----Original Message-----
From: Gendispatch <gendispatch-bounces@ietf.org> On Behalf Of Martin Thomson
Sent: 31 March 2023 00:21
To: gendispatch@ietf.org
Subject: Re: [Gendispatch] Fwd: New Version Notification for
draft-nottingham-iesg-review-workload-00.txt

It seems to me like Mark is challenging that mode of operation also.  That
is, he is suggesting that when that delegation occurs, it is more complete
than it is today.

I do somewhat like the idea that maybe the discussion could be conducted
outside of the ivory tower somewhat more than it is today.  As a document
author, I often find myself frustrated by the game of telephone that occurs
during IESG review.

On Thu, Mar 30, 2023, at 20:39, Joel Halpern wrote:
> There are some aspects of the AD review that I assume, and would like 
> to see referenced.
>
> One aspect is that when an AD has (or accepts from a reviewer) a 
> concern, the AD needs to do enough work themselves to be able to engage 
> effectively in discussion of that concern with fellow ADs and then (if 
> there is still a concern) with the document shepherd / editors / WG.
>
> The other aspect is somewhat more nuanced and subtle.  If ADs from 
> other areas see an issue in the area for which an AD is responsible, 
> one of the ADs for that area ought, I think, be prepared to engage in 
> enough review to determine whether they share or disagree with the 
> concern.  Maybe part of this could be delegated, but it seems that it 
> is the AD who needs to engage in the discussion.
>
> Yours,
>
> Joel
>
> On 3/30/2023 4:41 AM, Mark Nottingham wrote:
>> FYI -- based on discussions this week, food for thought / bike shedding /
discussion. 
>> 
>> Cheers,
>> 
>> 
>>> Begin forwarded message:
>>> 
>>> *From: *internet-drafts@ietf.org
>>> *Subject: **New Version Notification for
draft-nottingham-iesg-review-workload-00.txt*
>>> *Date: *30 March 2023 at 5:41:03 pm GMT+9
>>> *To: *"Mark Nottingham" <mnot@mnot.net>
>>> 
>>> 
>>> A new version of I-D, draft-nottingham-iesg-review-workload-00.txt
>>> has been successfully submitted by Mark Nottingham and posted to the
>>> IETF repository.
>>> 
>>> Name: draft-nottingham-iesg-review-workload
>>> Revision: 00
>>> Title: IESG Document Review Expectations: Impact on AD Workload
>>> Document date: 2023-03-30
>>> Group: Individual Submission
>>> Pages: 7
>>> URL:
https://www.ietf.org/archive/id/draft-nottingham-iesg-review-workload-00.txt
>>> Status:
https://datatracker.ietf.org/doc/draft-nottingham-iesg-review-workload/
>>> Html:
https://www.ietf.org/archive/id/draft-nottingham-iesg-review-workload-00.htm
l
>>> Htmlized:
https://datatracker.ietf.org/doc/html/draft-nottingham-iesg-review-workload
>>> 
>>> 
>>> Abstract:
>>>   Arguably, IETF Area Directors are overloaded with document review
>>>   duties.  This document surveys the relevant background, discusses the
>>>   implications, and makes a proposal for improvements.
>>> 
>>> 
>>> 
>>> 
>>> The IETF Secretariat
>>> 
>>> 
>> 
>> --
>> Mark Nottingham   https://www.mnot.net/
>> 
>> 
> -- 
> Gendispatch mailing list
> Gendispatch@ietf.org
> https://www.ietf.org/mailman/listinfo/gendispatch

-- 
Gendispatch mailing list
Gendispatch@ietf.org
https://www.ietf.org/mailman/listinfo/gendispatch