Re: Telechat reviews [Re: Tooling glitch in Last Call announcements and records]

John C Klensin <john-ietf@jck.com> Thu, 10 October 2024 21:43 UTC

Return-Path: <john-ietf@jck.com>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id CD95DC15170B; Thu, 10 Oct 2024 14:43:32 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.908
X-Spam-Level:
X-Spam-Status: No, score=-1.908 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Z3pdiVeSiOuM; Thu, 10 Oct 2024 14:43:32 -0700 (PDT)
Received: from bsa2.jck.com (bsa2.jck.com [70.88.254.51]) by ietfa.amsl.com (Postfix) with ESMTP id CBF22C1519AE; Thu, 10 Oct 2024 14:43:31 -0700 (PDT)
Received: from [198.252.137.10] (helo=PSB) by bsa2.jck.com with esmtp (Exim 4.82 (FreeBSD)) (envelope-from <john-ietf@jck.com>) id 1sz0wR-000Igb-OD; Thu, 10 Oct 2024 17:43:27 -0400
Date: Thu, 10 Oct 2024 17:43:20 -0400
From: John C Klensin <john-ietf@jck.com>
To: Brian E Carpenter <brian.e.carpenter@gmail.com>, Robert Sparks <rjsparks@nostrum.com>, iesg@ietf.org
Subject: Re: Telechat reviews [Re: Tooling glitch in Last Call announcements and records]
Message-ID: <924E90E592E9C867C285588F@PSB>
In-Reply-To: <bdb100c0-ebf1-4bdc-b02d-1d78be442487@gmail.com>
References: <F7B93DDC2E7F9D09E14CA72C@PSB> <14f24c98-f7da-477c-8ea6-892ee5ad4413@nostrum.com> <CE0F9F2237EE32F4806538EC@PSB> <bdb100c0-ebf1-4bdc-b02d-1d78be442487@gmail.com>
X-Mailer: Mulberry/4.0.8 (Win32)
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
X-SA-Exim-Connect-IP: 198.252.137.10
X-SA-Exim-Mail-From: john-ietf@jck.com
X-SA-Exim-Scanned: No (on bsa2.jck.com); SAEximRunCond expanded to false
Message-ID-Hash: 7OUL6QLKPAQOLMD25KL42TQ62FGNGWSP
X-Message-ID-Hash: 7OUL6QLKPAQOLMD25KL42TQ62FGNGWSP
X-MailFrom: john-ietf@jck.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-ietf.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: ietf@ietf.org
X-Mailman-Version: 3.3.9rc5
Precedence: list
List-Id: "IETF-Discussion. This is the most general IETF mailing list, intended for discussion of technical, procedural, operational, and other topics for which no dedicated mailing lists exist." <ietf.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/9gvrXYQGuVURVx-3cvU6--E5ulo>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Owner: <mailto:ietf-owner@ietf.org>
List-Post: <mailto:ietf@ietf.org>
List-Subscribe: <mailto:ietf-join@ietf.org>
List-Unsubscribe: <mailto:ietf-leave@ietf.org>


--On Friday, October 11, 2024 08:53 +1300 Brian E Carpenter
<brian.e.carpenter@gmail.com> wrote:

> [moved from tools-discuss]
> 
> On 11-Oct-24 08:06, John C Klensin wrote:
> 
> On Thursday, October 10, 2024 13:23 -0500 Robert Sparks
>> <rjsparks@nostrum.com> wrote:
> 
> <snip>
> 
>> 
>>> The practices of directorates continuing to change assignments or
>>> provide comments after last call is something I'll leave to the
>>> IESG to steer. Note, however, that almost all of the directorates
>>> also provide telechat reviews, not just last-call reviews.
>> 
>> (That brings us to an issue that I thought to mention in my earlier
>> note, decided against it, and may regret mentioning now.  If this
>> is worth pursuing, it should probably be on the IETF list, not
>> here.
>> 
>> At least in principle, there is a difference between (i) Last Call
>> as a community discussion mechanism whose effect is to inform the
>> IESG about community consensus and (ii) Last Call as a mechanism
>> to feed information, opinions, and other advice into the IESG so
>> the ADs can determine what they think is the right decision for
>> the Internet.  If those directorate/area reviews are given
>> privileged status -- input into the telechats that ordinary IETF
>> participants don't get, more flexibility about deadlines, etc. --
>> then the "treat this like any other review" boilerplate of most of
>> those reviews becomes a joke or worse.  It would be somewhat
>> different if those really were directorate or area reviews --
>> reviews that were written (or finalized) only after specific
>> discussion about the document within that area or directorate and
>> that represented consensus in that group.  But they often are not
>> -- they are more often the opinions of an individual who comes up
>> in rotation or draws a short straw.  If the latter is the case,
>> the community should probably be insisting that reviews that claim
>> to be (or are treated as) representative of a group rather than
>> that of the author as an individual be posted several days before
>> a Last Call ends so that other IETF participants can comment on
>> whatever is said.
>> 
>> So telling me/us that directorates provide telechat reviews in
>> addition to or instead of Last Call reviews is a source of concern,
>> not comfort.
> 
> When I was a Gen-ART reviewer it was fairly clear that telechat
> reviews
> had two properties:
> 
> 1. They were public.
> 
> 2. They were really supposed to be saying either "All my previous
> IETF Last Call comments have been dealt with" or "The following
> IETF Last Call comments have not been dealt with: ...".
> 
> If they go outside those boundaries, yes, there could be a problem.

Brian,

Since you have switched the lists, I'm concerned about the "public"
part but don't know if our definitions are the same.   Part of what
set me off --nearly separate from the datatracker timing glitch-- was
noticing that according to the datatracker [1] the Last Call on
draft-ietf-emailcore-rfc5321bis-31 closed today (California version)
and will close in under three hours (23:59 UTC version).   So far,
the number of directorate/area reviews posted is zero.  IIR, other
that an IANA concern, the number of postings about that document to
the list during Last Call has been around twice that.  Now, while I
hope that means that the WG, its leadership, and Murray can smile
happily and take a collective bow about having gotten all issues
addressed before Last Call started (we certainly tried), it raises an
interesting problem.  Supposed those directorate/area reviews,
including the one assigned in the last 24 hours, start rolling in on
Monday.  Certainly they would be "public" in the sense that the
portion of the community that follows the Last Call list would see
them.  That is far more public than a presentation to the IESG during
their review even though people who are particularly interested (and
in sufficiently convenient time zones) could listen to the IESG
meeting.   But they are not public in the sense that the community
could comment on whatever the reviews say -- to agree and cheer, to
disagree and protest, or anything in between.  And, should the
author(s) or WG have comments on the reviews or whatever might be
posted in response for them, their is no time for those responses
within the Last Call period.  

At that point, the IESG has a choice: they could proceed without
public feedback on the directorate/area review(s), they could
informally extend the Last Call period by declining to put the
document on the agenda until the discussion died down, or they could
more formally extend the Last Call.  In the first case, those reviews
become, from my perspective, non-public.   The others involve
elements of unfairness to anyone who counted on the document
finishing Last Call on the advertised dates and moving forward,
especially anyone who had set aside time in the final week of the
Last Call and subsequent few days to respond to any comments.  They
would also make a DoS attack on document approval by the careful
timing and sequencing of comments should any small cluster of people
feel motivated to do that.  

And so, yes there could be a problem.  I hope it remains mostly
hypothetical, but it is probably worth considering.

best,
   john