Re: Telechat reviews [Re: Tooling glitch in Last Call announcements and records]

"Eric Vyncke (evyncke)" <evyncke@cisco.com> Wed, 16 October 2024 18:43 UTC

Return-Path: <evyncke@cisco.com>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 647C3C1D4CEC; Wed, 16 Oct 2024 11:43:27 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.739
X-Spam-Level:
X-Spam-Status: No, score=-9.739 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.148, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, T_SPF_HELO_PERMERROR=0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id KBhZvYfZF6JF; Wed, 16 Oct 2024 11:43:23 -0700 (PDT)
Received: from rcdn-iport-2.cisco.com (rcdn-iport-2.cisco.com [173.37.86.73]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id C922FC14F70F; Wed, 16 Oct 2024 11:43:20 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.com; i=@cisco.com; l=34600; q=dns/txt; s=iport; t=1729104200; x=1730313800; h=from:to:subject:date:message-id:references:in-reply-to: mime-version; bh=tVyRPVx1qiOeuPZkQo91lJbML4TBWpP+Vm8k73tO8wQ=; b=ktKX7kZijlgt/E5vS9uraUAMN7Td4qRbjb53UGABtYa3jRVQhrJ/Gjkl 9Lu2KfHdQmZlrBpFUJVskGs5XkYhDdGJ96mA2BvjCK7/7t8xjCSDD1Dny Lr65jeL2ziOotOJfpfBJpwnBHjOtNhzLBX3c7LA/Sq3uq7yxJtnhdVFvO o=;
X-CSE-ConnectionGUID: vb8aVbolR3SJnnWzZM7y1g==
X-CSE-MsgGUID: 6kZddeyVTWiihwCoihsV/A==
X-IPAS-Result: A0AbAADvBxBn/43/Ja1aGgEBAQEBAQEBAQEDAQEBARIBAQEBAgIBAQEBZYEWBQEBAQELAYFAMSooB3QCgRxIhFWDTAOETl+GUYIiA4tihWaMToElA1YPAQEBDQJEBAEBhQcCFooLAiY0CQ4BAgQBAQEBAwIDAQEBAQEBAQEBDQEBBQEBAQIBBwWBDhOGCCcEAgGGLAEBAQEDEhFIHgIBCBEDAQIBIAcDAgICHhEUCQgCBAESCAwFCYJgghwUAzEDAVWidAGBQAKKKnqBMoEB3ToNgliBSAGEf4MuHgEqgTICDoF0hwAnG4FJRIEVQoI3MT6BBQGBGUIEgWAeFoMlOoIvBIVKgQwpgwY/gUsBAYIigTWBFmkEBQYPggoPgQyCKQQPgTxQgwF8JU1WhiteJW6EBoMvigxSdSIDJjMhAhEBVRMXCwkFiTUKgnYFIQSBaiaBCRaCcoEzEYEIAoJXgWcJYIQ6gytdgQyBPoFZAUaBF4FbLxshC4IhfxwbFYEhBThJOYIWak43Ag0CN4IkJFyCUYRrgQcdQAMLbT0UIQYOGwUEgTUFqjQEghJGgiEBMwINBk8BMh4PGT4bUhcBCAcQAQMLAQEBUg0CkjdqgzGLO6J0cQqEGoo1kAuBCoYrF4RRpXuYdyKRYJFSCwMBCQGFCQIEAgQFAg8BAQaBMzQ8gVlwFTuCZ1IZD1eNVhYWdgECzQN4AjkCBwEKAQEDCYZNh0gBAQ
IronPort-PHdr: A9a23:8BkQ3xG6hWCgyIwdOUqu2J1GfhMY04WdBeZdwpMjj7QLdbys4NG+e kfe/v5qylTOWNaT5/FFjr/Ourv7ESwb4JmHuWwfapEESRIfiMsXkgBhSM6IAEH2NrjrOgQxH d9JUxlu+HTTDA==
IronPort-Data: A9a23:DG6BIKBiO3QAhBVW/33iw5YqxClBgxIJ4kV8jS/XYbTApDwigjADz GEbX2rXbq2KMWOgLo9xbYW2pkJUvJPVmIQyOVdlrnsFo1CmBibm6XV1Cm+qYkt+++WaFBoPA /02M4SGcYZuCCeF9n9BC5C5xVFkz6aEW7HgP+DNPyF1VGdMRTwo4f5Zs7ZRbrVA357gWmthh fuo+5eDYQf8hWYoWo4pw/vrRC1H7ayaVAww5jTSVdgT1HfCmn8cCo4oJK3ZBxPQXolOE+emc P3Ixbe/83mx109F5gSNy+uTnuUiG9Y+DCDW4pZkc/HKbitq+kTe5p0G2M80Mi+7vdkmc+dZk 72hvbToIesg0zaldO41C3G0GAkmVUFKFSOuzXWX6aSuI0P6n3TE3f8+BX88Ookiod1VB2dx5 849dyFUYUXW7w626OrTpuhEnM8vKozveYgYoHwllW2fBvc9SpeFSKLPjTNa9G5v3YYVQrCEO pdfMGY2BPjDS0Un1lM/BYwvmuyri1H0ciZTrxSeoq9fD237llIpjeaxa4aIEjCMbZtWrEqUq 3P4w1v4AxEFH9ueySG7tVv504cjmgu+Aur+DoaQ9/Nxj3WSy3AdThoMWjOToPSlhGa/Vs5Rb UsO9UITQbMa7kenSJz5Gha/unPB5kJaUNtLGOp84waIokbJ3zuk6qE/ZmcpQPQttdQ9Qnoh0 Vrhoj8jLWYHXGG9IZ5FyoqpkA==
IronPort-HdrOrdr: A9a23:M6bLQaHOL+j1ooZApLqFupLXdLJyesId70hD6qkvc203TiXIra CTdaogtCMc0AxhJ03I+ertBEDyewKjyXcV2/hdAV7MZnichILFFvAH0WKm+UydJ8SczJ8Q6U 4DSdkFNDSYNzET5qiKgnjcLz9j+qj7zEnCv5a5854Zd3ATV0gW1XYBNu/0KDwQeCB2QbACON 634M1BqzC8eXIRQPiaKxA+NdTrlpngrr6jRQQJKSIGxWC14A9A7oSULzGomjMlFx9fy7Yr9m bI1ybj4L+4jv29whjAk0fO8pV/grLau5V+Lf3JrvJQBiTniw6uaogkcaaFpioJrOam70tvuM XQoi0nI9945xrqDyCISFrWqkndOQQVmj3fIGyj8D7eSAvCNXYH4v969MFkm93img0dVZ9Hoe R2Nimixutq5Fv77VTADp7zJl5Xfo7emwt7rQbV5EYvCLc2eftfq5cS81hSF4pFFCXm6Jo/GO 0rF83E4u1KGGnqJ0wxk1MftuBEZE5DVyuuUwwHoIiYwjJWlHd2ww8Rw9EehG4J8NY4R4Nf7+ rJP6x0nPUWJ/VmJ55VFaMEW4+6G2bNSRXDPCabJknmDrgOPzbIp4Ts6Ls46em2cNgDzYc0mp 7GTFRE3FRCMH7GGImLxtlG4xrNSGKyUXDkzdxf/YFwvvnmSL/iIUS4OScTegub0oEi6+HgKo OO0chtcozexEPVaPR04zE=
X-Talos-CUID: 9a23:CNws3GACAXX/yp76EzdtpEcqEMchSCbm7nHWHF2KLDl4EbLAHA==
X-Talos-MUID: 9a23:QLGVAAbhcjc82+BT6TzeiD1vJflU3KWvCF8mlpQGoPfDHHkl
X-IronPort-Anti-Spam-Filtered: true
Received: from rcdn-l-core-04.cisco.com ([173.37.255.141]) by rcdn-iport-2.cisco.com with ESMTP/TLS/TLS_AES_256_GCM_SHA384; 16 Oct 2024 18:43:19 +0000
Received: from alln-opgw-4.cisco.com (alln-opgw-4.cisco.com [173.37.147.252]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by rcdn-l-core-04.cisco.com (Postfix) with ESMTPS id 7469918000195; Wed, 16 Oct 2024 18:43:19 +0000 (GMT)
X-CSE-ConnectionGUID: XT6ISZznTam/hjnQmpK0Xw==
X-CSE-MsgGUID: JxeX0GHlS6aEsPojWWdSrw==
Authentication-Results: alln-opgw-4.cisco.com; dkim=pass (signature verified) header.i=@cisco.com
X-IronPort-AV: E=Sophos;i="6.11,208,1725321600"; d="scan'208,217";a="39314173"
Received: from mail-mw2nam10lp2043.outbound.protection.outlook.com (HELO NAM10-MW2-obe.outbound.protection.outlook.com) ([104.47.55.43]) by alln-opgw-4.cisco.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 16 Oct 2024 18:43:18 +0000
ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=jwbPL/neDblCIQGQBYwfngTwVT1MmVa1nyqYIsMWwf69JqyvmCgIhF9EkPtGH1+Jb4HEUo8evgw1kmAvY2UmZ+1DNg//rIYqlkwgY4IWEjJCE70P+n8kZDk7TlJD27EzaMdBTDgZOWBbb6KKzBSGZmV5ECNMG69pqhIltJg94HlDpxyB4oZXxk11SfP/Xww6T0PaSlyXtB3qtwXvUOMQrNEAmnM0/ospng6cVu8iYSsHbADWWR2YrCk237wOPRIWZe3mxciHGjbMd1t048rquSGvnwXarz8SoKyuGdRUgNU1XBwCybRI8+bNReMAVXlQAIEZWWXpT1l9FclWOR99Ew==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=tVyRPVx1qiOeuPZkQo91lJbML4TBWpP+Vm8k73tO8wQ=; b=So1LaZ9OqcjYqYbYSnKe/sb/aI3W+v1IlU0E9h3SfHkKvdvYhwCamOn0KVfUtKvjke/JO10y0XUHRvmx2xARYFXBS+Lh/XhzVrWu8yNEWCYhYKbv9S+NCUGHix1+LBYd2ER+GBZ7YNR1gZph/az0Oo94xqL5LEKT49zd2yfK9wIFNJcwIlbpJjZUM6FwdVm5lNvh6SI84/hX7kRdrMdIm8jxkCHJx1VipKFRCb4XB94HCIT1JJQDrGJ7scwrV22OrrvU5XREZwFCf8F4ZLVYh8GLsz3dZmN7yDKoLZW5rvHn2JYbh120VbuKnWSUTbZCdbsT2UaFPTvwGrydj+ze5w==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cisco.com; dmarc=pass action=none header.from=cisco.com; dkim=pass header.d=cisco.com; arc=none
Received: from PH0PR11MB4966.namprd11.prod.outlook.com (2603:10b6:510:42::21) by IA0PR11MB7257.namprd11.prod.outlook.com (2603:10b6:208:43e::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8069.18; Wed, 16 Oct 2024 18:43:16 +0000
Received: from PH0PR11MB4966.namprd11.prod.outlook.com ([fe80::dad6:3d43:4561:3c11]) by PH0PR11MB4966.namprd11.prod.outlook.com ([fe80::dad6:3d43:4561:3c11%5]) with mapi id 15.20.8048.020; Wed, 16 Oct 2024 18:43:15 +0000
From: "Eric Vyncke (evyncke)" <evyncke@cisco.com>
To: "ietf@ietf.org" <ietf@ietf.org>, "iesg@ietf.org" <iesg@ietf.org>
Subject: Re: Telechat reviews [Re: Tooling glitch in Last Call announcements and records]
Thread-Topic: Telechat reviews [Re: Tooling glitch in Last Call announcements and records]
Thread-Index: AQHbH8mXWH87P+dQ6kCwwotQupEQObKJkmkAgAACuwCAABnUgIAAB1CU
Date: Wed, 16 Oct 2024 18:43:15 +0000
Message-ID: <PH0PR11MB49661916B9FC62942BDB26E7A9462@PH0PR11MB4966.namprd11.prod.outlook.com>
References: <822159B0D390905C0A194997@PSB> <e8a0b44b-8ecf-4b24-94d4-9c79ddd26d41@amsl.com> <F3ACA29EAAC4DE9FE06EDA21@PSB> <CAL0qLwaKw8P7CGXXXHM5Hh6YvkMMqeN8OOgpv2v7Yrob5QsQ7A@mail.gmail.com> <CAC4RtVDqmcyjmbTZz3CU3zUXXtrQwfXZUS=PBhgtGK+NChhPtw@mail.gmail.com> <LV8PR11MB8536614B239A214C0E9D6981B5462@LV8PR11MB8536.namprd11.prod.outlook.com> <CALaySJK_ZZOgs+BjMMWA-vLO8n0ogy-WyDFCmOtGepjuohsGJQ@mail.gmail.com> <LV8PR11MB85361A9905FA2DF21577E56BB5462@LV8PR11MB8536.namprd11.prod.outlook.com>
In-Reply-To: <LV8PR11MB85361A9905FA2DF21577E56BB5462@LV8PR11MB8536.namprd11.prod.outlook.com>
Accept-Language: fr-BE, en-US
Content-Language: en-GB
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: PH0PR11MB4966:EE_|IA0PR11MB7257:EE_
x-ms-office365-filtering-correlation-id: f0f028f9-020b-427e-9062-08dcee126569
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;ARA:13230040|10070799003|366016|1800799024|376014|38070700018|8096899003;
x-microsoft-antispam-message-info: +2uBletpuex1vbjIQT7TIL9xgtAdwYNFI7jL1Tvtw4JzF3XWT+0s8R/4dNj1fTz+7XGoAj/1pKMoIlkNh4o0SbGoIO2LS8skffRAzT+V3JmB6FQB5uRwgc3rCDAf9+nZ9gz9v9K1+pZfyhj6bcfFDui3Db62lrEqH+8Jz1Tvvs6IqPoN3/Pe2qqXJ8dnjEEi+A8lsAgCB25RbXZKDLeF1YksccjCZT5HvYm2XCaTB4OE1hnCPRH1JJf2k1nlrv3nTK82scD/oyFXsBvv1lhzVdPepvdjo9TE2O3TFT1PodEj/80VKn/+cHqY8Gk/nrE4Za1H/LcYY8bq9R4nYL8ikzejw1fhRvnc4XXO0vphIq98fhatMfNpfs5zrJV0Vkg0hpyVv7H6YD76dSv5DLOcBieRltt3I1HtKs7UJM99Y5uTrGoP/rnYyAwsUEk5pOQaCBwYsNoP26WlvYOJFg5Txwl7D44pthVI4BqclboGyaeY7+vayRmgqJmHMiBlAUuda9Fotb2WGpdznqvQ9J0RyIRj20rrOxEOGpW8vDzJuna4KoxuV2T2YZWsV/Njo5V7v3Y277pZd6wBxPpelo0hEZCTr/qr63A9Fy9GgMRiIs2bjRpop8970putOZbQwcUmk5ZaztVrANi3E5vTnbhKhZya3KMqPMiQMBHI8fq2P8oRxuyPSAWVex03g8tPAZzwto9v4Z2qOYcUcYlY2RKT3rxaJP2bIHdC9XfnFWA+HMzkf8u3KEAq/U+FHzIPj1cxPZmBwgf3HPsO78x/RQBDkRZQ+C1U0Q8hSZPWGYrg71Cdq/uar3qF4iQutihLk3rjEXvjnfTkxI29pJCqh1Kviv/HQ3ZgH3RlT924XvuUSPw4x2UjrBipWKCggjujyVVNRfuUBDT5lqkABe3qtAKX6mUv0Hq+PPxV9hPMmzT9QbddDdJuj4vd2+LpdUFRzYtFcnvWWzaTsyz4chVt4yZkTCi9n6o159rJvb5V3ipeMYOW3whKGIN/pqx2yxHSum8NPQD2DaWe2mO2OoYAmW8+XOx/+bjVwCcS/fTBoTTzFSCeY7plW2m40lVH9Ec+tNMU5FAbJBhEQwyggIsbnadJBMqLsGzJosQiN+7mqFF5iSr7vmM9rcCcUoZuUnd4pHygVPDu1knuNV04uD5F/+WU4A9ySqG+4eqydA84WSL8USQqD5ityDrnmvB3K6NE6oTEd0/c2Uiti8ZOCdTrPhtQX4LMUkg8zv8qd1rzU4udU4jjTAW6XhIGAwAB66z2R08P8e4wvQd/MkROixGTpH+3tsf4osEzuZ5yEYdR+/UEQQ4RfELrnzm4Je50jb1X5AR/ysIUMtM2yez6gMlLHtih9g==
x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PH0PR11MB4966.namprd11.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(10070799003)(366016)(1800799024)(376014)(38070700018)(8096899003);DIR:OUT;SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: lSpUwff+p1+0zzzPeRh5MBaXhZZwZNzue3adVg5Sedcn9Md4R+znwwWpJByZ9amZJvi5+uEgjcDHF0g3598FhFn0QBMnxtimvEt6e8C9+egUgz/wr4gKfKPyJLlRUQAjS4fTLfOeyuyRpjGdNu/Fj05uFtfTkCLO5tutMLhqpa9zt77YknxMK3sS+gY2vTVSn9bNXKQHDmLtBbud7K0H/C6XxQwWXEgX33DsvJK8v8eD8iqqbH7FH5KL85d9/jayuXyGIZZ6mX3WuqR4K3VIl1ZNWjuBwD+5p9k9ITFWW+V/yZxC3Abbx/jjbEOjOaAlgg/OTOgKnxFq5q1Niv1Qb+AhRIZbOP/1jrNbKUtzjT8qHMZ3CNIt7LoGNTPbv5X3qKtjc+LGxhRQQCHg5kAIBLc+EsgCR6z4QvEGDpZL3Nt18ew0dT4C4mwNV4hPp7fcdXs3eNx5QuozYNIZ9Bf7b1fLJTmKnXRbHwcsDzgxP3AoT9Xl0a0ZxE48m5qSBnEjBaJSdE6M7s4zTWcglo641xSQouDGqdndg3IgGvxMWbWk3BE9d1Yk9M88e+U6XZ71td3Jd6Wxc5tKZ+xYC2NkGKEfykq2BF8vzO7yg1u47TpBXjUdiRKqzqEr1uguqOjHb3aiKau7WHP32QCTocDodM4ZRSj2CN0eGVn+mMKONWSLhG1RAm3YTwK3GSAOfleVwh/NAll8RKmtebylu0uS0yC8VF0dW8tLouABwUpc3PMZ0LzRAmeoe/vgpWNs7IIQ/YRrnGn3rs4IaKT1XR03GM2B8bh/DAUPkrqKGSAp3s3xcxGHRFjT4rI62D1AtW9DIFmKZ8GhENFdP8PEHhEnuIOWbDcqALtYe5+R1gGNSK9Vud58K3xgfWR6qofiNZlkqg/uOztsw/0XgfzGlj9DfAR5QAO67J68qirn9zXbjQVqvIg5nGdJlifgrO2qDlgmjcotImGRdHEPRpehKc8x4iHJBYoHFZZUgBB98a+ldZuI9U5uT0LyqqGLedypFYumiv+JRXWgPX/mmaVJ3TiZhlHCFJ88fDqRuqVgsnfIu/5sPJuNzUe39R8/1XxEPbCRwIqqubQRBB7H8aRCyrQOwf0Gvr0yO9ZK6ClVuYIuuib21GTSNyr3GHO4pkzTO398en1WK4m5P4E2qwDT3EHVrfRPUvC44EPxzBC715fXz2seIAXz6EMwS7pbU1rcixpUCKxHWDHnmpPRZ7xfXuIsaCX6bWfUC1XIRcpkfr5MjbNTyWI1o3uhMz9vAvfaueWsmXlLgx7oDD7a8zB/eKcBLmgfHUGeA03dwJaGSJISTrRZ8uO/A+vysFWRVUZkUX1ujqZGDjgmVIPTdu9jVT+3Cw5O0TxJPSRguw7GYHm5nDo1Dedf2uGk4E7lwjMFr605OzMPVamHEDwWRxAN7laAbQJxtLqy8llqgyH8yiecEQwu7z0v3445mfdrQmIthkv5bFi/SD8PSHbtF/yoKAy9gYCIXmgkQNQe9gDm5rFA8x0Ah4BuRak29/vrNTqbopP4t2GKovtxGqpEXK/aSkettEotof9WJ6H6YbAO0FtbJRpVnaj5aiZzWZQ/NmP5l/2/yrc7MOl+BzLYJmZ5xln+ejwjmz3JQpdzqGiLUwQlzTRN3bUucuG+lUOZYQ8GO+6s/H0bEhl+nOTfP2E/CpANHA==
Content-Type: multipart/alternative; boundary="_000_PH0PR11MB49661916B9FC62942BDB26E7A9462PH0PR11MB4966namp_"
MIME-Version: 1.0
X-OriginatorOrg: cisco.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: PH0PR11MB4966.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: f0f028f9-020b-427e-9062-08dcee126569
X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Oct 2024 18:43:15.7870 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 6Wyy/61YAtXym58ODBCAJ5p5zVVGITcURjSFfMAxENZmxiPbPBqYxqTDQjotlHNAdGM1Q9/AFG0fRDURBhjIeQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA0PR11MB7257
X-Outbound-SMTP-Client: 173.37.147.252, alln-opgw-4.cisco.com
X-Outbound-Node: rcdn-l-core-04.cisco.com
Message-ID-Hash: VOP4XK3AZ47SS3GRSEGS2FIYMJMDDZY6
X-Message-ID-Hash: VOP4XK3AZ47SS3GRSEGS2FIYMJMDDZY6
X-MailFrom: evyncke@cisco.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-ietf.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
X-Mailman-Version: 3.3.9rc6
Precedence: list
List-Id: "IETF-Discussion. This is the most general IETF mailing list, intended for discussion of technical, procedural, operational, and other topics for which no dedicated mailing lists exist." <ietf.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/i5zsYxiVWxyNP8L-Z2uOSBaUVeg>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Owner: <mailto:ietf-owner@ietf.org>
List-Post: <mailto:ietf@ietf.org>
List-Subscribe: <mailto:ietf-join@ietf.org>
List-Unsubscribe: <mailto:ietf-leave@ietf.org>

Every AD has a different view it seems as I prefer to do my AD review first then wait for a revised I-D (if required) before starting the IETF Last Call and associated requests for directorate reviews. My reasoning is to prefer having a review on the latest I-D.

But your mileage may vary ;-)

-éric

From: Rob Wilton (rwilton) <rwilton=40cisco.com@dmarc.ietf.org>
Date: Wednesday, 16 October 2024 at 20:15
To: Barry Leiba <barryleiba@computer.org>
Cc: Murray S. Kucherawy <superuser@gmail.com>, John C Klensin <john-ietf@jck.com>, iesg@ietf.org <iesg@ietf.org>, ietf@ietf.org <ietf@ietf.org>
Subject: Re: Telechat reviews [Re: Tooling glitch in Last Call announcements and records]
My suggestion is to automatically kick off the reviews as soon as it reaches WG “Submitted to IESG for Publication” state, rather than Last Call, which should be immediately after the shepherd review and writeup has been completed.  I.e., before the AD has done anything with the document.

Regards,
Rob



From: Barry Leiba <barryleiba@computer.org>
Date: Wednesday, 16 October 2024 at 17:42
To: Rob Wilton (rwilton) <rwilton@cisco.com>
Cc: Murray S. Kucherawy <superuser@gmail.com>, John C Klensin <john-ietf@jck.com>, iesg@ietf.org <iesg@ietf.org>, ietf@ietf.org <ietf@ietf.org>
Subject: Re: Telechat reviews [Re: Tooling glitch in Last Call announcements and records]
Working group chairs can always request early reviews at any time — they seldom do, but they sometimes do, particularly when they know a document is complex or needs someone with specific expertise to have a look.

Reviews are automatically requested by the tooling when the document enters the Last Call state (and the IESG Evaluation state with a telechat date set).  That’s where we get most of the review requests, exactly because it’s automatic.  No one has to think about it and (remember to) ask.

We could certainly use other state transitions (such as “In WG Last Call”) to trigger an automatic request, but I don’t think that would work well in general.  Some working groups have multiple “last calls” for various reasons, and I think chairs would rather not have side effects such as this.  Perhaps a separate check-box on state changes for “request directorate and review team reviews” would work.

In general, anything that requires a specific request will mostly not be used.

Barry

On Wed, Oct 16, 2024 at 12:32 PM Rob Wilton (rwilton) <rwilton@cisco.com<mailto:rwilton@cisco.com>> wrote:
Hi Barry,

Another choice, that perhaps could be considered, would be to initiate the directorate reviews slightly earlier in the cycle.  E.g., at the point that the WG has said that is ready before publication but before the AD has reviewed and agreed to publish.  In fact, input from the directorate reviews might be very helpful input to decide whether the document is really ready to progress, or if there are significant issues outstanding.

Of course, this might mean that a second follow up lighter directorate review is needed to cover any changes that occurred between the initial review and the version going before the IESG ballot, but if that second review was focussed on the differences and issues raised previously then I would have thought that the increase in workload on the directorate would probably be fairly small, and hopefully manageable.  I.e., I am assuming that the second review would be assigned back to the originate directorate reviewer.
Generally, I think that it is better to get as many reviews as early as possible in the process when the folks working on the document and still very fresh and vested in getting the document published.  Perhaps bigger changes to the process could also be considered …

Anyway, just a thought.

Regards,
Rob


From: Barry Leiba <barryleiba@computer.org<mailto:barryleiba@computer.org>>
Date: Wednesday, 16 October 2024 at 13:47
To: Murray S. Kucherawy <superuser@gmail.com<mailto:superuser@gmail.com>>
Cc: John C Klensin <john-ietf@jck.com<mailto:john-ietf@jck.com>>, iesg@ietf.org<mailto:iesg@ietf.org> <iesg@ietf.org<mailto:iesg@ietf.org>>, ietf@ietf.org<mailto:ietf@ietf.org> <ietf@ietf.org<mailto:ietf@ietf.org>>
Subject: Re: Telechat reviews [Re: Tooling glitch in Last Call announcements and records]
We should make it a general policy to add two weeks to the last call
period when a document is long, for some value of "long" (I might say
over 60 pages of substance (not counting change logs and such)).  I
try to get to assigning ART-ART reviews a couple of times a week, but
that still means that, depending upon the timing, with a two-week last
call I might be giving a reviewer only a 7- or 8-day deadline for a
100+-page document, and I always blanch when I have to do that.  While
ADs regularly have to review long documents with a week or two notice,
I think it's unreasonable to expect last-call reviews from
directorates/review-teams on that notice for long documents.

We decided on the two-week last call period at a different time, when
the IETF was a different organization.  Maybe we should re-think it
now, and keep in mind that an extra two weeks of last-call review is
*not* going to be the most significant delay in a document's life
cycle.

Barry, ART-ART manager

On Fri, Oct 11, 2024 at 5:53 PM Murray S. Kucherawy <superuser@gmail.com<mailto:superuser@gmail.com>> wrote:
>
> Hi John,
>
> On Fri, Oct 11, 2024 at 2:01 PM John C Klensin <john-ietf@jck.com<mailto:john-ietf@jck.com>> wrote:
>>
>> Thanks for the clarification.  Seems entirely reasonable with one or
>> two qualifications.  First, if you (and/or other areas) are doing
>> things that way, the review needs to be posted to the Last Call list
>> well before the Last Call closes out so there is time for people from
>> the Area and the broader community to comment on it.   Second, if the
>> posted end of Last Call date is unreasonable or unattainable for some
>> reason, I'd hope the responsible AD could be notified of that early
>> in the Last Call window -- at least no later than a week before it is
>> closed -- rather than, e.g., after the close date.  That would permit
>> actions, if needed, to be taken without things looking like a game of
>> "Gotcha" with the AD and WG and/or author(s) responsible for the
>> document.
>
>
> For what it's worth, in my time on the IESG, I haven't found the need to manage this vigorously.  If there's a directorate review I'd really like to have, I have the discretion to wait for it before scheduling the document onto a telechat even though Last Call has ended.  If the review has come in but it provokes discussion, I have the discretion to wait for that discussion to resolve before moving forward.  If we're talking about a document that isn't one of mine and a review comes in from my area review team raising something on which I'd like to dive deeper, I can use DISCUSS for that (so long as I am diligent about clearing it once the discussion is had, of course).  That's been my strategy for a while now and it's never raised a complaint, which (so far, at least) includes the document you're talking about here.
>
> The thing I used to determine if the review has come in is the datatracker.  I will check the last-call list too, but the datatracker provides a nice snapshot of which reviews have been requested and which have come in, and is usually where I start when checking on a document's status.
>
> Just to keep this all public: For this particular document, I have pinged the assigned directorate reviewers to ask them to upload their reviews ASAP on this document.  As I said elsewhere, I might be fine advancing a document missing a couple of directorate reviews, but not all of them.  If they don't come in soon, I'll reach out to the review team chairs to ask for reassignments.
>
> Lastly, I would definitely appreciate a notification (automated or otherwise) when a directorate review is going to be late.  Right now all the tracker tells me is "not done", which could mean "not done yet" or could mean "don't hold your breath".
>
> -MSK