RE: IESG experiment to conduct 360-degree reviews for ADs

"MORTON JR., AL" <acmorton@att.com> Fri, 15 October 2021 17:33 UTC

Return-Path: <acmorton@att.com>
X-Original-To: wgchairs@ietfa.amsl.com
Delivered-To: wgchairs@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6A5243A08FF; Fri, 15 Oct 2021 10:33:14 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.499
X-Spam-Level:
X-Spam-Status: No, score=-2.499 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=att.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id C6oKmm-IX3QX; Fri, 15 Oct 2021 10:33:08 -0700 (PDT)
Received: from mx0a-00191d01.pphosted.com (mx0a-00191d01.pphosted.com [67.231.149.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 60F823A0902; Fri, 15 Oct 2021 10:33:08 -0700 (PDT)
Received: from pps.filterd (m0049295.ppops.net [127.0.0.1]) by m0049295.ppops.net-00191d01. (8.16.1.2/8.16.1.2) with SMTP id 19FGqKPA019054; Fri, 15 Oct 2021 13:33:06 -0400
Received: from alpi155.enaf.aldc.att.com (sbcsmtp7.sbc.com [144.160.229.24]) by m0049295.ppops.net-00191d01. with ESMTP id 3bq9ex9m9j-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 15 Oct 2021 13:33:04 -0400
Received: from enaf.aldc.att.com (localhost [127.0.0.1]) by alpi155.enaf.aldc.att.com (8.14.5/8.14.5) with ESMTP id 19FHWccF003883; Fri, 15 Oct 2021 13:32:38 -0400
Received: from zlp27128.vci.att.com (zlp27128.vci.att.com [135.66.87.50]) by alpi155.enaf.aldc.att.com (8.14.5/8.14.5) with ESMTP id 19FHWYDG003635 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Fri, 15 Oct 2021 13:32:34 -0400
Received: from zlp27128.vci.att.com (zlp27128.vci.att.com [127.0.0.1]) by zlp27128.vci.att.com (Service) with ESMTP id 4607B4016B70; Fri, 15 Oct 2021 17:32:34 +0000 (GMT)
Received: from MISOUT7MSGED1AB.ITServices.sbc.com (unknown [135.66.184.208]) by zlp27128.vci.att.com (Service) with ESMTP id 1E50D4016B62; Fri, 15 Oct 2021 17:32:34 +0000 (GMT)
Received: from MISOUT7MSGED1BB.ITServices.sbc.com (135.66.184.220) by MISOUT7MSGED1AB.ITServices.sbc.com (135.66.184.208) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2308.14; Fri, 15 Oct 2021 13:32:33 -0400
Received: from MISOUT7MSGETA03.tmg.ad.att.com (144.160.12.222) by MISOUT7MSGED1BB.ITServices.sbc.com (135.66.184.220) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2308.14 via Frontend Transport; Fri, 15 Oct 2021 13:32:33 -0400
Received: from NAM12-DM6-obe.outbound.protection.outlook.com (104.47.59.172) by edgeso3.exch.att.com (144.160.12.222) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2308.14; Fri, 15 Oct 2021 13:32:30 -0400
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=FC+XrwjbWFyeZpSMzaSJVcloZpIZEHPxNmwNoUXhy6QrSksL54UNmfV/VoYSiVOVF4B0gTx+UbBxrL0Kok15maPcN5kQKNpEs1GglDGrswwF4wO314F0EbgF67sAYu53bXdwP/oEBl2Waf9gd2Upm9xif7jTTvtx3tlbMbpYdQGSoOpE5g9eyNHKR+JUqgVeqQZtXxaJjtW0EFaroelQVq7bzwFlwELID5Lo6v/Hhu8RFiXpPH4TmbL5/pGeG7Mgz4nF+Ini5g0wdTOaxUijl1sXyBxuehAJRYhLk90uWAH0j86yHhdOskoOr0fZRP+HHWoZvCFuTddVRCu0X+UO4g==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=4GKt3FEPm94w3XrJPgKldZI0T/YaEDiieMP5lf60bKc=; b=MUJjYhmlM+Q1hG95WKZWsouRUbZXReAxgoD2Zc055VItaobQkxIdR0Pwm4p/pLeppN5FJr/ewLQ/pKDRvamVTj0a9IEEgFnUnTaWmVRvP/hV6eg/kTbLW1Cr+gZtY3KBYzPzzxOjnPQxHrTbIrkmWUlnkg/gwTcs6OnaRlFd61UofKHKJvySbdHnfSHijEuilu16hbR+q0E3Yt6r8GvBQd7h4x9o5M2bAoG6Oo9EHHMglLYB/Vs4ZYfBUND3y3iJCGUEBTpkZmT+vjm81YzpKMSd8gWusoABjbvQJiEHqV6fsJ9/7Sjd8qRXPWJcpCrB1ZC71HGhjvY+rSGCJsLdVA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=att.com; dmarc=pass action=none header.from=att.com; dkim=pass header.d=att.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=att.onmicrosoft.com; s=selector2-att-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=4GKt3FEPm94w3XrJPgKldZI0T/YaEDiieMP5lf60bKc=; b=eSCV6PiuI5Fd5Q1GsHMCzaMyaNIfSAP909ryI/TXMcg3oqZPB8odO3mDNgqliPVDfDmYC/YB6eq1X+FLmwZtCEanOo1jEHa9mRYTrcyzyBRcmoaCey+JY5BJKaGPk23IPT1Nd9SWVDolgk5Z5I21MhBG41kxj1jTqSv9WZh5CfQ=
Received: from SJ0PR02MB7853.namprd02.prod.outlook.com (2603:10b6:a03:32e::8) by SJ0PR02MB8499.namprd02.prod.outlook.com (2603:10b6:a03:3e7::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4608.16; Fri, 15 Oct 2021 17:32:28 +0000
Received: from SJ0PR02MB7853.namprd02.prod.outlook.com ([fe80::49a5:79a:dfde:9b56]) by SJ0PR02MB7853.namprd02.prod.outlook.com ([fe80::49a5:79a:dfde:9b56%5]) with mapi id 15.20.4587.030; Fri, 15 Oct 2021 17:32:28 +0000
From: "MORTON JR., AL" <acmorton@att.com>
To: Rifaat Shekh-Yusef <rifaat.s.ietf@gmail.com>, Bob Hinden <bob.hinden@gmail.com>
CC: Working Chairs <wgchairs@ietf.org>, IETF Chair <chair@ietf.org>
Subject: RE: IESG experiment to conduct 360-degree reviews for ADs
Thread-Topic: IESG experiment to conduct 360-degree reviews for ADs
Thread-Index: AQHXwc1lgnsNxJyDsUeo6sqd8HW4hqvUL20AgAATkoCAAA2HUA==
Date: Fri, 15 Oct 2021 17:32:28 +0000
Message-ID: <SJ0PR02MB7853469E54C69695DF8978E0D3B99@SJ0PR02MB7853.namprd02.prod.outlook.com>
References: <6458E9EE-4475-4DDF-9D62-C93D16E4F53C@ietf.org> <68A6CE68-F68F-4F1D-AA8A-CE64834F0E1A@gmail.com> <CADNypP9iT0KOoQnfzkwiA+VVyS0UK7WVOyT51LaLS2NpvuiYTQ@mail.gmail.com>
In-Reply-To: <CADNypP9iT0KOoQnfzkwiA+VVyS0UK7WVOyT51LaLS2NpvuiYTQ@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: gmail.com; dkim=none (message not signed) header.d=none;gmail.com; dmarc=none action=none header.from=att.com;
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 33fe170a-f3b2-4389-e612-08d99001c2b1
x-ms-traffictypediagnostic: SJ0PR02MB8499:
x-microsoft-antispam-prvs: <SJ0PR02MB84996DC117988B5E42D77C20D3B99@SJ0PR02MB8499.namprd02.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: BgaEp/4GZKhmmg4dCfT73YDD44Cy0T7CsBfWzsFGU+2/5ZfDllPUGajP3ZuCUvGkAgnRmB9eX6N87FaeDTUs/vHURhG5sY5HKe0G+RpNoe1IBhzlUn4oxSUq3+ty7DpbwDkvWgjUHzoaR0mauy5CH54L/EluYwQWI31dPdv8mutxWa1oO91d14MZ+Dqva/isVpzqvpC4ATIoWz4bn2q2qna3398kO0vqrj0wpzl0//EcGqAgde2DMq1L/1403HNIp1JpK4D2FAApkED6Tt2eUH/HQLkJeZ4kXUYNsGo2ZpRNnpGpImZJHgN6jhNPnDJRLTFZEIphZ8wIsUkh1Ag6sFbw42LznE4M5+Gra2ralg3kcUoCneOK5WIA5yUlsoKmddqozd6/NqmBcrL2JQF6UNOUQ8tad1UwQk/EV9tol66slSSUnaU/edQn0xUjPSDuTP3vXZqjaeQlFt++QAuPcNk4wg2MYeV8HlAue/nAWQqosdcY8lT7H/8JbRyPxtuUxoUjnCUxQJrPiF3wyWeExmc7N3LQPzfJaCJblchBN/znWHonscMfsI7yYPdrN8zaW/0rEVgFrgQEBxrHg5vWcI8Y51XZQ9MIEr5B8GtSy6QyJlnyBx+WVYZNstBIEEXdtWk6z5yuRE0FLNVwbdFI6R1xMMoZGVJHt4FUSZW1Eb9tMTRfyKFsbSWN3ryOv09dBqSN3a/MGdr/BHKPoUTj9A2P/QiC8a+f5Y7WS6Zpy87jqQ9qYibrXWi/eNz/eMo8N70Sw9Ehv8mc9i76d8kiVbL8yZq/EhfdIA7Y1NZsC4ojONuEFnKko3AtEV6SyIjelX7uYjC0IriLMk2mzLezRA==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SJ0PR02MB7853.namprd02.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(66574015)(52536014)(71200400001)(26005)(82202003)(5660300002)(110136005)(38100700002)(8936002)(122000001)(38070700005)(86362001)(186003)(66446008)(64756008)(166002)(54906003)(316002)(82960400001)(76116006)(66476007)(8676002)(966005)(66556008)(33656002)(55016002)(2906002)(6506007)(9686003)(83380400001)(53546011)(4326008)(7696005)(66946007)(508600001)(579004); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: IGiuAMrgd30NwXf6rjxHtBrawHS8Ly0fLSFyUMtO+bEyb7fYfYYSvVjT0rFY/scaoo19slPdxp1aaq299b389+zeiu0E8lXyeII/uadRRnW4Z36vl5TH4KZ4ASpeMTm6EtnplkRoODQXG1RdpndgS/8NqdxE7Eb8uS725dePh2gcTymcY40ziXhpDf9Qu1hSHdJL0MhL4BSP07AblLMP/IhZ5nloIyfzWfWVrwWkGv/9v0F+E3IeNa3XYdaQ64sn56BYU9e1vxj3TEo6BLvI+GeBkfkw67up8eoS9LNLwO99EGlmGELk8bsx89bWGMW6CkN9qIAIxqe1O3mxfrrlr6E8VLlyKabx6sQjNOev8wuaIgjDlqsuMUOVbzBA9R2aAMJ0uPdf2Z1m3mOBC2U2Ts3k3JyxJ9eVPfXwaVQKZz72OEfecQ7UPGdbk9PW67yki23bCM3Cbg0/BIkDWabpvyCTUJM/sREjYjnVqvd0ixCUB2cTnSNPSH2dIGTuJQOvuw5hSsqu6mnnGiPZb+rYtsSps1nvOmeSyNgftEFu3aXQuWstDzb4JwXavz25g90RktKhvomYLmqsZDRDGEYTa+KYiCRNZUJ+QQHA3S+Qx81tV+J6g7otTdKlKToCcgFzxk2IQPuKSm6Wy809In8Je4ZfRMShbmtMEBt3DdHCwyPMYlUHLbrG5Ui2R6ykZ0oKmNVMK2+yNr4TdxgFzzJgA4oR7a+Krjv2+/PkwGqn1G0R25Y2s7NqTfbVcdcOZLnmqRbCKj59zPBIAhjnX+JH0iJGsI4beUN5qSAeyZwBjHTSp2e2HxHVrZC5rQ1/c25Euwii++PntW1BWRuWgUOdFLTf2CBQbxHWjmzjz7xsQcOSbwZvGDZYQzgAf8WOtnxYvirMaAuXyUtIsV7nrEexh1wnoKbHON8ACiQ+WdrExT5mflsviHfgA5K7axdvXtFnANiKK2gZzNBdWytr8RzAh09zGTNsEuMQN7zXgrL7ZTRUlpAsvzbriWIjNlYvuXD7jW74QQXxC8tAdW9s3SrK8X7tR7jrSQiBW1dBhxX4N4hpNVPX3Zvkw9IR6IqGvKA0gJD0ro6GLq82cCVRSEvz4/huMTzf4Opf6+w2yYa0NPWzsIgFjEY0rNYpKmRT3YPXLK/ytDMpApxRJ8lA87Ybm1tHYgB5pNnWfcVrJkm49hcVaAsiY9lRjrBWMajDfvXudAAfxC/bc/xoSM31X9qThZoK41REMWNm5bpCbpnSUnLoKawivol3Wz3n0RUyfWf/OJXux1+y5/q8RtqFn3bpsakRJqHH/SUkdU+h1NDNYlvdGM2/+6oRdaOspBgt8CxM
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_SJ0PR02MB7853469E54C69695DF8978E0D3B99SJ0PR02MB7853namp_"
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: SJ0PR02MB7853.namprd02.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 33fe170a-f3b2-4389-e612-08d99001c2b1
X-MS-Exchange-CrossTenant-originalarrivaltime: 15 Oct 2021 17:32:28.4396 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: e741d71c-c6b6-47b0-803c-0f3b32b07556
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: tk+mDxXaOEvBzBLyH3ktA3nBOanlfa9zJNSZU1LIKYa8te+npbhDztyY2aDT7z69
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR02MB8499
X-OriginatorOrg: att.com
X-TM-SNTS-SMTP: 6A2181B2FEC978A74958535F731C086277D244019058284033B25C6CD84A47EE2
X-Proofpoint-GUID: ajiFNZnK5Jwd2BI032XTH19VZjPyZz16
X-Proofpoint-ORIG-GUID: ajiFNZnK5Jwd2BI032XTH19VZjPyZz16
X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.182.1,Aquarius:18.0.790,Hydra:6.0.425,FMLib:17.0.607.475 definitions=2021-10-15_05,2021-10-14_02,2020-04-07_01
X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 spamscore=0 phishscore=0 malwarescore=0 priorityscore=1501 mlxscore=0 bulkscore=0 lowpriorityscore=0 suspectscore=0 impostorscore=0 clxscore=1011 adultscore=0 mlxlogscore=999 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2109230001 definitions=main-2110150104
Archived-At: <https://mailarchive.ietf.org/arch/msg/wgchairs/4BHi2hUZwiPnzhCL7BRD5jf7nI0>
X-BeenThere: wgchairs@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Working Group Chairs <wgchairs.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/wgchairs>, <mailto:wgchairs-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/wgchairs/>
List-Post: <mailto:wgchairs@ietf.org>
List-Help: <mailto:wgchairs-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/wgchairs>, <mailto:wgchairs-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 15 Oct 2021 17:33:15 -0000

If we can agree on the list of questions that didn’t quite reveal the opinions sought, we could agree to exclude those questions from further analysis and proceed with remaining questions that were more clear.

Al

From: WGChairs <wgchairs-bounces@ietf.org> On Behalf Of Rifaat Shekh-Yusef
Sent: Friday, October 15, 2021 12:40 PM
To: Bob Hinden <bob.hinden@gmail.com>
Cc: Working Chairs <wgchairs@ietf.org>; IETF Chair <chair@ietf.org>
Subject: Re: IESG experiment to conduct 360-degree reviews for ADs

While I agree with Bob that some of the questions were weirdly formulated, I do not think that the experiment is a "fail".

Regards,
 Rifaat


On Fri, Oct 15, 2021 at 11:30 AM Bob Hinden <bob.hinden@gmail.com<mailto:bob.hinden@gmail.com>> wrote:
Lars,

I responded to the survey after I received it.   I am fine with doing surveys.  However this one appears to have been written with a very negative slant.  For example (removed the name of the AD it asked about:

Q7. What best describes the quality of Internet-Drafts that XXXX XXXXX reviewed and submitted to IETF Last Call?

I was expecting to select between answers like high quality to low quality, but the questions are:

        More significant problems than average
        About the same severity of probems
        Fewer Significant problems than average
        No opinion.

It might have as well just asked “when did you stop beating your wife”.

I think this survey needs to be rewritten provide for neutral answers.  The current ones appear to assume there are problems.  It’s really bad in my view.

So far IMHO, the experiment is a “fail”.

Bob


> On Oct 15, 2021, at 7:01 AM, IETF Chair <chair@ietf.org<mailto:chair@ietf.org>> wrote:
>
> Hi,
>
> the IESG has started an experiment to conduct 360-degree reviews [1] of current
> Area Directors, to give them direct feedback allowing them to develop their
> method of working and behaviors. The feedback is entirely anonymous and we are
> not collecting tracking information. These types of IETF participants have been
> asked to provide feedback on the ADs they interacted with:
>
> * IAB, LLC, secretariat and IESG members will receive a survey for each AD
>
> * Each working group chair will receive a survey for their responsible ADs
>
> * Shepherds of drafts that went to the ballot in the past 12 months will receive
>  a survey for the responsible AD, if still active
>
> * Shepherds of drafts that spent any time in the AD Evaluation state in the past
>  12 months will receive a survey for the responsible AD, if still active
>
> The IETF Secretariat will collect the responses and aggregate them as follows:
> Individual survey responses will be kept anonymous. Each Area Director will
> receive a summary of all responses to their survey, and the IESG as a whole will
> receive a rollup of the results of all surveys. The IESG will publicly release
> the aggregate result for the entire IESG.
>
> If this experiment provides useful input to current Area Directors, the IESG may
> decide to continue 360-degree reviews in future years, possibly extend the
> survey to reach more of the community, or take other actions. A successful
> experiment may also lead to discussions on whether similar activities for IAB
> members, Working Group chairs or other roles may be useful to undertake.
>
> If you have been emailed feedback forms, the IESG would appreciate your input
> by Monday 25 October 2021.
>
> Lars Eggert
> IETF Chair (on behalf of the IESG)
>
> [1] https://en.wikipedia.org/wiki/360-degree_feedback<https://urldefense.com/v3/__https:/en.wikipedia.org/wiki/360-degree_feedback__;!!BhdT!12Lkb_JO5gcyTIj4bO6LmPeZxr4OQvMYiR3GYkgvqUz18s4kyPUUgepdFo1uZ9k$>
> _______________________________________________
> IETF-Announce mailing list
> IETF-Announce@ietf.org<mailto:IETF-Announce@ietf.org>
> https://www.ietf.org/mailman/listinfo/ietf-announce<https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/ietf-announce__;!!BhdT!12Lkb_JO5gcyTIj4bO6LmPeZxr4OQvMYiR3GYkgvqUz18s4kyPUUgepdhYCVfLE$>