Re: IESG experiment to conduct 360-degree reviews for ADs

Bob Hinden <> Fri, 15 October 2021 15:30 UTC

Return-Path: <>
Received: from localhost (localhost []) by (Postfix) with ESMTP id 9D3083A0654; Fri, 15 Oct 2021 08:30:12 -0700 (PDT)
X-Virus-Scanned: amavisd-new at
X-Spam-Flag: NO
X-Spam-Score: -2.098
X-Spam-Status: No, score=-2.098 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: (amavisd-new); dkim=pass (2048-bit key)
Received: from ([]) by localhost ( []) (amavisd-new, port 10024) with ESMTP id ARLRIZBlODtp; Fri, 15 Oct 2021 08:30:07 -0700 (PDT)
Received: from ( [IPv6:2a00:1450:4864:20::334]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by (Postfix) with ESMTPS id CEA5E3A0691; Fri, 15 Oct 2021 08:30:06 -0700 (PDT)
Received: by with SMTP id 63-20020a1c0042000000b0030d60716239so3318321wma.4; Fri, 15 Oct 2021 08:30:06 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;; s=20210112; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=nej2Y/xtQMyFmzCMvugELjsAS5aKXdSELkllVI3lqus=; b=BxiRwYxVikBTHhLDkkEbEVB2/quiOlZ0cvqYqwUMdUnreJhy2Mhe1N3+MqHssj5Ogr vx/xKBdD5OKHlO+2eNc2p3p6PI5zVm0Mvli43A6UvcFecn3CvSjjfzDJVVyL7raydjaL 0IFoZaoB/nZJgkN4k5T7fOUpN3DVAW6Qb1wIR9d0Ol84CUc0AoV6/sanuo2vCH954ME2 yc/C9WXYyKP6bEoi5OyODeSzVDyp3DMcBgvd+tl2RGeTebmDdMIw6nAQglc5N98RmlNE qPeTKqEpnjaFE+LsklboondmcRouz85qRDt+r5cERo72JkgNa7sAUnvOOL5VtI4lvB0i ZDyg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;; s=20210112; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=nej2Y/xtQMyFmzCMvugELjsAS5aKXdSELkllVI3lqus=; b=eed31Bb8UI6wUXJPGSPV3eWmMUn8xBD/L5Cb5XEtNEamiJBIEY4wV7+/H95ydSHlKS WGTp8LLhwElhgRa4Y86aDUnsuXxL+f6ancmUowvg/uHBTCUaAfNwJTG1ldAUuME/sSbP lBDeCOXgjW0mSj5gBrurLvOq3ScoErqRT8jGBRTN5PeGWqgEiTEt8jIRe1oqtNoUdfLb 6TDfX0SDArvyPJyJBSiA53qhE6oR9YsLdJE0grc8GnPRgiBy+hgPTmZctAgTpXw2t56M LpiXwz8fdNJSM/CtaMSIi0T3TBgVlLBtuSigEIbty64Illsn7jC8+J1u30P8kpcnVFE1 Tzbw==
X-Gm-Message-State: AOAM530tsE6te395Oc4vFraogzxMCHKewZDDTPd6lvovQV74BNdCEtrW 0urhN9fTDNh8PkI8zLTs5xg6rqZYFG0=
X-Google-Smtp-Source: ABdhPJyESPcqmmz8Wt5NjPxXXqAdt3sXAPfNUz8/J7jQU6KlvGDbxahtvD4hPpSo9t2LnDPMzJqgGQ==
X-Received: by 2002:a05:600c:a08:: with SMTP id z8mr26782287wmp.165.1634311804771; Fri, 15 Oct 2021 08:30:04 -0700 (PDT)
Received: from ?IPv6:2601:647:5a00:659:bd2a:9852:3d8b:5e4? ([2601:647:5a00:659:bd2a:9852:3d8b:5e4]) by with ESMTPSA id 25sm10909554wmo.18.2021. (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 15 Oct 2021 08:30:04 -0700 (PDT)
From: Bob Hinden <>
Message-Id: <>
Content-Type: multipart/signed; boundary="Apple-Mail=_D6985BF0-1F3F-4274-8B13-E58219947981"; protocol="application/pgp-signature"; micalg="pgp-sha512"
Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.21\))
Subject: Re: IESG experiment to conduct 360-degree reviews for ADs
Date: Fri, 15 Oct 2021 08:30:00 -0700
In-Reply-To: <>
Cc: Bob Hinden <>, Working Chairs <>, IESG <>
To: IETF Chair <>
References: <>
X-Mailer: Apple Mail (2.3445.104.21)
Archived-At: <>
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Working Group Chairs <>
List-Unsubscribe: <>, <>
List-Archive: <>
List-Post: <>
List-Help: <>
List-Subscribe: <>, <>
X-List-Received-Date: Fri, 15 Oct 2021 15:30:13 -0000


I responded to the survey after I received it.   I am fine with doing surveys.  However this one appears to have been written with a very negative slant.  For example (removed the name of the AD it asked about:

Q7. What best describes the quality of Internet-Drafts that XXXX XXXXX reviewed and submitted to IETF Last Call?

I was expecting to select between answers like high quality to low quality, but the questions are:

	More significant problems than average
	About the same severity of probems
	Fewer Significant problems than average
	No opinion.

It might have as well just asked “when did you stop beating your wife”.

I think this survey needs to be rewritten provide for neutral answers.  The current ones appear to assume there are problems.  It’s really bad in my view.

So far IMHO, the experiment is a “fail”.


> On Oct 15, 2021, at 7:01 AM, IETF Chair <> wrote:
> Hi,
> the IESG has started an experiment to conduct 360-degree reviews [1] of current
> Area Directors, to give them direct feedback allowing them to develop their
> method of working and behaviors. The feedback is entirely anonymous and we are
> not collecting tracking information. These types of IETF participants have been
> asked to provide feedback on the ADs they interacted with:
> * IAB, LLC, secretariat and IESG members will receive a survey for each AD
> * Each working group chair will receive a survey for their responsible ADs
> * Shepherds of drafts that went to the ballot in the past 12 months will receive
>  a survey for the responsible AD, if still active
> * Shepherds of drafts that spent any time in the AD Evaluation state in the past
>  12 months will receive a survey for the responsible AD, if still active
> The IETF Secretariat will collect the responses and aggregate them as follows:
> Individual survey responses will be kept anonymous. Each Area Director will
> receive a summary of all responses to their survey, and the IESG as a whole will
> receive a rollup of the results of all surveys. The IESG will publicly release
> the aggregate result for the entire IESG.
> If this experiment provides useful input to current Area Directors, the IESG may
> decide to continue 360-degree reviews in future years, possibly extend the
> survey to reach more of the community, or take other actions. A successful
> experiment may also lead to discussions on whether similar activities for IAB
> members, Working Group chairs or other roles may be useful to undertake.
> If you have been emailed feedback forms, the IESG would appreciate your input
> by Monday 25 October 2021.
> Lars Eggert
> IETF Chair (on behalf of the IESG)
> [1]
> _______________________________________________
> IETF-Announce mailing list