Re: Revised IETF LLC Draft Strategic Plan 2020 to address feedback raised

Eric Rescorla <ekr@rtfm.com> Fri, 29 May 2020 14:38 UTC

Return-Path: <ekr@rtfm.com>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9050C3A0956 for <ietf@ietfa.amsl.com>; Fri, 29 May 2020 07:38:29 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.895
X-Spam-Level:
X-Spam-Status: No, score=-1.895 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=rtfm-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id GvMgVM7HE392 for <ietf@ietfa.amsl.com>; Fri, 29 May 2020 07:38:27 -0700 (PDT)
Received: from mail-lf1-x12e.google.com (mail-lf1-x12e.google.com [IPv6:2a00:1450:4864:20::12e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id D75063A086E for <ietf@ietf.org>; Fri, 29 May 2020 07:38:26 -0700 (PDT)
Received: by mail-lf1-x12e.google.com with SMTP id z22so1460072lfd.0 for <ietf@ietf.org>; Fri, 29 May 2020 07:38:26 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rtfm-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=9Q8qyq77BxlX4290utuNfIRYdvAcMWClNuGY6Ug/7LM=; b=ZHWotff3tOPLc9LXBCHL0Afk09iqIljrMTkKX4iiyJxIvIK5aNjfOtPKv+7vZdJWek CWvQiG35skGqScOE3GWvC68PCTbsWFocBoa7FkfcPdLmJHkQvzqIwX4tW6bhYeJDNrKg 2p4mrcw5145sNeLghxQ+04qkFExZi8LojdIs7rOrgm/4vNhPbtDDMk1hZ6GpY/QqyBV3 Nfl79M2tSl0xZTvjDKe9R1OfbmbifJSiuO52hTesAePCrMGiDZOl8lgKoGqeM5U61fve aBobj/NVRiQr+SjkfCE5VY8Tdi5QtDNvij37O3amtbFmYPUOKjvmoj+/r85JORzQLe6L lV2A==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=9Q8qyq77BxlX4290utuNfIRYdvAcMWClNuGY6Ug/7LM=; b=r0Obve+PthdUObvyMklB37xYZ8HcbcIYNbZ0gDdGcBk/6KCdfw3BENuxqMnxsv9quD RiJRhCMcaebsmKJTSJMP/7Qy0AX5fWSB85uX8y6an/CxLACe4GTltTjwjRskyvK5981+ bK4sYxweH1Gsmv9poGJgBfPuUKgH2XKPfLYfTaSjzy6pfsdgYrgto36IN3PBoslRuccT Qsuu0ndCLEb+cn/3JxSJHma9+d3sfifyoWBc47lqt0ZrE1i9PAJlK9Nq9k1wBiYClHzm fGYQrWQJOkrlTRfAaaS46PvQAFKcO4gPqKhI0ZB/vkWd87ULzzSdnojApxjgjCyCf5v/ 8E2A==
X-Gm-Message-State: AOAM5323UA0o9SjQqVq1Q8zDkqq8qoYIbRjhf05dhHpnE2xCFANUIPMB jK8EdBCjWTQ9irNqhEW6YYugTle+8t3nIP62ZlQRyQ==
X-Google-Smtp-Source: ABdhPJymBphCshmlMWZItZ3lZpxqvMdjkfLeuuI+N0Ut3xh96PVdB4P0J1pjs0L4PfSEWB5N4hu/YJZMnv2JvkbAEpE=
X-Received: by 2002:ac2:5197:: with SMTP id u23mr4642284lfi.109.1590763105034; Fri, 29 May 2020 07:38:25 -0700 (PDT)
MIME-Version: 1.0
References: <FC99250A-2B7A-4A3D-80E3-8DDA513C63D6@ietf.org>
In-Reply-To: <FC99250A-2B7A-4A3D-80E3-8DDA513C63D6@ietf.org>
From: Eric Rescorla <ekr@rtfm.com>
Date: Fri, 29 May 2020 07:37:48 -0700
Message-ID: <CABcZeBOnddO=uiBzaDC82f+Ot532ArAE-czrSHWVqaDUtakGYA@mail.gmail.com>
Subject: Re: Revised IETF LLC Draft Strategic Plan 2020 to address feedback raised
To: Jay Daley <jay@ietf.org>
Cc: Stephen Farrell <stephen.farrell@cs.tcd.ie>, Pete Resnick <resnick@episteme.net>, Brian E Carpenter <brian.e.carpenter@gmail.com>, Martin Thomson <mt@lowentropy.net>, Vittorio Bertola <vittorio.bertola=40open-xchange.com@dmarc.ietf.org>, "Deen, Glenn (NBCUniversal)" <Glenn.Deen@nbcuni.com>, Mirja Kuehlewind <mirja.kuehlewind@ericsson.com>, ietf <ietf@ietf.org>
Content-Type: multipart/alternative; boundary="000000000000cc399305a6ca65e4"
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/PYel36JVtSkc_ZQ7aTUHzeY95PM>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 29 May 2020 14:38:30 -0000

Jay,

Thanks for sending this. Some comments below. I've also sent
you a PR to convert the tables to Markdown, which would
make this rather easier to read.


> 6. To deliver a toolchain that is up-to-date and well regarded by users.

This seems in conflict with "evidence-led". Suppose the toolchain
was well-regarded by users but empirically less efficient than
other toolchains.




> Sponsors, in addition to supporting the IETF for the value it
> delivers, are also increasingly concerned about how the organisations
> they sponsor operate, how they treat their volunteers and staff and
> what opportunities they provide for a diverse range of new
> participants.  To be able to explain this, we need to document the
> participant journey, a map of the different stages of participation
> (e.g. newcomer, leadership), at what stages people start their
> participation in the IETF, how they transition between them and at
> what stages they end their participation.

There seems to be an implicit assumption here that people should
have a "career arc" in IETF that starts with newcomer and
ends with leadership, but I don't think that's obviously
true. Many of our most valuable contributors have never served
in leadership and some of them do lots of reviewing but not
a lot of RFC writing.



> With particular regard to the services that are provided to
> participants by the LLC, a culture has built up where decisions are
> taken more on the basis of opinion and debate than evidence.  For
> example, someone has a good idea that we should provide X for
> participants and rather than ask participants if they want X, how they
> already obtain it and if it is a priority for them, a debate takes
> place on the merits of us providing it or not.  Sometimes this debate
> results in stalemate and issues get put into the “too hard” basket as
> a result.
>
> We need to shift from this to a culture where data is the starting
> point for identifying what needs to change and why and what the impact
> will be.  As the transformation says, we need to shift people from
> lining up next to people with the same opinions and standing opposite
> those who disagree, to lining up together facing the data and working
> together to interpret it.
>
> We already have some data available, such as stats on meeting
> attendees and the post-meeting survey, but making this cultural change
> requires much more data.  For example, there is a big set of questions
> on non-participation and barriers to participation which are crucial
> to providing better service to the community overall. Obtaining this
> data will require a wide ranging plan backed up with a major programme
> of surveys and technical analysis.

Well, maybe. I certainly do think that data-driven decision
making is important, but in my experience it is often
infeasibly expensive to make one's decisions based entirely
on data. In many cases, the cost of gathering the data to
make a decision whether to implement a feature far exceeds the
cost of implementing the feature. This can be necessary
in cases where the feature might have large negative
impacts, but generally when the cost is just the feature
itself, this is not true. Good product management is about
judgement that is informed by data, not by replacing judgement
with data, as this sort of suggests.

> | 15 | Lack of clarity on why we need additional income, how much and in
what form |

Perhaps this should be framed in a less loaded way in terms
of lack of clarity on how much income is needed. If it's unclear,
perhaps we need *less* income (though I doubt that is true).


> Running a cycle of three global meetings per year is a difficult and
> expensive task, and one that is going to get harder because of four
> growing issues.

This seems to be a list of three issues (1) meeting requirements (2)
carbon and (3) COVID

-Ekr

On Thu, May 28, 2020 at 9:35 PM Jay Daley <jay@ietf.org> wrote:

> All except for three of the issues raised in response to feedback are now
> addressed by a revised version.  This includes major rewrites of a number
> of areas (tools, engagement), a new linkages section to address a set of
> related issues, and multiple other changes.
>
> You can either read the whole thing in one go
>
>
> https://github.com/ietf-llc/strategy-2020-consultation/blob/latest-updates-from-consultation/DRAFT%20Strategic%20Plan%202020.md
>
> or you can read the individual commits, each of which tackles a related
> set of issues
>
>
> https://github.com/ietf-llc/strategy-2020-consultation/commits/latest-updates-from-consultation
>
> I would be grateful if those of you who provided feedback could let me
> know if these rewrites address your feedback or if more work is needed, and
> I welcome new feedback from anyone.
>
>
> For the remaining three issues
>
> 1. https://github.com/ietf-llc/strategy-2020-consultation/issues/11
> "Needs to explicitly reference the mission statements of IETF/IRTF/IAB"
> The submitter has agreed with me that this is handled by other changes
>
> 2. https://github.com/ietf-llc/strategy-2020-consultation/issues/2
> "Emphasis on accessibility for non-native english speakers needed"
> Is out of scope for the LLC to decide on this and to do it without clear
> community guidance
>
> 3. https://github.com/ietf-llc/strategy-2020-consultation/issues/3 "No
> reference to support being developed for community members who promote the
> IETF in different communities"
> We have done this some time ago but not clear if that was off our own back
> (and therefore out of scope) or following community lead. Checking.
>
>
> thanks
> Jay
>
> --
> Jay Daley
> IETF Executive Director
> jay@ietf.org
>
>