Re: [bmwg] Murray Kucherawy's Discuss on draft-ietf-bmwg-ngfw-performance-13: (with DISCUSS and COMMENT)

John C Klensin <john-ietf@jck.com> Wed, 16 February 2022 05:16 UTC

Return-Path: <john-ietf@jck.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B53B73A0B57; Tue, 15 Feb 2022 21:16:17 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.898
X-Spam-Level:
X-Spam-Status: No, score=-1.898 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, SPF_HELO_NONE=0.001, SPF_NONE=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id TdQefs7EtLup; Tue, 15 Feb 2022 21:16:13 -0800 (PST)
Received: from bsa2.jck.com (bsa2.jck.com [70.88.254.51]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 96C063A0B67; Tue, 15 Feb 2022 21:16:11 -0800 (PST)
Received: from [198.252.137.10] (helo=PSB) by bsa2.jck.com with esmtp (Exim 4.82 (FreeBSD)) (envelope-from <john-ietf@jck.com>) id 1nKCff-0007GD-Dy; Wed, 16 Feb 2022 00:16:07 -0500
Date: Wed, 16 Feb 2022 00:16:01 -0500
From: John C Klensin <john-ietf@jck.com>
To: Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com>
cc: Stewart Bryant <stewart.bryant@gmail.com>, Scott Bradner <sob@sobco.com>, draft-ietf-bmwg-ngfw-performance@ietf.org, bmwg-chairs@ietf.org, IETF <ietf@ietf.org>, bmwg@ietf.org, The IESG <iesg@ietf.org>
Message-ID: <F54FE95DAAE2E456E888D6A4@PSB>
In-Reply-To: <CAKKJt-fbmsh0sHEFtmWovCcRPOieSUJj1ObYKwKcE=uTgCGc+g@mail.gmail.com>
References: <164386586568.20734.14136987065393258244@ietfa.amsl.com> <fdb1df79-3a53-ea53-8532-ffb8d2545996@eantc.de> <CAL0qLwaDu9U1Kj_GtgNEY6JWpJncyC-t=NYA_uwOHs8zZmCHpQ@mail.gmail.com> <01D0C656-F323-4A7A-BF5B-764D646E2CD8@sobco.com> <5AAFE998-739E-48DA-B82D-2FBCD5989E42@gmail.com> <23A0A262ECC84B5B369983ED@PSB> <CAKKJt-fbmsh0sHEFtmWovCcRPOieSUJj1ObYKwKcE=uTgCGc+g@mail.gmail.com>
X-Mailer: Mulberry/4.0.8 (Win32)
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
X-SA-Exim-Connect-IP: 198.252.137.10
X-SA-Exim-Mail-From: john-ietf@jck.com
X-SA-Exim-Scanned: No (on bsa2.jck.com); SAEximRunCond expanded to false
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/sPQd_havNQi3KjwPbcmCOM7Hsjg>
Subject: Re: [bmwg] Murray Kucherawy's Discuss on draft-ietf-bmwg-ngfw-performance-13: (with DISCUSS and COMMENT)
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 16 Feb 2022 05:16:18 -0000


--On Tuesday, February 15, 2022 19:56 -0600 Spencer Dawkins at
IETF <spencerdawkins.ietf@gmail.com> wrote:

> I also agree with Barry's note further down in this thread,
> but wanted to talk about one of John's points here.
> 
> On Fri, Feb 11, 2022 at 10:14 AM John C Klensin
> <john-ietf@jck.com> wrote:
> 
>> 
>> 
>> If SHOULD is used, then it must be accompanied by at least one
>> of:
>>  (1) A general description of the character of the
>>         exceptions and/or in what areas exceptions are likely
>>         to arise.  Examples are fine but, except in plausible
>>         and rare cases, not enumerated lists.
>>  (2) A statement about what should be done, or what the
>>         considerations are, if the "SHOULD" requirement is not
>>         met.
>>  (3) A statement about why it is not a MUST.
> 
> 
> I never understood how a receiver of  a packet that did not
> satisfy what I might call a "naked SHOULD" (with none of these
> coverings) was supposed to know what to do next.
> 
> Since the receiver can't count on the SHOULD requirement being
> satisfied, it seems like the least a specification could do,
> was to provide guidance about what to do next, as in (2).
> 
> So I think (2) is even more helpful than the helpful (1) and
> (3).

I think it depends on the protocol.  For network  protocols near
the bottom of the stack, it will often be the case that things
either work or they don't and it seems to me that Scott's
observation -- which I might restate as "SHOULD is almost never
helpful" -- is correct or nearly so and the right answer might
be closer to (3) or maybe (1).  Closer to the application layer,
where interoperation with non-Internet systems may be important,
and maybe for Security and other issues, edge cases where things
usually work may be more common, it may be less possible to
precisely spell out all of the possibilities, and SHOULD (and/or
the Robustness Principle) become more useful and possibly
necessary, at least if we wish to avoid very long and complex
standards.

And that said, when I think of the places where I have used
SHOULD, far more of them would be best associated with the type
of explanation associated with (2) than with the other two cases.

best,
   john