[bmwg] Preliminary AD review of draft-ietf-bmwg-benchmarking-stateful

Warren Kumari <warren@kumari.net> Thu, 11 April 2024 20:09 UTC

Return-Path: <warren@kumari.net>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 34417C14F705 for <bmwg@ietfa.amsl.com>; Thu, 11 Apr 2024 13:09:36 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.095
X-Spam-Level:
X-Spam-Status: No, score=-2.095 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=kumari.net
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YBZrzL8FnI_f for <bmwg@ietfa.amsl.com>; Thu, 11 Apr 2024 13:09:31 -0700 (PDT)
Received: from mail-ed1-x530.google.com (mail-ed1-x530.google.com [IPv6:2a00:1450:4864:20::530]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4CCECC14F6F4 for <bmwg@ietf.org>; Thu, 11 Apr 2024 13:09:31 -0700 (PDT)
Received: by mail-ed1-x530.google.com with SMTP id 4fb4d7f45d1cf-56fead80bacso251170a12.0 for <bmwg@ietf.org>; Thu, 11 Apr 2024 13:09:30 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kumari.net; s=google; t=1712866169; x=1713470969; darn=ietf.org; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=RzQBkw398/3GRxggwDPvScvhr1kgF+wso6GpjGxLGiI=; b=PstwOiuaRem3wo/yQ0N46iYEG6Ne3u7ekz0OQF5+PhErGXHmATIaiMBTELkd3gKnaC maNWeGwI5mOa+CJrUiUCAD023YKzoTO/WeW24RSIK5Mc/tNnoD4Y5X7YJXjEe4t9qX/Y MgR+20E923WI1HduZp+zgSrB7x6iyEEjIOpYOgPeOClyhfLK351bsR2Qm5uwp6euibya JuImmpTwJS7WHTBG6eqd3n96euoXGhzZ7q1Rh1G/SG4p6bicVvckEDBUdxJWKoklfuBe 9AdhIxi3faoNoFzCAmxLRuu40jF9tj6i2Xd2v/iYCKb74/vQXi46t2MIfwNN1KQM8Abb 7ahA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1712866169; x=1713470969; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=RzQBkw398/3GRxggwDPvScvhr1kgF+wso6GpjGxLGiI=; b=WlppPTNUQnya9j88gn+71fhxmHIO6k/K7hRGTZuAr4+ToD9o0Vdropmhirh60ZuUkX ZvjQBL94iV0NXrbok4p5fPY0VXi0zBIqY7tLSc7KlDTLt2B4I4st4QQhqcoHtaqLz9BB p/G9HzWk4jCSeTuoMGVO5u8QmBaLgVPFTezZwQA7SN+pXFsBNBKao50g4btNE4vMXf8L jeZuoa6e44lY0R7G6QBCNH0w1EZ1vsNBvous8USURMI2+kBtGpSoTi3sM2XWNP90cCT8 rg4Qh1e08XKWzr+7g55Lk5ZCIIG1+raJ9N3QODGk2yjBBT0c5Iltb1+hulxq28b2Py+o xT8w==
X-Forwarded-Encrypted: i=1; AJvYcCU9AgU7UZ7bMh3Th/BO8wiBTpInh9hNy4sZBRcfj+BCi9CG1owjxNtZNTteuDRIfGiOwJ4EAmP5pcgPWvsa
X-Gm-Message-State: AOJu0YwoYTSghMnNQ3AgFaJSkFi/G+d57L2DG7HH76NJil+G0rgGOOW+ NJlFbPzVoEGsD8dGRPvnLUiJaj+4m+U28xtoBy4YJPfANIuGAP+xOz6yYPoeInPoqugrYzRl6t8 rkjI9hN4L4IMfg7Hs3u5HTl5/CIOF+wVSjMaXjpRQAHft6xcD
X-Google-Smtp-Source: AGHT+IH5f5R3P7mnCYIqxw7Zi7v/DKR7gp6GKdi7W4xkrHVGf4DCFiZbLIgU59rm8+RKiWBdaClkRImChyB33K7XN6U=
X-Received: by 2002:a50:d596:0:b0:56c:1696:58a8 with SMTP id v22-20020a50d596000000b0056c169658a8mr676163edi.0.1712866169160; Thu, 11 Apr 2024 13:09:29 -0700 (PDT)
Received: from 649336022844 named unknown by gmailapi.google.com with HTTPREST; Thu, 11 Apr 2024 16:09:27 -0400
Mime-Version: 1.0
X-Mailer: Superhuman Desktop (2024-04-10T19:06:43Z)
X-Superhuman-ID: luvoa14m.9366ffef-9bcc-4c14-8063-7cd22dbbbd72
X-Superhuman-Draft-ID: draft000c846a9a2ec199
X-Superhuman-Thread-ID: draft005d549e10327021
From: Warren Kumari <warren@kumari.net>
Date: Thu, 11 Apr 2024 16:09:27 -0400
Message-ID: <CAHw9_iLMQ8bHR_oTSgX0WzfAxH2h+zc0e-UsdC9HGivtKC2jyg@mail.gmail.com>
To: draft-ietf-bmwg-benchmarking-stateful@ietf.org, bmwg <bmwg@ietf.org>
Content-Type: multipart/alternative; boundary="0000000000008faac90615d7bb68"
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/nnud8ludhZtY9a6RctCm2hKxcNo>
Subject: [bmwg] Preliminary AD review of draft-ietf-bmwg-benchmarking-stateful
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 11 Apr 2024 20:09:36 -0000

Hi there authors and WG,

Firstly, massive apologies for how long this (preliminary) review has
taken; I usually get these done much more quickly, but travel (ICANN, then
IETF) got in the way, and then I wanted to discuss this with the rest of
the IESG.

There is some fairly strong pushback on amount of the use of "we" - some
examples:
First, we discuss why using pseudorandom port numbers with stateful NATxy
gateways is a hard problem.
Then we recommend a solution.
We follow the same approach: first, we use a single source and destination
IP address pair, and then we explain how to use multiple IP addresses.
We define the most important elements of our proposed benchmarking system
as follows. […]

This makes the document sound much more like an academic paper than a WG
consensus document. While this will require a fairly large number of
changes (there are ~56 occurrences of 'we'), I don't think that it will
actually be that hard to fix — in many cases it is simply s/We/This
document/.

While I'm sure it is annoying to have to make these sort of editorial
changes, I figure that it's better to let you know now, instead of waiting
until it reached IESG eval, and then end up with a bunch of DISCUSS ballots…

W