Re: [bmwg] Genart telechat review of draft-ietf-bmwg-ngfw-performance-13

Matt Joras <matt.joras@gmail.com> Wed, 02 February 2022 07:32 UTC

Return-Path: <matt.joras@gmail.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3855F3A272A; Tue, 1 Feb 2022 23:32:49 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id L1ihs1fAp0RO; Tue, 1 Feb 2022 23:32:44 -0800 (PST)
Received: from mail-lf1-x12e.google.com (mail-lf1-x12e.google.com [IPv6:2a00:1450:4864:20::12e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1600E3A2729; Tue, 1 Feb 2022 23:32:44 -0800 (PST)
Received: by mail-lf1-x12e.google.com with SMTP id u6so38767542lfm.10; Tue, 01 Feb 2022 23:32:43 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Au8pdRN73pGIaKE3IfcSYAmEHg+dgWbhrOGXkxBLkBY=; b=DissmmC9y7h/VqjByZe0F633KL8caj56a43QCRVuHXcwUQH8ceci70HhV+B9fIL1YQ 5skNxvoMgj5QvMpocSeFfoFJD1xP/sNm9MaT83a7x/8Nfyd+9IApOIOQ6QauOROSCTEe 9A+vbAiXPYdJAmKRVul39UXk6grlFHX+2NdO9UMXooWXAflDYh7ex+ApiP61KvG/iir2 AkVBDfnTivQHvacEotI7gampTtB/ErPJsvHSY0Hg/FzrkHP4fyOfJCfEuBjXzBBjyK/a XcADU//Ypi20PimdArE3F6cxh5875O4jj6sq/aLnTuAHIqVmshXnkf2dqiFDaOb2rgtp I1mg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Au8pdRN73pGIaKE3IfcSYAmEHg+dgWbhrOGXkxBLkBY=; b=2Scc7gn0mJbdWyRTVcRtU0YueJfOLMaIAm7E6tk20d1ivEtPS5pUfCoRQZeMPUe562 Gjc1/De/ooA7+V4mmU25Pr8m8XeZiGHLFVCrbqpRTJWZdYGhM9bikmJjguqi/LYUDVKf 7XKskh2QDZpTB7+XMGTiuh5lKa+EvWi59GvTDjBfqTP/ndeEs6xixWg8f3OVnTM6Rdsp n5vZq4zfR/7gkTosG9gRZw8jJf+I+92APc4BXlZKUosssRmR2DZidGW/wgLCuMaimHn7 HLsWVeJhwwUqFe8kuQh0DZ09jR5iV4ucXdQEXtOCkcfKmteqEQlipXMGE/fpW2E0s/1n TQDQ==
X-Gm-Message-State: AOAM532oQYD4vf1xl3zplRUlnj0l2W/qsrVksWC+BNL4frvAxKz+m+02 wBHRbl8IzhdiaorkH39L/a0IEL5cdgTDlqDoY5I2y7yT
X-Google-Smtp-Source: ABdhPJzF5nd9m72qzPwPE5XHZMtMt17NfvKO1lTp/EefV34X8Fsx8oWv5+TwZj4tOi4YVbwg/XDKVJf9uYk6TrmnlMw=
X-Received: by 2002:a05:6512:3e1f:: with SMTP id i31mr2262875lfv.34.1643787160760; Tue, 01 Feb 2022 23:32:40 -0800 (PST)
MIME-Version: 1.0
References: <164373365337.23647.13599772226951368639@ietfa.amsl.com> <ddf11891-8034-f28f-32d6-648ea2bf917f@eantc.de>
In-Reply-To: <ddf11891-8034-f28f-32d6-648ea2bf917f@eantc.de>
From: Matt Joras <matt.joras@gmail.com>
Date: Tue, 01 Feb 2022 23:32:29 -0800
Message-ID: <CADdTf+hwZefRf9A3rEx94rH_bReKcgMoGMySCWN_dvn08_9-Dg@mail.gmail.com>
To: Carsten Rossenhoevel <cross@eantc.de>
Cc: gen-art@ietf.org, bmwg@ietf.org, draft-ietf-bmwg-ngfw-performance.all@ietf.org, last-call@ietf.org
Content-Type: multipart/alternative; boundary="000000000000cdb3a205d70405c9"
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/9hBa_F-wRcyKTxyYi4Khu5doOCs>
Subject: Re: [bmwg] Genart telechat review of draft-ietf-bmwg-ngfw-performance-13
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 02 Feb 2022 07:32:49 -0000

Hi Carsten,

I don't have a good answer unfortunately. In my opinion the mentions of
QUIC and HTTP/3 don't add a lot, and feel a bit bolted on so to speak. This
is of course understandable given the relatively recent standardization of
QUIC itself and the lack of testing experience with it and the numerous
implementations.

If it were me I would perhaps instead make a note of QUIC as a potential
transport protocol for HTTP, and acknowledge that the document will not
attempt to enumerate specific testing procedures for it. The current text
probably would not lead to useful results for QUIC performance testing
relative to TCP.

That's my two cents anyway.

Matt Joras

On Tue, Feb 1, 2022, 11:14 PM Carsten Rossenhoevel <cross@eantc.de> wrote:

> Dear Matt,
>
> Thank you for your review!
>
> We added QUIC to the draft during one of the BMWG sessions based on
> suggestions from the attendees.  The authors are a bit unsure how to fix
> the draft that's up for approval so that it would be precise and fully
> compliant with QUIC environments.
>
> Do you have any specific suggestions how to correct the text, keeping
> QUIC in scope?
>
> Alternatively, we could remove QUIC references and take it out of scope
> and cover it in a future amendment.  Not the best solution, but after
> more than three years of drafting with so many contributors, we would
> like to avoid opening a new discussion area that would likely delay the
> work by another year.
>
> Best regards, Carsten
>
>
> Am 2/1/2022 um 5:40 PM schrieb Matt Joras via Datatracker:
> > Reviewer: Matt Joras
> > Review result: Ready with Issues
> >
> > I am the assigned Gen-ART reviewer for this draft. The General Area
> > Review Team (Gen-ART) reviews all IETF documents being processed
> > by the IESG for the IETF Chair. Please wait for direction from your
> > document shepherd or AD before posting a new version of the draft.
> >
> > For more information, please see the FAQ at
> >
> > <https://trac.ietf.org/trac/gen/wiki/GenArtfaq>.
> >
> > Document: draft-ietf-bmwg-ngfw-performance-13
> > Reviewer: Matt Joras
> > Review Date: 2022-01-31
> > IETF LC End Date: 2021-12-29
> > IESG Telechat date: 2022-02-03
> >
> > Nits/editorial comments:
> >
> > Section 4.3.1.1
> > This section details TCP stack attributes in great detail. However,
> > subsequently HTTP/3 and QUIC are both mentioned in 4.3.1.3.. QUIC is in
> need of
> > tuning just as much as TCP, if not more.
> >
> > " HTTP/3 emulated browser uses QUIC ([RFC9000]) as transport protocol."
> should
> > be reworded, and I'm not exactly sure what it is trying to convey.
> >
> > "Depending on test scenarios and selected HTTP version, HTTP header
> compression
> > MAY be set to enable or disable." should probably read " be enabled or
> > disabled."
> >
> > Similarly in sections 7, there is a lot of specific mention of TCP
> connections,
> > TCP RSTs, FINs, etc. and continued mentioning of HTTP. Since QUIC is a
> > significant carrier of HTTP traffic it seems these sections should not
> be so
> > specific to TCP. Especially since it seems as though for these kinds of
> devices
> > their limits may very well be different for UDP or TCP flows.
> >
> >
> --
> Carsten Rossenhövel
> Managing Director, EANTC AG (European Advanced Networking Test Center)
> Salzufer 14, 10587 Berlin, Germany
> office +49.30.3180595-21, fax +49.30.3180595-10, mobile +49.177.2505721
> cross@eantc.de, https://www.eantc.de
>
> Place of Business/Sitz der Gesellschaft: Berlin, Germany
> Chairman/Vorsitzender des Aufsichtsrats: Herbert Almus
> Managing Directors/Vorstand: Carsten Rossenhövel, Gabriele Schrenk
> Registered: HRB 73694, Amtsgericht Charlottenburg, Berlin, Germany
> EU VAT No: DE812824025
>
>