Re: [tsvwg] Fwd: New Version Notification for draft-heist-tsvwg-ecn-deployment-observations-00.txt
Martin Duke <martin.h.duke@gmail.com> Fri, 26 February 2021 23:31 UTC
Return-Path: <martin.h.duke@gmail.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F1BD43A123F for <tsvwg@ietfa.amsl.com>; Fri, 26 Feb 2021 15:31:26 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3p85gVTujOAi for <tsvwg@ietfa.amsl.com>; Fri, 26 Feb 2021 15:31:24 -0800 (PST)
Received: from mail-il1-x12f.google.com (mail-il1-x12f.google.com [IPv6:2607:f8b0:4864:20::12f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 222293A1236 for <tsvwg@ietf.org>; Fri, 26 Feb 2021 15:31:24 -0800 (PST)
Received: by mail-il1-x12f.google.com with SMTP id e7so9481762ile.7 for <tsvwg@ietf.org>; Fri, 26 Feb 2021 15:31:23 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=O+Yv/CxgOUed3T3WLdmq9eTG3zdpbOOCA33aMg56Rqk=; b=LU68fPYPWoZ9WRYpYA8/SX3z3bHddfoRbdCDXfMZyMFYfQZ/edbe3IX/xZiXYdRs+v 8d5Ky4sh9w/Uj94ItUGynMaIgXfgrfCG6oF1LkT3GWXPZ2+vIK4WJB9tw/XCQQvpoXhF clK9S6+KitVdsh/uIHIjFKegKbfOS20d/lhswkzPLx0byXp2DJMSXsrsGv3c1g97P0PH 9XVmglkBWZ/5BwJchnlWuHDWPcbu2dxJ1TpAS4kFT7eyJleR1mhy64LgEK1Pjs8Z3LZy EaHrpO36QdJZxJWB81YqsBliMj0SpvnkwHvaE/8gGjAqczIXnYk/kBVhdgobB8PqL5RK nCwA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=O+Yv/CxgOUed3T3WLdmq9eTG3zdpbOOCA33aMg56Rqk=; b=O8mULYSO6EWEyhbP6lDqdpWXh5hsJbnJ20dDdZ+3IpxSnA/NJMWdwKqiHFoifUhrwF 4/mO+yBfJKYV9QY54AKIYiWN5HP4+fGcV2tfG5j0+w0Wk1+FpcRTwclVA1N81rKEZ5pz QJdbi/hlAXciRGEBNpISCL1Q41RGVIloO5e3fxz2OldaDYBV8I3BQ7BZZsUz2qA4Hu7u lZW9k/4437F90oR5jloLY3nUwc64ixRjlyv4A6m3rrZuyZD/PsW+5Hfz7BcB3py6sfFz aoM+gLDWiFkKJsE9lotTTwcOOTK5glRBSkJPnu7/+2pO5/tdD6Y6KJMZW/OgLJoEDPvk adEw==
X-Gm-Message-State: AOAM533q7ZcBkoYC/b/XI267g4HxWn9lElEolj3GYb3quApCsZ2Yz6Dm 1e7c1wTGyEGD+C8pYuRXIYFR7L3gBSOxqMO+LGiaKv3QQP8=
X-Google-Smtp-Source: ABdhPJxRtumqX50KCyheG+DIojS9F2vbC1UP0m1ateUQT9RZwlqwPkoCzQVKUAn2L3rh6Srp//EUGLcrxcK/PPAFnOw=
X-Received: by 2002:a92:3f08:: with SMTP id m8mr4481414ila.237.1614382283248; Fri, 26 Feb 2021 15:31:23 -0800 (PST)
MIME-Version: 1.0
References: <161366419040.16138.17111583810851995947@ietfa.amsl.com> <BF0810D9-E742-4FCB-90B1-6957551B585D@heistp.net> <29EBB69A-2A00-4A1D-A7D0-09469602CD8E@ericsson.com> <414509c71436aac01e894689a4dce7f0251ec0ef.camel@heistp.net> <6e23258a-877f-2f2b-df6d-a18d20d61ec2@bobbriscoe.net> <2c07adbe91e69ddd79fa81edfedaf087cdbf12b2.camel@heistp.net> <81af054f-f7ee-2962-1419-ffa8398ac95d@bobbriscoe.net>
In-Reply-To: <81af054f-f7ee-2962-1419-ffa8398ac95d@bobbriscoe.net>
From: Martin Duke <martin.h.duke@gmail.com>
Date: Fri, 26 Feb 2021 15:31:12 -0800
Message-ID: <CAM4esxQR4Lqkt-eg1gi9DHHU5fKr-yYsZMPOci5rWORPSoO3KQ@mail.gmail.com>
To: Bob Briscoe <ietf@bobbriscoe.net>
Cc: Pete Heist <pete@heistp.net>, TSVWG <tsvwg@ietf.org>
Content-Type: multipart/alternative; boundary="0000000000008657db05bc45aa7f"
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/xmQ7fiGnac8CADKHDBATci2kzHI>
Subject: Re: [tsvwg] Fwd: New Version Notification for draft-heist-tsvwg-ecn-deployment-observations-00.txt
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 26 Feb 2021 23:31:27 -0000
Thanks Pete! I wonder if the non-TCP ECN traffic is QUIC? I don't think the main implementations are doing it, but there are a few ECN-capable implementations in production. On Sun, Feb 21, 2021 at 4:34 PM Bob Briscoe <ietf@bobbriscoe.net> wrote: > Pete, > > Thx for doing this. I'm afraid I won't be able to now analyse the data > you've provided for a couple of days, 'cos I have to focus on a couple > of deadlines tomorrow, one being the IETF draft deadline. > > But whatever, thx v much. > > Bob > > On 20/02/2021 13:39, Pete Heist wrote: > > New revision posted and some comments below... > > > > On Sat, 2021-02-20 at 09:36 +0000, Bob Briscoe wrote: > >> Pete, > >> > >> If you plan to post a revision, in the TCP table (Sec.5.3) would you > >> pls > >> consider including the counts of ECT packets, as in the non-TCP table > >> in > >> Sec.5.3? Otherwise we don't know what percentage of the total ECN > >> traffic each count represent. > > That's a useful addition. An ECT(0) column is now added, and the TCP > > table's column order is now similar to the non-TCP table. ECE for the > > opposite direction is still next to CE as that seems most readable. I > > left out ECT(1) for TCP as there's so little of that, and then it gets > > harder with the line length limit. > > > >> I'm trying to separate out the IPs known to be behind the FQ-CoDel > >> nodes > >> in the backhaul. I.e. separating known from unknown causes. > > That's mentioned in Section 3.2. > > > >> Separately, a count of total packets, or equivalently a count of > >> not-ECT, would be v useful too. > > I didn't capture Not-ECT by IP address, mainly because some testing > > made me question how at least one ipset lookup per-packet would affect > > performance on their production gateway. I added that to the > > Limitations section as it could be useful if available. > > > > Pete > > > >> If you can do this without losing the ECE counts, even better. Having > >> CE > >> and ECE together enables a rough estimate of the average window.{Note > >> 1} > >> > >> Specifically, > >> avgWindow = ECE * delAckRatio / CE > >> > >> Thank you (again) > >> > >> > >> Bob > >> > >> {Note 1} And lots of other assumptions, such as: > >> - delayed Ack Ratio including stretch ACKs has to be guessed (e.g. > >> 2???) > >> - minimal additional ack coalescing in the network > >> - minimal reordering > >> - traffic volume dominated by elephants > >> - the TCP protocol is working as it should > >> - and so on. > >> > >> > >> On 19/02/2021 13:06, Pete Heist wrote: > >>> Yes, that was somewhat unexpected to us at first too, but misuse of > >>> the > >>> ECN field esp. on non-TCP packets seems to explain it in cases > >>> where > >>> there ratios don't look like AQM signaling. The data for TCP is > >>> overall > >>> easier to attribute to ECN when you can see feedback via ECE. > >>> > >>> I didn't editorialize much on the results, but I'll use this as a > >>> chance to add what struck me: > >>> > >>> * While ECN negotiations were relatively small at around 1.44%, > >>> they > >>> were spread across 45% of the IPs, so the proportion of paths using > >>> it > >>> seems significant. > >>> > >>> * The data seem to show significant 3168 marking AQM deployment, > >>> when > >>> 24% of LAN IPs that negotiated ECN saw CE or ECE. The draft > >>> mentions > >>> how some of it is from known AQM instances and some not. Congestion > >>> overall doesn't seem excessive, but that could be quantified > >>> better. > >>> > >>> * A wider survey might help on the non-TCP data. > >>> > >>> Anyway thanks for taking a look... > >>> > >>> Pete > >>> > >>> On Fri, 2021-02-19 at 11:44 +0000, Mirja Kuehlewind wrote: > >>>> Hi Pete, > >>>> > >>>> thanks for putting this together and sharing! > >>>> > >>>> I have one question on the data. Maybe I'm not readying this > >>>> correctly but if I look at the big table at the end, then I see a > >>>> lot > >>>> of cases where there are much more CE marks than ECT(0) marks. > >>>> That's > >>>> a bit unexpected as usually an AQM should only mark a small > >>>> portion > >>>> of the packets. Or do I interpret the data there incorrectly? > >>>> > >>>> Mirja > >>>> > >>>> > >>>> > >>>> On 18.02.21, 17:38, "tsvwg on behalf of Pete Heist" > >>>> <tsvwg-bounces@ietf.org on behalf of pete@heistp.net> wrote: > >>>> > >>>> > >>>> > A new version of I-D, draft-heist-tsvwg-ecn-deployment- > >>>> observations-00.txt > >>>> > has been successfully submitted by Peter G. Heist and > >>>> posted to > >>>> the > >>>> > IETF repository. > >>>> > > >>>> > Name: draft-heist-tsvwg-ecn-deployment- > >>>> observations > >>>> > Revision: 00 > >>>> > Title: Explicit Congestion Notification (ECN) > >>>> Deployment Observations > >>>> > Document date: 2021-02-18 > >>>> > Group: Individual Submission > >>>> > Pages: 27 > >>>> > URL: > >>>> > >>>> > https://www.ietf.org/archive/id/draft-heist-tsvwg-ecn-deployment-observations-00.txt > >>>> > Status: > >>>> > >>>> > https://datatracker.ietf.org/doc/draft-heist-tsvwg-ecn-deployment-observations/ > >>>> > Html: > >>>> > >>>> > https://www.ietf.org/archive/id/draft-heist-tsvwg-ecn-deployment-observations-00.html > >>>> > Htmlized: > >>>> > >>>> > https://tools.ietf.org/html/draft-heist-tsvwg-ecn-deployment-observations-00 > >>>> > > >>>> > Abstract: > >>>> > This note presents data gathered at an Internet Service > >>>> Provider's > >>>> > gateway on the observed deployment and usage of ECN. > >>>> Relevant IP > >>>> > counter and flow tracking data was collected and > >>>> analyzed for > >>>> TCP and > >>>> > other protocols. > >>>> > >>>> This draft adds some data on the current usage of ECN. It > >>>> was > >>>> gathered over several weeks at a cooperative ISP with around 660 > >>>> members, and looks at ECN endpoint activity, AQM deployment and > >>>> ECN > >>>> usage on non-TCP protocols. While this study is still relatively > >>>> small, it’s hopefully at least a little more useful than the > >>>> stateless counter data I posted late last year, which should set > >>>> the > >>>> bar suitably low… :) > >>>> > >>>> Pete > >>>> > >>>> > > > > -- > ________________________________________________________________ > Bob Briscoe http://bobbriscoe.net/ > >
- [tsvwg] Fwd: New Version Notification for draft-h… Pete Heist
- Re: [tsvwg] Fwd: New Version Notification for dra… Mirja Kuehlewind
- Re: [tsvwg] Fwd: New Version Notification for dra… Jonathan Morton
- Re: [tsvwg] Fwd: New Version Notification for dra… Pete Heist
- Re: [tsvwg] Fwd: New Version Notification for dra… Dave Taht
- Re: [tsvwg] Fwd: New Version Notification for dra… Bob Briscoe
- Re: [tsvwg] Fwd: New Version Notification for dra… Jonathan Morton
- Re: [tsvwg] Fwd: New Version Notification for dra… Pete Heist
- Re: [tsvwg] Fwd: New Version Notification for dra… Bob Briscoe
- Re: [tsvwg] Fwd: New Version Notification for dra… Bob Briscoe
- [tsvwg] FQ & VPNs (was: Fwd: New Version Notifica… Bob Briscoe
- Re: [tsvwg] Fwd: New Version Notification for dra… Jonathan Morton
- Re: [tsvwg] FQ & VPNs (was: Fwd: New Version Noti… Jonathan Morton
- Re: [tsvwg] FQ & VPNs Bob Briscoe
- Re: [tsvwg] FQ & VPNs Jonathan Morton
- Re: [tsvwg] FQ & VPNs Bob Briscoe
- Re: [tsvwg] FQ & VPNs Bob Briscoe
- Re: [tsvwg] FQ & VPNs Dave Taht
- Re: [tsvwg] Fwd: New Version Notification for dra… Bob Briscoe
- Re: [tsvwg] Fwd: New Version Notification for dra… Pete Heist
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Jonathan Morton
- Re: [tsvwg] FQ & VPNs Sebastian Moeller
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Dave Taht
- Re: [tsvwg] FQ & VPNs Jonathan Morton
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Tom Henderson
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Jonathan Morton
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Jonathan Morton
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Tom Henderson
- Re: [tsvwg] FQ & VPNs Sebastian Moeller
- Re: [tsvwg] FQ & VPNs Jonathan Morton
- Re: [tsvwg] FQ & VPNs Tom Henderson
- Re: [tsvwg] FQ & VPNs Jonathan Morton
- Re: [tsvwg] FQ & VPNs Greg White
- Re: [tsvwg] FQ & VPNs Rodney W. Grimes
- Re: [tsvwg] Fwd: New Version Notification for dra… Bob Briscoe
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Sebastian Moeller
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Pete Heist
- Re: [tsvwg] Fwd: New Version Notification for dra… Martin Duke
- Re: [tsvwg] Fwd: New Version Notification for dra… Jonathan Morton
- Re: [tsvwg] Fwd: New Version Notification for dra… Dave Taht
- Re: [tsvwg] Fwd: New Version Notification for dra… Pete Heist
- Re: [tsvwg] Fwd: New Version Notification for dra… Pete Heist