Re: [tsvwg] Fwd: New Version Notification for draft-heist-tsvwg-ecn-deployment-observations-00.txt
Pete Heist <pete@heistp.net> Sat, 20 February 2021 13:39 UTC
Return-Path: <pete@heistp.net>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 511BF3A13B6 for <tsvwg@ietfa.amsl.com>; Sat, 20 Feb 2021 05:39:42 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level:
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=heistp.net
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id sscpwYL5DTJF for <tsvwg@ietfa.amsl.com>; Sat, 20 Feb 2021 05:39:40 -0800 (PST)
Received: from mail-wm1-x331.google.com (mail-wm1-x331.google.com [IPv6:2a00:1450:4864:20::331]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3FE2F3A13B5 for <tsvwg@ietf.org>; Sat, 20 Feb 2021 05:39:40 -0800 (PST)
Received: by mail-wm1-x331.google.com with SMTP id a207so10297340wmd.1 for <tsvwg@ietf.org>; Sat, 20 Feb 2021 05:39:40 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=heistp.net; s=google; h=message-id:subject:from:to:cc:date:in-reply-to:references :user-agent:mime-version:content-transfer-encoding; bh=1TabDPYE2r2EvamUQm8xyrFH2u90poViTCrmPMzi8/A=; b=bDITEq1tr3pcmqo8/sWmmMTMNfoH1SrMsE5ukkWcIwGLRAaYrVnB/e2tLiRgvs0Iun M28wfFNPdT0g9lc/PRanuDbVJM/vJCkUNxF0KHxz2UA6XE3GnhOe50enQNUDpSmv9m59 dQpr3zKVZQBh+hGQEot/Iala1RShUuNalsORMMqjukc/enPEUQTQIwrpn7tIjY+71/mx GOh5rZ7/xTWGwALuB/RtdeziX525L2f4ibArBPE844YSigjizBcvA5OYL5qL6Cr56jwc k9VrSPuX1JiEE2v0u4bDC2ZQ7sA/Bre+C/6HOzbMeqF2CYj8IM8Pce4mHqWkqCcckhEw E3eg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:message-id:subject:from:to:cc:date:in-reply-to :references:user-agent:mime-version:content-transfer-encoding; bh=1TabDPYE2r2EvamUQm8xyrFH2u90poViTCrmPMzi8/A=; b=KHbpSvpxvcN4Un+dc2uFTpY9OCDkRc52r7birztINX40kB42hr0KqftGaIss61NNxd /rYGli36z2ODhnnoaz9alCQk3jXDlgm8qAQutGzmiGLzT3Ar2u4HbSMT85iN8Q2cu8p/ HKdW/YoitzV3qbbbjfrpxxYMOYgPcMAUb/zewwCpDOQ68s5GDxqT7nxYmYn4o2/sMBwf m07nGjkWn+GaE72h9cPzjXuvYRloscbjlrJ7PwPtGmbTBaOLg1X2sI8h7KYun/1hBoZe O7QYVzULQMO65BRNapk96SDPyb35ttSa6Nvc7EO/nO7ddz1IPAeGRP1W8kRMfvxfpGuI QSSg==
X-Gm-Message-State: AOAM5311ou3rsIrIAja5q03PHbXj+At+Zod0OsvzsL4C2JZpRBgd95Y6 ZWGPPCiPI0eeLqBU4WSQ/XNW2ms7KLxBOw==
X-Google-Smtp-Source: ABdhPJw5ncggyLvPUqu6z0jD2S7ldpvEFk7GcW04GkykQ3yQK/uUAZWyIN7oGW90capvx0kyrZGasQ==
X-Received: by 2002:a1c:2d47:: with SMTP id t68mr12832645wmt.189.1613828378585; Sat, 20 Feb 2021 05:39:38 -0800 (PST)
Received: from [10.72.0.88] (h-1169.lbcfree.net. [185.193.85.130]) by smtp.gmail.com with ESMTPSA id v17sm18326427wru.85.2021.02.20.05.39.37 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 20 Feb 2021 05:39:38 -0800 (PST)
Message-ID: <2c07adbe91e69ddd79fa81edfedaf087cdbf12b2.camel@heistp.net>
From: Pete Heist <pete@heistp.net>
To: Bob Briscoe <ietf@bobbriscoe.net>
Cc: Mirja Kuehlewind <mirja.kuehlewind@ericsson.com>, TSVWG <tsvwg@ietf.org>
Date: Sat, 20 Feb 2021 14:39:37 +0100
In-Reply-To: <6e23258a-877f-2f2b-df6d-a18d20d61ec2@bobbriscoe.net>
References: <161366419040.16138.17111583810851995947@ietfa.amsl.com> <BF0810D9-E742-4FCB-90B1-6957551B585D@heistp.net> <29EBB69A-2A00-4A1D-A7D0-09469602CD8E@ericsson.com> <414509c71436aac01e894689a4dce7f0251ec0ef.camel@heistp.net> <6e23258a-877f-2f2b-df6d-a18d20d61ec2@bobbriscoe.net>
Content-Type: text/plain; charset="UTF-8"
User-Agent: Evolution 3.38.3
MIME-Version: 1.0
Content-Transfer-Encoding: 8bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/8v6LwXN1oN7UIqqG7XZ2_8_S4Qg>
Subject: Re: [tsvwg] Fwd: New Version Notification for draft-heist-tsvwg-ecn-deployment-observations-00.txt
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 20 Feb 2021 13:39:42 -0000
New revision posted and some comments below... On Sat, 2021-02-20 at 09:36 +0000, Bob Briscoe wrote: > Pete, > > If you plan to post a revision, in the TCP table (Sec.5.3) would you > pls > consider including the counts of ECT packets, as in the non-TCP table > in > Sec.5.3? Otherwise we don't know what percentage of the total ECN > traffic each count represent. That's a useful addition. An ECT(0) column is now added, and the TCP table's column order is now similar to the non-TCP table. ECE for the opposite direction is still next to CE as that seems most readable. I left out ECT(1) for TCP as there's so little of that, and then it gets harder with the line length limit. > I'm trying to separate out the IPs known to be behind the FQ-CoDel > nodes > in the backhaul. I.e. separating known from unknown causes. That's mentioned in Section 3.2. > Separately, a count of total packets, or equivalently a count of > not-ECT, would be v useful too. I didn't capture Not-ECT by IP address, mainly because some testing made me question how at least one ipset lookup per-packet would affect performance on their production gateway. I added that to the Limitations section as it could be useful if available. Pete > If you can do this without losing the ECE counts, even better. Having > CE > and ECE together enables a rough estimate of the average window.{Note > 1} > > Specifically, > avgWindow = ECE * delAckRatio / CE > > Thank you (again) > > > Bob > > {Note 1} And lots of other assumptions, such as: > - delayed Ack Ratio including stretch ACKs has to be guessed (e.g. > 2???) > - minimal additional ack coalescing in the network > - minimal reordering > - traffic volume dominated by elephants > - the TCP protocol is working as it should > - and so on. > > > On 19/02/2021 13:06, Pete Heist wrote: > > Yes, that was somewhat unexpected to us at first too, but misuse of > > the > > ECN field esp. on non-TCP packets seems to explain it in cases > > where > > there ratios don't look like AQM signaling. The data for TCP is > > overall > > easier to attribute to ECN when you can see feedback via ECE. > > > > I didn't editorialize much on the results, but I'll use this as a > > chance to add what struck me: > > > > * While ECN negotiations were relatively small at around 1.44%, > > they > > were spread across 45% of the IPs, so the proportion of paths using > > it > > seems significant. > > > > * The data seem to show significant 3168 marking AQM deployment, > > when > > 24% of LAN IPs that negotiated ECN saw CE or ECE. The draft > > mentions > > how some of it is from known AQM instances and some not. Congestion > > overall doesn't seem excessive, but that could be quantified > > better. > > > > * A wider survey might help on the non-TCP data. > > > > Anyway thanks for taking a look... > > > > Pete > > > > On Fri, 2021-02-19 at 11:44 +0000, Mirja Kuehlewind wrote: > > > Hi Pete, > > > > > > thanks for putting this together and sharing! > > > > > > I have one question on the data. Maybe I'm not readying this > > > correctly but if I look at the big table at the end, then I see a > > > lot > > > of cases where there are much more CE marks than ECT(0) marks. > > > That's > > > a bit unexpected as usually an AQM should only mark a small > > > portion > > > of the packets. Or do I interpret the data there incorrectly? > > > > > > Mirja > > > > > > > > > > > > On 18.02.21, 17:38, "tsvwg on behalf of Pete Heist" > > > <tsvwg-bounces@ietf.org on behalf of pete@heistp.net> wrote: > > > > > > > > > > A new version of I-D, draft-heist-tsvwg-ecn-deployment- > > > observations-00.txt > > > > has been successfully submitted by Peter G. Heist and > > > posted to > > > the > > > > IETF repository. > > > > > > > > Name: draft-heist-tsvwg-ecn-deployment- > > > observations > > > > Revision: 00 > > > > Title: Explicit Congestion Notification (ECN) > > > Deployment Observations > > > > Document date: 2021-02-18 > > > > Group: Individual Submission > > > > Pages: 27 > > > > URL: > > > > > > https://www.ietf.org/archive/id/draft-heist-tsvwg-ecn-deployment-observations-00.txt > > > > Status: > > > > > > https://datatracker.ietf.org/doc/draft-heist-tsvwg-ecn-deployment-observations/ > > > > Html: > > > > > > https://www.ietf.org/archive/id/draft-heist-tsvwg-ecn-deployment-observations-00.html > > > > Htmlized: > > > > > > https://tools.ietf.org/html/draft-heist-tsvwg-ecn-deployment-observations-00 > > > > > > > > Abstract: > > > > This note presents data gathered at an Internet Service > > > Provider's > > > > gateway on the observed deployment and usage of ECN. > > > Relevant IP > > > > counter and flow tracking data was collected and > > > analyzed for > > > TCP and > > > > other protocols. > > > > > > This draft adds some data on the current usage of ECN. It > > > was > > > gathered over several weeks at a cooperative ISP with around 660 > > > members, and looks at ECN endpoint activity, AQM deployment and > > > ECN > > > usage on non-TCP protocols. While this study is still relatively > > > small, it’s hopefully at least a little more useful than the > > > stateless counter data I posted late last year, which should set > > > the > > > bar suitably low… :) > > > > > > Pete > > > > > > > > >
- [tsvwg] Fwd: New Version Notification for draft-h… Pete Heist
- Re: [tsvwg] Fwd: New Version Notification for dra… Mirja Kuehlewind
- Re: [tsvwg] Fwd: New Version Notification for dra… Jonathan Morton
- Re: [tsvwg] Fwd: New Version Notification for dra… Pete Heist
- Re: [tsvwg] Fwd: New Version Notification for dra… Dave Taht
- Re: [tsvwg] Fwd: New Version Notification for dra… Bob Briscoe
- Re: [tsvwg] Fwd: New Version Notification for dra… Jonathan Morton
- Re: [tsvwg] Fwd: New Version Notification for dra… Pete Heist
- Re: [tsvwg] Fwd: New Version Notification for dra… Bob Briscoe
- Re: [tsvwg] Fwd: New Version Notification for dra… Bob Briscoe
- [tsvwg] FQ & VPNs (was: Fwd: New Version Notifica… Bob Briscoe
- Re: [tsvwg] Fwd: New Version Notification for dra… Jonathan Morton
- Re: [tsvwg] FQ & VPNs (was: Fwd: New Version Noti… Jonathan Morton
- Re: [tsvwg] FQ & VPNs Bob Briscoe
- Re: [tsvwg] FQ & VPNs Jonathan Morton
- Re: [tsvwg] FQ & VPNs Bob Briscoe
- Re: [tsvwg] FQ & VPNs Bob Briscoe
- Re: [tsvwg] FQ & VPNs Dave Taht
- Re: [tsvwg] Fwd: New Version Notification for dra… Bob Briscoe
- Re: [tsvwg] Fwd: New Version Notification for dra… Pete Heist
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Jonathan Morton
- Re: [tsvwg] FQ & VPNs Sebastian Moeller
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Dave Taht
- Re: [tsvwg] FQ & VPNs Jonathan Morton
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Tom Henderson
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Jonathan Morton
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Jonathan Morton
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Tom Henderson
- Re: [tsvwg] FQ & VPNs Sebastian Moeller
- Re: [tsvwg] FQ & VPNs Jonathan Morton
- Re: [tsvwg] FQ & VPNs Tom Henderson
- Re: [tsvwg] FQ & VPNs Jonathan Morton
- Re: [tsvwg] FQ & VPNs Greg White
- Re: [tsvwg] FQ & VPNs Rodney W. Grimes
- Re: [tsvwg] Fwd: New Version Notification for dra… Bob Briscoe
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Sebastian Moeller
- Re: [tsvwg] FQ & VPNs Ingemar Johansson S
- Re: [tsvwg] FQ & VPNs Pete Heist
- Re: [tsvwg] Fwd: New Version Notification for dra… Martin Duke
- Re: [tsvwg] Fwd: New Version Notification for dra… Jonathan Morton
- Re: [tsvwg] Fwd: New Version Notification for dra… Dave Taht
- Re: [tsvwg] Fwd: New Version Notification for dra… Pete Heist
- Re: [tsvwg] Fwd: New Version Notification for dra… Pete Heist