Re: [tsvwg] Fwd: New Version Notification for draft-heist-tsvwg-ecn-deployment-observations-00.txt

Pete Heist <pete@heistp.net> Sat, 20 February 2021 13:39 UTC

Return-Path: <pete@heistp.net>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 511BF3A13B6 for <tsvwg@ietfa.amsl.com>; Sat, 20 Feb 2021 05:39:42 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level:
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=heistp.net
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id sscpwYL5DTJF for <tsvwg@ietfa.amsl.com>; Sat, 20 Feb 2021 05:39:40 -0800 (PST)
Received: from mail-wm1-x331.google.com (mail-wm1-x331.google.com [IPv6:2a00:1450:4864:20::331]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3FE2F3A13B5 for <tsvwg@ietf.org>; Sat, 20 Feb 2021 05:39:40 -0800 (PST)
Received: by mail-wm1-x331.google.com with SMTP id a207so10297340wmd.1 for <tsvwg@ietf.org>; Sat, 20 Feb 2021 05:39:40 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=heistp.net; s=google; h=message-id:subject:from:to:cc:date:in-reply-to:references :user-agent:mime-version:content-transfer-encoding; bh=1TabDPYE2r2EvamUQm8xyrFH2u90poViTCrmPMzi8/A=; b=bDITEq1tr3pcmqo8/sWmmMTMNfoH1SrMsE5ukkWcIwGLRAaYrVnB/e2tLiRgvs0Iun M28wfFNPdT0g9lc/PRanuDbVJM/vJCkUNxF0KHxz2UA6XE3GnhOe50enQNUDpSmv9m59 dQpr3zKVZQBh+hGQEot/Iala1RShUuNalsORMMqjukc/enPEUQTQIwrpn7tIjY+71/mx GOh5rZ7/xTWGwALuB/RtdeziX525L2f4ibArBPE844YSigjizBcvA5OYL5qL6Cr56jwc k9VrSPuX1JiEE2v0u4bDC2ZQ7sA/Bre+C/6HOzbMeqF2CYj8IM8Pce4mHqWkqCcckhEw E3eg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:message-id:subject:from:to:cc:date:in-reply-to :references:user-agent:mime-version:content-transfer-encoding; bh=1TabDPYE2r2EvamUQm8xyrFH2u90poViTCrmPMzi8/A=; b=KHbpSvpxvcN4Un+dc2uFTpY9OCDkRc52r7birztINX40kB42hr0KqftGaIss61NNxd /rYGli36z2ODhnnoaz9alCQk3jXDlgm8qAQutGzmiGLzT3Ar2u4HbSMT85iN8Q2cu8p/ HKdW/YoitzV3qbbbjfrpxxYMOYgPcMAUb/zewwCpDOQ68s5GDxqT7nxYmYn4o2/sMBwf m07nGjkWn+GaE72h9cPzjXuvYRloscbjlrJ7PwPtGmbTBaOLg1X2sI8h7KYun/1hBoZe O7QYVzULQMO65BRNapk96SDPyb35ttSa6Nvc7EO/nO7ddz1IPAeGRP1W8kRMfvxfpGuI QSSg==
X-Gm-Message-State: AOAM5311ou3rsIrIAja5q03PHbXj+At+Zod0OsvzsL4C2JZpRBgd95Y6 ZWGPPCiPI0eeLqBU4WSQ/XNW2ms7KLxBOw==
X-Google-Smtp-Source: ABdhPJw5ncggyLvPUqu6z0jD2S7ldpvEFk7GcW04GkykQ3yQK/uUAZWyIN7oGW90capvx0kyrZGasQ==
X-Received: by 2002:a1c:2d47:: with SMTP id t68mr12832645wmt.189.1613828378585; Sat, 20 Feb 2021 05:39:38 -0800 (PST)
Received: from [10.72.0.88] (h-1169.lbcfree.net. [185.193.85.130]) by smtp.gmail.com with ESMTPSA id v17sm18326427wru.85.2021.02.20.05.39.37 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 20 Feb 2021 05:39:38 -0800 (PST)
Message-ID: <2c07adbe91e69ddd79fa81edfedaf087cdbf12b2.camel@heistp.net>
From: Pete Heist <pete@heistp.net>
To: Bob Briscoe <ietf@bobbriscoe.net>
Cc: Mirja Kuehlewind <mirja.kuehlewind@ericsson.com>, TSVWG <tsvwg@ietf.org>
Date: Sat, 20 Feb 2021 14:39:37 +0100
In-Reply-To: <6e23258a-877f-2f2b-df6d-a18d20d61ec2@bobbriscoe.net>
References: <161366419040.16138.17111583810851995947@ietfa.amsl.com> <BF0810D9-E742-4FCB-90B1-6957551B585D@heistp.net> <29EBB69A-2A00-4A1D-A7D0-09469602CD8E@ericsson.com> <414509c71436aac01e894689a4dce7f0251ec0ef.camel@heistp.net> <6e23258a-877f-2f2b-df6d-a18d20d61ec2@bobbriscoe.net>
Content-Type: text/plain; charset="UTF-8"
User-Agent: Evolution 3.38.3
MIME-Version: 1.0
Content-Transfer-Encoding: 8bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/8v6LwXN1oN7UIqqG7XZ2_8_S4Qg>
Subject: Re: [tsvwg] Fwd: New Version Notification for draft-heist-tsvwg-ecn-deployment-observations-00.txt
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 20 Feb 2021 13:39:42 -0000

New revision posted and some comments below...

On Sat, 2021-02-20 at 09:36 +0000, Bob Briscoe wrote:
> Pete,
> 
> If you plan to post a revision, in the TCP table (Sec.5.3) would you
> pls 
> consider including the counts of ECT packets, as in the non-TCP table
> in 
> Sec.5.3? Otherwise we don't know what percentage of the total ECN 
> traffic each count represent.

That's a useful addition. An ECT(0) column is now added, and the TCP
table's column order is now similar to the non-TCP table. ECE for the
opposite direction is still next to CE as that seems most readable. I
left out ECT(1) for TCP as there's so little of that, and then it gets
harder with the line length limit.

> I'm trying to separate out the IPs known to be behind the FQ-CoDel
> nodes 
> in the backhaul. I.e. separating known from unknown causes.

That's mentioned in Section 3.2.

> Separately, a count of total packets, or equivalently a count of 
> not-ECT, would be v useful too.

I didn't capture Not-ECT by IP address, mainly because some testing
made me question how at least one ipset lookup per-packet would affect
performance on their production gateway. I added that to the
Limitations section as it could be useful if available.

Pete

> If you can do this without losing the ECE counts, even better. Having
> CE 
> and ECE together enables a rough estimate of the average window.{Note
> 1}
> 
> Specifically,
>      avgWindow = ECE * delAckRatio / CE
> 
> Thank you (again)
> 
> 
> Bob
> 
> {Note 1} And lots of other assumptions, such as:
> - delayed Ack Ratio including stretch ACKs has to be guessed (e.g.
> 2???)
> - minimal additional ack coalescing in the network
> - minimal reordering
> - traffic volume dominated by elephants
> - the TCP protocol is working as it should
> - and so on.
> 
> 
> On 19/02/2021 13:06, Pete Heist wrote:
> > Yes, that was somewhat unexpected to us at first too, but misuse of
> > the
> > ECN field esp. on non-TCP packets seems to explain it in cases
> > where
> > there ratios don't look like AQM signaling. The data for TCP is
> > overall
> > easier to attribute to ECN when you can see feedback via ECE.
> > 
> > I didn't editorialize much on the results, but I'll use this as a
> > chance to add what struck me:
> > 
> > * While ECN negotiations were relatively small at around 1.44%,
> > they
> > were spread across 45% of the IPs, so the proportion of paths using
> > it
> > seems significant.
> > 
> > * The data seem to show significant 3168 marking AQM deployment,
> > when
> > 24% of LAN IPs that negotiated ECN saw CE or ECE. The draft
> > mentions
> > how some of it is from known AQM instances and some not. Congestion
> > overall doesn't seem excessive, but that could be quantified
> > better.
> > 
> > * A wider survey might help on the non-TCP data.
> > 
> > Anyway thanks for taking a look...
> > 
> > Pete
> > 
> > On Fri, 2021-02-19 at 11:44 +0000, Mirja Kuehlewind wrote:
> > > Hi Pete,
> > > 
> > > thanks for putting this together and sharing!
> > > 
> > > I have one question on the data. Maybe I'm not readying this
> > > correctly but if I look at the big table at the end, then I see a
> > > lot
> > > of cases where there are much more CE marks than ECT(0) marks.
> > > That's
> > > a bit unexpected as usually an AQM should only mark a small
> > > portion
> > > of the packets. Or do I interpret the data there incorrectly?
> > > 
> > > Mirja
> > > 
> > > 
> > > 
> > > On 18.02.21, 17:38, "tsvwg on behalf of Pete Heist"
> > > <tsvwg-bounces@ietf.org on behalf of pete@heistp.net> wrote:
> > > 
> > > 
> > >      > A new version of I-D, draft-heist-tsvwg-ecn-deployment-
> > > observations-00.txt
> > >      > has been successfully submitted by Peter G. Heist and
> > > posted to
> > > the
> > >      > IETF repository.
> > >      >
> > >      > Name:             draft-heist-tsvwg-ecn-deployment-
> > > observations
> > >      > Revision: 00
> > >      > Title:            Explicit Congestion Notification (ECN)
> > > Deployment Observations
> > >      > Document date:    2021-02-18
> > >      > Group:            Individual Submission
> > >      > Pages:            27
> > >      > URL:
> > >    
> > > https://www.ietf.org/archive/id/draft-heist-tsvwg-ecn-deployment-observations-00.txt
> > >      > Status:
> > >    
> > > https://datatracker.ietf.org/doc/draft-heist-tsvwg-ecn-deployment-observations/
> > >      > Html:
> > >    
> > > https://www.ietf.org/archive/id/draft-heist-tsvwg-ecn-deployment-observations-00.html
> > >      > Htmlized:
> > >    
> > > https://tools.ietf.org/html/draft-heist-tsvwg-ecn-deployment-observations-00
> > >      >
> > >      > Abstract:
> > >      >   This note presents data gathered at an Internet Service
> > > Provider's
> > >      >   gateway on the observed deployment and usage of ECN.
> > > Relevant IP
> > >      >   counter and flow tracking data was collected and
> > > analyzed for
> > > TCP and
> > >      >   other protocols.
> > > 
> > >      This draft adds some data on the current usage of ECN. It
> > > was
> > > gathered over several weeks at a cooperative ISP with around 660
> > > members, and looks at ECN endpoint activity, AQM deployment and
> > > ECN
> > > usage on non-TCP protocols. While this study is still relatively
> > > small, it’s hopefully at least a little more useful than the
> > > stateless counter data I posted late last year, which should set
> > > the
> > > bar suitably low… :)
> > > 
> > >      Pete
> > > 
> > > 
> > 
>