Re: [tsvwg] Fwd: New Version Notification for draft-heist-tsvwg-ecn-deployment-observations-00.txt

Martin Duke <martin.h.duke@gmail.com> Fri, 26 February 2021 23:31 UTC

Return-Path: <martin.h.duke@gmail.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F1BD43A123F for <tsvwg@ietfa.amsl.com>; Fri, 26 Feb 2021 15:31:26 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3p85gVTujOAi for <tsvwg@ietfa.amsl.com>; Fri, 26 Feb 2021 15:31:24 -0800 (PST)
Received: from mail-il1-x12f.google.com (mail-il1-x12f.google.com [IPv6:2607:f8b0:4864:20::12f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 222293A1236 for <tsvwg@ietf.org>; Fri, 26 Feb 2021 15:31:24 -0800 (PST)
Received: by mail-il1-x12f.google.com with SMTP id e7so9481762ile.7 for <tsvwg@ietf.org>; Fri, 26 Feb 2021 15:31:23 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=O+Yv/CxgOUed3T3WLdmq9eTG3zdpbOOCA33aMg56Rqk=; b=LU68fPYPWoZ9WRYpYA8/SX3z3bHddfoRbdCDXfMZyMFYfQZ/edbe3IX/xZiXYdRs+v 8d5Ky4sh9w/Uj94ItUGynMaIgXfgrfCG6oF1LkT3GWXPZ2+vIK4WJB9tw/XCQQvpoXhF clK9S6+KitVdsh/uIHIjFKegKbfOS20d/lhswkzPLx0byXp2DJMSXsrsGv3c1g97P0PH 9XVmglkBWZ/5BwJchnlWuHDWPcbu2dxJ1TpAS4kFT7eyJleR1mhy64LgEK1Pjs8Z3LZy EaHrpO36QdJZxJWB81YqsBliMj0SpvnkwHvaE/8gGjAqczIXnYk/kBVhdgobB8PqL5RK nCwA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=O+Yv/CxgOUed3T3WLdmq9eTG3zdpbOOCA33aMg56Rqk=; b=O8mULYSO6EWEyhbP6lDqdpWXh5hsJbnJ20dDdZ+3IpxSnA/NJMWdwKqiHFoifUhrwF 4/mO+yBfJKYV9QY54AKIYiWN5HP4+fGcV2tfG5j0+w0Wk1+FpcRTwclVA1N81rKEZ5pz QJdbi/hlAXciRGEBNpISCL1Q41RGVIloO5e3fxz2OldaDYBV8I3BQ7BZZsUz2qA4Hu7u lZW9k/4437F90oR5jloLY3nUwc64ixRjlyv4A6m3rrZuyZD/PsW+5Hfz7BcB3py6sfFz aoM+gLDWiFkKJsE9lotTTwcOOTK5glRBSkJPnu7/+2pO5/tdD6Y6KJMZW/OgLJoEDPvk adEw==
X-Gm-Message-State: AOAM533q7ZcBkoYC/b/XI267g4HxWn9lElEolj3GYb3quApCsZ2Yz6Dm 1e7c1wTGyEGD+C8pYuRXIYFR7L3gBSOxqMO+LGiaKv3QQP8=
X-Google-Smtp-Source: ABdhPJxRtumqX50KCyheG+DIojS9F2vbC1UP0m1ateUQT9RZwlqwPkoCzQVKUAn2L3rh6Srp//EUGLcrxcK/PPAFnOw=
X-Received: by 2002:a92:3f08:: with SMTP id m8mr4481414ila.237.1614382283248; Fri, 26 Feb 2021 15:31:23 -0800 (PST)
MIME-Version: 1.0
References: <161366419040.16138.17111583810851995947@ietfa.amsl.com> <BF0810D9-E742-4FCB-90B1-6957551B585D@heistp.net> <29EBB69A-2A00-4A1D-A7D0-09469602CD8E@ericsson.com> <414509c71436aac01e894689a4dce7f0251ec0ef.camel@heistp.net> <6e23258a-877f-2f2b-df6d-a18d20d61ec2@bobbriscoe.net> <2c07adbe91e69ddd79fa81edfedaf087cdbf12b2.camel@heistp.net> <81af054f-f7ee-2962-1419-ffa8398ac95d@bobbriscoe.net>
In-Reply-To: <81af054f-f7ee-2962-1419-ffa8398ac95d@bobbriscoe.net>
From: Martin Duke <martin.h.duke@gmail.com>
Date: Fri, 26 Feb 2021 15:31:12 -0800
Message-ID: <CAM4esxQR4Lqkt-eg1gi9DHHU5fKr-yYsZMPOci5rWORPSoO3KQ@mail.gmail.com>
To: Bob Briscoe <ietf@bobbriscoe.net>
Cc: Pete Heist <pete@heistp.net>, TSVWG <tsvwg@ietf.org>
Content-Type: multipart/alternative; boundary="0000000000008657db05bc45aa7f"
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/xmQ7fiGnac8CADKHDBATci2kzHI>
Subject: Re: [tsvwg] Fwd: New Version Notification for draft-heist-tsvwg-ecn-deployment-observations-00.txt
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 26 Feb 2021 23:31:27 -0000

Thanks Pete!

I wonder if the non-TCP ECN traffic is QUIC? I don't think the main
implementations are doing it, but there are a few ECN-capable
implementations in production.

On Sun, Feb 21, 2021 at 4:34 PM Bob Briscoe <ietf@bobbriscoe.net> wrote:

> Pete,
>
> Thx for doing this. I'm afraid I won't be able to now analyse the data
> you've provided for a couple of days, 'cos I have to focus on a couple
> of deadlines tomorrow, one being the IETF draft deadline.
>
> But whatever, thx v much.
>
> Bob
>
> On 20/02/2021 13:39, Pete Heist wrote:
> > New revision posted and some comments below...
> >
> > On Sat, 2021-02-20 at 09:36 +0000, Bob Briscoe wrote:
> >> Pete,
> >>
> >> If you plan to post a revision, in the TCP table (Sec.5.3) would you
> >> pls
> >> consider including the counts of ECT packets, as in the non-TCP table
> >> in
> >> Sec.5.3? Otherwise we don't know what percentage of the total ECN
> >> traffic each count represent.
> > That's a useful addition. An ECT(0) column is now added, and the TCP
> > table's column order is now similar to the non-TCP table. ECE for the
> > opposite direction is still next to CE as that seems most readable. I
> > left out ECT(1) for TCP as there's so little of that, and then it gets
> > harder with the line length limit.
> >
> >> I'm trying to separate out the IPs known to be behind the FQ-CoDel
> >> nodes
> >> in the backhaul. I.e. separating known from unknown causes.
> > That's mentioned in Section 3.2.
> >
> >> Separately, a count of total packets, or equivalently a count of
> >> not-ECT, would be v useful too.
> > I didn't capture Not-ECT by IP address, mainly because some testing
> > made me question how at least one ipset lookup per-packet would affect
> > performance on their production gateway. I added that to the
> > Limitations section as it could be useful if available.
> >
> > Pete
> >
> >> If you can do this without losing the ECE counts, even better. Having
> >> CE
> >> and ECE together enables a rough estimate of the average window.{Note
> >> 1}
> >>
> >> Specifically,
> >>       avgWindow = ECE * delAckRatio / CE
> >>
> >> Thank you (again)
> >>
> >>
> >> Bob
> >>
> >> {Note 1} And lots of other assumptions, such as:
> >> - delayed Ack Ratio including stretch ACKs has to be guessed (e.g.
> >> 2???)
> >> - minimal additional ack coalescing in the network
> >> - minimal reordering
> >> - traffic volume dominated by elephants
> >> - the TCP protocol is working as it should
> >> - and so on.
> >>
> >>
> >> On 19/02/2021 13:06, Pete Heist wrote:
> >>> Yes, that was somewhat unexpected to us at first too, but misuse of
> >>> the
> >>> ECN field esp. on non-TCP packets seems to explain it in cases
> >>> where
> >>> there ratios don't look like AQM signaling. The data for TCP is
> >>> overall
> >>> easier to attribute to ECN when you can see feedback via ECE.
> >>>
> >>> I didn't editorialize much on the results, but I'll use this as a
> >>> chance to add what struck me:
> >>>
> >>> * While ECN negotiations were relatively small at around 1.44%,
> >>> they
> >>> were spread across 45% of the IPs, so the proportion of paths using
> >>> it
> >>> seems significant.
> >>>
> >>> * The data seem to show significant 3168 marking AQM deployment,
> >>> when
> >>> 24% of LAN IPs that negotiated ECN saw CE or ECE. The draft
> >>> mentions
> >>> how some of it is from known AQM instances and some not. Congestion
> >>> overall doesn't seem excessive, but that could be quantified
> >>> better.
> >>>
> >>> * A wider survey might help on the non-TCP data.
> >>>
> >>> Anyway thanks for taking a look...
> >>>
> >>> Pete
> >>>
> >>> On Fri, 2021-02-19 at 11:44 +0000, Mirja Kuehlewind wrote:
> >>>> Hi Pete,
> >>>>
> >>>> thanks for putting this together and sharing!
> >>>>
> >>>> I have one question on the data. Maybe I'm not readying this
> >>>> correctly but if I look at the big table at the end, then I see a
> >>>> lot
> >>>> of cases where there are much more CE marks than ECT(0) marks.
> >>>> That's
> >>>> a bit unexpected as usually an AQM should only mark a small
> >>>> portion
> >>>> of the packets. Or do I interpret the data there incorrectly?
> >>>>
> >>>> Mirja
> >>>>
> >>>>
> >>>>
> >>>> On 18.02.21, 17:38, "tsvwg on behalf of Pete Heist"
> >>>> <tsvwg-bounces@ietf.org on behalf of pete@heistp.net> wrote:
> >>>>
> >>>>
> >>>>       > A new version of I-D, draft-heist-tsvwg-ecn-deployment-
> >>>> observations-00.txt
> >>>>       > has been successfully submitted by Peter G. Heist and
> >>>> posted to
> >>>> the
> >>>>       > IETF repository.
> >>>>       >
> >>>>       > Name:             draft-heist-tsvwg-ecn-deployment-
> >>>> observations
> >>>>       > Revision: 00
> >>>>       > Title:            Explicit Congestion Notification (ECN)
> >>>> Deployment Observations
> >>>>       > Document date:    2021-02-18
> >>>>       > Group:            Individual Submission
> >>>>       > Pages:            27
> >>>>       > URL:
> >>>>
> >>>>
> https://www.ietf.org/archive/id/draft-heist-tsvwg-ecn-deployment-observations-00.txt
> >>>>       > Status:
> >>>>
> >>>>
> https://datatracker.ietf.org/doc/draft-heist-tsvwg-ecn-deployment-observations/
> >>>>       > Html:
> >>>>
> >>>>
> https://www.ietf.org/archive/id/draft-heist-tsvwg-ecn-deployment-observations-00.html
> >>>>       > Htmlized:
> >>>>
> >>>>
> https://tools.ietf.org/html/draft-heist-tsvwg-ecn-deployment-observations-00
> >>>>       >
> >>>>       > Abstract:
> >>>>       >   This note presents data gathered at an Internet Service
> >>>> Provider's
> >>>>       >   gateway on the observed deployment and usage of ECN.
> >>>> Relevant IP
> >>>>       >   counter and flow tracking data was collected and
> >>>> analyzed for
> >>>> TCP and
> >>>>       >   other protocols.
> >>>>
> >>>>       This draft adds some data on the current usage of ECN. It
> >>>> was
> >>>> gathered over several weeks at a cooperative ISP with around 660
> >>>> members, and looks at ECN endpoint activity, AQM deployment and
> >>>> ECN
> >>>> usage on non-TCP protocols. While this study is still relatively
> >>>> small, it’s hopefully at least a little more useful than the
> >>>> stateless counter data I posted late last year, which should set
> >>>> the
> >>>> bar suitably low… :)
> >>>>
> >>>>       Pete
> >>>>
> >>>>
> >
>
> --
> ________________________________________________________________
> Bob Briscoe                               http://bobbriscoe.net/
>
>