Re: ECN in QUIC

Frank Kastenholz <fkastenholz@google.com> Wed, 20 September 2017 14:22 UTC

Return-Path: <fkastenholz@google.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 08DBD133053 for <quic@ietfa.amsl.com>; Wed, 20 Sep 2017 07:22:08 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2
X-Spam-Level:
X-Spam-Status: No, score=-2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=google.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id fx4Y9vsayl26 for <quic@ietfa.amsl.com>; Wed, 20 Sep 2017 07:22:04 -0700 (PDT)
Received: from mail-qt0-x22e.google.com (mail-qt0-x22e.google.com [IPv6:2607:f8b0:400d:c0d::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id DCB3E13293A for <quic@ietf.org>; Wed, 20 Sep 2017 07:22:03 -0700 (PDT)
Received: by mail-qt0-x22e.google.com with SMTP id x54so2902353qth.12 for <quic@ietf.org>; Wed, 20 Sep 2017 07:22:03 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=46NN4loN1AD9F6+gYn8JREifyW+cdhZGT/FU+JuqvMc=; b=WFJkFDfMJ3/DmoVI1bBD+dyzEFh5wSoFaN5XQD+rnl+hiByiy3W4ZgwZjgAbge1xNV zm9+drfX4pKvwGqO1SGPL34i2cmWVm0isPnK7X9tFOl9Sn6IMLaBOySM8p+gQ72FkHx+ /fipI+xcvX4y54iABSo6YNshIfE6Tr0B4n3opjcq4RQLoJ+Zj1fhj3/HZPLM8kXZjlR2 PZDePzSuOrfb/gTpG5ysAPUa0CaZM45uc4So5hm1IAGjzehFKJpHPxlJgrzbCCszPY3d mbPze2T4XlFL+57JzdkghzbFlZlCptgNQLjqi7y9zhrB5I9ZJW6wbKm+76hC1jE7fdSU RtHg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=46NN4loN1AD9F6+gYn8JREifyW+cdhZGT/FU+JuqvMc=; b=MsunTHvkk0cXo6hJDyGneqGmqtyTyIeo7mUqZuZc+SaBEXdBCovckkbnD+/KXyNkd4 /s55kZVHhvA4YA/+a4zLhliLzSVyt6eilSFce6gbClKwknBqII4GU+WiUX0g088Wsdcf WTfSLbPK1zNaqPwugfFoWAaB/TMbE3dU0r5cEk1aL7pVLBK8oFEApPduCDX5nWmeHivc l7NzvaNIFFldsw/mZqdK8T7akqAhaFlNhFiU3tNKO7DmYlz4LPdp+F7+5au6W/bI63zd wFK8BH92Wnx35W7Dg+yWMKim/30CbApN0NmADJUaSiI8GnQlVGxoyuTWX4xsbZx6KGN9 O8LA==
X-Gm-Message-State: AHPjjUhg1hG9LBVf8nYydLHfkTsZeYnPueYUZreOU6TZD3dXtGthZbMc ZnG32DdUbqyRzV+O2pm9YnfvWNJrFd6Ygqz5Kx8PoQ==
X-Google-Smtp-Source: AOwi7QBfwL4lC785k3/TKP8KDNWJwOFwEEMoX98nuaV02YZ74+hMkq8fmRB6Isn+ixrxruWyd7/MVDawFCu6UNA+DD4=
X-Received: by 10.200.52.117 with SMTP id v50mr1832066qtb.333.1505917322671; Wed, 20 Sep 2017 07:22:02 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.12.144.129 with HTTP; Wed, 20 Sep 2017 07:21:42 -0700 (PDT)
In-Reply-To: <DB4PR07MB348D95672E48A338758E32DC2610@DB4PR07MB348.eurprd07.prod.outlook.com>
References: <AM3PR07MB34048E916A7B18695313171C2820@AM3PR07MB340.eurprd07.prod.outlook.com> <8E718F38-88DB-4E1D-BC1B-1C0F0E9E5C34@csperkins.org> <DB4PR07MB348F7E2CFAF1574F838ED8CC2610@DB4PR07MB348.eurprd07.prod.outlook.com> <CAKcm_gMbxEMcq4UaQ9R_iGgXSpKJHzA67VMg2ZXDg2K1OhdUNA@mail.gmail.com> <DB4PR07MB348D95672E48A338758E32DC2610@DB4PR07MB348.eurprd07.prod.outlook.com>
From: Frank Kastenholz <fkastenholz@google.com>
Date: Wed, 20 Sep 2017 10:21:42 -0400
Message-ID: <CAD3dRjoz7XNPZB3HY2tHL6iJvqKf=0EgVCmc20nFkB0F914jkA@mail.gmail.com>
Subject: Re: ECN in QUIC
To: Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
Cc: Ian Swett <ianswett@google.com>, Magnus Westerlund <magnus.westerlund@ericsson.com>, "Bob Briscoe (research@bobbriscoe.net)" <research@bobbriscoe.net>, Praveen Balasubramanian <pravb@microsoft.com>, "Eggert, Lars (lars@netapp.com)" <lars@netapp.com>, marcelo bagnulo braun <marcelo@it.uc3m.es>, Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch>, Piers O'Hanlon <piers.ohanlon@cs.ox.ac.uk>, QUIC IETF mailing list <quic@ietf.org>, Colin Perkins <csp@csperkins.org>, "De Schepper, Koen (Nokia - BE/Antwerp)" <koen.de_schepper@nokia-bell-labs.com>
Content-Type: multipart/alternative; boundary="001a11394a3614ea5b05599fb3da"
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/PI7QcIsNnxIUfNI56YUhu7NMoi4>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 20 Sep 2017 14:22:08 -0000

Hi

I wonder if the ACK can be kept simple by including only the ECN
information from the most recently received packet, or maybe N (where N is
fairly small) most recently received packets? This would reduce the amount
of information to be carried as well as the complexity of including it.

I confess that I am not familiar with the various congestion control
algorithms ... but I would imagine that more recent ECN information would
be more useful than older ECN info. No?

Frank Kastenholz

On Wed, Sep 20, 2017 at 9:27 AM, Ingemar Johansson S <
ingemar.s.johansson@ericsson.com> wrote:

> Thanks Ian for the prompt response.
>
> I must admit that I have perhaps overlooked possible combos of loss and
> ECN, the price you pay for working too much with simulators. Your arguments
> are very strong indeed.
>
>
>
> In the SCReAM congestion control (RMCAT work) the ECN and loss info comes
> in the same feedback and the handling of loss and ECN is straightforward
> there. Personally I would prefer ECN in the ACK frames and the earlier
> drafts suggested formats for that, I however got the impression that there
> is a certain resistance against additional things in the ACK frame ?.
>
>
>
> /Ingemar
>
>
>
> *From:* Ian Swett [mailto:ianswett@google.com]
> *Sent:* den 20 september 2017 14:41
> *To:* Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
> *Cc:* Colin Perkins <csp@csperkins.org>; Magnus Westerlund <
> magnus.westerlund@ericsson.com>; Bob Briscoe (research@bobbriscoe.net) <
> research@bobbriscoe.net>; Praveen Balasubramanian <pravb@microsoft.com>;
> Eggert, Lars (lars@netapp.com) <lars@netapp.com>; marcelo bagnulo braun <
> marcelo@it.uc3m.es>; Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch>;
> Piers O'Hanlon <piers.ohanlon@cs.ox.ac.uk>; QUIC IETF mailing list <
> quic@ietf.org>; De Schepper, Koen (Nokia - BE/Antwerp) <
> koen.de_schepper@nokia-bell-labs.com>
>
> *Subject:* Re: ECN in QUIC
>
>
>
>
>
> On Wed, Sep 20, 2017 at 4:39 AM, Ingemar Johansson S <
> ingemar.s.johansson@ericsson.com> wrote:
>
> Hi
>
>
>
> And sorry for the sloth-ish response (you should see me type  a text
> message..).
>
> To summarize the two main questions
>
>
>
>    1. ECN in ACK frame or in a separate frame : Given the recent
>    discussion on the list and fear that the ACK frame is already enough
>    complex, it seems unwise to try to cram in additional info in the ACK
>    frames. So my personal feeling is that we should use a separate frame type
>    for ECN , but this frame type must be a MUST to implement and support !
>    Comments are very welcome.
>
> I was neutral on this before, but I started thinking about implementing
> this, and separating the frames makes it more complex, and potentially
> really, really difficult to get the implementation correct.  As an example,
> if the frames were accidentally sent in two separate packets, I would count
> the packet as acked, and potentially increase the congestion window and
> other state variables.  I might even send an extra packet based on this
> information.  Then in the next packet I'd realize that packet had an ECN
> marking, and actually should have been treated as lost from a congestion
> controller perspective.  In order to do this correctly, I'd have to undo a
> bunch of things.  My experience with undo is that it's terribly error
> prone, and I would never recommend it.
>
>
>
> Alternately, the ack could get lost, and the next packet would convey ECN
> marking information for packets that hadn't been acknowledged yet.  Which
> is just weird.
>
>
>
> If we require support for ECN, then the implementation has a certain extra
> level of complexity.  As illustrated above, putting it in one frame is
> actually simpler overall if the congestion controller needs to use all the
> information at once to be implemented correctly.  This same logic applies
> to timestamps as well, in my opinion.
>
>
>
>
>    1.
>    2. As regards to the level of detail : There are pros and cons with
>    both alternatives (marked bytes or detailed indication). I would like to
>    hear the opinions from others as well on this matter .
>
>
>
> /Ingemar
>
>
>
> *From:* Colin Perkins [mailto:csp@csperkins.org]
> *Sent:* den 16 augusti 2017 12:53
> *To:* Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
> *Cc:* QUIC IETF mailing list <quic@ietf.org>; Magnus Westerlund <
> magnus.westerlund@ericsson.com>; Bob Briscoe (research@bobbriscoe.net) <
> research@bobbriscoe.net>; Praveen Balasubramanian <pravb@microsoft.com>;
> Eggert, Lars (lars@netapp.com) <lars@netapp.com>; marcelo bagnulo braun <
> marcelo@it.uc3m.es>; Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch>;
> Piers O'Hanlon <piers.ohanlon@cs.ox.ac.uk>; De Schepper, Koen (Nokia -
> BE/Antwerp) <koen.de_schepper@nokia-bell-labs.com>
> *Subject:* Re: ECN in QUIC
>
>
>
>
>
> On 16 Aug 2017, at 10:33, Ingemar Johansson S <
> ingemar.s.johansson@ericsson.com> wrote:
>
>
>
> Hi
>
>
>
> Finally back from vacation, and very grateful for the support to continue
> the work to add ECN in QUIC.
>
> Just to recap.. there were two main topics raised at the meeting
>
>
>
> 1) ECN info in ACK frame or in dedicated frame : There were concerns about
> adding extra complexity in an already potentially complex ACK frame, one
> can have differing opinions about the complexity but can understand the
> concerns. As far as I am concerned, a separate frame type for ECN is
> possible, possibly one need to add information about the amount of not-ECT
> marked packets as well to keep the signaling robust, this needs further
> investigation though. One concern with a separate ECN frame is that it
> becomes a not-implemented or optional feature, is there any reason to be
> worried about this ?
>
>
>
> 2) More detailed ECN information : Earlier versions of the ECN in QUIC
> draft (seehttps://tools.ietf.org/id/draft-johansson-quic-ecn-01.txt )
> provided with examples. We (Myself, Koen, Mirja and Praveen) discussed this
> and we could not come up with any use case where it is beneficial to know
> exactly how each packet is ECN marked. I know that this kind of detailed
> ECN information is suggested for the generic feedback for RMCAT and I
> personally have a problem to see the gain with the detailed ECN information
> also here. Input from others is very welcome here.
>
>
>
> For the RMCAT format, we wanted per-packet loss and timing information,
> and it was as easy to feedback per-packet ECN information along with it as
> to design something different.
>
>
>
> A benefit of per-packet ECN marking could be to allow a congestion
> controller that reacted differently to bursts of consecutive ECN marks than
> it did to isolated ECN marks, given the same fraction of marked packets
> (i.e., that reacted to ECN marking events rather than ECN marking rate,
> like how TCP responds to loss events). I don’t think we have such a thing,
> but certainly in the context of RMCAT where we’re experimenting with novel
> congestion control schemes for traffic that has very different
> characteristics to traditional bulk flows, it might be plausible.
> Per-packet marking information is also useful for troubleshooting.
>
>
>
> Certainly we need to know number of NotECT, ECT(0), ECT(1), and ECN-CE
> marks since the last report, but I guess that’s already possible.
>
>
>
> Cheers,
>
> Colin
>
>
>
>
>
>
>
>
>
> There are a consequences with detailed ECN marking information.
>
> a) necessary to correlate with the list of transmitted packets, this
> increases amount of code on sender side, not sure of that is a large
> concern as lookup is anyway needed to process incoming ACKs
>
> b) necessary to embed ECN information in ACK frame ?, at least this was my
> conclusion when I devised the detailed ECN marking info in the 01 version
> of the draft.
>
>
>
> Comments are welcome
>
> /Ingemar
>
>
>
>
>
>
>
> ==================================
>
> Ingemar Johansson  M.Sc.
>
> Master Researcher
>
>
>
> Ericsson AB
>
> Wireless Access Networks
>
> Labratoriegränd 11
>
> 971 28, Luleå, Sweden
>
> Phone +46-1071 43042
>
> SMS/MMS +46-73 078 3289 <+46%2073%20078%2032%2089>
>
> ingemar.s.johansson@ericsson.com
>
> www.ericsson.com
>
>
>
> A mistake is to commit a misunderstanding
>                      Bob Dylan
> ==================================
>
>
>
>
>
> --
> Colin Perkins
> https://csperkins.org/
>
>
>
>
>



-- 
Thanks
Frank Kastenholz