Re: ECN in QUIC

Ian Swett <ianswett@google.com> Wed, 20 September 2017 14:09 UTC

Return-Path: <ianswett@google.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 17E911331E7 for <quic@ietfa.amsl.com>; Wed, 20 Sep 2017 07:09:02 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.7
X-Spam-Level:
X-Spam-Status: No, score=-2.7 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=google.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id OeHKTf-WqzhN for <quic@ietfa.amsl.com>; Wed, 20 Sep 2017 07:08:58 -0700 (PDT)
Received: from mail-yw0-x22a.google.com (mail-yw0-x22a.google.com [IPv6:2607:f8b0:4002:c05::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 810B7129A89 for <quic@ietf.org>; Wed, 20 Sep 2017 07:08:58 -0700 (PDT)
Received: by mail-yw0-x22a.google.com with SMTP id t127so1967585ywg.4 for <quic@ietf.org>; Wed, 20 Sep 2017 07:08:58 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=QtRH2kJpU/PkVPpeCUfWvYIJTZOZDhvA5z5G4H/yN+I=; b=qHbScege8qVIywmu9F7k2GOKaXamOCaM5Q0cAal2+uOKqDsgUaLXLkzbVut572q1Rl 5zPLVYlVuQVWgwDz48LxotR4dk956Wn5sE3Xa9SSoZbLsP+CXmlxHxRz8UGTT219LK5U q4Z2bo8uMKoKRL01fosaMlBLaMrhesLgLAfj6LDATr/dtYY/PIa9Ve6/bPmNBECCf5NS rHluPBtw9xjYj2+WynagVWPNZOKPf/TmKr5Kr56slsy6ZGBtCgdLx1CHqnAwQdEu+Zr9 wFsREuEp8Uc6vPZF3URPlgz0YSOs0bkS8fKB34PuBMQsz+gYh7/z6xKf/zfR7uT1bFZL X+AQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=QtRH2kJpU/PkVPpeCUfWvYIJTZOZDhvA5z5G4H/yN+I=; b=Z/d4pq41ArBsEaDijZG6mrfrJ769CVhG6NYgAacYhcEObB6J6GzqvAIu+2FS0kTcdV Gwam7/gnBCa9sNAjpliHZ0+cS0ccGeGMAX4BM72S5lpGMa84eiRPogExShOqN7nTyhjl I/5RFQHCh73yoduliaNuv+f0t5/NqIJocuGIqUNFwRMsyygGguuP3sIBxy4Q1CGrR5KV Aq4Ogc5LZ68kRF9zHYTpUMDF0oCGLqbVftewzKF+cZ2YjW9ii4gxcWljnRGtBoKN96zP Twi0QBtnZsiKX9Ts22kfW9OJdb5RRVkbSlXCqPDt5/ybsdeUtW4aGLssfJT1FCnuL/9b fz9A==
X-Gm-Message-State: AHPjjUiqeWjvIFmpF1WG5Pdmkhft3RYtd0+woBrij1Q1xn2GUf/MhOS2 l1l4bx87ECxSdrAzG8RHwxqNcDZDR/FPLeIZFrjUMQ==
X-Google-Smtp-Source: AOwi7QBikYEvqh8FLKravL2wFnqih6LAdoAKe5XQrTYv753q1bIIPPP7rgVY0iSuaB/ukThbJfSsN2x94X7l3AphFPE=
X-Received: by 10.37.51.130 with SMTP id z124mr3816372ybz.154.1505916537337; Wed, 20 Sep 2017 07:08:57 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.37.216.4 with HTTP; Wed, 20 Sep 2017 07:08:36 -0700 (PDT)
In-Reply-To: <DB4PR07MB348D95672E48A338758E32DC2610@DB4PR07MB348.eurprd07.prod.outlook.com>
References: <AM3PR07MB34048E916A7B18695313171C2820@AM3PR07MB340.eurprd07.prod.outlook.com> <8E718F38-88DB-4E1D-BC1B-1C0F0E9E5C34@csperkins.org> <DB4PR07MB348F7E2CFAF1574F838ED8CC2610@DB4PR07MB348.eurprd07.prod.outlook.com> <CAKcm_gMbxEMcq4UaQ9R_iGgXSpKJHzA67VMg2ZXDg2K1OhdUNA@mail.gmail.com> <DB4PR07MB348D95672E48A338758E32DC2610@DB4PR07MB348.eurprd07.prod.outlook.com>
From: Ian Swett <ianswett@google.com>
Date: Wed, 20 Sep 2017 10:08:36 -0400
Message-ID: <CAKcm_gP5ob73x45wiZAoJsESMkGRA+U8VOom6M-32-uHEsfrUw@mail.gmail.com>
Subject: Re: ECN in QUIC
To: Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
Cc: Colin Perkins <csp@csperkins.org>, Magnus Westerlund <magnus.westerlund@ericsson.com>, "Bob Briscoe (research@bobbriscoe.net)" <research@bobbriscoe.net>, Praveen Balasubramanian <pravb@microsoft.com>, "Eggert, Lars (lars@netapp.com)" <lars@netapp.com>, marcelo bagnulo braun <marcelo@it.uc3m.es>, Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch>, Piers O'Hanlon <piers.ohanlon@cs.ox.ac.uk>, QUIC IETF mailing list <quic@ietf.org>, "De Schepper, Koen (Nokia - BE/Antwerp)" <koen.de_schepper@nokia-bell-labs.com>
Content-Type: multipart/alternative; boundary="001a11489f16459da005599f8498"
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/IDEqlR5P-H6VHK726jNs46CVc90>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 20 Sep 2017 14:09:02 -0000

I think there are good reasons to keep frames smaller and simpler in
general.  But in this particular case, I think there are strong arguments
for putting ECN in the ACK frames.  I suspect this would have come up as
soon as someone implemented ECN in QUIC.

On Wed, Sep 20, 2017 at 9:27 AM, Ingemar Johansson S <
ingemar.s.johansson@ericsson.com> wrote:

> Thanks Ian for the prompt response.
>
> I must admit that I have perhaps overlooked possible combos of loss and
> ECN, the price you pay for working too much with simulators. Your arguments
> are very strong indeed.
>
>
>
> In the SCReAM congestion control (RMCAT work) the ECN and loss info comes
> in the same feedback and the handling of loss and ECN is straightforward
> there. Personally I would prefer ECN in the ACK frames and the earlier
> drafts suggested formats for that, I however got the impression that there
> is a certain resistance against additional things in the ACK frame ?.
>
>
>
> /Ingemar
>
>
>
> *From:* Ian Swett [mailto:ianswett@google.com]
> *Sent:* den 20 september 2017 14:41
> *To:* Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
> *Cc:* Colin Perkins <csp@csperkins.org>; Magnus Westerlund <
> magnus.westerlund@ericsson.com>; Bob Briscoe (research@bobbriscoe.net) <
> research@bobbriscoe.net>; Praveen Balasubramanian <pravb@microsoft.com>;
> Eggert, Lars (lars@netapp.com) <lars@netapp.com>; marcelo bagnulo braun <
> marcelo@it.uc3m.es>; Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch>;
> Piers O'Hanlon <piers.ohanlon@cs.ox.ac.uk>; QUIC IETF mailing list <
> quic@ietf.org>; De Schepper, Koen (Nokia - BE/Antwerp) <
> koen.de_schepper@nokia-bell-labs.com>
>
> *Subject:* Re: ECN in QUIC
>
>
>
>
>
> On Wed, Sep 20, 2017 at 4:39 AM, Ingemar Johansson S <
> ingemar.s.johansson@ericsson.com> wrote:
>
> Hi
>
>
>
> And sorry for the sloth-ish response (you should see me type  a text
> message..).
>
> To summarize the two main questions
>
>
>
>    1. ECN in ACK frame or in a separate frame : Given the recent
>    discussion on the list and fear that the ACK frame is already enough
>    complex, it seems unwise to try to cram in additional info in the ACK
>    frames. So my personal feeling is that we should use a separate frame type
>    for ECN , but this frame type must be a MUST to implement and support !
>    Comments are very welcome.
>
> I was neutral on this before, but I started thinking about implementing
> this, and separating the frames makes it more complex, and potentially
> really, really difficult to get the implementation correct.  As an example,
> if the frames were accidentally sent in two separate packets, I would count
> the packet as acked, and potentially increase the congestion window and
> other state variables.  I might even send an extra packet based on this
> information.  Then in the next packet I'd realize that packet had an ECN
> marking, and actually should have been treated as lost from a congestion
> controller perspective.  In order to do this correctly, I'd have to undo a
> bunch of things.  My experience with undo is that it's terribly error
> prone, and I would never recommend it.
>
>
>
> Alternately, the ack could get lost, and the next packet would convey ECN
> marking information for packets that hadn't been acknowledged yet.  Which
> is just weird.
>
>
>
> If we require support for ECN, then the implementation has a certain extra
> level of complexity.  As illustrated above, putting it in one frame is
> actually simpler overall if the congestion controller needs to use all the
> information at once to be implemented correctly.  This same logic applies
> to timestamps as well, in my opinion.
>
>
>
>
>    1.
>    2. As regards to the level of detail : There are pros and cons with
>    both alternatives (marked bytes or detailed indication). I would like to
>    hear the opinions from others as well on this matter .
>
>
>
> /Ingemar
>
>
>
> *From:* Colin Perkins [mailto:csp@csperkins.org]
> *Sent:* den 16 augusti 2017 12:53
> *To:* Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
> *Cc:* QUIC IETF mailing list <quic@ietf.org>; Magnus Westerlund <
> magnus.westerlund@ericsson.com>; Bob Briscoe (research@bobbriscoe.net) <
> research@bobbriscoe.net>; Praveen Balasubramanian <pravb@microsoft.com>;
> Eggert, Lars (lars@netapp.com) <lars@netapp.com>; marcelo bagnulo braun <
> marcelo@it.uc3m.es>; Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch>;
> Piers O'Hanlon <piers.ohanlon@cs.ox.ac.uk>; De Schepper, Koen (Nokia -
> BE/Antwerp) <koen.de_schepper@nokia-bell-labs.com>
> *Subject:* Re: ECN in QUIC
>
>
>
>
>
> On 16 Aug 2017, at 10:33, Ingemar Johansson S <
> ingemar.s.johansson@ericsson.com> wrote:
>
>
>
> Hi
>
>
>
> Finally back from vacation, and very grateful for the support to continue
> the work to add ECN in QUIC.
>
> Just to recap.. there were two main topics raised at the meeting
>
>
>
> 1) ECN info in ACK frame or in dedicated frame : There were concerns about
> adding extra complexity in an already potentially complex ACK frame, one
> can have differing opinions about the complexity but can understand the
> concerns. As far as I am concerned, a separate frame type for ECN is
> possible, possibly one need to add information about the amount of not-ECT
> marked packets as well to keep the signaling robust, this needs further
> investigation though. One concern with a separate ECN frame is that it
> becomes a not-implemented or optional feature, is there any reason to be
> worried about this ?
>
>
>
> 2) More detailed ECN information : Earlier versions of the ECN in QUIC
> draft (seehttps://tools.ietf.org/id/draft-johansson-quic-ecn-01.txt )
> provided with examples. We (Myself, Koen, Mirja and Praveen) discussed this
> and we could not come up with any use case where it is beneficial to know
> exactly how each packet is ECN marked. I know that this kind of detailed
> ECN information is suggested for the generic feedback for RMCAT and I
> personally have a problem to see the gain with the detailed ECN information
> also here. Input from others is very welcome here.
>
>
>
> For the RMCAT format, we wanted per-packet loss and timing information,
> and it was as easy to feedback per-packet ECN information along with it as
> to design something different.
>
>
>
> A benefit of per-packet ECN marking could be to allow a congestion
> controller that reacted differently to bursts of consecutive ECN marks than
> it did to isolated ECN marks, given the same fraction of marked packets
> (i.e., that reacted to ECN marking events rather than ECN marking rate,
> like how TCP responds to loss events). I don’t think we have such a thing,
> but certainly in the context of RMCAT where we’re experimenting with novel
> congestion control schemes for traffic that has very different
> characteristics to traditional bulk flows, it might be plausible.
> Per-packet marking information is also useful for troubleshooting.
>
>
>
> Certainly we need to know number of NotECT, ECT(0), ECT(1), and ECN-CE
> marks since the last report, but I guess that’s already possible.
>
>
>
> Cheers,
>
> Colin
>
>
>
>
>
>
>
>
>
> There are a consequences with detailed ECN marking information.
>
> a) necessary to correlate with the list of transmitted packets, this
> increases amount of code on sender side, not sure of that is a large
> concern as lookup is anyway needed to process incoming ACKs
>
> b) necessary to embed ECN information in ACK frame ?, at least this was my
> conclusion when I devised the detailed ECN marking info in the 01 version
> of the draft.
>
>
>
> Comments are welcome
>
> /Ingemar
>
>
>
>
>
>
>
> ==================================
>
> Ingemar Johansson  M.Sc.
>
> Master Researcher
>
>
>
> Ericsson AB
>
> Wireless Access Networks
>
> Labratoriegränd 11
>
> 971 28, Luleå, Sweden
>
> Phone +46-1071 43042
>
> SMS/MMS +46-73 078 3289 <+46%2073%20078%2032%2089>
>
> ingemar.s.johansson@ericsson.com
>
> www.ericsson.com
>
>
>
> A mistake is to commit a misunderstanding
>                      Bob Dylan
> ==================================
>
>
>
>
>
> --
> Colin Perkins
> https://csperkins.org/
>
>
>
>
>