Re: [tcpPrague] [tcpm] Fwd: I-D Action: draft-bagnulo-tcpm-tcp-low-rtt-00.txt

Praveen Balasubramanian <pravb@microsoft.com> Fri, 12 August 2016 20:35 UTC

Return-Path: <pravb@microsoft.com>
X-Original-To: tcpprague@ietfa.amsl.com
Delivered-To: tcpprague@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 44E7612DA96; Fri, 12 Aug 2016 13:35:48 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.022
X-Spam-Level:
X-Spam-Status: No, score=-2.022 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=microsoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id wWzErIqYppEr; Fri, 12 Aug 2016 13:35:46 -0700 (PDT)
Received: from NAM03-DM3-obe.outbound.protection.outlook.com (mail-dm3nam03on0108.outbound.protection.outlook.com [104.47.41.108]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A966212DAB1; Fri, 12 Aug 2016 13:35:45 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=9NcYhyERbF57EMrvaxLFccBxCiluk5LSqAfi86+kiRE=; b=EI/oWmSp8tvL6NOeb+mm+AN+dzREdaD8Z0WhkZFmRZxB3kFQ1g0qyg0DO2haSeKIXsleFbS9pIgtvYCghQRAUN0OQAzjIHhaiutOJb05zCIP4NTlwda2FJ6ftod8KOpBG1VyTyH1Pnj36drsnO4LlY3W1OoWAK+6U+eA1uIm2Wc=
Received: from BLUPR03MB004.namprd03.prod.outlook.com (10.255.208.38) by BLUPR03MB001.namprd03.prod.outlook.com (10.255.208.35) with Microsoft SMTP Server (version=TLS1_0, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA_P384) id 15.1.544.10; Fri, 12 Aug 2016 20:35:41 +0000
Received: from BLUPR03MB004.namprd03.prod.outlook.com ([169.254.2.30]) by BLUPR03MB004.namprd03.prod.outlook.com ([169.254.2.30]) with mapi id 15.01.0557.021; Fri, 12 Aug 2016 20:35:40 +0000
From: Praveen Balasubramanian <pravb@microsoft.com>
To: Yuchung Cheng <ycheng@google.com>, Karen Elisabeth Egede Nielsen <karen.nielsen@tieto.com>
Thread-Topic: [tcpm] Fwd: I-D Action: draft-bagnulo-tcpm-tcp-low-rtt-00.txt
Thread-Index: AQHR9M4ywbpExZthr0er6u5O8CZMX6BFxyYA
Date: Fri, 12 Aug 2016 20:35:40 +0000
Message-ID: <BLUPR03MB0042AEE20FBD0F0F4DE638CB61F0@BLUPR03MB004.namprd03.prod.outlook.com>
References: <20160708211635.32095.77047.idtracker@ietfa.amsl.com> <2f56d1b8-7450-42de-4a24-53df9cf4c045@it.uc3m.es> <a1f456db6e656785da8e356b9f530717@mail.gmail.com> <CAK6E8=etaxFSgBvQt27s=rB03rRQxQ_u43qWRExTVXys9A82wg@mail.gmail.com>
In-Reply-To: <CAK6E8=etaxFSgBvQt27s=rB03rRQxQ_u43qWRExTVXys9A82wg@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=pravb@microsoft.com;
x-originating-ip: [2001:4898:80e8:4::584]
x-ms-office365-filtering-correlation-id: b584871a-10e7-48c9-56d7-08d3c2f039e5
x-ms-office365-filtering-ht: Tenant
x-microsoft-exchange-diagnostics: 1; BLUPR03MB001; 6:hoKvihImVq4lnNHg4LkA81A2grR0WNtg1f3/Zf8ITGEAnTHxXFLfSAe8N5B41WmhGzsV8PK/cN1AHe6hLw0VmibEvufWwgNIvSd7LnZJVungnfI9WVzlZmcBxlP6zpUpW1roufWB6g9Wi2EmpiVfQvmvQmQhMx+a9l/+pilSHrjPsbk+d5uFbHom3rBBkTCnBKL5dQmOuu0psOk4j7e4ANry5XVgdB/ruxQKTBrrz1/76pzamEs3m/5JB+KqCEp8EcObBwyJ0QYZ0JHXB8xITiajqughH2jFs9Kky44TyCSt+GDD0m42S3WbxlHVk+K6qvbPi0COTquDzxJ85AXH8A==; 5:+88adDQbdb4zvuYCR4TdNPFS+81sUp5zMHgh0CPPRu+hJch6YQnJbphIrjByKH3kjt1LpTIdOWigvVdKoIOB4BMONqkbNyfHqJLsY/bhhC1/WcbCuSgdy0wRjIeBV6e0imjgX1Yc4CRHO+l/OuP79/anNK75OimU9Vap2ciqkdw=; 24:vJpqa696B16ZXlB6mRX5WUFcYgmi/POMVU4yoopK/YdLDuTz6k2c63kLCYY1MLOkmNHcsARpk/n5npguYeLpNFUxgR04P3H83JcTn2fg0Zk=; 7:+5aoddz1iIrtyuSN9nRBy/+Xm3eU7++NLiwxHVrf1PP+nKWu064efKmHM7ragx9cltmVRmpHpE1xvKR4ynAxnFkUS9PSllM+EgqR7OGlfphHETNg+QIKPlYsBs3yN1mYh2z0ZulRgHLZRpZOjL5gf0/qE9Il9Vu4Oecn36rhAADVJK49JihQCtkgnAJVdQ7Ktwg+9zbBtBH5TGt/la7OBeUXVwP2CAVFjkNX4O95rGbfBLXcP4x6gVmE6s6BfpUr
x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BLUPR03MB001;
x-microsoft-antispam-prvs: <BLUPR03MB0011775EFD7DBA506B8A9ADB61F0@BLUPR03MB001.namprd03.prod.outlook.com>
x-exchange-antispam-report-test: UriScan:(158342451672863)(120809045254105);
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(61425038)(6040176)(601004)(2401047)(8121501046)(5005006)(3002001)(10201501046)(6055026)(61426038)(61427038); SRVR:BLUPR03MB001; BCL:0; PCL:0; RULEID:(304825118); SRVR:BLUPR03MB001;
x-forefront-prvs: 003245E729
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(6009001)(7916002)(189002)(76094002)(377454003)(377424004)(199003)(2473001)(13464003)(24454002)(68736007)(586003)(97736004)(189998001)(2906002)(8990500004)(5002640100001)(87936001)(93886004)(2900100001)(2950100001)(76576001)(105586002)(5001770100001)(9686002)(6116002)(81156014)(7846002)(81166006)(102836003)(4326007)(8936002)(7736002)(7696003)(8676002)(101416001)(106356001)(106116001)(54356999)(76176999)(86362001)(50986999)(19580395003)(10090500001)(92566002)(19580405001)(305945005)(74316002)(5005710100001)(33656002)(15975445007)(10290500002)(122556002)(99286002)(3660700001)(10400500002)(86612001)(3280700002)(230783001)(3826002); DIR:OUT; SFP:1102; SCL:1; SRVR:BLUPR03MB001; H:BLUPR03MB004.namprd03.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en;
received-spf: None (protection.outlook.com: microsoft.com does not designate permitted sender hosts)
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: microsoft.com
X-MS-Exchange-CrossTenant-originalarrivaltime: 12 Aug 2016 20:35:40.7032 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLUPR03MB001
Archived-At: <https://mailarchive.ietf.org/arch/msg/tcpprague/DBg369FpiP6pQp-e9TIyaD558lA>
Cc: tcpm IETF list <tcpm@ietf.org>, TCP Prague List <tcpPrague@ietf.org>
Subject: Re: [tcpPrague] [tcpm] Fwd: I-D Action: draft-bagnulo-tcpm-tcp-low-rtt-00.txt
X-BeenThere: tcpprague@ietf.org
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: "To coordinate implementation and standardisation of TCP Prague across platforms. TCP Prague will be an evolution of DCTCP designed to live alongside other TCP variants and derivatives." <tcpprague.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tcpprague/>
List-Post: <mailto:tcpprague@ietf.org>
List-Help: <mailto:tcpprague-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 12 Aug 2016 20:35:48 -0000

>>2. delayed acks:
as mentioned the actual time depends a lot on the DC implementation, which is really "vender/owner"-specific. instead of perhaps an option during setup to inform the sender about the max delay in the ack works better.

Yeah this is a real problem in IaaS environment today since TCP sender picks minrto and receiver picks delayed ACK timeout independently and can cause spurious RTOs if the minrto is too aggressive. Windows server tries to use the connection handshake RTT (< 10 msec) to auto pick the DC values but this is a heuristic that can fail and doesn't really work in the Linux interop cases. 

-----Original Message-----
From: tcpm [mailto:tcpm-bounces@ietf.org] On Behalf Of Yuchung Cheng
Sent: Friday, August 12, 2016 12:17 PM
To: Karen Elisabeth Egede Nielsen <karen.nielsen@tieto.com>
Cc: tcpm IETF list <tcpm@ietf.org>; TCP Prague List <tcpPrague@ietf.org>
Subject: Re: [tcpm] Fwd: I-D Action: draft-bagnulo-tcpm-tcp-low-rtt-00.txt

On Fri, Aug 12, 2016 at 4:30 AM, Karen Elisabeth Egede Nielsen <karen.nielsen@tieto.com> wrote:
>
> Hi Marcello,
>
> I very much appreciate your draft.
>
> Even more so as it addresses one of the things I find to be a bit 
> "disturbing"  in the l4s drafts - Namely the claim that the finer saw 
> tooth functionality of l4s/DCTCP alone solves the latency problems 
> (while DCTCP indeed also is tuning the RTO timeout aggressively).
> E.g., the formulation in  section 1.1 of 
> https://datatracker.ietf.org/doc/draft-briscoe-tsvwg-ecn-l4s-id/?inclu
> de_t
> ext=1
>
> It turns out that a TCP algorithm like DCTCP that solves TCP's
>    scalability problem also solves the latency problem, because the
>    finer sawteeth cause very little queuing delay.  A supporting paper
>    [DCttH15] gives the full explanation of why the design solves both
>    the latency and the scaling problems, both in plain English and in
>    more precise mathematical form.  The explanation is summarised
>    without the maths in [I-D.briscoe-aqm-dualq-coupled].
>
> could benefit from a reference to your draft or the issue that you 
> addresses here (at least for comprehensiveness).
>
> An additional comment is  that new approaches to retransmissions - 
> like TCP TLP and TCP RACK (also SCTP TLR which however is not 
> progressing at the moment) might fundamentally alter the picture. 
> I.e., if retransmissions are sent pro-actively in tail loss situations 
> then more conservative RTOs may be kept for situations where it is 
> prudent to wait longer. Don't know if TCP TLP is so widely deployed 
> that it is something that you should relate to even if it may be 
> superseded by RACK. Just a thought.
TLP and RACK help reduce timeout cases in DC environment for sure. But still it can not completely avoid timeouts. So I agree we should keep timeouts conservative, but the current RFCs are way too conservative:
min RTO of 1 second is 4-5 orders of magnitude of DC RTTs.

The issue is, the "right" min-RTO depends on the actual DC and stacks:
they all have different RTTs and timer granularity. The draft cites Glenn's paper, but Morgan Stanley's DC could be different than others.


Other comments on the draft:

1. min ssthresh or cwnd: with very large incast ((tens of) thousands of senders into one receiver), cwnd of 0.1 pkt can still be too big. the only way is to pace the packets over N*RTT intervals.


2. delayed acks:
as mentioned the actual time depends a lot on the DC implementation, which is really "vender/owner"-specific. instead of perhaps an option during setup to inform the sender about the max delay in the ack works better.



>
> BR, Karen
>
> > -----Original Message-----
> > From: tcpm [mailto:tcpm-bounces@ietf.org] On Behalf Of marcelo 
> > bagnulo braun
> > Sent: 8. juli 2016 23:19
> > To: tcpm IETF list <tcpm@ietf.org>
> > Subject: [tcpm] Fwd: I-D Action: 
> > draft-bagnulo-tcpm-tcp-low-rtt-00.txt
> >
> > Hi,
> >
> > We just submitted this draft for consideration of the WG. Comments 
> > are appreciated.
> >
> > Regards, marcelo
> >
> >
> >
> >
> > -------- Mensaje reenviado --------
> > Asunto:       I-D Action: draft-bagnulo-tcpm-tcp-low-rtt-00.txt
> > Fecha:        Fri, 08 Jul 2016 14:16:35 -0700
> > De:   internet-drafts@ietf.org
> > Responder a:  internet-drafts@ietf.org
> > Para:         i-d-announce@ietf.org
> >
> >
> >
> > A New Internet-Draft is available from the on-line Internet-Drafts
> directories.
> >
> >
> >          Title           : Recommendations for increasing TCP
> performance in low RTT
> > networks.
> >          Authors         : Marcelo Bagnulo
> >                            Koen De Schepper
> >                            Glenn Judd
> >       Filename        : draft-bagnulo-tcpm-tcp-low-rtt-00.txt
> >       Pages           : 7
> >       Date            : 2016-07-08
> >
> > Abstract:
> >     This documents compiles a set of issues that negatively affect TCP
> >     performance in low RTT networks as well as the recommendations to
> >     overcome them.
> >
> >
> > The IETF datatracker status page for this draft is:
> > https://datatracker.ietf.org/doc/draft-bagnulo-tcpm-tcp-low-rtt/
> >
> > There's also a htmlized version available at:
> > https://tools.ietf.org/html/draft-bagnulo-tcpm-tcp-low-rtt-00
> >
> >
> > Please note that it may take a couple of minutes from the time of
> submission
> > until the htmlized version and diff are available at tools.ietf.org.
> >
> > Internet-Drafts are also available by anonymous FTP at:
> > ftp://ftp.ietf.org/internet-drafts/
> >
> > _______________________________________________
> > I-D-Announce mailing list
> > I-D-Announce@ietf.org
> > https://www.ietf.org/mailman/listinfo/i-d-announce
> > Internet-Draft directories: http://www.ietf.org/shadow.html or 
> > ftp://ftp.ietf.org/ietf/1shadow-sites.txt
> >
> >
> > _______________________________________________
> > tcpm mailing list
> > tcpm@ietf.org
> > https://www.ietf.org/mailman/listinfo/tcpm

_______________________________________________
tcpm mailing list
tcpm@ietf.org
https://www.ietf.org/mailman/listinfo/tcpm