Re: [tcpm] inband signaling (was: Re: [tsvwg] Agenda requests for TSVWG@IETF101)

"Scharf, Michael (Nokia - DE/Stuttgart)" <michael.scharf@nokia.com> Fri, 16 March 2018 00:34 UTC

Return-Path: <michael.scharf@nokia.com>
X-Original-To: tcpm@ietfa.amsl.com
Delivered-To: tcpm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 72161127522; Thu, 15 Mar 2018 17:34:32 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.91
X-Spam-Level:
X-Spam-Status: No, score=-2.91 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H5=-1, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id S_aI1fi00x2M; Thu, 15 Mar 2018 17:34:29 -0700 (PDT)
Received: from EUR01-HE1-obe.outbound.protection.outlook.com (mail-he1eur01on0139.outbound.protection.outlook.com [104.47.0.139]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 49053127599; Thu, 15 Mar 2018 17:34:29 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com; s=selector1-nokia-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=XSfMwOO7Op74P9w80gMfbI4nWPRTGSzcYBkTPyrHx18=; b=V/2tDkNpYo13h7lUtMU7sW96ZOw6Q9hBix5xBpsiC99GBDXlcmqS/BM+6naoTUObLFeKXJ4vMqj2fDM0RFd727z/xrQipcuoxPopA0Q+ihQCWiY1ryYsr41tMOOw9pNPWyUIE8QxyH7qKaK7OpXRNwjKKGW35+E0V3BN+YV4mto=
Received: from AM5PR0701MB2547.eurprd07.prod.outlook.com (10.173.92.15) by AM5PR0701MB2884.eurprd07.prod.outlook.com (10.168.156.7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.609.6; Fri, 16 Mar 2018 00:34:26 +0000
Received: from AM5PR0701MB2547.eurprd07.prod.outlook.com ([fe80::4935:9288:dcd6:7db0]) by AM5PR0701MB2547.eurprd07.prod.outlook.com ([fe80::4935:9288:dcd6:7db0%5]) with mapi id 15.20.0588.013; Fri, 16 Mar 2018 00:34:26 +0000
From: "Scharf, Michael (Nokia - DE/Stuttgart)" <michael.scharf@nokia.com>
To: Toerless Eckert <tte@cs.fau.de>, Gorry Fairhurst <gorry@erg.abdn.ac.uk>
CC: Katsushi Kobayashi <ikob@acm.org>, Thomas Nadeau <tnadeau@lucidvision.com>, "tcpm@ietf.org" <tcpm@ietf.org>, "tsvwg@ietf.org" <tsvwg@ietf.org>, "tsvwg-chairs@ietf.org" <tsvwg-chairs@ietf.org>, Yingzhen Qu <yingzhen.qu@huawei.com>
Thread-Topic: inband signaling (was: Re: [tsvwg] Agenda requests for TSVWG@IETF101)
Thread-Index: AQHTuutG8oqK4QFtw0y+eV4edPDGpaPSAD3A
Date: Fri, 16 Mar 2018 00:34:26 +0000
Message-ID: <AM5PR0701MB2547C46DDFBD295F34989C0D93D70@AM5PR0701MB2547.eurprd07.prod.outlook.com>
References: <A1F61D20-1911-4A6E-9F80-A1DF1EF91816@huawei.com> <AM5PR0701MB254755BA63E33173CC7C7BCE93DB0@AM5PR0701MB2547.eurprd07.prod.outlook.com> <5A9BEB65.6010102@erg.abdn.ac.uk> <CABY-gOO8sH3+5qfFj7DV6wh6+uX8CyBfwo4FBLi=9x1RngQDHg@mail.gmail.com> <AM5PR0701MB25474AC4A52E38B43E543FA193DA0@AM5PR0701MB2547.eurprd07.prod.outlook.com> <CABY-gOMJf-4GKkbmYMJScrafO44NEfy0hoq5KXJ0uVA+QUXGiA@mail.gmail.com> <050065D2-5F2E-4E79-9BD1-E1DC03F13900@acm.org> <5AA79C2E.1040808@erg.abdn.ac.uk> <20180313164928.GA17042@faui40p.informatik.uni-erlangen.de>
In-Reply-To: <20180313164928.GA17042@faui40p.informatik.uni-erlangen.de>
Accept-Language: en-US, de-DE
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=michael.scharf@nokia.com;
x-originating-ip: [92.203.186.220]
x-ms-publictraffictype: Email
x-microsoft-exchange-diagnostics: 1; AM5PR0701MB2884; 7:U+MxPcKtm4Cd4FkN/HBxs9uCNNYrE8wQs4W5D27xWFX+FQ1YTvkcrgNOibIHPZGHx7v1HQW463nYSsuuY+PIb0WZklQO7/5CXq1r/7e+Hq2ahiAiEvhhsiB6E2hAaD+lviUYDideRZC8+hFIbmchjo3O46At5rY+TxJ0oAy8UjQ2X+dGtWTFZ3PH63Q3o5D9v/GYVEkwuDjD8isARwexYvNz4QQpDSGyxm5FlUXdHwhIe4sAWQ6brSw2rYUEIRyC
x-ms-exchange-antispam-srfa-diagnostics: SOS;
x-ms-office365-filtering-ht: Tenant
x-ms-office365-filtering-correlation-id: 3b47f726-c966-465a-6728-08d58ad5ac50
x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(48565401081)(5600026)(4604075)(3008032)(4534165)(4627221)(201703031133081)(201702281549075)(2017052603328)(7193020); SRVR:AM5PR0701MB2884;
x-ms-traffictypediagnostic: AM5PR0701MB2884:
x-microsoft-antispam-prvs: <AM5PR0701MB288456FD1AD6E15BF20B7A6593D70@AM5PR0701MB2884.eurprd07.prod.outlook.com>
x-exchange-antispam-report-test: UriScan:(278428928389397);
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(8121501046)(5005006)(93006095)(93001095)(3231221)(11241501184)(806099)(944501244)(52105095)(3002001)(10201501046)(6055026)(6041310)(20161123562045)(20161123564045)(20161123558120)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(6072148)(201708071742011); SRVR:AM5PR0701MB2884; BCL:0; PCL:0; RULEID:; SRVR:AM5PR0701MB2884;
x-forefront-prvs: 0613912E23
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(366004)(346002)(396003)(376002)(39380400002)(39860400002)(199004)(189003)(4326008)(6246003)(59450400001)(6506007)(53936002)(3846002)(106356001)(3280700002)(14454004)(9686003)(966005)(478600001)(8936002)(55016002)(2950100002)(6306002)(110136005)(33656002)(8676002)(81156014)(81166006)(2906002)(6436002)(54906003)(105586002)(66066001)(5660300001)(74316002)(68736007)(7736002)(305945005)(316002)(76176011)(5250100002)(229853002)(99286004)(6116002)(93886005)(2900100001)(102836004)(26005)(3660700001)(186003)(86362001)(7696005)(25786009)(97736004); DIR:OUT; SFP:1102; SCL:1; SRVR:AM5PR0701MB2884; H:AM5PR0701MB2547.eurprd07.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en;
received-spf: None (protection.outlook.com: nokia.com does not designate permitted sender hosts)
x-microsoft-antispam-message-info: I9Ihyj5iSQCDsFyZ28PrWqLIUGJw9u7XKpj2ETn6CEwGuvSOO3RHOJlRjVT908DYIO2Uvk1ihZImXHvX1Ma8o8MJzv4KpSj/90so6O8Q0bBBu8eClm5pW9TOu3zYY2WCecrFajvQD1C2nenXi9O5QIsk+dzYwHJhjYeOzYTOBBQlcmYulWi0NQAqFEdgggCGIt6KBvdQXXdtUOoaWtO+qKbXETEPxmW3oejYPymJQXJFN+VPQVg2j/2PS0QJinWDAOCvyJ5WxeGBjI+2pDGq/SkKA+MVo9tqSPNmJSJM6+quQiosTAcEINDLCmSqFRqftHHh5mE44IBKe9V7rfHpdOoGT0bIf+hpAbW6UqzVx2tzZNe1KtWodMgts/0nHWCp
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: nokia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 3b47f726-c966-465a-6728-08d58ad5ac50
X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Mar 2018 00:34:26.5600 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM5PR0701MB2884
Archived-At: <https://mailarchive.ietf.org/arch/msg/tcpm/6NyV9g1DBnCGp_J-Nz8fJB40KP0>
Subject: Re: [tcpm] inband signaling (was: Re: [tsvwg] Agenda requests for TSVWG@IETF101)
X-BeenThere: tcpm@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: TCP Maintenance and Minor Extensions Working Group <tcpm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tcpm>, <mailto:tcpm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tcpm/>
List-Post: <mailto:tcpm@ietf.org>
List-Help: <mailto:tcpm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tcpm>, <mailto:tcpm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 16 Mar 2018 00:34:32 -0000

> TCP quickstart really relates IMHO primarily to draft-han-6man-in-band-
> signaling-for-transport-qos, but not to draft-han-tsvwg-cc. The latter one is

This is wrong. Section 4.4 in RFC 4782 is very related to draft-han-tsvwg-cc. Of specific interest is e.g. the handling of ssthresh. RFC 4782 also considers packet headers.

> really meant to modify TCP assuming a known guaranteed CIR - whatever
> mechanism is used to provide that guarantee.
> 
> TCP quickstart is an interesting example for inband signaling, which is what
> Lin's in-band-signaling draft does too. The main difference is that our draft
> focusses on high-value traffic where per-flow state is feasible and beneficial,
> if not necessary. And TCP quickstart seems more targeted to ANY TCP flow.

No. Quick-Start only has benefits if it is enabled by the applications that can indeed leverage it, which is a subset of all TCP flows. If a host naively applies it to any TCP connection, there will be no benefit as most Quick-Start requests will be rejected. So the endpoint has a strong incentive to enable it only on these connections that actually leverage it. Actually doing this is a problem of its own. I have discussed this issue with AR/VR developers 10 years ago and it was non-trivial by then. It would be interesting to learn what has changed since then in the application developer community.

> Which raises a complete different scalability challenge to TCP quickstart.

Yep. Quick-Start can be implemented in a router without per-flow state and thus scales e.g. on network processors. 10 years ago we found that the key performance bottleneck in the fast path would be the state-synchronization between the different cores of a network processor. But as Quick-Start does not perform hard guarantees, this can be worked around.

I am not a hardware expert, any maybe state synchronization between many cores is cheaper these days. But I'd really like to understand how hard QoS guarantees for single TCP connections would be achieved e.g. on modern multi-core network processor (i.e., multiple TBit/s). 
 
> This type of comparison discussion will go into draft updates on our side.
> 
> Would be interested in any more data points about the history of TCP
> quickstart, eg: where it was observed in the wild in deployments.

In my experiments 10 years ago, there was little performance benefit of Quick-Start as compared to IW10, which was published in RFC 6928. My experiments are published in http://www.ikr.uni-stuttgart.de/Content/Publications/Archive/Sf_Diss_40112.pdf.

I strongly suggest to compare new congestion control schemes tot CUBIC+IW10 as baseline, and to show how much performance benefit one indeed gets, and at what risk and costs.

Michael