Re: [tcpPrague] [tsvwg] [iccrg] Realistic Queue delay targets

Ingemar Johansson S <ingemar.s.johansson@ericsson.com> Mon, 02 November 2020 09:51 UTC

Return-Path: <ingemar.s.johansson@ericsson.com>
X-Original-To: tcpprague@ietfa.amsl.com
Delivered-To: tcpprague@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id CDD7A3A0D6C; Mon, 2 Nov 2020 01:51:08 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.102
X-Spam-Level:
X-Spam-Status: No, score=-2.102 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 6mrXXlz-ltbr; Mon, 2 Nov 2020 01:51:05 -0800 (PST)
Received: from EUR03-VE1-obe.outbound.protection.outlook.com (mail-eopbgr50047.outbound.protection.outlook.com [40.107.5.47]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 73C9B3A0DE8; Mon, 2 Nov 2020 01:51:03 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=er7Oik0WlxTUbQ71y5G32Bfg5brp747gJFIW+BF/sO7mHSm2lZvgoArux8ae777wBVdIo3yY+dcu1VC+ICvlrtwWk2VoBadiy7X5Y+gn6jBodRSs6hIFVvRrU0MrAaPJgXZA1dKJSLjDb/wTPdGLPLPmnq3GWDfYA5R2nMBkFd+DlCkYRRH8Oj47oPDYmDF/Pjnm1Yd5pkMy6W3hQmuARrku+Ygp5gmJqF263fCyi/DdmwDyWz73al/U/pnrnrNgBXLhZJPY/tQwiZPdzaQTOmLhAX2Hj187VUieA7Xss7LDJzORZEJfPCkfdpwnFOcsL2cRQZ0Ta0WoLRFimQ2vpw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=sYVU53BrtTrIHsaYdlM3hLNx1/0ciCuMTnBvbNkrwo0=; b=RGxKiRwIUhL7VSb8YdJtAwhFkjjGDR82iLaORn9/h69XFpV7mFwGuaAAE3d71qZA79tXZYrsHFXXBoGOzA3UOm9JCo/hhHM368vuH2do9Eob4Vnokh7kMr2YxwtLy+vdecLzyvYGKUKlGpIzrBKe6NzXL1CPDkbXoIINtp1r4keCizdJRL8cdgiR+HyEhOvExk0Yt/cGaahbj60OpPttl5uLPeOm78tMEkhwGKUv4eBKRxn0GKQkA77PZw/IlR+6VOxQ0GBgaY7swsHGL+vGjb1mhr9O6DWdfXWfjs3FOMAoRlOlNcwKTcd0Sf9nlVqkAxhzexNc0qAp4bwImjWXFA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=sYVU53BrtTrIHsaYdlM3hLNx1/0ciCuMTnBvbNkrwo0=; b=Pv03hTeizC/N1vxLw3H2x7h9i41/gQFDs+3yM5Ikby6/+sGOonTbJb//0+08K0QFcVthCsryREegJyrZ5rp3biDlko2xVwXBNU5PF2MGEDg8UAo6qOEkm05dZK5/tR0Z5/HagKOV7gDsMk63FNZIO7iqtOFOeei/LUSqlSqBNQE=
Received: from HE1PR0701MB2876.eurprd07.prod.outlook.com (2603:10a6:3:56::8) by HE1PR0701MB2987.eurprd07.prod.outlook.com (2603:10a6:3:51::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3541.10; Mon, 2 Nov 2020 09:50:55 +0000
Received: from HE1PR0701MB2876.eurprd07.prod.outlook.com ([fe80::a4a1:d6b5:1254:923a]) by HE1PR0701MB2876.eurprd07.prod.outlook.com ([fe80::a4a1:d6b5:1254:923a%11]) with mapi id 15.20.3541.011; Mon, 2 Nov 2020 09:50:55 +0000
From: Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
To: Sebastian Moeller <moeller0@gmx.de>
CC: "Rodney W. Grimes" <ietf@gndrsh.dnsmgr.net>, Bob Briscoe <ietf@bobbriscoe.net>, tsvwg IETF list <tsvwg@ietf.org>, iccrg IRTF list <iccrg@irtf.org>, Christian Huitema <huitema@huitema.net>, TCP Prague List <tcpPrague@ietf.org>, "De Schepper, Koen (Koen)" <koen.de_schepper@nokia.com>, Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
Thread-Topic: Re: [tsvwg] [iccrg] Realistic Queue delay targets
Thread-Index: AQHWsPJjPxAUbDfzuUaS/obDyN9yVam0h3MAgAAOk0A=
Date: Mon, 02 Nov 2020 09:50:55 +0000
Message-ID: <HE1PR0701MB2876031A4673A5D3763ACB67C2100@HE1PR0701MB2876.eurprd07.prod.outlook.com>
References: <69a73308-6718-7304-be24-0eb84f77e50d@bobbriscoe.net> <202011012023.0A1KNkue011764@gndrsh.dnsmgr.net> <HE1PR0701MB2876C75B0F58EDF71B4A3CD1C2100@HE1PR0701MB2876.eurprd07.prod.outlook.com> <trinity-b5b45825-bcee-412e-b5f3-7443e8add3a8-1604306796750@3c-app-gmx-bap61>
In-Reply-To: <trinity-b5b45825-bcee-412e-b5f3-7443e8add3a8-1604306796750@3c-app-gmx-bap61>
Accept-Language: sv-SE, en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
authentication-results: gmx.de; dkim=none (message not signed) header.d=none;gmx.de; dmarc=none action=none header.from=ericsson.com;
x-originating-ip: [83.227.122.88]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 1d0acf14-4fad-4435-6f58-08d87f14cb09
x-ms-traffictypediagnostic: HE1PR0701MB2987:
x-ms-exchange-transport-forked: True
x-microsoft-antispam-prvs: <HE1PR0701MB2987FABD8A1F1FC891A3C999C2100@HE1PR0701MB2987.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:8273;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: yB1JaYNs6sad+x6/7u2dtVDuL/AlAOoEh51U7OmmeDhJ16tUCcsrpQkRJin+LUsFQzicmUKTFyU2LvNiDF8bXGSS0SfxIha/V54R3T5f0HHpLaEn1FltM0UcW3uOVDJklMPu+PUEOpWM346pegFfCf8NFze2vob7QyPOE1G8VR55nWCic5f0QD+uJOWv6KkOsOpQ3Gupqy696k7mpn25mlR/REiQOvdaefU5JqY+YMFB57W2mvHdmsXDqMtiUAvZWgdj37bG07Pm/KJhUFWdMhDA/FNCuNHQFThdm1nHDjLaMHlRozsJrlUkjfNOGrB2/vA+ubDZ+YVkvVrRIBPsKdoCiyBIQKASt/GseJTq5DZo70mldbRXI0CbscDxFrDaPuyMG03XMnjFKZw9+Fc2iQ==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:HE1PR0701MB2876.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(39860400002)(376002)(366004)(346002)(136003)(396003)(66946007)(966005)(66446008)(66556008)(66616009)(55016002)(64756008)(66476007)(2906002)(52536014)(6916009)(316002)(9686003)(76116006)(478600001)(5660300002)(54906003)(99936003)(8936002)(66574015)(83380400001)(4326008)(71200400001)(7696005)(33656002)(86362001)(26005)(186003)(53546011)(6506007)(107886003)(8676002); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata: YGSr8G6X0sI0LUpoyUNKHNJA66mmlOnqIl5PJQSf5EyPtN5larHoDtwNOpD396ThfoJTcQRTdQIrnQMSap6rlbvKOs4WgVmcqGtmUjpWZAcYv3csAwRviVnPzELyKEpUiteLeD8k9aAx8hIhlddOM2TeVvB7neqvb9dcUPkTW+6COu8LRC/wux7WN3W09nYsD3+8RPQDUXNyoga+CqBOul/fygcsMARDFpGBBYztGPz7utboBF6Z3LSP04UKzvWcmVf+U6pE6fMk6Apfu5QrkH2m3qbhZcP2lk2Bv7f+GI4qa4o4355VJ7OG2/HzDj5cTdBng6Rd9lmvWttW7ZXRPGPiWjk4aKyc95PcRwSM9PZVyxkU6obISmp45WYXLr1mYc2/PUKHmx8pUI9lZ4EnHGxCpeo8fHmYo1ijuRFa0DqltDZmXRK+mAUC6ljiYUloN+wiEoFDLHFfsWFYQN1XkvLLsUv4qkTO7Kt2FLD7cLlr7Zg1PBBPCWvteo40uYGuwJMQOEHi3s80khhwkA+Ue/Xd5ho7gtScjoasOJTGaT0WjfdJNdJPtB6PKsJtY1nrR85wykJeDSOifiUJmzAAF2iPilYjMH90bjmewV5e6CddMzTAZnFjdR9H8SBTpjrVPBbU8NYnNmHZsJ4wtOHjYQ==
Content-Type: multipart/signed; protocol="application/x-pkcs7-signature"; micalg="SHA1"; boundary="----=_NextPart_000_00DB_01D6B106.09411A70"
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: HE1PR0701MB2876.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 1d0acf14-4fad-4435-6f58-08d87f14cb09
X-MS-Exchange-CrossTenant-originalarrivaltime: 02 Nov 2020 09:50:55.3722 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: LpNwOgLmCyTacGdbJOzatL8Qdw8/yChFHbjyQQwQXbP42ABnpaP6LYbgZdyPn25AIvh7BGcKISOwO2iVKy0PUZJXxvHzQeEQBKEuZlq0AuUnTbbbdtucd9LnSFjC7Qpj
X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR0701MB2987
Archived-At: <https://mailarchive.ietf.org/arch/msg/tcpprague/I6gt0TsS-qzaCD-Rws0tsixu3pE>
Subject: Re: [tcpPrague] [tsvwg] [iccrg] Realistic Queue delay targets
X-BeenThere: tcpprague@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "To coordinate implementation and standardisation of TCP Prague across platforms. TCP Prague will be an evolution of DCTCP designed to live alongside other TCP variants and derivatives." <tcpprague.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tcpprague/>
List-Post: <mailto:tcpprague@ietf.org>
List-Help: <mailto:tcpprague-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 02 Nov 2020 09:51:09 -0000

Hi
I don't anymore know where all these discussions are heading. Seems like we 
always end up in infinite discussions that lead nowhere!.
Network implementers will implement whatever queue management they find 
useful, be it dualQ, fq-codel or whatever.

Yes, there are ways to deal with jitter, some are implemented, some are in the 
pipe, some are on the drawing board and as I mentioned several times: It is 
not very fruitful to take todays internet jitter as a litmus test on how good 
L4S will behave in the future.
As examples, 5G has a shorter HARQ retransmission loop than 4G, this reduces 
jitter, there is also work to reduce handover delay, shorter TTIs etc. It is 
therefore quite meaningless to produce data on how well L4S will fare in the 
precense of jitter. Leave that to the experiments.

/Ingemar


> -----Original Message-----
> From: Sebastian Moeller <moeller0@gmx.de>
> Sent: den 2 november 2020 09:47
> To: Ingemar Johansson S <ingemar.s.johansson@ericsson.com>
> Cc: Rodney W. Grimes <ietf@gndrsh.dnsmgr.net>; Bob Briscoe
> <ietf@bobbriscoe.net>; tsvwg IETF list <tsvwg@ietf.org>; iccrg IRTF list
> <iccrg@irtf.org>; Christian Huitema <huitema@huitema.net>; TCP Prague List
> <tcpPrague@ietf.org>; De Schepper, Koen (Koen)
> <koen.de_schepper@nokia.com>
> Subject: Aw: Re: [tsvwg] [iccrg] Realistic Queue delay targets
>
> Hi Ingemar,
>
> more below in-line, prefixed [SM].
>
> > Gesendet: Montag, 02. November 2020 um 09:30 Uhr
> > Von: "Ingemar Johansson S"
> > <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org>
> > An: "Rodney W. Grimes" <ietf@gndrsh.dnsmgr.net>, "Bob Briscoe"
> > <ietf@bobbriscoe.net>
> > Cc: "tsvwg IETF list" <tsvwg@ietf.org>, "iccrg IRTF list"
> > <iccrg@irtf.org>, "Christian Huitema" <huitema@huitema.net>, "TCP
> > Prague List" <tcpPrague@ietf.org>, "De Schepper, Koen (Koen)"
> > <koen.de_schepper@nokia.com>
> > Betreff: Re: [tsvwg] [iccrg] Realistic Queue delay targets
> >
> > Hi Rodney
> >
> > I believe part of the answer to your question is found in
> > https://tools.ietf.org/html/draft-ietf-tsvwg-l4s-arch-07#section-6.3 .
> > The fact that we begin to see the scheduling jitter does not
> > invalidate L4S as a means to reduce the congestion related jitter.
>
>        [SM] As so often that section does contain some theoretical 
> observations,
> but fails to empirically show which level of burstyness L4S can deal with
> gracefully and what the consequences are (on the bursty flow itself, other
> flows in the shallow-queue and and flows in the deep queue). That would be
> meaningful responses to Rodney's concern. As is that section basically just
> claims without supporting data, that even in the face of bursty flows, L4S
> should still be tried, but that must be compared to a FiFO, because compared
> to say fq_codel with a 5ms default target, traffic with > 5ms jitter will 
> probably
> look much better after fq_codel than after L4S (L4S will conserve the
> burstyness much more, while fq_codel will smooth it out a bit).
>         I wonder why such verbose but essentially non-actionable (almost
> useless) sections keep getting added to already  quite long and verbose
> internet drafts in the first place?
>
> Regards
>         Sebastian
>
> >
> > Scheduling jitter exist also in cellular technology. Scheduling jitter
> > is however generally not evidence of congestion. L4S congestion
> > marking should therefore be designed to not trigger on this. The
> > master thesis** the L4S marking threshold was set sufficiently high to
> > avoid this but it should be understood that L4S marking in cellular can be
> implemented in smarter ways.
> > In the master thesis, the L4S marker only inspected the queue on the
> > RLC layer.
> > There are other causes to delay jitter in cellular, HARQ
> > retransmissions and handover delays are two examples. There is work in
> > progress to reduce all kinds on delay jitter, L4S is a tool to reduce
> congestion related jitter.
> > In any case, non-congestion related jitter is not an argument against
> > L4S
> >
> > /Ingemar
> >
> > **
> > https://kth.diva-portal.org/smash/record.jsf?dswid=-6303&pid=diva2%3A1
> > 484466
> >
> &c=1&searchType=SIMPLE&language=en&query=brunello&af=%5B%5D&aq=
> %5B%5B%
> > 5D%5D&
> >
> aq2=%5B%5B%5D%5D&aqe=%5B%5D&noOfRows=50&sortOrder=author_sor
> t_asc&sort
> > Order2 =title_sort_asc&onlyFullText=false&sf=all
> >
> > > -----Original Message-----
> > > From: Rodney W. Grimes <ietf@gndrsh.dnsmgr.net>
> > > Sent: den 1 november 2020 21:24
> > > To: Bob Briscoe <ietf@bobbriscoe.net>
> > > Cc: Christian Huitema <huitema@huitema.net>; tsvwg IETF list
> > > <tsvwg@ietf.org>; iccrg IRTF list <iccrg@irtf.org>; TCP Prague List
> > > <tcpPrague@ietf.org>; De Schepper, Koen (Koen)
> > > <koen.de_schepper@nokia.com>
> > > Subject: [iccrg] Realistic Queue delay targets
> > >
> > > Bob,
> > >
> > > > Christian,
> > > >
> > > > I've changed the subject line given it's no longer appropriate.
> > > > See inline tagged [BB]...
> > >
> > > And I am changing it again... as only addressing a statement that I
> > > have
> > great
> > > concerns about.
> > >
> > > See inline ragged [RWG]
> > >
> > > > On 01/11/2020 01:07, Christian Huitema wrote:
> > > ... [ much text deleted ] ...
> > >
> > > > [BB] Yes, once the IETF assigns the codepoint, BBRv2 will be 'allowed'
> > > > to send packets over the Internet as ECT(1). Then, yes, an L4S
> > > > DualQ Coupled AQM will classify BBRv2 packets into the L4S queue.
> > > > This should have a very shallow ECN marking threshold (500us -
> > > > 1ms), so even if the flow (whether QUIC or TCP) is flying just
> > > > under the available capacity, bunching of packets means it is
> > > > unlikely to completely avoid ECN marking between probes. If it
> > > > could avoid ECN marking, you are right that it would get a bump of
> > > > ECN marks during the probe. I haven't studied the code, but when
> > > > it experiences ECN marking I believe it switches into an L4S ECN
> > > > mode for a while, and uses ECN rather than delay probing to track
> > > > available capacity. I assume it switches back to BBR's delay
> > > > probing mode if it gets no ECN for a while (e.g. the bottleneck
> > > > might have moved). But I haven't looked
> > at
> > > BBRv2's ECN behaviour in detail.
> > >
> > >  [RWG] I have great concern about this 500uS to 1mS ECN marking
> > > threshold given that I have recently learned the latest WiFi
> > > standards actually run
> > with a
> > > packet aggregation time of 4mS thus making it probably impossible to
> > > have such traffic work in such a targeted low latency queue.
> > >
> > >  [RWG] Has any consideration been given to what is already deployed
> > > on the Internet as link layer technologies that would preclude the
> > > operation of
> > the
> > > L4S low latency queue?
> > >
> > > Regards,
> > > --
> > > Rod Grimes
> > rgrimes@freebsd.org
> > >
> >
> >