Re: [tcpm] [EXTERNAL] Re: Hystart and delay jitter

Mirja Kuehlewind <mirja.kuehlewind@ericsson.com> Mon, 22 March 2021 15:12 UTC

Return-Path: <mirja.kuehlewind@ericsson.com>
X-Original-To: tcpm@ietfa.amsl.com
Delivered-To: tcpm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 625073A03C9 for <tcpm@ietfa.amsl.com>; Mon, 22 Mar 2021 08:12:30 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.452
X-Spam-Level:
X-Spam-Status: No, score=-0.452 tagged_above=-999 required=5 tests=[DKIMWL_WL_HIGH=-0.251, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id mmZfcUqNe4bx for <tcpm@ietfa.amsl.com>; Mon, 22 Mar 2021 08:12:26 -0700 (PDT)
Received: from EUR02-AM5-obe.outbound.protection.outlook.com (mail-eopbgr00040.outbound.protection.outlook.com [40.107.0.40]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2EF3B3A03EE for <tcpm@ietf.org>; Mon, 22 Mar 2021 08:12:26 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=JQfidmDhrLy/3WuTh81Ve+Fm4VvxETP75HK3Eu+bfnSbgb91w5ueyJCm8I9K9Io4qxv+fBzkV4OgfuaglBHkwNmt6JBJ0iHVUNYxwrkdS8YXH3ky/X4/niG4NbSaESzAKjyCwEjPYoqsD+MBhSlvVn70mWW0QUuJ8HgSIPK5eDsJDSQMKEnYnmpLg2CSvMFKk0xiSBLKXwKxWDPk85vUICUVFD6/CCzuktUBlyrVr0K3rvQa8KBJCl4TAZ3ZFEKswNCmDV6namdIW/XBj66N5UIyBYHaas/JXJFVH7OWKDKhqKj6ufGCy/Gldr+TWlV3SAsdes4rY2lZluBg3ehW0w==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=/dDL06BaEnyWznO8h/LRhhZ8EOzrFYyPdfBp0ngY+HU=; b=UeGKF/do9Z4iPQ2VIKAB0OSjLCN4L9njDfnhIPSlDS7iaWmCaNNBlVQ5v6g/7hilBU/NS38iZoFL/9GmipDid+ReLBXeTvEZN6vPB4m5UVZ9r7F09/gTtAPdigG2pORCPyUi0Az9uyEw630XSOLpus8FvhF96M6k06gkP4WljkAcg01gorZojJqAdrO4kGLoKDUrKT8GkI7Ju0GtPRgwSrjv5hXmt082z5l5+ZMvaBYawzmw/WnqTnIDAxSWuCxhVpkwIVXs8CqxCFSq4KXgen0dlT5fIXkCxe1W+R/bpmjNWhbZwemuxHxsK8IaopzgESAvOm/rWBCLYyfMIaqGsQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=/dDL06BaEnyWznO8h/LRhhZ8EOzrFYyPdfBp0ngY+HU=; b=cjM3Q4fqB42tJxDMoJsj1XPCH8FV3k052NXoOyHfNaobvlDYUNdBTXM6/WSKFRbQ+PR1MurdycLTKHRtfF3mxXuw7TNUoE0jtM3YUNYSnAoEYh82IsrWzG9M8wwau7BoyYWYSOaEc57RjckKRgCxI028T77BN0Dcm5sX1lqlo6w=
Received: from AM0PR07MB3939.eurprd07.prod.outlook.com (2603:10a6:208:40::14) by AM4PR07MB3284.eurprd07.prod.outlook.com (2603:10a6:205:5::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3977.9; Mon, 22 Mar 2021 15:12:15 +0000
Received: from AM0PR07MB3939.eurprd07.prod.outlook.com ([fe80::3dcd:3a09:9479:a61f]) by AM0PR07MB3939.eurprd07.prod.outlook.com ([fe80::3dcd:3a09:9479:a61f%4]) with mapi id 15.20.3977.022; Mon, 22 Mar 2021 15:12:15 +0000
From: Mirja Kuehlewind <mirja.kuehlewind@ericsson.com>
To: Ingemar Johansson S <ingemar.s.johansson=40ericsson.com@dmarc.ietf.org>, Praveen Balasubramanian <pravb=40microsoft.com@dmarc.ietf.org>, "ncardwell=40google.com@dmarc.ietf.org" <ncardwell=40google.com@dmarc.ietf.org>, Christian Huitema <huitema@huitema.net>
CC: "tcpm@ietf.org" <tcpm@ietf.org>
Thread-Topic: [tcpm] [EXTERNAL] Re: Hystart and delay jitter
Thread-Index: AQHXHEdRyYz30/l4DUe1ERgCEDpiVKqLCHWAgAUrOgA=
Date: Mon, 22 Mar 2021 15:12:15 +0000
Message-ID: <3E80F724-7BCA-4DD2-BBEE-9D9B9E0B02FD@ericsson.com>
References: <376bdc9f-4774-bfc8-1736-6c94fb24953c@huitema.net> <CADVnQymN6UH+XTgdkwdX16TsDTeeTu+S-=O1nVjQFWYbpDT24Q@mail.gmail.com> <CY1PR00MB01700C2168E1B4200BE23B34B6699@CY1PR00MB0170.namprd00.prod.outlook.com> <HE1PR0701MB229938341C5A909CB5664085C2689@HE1PR0701MB2299.eurprd07.prod.outlook.com>
In-Reply-To: <HE1PR0701MB229938341C5A909CB5664085C2689@HE1PR0701MB2299.eurprd07.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-GB
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels: MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_ActionId=09b6e272-b5ca-4c22-a421-e5ad318ef3b2; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_ContentBits=0; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Enabled=true; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Method=Standard; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Name=Internal; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_SetDate=2021-03-18T22:29:46Z; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_SiteId=72f988bf-86f1-41af-91ab-2d7cd011db47;
user-agent: Microsoft-MacOutlook/16.45.21011103
authentication-results: dmarc.ietf.org; dkim=none (message not signed) header.d=none;dmarc.ietf.org; dmarc=none action=none header.from=ericsson.com;
x-originating-ip: [2003:de:e71f:e600:f9cd:4c64:4f6a:754d]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 7216aafe-2fc6-4817-5784-08d8ed44e0a1
x-ms-traffictypediagnostic: AM4PR07MB3284:
x-microsoft-antispam-prvs: <AM4PR07MB32846512A6B59A036F21AA06F4659@AM4PR07MB3284.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:8882;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: HjwdEz7tgn3bCGw+VrsB/9RXsq4IerYbmKuVf+CTDaW7gi2TFU+rKCkm8/gJFf8qDHHJcg0ib4GcXX47TkCTJUFmXlf+sT4uiBcMqu6/DbFP9kMJK5RFOalRc1lds94IKfbLfRJLtJAavuXUcwau/KmCOnTtLTQSd36soSINtztZt50lES0L1pVMqarFyq1ayk7ldgv+PfStCU1WY66eiefCVYFL/q7raVgan9x7S8Q2SiuNSlxFOzIG53vVT+38cxOUzvP37DbyAjrnnjo7bXr5mCsQS0ESgYu77CcAp1Duy4nFQsh8pgMPb296YB8jZlVqnuOKpPwHmjzNq19vF2/Dj4CefcTR1snl/WmIPqCfvVt1EwPT8n6K828NISC4Om++alZTdikJ4NED0DP+hSPVlp55nLj6INTLFjWilCB4v29UJTmXiluV4exAtlWxMjrLqt1bLjBPOKD3rqbWY2NucP9QMtT2PWyLjIfsj0q+6VSsfXFdeQ0h4zoOpUJCgKs5rLHb99sQrkq50V6aFhNJMPSkHEVrmG7JFQQ7V+o2enTSYQmJdozyrgziVX8oFveHz2oyNhWyv5Duub6AJLdnC/ByvH8TWicVD0e2Kro19K7aENsRLVjlUsa2UbZZcbEi9vt4RyzUDvnOnxx+i869VWmiaXAeazYxfVSYen4rMkocaUGZLWJrnmSyJW5+ZHKQGfGNns8S2/4XH0PLdhp7K6s7FQcQIQPMwd9uoSOJqsXowZRTTQzGz2q21lFo7Xq7jBhNpeDUYnWsGePByQ==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM0PR07MB3939.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(39860400002)(396003)(376002)(346002)(136003)(6486002)(86362001)(110136005)(8676002)(316002)(8936002)(4326008)(33656002)(6506007)(53546011)(36756003)(186003)(83380400001)(45080400002)(478600001)(2906002)(76116006)(66446008)(64756008)(5660300002)(66946007)(44832011)(6512007)(71200400001)(38100700001)(2616005)(966005)(66556008)(66476007)(45980500001); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata: =?utf-8?B?U3VveWtBWk9RM2hBMGJzT3RGMVJNOWdFbUkzdEtDS2xjVUlrUWN0dStjaGQw?= =?utf-8?B?NEhsRUhpUHZFUlVaVnY5VG5udlZHQWpwK2x3UytFRXBHdW83KzJFcWZGQTN5?= =?utf-8?B?ck05T3BZbm94L1AxczlZSTNETU5ZcGdDK1gzQVJjN3RHK1MvUmxSNHJUbVc3?= =?utf-8?B?eGRUS25lc0EzVmJSbjF0dWJYU3dJY0Z3V0NwSjZTLzJwMEp2SW5tSTZFOWt6?= =?utf-8?B?dGpsMUNwUVhzNGhBRit0anN6MGpMNlV6WndnUlpPa3A2QVhnb0dJUktYYnlW?= =?utf-8?B?MFVDVHJUOG4vNkh1aS9NdkV6VDhrVFo0QW10ekFlc3AzZzB6K2dUUnZOd0p0?= =?utf-8?B?OU51dEZqeXpCenVocmZaT1QzOGJmY0RDeXpVTHphTzRaM0xwd0JjaWhjTlN4?= =?utf-8?B?NmlHNW1CZkJZdDNpTm1RSmQ3ekdUdFFGOHZROTVob2luSWkvYzRGSWNQc3F2?= =?utf-8?B?NkJWa09YRE03RmhSRFl6YmxnTndldVcvcENXQ0h4WEh2cUNqVU5uQmRMNmxZ?= =?utf-8?B?d3JQRTdPendyd0JmbkVENU9YSDkwaEFNL0xJTUtLU3BzYXlMMkdRMTRlbzh4?= =?utf-8?B?YkRFeUR6Nk5UTTNrVDZWMDd4aGtuTUxhUXVHNmdGcXl0MTlmK3VoTEI3cElI?= =?utf-8?B?Z2o0WkVJWHRDdzkrY2M2dkdtV3hoQ3UxRitMaE1IblNmRUwvS1VxTVVVUi9K?= =?utf-8?B?M3BleEVjbHQxVXJmSzRoemRFQWViS01oMGEzYnlIL3VObSs5NWhjc1NWb015?= =?utf-8?B?QTJHanM3Ukdmdm9weUF6SnVHTkVBS3VEclZRSlRBdHl2SGo3aUZUYURUaitm?= =?utf-8?B?V0xxTWN0ZDNWcnd3REd4d3FSQTl5VUNaSWZ0WGZObDlzMU85bU9BaHNMdG9G?= =?utf-8?B?L05uSU1nUWNNU3FGRDU3NnNUQVdZSk9kM2VmQzUzdFJXVzAvazZBdlBzTm45?= =?utf-8?B?VG9vdFdIREYrR3ltRVEzRFNHL1NyN2dEM3NnU1JCYlE4TkE1cHZGQmVEclpN?= =?utf-8?B?V2UyUzdrZXE3Z0NyNjlaYWRQQWpqSHR0ZkFQZlVnZ3hRQWhyK2IwVSsyVWhK?= =?utf-8?B?b0xGbk5OTHArUUdLaEg3ajJwY3ZEcVpjUnpXbE56dGFNZ2FhTjFpUDhRbzR2?= =?utf-8?B?dFBlbmljbWtNRHB0bDgrMnRaOU5QeU0xWVdySjliNnJybGt6ZmcxejVUS3lZ?= =?utf-8?B?by91UWNGMHpRMjl0a2ZOazBoVzlMRmIvZy83Q2I2SVZXbnVKMGJVdnl2RHRx?= =?utf-8?B?TnFlZU9IVGlHYTFTYkhBaGRrb2xCZU0vU0lidk4rTDlLcXdFdkdoVm15TUk4?= =?utf-8?B?N01BVUVUWDlTdXY5S0lvSVRqcTZqbmJQV0ZuVDdqN1VKYzRkT0VNeVRXVyt2?= =?utf-8?B?dXQxb2dqS0F4NU5hY1BoRzVsQ0lOZ2Z6Y3dLTkliMjBjbm5Kc0lrMGZCcEla?= =?utf-8?B?NWRRUzhTOWx4QlV0Q2h6elJDMVk4NmxLZ3E1dzZEK3VOQmh0VHVGbHAxOEVZ?= =?utf-8?B?YVNVUEVLWUgxM1BGMEVvVEtjN0YvTnpHSEpMMFBseGwzc3RoUDNRcHZtNWZC?= =?utf-8?B?b2pLNmZBa0EzaUR5eTVFUnVIR21QQzRML1FIRmJoNG8yMFhKRkdSMC9RUHM5?= =?utf-8?B?ZEdDMnFGMWt1M1hFdER4UXRQcE9MQktXc3FlM3NuYVAwUkRVNElQUWU5Nk4r?= =?utf-8?B?dVpvTXY5U2FsaExKOS96OStTc2VLNEpnRlpiTzlNd0JzWlJCcDY5UWVTK3ZG?= =?utf-8?B?bmYwWTYvMWwxL042UlFHbG1XYm5Yd3V6MU83anIwTGhvWklHaEx4WHlZZS96?= =?utf-8?B?a0ZCK3gzSTJXcXFreWxGUC9CbWFxdmdtNEZ3TGd4U3dZdHpRV2Q2OThHR0xm?= =?utf-8?Q?yBPugkNu6AeyH?=
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="utf-8"
Content-ID: <EE226C2E941B2649AF50F51E1B08B6AE@eurprd07.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AM0PR07MB3939.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 7216aafe-2fc6-4817-5784-08d8ed44e0a1
X-MS-Exchange-CrossTenant-originalarrivaltime: 22 Mar 2021 15:12:15.3795 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: pcEQ6XHzVE2A9+H1mn3/mUXZBuD1WPVvQF8LnaTf5bNKvjHMlQPKQ0AiKJ2WZWHfHTALwTHxIQNk+rJrgbEMZMomCcZT9wOQuwUHMLsXQUE=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM4PR07MB3284
Archived-At: <https://mailarchive.ietf.org/arch/msg/tcpm/42f8e1D-52zKlrmNOd14pa_PR2w>
Subject: Re: [tcpm] [EXTERNAL] Re: Hystart and delay jitter
X-BeenThere: tcpm@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: TCP Maintenance and Minor Extensions Working Group <tcpm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tcpm>, <mailto:tcpm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tcpm/>
List-Post: <mailto:tcpm@ietf.org>
List-Help: <mailto:tcpm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tcpm>, <mailto:tcpm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 22 Mar 2021 15:12:30 -0000

Yes, we also reported on some problems/bugs in HyStart in maprg two meetings back:

https://datatracker.ietf.org/meeting/interim-2020-maprg-01/materials/slides-interim-2020-maprg-01-sessa-behavior-of-tcp-cubic-in-low-latency-mobile-radio-networks-00

This problem, where Slow Start is left wrongly and much too early, is particularly bad in combination with the TCP friendly region in Cubic. However, the actually problems lies in HyStart which is not covered in the Cubic RFC/bis-draft.
 

´╗┐On 19.03.21, 10:16, "tcpm on behalf of Ingemar Johansson S" <tcpm-bounces@ietf.org on behalf of ingemar.s.johansson=40ericsson.com@dmarc.ietf.org> wrote:

    Hi

    My finding is that it is a bit problematic to rely on RTT estimates for path
    capacity especially with cellular access . It was summarized in section 4 in
    https://tools.ietf.org/html/draft-johansson-cc-for-4g-5g-02 and also
    presented in
    https://www.ietf.org/proceedings/96/slides/slides-96-iccrg-1.pdf

    Regards
    Ingemar

    > -----Original Message-----
    > From: tcpm <tcpm-bounces@ietf.org> On Behalf Of Praveen
    > Balasubramanian
    > Sent: den 18 mars 2021 23:37
    > To: ncardwell=40google.com@dmarc.ietf.org; Christian Huitema
    > <huitema@huitema.net>
    > Cc: tcpm@ietf.org
    > Subject: Re: [tcpm] [EXTERNAL] Re: Hystart and delay jitter
    > 
    > Thanks Christian for the suggestions! We will include a discussion on
    jitter in
    > the next draft update and also experiment with the min of max function.
    > 
    > -----Original Message-----
    > From: tcpm <tcpm-bounces@ietf.org> On Behalf Of Neal Cardwell
    > Sent: Friday, March 12, 2021 2:18 PM
    > To: Christian Huitema <huitema@huitema.net>
    > Cc: tcpm@ietf.org Extensions <tcpm@ietf.org>
    > Subject: [EXTERNAL] Re: [tcpm] Hystart and delay jitter
    > 
    > On Fri, Mar 12, 2021 at 4:29 PM Christian Huitema <huitema@huitema.net>
    > wrote:
    > >
    > > Back in November 2019, when adding Cubic and Hystart to my
    > > implementation of QUIC, I noticed that Hystart was sensitive to delay
    > > jitter. Hystart detects the buildup of queues by monitoring the RTT.
    > > Some links experience delay jitter, caused for example by access
    > > protocol for shared radio links or possibly by link-local ARQ protocols.
    > > The delay jitter can cause Hystart to make the wrong decision, in two
    ways:
    > >
    > > 1) Delay jitter during a previous period could cause some packets to
    > > be delivered "faster than usual", causing Hystart to under-estimate
    > > the min RTT for that period.
    > >
    > > 2) Delay jitter during the currently measured period can cause packets
    > > to be delivered "slower than usual",  causing Hystart to over-estimate
    > > the min RTT for that period.
    > >
    > > The combination of these two issues may cause Hystart to make the
    > > wrong decisions, and exit slow start at levels well below link capacity.
    > 
    > Yes, we have found in both our production experience and controlled
    > experiments that the Hystart-Delay algorithm is very susceptible to
    spurious
    > triggering from jitter, particularly in LTE and wifi paths.
    > 
    > We discussed this a bit in Spring 2017 in the comparison of BBR's
    bandwidth-
    > based mechanism for exiting startup, vs Hystart-Delay's delay-based
    > mechanism:
    >   https://protect2.fireeye.com/v1/url?k=6c35f204-33aecb47-6c35b29f-
    > 861fcb972bfc-c8f94340e007b7bd&q=1&e=fd13218f-2e70-4b39-a879-
    > e9b53c01447d&u=https%3A%2F%2Fnam06.safelinks.protection.outlook.com
    > %2F%3Furl%3Dhttps%253A%252F%252Fwww.ietf.org%252Fproceedings%25
    > 2F98%252Fslides%252Fslides-98-iccrg-an-update-on-bbr-congestion-control-
    > 00.pdf%2523page%253D8%26amp%3Bdata%3D04%257C01%257Cpravb%2540
    > microsoft.com%257Cbc3399870c0d4105299408d8e5a4cbaa%257C72f988bf86f
    > 141af91ab2d7cd011db47%257C1%257C0%257C637511843745826011%257CUn
    > known%257CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBT
    > iI6Ik1haWwiLCJXVCI6Mn0%253D%257C1000%26amp%3Bsdata%3D6SQWDb1
    > mFH0cgrayEwiRYeccYvP0dv%252BAJ1eokyJF%252BKs%253D%26amp%3Brese
    > rved%3D0
    > 
    > > The draft-ietf-tcpm-hystartplusplus-01 does have some protection
    > > against the second issue, because currentRoundMinRTT is computed on at
    > > least N_RTT_SAMPLE. If that number is large enough, computing the min
    > > over N samples should filter out "slower than usual" anomalies.
    > > However, the draft does not include a protection against "faster than
    > usual"
    > > anomalies happening in the previous period. In my implementation, I
    > > protected against that by computing a "min of max" function: compute a
    > > rolling "MAX over N_RTT_SAMPLE", then compute the MIN value of that
    > > during the reference period, and use that to set the reference value
    > > "lastRoundMinRTT".
    > >
    > > I think it would be good to add a discussion of the effect of jitter
    > > to the hystart++ draft. In addition, we may also want to mention
    > > timestamps. The jitter on RTT may be caused by jitter on either
    > > direction of transmission -- data path or ACK path. The effect of
    > > jitter on the ACK path can be minimized if time stamps can be used to
    > > monitor the variation of one-way delays. This is not discussed in the
    > > current draft. Maybe it should be.
    > 
    > A discussion of the effect of jitter sounds like a great idea.
    > 
    > neal
    > 
    > _______________________________________________
    > tcpm mailing list
    > tcpm@ietf.org
    > https://protect2.fireeye.com/v1/url?k=032901f3-5cb238b0-03294168-
    > 861fcb972bfc-7a6ccb41bd90a846&q=1&e=fd13218f-2e70-4b39-a879-
    > e9b53c01447d&u=https%3A%2F%2Fnam06.safelinks.protection.outlook.com
    > %2F%3Furl%3Dhttps%253A%252F%252Fwww.ietf.org%252Fmailman%252Flis
    > tinfo%252Ftcpm%26amp%3Bdata%3D04%257C01%257Cpravb%2540microsof
    > t.com%257Cbc3399870c0d4105299408d8e5a4cbaa%257C72f988bf86f141af91a
    > b2d7cd011db47%257C1%257C0%257C637511843745826011%257CUnknown%
    > 257CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1ha
    > WwiLCJXVCI6Mn0%253D%257C1000%26amp%3Bsdata%3Doqte6wCaTBUvrw
    > gXVRMcD13YgtspMJyIWMMLlwNuYdY%253D%26amp%3Breserved%3D0
    > 
    > _______________________________________________
    > tcpm mailing list
    > tcpm@ietf.org
    > https://www.ietf.org/mailman/listinfo/tcpm