[tsvwg] L4S and 3DupACK CE behavior (from the RFC 4301 thread)

"Black, David" <David.Black@dell.com> Mon, 06 January 2020 17:35 UTC

Return-Path: <David.Black@dell.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4DFE41208E8 for <tsvwg@ietfa.amsl.com>; Mon, 6 Jan 2020 09:35:06 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.699
X-Spam-Level:
X-Spam-Status: No, score=-2.699 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=dell.com header.b=LHvuURS9; dkim=pass (1024-bit key) header.d=dell.onmicrosoft.com header.b=kRfc1vxs
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id TTUd2EizYSjv for <tsvwg@ietfa.amsl.com>; Mon, 6 Jan 2020 09:35:04 -0800 (PST)
Received: from mx0a-00154904.pphosted.com (mx0a-00154904.pphosted.com [148.163.133.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 475BB1208E3 for <tsvwg@ietf.org>; Mon, 6 Jan 2020 09:35:04 -0800 (PST)
Received: from pps.filterd (m0170391.ppops.net [127.0.0.1]) by mx0a-00154904.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 006HPFbI015058 for <tsvwg@ietf.org>; Mon, 6 Jan 2020 12:35:03 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dell.com; h=from : to : cc : subject : date : message-id : content-type : mime-version; s=smtpout1; bh=lKqG+KBeuKfk2LSG6N4ecULWeE5RI+eUWK+zlr+MNfM=; b=LHvuURS9h9UYwERXbpdQcBY+Vqix9K6weqTVOOkE3vjyPDMbMpYPsbp9eSR5PT/0jEY5 6tRy187LMOcoISsLD14deUD7h4CttgSN/K8zoRNrtf9hP5h1Uf7KvumRv8q3tpEdyh0h j9THCLMVnmCa8GE0iajr+nvILdWfA/B0umeaYBZHx3LIQ36rtBmpZ02rL72xsbJYN+bT JySaTzL8ikgzFjpYf4ClTGZrWNJpGl8OJ7DvPXKjm2d0bIn9TpxEREpvwm0Fhk4B9V/R 3Tx0e1uElBNnKqW/3tZjohRm4NlghxYynzIyQOPKYQTznswCSaLtu1mTP7D3+Nqbs7th hQ==
Received: from mx0a-00154901.pphosted.com (mx0a-00154901.pphosted.com [67.231.149.39]) by mx0a-00154904.pphosted.com with ESMTP id 2xapqyq90c-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for <tsvwg@ietf.org>; Mon, 06 Jan 2020 12:35:03 -0500
Received: from pps.filterd (m0142693.ppops.net [127.0.0.1]) by mx0a-00154901.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 006HSAgD156121 for <tsvwg@ietf.org>; Mon, 6 Jan 2020 12:35:03 -0500
Received: from nam10-dm6-obe.outbound.protection.outlook.com (mail-dm6nam10lp2100.outbound.protection.outlook.com [104.47.58.100]) by mx0a-00154901.pphosted.com with ESMTP id 2xc4hkcvt9-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK) for <tsvwg@ietf.org>; Mon, 06 Jan 2020 12:35:03 -0500
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=lUxHij9WiATI43hyW6JALBLgDxo+UXIW8HFpEakO+gj06JWBtFL94n5GE1yGBhjYFStOMdh0rh+O9QsHznkgN2LLyi2SjLEzlNCPJQM7gaoYvVltuVLnmSvftn/7gsdMPgfXf1cHuKfFK8IdZj8tXHIWho0JLqfXYvNUpq/bKnErJxb8fjFtL2cOuY7jnTztTxtY4LuR54QNPf1ZePQixlwm1pjxZ192s07vF0aIHGagalnCQcB/5HFBcupG3vzPt6cylVTxAqd/89mizxIS2DBoIXhgDXM0Vl2MUMl5hA4cg1bzC+u3B8KwjFtpPnlytrkENnEqFLK6rc7zKXAHzQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=lKqG+KBeuKfk2LSG6N4ecULWeE5RI+eUWK+zlr+MNfM=; b=Mj2tM+XW1KoQ/SRI7IF8rZpxaUMjy4TvjGrdieV8Kb0duV8r0wzh637Ksr98C4tAHr8A3JieZ57Vk4+EF0TuRS8pUnrXaUUSAyJgW9ALmwqG5C2LF4JQ84E6WEGU3rbBB2t/w656gZdPif1LtqyAhvSMwp5RO4MSMkC5JVOX9vhUhuBCJyAbP1kxM3NpsyvlT2cDytww1Z+hzSJpcoj53zh9oO+gzEJQ4Ifc16Ihx4PKAT2D0GdIUYJsBYEZi0/9QN4vOCZ9h3QU7VJDamUHTO41hkMWItVtlQfXJF4U4Z5MVr58a7Mmid3DXUivifO8twNn5bUBWLaaKr9kamgypw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=dell.com; dmarc=pass action=none header.from=dell.com; dkim=pass header.d=dell.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Dell.onmicrosoft.com; s=selector1-Dell-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=lKqG+KBeuKfk2LSG6N4ecULWeE5RI+eUWK+zlr+MNfM=; b=kRfc1vxswXhNpXQX0LhBnAHrR1yW5klrrSALjf7KQEXaPIHjRWwvJ5Yehtb2S7LmvjH+3sZ0vOAPYsEZ8hzLzjrsUsyWkeDkSDlSLn/W7IzRjvTORRbhS3HD1iWyAws/n/RbSHTFDpHBSbiUCf/rB9qf1/y7avYNWMKGFaQMdQw=
Received: from MN2PR19MB4045.namprd19.prod.outlook.com (10.186.145.137) by MN2PR19MB3021.namprd19.prod.outlook.com (20.178.253.27) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2602.12; Mon, 6 Jan 2020 17:35:01 +0000
Received: from MN2PR19MB4045.namprd19.prod.outlook.com ([fe80::58e:e637:6650:64ab]) by MN2PR19MB4045.namprd19.prod.outlook.com ([fe80::58e:e637:6650:64ab%3]) with mapi id 15.20.2602.015; Mon, 6 Jan 2020 17:35:01 +0000
From: "Black, David" <David.Black@dell.com>
To: "tsvwg@ietf.org" <tsvwg@ietf.org>
Thread-Topic: L4S and 3DupACK CE behavior (from the RFC 4301 thread)
Thread-Index: AdXEsH+gxS5EtirOQgK/MHRmcJ1h4Q==
Date: Mon, 06 Jan 2020 17:35:01 +0000
Message-ID: <MN2PR19MB4045B8396F53ED9ED967AB46833C0@MN2PR19MB4045.namprd19.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels: MSIP_Label_17cb76b2-10b8-4fe1-93d4-2202842406cd_Enabled=True; MSIP_Label_17cb76b2-10b8-4fe1-93d4-2202842406cd_SiteId=945c199a-83a2-4e80-9f8c-5a91be5752dd; MSIP_Label_17cb76b2-10b8-4fe1-93d4-2202842406cd_Owner=david.black@emc.com; MSIP_Label_17cb76b2-10b8-4fe1-93d4-2202842406cd_SetDate=2020-01-06T16:43:12.3837771Z; MSIP_Label_17cb76b2-10b8-4fe1-93d4-2202842406cd_Name=External Public; MSIP_Label_17cb76b2-10b8-4fe1-93d4-2202842406cd_Application=Microsoft Azure Information Protection; MSIP_Label_17cb76b2-10b8-4fe1-93d4-2202842406cd_Extended_MSFT_Method=Manual; aiplabel=External Public
x-originating-ip: [72.74.71.221]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 076902d1-1c5f-4b2f-88b1-08d792cec239
x-ms-traffictypediagnostic: MN2PR19MB3021:
x-ms-exchange-transport-forked: True
x-microsoft-antispam-prvs: <MN2PR19MB302183220929DF64FF45DC86833C0@MN2PR19MB3021.namprd19.prod.outlook.com>
x-exotenant: 2khUwGVqB6N9v58KS13ncyUmMJd8q4
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-forefront-prvs: 0274272F87
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(366004)(39860400002)(396003)(376002)(136003)(346002)(199004)(7502003)(189003)(6506007)(6916009)(2906002)(4326008)(81166006)(81156014)(7696005)(26005)(76116006)(478600001)(8676002)(8936002)(33656002)(5660300002)(55016002)(52536014)(86362001)(9686003)(186003)(66556008)(786003)(66476007)(71200400001)(64756008)(316002)(66946007)(66446008)(107886003); DIR:OUT; SFP:1101; SCL:1; SRVR:MN2PR19MB3021; H:MN2PR19MB4045.namprd19.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1;
received-spf: None (protection.outlook.com: dell.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: I4cfgnLpPYUIfQ3AZe08ZxZJb7Xnbzhb86gYvitxf/djbfqncmoakQw8ZJ5PfKDestk5HYsPvhENWyi6+XBqRYOC4fikeh4WByWhW262Q4aWpXgCkuYP5Z2L/yXtqaW2KlYyVGY4lXI9dJB8b191wXeTU6OwS4ICqwzXkvI/1U2yPO+337DBpbJA6u28WCqNAKkSXtCLh2J0C6ShhmJ80G/663rRH97j/WbhMIlgWiwqD9jt4erj8P38OC8k+RErJBjvSjmTLTnvLowR56jvClMPFamXaiRF5Yhnvv4ouz80wVxV6z4Y6pLjCpAZR5YrjaP2QVTKDNOPvLeJCQNHRbFPg8eeXK9JWW1zayyJwkrExUVAbz3au3eH+StwjKNDNExqqIKqOHWpWUzqSWgmuGMh9kkbzvII2aIXTWWg76dFfEsWl1AXm6d3kE/jSzzvnCET8YrXMYB52jdX7fJ/TVzPgP47RMWj4FnoJCFFulVRD1kA2mudEbSHvBAJf/0j
Content-Type: multipart/alternative; boundary="_000_MN2PR19MB4045B8396F53ED9ED967AB46833C0MN2PR19MB4045namp_"
MIME-Version: 1.0
X-OriginatorOrg: Dell.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 076902d1-1c5f-4b2f-88b1-08d792cec239
X-MS-Exchange-CrossTenant-originalarrivaltime: 06 Jan 2020 17:35:01.3492 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 945c199a-83a2-4e80-9f8c-5a91be5752dd
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: zHOJ0J8zViOgZl8sVurXE3Lkanuu2O0+iY3juyk9q+V8uHVk/hcZ6CqkShnNee56vm4aRt0qrJbO6i5Xo9yTAw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR19MB3021
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.95,18.0.572 definitions=2020-01-06_05:2020-01-06,2020-01-06 signatures=0
X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 adultscore=0 clxscore=1015 lowpriorityscore=0 mlxlogscore=999 mlxscore=0 malwarescore=0 phishscore=0 suspectscore=0 priorityscore=1501 spamscore=0 bulkscore=0 impostorscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-1910280000 definitions=main-2001060150
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 bulkscore=0 mlxlogscore=999 phishscore=0 clxscore=1015 spamscore=0 impostorscore=0 mlxscore=0 malwarescore=0 adultscore=0 lowpriorityscore=0 priorityscore=1501 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-1910280000 definitions=main-2001060150
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/37lNnY-DO_yQDGO2cQtap2Txh7M>
Subject: [tsvwg] L4S and 3DupACK CE behavior (from the RFC 4301 thread)
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 06 Jan 2020 17:35:07 -0000

(posting as an individual, not WG chair)

Following on to the long thread about CE marks for non-L4S traffic using the L4S queue, I have a few remarks and a test scenario to suggest:

Much as we'd like to banish 3DupACK, that's not going to happen anytime soon, hence L4S has to deal with the fact that CE-marked traffic for flows that use 3DupACK will be present in the L4S queue of the dual-Q AQM.  E.g., it's a fine architectural vision to appeal to ubiquitous use of RACK and pacing to make this problem go away in the longer term, but that doesn't address the current engineering problem with existing transport protocol implementations.

We know that if the dual-Q AQM default/base queue is backed up at an L4S node, then for a non-L4S flow, arbitrary reordering of CE-marked packets wrt the rest of the flow is possible because the CE packets use the L4S queue but the rest of the non-L4S flow does not.

A test scenario to investigate this involves a couple of nodes, [1] RFC-3168 AQM and [2]L 4S dual-Q AQM in that order, and two unrelated non-L4S flows:

  *   Flow [A]: passes through both nodes, bottleneck for flow [A] is at RFC-3168 AQM node [1], CE marks are being generated resulting in the usual TCP "sawtooth" pattern for flow [A] (pattern may not be continuous).
  *   Flow [B]: passes only through L4S dual-Q AQM node [2], not RFC-3168 AQM node [1], bottleneck for flow [B] is at node [2], so flow [B] builds a deep queue in the coarse grain (conventional) queue at node [2], which generates CE marks , resulting in the usual TCP "sawtooth" pattern for flow [B] (pattern may not be continuous).

In this test scenario, each flow has only one bottleneck, but the bottleneck for flow [B] at node [2] causes CE-marked packets for flow [A] to be reordered at that node (in addition to likely applying some additional CE marks to flow [A]).  I think this overall scenario is plausible and realistic, e.g., node [1] could be the egress from a home network for the Flow [A] TCP sender, and node [2] could be at the boundary between a backbone network and an access network for both TCP receivers - both nodes are places where the bandwidth drops between ingress and egress.  I hope everyone agrees that in this scenario, Flow [B] will experience re-ordering, but that's only the beginning of the discussion.

An important open question (IMHO) is whether that re-ordering matters in practice.  A reason why the answer is less than obvious is that flow [A] is already carrying CE marks from node [1], and the flow [A] TCP sender only reacts once per RTT to the combination of 3DupACK and CE, so at least some of the 3DupACK-based congestion responses for flow [A] get combined with CE-based congestion responses because both indications of congestion occur within the same RTT reaction period.

The reason to invest the time to run this sort of test is to understand whether or not "some of the 3DupACK-based congestion responses" in the above paragraph is in practice "all" or close enough to "all" to not matter.

Thanks, --David