Re: [tsvwg] Update to Position Statement on ECT(1)

"Holland, Jake" <jholland@akamai.com> Wed, 20 May 2020 01:32 UTC

Return-Path: <jholland@akamai.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9C67E3A087F for <tsvwg@ietfa.amsl.com>; Tue, 19 May 2020 18:32:19 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level:
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=akamai.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id v28CbMJYOexC for <tsvwg@ietfa.amsl.com>; Tue, 19 May 2020 18:32:17 -0700 (PDT)
Received: from mx0a-00190b01.pphosted.com (mx0a-00190b01.pphosted.com [IPv6:2620:100:9001:583::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B42E53A087D for <tsvwg@ietf.org>; Tue, 19 May 2020 18:32:17 -0700 (PDT)
Received: from pps.filterd (m0050093.ppops.net [127.0.0.1]) by m0050093.ppops.net-00190b01. (8.16.0.42/8.16.0.42) with SMTP id 04K1PrvU032322; Wed, 20 May 2020 02:32:16 +0100
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=akamai.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=jan2016.eng; bh=WPHaedaYNCRKB316Mk1sSQSA/X0tR6eqkAFP2j63dl0=; b=ap3BruT+5VYcdIaG32mTCs3uexJ7ezEC4ekvt1J6V5Op+5SuC5cXAqFm4eV7giMf6//C bj40SFCdPdo1br67VU2C0HyL1f7DbZ45ARSItfAwpiB+xK6qYBS2SSg+UBBrYIRgXJTr spsrefkUFrJage84CldVp+ty0Ci6sbOLHREz0HVm/ugeFesQgF7H+/jNSaGa78SE39dG veFK1q3MWVOsNJTPyMyRZ0QaGTXq1f1N2cx9X4O5rkDm8TWThPcRL+PpgRk04uLvE02e oab2DrLLd5C2tv5KwxpXlyhEiBioI+0NdSxPSwlvVoSlt2qbKMlKhH54FgvejG+cwfb4 Ig==
Received: from prod-mail-ppoint2 (prod-mail-ppoint2.akamai.com [184.51.33.19] (may be forged)) by m0050093.ppops.net-00190b01. with ESMTP id 312rvpm6me-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 20 May 2020 02:32:16 +0100
Received: from pps.filterd (prod-mail-ppoint2.akamai.com [127.0.0.1]) by prod-mail-ppoint2.akamai.com (8.16.0.27/8.16.0.27) with SMTP id 04K1HgjL003938; Tue, 19 May 2020 21:32:14 -0400
Received: from email.msg.corp.akamai.com ([172.27.123.31]) by prod-mail-ppoint2.akamai.com with ESMTP id 312bgvb98c-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Tue, 19 May 2020 21:32:14 -0400
Received: from usma1ex-dag1mb6.msg.corp.akamai.com (172.27.123.65) by usma1ex-dag1mb3.msg.corp.akamai.com (172.27.123.103) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Tue, 19 May 2020 21:32:14 -0400
Received: from usma1ex-dag1mb6.msg.corp.akamai.com ([172.27.123.65]) by usma1ex-dag1mb6.msg.corp.akamai.com ([172.27.123.65]) with mapi id 15.00.1497.006; Tue, 19 May 2020 21:32:14 -0400
From: "Holland, Jake" <jholland@akamai.com>
To: Martin Duke <martin.h.duke@gmail.com>
CC: "C. M. Heard" <heard@pobox.com>, TSVWG <tsvwg@ietf.org>
Thread-Topic: [tsvwg] Update to Position Statement on ECT(1)
Thread-Index: AQHWJXDCMj0HjdV7wk+M4pcr+ovB2aihqRUAgAAqnYCADOcbAP//2jKAgAFm54D//7rTAIAAwvOA//+WIYA=
Date: Wed, 20 May 2020 01:32:14 +0000
Message-ID: <789B55A8-A560-4C93-94FA-C62498B33411@akamai.com>
References: <BE44EAE9-5CFB-4F5D-85B8-05AFA516C151@akamai.com> <CACL_3VEbUHB-Omwp1-g5Tq3G3J-kKj9N3jPZLcfruicw3X=AsA@mail.gmail.com> <2CBBD8CD-2088-4E41-B113-EED665853D3C@akamai.com> <CAM4esxSFCBcxXjz5JJJg1z6+wwfN3mTrtJ8bKiBsj2TeOmmFSw@mail.gmail.com> <1D8D2AF8-F805-4BAC-8126-355A8337D830@akamai.com> <CAM4esxSMELAi0BMBRynYTx44iY6f-yLEWng4QQ2Pxt9J-haxFg@mail.gmail.com> <DE770902-CA1E-405C-A944-F12114AF2C3B@akamai.com> <CAM4esxQTyDNfNiAFhiHL9Zb3OPr9jivkrD2u8DtvhsMw_2Yv-g@mail.gmail.com>
In-Reply-To: <CAM4esxQTyDNfNiAFhiHL9Zb3OPr9jivkrD2u8DtvhsMw_2Yv-g@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/16.37.20051002
x-ms-exchange-messagesentrepresentingtype: 1
x-ms-exchange-transport-fromentityheader: Hosted
x-originating-ip: [172.19.119.102]
Content-Type: multipart/alternative; boundary="_000_789B55A8A5604C9394FAC62498B33411akamaicom_"
MIME-Version: 1.0
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.216, 18.0.676 definitions=2020-05-19_10:2020-05-19, 2020-05-19 signatures=0
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 mlxscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-2004280000 definitions=main-2005200008
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.216, 18.0.676 definitions=2020-05-19_10:2020-05-19, 2020-05-19 signatures=0
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 lowpriorityscore=0 phishscore=0 clxscore=1015 malwarescore=0 priorityscore=1501 mlxlogscore=999 bulkscore=0 spamscore=0 cotscore=-2147483648 mlxscore=0 adultscore=0 impostorscore=0 suspectscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2004280000 definitions=main-2005200009
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/gcPiGGrmxZ6nuWEMBmV-Ph7wFvY>
Subject: Re: [tsvwg] Update to Position Statement on ECT(1)
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 20 May 2020 01:32:20 -0000

Hi Martin,

> Jake, I like your frame of the interesting trade-off between losing the L4S signal and losing the 3168 signal. However, let me add yet another concern about ECT1->0: by design, packets so marked may arrive *much* later than neighbors not marked, which means they are likely to be declared lost anyway. Do you see this as a problem, or post bottleneck is the latency difference likely small?


My take is that this basically happens only in a dualq (leaving aside other causes of reordering), and the classic portion of a dualq is not a deep dumb fifo, but rather a ordinary PIE AQM with a good delay response like normal classic PIE AQMs.  So the time difference that’s added by a single such queue is what you’d expect from a normal classic PIE AQM, if you have multiple loaded links (which by the way we’ve seen argued is quite uncommon, at least when L4S proponents are supporting the notion that mis-classifying classic CE-marked packets isn’t a problem).

According to the same charts, such a PIE queue tends to vary from up to what looks like about 5ms at near the median to about 50ms at the 5 9’s level:
https://datatracker.ietf.org/meeting/105/materials/slides-105-tsvwg-sessa-5-l4s-presentation-00.pdf#page=2

This time difference is well below RTO, but could easily hit a fast rexmit from dupacks if the L4S endpoint isn’t using RACK, or if it is using RACK it could reasonably at the higher end fall outside the RACK reordering window if it’s a short enough path, since the reordering window at min_rtt/4, according to https://tools.ietf.org/html/draft-ietf-tcpm-rack-08#section-8.3.  (And of course this can cascade if there are multiple queues, so at, say, 10-15 such loaded bottlenecks when the first one gets a high-fi mark, you might be able to make it start to bump into RTO.)

However, IIRC previous review found that a fast retransmit in a modern linux would get retroactively fixed up to be a non-loss signal when the late ack arrives, though you could end up with some extra traffic generated when it happens.

So to me the reordering issue doesn’t look offhand like a likely stopper for this, though it’s certainly awkward when there’s multiple loaded paths in sequence and this is a clear downside for this signaling strategy, regardless of whether people agree that the MD signal is the more important of the 2 signals to keep in tunneled paths.  The similar worry over classic CE reordering got a lot of discussion IIRC, but I think the resolution concluded that it wasn’t a big problem.  However, I think this would be somewhat worse, and could also get some similar discussion, even if this otherwise looks like a worthwhile path.

Caveat emptor: this is all off-the-cuff reasoning, I haven’t tested any of this of course.  Just laying out the line of reasoning as I understand it, but if anybody ever tests this, it could reasonably show out problems I haven’t thought of.  I do think it would be potentially quite a bit of reordering sometimes in paths with multiple dualqs.

Best,
Jake