Multipath acknowledgments
Michael Eriksson <michael.eriksson@ericsson.com> Fri, 18 November 2022 15:03 UTC
Return-Path: <michael.eriksson@ericsson.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 627C0C14CE41 for <quic@ietfa.amsl.com>; Fri, 18 Nov 2022 07:03:10 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.097
X-Spam-Level:
X-Spam-Status: No, score=-7.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jjsjJvwj8y_o for <quic@ietfa.amsl.com>; Fri, 18 Nov 2022 07:03:06 -0800 (PST)
Received: from EUR04-VI1-obe.outbound.protection.outlook.com (mail-vi1eur04on062d.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe0e::62d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 01050C14CE30 for <quic@ietf.org>; Fri, 18 Nov 2022 07:03:05 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=anxPYxH/ZIV1raut1+Yw47E5ggPAEzrTCoJhf4pgWgaupHZtHF3PfnPJZmlhP2hdDVhCxiee4uUlekfW+X5+wzhLrhw/x2g6s5CZyk9YP/FVbJvdkIZiygU4gU4w65bWY7yioP0Gkb1RC7EUanEapjO2aN2PXpfU6cLlWmvjNfi2KvCXICS5loR6/NtKha0CozY9tEFx+xiualVyrWnxkoQ3FH7QGGvkEZlZ9r5xCIlDyUyLnWk02lK9ExBX/FbAww2EOtugRhGAIN+7aFyxUpmlUzn8sccgt9sdNDQRgR4QvElfxvpWytVmc9qSq+IFOx1cIS0Rqdhi+rih3kGhBw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=fFF7KmALcMnMWIlgsrFcsNzFrxg2c0OLCH6+uDpVLco=; b=evK5SLu33FwYEEaid+9Hjv5SKLWtHbhzFQB1daZ+Wh4niWb8hJgc/LZo6BZuFxpnZyl85cuDBGRpuJpHuUZS4iN6LU8S42DpmBKTF5UVtZpDexMhOyDldh3vc8cMU+oB5kTPDXEIiLffoJyRzn9lyy9l4Veigrqh4aG3i7c3xulrdmdNRAvST4lb89dofbN7RdCyS5rUPut2NYgaFaL/hKm0gp/GJJXTeH8tlQ1A/Zi7NoyuGiL6stWhRgSWSwIMd3IWqOBS+sHT56D0DukXv6C62ofU1cBumVFhIOYh94Ew9+j3xZGSTzKWZcGLxdSD1ErXcSpWqFpfvPbLxLLaZw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=fFF7KmALcMnMWIlgsrFcsNzFrxg2c0OLCH6+uDpVLco=; b=h58MOcNkpuldVeaGW19eCExNDb1Za2V+aQdyqhbX+ICEArQmb6eivNr2Q+9cE+0HFNZd9KoBZEezG3v9IhPJ/EONFKrd5l56ePnFHjVBXDvV3lIPOt08ufs1fBFSwnR+kAqAJrA+SIFyI1RDVmMQbGAasucijbBbcKUV9j+XSe0=
Received: from DU2PR07MB8077.eurprd07.prod.outlook.com (2603:10a6:10:2b6::6) by AM8PR07MB8044.eurprd07.prod.outlook.com (2603:10a6:20b:3db::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5813.18; Fri, 18 Nov 2022 15:03:01 +0000
Received: from DU2PR07MB8077.eurprd07.prod.outlook.com ([fe80::30cd:9a61:4e49:9ebf]) by DU2PR07MB8077.eurprd07.prod.outlook.com ([fe80::30cd:9a61:4e49:9ebf%9]) with mapi id 15.20.5813.018; Fri, 18 Nov 2022 15:03:01 +0000
From: Michael Eriksson <michael.eriksson@ericsson.com>
To: IETF QUIC WG <quic@ietf.org>
Subject: Multipath acknowledgments
Thread-Topic: Multipath acknowledgments
Thread-Index: AQHY+17Z/IvxUkGi+kCc2c2x24fozQ==
Date: Fri, 18 Nov 2022 15:03:00 +0000
Message-ID: <87bdc4f9-5f17-fb37-477d-8249b9ab5c1f@ericsson.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0) Gecko/20100101 Thunderbird/102.4.2
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=ericsson.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: DU2PR07MB8077:EE_|AM8PR07MB8044:EE_
x-ms-office365-filtering-correlation-id: 2ee787b9-7b6d-457b-b3c8-08dac975fc81
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: UgfB3C6L1dtM45d0Vlujcypro3tTQJ91lJf+1vQ2MSBZuY+NigV3Mzr6/gwdDhVVx17XTvPO4KcWH7QAJ+lx8jA3qr1cShnZtmCbYOk8KoW1gX27kfNN/1neUPv5sKwWhOWL0JpvpZhK/cS58VaWATevrOH9WzMXIcWH+fznTUHHbTc7a0zuwZIg1QPA2alaWfb8gk5N2THkvr6yqfqW5EY63/QrbV/Dt4GcTZvoICSG324F3x6+OAW8CIcuVkV5W2ITosC0o3PSs8mAkJSDpdXHtbSKkNZt7WrH+AJ/grrYH4qlaHZVbn0VoDVB3GQZYF1KGw732T7FdGaunPTJzd7qIlXeo6z+f1uh9xUYmynl/IhWTAE2F+p3Nczu5xis4P+/8+o2YMYY0N3XfckKzh5XQon1Rnb8jCVt0M6QCHEeTStaXUi+bm86bMJoi1DtnG3bT02jl9xElafrWJntcS+iP57YWVR8jhH5CxAB4UwXtTDwUAGL1ng4Nx7rMkb8lwgPUev5tHe/zsCQEAGHypXvREMwfLqGTNIdw7lfMrEbhXmhK+0DqhMizNCr8EgOMYDb332ob7VheYFMmZlUdsx4bItdjH4du2CCLP/Td7rfpWKNE2Pg8xx32aQ2ZXlghyXUjkC0lSiKy5FGNkmytIlNEmDR/emZyAtj02vqHuTXqzsO1OHJ83nPuV75wjghXui8umdxwpi1nbLEDsrcXaCHqIfC/WmQ/EC4OtAurRFzjgJeqBKVr5+BnuVsFywlsgOhUZBVvMUIqMNgjwR0qj6mgQc7wd5NUKzO/YDQeMA/iyF+bLg9ijJ2rQUs/2Gv+y6wyTIGqrOSDyUDs834Ug==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DU2PR07MB8077.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230022)(4636009)(346002)(136003)(39860400002)(366004)(396003)(376002)(451199015)(5660300002)(38070700005)(31686004)(2906002)(7116003)(38100700002)(41300700001)(82960400001)(66556008)(83380400001)(26005)(6506007)(6512007)(31696002)(66476007)(316002)(8936002)(91956017)(86362001)(36756003)(64756008)(2616005)(122000001)(66446008)(76116006)(6916009)(186003)(66946007)(44832011)(8676002)(3480700007)(6486002)(478600001)(71200400001)(69594002)(43740500002)(45980500001); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: D8ooFl/7y0QbtNNxmyB0rMGHC/qPhMoRlaBnTdt5I7oW3VCWMSQO/lUZAWs6uTohMquHSBaG6L2m+sy+Nk40lHlqWjJ/v3Om0JsB3dYj6CZA7gianEkoqgZLg6RtwAOg/3ULfFlbbKJf/IDeytwXw7YLuA3dU++fGIho+aR5y8ypPR6O6ZUj+qxdKNJ0K7/WvWqzdYwUC5PPjG4aEpEx1fR32fytjtpXH/eFwtd6VcR9tqRl929bvMx6KW7XCGS3f46hidLnKy70O286rnXVt9Wu4NSg8JrgDvTX78WwShFIFjtOAiJJBzImAevsykjsHRVVHANr+0WckKJ2L7tV3mrtAL6LWCTsSRkXI/Z5X+kwabLrYyQaXmEPjUcEGe1tLwP6J1ZXKTWPvGB8Pk581BkNuidEEPj9UZJJprKCThipuEtS/cgisls0DeOuHqP8pFpO5Df0OfaNc6kxXY+9qb0GpMHc65tz9jPfmjNQYYpxeZcOAtAav1GIC6TEvtFDFhmBPvhxIwCDs8Znp+rTCQ0w2p69TUKsj4Oc8CBtH5BjFYLKxcOAhwjN9sZgeRTquqcxswV6mtctUgsqmGVfb/m+C+dZyFwsKJtFSXXQzMUvGIsLubHg+cMss9jMZX6Pu3JOx31Oq2mIwJP0IkznVNDSdlk0Ppx9GoTl/eH3unYS/pVFoj1/jZpupay88PXKjn5qbOpf929Kok1DyR/cRvHtgznCgnDljPlx3gsYSoGIbwEQE1zNN2/b5WJGs72RbL+402CoquWnku/T9/2f40cJM9Jxx6+linqEiRA7U2D5PAYB0/9UFL20Ub0/CZMWkh4COUFxSpaQOiWBZsogWt9616DfVLLtWt1P8niskOXs5iE0ki/OgKjYxhHoyXjnqvzVOmEiZ5lhzl9k5bixmC6DpWg737wfhDzEqjZS9RL7v+cKQzf4y1Mrtm68X3h3pUpmis+Q4l3IwjzFuFpHo6x8D8Vk97GlutrD5KxlFC26IOvqKSXBZoiSUqwFYtEtks1H6dBlu+yqD6+c9bkDmR+PcSiac1AnWrPQ6qkZ8lCkN4Ocjn5blHZkigD7yWdd0hdoB8frTeV8nwnHFm73A7Ei5kzcR0gpss0nKOA+r0VnRCjZV/s1lJNZ6eGtZGfWTZbPpN05PzMhKdY4uo90cDUCMT26X3xHQjgTJKaaYqSGzG+L2j9dpBjHdUin9ZntR1WtfMMLbMkLWVtLk6ot23rZedcHoN3IwrSk1d8REHYSW4onS6WhNBIyuKJvzynC5Sgeej3yMy1cR6IIBmaDaFLyW47pFalFHE268JkwWC3/ZWvXAee3Gc7T7cEIVqs8tC98G2VSS6HOBm7gSVAeMZiBeerFnYcUxjw3gIeqsIWcjttc9RhEkHuq6/R2SO6RA7KJDN8D8VuEGGRsicig9qF8g+fJrdLakxRYZaaHpbYoQ3Ixh4gRclo/4WzuuEXB1GJcCx7mpWfqy9saSlJLEe4IgY+BL8CaXlvS0UjpKnpQk1pjIpkgyne4eG3sHxd+N1Hu2a/nLRDGFYbmVTFUkQR99Y0T+/zN3ippFKbA/1JsNqdsuxxfkKWYZ8ol3oaIKcve90aDPTu6N6G1VZ9NfZ/AjIEZJUY4FVYCa84Earg=
Content-Type: multipart/alternative; boundary="_000_87bdc4f95f17fb37477d8249b9ab5c1fericssoncom_"
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: DU2PR07MB8077.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 2ee787b9-7b6d-457b-b3c8-08dac975fc81
X-MS-Exchange-CrossTenant-originalarrivaltime: 18 Nov 2022 15:03:01.0593 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: +RO+aoUYO+d9LMdqlKwkG55Cf5KCs0DN1nslmTkfU8n2pmpY1PxHH6I5s2+xXm7wTy+mFX2GM0umLkshvAq8vL3ojrBaU7wN5PEkxA9MZ04=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM8PR07MB8044
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/mD3r-IXYB3BXXRL0HBAFa-66-2w>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 18 Nov 2022 15:03:10 -0000
Greetings fellow multipathers, TL;DR: Multipath QUIC should by default use the same in-path acknowledgment design as unipath QUIC. Cross-path acknowledgments are interesting but complex, not yet fully understood and should be an opt-in extension. The current multipath draft specifies that acknowledgment signaling should be done with a new frame type, ACK_MP, when the (potential) use of multiple paths has been agreed for a connection. This means that all implementations need to be able to handle incoming cross-path acknowledgments (XP ACKs), where acknowledgments of packets that have arrived on one path is sent on other paths. Sending XP ACKs is voluntary. XP ACKs have some attractive properties, in particular these two: * Some "self-clocking" congestion control algorithms, such as the popular CUBIC, can grow the congestion window faster if the ACK is sent on a path with lower latency * The stream data retransmission and receive buffers can be smaller if the flow control feedback is faster However, XP ACKs also have a few drawbacks, mainly because the experienced round-trip time varies depending on which path is used for each ACK. This implies that: * Latency-based congestion control algorithms can be confused * Loss detection is harder; both the packet loss time threshold and the probe timeout will have problems I argue that these problems are not well understood, and forcing all multipath implementations to handle them is not a good idea. However, there are interesting possible optimizations that should be researched, so there should be a mechanism to negotiate the use of XP ACKs. If this should be specified in the main multipath spec or another document is a separate but minor question. When the use of XP ACKs is not negotiated, each path should use the acknowledgment mechanism (including the use of the normal ACK frame) that is already implemented and proven to work with unipath QUIC. Summary Cross-path acknowledgments are so difficult to handle that implementations should not be forced to do that. The default should be to only do in-path acknowledgments exactly like unipath QUIC does. /me
- Multipath acknowledgments Michael Eriksson
- Re: Multipath acknowledgments Yunfei Ma
- Re: Multipath acknowledgments Michael Eriksson