Re: [ippm] https://datatracker.ietf.org/doc/html/draft-ietf-ippm-responsiveness-03
Marcus Ihlar <marcus.ihlar@ericsson.com> Tue, 09 January 2024 17:15 UTC
Return-Path: <marcus.ihlar@ericsson.com>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B25FFC14CE39; Tue, 9 Jan 2024 09:15:46 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.109
X-Spam-Level:
X-Spam-Status: No, score=-2.109 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ohmg6O89FWB2; Tue, 9 Jan 2024 09:15:42 -0800 (PST)
Received: from EUR01-HE1-obe.outbound.protection.outlook.com (mail-he1eur01on2084.outbound.protection.outlook.com [40.107.13.84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4A40BC151991; Tue, 9 Jan 2024 09:14:41 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=PV7aDA/fzyzhdbgfngH2hb+DlsgNZi6xMFZD+wQeOISUgZvbi1uWsHvcq0y3mE1X+8tZpTFravUDrPT3TFP8atN40hgXxsVhX3YQUDbBH8MzsTN4OymaLVyFjUcgkGSNkBeILr/DmUY+2Ohef4df5SY0ApQvX5VA+JEwvl1fxz0ItIjeuQFiElDKz50DHq481qnNdZHYqYjerq+rPw5iTHXRgh80W+o1JvDdmWGM68g9/ZTOTm7q8eNJy4axT1urRTQfVQlAnUfT0kfnorQz4i+vjiu9B2w+kIzazGJ1jfrgES6qiZLjyFXNmSTVWd/bjjuWHz0luRZ3iXOf4VOz5A==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=bO8I7EGcHU6uk0GnltmV9tbSCOAlMbsyhNVj5ucGcO8=; b=AbEx7/GKYWon95rfhw+rR0q2MAZ2vYyRd0psZO8eBP0FTn6iPQJu0Ox9GQQYPK2RmlpprNCRhZg9O4VC7W5xopP8scp298lYz7AVb80k1s7680QT39OiSpshf0ACexigMkBSZX5o40oEOpSCrJVdcZN9iAmjHcr0gEsMnA0FEeFKqB7nMl9Ma7NpZD2OAj5Y6ZQpAZnn3tFqtFXVlFgd+G+Hv19LwsbD742GRfNok0w/SfafdsN7g23VRx1zPBtsxJHURcIyZV+8EtRHq96bxzLUXLHYI4wwo0up8O1+lqK9i0XR2Q570aBl+xKrVmVhePvJ0ijqxA1x67J2Tgff8g==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bO8I7EGcHU6uk0GnltmV9tbSCOAlMbsyhNVj5ucGcO8=; b=RFstfosMIwgYR8lFHqy20Kb9D9e5cLAYOeWsHWpb+C5iu9XqFiLATgxU4czV1LRlaF1KepKuh/PAse84+cmgDisNr8U2DMEe2iT8A/agXHYkyqyf7L08FDEWRi+Man8O9swf9UP7CdaO6T0kXWxVXdGCj1WDdsOPEJ5GJECCwj9eBnYCcf2FZIkFfmnYv9c+pQDcDNBPpzGoLFp+hylUbQt+O+tkuUCAaF9DjEVZ9UKv1NGkdC2N6wtRURrKBiEi11rZTPW8vPT9cCwyFBp0vQg0GF+XntWp65192bERxYoyGsGb31kk0cwkqh2J8ERD6FMv5MChYzZ5/AmP5/tOEA==
Received: from AM0PR07MB4131.eurprd07.prod.outlook.com (2603:10a6:208:4b::27) by DBAPR07MB6712.eurprd07.prod.outlook.com (2603:10a6:10:189::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7159.23; Tue, 9 Jan 2024 17:14:38 +0000
Received: from AM0PR07MB4131.eurprd07.prod.outlook.com ([fe80::d43d:5be6:2bf8:2bef]) by AM0PR07MB4131.eurprd07.prod.outlook.com ([fe80::d43d:5be6:2bf8:2bef%5]) with mapi id 15.20.7159.020; Tue, 9 Jan 2024 17:14:38 +0000
From: Marcus Ihlar <marcus.ihlar@ericsson.com>
To: Sebastian Moeller <moeller0=40gmx.de@dmarc.ietf.org>, "draft-ietf-ippm-responsiveness.authors@ietf.org" <draft-ietf-ippm-responsiveness.authors@ietf.org>, "IETF IPPM WG (ippm@ietf.org)" <ippm@ietf.org>
Thread-Topic: [ippm] https://datatracker.ietf.org/doc/html/draft-ietf-ippm-responsiveness-03
Thread-Index: AQHaLf/FfaVWMgMgGkGMbIZtZ04DwLDRz6mA
Date: Tue, 09 Jan 2024 17:14:38 +0000
Message-ID: <AM0PR07MB4131C89299334ADEBC2AA6E4E26A2@AM0PR07MB4131.eurprd07.prod.outlook.com>
References: <494C914A-D9CC-4822-85D5-63F6DE849E71@gmx.de>
In-Reply-To: <494C914A-D9CC-4822-85D5-63F6DE849E71@gmx.de>
Accept-Language: sv-SE, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=ericsson.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: AM0PR07MB4131:EE_|DBAPR07MB6712:EE_
x-ms-office365-filtering-correlation-id: 255edc42-c718-4cfc-2fa1-08dc11367624
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: eoyqwdw68lRm5QNm7KeUQu4C29uKRs9NLOs725FtcKWHMznqEB+hOnW5v/n3uHxVY3Ib2b/TpUqHXBG+8BSi+8tU/UyZZUhulnYjHXDk9AZ2zPC4Dxm6/ccHH2cVT0SEsER8zvKmHZHTAMjKhVREEmd25EAaqA1VipyLJJIr3jqv+DrsD03EBFGexQ2qNpFqYMrWpTORTyD3X2HMCshwOu5HGyfiTsCuL9kr3nct8g2mF7AYl+6MwxDzzkZFHzOx/5nvGKhnq8bDRdRcRDYFls1zlaEapVdsDY4LI8CdMgPcGB7kct8HxZkJ63YuSzxRDsZ56sUafNLXZFNeIBjH9oxrgHgIeNYnIw3YS58t6MgWE8V+eLywdLI7xMd9PppLr78y8hiZPfVaVmqTCZExLOEtbFel1BWePP+F2JneceE9xYCguihxupNWdyKhhW1DGwUNfFIu9xT7E8HMo4gqsqsphWjY5KPTzWdoPZ+qJIb4UkxoYrH5ami4qR251ryZrmVNrd57yOks3GxhbYYQht+lcUM1C2MXMMaUkYe5LJQzI+SQhLqyLTFQ7ZVyjacZ58SCikNLe/zC2jFDvx1V4dAtSKIhzdb+TSpRbYGAowAvQ+AqmgR9Ddu3Rr+raWKQctdctyNUNIWGzHXl2/ISwg==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM0PR07MB4131.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(376002)(366004)(346002)(136003)(39860400002)(396003)(230922051799003)(451199024)(1800799012)(186009)(64100799003)(26005)(83380400001)(9686003)(7696005)(122000001)(71200400001)(44832011)(5660300002)(52536014)(41300700001)(2906002)(53546011)(478600001)(66446008)(8676002)(110136005)(66476007)(316002)(64756008)(66556008)(8936002)(76116006)(66946007)(966005)(86362001)(33656002)(82960400001)(38100700002)(38070700009)(6506007)(55016003); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: MLnXlRT6SxqVyVQEarJMCKbixx5SDJtrcRm1CqtPF8Wym1ls3ZU61pNH7nm0/6ev0+SuS6qYxetB9+bWBZj3bbFP+uOvXJL2ruUHWDdTm6Vj+YCYgOrS3ajm8mgAIbUV3D1vM9cWbyL6fOKI23HD9FQzvvPWZmswB2Q9Zdta/8NL2Ahn4/ujZecsZJYubhN0MtcLapYLdD0v4kNKoSajVh829nawcwE/WsokvPGeT5KXrY30VIiJnLpahWDCHwbVWlta7Hb9DtBelaYUbt9fvGXQx3rpMTczCTFIWh8mNdR7S83dng/1k3BhWpXhg3O2I6v/FuwNeUQHOwJ46ULNd5o1PLnlJwgb4j5TI1gmKB+nOqOZsEqd4fzcfxVcJpxR+qSNzU0qxvfSGy3c5Od9rEIOte+78e40BIpIy7gMtAAqepSM/AwUXs4zsgTLP0sPQ6hbK51UzkdwqCFhq0gPqqY3imtQ9OyBTZfWu8lCjkS7rLrCBXSK+AaRduG+NUWLF3lIsBNudIZIwWBDOl+1V8eKYjOFvylFp2MIE4bjQvmjO4FGB0Q1y4C3A5f9/NrCG6RCiCsifhKEjzX4syWCiiEQ6B1Ekv8rqOFIzib6vmxLW56KwAIBn3mb8xs5LCwNs2QlggQ0O1dR8klIG2YWlpkjoayqzze8/7bYmQNghir98iP5ySDrFlQ/Mv/zGJM2H73Zs9uUsYVOeUzuOPJVeiTVHngSbmY0J+jkiYPn2GiIEMFRJwhYTpkGPcyxHEWqtV4M0k+yy3w7UDpjDTwdFbj2xYr++YXkug5+pTcOQB/uxP3XJ54vid367qCsB1TFm3afFudg3gv8VTFsPicXA5+g2rqKZV1AvbLtnsRxwsax3pm2X37csOIplhpdfLc1CZMou0xvSFtvaW3/p/ITScEfk4asF4+XqKZSz0VOkb1VfHOkB8GjN0k6zSL1vFk/FhOTYMfFpW8drKMzdl2el0Yks7iwXpE7RhGspmgVxI/htjBjtVNzYSKVjp9Bir5twewE3+CxwsH8pNAtTaAw7lYjzmyq9SZAeunNRmCNsmXWOyRNjlrvRYDBDwlfM3rSGE3V99yEkkXVvdf/JtQHfYE0J1t3qAfNrKQsFDLICxpLtDd7q1MdOJH4A1cg6OivolYc5NYzSj0jMX5rqO5prbAGoE/Fo74FilvHSjRpw9Uy3Q1hhChnKvDFFCQG76AvN3FoEGU15cQqyoKqY60EDwYCjqlw/c8eQcIBmxIAHUzMRufiFOETVoofY5twaa1BDFBTYD51NGUrOZlEmOqOHWcKZ1HyhRPLkFPSR1oXl14bliGJhvc2cUL03OC9MZvi0CSUYZ2mSVZythFMvfCsfMAcn4RyVLETLxnhJqhF8UsEM0ToCzkcM4f1rlgbCeXXBr08f3aUIhpGzSYqXO2nINURd9g/k530Q30Og5280PrG0Sh+vUlOOPbGCEKXjovLptR4vHyX9AsQnLghhpHsdjErFx2kNFIqqIIGZxNrd8Ub6uxjFUuL3LJRuSWAC3bCQFdPYvz2VNY8StjCBbhgkA7zGqp00ME5WdsMb0u3/0iNqTxm/txTI6AdUhaQdI0t
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AM0PR07MB4131.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 255edc42-c718-4cfc-2fa1-08dc11367624
X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Jan 2024 17:14:38.7193 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 0N75VoUtDlO18VNBIytOanW9M5fziqWWHOUJkQv0vruYsCqOF6L0oyUKmzcMGYMkhArdOKzfDFYsJmDqP5tdL3DeEbE64hrsFgOr2+K2b3M=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DBAPR07MB6712
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/SVgPGMghXiCLWCLPWchjauJrEk8>
Subject: Re: [ippm] https://datatracker.ietf.org/doc/html/draft-ietf-ippm-responsiveness-03
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Jan 2024 17:15:46 -0000
Hi Sebastian, Since this review was submitted during an ongoing working group last call, it would be good to understand you support progressing this document given that you get sufficient answers to your comments and suggestions. Authors, it would be great if you could address the comments of this review. BR Marcus -----Original Message----- From: ippm <ippm-bounces@ietf.org> On Behalf Of Sebastian Moeller Sent: Wednesday, 13 December 2023 21:05 To: IETF IPPM WG <ippm@ietf.org> Subject: [ippm] https://datatracker.ietf.org/doc/html/draft-ietf-ippm-responsiveness-03 Dear List, I revisited my assessment of the actual calculation, and think we can do better (with little effort): "The responsiveness is then calculated as the weighted mean: Responsiveness = 60000 / (1/6*(TM(tcp_f) + TM(tls_f) + TM(http_f)) + 1/2*TM(http_s)) This responsiveness value presents round-trips per minute (RPM)." And this makes sense for a single value result; though I believe that mixing up the self and the foreign probes into one aggregate is not the best we can do. At least for a standardized verbose output I think we should report self and foreign RPM values separately, exactly because they do measure subtly different things: foreign: inter-flow queueing self: intra-flow queueing these are not the same and hence aggregating them into a single number will not be the optimal to predict how well a link will behave under realistic loads. Especially, since the different types of queueing delay have different remedies (e.g. flow queuing will help foreign RPM, while AQMs will help self RPM, some more and some less). I also had a look at the recommendations regarding L4S testing: "As clients and servers become deployed that use L4S congestion control (e.g., TCP Prague with ECT(1) packet marking), for their normal traffic when it is available, and fall back to traditional loss-based congestion controls (e.g., Reno or CUBIC) otherwise, the same strategy SHOULD be used for Responsiveness Test traffic. This is RECOMMENDED so that the synthetic traffic generated by the Responsiveness Test mimics real-world traffic for that server." I think this at least needs to be selectable via command line switches (and the question arises whether working latency would not require a mix of L4S and non-L4S TCP flows with separate RPM reports for each type). Regards Sebastian _______________________________________________ ippm mailing list ippm@ietf.org https://www.ietf.org/mailman/listinfo/ippm
- [ippm] https://datatracker.ietf.org/doc/html/draf… Sebastian Moeller
- Re: [ippm] https://datatracker.ietf.org/doc/html/… Marcus Ihlar
- Re: [ippm] https://datatracker.ietf.org/doc/html/… Sebastian Moeller
- Re: [ippm] https://datatracker.ietf.org/doc/html/… Tommy Pauly
- Re: [ippm] https://datatracker.ietf.org/doc/html/… Sebastian Moeller
- Re: [ippm] https://datatracker.ietf.org/doc/html/… Christoph Paasch
- Re: [ippm] https://datatracker.ietf.org/doc/html/… Sebastian Moeller
- Re: [ippm] https://datatracker.ietf.org/doc/html/… Christoph Paasch