Re: [ippm] Opsdir last call review of draft-ietf-ippm-explicit-flow-measurements-03

Tim Chown <Tim.Chown@jisc.ac.uk> Wed, 10 May 2023 16:14 UTC

Return-Path: <Tim.Chown@jisc.ac.uk>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 96EC9C19E0FE; Wed, 10 May 2023 09:14:10 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level:
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=jisc.ac.uk
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id u2qfpqSMLQIV; Wed, 10 May 2023 09:14:06 -0700 (PDT)
Received: from EUR05-DB8-obe.outbound.protection.outlook.com (mail-db8eur05on2086.outbound.protection.outlook.com [40.107.20.86]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id DE201C17B35B; Wed, 10 May 2023 09:14:00 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=SYGrrxJMY54e0m6B6z8LU3S3i04x2/oQ0mstgTriJiSD45QCo5Txm4s4P/KO/1/MFkPOPlFVL222bcJvMB8i8XIsZymeFQAqeQjA6ACdYFMNR7cir8HGF2nImZVeOBm0hdgvPvMcS49urUAbaY3aqDJ589hJrKbaTeEXMoHa3IX1fwToq7ZhY4m3DPxWSeubsXm9HrW9pAvNU6PEJzo/OiJBhxEgr0tAwHd7+kWVaJx5gu+FUy9qdPONH8pt01+02O8G8VZcyLDLFhOJxw8VYp9OM2vePXeyMwQdr+OlYGQo/wlZVCXLguCjewRHIdZZpcGv6KTLhRxKw1JKVkPPMA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=fUTDY5++qlQWB/3vMyN/WBpMEIgM3adA0auQ/Hkk+W0=; b=jDNDIQhiMHYsMJQlC1kUyyNaB6biFkGvzvhYcr7/3veMElfmx3PWjljds7QQrCxMllUonQcknhEQcDapNPuVtReSmCqFoQ2v5NGnXZQ827+h6IfvAL5haGJ4YQQAd7nBCii40wSkEMteRGYe/x/ngWZNwNgPezYacxCI0TXofFqL7irVCDOTRTa5UYPh13xtPxyZEqlG3Zaye0pgh5OLw8kxWFi1+FJ8H0Rd9kdm3FrFa6UikLYDnYLP9lXewtMAUib596DrUoMmmOO6z4xCiCuHKKW9Gm70IY+E5bovQZnbBqHQxyJ4BmZh2L/FFI8Zm2spwfGYIFXn3OZhyUH/Xw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=jisc.ac.uk; dmarc=pass action=none header.from=jisc.ac.uk; dkim=pass header.d=jisc.ac.uk; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jisc.ac.uk; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=fUTDY5++qlQWB/3vMyN/WBpMEIgM3adA0auQ/Hkk+W0=; b=KmIUSzwJTu9xI1EPwRVCGjitpxcUzqg7w6iqhiAX2uE0EBtBKr5uIp8Lh3ByB545Qllivr+204gZ2cE5jhndrDbtcBBhD73vjsQe3VTou+wz0LFRxu+bJDpm3BaLErZXitoPkgtSLbRMvLSE1/r6XPc+GAm8fUb45W1+8x3lvTY=
Received: from DB9PR07MB7771.eurprd07.prod.outlook.com (2603:10a6:10:2a6::15) by VI1PR07MB6589.eurprd07.prod.outlook.com (2603:10a6:800:18b::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6387.19; Wed, 10 May 2023 16:13:54 +0000
Received: from DB9PR07MB7771.eurprd07.prod.outlook.com ([fe80::54e4:7627:948e:2884]) by DB9PR07MB7771.eurprd07.prod.outlook.com ([fe80::54e4:7627:948e:2884%5]) with mapi id 15.20.6363.033; Wed, 10 May 2023 16:13:54 +0000
From: Tim Chown <Tim.Chown@jisc.ac.uk>
To: Giuseppe Fioccola <giuseppe.fioccola@huawei.com>
CC: "ops-dir@ietf.org" <ops-dir@ietf.org>, "draft-ietf-ippm-explicit-flow-measurements.all@ietf.org" <draft-ietf-ippm-explicit-flow-measurements.all@ietf.org>, "ippm@ietf.org" <ippm@ietf.org>, "last-call@ietf.org" <last-call@ietf.org>
Thread-Topic: Opsdir last call review of draft-ietf-ippm-explicit-flow-measurements-03
Thread-Index: AQHZfm/EKv75mWCn30K1qAzI+tAVTa9Tt+kA
Date: Wed, 10 May 2023 16:13:54 +0000
Message-ID: <7D835E1F-D6D4-4E43-94C7-3596549F8D88@jisc.ac.uk>
References: <168312350072.2328.16576009877170975039@ietfa.amsl.com> <034cb54f47bc4adca3e9bb53001294ef@huawei.com>
In-Reply-To: <034cb54f47bc4adca3e9bb53001294ef@huawei.com>
Accept-Language: en-GB, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-mailer: Apple Mail (2.3731.300.101.1.3)
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=jisc.ac.uk;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: DB9PR07MB7771:EE_|VI1PR07MB6589:EE_
x-ms-office365-filtering-correlation-id: 71c83767-18df-4cf5-b3d9-08db51718d54
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: oJxVd0C24ubse15yl9QOzWa2v57Rq1mdy8+cyWtTQES8SI+kGCAT6Nv2RBzGwmXBcBEAd9QgCuawXXoA571Te3bRwrjQsP3MAqFF+WCSFHY9zW/HapUm2YXmYLvnk9sudrt/DGV31WoJZs595kBZBY6/88JEflH1BGdimxSfMZTxjlIUvmD9M3TJ2+XqoYKd8xEno98Gwzq94Owfr2q7ta20ApbsQeqU+EuIoI1HCT6tkEEEl2kT0vrRQSoIrpH/CAcXmgw9bF4cSOktRv8nrtoFf0ys/OkFC5y7MVCc7qKRiiOmsJx2Ic9nBzqK1rESPPzbbbJYiZNryhsF0qWrkNqse5bAOJiy0dNIruagdi0AuFqJ/euzcwYTSCSnP2gJFxag58UHVrlvnWefmT3weH6Rw8Hr4IVRPxpLHJqkfxxjqjYdYaf2HjL/Jc06Ggnw0RVqBPOo9ugMdehD7Qa2uLs/YThBccjht10QjloRAovj67N/qZaIxq885B0oWkypZE7aWu3a3Gymcq/IVVxWsnHyVm9jDzN1UpQ5URRaZU3McId8126i5yoUq0G9GLsRoK/aEzx1VBN1Cz8xTb9hyoG8RgR+jsgrCrXF1kXv8AIJnrQaMMmCQduDUYn5ydwM+eBXFfHPEoLbXJl5kg5AGw==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DB9PR07MB7771.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230028)(4636009)(39850400004)(346002)(396003)(376002)(366004)(136003)(451199021)(53546011)(83380400001)(2906002)(2616005)(91956017)(186003)(786003)(6512007)(41300700001)(6916009)(71200400001)(64756008)(66446008)(54906003)(316002)(4326008)(66556008)(76116006)(66946007)(66476007)(6486002)(5660300002)(6506007)(8936002)(8676002)(478600001)(38070700005)(38100700002)(122000001)(86362001)(41320700001)(36756003)(33656002)(45980500001); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: ecELEPqnn3mjmkZsEXSj9ll1J+iD6NKRb+NNVva/LTBdtJ5F2+0R1ImpQ9EJsv0LpAGakjMQd8AkwYNf+9eRYwSTOuwUcTTdj5id1qgp/Q/qwnZzLRWZCsL3fbmaCFniHZWotmhFb04xtypLEJXQVVLMQMUeVo5huSAYTNlPVg/B+mWD0oKmLViBn+dwbatOOeY5QLhJ3SVzZCD2ATW1kHOnTAGW3PQkp2THj65K5LqOk5Joxx7iev15ayRQheF1adQFATazxof1ZPuWR8MKsSgx5kLMaCrtJkQCVQgYkfHjFng/beyTBaH8XKOpt7Rh2tyQe4v9cbfULRfmm4+mTV8F9ZDs4KqgBRCi0In+PJMXee9w/QH2DutcuTKL6J9oGxdCESEZwhWIGCFtqaN/6g8Dl8M2gT6u5x1+f0Vod3apC1dTk0vmkmx2zX4lwYrJQsRODCKFZfRfMFBdtUdm0B17orJvdXch9Ohv4gZ8Q0QKMsoJ2Wx0AfK8iEpVJdFLLRdixyhXANrwj4bLJPWI2CcK0cIu+svpvQlzM4qBN8KvEd3MJdJZPtMBNQ56VZwv5pRlYMJAS20WJ35BWEFhAIJm0qtNV8WNveeb1sPJOmOt3PrUn6vWoQyRN+NscKBwFBRj9CpWdH4pFSQCczHqBp86u9Wxu28OoksnFLwvavDRe9C7NmP0aflRIGaPRhb7zxzDU2DYr1TytedDJG8Eagd6EAkeFt7FMQLWqfbPXS978+wHmGNJsRkX8qB083/boma1iPDF9EQgooWeQfcqegJhLKLRfU3cPDzLiBDCotFOy/NBRES+bfqonUN4IBcvADQZy6FExV6E5+n4Xj+fxlbzuuxjiLNrGqhlLMDq6SEdEVXbGa4mrQYdX/pn2hGm7XmR7gPiAGMRguJgDgdbNIZexdHH1Wrpnw00giZrjD1cqlc7smTgZqAi1yBD7+ryEmGPpQb2RCGi1HFh09UJDN6OuXU/mWsQbgt4+hrYq8n/hr2e/IgIZ7Ji1ALAdUbZRrMdiEJ8mdHtw03Mc3TsUxlKO/zfupRgMVP7dCvT3XrSMtatYIMFD0C/0XtLCGyApRRIc2cnq01VgF8HgyZ/Rc5CkdL3BMM2CXw67IHF3jY8fVfLRrazcs6FgIE+xq52LxjvTEfCCrjLqyljGvnIGyo/dZtSDdm9ZsqTzr0uiG1LvfhrnYv69G4tadxFBMlUQNHKQuKHq00dutrjY72ltsb+jACMwPEjkorrbEEwpJL84fIL25JPKcjMCLRKJMhxvStndY3eT0SJsNWadpBDDb/SjgU8wZat96qQZ/oBfRu8DinKd/beWuWNSr6Rtn9913cp5WIzS/X0e162aqlGIGkVch94bRo+gjK024Qo/AsLxomnissd5nRv6hHgEjrcIDNFFr+re/DEuoiPr7GsPE6Z+8fqNNL7hj2Xdi6dWUeVWAsF2QpvFbzQgA40qF0iJbCapCLD66CVurb2iRbOcpUVsJ5HBTfkZFpBnQ1N4sPnl3UV84np39FbC3SqV6OQnrbr6IRwBLzeaHDWOuQj9Biv1vEuLv41XEUbpk3yxBx54LeIj3Aukb1pyiv1BzarkhKIT+WJD3qptQ7pLGLcNxs03DpQbzJacPn3ktOiR+FLGwp11GLd2zka3pjZTCdRSC9dLOSKTNc9PwfEPrR8Sw==
Content-Type: text/plain; charset="utf-8"
Content-ID: <C82D626B11B4984CA67910EE4686E6F5@eurprd07.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: jisc.ac.uk
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: DB9PR07MB7771.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 71c83767-18df-4cf5-b3d9-08db51718d54
X-MS-Exchange-CrossTenant-originalarrivaltime: 10 May 2023 16:13:54.7149 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 48f9394d-8a14-4d27-82a6-f35f12361205
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: Q6597UgoGT8DTbtRvhfKUxzuPDw1mJZegigrWq0z3Fd4vUEO+5ZP8V+XbLH6fkq8oiNo3nRllw7T6ZFzwYwaLA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR07MB6589
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/TVRKcMFEUy7k6K8PK-eoLHLgBak>
Subject: Re: [ippm] Opsdir last call review of draft-ietf-ippm-explicit-flow-measurements-03
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 10 May 2023 16:14:10 -0000

Hi,

> On 4 May 2023, at 11:04, Giuseppe Fioccola <giuseppe.fioccola@huawei.com> wrote:
> 
> Hi Tim,
> Thank you for your feedback,
> Please find my replies inline tagged as [GF].

Thanks, your comments and responses look fine.  The ECN comment doesn’t require action.

One comment on reflection, perhaps emphasise that the draft provides a “toolbox” to capabilities, not all of which need to be implemented at once.  Perhaps this can be captured if you show a couple of example scenarios as suggested.

Best wishes,
Tim

> Regards,
> 
> Giuseppe
> 
> -----Original Message-----
> From: Tim Chown via Datatracker <noreply@ietf.org> 
> Sent: Wednesday, May 3, 2023 4:18 PM
> To: ops-dir@ietf.org
> Cc: draft-ietf-ippm-explicit-flow-measurements.all@ietf.org; ippm@ietf.org; last-call@ietf.org
> Subject: Opsdir last call review of draft-ietf-ippm-explicit-flow-measurements-03
> 
> Reviewer: Tim Chown
> Review result: Ready
> 
> Hi,
> 
> I have reviewed this document as part of the Operational directorate's ongoing effort to review all IETF documents being processed by the IESG.  These comments were written with the intent of improving the operational aspects of the IETF drafts. Comments that are not addressed in last call may be included in AD reviews during the IESG review.  Document editors and WG chairs should treat these comments just like any other last call comments.
> 
> The document has very minor nits, and is pretty much Ready.
> 
> [GF]: Thank you for the good opinion.
> 
> This draft proposes the use of specific bits for the purposes of marking traffic to support passively estimating round trip time (delay) and loss between two endpoints supporting the mechanisms described in the document.  The approach is designed with encrypted transport protocols in mind.
> 
> The document is well-structured.  Some of the more detailed descriptions of the use of the bits, particularly the later sections on the R and Q bits were a little hard to follow, but overall the quality is good. Some of the use of language hints at author(s) for whom English is not their first language, some minor improvement would be desirable before submission towards publication, to save effort for the RFC Editor.
> 
> Overall the proposed use of the bits seems reasonable, and potentially useful.
> It is not clear what implementations are available or tested as yet, there is only one mention of a part implementation by Christian Huitema. The draft talks of what a QUIC implementation would need to do, implying there is as yet not one available. However, given the document’s Informational status this is less of a concern.
> 
> The summary of approaches at the end is very useful.
> 
> Some use case discussion might be useful, especially for an informational document. Maybe include a couple of extremes, one a intra-DC, one for large scale data transfers over 100G+ paths from Europe to the US; these might require quite different “tuning” of the techniques and bits (considering train sizes, counters, etc)?
> 
> [GF]: This is a useful suggestion. Agree, we could mention some possible application scenarios.
> 
> General comments:
> 
> “Explicit Host-to-Network Flow Measurement Techniques” is perhaps not the best name, or most indicative of the approach. Is it explicit? Is it host to network or client to server?
> 
> [GF]: They are referred to as Explicit since these techniques are especially valuable when applied to protocols that encrypt transport headers as they enable measurements by passive on-path network devices. Also, we called them Host-to-Network since Client and Server are collaborative and expose performance information to the network probes.
> 
> Perhaps emphasise more in the abstract and introduction (and even the title) that the approach is passive.  And maybe that the methods don’t necessarily, or even generally, cover all packets in a flow.
> 
> [GF]: Ok, we will highlight that the approach is passive.
> 
> The AltMark drafts are now published - RFC 9341, 9342, 9343.
> 
> [GF]: Sure, we will update all the references.
> 
> Specific comments:
> 
> The draft suggests which bits could be used for TCP and QUIC implementations, in particular using reserved bits at the end of Section 1, but is not a Standards Track document, so cannot specifically reserve bits.
> 
> [GF]: We can rephrase this part in order to emphasize that it is for experimentation. In this regard, I think we can also omit all the figures of section 6.
> 
> Section 2.2 - maybe some scenarios would prefer application measurement; maybe the draft should state the approach is designed for network delays, not full end-to-end delays.
> 
> [GF]: Agree, we may add this point.
> 
> In 2.2.3 I suppose the 100ms needs to be a value big enough that it is worse than the likely worst case. This would be different for the scenarios I mentioned above.
> 
> [GF]: Yes, we can mention that its value can change depending on the scenarios.
> 
> In 2.2.4.1 “endpoints” aren’t defined.  Are they nodes, or unique port/IP tuples? Given the title says “flow”, presumably the latter.
> 
> [GF]: Sure, we can add the definition of endpoints as you noted.
> 
> In 2.2.5 is it worth mentioning cases where an observer might not see both flows?  Use of ECMP, or other asymmetric routing in particular.  The client should still see everything g, but an observer’s mileage may vary.
> 
> [GF]: In this case the observer can measure only a subset of the performance information.
> 
> In 3.1.1 and the end of 3.1.2 these trains could be quite large, thinking of how many packets are in flight on a 30Gbps data transfer flow over a 100ms path.  The example at the end of 3.1.3 is of 5 packets.
> 
> [GF]: Yes, we can highlight that it is just an example.
> 
> WRT 3.5, I started musing over ECN as another “measurement” bit somewhere in Section 2, nice to see it discussed here.
> 
> [GF]: Ok we will add it.
> 
> Tim
> 
> 
>