[ippm] Re: AD Review of draft-ietf-ippm-qoo

Ike Kunze <ike.kunze@cujo.com> Thu, 29 January 2026 16:14 UTC

Return-Path: <ike.kunze@cujo.com>
X-Original-To: ippm@mail2.ietf.org
Delivered-To: ippm@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 066BBAEFDD77; Thu, 29 Jan 2026 08:14:35 -0800 (PST)
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=0.001, RCVD_IN_VALIDITY_CERTIFIED_BLOCKED=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (1024-bit key) header.d=cujo.com
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 4nZeteF2FMgM; Thu, 29 Jan 2026 08:14:34 -0800 (PST)
Received: from PA4PR04CU001.outbound.protection.outlook.com (mail-francecentralazon11023114.outbound.protection.outlook.com [40.107.162.114]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-384) server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id C6C81AEFDD66; Thu, 29 Jan 2026 08:14:33 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=c6m86cTtoMCqmUaB8F3oxkY9uEy3Ra7xOLis647Jv2wvtgAixKByrRzSsIVeQHMYY49JzwSd/YoKoPWTg0Fd1S7DmGg3RgA+PGaario04fXqCUi9rwzIlqTaXFB2YHwc1U7C1x8K3dxkmxI50RpYX6+LBfaD4S0Wl7Ll/udeOLPZU8uzuyeL2E/BaJxWUzSxANNkV9SAnKaufGnxH0hg/seMMfw6uKkXEMYKuh1As4SrFNR6F33/V1IgaxoxwzW4wyjvytXGgcCV5QEM8xVGe22gcfxVLgWjxNBI5dR5n0Oou1IcOWwwPIyR94gXBYrVScAkvPh7/N25yMOo+YIqzg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=eBR00WgeDsJPkX2Bt94/PVBCKVpc19p3crBknOLBWdM=; b=ii1zFHQWsxzF2OLEpF63XE4g9BBLO1uyNe5GCYjf/7ezc6P0TgMQEKOJp3eFpLSAJXP/KuDzmo2quHVtIy4YRvJvRJx6CKBZqp1D6fscRNBz4lfbW++fSxU4Hd9pq/nCari4ePELSmkzMs6h/80sAqiPIKHVMiCUQJT6/wtjQ/dpkaA5ZlS2zpckkic21DwV5vOXPA0TIibHxTDUeAh4C4u5IWWDwNbevMsbH8B1yKSKtRmgMHHxKAWxKD6B4OlPpazxyN8IksVXWnMLqvYu6dRA0QTEPjB3yyPMlVuC4CCl37B2GzYofUVUinJXyjX89G0lZeYWUrIdO/lAqLdVWw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cujo.com; dmarc=pass action=none header.from=cujo.com; dkim=pass header.d=cujo.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cujo.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=eBR00WgeDsJPkX2Bt94/PVBCKVpc19p3crBknOLBWdM=; b=boYwCKbKhYhPTlkFJIbx5UxKSKGOkPwBBFybLOBXmryTcJ0aRN7gNtn32FcQOUX98uw2zip3R/OOkB8HK8bI5SI1+m6T6GLIplGwe+nYno3+nxlJFX5azIKSW6z7BugW5wKLYFk/0TNjieCGAxByGVn+6zYl0ZQeaYewJTKciIE=
Received: from AS8PR02MB9790.eurprd02.prod.outlook.com (2603:10a6:20b:61d::8) by DU4PR02MB10977.eurprd02.prod.outlook.com (2603:10a6:10:580::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9564.7; Thu, 29 Jan 2026 16:14:23 +0000
Received: from AS8PR02MB9790.eurprd02.prod.outlook.com ([fe80::e98c:dd07:34a5:9a3]) by AS8PR02MB9790.eurprd02.prod.outlook.com ([fe80::e98c:dd07:34a5:9a3%6]) with mapi id 15.20.9542.015; Thu, 29 Jan 2026 16:14:23 +0000
From: Ike Kunze <ike.kunze@cujo.com>
To: "mohamed.boucadair@orange.com" <mohamed.boucadair@orange.com>
Thread-Topic: AD Review of draft-ietf-ippm-qoo
Thread-Index: AdxT2WdiBRqY42P6QF64DkLo+z8hVg61rc0d
Date: Thu, 29 Jan 2026 16:14:23 +0000
Message-ID: <AS8PR02MB97909A84C96F1D9086B9D1578093A@AS8PR02MB9790.eurprd02.prod.outlook.com>
References: <PR0P264MB28855616322A9175CDA536DA88CCA@PR0P264MB2885.FRAP264.PROD.OUTLOOK.COM>
In-Reply-To: <PR0P264MB28855616322A9175CDA536DA88CCA@PR0P264MB2885.FRAP264.PROD.OUTLOOK.COM>
Accept-Language: en-GB, en-US
Content-Language: en-GB
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
x-ms-reactions: allow
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=cujo.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: AS8PR02MB9790:EE_|DU4PR02MB10977:EE_
x-ms-office365-filtering-correlation-id: 4b9daaa5-c2d2-4e1e-83c5-08de5f517744
x-ms-exchange-atpmessageproperties: SA
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;ARA:13230040|376014|366016|1800799024|8096899003|13003099007|4013099003|4053099003|7053199007|38070700021;
x-microsoft-antispam-message-info: mUcs7pqwtCjOSY1FeyGpf40ecvYDQnDs5JVoo42tj9m8ApFJUBW9StZSbw9yZUj7+WO9t0IuI6KkQcip4JQmgoNv/vrPt1VjvUBwHSiU6KBLv8yoiJCYvsi7wSYnqUkaWZXhqGny4e2ioL4dgVoRA72V4UdMcJRGuJPd5MBFMJ6T43YVJVyxLuMDvsEnByDKhtehdnV2zye0PObNJ+FL7vQWZT1Z7zQCQyJbAzsbMMo1kezV2xcIJwJY+wq4dIvZPkRakXuXCvbu+Zy8BkP//9VinBQ83yAlZit5K/k0dLNf7c0khPr2Eql4im+2+jL9l/hrMjSpFHRB05D89QgPe7NmjOwat+KvYSSHdsvg1cQFtLUIv80V2eFojGFnag5dJnRvC/exjcXV2kprmsT66AYDGpkiVgQfbnVK3WB5blLYfV3sDq13CeqX7NvzDwjtA4bH/xWqbbz5YhTUuWuTDrGZSDXjha4sYc37hFvmAK5Ihuoa4BLoaB6Ugl26JiLVt7KZsqLZ1GCjrt8rd9LFahYWyGiorilCP4yyp56yZfZuLf4N6UpP480hsUrkehRwRypE+sW9R6UtxSdiv37Ljnp0rRek6BHQPO/tMR+hHcsvNSbmo6D+mkJ5OLswWtVgGqTDlP0uxUtAI9cW2X3Gpj0W0ieKGAOOsvC8UCxEkWIWbPeH8WUOus5Bh+g+1PrkhzbAEiAydnzTQJdZ/4qcP9R766NZ7JqxzUOPhAz+7OSwVgY1WzGHmqQP4qmC90SCvlozDDuAWioSz7W8AJIE35DsI0OBbtraymqVnZBWcfL61xThnwc14+WP4inJEp1oTPJA0dFevl/XjnBs6YDHe5m53/uRfmPLyt2P05PY9Ma8X/itkTuaDGVHTxTQ9tnT+pZ6IQx+axdNhdckrbQ6OaeglzuNbNLwUtWfG17Km3PFLlwtSO7LcAscOM3DMfUMzGFWkMLNQNrOxhqfc4rs2Y7fGL7Wr/YKAebfTW5WCfAf1avJIGNlqh/bLbuYwO2EgIGciVD8akEp8FUr+hf7fquGjYR0MSNARpRE5RsBAFSjQb3jiP1WYGW+h/4FEtJfTi6VKrW7OdIn50aW7xdpV8xURXUBP+Fp1EJCiJ9fZcu8gim8K0YFdX0To1NncWrkwp3E2v19Gw3epnNlvGVkkJqPNpsYZnGsNTd7joD4zgXpNgKupXPi7ZEV2yWmcNojHVJO2UcqMPV5QHkEeOWjneMqHoDfmAjw76fWAq1q8JKkGAOURztlHZmpUDsBx0dIrzFVqsIu6FhQuKTJwFWXVZ1pGiCRQ4ScUTAiLwMHNp2BZLi+rtqgvC9qXoKrMz93ezlAjegV5waMe8zguA/tY5vgtfyhYwiFG2zqr4ohGTLqGZm7etXGSWlIKnm9S6b3qGg9zMmLfmQvDj8E+e8LCGhCHvnAcKw8mtdMsowMfVI44OFQwTXvf/0RUhOOILVwLSIBA3/UvTOcQYFcBHDhQrUFegrrlqzL0wzk8MLO4guDLpDgyiqYVW/N1XYU0ZBvtDYXva9iWEZElsRShxKfWlRSkU3za/1DmrNkFSqQczUXI952WHYOCvcs+HFZIDFQ
x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AS8PR02MB9790.eurprd02.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(376014)(366016)(1800799024)(8096899003)(13003099007)(4013099003)(4053099003)(7053199007)(38070700021);DIR:OUT;SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: +pcBRZptEpELPL/yX7P0qJO0w0vegwMpEMJduZoiJLghOvF43n8qZzbGKUKPoSFsrT3L2rBmcafAmvz4Am6Dy+0hyytWlwLGr1OLocFsXWdr89qAMChuUj9w38msOFO/wJIjaR3Mb4ZRnIxKe0N2OQTWfiRL6jo5Qx8RIyebN/Sw3+UkBG2P7zmU7kFmwzJv+EIj+/noiEVBxmdPrEGvC4OoHRpxQZfX+y3l3rLrzrvWOjhQcCxITtV4cVvkWspaKCa9r4wOS01PEJPS6ckUv8dEOZTx88pRESq0XNZ6JykW+4MhXNyX6rb15nyNL3QH68R6cwagC/W0F8APsajDektMwDw0w4LbGWk93SKPgeS10tj4m64qMq65kg5yKVpTE0YY7HNCVDsM6GRnPHHVzk0vKcvwLRrkMlRSpXi84s5By18HnJALLb4UPUHgF3aDOia9wk/W51zGwO2Q9xTSBnQWKcz3wSwtr6yOPoHcY9q5d7hEtJw/7AkQaQVYH8kXS2ybNI5ikop79x31aiRu+UGqyH+alZAUcbpEmnUT+r5QeeYMCKhJwuds/mMAc9JOnSKoI2s4Azy52cN5PdR2rtmeLRwzEDfne6AWRJyZI7XjsBrgHB9xodPe29mDNBmxq9XH3Ae5W7PVnbyfC0pWIm6x948kDsUzX+yJ+h7LmgVAP7O9zM55sIoZpUqrFzkWPQCvE8zBmRhtkkDVIC48dOQCE4qBSjonAt8DBqXd0hwoE8GaJpxWuKeiSkjMcNnxqAr6ZzpSQDxhdd9+hvHu2Wu/7CjKCeZz4+Yj0BtPH0dncr8pkVMFpdZCPUJW/nFcRB4j1A1oRplzQGWNBXR11aFgAQsyLmNDXJ9YP7Dv9SndzqKu3VYq2qwXK5sNobAfhHXXAeRMdAhI2+oHXwM0SEm7Jay56+AFp955l8oUda5kLiXEnxnkPncRteXNVBFdx3+20RO82595p3O+gJInVJc5egCFvDjkHskf0HY3QlyjcYUl/n7xb7fCd944Fq/NPbNFTCwh1+4iZRBZyIF27QCqmHX/EyLj3Rfd6DQuM+56hbCaPBriEEPX9yOuW80ekuZd/iLU8Fy/yAFVsIP9tf2I0Z36eQv6y2Ed9ISud+UkO6e9iR+aH04zR6D5zEKKgGiNmGLqM45bpCATa/ECaBklQ1elFY6+knXVs80Dwdo5817IHl2b3OOfbPenZ7erG7ktp66yZhgTu8ISkRCRgeoMBz/Kz4gjPHRx1vKxKZZsiDPu+BGHk9C52CazD9SiqZoH5kNgwdaIGP3jeoWxpQtnhr1Czc8O/Cvie9D40OG1loKpjdUivsB60dlrMtHTCE7v1k6FTiYUF2sonJqQnK++6wC6eh9b4aRfS3VZF8Ct1Naddd4x7P0/+ok0AKA51aIMhKdVbnI69I0XBYFEfsSngFquJU8p53OJG8nhIhBK8CB53Qi8HBQAIXoicC4TGez9/1H32T/RRPoVpDmQvG36Kn1ID4+8hLwmQpyEhmu/NhUwEg5u/Y6XpY21BRcw+vTjATQC9PjNhW2S8w4d5rPRcvy4w4IjIXFZ1T4iRFAIcRZkwldqS+TixRc8oEmvV1xkZJzusvJwobqzOnFJ4frJydZa8GWzeEqdUb10v6Nz2eA69XN5hCQVmfocLPdL/OsgpfuF9wm6D57iccxH7rkupwy07qyVm3Fb8tDqtphDfGxQavn8FLnMYCfon8Nehh3OdSNFRmmXVvRQCNe5HQ==
Content-Type: multipart/related; boundary="_004_AS8PR02MB97909A84C96F1D9086B9D1578093AAS8PR02MB9790eurp_"; type="multipart/alternative"
MIME-Version: 1.0
X-OriginatorOrg: cujo.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AS8PR02MB9790.eurprd02.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 4b9daaa5-c2d2-4e1e-83c5-08de5f517744
X-MS-Exchange-CrossTenant-originalarrivaltime: 29 Jan 2026 16:14:23.0573 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: a5d2f1ce-8ca6-49ce-893a-b4f922d7fc6b
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: d5YRJ+RTxoYJdyT0iN6LmFQwic2wEN7ci/IDfX77pXdSGlkLDPFczSGsnIoJ2rF4zeEY7+loQ9tH/A5BHtAjZA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DU4PR02MB10977
Message-ID-Hash: WC7AL5LTSTSGBPAGRFD3FWE4N7TNYKO2
X-Message-ID-Hash: WC7AL5LTSTSGBPAGRFD3FWE4N7TNYKO2
X-MailFrom: ike.kunze@cujo.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-ippm.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: "draft-ietf-ippm-qoo@ietf.org" <draft-ietf-ippm-qoo@ietf.org>, IETF IPPM WG <ippm@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [ippm] Re: AD Review of draft-ietf-ippm-qoo
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/HXMJNB77St9GevVpG3r0rdu7HEY>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Owner: <mailto:ippm-owner@ietf.org>
List-Post: <mailto:ippm@ietf.org>
List-Subscribe: <mailto:ippm-join@ietf.org>
List-Unsubscribe: <mailto:ippm-leave@ietf.org>

Hi Med,

Thank you very much for your feedback and suggestions!
We have gone through the annotated pdf and have addressed all your comments.

I will briefly comment on how we have addressed your major comments below inline, indicated with [IK].

Please let us know if you see the need for any additional changes or if you would like a detailed description of how we have addressed your comments from the annotated pdf.

Thanks again.

Cheers,
Ike


Friendly Note: I send emails at times that work best for me. Please don’t feel any pressure to reply outside your usual working hours.


[Background pattern  Description automatically generated]

Ike Kunze

Senior Researcher

Phone +47 408 81 254

CUJO AI<https://cujo.com/> | News <https://cujo.com/blog/> | LinkedIn<https://www.linkedin.com/company/cujoai>


From: mohamed.boucadair@orange.com <mohamed.boucadair@orange.com>
Date: Wednesday, 12 November 2025 at 14:44
To: draft-ietf-ippm-qoo@ietf.org <draft-ietf-ippm-qoo@ietf.org>, IETF IPPM WG <ippm@ietf.org>
Subject: [ippm] AD Review of draft-ietf-ippm-qoo

Hi Bjørn, Magnus, and IPPM,

Many thanks for the effort put into this well-written document. Thanks for the insights and various practical advices in the document.

As a preparation to the IETF Last Call, I performed my AD review of the document. I have a set of comments, suggestions, and edits that you can find in the detailed review below. Most of the comments are easy to fix. Major comments are:


  *
Need to clarify early in the document that the framework is about network performance requirements, not **all** network requirements.

[IK] We now consistently use the term network performance requirements.


  *   Indicate early in the document that it is out of scope to cover the following
     *   How applications defines and share their network requirements.
     *   Which format is used to publish such information
     *
How operators retrieve such data

[IK] We have added a corresponding paragraph at the end of the Introduction.



  *
As communications are likely to span multiple administrative domains, I think that we need to clearly characterize what is meant by “network” in the doc. The current definition entry in Section 3 should be updated. As I’m there, that definition seems like it assume point to point communications, while other forms of communication can be supported by a network (multicast, etc.). Please fix that as well.

[IK] We have updated the network definition as follows:

The communication infrastructure that facilitates data transmission between endpoints, including all intermediate devices, links, and protocols that affect the transmission of data.  This encompasses both the physical infrastructure and the logical protocols that govern data transmission.  The network may support various communication patterns and may span multiple administrative domains.
Does this work for you?



  *
Also, connectivity issues may be encountered in the customer-facing network, in-between, or at the server/remote side. As such, the target perimeter of the framework should be made better early in the doc.

[IK] We added an additional paragraph in the introduction that makes it clear that the QoO framework can, in principle, used in all of these environments, depending on what measurements are performed.



  *
The use of “perfect” is a bit unfortunate IMO. Typically, a network may be designed to accommodate a variety of applications. The delivered connectivity service may be nominal for some applications, but not for all under some conditions. Not sure what “perfect” would mean in such cases. Some tweaking of the text may needed to convey the intent. BTW, “Optimal” or “Nominal” or “optimized Performance” would be more appropriate as I don’t think we can reason about “perfect” conditions, in general.

[IK] We switched to “optimal” throughout the document.



  *
The assumption in the document is that the measured perf will reflect the perf of actual connectivity service that will be provided to that application flows. However, there might be several connectivity service levels offered by a same network (e.g., VPN services, corporate customers, network slicing). There is a challenge about how to bind the measurement and the actual network configuration that will deliver related flows. I think these deployment assumptions should be called out.

[IK] You had several comments in this direction. To address them, we have added a corresponding subsection on deployment considerations. Does this work for you or would you rather have more explicit statements throughout the document?



  *
I tagged at least three references that need to be listed as normative. Please check and fix those.

[IK] Done.


  *
The QoO score definition does not cover the directionality. Should such aspect be reminded in Section 7?

[IK] Instead of defining the QoO score as a per-direction metric, we added the following paragraph after the the “Calculating QoO”-introduction and before the description of the calculation.

Note that the QoO score should reflect the directionality of the measurements
(one-way or round-trip) as specified in the network performance requirements. When comparing
measurements to requirements, both must use the same directionality and, for
one-way measurements, the same direction (uplink or downlink).
Does this work for you?


  *   Group Ops matters under an “Operational Considerations” Section per the guidance in draft-opsarea-rfc5706bis.

[IK] Added an “operational considerations” section and discussed several considerations. Please let us know if you see the need to cover additional aspects.


FWIW, the detailed review can be found at:


  *   pdf: https://github.com/boucadair/IETF-Drafts-Reviews/blob/master/2025/draft-ietf-ippm-qoo-04-rev%20Med.pdf
  *   doc: https://github.com/boucadair/IETF-Drafts-Reviews/blob/master/2025/draft-ietf-ippm-qoo-04-rev%20Med.doc

Please let me know if any clarification is needed.

Thank you.

Cheers,
Med

____________________________________________________________________________________________________________
Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.

This message and its attachments may contain confidential or privileged information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
Thank you.

This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited.