[ippm] Re: Gen-ART Last Call review of draft-ietf-ippm-qoo-06

Ike Kunze <ike.kunze@cujo.com> Thu, 19 February 2026 11:33 UTC

Return-Path: <ike.kunze@cujo.com>
X-Original-To: ippm@mail2.ietf.org
Delivered-To: ippm@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 8C616B9CB823; Thu, 19 Feb 2026 03:33:39 -0800 (PST)
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=0.001, RCVD_IN_VALIDITY_CERTIFIED_BLOCKED=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (1024-bit key) header.d=cujo.com
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id P7Q7zh1uPZrS; Thu, 19 Feb 2026 03:33:38 -0800 (PST)
Received: from AS8PR04CU009.outbound.protection.outlook.com (mail-westeuropeazon11021114.outbound.protection.outlook.com [52.101.70.114]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-384) server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id 8E751B9CB817; Thu, 19 Feb 2026 03:33:38 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=KoKVUqwsVkfUoSX8OE6sKrRp3PRh4C5sl8tlGqjNJHMW5XStzyx0aaeHpffF4kSpzFNxKSCsyHYKfQDKfhAGG+qQyiwXA97+8CMg5FYhLPPbbZrBLUF/zYbZocSsb1lqJt6T8ZWqyI6QLqJnXeHMSWI7RAWbLiYt49nVt3dnfzTRuzBpB+gSt1fe3WxmPagOBtSF5VPNKTegzmtJw3qtaWn1C+NXjfhKtYVa39bpvmty8/UfcHutwwni9zjLTkHC0bEfefNZVe7STf1LyhB36B0Fhafn0NQwa2KfTTzDeJPKuSX+sVkkrdmQ6vsrWCkydzug5uahLpVMBMJMyR9ieg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=KKMCPvHrx8FzNDk/lOLxo30uYeGNS2ldDY6V2Lz2jx8=; b=eD34ltLNdG3qSoeCl8S+HrEDVX+p3M8+NRTyzmJWIWhgKasYf5t59FVPrnX6elVP/C4/HipxWn/Aszbg2ILdMGyZCqY8HJuC2OLln6gb1LP8lFaxBM5RN6vKosiVAWfljtP0sN6VuEBXrZXUsLKS/+W++kpNdijXF518fe0D7hCH5My6bCRR7R9trKj7SyZgn+6v63h029jvhIAeAR2h3PqpwA1bHPnej85h8q8vHsoP9VwUxi9VhLSMXisdKGTy6e3dzZN2jFO+X7oHTurYCSYPlTbNHdRAh0HwHWMAjQ653+ckzs48iku8yhUoIv/Lod8mpfLxXVOAsMmmbdQ0jg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cujo.com; dmarc=pass action=none header.from=cujo.com; dkim=pass header.d=cujo.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cujo.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=KKMCPvHrx8FzNDk/lOLxo30uYeGNS2ldDY6V2Lz2jx8=; b=HpPyeDjmV+CwsNkxVkbXYbvgkjv9sY2UfcT0JuZw2DwWtWLfa8Hl/R8kKwh3tANEJj4SmzKuAeeNrEoU6dT+TVNUYOfQpFTdthSPwd9swd5hf5lWs+50tGLvPk7VBzzCCjPEcjbaqLqii0lcB23/ldw+einXMHzq5ckhqY/ZFxE=
Received: from AM0PR02MB4035.eurprd02.prod.outlook.com (2603:10a6:208:d6::19) by AM7PR02MB5879.eurprd02.prod.outlook.com (2603:10a6:20b:10b::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9632.13; Thu, 19 Feb 2026 11:33:27 +0000
Received: from AM0PR02MB4035.eurprd02.prod.outlook.com ([fe80::b57a:ac67:5d35:fd46]) by AM0PR02MB4035.eurprd02.prod.outlook.com ([fe80::b57a:ac67:5d35:fd46%5]) with mapi id 15.20.9632.010; Thu, 19 Feb 2026 11:33:27 +0000
From: Ike Kunze <ike.kunze@cujo.com>
To: Paul Kyzivat <pkyzivat@alum.mit.edu>
Thread-Topic: Gen-ART Last Call review of draft-ietf-ippm-qoo-06
Thread-Index: AQHcmdoZu2QaDbigNU6j+1f0uHdkHrV7oQlNgAB0AICACuhOXw==
Date: Thu, 19 Feb 2026 11:33:27 +0000
Message-ID: <AM0PR02MB4035EAD21A11578205A65E74806DA@AM0PR02MB4035.eurprd02.prod.outlook.com>
References: <b08e1131-f12f-4fdc-b2ec-2834be59266b@alum.mit.edu> <AM0PR02MB403500BF7605433F68AD15338062A@AM0PR02MB4035.eurprd02.prod.outlook.com> <9268212e-d30f-4c65-a8ec-3183d2da9a7c@alum.mit.edu>
In-Reply-To: <9268212e-d30f-4c65-a8ec-3183d2da9a7c@alum.mit.edu>
Accept-Language: en-GB, en-US
Content-Language: en-GB
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
x-ms-reactions: allow
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=cujo.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: AM0PR02MB4035:EE_|AM7PR02MB5879:EE_
x-ms-office365-filtering-correlation-id: b465b246-cb0f-4a10-6df1-08de6faab322
x-ms-exchange-atpmessageproperties: SA
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;ARA:13230040|6049299003|376014|366016|10070799003|1800799024|8096899003|38070700021|4053099003;
x-microsoft-antispam-message-info: dJUKvujyJwwt5UA+9a9cmhmf+fXiC/Mg+MmjHZo1gk8Mpsdb+u8ATSnVNrmOSdTvDD5qr+8SipG3NU0nLODgGIOxDvAiFsjxAE/0iaGVfViB8nkGNqL9mpznoAveEkbT+rgyeZu4itD50nBYChbxtmrFMJgXZWUqQOyE+erSlasYc1N+UNeA4qRFK6uKvWeAaYaOSmatSMGnJrhPHhfjgBHuwdCe7zh3gfiRCb2qT18aU/iYGMErI9P/QZs+LGtHdeKNW+i/wLGDsUmgWg6BJlai9W7BWuX0LuMJtA84+YLCOTYHJ0v+bV8AQ2/cDujDZSdf4hGjZD46Ss3FEolPfzBNgNb4M0KSSqmWaNj1wjGXmT8CCzMQBjunx4UgeBXxQV9IV1OqjSl3u2Vk9xBe/WpdDpxjVjZnuS5qdl/uQsakhYXmiaoQ2yh+rrK23toUYaJX/LsAUvFjlCXLILd1ZKw/ZuCLcudLIkRv3tUPQ1GcVgMhWKM2dLVWf8QyQQd9HKS2UcZPMpKPZ9p0FJpnXy11U9/6h1Cl+eUu/xwrOvCIsZyQUNQqRLdgNzfgptBDSnTas04zC99QcXkHZDHIrxZ/G6C3SdtAAwVoR9oKhlxriWOM7fcVw4tkgN3NRksVggm3J9jG1/UAcfJd/v06UPgPcBayMXAHFLO444MeiEbGxgIgbX7/uhIQcR7G1jaP4bfJgaSo0B7xs9ubLbZE1lX92zaqTKru3wFrpkve12e/k/SVRg4RjE9odJDORjcOa8PB5Ya74HwtOuiHLSAX8qmNos1nv6KV+i66iKjBf9+5zBHaVjHtbWmG87A7ExoqVwJ7otbBw37zAfM+rQe2gsZCZ7Vd27JhGl7c8mcYr+QJ1I66ogKBcjb5xKTOqVCH+PgA7bLQpmGKpULk1bSUEwca5nTvoZmvpmAhPkt34gGzk3OcpphVnsLG6Dyxi+ujilboooyud3uj6sHvCdcixwDv3riIK9LpWcW8Lr5naRIfRniqPSpg73kJqY2i9mzGEf1Zx3Mo+/di5h5nPfyCrtABGqa1SCM+jOxAvuZoZ2Uponf3T76QPJX0ugtTXtGIud/32g8vwt9UzceOQHEcvShmQvJt7hSoMxeVyf4xpjNXRyL1HC0XKWUvV/iC4M8v/oWy+8MiqpNBfTim42PXNiMnXeDwMmYx6UcAsWLUgv1cH4aDBj0m9e4oKE2VgZ+kskUiUmKiEbfaqN0LoFFSsAdC4WZyHyTjWLzzMSEijTJvKyHxdSHCIO52dEKHwSZVU4aYMKYqyf7DiFlJID6CmTaTI1wqxxcftpDJfckD9ySdNdqoobFZLwB/UK4WQpDVVZoMdBKtyGKjJ+uIxc56ojMnfOomdTNyvIa1dC+LrQdOUMtd0zBOtDOray48HSitLgnJz5HCKfaKq3ut4n9J2HFemVLWu1LUhYXNz1NG91x9yYR4zaftnOdZHmIFlx3+NU4lAlY2+RRfJlXfc8jMlxA7Dy0xIGMDxtZLWq7A28qdguskLO3KuVH2jrcyjcQC98d3pYWNhKB813j8hoSqM1gOPrJr5SrwsmpQl7jPNLc=
x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AM0PR02MB4035.eurprd02.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(6049299003)(376014)(366016)(10070799003)(1800799024)(8096899003)(38070700021)(4053099003);DIR:OUT;SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: Y9kf+ChtEXbo9ZpWIv0ptcwEnxTu9p/CpAWjCwX8b1azLGipNGKVsFJJ+fOo+GJl4ZRu7LmcFK2rXpfuRgbAwlXJDTSKUvOdGZj3QK9sH3SdsenMY7gPZIRtdrDQqIkGP3eT0xCvEDajbcRZqdMoD14aO4yZoAT9oVv6G9JtUwuNRyFF3TZRBI30OXawe3E5SU86j3+nrBjcNyCxbwyzqybhwoELxERL4x1apsrYJHGp6WWyJq6LlT6j5M5enCaOHNAvbLTujvA3unn0G+MH0ktE3PSgHBttCxRR8jBKiFb1BokuASgZXPOo/M664vHaf2bcg47ePsycse9tvOHYC6LfPhfo2aX8mGoVOfIXgqUdGklfYgKAyXT5FpSe1GxQKtfNmQcV760jGVD1TtMMqtxjIc7+Fl9WtoCpImnRz9CXAKRcCHE9PWuAn3uA92d3lDhGs3NJAjfT7y9BsRJlOXzNYrVY1TCn5wcB9b+pu8K+D65yM+Hu1rL3k/dYpmSrvubktKCVbHCSbHiaLtPt5Orfqfa0dStRWiXTiLfxpoKLqDHVDcIhGbuJT/nuXiYB68elzM/rj6tcjTcdLW2OA4ZiUSRoquP7y5rAjGR+XxxhP07MA9MwjB8NatLY4jqKBbHCcKaEEoMQz7AP4dG55aERpp04AMG4D4R9PLnGS+z6zLpn0YagdHq0vw1R5YONiEjH9698p/cLDSDUZnPzrvhPEeUESK8gwQvEhCltum92Y9JrZryjPSOM4Qfn0DSQvbitUDpFasFuPlwm6uMk1id5NmHyCbUDn/GelcpAO3Q58tG2lqnx+nyF22OQ/mPsMATwXcIuRuj1TBExhse7gDu0weQIpGV1uGmgYZnt94oMdqd9mQVSEbT9lC5Y51+KCIls6qps2knifIYBju8XiV1C24EyBeY5c/pRhy+46KCAyhls+OakxwQB5VeIygsEk9IDuAboUovpZUClnuiW0h4QpS7BzhrSAxnAVsS9g8POqchKMOMCBP61ByBwW+4UkqScVPaIYRB9L0q/c3WRcXBJndfCAmCS5fCr2kRz3SzxWoCiTlzQVWe9X0p6cYuXojz2nXyz7wweeuZxuoocWg/WFrxdAhBu7fv0dVPKB513T2oYg4h06rbQ/H/AWYoKHMnDcqPWEgbM4oO4fYQflsIXGgISMyfsSYyOENcOzWMp+8Srwy5B0BOkavhmTFqDyL/r6+tUmbf5gXLS/1CTQ5DrWCBzmtaBX1lNtB+boDDWLeuWhzMHg800DbMQ8dA1JHyg8n2uhugFB1R3BgqkLirnYL9LaN26Yt5hrAWSsV1SI77tFy9vvjL7vSu32cpwwHlJ5D9CjltIpGVStG3Q1X+NtaP5GnHBLIbHXF7qk1zoVYKnl0pqAKv7Wd5ZQaFhve/cYBG5zKRIHmkJ2WDtIR5l+H08iSxblnPOaqRVG0+92cs9jj4qAyRyRQwGWcKM2I6x2IFKp59LRAlUW4PYdLdW/g3LJBDZYrgaN7//jugt/l2DvL9milVdR/sAu9liUrWbiC51PhF8yGJF1Hy3aAgrpzT7a56szKEcq9SRxPMoVhk4g5gfbT6/way2YxsLClHSlXWDPOUwz1T6ZD1td0kILUq9qrtgK4MUaJ+BjP0YZ1CvhxT3+L6NsAb6n3TuH/9vuo5TC6J27FSN7aFoPegZZfAldR7PcEOvBBxkFLyCN4SU/BFGpFhoSJ7jpMZTGAkIthAvo2bIGCOYyGSqvPp5xl4OFLdBA7wOSr19LnFrMGMJnZaPlKDdbduO9oH1
Content-Type: multipart/related; boundary="_004_AM0PR02MB4035EAD21A11578205A65E74806DAAM0PR02MB4035eurp_"; type="multipart/alternative"
MIME-Version: 1.0
X-OriginatorOrg: cujo.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AM0PR02MB4035.eurprd02.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: b465b246-cb0f-4a10-6df1-08de6faab322
X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Feb 2026 11:33:27.3670 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: a5d2f1ce-8ca6-49ce-893a-b4f922d7fc6b
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: lvXkaB2orgRwRXe+04sSzl8G1TGeB+8s31Oi+okRllVFA399Q1TjPH+91HxDGnqeibRUE5tRGOVC7YbghAHTtA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM7PR02MB5879
Message-ID-Hash: V42GLQHCFIRKRLBDSC3IAK6LWRTERFIW
X-Message-ID-Hash: V42GLQHCFIRKRLBDSC3IAK6LWRTERFIW
X-MailFrom: ike.kunze@cujo.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-ippm.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: General Area Review Team <gen-art@ietf.org>, "draft-ietf-ippm-qoo.all@ietf.org" <draft-ietf-ippm-qoo.all@ietf.org>, "last-call@ietf.org" <last-call@ietf.org>, "ippm@ietf.org" <ippm@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [ippm] Re: Gen-ART Last Call review of draft-ietf-ippm-qoo-06
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/95uWDw_BksNelRmASJTZNZ7iLYA>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Owner: <mailto:ippm-owner@ietf.org>
List-Post: <mailto:ippm@ietf.org>
List-Subscribe: <mailto:ippm-join@ietf.org>
List-Unsubscribe: <mailto:ippm-leave@ietf.org>

Hi Paul,

Thanks again for your review!

As proposed in my previous email, we have added a dedicated discussion on composability.
In that context, we have also picked up some of the use cases from Section 4 in that discussion to show what is possible even if there is no full sharing across networks/operators/etc.

While working on the section, I noticed that we might have been talking past each other in our previous exchange so I’d like to provide some additional context.

As I also mentioned in my earlier responses to Martin, QoO values (and latency percentiles) are not directly composable but only the underlying Quality Attenuation measurements, i.e., measurement distributions. Hence, the alignment of latency percentiles across operators I mentioned is mainly about enabling meaningful comparisons between QoO scores reported for different network segments and to support common application “profiles” and not about enabling true composability.

I believe part of this confusion stems from what is now Section 5.1, which introduces the simplification of reporting percentiles instead of distributions.
This simplification comes with the trade-off of losing composability which we now mention explicitly in the document.

Another possible reason for the confusion lies in what is now Section 5.2 where the document stated that requirement percentiles need to match those reported by the measurements (which could imply that measurement always only report percentiles, even though reporting percentiles is only a simplification as stated in Sec. 5.1).
To resolve this ambiguity, the document now clarifies that requirements can use arbitrary percentiles when latency distributions are reported and that percentiles need to match those reported by measurements when the simplified reporting scheme is used.
I hope these modifications help resolve the confusion.
Thank you very much for bringing this issue to our attention!

We have also updated the QoO calculation formulas based on Martin’s suggestions, using the pseudocode-style instead of the math environment approach.

Please let us know if you feel that there are still aspects of your review that need to be addressed.

Thanks again for the helpful comments!

Cheers,
Ike



Friendly Note: I send emails at times that work best for me. Please don’t feel any pressure to reply outside your usual working hours.


[Background pattern  Description automatically generated]

Ike Kunze

Senior Researcher

Phone +47 408 81 254

CUJO AI<https://cujo.com/> | News <https://cujo.com/blog/> | LinkedIn<https://www.linkedin.com/company/cujoai>


From: Paul Kyzivat <pkyzivat@alum.mit.edu>
Date: Tuesday, 10 February 2026 at 16:46
To: Ike Kunze <ike.kunze@cujo.com>, draft-ietf-ippm-qoo.all@ietf.org <draft-ietf-ippm-qoo.all@ietf.org>
Cc: General Area Review Team <gen-art@ietf.org>, last-call@ietf.org <last-call@ietf.org>, ippm@ietf.org <ippm@ietf.org>
Subject: Re: Gen-ART Last Call review of draft-ietf-ippm-qoo-06

CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.


Hi Ile,

On 2/10/26 7:55 AM, Ike Kunze wrote:
> Hi Paul,
>
> Thank you very much for taking the time to review the draft!
>
> You are right in that the measurements / reported percentiles of
> different network segments need to be the same to enable composability.
> Ensuring this alignment across different networks / operators might be
> challenging, especially considering that the draft does not impose
> standardized percentiles for the network performance requirements of
> applications.
> The draft does follow BITAG recommendations regarding
> measurement percentiles, though, and I think that once we have a better
> understanding which measurement percentiles have the most meaning for
> applications (with application “profiles" then also using those
> percentiles), alignment across operators could very well just follow
> naturally.
> Even if it does not follow, there is still a lot of value to be gained
> by just using the methodology on different network segments within the
> same network.
>
> I believe we already have some limited (implicit) text along this line
> in the document. If you see value in clarifying possible deployment /
> adoption challenges beyond what we currently have, we could add some
> additional, explicit discussion focusing on this aspect in the
> operational consideration section.
> What do you think?

It was the existing text that mentions the need for alignment of
percentiles, in a different context, that led me to ask the question.

I do believe it is important to add a discussion about the challenges to
successful deployment, including the challenges to composability. How
useful will this method be without composability over the end-to-end
path? And how will that alignment be achieved?

Toward that end, it would be helpful if you included some important
use-cases. For instance, a way for an end user to obtain statistics for
their own network attachment, for the ways they use the network.

> Regarding the presentation of the formulas, you have probably also seen
> in the thread with Martin that we plan to (at the very least) implement
> his suggestion that you also refer to in your comment. Additionally,
> Martin has kindly provided me additional pointers for alternative forms
> of formula rendering and we plan to also explore these options to come
> up with a version that is as clear and easy to understand as possible.
> I would very much appreciate your feedback on the final version once we
> have it.

Yes, I have been following that. And will be happy to review the changes
you ultimately make.

        Thanks,
        Paul


This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited.