Re: [ippm] Broadband Forums QED and its relevance to draft-olden-ippm-qoo

"Kevin Smith, Vodafone" <Kevin.Smith@vodafone.com> Mon, 27 March 2023 08:26 UTC

Return-Path: <Kevin.Smith@vodafone.com>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id AA58EC159495 for <ippm@ietfa.amsl.com>; Mon, 27 Mar 2023 01:26:22 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.094
X-Spam-Level:
X-Spam-Status: No, score=-2.094 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=vodafone.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id q-k6BFQVbeQO for <ippm@ietfa.amsl.com>; Mon, 27 Mar 2023 01:26:17 -0700 (PDT)
Received: from EUR03-AM7-obe.outbound.protection.outlook.com (mail-am7eur03lp20200.outbound.protection.outlook.com [IPv6:2a01:111:f400:7eaf::200]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 9776EC1526F4 for <ippm@ietf.org>; Mon, 27 Mar 2023 01:25:20 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=ityAGqiu2qAk0hYRSKOxUQTS9E7WaK2tKJ6iYchdNMkzxEba1/kk9feRgkMkhjji0cUq83xvf6JGv607YkYUuL89zUA2tGXBH0EK2/P9MhXMNkpLxw8XIPm4PSkEedVgkZNTT9Fy5iu4S9YhMdMGY/sNvR/+4nsSwbjPKeOokGq8meed8J0bebIF/AZvzq0ob5/XKsIVNImkvCrcSvzcZIhBkRAH7xiWBia14cr9jh/+9GrlTNQsFGKVLe1GApHlxyKpqSCXHNJ96TCHHLLnGRwigsz3G9ifLGNwkiWUNRbmx9IjOZGhfXiSe1tLllpNTSlgA/XDhKT/BWZzS6UHYg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=pY2CXUVcPhs4fQlKoP2QG1GTkW1oLSLYksza/tXxFHQ=; b=boUfqAJQ5AKQ6OIp8Yt5Dhv+j0FupQgbOZyxrgWvkLIhgx+YP5tUyhQAncEd1PmCcan0I2H7ekrSu1DTSsmpswpX+NHG2QKeGLy8HPGdJPgXcrQX92dLEi3k/mH3MTy2uU+EvhFrdqgnU3wcxCAj78vVrSOROK7CvKxZuZnxBdHSzOj6dzqnpN37S/8DqVszGB7MwD/d4jIEl18gvsBnYRaNfZC/NhA4ZP+Jz+qvU8xrxQCg+NQICqUVCyOBGY6O9FcDcVVW9GjScufb2YP+9+dvg3OC20QRJ+0TKpXb20RNmP6babUSiZmxoJ7vZQf72x+saBtRab88B+r7gkDnSQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=vodafone.com; dmarc=pass action=none header.from=vodafone.com; dkim=pass header.d=vodafone.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=vodafone.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=pY2CXUVcPhs4fQlKoP2QG1GTkW1oLSLYksza/tXxFHQ=; b=Jo+HCfAiDuLVlPoFtH7WgSykJAPJGRwB893jUf8//Y7yVpRp7wqZstruJFPaBh+DH62IJkS98TH09qqdeB58618bDCl99pxTvrZAE2qicNC9QzNPrEemdFLNqO8tERICHryURUlbRcnBiJbKzWHm64mIQrAKXlDx4TnrSch5XNYj+hu+bX/iN3tdZenlIb6SUwWK3/7xUE9N4cKicEQr01rz1MsricgEHfEzy8mGkx/MYWef2RQPX7monSJwPgAdTzuMbTRM0Yi8DZDQctDDkXAuDUDF09kqYCZ+gHskVeCUrnQMYTP+xzWkHoK7bgWAzbybHwV862jGabJZbENypg==
Received: from AM5PR0501MB2418.eurprd05.prod.outlook.com (2603:10a6:203:9::17) by AS4PR05MB8991.eurprd05.prod.outlook.com (2603:10a6:20b:4e6::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6178.41; Mon, 27 Mar 2023 08:25:13 +0000
Received: from AM5PR0501MB2418.eurprd05.prod.outlook.com ([fe80::ae80:5678:6efd:a407]) by AM5PR0501MB2418.eurprd05.prod.outlook.com ([fe80::ae80:5678:6efd:a407%12]) with mapi id 15.20.6222.028; Mon, 27 Mar 2023 08:25:13 +0000
From: "Kevin Smith, Vodafone" <Kevin.Smith@vodafone.com>
To: "ippm@ietf.org" <ippm@ietf.org>
Thread-Topic: Re: [ippm] Broadband Forums QED and its relevance to draft-olden-ippm-qoo
Thread-Index: AdlghCDOdKgfgWMIRwaKEjnjp4/LHA==
Date: Mon, 27 Mar 2023 08:25:13 +0000
Message-ID: <AM5PR0501MB24189555F9C8C59F1BADB940918B9@AM5PR0501MB2418.eurprd05.prod.outlook.com>
Accept-Language: en-GB, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels: MSIP_Label_0359f705-2ba0-454b-9cfc-6ce5bcaac040_Enabled=true; MSIP_Label_0359f705-2ba0-454b-9cfc-6ce5bcaac040_SetDate=2023-03-27T08:25:12Z; MSIP_Label_0359f705-2ba0-454b-9cfc-6ce5bcaac040_Method=Standard; MSIP_Label_0359f705-2ba0-454b-9cfc-6ce5bcaac040_Name=0359f705-2ba0-454b-9cfc-6ce5bcaac040; MSIP_Label_0359f705-2ba0-454b-9cfc-6ce5bcaac040_SiteId=68283f3b-8487-4c86-adb3-a5228f18b893; MSIP_Label_0359f705-2ba0-454b-9cfc-6ce5bcaac040_ActionId=d9a26681-7b79-44c2-99d3-7ddc029728a3; MSIP_Label_0359f705-2ba0-454b-9cfc-6ce5bcaac040_ContentBits=2
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=vodafone.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: AM5PR0501MB2418:EE_|AS4PR05MB8991:EE_
x-ms-office365-filtering-correlation-id: e4e8f403-bb11-4827-b7d2-08db2e9cc97b
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: +lDih8YpyFM7sjuN7q5Fv9ND1SxtTcZIyIgbY9b2XwID9yifF8d+CLDUNh3Gb180ov/yLmD5mFMRUNFtCBY8xIx4agZSP8qT5czpNbpfI/kCcc2TobOSX/6oW6bUVQv/mYiZ+V6kM9uxSycsBL5dmtFRlJyRnIJ5H+CFobyYFrZ+43sXoVgOchc5wxaxS2glPh0KODoVnffnKydaqjsnMaR2t1NU9/PYwCZYut50jjahFp2ZIGqxkY7p+k3SD5IfHwusO+VIcxDj4NZD5FaFZ3DjCYn+ZsM0MV0T3b/AH4PsQgi/O47psVitWeAGhQb1QcaMGa47hvkUDGa/jmHqFP6zxp17nH5pB13rC8oAX9EdIbbMingiyRoB/ysx2XVBAnSUX/3R48OcsWUn0B9C401rxocFYRG+tmkpIz8PS46AVa3fuVFeRNxC/hBb+4IBbsmXLoLhgau6/Pq34DNQfk1zM4jALFt2/2iQ5DpKkQQpNMHXZkiHpzYWOA1JudE/Z6GAxv0IIF4eXxMlPF6Tvw+vgaQT9OEIpNrD/eVcWmu1pRXu/B8+IaujkWEc2mGniXpmETShH4Ai9ZRef71AMqjneeqqjCj3Iev+Gh7T6J4WMKw8tucTOqz+WzPj18oj
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM5PR0501MB2418.eurprd05.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230028)(4636009)(396003)(136003)(366004)(376002)(39860400002)(346002)(451199021)(38070700005)(55016003)(83380400001)(6916009)(8676002)(66446008)(64756008)(316002)(66556008)(66476007)(66946007)(76116006)(71200400001)(82960400001)(7696005)(33656002)(122000001)(478600001)(52536014)(8936002)(5660300002)(86362001)(2906002)(41300700001)(38100700002)(9686003)(6506007)(26005)(186003); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: hiA0477X4GbYwWrjcOv9SD7hAokjgt/kXsda1jy8rTioOyuQRCNi6fRoJeNk/gIPB+qhctb58oK57XmG6sL/C2bYUsNrESexpcqr1dStNXA66CE+sP0fYjpqthYF9iY4CvdvbbP/xhSpG0xHrzoKlBlHaT9CHJgGZA0x50Zqx5bgYX8WUVDbkn8qxHUmxIC47vRKHEaFeTgjK1yZVe+cV4M4KkewRjH8hJ0Tnf0zMFLqJga7rNKinCxvoRDZkwViSSpq7fwWppgzqToS01C02bpg85ol6+tVuhexMTplDeQ6nFv2XjMxAHcxqjRb3Lgqt6hTspuSj/OT53TIkvTOocJeYjAXn9aWmHgEIq+yr+KzH4PirT9sdDedsJ5cGDPdHLWJOs1Vsp5TGDwQmKf/xAs/iszJX0qqcP08HroPWAdOhxgNiX+MX+eGl9jjeGbYuKSJgF3FxiUjPTPkDLu1EuTeIpYES6/z9fYsn60B+5OCHBBXZCs9pMMDIKJnkAfEYguPLXI3rQgeQ1Fe6Lpy9tZpZbzzxpxTOcK0m0FlhAokLdHscKmMLd+z55LvjKo3ji3izD/HH6x+XLj1jQVItO35w+0uSOqQgee7kM2XyegCvBGhzCkCh/YezDwu88piSGMvK8o4dT8IAGzx678OJgwyi0yyMVDFKD/YcW2u4cJ4S9ZCNJKdxw3hLz29w2N5tb2A+2qLUqARjRqMzU5xcutiI+b7IfHK6TMAJs0T2ByznpoNm24nE6O9vqac4bZgiTAA//DifWuRblxkovV6wCRS41hRljULltpbHrmg78InSOEcLeOz5CZ5Fu3l+ll5EgwmM9bcqYqZ8dfk/TXkBH0+9ResHHuYZqmSONg2JACKbNP8aPYR0TMNga0ztyxVP0rnuFqUzikLqKp82yiSS7YkkmSPS13WSSkQIcPYiQy+6MmoOz2cniNvYhFkhkR5Q1qMPbqYyFDS/ktU+ds3EXwnBwy8Csl515D6U11GIqsPgk4aTlp/uGNOA3SjupWnLiC/HpolEoZO7nSM1JBs6PCx5HgAn194MmSDnaFslEX3aYsC1W1ZAwpKQk05SisT4BH9934GXhZVBjTxplflbQVWyWXVFfjveAmgN/9+yS9XNWhuMtXpMqedDx9pciPfCF0w2OCWCwaMl3Bl7ZM1StbIWvrCX9EA48IhT+2f0Wbd40T/wvVWikqIkKlQeL/K+QiJ1nUad1OhKDWi1p1tZCQmbS8C5+gYDwiW7YvdY44QVdfko5FigLdo7y7SDu57pnbQVsHR6kGH2qsc7jxfu5JpLVscNiMpy3TotPF5R+uDbbel2S+tFdYSOvScgql8VVDG9QrLIAQvjbwldsbtCGxmT0YUfgTvFk7O3u4lk+t1ACVSLD9zXZ9RjxnZo9VnnFVoU/68Z1+zPzd7DoS19AtgSn5jpwVpPkLKIqwXg1FRMZmpYwgUElqyPtcHtsKgGqxm+ZDvqlGK5hnSu7FCBLKL4k8qWE9cuwF9V71fAsbj1+OHhGDhi4MOAsS0wLgyfrhn1O/DabgS65bmynC6UrRxcxDAtJBNS1TkprX/iPxbZ3oqsUiOH/300BoSc3Kr
Content-Type: multipart/alternative; boundary="_000_AM5PR0501MB24189555F9C8C59F1BADB940918B9AM5PR0501MB2418_"
MIME-Version: 1.0
X-OriginatorOrg: vodafone.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: AM5PR0501MB2418.eurprd05.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: e4e8f403-bb11-4827-b7d2-08db2e9cc97b
X-MS-Exchange-CrossTenant-originalarrivaltime: 27 Mar 2023 08:25:13.2672 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 68283f3b-8487-4c86-adb3-a5228f18b893
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: X2oPYfLH4m31QcUDpoBA5ZzW14+vwJ/XoV2qN25GbOgXXm66P0V0rDfKiWAMQkAMVfRwL2YZiDu5SRgpnV8//94ibDiaGJY1HtyU+MlNI2I=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS4PR05MB8991
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/FQsU-Q8wJ3vVEbs3sDhyQvd9hGo>
Subject: Re: [ippm] Broadband Forums QED and its relevance to draft-olden-ippm-qoo
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 27 Mar 2023 08:26:22 -0000

We (Vodafone) have used Quality Attenuation in practice on both fixed and cellular radio networks to give a granular view of the causes of latency and loss on both uplink and downlink. Very useful in determining what you can't easily change - e.g. propagation delay as a result of cell and core siting - vs. what you can change more easily e.g. scheduler and core queuing policy). Helps with A/B comparison of network changes too.

Rather than 'selling bandwidth' as networks have done for years, QA recognises that no network is perfect and instead measures the shortfall, broken up into the causes. An analogy is pro-audio equipment manufacturers that declare all the imperfections of their high-end products (Total Harmonic Distortion, Noise Floor, Frequency Response etc.) to help the recording engineer know what to expect, and plan how to account for it. QA (and especially it's interpretation as part of the Quality of Outcome draft) can help application developers know what to expect from the network, and plan how to account  for it, too.

All best
Kevin
Vodafone Networks


C2 General