[ippm] Fwd: New Version Notification for draft-mhmcsfh-ippm-pam-03.txt

Thomas.Graf@swisscom.com Thu, 01 December 2022 16:13 UTC

Return-Path: <Thomas.Graf@swisscom.com>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 691D1C14CF14; Thu, 1 Dec 2022 08:13:56 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.195
X-Spam-Level:
X-Spam-Status: No, score=-4.195 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id mVxwO1cuFzlh; Thu, 1 Dec 2022 08:13:51 -0800 (PST)
Received: from mail.swisscom.com (mailout110.swisscom.com [138.188.166.110]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id C07C7C14CF02; Thu, 1 Dec 2022 08:13:49 -0800 (PST)
Received: by mail.swisscom.com; Thu, 1 Dec 2022 17:13:46 +0100
MIME-Version: 1.0
Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg="sha-256"; boundary="----=_Part_311215_246844751.1669911225956"
X-Mailer: Totemo_TrustMail_(Notification)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=a/gTC4O0N/bhoFreR0wsBFD4S4A2LM22IFQyAFPYLB3qIH4XZ/J/hmTXGAdGPqwxXf6NTFJu7vi3jCrtnqVrAPcvRraI0/93Gq/Lg+YJvre/rVYoQ2cy4EdCVqfdeBadwYv9Qy46d9fYfotylUTHJTJEV6mamOphVUrXUPI/KVyJ5Ky2b62xFePifmTa/OIv8KQzH1SEprV9ZzoufPFnhpwQdawG5u6g8UwI+5sD5Bu//jePgFssu2MEdLpJw0/KJkR5MsyeLi7Gn/n6IIlGS6HErSBOR/13wRTCc8fHry3251WxOYW5GsxS3s9N+Zt3gqwNBCy4H4nNpjKpSPs4PA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=hZLYAXWODT9K4Fx1Y31dSAp5GEeSU3K80NTJvdYOyOM=; b=icoP93dZka86hB7jPDxoT1p5nBZWHEODuEB44mZHdtTm1C0PsnJw1uwxzkfVBTHXdJvDWP0i0rjvPMw0MvwtKBMlIvfb5roxjy45aPe5UjwLM1JhB2xfznZoQUMZCGoA5CSFdz1z6BIotgDY/OrQT7vtN7ygwm5yBoRJom+x75NamsT9mR3fddopQAAvswxISX3/96SJsFxBL6FivEavg4Ngb//xvS7nsvKRcmPdGLgHSUdwuQRIsBN7SW1aCnDn+pe7pp13qcvpl675KKFCDl26G3DpmBBbLDhN0Y8ZSg00r8293PvYrWVW34mXYDZmjPPQUseDjq7HmJwiY27HdA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=swisscom.com; dmarc=pass action=none header.from=swisscom.com; dkim=pass header.d=swisscom.com; arc=none
From: Thomas.Graf@swisscom.com
To: gregimirsky@gmail.com, ippm@ietf.org, ippm-chairs@ietf.org
CC: teas@ietf.org
Thread-Topic: [ippm] Fwd: New Version Notification for draft-mhmcsfh-ippm-pam-03.txt
Thread-Index: AQHY8psaGJj8A7u6eUqLC1QOvkti6q5ZTceg
Date: Thu, 01 Dec 2022 16:13:40 +0000
Message-ID: <ZRAP278MB0176FB385153DE495437FDB989149@ZRAP278MB0176.CHEP278.PROD.OUTLOOK.COM>
References: <166781984654.32419.11411479383442277210@ietfa.amsl.com> <CA+RyBmUUSths41=bngm6UcJWG8v=ek08LONDQqv37rCODALqgg@mail.gmail.com>
In-Reply-To: <CA+RyBmUUSths41=bngm6UcJWG8v=ek08LONDQqv37rCODALqgg@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels: MSIP_Label_2e1fccfb-80ca-4fe1-a574-1516544edb53_Enabled=true; MSIP_Label_2e1fccfb-80ca-4fe1-a574-1516544edb53_SetDate=2022-12-01T16:13:38Z; MSIP_Label_2e1fccfb-80ca-4fe1-a574-1516544edb53_Method=Standard; MSIP_Label_2e1fccfb-80ca-4fe1-a574-1516544edb53_Name=C2 Internal; MSIP_Label_2e1fccfb-80ca-4fe1-a574-1516544edb53_SiteId=364e5b87-c1c7-420d-9bee-c35d19b557a1; MSIP_Label_2e1fccfb-80ca-4fe1-a574-1516544edb53_ActionId=09d26f2f-043b-49b5-8d49-02dd3e952e12; MSIP_Label_2e1fccfb-80ca-4fe1-a574-1516544edb53_ContentBits=0
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=swisscom.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: ZRAP278MB0176:EE_|GV0P278MB0051:EE_
x-ms-office365-filtering-correlation-id: cbf29981-14c5-4f06-32b1-08dad3b702b0
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: ModAYOCagt5PQRYEfmIiwY6bKJsMD3nNgfDH5NWCwBC9wayjAu+15/GP79xBa9m/k4X+lcb2aUFUaLWIe4X9w7tPC+BApdEp+d8iSIwD4jFrmr2VESQPUHfgxfWzQ3g/p0yIkyqi/q5hdNAIO8qFl7ciJSY0YXNn+kP8LzqnJMkLV4pyeAUMmKLMRLKUAUXs9P98x06hYJVVrE7e4NSUStdbTUHYt99FhQd3O6wnJLT6DUIJE1Fu/B8QXcj7hRT+umn0YSKYx5hMhKqQaO6rY3x5YKGyqzauIWAR8UypkJOh+ItR2r1cByVeMmxuTSQS9LzRvPPpdkD+hex56cr/ImAg7w2d5Jc+kThK2gPqrSWz6k/8TdsZyxUXWiVX+6niV77Ib375DvgXAT/Jrp4lZvPd6NSWUfy1dismNjl9wzcYAtL4XLO8McgHxsksdkU4HMCq4o6NHC+jFY6P1orwu0UAopVejU/KekcLg+nU/cvvwfWHZZ+UB1v/oIu8ey5yF3yUnYDR4XWkcEbaZ1rgd6PyU/yCQIic4iPZEyauSsJZb17rWuo6Mmkqf1hJs+tjPP2gZv79r3r5I/7jG7xIyKza5tx5t/VJsYQUBg6FYs0gjf01+H95dbLV1CCr65Ph2TduH5+QUbiSSi9bRHItGOknL8CY8ymasOl6MUKPh8XkEzH4vIA62+vHC2w3J9uNc5O6tASp71l6XxRHpEbpk8ZnZIA7m8vff82eZ2ZNimA=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:ZRAP278MB0176.CHEP278.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230022)(4636009)(366004)(136003)(376002)(396003)(346002)(39860400002)(451199015)(71200400001)(966005)(9686003)(15650500001)(86362001)(53546011)(478600001)(7696005)(6506007)(26005)(186003)(10290500003)(10300500001)(10440500001)(66574015)(55016003)(5660300002)(83380400001)(110136005)(316002)(66899015)(38100700002)(82960400001)(8936002)(2906002)(33656002)(38070700005)(122000001)(166002)(52536014)(8676002)(66446008)(76116006)(41300700001)(66476007)(64756008)(66556008)(66946007)(4326008); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: OW/WHvOTOmkq3QA4JIHYmiIBd7vJ97RGJv26LEvqXqvujp1r8sjUDWIslKRsy6x45DMgZyqmuOv6d2R5P6oNFtIKT+wyHMjoXAS6gGTGAP+Hxc82iNaqQy+LcTfy69fsd1tOydbsyQdkq6dd6JhVkBCkjkTAnjvZKrJ6TIptSUC/KmG16OgLEM8Nws6Uu78esTXo+CZJobd3X55FSkLyqis7Kvbh/6HoqqRnFpSbVpXj+54WXqe8Sq4H8wmnc3CuM2goh+cLbpswkDEO843+hygw5flUG4xAmsVmwT3EdHbiGQTsT9jAFPAPq4KxgD5czUwpsc655OgX0BHEwmU7Zk9EGiiELTKE9zUDwPYtbzBuI+RNodLhvj22jdDcoV7YXc4iHqR9YgNbkvr67ZS5FLStpy8VyDzmOFNfQTW8mI11pJZkBt1RFdgLpsEpluTmaV9tdxlKcuz0XwaSfC6BRsH4TTRVBTRaYtMB6SKNVO7jlFvGHZoZ8l4SowFrfmYR0PF0MMd3gF/q53a0u2FwcoPUnsszV8M5fG70h+GrBEtJcRR8ociWZnIWXwFIRddKI0ZIl4hYoV4VhI/y/mdJ67OaODGNfryWwpGKUSoj22/bRqhEufBm0mg6EvC164GaopVflad/8Yf56T6JnlvxqzpudcmrRozV5XcWopX9oklyyMaNeY41pBsCLpzsHi7iJnVQOCJ5YKMzbLfLO4+XXePhsW3Pmsl8hMKOchUYg4C5chHj0kzkhzBVKFkDK2LfOZ8hWkuXV66CzKIUXRo/eMAYTa4YgY/6xJ/9ynXQugXCEyUMh+PpijeezxZH30Kfi6h1dOE0mvsQO0BWtrVKn5ZcT888WTgwjgvgLVBewIInAyro386dX3d9rgpYpqVTN4AIWBTtGEBIyBC0brjWwzjkpgfHIIE/ORJ8vmm3u6oLTnQHECYUBf0+TT9vPNutY3a+ztQZUApOqOy95ZDIKeqC35lEjk3GZK4t7gklld6v2MWyDLxzXqJxcOyCkvo9+6hLs42wXvGiRiSzxhDqmWlPcWJ0N21QV/xD4Zmovy6BFrh02VQ9SdaBm8BB9BFWL/V+s1k/vYMnQDX/ecUa8xKI5mRvtny2TBDAgJf1G/f6Vq933EttuLQmtxeDZ7O6lO4BQexfWM2WTCUvQthkd7o8VFSY83pag3jPgsh7FEHl53RnKhlB0xN96xBPGeu1MfsAWMv82iu/x2QTf4sRGSzHHj2OuZ1nqHcBqPKZ9TsnoO9piaq43i5oX3+QeHOvPV661PhXfNW9JwVG1vguuZK0j+ht9j3cK9LqkNJ9ewzo8eHo0VRNzK5l6YjorshHvlG+lgnCAl1AmwYDE3tbqXwbw3Ts3pSYPN/q/jkRvb8cB5UQ3qPNm6WDJwjknewghHp3MfoGfPwDM7b9q84jwIIw+ToVOL2kF3UQ4Gj1s06fWFD1y9e2UUiLGfvOZyGRJIRQriHC908e1Czvh21CWitQimgucls7KcB4OhVwTo0Q3ga+MaPB8Y8FQD9F/bnjIkwVItdQH0QHtHuFeJOnqrns+WDxHinTQWru3mw9tjDiFCnfNu8i6aCnzPXayEo8snY0OKVB9f4UQyolTW7Udg==
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: ZRAP278MB0176.CHEP278.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-Network-Message-Id: cbf29981-14c5-4f06-32b1-08dad3b702b0
X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Dec 2022 16:13:40.3767 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 364e5b87-c1c7-420d-9bee-c35d19b557a1
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: YTYu74P1LtmvGKCFbKjXX3JxOT4VF/DN1omITQprQsS4b9BpBw6f+vshHYd7vvU8wBXr59LRcmyJX39VNmC5PFmUfhcagh/Eio1jTNGp+Qk=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: GV0P278MB0051
X-OriginatorOrg: swisscom.com
X-CFilter-Loop: Reflected
X-Trustmail: processed
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/dwMbE2GYY5dIvDe2xYqUCUBbGBk>
Subject: [ippm] Fwd: New Version Notification for draft-mhmcsfh-ippm-pam-03.txt
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 01 Dec 2022 16:13:56 -0000

Dear Greg,

First of all, thank you very much for picking up this important topic. I think this is very valuable.

I would welcome the distinction between the SRE terms SLI (Service Level Indicator) and SLO (Service Level Objective) and apply the SLI to both packet loss and delay for a specific flow.

To my understanding, section 3.1 (https://datatracker.ietf.org/doc/html/draft-mhmcsfh-ippm-pam#section-3.1) describes the SLI. Defining the upper and lower bounds of the bucketing for VI and SVI.

For the SLO definition, what is missing is the burn rate which defines the time range and the VI / SVI count. The notification should not immediately happen at every VI and SVI violation, it should happen with a delay when the VI / SVI burn rate is violated. That delay can be defined for different criticality.

For the semantics I suggest to be guided, inspired by OpenSLO (https://openslo.com/, https://github.com/openslo/openslo). This is widely adopted in the industry already.

Regarding section 6. In my opinion, the end goal of this document should be that an SLO and SLI for a network service intent (https://datatracker.ietf.org/doc/html/rfc9316#section-6.2) is defined in a YANG module and the SLI can be applied to a flow, which is actively being generated and measured by a probe or the flow is passively/hybrid being measured by a transit node. I gladly contribute to the document and I am looking forward to the working group adoption.

>From a data mesh architecture (https://www.datamesh-architecture.com/) perspective, the delay and loss measured measurements are operational metrics. The SLI, VI and SVI count, are analytical metrics.

Best wishes
Thomas

From: ippm <ippm-bounces@ietf.org> On Behalf Of Greg Mirsky
Sent: Monday, November 7, 2022 12:21 PM
To: IETF IPPM WG <ippm@ietf.org>; IPPM Chairs <ippm-chairs@ietf.org>
Cc: TEAS WG <teas@ietf.org>
Subject: [ippm] Fwd: New Version Notification for draft-mhmcsfh-ippm-pam-03.txt

Dear All,
as we were suggested by the IPPM WG Chairs, the new version of the Precision Availability Metrics draft includes updates addressing comments received in the course of the IPPM WG AP.

The authors allways welcome and greatly appreciate your comments, questions, and suggestions.

Best regards,
Greg (on behalf of the Authors)
---------- Forwarded message ---------
From: <internet-drafts@ietf.org<mailto:internet-drafts@ietf.org>>
Date: Mon, Nov 7, 2022 at 11:17 AM
Subject: New Version Notification for draft-mhmcsfh-ippm-pam-03.txt
To: Alexander Clemm <ludwig@clemm.org<mailto:ludwig@clemm.org>>, Greg Mirsky <gregimirsky@gmail.com<mailto:gregimirsky@gmail.com>>, Jerome Francois <jerome.francois@inria.fr<mailto:jerome.francois@inria.fr>>, Joel Halpern <joel.halpern@ericsson.com<mailto:joel.halpern@ericsson.com>>, John Strassner <strazpdj@gmail.com<mailto:strazpdj@gmail.com>>, Xiao Min <xiao.min2@zte.com.cn<mailto:xiao.min2@zte.com.cn>>



A new version of I-D, draft-mhmcsfh-ippm-pam-03.txt
has been successfully submitted by Greg Mirsky and posted to the
IETF repository.

Name:           draft-mhmcsfh-ippm-pam
Revision:       03
Title:          Precision Availability Metrics for SLO-Governed End-to-End Services
Document date:  2022-11-07
Group:          Individual Submission
Pages:          13
URL:            https://www.ietf.org/archive/id/draft-mhmcsfh-ippm-pam-03.txt<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ietf.org%2Farchive%2Fid%2Fdraft-mhmcsfh-ippm-pam-03.txt&data=05%7C01%7CThomas.Graf%40swisscom.com%7Cfacd9acfdd554eb0774908dac0b23c2c%7C364e5b87c1c7420d9beec35d19b557a1%7C0%7C0%7C638034168986274458%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=i6ShlP4%2BwmWjF%2BOvpBdvIqi%2BaYmsMkwxY7JagVTdi0w%3D&reserved=0>
Status:         https://datatracker.ietf.org/doc/draft-mhmcsfh-ippm-pam/<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdatatracker.ietf.org%2Fdoc%2Fdraft-mhmcsfh-ippm-pam%2F&data=05%7C01%7CThomas.Graf%40swisscom.com%7Cfacd9acfdd554eb0774908dac0b23c2c%7C364e5b87c1c7420d9beec35d19b557a1%7C0%7C0%7C638034168986274458%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=VABNSiq1TR8VpWx1YvWATSi%2Bq3dMSvM3fBc2XRlQgC4%3D&reserved=0>
Html:           https://www.ietf.org/archive/id/draft-mhmcsfh-ippm-pam-03.html<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ietf.org%2Farchive%2Fid%2Fdraft-mhmcsfh-ippm-pam-03.html&data=05%7C01%7CThomas.Graf%40swisscom.com%7Cfacd9acfdd554eb0774908dac0b23c2c%7C364e5b87c1c7420d9beec35d19b557a1%7C0%7C0%7C638034168986274458%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Ctky0fyed2kWOp3i5ijv%2FfTbxX9tvTnTCmWYbyZZ3rk%3D&reserved=0>
Htmlized:       https://datatracker.ietf.org/doc/html/draft-mhmcsfh-ippm-pam<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdatatracker.ietf.org%2Fdoc%2Fhtml%2Fdraft-mhmcsfh-ippm-pam&data=05%7C01%7CThomas.Graf%40swisscom.com%7Cfacd9acfdd554eb0774908dac0b23c2c%7C364e5b87c1c7420d9beec35d19b557a1%7C0%7C0%7C638034168986274458%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=hgZecpNDDz50hu8EgGUK7g1Hkdcj7BOdi%2BrOlbupYeQ%3D&reserved=0>
Diff:           https://www.ietf.org/rfcdiff?url2=draft-mhmcsfh-ippm-pam-03<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ietf.org%2Frfcdiff%3Furl2%3Ddraft-mhmcsfh-ippm-pam-03&data=05%7C01%7CThomas.Graf%40swisscom.com%7Cfacd9acfdd554eb0774908dac0b23c2c%7C364e5b87c1c7420d9beec35d19b557a1%7C0%7C0%7C638034168986274458%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=SdfxkMR13q0ix%2FNZde5gBYc5uTJmR%2B3Er0NjAfOi%2Few%3D&reserved=0>

Abstract:
   This document defines a set of metrics for networking services with
   performance requirements expressed as Service Level Objectives (SLO).
   These metrics, referred to as Precision Availability Metrics (PAM),
   are useful for defining and monitoring of SLOs.  Specifically, PAM
   can be used by providers and/or users of the Network Slice service to
   assess whether the service is provided in compliance with its
   specified quality, i.e., in accordance with its defined SLOs.




The IETF Secretariat