IETF Logo Mail Archive

Re: [ippm] Availability metrics in the IETF Network Slice

John E Drake <jdrake@juniper.net> Mon, 04 April 2022 14:52 UTC

Return-Path: <jdrake@juniper.net>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2EBDE3A0BF2; Mon, 4 Apr 2022 07:52:41 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.109
X-Spam-Level:
X-Spam-Status: No, score=-2.109 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=juniper.net header.b=t3/XHg7S; dkim=pass (1024-bit key) header.d=juniper.net header.b=NhS0R5SQ
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Nxdmg3HF1xPO; Mon, 4 Apr 2022 07:52:35 -0700 (PDT)
Received: from mx0a-00273201.pphosted.com (mx0a-00273201.pphosted.com [208.84.65.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 243AF3A0BED; Mon, 4 Apr 2022 07:52:33 -0700 (PDT)
Received: from pps.filterd (m0108158.ppops.net [127.0.0.1]) by mx0a-00273201.pphosted.com (8.16.1.2/8.16.1.2) with ESMTP id 233Nq4wL014925; Mon, 4 Apr 2022 07:52:30 -0700
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=PPS1017; bh=lomI4RErPNXfQfGjLNt+jRpyb5XId6UlVvNHPXGg480=; b=t3/XHg7S31ljNWnvy9Q+DJAo9YpOHSJIBgR+aZtJJsWBGGmlnscurtrQ4r8tzua6x8NV hV0x1r6yJIvPYMMgpxfzJhM7FEd5WipKtn1p9DkuC1eE5FYrz8NNFgOXvKM8R+6CZRvo cWn/LoNf8HSUKGtbZOcBeX7+XJe1I3plTyzVXzcVbY/lIR41TG0OxUNKqrQJbSFUUO1d CE2Qbk7eVjgD+bXJ93alEn27NlXlnabLlB+VFx6nPl+lcfJQwB2c6B4FTkPVWW0cg9O6 jjl5K1NcGBKGRtQ/0YPD7kq5LIIwvj3AtYfytyiqvOQsAsXzTebabrGJVDvHgZns2txH Ag==
Received: from nam12-dm6-obe.outbound.protection.outlook.com (mail-dm6nam12lp2177.outbound.protection.outlook.com [104.47.59.177]) by mx0a-00273201.pphosted.com (PPS) with ESMTPS id 3f6j6qkwhw-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 04 Apr 2022 07:52:30 -0700
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=UQctcOqTuwF8/X0cyySIcX7iBc2a1AB517qPmtWR6czU019QXdYZpFxKwzy5n0Dz3VHyzWeG71lWj+rW28aQ0V1I7gBILgFiN/G9ULa7sXrbul1+T3vF2P97MLE1LT5rb3lZNC4AuuH29H/khUlz7XlRZMAtVWFGqMOHIPa5O9QxWgUNd7PHCjJr+rQG9OaSlAHOR1ECu5+N84ZAwKc5jEG5/aNhBoe5t6bkL8JEDBeEEbEkvjBsM0IN5yft+hT/fqSV0YTnnALSoQxQJu80RCDerWfrd4kGFTrKAsYswc7rWiU7aNWaTNHpMt+vUqfoZZtQSm9FsVU3RRyYjmwwGA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=lomI4RErPNXfQfGjLNt+jRpyb5XId6UlVvNHPXGg480=; b=MsWnvX5GDenbrPLeZdXxVPnR2q2JwgK3bmJoldFPwbxJUsxO52xRmNDPyKBvqZELjSATMzmUgF/hwSnn58dqwPUCCJ5JTMlpIWiKu6j9PYjwSbsulfJBneMzAkVdyNf435g68CiPVWNF4MRd2Rirm95DSDJFzyrA6rLB+jopDgi6FGAJHOQiQDZoKmrIckl5N4/hJJp3+Yfgy7JipTwye5jex62PizIKmyylNfosF94MNkgya199y4l8Z/rCMWi9QZV37X6rhsh8nSvPbAfNvETs8xtToZy9I47StzhD55LFld5l2kYj9TAtx6yBrJKjLsy6Kgk5LnbJzjDPlim4Tw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=lomI4RErPNXfQfGjLNt+jRpyb5XId6UlVvNHPXGg480=; b=NhS0R5SQCuUilBQjyxID51yah3CG+g2pXwkpD+HeCY08FD6TLGNFO1jba2Tmq4UcztBQ2bjQ50BXd+9m7wEcASE4yHF5XygwT8QNtGDC2eqe8XXczTiLgmVFyjrHWHBA0z0/eCeJamWFF/8FOgQVDccdAEOga0xtuydJenPDRRQ=
Received: from BY3PR05MB8081.namprd05.prod.outlook.com (2603:10b6:a03:366::15) by DM6PR05MB4618.namprd05.prod.outlook.com (2603:10b6:5:fe::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5123.31; Mon, 4 Apr 2022 14:52:28 +0000
Received: from BY3PR05MB8081.namprd05.prod.outlook.com ([fe80::8db8:fd72:6beb:3657]) by BY3PR05MB8081.namprd05.prod.outlook.com ([fe80::8db8:fd72:6beb:3657%7]) with mapi id 15.20.5144.016; Mon, 4 Apr 2022 14:52:27 +0000
From: John E Drake <jdrake@juniper.net>
To: Greg Mirsky <gregimirsky@gmail.com>, Adrian Farrel <adrian@olddog.co.uk>, TEAS WG <teas@ietf.org>, IETF IPPM WG <ippm@ietf.org>
Thread-Topic: [ippm] Availability metrics in the IETF Network Slice
Thread-Index: AQHYSC0KqEwmX/cWkkukrhPw+W/VLKzf1r7A
Date: Mon, 04 Apr 2022 14:52:27 +0000
Message-ID: <BY3PR05MB8081D69335BCCBDEC6E308BFC7E59@BY3PR05MB8081.namprd05.prod.outlook.com>
References: <CA+RyBmVAnW3vviEL53feo8Hx573W7sMkx+MK0_v+aWjeF2HZEg@mail.gmail.com>
In-Reply-To: <CA+RyBmVAnW3vviEL53feo8Hx573W7sMkx+MK0_v+aWjeF2HZEg@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
dlp-product: dlpe-windows
dlp-version: 11.6.401.20
dlp-reaction: no-action
msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=true; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2022-04-04T14:52:26Z; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Method=Standard; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Name=0633b888-ae0d-4341-a75f-06e04137d755; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ActionId=5a395545-3a91-467f-9919-a2c0029e2fa6; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ContentBits=2
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 4fe6c9fa-9371-4526-8aea-08da164abcf5
x-ms-traffictypediagnostic: DM6PR05MB4618:EE_
x-ms-exchange-atpmessageproperties: SA|SL
x-microsoft-antispam-prvs: <DM6PR05MB46186AD022764D2B8C77D843C7E59@DM6PR05MB4618.namprd05.prod.outlook.com>
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: S3eF4pOEPetzoSAHBWMH6BsMxVJmv5brE0roLWSLR41b1IhvnHyXz39jZkYQbbbPqtMhDpkEzlnG/slp7YvRLrhAianUmWhfBZBkPVaa77T6simDoFONOfnk7mmfOTke+as0Lq+q/D0RNOuSnDzwfoGUJecAhgrMjv7jvSr1ZUCz/Gs2SAriDXo+m7E2iEmPO2WFs9hz81p3uPBKLFy8ue5uCGMZCd/nhhvxFPMV2rnFKiqYifMpgDv7otz1JmBfGqvVzNY8+3BSFijAI/EkUKv21vIX3QSMPQ9H2g6FOcetFSFLjmUSes19TvlGjvxHKbmpqhnKB6NSXJTyODSOg73Ugx5qp2Ivjj+ATM/4kZw/4S8Z9iqk9oNRO9f4vjMsRB7DnlYuLQnP1MGtAm26Af3ShI0s/1KEIfdRPV/8/u9hTAWJukOXM/yRfHRG0XvDpqGgE5MPWRqwGh6o+KKpnwnvSiUVWsCOYMtbmx36TNoXSWOexV21MNvmi5DJsY2MW2Zy7LhbPSaK/9S8/Q2/teIvDtypoyh3gaVRYk8zTZtU3xxEIv1yhDmWDIwNP5RLosgOd3Gi2ZVUlBdKry7AyV3of4TbTRSyJVx1ReXQJt7FQ9g3E262HcYthuYxA6/ONAO8CsoJUpj3atOJNG6UPQJcGMW6k1zJ5jr6mDHFD177U54jWlwcDWxfHPowfts78BiTS72I0yTXz2GbrjJ4xh9xU3Rq+OewkJ9mfOD4gPA3XFXtgoUGAYWNQ9AL6G0H3bDZj8zFyngkfdnkRlJ0wDNwXKHnAxoDU0UFHyvkD6U=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BY3PR05MB8081.namprd05.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230001)(4636009)(366004)(166002)(76116006)(8936002)(86362001)(66946007)(52536014)(64756008)(2906002)(66446008)(66476007)(8676002)(508600001)(66556008)(122000001)(5660300002)(186003)(26005)(55016003)(7696005)(110136005)(53546011)(38100700002)(33656002)(316002)(38070700005)(6506007)(71200400001)(9686003); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: QSSZnu3i//78cE0FB+2ruSWy6vkEFZETTuGw1ogKf6Q7ScW9yeEIMDf86bC3vUeRHIryj1sd/KI+E9oDFC7w/apkhgftMlyM2VpWgZ76pcT0RqkgboaLRDYvjBHbQH85PwfMjgJGI4nfmp3cdriX1GlaALgmagLcexGAb7f3EzH1avV+t+Sa5PA9PiXnavkX0khmQz4zgAG1d6eTc82uPqen++QcjANRMcFHKvdx/ja4SxLOAyQtlSSLYHFIBuK1UyPz4/nDedY/x1qLS20KlvvVK/NQCe81F0clyD5z6c1Qv1TOIc3b+U7rq6J3Ojom+WXA08s4aETcZO1IlxKnqRl5XJXPZwebQ7wo/Kn9WQKMd3f1NCaueTPpWQTa5hrZjRCXjQ6w4zJanTIerK8RaCTaCyCwpC8mI96CGdosYfkPJPnecjzrpyNX6m/4WJFs8CejTMuBGJ9RrfGuhbK7eXDxLryVmlFcJ3Wky9rCbIh2HaO9ejmQKjG62TRnuVmjH5wi6mv5BLTYAC08JlViN4QePubcsWjO48/Fxk1Jjz5G1wLAYrKaxd4AdlRBNhzLry9KIzMM3w9xPknJ1E7MsLn3X9SEEsJZ77w6AuErctcoy7FXfGYY7ctCXN073QMYa3/XJFz8Q7XiM5Jq+I7IKgebFSYzDxHSQkh3ZrC9fZ+3OJOu7/y7WFJxAOv/AsoTcXAm89URWqD2rQ9+eVdGMuDdSIZU1kwH04Q6DUrS7ETuQYM99PQEJmHY4yE1ufRK4IstNOhYHtE1YJmHujvpRR2XMDfb4FYT74RyAFxtgklBpjko7wGDptTp/LAB0sSNfPtZxXkESpJA0PQBd7M4hECgjno+WWnQxIz6gDD1yNg6tWYRFojEAsLIsGB6mqXRSUy+9SWAOX8ngUlX6GZVW2lSXWszI5XCRUCYCbfBL4L3Ifgxta44qmVLznUDzvqJurqBA5veMu8NKNMfSI/HaWdgJYHH82fPexImgrd+ekjTU7jrh3SyX5Db8kQKNAFEq6dobBQW6ny21Zj/Rqr7+Xye7Xujo7RUhif/9VDMqNHU+SFaElq6lx9s8ly6NzzyrOAykgUemQ0bQ8oRJwuQ/RAM5w2amrW6bNUVddW4DlhQ9sZv9+Dgj4l33T439+6+hqqr1F4GANoFXHs8BlISa2QeErg316WY5b+viDiLCxtRfyhz4YkiIxosD8JGUWcak7oYQxPPSO1tgo7wFtCp3tRc5rkniQ4flAThyCJT04kbZjvgYisFPDGY6EYVHB7omW+QoLEEGxABZTcUfEM8zHE8tEAPD50AUanvHKL4UnqbEDGfOj/1WxlRhThoAVgzLZBGrKx7KyMhgMo4aHPHQxjOpXmlQhMdycbwbqrPmdm1PhshWj02BQ9gHXDYlMSVQeXFqWhGnfmsSrzfeGCXBeMDugDP2YBFtGgiMAlievNdoCguSQpFojbp+0SBYOd4Ywl86jMoPJoA3iYHrJ1QQ2N2VtRztQS1frlCuOyVrHzrRC1YtVhjCDjYxlEYRW527lV5b+5yfCQac6FBBPZIvPF0riw5m/QGzpYrBj5vF+4GqJdDFRJIyvm6rAbi/Mr+DgNyXCE/LIciwqmejp0OR1lGFgnXRQqms2P70cpTwP9f88e47Qv1ql5W+Bei5s0V1ThZqPS7ZUBIcrgUiRz6FHxQ5FFGLIausCgAEfArHXD5oqogRfZQPPx11ap9/Cb3Ktashs+SKLbe6E53F4Pv5A==
Content-Type: multipart/alternative; boundary="_000_BY3PR05MB8081D69335BCCBDEC6E308BFC7E59BY3PR05MB8081namp_"
MIME-Version: 1.0
X-OriginatorOrg: juniper.net
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BY3PR05MB8081.namprd05.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 4fe6c9fa-9371-4526-8aea-08da164abcf5
X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Apr 2022 14:52:27.8539 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 6H4qSeRqNsv5q5WxhOPrH9rYDlgK7h6pwEuKsEeZyGAhtyUaqLQ4tddlScx0J5L3y5ylCv4pExdormjtC8sAbA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR05MB4618
X-Proofpoint-ORIG-GUID: JQ8sWy7eMzLRsm4Bqp6-vaiqM6UN8qZt
X-Proofpoint-GUID: JQ8sWy7eMzLRsm4Bqp6-vaiqM6UN8qZt
X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.850,Hydra:6.0.425,FMLib:17.11.64.514 definitions=2022-04-04_06,2022-03-31_01,2022-02-23_01
X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 lowpriorityscore=0 priorityscore=1501 suspectscore=0 phishscore=0 mlxscore=0 adultscore=0 impostorscore=0 mlxlogscore=999 clxscore=1011 malwarescore=0 bulkscore=0 spamscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2202240000 definitions=main-2204040085
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/VNzOhcCI1lF1n8yZeRJD43mPAHc>
Subject: Re: [ippm] Availability metrics in the IETF Network Slice
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 04 Apr 2022 14:52:41 -0000

Greg,

That sounds like a great idea.

Yours Irrespectively,

John



Juniper Business Use Only
From: ippm <ippm-bounces@ietf.org> On Behalf Of Greg Mirsky
Sent: Monday, April 4, 2022 10:04 AM
To: Adrian Farrel <adrian@olddog.co.uk>; TEAS WG <teas@ietf.org>; IETF IPPM WG <ippm@ietf.org>
Subject: [ippm] Availability metrics in the IETF Network Slice

[External Email. Be cautious of content]

Hi Adrian, et al,
I've got a question about the relationship of performance metrics like packet loss ratio, packet delay, packet delay variation of an IETF Network Slice service (NSS), on one hand, and IETF NSS availability. I think that  Section 4.1.1.1 considers all these metrics as Directly Measurable SLOs. I agree with such characterization in regard to loss and delay while I am not sure that that applies to the availability. The issue I have is that, as far as I know, there's no formal definition of the availability metric in the document and it seems that we've been using it in a colloquial way. A group of us started to work on a definition of the availability as a performance metric for a multi-SLO service<https://urldefense.com/v3/__https:/datatracker.ietf.org/doc/draft-mhmcsfh-ippm-pam/__;!!NEt6yMaO-gk!THS33yjziPwDcoT1wn1gm-hvkwEU_Rq9HFUL-GDa57LhJWHD0uVygH0OV3TtD-w$>. We had discussed this work at the IPPM WG meeting at IETF-113. I think that this work is relevant to the discussion of the IETF NSS availability. If that is the case, perhaps the characterization of the availability in Section 4.1.1.1 can be further enhanced with the reference to the draft-mhmcsfh-ippm-pam.
I greatly appreciate your comments, questions, and suggestions on our work on Precision Availability Metrics.

Regards,
Greg

PS. Attached, please find the presentation slides from the IPPM WG meeting.

v2.23.0 | Report a Bug | By Email