Re: [Teas] What SLOs and SLEs should be in the Slicing Service Model?

John E Drake <jdrake@juniper.net> Sat, 26 March 2022 15:35 UTC

Return-Path: <jdrake@juniper.net>
X-Original-To: teas@ietfa.amsl.com
Delivered-To: teas@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 91F4E3A0DD4 for <teas@ietfa.amsl.com>; Sat, 26 Mar 2022 08:35:48 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level:
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_REMOTE_IMAGE=0.01, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=juniper.net header.b=syBoHJJz; dkim=pass (1024-bit key) header.d=juniper.net header.b=kW9LgC12
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YTXf5tenJ5QH for <teas@ietfa.amsl.com>; Sat, 26 Mar 2022 08:35:42 -0700 (PDT)
Received: from mx0b-00273201.pphosted.com (mx0b-00273201.pphosted.com [67.231.152.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B023D3A0B75 for <teas@ietf.org>; Sat, 26 Mar 2022 08:35:41 -0700 (PDT)
Received: from pps.filterd (m0108160.ppops.net [127.0.0.1]) by mx0b-00273201.pphosted.com (8.16.1.2/8.16.1.2) with ESMTP id 22QEb0vG030142; Sat, 26 Mar 2022 08:35:40 -0700
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=PPS1017; bh=iSGsZkpFmu7AzN2tf6W5ZzJeJpuDx+QF3C55WHvHk1A=; b=syBoHJJzoxRQN024KCAMhDcYdMay8LQpcNvPCfBYNIQM5NmKhVscpOA63m6/+xJfM26o kSLf7SMEoq0127KOQdWqRHVc2BQf6tr5DqlzAXXCvAei6M6q1qWaf5OjH39cIMf5+kvC Hc13APhNZoEk8i/TVRGF6rFMlLxQeWa9EJ/dwt4UHIXNjCIbFOrCDzSk4aqFJq4LrtGW 7wQKloayeAnm5sUOcCvUUbjxgmHRijbxxs0H1RxZ0yJfD4EAoBHLmOdI3jWByDrCLv2p xaJgTf1A4cvugnqut+F4Jen1lOxhrcoPs2B2E1BZkFojD8ME6RY5fx5FKY9Sp7fruCxF Aw==
Received: from nam12-bn8-obe.outbound.protection.outlook.com (mail-bn8nam12lp2175.outbound.protection.outlook.com [104.47.55.175]) by mx0b-00273201.pphosted.com (PPS) with ESMTPS id 3f20rfrf8c-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sat, 26 Mar 2022 08:35:39 -0700
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=P71bWsznyp5mOvaQp9QbHzek/naeMNisjcZZakcVpeoR3mhx/Xt5SlYkadfEAVzALaCdXyNViOgPkn8AZeH+OhfSvgibxDRpX99P+9AU2VUTJh3F/vYjdGbNySZTV8WSQvmmVby1X+qPb7B6BqNHnmK0FETSQXOLjKe+h27uP8u3k988hOMS0B9/d3713VyowEn7YHvcBY4jG7nwiMiD3e3uIKvgmeDdkMv6UUYoKLEYM0orxe7q3MdToeEMFEOiyxSsRl96LLm3vrBZAj4lzPdd9dBcY0nZqMSSQaxZY3cbGCca6A8S+5O9jDVcocHLPdxTPiZfZLE8GsnydDSAgQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=iSGsZkpFmu7AzN2tf6W5ZzJeJpuDx+QF3C55WHvHk1A=; b=CqPU6r/vWCz7+xwEbmgNQNO8L1x6mRir9e6O2G6w3vlkBuFe2wHFIyyDbNGMpwRt7eQkggY6Y/a1QlRyGDAATDkxjYpLn9fdM4i9YLMmPWWtiov/6rFSHTXPA/okIrmCi/n0GrorSSol9epdGB1chpch3mN5TV+pU7Gg/xq+WeWtcrL6mYmucO09zaECnCAvGz0MaqNbOG/SuhmCMUKX0hvmEU5tBLTeUe4XBfW4hIz9NQ4DcypGeT+PriL9EyndbmnajzavQdBflJfdStFZbkWRJO4pabMnpjDyyk8ogGw4mIGUZgD58p0NXoNLmJj1acT6nyCqbBWBT0/QQ3pXIw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=iSGsZkpFmu7AzN2tf6W5ZzJeJpuDx+QF3C55WHvHk1A=; b=kW9LgC12h7BDsQ8B5G13aee6/3fsg03BqoP+S0+QcFgM5KIwUaxrEttGllrTqGLx6bkyiFp/Id0Orvhed/QkwTctxTMXqf2YQCiw8tU6Ca4WszvUS87eWARgdAGxuPfp8YciGlOXXGIPHr0NqnOQGnfjJ0NROXn+I+N+Nfjb5VU=
Received: from BY3PR05MB8081.namprd05.prod.outlook.com (2603:10b6:a03:366::15) by CO1PR05MB8395.namprd05.prod.outlook.com (2603:10b6:303:e6::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5123.12; Sat, 26 Mar 2022 15:35:35 +0000
Received: from BY3PR05MB8081.namprd05.prod.outlook.com ([fe80::283c:d671:e4e5:31f8]) by BY3PR05MB8081.namprd05.prod.outlook.com ([fe80::283c:d671:e4e5:31f8%9]) with mapi id 15.20.5123.012; Sat, 26 Mar 2022 15:35:35 +0000
From: John E Drake <jdrake@juniper.net>
To: Gyan Mishra <hayabusagsm@gmail.com>
CC: "Joel M. Halpern" <jmh@joelhalpern.com>, "adrian@olddog.co.uk" <adrian@olddog.co.uk>, TEAS WG <teas@ietf.org>
Thread-Topic: [Teas] What SLOs and SLEs should be in the Slicing Service Model?
Thread-Index: Adg+ux+qPW46+KPXStClMmX63fu0igAAjZ1wADI+NIAAAGskAAAAGJaAAAB7roAAAEr0AAAAPpYAADvK64AAAY4DAAAEQZUwAAT5S4AAHzmR8A==
Date: Sat, 26 Mar 2022 15:35:35 +0000
Message-ID: <BY3PR05MB80810A285729D7E4AC36CBABC71B9@BY3PR05MB8081.namprd05.prod.outlook.com>
References: <001001d83ebc$759fa480$60deed80$@olddog.co.uk> <5555_1648044491_623B29CB_5555_257_4_8693a9ff074e4aa18f1c6098791f836c@orange.com> <0c243152-e58f-e71d-6d42-df09933dcffe@joelhalpern.com> <15388_1648130629_623C7A45_15388_1_2_9344dd3ead7e404996bc1abfa0e39081@orange.com> <3a917051-7ac5-240b-b738-1cb2ed4b7491@joelhalpern.com> <18986_1648131629_623C7E2D_18986_340_25_72aafee7391b4faa87587f50bf3100fd@orange.com> <e4e48783-4ce9-3a6f-953f-319c934d819e@joelhalpern.com> <2347_1648132547_623C81C3_2347_400_3_530dad9f874a4488b0db998365202dd9@orange.com> <CABNhwV3O0h9-vyke5eUOY5q+9PQ4yQBr6vXtyV1zEik+-z0-BA@mail.gmail.com> <61ab2fb5-c417-a6ce-78c1-ebef67c77311@joelhalpern.com> <BY3PR05MB8081A785977E4D03BB03FC3AC71A9@BY3PR05MB8081.namprd05.prod.outlook.com> <CABNhwV0KdpcAYp_gurYoxgpVcAGFm69bcrqYYYZUBM-bTizNqQ@mail.gmail.com>
In-Reply-To: <CABNhwV0KdpcAYp_gurYoxgpVcAGFm69bcrqYYYZUBM-bTizNqQ@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
dlp-product: dlpe-windows
dlp-version: 11.6.401.20
dlp-reaction: no-action
msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=true; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2022-03-26T15:35:33Z; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Method=Standard; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Name=0633b888-ae0d-4341-a75f-06e04137d755; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ActionId=88bb5d24-fd55-41bf-ab8c-130677dfda51; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ContentBits=2
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 927b12d8-5c69-4e37-d189-08da0f3e458a
x-ms-traffictypediagnostic: CO1PR05MB8395:EE_
x-ms-exchange-atpmessageproperties: SA|SL
x-microsoft-antispam-prvs: <CO1PR05MB8395D4A0C54AAE0BDB988ABEC71B9@CO1PR05MB8395.namprd05.prod.outlook.com>
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: OI0HgRIoXMQl7ueeEupa78enahD1JvvpxpxUg0c5wIQs6JDkgSXZwsC210ruNzU7q6RoOq8c4icN09ntuQkCWaRFKR4mgFQu5MZr3Vl1JI6zaQEtq3GQogD3IrmXXAAR+uFpoexg9xUUF8QboL6Y3azhUihqZzfVL4Sg0a/fpNx7LbRGoa35CdfGDPUrvK+yAxW5qKjDWoz9ORrzt+c0rEE8PzU67ryxFaeMxKZeWYkR0weEtCTLmY9FEhsKKwpqxlzgv4uEvABSsqb62zRtEDNy89CZwm5delBbjk9dsVPlAJEPBCVK/HRFYCvseIM/KMuSs9yRlzSpyjuo4NpmDD+0wGMXILatpk0D9WWYXIbOUruMGGEuLYGUx2ZEeAkoHHFA3rFMyObKLe1RdqPvTSgMImpAEQ9RAti44TxR5dhbMNe55aIJJ70Vrk33B1l45/iskmNfiNPkhzU/CREfQC2dzJSQQ1R1XPhoJ19W26P2MaeqpndXC290y6ML8Hy+RB2vxNdI3mkwA7OeyFgpMy7JW8DR3sZF37JgQ7ZQWb/8QGhH8LVREKtXrS5XGWcC+dFMB+jFRYTNGiNpclxf3xAtvcQh+N5uSa5++PYnxNcXStRF9bC2BKF9ZQu6d/d7qDrWiMuqnwzvs5l36/Kk6Mk2OYm83f2JLSX9aUwZ3A/mswChcpk3UQb4h5apYkprai/DivUFYy/8gUNYZVod8zjoHRdiWMuWkZqzDMOEcXQrgq+c8hGx3y7hpmWcO5yjupraYilIk9M8wjDDUhpvHLIXLVzl7n1fmYxyxwHY1sincxu465b4FHwWrbVH7O5JJ/X40hqPRZ4URL36gnKde8bsFUKjBTqSH7kQ34Vlqfkqll7Q21pbP7HppZmBPiB7
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BY3PR05MB8081.namprd05.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230001)(4636009)(366004)(508600001)(38100700002)(122000001)(86362001)(53546011)(38070700005)(7696005)(166002)(54906003)(6916009)(83380400001)(6506007)(52536014)(8936002)(9326002)(316002)(9686003)(64756008)(66476007)(66556008)(33656002)(66446008)(66946007)(966005)(76116006)(55016003)(4326008)(8676002)(2906002)(30864003)(5660300002)(40140700001)(71200400001)(186003)(26005)(579004); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: V6bJUQgmYvfzNMuBH/DRn4S64Z6QbQb9d7ZdFafPloR18KibOS+O/eUioER3TjKcncXgXueYIRRqDj5PxCvBpqR3+WhXxDxqTLB73p21CYf2W67EvLfNe5fJ/RgI2NYCGVgM3xx4GDxrFc4Ds1FcgaQtByl+CesIAuO4S7iK+XMpVHVnTr7vTcpqlT55t5fI8Jm9tWOfkX4rZxh9HshjnT996Wa/uLt2m2J+Raij1JVREB4wR9s2Lky8KT5ZzWpHbAIZRTmEuloyvxvMT/oRmyZBfZVXdIWquYbdnQu2bzwdtLUPKqv8rNmqsUi/hbFZZDZfmaw7A3UXifze9hR40g/nGtU6kRpGuO1QbvQVDIfXPD73NZ93K1KL7QFm5JRiyT9vw2zi76GvYkFl6wh5VVZ+uZb+OkVOdnQbcTj6aIeQcGWOPycCQo9npNOZgAB0SLUunc3WXAafuHLKCX/0OORiMtl7PUHEcc1oAxljBZPJiNOfbjmrKd9480zjU1wV2yB9/SG+Gi4VT3f5gLyv4ZmBc1ChtWjDCSaUNCGejyeS0J4+LcGF0To828LtPcSQ4vQSxJA3AD/9Cw225gcwHnWrdVu63d7cJjLi4t7/dUYE1IMEtm/v6IVbbehq20WG50qSmIGHqNz80hqE25SSLDdfEItW6CIK42GAR5T0Xxm90QrnCb0Lm5AtUhOrghBVhAaVF9+Kr/YJo0jWC5NJolbbVWy6t3knAaWt/nmdxHXYE4N+/I2ofDwGaH3tNEQ1aZOiFjG6mvxLZXZqPcZtBc/l9aTf7ryHKEstzG3CyPjYqVKlk/2Q3+ROyiB5CpjydqFsQwKYgZkUSHiEdfaaOxCIqGOlN2wujFtn0CfJCZgMFIzgkcQuxQkiQKrlEpurVa2N8rNCHOXeWS6zkeXk8qDLPR2pzi/ZEWorXGFjplUECvlqDrMeOUcyIe2e5IFcvbFc2vJYYj3gf6U/EYAmdoh+g568LHm6I5aNhqav+mMlcYbdZoY7rBiiVZ5/l4wSctfz8lkXgOowtORIBXLOHhMgVoeNnNKU0sfEDMB75h5D7ya61MhktwAY6rnD3axHAvIeWqnesjLjg/DgEeMcXeszNaOodVNlg4LJK0MEnjGfEwnhihrGJtheMBT/eBIIG1EumepH6XQn+R6HpdLs9nRQHdBeANEYqFvzOPGsXMb9uZ1EiwH3MexHGXobhsuFgszLorN305W2O2RtSHPNSAAeyXe2GuVv9H0LwGgD3tCKo/+SdnFgzMJ2WWJBhSqnqg3Csppts1i11TYuTPzXr5l+B1wSpvX3aj05HABwKn/MdGM/lmapDb+3nc53QHeywmz276CHNeQ7kPByaEwGGQGp3mtKs8LNhmti6ZNH4FgdUhVy9utAS0Tjc46SS86igjdWdJoa7hZr8MpKTmgYxp+KB0N42Qz5qcnCcMuHTS1l1HX/sJkmCMD0HYsbZNbpL7GbgputHQxs3dw/TB/FHNjOzBniPjIUr37ssexow7sVyRYF3XTru/lYawplaHAiVepvxirL0zsxxysl6UMe7+xNqAEhJpaeeYenCEVgkqWkYKyvRGrG3xmjyDfqpJKVSj1wAPpiAcfk9AnPl7CNHZjTsyedQ9aCVgSRWcviyUniOhBtT1B4rQmnaC1ZMLBpyWOj/fymUHxXZZKlO90Oryj0s9oJnLX0YLIRRv/uFQlDq65/cBCQKXyqUvkX+SiD1A7TTPILk43gD3jLDFvI0A==
Content-Type: multipart/alternative; boundary="_000_BY3PR05MB80810A285729D7E4AC36CBABC71B9BY3PR05MB8081namp_"
MIME-Version: 1.0
X-OriginatorOrg: juniper.net
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BY3PR05MB8081.namprd05.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 927b12d8-5c69-4e37-d189-08da0f3e458a
X-MS-Exchange-CrossTenant-originalarrivaltime: 26 Mar 2022 15:35:35.4211 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: Zgp5DZhX5IqwtHTm/j1jfW1MCQgTzpQBIT7cTxbCn5sUc6X7FVJcwSDuZThkCWi/5jq3FMBDiJw304DNED4/Ag==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO1PR05MB8395
X-Proofpoint-ORIG-GUID: 9zcZdODPbgqV9T4uOAnfbtthbRH_8id-
X-Proofpoint-GUID: 9zcZdODPbgqV9T4uOAnfbtthbRH_8id-
X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.850,Hydra:6.0.425,FMLib:17.11.64.514 definitions=2022-03-26_06,2022-03-24_01,2022-02-23_01
X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 impostorscore=0 bulkscore=0 clxscore=1015 mlxlogscore=999 phishscore=0 lowpriorityscore=0 priorityscore=1501 malwarescore=0 adultscore=0 spamscore=0 suspectscore=0 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2202240000 definitions=main-2203260100
Archived-At: <https://mailarchive.ietf.org/arch/msg/teas/jlrslnSAV42yHBINDz13PgBeyRs>
Subject: Re: [Teas] What SLOs and SLEs should be in the Slicing Service Model?
X-BeenThere: teas@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Traffic Engineering Architecture and Signaling working group discussion list <teas.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/teas>, <mailto:teas-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/teas/>
List-Post: <mailto:teas@ietf.org>
List-Help: <mailto:teas-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/teas>, <mailto:teas-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 26 Mar 2022 15:35:49 -0000

Hi,

Comments inline below.

Yours Irrespectively,

John



Juniper Business Use Only
From: Gyan Mishra <hayabusagsm@gmail.com>
Sent: Friday, March 25, 2022 8:17 PM
To: John E Drake <jdrake@juniper.net>
Cc: Joel M. Halpern <jmh@joelhalpern.com>; adrian@olddog.co.uk; TEAS WG <teas@ietf.org>
Subject: Re: [Teas] What SLOs and SLEs should be in the Slicing Service Model?

[External Email. Be cautious of content]

John / All

Per this thread where we are discussing what SLO/SLE taxonomy should be in the service model does bring up some questions related to the network slice draft.

In the thread as Adrian started off the thread stating that Protection qualifies as an SLE  but Reliability is definitely an SLO and there may be a gray area of whether or not it's one or the other.

[JD]  Protection is actually a technique that a service provider may use to provide reliability

I wonder if there could be characteristics that could be both SLO & SLE?

[JD]  Do you have any in mind?

The term measurable  & unmeasurable realization feature really helps define what characteristics define an SLO or SLE.

[JD]  Correct.  I think this argues against a characteristic that can be both an SLO and an SLE

Does not have to be an exhaustive list but I think more than just the common SLO's & SLE's.  I think the gray area ones we should try to spell out in the draft.

[JD]  I would love to hear of a characteristic which is both.  If we find any we can deal with them

Below are good points that Med brought up and I think are applicable to section 4 of the draft. Especially that over time the what maybe an SLE today maybe an SLO tomorrow and vice versa.

[JD]  That's fine, but  1) there was never any intention to enumerate all possible characteristics, which is probably impossible, and tag each as either an SLO or an SLE and 2)  the set of SLOs and SLEs negotiated between a customer and its service provider(s) is ultimately a matter between them;  i.e., it is not a matter in which we are involved

Flip side of that is maybe to only spell out the concrete ones that will never change sides.

[JD]  See above

**Mentioned by Med at the beginning of this thread***

* Things would be much simpler if we just focus on service requirements without making an assumption how such requirement is expressed and whether it is quantified/quantitative/qualitative/measurable/etc. Whether/how a specific service requirement is covered by service assurance/fulfillment can be part of the slice service definition itself.

* What we may tag as an SLE today because of the technology limitations, may not stay as such forever. It may be true that an "expectation" may not be easily assessed using current techniques (and thus be tagged as SLE), but this does not prevent that innovative means would be defined in the future (which means that it is an SLO, not an SLE anymore).

* We are artificially adding extra complexity for the modelling part as service requirement will need to be classified based as SLO or SLEs.

[JD]  I agree with the second statement, above, but since we are simply trying to introduce the concepts of SLO and SLE, which are clearly different, and not enumerate all possible characteristics and tag each as being either an SLO or an SLE, I think it's largely irrelevant

We can branch this off on a separate thread if everyone thinks there is any merit to follow up on this topic.

Kind Regards

Gyan

On Fri, Mar 25, 2022 at 5:55 PM John E Drake <jdrake@juniper.net<mailto:jdrake@juniper.net>> wrote:
Did we not make it clear that SLOs and SLEs are used to create an SLA?

Yours Irrespectively,

John


Juniper Business Use Only

> -----Original Message-----
> From: Teas <teas-bounces@ietf.org<mailto:teas-bounces@ietf.org>> On Behalf Of Joel M. Halpern
> Sent: Friday, March 25, 2022 3:52 PM
> To: Gyan Mishra <hayabusagsm@gmail.com<mailto:hayabusagsm@gmail.com>>
> Cc: adrian@olddog.co.uk<mailto:adrian@olddog.co.uk>; TEAS WG <teas@ietf.org<mailto:teas@ietf.org>>
> Subject: Re: [Teas] What SLOs and SLEs should be in the Slicing Service Model?
>
> [External Email. Be cautious of content]
>
>
> Sounds like we need to clarify the verbiage.  SLEs are, as I understand it, indeed
> non-measurables.  But they are not the legal translation of the SLOs.  They are
> expression of customer expectations that are not directly observable or
> measurable.  The example I have the easiest time understanding is that the
> customer expects the operator to encrypt the traffic across the service.
>
> Yours,
> Joel
>
> On 3/25/2022 3:07 PM, Gyan Mishra wrote:
> > Hi Med & Joel
> >
> > I reread section 4.1 of the slice draft and to me it seems that SLO is
> > from provider POV measurable indicators and SLE is the is unmeasurable
> > expectations which is makes up the customer fulfillment of obligations
> > by the provider which would be like taking the tangible measurement
> > characteristics from the SLO and translation into legal obligation
> > fulfillment verbiage that goes into the service agreement.  So as the
> > SLE is not tangible but just a translation of SLO metrics into legal
> > verbiage my thoughts are that the framework as well as Yang model need
> > only focus on the SLO tangible metrics and leave the intangible for
> > the lawyers writing the customer agreement.
> >
> >
> > 4.1
> > <https://urldefense.com/v3/__https://datatracker.ietf.org/doc/html/draft-<https://urldefense.com/v3/__https:/datatracker.ietf.org/doc/html/draft->
> ietf-teas-ietf-network-slices-09*section-4.1__;Iw!!NEt6yMaO-
> gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_-
> LiOR92MnzCJzyL9ESsViw$ >.
> > Objectives for IETF Network Slices
> >
> >     An IETF Network Slice service is defined in terms of quantifiable
> >     characteristics known as Service Level Objectives (SLOs) and
> >     unquantifiable characteristics known as Service Level Expectations
> >     (SLEs).  SLOs are expressed in terms Service Level Indicators (SLIs),
> >     and together with the SLEs form the contractual agreement between
> >     service customer and service provider known as a Service Level
> >     Agreement (SLA).
> >
> >     The terms are defined as follows:
> >
> >     *  A Service Level Indicator (SLI) is a quantifiable measure of an
> >        aspect of the performance of a network.  For example, it may be a
> >        measure of throughput in bits per second, or it may be a measure
> >        of latency in milliseconds.
> >
> >     *  A Service Level Objective (SLO) is a target value or range for the
> >        measurements returned by observation of an SLI.  For example, an
> >        SLO may be expressed as "SLI <= target", or "lower bound <= SLI <=
> >        upper bound".  A customer can determine whether the provider is
> >        meeting the SLOs by performing measurements on the traffic.
> >
> >     *  A Service Level Expectation (SLE) is an expression of an
> >        unmeasurable service-related request that a customer of an IETF
> >        Network Slice makes of the provider.  An SLE is distinct from an
> >        SLO because the customer may have little or no way of determining
> >        whether the SLE is being met, but they still contract with the
> >        provider for a service that meets the expectation.
> >
> >
> >
> > On Thu, Mar 24, 2022 at 10:36 AM <mohamed.boucadair@orange.com<mailto:mohamed.boucadair@orange.com>
> > <mailto:mohamed.boucadair@orange.com<mailto:mohamed.boucadair@orange.com>>> wrote:
> >
> >     Re-,
> >
> >     They shouldn't!
> >
> >     This is why I'm suggesting to not have that tagging frozen in the
> >     model. We can simply have a provision for a set of parameters. These
> >     parameters will be included to characterize the service with a
> >     service assurance component that will call out the identity of the
> >     subset of parameters that will be used as committed ones. That
> >     component will also include other data to ensure the same based used
> >     for assessment, etc.
> >
> >     Cheers,
> >     Med
> >
> >      > -----Message d'origine-----
> >      > De : Joel M. Halpern <jmh@joelhalpern.com<mailto:jmh@joelhalpern.com>
> >     <mailto:jmh@joelhalpern.com<mailto:jmh@joelhalpern.com>>>
> >      > Envoyé : jeudi 24 mars 2022 15:29
> >      > À : BOUCADAIR Mohamed INNOV/NET
> <mohamed.boucadair@orange.com<mailto:mohamed.boucadair@orange.com>
> >     <mailto:mohamed.boucadair@orange.com<mailto:mohamed.boucadair@orange.com>>>
> >      > Cc : 'TEAS WG' <teas@ietf.org<mailto:teas@ietf.org> <mailto:teas@ietf.org<mailto:teas@ietf.org>>>;
> >     adrian@olddog.co.uk<mailto:adrian@olddog.co.uk> <mailto:adrian@olddog.co.uk<mailto:adrian@olddog.co.uk>>
> >      > Objet : Re: [Teas] What SLOs and SLEs should be in the Slicing
> >     Service
> >      > Model?
> >      >
> >      > If the others are best effort, why would they be included in the SLO?
> >      > (We do not assume that every IETF network slice service will
> >     specify all
> >      > possible parameters.)
> >      >
> >      > Yours,
> >      > Joel
> >      >
> >      > On 3/24/2022 10:20 AM, mohamed.boucadair@orange.com<mailto:mohamed.boucadair@orange.com>
> >     <mailto:mohamed.boucadair@orange.com<mailto:mohamed.boucadair@orange.com>> wrote:
> >      > > Re-,
> >      > >
> >      > > Some services may be sensitive to delay for example but the
> >     slice service
> >      > request may include (for whatever reason) not only the delay, but
> >     also
> >      > other attributes that are currently listed as SLOs in the draft. The
> >      > provider is requested to only commit on the delay and best effort
> >     for the
> >      > other attributes.
> >      > >
> >      > > Cheers,
> >      > > Med
> >      > >
> >      > >> -----Message d'origine-----
> >      > >> De : Joel M. Halpern <jmh@joelhalpern.com<mailto:jmh@joelhalpern.com>
> >     <mailto:jmh@joelhalpern.com<mailto:jmh@joelhalpern.com>>> Envoyé : jeudi 24 mars
> >      > >> 2022 15:07 À : BOUCADAIR Mohamed INNOV/NET
> >      > >> <mohamed.boucadair@orange.com<mailto:mohamed.boucadair@orange.com>
> >     <mailto:mohamed.boucadair@orange.com<mailto:mohamed.boucadair@orange.com>>> Cc : 'TEAS WG'
> <teas@ietf.org<mailto:teas@ietf.org>
> >     <mailto:teas@ietf.org<mailto:teas@ietf.org>>>;
> >      > >> adrian@olddog.co.uk<mailto:adrian@olddog.co.uk> <mailto:adrian@olddog.co.uk<mailto:adrian@olddog.co.uk>> Objet : Re:
> >     [Teas] What SLOs and SLEs should be
> >      > >> in the Slicing Service Model?
> >      > >>
> >      > >> Interesting.  If they are indeed not coupled, then you are clearly
> >      > >> correct about representation.
> >      > >>
> >      > >> Can you give an example so I can understand when they would not be
> >      > coupled.
> >      > >> I had leapt to the (quite possibly incorrect) conclusion that
> >     the two
> >      > >> sets of properties went together.
> >      > >>
> >      > >> Thank you,
> >      > >> Joel
> >      > >>
> >      > >> On 3/24/2022 10:03 AM, mohamed.boucadair@orange.com<mailto:mohamed.boucadair@orange.com>
> >     <mailto:mohamed.boucadair@orange.com<mailto:mohamed.boucadair@orange.com>> wrote:
> >      > >>> Hi Joel,
> >      > >>>
> >      > >>> It is.
> >      > >>>
> >      > >>> As mentioned below, this should be covered as part of service
> >      > >> assurance/fulfillment/reporting parameters. Which parameters
> >     to put
> >      > >> there is deployment-specific. Not all parameters tagged as SLO
> >     in the
> >      > >> framework will end up as part of the
> >     assurance/fulfillment/reporting.
> >      > >>>
> >      > >>> Cheers,
> >      > >>> Med
> >      > >>>
> >      > >>>> -----Message d'origine-----
> >      > >>>> De : Joel M. Halpern <jmh@joelhalpern.com<mailto:jmh@joelhalpern.com>
> >     <mailto:jmh@joelhalpern.com<mailto:jmh@joelhalpern.com>>> Envoyé : jeudi 24 mars
> >      > >>>> 2022 14:52 À : BOUCADAIR Mohamed INNOV/NET
> >      > >>>> <mohamed.boucadair@orange.com<mailto:mohamed.boucadair@orange.com>
> >     <mailto:mohamed.boucadair@orange.com<mailto:mohamed.boucadair@orange.com>>>; adrian@olddog.co.uk<mailto:adrian@olddog.co.uk>
> >     <mailto:adrian@olddog.co.uk<mailto:adrian@olddog.co.uk>>; 'TEAS WG'
> >      > >>>> <teas@ietf.org<mailto:teas@ietf.org> <mailto:teas@ietf.org<mailto:teas@ietf.org>>> Objet : Re: [Teas]
> >     What SLOs and SLEs should be in
> >      > >>>> the Slicing Service Model?
> >      > >>>>
> >      > >>>> Isn't it important to distinguish between "these are things I
> >      > >>>> expect you to do, measure, and report" and "these are things I
> >      > >>>> would like you to do even though they are not measurable or
> >      > reportable"?
> >      > >>>>
> >      > >>>> Yours,
> >      > >>>> Joel
> >      > >>>>
> >      > >>>> On 3/23/2022 10:08 AM, mohamed.boucadair@orange.com<mailto:mohamed.boucadair@orange.com>
> >     <mailto:mohamed.boucadair@orange.com<mailto:mohamed.boucadair@orange.com>> wrote:
> >      > >>>>> Hi all,
> >      > >>>>>
> >      > >>>>> This message actually triggers a companion comment I have
> >     on the
> >      > >>>>> SLO/SLE
> >      > >>>> taxonomy. From the service modeling standpoint, I suggest
> >     that we
> >      > >>>> don't inherit that taxonomy for various reasons:
> >      > >>>>>
> >      > >>>>> * Things would be much simpler if we just focus on service
> >      > >>>>> requirements
> >      > >>>> without making an assumption how such requirement is
> >     expressed and
> >      > >>>> whether it is
> >     quantified/quantitative/qualitative/measurable/etc.
> >      > >>>> Whether/how a specific service requirement is covered by service
> >      > >>>> assurance/fulfillment can be part of the slice service
> >     definition
> >      > >> itself.
> >      > >>>>>
> >      > >>>>> * What we may tag as an SLE today because of the technology
> >      > >>>>> limitations,
> >      > >>>> may not stay as such forever. It may be true that an
> >     "expectation"
> >      > >>>> may not be easily assessed using current techniques (and thus be
> >      > >>>> tagged as SLE), but this does not prevent that innovative means
> >      > >>>> would be defined in the future (which means that it is an
> >     SLO, not
> >      > >>>> an SLE
> >      > >> anymore).
> >      > >>>>>
> >      > >>>>> * We are artificially adding extra complexity for the modelling
> >      > >>>>> part as
> >      > >>>> service requirement will need to be classified based as SLO
> >     or SLEs.
> >      > >>>>>
> >      > >>>>> * I remember that Kiran agreed at least to not import that
> >      > >>>>> taxonomy into
> >      > >>>> the data model when we were discussing the call for adoption
> >     of the
> >      > >>>> slice
> >      > >>>> definition:
> >      > >>>>>
> >      > >>>>> ==(the full message from Kiran can be found in the archives)===
> >      > >>>>> "However, it should not imply that NBI models are required
> >     to have
> >      > >>>> SLE/SLO indicators and I totally agreed with your comments on
> >      > >>>> draft-wd- teas-ietf-network-slice-nbi-yang-03"
> >      > >>>>> ==
> >      > >>>>>
> >      > >>>>> Cheers,
> >      > >>>>> Med
> >      > >>>>>
> >      > >>>>>> -----Message d'origine-----
> >      > >>>>>> De : Teas <teas-bounces@ietf.org<mailto:teas-bounces@ietf.org>
> >     <mailto:teas-bounces@ietf.org<mailto:teas-bounces@ietf.org>>> De la part de Adrian Farrel
> >      > >>>>>> Envoyé
> >      > >>>>>> : mercredi 23 mars 2022 14:47 À : 'TEAS WG' <teas@ietf.org<mailto:teas@ietf.org>
> >     <mailto:teas@ietf.org<mailto:teas@ietf.org>>> Objet :
> >      > >>>>>> [Teas] What SLOs and SLEs should be in the Slicing Service
> >     Model?
> >      > >>>>>>
> >      > >>>>>> Hi,
> >      > >>>>>>
> >      > >>>>>> Sorry for my audio being a mess in TEAS today.
> >      > >>>>>>
> >      > >>>>>> I believe I heard the discussion between Kireeti and Reza
> >      > >>>>>> correctly, and there was some follow-up in the chat.
> >      > >>>>>>
> >      > >>>>>> I agree that "Protection" is a realisation feature and so it
> >      > >>>>>> qualifies as an SLE, if at all.
> >      > >>>>>> But "Reliability" is clearly an SLO. Usually expressed as
> >     maximum
> >      > >>>>>> down- time per unit of time, or maximum lost traffic.
> >      > >>>>>>
> >      > >>>>>> There was one thing that I *think* I heard. This was Reza
> >     saying
> >      > >>>>>> that the service YANG model was only including the SLOs
> >     and SLEs
> >      > >>>>>> noted in the framework. Maybe I misheard "only" because I
> >     think
> >      > >>>>>> that might be a mistake.
> >      > >>>>>> The YANG model should certainly be interested in what the
> >      > >>>>>> framework says, but it is not a requirement that all SLOs and
> >      > >>>>>> SLEs in the framework be in the model if the authors find that
> >      > >>>>>> there is no interest in implementing them, and there should
> >      > >>>>>> certainly be no limitation about including additional SLOs
> >     or SLEs
> >      > in the YANG model.
> >      > >>>>>> Indeed, the SLOs and SLEs listed in the framework are
> >     presented
> >      > >>>>>> as
> >      > >>>> examples.
> >      > >>>>>>
> >      > >>>>>> Cheers,
> >      > >>>>>> Adrian
> >      > >>>>>>
> >      > >>>>>> _______________________________________________
> >      > >>>>>> Teas mailing list
> >      > >>>>>> Teas@ietf.org<mailto:Teas@ietf.org> <mailto:Teas@ietf.org<mailto:Teas@ietf.org>>
> >      > >>>>>>
> https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/teas__;!!N<https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/teas__;!!N>
> Et6yMaO-gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_-
> LiOR92MnzCJzyLzCREI4M$
> >
> <https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/teas__;<https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/teas__;>!!
> NEt6yMaO-gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_-
> LiOR92MnzCJzyLzCREI4M$ >
> >      > >>>>>
> >      > >>>>>
> >
> _________________________________________________________________
> _
> >      > >>>>> __ __
> ___________________________________________________
> >      > >>>>>
> >      > >>>>> Ce message et ses pieces jointes peuvent contenir des
> >     informations
> >      > >>>>> confidentielles ou privilegiees et ne doivent donc pas etre
> >      > >>>>> diffuses, exploites ou copies sans autorisation. Si vous
> >     avez recu
> >      > >>>>> ce message par erreur, veuillez le signaler a l'expediteur
> >     et le
> >      > >>>>> detruire ainsi que
> >      > >>>> les pieces jointes. Les messages electroniques etant
> >     susceptibles
> >      > >>>> d'alteration, Orange decline toute responsabilite si ce
> >     message a
> >      > >>>> ete altere, deforme ou falsifie. Merci.
> >      > >>>>>
> >      > >>>>> This message and its attachments may contain confidential or
> >      > >>>>> privileged information that may be protected by law; they
> >     should
> >      > >>>>> not be
> >      > >>>> distributed, used or copied without authorisation.
> >      > >>>>> If you have received this email in error, please notify the
> >     sender
> >      > >>>>> and
> >      > >>>> delete this message and its attachments.
> >      > >>>>> As emails may be altered, Orange is not liable for messages
> >     that
> >      > >>>>> have
> >      > >>>> been modified, changed or falsified.
> >      > >>>>> Thank you.
> >      > >>>>>
> >      > >>>>> _______________________________________________
> >      > >>>>> Teas mailing list
> >      > >>>>> Teas@ietf.org<mailto:Teas@ietf.org> <mailto:Teas@ietf.org<mailto:Teas@ietf.org>>
> >      > >>>>>
> https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/teas__;!!N<https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/teas__;!!N>
> Et6yMaO-gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_-
> LiOR92MnzCJzyLzCREI4M$
> >
> <https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/teas__;<https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/teas__;>!!
> NEt6yMaO-gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_-
> LiOR92MnzCJzyLzCREI4M$ >
> >      > >>>
> >      > >>>
> >
> _________________________________________________________________
> ___
> >      > >>> __ ___________________________________________________
> >      > >>>
> >      > >>> Ce message et ses pieces jointes peuvent contenir des
> >     informations
> >      > >>> confidentielles ou privilegiees et ne doivent donc pas etre
> >      > >>> diffuses, exploites ou copies sans autorisation. Si vous avez
> >     recu
> >      > >>> ce message par erreur, veuillez le signaler a l'expediteur et le
> >      > >>> detruire ainsi que
> >      > >> les pieces jointes. Les messages electroniques etant susceptibles
> >      > >> d'alteration, Orange decline toute responsabilite si ce
> >     message a ete
> >      > >> altere, deforme ou falsifie. Merci.
> >      > >>>
> >      > >>> This message and its attachments may contain confidential or
> >      > >>> privileged information that may be protected by law; they
> >     should not
> >      > >>> be
> >      > >> distributed, used or copied without authorisation.
> >      > >>> If you have received this email in error, please notify the
> >     sender
> >      > >>> and
> >      > >> delete this message and its attachments.
> >      > >>> As emails may be altered, Orange is not liable for messages that
> >      > >>> have
> >      > >> been modified, changed or falsified.
> >      > >>> Thank you.
> >      > >>>
> >      > >
> >      > >
> >
> _________________________________________________________________
> _____
> >      > > ___________________________________________________
> >      > >
> >      > > Ce message et ses pieces jointes peuvent contenir des informations
> >      > > confidentielles ou privilegiees et ne doivent donc pas etre
> >     diffuses,
> >      > > exploites ou copies sans autorisation. Si vous avez recu ce message
> >      > > par erreur, veuillez le signaler a l'expediteur et le detruire
> >     ainsi que
> >      > les pieces jointes. Les messages electroniques etant susceptibles
> >      > d'alteration, Orange decline toute responsabilite si ce message a ete
> >      > altere, deforme ou falsifie. Merci.
> >      > >
> >      > > This message and its attachments may contain confidential or
> >      > > privileged information that may be protected by law; they
> >     should not be
> >      > distributed, used or copied without authorisation.
> >      > > If you have received this email in error, please notify the
> >     sender and
> >      > delete this message and its attachments.
> >      > > As emails may be altered, Orange is not liable for messages
> >     that have
> >      > been modified, changed or falsified.
> >      > > Thank you.
> >      > >
> >
> >
> >
> _________________________________________________________________
> _____
> > ___________________________________________________
> >
> >     Ce message et ses pieces jointes peuvent contenir des informations
> >     confidentielles ou privilegiees et ne doivent donc
> >     pas etre diffuses, exploites ou copies sans autorisation. Si vous
> >     avez recu ce message par erreur, veuillez le signaler
> >     a l'expediteur et le detruire ainsi que les pieces jointes. Les
> >     messages electroniques etant susceptibles d'alteration,
> >     Orange decline toute responsabilite si ce message a ete altere,
> >     deforme ou falsifie. Merci.
> >
> >     This message and its attachments may contain confidential or
> >     privileged information that may be protected by law;
> >     they should not be distributed, used or copied without authorisation.
> >     If you have received this email in error, please notify the sender
> >     and delete this message and its attachments.
> >     As emails may be altered, Orange is not liable for messages that
> >     have been modified, changed or falsified.
> >     Thank you.
> >
> >     _______________________________________________
> >     Teas mailing list
> >     Teas@ietf.org<mailto:Teas@ietf.org> <mailto:Teas@ietf.org<mailto:Teas@ietf.org>>
> >
> https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/teas__;!!N<https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/teas__;!!N>
> Et6yMaO-gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_-
> LiOR92MnzCJzyLzCREI4M$
> >
> > <https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/tea<https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/tea>
> > s__;!!NEt6yMaO-gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_-
> LiOR92MnzC
> > JzyLzCREI4M$ >
> >
> > --
> >
> > <https://urldefense.com/v3/__http://www.verizon.com/__;!!NEt6yMaO-gk!V<https://urldefense.com/v3/__http:/www.verizon.com/__;!!NEt6yMaO-gk!V>
> > rEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_-LiOR92MnzCJzyLqOCoT3c$
> >
> >
> > *Gyan Mishra*
> >
> > /Network Solutions A//rchitect /
> >
> > /Email gyan.s.mishra@verizon.com<mailto:gyan.s.mishra@verizon.com> <mailto:gyan.s.mishra@verizon.com<mailto:gyan.s.mishra@verizon.com>>//
> > /
> >
> > /M 301 502-1347
> >
> > /
> >
> >
>
> _______________________________________________
> Teas mailing list
> Teas@ietf.org<mailto:Teas@ietf.org>
> https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/teas__;!!N<https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/teas__;!!N>
> Et6yMaO-gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_-
> LiOR92MnzCJzyLzCREI4M$


--

[http://ss7.vzw.com/is/image/VerizonWireless/vz-logo-email]<https://urldefense.com/v3/__http:/www.verizon.com/__;!!NEt6yMaO-gk!RvVLz0GpjIyf2oVvTxnMgHzO5_TsnvXLYRGzpTsQSjwAIOP5-Q9vlZiJlwa0Nuw$>

Gyan Mishra

Network Solutions Architect

Email gyan.s.mishra@verizon.com<mailto:gyan.s.mishra@verizon.com>

M 301 502-1347