Re: [Teas] Protection: SLO or SLE? [Re: What SLOs and SLEs should be in the Slicing Service Model?]
Gyan Mishra <hayabusagsm@gmail.com> Sat, 26 March 2022 22:04 UTC
Return-Path: <hayabusagsm@gmail.com>
X-Original-To: teas@ietfa.amsl.com
Delivered-To: teas@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id AEB793A19BF for <teas@ietfa.amsl.com>; Sat, 26 Mar 2022 15:04:26 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_REMOTE_IMAGE=0.01, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id B59qjVdvrNZH for <teas@ietfa.amsl.com>; Sat, 26 Mar 2022 15:04:18 -0700 (PDT)
Received: from mail-pg1-x52e.google.com (mail-pg1-x52e.google.com [IPv6:2607:f8b0:4864:20::52e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 9181D3A19F9 for <teas@ietf.org>; Sat, 26 Mar 2022 15:04:17 -0700 (PDT)
Received: by mail-pg1-x52e.google.com with SMTP id w21so9285618pgm.7 for <teas@ietf.org>; Sat, 26 Mar 2022 15:04:17 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=gqnodDGypM7vKYuBDHU1Cynpl7eoNkghDn6VAjsurGs=; b=iQvCRPn2mb5xBjLyRIBvypFW+Sucz+AFl+hHKmZKJtkeoPUCiIAc77HX3nZcJkJ9OY Dk+2k2jKC7gearAw8qwzRc57JTtosCL4UWnNT/+FJJQxVOw4li/qew21YS4lKqXgPFYQ 0LAVqhRJ4cl20wxLNC5zgR8d3ABFK4Njf1NAfyooKJ/FTXJoT59wsK9lfRxMSORn0jHi LJHPTa2qhQYLoCQQl08+taja3cSBArP0s/sgJCMQzdyqaq7R5lvU77Shk6bU9HXKnFt6 Sy/cqtgnKhCbI22UoitGe1YYWpHqqeEcKzmdjYy46ml+JagmxL/0fGGOqtm2J/U4xQtX AJqA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=gqnodDGypM7vKYuBDHU1Cynpl7eoNkghDn6VAjsurGs=; b=ZDicSlPM8AwChPoZtdaQ7bTdqtyhc50w1iokL/iARdGh82BUkrcG8ciKR/uDpDxxkk Y8RJGs2RjdX0BvJZrutaZhRcgoMlQK8MAp6Yyz4gRh1JoAGyFM7GcsE3YFwK6uUvlPQQ gkBqF4VgVYxFkSq3OFUQY6z25FBu60/StgUHgYUb7Sh/mgiCqwyP+Z+rzpK7NfTl1bC5 vbQmrHdYgb1tVLFnVrVsffWMyaMUrLXsPtByBUadSoNhmNG2qz40v5/IV8mW++bsHE4J dJzo0PY2zaCq1+qX9eypbWzzvhTnWhqLv7NY2C8wHG69PkZp0ZPy+pRyYogra5JiLTXG UavQ==
X-Gm-Message-State: AOAM531yYVx1IYNSNyNLbUBmQs6NrPqXWYGZG+wkgiaEMwjVoLhQjJaC aTp6gyimpa4QUVIx/5Tpx6tBnGbyBUC7TqSjaFo=
X-Google-Smtp-Source: ABdhPJxgbF/C1UJmH8VBDvmnlEYC4houiPQTk2Fbw4ysYWUZwT0eeC+6ki2zHEaPb8YYWDwBfvn5XnxHHzGA4S2cfmY=
X-Received: by 2002:a05:6a00:a0f:b0:4e1:309:83c0 with SMTP id p15-20020a056a000a0f00b004e1030983c0mr16413440pfh.68.1648332256134; Sat, 26 Mar 2022 15:04:16 -0700 (PDT)
MIME-Version: 1.0
References: <001001d83ebc$759fa480$60deed80$@olddog.co.uk> <5555_1648044491_623B29CB_5555_257_4_8693a9ff074e4aa18f1c6098791f836c@orange.com> <0c243152-e58f-e71d-6d42-df09933dcffe@joelhalpern.com> <15388_1648130629_623C7A45_15388_1_2_9344dd3ead7e404996bc1abfa0e39081@orange.com> <3a917051-7ac5-240b-b738-1cb2ed4b7491@joelhalpern.com> <18986_1648131629_623C7E2D_18986_340_25_72aafee7391b4faa87587f50bf3100fd@orange.com> <e4e48783-4ce9-3a6f-953f-319c934d819e@joelhalpern.com> <2347_1648132547_623C81C3_2347_400_3_530dad9f874a4488b0db998365202dd9@orange.com> <CABNhwV3O0h9-vyke5eUOY5q+9PQ4yQBr6vXtyV1zEik+-z0-BA@mail.gmail.com> <61ab2fb5-c417-a6ce-78c1-ebef67c77311@joelhalpern.com> <BY3PR05MB8081A785977E4D03BB03FC3AC71A9@BY3PR05MB8081.namprd05.prod.outlook.com> <CABNhwV0KdpcAYp_gurYoxgpVcAGFm69bcrqYYYZUBM-bTizNqQ@mail.gmail.com> <BY3PR05MB80810A285729D7E4AC36CBABC71B9@BY3PR05MB8081.namprd05.prod.outlook.com> <CABNhwV22=qVK7HrxyzeyAX5sCTnmyjpvGm_FikPvtJfoup0_Jw@mail.gmail.com> <CA+RyBmWEmUQor+3YSgEgoEaMiw2Wy4mA2aaHDJzQ9zJ20O1rrQ@mail.gmail.com>
In-Reply-To: <CA+RyBmWEmUQor+3YSgEgoEaMiw2Wy4mA2aaHDJzQ9zJ20O1rrQ@mail.gmail.com>
From: Gyan Mishra <hayabusagsm@gmail.com>
Date: Sat, 26 Mar 2022 18:04:05 -0400
Message-ID: <CABNhwV1TmKDDw_Ag9D3kaN3FXgP5=aMcUmZo84hJURW_YsWCYA@mail.gmail.com>
To: Greg Mirsky <gregimirsky@gmail.com>
Cc: John E Drake <jdrake@juniper.net>, TEAS WG <teas@ietf.org>, "adrian@olddog.co.uk" <adrian@olddog.co.uk>
Content-Type: multipart/alternative; boundary="00000000000099484605db2642ca"
Archived-At: <https://mailarchive.ietf.org/arch/msg/teas/_XSSuJenxjywSFtlX60bo8HGEbU>
Subject: Re: [Teas] Protection: SLO or SLE? [Re: What SLOs and SLEs should be in the Slicing Service Model?]
X-BeenThere: teas@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Traffic Engineering Architecture and Signaling working group discussion list <teas.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/teas>, <mailto:teas-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/teas/>
List-Post: <mailto:teas@ietf.org>
List-Help: <mailto:teas-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/teas>, <mailto:teas-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 26 Mar 2022 22:04:36 -0000
Hi Greg Very nicely stated on the protection caveats which historically optical networks optical bypass UPSR BLSR APS switching from working to protect yields a 50ms has always been the bogie number as well for RSVP-TE FRR that within that contracted packet loss ratio SLO for TDM optical and Unified Transport GMPLS optical yielding the same non zero SLO between 0-50ms. Very good point on the DETNET PREOF function yields 0 packet loss guarantee. Are you aware of any implementations of DETNET PREOF as that would be a tremendous benefit for operators and Network slicing as well? Many Thanks Gyan On Sat, Mar 26, 2022 at 4:28 PM Greg Mirsky <gregimirsky@gmail.com> wrote: > Hi Gyan, et al., > I want to share my view on one example that is often used in the > discussion of ETF Network Slice SLO/SLE - the protection. I can agree that > in a contract between a client and the service provider protection can be > listed as SLE with its set of parameters that characterize guaranteed > failure detection time and the efficiency of the service switchover (number > of services to be switched over within guaranteed time interval after the > failure detection). At the same time, all that might be left to the service > provider choice as part of the mechanism to deliver service with below the > contracted packet loss ratio SLO. The provider then decides which > protection method to use and how to tune the parameters. > On a side note. DetNet's PREOF guarantees zero packet loss because the > Elimination function accepts all copies of a packet. In the traditional 1+1 > protection (circuit or path), the receiver accepts flow only from the > working circuit/path. In the case of failure, it would take some time for > the receiver to detect it and switch to the backup source. Thus, even in > 1+1 protection, there will be a non-zero packet loss resulting from a > working path failure that is determined by the failure detection time. > > Regards, > Greg > > On Sat, Mar 26, 2022 at 12:19 PM Gyan Mishra <hayabusagsm@gmail.com> > wrote: > >> >> Hi John >> >> Comments in-line >> >> Kind Regards >> >> Gyan >> >> On Sat, Mar 26, 2022 at 11:35 AM John E Drake <jdrake@juniper.net> wrote: >> >>> Hi, >>> >>> >>> >>> Comments inline below. >>> >>> >>> >>> Yours Irrespectively, >>> >>> >>> >>> John >>> >>> >>> >>> >>> >>> Juniper Business Use Only >>> >>> *From:* Gyan Mishra <hayabusagsm@gmail.com> >>> *Sent:* Friday, March 25, 2022 8:17 PM >>> *To:* John E Drake <jdrake@juniper.net> >>> *Cc:* Joel M. Halpern <jmh@joelhalpern.com>; adrian@olddog.co.uk; TEAS >>> WG <teas@ietf.org> >>> *Subject:* Re: [Teas] What SLOs and SLEs should be in the Slicing >>> Service Model? >>> >>> >>> >>> *[External Email. Be cautious of content]* >>> >>> >>> >>> John / All >>> >>> >>> >>> Per this thread where we are discussing what SLO/SLE taxonomy should be >>> in the service model does bring up some questions related to the network >>> slice draft. >>> >>> >>> >>> In the thread as Adrian started off the thread stating that Protection >>> qualifies as an SLE but Reliability is definitely an SLO and there may be >>> a gray area of whether or not it's one or the other. >>> >>> >>> >>> *[JD] Protection is actually a technique that a service provider may >>> use to provide reliability* >>> >>> >>> >> Gyan> I think most of the SLEs are options or parameters that are >> provisioned and realized by the provider. >> >>> I wonder if there could be characteristics that could be both SLO & SLE? >>> >>> >>> >>> *[JD] Do you have any in mind?* >>> >>> Gyan> After thinking about it further the definitions of SLE and SLO is >>> very clear and I think one key point is that SLO is “directly” measurable >>> as which more a L1 characteristic of the slice where the ones which I might >>> think maybe in that gray area are not directly measurable for example >>> protection. Protection during a failure the result on the 1+1 protected >>> link is 0 packet loss which is realized by the provider and that >>> realization is in the SLE description. So the definition is very clear. >>> >> The term measurable & unmeasurable realization feature really helps >>> define what characteristics define an SLO or SLE. >>> >>> >>> >>> *[JD] Correct. I think this argues against a characteristic that can >>> be both an SLO and an SLE * >>> >>> Gyan> I completely agree it’s impossible for characteristic to be both >>> an SLO and SLE >>> >>> Does not have to be an exhaustive list but I think more than just the >>> common SLO's & SLE's. I think the gray area ones we should try to spell >>> out in the draft. >>> >>> >>> >>> *[JD] I would love to hear of a characteristic which is both. If we >>> find any we can deal with them * >>> >>> Gyan> Agreed. I think the directly measurable and being a “L1 >>> characteristic” it is crystal clear and that does make it quite clear and >>> in my mind difficult to find one but as you stated we can deal with them if >>> it comes up. >>> >>> Below are good points that Med brought up and I think are applicable to >>> section 4 of the draft. Especially that over time the what maybe an SLE >>> today maybe an SLO tomorrow and vice versa. >>> >>> >>> >>> *[JD] That’s fine, but 1) there was never any intention to enumerate >>> all possible characteristics, which is probably impossible, and tag each as >>> either an SLO or an SLE and 2) the set of SLOs and SLEs negotiated between >>> a customer and its service provider(s) is ultimately a matter between >>> them; i.e., it is not a matter in which we are involved* >>> >>> Gyan> Understood and agreed. The key is defining what an SLO and SLE >>> is utmost importance over listing an exhaustive list. With the clear >>> definition gives the reader of the specification a solid understanding so >>> no room for misinterpretation. I believe the we have all done a excellent >>> job many thanks to the WG! >>> >>> Flip side of that is maybe to only spell out the concrete ones that will >>> never change sides. >>> >>> >>> >>> *[JD] See above* >>> >>> >>> >>> **Mentioned by Med at the beginning of this thread*** >>> >>> >>> >>> * Things would be much simpler if we just focus on service requirements >>> without making an assumption how such requirement is expressed and whether >>> it is quantified/quantitative/qualitative/measurable/etc. Whether/how a >>> specific service requirement is covered by service assurance/fulfillment >>> can be part of the slice service definition itself. >>> >> >> Gyan> Agreed on this point >> >>> >>> >>> * What we may tag as an SLE today because of the technology limitations, >>> may not stay as such forever. >>> >> Gyan> I think this is doubtful to happen but if it does we can deal >> with it at that time >> >>> It may be true that an "expectation" may not be easily assessed using >>> current techniques (and thus be tagged as SLE), but this does not prevent >>> that innovative means would be defined in the future (which means that it >>> is an SLO, not an SLE anymore). >>> >> Gyan> With the definition of SLO being directly measurable and a L1 >> slice characteristic there are only so many today and the common ones which >> seems to be the current exhaustive are already listed. I guess it’s >> possible with a new technology could yield a new type of L1 slice >> characteristic that is measurable and then that SLE would become an SLO. >> It’s possible. I don’t think that impacts the draft in any way and SLOs >> and SLE can in theory slide back and forth based on our definition and that >> is not an issue in my mind. >> >>> >>> * We are artificially adding extra complexity for the modelling part as >>> service requirement will need to be classified based as SLO or SLEs. >>> >>> >>> >>> *[JD] I agree with the second statement, above, but since we are simply >>> trying to introduce the concepts of SLO and SLE, which are clearly >>> different, and not enumerate all possible characteristics and tag each as >>> being either an SLO or an SLE, I think it’s largely irrelevant* >>> >>> Gyan> Agreed >>> >>> We can branch this off on a separate thread if everyone thinks there is >>> any merit to follow up on this topic. >>> >>> Gyan> I am all set. Thanks! >>> >>> Kind Regards >>> >>> >>> >>> Gyan >>> >>> >>> >>> On Fri, Mar 25, 2022 at 5:55 PM John E Drake <jdrake@juniper.net> wrote: >>> >>> Did we not make it clear that SLOs and SLEs are used to create an SLA? >>> >>> Yours Irrespectively, >>> >>> John >>> >>> >>> Juniper Business Use Only >>> >>> > -----Original Message----- >>> > From: Teas <teas-bounces@ietf.org> On Behalf Of Joel M. Halpern >>> > Sent: Friday, March 25, 2022 3:52 PM >>> > To: Gyan Mishra <hayabusagsm@gmail.com> >>> > Cc: adrian@olddog.co.uk; TEAS WG <teas@ietf.org> >>> > Subject: Re: [Teas] What SLOs and SLEs should be in the Slicing >>> Service Model? >>> > >>> > [External Email. Be cautious of content] >>> > >>> > >>> > Sounds like we need to clarify the verbiage. SLEs are, as I >>> understand it, indeed >>> > non-measurables. But they are not the legal translation of the SLOs. >>> They are >>> > expression of customer expectations that are not directly observable or >>> > measurable. The example I have the easiest time understanding is that >>> the >>> > customer expects the operator to encrypt the traffic across the >>> service. >>> > >>> > Yours, >>> > Joel >>> > >>> > On 3/25/2022 3:07 PM, Gyan Mishra wrote: >>> > > Hi Med & Joel >>> > > >>> > > I reread section 4.1 of the slice draft and to me it seems that SLO >>> is >>> > > from provider POV measurable indicators and SLE is the is >>> unmeasurable >>> > > expectations which is makes up the customer fulfillment of >>> obligations >>> > > by the provider which would be like taking the tangible measurement >>> > > characteristics from the SLO and translation into legal obligation >>> > > fulfillment verbiage that goes into the service agreement. So as the >>> > > SLE is not tangible but just a translation of SLO metrics into legal >>> > > verbiage my thoughts are that the framework as well as Yang model >>> need >>> > > only focus on the SLO tangible metrics and leave the intangible for >>> > > the lawyers writing the customer agreement. >>> > > >>> > > >>> > > 4.1 >>> > > < >>> https://urldefense.com/v3/__https://datatracker.ietf.org/doc/html/draft- >>> <https://urldefense.com/v3/__https:/datatracker.ietf.org/doc/html/draft-> >>> > ietf-teas-ietf-network-slices-09*section-4.1__;Iw!!NEt6yMaO- >>> > gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_- >>> > LiOR92MnzCJzyL9ESsViw$ >. >>> > > Objectives for IETF Network Slices >>> > > >>> > > An IETF Network Slice service is defined in terms of quantifiable >>> > > characteristics known as Service Level Objectives (SLOs) and >>> > > unquantifiable characteristics known as Service Level >>> Expectations >>> > > (SLEs). SLOs are expressed in terms Service Level Indicators >>> (SLIs), >>> > > and together with the SLEs form the contractual agreement between >>> > > service customer and service provider known as a Service Level >>> > > Agreement (SLA). >>> > > >>> > > The terms are defined as follows: >>> > > >>> > > * A Service Level Indicator (SLI) is a quantifiable measure of >>> an >>> > > aspect of the performance of a network. For example, it may >>> be a >>> > > measure of throughput in bits per second, or it may be a >>> measure >>> > > of latency in milliseconds. >>> > > >>> > > * A Service Level Objective (SLO) is a target value or range >>> for the >>> > > measurements returned by observation of an SLI. For example, >>> an >>> > > SLO may be expressed as "SLI <= target", or "lower bound <= >>> SLI <= >>> > > upper bound". A customer can determine whether the provider >>> is >>> > > meeting the SLOs by performing measurements on the traffic. >>> > > >>> > > * A Service Level Expectation (SLE) is an expression of an >>> > > unmeasurable service-related request that a customer of an >>> IETF >>> > > Network Slice makes of the provider. An SLE is distinct from >>> an >>> > > SLO because the customer may have little or no way of >>> determining >>> > > whether the SLE is being met, but they still contract with the >>> > > provider for a service that meets the expectation. >>> > > >>> > > >>> > > >>> > > On Thu, Mar 24, 2022 at 10:36 AM <mohamed.boucadair@orange.com >>> > > <mailto:mohamed.boucadair@orange.com>> wrote: >>> > > >>> > > Re-, >>> > > >>> > > They shouldn't! >>> > > >>> > > This is why I'm suggesting to not have that tagging frozen in the >>> > > model. We can simply have a provision for a set of parameters. >>> These >>> > > parameters will be included to characterize the service with a >>> > > service assurance component that will call out the identity of >>> the >>> > > subset of parameters that will be used as committed ones. That >>> > > component will also include other data to ensure the same based >>> used >>> > > for assessment, etc. >>> > > >>> > > Cheers, >>> > > Med >>> > > >>> > > > -----Message d'origine----- >>> > > > De : Joel M. Halpern <jmh@joelhalpern.com >>> > > <mailto:jmh@joelhalpern.com>> >>> > > > Envoyé : jeudi 24 mars 2022 15:29 >>> > > > À : BOUCADAIR Mohamed INNOV/NET >>> > <mohamed.boucadair@orange.com >>> > > <mailto:mohamed.boucadair@orange.com>> >>> > > > Cc : 'TEAS WG' <teas@ietf.org <mailto:teas@ietf.org>>; >>> > > adrian@olddog.co.uk <mailto:adrian@olddog.co.uk> >>> > > > Objet : Re: [Teas] What SLOs and SLEs should be in the Slicing >>> > > Service >>> > > > Model? >>> > > > >>> > > > If the others are best effort, why would they be included in >>> the SLO? >>> > > > (We do not assume that every IETF network slice service will >>> > > specify all >>> > > > possible parameters.) >>> > > > >>> > > > Yours, >>> > > > Joel >>> > > > >>> > > > On 3/24/2022 10:20 AM, mohamed.boucadair@orange.com >>> > > <mailto:mohamed.boucadair@orange.com> wrote: >>> > > > > Re-, >>> > > > > >>> > > > > Some services may be sensitive to delay for example but the >>> > > slice service >>> > > > request may include (for whatever reason) not only the delay, >>> but >>> > > also >>> > > > other attributes that are currently listed as SLOs in the >>> draft. The >>> > > > provider is requested to only commit on the delay and best >>> effort >>> > > for the >>> > > > other attributes. >>> > > > > >>> > > > > Cheers, >>> > > > > Med >>> > > > > >>> > > > >> -----Message d'origine----- >>> > > > >> De : Joel M. Halpern <jmh@joelhalpern.com >>> > > <mailto:jmh@joelhalpern.com>> Envoyé : jeudi 24 mars >>> > > > >> 2022 15:07 À : BOUCADAIR Mohamed INNOV/NET >>> > > > >> <mohamed.boucadair@orange.com >>> > > <mailto:mohamed.boucadair@orange.com>> Cc : 'TEAS WG' >>> > <teas@ietf.org >>> > > <mailto:teas@ietf.org>>; >>> > > > >> adrian@olddog.co.uk <mailto:adrian@olddog.co.uk> Objet : >>> Re: >>> > > [Teas] What SLOs and SLEs should be >>> > > > >> in the Slicing Service Model? >>> > > > >> >>> > > > >> Interesting. If they are indeed not coupled, then you are >>> clearly >>> > > > >> correct about representation. >>> > > > >> >>> > > > >> Can you give an example so I can understand when they >>> would not be >>> > > > coupled. >>> > > > >> I had leapt to the (quite possibly incorrect) conclusion >>> that >>> > > the two >>> > > > >> sets of properties went together. >>> > > > >> >>> > > > >> Thank you, >>> > > > >> Joel >>> > > > >> >>> > > > >> On 3/24/2022 10:03 AM, mohamed.boucadair@orange.com >>> > > <mailto:mohamed.boucadair@orange.com> wrote: >>> > > > >>> Hi Joel, >>> > > > >>> >>> > > > >>> It is. >>> > > > >>> >>> > > > >>> As mentioned below, this should be covered as part of >>> service >>> > > > >> assurance/fulfillment/reporting parameters. Which >>> parameters >>> > > to put >>> > > > >> there is deployment-specific. Not all parameters tagged as >>> SLO >>> > > in the >>> > > > >> framework will end up as part of the >>> > > assurance/fulfillment/reporting. >>> > > > >>> >>> > > > >>> Cheers, >>> > > > >>> Med >>> > > > >>> >>> > > > >>>> -----Message d'origine----- >>> > > > >>>> De : Joel M. Halpern <jmh@joelhalpern.com >>> > > <mailto:jmh@joelhalpern.com>> Envoyé : jeudi 24 mars >>> > > > >>>> 2022 14:52 À : BOUCADAIR Mohamed INNOV/NET >>> > > > >>>> <mohamed.boucadair@orange.com >>> > > <mailto:mohamed.boucadair@orange.com>>; adrian@olddog.co.uk >>> > > <mailto:adrian@olddog.co.uk>; 'TEAS WG' >>> > > > >>>> <teas@ietf.org <mailto:teas@ietf.org>> Objet : Re: >>> [Teas] >>> > > What SLOs and SLEs should be in >>> > > > >>>> the Slicing Service Model? >>> > > > >>>> >>> > > > >>>> Isn't it important to distinguish between "these are >>> things I >>> > > > >>>> expect you to do, measure, and report" and "these are >>> things I >>> > > > >>>> would like you to do even though they are not measurable >>> or >>> > > > reportable"? >>> > > > >>>> >>> > > > >>>> Yours, >>> > > > >>>> Joel >>> > > > >>>> >>> > > > >>>> On 3/23/2022 10:08 AM, mohamed.boucadair@orange.com >>> > > <mailto:mohamed.boucadair@orange.com> wrote: >>> > > > >>>>> Hi all, >>> > > > >>>>> >>> > > > >>>>> This message actually triggers a companion comment I >>> have >>> > > on the >>> > > > >>>>> SLO/SLE >>> > > > >>>> taxonomy. From the service modeling standpoint, I suggest >>> > > that we >>> > > > >>>> don't inherit that taxonomy for various reasons: >>> > > > >>>>> >>> > > > >>>>> * Things would be much simpler if we just focus on >>> service >>> > > > >>>>> requirements >>> > > > >>>> without making an assumption how such requirement is >>> > > expressed and >>> > > > >>>> whether it is >>> > > quantified/quantitative/qualitative/measurable/etc. >>> > > > >>>> Whether/how a specific service requirement is covered by >>> service >>> > > > >>>> assurance/fulfillment can be part of the slice service >>> > > definition >>> > > > >> itself. >>> > > > >>>>> >>> > > > >>>>> * What we may tag as an SLE today because of the >>> technology >>> > > > >>>>> limitations, >>> > > > >>>> may not stay as such forever. It may be true that an >>> > > "expectation" >>> > > > >>>> may not be easily assessed using current techniques (and >>> thus be >>> > > > >>>> tagged as SLE), but this does not prevent that >>> innovative means >>> > > > >>>> would be defined in the future (which means that it is an >>> > > SLO, not >>> > > > >>>> an SLE >>> > > > >> anymore). >>> > > > >>>>> >>> > > > >>>>> * We are artificially adding extra complexity for the >>> modelling >>> > > > >>>>> part as >>> > > > >>>> service requirement will need to be classified based as >>> SLO >>> > > or SLEs. >>> > > > >>>>> >>> > > > >>>>> * I remember that Kiran agreed at least to not import >>> that >>> > > > >>>>> taxonomy into >>> > > > >>>> the data model when we were discussing the call for >>> adoption >>> > > of the >>> > > > >>>> slice >>> > > > >>>> definition: >>> > > > >>>>> >>> > > > >>>>> ==(the full message from Kiran can be found in the >>> archives)=== >>> > > > >>>>> "However, it should not imply that NBI models are >>> required >>> > > to have >>> > > > >>>> SLE/SLO indicators and I totally agreed with your >>> comments on >>> > > > >>>> draft-wd- teas-ietf-network-slice-nbi-yang-03" >>> > > > >>>>> == >>> > > > >>>>> >>> > > > >>>>> Cheers, >>> > > > >>>>> Med >>> > > > >>>>> >>> > > > >>>>>> -----Message d'origine----- >>> > > > >>>>>> De : Teas <teas-bounces@ietf.org >>> > > <mailto:teas-bounces@ietf.org>> De la part de Adrian Farrel >>> > > > >>>>>> Envoyé >>> > > > >>>>>> : mercredi 23 mars 2022 14:47 À : 'TEAS WG' < >>> teas@ietf.org >>> > > <mailto:teas@ietf.org>> Objet : >>> > > > >>>>>> [Teas] What SLOs and SLEs should be in the Slicing >>> Service >>> > > Model? >>> > > > >>>>>> >>> > > > >>>>>> Hi, >>> > > > >>>>>> >>> > > > >>>>>> Sorry for my audio being a mess in TEAS today. >>> > > > >>>>>> >>> > > > >>>>>> I believe I heard the discussion between Kireeti and >>> Reza >>> > > > >>>>>> correctly, and there was some follow-up in the chat. >>> > > > >>>>>> >>> > > > >>>>>> I agree that "Protection" is a realisation feature and >>> so it >>> > > > >>>>>> qualifies as an SLE, if at all. >>> > > > >>>>>> But "Reliability" is clearly an SLO. Usually expressed >>> as >>> > > maximum >>> > > > >>>>>> down- time per unit of time, or maximum lost traffic. >>> > > > >>>>>> >>> > > > >>>>>> There was one thing that I *think* I heard. This was >>> Reza >>> > > saying >>> > > > >>>>>> that the service YANG model was only including the SLOs >>> > > and SLEs >>> > > > >>>>>> noted in the framework. Maybe I misheard "only" >>> because I >>> > > think >>> > > > >>>>>> that might be a mistake. >>> > > > >>>>>> The YANG model should certainly be interested in what >>> the >>> > > > >>>>>> framework says, but it is not a requirement that all >>> SLOs and >>> > > > >>>>>> SLEs in the framework be in the model if the authors >>> find that >>> > > > >>>>>> there is no interest in implementing them, and there >>> should >>> > > > >>>>>> certainly be no limitation about including additional >>> SLOs >>> > > or SLEs >>> > > > in the YANG model. >>> > > > >>>>>> Indeed, the SLOs and SLEs listed in the framework are >>> > > presented >>> > > > >>>>>> as >>> > > > >>>> examples. >>> > > > >>>>>> >>> > > > >>>>>> Cheers, >>> > > > >>>>>> Adrian >>> > > > >>>>>> >>> > > > >>>>>> _______________________________________________ >>> > > > >>>>>> Teas mailing list >>> > > > >>>>>> Teas@ietf.org <mailto:Teas@ietf.org> >>> > > > >>>>>> >>> > >>> https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/teas__;!!N >>> <https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/teas__;!!N> >>> > Et6yMaO-gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_- >>> > LiOR92MnzCJzyLzCREI4M$ >>> > > >>> > < >>> https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/teas__; >>> <https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/teas__;> >>> !! >>> > NEt6yMaO-gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_- >>> > LiOR92MnzCJzyLzCREI4M$ > >>> > > > >>>>> >>> > > > >>>>> >>> > > >>> > _________________________________________________________________ >>> > _ >>> > > > >>>>> __ __ >>> > ___________________________________________________ >>> > > > >>>>> >>> > > > >>>>> Ce message et ses pieces jointes peuvent contenir des >>> > > informations >>> > > > >>>>> confidentielles ou privilegiees et ne doivent donc pas >>> etre >>> > > > >>>>> diffuses, exploites ou copies sans autorisation. Si vous >>> > > avez recu >>> > > > >>>>> ce message par erreur, veuillez le signaler a >>> l'expediteur >>> > > et le >>> > > > >>>>> detruire ainsi que >>> > > > >>>> les pieces jointes. Les messages electroniques etant >>> > > susceptibles >>> > > > >>>> d'alteration, Orange decline toute responsabilite si ce >>> > > message a >>> > > > >>>> ete altere, deforme ou falsifie. Merci. >>> > > > >>>>> >>> > > > >>>>> This message and its attachments may contain >>> confidential or >>> > > > >>>>> privileged information that may be protected by law; >>> they >>> > > should >>> > > > >>>>> not be >>> > > > >>>> distributed, used or copied without authorisation. >>> > > > >>>>> If you have received this email in error, please notify >>> the >>> > > sender >>> > > > >>>>> and >>> > > > >>>> delete this message and its attachments. >>> > > > >>>>> As emails may be altered, Orange is not liable for >>> messages >>> > > that >>> > > > >>>>> have >>> > > > >>>> been modified, changed or falsified. >>> > > > >>>>> Thank you. >>> > > > >>>>> >>> > > > >>>>> _______________________________________________ >>> > > > >>>>> Teas mailing list >>> > > > >>>>> Teas@ietf.org <mailto:Teas@ietf.org> >>> > > > >>>>> >>> > >>> https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/teas__;!!N >>> <https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/teas__;!!N> >>> > Et6yMaO-gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_- >>> > LiOR92MnzCJzyLzCREI4M$ >>> > > >>> > < >>> https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/teas__; >>> <https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/teas__;> >>> !! >>> > NEt6yMaO-gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_- >>> > LiOR92MnzCJzyLzCREI4M$ > >>> > > > >>> >>> > > > >>> >>> > > >>> > _________________________________________________________________ >>> > ___ >>> > > > >>> __ ___________________________________________________ >>> > > > >>> >>> > > > >>> Ce message et ses pieces jointes peuvent contenir des >>> > > informations >>> > > > >>> confidentielles ou privilegiees et ne doivent donc pas >>> etre >>> > > > >>> diffuses, exploites ou copies sans autorisation. Si vous >>> avez >>> > > recu >>> > > > >>> ce message par erreur, veuillez le signaler a >>> l'expediteur et le >>> > > > >>> detruire ainsi que >>> > > > >> les pieces jointes. Les messages electroniques etant >>> susceptibles >>> > > > >> d'alteration, Orange decline toute responsabilite si ce >>> > > message a ete >>> > > > >> altere, deforme ou falsifie. Merci. >>> > > > >>> >>> > > > >>> This message and its attachments may contain confidential >>> or >>> > > > >>> privileged information that may be protected by law; they >>> > > should not >>> > > > >>> be >>> > > > >> distributed, used or copied without authorisation. >>> > > > >>> If you have received this email in error, please notify >>> the >>> > > sender >>> > > > >>> and >>> > > > >> delete this message and its attachments. >>> > > > >>> As emails may be altered, Orange is not liable for >>> messages that >>> > > > >>> have >>> > > > >> been modified, changed or falsified. >>> > > > >>> Thank you. >>> > > > >>> >>> > > > > >>> > > > > >>> > > >>> > _________________________________________________________________ >>> > _____ >>> > > > > ___________________________________________________ >>> > > > > >>> > > > > Ce message et ses pieces jointes peuvent contenir des >>> informations >>> > > > > confidentielles ou privilegiees et ne doivent donc pas etre >>> > > diffuses, >>> > > > > exploites ou copies sans autorisation. Si vous avez recu ce >>> message >>> > > > > par erreur, veuillez le signaler a l'expediteur et le >>> detruire >>> > > ainsi que >>> > > > les pieces jointes. Les messages electroniques etant >>> susceptibles >>> > > > d'alteration, Orange decline toute responsabilite si ce >>> message a ete >>> > > > altere, deforme ou falsifie. Merci. >>> > > > > >>> > > > > This message and its attachments may contain confidential or >>> > > > > privileged information that may be protected by law; they >>> > > should not be >>> > > > distributed, used or copied without authorisation. >>> > > > > If you have received this email in error, please notify the >>> > > sender and >>> > > > delete this message and its attachments. >>> > > > > As emails may be altered, Orange is not liable for messages >>> > > that have >>> > > > been modified, changed or falsified. >>> > > > > Thank you. >>> > > > > >>> > > >>> > > >>> > > >>> > _________________________________________________________________ >>> > _____ >>> > > ___________________________________________________ >>> > > >>> > > Ce message et ses pieces jointes peuvent contenir des >>> informations >>> > > confidentielles ou privilegiees et ne doivent donc >>> > > pas etre diffuses, exploites ou copies sans autorisation. Si vous >>> > > avez recu ce message par erreur, veuillez le signaler >>> > > a l'expediteur et le detruire ainsi que les pieces jointes. Les >>> > > messages electroniques etant susceptibles d'alteration, >>> > > Orange decline toute responsabilite si ce message a ete altere, >>> > > deforme ou falsifie. Merci. >>> > > >>> > > This message and its attachments may contain confidential or >>> > > privileged information that may be protected by law; >>> > > they should not be distributed, used or copied without >>> authorisation. >>> > > If you have received this email in error, please notify the >>> sender >>> > > and delete this message and its attachments. >>> > > As emails may be altered, Orange is not liable for messages that >>> > > have been modified, changed or falsified. >>> > > Thank you. >>> > > >>> > > _______________________________________________ >>> > > Teas mailing list >>> > > Teas@ietf.org <mailto:Teas@ietf.org> >>> > > >>> > >>> https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/teas__;!!N >>> <https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/teas__;!!N> >>> > Et6yMaO-gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_- >>> > LiOR92MnzCJzyLzCREI4M$ >>> > > >>> > > < >>> https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/tea >>> <https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/tea> >>> > > s__;!!NEt6yMaO-gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_- >>> > LiOR92MnzC >>> > > JzyLzCREI4M$ > >>> > > >>> > > -- >>> > > >>> > > < >>> https://urldefense.com/v3/__http://www.verizon.com/__;!!NEt6yMaO-gk!V >>> <https://urldefense.com/v3/__http:/www.verizon.com/__;!!NEt6yMaO-gk!V> >>> > > rEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_-LiOR92MnzCJzyLqOCoT3c$ >>> > > >>> > > >>> > > *Gyan Mishra* >>> > > >>> > > /Network Solutions A//rchitect / >>> > > >>> > > /Email gyan.s.mishra@verizon.com <mailto:gyan.s.mishra@verizon.com >>> >// >>> > > / >>> > > >>> > > /M 301 502-1347 >>> > > >>> > > / >>> > > >>> > > >>> > >>> > _______________________________________________ >>> > Teas mailing list >>> > Teas@ietf.org >>> > >>> https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/teas__;!!N >>> <https://urldefense.com/v3/__https:/www.ietf.org/mailman/listinfo/teas__;!!N> >>> > Et6yMaO-gk!VrEVB46KF20816iW_4FlbM4JGWGSLyFu-vk4PGWX_- >>> > LiOR92MnzCJzyLzCREI4M$ >>> >>> >>> >>> >>> -- >>> >>> >>> <https://urldefense.com/v3/__http:/www.verizon.com/__;!!NEt6yMaO-gk!RvVLz0GpjIyf2oVvTxnMgHzO5_TsnvXLYRGzpTsQSjwAIOP5-Q9vlZiJlwa0Nuw$> >>> >>> *Gyan Mishra* >>> >>> *Network Solutions Architect * >>> >>> *Email gyan.s.mishra@verizon.com <gyan.s.mishra@verizon.com>* >>> >>> *M 301 502-1347* >>> >>> >>> >> -- >> >> <http://www.verizon.com/> >> >> *Gyan Mishra* >> >> *Network Solutions A**rchitect * >> >> *Email gyan.s.mishra@verizon.com <gyan.s.mishra@verizon.com>* >> >> >> >> *M 301 502-1347* >> >> _______________________________________________ >> Teas mailing list >> Teas@ietf.org >> https://www.ietf.org/mailman/listinfo/teas >> > _______________________________________________ > Teas mailing list > Teas@ietf.org > https://www.ietf.org/mailman/listinfo/teas > -- <http://www.verizon.com/> *Gyan Mishra* *Network Solutions A**rchitect * *Email gyan.s.mishra@verizon.com <gyan.s.mishra@verizon.com>* *M 301 502-1347*
- [Teas] What SLOs and SLEs should be in the Slicin… Adrian Farrel
- Re: [Teas] What SLOs and SLEs should be in the Sl… mohamed.boucadair
- Re: [Teas] What SLOs and SLEs should be in the Sl… Joel M. Halpern
- Re: [Teas] What SLOs and SLEs should be in the Sl… mohamed.boucadair
- Re: [Teas] What SLOs and SLEs should be in the Sl… Joel M. Halpern
- Re: [Teas] What SLOs and SLEs should be in the Sl… mohamed.boucadair
- Re: [Teas] What SLOs and SLEs should be in the Sl… Joel M. Halpern
- Re: [Teas] What SLOs and SLEs should be in the Sl… mohamed.boucadair
- Re: [Teas] What SLOs and SLEs should be in the Sl… Gyan Mishra
- Re: [Teas] What SLOs and SLEs should be in the Sl… Joel M. Halpern
- Re: [Teas] [E] Re: What SLOs and SLEs should be i… Jalil, Luay
- Re: [Teas] What SLOs and SLEs should be in the Sl… Adrian Farrel
- Re: [Teas] What SLOs and SLEs should be in the Sl… Gyan Mishra
- Re: [Teas] What SLOs and SLEs should be in the Sl… John E Drake
- Re: [Teas] What SLOs and SLEs should be in the Sl… Gyan Mishra
- Re: [Teas] What SLOs and SLEs should be in the Sl… John E Drake
- Re: [Teas] What SLOs and SLEs should be in the Sl… Gyan Mishra
- Re: [Teas] What SLOs and SLEs should be in the Sl… John E Drake
- Re: [Teas] What SLOs and SLEs should be in the Sl… Gyan Mishra
- Re: [Teas] What SLOs and SLEs should be in the Sl… John E Drake
- [Teas] Protection: SLO or SLE? [Re: What SLOs and… Greg Mirsky
- Re: [Teas] Protection: SLO or SLE? [Re: What SLOs… Gyan Mishra
- Re: [Teas] Protection: SLO or SLE? [Re: What SLOs… Greg Mirsky
- Re: [Teas] Protection: SLO or SLE? [Re: What SLOs… Gyan Mishra
- Re: [Teas] What SLOs and SLEs should be in the Sl… mohamed.boucadair