Re: [ippm] Call for Adoption of draft-mhmcsfh-ippm-pam

Benoit Claise <benoit.claise@huawei.com> Mon, 05 September 2022 07:21 UTC

Return-Path: <benoit.claise@huawei.com>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id DA1BBC1524C6 for <ippm@ietfa.amsl.com>; Mon, 5 Sep 2022 00:21:40 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.906
X-Spam-Level:
X-Spam-Status: No, score=-1.906 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, NICE_REPLY_A=-0.001, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=unavailable autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id War3jGyIe9nh for <ippm@ietfa.amsl.com>; Mon, 5 Sep 2022 00:21:37 -0700 (PDT)
Received: from frasgout.his.huawei.com (frasgout.his.huawei.com [185.176.79.56]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id D509AC15256D for <ippm@ietf.org>; Mon, 5 Sep 2022 00:21:36 -0700 (PDT)
Received: from fraeml736-chm.china.huawei.com (unknown [172.18.147.200]) by frasgout.his.huawei.com (SkyGuard) with ESMTP id 4MLfwv72yjz687x5; Mon, 5 Sep 2022 15:17:35 +0800 (CST)
Received: from [10.48.144.236] (10.48.144.236) by fraeml736-chm.china.huawei.com (10.206.15.217) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.31; Mon, 5 Sep 2022 09:21:31 +0200
Content-Type: multipart/alternative; boundary="------------RBh4PLBWm1RGeFFJvB29UWGb"
Message-ID: <b108d198-f24f-bb8e-6782-05ffe95e2888@huawei.com>
Date: Mon, 05 Sep 2022 09:21:27 +0200
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.2.0
Content-Language: en-GB
To: Tommy Pauly <tpauly=40apple.com@dmarc.ietf.org>, IETF IPPM WG <ippm@ietf.org>
References: <1BCD27D1-4A44-4FF1-BD91-C6B78F0F03A3@apple.com>
From: Benoit Claise <benoit.claise@huawei.com>
In-Reply-To: <1BCD27D1-4A44-4FF1-BD91-C6B78F0F03A3@apple.com>
X-Originating-IP: [10.48.144.236]
X-ClientProxiedBy: dggems706-chm.china.huawei.com (10.3.19.183) To fraeml736-chm.china.huawei.com (10.206.15.217)
X-CFilter-Loop: Reflected
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/asAH9dfylvGHIVCoy9e24xSLdzE>
Subject: Re: [ippm] Call for Adoption of draft-mhmcsfh-ippm-pam
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 05 Sep 2022 07:21:41 -0000

Dear all,

I don't dispute the importance of this work. However, the scope of this 
work is not clear yet IMO.

  - SLO, sure,  but what's not clear to me is: SLO per customer, per 
service, per class of service, per flow, per application
I found "Precision Availability Metrics (PAM), aimed at capturing 
end-to-end service levels for a flow, specifically the degree to which 
flows comply with the SLOs that are in effect".
So OK, we speak about flow. So what is your flow definition?
- Btw, based on the previous quoted sentence, I don't understand this 
PAM name. No mention of SLA, no mention of flow, no notion of service.
  Basically, you report a service level indicator (SLI). You confused me 
with PAM
- How are you going to report this flow definition, along with the SLI? 
IPFIX key fields? With a YANG model?
This section 6 content is key to understand how to use those SLIs in an 
operational environment

        The following is a list of items for which further discussion is
        needed as to whether they should be included in the scope of this
        specification:

        *  A YANG data model.

        *  A set of IPFIX Information Elements.

        *  Statistical metrics: e.g., histograms/buckets.

- I am not a big fan to specify some level of thresholding in 
specifications.

    *  VI is a time interval during which at least one of the performance
       parameters degraded below its pre-defined optimal level threshold.

    *  SVI is a time interval during which at least one the performance
       parameters degraded below its pre-defined critical threshold.

Based on my experience, most of the time, we don't get the threshold 
values/names right, and we don't get the number of them right.
     ex: violated, severely violated ... why not extremely violated, 
catastrophically violated?
Trying to express, from the measurement aspects, whether the 
observations are SEVERELY impacting (that's the way I read SVI) is not 
the right approach IMO.
This is maybe you open issues in section 6
     * Policies regarding the definition of "violated" and "severely 
violated" time interval.

Bottom line:
Granted, IPPM is about performance metrics but specifying metrics 
without specifying how they will be used in an operational environment 
is not the right way IMO.
I believe the scope of this document is NOT clear enough to be adopted. 
In other words, I don't know what I'm signing for...

Regards, Benoit

On 9/1/2022 7:25 PM, Tommy Pauly wrote:
> Hello IPPM,
>
> As discussed at IETF 114, we’re starting an adoption call for 
> Precision Availability Metrics for SLO-Governed End-to-End Services, 
> draft-mhmcsfh-ippm-pam.
>
> https://datatracker.ietf.org/doc/draft-mhmcsfh-ippm-pam/
>
> The current version is here:
>
> https://www.ietf.org/archive/id/draft-mhmcsfh-ippm-pam-02.html
>
> Please reply to this email by *Thursday, September 15*, to indicate 
> whether you support adoption of this draft.
>
> Best,
> Tommy & Marcus
>
>
> _______________________________________________
> ippm mailing list
> ippm@ietf.org
> https://www.ietf.org/mailman/listinfo/ippm