Re: [ippm] Roman Danyliw's No Objection on draft-ietf-ippm-pam-08: (with COMMENT)

Alexander L Clemm <ludwig@clemm.org> Fri, 17 November 2023 18:58 UTC

Return-Path: <ludwig@clemm.org>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 65E83C151076; Fri, 17 Nov 2023 10:58:58 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.904
X-Spam-Level:
X-Spam-Status: No, score=-1.904 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9LI43AQQfRe0; Fri, 17 Nov 2023 10:58:54 -0800 (PST)
Received: from mout.perfora.net (mout.perfora.net [74.208.4.197]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2F15FC14CE47; Fri, 17 Nov 2023 10:58:53 -0800 (PST)
Received: from [172.16.0.44] ([73.189.160.186]) by mrelay.perfora.net (mreueus003 [74.208.5.2]) with ESMTPSA (Nemesis) id 0MScio-1quC871R48-00RXWd; Fri, 17 Nov 2023 19:58:43 +0100
Content-Type: multipart/alternative; boundary="------------HVmW5wl5A7jXJbMrczTOLskh"
Message-ID: <9ee919c5-5374-4da2-b9a0-546dd0b2f0bc@clemm.org>
Date: Fri, 17 Nov 2023 19:58:39 +0100
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Content-Language: en-US
From: Alexander L Clemm <ludwig@clemm.org>
To: ippm@ietf.org, Greg Mirsky <gregimirsky@gmail.com>, rdd@cert.org, draft-ietf-ippm-pam@ietf.org, ippm-chairs@ietf.org, 'The IESG' <iesg@ietf.org>
References: <170016532185.47410.13062263606165533328@ietfa.amsl.com> <CA+RyBmXZeYEbQXAdi3h72LDO5is+gdL-b2iiEAXWSia6mpv47w@mail.gmail.com> <cabb76d2-03fe-4f41-8de9-a735501b6870@clemm.org>
In-Reply-To: <cabb76d2-03fe-4f41-8de9-a735501b6870@clemm.org>
X-Provags-ID: V03:K1:f4lx/eXkqPdO1rv8r2NcU+US5LYkgV3Zd9g4GDRV3xUnxRpB6P7 NqYxZ8dkSa8hJ+4OYYoABKBRKevmroqI3hKQpsz3xwFM+7a7HIe8dcyYa/Nx0TFOVdW5IlB O0dFsoNO6TMBQqVlj3x9x+fZxX8g8BFAhNTM6ERkVVLxOBobpj4UupIUJQfN0xc6XZLtIFG SyHiD++ooYrBMghNNuDmw==
UI-OutboundReport: notjunk:1;M01:P0:GkqA5wLRCkQ=;kF7SV1l9i5W79f5/6uG3NcsLZKV 71TRf7XLbwaAz8DAmM8k7bQnnTnL/ypEHrCrdom1dxqH75loErYcX2NlIu5OV2jLaUxX5Qt3D hEngAePI74bbewdUqi4e4eruIlwUwIkrznHrTcT0exIEcIA/NskpwEb3shGZCszC58zgX90+Z 7dhepw4gLtQJz51UobdJqCjoPnG+ZLL4GdIhiSGKB6007uNvTeDmsSAz8EMyaV1hhgze0cPOJ UKYObpY93Fa1tlW3R77/ni1Vm14whgY+fsyCJvJdannX8VB059KS0L+mOJE/JcFVlGcW+gf5S ivleMYYn5z7GevpAWlSgKTacBHygeRu62LcRrbMBGxkSaScVnUVv90mte39e4ueYGBGSCBn93 z2t2CsnZW9v2tyAjvUqHv1d619Fb58xkB266RcGZSdTPMmJKsP1CngQL8szV1f1bf6dPxfc7o 6Y8LE7Sve2+akA6aLLI7ANiB7itd1FTzGQpltZYmyPs5rXdyRQlS37SOexBzaSEMYuK927sGm /XWIxwKKGNKsoOZhwg0YVGNzK4wAGZiCGqF9QWVr2cxZFADOSBpaEnbOLP9X6MYWY1Yc/chm5 kJGslzJGVdLdA7Aj6wA0GuPv7uvFvWWKdPqXErh/AMHxg/CyUnlCeN02FNfF8LxQbUy7wM86A cgq2ZVrI/EcjbieArYcUe91e3/C9+bv5haxGh+3QPFvypiAgXGokdPOj6H/RQZzUEV5bPM8Rd /0brd5dJTKRytK3aBuxf6zr7QE91fPlwuUbrVNVIOFgJaFEL9Gy1KrdezHw4bzD/4NTEaSm27 /Wnh9LBT2rH5TDONghKlODqwrv27vj81BQD196wIYswKa+BPZehQzJAuACw41mWCE3P23KMBx E7NTEPyy23p9KMA==
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/CHynaRpWsGEbOI09NansY7nnyi0>
Subject: Re: [ippm] Roman Danyliw's No Objection on draft-ietf-ippm-pam-08: (with COMMENT)
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 17 Nov 2023 18:58:58 -0000

(Resending to complete list of recipients; apologies to ippm for the 
duplicate)

On 11/17/2023 7:54 PM, Alexander L Clemm wrote:
>
> Hi,
>
> Roman, thank you for your questions and suggestions; Greg, thank you 
> for for your responses.
>
> I actually disagree with one of the resolutions, as explained inline, 
> <ALEX>.  Specifically, I believe that the original text in 3.1 should 
> be reinstated as the new one is not only not quite correct but would 
> introduce additional issues.
>
> Thanks
>
> --- Alex
>
> On 11/17/2023 12:56 AM, Greg Mirsky wrote:
>> Hi Roman,
>> thank you for your questions and suggestions. Please find my notes 
>> in-lined below tagged GIM>>. Attached, please find the new working 
>> version (Gmail believes that diff contains a virus ;(. )
>>
>> Regards,
>> Greg
>>
>> On Thu, Nov 16, 2023 at 12:08 PM Roman Danyliw via Datatracker 
>> <noreply@ietf.org> wrote:
>>
>>     Roman Danyliw has entered the following ballot position for
>>     draft-ietf-ippm-pam-08: No Objection
>>
>>     When responding, please keep the subject line intact and reply to all
>>     email addresses included in the To and CC lines. (Feel free to
>>     cut this
>>     introductory paragraph, however.)
>>
>>
>>     Please refer to
>>     https://www.ietf.org/about/groups/iesg/statements/handling-ballot-positions/
>>
>>     for more information about how to handle DISCUSS and COMMENT
>>     positions.
>>
>>
>>     The document, along with other ballot positions, can be found here:
>>     https://datatracker.ietf.org/doc/draft-ietf-ippm-pam/
>>
>>
>>
>>     ----------------------------------------------------------------------
>>     COMMENT:
>>     ----------------------------------------------------------------------
>>
>>     ** Section 3.1.  Consider defining or providing an explanation of
>>     “optimal
>>     level threshold” and “critical threshold” in the definitions of
>>     VI and SVI.
>>     I’m assuming that these are two configured threshold levels.
>>
>> GIM>> You are right. We planned that both thresholds are configured, 
>> i.e., pre-defined, as noted in the document. Both reflect what can be 
>> described as "an acceptable deviation from an ideal performance 
>> metric". The optimal level may be used by a service provider to 
>> detect performance degradation, while the critical level reflects the 
>> requirements of the service customer. Would adding the following 
>> sentence make it clearer:
>> OLD TEXT:
>>    The monitoring of performance parameters to determine the quality of
>>    an interval is performed between the elements of the network that are
>>    referred to for the SLO corresponding to the performance parameter.
>>    Mechanisms of setting levels of a threshold of an SLO are outside the
>>    scope of this document.
>> NEW TEXT:
>>    The monitoring of performance parameters to determine the quality of
>>    an interval is performed between the elements of the network that are
>>    referred to for the SLO corresponding to the performance parameter.
>>    The optimal level threshold may be used by a service provider to
>>    detect performance degradation, while the critical level threshold
>>    reflects the requirements of the service customer.  Mechanisms of
>>    setting levels of a threshold of an SLO are outside the scope of this
>>    document.
>
> <ALEX> Actually, I do not agree with this change.  In particular, I 
> would take issue with the term "optimal level threshold".  What 
> constitutes a Violated Interval is determined by the SLO.  It is the 
> service level objective that, when breached, will cause a 
> corresponding interval to be violated.
>
> Now, SVI has a notion of higher severity - and what constitutes that 
> is again up to the network provider to define.  But there is no notion 
> of optimality.  (Nor is there, in fact, a notion of criticality - it's 
> SVI, not CVI.)
>
> I therefore find the new text to be misleading and believe the 
> original text should be reinstated.  If we believe that additional 
> clarification is needed, we could add another sentence that indicates 
> that the configuration of a threshold which, when breached during an 
> interval, will cause a violation to be registered for that interface, 
> is determined per the definition of the SLO and configured accordingly.
>
> </ALEX>
>
>>
>>     ** Section 3.1.
>>        Beyond accounting for violated intervals, it is sometimes
>>     beneficial
>>        to maintain counts of packets for which a performance threshold is
>>        violated.
>>
>>     No question of the utility of counting packets. However,
>>     shouldn’t there be a
>>     count of flows too?  Section 1 said “This specification
>>     introduces a new set of
>>     metrics, Precision Availability Metrics (PAM), aimed at capturing
>>     end-to-end
>>     service levels for a flow, specifically the degree to which flows
>>     comply with
>>     the SLOs that are in effect.”
>>
>> GIM>> Thank you for the question and highlighted text. PAM is 
>> intended to characterize a single flow, and it seems to me that the 
>> use of plural is confusing. I propose the update as follows:
>> OLD TEXT:
>>    This specification introduces a new set of metrics, Precision
>>    Availability Metrics (PAM), aimed at capturing end-to-end service
>>    levels for a flow, specifically the degree to which flows comply with
>>    the SLOs that are in effect.
>> NEW TEXT:
>>    This specification introduces a new set of metrics, Precision
>>    Availability Metrics (PAM), aimed at capturing end-to-end service
>>    levels for a flow, specifically the degree to which the flow complies
>>    with the SLOs that are in effect.
>> I hope that this update clarifies the scope of PAM.
>>
>> _______________________________________________
>> ippm mailing list
>> ippm@ietf.org
>> https://www.ietf.org/mailman/listinfo/ippm