Re: [ippm] Roman Danyliw's No Objection on draft-ietf-ippm-pam-08: (with COMMENT)
Alexander L Clemm <ludwig@clemm.org> Fri, 17 November 2023 18:58 UTC
Return-Path: <ludwig@clemm.org>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 65E83C151076; Fri, 17 Nov 2023 10:58:58 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.904
X-Spam-Level:
X-Spam-Status: No, score=-1.904 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9LI43AQQfRe0; Fri, 17 Nov 2023 10:58:54 -0800 (PST)
Received: from mout.perfora.net (mout.perfora.net [74.208.4.197]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2F15FC14CE47; Fri, 17 Nov 2023 10:58:53 -0800 (PST)
Received: from [172.16.0.44] ([73.189.160.186]) by mrelay.perfora.net (mreueus003 [74.208.5.2]) with ESMTPSA (Nemesis) id 0MScio-1quC871R48-00RXWd; Fri, 17 Nov 2023 19:58:43 +0100
Content-Type: multipart/alternative; boundary="------------HVmW5wl5A7jXJbMrczTOLskh"
Message-ID: <9ee919c5-5374-4da2-b9a0-546dd0b2f0bc@clemm.org>
Date: Fri, 17 Nov 2023 19:58:39 +0100
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Content-Language: en-US
From: Alexander L Clemm <ludwig@clemm.org>
To: ippm@ietf.org, Greg Mirsky <gregimirsky@gmail.com>, rdd@cert.org, draft-ietf-ippm-pam@ietf.org, ippm-chairs@ietf.org, 'The IESG' <iesg@ietf.org>
References: <170016532185.47410.13062263606165533328@ietfa.amsl.com> <CA+RyBmXZeYEbQXAdi3h72LDO5is+gdL-b2iiEAXWSia6mpv47w@mail.gmail.com> <cabb76d2-03fe-4f41-8de9-a735501b6870@clemm.org>
In-Reply-To: <cabb76d2-03fe-4f41-8de9-a735501b6870@clemm.org>
X-Provags-ID: V03:K1:f4lx/eXkqPdO1rv8r2NcU+US5LYkgV3Zd9g4GDRV3xUnxRpB6P7 NqYxZ8dkSa8hJ+4OYYoABKBRKevmroqI3hKQpsz3xwFM+7a7HIe8dcyYa/Nx0TFOVdW5IlB O0dFsoNO6TMBQqVlj3x9x+fZxX8g8BFAhNTM6ERkVVLxOBobpj4UupIUJQfN0xc6XZLtIFG SyHiD++ooYrBMghNNuDmw==
UI-OutboundReport: notjunk:1;M01:P0:GkqA5wLRCkQ=;kF7SV1l9i5W79f5/6uG3NcsLZKV 71TRf7XLbwaAz8DAmM8k7bQnnTnL/ypEHrCrdom1dxqH75loErYcX2NlIu5OV2jLaUxX5Qt3D hEngAePI74bbewdUqi4e4eruIlwUwIkrznHrTcT0exIEcIA/NskpwEb3shGZCszC58zgX90+Z 7dhepw4gLtQJz51UobdJqCjoPnG+ZLL4GdIhiSGKB6007uNvTeDmsSAz8EMyaV1hhgze0cPOJ UKYObpY93Fa1tlW3R77/ni1Vm14whgY+fsyCJvJdannX8VB059KS0L+mOJE/JcFVlGcW+gf5S ivleMYYn5z7GevpAWlSgKTacBHygeRu62LcRrbMBGxkSaScVnUVv90mte39e4ueYGBGSCBn93 z2t2CsnZW9v2tyAjvUqHv1d619Fb58xkB266RcGZSdTPMmJKsP1CngQL8szV1f1bf6dPxfc7o 6Y8LE7Sve2+akA6aLLI7ANiB7itd1FTzGQpltZYmyPs5rXdyRQlS37SOexBzaSEMYuK927sGm /XWIxwKKGNKsoOZhwg0YVGNzK4wAGZiCGqF9QWVr2cxZFADOSBpaEnbOLP9X6MYWY1Yc/chm5 kJGslzJGVdLdA7Aj6wA0GuPv7uvFvWWKdPqXErh/AMHxg/CyUnlCeN02FNfF8LxQbUy7wM86A cgq2ZVrI/EcjbieArYcUe91e3/C9+bv5haxGh+3QPFvypiAgXGokdPOj6H/RQZzUEV5bPM8Rd /0brd5dJTKRytK3aBuxf6zr7QE91fPlwuUbrVNVIOFgJaFEL9Gy1KrdezHw4bzD/4NTEaSm27 /Wnh9LBT2rH5TDONghKlODqwrv27vj81BQD196wIYswKa+BPZehQzJAuACw41mWCE3P23KMBx E7NTEPyy23p9KMA==
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/CHynaRpWsGEbOI09NansY7nnyi0>
Subject: Re: [ippm] Roman Danyliw's No Objection on draft-ietf-ippm-pam-08: (with COMMENT)
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 17 Nov 2023 18:58:58 -0000
(Resending to complete list of recipients; apologies to ippm for the duplicate) On 11/17/2023 7:54 PM, Alexander L Clemm wrote: > > Hi, > > Roman, thank you for your questions and suggestions; Greg, thank you > for for your responses. > > I actually disagree with one of the resolutions, as explained inline, > <ALEX>. Specifically, I believe that the original text in 3.1 should > be reinstated as the new one is not only not quite correct but would > introduce additional issues. > > Thanks > > --- Alex > > On 11/17/2023 12:56 AM, Greg Mirsky wrote: >> Hi Roman, >> thank you for your questions and suggestions. Please find my notes >> in-lined below tagged GIM>>. Attached, please find the new working >> version (Gmail believes that diff contains a virus ;(. ) >> >> Regards, >> Greg >> >> On Thu, Nov 16, 2023 at 12:08 PM Roman Danyliw via Datatracker >> <noreply@ietf.org> wrote: >> >> Roman Danyliw has entered the following ballot position for >> draft-ietf-ippm-pam-08: No Objection >> >> When responding, please keep the subject line intact and reply to all >> email addresses included in the To and CC lines. (Feel free to >> cut this >> introductory paragraph, however.) >> >> >> Please refer to >> https://www.ietf.org/about/groups/iesg/statements/handling-ballot-positions/ >> >> for more information about how to handle DISCUSS and COMMENT >> positions. >> >> >> The document, along with other ballot positions, can be found here: >> https://datatracker.ietf.org/doc/draft-ietf-ippm-pam/ >> >> >> >> ---------------------------------------------------------------------- >> COMMENT: >> ---------------------------------------------------------------------- >> >> ** Section 3.1. Consider defining or providing an explanation of >> “optimal >> level threshold” and “critical threshold” in the definitions of >> VI and SVI. >> I’m assuming that these are two configured threshold levels. >> >> GIM>> You are right. We planned that both thresholds are configured, >> i.e., pre-defined, as noted in the document. Both reflect what can be >> described as "an acceptable deviation from an ideal performance >> metric". The optimal level may be used by a service provider to >> detect performance degradation, while the critical level reflects the >> requirements of the service customer. Would adding the following >> sentence make it clearer: >> OLD TEXT: >> The monitoring of performance parameters to determine the quality of >> an interval is performed between the elements of the network that are >> referred to for the SLO corresponding to the performance parameter. >> Mechanisms of setting levels of a threshold of an SLO are outside the >> scope of this document. >> NEW TEXT: >> The monitoring of performance parameters to determine the quality of >> an interval is performed between the elements of the network that are >> referred to for the SLO corresponding to the performance parameter. >> The optimal level threshold may be used by a service provider to >> detect performance degradation, while the critical level threshold >> reflects the requirements of the service customer. Mechanisms of >> setting levels of a threshold of an SLO are outside the scope of this >> document. > > <ALEX> Actually, I do not agree with this change. In particular, I > would take issue with the term "optimal level threshold". What > constitutes a Violated Interval is determined by the SLO. It is the > service level objective that, when breached, will cause a > corresponding interval to be violated. > > Now, SVI has a notion of higher severity - and what constitutes that > is again up to the network provider to define. But there is no notion > of optimality. (Nor is there, in fact, a notion of criticality - it's > SVI, not CVI.) > > I therefore find the new text to be misleading and believe the > original text should be reinstated. If we believe that additional > clarification is needed, we could add another sentence that indicates > that the configuration of a threshold which, when breached during an > interval, will cause a violation to be registered for that interface, > is determined per the definition of the SLO and configured accordingly. > > </ALEX> > >> >> ** Section 3.1. >> Beyond accounting for violated intervals, it is sometimes >> beneficial >> to maintain counts of packets for which a performance threshold is >> violated. >> >> No question of the utility of counting packets. However, >> shouldn’t there be a >> count of flows too? Section 1 said “This specification >> introduces a new set of >> metrics, Precision Availability Metrics (PAM), aimed at capturing >> end-to-end >> service levels for a flow, specifically the degree to which flows >> comply with >> the SLOs that are in effect.” >> >> GIM>> Thank you for the question and highlighted text. PAM is >> intended to characterize a single flow, and it seems to me that the >> use of plural is confusing. I propose the update as follows: >> OLD TEXT: >> This specification introduces a new set of metrics, Precision >> Availability Metrics (PAM), aimed at capturing end-to-end service >> levels for a flow, specifically the degree to which flows comply with >> the SLOs that are in effect. >> NEW TEXT: >> This specification introduces a new set of metrics, Precision >> Availability Metrics (PAM), aimed at capturing end-to-end service >> levels for a flow, specifically the degree to which the flow complies >> with the SLOs that are in effect. >> I hope that this update clarifies the scope of PAM. >> >> _______________________________________________ >> ippm mailing list >> ippm@ietf.org >> https://www.ietf.org/mailman/listinfo/ippm
- [ippm] Roman Danyliw's No Objection on draft-ietf… Roman Danyliw via Datatracker
- Re: [ippm] Roman Danyliw's No Objection on draft-… Greg Mirsky
- Re: [ippm] Roman Danyliw's No Objection on draft-… Alexander L Clemm
- Re: [ippm] Roman Danyliw's No Objection on draft-… Alexander L Clemm
- Re: [ippm] Roman Danyliw's No Objection on draft-… Greg Mirsky