Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-ippm-pam-09> for your review
Greg Mirsky <gregimirsky@gmail.com> Wed, 21 February 2024 23:31 UTC
Return-Path: <gregimirsky@gmail.com>
X-Original-To: auth48archive@ietfa.amsl.com
Delivered-To: auth48archive@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 73ED6C14F70D; Wed, 21 Feb 2024 15:31:01 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.104
X-Spam-Level:
X-Spam-Status: No, score=-2.104 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id pL-TdVr0dShM; Wed, 21 Feb 2024 15:30:57 -0800 (PST)
Received: from mail-yb1-xb30.google.com (mail-yb1-xb30.google.com [IPv6:2607:f8b0:4864:20::b30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A09AFC15198D; Wed, 21 Feb 2024 15:29:41 -0800 (PST)
Received: by mail-yb1-xb30.google.com with SMTP id 3f1490d57ef6-dcc4de7d901so6495363276.0; Wed, 21 Feb 2024 15:29:41 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1708558181; x=1709162981; darn=rfc-editor.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=CYaPTv9LFK8fksjrfQ4RqlwNl1sgW1WivaVnmqTWlyg=; b=j17YvZwDF+Bz+ABrnmnXQo9B7AP3CwgxUfQKhukfoyuP+AeUM5Ce1iW4rXcM8WiQcJ bTG9QR4bkrcBKuIxDjIntVDvTGT2qUooX1dZXuchLa9cRyomfnkqzAPa+m6yicCSUNho aAT9RpX0qQ3cmgATfhsc43K3lHDzb1uP4PRCkjNvXLitjAcUWMHXuxdm1DfRxk8ygZih tTauUecKZTLGscTVYEsUhMt4bZ0AgTFzZm3useul9aCZQUtiCQiQ36jOBQPWqz/MlKJk KMC3jjPQ3H18+S/T7arccCwfDLDMvq6Qc8zNL6FcRdlzyAwwb4XbVrhB+4E5s8ldzcz7 GTnQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1708558181; x=1709162981; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=CYaPTv9LFK8fksjrfQ4RqlwNl1sgW1WivaVnmqTWlyg=; b=WSbFsqSyA+ezU17S0fn3XjabY6s+bR6D4vR+XEJXrf3OLo9R8tfrSy207VXSZ8dKZW soBRLCXb2p9AGYAS2dWC/XnQRorMsHzTEu7yZkDNdLSuOfsAMcPN3QHB5R/hag2djQzs G6+KkYGttbuys6cpguEMBqfolf0H1WW6pHpWskEvW0cPggTmLmd80Mp3iYb6shooJNOS D/BlZRdTDTYEUszBQG4FdU7kWk6WC0uRKTNnXJJwwWutH0ATcDw8c4PZu3DTrFaFmn4Q 62YtXNFi3v5q8wky2j2UGeiKR6Fw1qRe0pKuNvE4fWZGpTlQMTeg4AIbhPsYA5OtGAIO hSog==
X-Forwarded-Encrypted: i=1; AJvYcCUHylp9k9ksGQfLM0UbTj/30I0gWC6oBHUwH6rAMR+lad65PnNv+tWnooNvxhI1VQ21sM7o5ZbXcASxositG4wr3MdE6frDUwCHHnzEKutKZEfYQb0GApEO2YhFJh9rzAGv5WMlV/Gi
X-Gm-Message-State: AOJu0Yz06CXqIHUGyV96CXorjayyx6jEZWYpd7lXdNNwb6FHzqUlD7uZ zvoM+Py7Ev4U4jhVtdqAevNBaw6yWCP2uOrzjAIGwOI6HsxbTBIK/Ou8SowmmOiNlTs4LrYB/fa iX9AtcuhOOIr8+luwiTTkU8JJkoc=
X-Google-Smtp-Source: AGHT+IFx4bOD0HP3Dav8k/uzOBC1lSdtJEEVE3XwvIzBO4ZH7eboSMK9XoHxkvHi7nTml/Ht3DfinTOwwHTaEUFJERE=
X-Received: by 2002:a25:aa22:0:b0:dc7:32b1:b7ea with SMTP id s31-20020a25aa22000000b00dc732b1b7eamr694571ybi.46.1708558180359; Wed, 21 Feb 2024 15:29:40 -0800 (PST)
MIME-Version: 1.0
References: <20240216013901.CFDFA1E58A6@rfcpa.amsl.com> <CA+RyBmVgQPGHutNL9E79rOGZBy8rZ6ZBiQpxU9u6b03WtE8YuQ@mail.gmail.com> <BL0PR1501MB2132FF3AD9E08B1799AEBB39E7512@BL0PR1501MB2132.namprd15.prod.outlook.com> <CAJwYUrFzT5nvyk-47KZ5Di8AUArsMRqBJE8wYiReFOyxW=GqQQ@mail.gmail.com> <0FA0C9A7-44D2-4ADE-AF11-9BF6B629C0F5@amsl.com> <CA+RyBmU7N8ZpSMXeEetSpUfH+JWpK44=4F+wJ8Vv7phb_vu_xw@mail.gmail.com> <CAJwYUrFVM9ZDpUYjHOLLaiY6WE5CbBRuS7uUd2ho00GbrdPr4w@mail.gmail.com> <CA+RyBmVPhxuZBr7+xqgav4ia4SHGU8g2Qj14ebWp0bLZfHjZGQ@mail.gmail.com> <EA7E56CD-14F4-4691-B9A0-63054C90E20B@amsl.com>
In-Reply-To: <EA7E56CD-14F4-4691-B9A0-63054C90E20B@amsl.com>
From: Greg Mirsky <gregimirsky@gmail.com>
Date: Wed, 21 Feb 2024 15:29:30 -0800
Message-ID: <CA+RyBmW57-1=1i38BzPkGyRax2Gjp+dB=CLi7pX0ea9m9CxruQ@mail.gmail.com>
To: Rebecca VanRheenen <rvanrheenen@amsl.com>
Cc: John Strassner <strazpdj@gmail.com>, Joel Halpern <joel.halpern@ericsson.com>, "xiao.min2@zte.com.cn" <xiao.min2@zte.com.cn>, "ludwig@clemm.org" <ludwig@clemm.org>, "jerome.francois@inria.fr" <jerome.francois@inria.fr>, RFC Editor <rfc-editor@rfc-editor.org>, "ippm-ads@ietf.org" <ippm-ads@ietf.org>, "ippm-chairs@ietf.org" <ippm-chairs@ietf.org>, "tpauly@apple.com" <tpauly@apple.com>, "martin.h.duke@gmail.com" <martin.h.duke@gmail.com>, "auth48archive@rfc-editor.org" <auth48archive@rfc-editor.org>
Content-Type: multipart/alternative; boundary="0000000000006b23ef0611ecb3c2"
Archived-At: <https://mailarchive.ietf.org/arch/msg/auth48archive/jyfc6kgejfnr8zrqzx9EVyC01Gc>
Subject: Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-ippm-pam-09> for your review
X-BeenThere: auth48archive@rfc-editor.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: "Archiving AUTH48 exchanges between the RFC Production Center, the authors, and other related parties" <auth48archive.rfc-editor.org>
List-Unsubscribe: <https://mailman.rfc-editor.org/mailman/options/auth48archive>, <mailto:auth48archive-request@rfc-editor.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/auth48archive/>
List-Post: <mailto:auth48archive@rfc-editor.org>
List-Help: <mailto:auth48archive-request@rfc-editor.org?subject=help>
List-Subscribe: <https://mailman.rfc-editor.org/mailman/listinfo/auth48archive>, <mailto:auth48archive-request@rfc-editor.org?subject=subscribe>
X-List-Received-Date: Wed, 21 Feb 2024 23:31:01 -0000
Hi Rebecca, thank you for your thoughtful handling of our comments and carefully applying them to the document. I read the AUTH48 version, and I agree with all the updates. Best regards, Greg On Wed, Feb 21, 2024 at 1:56 PM Rebecca VanRheenen <rvanrheenen@amsl.com> wrote: > Hi authors, > > Thanks for the quick responses! We have updated the document. All > questions have been resolved. > > Please review the document carefully to ensure satisfaction as we do not > make changes once it has been published as an RFC. Contact us with any > further updates or with your approval of the document in its current form. > We will await approvals from each author prior to moving forward in the > publication process. > > Updated XML file: > https://www.rfc-editor.org/authors/rfc9544.xml > > Updated output files: > https://www.rfc-editor.org/authors/rfc9544.txt > https://www.rfc-editor.org/authors/rfc9544.pdf > https://www.rfc-editor.org/authors/rfc9544.html > > Diff file showing all changes made during AUTH48: > https://www.rfc-editor.org/authors/rfc9544-auth48diff.html > > Diff files showing all changes: > https://www.rfc-editor.org/authors/rfc9544-diff.html > https://www.rfc-editor.org/authors/rfc9544-rfcdiff.html (side-by-side > diff) > https://www.rfc-editor.org/authors/rfc9544-alt-diff.html (diff showing > changes where text is moved or deleted) > > Note that it may be necessary for you to refresh your browser to view the > most recent version. > > For the AUTH48 status of this document, please see: > https://www.rfc-editor.org/auth48/rfc9544 > > Thank you, > > RFC Editor/rv > > > > > On Feb 20, 2024, at 4:18 PM, Greg Mirsky <gregimirsky@gmail.com> wrote: > > > > Hi John, > > thank you for your prompt response. I like "identified in" and support > your proposal. > > > > Regards, > > Greg > > > > On Tue, Feb 20, 2024 at 4:13 PM John Strassner <strazpdj@gmail.com> > wrote: > > Hi Greg, et al., > > > > Greg wrote: > > John: > > > #7: I think that "between the elements of the network that are > referred to for > > > the SLO corresponding to the performance parameter" is incorrect. > > > The SLO defines both the metric and where the metric is measured. > > > The SLO does not "refer" to anything. > > > Hence, I would instead say: "between the elements of the network > that > > > are defined by the SLO corresponding to the performance > parameter." > > GIM2>> I agree with "referred to by" suggested by Joel. I think that > "defined by" suggested by John is closer to "identified in" as a > performance metric is firstly defined and then can be used in the SLO. > Similarly, in my opinion, network elements are identified in the SLO. Thus, > I think that "referred to by" most accurately characterizes the > relationship. > > > > <jcs> > > The SLO does define the metric. If you are more comfortable with > identified in, that is fine. > > I think that "referred to by" is awkward. So how about "between the > elements of the network that are identified in the SLO corresponding to the > performance parameter."? > > > > best regards, > > John > > > > On Tue, Feb 20, 2024 at 3:11 PM Greg Mirsky <gregimirsky@gmail.com> > wrote: > > Hi Rebecca, > > thank you for careful consolidation of our proposals. Please find my > responses to the outstanding questions below tagged GIM2>>. > > > > Kind regards, > > Greg > > > > On Tue, Feb 20, 2024 at 2:24 PM Rebecca VanRheenen <rvanrheenen@amsl.com> > wrote: > > Hi authors, > > > > Thank you all for your replies! We have updated the document accordingly > (see list of updated files below) and have a few followup questions: > > > > > > 1) There were several suggestions in response to this question (listed > below). Please discuss and let us know how to update. > > > > >> 7) <!-- [rfced] Please confirm that "referred to for" is correct. Or > should this > > >> be updated to "referred to", "referred for", or something else? > > >> > > >> Original: > > >> The monitoring of performance parameters to determine the quality > of > > >> an interval is performed between the elements of the network that > are > > >> referred to for the SLO corresponding to the performance parameter. > > > > Greg: > > > I think that it should be "referred to". > > > > Joel: > > > If I am reading item 7 correctly, I think that is “referred to by”. I > can live with many forms, but I think “between the elements of the network > that are referred to the SLO” will cause many people reading difficulty. > > > > John: > > > #7: I think that "between the elements of the network that are > referred to for > > > the SLO corresponding to the performance parameter" is incorrect. > > > The SLO defines both the metric and where the metric is measured. > > > The SLO does not "refer" to anything. > > > Hence, I would instead say: "between the elements of the network > that > > > are defined by the SLO corresponding to the performance > parameter." > > GIM2>> I agree with "referred to by" suggested by Joel. I think that > "defined by" suggested by John is closer to "identified in" as a > performance metric is firstly defined and then can be used in the SLO. > Similarly, in my opinion, network elements are identified in the SLO. Thus, > I think that "referred to by" most accurately characterizes the > relationship. > > > > > > 2) > > > > >> 11) <!-- [rfced] May we change the first bulleted list in Sections > 3.1 and all > > >> the bulleted lists in Section 3.2 to definition lists? See > > >> https://authors.ietf.org/en/rfcxml-vocabulary#dl. > > >> > > >> One example: > > >> > > >> Current: > > >> * VI is a time interval during which at least one of the > performance > > >> parameters degraded below its configurable optimal level > > >> threshold. > > >> > > >> * SVI is a time interval during which at least one of the > > >> performance parameters degraded below its configurable critical > > >> threshold. > > >> > > >> * Consequently, VFI is a time interval during which all > performance > > >> parameters are at or better than their respective pre-defined > > >> optimal levels. > > >> > > >> Perhaps: > > >> VI: A time interval during which at least one of the performance > > >> parameters degraded below its configurable optimal level > > >> threshold. > > >> > > >> SVI: A time interval during which at least one of the > > >> performance parameters degraded below its configurable critical > > >> threshold. > > >> > > >> VFI: A time interval during which all performance > > >> parameters are at or better than their respective pre-defined > > >> optimal levels. > > > > > > GIM>> I slightly prefer the current format, but I can live with the > update. > > > —> > > > > We did not make any changes here, per your preference. > > GIM2>> Thank you > > > > > > 3) > > > > >> a) We see both of the following as the expansion for PAM. > > >> > > >> Precision Availability Metric (1 instance) > > >> Precision Availability Metrics (8 instances) > > >> > > >> We updated to use the latter form (i.e., the form with "Metrics"). > Please let > > >> us know any objections. > > > GIM>> Thank you for the question. I think that the use of singular, > i.e., "Metric", in Acronyms is valid. Consequently, all acronyms in the > document, in my opinion, should be changed to "PAMs". > > > > We updated PAM to PAMs in all instances except the following (when used > as an adjective). In a few instances, we also updated verbs from singular > to plural when “PAMs" is used as a subject, so please review those for > correctness. > > > > Current (“PAM” as adjective): > > 3.3. PAM Configuration Settings and Service Availability > > > > 5. Other Expected PAM Benefits > > > > … per some predefined PAM settings. > > > > … of PAM-related settings. > > > > GIM2>> Thank you for your thoughtful handling of the use of this acronym > in the document. > > > > > > 4) > > > > >> d) FYI - We have added an expansion for the following abbreviation > > >> per Section 3.6 of RFC 7322 ("RFC Style Guide"). Please review each > > >> expansion in the document carefully to ensure correctness. > > >> > > >> IP Flow Information Export (IPFIX) > > > > Greg: > > > It seems that IPFIX is used only one time in the document. Do you > think that the expanded form without the acronym is sufficient? I'm okay > with any form. > > > > John: > > > #17d: I would rather spell out IPFIX (since it is only used once) but > am also ok with adding it to the list of abbreviations. > > > > We chose to add this to the list of abbreviations as suggested by John. > Omitting the acronym might make the sentence a bit harder to read because > of the two instances of “Information”. Please let us know any concerns. > > > > Text without acronym: > > * A set of IP Flow Information Export Information Elements > > will allow PAM ... > > GIM2>> I agree with John's proposal to add IPFIX to the list of acronyms > and use the abbreviated form in the body of the document. > > > > > > 5) Would you like to alphabetize the acronyms in Section 2.2, or do you > prefer the current order? The current ordering seems to be intentional > (similar terms grouped together), but we want to check after adding IPFIX > to the end of the list. > > GIM2>> I find the alphabetical order to be more reader-friendly. > > _______________ > > > > Updated XML file: > > https://www.rfc-editor.org/authors/rfc9544.xml > > > > Updated output files: > > https://www.rfc-editor.org/authors/rfc9544.txt > > https://www.rfc-editor.org/authors/rfc9544.pdf > > https://www.rfc-editor.org/authors/rfc9544.html > > > > Diff file showing all changes made during AUTH48: > > https://www.rfc-editor.org/authors/rfc9544-auth48diff.html > > > > Diff files showing all changes: > > https://www.rfc-editor.org/authors/rfc9544-diff.html > > https://www.rfc-editor.org/authors/rfc9544-rfcdiff.html > (side-by-side diff) > > https://www.rfc-editor.org/authors/rfc9544-alt-diff.html(diff > showing changes where text is moved or deleted) > > > > Note that it may be necessary for you to refresh your browser to view > the most recent version. > > > > For the AUTH48 status of this document, please see: > > https://www.rfc-editor.org/auth48/rfc9544 > > > > Thank you, > > > > RFC Editor/rv > > > > > > > > > On Feb 19, 2024, at 9:44 PM, John Strassner <strazpdj@gmail.com> > wrote: > > > > > > Hi all, > > > > > > MY comments are as follows: > > > YES with no additional comments to what Greg made: 1, 2, 4, 5, 6, 8, > 9, 10, 11,12, 13, 14, 15, 16, 17 (a and b and c), 18, 19 > > > > > > #3: YES, but I do not like changing "or" to "nor" > > > > > > #17d: I would rather spell out IPFIX (since it is only used once) but > am also ok with adding it to the list of abbreviations. > > > > > > #7: I think that "between the elements of the network that are > referred to for > > > the SLO corresponding to the performance parameter" is incorrect. > > > The SLO defines both the metric and where the metric is measured. > > > The SLO does not "refer" to anything. > > > Hence, I would instead say: "between the elements of the network > that > > > are defined by the SLO corresponding to the performance > parameter." > > > > > > On Feb 15, 2024, at 5:34 PM, rfc-editor@rfc-editor.org wrote: > > > > > > > > > *****IMPORTANT***** > > > > > > Updated 2024/02/15 > > > > > > RFC Author(s): > > > -------------- > > > > > > Instructions for Completing AUTH48 > > > > > > Your document has now entered AUTH48. Once it has been reviewed and > > > approved by you and all coauthors, it will be published as an RFC. > > > If an author is no longer available, there are several remedies > > > available as listed in the FAQ (https://www.rfc-editor.org/faq/). > > > > > > You and you coauthors are responsible for engaging other parties > > > (e.g., Contributors or Working Group) as necessary before providing > > > your approval. > > > > > > Planning your review > > > --------------------- > > > > > > Please review the following aspects of your document: > > > > > > * RFC Editor questions > > > > > > Please review and resolve any questions raised by the RFC Editor > > > that have been included in the XML file as comments marked as > > > follows: > > > > > > <!-- [rfced] ... --> > > > > > > These questions will also be sent in a subsequent email. > > > > > > * Changes submitted by coauthors > > > > > > Please ensure that you review any changes submitted by your > > > coauthors. We assume that if you do not speak up that you > > > agree to changes submitted by your coauthors. > > > > > > * Content > > > > > > Please review the full content of the document, as this cannot > > > change once the RFC is published. Please pay particular attention > to: > > > - IANA considerations updates (if applicable) > > > - contact information > > > - references > > > > > > * Copyright notices and legends > > > > > > Please review the copyright notice and legends as defined in > > > RFC 5378 and the Trust Legal Provisions > > > (TLP – https://trustee.ietf.org/license-info/). > > > > > > * Semantic markup > > > > > > Please review the markup in the XML file to ensure that elements of > > > content are correctly tagged. For example, ensure that <sourcecode> > > > and <artwork> are set correctly. See details at > > > <https://authors.ietf.org/rfcxml-vocabulary>. > > > > > > * Formatted output > > > > > > Please review the PDF, HTML, and TXT files to ensure that the > > > formatted output, as generated from the markup in the XML file, is > > > reasonable. Please note that the TXT will have formatting > > > limitations compared to the PDF and HTML. > > > > > > > > > Submitting changes > > > ------------------ > > > > > > To submit changes, please reply to this email using ‘REPLY ALL’ as all > > > the parties CCed on this message need to see your changes. The parties > > > include: > > > > > > * your coauthors > > > > > > * rfc-editor@rfc-editor.org (the RPC team) > > > > > > * other document participants, depending on the stream (e.g., > > > IETF Stream participants are your working group chairs, the > > > responsible ADs, and the document shepherd). > > > > > > * auth48archive@rfc-editor.org, which is a new archival mailing > list > > > to preserve AUTH48 conversations; it is not an active discussion > > > list: > > > > > > * More info: > > > > https://mailarchive.ietf.org/arch/msg/ietf-announce/yb6lpIGh-4Q9l2USxIAe6P8O4Zc > > > > > > * The archive itself: > > > https://mailarchive.ietf.org/arch/browse/auth48archive/ > > > > > > * Note: If only absolutely necessary, you may temporarily opt out > > > of the archiving of messages (e.g., to discuss a sensitive > matter). > > > If needed, please add a note at the top of the message that you > > > have dropped the address. When the discussion is concluded, > > > auth48archive@rfc-editor.org will be re-added to the CC list > and > > > its addition will be noted at the top of the message. > > > > > > You may submit your changes in one of two ways: > > > > > > An update to the provided XML file > > > — OR — > > > An explicit list of changes in this format > > > > > > Section # (or indicate Global) > > > > > > OLD: > > > old text > > > > > > NEW: > > > new text > > > > > > You do not need to reply with both an updated XML file and an explicit > > > list of changes, as either form is sufficient. > > > > > > We will ask a stream manager to review and approve any changes that > seem > > > beyond editorial in nature, e.g., addition of new text, deletion of > text, > > > and technical changes. Information about stream managers can be found > in > > > the FAQ. Editorial changes do not require approval from a stream > manager. > > > > > > > > > best regards, > > > John > > > > > > On Sun, Feb 18, 2024 at 8:04 PM Joel Halpern < > joel.halpern@ericsson.com> wrote: > > > I can live with all the changes as proposed. > > > > > > > > > > > > If I am reading item 7 correctly, I think that is “referred to by”. I > can live with many forms, but I think “between the elements of the network > that are referred to the SLO” will cause many people reading difficulty. > > > > > > Yours, > > > Joel > > > > > > > > > > > > From: Greg Mirsky <gregimirsky@gmail.com> > > > Sent: Friday, February 16, 2024 8:45 PM > > > To: rfc-editor@rfc-editor.org > > > Cc: Joel Halpern <joel.halpern@ericsson.com>; xiao.min2@zte.com.cn; > ludwig@clemm.org; strazpdj@gmail.com; jerome.francois@inria.fr; > ippm-ads@ietf.org; ippm-chairs@ietf.org; tpauly@apple.com; > martin.h.duke@gmail.com; auth48archive@rfc-editor.org > > > Subject: Re: AUTH48: RFC-to-be 9544 <draft-ietf-ippm-pam-09> for your > review > > > > > > > > > > > > Dear RFC Editor, > > > > > > thank you for your thoughtful proposals helping in improving the > document. Please find my responses and notes below tagged GIM>>. > > > > > > > > > > > > Regards, > > > > > > Greg > > > > > > > > > > > > On Thu, Feb 15, 2024 at 5:39 PM <rfc-editor@rfc-editor.org> wrote: > > > > > > Authors, > > > > > > While reviewing this document during AUTH48, please resolve (as > necessary) the following questions, which are also in the XML file. > > > > > > > > > 1) <!-- [rfced] FYI - We updated the abbreviated title (appears in the > center of > > > the running header in the pdf output) to more closely align with the > > > document title. Please let us know any objections. > > > > > > Original: > > > Framework of PAM > > > > > > Current: > > > PAM for Services Governed by SLOs > > > > > > GIM>> I agree with the update with a minor modification > > > > > > PAMs for Service Governed by SLOs > > > > > > I've looked at the title itself and wanted to ask you and the > co-authors a question. The title introduces the SLO acronym, should the PAM > acronym also be introduced in the title as > > > > > > > > > > > > Precision Availability Metrics (PAMs) for Services Governed by > Service Level Objectives (SLOs) > > > > > > --> > > > > > > > > > 2) <!-- [rfced] How may we update the text after the comma to improve > clarity? > > > > > > Original: > > > Hence it is not sufficient to measure service levels > > > per se over time, but to assess the quality of the service being > > > contextually provided (e.g., with the applicable SLO in mind). > > > > > > Perhaps: > > > Hence, it is not sufficient to measure service levels > > > per se over time; the quality of the service being > > > contextually provided (e.g., with the applicable SLO in mind) must > be also assessed. > > > > > > GIM>> I agree with the proposed update. It makes the text more > readable. > > > > > > --> > > > > > > > > > 3) <!-- [rfced] May we update the text starting with ", and whether > their > > > SLOs..." as follows for to create parallel structure? > > > > > > Original: > > > However, at this point, there are no standard metrics that can be > > > used to account for the quality with which services are delivered > > > relative to their SLOs, and whether their SLOs are being met at all > > > times. > > > > > > Perhaps: > > > However, at this point, there are no standard metrics that can be > > > used to account for the quality with which services are delivered > > > relative to their SLOs or to determine whether their SLOs are being > met at all > > > times. > > > > > > GIM>> I agree with the proposed update that improves the text. I > wonder if s/or/nor/ is acceptable in this sentence? > > > > > > > > > --> > > > > > > > > > 4) <!-- [rfced] We see the term "Flow Record" in RFC 7011 but not in > RFC 7012 > > > (though "flow" does appear). Please review the citations and let us > know > > > if any updates are needed. > > > > > > Original: > > > Flow records [RFC7011] and > > > [RFC7012] maintain statistics about flows, including flow volume and > > > flow duration, but again, contain very little information about > > > service levels, let alone whether the service levels delivered meet > > > their respective targets, i.e., their associated SLOs. > > > > > > GIM>> Thank you for your thoughtful question. I think that reference > to RFC 7012 is justified as it refers, as you've noted, to 'Flow' and 'Flow > information'. > > > > > > --> > > > > > > > > > 5) <!-- [rfced] FYI - We updated the title of Section 2 from > "Conventions and > > > Terminology" to "Conventions" because "Terminology" is one of the > > > subsections. Please review and let us know any concerns. > > > > > > Original: > > > 2. Conventions and Terminology > > > 2.1. Terminology > > > 2.2. Acronyms > > > > > > Current: > > > 2. Conventions > > > 2.1. Terminology > > > 2.2. Acronyms > > > > > > GIM>> I agree with the update > > > > > > --> > > > > > > > > > 6) <!-- [rfced] Is "configurable optimal level threshold" correct > here? Should > > > this read "configurable optimal threshold" (i.e., no "level") or > "configurable > > > optimal level (i.e., no "threshold")? > > > > > > Original: > > > * VI is a time interval during which at least one of the > performance > > > parameters degraded below its configurable optimal level > > > threshold. > > > > > > Perhaps: > > > * VI is a time interval during which at least one of the > performance > > > parameters degraded below its configurable optimal > > > threshold. > > > > > > GIM>> Thank you for pointing out that "threshold" and "level" are > synonyms. I slightly prefer the first option (above), but I can live with > the other proposal (below) > > > > > > > > > Or: > > > * VI is a time interval during which at least one of the > performance > > > parameters degraded below its configurable optimal > > > level. > > > --> > > > > > > > > > 7) <!-- [rfced] Please confirm that "referred to for" is correct. Or > should this > > > be updated to "referred to", "referred for", or something else? > > > > > > Original: > > > The monitoring of performance parameters to determine the quality of > > > an interval is performed between the elements of the network that > are > > > referred to for the SLO corresponding to the performance parameter. > > > > > > GIM>> I think that it should be "referred to". > > > > > > --> > > > > > > > > > 8) <!-- [rfced] How may we update "this allows distinguishing" here? > > > > > > Original: > > > For example, this allows distinguishing between cases in > > > which violated intervals are caused by isolated violation > occurrences > > > (such as, a sporadic issue that may be caused by a temporary spike > in > > > a queue depth along the packet's path) or by broad violations across > > > multiple packets (such as a problem with slow route convergence > > > across the network or more foundational issues such as insufficient > > > network resources). > > > > > > Perhaps ("this allows a service provider to distinguish"): > > > For example, this allows a service provider to distinguish between > cases in > > > which violated intervals are caused by isolated violation > occurrences > > > (such as a sporadic issue that may be caused by a temporary spike in > > > a queue depth along the packet's path) or by broad violations across > > > multiple packets (such as a problem with slow route convergence > > > across the network or more foundational issues such as insufficient > > > network resources). > > > > > > Or ("this allows for distinguishing"): > > > For example, this allows for distinguishing between cases in > > > which violated intervals are caused by isolated violation > occurrences > > > (such as a sporadic issue that may be caused by a temporary spike in > > > a queue depth along the packet's path) or by broad violations across > > > multiple packets (such as a problem with slow route convergence > > > across the network or more foundational issues such as insufficient > > > network resources). > > > > > > GIM>> I slightly prefer the latter option as the act of attributing > degradation to a cause could be performed by a function, not an operator. > But I can live with the former option. > > > > > > > > > --> > > > > > > > > > 9) <!-- [rfced] This sentence appears in Section 3.2 and points to > Section > > > 3. Should "introduced in Section 3" either be removed or updated to > "introduced > > > in this document"? Also, is this sentence introducing the bulleted list > > > that appear after the paragraph? If so, would adding "The following" be > > > helpful? > > > > > > Original: > > > A set of metrics can be created based on PAM introduced in Section > 3. > > > > > > Perhaps (omit section pointer): > > > The following set of metrics can be created based on PAM. > > > > > > Or (use "in this document" instead of section pointer): > > > The following set of metrics can be created based on PAM as > introduced > > > in this document. > > > > > > GIM>> I slightly prefer the latter option, but I can live with the > first one. > > > > > > --> > > > > > > > > > 10) <!-- [rfced] We updated the first two bulleted lists in Section > 3.2 (created > > > parallel structure and removed the parentheses around sentences). > Please > > > review these changes in the diff file and let us know any concerns. > > > > > > GIM>> I agree with the update that makes looks of lists in the > document consistent. > > > > > > --> > > > > > > > > > 11) <!-- [rfced] May we change the first bulleted list in Sections 3.1 > and all > > > the bulleted lists in Section 3.2 to definition lists? See > > > https://authors.ietf.org/en/rfcxml-vocabulary#dl. > > > > > > One example: > > > > > > Current: > > > * VI is a time interval during which at least one of the > performance > > > parameters degraded below its configurable optimal level > > > threshold. > > > > > > * SVI is a time interval during which at least one of the > > > performance parameters degraded below its configurable critical > > > threshold. > > > > > > * Consequently, VFI is a time interval during which all performance > > > parameters are at or better than their respective pre-defined > > > optimal levels. > > > > > > Perhaps: > > > VI: A time interval during which at least one of the performance > > > parameters degraded below its configurable optimal level > > > threshold. > > > > > > SVI: A time interval during which at least one of the > > > performance parameters degraded below its configurable critical > > > threshold. > > > > > > VFI: A time interval during which all performance > > > parameters are at or better than their respective pre-defined > > > optimal levels. > > > > > > GIM>> I slightly prefer the current format, but I can live with the > update. > > > > > > --> > > > > > > > > > 12) <!-- [rfced] Should "the following section" here read "this > section"? This > > > sentence appears in Section 3.3; the following section is Section 4, > > > which does not mention a state model. > > > > > > Original: > > > While the definition of a service state model is outside the scope > of > > > this document, the following section provides some considerations > for > > > how such a state model and accompanying configuration settings could > > > be defined. > > > > > > Perhaps: > > > While the definition of a service state model is outside the scope > of > > > this document, this section provides some considerations for > > > how such a state model and accompanying configuration settings could > > > be defined. > > > > > > GIM>> Thank you for your thoughtful consideration of the text. I agree > with the proposed update. > > > > > > --> > > > > > > > > > 13) <!-- [rfced] Would it be helpful to update "YANG/NETCONF/RESTCONF > framework" > > > as follows? Or do you prefer the current? > > > > > > Original: > > > * A YANG data model will allow PAM to be incorporated into > > > monitoring applications based on the YANG/NETCONF/RESTCONF > > > framework. > > > > > > Perhaps: > > > * A YANG data model will allow PAM to be incorporated into > > > monitoring applications based on the YANG, NETCONF, > > > and RESTCONF frameworks. > > > > > > GIM>> I agree with the proposed update. > > > > > > > > > --> > > > > > > > > > 14) <!-- [rfced] FYI - We rephrased this as follows to form a complete > > > sentence. The other items in the list are complete sentences. Please > > > review. > > > > > > Original: > > > * The definition of the metrics that represent histograms for > > > service level parameters with buckets corresponding to individual > > > service level objectives, > > > > > > Updated: > > > * Metrics can be defined to represent histograms for > > > service-level parameters with buckets corresponding to individual > > > SLOs.. > > > > > > GIM>> I agree with the proposed update. > > > > > > --> > > > > > > > > > 15) <!-- [rfced] Please review "that should be maintained". Should > this read "and > > > should be maintained", or is the current okay? Also, please confirm > that > > > "violated time units" is correct here. We do not see this mentioned > > > elsewhere in the document. > > > > > > Original: > > > The same service levels that > > > constitute SLO violations for one flow that should be maintained as > > > part of the "violated time units" and related metrics, may be > > > compliant for another flow. > > > > > > Perhaps: > > > The same service levels that > > > constitute SLO violations for one flow and should be maintained as > > > part of the "violated time units" and related metrics may be > > > compliant for another flow. > > > > > > GIM>> I agree with the updated version. > > > > > > > > > --> > > > > > > > > > 16) <!-- [rfced] FYI - We updated this fragment as follows to create a > complete > > > sentence. > > > > > > Original: > > > By the same token, where the definition of what constitutes a > > > "severe" or a "significant" violation depends on configuration > > > settings or context. > > > > > > Perhaps: > > > By the same token, the definition of what constitutes a > > > "severe" or a "significant" violation depends on configuration > > > settings or context. > > > > > > GIM>> I agree with the proposed update. > > > > > > > > > --> > > > > > > > > > 17) <!-- [rfced] Abbreviations > > > > > > a) We see both of the following as the expansion for PAM. > > > > > > Precision Availability Metric (1 instance) > > > Precision Availability Metrics (8 instances) > > > > > > We updated to use the latter form (i.e., the form with "Metrics"). > Please let > > > us know any objections. > > > > > > GIM>> Thank you for the question. I think that the use of singular, > i.e., "Metric", in Acronyms is valid. Consequently, all acronyms in the > document, in my opinion, should be changed to "PAMs". > > > > > > > > > > > > b) We see two instances of "PAMs" in the document (see below). Since > "Metrics" > > > in the expansion is already plural, is the "s" needed in "PAMs"? Please > > > review. > > > > > > Original: > > > To indicate a historic degree of precision availability, additional > > > derived PAMs can be defined as follows: > > > ... > > > It might be useful for a service provider to determine the current > > > condition of the service for which PAMs are maintained. > > > > > > GIM>> If we agree that the acronym is expanded as "Precision > Availability Metric", then "PAMs" is the right form. > > > > > > > > > > > > > > > c) OAM appears in the list of acronyms in Section 2.2 but is not > mentioned > > > elsewhere in the document. May we delete this term from the list? > > > > > > GIM>> Yes, please remove it. > > > > > > > > > > > > d) FYI - We have added an expansion for the following abbreviation > > > per Section 3.6 of RFC 7322 ("RFC Style Guide"). Please review each > > > expansion in the document carefully to ensure correctness. > > > > > > IP Flow Information Export (IPFIX) > > > > > > GIM>> It seems that IPFIX is used only one time in the document. Do > you think that the expanded form without the acronym is sufficient? I'm > okay with any form. > > > > > > --> > > > > > > > > > 18) <!-- [rfced] Please review the "Inclusive Language" portion of the > online > > > Style Guide < > https://www.rfc-editor.org/styleguide/part2/#inclusive_language> > > > and let us know if any changes are needed. > > > > > > Note that our script did not flag any words in particular, but this > should > > > still be reviewed as a best practice. > > > > > > GIM>> I agree, don't find anything that requires rewording. > > > > > > --> > > > > > > > > > 19) <!-- [rfced] We see a number of author-inserted comments in the > .xml file for > > > this document. We are unsure if these have been resolved. Please review > > > and let us know if these can be deleted or if they need to be > addressed. > > > > > > GIM>> :-) My apologies for not cleaning our workspace properly. Thank > you. > > > > > > --> > > > > > > > > > Thank you. > > > > > > RFC Editor/rv > > > > > > > > > > > > On Feb 15, 2024, at 5:34 PM, rfc-editor@rfc-editor.org wrote: > > > > > > *****IMPORTANT***** > > > > > > Updated 2024/02/15 > > > > > > RFC Author(s): > > > -------------- > > > > > > Instructions for Completing AUTH48 > > > > > > Your document has now entered AUTH48. Once it has been reviewed and > > > approved by you and all coauthors, it will be published as an RFC. > > > If an author is no longer available, there are several remedies > > > available as listed in the FAQ (https://www.rfc-editor.org/faq/). > > > > > > You and you coauthors are responsible for engaging other parties > > > (e.g., Contributors or Working Group) as necessary before providing > > > your approval. > > > > > > Planning your review > > > --------------------- > > > > > > Please review the following aspects of your document: > > > > > > * RFC Editor questions > > > > > > Please review and resolve any questions raised by the RFC Editor > > > that have been included in the XML file as comments marked as > > > follows: > > > > > > <!-- [rfced] ... --> > > > > > > These questions will also be sent in a subsequent email. > > > > > > * Changes submitted by coauthors > > > > > > Please ensure that you review any changes submitted by your > > > coauthors. We assume that if you do not speak up that you > > > agree to changes submitted by your coauthors. > > > > > > * Content > > > > > > Please review the full content of the document, as this cannot > > > change once the RFC is published. Please pay particular attention > to: > > > - IANA considerations updates (if applicable) > > > - contact information > > > - references > > > > > > * Copyright notices and legends > > > > > > Please review the copyright notice and legends as defined in > > > RFC 5378 and the Trust Legal Provisions > > > (TLP – https://trustee.ietf.org/license-info/). > > > > > > * Semantic markup > > > > > > Please review the markup in the XML file to ensure that elements of > > > content are correctly tagged. For example, ensure that <sourcecode> > > > and <artwork> are set correctly. See details at > > > <https://authors.ietf.org/rfcxml-vocabulary>. > > > > > > * Formatted output > > > > > > Please review the PDF, HTML, and TXT files to ensure that the > > > formatted output, as generated from the markup in the XML file, is > > > reasonable. Please note that the TXT will have formatting > > > limitations compared to the PDF and HTML. > > > > > > > > > Submitting changes > > > ------------------ > > > > > > To submit changes, please reply to this email using ‘REPLY ALL’ as all > > > the parties CCed on this message need to see your changes. The parties > > > include: > > > > > > * your coauthors > > > > > > * rfc-editor@rfc-editor.org (the RPC team) > > > > > > * other document participants, depending on the stream (e.g., > > > IETF Stream participants are your working group chairs, the > > > responsible ADs, and the document shepherd). > > > > > > * auth48archive@rfc-editor.org, which is a new archival mailing > list > > > to preserve AUTH48 conversations; it is not an active discussion > > > list: > > > > > > * More info: > > > > https://mailarchive.ietf.org/arch/msg/ietf-announce/yb6lpIGh-4Q9l2USxIAe6P8O4Zc > > > > > > * The archive itself: > > > https://mailarchive.ietf.org/arch/browse/auth48archive/ > > > > > > * Note: If only absolutely necessary, you may temporarily opt out > > > of the archiving of messages (e.g., to discuss a sensitive > matter). > > > If needed, please add a note at the top of the message that you > > > have dropped the address. When the discussion is concluded, > > > auth48archive@rfc-editor.org will be re-added to the CC list > and > > > its addition will be noted at the top of the message. > > > > > > You may submit your changes in one of two ways: > > > > > > An update to the provided XML file > > > — OR — > > > An explicit list of changes in this format > > > > > > Section # (or indicate Global) > > > > > > OLD: > > > old text > > > > > > NEW: > > > new text > > > > > > You do not need to reply with both an updated XML file and an explicit > > > list of changes, as either form is sufficient. > > > > > > We will ask a stream manager to review and approve any changes that > seem > > > beyond editorial in nature, e.g., addition of new text, deletion of > text, > > > and technical changes. Information about stream managers can be found > in > > > the FAQ. Editorial changes do not require approval from a stream > manager. > > > > > > > > > Approving for publication > > > -------------------------- > > > > > > To approve your RFC for publication, please reply to this email stating > > > that you approve this RFC for publication. Please use ‘REPLY ALL’, > > > as all the parties CCed on this message need to see your approval. > > > > > > > > > Files > > > ----- > > > > > > The files are available here: > > > https://www.rfc-editor.org/authors/rfc9544.xml > > > https://www.rfc-editor.org/authors/rfc9544.html > > > https://www.rfc-editor.org/authors/rfc9544.pdf > > > https://www.rfc-editor.org/authors/rfc9544.txt > > > > > > Diff file of the text: > > > https://www.rfc-editor.org/authors/rfc9544-diff.html > > > https://www.rfc-editor.org/authors/rfc9544-rfcdiff.html (side by > side) > > > > > > Alt-diff of the text (allows you to more easily view changes > > > where text has been deleted or moved): > > > https://www.rfc-editor.org/authors/rfc9544-alt-diff.html > > > > > > Diff of the XML: > > > https://www.rfc-editor.org/authors/rfc9544-xmldiff1.html > > > > > > > > > Tracking progress > > > ----------------- > > > > > > The details of the AUTH48 status of your document are here: > > > https://www.rfc-editor.org/auth48/rfc9544 > > > > > > Please let us know if you have any questions. > > > > > > Thank you for your cooperation, > > > > > > RFC Editor > > > > > > -------------------------------------- > > > RFC9544 (draft-ietf-ippm-pam-09) > > > > > > Title : Precision Availability Metrics for Services > Governed by Service Level Objectives (SLOs) > > > Author(s) : G. Mirsky, J. Halpern, X. Min, A. Clemm, J. > Strassner, J. François > > > WG Chair(s) : Marcus Ihlar, Tommy Pauly > > > Area Director(s) : Martin Duke, Zaheduzzaman Sarker > > > > > > > > > > > > -- > > > regards, > > > John > > > > > > > > -- > > regards, > > John > > >
- [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-ippm-… rfc-editor
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… rfc-editor
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Alexander L Clemm
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… John Strassner
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Alexander L Clemm
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Greg Mirsky
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Joel Halpern
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… John Strassner
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Rebecca VanRheenen
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Joel Halpern
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Greg Mirsky
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… John Strassner
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Greg Mirsky
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Rebecca VanRheenen
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… xiao.min2
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Greg Mirsky
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Joel Halpern
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Rebecca VanRheenen
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… John Strassner
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… xiao.min2
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Rebecca VanRheenen
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Alexander L Clemm
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Rebecca VanRheenen
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Alexander L Clemm
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Rebecca VanRheenen
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Rebecca VanRheenen
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Rebecca VanRheenen
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Martin Duke
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Alexander L Clemm
- Re: [auth48] AUTH48: RFC-to-be 9544 <draft-ietf-i… Rebecca VanRheenen