Re: [Teas] FW: New Version Notification for draft-lee-teas-actn-pm-telemetry-autonomics-17.txt

Young,
Thanks for bringing the offline discussion to the list. Please discuss (on
the list) how the changes in the latest revision address all of Dieter's
comments.

Dieter,
Please do confirm on the list if there are no further open issues to
discuss.

Regards,
-Pavan

On Wed, May 8, 2019 at 11:50 AM Leeyoung <leeyoung@huawei.com> wrote:

> Hi,
>
> This revision incorporated Dieter's comments (exchanged privately --- see
> the attachment for this content of Dieter's comments).
>
> If there are still further comments before being ready for WG adoption,
> we'd appreciate your providing comments in a timely manner.
>
> Thanks & Best regards,
> Young (on behalf of co-authors)
>
> -----Original Message-----
> From: internet-drafts@ietf.org [mailto:internet-drafts@ietf.org]
> Sent: Wednesday, May 8, 2019 11:43 AM
> To: Daniele Ceccarelli <daniele.ceccarelli@ericsson.com>; Satish
> Karunanithi <satish.karunanithi@gmail.com>; Leeyoung <leeyoung@huawei.com>;
> Dhruv Dhody <dhruv.dhody@huawei.com>; Daniel King <d.king@lancaster.ac.uk>;
> Ricard Vilata <ricard.vilalta@cttc.es>; Ricard Vilalta <
> ricard.vilalta@cttc.es>
> Subject: New Version Notification for
> draft-lee-teas-actn-pm-telemetry-autonomics-17.txt
>
>
> A new version of I-D, draft-lee-teas-actn-pm-telemetry-autonomics-17.txt
> has been successfully submitted by Young Lee and posted to the IETF
> repository.
>
> Name:           draft-lee-teas-actn-pm-telemetry-autonomics
> Revision:       17
> Title:          YANG models for VN & TE Performance Monitoring Telemetry
> and Scaling Intent Autonomics
> Document date:  2019-05-08
> Group:          Individual Submission
> Pages:          30
> URL:
> https://www.ietf.org/internet-drafts/draft-lee-teas-actn-pm-telemetry-autonomics-17.txt
> Status:
> https://datatracker.ietf.org/doc/draft-lee-teas-actn-pm-telemetry-autonomics/
> Htmlized:
> https://tools.ietf.org/html/draft-lee-teas-actn-pm-telemetry-autonomics-17
> Htmlized:
> https://datatracker.ietf.org/doc/html/draft-lee-teas-actn-pm-telemetry-autonomics
> Diff:
> https://www.ietf.org/rfcdiff?url2=draft-lee-teas-actn-pm-telemetry-autonomics-17
>
> Abstract:
>    This document provides YANG data models that describe performance
>    monitoring telemetry and scaling intent mechanism for TE-tunnels and
>    Virtual Networks (VN).
>
>    The models presented in this draft allow customers to subscribe to
>    and monitor their key performance data of their interest on the
>    level of TE-tunnel or VN. The models also provide customers with the
>    ability to program autonomic scaling intent mechanism on the level
>    of TE-tunnel as well as VN.
>
>
>
>
>
>
> Please note that it may take a couple of minutes from the time of
> submission until the htmlized version and diff are available at
> tools.ietf.org.
>
> The IETF Secretariat
>
>
>
>
> ---------- Forwarded message ----------
> From: "Beller, Dieter (Nokia - DE/Stuttgart)" <dieter.beller@nokia.com>
> To: Leeyoung <leeyoung@huawei.com>
> Cc: TEAS WG Chairs <teas-chairs@ietf.org>, "King, Daniel" <
> d.king@lancaster.ac.uk>, Daniele Ceccarelli <
> daniele.ceccarelli@ericsson.com>
> Bcc:
> Date: Thu, 25 Apr 2019 09:06:20 +0000
> Subject: Re: [Teas] FW: New Version Notification for
> draft-lee-teas-actn-pm-telemetry-autonomics-16.txt
> Hi Young,
>
> here are some more comments as promised:
>
> Other terms which are not defined are:
>
>    - scaling intent (the description in section 4 is very poor and does
>    not describe what scaling intent is all about),
>    - network autonomics
>
>
> The term performance monitoring (PM) is being used in transport networks
> for many years and typically relates to 15min/24h PM counters and PM
> history.
> Streaming telemetry data is rather new for transport network equipment and
> care should be taken to distinguish streaming telemetry data  from
> classical PM data
> unless the classical PM counters are streamed, which is also an option.
>
> Regarding the scaling intent: I was expecting to find a description of
> "scaling intent" in order to understand what it means:
>
>    Scaling intent configuration mechanism allows the client to
>    configure automatic scale-in and scale-out mechanisms on both the
>    TE-tunnel and the VN level. Various conditions can be set for auto-
>    scaling based on the PM telemetry data.
>
>
> What are the "automatic scale-in and scale-out mechanisms"? What are the
> configuration parameters of these mechanisms? This is totally unclear to me:
>
>    There are a number of parameters involved in the mechanism:
>
>      . scale-out-intent or scale-in-intent: whether to scale-out or
>         scale-in.
>
> The tree view in section 4 is not providing any clarity either:
>
>    module: ietf-te-kpi-telemetry
>      augment /te:te/te:tunnels/te:tunnel:
>        +-rw te-scaling-intent
>        |  +-rw scale-in-intent
>        |  |  +-rw threshold-time?            uint32
>        |  |  +-rw cooldown-time?             uint32
>        |  |  +-rw scale-in-operation-type?   scaling-criteria-operation
>        |  |  +-rw scaling-condition* [performance-type]
>        |  |     +-rw performance-type           identityref
>        |  |     +-rw threshold-value?           string
>        |  |     +-rw te-telemetry-tunnel-ref?
>                    -> /te:te/tunnels/tunnel/name
>        |  +-rw scale-out-intent
>        |     +-rw threshold-time?             uint32
>        |     +-rw cooldown-time?              uint32
>        |     +-rw scale-out-operation-type?   scaling-criteria-operation
>        |     +-rw scaling-condition* [performance-type]
>        |        +-rw performance-type           identityref
>        |        +-rw threshold-value?           string
>        |        +-rw te-telemetry-tunnel-ref?
>                    -> /te:te/tunnels/tunnel/name
>
> The meaning of the attributes (e.g. cooldown-time,
> scale-in-operation-type) are not explained.
>
>
> My conclusion: this document is not ready yet for WG adoption. The
> concerns I raised at IETF104 wer not properly addressed.
>
>
> Thanks,
> Dieter
>
>
>
> On 18.04.2019 20:58, Dieter Beller wrote:
>
> Hi Young,
>
> here is my very first comment:
>
> The abstract reads:
>
> Abstract
>
>    This document provides YANG data models that describe performance
>    monitoring telemetry and scaling intent mechanism for TE-tunnels and
>    Virtual Networks (VN).
>
>    The models presented in this draft allow customers to subscribe to
>    and monitor their *key performance data* of their interest on the
>    level of TE-tunnel or VN. The models also provide customers with the
>    ability to program autonomic scaling intent mechanism on the level
>    of TE-tunnel as well as VN.
>
> When I tried to find the definition of the term "*key performance data*"
> I failed. The terminology section reads:
>
> 1.1 <https://tools.ietf.org/html/draft-lee-teas-actn-pm-telemetry-autonomics-16#section-1.1>. Terminology   Refer to [RFC8453 <https://tools.ietf.org/html/rfc8453>], [RFC7926 <https://tools.ietf.org/html/rfc7926>], and [RFC8309 <https://tools.ietf.org/html/rfc8309>] for the key terms used
>    in this document.
>
>
> The term "*key performance data*" is not defined in section 1.1 nor in
> the referenced RFSs!
> Frankly speaking, I have no clue what "*key performance data*" is.
>
> This is what I was criticizing when you presented the draft in Prague.
>
> More comments will follow.
>
>
> Thanks,
> Dieter
>
>
>
> On 18.04.2019 18:56, Dieter Beller wrote:
>
> Hi Young,
>
> I will have a look at the latest version. Unfortunately, I was not able to
> find the necessary time yet.
>
>
> Thanks,
> Dieter
>
>
> On 18.04.2019 18:27, Leeyoung wrote:
>
> Hi Pavan and Lou,
>
> To recap, the revision addressed all your comments in Prague meeting on the generalization of this draft so that it would be applicable in general contexts. And thanks to Tom, all other comments have been incorporated to improve the draft.
>
> The co-authors believe that this is ready for WG adoption. Please let us know if this is the case; otherwise, let us know what needs further to be done.
>
> Thanks & Best regards,
> Young (on behalf of co-authors)
>
> -----Original Message-----
> From: internet-drafts@ietf.org [mailto:internet-drafts@ietf.org <internet-drafts@ietf.org>]
> Sent: Thursday, April 18, 2019 11:18 AM
> To: Daniele Ceccarelli <daniele.ceccarelli@ericsson.com> <daniele.ceccarelli@ericsson.com>; Satish Karunanithi <satish.karunanithi@gmail.com> <satish.karunanithi@gmail.com>; Leeyoung <leeyoung@huawei.com> <leeyoung@huawei.com>; Dhruv Dhody <dhruv.dhody@huawei.com> <dhruv.dhody@huawei.com>; Daniel King <d.king@lancaster.ac.uk> <d.king@lancaster.ac.uk>; Ricard Vilata <ricard.vilalta@cttc.es> <ricard.vilalta@cttc.es>; Ricard Vilalta <ricard.vilalta@cttc.es> <ricard.vilalta@cttc.es>
> Subject: New Version Notification for draft-lee-teas-actn-pm-telemetry-autonomics-16.txt
>
>
> A new version of I-D, draft-lee-teas-actn-pm-telemetry-autonomics-16.txt
> has been successfully submitted by Young Lee and posted to the IETF repository.
>
> Name:		draft-lee-teas-actn-pm-telemetry-autonomics
> Revision:	16
> Title:		YANG models for VN & TE Performance Monitoring Telemetry and Scaling Intent Autonomics
> Document date:	2019-04-18
> Group:		Individual Submission
> Pages:		29
> URL:            https://www.ietf.org/internet-drafts/draft-lee-teas-actn-pm-telemetry-autonomics-16.txt
> Status:         https://datatracker.ietf.org/doc/draft-lee-teas-actn-pm-telemetry-autonomics/
> Htmlized:       https://tools.ietf.org/html/draft-lee-teas-actn-pm-telemetry-autonomics-16
> Htmlized:       https://datatracker.ietf.org/doc/html/draft-lee-teas-actn-pm-telemetry-autonomics
> Diff:           https://www.ietf.org/rfcdiff?url2=draft-lee-teas-actn-pm-telemetry-autonomics-16
>
> Abstract:
>    This document provides YANG data models that describe performance
>    monitoring telemetry and scaling intent mechanism for TE-tunnels and
>    Virtual Networks (VN).
>
>    The models presented in this draft allow customers to subscribe to
>    and monitor their key performance data of their interest on the
>    level of TE-tunnel or VN. The models also provide customers with the
>    ability to program autonomic scaling intent mechanism on the level
>    of TE-tunnel as well as VN.
>
>
>
>
>
>
> Please note that it may take a couple of minutes from the time of submission until the htmlized version and diff are available at tools.ietf.org.
>
> The IETF Secretariat
>
> _______________________________________________
> Teas mailing listTeas@ietf.orghttps://www.ietf.org/mailman/listinfo/teas
>
>
> _______________________________________________
> Teas mailing list
> Teas@ietf.org
> https://www.ietf.org/mailman/listinfo/teas
>