Re: [alto] Zaheduzzaman Sarker's Discuss on draft-ietf-alto-performance-metrics-20: (with DISCUSS and COMMENT)

Qin Wu <bill.wu@huawei.com> Wed, 02 March 2022 11:38 UTC

Return-Path: <bill.wu@huawei.com>
X-Original-To: alto@ietfa.amsl.com
Delivered-To: alto@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2791E3A12A0; Wed, 2 Mar 2022 03:38:43 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.906
X-Spam-Level:
X-Spam-Status: No, score=-1.906 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=unavailable autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id H8udu6xzgLMh; Wed, 2 Mar 2022 03:38:38 -0800 (PST)
Received: from frasgout.his.huawei.com (frasgout.his.huawei.com [185.176.79.56]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4B06E3A12A4; Wed, 2 Mar 2022 03:38:38 -0800 (PST)
Received: from fraeml712-chm.china.huawei.com (unknown [172.18.147.226]) by frasgout.his.huawei.com (SkyGuard) with ESMTP id 4K7sXx1Smbz67bFy; Wed, 2 Mar 2022 19:37:21 +0800 (CST)
Received: from canpemm500008.china.huawei.com (7.192.105.151) by fraeml712-chm.china.huawei.com (10.206.15.61) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2308.21; Wed, 2 Mar 2022 12:38:33 +0100
Received: from canpemm500005.china.huawei.com (7.192.104.229) by canpemm500008.china.huawei.com (7.192.105.151) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2308.21; Wed, 2 Mar 2022 19:38:25 +0800
Received: from canpemm500005.china.huawei.com ([7.192.104.229]) by canpemm500005.china.huawei.com ([7.192.104.229]) with mapi id 15.01.2308.021; Wed, 2 Mar 2022 19:38:25 +0800
From: Qin Wu <bill.wu@huawei.com>
To: Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>, "Y. Richard Yang" <yry@cs.yale.edu>
CC: Qin Wu <bill.wu=40huawei.com@dmarc.ietf.org>, The IESG <iesg@ietf.org>, "alto-chairs@ietf.org" <alto-chairs@ietf.org>, "draft-ietf-alto-performance-metrics@ietf.org" <draft-ietf-alto-performance-metrics@ietf.org>, "alto@ietf.org" <alto@ietf.org>
Thread-Topic: [alto] Zaheduzzaman Sarker's Discuss on draft-ietf-alto-performance-metrics-20: (with DISCUSS and COMMENT)
Thread-Index: AdguKedF1iD7oBJbSFmEyCvjb/WhLw==
Date: Wed, 02 Mar 2022 11:38:25 +0000
Message-ID: <7ed29800e81140d7a21acaf61749d8c5@huawei.com>
Accept-Language: zh-CN, en-US
Content-Language: zh-CN
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [10.136.100.16]
Content-Type: multipart/alternative; boundary="_000_7ed29800e81140d7a21acaf61749d8c5huaweicom_"
MIME-Version: 1.0
X-CFilter-Loop: Reflected
Archived-At: <https://mailarchive.ietf.org/arch/msg/alto/rS88gnNREYgP0iApl1sabq_4SR4>
Subject: Re: [alto] Zaheduzzaman Sarker's Discuss on draft-ietf-alto-performance-metrics-20: (with DISCUSS and COMMENT)
X-BeenThere: alto@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Application-Layer Traffic Optimization \(alto\) WG mailing list" <alto.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/alto>, <mailto:alto-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/alto/>
List-Post: <mailto:alto@ietf.org>
List-Help: <mailto:alto-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/alto>, <mailto:alto-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 02 Mar 2022 11:38:43 -0000

Good catch, Zahed, authors have issued v-26 to fix this issue.
See the diff:
https://www.ietf.org/rfcdiff?url2=draft-ietf-alto-performance-metrics-26.txt
发件人: Zaheduzzaman Sarker [mailto:zaheduzzaman.sarker@ericsson.com]
发送时间: 2022年3月2日 18:30
收件人: Y. Richard Yang <yry@cs.yale.edu>
抄送: Qin Wu <bill.wu=40huawei.com@dmarc.ietf.org>; The IESG <iesg@ietf.org>; alto-chairs@ietf.org; draft-ietf-alto-performance-metrics@ietf.org; alto@ietf.org
主题: Re: [alto] Zaheduzzaman Sarker's Discuss on draft-ietf-alto-performance-metrics-20: (with DISCUSS and COMMENT)

Thanks for the updates.

I however, didn’t notice the change in section 2.2 egarding JSON number format, which previously was agreed to be changed, in the 25th of this document.

//Zahed




On 28 Feb 2022, at 22:14, Y. Richard Yang <yry@cs.yale.edu<mailto:yry@cs.yale.edu>> wrote:

Hi Zaheduzzaman,

We have posted the latest version of the document: https://datatracker.ietf.org/doc/html/draft-ietf-alto-performance-metrics-24

Could you please take a look to see if all of your comments are addressed? In particular,
- We checked and made sure that the normative references are correct.
- We updated the abstract to clarify the wording and added sentences in Sec. 1 on the uses.
- We revised the final wording of 2.2 on the number format
- We checked all json examples and fixed the issues.

Please take a look and let us know if there are remaining issues to be addressed.

Thank you so much!
Richard

On Thu, Dec 2, 2021 at 8:32 AM Qin Wu <bill.wu=40huawei.com@dmarc.ietf.org<mailto:40huawei.com@dmarc.ietf.org>> wrote:
Hi, Zaheduzzaman:
-----邮件原件-----
发件人: Zaheduzzaman Sarker via Datatracker [mailto:noreply@ietf.org<mailto:noreply@ietf.org>]
发送时间: 2021年12月2日 19:35
收件人: The IESG <iesg@ietf.org<mailto:iesg@ietf.org>>
抄送: draft-ietf-alto-performance-metrics@ietf.org<mailto:draft-ietf-alto-performance-metrics@ietf.org>; alto-chairs@ietf.org<mailto:alto-chairs@ietf.org>; alto@ietf.org<mailto:alto@ietf.org>; ietf@j-f-s.de<mailto:ietf@j-f-s.de>; ietf@j-f-s.de<mailto:ietf@j-f-s.de>
主题: Zaheduzzaman Sarker's Discuss on draft-ietf-alto-performance-metrics-20: (with DISCUSS and COMMENT)

Zaheduzzaman Sarker has entered the following ballot position for
draft-ietf-alto-performance-metrics-20: Discuss

When responding, please keep the subject line intact and reply to all email addresses included in the To and CC lines. (Feel free to cut this introductory paragraph, however.)


Please refer to https://www.ietf.org/blog/handling-iesg-ballot-positions/
for more information about how to handle DISCUSS and COMMENT positions.


The document, along with other ballot positions, can be found here:
https://datatracker.ietf.org/doc/draft-ietf-alto-performance-metrics/



----------------------------------------------------------------------
DISCUSS:
----------------------------------------------------------------------

I perhaps understand the intention of extending the ALTO protocol so that the ALTO client and server have defined way of exchanging values for already defined metrics. However, I need to agree with my fellow AD colleagues that this document need to describe why those metrics are needed and describe the relationship with other RFCs those defines those metrics mostly for other contexts. To that end all the RFCs in the Table 1 in section 1 need to be normative references.

[Qin Wu] I think the key use case is defined in RFC7752 section 2.2, i.e., export BGP-LS collected topology data to ALTO server and the ALTO server expose data to the client. RFC8571 provides additional performance metric related data which is part of topology data. Most of performance cost metrics derived from metrics defined in RFC8571.
Another two relevant use cases are documented in section 3 of draft-xie-alto-lmap-00, one is targeted to network operators who need to understand the performance of their networks, the performance of the suppliers (downstream and upstream networks), the performance of Internet access services, and the impact that such performance has on the experience of their customers.
The other is targeted to regulators who want to evaluate the performance of the network services offered by operators.
----------------------------------------------------------------------
COMMENT:
----------------------------------------------------------------------

Thanks for the work on this document and thanks to Brian Trammell for his TSVART early review.

I have following comments which I believe will improve the document quality -

1. In the abstract I read about "a better delay performance" and was hoping it will be clear to me what is "a better delay performance". Unfortunately, I was unable to get that. This comes to the point that this document needs to describe why purpose of using the defined metrics well.
[Qin Wu] See clarification above.

2. Section 2.2 says

    The number MUST be a non-negative JSON integer in the range [0, 100] (i.e.,
    greater than or equal to 0 and less than or equal to 100), followed by an
    optional decimal part, if a higher precision is needed.

  This should be a JSON number type not integer type.
[Qin Wu] See clarification to Ben's comments. The format of percentile is integer number followed by optional decimal part starting with the '.' separator.
3. There are number of broken JSON examples. for example, in section 4.2.3
    "ipv4:192.0.2.2" {
      "ipv4:192.0.2.89" :    0,
      "ipv4:198.51.100.34": 2000
    }
   missing ":" after  ipv4:192.0.2.2
[Qin Wu] Agree to fix this.
4. Content-Length: TBA in the examples, I actually don't know how to interpret it.

[Qin Wu] Agree to fix this.

_______________________________________________
alto mailing list
alto@ietf.org<mailto:alto@ietf.org>
https://www.ietf.org/mailman/listinfo/alto