Re: [alto] Zaheduzzaman Sarker's Discuss on draft-ietf-alto-performance-metrics-20: (with DISCUSS and COMMENT)

Qin Wu <bill.wu@huawei.com> Thu, 02 December 2021 13:31 UTC

Return-Path: <bill.wu@huawei.com>
X-Original-To: alto@ietfa.amsl.com
Delivered-To: alto@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 623273A10D7; Thu, 2 Dec 2021 05:31:55 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.897
X-Spam-Level:
X-Spam-Status: No, score=-1.897 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Kqpq5NTwtxOO; Thu, 2 Dec 2021 05:31:50 -0800 (PST)
Received: from frasgout.his.huawei.com (frasgout.his.huawei.com [185.176.79.56]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 853D93A10D6; Thu, 2 Dec 2021 05:31:50 -0800 (PST)
Received: from fraeml736-chm.china.huawei.com (unknown [172.18.147.207]) by frasgout.his.huawei.com (SkyGuard) with ESMTP id 4J4cJk22gxz689KS; Thu, 2 Dec 2021 21:30:14 +0800 (CST)
Received: from dggeml751-chm.china.huawei.com (10.1.199.150) by fraeml736-chm.china.huawei.com (10.206.15.217) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256) id 15.1.2308.20; Thu, 2 Dec 2021 14:31:42 +0100
Received: from dggeml753-chm.china.huawei.com (10.1.199.152) by dggeml751-chm.china.huawei.com (10.1.199.150) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.2308.20; Thu, 2 Dec 2021 21:31:40 +0800
Received: from dggeml753-chm.china.huawei.com ([10.1.199.152]) by dggeml753-chm.china.huawei.com ([10.1.199.152]) with mapi id 15.01.2308.020; Thu, 2 Dec 2021 21:31:39 +0800
From: Qin Wu <bill.wu@huawei.com>
To: Zaheduzzaman Sarker <Zaheduzzaman.Sarker@ericsson.com>, The IESG <iesg@ietf.org>
CC: "draft-ietf-alto-performance-metrics@ietf.org" <draft-ietf-alto-performance-metrics@ietf.org>, "alto-chairs@ietf.org" <alto-chairs@ietf.org>, "alto@ietf.org" <alto@ietf.org>, "ietf@j-f-s.de" <ietf@j-f-s.de>
Thread-Topic: Zaheduzzaman Sarker's Discuss on draft-ietf-alto-performance-metrics-20: (with DISCUSS and COMMENT)
Thread-Index: AdfngNK+EK/hF42enECKzU+gnPg+OA==
Date: Thu, 02 Dec 2021 13:31:39 +0000
Message-ID: <d2c14e67364f480b902e532894930daa@huawei.com>
Accept-Language: zh-CN, en-US
Content-Language: zh-CN
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [10.136.100.16]
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-CFilter-Loop: Reflected
Archived-At: <https://mailarchive.ietf.org/arch/msg/alto/vQkktQ-EdnWQwaIAIyJoEzPLwWU>
Subject: Re: [alto] Zaheduzzaman Sarker's Discuss on draft-ietf-alto-performance-metrics-20: (with DISCUSS and COMMENT)
X-BeenThere: alto@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Application-Layer Traffic Optimization \(alto\) WG mailing list" <alto.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/alto>, <mailto:alto-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/alto/>
List-Post: <mailto:alto@ietf.org>
List-Help: <mailto:alto-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/alto>, <mailto:alto-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 02 Dec 2021 13:31:56 -0000

Hi, Zaheduzzaman:
-----邮件原件-----
发件人: Zaheduzzaman Sarker via Datatracker [mailto:noreply@ietf.org] 
发送时间: 2021年12月2日 19:35
收件人: The IESG <iesg@ietf.org>
抄送: draft-ietf-alto-performance-metrics@ietf.org; alto-chairs@ietf.org; alto@ietf.org; ietf@j-f-s.de; ietf@j-f-s.de
主题: Zaheduzzaman Sarker's Discuss on draft-ietf-alto-performance-metrics-20: (with DISCUSS and COMMENT)

Zaheduzzaman Sarker has entered the following ballot position for
draft-ietf-alto-performance-metrics-20: Discuss

When responding, please keep the subject line intact and reply to all email addresses included in the To and CC lines. (Feel free to cut this introductory paragraph, however.)


Please refer to https://www.ietf.org/blog/handling-iesg-ballot-positions/
for more information about how to handle DISCUSS and COMMENT positions.


The document, along with other ballot positions, can be found here:
https://datatracker.ietf.org/doc/draft-ietf-alto-performance-metrics/



----------------------------------------------------------------------
DISCUSS:
----------------------------------------------------------------------

I perhaps understand the intention of extending the ALTO protocol so that the ALTO client and server have defined way of exchanging values for already defined metrics. However, I need to agree with my fellow AD colleagues that this document need to describe why those metrics are needed and describe the relationship with other RFCs those defines those metrics mostly for other contexts. To that end all the RFCs in the Table 1 in section 1 need to be normative references.

[Qin Wu] I think the key use case is defined in RFC7752 section 2.2, i.e., export BGP-LS collected topology data to ALTO server and the ALTO server expose data to the client. RFC8571 provides additional performance metric related data which is part of topology data. Most of performance cost metrics derived from metrics defined in RFC8571.
Another two relevant use cases are documented in section 3 of draft-xie-alto-lmap-00, one is targeted to network operators who need to understand the performance of their networks, the performance of the suppliers (downstream and upstream networks), the performance of Internet access services, and the impact that such performance has on the experience of their customers.
The other is targeted to regulators who want to evaluate the performance of the network services offered by operators.
----------------------------------------------------------------------
COMMENT:
----------------------------------------------------------------------

Thanks for the work on this document and thanks to Brian Trammell for his TSVART early review.

I have following comments which I believe will improve the document quality -

1. In the abstract I read about "a better delay performance" and was hoping it will be clear to me what is "a better delay performance". Unfortunately, I was unable to get that. This comes to the point that this document needs to describe why purpose of using the defined metrics well.
[Qin Wu] See clarification above.

2. Section 2.2 says

    The number MUST be a non-negative JSON integer in the range [0, 100] (i.e.,
    greater than or equal to 0 and less than or equal to 100), followed by an
    optional decimal part, if a higher precision is needed.

  This should be a JSON number type not integer type.
[Qin Wu] See clarification to Ben's comments. The format of percentile is integer number followed by optional decimal part starting with the '.' separator.
3. There are number of broken JSON examples. for example, in section 4.2.3
    "ipv4:192.0.2.2" {
      "ipv4:192.0.2.89" :    0,
      "ipv4:198.51.100.34": 2000
    }
   missing ":" after  ipv4:192.0.2.2
[Qin Wu] Agree to fix this.
4. Content-Length: TBA in the examples, I actually don't know how to interpret it.

[Qin Wu] Agree to fix this.