Re: [alto] Status update //RE: I-D Action: draft-ietf-alto-performance-metrics-05.txt

"Randriamasy, Sabine (Nokia - FR/Paris-Saclay)" <sabine.randriamasy@nokia-bell-labs.com> Fri, 02 November 2018 14:17 UTC

Return-Path: <sabine.randriamasy@nokia-bell-labs.com>
X-Original-To: alto@ietfa.amsl.com
Delivered-To: alto@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A700A126CC7 for <alto@ietfa.amsl.com>; Fri, 2 Nov 2018 07:17:32 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.369
X-Spam-Level:
X-Spam-Status: No, score=-2.369 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.47, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id DKz_cFN0KJqW for <alto@ietfa.amsl.com>; Fri, 2 Nov 2018 07:17:29 -0700 (PDT)
Received: from EUR04-VI1-obe.outbound.protection.outlook.com (mail-vi1eur04on0719.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe0e::719]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 67ECD123FFD for <alto@ietf.org>; Fri, 2 Nov 2018 07:17:28 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com; s=selector2-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=3A1D5W8zyHHmaHG6Gl16/Koyl6LpG23E2r7luq0UTPs=; b=NoI4+pI98YbfqGv9YxAD/LqSqJMrzeBGe4a8klsGTby6HmdHgH0uvuzSU2QB1OWTqES8xQ3Vz7skvruD4M5QasYJR+taapRvhTl5ZKtNVipqyGgN2QYZ9frtU/32LCil8wJMz5ziGucdaCKBczcUwZPIfnVxXvkbA8Wu5rCx9EU=
Received: from AM4PR07MB3236.eurprd07.prod.outlook.com (10.171.189.13) by AM4PR07MB3201.eurprd07.prod.outlook.com (10.171.188.154) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1294.9; Fri, 2 Nov 2018 14:16:57 +0000
Received: from AM4PR07MB3236.eurprd07.prod.outlook.com ([fe80::c852:2cf:536:6737]) by AM4PR07MB3236.eurprd07.prod.outlook.com ([fe80::c852:2cf:536:6737%4]) with mapi id 15.20.1294.024; Fri, 2 Nov 2018 14:16:57 +0000
From: "Randriamasy, Sabine (Nokia - FR/Paris-Saclay)" <sabine.randriamasy@nokia-bell-labs.com>
To: Danny Alex Lachos Perez <dlachosp@dca.fee.unicamp.br>, "bill.wu@huawei.com" <bill.wu@huawei.com>
CC: IETF ALTO <alto@ietf.org>
Thread-Topic: [alto] Status update //RE: I-D Action: draft-ietf-alto-performance-metrics-05.txt
Thread-Index: AQHUaaTBkFsxUNvlm0uQNWWE13Fv0aUsFiIAgBB96EA=
Date: Fri, 02 Nov 2018 14:16:57 +0000
Message-ID: <AM4PR07MB3236CD316040A0E856A9860395CF0@AM4PR07MB3236.eurprd07.prod.outlook.com>
References: <154017073595.10657.7642714774728414581@ietfa.amsl.com> <B8F9A780D330094D99AF023C5877DABA9B0B8CBE@nkgeml513-mbx.china.huawei.com> <CAEDarXKNWSGyU3LXQZjD++rdXqX+tCMhV7=zYpoeQpKu7X4O3Q@mail.gmail.com>
In-Reply-To: <CAEDarXKNWSGyU3LXQZjD++rdXqX+tCMhV7=zYpoeQpKu7X4O3Q@mail.gmail.com>
Accept-Language: fr-FR, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=sabine.randriamasy@nokia-bell-labs.com;
x-originating-ip: [2a01:cb00:a00:b000:b103:2b86:ccba:cc51]
x-ms-publictraffictype: Email
x-microsoft-exchange-diagnostics: 1; AM4PR07MB3201; 6:wbWUvbPQ+c3Od0sAHH8/kjs+6iaSRXcG4WB2DG9XpoSkuBDMqp55qO9TBNsbtmePCcJZt6A7+AFocjA/3xvVNwT67kD2q4lVlXiFq1ApppOHzO34fy+6dH8BzXr6xGcA+zJuJjipCF/HtC6OfXPKt/sOVF70qJn917h0H9N2XaW1IPZOIs0UEaQnr/6yWfBP7tCK/FA2Mcy/tkBJdCtboVXzo3OILUakXFrxDPKV+EWN9cX9I4OxKK4RMLchkOAuaORSOt1zpE/ydFWBTkmpABSk1s8APtKPld2mv5scKimWjaxkvuhwDzjYmU/tkCR5cAW1cjg99i/fD35tpIq7vCmu21d4obbzDHEPYHDXrs0FvcCTnUb9viZjLBTnAHdl6EsIAjNdZ00ARFGHHBwLyP7b2zX84zTchr/jRAxvuaXnbYmzccOD6kFvgfESzsm8KHmMrGPftM4+PtQfpCekrw==; 5:WFPq5vBtyOCsxwBb9h3FxggGCVxYa8ZCdWufXagdsMhqWmN+Z9D5bUYtLqIvJRRH0naRGtOU/MUzn6PMRMnalyYoZLSMMBAvLsOxjf2s8I2MTp7kYd+JENzl2GoM0K+dAVRmzkWZhlJ0ix1WOQnFdf5+4po2DoqnD+DDULsP2eE=; 7:71d/+G9R/0l9MYaY+p/KKWRFQB0HVKsBElB3CVAhZVvt4ARpvl+K/pKNEKvvV7TpBWt37RkC7KOq69Y1lJfVvdFfCY0oQYXGaA6/51dUzLFvfPZzWhSfXDPJ8LJphkL/rq1d3fGgkgGvR/4LsCxEbw==
x-ms-exchange-antispam-srfa-diagnostics: SOS;
x-ms-office365-filtering-correlation-id: b91ff43f-eacd-4d83-bf68-08d640cdd92a
x-ms-office365-filtering-ht: Tenant
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600074)(711020)(4618075)(2017052603328)(7193020); SRVR:AM4PR07MB3201;
x-ms-traffictypediagnostic: AM4PR07MB3201:
x-microsoft-antispam-prvs: <AM4PR07MB320153BE8B80D4B03AC21E7595CF0@AM4PR07MB3201.eurprd07.prod.outlook.com>
x-exchange-antispam-report-test: UriScan:(50582790962513)(278428928389397)(211171220733660)(158342451672863)(21532816269658)(120809045254105)(21748063052155)(28532068793085)(190501279198761)(227612066756510);
x-ms-exchange-senderadcheck: 1
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(8211001083)(6040522)(2401047)(5005006)(8121501046)(3002001)(10201501046)(93006095)(93001095)(3231382)(11241501184)(944501410)(52105095)(6055026)(148016)(149066)(150057)(6041310)(20161123560045)(20161123564045)(20161123562045)(20161123558120)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(201708071742011)(7699051)(76991095); SRVR:AM4PR07MB3201; BCL:0; PCL:0; RULEID:; SRVR:AM4PR07MB3201;
x-forefront-prvs: 08444C7C87
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(396003)(39860400002)(366004)(136003)(376002)(346002)(189003)(199004)(51444003)(2420400007)(33656002)(102836004)(6246003)(316002)(606006)(6436002)(14454004)(5660300001)(2900100001)(7736002)(236005)(6506007)(9686003)(53546011)(110136005)(53936002)(4326008)(53386004)(478600001)(74316002)(15650500001)(2906002)(966005)(54896002)(6306002)(7696005)(76176011)(55016002)(7110500001)(99286004)(10710500007)(6116002)(229853002)(71190400001)(71200400001)(790700001)(186003)(105586002)(106356001)(25786009)(256004)(5024004)(81156014)(81166006)(86362001)(46003)(68736007)(486006)(11346002)(8936002)(8676002)(476003)(4001150100001)(97736004)(14444005)(2501003)(446003)(90052001); DIR:OUT; SFP:1102; SCL:1; SRVR:AM4PR07MB3201; H:AM4PR07MB3236.eurprd07.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:0;
received-spf: None (protection.outlook.com: nokia-bell-labs.com does not designate permitted sender hosts)
x-microsoft-antispam-message-info: wVyIJ3x5ohShxXdJwy9XIIGkHwdU9nUeS7WKJVSYi7jgiUqrCh7UMeIxaCUVyZ3kz+8iaJxFsiM2/nxCzCDKhplAavcYtSaSLWssrD7+eFIW/vgYazJFI/bIP7Hj5fW3r+0aPYnNlvD0JyRo2wpD4CwGwODJP9nZK+6rpb8k5oCTXf5qh5xC020c6QvIQNFyQbmrYqSNWDjyojlHr9DHMVNGdE62JaUdtXInauBLWBfsqcnGetyU8sR5eU6Fq2nhmmzmDHHd6axuNyp7xkwy4eA4jlhr2D2xp2pLzrObNjNtit4Hd3WhH502E8KO+jnVg5wgJHV9y1jTknpRVvTVVXrURdgsKEGLCu9Ui4GflDs=
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/alternative; boundary="_000_AM4PR07MB3236CD316040A0E856A9860395CF0AM4PR07MB3236eurp_"
MIME-Version: 1.0
X-OriginatorOrg: nokia-bell-labs.com
X-MS-Exchange-CrossTenant-Network-Message-Id: b91ff43f-eacd-4d83-bf68-08d640cdd92a
X-MS-Exchange-CrossTenant-originalarrivaltime: 02 Nov 2018 14:16:57.4809 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM4PR07MB3201
Archived-At: <https://mailarchive.ietf.org/arch/msg/alto/BymDIjuvoCd2KzzYkkxEGa093ks>
Subject: Re: [alto] Status update //RE: I-D Action: draft-ietf-alto-performance-metrics-05.txt
X-BeenThere: alto@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Application-Layer Traffic Optimization \(alto\) WG mailing list" <alto.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/alto>, <mailto:alto-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/alto/>
List-Post: <mailto:alto@ietf.org>
List-Help: <mailto:alto-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/alto>, <mailto:alto-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 02 Nov 2018 14:17:33 -0000

Hi Dany,

Thanks a lot , please see answers inline,
Best regards,
Sabine

From: alto <alto-bounces@ietf.org> On Behalf Of Danny Alex Lachos Perez
Sent: Tuesday, October 23, 2018 4:04 AM
To: bill.wu@huawei.com
Cc: IETF ALTO <alto@ietf.org>
Subject: Re: [alto] Status update //RE: I-D Action: draft-ietf-alto-performance-metrics-05.txt

Hello, Qin and all the authors.

I have performed a review of this draft (-05).

My comments are in the attached file (marked with [DANNY]). Most of them are about format issues, consistency, and clarity.
[[SR]] Thanks a lot. They will greatly help clarifying the document.
However, I have a technical comment:

Regarding hop count cost metric (section 6), the metric name is very generic. Considering the "metric description", you basically refer to router hops. What about other types of hop count, for example, AS-hops?. Based on your description, I think that this metric could have a more specific name ("router hop count", for giving an example)
[[SR]] Indeed there was quite some discussion on that metric and the issue was as you mentioned it. How the “hopcount” metric is constructed is not specified in RFC 7285, that uses it in its examples. So it may cover any types of hops (IP, AS, etc.). One way to specify the “type” of hops would be:
in the ”meta” of the IRD, in its “cost-type” member, add for cost-type names related to metric “hopcount” a field “description” taking values such as: “AS hops”, “router hops”, “IP hops”, “Abstracted hops” or other types. Or can be “hop type XX”.

Any thoughts and suggestions in the WG?

PLUS:
Each cost metric (OWDelay, RTT, PDV, Hop Count, Packet Loss, and Throughput) is considered a section. However, I think you can consider them as subsections of a section, similar to how you did with Traffic Engineering Performance Cost Metrics (section 9).
[[SR]] How about we put a section 3. “End to end path performance metrics” with one subsection for each of the metrics specified in current sections 3 through 8?

Best regards,

Danny Lachos

On Sun, Oct 21, 2018 at 10:15 PM Qin Wu <bill.wu@huawei.com<mailto:bill.wu@huawei.com>> wrote:
Hi,
The main changes in v-(05) are to remove duplicated text for PDV cost metric and add throughput cost metric to align with cost calendar draft.
The diff is:
https://www.ietf.org/rfcdiff?url2=draft-ietf-alto-performance-metrics-05

-Qin
-----邮件原件-----
发件人: alto [mailto:alto-bounces@ietf.org<mailto:alto-bounces@ietf.org>] 代表 internet-drafts@ietf.org<mailto:internet-drafts@ietf.org>
发送时间: 2018年10月22日 9:12
收件人: i-d-announce@ietf.org<mailto:i-d-announce@ietf.org>
抄送: alto@ietf.org<mailto:alto@ietf.org>
主题: [alto] I-D Action: draft-ietf-alto-performance-metrics-05.txt


A New Internet-Draft is available from the on-line Internet-Drafts directories.
This draft is a work item of the Application-Layer Traffic Optimization WG of the IETF.

        Title           : ALTO Performance Cost Metrics
        Authors         : Qin Wu
                          Y. Richard Yang
                          Young Lee
                          Dhruv Dhody
                          Sabine Randriamasy
        Filename        : draft-ietf-alto-performance-metrics-05.txt
        Pages           : 26
        Date            : 2018-10-21

Abstract:
   Cost Metric is a basic concept in Application-Layer Traffic
   Optimization (ALTO).  It is used in both the Cost Map Service and the
   Endpoint Cost Service.

   Different applications may benefit from different Cost Metrics..  For
   example, a Resource Consumer may prefer Resource Providers that offer
   a low delay delivery to the Resource Consumer.  However the base ALTO
   protocol [ALTO] has documented only one single cost metric, i.e., the
   generic "routingcost" metric (Sec. 14.2 of ALTO base specification
   [ALTO]).

   This document, proposes a set of Cost Metrics, derived and aggregated
   from routing protocols with different granularity and scope, such as
   BGP-LS,OSPF-TE and ISIS-TE, or from end-to-end traffic management
   tools.  It currently documents Network Performance Cost Metrics
   reporting on network delay, jitter, packet loss, hop count, and
   bandwidth.  These metrics may be exposed by an ALTO Server to allow
   applications to determine "where" to connect based on network
   performance criteria.  Additional Cost Metrics involving ISP specific
   considerations or other network technologies may be documented in
   further versions of this draft.



The IETF datatracker status page for this draft is:
https://datatracker.ietf.org/doc/draft-ietf-alto-performance-metrics/

There are also htmlized versions available at:
https://tools.ietf.org/html/draft-ietf-alto-performance-metrics-05
https://datatracker.ietf..org/doc/html/draft-ietf-alto-performance-metrics-05<https://datatracker.ietf.org/doc/html/draft-ietf-alto-performance-metrics-05>

A diff from the previous version is available at:
https://www.ietf.org/rfcdiff?url2=draft-ietf-alto-performance-metrics-05


Please note that it may take a couple of minutes from the time of submission until the htmlized version and diff are available at tools.ietf.org<http://tools.ietf.org>.

Internet-Drafts are also available by anonymous FTP at:
ftp://ftp.ietf.org/internet-drafts/

_______________________________________________
alto mailing list
alto@ietf.org<mailto:alto@ietf.org>
https://www.ietf.org/mailman/listinfo/alto
_______________________________________________
alto mailing list
alto@ietf.org<mailto:alto@ietf.org>
https://www.ietf.org/mailman/listinfo/alto