[alto] Here is a review of draft-ietf-alto-performance-metrics-01

xin wang <xinwang2014@hotmail.com> Wed, 28 June 2017 02:05 UTC

Return-Path: <xinwang2014@hotmail.com>
X-Original-To: alto@ietfa.amsl.com
Delivered-To: alto@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A962012762F; Tue, 27 Jun 2017 19:05:50 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.876
X-Spam-Level:
X-Spam-Status: No, score=-0.876 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FORGED_HOTMAIL_RCVD2=0.874, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=hotmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0UBb8Kgx1Doi; Tue, 27 Jun 2017 19:05:49 -0700 (PDT)
Received: from APC01-HK2-obe.outbound.protection.outlook.com (mail-oln040092255056.outbound.protection.outlook.com [40.92.255.56]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 80C53127871; Tue, 27 Jun 2017 19:05:45 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=QV7ZeYcAp4slJdt4wa0QMg4pTO245KrR/qxuunaPHls=; b=XKYlC7Hn/vJz5wQrMTDvJo6Jo/U4CEsDqNG6OYLHkxMBL2At0BOcd+zKmpU37b2C99z9hSR/brKJT3f1Xc672dXHl3aewJ3kcdICUIhao2KpEWhKZ+Ed/4RT4guYMgd/frdkiqdubN881F4/GsT8NB2RRkYhbQciDJF24YMwWyA7m9hYHG+YoAcCGaLozSPLusnbm3BUrdkBpRfUQIuSLCpuFDxMqWZIIp/67fZnTFYT00wFEvgJYL6A85c4VidY2ds1i8ymVgUWOPX17c3B6tkl4lDkyp6I6ksicYZCoN0tZye6k7D924i/ZtNkPu+3w3B+UVsq7pZLJoq+Sw3K4Q==
Received: from HK2APC01FT114.eop-APC01.prod.protection.outlook.com (10.152.248.59) by HK2APC01HT110.eop-APC01.prod.protection.outlook.com (10.152.249.201) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.1199.9; Wed, 28 Jun 2017 02:05:42 +0000
Received: from PS1PR0302MB2457.apcprd03.prod.outlook.com (10.152.248.52) by HK2APC01FT114.mail.protection.outlook.com (10.152.248.192) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1199.9 via Frontend Transport; Wed, 28 Jun 2017 02:05:42 +0000
Received: from PS1PR0302MB2457.apcprd03.prod.outlook.com ([fe80::290a:8d10:d903:ff49]) by PS1PR0302MB2457.apcprd03.prod.outlook.com ([fe80::290a:8d10:d903:ff49%18]) with mapi id 15.01.1220.011; Wed, 28 Jun 2017 02:05:42 +0000
From: xin wang <xinwang2014@hotmail.com>
To: "draft-ietf-alto-performance-metrics@ietf.org" <draft-ietf-alto-performance-metrics@ietf.org>
CC: IETF ALTO <alto@ietf.org>
Thread-Topic: Here is a review of draft-ietf-alto-performance-metrics-01
Thread-Index: AQHS77KHjlFF1/I4VEOSeLJnKnux4Q==
Date: Wed, 28 Jun 2017 02:05:42 +0000
Message-ID: <PS1PR0302MB24575EB8EFEB9023D40F4530A8DD0@PS1PR0302MB2457.apcprd03.prod.outlook.com>
Accept-Language: en-US, zh-CN
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: ietf.org; dkim=none (message not signed) header.d=none;ietf.org; dmarc=none action=none header.from=hotmail.com;
x-incomingtopheadermarker: OriginalChecksum:A965E7A7402916E170FA641314CF39A2577B41DE1B5375450D0CE8937B0139DF; UpperCasedChecksum:58C2F97C6129A8B91A4AB52E2BE0D25F3B807A66BFD42F70A400B2F447E50335; SizeAsReceived:7206; Count:44
x-ms-exchange-messagesentrepresentingtype: 1
x-tmn: [m3ohLlDLxPXmul1hFij3lonSE9Oq1uyK]
x-ms-publictraffictype: Email
x-microsoft-exchange-diagnostics: 1; HK2APC01HT110; 7:t3zxBwCSxVVONdxDJ1WhKwq0oqgXTfGwhVktfswFc1xEXMt0uemlPBtYJMCO0/eBGCRxQFkwTDTAGt6c+BTdEIFb8RCS2JfCvXIjtv6fGz6ATpCEounrpYvj4vgEfGHvbaLxW2GjJYekWiHjUMx/UfksMEIEMDviZkqJyz20aU1BjFqsViEv95xspzBh5/jjAtXRVGSdktzQhAOOaafM+Qf2FpN4DnQM5vTAS43dLIMA6LMxEPF73qQwkps1XHw47u41NUtUAifwWfFxvnzn5GqR/hg6dLwc+munU1su67XmS29b9Qv6AVQ6PKwN+av6ZqNvlCTpU68q47071mHX/s/NeYbvWr3dlUaSx1m6WUFkdVCT80IQ1/XLdLIRIBcxbh0mV5tFjy/mf/OigkHxCz+K3i+zmfOfE1H/c+umfA7W+ZK5kgfhUWaoRj/2vmyQ0Yn0rgXFR0p6NPMW4oAN+GnFDgoYxy1ZffDXJK27HRDefkTw9IKbm7m6r16ZH0DMLNCThulRYTkbFnFMDJApA354YF0Y7lwC4fJsoIgEoTwDWZk37XkRybfbnC2vkoOLjicMWqMAGwFtX5J5T1Iesmge8XblftoMrnwaM+qpUCMyAWPM+5BrTNWsGYo0O6ezh4jGIlROwk75Ykv4iqTxdoYWl6I+yYCkzGigSsrzRc/sZMEY+JsDVuMfiaraSjW3IkRRuTb0gBwuEjCIuPlvMt+cyVk3aWiwwG1G08EOO+/AVfiodiw8HsoVEfVCHkiUy3m5hKmWnY/ZS92S8TY+4Q==
x-incomingheadercount: 44
x-eopattributedmessage: 0
x-forefront-antispam-report: EFV:NLI; SFV:NSPM; SFS:(7070007)(98901004); DIR:OUT; SFP:1901; SCL:1; SRVR:HK2APC01HT110; H:PS1PR0302MB2457.apcprd03.prod.outlook.com; FPR:; SPF:None; LANG:en;
x-ms-office365-filtering-correlation-id: 7b04da7e-e142-45fe-9bd5-08d4bdca2e80
x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(300000503095)(300135400095)(201702061074)(5061506573)(5061507331)(1603103135)(2017031320274)(2017031324274)(2017031323274)(2017031322274)(1601125374)(1603101448)(1701031045)(300000504095)(300135200095)(300000505095)(300135600095)(300000506073)(300135500095); SRVR:HK2APC01HT110;
x-ms-traffictypediagnostic: HK2APC01HT110:
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(444000031); SRVR:HK2APC01HT110; BCL:0; PCL:0; RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095); SRVR:HK2APC01HT110;
x-forefront-prvs: 03524FBD26
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/alternative; boundary="_000_PS1PR0302MB24575EB8EFEB9023D40F4530A8DD0PS1PR0302MB2457_"
MIME-Version: 1.0
X-OriginatorOrg: hotmail.com
X-MS-Exchange-CrossTenant-originalarrivaltime: 28 Jun 2017 02:05:42.6993 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Internet
X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa
X-MS-Exchange-Transport-CrossTenantHeadersStamped: HK2APC01HT110
Archived-At: <https://mailarchive.ietf.org/arch/msg/alto/KwqRl-ii7N0jnvrgJaqKuFP_GXU>
Subject: [alto] Here is a review of draft-ietf-alto-performance-metrics-01
X-BeenThere: alto@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: "Application-Layer Traffic Optimization \(alto\) WG mailing list" <alto.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/alto>, <mailto:alto-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/alto/>
List-Post: <mailto:alto@ietf.org>
List-Help: <mailto:alto-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/alto>, <mailto:alto-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 28 Jun 2017 02:05:51 -0000

Dear authors of "ALTO Performance Cost Metrics”,


Your draft about extending cost metrics of ALTO looks very useful, especially for varieties of applications with different criteria to make decisions for traffic engineering. The following is a review of your draft:


a. Link Maximum Reservable Bandwidth and Link Residue Bandwidth


These three cost metrics look very similar but have different meanings according to your draft. In my understanding, based on the concept of bandwidth oversubscription, a reserved bandwidth could be larger than current remaining bandwidth (equals to max bandwidth subtract the sum of all reserved bandwidth). Then, Link Maximum Reservable Bandwidth should be slightly larger than Link Residue Bandwidth. Is this right?


b. Unitless performance scores


In section 2.1, the draft suggests providing unitless performance scores for privacy issues. In ALTO cost mode, it defines “ordinal” which indicates the ranking of the cost values instead of actual costs. Do you suggest to add more intelligent abstraction of cost values besides of ranking?


c. Packet Delay Variation


The draft uses the minimum delay observed as the definition of packet delay variation. I am not sure it is a good solution. There are some other approaches you may consider, such as standard deviation.


d. The unit of Periodic One Way Delay


The draft uses seconds as the unit of Periodic One Way Delay. I am not sure it is typos or not since the example shows the powdelay cost values are 10, 20, and 30.


Also there are some typos you may fix:


Abstraction: add space between "BGP-LS,OSPF-TE";

Page 2: “delay sensitive” -> “delay-sensitive”;

Page 2: “a set new” -> “a set of new”;

Page 2: “ explicitely” -> “ explicitly”

Page 4: “ invlove” -> “ involve"


Best,

Xin