Re: [alto] AD review of draft-ietf-alto-cost-calendar-07

"Randriamasy, Sabine (Nokia - FR/Paris-Saclay)" <sabine.randriamasy@nokia-bell-labs.com> Tue, 14 August 2018 17:03 UTC

Return-Path: <sabine.randriamasy@nokia-bell-labs.com>
X-Original-To: alto@ietfa.amsl.com
Delivered-To: alto@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 30168129AB8; Tue, 14 Aug 2018 10:03:56 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.911
X-Spam-Level:
X-Spam-Status: No, score=-1.911 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, T_DKIMWL_WL_HIGH=-0.01] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id CbKTkFmPy2mc; Tue, 14 Aug 2018 10:03:53 -0700 (PDT)
Received: from EUR03-VE1-obe.outbound.protection.outlook.com (mail-eopbgr50104.outbound.protection.outlook.com [40.107.5.104]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 0A4EA130DC3; Tue, 14 Aug 2018 10:03:53 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com; s=selector2-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ZN6qx7rOSTd6yq9luEnBThweySNlYSmKnfCpVDnkkNk=; b=UwAgEJbbMrTK0sfqd6CVdb3JTN4ARfwqAgDfgkB+pi1dbgMAdBwCl9WYNbyUSNw4Atu4FJxGx1e+SEvw05P9Z4C6U2kXqxlknna5GaPG+uYxvUFLiLr7zA29BgMxLLxm8pQ9sVgZiEzue4I4vqucrtEsk0jgiHurqGqQOqngBi4=
Received: from AM4PR07MB3236.eurprd07.prod.outlook.com (10.171.189.13) by AM4SPR01MB268.eurprd07.prod.outlook.com (10.171.191.141) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1059.18; Tue, 14 Aug 2018 17:03:50 +0000
Received: from AM4PR07MB3236.eurprd07.prod.outlook.com ([fe80::593:e164:10fd:ebd2]) by AM4PR07MB3236.eurprd07.prod.outlook.com ([fe80::593:e164:10fd:ebd2%3]) with mapi id 15.20.1059.017; Tue, 14 Aug 2018 17:03:50 +0000
From: "Randriamasy, Sabine (Nokia - FR/Paris-Saclay)" <sabine.randriamasy@nokia-bell-labs.com>
To: "Mirja Kuehlewind (IETF)" <ietf@kuehlewind.net>, "draft-ietf-alto-cost-calendar.all@ietf.org" <draft-ietf-alto-cost-calendar.all@ietf.org>
CC: "alto@ietf.org" <alto@ietf.org>
Thread-Topic: AD review of draft-ietf-alto-cost-calendar-07
Thread-Index: AQHULY+LTZVPNcrXCEa8DFfrK8ugW6S/f/kQ
Date: Tue, 14 Aug 2018 17:03:50 +0000
Message-ID: <AM4PR07MB32367CAEC02B43F894ECD9B295380@AM4PR07MB3236.eurprd07.prod.outlook.com>
References: <B70C4789-71FC-436F-85DA-3F79D7508D5E@kuehlewind.net>
In-Reply-To: <B70C4789-71FC-436F-85DA-3F79D7508D5E@kuehlewind.net>
Accept-Language: fr-FR, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [135.245.212.136]
x-ms-publictraffictype: Email
x-microsoft-exchange-diagnostics: 1; AM4SPR01MB268; 6:IP2Mebj8rBV4pICZ7zjFexrmQVBXGP9ZTPRAwExZ8mB47CQZvsOwpMlAj1bpCn1taRxXC+8LOpLV2YH/rpR0brDHcQwZljyNexNcOz89MZykuYrIQodHsq88PRUlByhq0PRx8UvOCwZHViBsQO+axQjzI/yyLCdC2RYrCNyPbmzQKzYoRAQ0BQO001hSCy4B7/kXIH24m7qnIWj3L3fK32voWLYIJ3b7lNdkg5oXz7ltFJVBQ0vib0ANCvfCXqu3Uz4BtYPELkwT7k1qpE/n+TqJyShDbssgavRjQanXRwHDpJCgMkP8d1BiugT0HqtY5yUdj1JtIecAcUWNbhkm7Yor/+v9ZTaAcu44outcYJxfmpxOFyjw41YHwP8WH7ALTje5ij/8rU5MsfzXAEVFoXY+LCh7VU66h13wvTT0a4l8rzie8mJrU4zvaBrVcmvNrA46pOruL8bN9Y72hMEe4w==; 5:ytz0pecSd0O9VYdjDyprUzC3tsjgdWgA6GfFu7DYse+O+ms+ID6FjTKEnjs2XswSZDNWJ6WWD1dbJUkYt27wxPUxYPREbbTtl4UjQFLMo1MiYyPmARBvr39f2YALTMA0i1pWp6UfJK+h4Xlcs0WEPPqs8H+IYq/mwP1U68Nu7Eo=; 7:0Khq4waz2/+FC6eOBorgqeTT9oG//UlWILN00U5qt8I7tehBwDH38AbNP6ABpNDNq4e4MTrb5AEgm1MxMiqBy/o/IAD7WWu3zv/9zRRlvZnmJ3ZBE29NKDQy8qnUVuJrWyPAICi2w//xnHWN4pZRguSOcxzxGhDpxinNESfL9x27pvGesG6u4WurSGRZDyOw3kfzd+6z1kl3prT36aSqSsO1UNZwIfWyspe+NVIZHrpBMy7VftY9uhua0DY8TX+H
x-ms-exchange-antispam-srfa-diagnostics: SOS;
x-ms-office365-filtering-correlation-id: 91cfcef6-469f-47a0-8765-08d60207e82d
x-ms-office365-filtering-ht: Tenant
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(7020095)(4652040)(8989117)(4534165)(4627221)(201703031133081)(201702281549075)(8990107)(5600074)(711020)(4618075)(2017052603328)(7193020); SRVR:AM4SPR01MB268;
x-ms-traffictypediagnostic: AM4SPR01MB268:
x-microsoft-antispam-prvs: <AM4SPR01MB268C7DF0696289733ACB49F95380@AM4SPR01MB268.eurprd07.prod.outlook.com>
x-exchange-antispam-report-test: UriScan:(158342451672863)(278428928389397)(192374486261705)(788757137089)(21532816269658);
x-ms-exchange-senderadcheck: 1
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(5005006)(8121501046)(93006095)(93001095)(3002001)(3231311)(11241501184)(944501410)(52105095)(10201501046)(6055026)(149027)(150027)(6041310)(20161123560045)(20161123564045)(20161123562045)(20161123558120)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(6072148)(201708071742011)(7699016); SRVR:AM4SPR01MB268; BCL:0; PCL:0; RULEID:; SRVR:AM4SPR01MB268;
x-forefront-prvs: 0764C4A8CD
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(396003)(39860400002)(346002)(376002)(136003)(366004)(13464003)(53754006)(189003)(199004)(68736007)(256004)(33656002)(53546011)(76176011)(229853002)(14444005)(106356001)(6436002)(105586002)(2501003)(316002)(53936002)(11346002)(2906002)(86362001)(99286004)(186003)(6346003)(102836004)(6506007)(26005)(8936002)(7696005)(486006)(6116002)(8676002)(66066001)(2900100001)(110136005)(3846002)(446003)(5250100002)(5660300001)(81156014)(478600001)(55016002)(9686003)(97736004)(81166006)(476003)(305945005)(74316002)(6246003)(7736002)(14454004)(25786009)(4326008)(90052001); DIR:OUT; SFP:1102; SCL:1; SRVR:AM4SPR01MB268; H:AM4PR07MB3236.eurprd07.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:0;
received-spf: None (protection.outlook.com: nokia-bell-labs.com does not designate permitted sender hosts)
authentication-results: spf=none (sender IP is ) smtp.mailfrom=sabine.randriamasy@nokia-bell-labs.com;
x-microsoft-antispam-message-info: QGNGx+1LNLSzMJSYyInn1HRS6tgovCT1eKIKcp56wlSywokg3npqksuPpXrAuPdDr4LRqfTLCalG3aKMwlrugs7eOYmzxdRPNxJ5jkeA9UioUHazH3DvcEtJ0kmKYriXRXwnjPVPREYVDtMpNM/ac+/uMgQRDJaB5UceauGpCQs/P759wmFzFClUS8q16oI/TEkOj1EAD3sFTaczqmu2qHAQphV0hKNSJSiKTphWmYEJJWb/YCh8Y/w/f1uXA2o1rzx2rTrxKBl2g6KLTV3yscrtnYa4pU4CpgPWRn9YEu2msqItO5Rj/hSrpPqa3K2t7wp6aX4Q8gKkRn3fSnmCaD3GyY0e9aaKtTVSd2he5DY=
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: nokia-bell-labs.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 91cfcef6-469f-47a0-8765-08d60207e82d
X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Aug 2018 17:03:50.2203 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM4SPR01MB268
Archived-At: <https://mailarchive.ietf.org/arch/msg/alto/lLkf5V0-lGr3uI1QiSf_tjhhjMI>
Subject: Re: [alto] AD review of draft-ietf-alto-cost-calendar-07
X-BeenThere: alto@ietf.org
X-Mailman-Version: 2.1.27
Precedence: list
List-Id: "Application-Layer Traffic Optimization \(alto\) WG mailing list" <alto.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/alto>, <mailto:alto-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/alto/>
List-Post: <mailto:alto@ietf.org>
List-Help: <mailto:alto-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/alto>, <mailto:alto-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 14 Aug 2018 17:03:56 -0000

Hello Mirja,

Thank you so much for your thorough review and suggestions. The authors will discuss open points such as those relating with metrics and your they will be integrated in a next version.

Best regards,
Sabine and co-authors

-----Original Message-----
From: Mirja Kuehlewind (IETF) [mailto:ietf@kuehlewind.net] 
Sent: Monday, August 06, 2018 4:12 PM
To: draft-ietf-alto-cost-calendar.all@ietf.org
Cc: alto@ietf.org
Subject: AD review of draft-ietf-alto-cost-calendar-07

Hi all,

I reviewed this draft and there are a few minor fixes that we need before we can start IETF last call:

1) Please remove the following sentence, or refer to the respective sections instead:
„IANA considerations and security considerations will be completed in
   further versions."
[[SR]] [[SR]] OK, will do and will remove previous sentence on section 5 that is no longer applicable.

2) Please fix everywhere in the doc:
"Content-Length: TODO“
[[SR]] the value "TODO" was left on purpose, in case we would be asked to change the names of the metrics. The plan was to fill them up when all the example metrics will be approved by the reviewers.

3) Also please make all occurrences of RFC7285 an actually reference ("[RFC7285]" instead of only „RFC7285“).
[[SR]] OK, will do

4) Then I also have a question about this example in Sec 4.1.2:
"For example: if the "calendar-start-time" member has value "Mon, 30
   Jun 2014 at 00:00:00 GMT" and if the value of member "repeated" is
   equal to 4, it means that the calendar values are the same values on
   Monday, Tuesday, Wednesday and Thursday.  The ALTO Client thus may
   use the same calendar for the next 4 duration periods following
   "calendar-start-time“.“
I think this example only makes sense if also the duration period based on "time-interval-size“ and "number-of-intervals“ with „1 hour“ and „24“ respectively is given, right? Can you please add this here.
[[SR]]  Would the following re-phrasing be fine? 
"For example: suppose the "calendar-start-time" member has value "Mon, 30 Jun 2014 at 00:00:00 GMT", the "time-interval-size" member has value "1 hour", the "number-of-intervals" member has value "24" and the value of member "repeated" is equal to 4. This means that the calendar values are the same on Monday, Tuesday, Wednesday and Thursday on a period of 24 hours starting at 00:00:00 GMT. 
The ALTO Client thus may use the same calendar for the next 4 days starting at "calendar-start-time" and will only need to request a new one for Friday July 4th at 00:00:00 GMT."

And one minor (technical) comment/question that I would like to discuss before we go into IETF last call:
Why is "time-interval-size“ combining the value and unit in one element, instead of e.g. using "time-interval-unit“ and "time-interval-value“? Would that not make the implementation of the parsing much simpler?  
[[SR]] Parsing 2 separate fields would avoid ambiguities indeed, the idea with this proposed format was to spare one member to convey in the responses. We took inspiration from the encoding format of constraints by an ALTO Client in 11.3.2.3 of RFC 7285 that follows a similar pattern, e.g. "le 15". Would it help if we rephrase the format specification of the "time-interval-size“  value in section 3.1 to avoid parsing errors ?

And finally, you use the cost type names "num-routingcost", "num-latency", "num-pathbandwidth" and "string-quality-status“ as well as metrics "routingcost", "latency" and "bandwidthscore" in the examples and say that "The cost types in this example are either specified in the base ALTO
   protocol or may be specified in other drafts see
   [draft-ietf-alto-performance-metrics] or defined in this draft for
   illustrative purposes.“
However, non of these metrics are actually defined in [draft-ietf-alto-performance-metrics], nor are they „defined“ in this doc. Would it maybe make sense to actually use cost types and metrics from [draft-ietf-alto-performance-metrics] in these examples (or remove the reference and provide some kind of definition)?
[[SR]]  We propose to revise the related parts in section 3.3 as follows: 
- only reference [draft-ietf-alto-performance-metrics] in section 2.2.1 that explains how Calendars support all kinds of metrics and modes and remove it from section 3.3, 
- keep the "routingcost" metric, 
- define example illustrative costs and metrics in section 3.3, that have names such as "num-owdelay", "num-throughput",  "string-service-status". If we are asked to replace them by cost types with nonsensical metric names such as "shoesize" or "cattle-head-count", we will do so. 

Given I reviewed the whole doc, also a couple of editorial comments/proposals below (however, I fully leave it to the authors' judgement to apply these or not).

Thanks!
Mirja
[[SR]] Thanks a lot for your guidance and suggestions
Sabine


————————————————
Other editorial comments:

1) The abstract is quite long. I think if it could be formulated more crisp, it would be easier to read, e.g. see the text in the shepherd write-up

"This document is an extension to the base ALTO protocol (RFC 7785).  It extends the ALTO cost information service such that applications decide not only 'where' to connect, but also 'when'.  This is useful for applications that need to perform bulk data transfer and would like to schedule these transfers during an off-peak hour, for example.“
[[SR]] OK will do

2) I know that IRD is on the known abbreviation list, maybe still spell it out at first occurrence for the ease of the reader…?
[[SR]] OK will do

3) As the alto base spec is already published for a while, maybe:
OLD
"IETF is currently standardizing the ALTO protocol which aims at
   providing guidance to overlay applications…“ NEW "The ALTO protocol provides guidance to overlay applications…“
[[SR]] OK will do

4) Maybe:
OLD
“...for example by deferring backup to night
   during traffic trough.“
NEW
"for example by deferring backups or other background traffic to off-peak hours.“
[[SR]] OK will do

5) To be inline with previously used wording, maybe OLD „...we expect to further
   gain on storage and on the wire data exchange…“ NEW "we expect to further save network and storage resources…“
[[SR]] OK will do

6) sec 2.2 "The protocol extension placeholders for an ALTO Calendar are: the
   IRD, the ALTO requests and responses for Cost calendars.“ Not sure I fully understand the word „placeholder“ here, maybe:
„To realize an ALTO Calendar, this document extends the
   IRD, the ALTO requests and responses for Cost calendars.“ ?
[[SR]] OK will do

Also further
"Extensions are designed to be light and ensure backwards
   compatibility with base protocol ALTO Clients and with other
   extensions.  It uses section 8.3.7...“ What is „it“ here?
Maybe:
„This extension is designed to be light and ensure backwards
   compatibility with base protocol ALTO Clients and with other
   extensions. As recommended, it relies on section 8.3.7…“ ?
[[SR]] OK will do

7) Sec 4.1.1:
"A Calendar-aware ALTO client supporting single cost type values, as
   specified in RFC7285, MUST provide an array of 1 element:

                          "calendared" : [true];“ This could be stated more clearly e.g.
"A Calendar-aware ALTO client only supporting single cost type values, as
   specified in RFC7285, that aims to request a Calendar MUST provide 
   an array of 1 element:

                          "calendared" : [true];“
[[SR]] OK will do

8) 4.2.2
"If the value of member "calendared" is equal to 'false' for a given
   requested Cost Type, the ALTO Server must return, for these Cost
   Types, a single cost value as specified in RFC 7285.“ Probably use normative MUST here instead.
[[SR]] OK will do

9) Probably RFC5246 does not need to be a normative reference for this doc (as it is already normative for RFC7285).
[[SR]] OK, will move it to Informative