Re: [alto] AD review of draft-ietf-alto-cost-calendar-07

"Randriamasy, Sabine (Nokia - FR/Paris-Saclay)" <sabine.randriamasy@nokia-bell-labs.com> Fri, 21 September 2018 17:47 UTC

Return-Path: <sabine.randriamasy@nokia-bell-labs.com>
X-Original-To: alto@ietfa.amsl.com
Delivered-To: alto@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 7FA17128CF3; Fri, 21 Sep 2018 10:47:01 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.91
X-Spam-Level:
X-Spam-Status: No, score=-1.91 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, T_DKIMWL_WL_HIGH=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 6qWLnP0mIkxa; Fri, 21 Sep 2018 10:46:58 -0700 (PDT)
Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-db5eur01on0113.outbound.protection.outlook.com [104.47.2.113]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7B5BD1292AD; Fri, 21 Sep 2018 10:46:57 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com; s=selector2-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=PoHabrJfpOPzTy/SR0lm9ATF21whDzlybJop/fptklE=; b=d0mE6T4pl+pHhkHKD2v7P1Yqe/15kRRMSNyUQu5kaw/DLchY3zLs71tuvyraT3UjaLMEeRRWeo8dlY+5EPXhfUrH1Co8ABo0RleRtA36c/n8H43M1IHiGwiibfkB4lzqlpjK4txOxF2z1nQprshhgYjFln1G7VsuG24fWbhW15o=
Received: from AM4PR07MB3236.eurprd07.prod.outlook.com (10.171.189.13) by AM4PR07MB3377.eurprd07.prod.outlook.com (10.171.189.150) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1185.10; Fri, 21 Sep 2018 17:46:54 +0000
Received: from AM4PR07MB3236.eurprd07.prod.outlook.com ([fe80::81f4:5eac:1cf0:4327]) by AM4PR07MB3236.eurprd07.prod.outlook.com ([fe80::81f4:5eac:1cf0:4327%2]) with mapi id 15.20.1164.014; Fri, 21 Sep 2018 17:46:54 +0000
From: "Randriamasy, Sabine (Nokia - FR/Paris-Saclay)" <sabine.randriamasy@nokia-bell-labs.com>
To: Mirja Kühlewind <ietf@kuehlewind.net>, "draft-ietf-alto-cost-calendar.all@ietf.org" <draft-ietf-alto-cost-calendar.all@ietf.org>
CC: "alto@ietf.org" <alto@ietf.org>
Thread-Topic: AD review of draft-ietf-alto-cost-calendar-07
Thread-Index: AQHULY+LTZVPNcrXCEa8DFfrK8ugW6S/f/kQgAEKc4CAOr/M0A==
Date: Fri, 21 Sep 2018 17:46:54 +0000
Message-ID: <AM4PR07MB323698C0C3F2EA135D830D8295120@AM4PR07MB3236.eurprd07.prod.outlook.com>
References: <B70C4789-71FC-436F-85DA-3F79D7508D5E@kuehlewind.net> <AM4PR07MB32367CAEC02B43F894ECD9B295380@AM4PR07MB3236.eurprd07.prod.outlook.com> <2f7c30e8-0b4b-2fe2-2845-1d4e24c75f1b@kuehlewind.net>
In-Reply-To: <2f7c30e8-0b4b-2fe2-2845-1d4e24c75f1b@kuehlewind.net>
Accept-Language: fr-FR, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [135.245.212.139]
x-ms-publictraffictype: Email
x-microsoft-exchange-diagnostics: 1; AM4PR07MB3377; 6:HRAWAys8SRqoXbqXzdZjFGn0184oV2xrtmKaBivNTwezVBQy5E8vYhuG1FlJW/L9KOVQdSzUOOswOWA0RjWtUWpv1L0HqxdEAGI7XkEC6BBjEz2ELSGB8tnSEVnlTLSBmCbdpbvCY6Qny/rigdMxO+yX28H+jZITO/5foEKNeQ1SKRGbxL/3fWPqGT9uATU1I89pWsmREtPXrE6x7b2rHTUgTmxiYaz/wC4i5HfQ80H9Mzh5dF3/VDOuPEAX7qXCPEfGl1fpuA1fVGN3gQ5M7yUzEkoVJD2+lh5X+PWLitJI0rbfBx/sVUO7a2PW65nXcR5Ifv+pNHP9wJAjQwMPAf75NNmtOTNjGS0rijQI4zu5jmrbwJ1LQwp1BFJE3Ftku3rz+zxtyKKKwHl2gVZMUF0I5DTK7WOsGldurnp0xKcLw/xH41OviXObgOq8xPiV4vj0LboqSxuKBQhUhCj+AA==; 5:TsT8FTC/AgWqLGusXfpFBe2uzLXsG9uQXKrZuWXizalqIJ3HVFZnl8Tg3d7PYegSK4e+C8gdbfjdB1eKTYdAVKT30/EC05EhoAUvX5hkJWF2eVXQxRJ4Dz+lt5BgMkTZzJTB0jbgDLEY+r8CWOklev8qhMNWf4Q1Mo9hPaeFdsM=; 7:jMFp0uOPBszFg3anf4GK3xITlwclUruBieKrbDiJp7cVUnjAmOl/z7hYTkveL2PUi0ZI+EX/A03DEzrmz+5dOwdJSUcVYt1kTAcT3eNPsf+K63QofXFMwL8WH02FRkv6JdxyiRHboe3JuM211azHoyNkKLbeTeFoRXCqswWwhIGiNmt+cc+BCIHXHyrM/suVU2uTkhZc5gPLLsM/cHyoq0yYey7/XC5VOY6PNN/DTn9I6LLk0SUGJF0sipOSFkwV
x-ms-exchange-antispam-srfa-diagnostics: SOS;
x-ms-office365-filtering-correlation-id: 65e8150a-396d-43c1-32a3-08d61fea3868
x-ms-office365-filtering-ht: Tenant
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(7020095)(4652040)(8989299)(4534165)(4627221)(201703031133081)(201702281549075)(8990200)(5600074)(711020)(4618075)(2017052603328)(7193020); SRVR:AM4PR07MB3377;
x-ms-traffictypediagnostic: AM4PR07MB3377:
x-microsoft-antispam-prvs: <AM4PR07MB33779A393E0417A96E7EEF3195120@AM4PR07MB3377.eurprd07.prod.outlook.com>
x-exchange-antispam-report-test: UriScan:(192374486261705)(788757137089)(278428928389397)(21532816269658)(158342451672863);
x-ms-exchange-senderadcheck: 1
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(8211001083)(6040522)(2401047)(8121501046)(5005006)(93006095)(93001095)(3231355)(11241501184)(944501410)(52105095)(3002001)(10201501046)(6055026)(149027)(150027)(6041310)(20161123564045)(20161123562045)(20161123558120)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(201708071742011)(7699051)(76991041); SRVR:AM4PR07MB3377; BCL:0; PCL:0; RULEID:; SRVR:AM4PR07MB3377;
x-forefront-prvs: 0802ADD973
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(366004)(376002)(396003)(346002)(136003)(39860400002)(13464003)(53754006)(189003)(199004)(11346002)(4326008)(446003)(105586002)(99286004)(6246003)(478600001)(74316002)(33656002)(97736004)(55016002)(229853002)(6436002)(14454004)(7736002)(71200400001)(71190400001)(2906002)(5660300001)(25786009)(106356001)(8676002)(81156014)(81166006)(305945005)(110136005)(9686003)(53936002)(68736007)(8936002)(6346003)(66066001)(26005)(316002)(102836004)(3846002)(5250100002)(6116002)(53546011)(6506007)(2501003)(186003)(14444005)(256004)(486006)(2900100001)(7696005)(76176011)(476003)(86362001)(90052001); DIR:OUT; SFP:1102; SCL:1; SRVR:AM4PR07MB3377; H:AM4PR07MB3236.eurprd07.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:0;
received-spf: None (protection.outlook.com: nokia-bell-labs.com does not designate permitted sender hosts)
authentication-results: spf=none (sender IP is ) smtp.mailfrom=sabine.randriamasy@nokia-bell-labs.com;
x-microsoft-antispam-message-info: cTRSJiX0Y0EcqXIgpkhe35Jx1XxuYLrr0Z66/rzzk6+qbje0F/PM1Ba4Yn8gUGkaOh9A3GdCCSgBIJyLja6ZGu9HbkcaVvKi5ic/Q3g8tS6mxVCYxLvSaKeAqOEmtE3AAq6cZ74rvHz0Xk6N7HuAK7CSrburgUAudNq6J2LrbukjJaIbrCrseGKwK71ipYTZZvxbQK58iro71JcwYtICYI0QZiRJrlR624n/qwunpL3rnvVI36PfBUls7FuhkBeDkBtCf1ogz7cTjQb9p56NIp4GD0K+GVfoX7RPNP956/60RjYdsSheDbFR/Ab3FMs/ABWlJbSfGnSB1fLRqTR8mp/m1m/tC0UK6e87TiyKHAM=
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: nokia-bell-labs.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 65e8150a-396d-43c1-32a3-08d61fea3868
X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Sep 2018 17:46:54.7013 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM4PR07MB3377
Archived-At: <https://mailarchive.ietf.org/arch/msg/alto/LfXyRrk3baMReP9w1BsxUMptLz0>
Subject: Re: [alto] AD review of draft-ietf-alto-cost-calendar-07
X-BeenThere: alto@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Application-Layer Traffic Optimization \(alto\) WG mailing list" <alto.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/alto>, <mailto:alto-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/alto/>
List-Post: <mailto:alto@ietf.org>
List-Help: <mailto:alto-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/alto>, <mailto:alto-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 21 Sep 2018 17:47:02 -0000

Hello Mirja,

draft-ietf-alto-cost-calendar-08.txt has just been uploaded and updated according to the conclusions in your e-mail of August 15th below. All comments have been addressed and your feedback would be welcome on some of the updates listed below. 

Besides, the "dependent-vtags" fields were completed in example of section 4.1.3 and member "default-alto-network-map" was added in the example IRD capabilities. 

For the Content-Length values, some text was added on the example number of characters used to encode metric values. 

Thanks a lot and best regards,
Sabine  

-------------------------- highlight on updates ---------------------------

----- First set of comments: last one on the cost type names:

As section 2.2.1 is about cost modes only, reference on [draft-ietf-alto-performance-metrics] has not been added and remains in section 3.3 (example IRD) instead. One sentence has been clarified as follows:

OLD: Actually, Calendars can also represent metrics in other modes
 and having considered as  time-varying values.
NEW: Actually, Calendars can also represent metrics in other modes
 considered as compatible with time-varying values.

Section 3.3 has been updated as follows: 

The 4 utilised cost types are listed: "num-routingcost",  "num-owdelay", "num-throughputrating", "string-servicestatus", with a mention that: 

- "routingcost" in the numerical mode is a must have according to RFC 7285,
- the 3 other ones are ficitious and one of them relates to a performance metric currently being defined in [draft-ietf-alto-performance-metrics]. 

These cost types and metric names have been updated accordingly in the examples of rest of the draft. 

----- other editorial comments: 1) "The abstract is quite long... ": 
The abstract has been shortened and a bit of the 2nd paragraph of the previous version has been left.



-----Original Message-----
From: Mirja Kühlewind <ietf@kuehlewind.net> 
Sent: Wednesday, August 15, 2018 10:34 AM
To: Randriamasy, Sabine (Nokia - FR/Paris-Saclay) <sabine.randriamasy@nokia-bell-labs.com>; draft-ietf-alto-cost-calendar.all@ietf.org
Cc: alto@ietf.org
Subject: Re: AD review of draft-ietf-alto-cost-calendar-07

Hi Sabine,

please see inline.

On 14.08.2018 19:03, Randriamasy, Sabine (Nokia - FR/Paris-Saclay) wrote:
> Hello Mirja,
>
> Thank you so much for your thorough review and suggestions. The authors will discuss open points such as those relating with metrics and your they will be integrated in a next version.
>
> Best regards,
> Sabine and co-authors
>
> -----Original Message-----
> From: Mirja Kuehlewind (IETF) [mailto:ietf@kuehlewind.net]
> Sent: Monday, August 06, 2018 4:12 PM
> To: draft-ietf-alto-cost-calendar.all@ietf.org
> Cc: alto@ietf.org
> Subject: AD review of draft-ietf-alto-cost-calendar-07
>
> Hi all,
>
> I reviewed this draft and there are a few minor fixes that we need before we can start IETF last call:
>
> 1) Please remove the following sentence, or refer to the respective sections instead:
> „IANA considerations and security considerations will be completed in
>     further versions."
> [[SR]] [[SR]] OK, will do and will remove previous sentence on section 5 that is no longer applicable.
>
> 2) Please fix everywhere in the doc:
> "Content-Length: TODO“
> [[SR]] the value "TODO" was left on purpose, in case we would be asked to change the names of the metrics. The plan was to fill them up when all the example metrics will be approved by the reviewers.
Which reviewers? I think the should be filled before we go to IETF last call, so please do it now.


>
> 3) Also please make all occurrences of RFC7285 an actually reference ("[RFC7285]" instead of only „RFC7285“).
> [[SR]] OK, will do
>
> 4) Then I also have a question about this example in Sec 4.1.2:
> "For example: if the "calendar-start-time" member has value "Mon, 30
>     Jun 2014 at 00:00:00 GMT" and if the value of member "repeated" is
>     equal to 4, it means that the calendar values are the same values on
>     Monday, Tuesday, Wednesday and Thursday.  The ALTO Client thus may
>     use the same calendar for the next 4 duration periods following
>     "calendar-start-time“.“
> I think this example only makes sense if also the duration period based on "time-interval-size“ and "number-of-intervals“ with „1 hour“ and „24“ respectively is given, right? Can you please add this here.
> [[SR]]  Would the following re-phrasing be fine?
> "For example: suppose the "calendar-start-time" member has value "Mon, 30 Jun 2014 at 00:00:00 GMT", the "time-interval-size" member has value "1 hour", the "number-of-intervals" member has value "24" and the value of member "repeated" is equal to 4. This means that the calendar values are the same on Monday, Tuesday, Wednesday and Thursday on a period of 24 hours starting at 00:00:00 GMT.
> The ALTO Client thus may use the same calendar for the next 4 days starting at "calendar-start-time" and will only need to request a new one for Friday July 4th at 00:00:00 GMT."
Yes, please.

>
> And one minor (technical) comment/question that I would like to discuss before we go into IETF last call:
> Why is "time-interval-size“ combining the value and unit in one element, instead of e.g. using "time-interval-unit“ and "time-interval-value“? Would that not make the implementation of the parsing much simpler?
> [[SR]] Parsing 2 separate fields would avoid ambiguities indeed, the idea with this proposed format was to spare one member to convey in the responses. We took inspiration from the encoding format of constraints by an ALTO Client in 11.3.2.3 of RFC 7285 that follows a similar pattern, e.g. "le 15". Would it help if we rephrase the format specification of the "time-interval-size“  value in section 3.1 to avoid parsing errors ?
I think the approach is fine. I was just wondering why it was chosen.

>
> And finally, you use the cost type names "num-routingcost", "num-latency", "num-pathbandwidth" and "string-quality-status“ as well as metrics "routingcost", "latency" and "bandwidthscore" in the examples and say that "The cost types in this example are either specified in the base ALTO
>     protocol or may be specified in other drafts see
>     [draft-ietf-alto-performance-metrics] or defined in this draft for
>     illustrative purposes.“
> However, non of these metrics are actually defined in [draft-ietf-alto-performance-metrics], nor are they „defined“ in this doc. Would it maybe make sense to actually use cost types and metrics from [draft-ietf-alto-performance-metrics] in these examples (or remove the reference and provide some kind of definition)?
> [[SR]]  We propose to revise the related parts in section 3.3 as follows:
> - only reference [draft-ietf-alto-performance-metrics] in section 2.2.1 that explains how Calendars support all kinds of metrics and modes and remove it from section 3.3,
> - keep the "routingcost" metric,
> - define example illustrative costs and metrics in section 3.3, that have names such as "num-owdelay", "num-throughput",  "string-service-status". If we are asked to replace them by cost types with nonsensical metric names such as "shoesize" or "cattle-head-count", we will do so.
Yes, please define the metric accordingly. I'm okay to have metric that 
actually make some sense. Just make sure that these metric are 
understood as example metrics only and should not be used. Or would it 
make more sense to "just" use some metrics from 
[draft-ietf-alto-performance-metrics]?

Mirja

>
> Given I reviewed the whole doc, also a couple of editorial comments/proposals below (however, I fully leave it to the authors' judgement to apply these or not).
>
> Thanks!
> Mirja
> [[SR]] Thanks a lot for your guidance and suggestions
> Sabine
>
>
> ————————————————
> Other editorial comments:
>
> 1) The abstract is quite long. I think if it could be formulated more crisp, it would be easier to read, e.g. see the text in the shepherd write-up
>
> "This document is an extension to the base ALTO protocol (RFC 7785).  It extends the ALTO cost information service such that applications decide not only 'where' to connect, but also 'when'.  This is useful for applications that need to perform bulk data transfer and would like to schedule these transfers during an off-peak hour, for example.“
> [[SR]] OK will do
>
> 2) I know that IRD is on the known abbreviation list, maybe still spell it out at first occurrence for the ease of the reader…?
> [[SR]] OK will do
>
> 3) As the alto base spec is already published for a while, maybe:
> OLD
> "IETF is currently standardizing the ALTO protocol which aims at
>     providing guidance to overlay applications…“ NEW "The ALTO protocol provides guidance to overlay applications…“
> [[SR]] OK will do
>
> 4) Maybe:
> OLD
> “...for example by deferring backup to night
>     during traffic trough.“
> NEW
> "for example by deferring backups or other background traffic to off-peak hours.“
> [[SR]] OK will do
>
> 5) To be inline with previously used wording, maybe OLD „...we expect to further
>     gain on storage and on the wire data exchange…“ NEW "we expect to further save network and storage resources…“
> [[SR]] OK will do
>
> 6) sec 2.2 "The protocol extension placeholders for an ALTO Calendar are: the
>     IRD, the ALTO requests and responses for Cost calendars.“ Not sure I fully understand the word „placeholder“ here, maybe:
> „To realize an ALTO Calendar, this document extends the
>     IRD, the ALTO requests and responses for Cost calendars.“ ?
> [[SR]] OK will do
>
> Also further
> "Extensions are designed to be light and ensure backwards
>     compatibility with base protocol ALTO Clients and with other
>     extensions.  It uses section 8.3.7...“ What is „it“ here?
> Maybe:
> „This extension is designed to be light and ensure backwards
>     compatibility with base protocol ALTO Clients and with other
>     extensions. As recommended, it relies on section 8.3.7…“ ?
> [[SR]] OK will do
>
> 7) Sec 4.1.1:
> "A Calendar-aware ALTO client supporting single cost type values, as
>     specified in RFC7285, MUST provide an array of 1 element:
>
>                            "calendared" : [true];“ This could be stated more clearly e.g.
> "A Calendar-aware ALTO client only supporting single cost type values, as
>     specified in RFC7285, that aims to request a Calendar MUST provide
>     an array of 1 element:
>
>                            "calendared" : [true];“
> [[SR]] OK will do
>
> 8) 4.2.2
> "If the value of member "calendared" is equal to 'false' for a given
>     requested Cost Type, the ALTO Server must return, for these Cost
>     Types, a single cost value as specified in RFC 7285.“ Probably use normative MUST here instead.
> [[SR]] OK will do
>
> 9) Probably RFC5246 does not need to be a normative reference for this doc (as it is already normative for RFC7285).
> [[SR]] OK, will move it to Informative
>
>
>