Re: [alto] Review of cost-calendar-11

"Randriamasy, Sabine (Nokia - FR/Paris-Saclay)" <sabine.randriamasy@nokia-bell-labs.com> Tue, 26 March 2019 11:13 UTC

Return-Path: <sabine.randriamasy@nokia-bell-labs.com>
X-Original-To: alto@ietfa.amsl.com
Delivered-To: alto@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F215B1202BD; Tue, 26 Mar 2019 04:13:07 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.9
X-Spam-Level:
X-Spam-Status: No, score=-1.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id lNX_caTIzaNz; Tue, 26 Mar 2019 04:13:04 -0700 (PDT)
Received: from EUR03-VE1-obe.outbound.protection.outlook.com (mail-eopbgr50126.outbound.protection.outlook.com [40.107.5.126]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 22FE61202D2; Tue, 26 Mar 2019 04:13:04 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com; s=selector2-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=6LvwafcYk+xN5oZkmRVZ9g94pRREVG7hhwQF3nSbziA=; b=UAxzlBjmlm0DCpn/NxxnW9np6MKsd62Ky0O9VR1VEC1wxHwpdvPT71ZfqqpJZkgPAhq591M3dzsvRIwsoByyUF1mkN/MzSJdNNaBBH2mhzrHSueWFWtaCrbuufSVQiKjaP+VyVcMFFb4oQ2uACij45ee3PQP37EEGPCHQpGAPY0=
Received: from AM4PR07MB3236.eurprd07.prod.outlook.com (10.171.189.13) by AM4PR07MB3282.eurprd07.prod.outlook.com (10.171.191.160) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1750.15; Tue, 26 Mar 2019 11:13:01 +0000
Received: from AM4PR07MB3236.eurprd07.prod.outlook.com ([fe80::6c38:8a94:8ec1:8b0f]) by AM4PR07MB3236.eurprd07.prod.outlook.com ([fe80::6c38:8a94:8ec1:8b0f%3]) with mapi id 15.20.1750.014; Tue, 26 Mar 2019 11:13:01 +0000
From: "Randriamasy, Sabine (Nokia - FR/Paris-Saclay)" <sabine.randriamasy@nokia-bell-labs.com>
To: Vijay Gurbani <vijay.gurbani@gmail.com>, IETF ALTO <alto@ietf.org>, "draft-ietf-alto-cost-calendar@ietf.org" <draft-ietf-alto-cost-calendar@ietf.org>
Thread-Topic: Review of cost-calendar-11
Thread-Index: AQHU40L+TciQuwTN90Ck2JILIXGZbqYdwiHA
Date: Tue, 26 Mar 2019 11:13:01 +0000
Message-ID: <AM4PR07MB3236AA97A877229A4D0192EF955F0@AM4PR07MB3236.eurprd07.prod.outlook.com>
References: <CAMMTW_KZwvRyhhQV+9yv+805M6DoYdFMFPOOVKm8q+azMGU7ZA@mail.gmail.com>
In-Reply-To: <CAMMTW_KZwvRyhhQV+9yv+805M6DoYdFMFPOOVKm8q+azMGU7ZA@mail.gmail.com>
Accept-Language: fr-FR, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [2001:67c:1232:144:58b2:6e3e:f319:12a6]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 8d15ece4-970c-4848-d298-08d6b1dc02a0
x-ms-office365-filtering-ht: Tenant
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600127)(711020)(4605104)(4618075)(2017052603328)(7193020); SRVR:AM4PR07MB3282;
x-ms-traffictypediagnostic: AM4PR07MB3282:
x-microsoft-antispam-prvs: <AM4PR07MB3282E9419532A325BDC3E317955F0@AM4PR07MB3282.eurprd07.prod.outlook.com>
x-forefront-prvs: 09888BC01D
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(979002)(396003)(39860400002)(136003)(346002)(366004)(376002)(199004)(189003)(6116002)(476003)(2906002)(790700001)(6246003)(6346003)(186003)(74316002)(105586002)(52536014)(102836004)(76176011)(6506007)(53546011)(11346002)(446003)(25786009)(106356001)(486006)(46003)(7736002)(5660300002)(256004)(14444005)(86362001)(81166006)(81156014)(7696005)(8936002)(71190400001)(71200400001)(14454004)(110136005)(99286004)(8676002)(33656002)(316002)(2501003)(97736004)(9686003)(54896002)(6306002)(68736007)(55016002)(53936002)(6436002)(478600001)(229853002)(969003)(989001)(999001)(1009001)(1019001); DIR:OUT; SFP:1102; SCL:1; SRVR:AM4PR07MB3282; H:AM4PR07MB3236.eurprd07.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:0; MX:1;
received-spf: None (protection.outlook.com: nokia-bell-labs.com does not designate permitted sender hosts)
authentication-results: spf=none (sender IP is ) smtp.mailfrom=sabine.randriamasy@nokia-bell-labs.com;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: LqAIm9VMB1Upnz8eQjNM+T6G9UYCsEV6RVffFbxKotMXsZR5qe0CAWdKmPRVDQmeN4CRFmYCEn5jWsBK3n5oesd3MtmesZztyrfWC19VkIIFfMFnV0+pC0RUAw+8wi6FkCGV83jjBA0I02p9Zz0987wWRb2kfninZm1WuCNdirE++g89WSNKCThXF9cRo1Uuj2ZVsiNHnYKGIvcSZ4t+Zof334qg8Xq+yycw28lmO6rx12e6t+aJJb2NqjceAUfCn5FBf7Q4LDpiZ2FFvY+YK/ShRJ7TZRMzMfOxeFVRAs+q3d0KmQcvHTgtZHDavzRMTCD4teZLnJSmvsuUBRO81hTIquiwekVDJ6tvcnvHJuYLu1ahMMOYNxiIb+DWq7fxKWE16g4MaBCiehMj1OhaGpaAB6clhyyVaCJmtxrelp4=
Content-Type: multipart/alternative; boundary="_000_AM4PR07MB3236AA97A877229A4D0192EF955F0AM4PR07MB3236eurp_"
MIME-Version: 1.0
X-OriginatorOrg: nokia-bell-labs.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 8d15ece4-970c-4848-d298-08d6b1dc02a0
X-MS-Exchange-CrossTenant-originalarrivaltime: 26 Mar 2019 11:13:01.3558 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM4PR07MB3282
Archived-At: <https://mailarchive.ietf.org/arch/msg/alto/1LJMZvAxDCmuA8B7CI5VcBFXnjI>
Subject: Re: [alto] Review of cost-calendar-11
X-BeenThere: alto@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Application-Layer Traffic Optimization \(alto\) WG mailing list" <alto.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/alto>, <mailto:alto-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/alto/>
List-Post: <mailto:alto@ietf.org>
List-Help: <mailto:alto-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/alto>, <mailto:alto-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 26 Mar 2019 11:13:08 -0000

Hi Vijay,

Great thanks for your feedback, thorough review and advices.
Indeed, clarity and editorial consistency is key for bugless implems.
The document will be revised right after the IETF meeting.
Best regards,
Sabine


From: Vijay Gurbani <vijay.gurbani@gmail.com>
Sent: Monday, March 25, 2019 8:44 PM
To: IETF ALTO <alto@ietf.org>; draft-ietf-alto-cost-calendar@ietf.org
Subject: Review of cost-calendar-11

The cost-calendar draft is ready.  It is an excellent piece of work by the authors who are long standing ALTO contributors; the draft is is applicable and of interest to many ALTO deployments (and this should be highlighted; I provide the Unicorn link to highlight this in my  feedback below, but please provide more).  The one feedback I have about the draft is the need for a thorough edit session to ensure grammar and consistency in the document as well as to ensure that implementations deal with as less ambiguity as possible when following the protocol extension.  I provide some examples of where the text can be improved below.

- General:
 a) Is it Cost Calendars (plural) or Cost Calendar (singular)?  You use both in
 the text; best to ensure that only one representation is being used.

 b) There are a number of run-on sentences (see first, second and third
 paragraphs in S3.1; such run-on sentences make it very hard to understand what
 is being asked of the implementors, and as a result will lead to an
 implementation that is ambiguous at best and full of bugs in the worst case.
 Such sentences must be scrubbed appropriately before publishing as these
 outline normative behaviour).

 Getting the right text to describe the processing of cost-calendar is not easy,
 I will be the first to admit.  Perhaps an editor can improve the text to
 eliminate such run-on sentences.

 c) In many HTTP requests and responses (see for example the ALTO POST request
 on page 19), a content length is specified.  In the example on page 19, the C-L
 is 815.  However, how was this sum arrived at?  The body of the response
 contains a lot of elucidations ("v1, v2, ..., v12"), for example.  Does the 815
 bytes include these elucidations ("...")?  My advice would be to be as
 realistic as possible and remove these elucidations, put sample values in the
 response and calculate the C-L.  Yes, more work, but better product.

Document-order specific comments follow.

- Abstract:
  a) s/service such that/service so that/
  b) s/ALTO Cost Calendars/ALTO Cost Calendar/

- S1, para 1: s/needing to/that need to/

- S1, para 2: The larger point you are making in the second half of the
  paragraph is that due to the fact that ALTO does not provide real time network
  metrics, the applications essentially have to figure out what the cost of
  doing business will be at some later time, a proposition that is sub-optimal
  since the application has no idea of network usage at some future time.  This
  salient point is not quite captured.  Perhaps the text below may help?
  (Please feel free to edit as needed.)  Also, you have the wrong reference to
  ALTO requirements document in your current text; that is fixed below as well.

  OLD:
  ALTO intentionally avoids provisioning real-time information as explained in
  the ALTO Problem Statement [RFC5693] and ALTO Requirements [RFC5693].  Thus
  the current Cost Map and Endpoint Cost Service are providing, for a given Cost
  Type, exactly one path cost value.  Applications have to query one of these
  two services to retrieve the currently valid cost values.  They, therefore,
  need to plan their ALTO information requests according to their own estimation
  of the frequency of cost value change.

  With [RFC7285], an ALTO client should interpret the returned costs as those at
  the query moment.  However, Network costs can fluctuate, e.g., due to diurnal
  patterns of traffic demand or planned events such as network maintenance,
  holidays or highly publicized events.  Providing network costs for only the
  current time thus may not be sufficient, in particular for applications that
  can schedule their traffic in a span of time, for example by deferring
  backups or other background traffic to off-peak hours.

  NEW:
  For the reasons outlined in the ALTO problem statement [RFC5693] and
  requirement AR-14 [RFC6708], ALTO does not disseminate network metrics that
  change frequently.  In a network, the costs can fluctuate for many reasons
  having to do with instantaneous traffic load or due to diurnal patterns of
  traffic demand or planned events such as network maintenance, holidays or
  highly publicized events.  Thus, an ALTO application wishing to use the Cost
  Map and Endpoint Cost Service at some future time will have to estimate the
  state of the network at that time, a process that is, at best, fragile and
  brittle since the application does not have any visibility into the state of
  the network.  The need of such future scheduling of large scale traffic that
  can be addressed by the ALTO protocol is motivated by Unicorn, a unified
  resource orchestration framework for multi-domain, geo-distributed data
  analytics [draft-xiang-alto-multidomain-analytics].

- S2, para 2: s/crowded events/expected spike in traffic due to crowd gathering
  (concerts, sports, etc.)/

- S2.1, para 1:
  a) s/with dateless/without date/
  b) s/the "meta" of/the "meta" section of/
  c) s/avoiding to process useless requests./reducing processing of similar
  requests./

- S2.2, para 2: s/also says/states/

- S2.2,
  a) s/and ensure/and to ensure/
  b) para 4: "As recommended, it relies ..." ==> Recommended by who?  Please
  specify.

- S2.2.2:
  OLD:
  As a consequence, when a metric is available as a Calendar array, it
  MUST be as well available as a single value, as provided by
  [RFC7285].

  NEW:
  As a consequence, when a metric is available as a Calendar array, it also MUST
  be available as a single value as required by [RFC7285].  (This ensures
  backwards compatibility.)

- S3.1, para 1, 2, and 3: I would re-write these paragraphs completely, probably
  put them in one pragraph.  In its current form, it is hard to parse and
  understand these paragraphs.

  My suggested edit is below, but please feel free to modify as needed.

  A Cost Calendar for a given Cost Type MUST be indicated in the IRD by an
  object of type CalendarAttributes.  A CalendarAttribute object is represented
  by "calendar-attributes" member of a resource entry.  Each CalendarAttributes
  object applies to a set of one or more cost types.  A Cost Type name MUST
  appear no more than once in the "calendar-attributes" member of a resource
  entry; multiple appearances of a Cost Type name in CalendarAttributes object
  of the "calendar-attributes" member causes the ALTO client to ignore any
  occurrences of this name beyond the first encountered occurrence.

- S3.2, para 1: "w.r.t." ==> Too colloquial to be in a standard document.
  Please take out or reword the sentence.

- S3.3:
  a) first bullet: s/at the IANA./with IANA.
  b) in the remaining bullets, s/some fictitious/a fictitious/

- S3.3, after the GET request, what is the horizontal line doing?  It appears to
  be separating the request and the response, if so, please use the "S -> C" and
  "C -> S" nomenclature used in other IETF documents to denote request going
  from Client to Server and response from Server to Client.

- S4, para 2 does not make sense grammatically.  Please reword.

- S4.1.3, para 1: s/periods for example to/periods to/

- S4.1.3, para 3: s/To lighten the text/For representation brevity/

Thanks.

- vijay