Re: [ippm] Lars Eggert's Discuss on draft-ietf-ippm-capacity-metric-method-10: (with DISCUSS and COMMENT)

"MORTON JR., AL" <acmorton@att.com> Sat, 29 May 2021 21:16 UTC

Return-Path: <acmorton@att.com>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A19963A203E; Sat, 29 May 2021 14:16:03 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.597
X-Spam-Level:
X-Spam-Status: No, score=-2.597 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id A9KAsPFIXMSJ; Sat, 29 May 2021 14:15:58 -0700 (PDT)
Received: from mx0a-00191d01.pphosted.com (mx0b-00191d01.pphosted.com [67.231.157.136]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2C23E3A203B; Sat, 29 May 2021 14:15:57 -0700 (PDT)
Received: from pps.filterd (m0049459.ppops.net [127.0.0.1]) by m0049459.ppops.net-00191d01. (8.16.0.43/8.16.0.43) with SMTP id 14TLF6SX025105; Sat, 29 May 2021 17:15:49 -0400
Received: from alpi154.enaf.aldc.att.com (sbcsmtp6.sbc.com [144.160.229.23]) by m0049459.ppops.net-00191d01. with ESMTP id 38uheufnp6-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sat, 29 May 2021 17:15:49 -0400
Received: from enaf.aldc.att.com (localhost [127.0.0.1]) by alpi154.enaf.aldc.att.com (8.14.5/8.14.5) with ESMTP id 14TLFnbl011566; Sat, 29 May 2021 17:15:49 -0400
Received: from zlp30488.vci.att.com (zlp30488.vci.att.com [135.47.91.93]) by alpi154.enaf.aldc.att.com (8.14.5/8.14.5) with ESMTP id 14TLFlxm011517 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sat, 29 May 2021 17:15:47 -0400
Received: from zlp30488.vci.att.com (zlp30488.vci.att.com [127.0.0.1]) by zlp30488.vci.att.com (Service) with ESMTP id 64B044009E60; Sat, 29 May 2021 21:15:47 +0000 (GMT)
Received: from GAALPA1MSGEX1DD.ITServices.sbc.com (unknown [135.50.89.117]) by zlp30488.vci.att.com (Service) with ESMTP id 1F92C4009E61; Sat, 29 May 2021 21:15:47 +0000 (GMT)
Received: from GAALPA1MSGEX1DB.ITServices.sbc.com (135.50.89.115) by GAALPA1MSGEX1DD.ITServices.sbc.com (135.50.89.117) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2242.4; Sat, 29 May 2021 17:15:45 -0400
Received: from GAALPA1MSGEX1DB.ITServices.sbc.com ([135.50.89.115]) by GAALPA1MSGEX1DB.ITServices.sbc.com ([135.50.89.115]) with mapi id 15.01.2242.010; Sat, 29 May 2021 17:15:38 -0400
From: "MORTON JR., AL" <acmorton@att.com>
To: Lars Eggert <lars@eggert.org>
CC: The IESG <iesg@ietf.org>, Ian Swett <ianswett@google.com>, "ippm-chairs@ietf.org" <ippm-chairs@ietf.org>, "tpauly@apple.com" <tpauly@apple.com>, "draft-ietf-ippm-capacity-metric-method@ietf.org" <draft-ietf-ippm-capacity-metric-method@ietf.org>, "ippm@ietf.org" <ippm@ietf.org>
Thread-Topic: Lars Eggert's Discuss on draft-ietf-ippm-capacity-metric-method-10: (with DISCUSS and COMMENT)
Thread-Index: AQHXRj9wHkruODMC0Ei/Hlwt8URm2armoX9QgAJ9SQCAEeD3MA==
Date: Sat, 29 May 2021 21:15:38 +0000
Message-ID: <05d05addd3544b1fb61bdd6df06df8e4@att.com>
References: <162072161364.15626.11472410331094167599@ietfa.amsl.com> <1764ec14e5394838b2a2802c45561aab@att.com> <6B3E6E27-AE72-4ABB-AE28-0A74B3EE93D0@eggert.org>
In-Reply-To: <6B3E6E27-AE72-4ABB-AE28-0A74B3EE93D0@eggert.org>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [130.10.204.195]
x-tm-snts-smtp: 5C7136CBD9C31752B21BFA20E6727B2F20601BB0CA7B9DFC7044132A3E59553C2
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Proofpoint-ORIG-GUID: gAOuZzaYJko2XVOhvCMmPMkp4TPZuJw3
X-Proofpoint-GUID: gAOuZzaYJko2XVOhvCMmPMkp4TPZuJw3
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.391, 18.0.761 definitions=2021-05-29_10:2021-05-27, 2021-05-29 signatures=0
X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 clxscore=1015 mlxscore=0 suspectscore=0 adultscore=0 lowpriorityscore=0 mlxlogscore=999 impostorscore=0 priorityscore=1501 bulkscore=0 phishscore=0 malwarescore=0 spamscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2104190000 definitions=main-2105290161
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/ZCha6oZRizuJE3TY4Pxqmk0zwDU>
Subject: Re: [ippm] Lars Eggert's Discuss on draft-ietf-ippm-capacity-metric-method-10: (with DISCUSS and COMMENT)
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 29 May 2021 21:16:04 -0000

Hi Lars,

I'll trim this reply down to the essentials.

Al

> -----Original Message-----
> From: Lars Eggert <lars@eggert.org>
> Sent: Tuesday, May 18, 2021 3:05 AM
> To: MORTON JR., AL <acmorton@att.com>
...
> 
> Hi Al,
> 
> On 2021-5-17, at 21:00, MORTON JR., AL <acmorton@att.com> wrote:
...
> 
> yes, another LC will unfortunately be needed. It's an action item for
> Martin.
[acm] 
Martin obtained a waiver for the LC; this DOWNREF didn't appear in the memo
until we addressed Magnus' comments. We're good here.

> 
> Note that everything below was comments, which are not blocking the
> document:
> 
> >> Section 1, paragraph 3, comment:
> >>>   Here, the main use case is to assess the maximum capacity of the
> >>>   access network, with specific performance criteria used in the
> >>>   measurement.
> >>
> >> If the main use case is to measure access network paths, that applicability
> >> should be made very explicit, i.e., in the title and abstract.
> >
> > Two things:
> >
> > 1. The term "access" doesn't have a universally agreed definition
> regarding the portion of the network it covers, and that's partly because
> there are many architectures in use.
> >
> > 2. If we add access to the title or abstract, we are unnecessarily
> limiting the scope that we define later. We refer to section of RFC 7497
> where the figure includes the subscriber's device, multiple private
> networks, and various devices and gateways ending at a transit gateway.
> >
> > So, I don't want to emphasize the term "access" as you propose.
> 
> That's fine, too. When reading the document, I came away with the
> impression that it did want to focus on measuring access networks, because
> it actually says that in several places (e.g., the quote above.) If the
> intent is for this to be a general metric for IP paths, maybe review the
> places where the document talks about "access" to make sure they are not
> giving the wrong impression.
> 
> > Perhaps we can clarify this further in the Intro, because the Scope says:
> >
> >   The primary application of the metric and method of measurement
> >   described here is the same as in Section 2 of [RFC7497]...
> >
> > How about:
> > Here, the main use case is to assess the maximum capacity of one or more networks
> > where the subscriber receives specific performance assurances, sometimes
> > referred to as the Internet access.
> 
> It's not only the intro, though. There is text talking about "access"
> throughout the document.
[acm] 
I have substituted more descriptive terms where possible. Note that we 
use "Internet access" to describe a service, and that "on-demand access"
is now clarified as "on-demand communications access". The later clarification
convinced me to avoid pairing terms like "access" and "capacity" in the title,
where access capacity might be misconstrued as a number of users, or sessions,
or something else we don't intend.

...
> 
> >> Section 3, paragraph 4, comment:
> >>>   1.  Internet access is no longer the bottleneck for many users.
> >>
> >> What is the bottleneck then, and if it's not the access bandwidth, why is
> >> a new metric for it helpful?
> >
> > [RG]+[acm] 1.  Internet access is no longer the bottleneck for many
> users, but subscribers expect network providers to honor contracted access
> performance.
> >
> > [acm] IOW, when you subscribe to a 1 Gbps service, then your ISP, you,
> and possibly other parties want to assure that performance level is
> delivered. If you test and confirm the subscribed performance level, then
> you can seek the location of the bottleneck elsewhere.
> 
> That context would be helpful to have in the document in some form, IMO.
[acm] 
Ok, added to the intro.

> 
...
> 
> > Section 8.1, paragraph 1, comment:
> >>> 8.1.  Load Rate Adjustment Algorithm
> >>
> >> I wonder why this section is trying to define a crude new AIMD scheme, when we
> >> have lots of good experience with TCP's AIMD approach, which converges on
> >> the available bandwidth relatively well?
> >
> > [acm] "crude"?? Our algorithm has the advantage of receiver measurements of rate,
> > loss, and delay. So, we aren't making inferences based on ACKs, we communicate
> > measurement feedback instead.
> 
> Maybe I should have said "complex" :-)
[acm] 
That's closer, although it's 20 lines of pseudocode... wondering how that 
compares to CUBIC or BBR (and not stopping to look).
...

> >>
> >> -----------------------------------------------------------------------
> ---
> >> -----
> >> All comments below are about very minor potential issues that you may
> choose to
> >> address in some way - or ignore - as you see fit. Some were flagged by
> >> automated tools, so there will likely be some false positives. There is
> no need
> >> to let me know what you did with these suggestions.
> >
> > Ok, thanks.  I would like to know which tool(s) you used (and if free,
> > even on a trial basis). Seemed to do a decent job.
> 
> https://github.com/larseggert/ietf-reviewtool
[acm] 
Thanks, I had tried the idcomments tool, once. I must not have been won-over.
I'll try yours at my next opportunity (which is probably already in my to-do
list).

Thanks again for your review!  We have Zahed's comments now and there will be a 
revised draft shortly.

Al