Re: [ippm] I-D Action: draft-ietf-ippm-capacity-metric-method-08.txt

Magnus Westerlund <magnus.westerlund@ericsson.com> Wed, 31 March 2021 14:27 UTC

Return-Path: <magnus.westerlund@ericsson.com>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0A1C73A2A3E for <ippm@ietfa.amsl.com>; Wed, 31 Mar 2021 07:27:59 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.102
X-Spam-Level:
X-Spam-Status: No, score=-2.102 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id A4lfi4jx6Wx6 for <ippm@ietfa.amsl.com>; Wed, 31 Mar 2021 07:27:54 -0700 (PDT)
Received: from EUR02-HE1-obe.outbound.protection.outlook.com (mail-eopbgr10079.outbound.protection.outlook.com [40.107.1.79]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 8A40B3A2A39 for <ippm@ietf.org>; Wed, 31 Mar 2021 07:27:53 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=HtivjHblMl8DvARNnN10TwVw6KcWe+eWaGFIJexU+YJaMlaiu3Pn+tR2egF/ihW345lbc/7UDbruP5THmF5airq31KAr92V3veqvdVvzBOvfZGCyfM+N+0dOk68pSXXQpw48fRcgQ25FusdZZMbu0yezoMzxnAnjK8QaVzPniKpBBgWfJT626vArx0gcuEmJM6nJcaB98SAP/kAyhfoBtbzU2FBH3mQTSZEaFzHUTaVSvwbaji32SJXubcKV2ZW/wizvdzoTBXGGcDpIaQLlCsrC2+ywWLzcpnSUZvtgRF+1ZPrKQp9s8QFhcU5X66PsoTHGupIILTA10jsKmQXyCw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=MQtovrwBQrbFzxLCXAH3zt6LzllMzD0yIaYd1Kd8nqM=; b=BSE3hArrP8Nyya8EAzmTU1AwLaVEUgLSKS6a2xRAR2lyRU7o5SQU5X4nlp+Q4yea7odiZWtvfGqvg1+CvoSmwfvqtwafM5eWLbKoAImVPAioB2iWjCRDq6vIQowidl3IRly93jlWF5XiD7k3Xy8TpSgWjnt9D/vPObuGuAdGBjzAM60EqBZO7sDpoBczFZA2Pv6E6pw4rhwEWesP7bRE7DOOZlAJW1lEVEw8cKUm9nPLIgxlZczzbV0diaxrn1v8iUvn7Xorh3qUbR+mKLUmIM0HatF+X8sv9KYIP6scmfqTDG4BK2kOjVv4OaLOdFVBZcpvVeM8HEYqQtb9Ej2cjg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=MQtovrwBQrbFzxLCXAH3zt6LzllMzD0yIaYd1Kd8nqM=; b=WXbvmHYjDk+zbzFh6y+dAonFU8FCGTQdnf9uuxWIIKJrPOEi/YX9wmrPMvm+Q3BVa/K8o3IPmvfwmytuPuqBMcaeo5Z+03B7+NvdwhVOGZmhojRdQwJcsHacdTxX6fS65EPDN2CzJWeQtJk7s0UeE0EQ3jf9ewwenUXZLgxjP6I=
Received: from HE1PR0702MB3772.eurprd07.prod.outlook.com (2603:10a6:7:8e::14) by HE1PR0702MB3769.eurprd07.prod.outlook.com (2603:10a6:7:83::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.16; Wed, 31 Mar 2021 14:27:41 +0000
Received: from HE1PR0702MB3772.eurprd07.prod.outlook.com ([fe80::d1fa:a432:3534:56da]) by HE1PR0702MB3772.eurprd07.prod.outlook.com ([fe80::d1fa:a432:3534:56da%6]) with mapi id 15.20.3999.027; Wed, 31 Mar 2021 14:27:41 +0000
From: Magnus Westerlund <magnus.westerlund@ericsson.com>
To: "Ruediger.Geib@telekom.de" <Ruediger.Geib@telekom.de>
CC: "ippm@ietf.org" <ippm@ietf.org>
Thread-Topic: AW: AW: I-D Action: draft-ietf-ippm-capacity-metric-method-08.txt
Thread-Index: AQHXJOLrl9yneiGOTUyGqQdxAyNF5aqcKKEQgAAm9/CAAWmVgIAADyuAgABh44A=
Date: Wed, 31 Mar 2021 14:27:40 +0000
Message-ID: <ae21c673c1f86ab3e4907c0f74e04e5b12d5a0f0.camel@ericsson.com>
References: <161705348048.17388.9380614999436689902@ietfa.amsl.com> <HE1PR0702MB3772E8BA15BFF01315E139A8957D9@HE1PR0702MB3772.eurprd07.prod.outlook.com> <FRYP281MB01127BBC2A94F40783044DFE9C7D9@FRYP281MB0112.DEUP281.PROD.OUTLOOK.COM> <201af4d37914dfc0a87204b82c6db3c236acea6d.camel@ericsson.com> <FRYP281MB011208657C5A83AA34F137829C7C9@FRYP281MB0112.DEUP281.PROD.OUTLOOK.COM>
In-Reply-To: <FRYP281MB011208657C5A83AA34F137829C7C9@FRYP281MB0112.DEUP281.PROD.OUTLOOK.COM>
Accept-Language: sv-SE, en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
x-mailer: Evolution 3.28.5-0ubuntu0.18.04.2
authentication-results: telekom.de; dkim=none (message not signed) header.d=none;telekom.de; dmarc=none action=none header.from=ericsson.com;
x-originating-ip: [158.174.130.243]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: fcfa5c03-d1f0-4dbe-9c13-08d8f4512451
x-ms-traffictypediagnostic: HE1PR0702MB3769:
x-microsoft-antispam-prvs: <HE1PR0702MB376904B9D756165FBF48D28D957C9@HE1PR0702MB3769.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: F/iScDPr91gpgzBSEumqjeHimkJC7n0tF9Ag48Df8SNILtalw2vJ803X2cXc2NX6PcDDR63AngK05l8g1lxEBGCwzJjpiiTX/BYx2FOUsEL+cZ8NgYYhYCxy4yL8kz9+WnDRFLSo/G2rwu3QhOZRxyOlVdfgJbRWPgt0gqF9Rn5kXtsOgKmL+dqQulfkpJfLCU7FE78d2Ju4W0utYRBkVaSxL3zPOj/G6E9rhXagxootIcCxcCVMSpx8yvusCiu8g06BMQ4zYExijcjjTOzzaEwLUdNQGyJ5ESZed+BrNO4t6PAIBejVaoUfsJe+dVI5wBO94yPOuD4gbgY3U6bVTAlH5uAWV5D4WUy6W9rERVUuNEW40UKobe1dC/kuR2ovprjjkmzTscfNkGNtFMpOzi50zUjYPyXjgRzZtqm/koB0vVHctDnRwTyOwh8hezVAVEpfgSVfUraKe0jjJs98Xvqmyc/H9qvlkUz3Mmaofvj8yZQmsTcCpgLpWx3Y1rWpuqQZDMAxI/hv19fGpZmd64eD4klBiQMbmvKKSmi9hY7N1XgWVOiGHTpIFIaBkEaT6Go0bF0cIwflb5bXqaxsPGk6qr3lTXQeQ1tIar1+qRDienss2n5k9TjuMmIMbcFV0Hv/2CKYgAwAQMKatqgT/Nsla8vC/XRAXLGDU9NwrdejkM0dgBp0TppCsErW7zaH
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:HE1PR0702MB3772.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(376002)(346002)(39860400002)(136003)(396003)(83380400001)(66574015)(5660300002)(64756008)(66946007)(316002)(76116006)(6506007)(2616005)(66616009)(66476007)(99936003)(66556008)(71200400001)(86362001)(36756003)(66446008)(6916009)(478600001)(6486002)(6512007)(186003)(8676002)(8936002)(26005)(38100700001)(44832011)(2906002)(4326008)(99106002); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata: XxSz/HAYesj+iAawTiCzdk+/FwNi/cEWQ/6HgofcL0t4NIWzIKw+CSKN/BNkvd2v6NU57oXBeYyS7a60csVADGfmaDiEWOUApRUaQid9OFrK2Q3z2EkRzM2nDK1EJGaiLGP6zaxh9kQFu+bDVYvBeKvC1G28+IOHaTocP0hmeL2HalsWlJTtXf1mIjMoUtYlmlf1Vvekx1avsYTG5KRmnsxkDir/F0h6f/jPQW17M8oFEE37LbrBfNcxa67/XrDHWS0Ztc0f6WTDC+BLt/EsPiRKh89YhzfjqOUcUaTiW+5oOBe+BksEtB3eAa6ezdijaDUH5GWi/zvaGd+0DdbR06UAvTRbBBWmblgWTV3mILKXgzTvOkLad+PFEuJESL9dpkXRpnwnfooUfZgGRLNIkxQIYKzOMBtOnKi1ckHRHfQe6mYQaWou50YCTl7W+2CUVy/KOXmyXCK4/QW2rtdyE/NBmA5btQTWUI5fto+AuB0t/m+e3msc6W/LN8mJso+BU0WdhPOffYyK+9vZ/hL4NuOKRg/LHTFYoZpeEVWQUjQRm43TOWMkYNVwxzLUK3HNwhqCKqTL0v9qonb9vQAN1xUl9Ksbcw0GzMiOWeybiHNRW7/4PiU1s2TtryMHwCKN+5uqQLJMZirfbjXIE3cYjLT8CyLamIMqBiSz61PXe0xTkAgJ9y7gvxBUsp0YOHWwZpYmYhoNEoeH/NTsNty3vPcYttlZiiOjn1IrWAm0iz9SLGsrBBoUOQWnELmVD/X3DnDT21v+V5vpCyXCVivmsdFPxKm5gqrhheoMNscj5KXwKyo5nekopwvswI+ilro48K1nX9X425bqYm/nxrobXf6ZT0Sqg4Gttyz41VqoI3UsQojD/IrlU3h6iSBMkUGJ4qyd/iN2CmZaCS9HoteyekMqAFrukksqj88fx22C1ow3NRyesM7OiD8TS756MpVxYLcAuR2OTWYAd08ob8y7vMHZzA9ff4Csq93/a63dkGZh95Nq13DYIHiR4S+ZtFYoi2U4QIjc2WKcL2lVGe7Wes142lWPCE88+dF1ugEo/YK+/TwlchHrYiN0Qw1WrIZomZoTSj3VTmLzCXfC09tImhlSVBNT20oYiA4Q2fkvVTwWCHubXO0F5xs5Rnk0oeMbkrC9SnWczN24xueaijojyIJIgRMi4je+mv9mI2Ny/UadQ2gtEOlFBtBCt+Jd867KO7cLIoej0DQJETRiOiOTBSrL4ViMOm+5ODrr5LHe8j+ygnlGX75d2VX622mfjFKD1juPq7Os3d+jxVcmHfu1s+GhUHKroU8yMSqBF+d0UN1JKQF+/Vp1qFe5CwZwO0+lUAvelkh+qU4wucJwJcnC7Q==
x-ms-exchange-transport-forked: True
Content-Type: multipart/signed; micalg="sha-256"; protocol="application/x-pkcs7-signature"; boundary="=-vb758RnXwsogmPUxcLRI"
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: HE1PR0702MB3772.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: fcfa5c03-d1f0-4dbe-9c13-08d8f4512451
X-MS-Exchange-CrossTenant-originalarrivaltime: 31 Mar 2021 14:27:41.0119 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: oU+NvXRT5rBA0dlGxtI+oahDF4nrFQUCbitEeo8oF16wYvkwNTMUcFcGw2tg18rqWBgIQTH9xqs0zlIjiNHANJNobKSJumBpRp1ZhelAOiE=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR0702MB3769
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/Gx5y48vDWW0GhNsQWCTDWoK068A>
Subject: Re: [ippm] I-D Action: draft-ietf-ippm-capacity-metric-method-08.txt
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 31 Mar 2021 14:27:59 -0000

Hi,

Yes, so I think ECN is definitely something that can wait for future
improvements. I was simply trying to be as clear as possible that from an
endpoint you don't have that many basic indicators of congestions. 

So I am primarily concerned that this one has the right description for what we
expect it to do. From my perspective I have no issue with this being published
with a clear limited applicability and clear indication of what it is expected
to do. For the intention I am fine with you authors reword it to something
similar that is more consistent with the existing text. I just want it to be
clear that due to the nature of the intent to measure capacity it may push
existing elastic traffic out of the way in the probing to determine maximum
capacity. 

Cheers

Magnus

On Wed, 2021-03-31 at 09:30 +0000, Ruediger.Geib@telekom.de wrote:
> Hi Magnus,
> 
> Thanks for clarifying. 
> 
> The scheduling behaviour of wireless shared media is an issue and first
> results I saw indicated an increased RTT and a rather high access capacity.
> Store until there's sufficient load to use a "bearer" and then send at line
> rate. I think that's one of the reasons why a measurement "preamble" is part
> of the method. As far as I can tell, the above behaviour turned (often at
> least) into a more stable forwarding, as long as measurement traffic arrived
> regularly afterwards.
> 
> We can't get around inducing congestion to recon that we are "over the top".
> I'd be happy to work with ECN marks too, but ECN isn't widespread at devices
> scheduling customer and server traffic with operator connectivity. The
> overshooting carefully is a requirement, and that's a reason why the algorithm
> measures queue-build up by increasing delay and classifies it as a congestion
> indication (as I think do some or all of the latest transport protocols too,
> without comparing the detailed algos). Fairness against competing transport
> hasn't been tested. In my eyes, such a test needs to compare commodity speed
> test vs. competing transport and then IP-capacity metric traffic vs. competing
> transport. Both, commodity speed-test and IP-capacity metric traffic decrease
> the bandwidth of competing transport. One of both might have a significantly
> stronger impact. I don't judge here, as I'm not aware of tests, but I also
> don't think it's ok to state commodity speed tests are fair, as they are TCP
> based. Their design goal is to reliably congest the receiver access until
> drops occur.
> 
> Udpst is open source. In general, and not addressing you personally, I'd
> appreciate all improvements to reduce total test load and test duration, and
> dealing with background traffic or (more generic) dealing with feedback
> indicating varying IP-capacity during a single test session at the receiver.
> If the result is "available capacity" because of such a time-varying receiver
> IP capacity, then that's the result and the test stops. I agree, that a test
> should not try to determine IP access capacity "by all means" (and I think
> neither does the text provided, nor does the implementation). 
> 
> Regards,
> 
> Rüdiger
>  
> 
> -----Ursprüngliche Nachricht-----
> Von: Magnus Westerlund <magnus.westerlund@ericsson.com> 
> Gesendet: Mittwoch, 31. März 2021 09:43
> An: Geib, Rüdiger <Ruediger.Geib@telekom.de>
> Cc: ippm@ietf.org
> Betreff: Re: AW: I-D Action: draft-ietf-ippm-capacity-metric-method-08.txt
> 
> Hi Ruediger,
> 
> On Tue, 2021-03-30 at 10:48 +0000, Ruediger.Geib@telekom.de wrote:
> > Hi Magnus,
> > 
> > [MW] To accurately measure the capacity of the path the load algorithm
> > strive
> > to load the path so that the one way latency increases to indicate that the
> > bottleneck buffer is sufficiently filled to achieve high utility. This load
> > is
> > not intended to be fair against other applications, it is intended to
> > provide
> > as accurate measurement as possible, potentially pushing other applications
> > out of the way.
> > 
> > [RG] The sender rate adaption mechanism operates by congestion feedback, as
> > do
> > many standard transport protocols. The purpose of the algorithm is not to
> > determine, whether a queue or a policer burst size "is sufficiently filled
> > to
> > achieve high utility", the purpose is to accurately determine the access
> > speed
> > which can be reached without queue-build up and/or packet loss. After
> > feedback
> > indicating a sender rate which has caused congestion has been received, the
> > sender rate is adapted until the maximum access speed not causing congestion
> > is determined. To decide on a sender rate fulfilling this this criterium, a
> > sender rate causing a congestion which can be accurately identified as
> > congestion by a measurement system is required. If you are aware of a method
> > reaching this goal without causing limited congestion, please share.
> 
> Okay, I might be slightly conflating two things. So the indication that the
> path
> bottleneck is filled to capacity is the fact that there are some queue
> buildup.
> Loss and queue build up are the two signals that the algorithm has defined to
> indicate load and congestion, as it isn't defining a ECN response. However, I
> would argue on a number of link technologhies you will not find maximum
> capacity
> unless you attempt to transmit enough data and actually build up some queue in
> the relevant buffer. That is definitely true for a number of radio
> technologies.
> The underlying reason can be both efficiency in inter user scheduling as well
> as
> deal with short term radio fading effects. So capacity and high utility are
> necessarly linked to me.
> 
> 
> > 
> > [RG] I don't understand whether your feedback is focused on improvements of
> > parametrization or on the basic behaviour of the algorithm. The algorithm is
> > not designed to be unfair.
> 
> I am not after improvements of the algorithms I after accruate representation
> of
> the algorithm and intended usage. From my perspective this algorithm does not
> need to be either self-fair or fair against any other congestion control
> algorithms. And I am fine with that as long as it is clear on the box what it
> does. Have anyone run any tests of how this beahves when competing with other
> congestion controls, like CUBIC, BBR(1/2), LEDBAT etc? I am not asking for it
> but it if it has been run it would be enlightening.
> 
> Cheers
> 
> Magnus