IETF Logo Mail Archive

Re: [ippm] [Rpm] Preliminary measurement comparison of "Working Latency" metrics

"MORTON JR., AL" <acmorton@att.com> Mon, 31 October 2022 22:09 UTC

Return-Path: <acmorton@att.com>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A15C7C14CF03 for <ippm@ietfa.amsl.com>; Mon, 31 Oct 2022 15:09:15 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.908
X-Spam-Level:
X-Spam-Status: No, score=-6.908 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=att.onmicrosoft.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0zvkLveVpqhH for <ippm@ietfa.amsl.com>; Mon, 31 Oct 2022 15:09:11 -0700 (PDT)
Received: from mx0a-00191d01.pphosted.com (mx0a-00191d01.pphosted.com [67.231.149.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 71399C14F73B for <ippm@ietf.org>; Mon, 31 Oct 2022 15:09:11 -0700 (PDT)
Received: from pps.filterd (m0288872.ppops.net [127.0.0.1]) by m0288872.ppops.net-00191d01. (8.17.1.5/8.17.1.5) with ESMTP id 29VLBis1022147; Mon, 31 Oct 2022 18:09:10 -0400
Received: from alpi155.enaf.aldc.att.com (sbcsmtp7.sbc.com [144.160.229.24]) by m0288872.ppops.net-00191d01. (PPS) with ESMTPS id 3kjkfj6kv0-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 31 Oct 2022 18:09:09 -0400
Received: from enaf.aldc.att.com (localhost [127.0.0.1]) by alpi155.enaf.aldc.att.com (8.14.5/8.14.5) with ESMTP id 29VM98TQ030182; Mon, 31 Oct 2022 18:09:08 -0400
Received: from zlp27128.vci.att.com (zlp27128.vci.att.com [135.66.87.50]) by alpi155.enaf.aldc.att.com (8.14.5/8.14.5) with ESMTP id 29VM91CI030108 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 31 Oct 2022 18:09:02 -0400
Received: from zlp27128.vci.att.com (zlp27128.vci.att.com [127.0.0.1]) by zlp27128.vci.att.com (Service) with ESMTP id C0B914016CE9; Mon, 31 Oct 2022 22:09:01 +0000 (GMT)
Received: from MISOUT7MSGEX2CB.ITServices.sbc.com (unknown [135.66.184.206]) by zlp27128.vci.att.com (Service) with ESMTP id 8F59040006A2; Mon, 31 Oct 2022 22:09:01 +0000 (GMT)
Received: from MISOUT7MSGEX2CE.ITServices.sbc.com (135.66.184.201) by MISOUT7MSGEX2CB.ITServices.sbc.com (135.66.184.206) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.12; Mon, 31 Oct 2022 18:09:01 -0400
Received: from MISOUT7MSGETA01.tmg.ad.att.com (144.160.12.221) by MISOUT7MSGEX2CE.ITServices.sbc.com (135.66.184.201) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.12 via Frontend Transport; Mon, 31 Oct 2022 18:09:01 -0400
Received: from NAM12-MW2-obe.outbound.protection.outlook.com (104.47.66.48) by edgeso.exch.att.com (144.160.12.221) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.12; Mon, 31 Oct 2022 18:09:00 -0400
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Tx/6RZoAscmrJsa7LKcz5tseSVwxal4i99X4FPN2l2rUg4cgJXY9/VUWTHPgu7c4MIPbHG5zys6QaPiteOwZxXTTJ3gcp2nHcjoZYo7nVXf/8WwLgCBtJKcZscl8SaOUr/fnWwYpO3zhylqWs12E254L0Qykr0/uvrkiGMAIkWukQvQI/e8v0cz1UGHqg7ei9ky9k5hfvB0IljznkmkdWe6tXS64goddchg0LJjRl9yCH5yeLjxytBKaIz5mcRXicW9RZ6CwSwt5lbyuXEoZcugNOs3Dm5RZwkICW4ZX/Nje4wwixgWO4wriTyvuOpxfyg0HF6f0HUO5+kmR90vtUA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=mQ/dTBndz5EBqQ5vR56NShb1Z/sd2AUsP0MfJ3jUfgo=; b=m8W3EV8Q73/z6tn33G3nMTSVnunSj7/Xz+Ke64XpHH6EG5iOAEC7uKY+AFMWB7WtmPIOZYvPGz3iTJ80TxJuz+mctKDDpcKU6DHrZOguz4JGFVx+rhsyfUy1/Cu9J8mUG4OgSJtGj+pNaC2/CuOs5C/OSiY0B1HkAsW9Uoy7SlG0I7ksxk9SYlj1GHkyq0V3E0N0srDhrcsA/3z0H2LBK8c7YmtPRweqGuLzj4TEIPufeV9XIzyp6pJji84xf5G4bMqJg0Ku6WSKuEmU2a4bLVi+xzzZgOy6yuSgBqN5BkrCpxFHNZvyPEVrJS6rqLVYPZ87vP5Slh9HjDI3hbI3qQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=att.com; dmarc=pass action=none header.from=att.com; dkim=pass header.d=att.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=att.onmicrosoft.com; s=selector2-att-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=mQ/dTBndz5EBqQ5vR56NShb1Z/sd2AUsP0MfJ3jUfgo=; b=Gm+7iKlVDta25vCHqlYLi9wdTTRRiRD6EVXAfId+lohBv0yDs5HbknjBrQwhD3bACDyiVhVZ/Xk4AOe6jGHHDS3CgY81cfmpxHtN2KF/uUwk7k0QUHlafjXank3wTm+GyM5ARw9lf3czjLm2/3w0Q7O/hsbbmT85lhxUIbLwIMg=
Received: from CH0PR02MB7980.namprd02.prod.outlook.com (2603:10b6:610:105::17) by DM6PR02MB6921.namprd02.prod.outlook.com (2603:10b6:5:258::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5746.28; Mon, 31 Oct 2022 22:08:59 +0000
Received: from CH0PR02MB7980.namprd02.prod.outlook.com ([fe80::2732:4452:c534:dc0a]) by CH0PR02MB7980.namprd02.prod.outlook.com ([fe80::2732:4452:c534:dc0a%4]) with mapi id 15.20.5769.021; Mon, 31 Oct 2022 22:08:59 +0000
From: "MORTON JR., AL" <acmorton@att.com>
To: rjmcmahon <rjmcmahon@rjmcmahon.com>, Dave Taht <dave.taht@gmail.com>
CC: Rpm <rpm@lists.bufferbloat.net>, "ippm@ietf.org" <ippm@ietf.org>
Thread-Topic: [Rpm] [ippm] Preliminary measurement comparison of "Working Latency" metrics
Thread-Index: Adjn9RFV1510Nn0rRAK145Jj2ExYNwExbsswAB5pHFAABSpiAAAENfMAAAPc5lA=
Date: Mon, 31 Oct 2022 22:08:59 +0000
Message-ID: <CH0PR02MB798043B62D22E8C82F61138DD3379@CH0PR02MB7980.namprd02.prod.outlook.com>
References: <CH0PR02MB79808E2508E6AED66DC7657AD32E9@CH0PR02MB7980.namprd02.prod.outlook.com> <CH0PR02MB7980DFB52D45F2458782430FD3379@CH0PR02MB7980.namprd02.prod.outlook.com> <CH0PR02MB7980D3036BF700A074D902A1D3379@CH0PR02MB7980.namprd02.prod.outlook.com> <CAA93jw7Jb_77dZzr-AFjXPtwf_hBxhODyF5UzTX5a-A6+xMkWw@mail.gmail.com> <0a8cc31c7077918bf84fddf9db50db02@rjmcmahon.com>
In-Reply-To: <0a8cc31c7077918bf84fddf9db50db02@rjmcmahon.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: CH0PR02MB7980:EE_|DM6PR02MB6921:EE_
x-ms-office365-filtering-correlation-id: 955fa7f7-dd8c-402a-1834-08dabb8c82dc
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: lYznyxxK75bRk9UYT9sTcazgpCsHbzFhErYnnCcPfruXXDHTzIhgiR3Yr6nxoJ0z++G6vI/OIIwt6fufEIbEy1MPQs5pLLZaDxg5t+JbqZUbJxA5bTdOAH8r7vgFpcpQFpboBcvd9J1XaHyH6ENnBwzfjaY//54wmRtlQjdgW6I9YHnN46sIIyP0LAXdb63P467GPfmwFoo6QrNvx31vkxbXhHRp8+rwfoHo2kGqE2n17FU0AJLpP3SbU7h/ftlvNXCSkZsQz5Zs7cANl9HYam6nAED/DxJ6aF/3bJyoQDc8IjZ6seATe02jh6kPk1QPJ7J1yief5IdL8YUVX1IX9U+dWv7HYOElDnvYRr6D7Md5J6Z18m62a+bdYyeV//U1q5ikhvLF+o9WYRcvrcmjKvTjmccLzFTdo/pLUr22uxLtk+NI2q7ugDs/uS6eUZVe7EEJZpLVPfjYrOqCSx09wGEbtLQEU2nBTvvtdRND56nD5sgrcp2qWMea83FeO7n+jQrTaaxpSn97S836ladDSePOJp/gBd8uaojXwv8fNuDeZ44jhDen0VwvbC84cp7LWo6WdrtcDlHrnPLzLDq7ZhnnhclweyeUo7BpFwf2KoBQU3TKAVaHySWf5z853ENiEHut4iGdbKpULM2/K7l/GBjodx7KlZW2Trra9vbln1zcjQBaRYl9x51NOZFtsFVPu7zie+eWdB03Pyze9PEmNyigb1XpvB7zJ80LuD293nBFwsO40U0dHv4CnuzfBPf5o4CatNVzzt7rNCKvfcNcPPC83603CFibBSmIH/EQ84E=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CH0PR02MB7980.namprd02.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230022)(4636009)(346002)(396003)(39860400002)(136003)(366004)(376002)(451199015)(186003)(83380400001)(82202003)(41300700001)(52536014)(9686003)(38100700002)(38070700005)(122000001)(7696005)(82960400001)(64756008)(55016003)(5660300002)(966005)(110136005)(26005)(316002)(71200400001)(66446008)(53546011)(19627235002)(76116006)(2906002)(478600001)(66476007)(4326008)(8676002)(66556008)(86362001)(8936002)(54906003)(66946007)(6506007)(16799955002)(33656002); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: kigMPe7AUqi1LmPLJ3I5FWoPfY3/YiEGsBpy1NYc+Ctw7cQL2+nuHURxHrclau2Vs/98g+ILBJRg5fttUT9ZEXgJ9AjJzRpaxSHNZSDo1Zl703adWfQciruIxi76BZrsoQPxzBnL+FSAS9eA5R48O1LOCLTVs4CzX/JDL1m+dnTZ8qAp2gFiGdnL/FS0XQrgcCfuC426nMaJd+nmH388eADnHgskrMl0VcaxHrtNUr4qC7X/vla4IADyKRmQSC2+kKdcYeu8U83RARk5qY2UMHU7DXBRqFOE+L/Bvh2nTB6VpOuxebsH9wvw12ArQCGbP0s0f07aznW1dgv30tddFyaEAPSYRTh5kKynJvCqUmixz4RvyyijLiv1eQlI2maEQkZjNt91iGX8ntILTvPuViIZbnwVfom1WbcaVJYVxVb1Xi/VflGMXRLQwWPtfyOvWgu0TOihuh6N2E3HES0INEpuB5O5m+DLyzZyXpx0ZvW/9h4VcNw8RDMLHHfzHnatgE3YMRLgK8NACTwHgGsApCaGPor9Cg84BegZRokwmvcc6/Z9M+wuxqrozM77oCZkL+bWNOOoLfZRpZbe+0hCR0+A0TiattUEShoaSzpqdlxn63j8VQBVFeAjiG61vxJwDDHzJ9OXmrRiR9Qk8MRWt9gY3Kh2T9HiuKK283ghhr+TGN13pQbc3LAKcs0qkGXdDA0zFbdFnaSJQH1j4lQmxiKVzuG2fGR9RrapWcFlxeGq+hl5c3vz7KggeQwPKplyFkjWkkPNUfQ6AbsFzJsw7qfyi9olrktmRdWQf/YaLKgWv0V6O5IF4zt0Mw36z5l33iKMGvXirK9l/r2+LU9uRlaUUNYBi3a8vsUsj2XrKuM6ToH+jTgQ9wr8Yg7o/s8DPaeOrM0DyMX9BWWJNp9VPjrkYGv1DxWYxTBTFu3qCZ3FUX/obdZKzRkz/PHODcP1OXruuB8Kz/9nEKHpUTzwBMJRMNVBZEwNlu2FS6wGfvp7Vkr18/cmsqk2ovG1fzend6XIGQudIn77q9XN/BvdoQH197ronaz0Z2yhVaRL8wx5yT/9k8VkQNOIB6oy/Q++810P9MiAqJSrS5fvgbO1Ig2yzFgWrtoUiD1FrmgEb7CfrijxYoOIv2IiXJbIW1AeGUraJ9FvmCtuxnqDDca+pb6JNtHW6GisGOiOyKti+hj8VPs3F0zygd2EVzIA+IrdKkeUSkGk0nOAnE1UmnGBfmYIXk0cb1joHS6b6gxHfs3Ub3Sn/gImDyFjgPs3co7lanlLEoSm/FZuFeTzFaIyrk2VUGFL+CyxHtItCNcweL4FJ17Bal8xFnU4nus9bYCmAadwsoc0QBgAbUXU/jhJWp/z0Y5vsevcBOp+i3s/nJojCjgNrzN2zmIz2WYYD8kBG0UaLNJv+g8+UrQQLwZiM3dw67K2aqZbMpoE/Vu0UOMWVvKNXLsRr0O1ezRYZcdC6I6nj46fjbKpJBg5l3WxGnv0q3+09s3d4ho11mTeH/XD8/fEdtQgZiRT3O5YxJSZhCsL431GfYaEr0xxAYRgSNSMklYW1tGvEYHBNvsxEkM=
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: CH0PR02MB7980.namprd02.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 955fa7f7-dd8c-402a-1834-08dabb8c82dc
X-MS-Exchange-CrossTenant-originalarrivaltime: 31 Oct 2022 22:08:59.1155 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: e741d71c-c6b6-47b0-803c-0f3b32b07556
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: a8SyGx8LSrjjUQdd1clIkKKSiTzq603chYhX+tOeL1AX27cHDK9xlNxraBtcKgPc
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR02MB6921
X-TM-SNTS-SMTP: E3A61CAFDBED9F8A3EE3E83F46E30C60D1543EED8525A1063EB6ADFFAA1C1F6C2
X-Proofpoint-ORIG-GUID: e_nMGHDcMAYP3MNiKDjQZAO_4Zeic7ZV
X-Proofpoint-GUID: e_nMGHDcMAYP3MNiKDjQZAO_4Zeic7ZV
X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.895,Hydra:6.0.545,FMLib:17.11.122.1 definitions=2022-10-31_21,2022-10-31_01,2022-06-22_01
X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 lowpriorityscore=0 adultscore=0 phishscore=0 mlxlogscore=999 clxscore=1011 bulkscore=0 spamscore=0 malwarescore=0 impostorscore=0 priorityscore=1501 mlxscore=0 suspectscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2210170000 definitions=main-2210310136
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/F6bYGDFdyBvFHsTKZtveKXmysJI>
Subject: Re: [ippm] [Rpm] Preliminary measurement comparison of "Working Latency" metrics
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 31 Oct 2022 22:09:15 -0000

> -----Original Message-----
> From: rjmcmahon <rjmcmahon@rjmcmahon.com>
> Sent: Monday, October 31, 2022 2:53 PM
> To: Dave Taht <dave.taht@gmail.com>
> Cc: MORTON JR., AL <acmorton@att.com>; Rpm <rpm@lists.bufferbloat.net>;
> ippm@ietf.org
> Subject: Re: [Rpm] [ippm] Preliminary measurement comparison of "Working
> Latency" metrics
> 
> Would it be possible to get some iperf 2 bounceback test results too?
> 
> https://urldefense.com/v3/__https://sourceforge.net/projects/iperf2/__;!!BhdT!
> gmYpYN3pBO-aWMfjDRdVRFQ20aHQ5nDHOhEVY1y-
> MkFFyH8YmM4wf8cEtaxzvcwTMaCaJOCNRBtj0tnz9A$
> 
> Also, for the hunt algo, maybe use TCP first to get a starting point and
> then hunt? Just a thought.
> 
> Thanks,
> Bob
> >
<snip>

Thanks for your suggestion, Bob, and it's nice to meet you! 
I was only familiar with the "old" iperf2 at:
https://iperf.fr/iperf-doc.php
before your message and URL arrived (yet another segment of the elephant!).

I didn't quickly find whether your code will run on linux (ubuntu for me). I suppose I use the .tar.gz and compile locally. Let me know, I've got some other tools to check-out first.

You suggest the bounceback test option (I found it on the man page), but there are lots of options and six versions of bounceback!  Based on the results I already reported, can you suggest a specific version of bounceback and a set of options that would be a good first try?
(see the man page at https://iperf2.sourceforge.io/iperf-manpage.html )

Regarding our hunt algorithms (search for max), the new Type C algo (in release 7.5.0) locates the Max very quickly. I showed a comparison of our Type B and Type C search algorithms on a slide at the IPPM meeting in July. See Slide 10:
https://datatracker.ietf.org/meeting/114/materials/slides-114-ippm-sec-dir-review-discussion-test-protocol-for-one-way-ip-capacity-measurement-00

The measured capacity reaches 1 Gbps in about 1 second with the Type C algorithm, without choosing or testing for a starting point (our default starting point rate is ~500kbps, very low to accommodate "any" subscribed rate).

regards, and thanks again,
Al

v2.30.2 | Report a Bug | By Email | System Status