[bmwg] yang model for management of network tester project presentation

Vladimir Vassilev <vladimir@lightside-instruments.com> Sat, 01 April 2023 19:32 UTC

Return-Path: <vladimir@lightside-instruments.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D6063C14F6EC; Sat, 1 Apr 2023 12:32:52 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.9
X-Spam-Level:
X-Spam-Status: No, score=-1.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=netorgft4991094.onmicrosoft.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id FVK5xtWvAsI3; Sat, 1 Apr 2023 12:32:50 -0700 (PDT)
Received: from EUR01-VE1-obe.outbound.protection.outlook.com (mail-ve1eur01on0607.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe1f::607]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 54295C14E515; Sat, 1 Apr 2023 12:32:50 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=O+8aeTW3jIqEQbqDfHg0oqaK6PB/PaDl+bY4KOS8F9UPDkZ4e2991xMv+rRJe3JhoQ9mbGAqVHyzQU5nFNbFmYCGOD340E85/d/8H3a8lDZHI9k0TGpmhaUf+XjCimIsnjWrUF646vQyoxa7nFaxPjh9I880RqVsiY0DvOqE67+WxBOMORW/S+AbCxagcBkKwHJ0Gz7ftWo+mbTGTq6h8cNsgrimOTRRvddquYUdmcOkhtnu4aHfHr+rQaO48d8jQf5RPM8PHbTdORCKbQSDASvXCmVIswOdt8ZXx5ynimw/r/iXdPTWnY1TmxFtTT8yGPi4uM/2dZkNSwFqQHePFg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=WxqVCMLd9TmkxV28Kl++pctJwvvmEDmYrR4CgBvlYIQ=; b=ltg6Fk4T+aBNiRnRIM0qT7LKtQu6y1MoW9mEo+iXthk27iFZsDLttr8b5qQ0z1nMI0HAjPm08HthiQWMYqi2WY6ZGaA5Wl4fDJ7vq7XqsfqjXwKq7NnKE4xRS1+j0K7tLU5hYYr5eGTsa4e09+wNKwCey1gQBUETIqHP/cwOpnAH3F4/UjES3MgTRKX6ZIou077jbXY4k3Lg8qTxN9bnFivL/ykVoVAfLUhF0WKiUPYGHaphdZ6qmTfWnBCNYohOOCST/DcdIoey4ZgYuxniOAtV9JQ7BnqGA1MjztaJs7bEje1RPuxcqTJMgDxPm6dCWwU51/MZN6sv2790aHoRwQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=lightside-instruments.com; dmarc=pass action=none header.from=lightside-instruments.com; dkim=pass header.d=lightside-instruments.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=NETORGFT4991094.onmicrosoft.com; s=selector2-NETORGFT4991094-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=WxqVCMLd9TmkxV28Kl++pctJwvvmEDmYrR4CgBvlYIQ=; b=JE19vGcU1uYtjK3RkbCwIDTHFwOCIoX2R+11Kz7mHdXEyGPe2VbXWo04HUqaqwk1ui9nloCxOm/YYZvjF7ZKrUm6bWSBeNpcA8Q/+zXl//cIh/FoJWT+iBSdC8xOA8P8hnhho3adlzTLW5ygbUG0UPxsqnED7y1bC5ZRQu1EM6s=
Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=lightside-instruments.com;
Received: from DU0PR08MB10325.eurprd08.prod.outlook.com (2603:10a6:10:471::22) by DU0PR08MB8044.eurprd08.prod.outlook.com (2603:10a6:10:3e8::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6254.23; Sat, 1 Apr 2023 19:32:44 +0000
Received: from DU0PR08MB10325.eurprd08.prod.outlook.com ([fe80::79af:15f0:64a7:6412]) by DU0PR08MB10325.eurprd08.prod.outlook.com ([fe80::79af:15f0:64a7:6412%9]) with mapi id 15.20.6254.026; Sat, 1 Apr 2023 19:32:44 +0000
Message-ID: <ff66afc3-d8fd-7b68-cdc0-a5fd54546083@lightside-instruments.com>
Date: Sat, 01 Apr 2023 21:32:41 +0200
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.8.0
From: Vladimir Vassilev <vladimir@lightside-instruments.com>
To: "bmwg@ietf.org" <bmwg@ietf.org>
Cc: hackathon@ietf.org
Content-Language: en-US
Content-Type: text/plain; charset="UTF-8"; format="flowed"
Content-Transfer-Encoding: 7bit
X-ClientProxiedBy: GVYP280CA0008.SWEP280.PROD.OUTLOOK.COM (2603:10a6:150:fa::17) To DU0PR08MB10325.eurprd08.prod.outlook.com (2603:10a6:10:471::22)
MIME-Version: 1.0
X-MS-PublicTrafficType: Email
X-MS-TrafficTypeDiagnostic: DU0PR08MB10325:EE_|DU0PR08MB8044:EE_
X-MS-Office365-Filtering-Correlation-Id: 017d8178-d1e9-4c9d-6d4c-08db32e7dd94
X-MS-Exchange-SenderADCheck: 1
X-MS-Exchange-AntiSpam-Relay: 0
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: t9L5ou6H5D6Y9jGhOK1Q7nDkNjNSZwEta/t22kY2gw5hijZgqo2qD2zNFhlM3IL/STns8Sn1HXZbVG2+9hbYiOiSNJ8KuXJPZvROt5S24LIFdw2UA7BDQDlZxy/OpJ+trlW41ats7wcfE+VQy2fZSW1RXbgjOvIiMoik/ty9AhOQl6N2tEhOaucAZJnPqDKK/lYcb4ZFREpHDIK/Ue2y92VF6rKne5AuNm/at2ZkpLHaWACsKG2bPJPtj/tGIlVmyxj1jixuu+eRB+WF3ixaHazNKweb204iqZh8t2uDZLKkvZ68IK4bNOqbMu73awpwxY/YbWjtetT7P3hfZpl3RLqCGACMHF+B88XD/kzDIoBXY1oQJmBgMwdLvgwC1lxGH4m8H+IsvWbNsy4R8qtBFQvpd+iS8LMHXleVKO9KVDCfl+tDGVaeXG/FsOgup8AQ+vQcEDkUnm7fVahyrPvX6Gddm5b37s4JnaKRhaHNI/zuu/3l6Qdit2VtiaSZCBzrJRkKNC51DtihQg30xRHzR58M7D6SXtrRg+5Z4UgthIKHl73ByHnYyY0N42Mm2isFgA4I1PkgLz1yJ/UBnvFfu/EgIdVL/d1SHYjtWSbBpy7D8nxMBoEbISB3z+UcgYDI9HTBYOeykNNHrbYCF3+deQ==
X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DU0PR08MB10325.eurprd08.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230028)(39830400003)(366004)(136003)(376002)(346002)(396003)(451199021)(36756003)(450100002)(66946007)(6486002)(966005)(316002)(66556008)(4326008)(6916009)(8676002)(52116002)(6512007)(86362001)(478600001)(2906002)(8936002)(31696002)(2616005)(66476007)(6666004)(6506007)(38100700002)(186003)(5660300002)(41300700001)(83380400001)(31686004)(43740500002)(45980500001); DIR:OUT; SFP:1101;
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: 0CQw2DXZpzrzV975FXsQlF9eTQTjRO1KPAbZSo4cdoi6U+vb/3gFqHo2XVV0P76Cx6htzueqjVhMu9En56K0l8q397xIw21TWQ5aBPE+7VMRvMdu/3OnreWGnTsSlkcElncuIXJDs/eCUWOAnMWzKbATJd72MfVHRG1oNtNtjyeIV+aIxUGcyBW/zIGRkO4+B2vWkOhsI3tCC5mj0W4MgXYPgfKkmyWvrF/cx8rzVTTydkyHDSccmTmZOYeN9RGLpepandIlgtOYWE8DYmSFaw1pgWnZxHZG8hB1emA4Yx3FoWPFZ24JrNLkJVyOpt9tefeOvxzy9XfDj0g9Pwi7bF+PDM2dnPBhE+CPOh446FtOGheVNpABGQxuEULNNSLWMz+3WBi8kqxnY1R70KBzpu1tp1Zq+nUCWqkGYQg2I5VbDK7lReQ5nzfGCeaKQSTlGVbFQDHNOWKUrTQNH2mWvZ29YLKQ617BvGrH7DSsH7mqqDSTC7c8NYroXIHy+lFHxpSaYJM+OjbOycFDzVUdPQEK/Gec4Mx8YXbz7vfwzuAj8DT6hgzoWp6pMle7wFE6ed+vrJjjeMqrXFNBskSWr583tFZ0w8G9UaXK95CmhFy9KSA5ttgnzH7TkdnYUdgaAFY3yQo3GI831tuScSCj8nq5pd1a8JXLHe8XHi7FkAu4rg4rYggDprfrWNP8lFF5tz4qh2tt4dUBZrCAns0irOXV6EyIv+bVArYzwp99pI29ntIX8hEeYAA4R4kPycoGr2qbCYNUoBzEBvsbp/PHUksMVIHT7ZpLZ4vXU74GZUqevYypFOmiKOhBujNj6NusPrhCWtVVpx3XZfj8sU8gADz2xh9jTy2VF6pGCQ7dOGLwi4kXGvVK12mLE81C55IGoedPTE5F1M1sdLPXMdv6Y9Uk2y1XvkMLDAF2EH5keng5VMibxLWllQ+UbwtKCoW5A7CrdQMZUiZrwwZxRGOhN44KXhyW3q6if5tP/d78f/MITxK9GKzdqWJUpRbJZMWY+0mUyCsOrsOvxox3+043IjMgzxPm2cK751cnlu50qDgwI+Gns1S/qFEFp0NAeOpCZkXbXy0qc/rYT9m7gp4xieiJ9NvuJtlZ2PLJW1KsCmIhSefc7RggZFO1hwG7jUfbfQ7qZjphcU7pZt0/GMcEIuo4hRF6KsmFiu89ASNVPlvRxRConjqmyZJPbl59dw1I9c6GwkvfpSODd/ng4dZrfoBMHKQLWiGcLeoBC9w8NV5exXqyqWetskP7eRXHm8V8v7S+bO0xsj3dIFv2NgvBFuo2CHmQ0QZmdRaj8quYGMRDOfXH4BK1+bYWsvVpyiF2tXJJ5xXah/OJLpcFC3uF0KLn2AYIIHkr9QZd/0gv33kzz2TgbVd+IbrBVQ3nI4BaI5TQB/fuqC2Oh2mPlMkV4Rjwcl8pmgQ/HpwBQtxvOWMWErp/JVCG4NcUXXfuxVRvBW7ZZIxiSROz5EouX+ZIJ1vFpRgkh5VMnAeySENTzin4uIJj1YY4E0eybbbtvp8f1GpIqXKRpwDssDtWNglO+GbE+vgueK+ccAvJ1NdI0y35HgnALlk6sB/Zxie+xRFVYOQ/16vNmwq5XSGF0ZPdh5ODrpNSNKgc4sDmNdJ6b5s3VaC5MCH0ITOiXUhRVNXLxhI4w6aZdUuRWfyRrBOUjXQMwOL6VbdRJypExRZm034=
X-OriginatorOrg: lightside-instruments.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 017d8178-d1e9-4c9d-6d4c-08db32e7dd94
X-MS-Exchange-CrossTenant-AuthSource: DU0PR08MB10325.eurprd08.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 Apr 2023 19:32:44.0712 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: c0326317-f373-4461-a96f-7946e0abb603
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: arE9u7V4e6QbKuesyhvbfeQ7xRLbVVT13PHgGloIxI8ePQJO+ZPkI74zT8sN+5OS/jIFXPdmfehxzoY+qxKLdcennkaXhQRXd3jY1YfO2BqcRstT2DU5LoGw/kzqf3zT
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DU0PR08MB8044
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/GPy-jkOk_4GrnBLwyCL4twwjFX8>
Subject: [bmwg] yang model for management of network tester project presentation
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 01 Apr 2023 19:32:52 -0000

Hi Folks,

We have just submitted the IETF116 Hackathon report for the "YANG model 
for management of Network Tester" project - which we did not manage to 
present during the event.

You can find it here: 
https://github.com/IETF-Hackathon/ietf116-project-presentations/blob/main/ietf116-bmwg-yang-model-for-management-of-network-tester.pdf

In summary the results generated by the open-source Python 
implementation of a RFC2544 benchmark based on the 
draft-ietf-bmwg-network-tester-cfg-02 model was validated against a 
commercial tester for the same Device Under Test (DUT):

Commercial product vs. reference implementation results:

* Throughput 997024 (67%) vs. 1000000 (67.2%)
* Latency 6668 ns vs. 24440.4 nanoseconds (24 ns isthe actual maximum 
delay. None is wrong.)
* Frame loss 32%,25%,15%,3% vs32%,24%,15%,3%
* 1682 back-to-back frames vs. 1679
* System recovery 0.000491 sec vs. N/A

Seems to be working OK.


[1] the code for the reference-implementation benchmark: 
https://github.com/vlvassilev/rfc2544-benchmark/blob/master/rfc2544-benchmark

[2] the report generated by the reference implementation: 
https://github.com/vlvassilev/rfc2544-benchmark/blob/dut3-tl-sg105e-qos-50-percent-bandwitdh/README

[3] the report generated by the commercial tester: 
https://github.com/vlvassilev/rfc2544-benchmark/blob/dut3-tl-sg105e-qos-50-percent-bandwitdh/example/reference-results/anritsu-md1230b-log.txt


/Volodymyr