Re: [bmwg] matters arising Re: Minutes from IETF-109 Session

Vladimir Vassilev <vladimir@lightside-instruments.com> Tue, 12 January 2021 20:46 UTC

Return-Path: <vladimir@lightside-instruments.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 770EA3A11B2 for <bmwg@ietfa.amsl.com>; Tue, 12 Jan 2021 12:46:17 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.162
X-Spam-Level:
X-Spam-Status: No, score=-2.162 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, MSGID_FROM_MTA_HEADER=0.001, NICE_REPLY_A=-0.262, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=netorgft4991094.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id vOA_G6hiW1oR for <bmwg@ietfa.amsl.com>; Tue, 12 Jan 2021 12:46:15 -0800 (PST)
Received: from EUR04-VI1-obe.outbound.protection.outlook.com (mail-eopbgr80088.outbound.protection.outlook.com [40.107.8.88]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 6BF453A11B4 for <bmwg@ietf.org>; Tue, 12 Jan 2021 12:46:15 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=WdhZJe7ONQR1lujnkgFfn5ncqfVTk6Jd/oCf9kg4NfVZ3fSQ5mMB7eN9u9Rzgx2o/wD1+6B7cne9frz3CwNCw0N67devcy4jkE1XPCNB67UsIA9seUB7hVxT0h67sr3AliVVlK5/J/kEgFaw8ZrpMyatIxCl8SrKJSM/dl3R08V+wdQgLU6TLW3Cpr0sVnA+9V69Xugcb7PzoJYGupePEKiLbbDnji3qORP7+rt/4VpdBM3/fI6tHuc5NQESPJd6odc+OJOaHOQBPz3eH3l41K+eci1fRpjOFxFbZDuGj1WercOobkN8Ma8anIe9K1wVyYgxsTYaFlOqxzYGUTWi1Q==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=IK95ZPd+jV/+3+3VW/cUOSZQr5vcZSK1T607sp1B25o=; b=abkciREe8AaT7PeNJI8AtSTiiuhq344D7W0nrBVd7Kj/YItUc9faJ5aJIHyupW442HRkYv0TirVlWEl7SncRgEnkJn0ANu4UvIS81d3NEac4ygG7U+cztTlAQTLycBwN81+HouJ9nmBEWdeYxPlOt+HPdVT4X+5KT3RUwnmYFSlb9fENU4GZ5GHEKjlky0I0oKns4AhJCuCOyGGkA4o7BYi/6Tg/CjBLlltrfVCcFvJKlhnNQSgAD4ctpdC2yaIKW8dEyIpKZhjFN0UL5wi0dECTw13TN43tx0WWDDPWEwytr9rjGkBIIoZZf9sdYSgfUq/Aae6HfVQ44p8+VugH9A==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=lightside-instruments.com; dmarc=pass action=none header.from=lightside-instruments.com; dkim=pass header.d=lightside-instruments.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=NETORGFT4991094.onmicrosoft.com; s=selector2-NETORGFT4991094-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=IK95ZPd+jV/+3+3VW/cUOSZQr5vcZSK1T607sp1B25o=; b=r/sa1bSSxl67CKukCFW9IXCStV+0B/rujS6fWk8f7cCSOKxzYOecYbDgmXPcM/Qbm/h/fHCFvey31GnuhnI9/asDdjASOnq372ZjiCjSVH9GknJ9OcuP2WZXcT2UFb1elv+p6evlSJH0HiSTKG+kYGTt1yaJrAjNDOlMnE5QZRY=
Authentication-Results: ietf.org; dkim=none (message not signed) header.d=none;ietf.org; dmarc=none action=none header.from=lightside-instruments.com;
Received: from AM0PR08MB4084.eurprd08.prod.outlook.com (2603:10a6:208:129::25) by AM0PR08MB4945.eurprd08.prod.outlook.com (2603:10a6:208:157::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3742.8; Tue, 12 Jan 2021 20:46:12 +0000
Received: from AM0PR08MB4084.eurprd08.prod.outlook.com ([fe80::7c0e:f49c:1a90:1783]) by AM0PR08MB4084.eurprd08.prod.outlook.com ([fe80::7c0e:f49c:1a90:1783%6]) with mapi id 15.20.3742.012; Tue, 12 Jan 2021 20:46:12 +0000
From: Vladimir Vassilev <vladimir@lightside-instruments.com>
To: tom petch <ietfa@btconnect.com>, "bmwg@ietf.org" <bmwg@ietf.org>
References: <4D7F4AD313D3FC43A053B309F97543CF0147686323@njmtexg5.research.att.com> <AM6PR07MB578490CD05CB228FA12D3D9DA2AE0@AM6PR07MB5784.eurprd07.prod.outlook.com>
Message-ID: <68aebc4d-1176-7bd6-3b99-9f5a7d232ee9@lightside-instruments.com>
Date: Tue, 12 Jan 2021 21:46:09 +0100
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.11.0
In-Reply-To: <AM6PR07MB578490CD05CB228FA12D3D9DA2AE0@AM6PR07MB5784.eurprd07.prod.outlook.com>
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Transfer-Encoding: 8bit
Content-Language: en-US
X-Originating-IP: [84.209.6.28]
X-ClientProxiedBy: OL1P279CA0003.NORP279.PROD.OUTLOOK.COM (2603:10a6:e10:12::8) To AM0PR08MB4084.eurprd08.prod.outlook.com (2603:10a6:208:129::25)
MIME-Version: 1.0
X-MS-Exchange-MessageSentRepresentingType: 1
Received: from [192.168.0.19] (84.209.6.28) by OL1P279CA0003.NORP279.PROD.OUTLOOK.COM (2603:10a6:e10:12::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3763.9 via Frontend Transport; Tue, 12 Jan 2021 20:46:11 +0000
X-MS-PublicTrafficType: Email
X-MS-Office365-Filtering-Correlation-Id: ddbb7e2d-439d-4190-fd7a-08d8b73b1935
X-MS-TrafficTypeDiagnostic: AM0PR08MB4945:
X-Microsoft-Antispam-PRVS: <AM0PR08MB494591D0A35056963C896F0D9BAA0@AM0PR08MB4945.eurprd08.prod.outlook.com>
X-MS-Oob-TLC-OOBClassifiers: OLM:10000;
X-MS-Exchange-SenderADCheck: 1
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: Glqn+fS/HTG3iL893Abri7ndS6+7R7vSE63yha3KVeMYG8TOtzrIksHW46Vbg2TJcGXA7Mmv+TBQRmImyVnqKh68xMwLCeEDhtfw7h39P7MUK4TS/VUYYQ9loGRjakgfw/gVl4pZx6SJ4SGSoVr0Wwi47WT21d00MaO2iLdGFJTO/5tVF5MjoBCHxxB0wP3OeaFEOvVZOFvvqwbY2IJprWeP7Cnry8XVx9ESKINyWx42a2OfdjCHBPNWk+YSeqlqnRCuCo4hZUPVI235/fO4xu/Fd3MDhgBMpsLS5pD2kd1Nvn5lTsAeSrmIC8pcdnSSGe1zlMCV1oVtIwTT8BbZAohD0dYqv6gEUpopGTPQTBfpIRUioB2d0vbGWSaoAgFjQTAKG73XWEkCfoCCjX5IMZy3t6x3TepS98wcYr6L/bIuaBB0kkLcCN41/SNp6XrqGmpTsYqhz2YLZhxrsHMt8+Bm/uwvEw9vNK6x3b9s2RZFxYcFmFsWyWXJybtj/NlEzYHWRwxccBzAjX0pG7QAnFlLHNPD3ufzWw1PORJHNR+31FxylAFqRWU+tEqFuOu/
X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM0PR08MB4084.eurprd08.prod.outlook.com; PTR:; CAT:NONE; SFS:(376002)(39830400003)(136003)(396003)(346002)(366004)(186003)(16576012)(478600001)(16526019)(956004)(110136005)(8936002)(31686004)(26005)(2616005)(316002)(966005)(52116002)(6486002)(66556008)(31696002)(83380400001)(2906002)(66946007)(36756003)(8676002)(5660300002)(66476007)(86362001)(45980500001)(43740500002); DIR:OUT; SFP:1101;
X-MS-Exchange-AntiSpam-MessageData: w493aZlwsleDSdCJ0QbRA18MYIvGmrAN1p1JUQvUsmVpGo780THlLDvD1ky6gzU57L3zcg6PLoptRV1T5OEHzuRuLuWSVq/WiiWwUoyDDIsBaWaJMZOHwC+g0Ttg+1sAge8gOfJ47poVrvkv8qwWLSpp89fVXI5WZBVETe7vYZEqJY1QAmTWlSHcW+e4hFNy8qlw5KLhb37lAByHL6KkvkcXsGCZlyNt9usWl7+LORrlj7viQGdQD9R4vlV8pchfecZJmxIxgFpQ35xCRo8hGGA6IiWQUpxls5rTxJE6BArPBdhTUeEdO7qIgf2E4QaqPkx+hVC/9DKvBfcnRq7HBi2NksVQ973gYlVSoBSU5RvfifM20Wk5Evy4+2QHktdxLkSnc1LBphVO5Ca+LnxdoEnLhE7kgaWA3nrJCStZeNhW0OoKiJZrQzkMBArO9O8I0eR3FDW4MjNdUOP5vzDHf1pA0RHRY/QhQaiGgRsaGfy0yHw4P+ccZbUXJ4W68sHW20Z0F130YkRqPzUjvU2ZnkwUCUTOqXSz8JQFKJO6aXU+5ypUuILImQK0BnkrsFbg37q44WeOJyhd1aCyPff/0Wunpr9nswqUiKbd+NBWDJnfCsBEG1AcGcUpruPCMYdU102vE2MMdL6tHYLqpnO8PHqhfsXparv/8eTH9pDFYd7VNx2yNYrqhAu48xwZwjAYNCiKJzrhUDB4/00dVv2NNfK4bUhHR8/PvJcDBgygWk+RzhqQOfZH64aBD2Dp8I/dP80UBTL+iakv/xOPxSr0FuGRfJIn2pSOIZE98tudyXPR/EuVwuJiiAnNtRespUatWTp98rCto4xPCtEMCiEu5p2zqDK6rdK9Ifv0Jl9/cFXP2jCKL860GDIDiP65e7oetKeIsVxNceD5rnp+nLgKWb2ZVtz2lxi3/k43NhUuxGvIlBcibcepXwjx8mbGzvmIC9TVWD/XFEMLvPceGuj5pacA16a8CwUOyJl4dr6kA8Q=
X-OriginatorOrg: lightside-instruments.com
X-MS-Exchange-CrossTenant-AuthSource: AM0PR08MB4084.eurprd08.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 12 Jan 2021 20:46:12.1240 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: c0326317-f373-4461-a96f-7946e0abb603
X-MS-Exchange-CrossTenant-Network-Message-Id: ddbb7e2d-439d-4190-fd7a-08d8b73b1935
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: WrtNuV2VFg3QSx0j7Xob4grqEfkeWj/JipKW92f56Dxwsw4CYPW59Pv3XHLntuICzzU7mCzBLS55ltYMzUYadciP8a8jicFYGsyn8cK/Hdks4xWxSNlG/JNsDYGrjm72
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR08MB4945
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/ZmJxQl_h7H-5z-YugIjoBS5alHg>
Subject: Re: [bmwg] matters arising Re: Minutes from IETF-109 Session
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 12 Jan 2021 20:46:18 -0000

Hi Tom,

Thanks for keeping an eye on the draft.

On 08/01/2021 11.21, tom petch wrote:
> <tp>
>
> '  Proposals:
>
>      A YANG Data Model for Network Interconnect Tester Management
>      https://tools.ietf.org/html/draft-vassilev-bmwg-network-interconnect-tester-04
>      status:
>          Draft updated Sept 9, added mechanism for real time synchronization of traffic generation
>          open-source/hardware implementation of generator/analyzer at the hackathon.
>
> No one raised hand that they have read above draft. '
>
> That is because the word 'yang' does not appear in the title!


What do you mean? The title is "A YANG Data Model for Network 
Interconnect Tester Management".


>   No matter,
>
> NMDA support or lack thereof needs a mention in the Introduction


There are a few counters defined under 
/if:interfaces-state/interface/statistics (which make the draft 
dependent on a deprecated container as of RFC8343). My intention is to 
remove them in the next version and copy the RFC8407 "NMDA support" 
boilerplate text.


> There are about twenty Normative References missing such as
>
> IEEE 802-2014
> IEEE 802.1Q
> IEEE 802.1p
> RFC6991
> RFC8343
> RFC7224


OK. These 6 references will be added to the next version.


> while all features should have a YANG Reference clause according to a recent YANG doctor review - I agree!


OK but what would be the reference for the "multi-stream" feature for 
example or the rest of the features specified in the draft that do not 
need external reference?


> Why is data type 'string'?  Why not binary or hex-string?

Both 'binary' and 'hex-string' are alternatives that can work. With 
binary one looses the human readable representation on the wire and the 
ability to edit the configuration without specialized tools for a 1/3 
compression gain. While hex-string adds 1/3 extra data in form of 
columns separating each byte "01:02:03" which works fine for MAC 
addresses but is standing a bit in the way for longer strings - frame 
header specification etc.

can make this change once at a more mature point so I do not need to 
change all the tools (here an example of a tool generating an RFC2544 
testframe that can be directly reused with the configuration of the 
generator):

  ./traffic-generator-make-testframe --frame-size=64 
--dst-mac-address="12:34:56:78:9A:BC" 
--src-mac-address="DE:F0:12:34:56:78" --src-ipv4-address="192.0.2.1" 
--ipv4-ttl=10 --src-ipv4-udp-port=49184 --dst-ipv4-address="192.0.2.2" 
--dst-ipv4-udp-port=7
  123456789ABCDEF01234567808004500002E000000000A112CBCC0000201C0000202C0200007001A0000000102030405060708090A0B0C0D0E0F10119CD50E0F


> I note that 'burst-data' is couched in terms of octets


Correct. The interframe-,interburst- and interstream- gaps are expressed 
in octets.


> YANG 'augment' are usually constrained by 'when' clause. Here every YANG interface on the box will be augmented.


IMO this is the case when the augment only applies to a certain set of 
interface types. However in the case of a generator/analyzer modules 
that aim to be universal and applicable for all interfaces that send and 
receive packets I do not see how we can do this.


> YANG prefix must be unique across the entire spectrum of IETF work and ideally beyond that as well.  I find 'ta' and 'tg' too brief and think that they should have another two or three characters. 't(raffic)' embraces a lot of concepts!


While I am OK with changing the prefixes to a different/longer strings I 
think we can do it later in the process. For me the cost will be going 
through some working code in order to modify these particular bits. 
Formally there is no requirement in RFC8407 for avoiding too short prefixes.


> 'The proposed model splits the design into 3 modules - 1) Traffic
>     Generator module (TG), 2) Traffic Analyzer module (TA).  '
> That would be one and two and ???


I will fix that.


> MAC-address implies, well MAC address only; seems a bit limiting or worth a mention in the Abstract/Introduction


I am lost here. Do you refer to the ethernet feature which enables 
specification of parameters like src-mac-address, dst-mac-address 
vlan-id etc.?


> 'statistics' would be better IMHO in a container of their own for this application rather than alongside every other interface statistic.


The original argument for placing some of the statistic counter 
definitions ( e.g. tg:generated-pkts, tg:generated-octets) in the same 
container as the rest of the generic interface counters 
{if:out-unicast-pkts, if:out-broadcast-pkts, if:out-multicast-pkts} was 
the strict synchronization requirements for the counters of such 
instruments and  some anticipated complications associated with the 
synchronization of separate containers.

I would like to keep this point open for discussion for now.


> vlan id has been defined by IEEE and it is different!

Correct. This is not a precedent for IETF (yang:mac-address is also 
different). That said I am considering removing the VLAN fields from the 
traffic-generator module all together. I find myself using the raw 
frame-data leaf for specifying advanced testframe headers (that includes 
VLAN tagged frames, alternative ipv4(udp) and ipv6(udp) header options).


>       when "ta:type = 'ta:ethernet'";
> is fragile - derived from or self is a more robust concepthea


OK. I can't see any disadvantage in that.


> Security Considerations must conform to YANG GuidelinOK.


OK. I will add the RFC8407 boilerplate text and a few lines informing 
the reader that a stateless traffic generator is controlled with the 
model and the potential risks when used outside of test environments.


> her
>
> What language is used for Appendix A.1?

This should be considered pseudo code but is actually python which uses 
command line syntax (based on the YANG modules) that expands to NETCONF 
protocol PDUs to orchestrate the test network in the example. The 
intention is to demonstrate how the generator can be programmed along 
with the DUTs.


/Vladimir


>
> Tom Petch