Re: [bmwg] BMWG interim meeting?

Giuseppe Fioccola <giuseppe.fioccola@huawei.com> Tue, 06 February 2024 11:51 UTC

Return-Path: <giuseppe.fioccola@huawei.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 98F6CC18DB80 for <bmwg@ietfa.amsl.com>; Tue, 6 Feb 2024 03:51:46 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.905
X-Spam-Level:
X-Spam-Status: No, score=-6.905 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H5=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qfm6C5Ua6CBd for <bmwg@ietfa.amsl.com>; Tue, 6 Feb 2024 03:51:42 -0800 (PST)
Received: from frasgout.his.huawei.com (frasgout.his.huawei.com [185.176.79.56]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id C45B7C151095 for <bmwg@ietf.org>; Tue, 6 Feb 2024 03:51:41 -0800 (PST)
Received: from mail.maildlp.com (unknown [172.18.186.231]) by frasgout.his.huawei.com (SkyGuard) with ESMTP id 4TThMp48S4z67HRc; Tue, 6 Feb 2024 19:48:22 +0800 (CST)
Received: from frapeml500007.china.huawei.com (unknown [7.182.85.172]) by mail.maildlp.com (Postfix) with ESMTPS id B54C9140DAF; Tue, 6 Feb 2024 19:51:37 +0800 (CST)
Received: from frapeml500006.china.huawei.com (7.182.85.219) by frapeml500007.china.huawei.com (7.182.85.172) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35; Tue, 6 Feb 2024 12:51:37 +0100
Received: from frapeml500006.china.huawei.com ([7.182.85.219]) by frapeml500006.china.huawei.com ([7.182.85.219]) with mapi id 15.01.2507.035; Tue, 6 Feb 2024 12:51:37 +0100
From: Giuseppe Fioccola <giuseppe.fioccola@huawei.com>
To: "Maciek Konstantynowicz (mkonstan)" <mkonstan=40cisco.com@dmarc.ietf.org>
CC: "Maciek Konstantynowicz (mkonstan)" <mkonstan@cisco.com>, Sarah Banks <sbanks@encrypted.net>, "bmwg@ietf.org" <bmwg@ietf.org>, "Vratko Polák -X (vrpolak - PANTHEON TECH SRO at Cisco)" <vrpolak@cisco.com>
Thread-Topic: BMWG interim meeting?
Thread-Index: AQHaSfr52CzvBCkCc0a8xLPwFc8+MbDnMJPggBSLVQCAAZLsQA==
Date: Tue, 06 Feb 2024 11:51:37 +0000
Message-ID: <6ca8d0e1e670467fb08f0e323ba7040f@huawei.com>
References: <263DEE60-8E14-47A8-9CCB-E4133CAEEEEA@cisco.com> <8c9440d7cd424ffca67aca4d43d5e6cb@huawei.com> <561C75BB-B9AE-4760-A944-6F37976162E1@cisco.com> <10C70B04-A3C2-4D75-9695-3257FAA63C81@cisco.com> <2f09753770a445bcb01538c290b09ee4@huawei.com> <8ED38833-CF08-4AA4-8EA6-859BC315056C@cisco.com>
In-Reply-To: <8ED38833-CF08-4AA4-8EA6-859BC315056C@cisco.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [10.81.205.129]
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/XjMeCHlRfK4ihtXTzzzEQW56-eI>
Subject: Re: [bmwg] BMWG interim meeting?
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 06 Feb 2024 11:51:46 -0000

Hi Maciek, Vratko,
Yes, I think you can present the results on the mlrsearch applied topic in addition to the update to draft-ietf-bmwg-mlrsearch.
We will include this presentation slot when Sarah and I prepare the agenda.

Regards,

Giuseppe


-----Original Message-----
From: Maciek Konstantynowicz (mkonstan) <mkonstan=40cisco.com@dmarc.ietf.org> 
Sent: Monday, February 5, 2024 1:39 PM
To: Giuseppe Fioccola <giuseppe.fioccola@huawei.com>
Cc: Maciek Konstantynowicz (mkonstan) <mkonstan@cisco.com>; Giuseppe Fioccola <giuseppe.fioccola@huawei.com>; Sarah Banks <sbanks@encrypted.net>; bmwg@ietf.org; Vratko Polák -X (vrpolak - PANTHEON TECH SRO at Cisco) <vrpolak@cisco.com>
Subject: Re: BMWG interim meeting?

+Vratko

Hi Giuseppe,

Thank you for your note.
Agree that it probably does not make sense to organise the interim BMWG meeting for the mlrsearch applied topic, with IETF119 just round the corner.
We will be attending Brisbane remotely, so hackathon won’t work I don’t think, not for an interactive session that we would like to aim for.

Could we instead ask for a slot in the BMWG agenda to present the results?
This would be in addition to update on the mlrsearch draft.

And thanks for the update re SR drafts, makes sense.

Regards,
-Maciek

> On 23 Jan 2024, at 12:14, Giuseppe Fioccola <giuseppe.fioccola=40huawei.com@dmarc.ietf.org> wrote:
> 
> Hi Maciek, All,
> To organize the interim meeting, I think that Sarah and I, as chairs, should start a poll to check everyone’s interest, time zone and availability over the next weeks. We may try to arrange it in February but it could be too close in time to our March meeting in Brisbane.
> An alternative option can be to propose a dedicated BMWG Hackathon project on mlrsearch at IETF 119 (https://www.ietf.org/how/runningcode/hackathons/119-hackathon/). I think the topic fits quite well with the IETF Hackathon as it involves implementations and tests. Then you can report the results during the BMWG session as well.
> Regarding the SR-related drafts, as coauthor of those documents, I can say that we are already working to merge the SR-MPLS and SRv6 drafts in order to address the comments received in Prague. The resulting document will be submitted for the IETF 119.
> 
> Regards,
> 
> Giuseppe
> 
> 
> -----Original Message-----
> From: bmwg <bmwg-bounces@ietf.org> On Behalf Of Maciek Konstantynowicz 
> (mkonstan)
> Sent: Thursday, January 18, 2024 11:41 AM
> To: Giuseppe Fioccola <giuseppe.fioccola=40huawei.com@dmarc.ietf.org>; 
> Sarah Banks <sbanks@encrypted.net>
> Cc: bmwg@ietf.org
> Subject: [bmwg] BMWG interim meeting?
> 
> Hi Sarah, Giuseppe,
> 
> We would like to propose an interim (remote) BMWG meeting, following IETF118 Prague BMWG meeting and an impromptu small BOF while there (see email below).
> 
> Topics for interim meeting already captured in BMWG IETF118 notes [1]:
> 
> 1. Applying mlrsearch in practice in the LFN FD.io project for 
> continuous networking software benchmarking
> 
>   - walk-through NDR and PDR test results using mlrsearch as specified in mlrsearch draft.
>   - tested software workloads: VPP, DPDK and TRex.
>   - test environments:
> 
>     - LFN FD.io physical labs with Intel Xeon, Arm Ampere Altra, Intel Atom servers.
>     - AWS EC2 instances.
> 
>   - will be using FD.io public CSIT dashboard: https://csit.fd.io/
> 
> 2. Merging the two SR-related drafts, per Sarah comments in [1].
> 
> Other topics TBD.
> 
> Thoughts?
> 
> Regards,
> Maciek and Vratko
> 
> [1] https://notes.ietf.org/notes-ietf-118-bmwg
> 
> 
> 
>> On 8 Nov 2023, at 19:21, Maciek Konstantynowicz (mkonstan) <mkonstan=40cisco.com@dmarc.ietf.org> wrote:
>> 
>> Hi Giuseppe,
>> 
>> The impromptu BOF went well, we had only few people from BMWG 
>> (Carsten, Jeffry, me), but attracted interest from wider IETF
>> community: netdef/frrouting, freebsd and St Andrews University, and 
>> some opsawg folks.
>> 
>> Co-authors of two opsawg drafts were asking questions about relevance 
>> of the SW networking benchmarking to their work focusing on 
>> sustainability and power measurements:
>> 
>>   https://datatracker.ietf.org/doc/draft-almprs-sustainability-insights/
>>   https://datatracker.ietf.org/doc/draft-opsawg-poweff/
>> 
>> We agreed to re-connect after IETF118 and see if there is a scope to 
>> connect the dots.
>> 
>> The focus was mainly on SW Networking data plane testing and 
>> benchmarking, using LFN FD.io materials per links in my original 
>> email from Mon 06-Nov.
>> 
>> In line with what we discussed in IETF-118 BMWG meeting on Mon 
>> -06-Nov in the morning,
>> 
>> I like Sarah’s suggestion to schedule an interim meeting to cover the 
>> topic properly, with more complete BMWG partiicipation, per 
>> https://notes.ietf.org/notes-ietf-118-bmwg.
>> 
>> Regards,
>> -Maciek
>> 
>>> On 7 Nov 2023, at 06:59, Giuseppe Fioccola <giuseppe.fioccola=40huawei.com@dmarc.ietf.org> wrote:
>>> 
>>> Hi Maciek,
>>> Thank you for having pointed out this BMWG discussion on the benchmarking of software networking devices and software workloads.
>>> Please feel free to share any outcome of the meeting with the BMWG mailing list.
>>> 
>>> Regards,
>>> 
>>> Giuseppe
>>> 
>>> -----Original Message-----
>>> From: Maciek Konstantynowicz (mkonstan) 
>>> <mkonstan=40cisco.com@dmarc.ietf.org>
>>> Sent: Monday, November 6, 2023 3:30 PM
>>> To: bmwg@ietf.org; 118attendees@ietf.org
>>> Cc: Giuseppe Fioccola <giuseppe.fioccola@huawei.com>; Sarah Banks 
>>> <sbanks@encrypted.net>; Vratko Polak -X (vrpolak - PANTHEON TECH SRO 
>>> at Cisco) <vrpolak@cisco.com>
>>> Subject: BMWG informal "bar" BOF after Hackdemo Happy Hour on Mon 
>>> 06-Nov
>>> 
>>> // Apologies for wide distribution
>>> // If you are not interested in network benchmarking in general or 
>>> // Software networking benchmarking in particular // you may want to 
>>> ignore the rest of this message
>>> 
>>> Hi,
>>> 
>>> We would like to propose an informal BMWG “bar” BOF session for those interested in (continuous) benchmarking of software networking “devices” and SW workloads.
>>> 
>>> Open to all IETFers and BMWG participants and contributors.
>>> 
>>> TOPICS
>>> 
>>> Covering network data plane benchmarking results, with focus on Software networking: DPDK and VPP (FD.io <http://fd.io/>).
>>> 
>>> We will be using ope-source materials from Linux Foundation Networking Developer & Testing Forum:
>>> 
>>> - FD.io CSIT dashboard: https://csit.fd.io/
>>> 
>>> - LF Networking Developer & Testing Forum - FD.io CSIT Performance Dashboard - June 2023 talk: 
>>> -
>>> https://wiki.lfnetworking.org/display/LN/2023-06+-+FD.io%3A+CSIT+Per
>>> f
>>> ormance+Dashboard
>>> - https://youtu.be/LnbFNKhb99M?si=IMZ0NDz7zp0xgDAP
>>> 
>>> - Depending on interest, also covering testing results for currently active BMWG WG mlrsearch draft:
>>> - draft: https://datatracker.ietf.org/doc/draft-ietf-bmwg-mlrsearch/
>>> - updated slides from this morning BMWG meeting: 
>>> - https://datatracker.ietf.org/meeting/118/session/bmwg/
>>> -
>>> https://datatracker.ietf.org/meeting/118/materials/slides-118-bmwg-2
>>> -
>>> multiple-loss-ratio-search-and-yang-model-01
>>> 
>>> MEETING LOGISTICS
>>> 
>>> - Proposed meeting point:
>>> 
>>> - Location: Hackdemo Happy Hour in Ballroom Foyer.
>>> - Time: Start gathering from 19:00 / 7pm CET/local time.
>>> - Depending on turnout move to a different location around 19:30 / 7:30pm or earlier if out of space at Foyer.
>>> - Unfortunately we did not manage to secure a side meeting room, but will check again later today.
>>> 
>>> Any questions, let me know by unicast reply.
>>> 
>>> Thank you, and hopefully see you there.
>>> 
>>> Regards,
>>> -Maciek
>> 
>> _______________________________________________
>> bmwg mailing list
>> bmwg@ietf.org
>> https://www.ietf.org/mailman/listinfo/bmwg
> 
> _______________________________________________
> bmwg mailing list
> bmwg@ietf.org
> https://www.ietf.org/mailman/listinfo/bmwg