[bmwg] Re: [hackathon] Hackathon Project: ROVBench – Benchmarking Framework for Route Origin Validation
Libin Liu <liu.libin@outlook.com> Fri, 13 March 2026 15:20 UTC
Return-Path: <liu.libin@outlook.com>
X-Original-To: bmwg@mail2.ietf.org
Delivered-To: bmwg@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 2EBD3C9701DC; Fri, 13 Mar 2026 08:20:45 -0700 (PDT)
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -2.096
X-Spam-Level:
X-Spam-Status: No, score=-2.096 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=0.001, RCVD_IN_VALIDITY_CERTIFIED_BLOCKED=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=outlook.com
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id C-C1RCofRdJd; Fri, 13 Mar 2026 08:20:44 -0700 (PDT)
Received: from OS0P286CU011.outbound.protection.outlook.com (mail-japanwestazolkn19010021.outbound.protection.outlook.com [52.103.66.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-384) server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id 2B2D9C9701D5; Fri, 13 Mar 2026 08:20:44 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=bCcJ48tefdLBIAO77/nIBnZTd6XzTB9XlJeILCz7v54sHdQPkHTr46mL6FN9SkWM6Rc3d5rquPFFilRiDHAYMhw+37JNXsI9nDZQremTI65SIxFnvXYD5XbdFtfUz9LY4LCc2kkOJRX9zPkaPtEf+Cfzv4luR23Xcy5zGM6dJFqEi2B4mJjV2m9msNJMmS8aJ6Osrb4zQBWbtzPR2IRRKPcVVJglbXjPnAgLSOUXNIg2Aw+up6dZfujasGNqBUVOasC+KqwCZLaqhE995d+Q+nvddzwqZbJf5PBlTt+mgWYAT7JmIPeowYnGvHvN5yhe8qoJfiXQvJ4S0o1ZsnyUMA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=aeQFkuSFfPOd9TlM+NC3pm/UkY5qNWtW0qcvnEmFT/I=; b=qlSc283DpBLNpEi6rl9BTSaX3EG4d+iO1s2f8UIa4UOwXRHTA+n3FdOfpDcs8beNWdZjfTwHJf/Ar9CdkMTdNUSx8ckX88uZ5ce2TITlDofR8IUIuwY2Rrx72D40HBwIvdlrgiCOtQQ8cH1JGP15BUk8gzXDmwbXsJNzbaDTxsD5dtrimPV5cpZf9owyHtxo1xAUePCMu0JMbmQvHp84Zmtdwt7RKDiJPZsMWbDFK78MZ6S0/0sw/RbL7bxECaLUbc4mogeuaOXOJkk5JzTC1s+SvW9R+oEru/mZ8UnH5q/ndiInZqd9NLidEe/XEC9c1yS9JCwGPdyeL2uLMIbKHQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outlook.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=aeQFkuSFfPOd9TlM+NC3pm/UkY5qNWtW0qcvnEmFT/I=; b=NGCtgVy2zmBXQ5LZITcDJ/N7tYgLEMo5ydganEv2JRMx0NLa4CMOX4oSbkdBtXUTXaguEjd6Gvh0m+BvhltDAGrKvqCHdsuM6C4ohz+h2zwDqTelXtqHRKxPP3xyDOUR+OBFE1mpDL9B+RoAvKXRYw/zQoX8CvoIWuUAxpvylAQx4u3sdvUceP16z1SnWo5Ivab70UeZK1TGdvBB22BNaZFRfZy4EXvUQjkBEAcbxLK2fVMUbr3JrndRXqH5N85BxzrvrIOYFgIWMcuDnaRBjqSEUwKQDRANZV6w8Xiby4N+69/fg/U5XhGvMg/GsipW82SuLFPl44mwTcyn9ZDxNg==
Received: from TYYPR01MB12660.jpnprd01.prod.outlook.com (2603:1096:405:15a::12) by OSCPR01MB16066.jpnprd01.prod.outlook.com (2603:1096:604:3d3::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9700.18; Fri, 13 Mar 2026 15:20:24 +0000
Received: from TYYPR01MB12660.jpnprd01.prod.outlook.com ([fe80::5627:60f3:e0df:3967]) by TYYPR01MB12660.jpnprd01.prod.outlook.com ([fe80::5627:60f3:e0df:3967%3]) with mapi id 15.20.9700.017; Fri, 13 Mar 2026 15:20:19 +0000
From: Libin Liu <liu.libin@outlook.com>
To: Christian Giese <christian@rtbrick.com>
Thread-Topic: [hackathon] Hackathon Project: ROVBench – Benchmarking Framework for Route Origin Validation
Thread-Index: AQHcsvAQKto08x0/fUCf8qiLyCIGZrWsjsgAgAAD7Ns=
Date: Fri, 13 Mar 2026 15:20:19 +0000
Message-ID: <TYYPR01MB1266083EC440AE14B5C3756D8E245A@TYYPR01MB12660.jpnprd01.prod.outlook.com>
References: <TY4PR01MB126682517AC46D2F506ADBCBDE245A@TY4PR01MB12668.jpnprd01.prod.outlook.com> <CACrksOdvyMHDU_Uo4thFSapVKBFMrS0fDprZq=v3D-7CFVqDVQ@mail.gmail.com>
In-Reply-To: <CACrksOdvyMHDU_Uo4thFSapVKBFMrS0fDprZq=v3D-7CFVqDVQ@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels:
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: TYYPR01MB12660:EE_|OSCPR01MB16066:EE_
x-ms-office365-filtering-correlation-id: fecd8a6e-e760-42b4-feab-08de811409e3
x-microsoft-antispam: BCL:0;ARA:14566002|15080799012|15030799006|9400799043|19110799012|12050799012|41001999006|8060799015|8062599012|51005399006|25031999004|461199028|31061999003|10035399007|440099028|4302099013|3412199025|23131999003|102099032|56899033|1602099012|40105399003;
x-microsoft-antispam-message-info: mhacFi3yj2/l/TK2dM/Zv+WM9W9BPKJXqYis0ykhhQ2U5PhEpwL7qjZN5nizjj0wKKsomZq9Qi4CZfUZfDIZ+vf/kywdMN+CkwZPmOD5t5jooEswCCUxgLx38G2qlTdx0Im3e9nyNoWBlV3u56m7YkRDlueD3uW9pgUWMjCBEt5fr0Qd/j8oxCeOyQ7RzNa5Qmm6pBxWYVGIDsWbC78NP+CsAgLzxoLIn/NJtBsWLS+U0Un+fNNVkS6xOLKN0uaBrg3Z54VHt8lVw2fJume+iS9AyAdYawjS4tqDt427lEhJUD+IGT/a7zdKnQS0gxd1g2TedWVp9q7+RIo0cUiY6TKSq44VfVdf9LsiClTCjorDC9yBCduMyzT/9qsHipOQAf0da7jjqRK1V+1lXuWAX6/mhWgtxH2qqBbwWxKEnY3/Cw+Fz+lcmWpO7e8MYbcBmgKwXchSgs8ushQOIPbYzdHK9PwhrK7GrbvpdFQqe2CnA6SWxMCEIzV0G2v/k8UpRLoSVwXiPrImsY2OHwlu03eaSkW/HKyXV8xkkA96ws/D9VnTA1IIwBRzHqLWTTnBBfQYkFINbnM8br685v4CeeOSJTnP3ZcTdkaKzqTX5wGdE3BLgJlzhs28MxUVaCXpiooCFlX13Q948i5azdyiyzU82xhT6XC2BD2ftG273BeIh54R8JBHuBW1yrZluARWw6dYCuMTSIJujjYkMm34XswDa0AZjgiyvm8OwfhQfZnnQ4KGFl2xxM1NWiI9GiGq91fKQ9ZN+2mZCg9Hy5363nEEQZVI2ZLBxDQOArH4WFyiGo/2h+2jI5MJpuO6ctOIBmI50BpKL0cED13gs8KJX+GR/JpxCZqM8zH8SuLzIlT2EjDwwdAwPuPfXa0h96cHVeY2xx69NtFOo+75DNcDx1Kci4SKhmZmV2kpuErOsLfoJENuGJSIL1s4t10eBpGkJcQLwCKNeiwXxtJ/V6rL/RX95i1vKmk0lhtpT2i6DzP3TnUnyjXJYzCiWhv5vQqzzs1/QDs72TkL/1iKPvhn99gYZ5jY0/ypbdSqNG8CJbFqAi4RiRp2gT2xPo7peE2diyWJwbANaXOprjLYETuhZhiVfoda704fandqdhRNkg/uPELN1Tjgzx3VkZKEc2wXeSzShrRRoTJWRXL1Gs04MmaCwSWDQQ1922TKdxN5UG4=
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: lSovxK7Qy4lrQwFuyKyEeqTr/WRPTrW7Tiyu3plP+3k7ByKS1cc74rG+Oho6WlSO3Dr/+YDMFYgKykCXAzHruPBa3AuCunkNA8xrIHORluTwtinKWcS0yuB2PVBXCpBErjloU5r7pUdVAJ/+pnuRK9Qsq9lgevyXdkNL033Qf8hDm1Xa3ddApcLRW/YH5Hb5VrJZNyZMaU11I1QhyfPryQfZsgdNI/127wZUQk7nx9kmLt1WMe5NdCQP9vsgSctRevTSfbGNHyIxhgghrYVsKvT2y7vN/AfFihz+OoF1dtS57c4ziBxW2C8Vw5NxucMl9Ys2ch6OdHEFOSotR7JAHuzEHjhANCNXQYCKB+yjcbVWeN1ZPm307CXF8mjwa+QEQkKNwoJ1MDzRLgDw/ujSMQMzh86mWAQZBLxuF9L6PfmizsH8j1PAcdi53if/2goatgUPHS7g5ewvT2h0rquy229pDMi1zwzuKe41jLCzj54QRvXzPKXoaBNySCdhYLV7ftdJ9D5n0Cf0Qz3moLcv1H5cYTO0zMi/vpDG6XPAl9aI7YfqH0+FgSfAcCTaSxSlP7pfojcb19lQbIt0CtYgpE1bOIWvRRw77botUYtvw8OcYMcJ+MMlaQ/gir5b5CcKzryd3KTGjeRU0Rfr9Co/VQ2l7Dj4AUpqUtbH1eGwNXT4goflyql0dHmAvLBxwKmYTCgIXbHOmRn1p19bje/DCHGbnyaVCrK8obrIrEwxUtgQ7oKEQJA8HmCoLBugjQEW/uydzNZZfe6onDSPvFU8ap03SuqUdMbZeIQRFFyiP7JFN4cQ4VAdwSWDs4tEZdlqCxMj+dQbjMg6pfiGig34lxAOKzOH0Wvd/6vfJUWgtsuc6LJuUqQyg6GsQJZKlBfYGsHSkN/NU/vwSYjnUQaP4MSwGUuVh307iLYa8G7t9zvKQJn3rwForCDJE7e3ae97vd3goAxJcm+PChl8q5n27qLLM3szzJd53BWdL1rikDhj6J4OTptjzbmi9LVnjP+dbFvFWNjqplw9QzaoaeRmjjoicoIn65X7QuJmgHK2QGUz2cwW0K7xUG0g3ihLE2Qs6EQZU6rJfV1/fqkPNNWLVqJvfqu+5jr+N30pbZc/dcvurF/oRuuokko80cIy5VL58rRaEOM7/XPA+3dp4yFspAjW55NNLTnm3LVbxkqUKAGykr0F25hZvVSeNqzobg3t1Z6kCeLUp9Ee/mlwQiDZhHjD4yMW3sldTkeLSUE2QhhsWkwdvkuA84repV7NDZkLqdfUvlrZE0WPIbU6yvSS0TVf1jOC/5CrKWQ0CctTdJ3ehg5ChUZ73fbLiEmxWLY42vDn63UeWCVSxIiM1AEI/rR4vPGWuaGci9qE6OEIROc=
Content-Type: multipart/alternative; boundary="_000_TYYPR01MB1266083EC440AE14B5C3756D8E245ATYYPR01MB12660jp_"
MIME-Version: 1.0
X-OriginatorOrg: outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: TYYPR01MB12660.jpnprd01.prod.outlook.com
X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000
X-MS-Exchange-CrossTenant-Network-Message-Id: fecd8a6e-e760-42b4-feab-08de811409e3
X-MS-Exchange-CrossTenant-originalarrivaltime: 13 Mar 2026 15:20:19.8135 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa
X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000
X-MS-Exchange-Transport-CrossTenantHeadersStamped: OSCPR01MB16066
Message-ID-Hash: LSB2KLLEVSC4K2TI2EM5W65BC7VDKHYA
X-Message-ID-Hash: LSB2KLLEVSC4K2TI2EM5W65BC7VDKHYA
X-MailFrom: liu.libin@outlook.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-bmwg.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: "hackathon@ietf.org" <hackathon@ietf.org>, bmwg <bmwg@ietf.org>, "IETF IPPM WG (ippm@ietf.org)" <ippm@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [bmwg] Re: [hackathon] Hackathon Project: ROVBench – Benchmarking Framework for Route Origin Validation
List-Id: "IETF Benchmarking Methodology Working Group (BMWG)" <bmwg.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/y4IPfqHeA9_wobHfSrlvzQeGUlw>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Owner: <mailto:bmwg-owner@ietf.org>
List-Post: <mailto:bmwg@ietf.org>
List-Subscribe: <mailto:bmwg-join@ietf.org>
List-Unsubscribe: <mailto:bmwg-leave@ietf.org>
Hi Christian, Thank you for sharing this and for the detailed introduction. BNG Blaster looks very relevant for this work, especially for measuring the time between BGP updates and forwarding behavior. It would be great to explore how it could be integrated into the ROV benchmarking setup. I will be onsite tomorrow at the hackathon and look forward to discussing this further and collaborating. Best, Libin ________________________________ From: Christian Giese <christian@rtbrick.com> Sent: Friday, March 13, 2026 11:01 PM To: Libin Liu <liu.libin@outlook.com> Cc: hackathon@ietf.org <hackathon@ietf.org>; bmwg <bmwg@ietf.org>; IETF IPPM WG (ippm@ietf.org) <ippm@ietf.org> Subject: Re: [hackathon] Hackathon Project: ROVBench – Benchmarking Framework for Route Origin Validation Hi Libin, This is a great initiative! I've developed a similar benchmark to measure the time between receiving a BGP update and the corresponding forwarding entry becoming active. The open-source (BSD licensed) tool BNG Blaster is used for this test. Although the name is misleading (it began as a BNG tester but has grown into a complete router tester), it could be ideal for this specific purpose. The test operates by sending pre-built BGP updates and generating traffic streams for each prefix (e.g. one million streams or more) to verify successful forwarding. Running this test initially without any policies establishes a baseline, which allows you to observe how the test results change as different configurations are applied. Happy to contribute during tomorrow's hackathon! BNG Blaster: https://rtbrick.github.io/bngblaster/index.html Benchmark Test: https://github.com/rtbrick/BGP-CP-DP-Testing There is also a video from a live demo of thie benchmark, but unfortunately in german. https://youtu.be/ttbjXxCpKvE?si=6hayD7VWcduKBN-t&t=53 Regards Christian Giese On Fri, Mar 13, 2026 at 10:06 PM Libin Liu <liu.libin@outlook.com<mailto:liu.libin@outlook.com>> wrote: Dear All, We would like to introduce a Hackathon project (ROVBench) related to benchmarking Route Origin Validation (ROV) and invite interested participants to join. ROV is increasingly deployed to improve BGP routing security. As deployment grows, it becomes important to evaluate how routers process RPKI validation data and how ROV affects routing behavior and control-plane performance. In BMWG, ongoing work is defining a benchmarking methodology for routers that implement ROV, including evaluation of VRP update processing, BGP-RPKI interactions, control-plane resource usage, and scalability. The ROVBench hackathon project aims to explore how such benchmarking procedures can be implemented in practice by building a small prototype benchmarking environment. We welcome participation from anyone interested in ROV deployment, router benchmarking, or BGP control-plane behavior. More information about the project can be found here: https://wiki.ietf.org/en/meeting/125/hackathon#rovbench-a-benchmarking-framework-for-route-origin-validation-rov. Comments, suggestions, and collaboration are very welcome. Best, Libin _______________________________________________ hackathon mailing list -- hackathon@ietf.org<mailto:hackathon@ietf.org> To unsubscribe send an email to hackathon-leave@ietf.org<mailto:hackathon-leave@ietf.org> Unsubscribe: mailto:hackathon-request@ietf.org<mailto:hackathon-request@ietf.org>?subject=unsubscribe NOTICE TO RECIPIENT This e-mail message and any attachments are confidential and may be privileged. If you received this e-mail in error, any review, use, dissemination, distribution, or copying of this e-mail is strictly prohibited. Please notify us immediately of the error by return e-mail and please delete this message from your system. For more information about Rtbrick, please visit us at www.rtbrick.com<http://www.rtbrick.com>
- [bmwg] Hackathon Project: ROVBench – Benchmarking… Libin Liu
- [bmwg] Re: [hackathon] Hackathon Project: ROVBenc… Christian Giese
- [bmwg] Re: [hackathon] Hackathon Project: ROVBenc… Libin Liu
- [bmwg] Re: [hackathon] Hackathon Project: ROVBenc… Libin Liu
- [bmwg] Re: [hackathon] Hackathon Project: ROVBenc… Christian Giese
- [bmwg] Re: [hackathon] Hackathon Project: ROVBenc… Libin Liu