[Rtg-open-source] OpenBMP

"Serpil Bayraktar (serpil)" <serpil@cisco.com> Wed, 16 November 2016 20:50 UTC

Return-Path: <serpil@cisco.com>
X-Original-To: rtg-open-source@ietfa.amsl.com
Delivered-To: rtg-open-source@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5AB8F129864 for <rtg-open-source@ietfa.amsl.com>; Wed, 16 Nov 2016 12:50:43 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -16.017
X-Spam-Level:
X-Spam-Status: No, score=-16.017 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-1.497, SPF_PASS=-0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id GIQF0TFO4iXS for <rtg-open-source@ietfa.amsl.com>; Wed, 16 Nov 2016 12:50:41 -0800 (PST)
Received: from alln-iport-5.cisco.com (alln-iport-5.cisco.com [173.37.142.92]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A5F511295E0 for <rtg-open-source@ietf.org>; Wed, 16 Nov 2016 12:50:41 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=16440; q=dns/txt; s=iport; t=1479329441; x=1480539041; h=from:to:subject:date:message-id:mime-version; bh=/+jubPTbOyHBMMgrgZd+XX8lY0B82/dW/+ikK3vQK74=; b=G9BoouGNEQon5JFRavNzp75n1jFKpO3DdXzguh5Vy7V3vmF/tlFDlxH0 NupKCP8wcjq1aExzvJZiKcPkEbJCLuhMThb9BHTg1SD3hmppjsQ1LU9hK q0sYpR6u2TPXRS6agwr2lOgqG/6scJoY7z7Kj+7ZRlzphVbeMaGJ/+ksO I=;
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: =?us-ascii?q?A0DpAQAsxixY/4MNJK1eGwEBAQMBAQEJA?= =?us-ascii?q?QEBgnNEAQEBAQEfWIEAB403plUrhHCCByiGFYF4PxQBAgEBAQEBAQFiHQuEbyN?= =?us-ascii?q?oASwbAwIEMBQTBBOIbA6iaI98gikvizUBAQEBAQEBAwEBAQEBAQEBAQEBHIg5i?= =?us-ascii?q?XI4LYIwBZpCAYY9iiqBcE+EJ4k9h0KKFAEeN0ZBhTlyhxqBDAEBAQ?=
X-IronPort-AV: E=Sophos;i="5.31,649,1473120000"; d="scan'208,217";a="347464590"
Received: from alln-core-1.cisco.com ([173.36.13.131]) by alln-iport-5.cisco.com with ESMTP/TLS/DHE-RSA-AES256-SHA; 16 Nov 2016 20:50:40 +0000
Received: from XCH-ALN-012.cisco.com (xch-aln-012.cisco.com [173.36.7.22]) by alln-core-1.cisco.com (8.14.5/8.14.5) with ESMTP id uAGKoerj028422 (version=TLSv1/SSLv3 cipher=AES256-SHA bits=256 verify=FAIL) for <rtg-open-source@ietf.org>; Wed, 16 Nov 2016 20:50:40 GMT
Received: from xch-aln-014.cisco.com (173.36.7.24) by XCH-ALN-012.cisco.com (173.36.7.22) with Microsoft SMTP Server (TLS) id 15.0.1210.3; Wed, 16 Nov 2016 14:50:39 -0600
Received: from xch-aln-014.cisco.com ([173.36.7.24]) by XCH-ALN-014.cisco.com ([173.36.7.24]) with mapi id 15.00.1210.000; Wed, 16 Nov 2016 14:50:40 -0600
From: "Serpil Bayraktar (serpil)" <serpil@cisco.com>
To: "rtg-open-source@ietf.org" <rtg-open-source@ietf.org>
Thread-Topic: OpenBMP
Thread-Index: AQHSQEsXdsLJpLJnMES5ulmoU3YuLA==
Date: Wed, 16 Nov 2016 20:50:40 +0000
Message-ID: <7FB5C932-3FDF-4A3A-BBEA-CE87E2F8CB60@cisco.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/f.1b.0.161010
x-ms-exchange-messagesentrepresentingtype: 1
x-ms-exchange-transport-fromentityheader: Hosted
x-originating-ip: [10.154.248.55]
Content-Type: multipart/alternative; boundary="_000_7FB5C9323FDF4A3ABBEACE87E2F8CB60ciscocom_"
MIME-Version: 1.0
Archived-At: <https://mailarchive.ietf.org/arch/msg/rtg-open-source/oEZeP0G-DFQF1k5pmEdwFGr2tWk>
X-Mailman-Approved-At: Wed, 16 Nov 2016 12:54:35 -0800
Subject: [Rtg-open-source] OpenBMP
X-BeenThere: rtg-open-source@ietf.org
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: Discussion and collaboration for Open Source efforts related to the Routing Area <rtg-open-source.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtg-open-source>, <mailto:rtg-open-source-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rtg-open-source/>
List-Post: <mailto:rtg-open-source@ietf.org>
List-Help: <mailto:rtg-open-source-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtg-open-source>, <mailto:rtg-open-source-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 16 Nov 2016 20:50:43 -0000

Hi folks,

We'd like to introduce OpenBMP, an open source project that enables you to collect and easily consume real time routing data. Collection is based on BGP Monitoring Protocol (BMP - RFC 7854). For those of you are not familiar, a router with the BMP configuration streams BGP data (all address families) from all of its BGP peers to a BMP collector. In this project we provide a high performance, low footprint collector that can handle Internet scale and speeds.

With BMP, you can stream both pre-policy (unmodified updates as received before an import policy is applied to the peer or the router dropped the update due to error) and post-policy data (after import policy is applied, i.e. what is accepted by the router) which opens up some interesting analysis for security.

The collector produces both raw and parsed BGP data to Kafka using the topic structure specified in:

http://openbmp.org/#!docs/MESSAGE_BUS_API.md

Consumers subscribe to the topics of their interest on the bus to receive and use bgp data that is of interest. Parsed BGP messages allow consumers to focus on the BGP data itself instead of unpacking and decoding BGP NLRIs.

We have a collection of consumers including a UI. UI is a consumer of the data and makes REST calls to the database. The API spec can be found here (we are in the process of updating the API):

https://github.com/OpenBMP/db_rest


You can find all the information about the project in openbmp.org<http://openbmp.org/> and the code in https://github.com/OpenBMP.

The easiest way to start is by installing two docker containers from here:

https://github.com/OpenBMP/docker

aio container includes everything except ui (kafka, database, consumer, collector)
ui container (if you want a ui)

I am sorry that we are not attending IETF this time but please let us know if you have any questions or interested in further discussions.

Thanks,
Serpil Bayraktar (serpil@cisco.com)<mailto:serpil@cisco.com)>
Tim Evens (tievens@cisco.com)<mailto:tievens@cisco.com)>