Re: [Idr] [bess] IPSec Tunnels and draft-sajassi-bess-secure-evpn

"Rabadan, Jorge (Nokia - US/Mountain View)" <> Mon, 03 August 2020 07:00 UTC

Return-Path: <>
Received: from localhost (localhost []) by (Postfix) with ESMTP id D169D3A0BEC; Mon, 3 Aug 2020 00:00:17 -0700 (PDT)
X-Virus-Scanned: amavisd-new at
X-Spam-Flag: NO
X-Spam-Score: -0.001
X-Spam-Status: No, score=-0.001 tagged_above=-999 required=5 tests=[DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: (amavisd-new); dkim=pass (1024-bit key)
Received: from ([]) by localhost ( []) (amavisd-new, port 10024) with ESMTP id Sb2WpJn_j2As; Mon, 3 Aug 2020 00:00:15 -0700 (PDT)
Received: from ( []) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by (Postfix) with ESMTPS id 9E55D3A0BED; Mon, 3 Aug 2020 00:00:14 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901;; cv=none; b=lDDbt82LOx4arEgSjgV0YUooXHAPMhQWP9RlcMu2Z6YRAbJ7NSK835sJuya4d3OwilHi1zoOT7TbjSY+74TQUhaeEP2WgcXPTljubNs2Ezg9mogZVEVKgbJcssbe7t596pecrr9q3HXRjXiOPbyBUsLSfvsKrVy/Nsk7lysadIKGZ6GRztGSJPv/FkH+OMzVBFGRLW1aYO3M6jacPTynERMof/I9JJQPtwmef43hjY3Sgrgz0bf5wkSDNBU6hIkdY0DG+sANeW/gI2OQbWBb889Z3le7PfNkWhskYEO/6ma1/41OckyRMJr4ii3LxHH35msqVTBUCTs88gE+zCUkiA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed;; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=UDUVJ3b+VHB6c7bcdLtmckjRwaR8v/sn6o4o+Vrs9XY=; b=nfWAAkC2+9+BdM+JbzGt/eaQCQVGUZP3Yi2HBY2fj67Z0a8e5zFJdJ4sjDT5DOuOIVcwZT8FpLGpve8gocmSFJ9Jjpv1Zqi9Mven3szSDptlcZi2AozsXfwTUDo/7oRRQoWZW4UmSs/rm82bOj3cSX5P+j1/baEcg3dop90KYrWsT09vD+0ylX168zvyWtiRsMJuJxrvW7zhzbQnXWRRF1XxXRvqOqYOaQtJ3KyLHyzgLI4nRbrNNIyoLkgG9lSBC+C7CfmWNkgpdR45sbVrPfm8eXD5Vh8zuyIxT/k08Cka5mW2HBRxI0T1A94xyc7vcj2Sw/PzxzL5lS5OovAHOw==
ARC-Authentication-Results: i=1; 1; spf=pass; dmarc=pass action=none; dkim=pass; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;; s=selector1-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=UDUVJ3b+VHB6c7bcdLtmckjRwaR8v/sn6o4o+Vrs9XY=; b=LBCXR1r1f8mjsBKvOh0sLYQcibdVcSnr2P7gxnsfM7pSvdGcMOQrEm7vEk80K4jH1UDVgS025QIVeaPlX9ANI4kBOwMb4dKbspElxo/LQXltUjzzFAsiDkAgiXT8tsmxoajbV86OFSaS/hS/A/eJKOJbW60Qq2D47YwubCQskIg=
Received: from (2603:10b6:301:61::15) by (2603:10b6:301:61::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3239.19; Mon, 3 Aug 2020 07:00:11 +0000
Received: from ([fe80::d1a6:4eb8:4301:8900]) by ([fe80::d1a6:4eb8:4301:8900%7]) with mapi id 15.20.3239.021; Mon, 3 Aug 2020 07:00:11 +0000
From: "Rabadan, Jorge (Nokia - US/Mountain View)" <>
To: Susan Hares <>, "'Ali Sajassi (sajassi)'" <>, "" <>, "" <>
Thread-Topic: [bess] IPSec Tunnels and draft-sajassi-bess-secure-evpn
Thread-Index: AdZk8izhjCdDx5/XSYuR36KvQpfiTAB0hUQAABuHzYAADSRigAAdqGjVAAazAgAAWfD1iA==
Date: Mon, 3 Aug 2020 07:00:10 +0000
Message-ID: <>
References: <007f01d664f3$e2b14ff0$a813efd0$> <> <00ff01d66732$61fc9fe0$25f5dfa0$>, <> <>, <00d901d667f8$64004d20$2c00e760$>
In-Reply-To: <00d901d667f8$64004d20$2c00e760$>
Accept-Language: en-US
Content-Language: en-US
authentication-results:; dkim=none (message not signed) header.d=none;; dmarc=none action=none;
x-originating-ip: []
x-ms-publictraffictype: Email
x-ms-office365-filtering-ht: Tenant
x-ms-office365-filtering-correlation-id: 9783d082-5c70-4fc3-d6ba-08d8377add59
x-ms-traffictypediagnostic: MWHPR08MB3615:
x-ms-exchange-transport-forked: True
x-microsoft-antispam-prvs: <>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: urg3c1Cj066AzFCxghBtXzWwlnHhoYzGfxbs4b+6EkGtDPsIkZxbSCoyWQ5aw2sdkk89EGb8cHRNsjsoaTaBsTRy3xznHvtCGs5kCb9j9gpIerMlozR2feCMib1pV3SMkidjLvt+FhUql8xVdErS63Zo4JOT5ZaloM8NHVnwai8etJj0FtK5FdSHhDlnbTF6BQmJmrZBzhc1VpbiDPVOH5+TnMZvsh8lFXTo+ZYiVOld4Gx0KI6CD8vdIpe/gy6SY3Qm6t5zvWnrgvw9Fqy7Q5doAKuE/55EgenTuCKefOjMogJG1leoFgivk3egnBbeN1Or3GTSkF2zhwWUq7nfHAkl6E3sbclw9kCCry/AnXLQPeNb+cya39WYQERgRsWY2eQOq4GpF0oWo5brT5zXyw==
x-forefront-antispam-report: CIP:; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM;; PTR:; CAT:NONE; SFTY:; SFS:(4636009)(396003)(136003)(366004)(39850400004)(376002)(346002)(2906002)(52536014)(7696005)(66446008)(66556008)(53546011)(6506007)(66476007)(186003)(316002)(64756008)(86362001)(55016002)(478600001)(5660300002)(71200400001)(83380400001)(966005)(9686003)(8936002)(110136005)(4326008)(33656002)(8676002)(166002)(26005)(83080400001)(107886003)(76116006)(91956017)(66946007); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata: wCtIt7JA/RCKaUYylnEgod7Eaw9xiei6YxJmS7WlBsE1RUV7KN8MPJ1R/g3X2eCDeGgFjKe8PTKhM8i1XLuaVlyMWooSuy7LcRG8UtHILjRFG+KVxzYmexcLpBeJe4KwEHR4othIC0DkZ0HaYyxZ9j1F8jFB7FOAofDQNDqL7D+Yq/uXOtP8g4uMAyrcYYrRJhY7OuhO9DwF1s9G8NFdK3Y3+WYCvJTwDaod/YqfrjhK32TtY18gxjeR3lZZ2n8n2CL+s87NdhdPC/b0UdF/T6T7JyBG5EKwSHY3BdgLD22DR2hDCfGG/pCMlwN0eYUMUxVYFrrndgLDAjBDsrXa45ayNGYE6ADwp3oJezlcy8hotn0uScpCa/AYuwvxpsB8Z2l9c2W4b5jeCpr9whamFFjrT1NijC/K5mAFW/jl1QLW5zbNaoOTV7l8rK8pJUIjSoYrX2qoc17OpmRwmixYqqYm4AdF3D9Vq6Wa2n0+Nwf8YRvvDO7dX3rARvT+DAcyvF2tztdpcrYGmWh76LGkLlBKB/FefKJEYuFknaiPhO0WWq4GUhqoKvwruRTGSTtxzyVFVEH5bb/ZT94klys3yVfockCIBa41J+yZUAaFhCdvk5tSu2lwzzN88HRAS0CJWj8VhxmK/tpdee3NXQDUGA==
Content-Type: multipart/alternative; boundary="_000_MWHPR08MB352041F2174DFFD109EE52A1F74D0MWHPR08MB3520namp_"
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-Network-Message-Id: 9783d082-5c70-4fc3-d6ba-08d8377add59
X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Aug 2020 07:00:10.7278 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 4/rqHkXMgpJQy6Q4f6Un0N6/jSXx2dVGp1rc/E3AGakQf9mSe3SEtd+6s5voVJRO4zSL/6AoecoR6+HXBIW7yA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR08MB3615
Archived-At: <>
Subject: Re: [Idr] [bess] IPSec Tunnels and draft-sajassi-bess-secure-evpn
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Inter-Domain Routing <>
List-Unsubscribe: <>, <>
List-Archive: <>
List-Post: <>
List-Help: <>
List-Subscribe: <>, <>
X-List-Received-Date: Mon, 03 Aug 2020 07:00:18 -0000

Sue and authors,

To be clear, and John/Ali can chime in too, what I think we are saying is:

  *   people use RFC8365 as the reference to implement EVPN for VXLAN, VXLAN GPE, NVGRE and MPLS-in-GRE.
  *   RFC8365 uses the encapsulation extended community described in section 4.1 of the tunnel-encaps draft, and not the sub-TLVs in section 3.2.
  *   Because of that, new implementers of EVPN could be confused whether to use the encap extended community or the sub-TLVs. And the use of the latter would lead to interop issues.

Because of that, I am not suggesting to remove the TLVs in section 3.2, *but* I am asking to add a sentence in section 3.2 saying something like “The Encapsulation Sub-TLVs specified in sections 3.2.1, 3.2.2, 3.2.3 and 3.2.6 MUST NOT be used along with BGP UPDATE messages of AFI/SAFI 25/70 (EVPN).”

NOTE: the sub-TLVs are not useful for EVPN but can still be used with other families, i.e. 1/128 or 2/128, hence they should be kept in the document.

Now, Sue, authors, would that be possible?
@Sue, I’m happy to provide information about our EVPN implementation in the wiki, but it is about RFC8365 and not the tunnel-encaps draft. We can also point at this public interop report [1], where all the vendors listed in the EVPN tests for VXLAN encapsulation use the BGP encapsulation extended community and NOT the sub-TLVs used in section 3.2 of the tunnel-encaps draft.



From: Susan Hares <>
Date: Saturday, August 1, 2020 at 1:39 PM
To: Rabadan, Jorge (Nokia - US/Mountain View) <>om>, 'Ali Sajassi (sajassi)' <>rg>, <>rg>, <>
Cc: Hu, Jun (Nokia - US/Mountain View) <>
Subject: RE: [bess] IPSec Tunnels and draft-sajassi-bess-secure-evpn

Thank you for your input.   Please review the details of the message I sent to Ali.

[IDR Chair hat]  We welcome implementation reports at:

It’s hard to ask authors to re-open old issues unless you have specific implementation issues
substantiated on the wiki with an implementation report.
You can put a comment at the bottom if you are unclear about the format.
The person who puts the information must provide a name and an email address.
[IDR Chair hat off]
[Shepherd hat on] I will await the authors response to your queries on EVPN.  [Shepherd hat off]

Thank you for bring up the EVPN related issues.

Cheerily, Susan Hares

From: BESS [] On Behalf Of Rabadan, Jorge (Nokia - US/Mountain View)
Sent: Saturday, August 1, 2020 4:30 AM
To: Ali Sajassi (sajassi); Susan Hares;;
Cc: Hu, Jun (Nokia - US/Mountain View)
Subject: Re: [bess] IPSec Tunnels and draft-sajassi-bess-secure-evpn

I fully agree with Ali.
I think the VXLAN TLV only makes sense for other families, and not for EVPN. We’ve done EVPN public interoperability for a few years and everyone uses the BGP encap extends community.


From: BESS <> on behalf of Ali Sajassi (sajassi) <>
Sent: Saturday, August 1, 2020 03:18
To: Susan Hares;;
Cc: Hu, Jun (Nokia - US/Mountain View)
Subject: Re: [bess] IPSec Tunnels and draft-sajassi-bess-secure-evpn


I am afraid if we don’t clean up the draft, it can cause confusion as it has already and result in immediate errata filing for it after publication. A sub-bullet got added to the latest rev (rev17) that is not correct. It says that the VxLAN sub-tlv is sent with EVPN route when V bit not set. However, EVPN never uses this sub-tlv as its routes has all the needed info. Furthermore, RFC 8365 is very clear that EVPN uses Tunnel Encapsulation Extended Community (per section 4.1). As I said, I am not aware of any of the vendors using these sub-TVLs and it is easy to have a quick poll.

Regarding the paragraph that got omitted, it is making it much more ambiguous than it used to. I would opt for clarifying the paragraph rather than removing it. If needed I can provide an updated paragraph. Section 9 of RFC 8365 specifies how a VPN multicast route can be advertised with PMSI tunnel attribute and Encapsulation extended community and has been implemented by many vendors.


From: Susan Hares <>
Date: Friday, July 31, 2020 at 5:02 AM
To: Cisco Employee <>om>, "" <>rg>, "" <>
Cc: "'Hu, Jun (Nokia - US/Mountain View)'" <>
Subject: RE: IPSec Tunnels and draft-sajassi-bess-secure-evpn


It is wise to start with the RFC6514 and the draft-ietf-idr-tunnel-encapsulation draft..

[WG chair hat on]
The tunnel-encapsulation draft has passed general WG LC – so it is inappropriate to call for the request to remove these sections.  The WG LC that is currently running is whether to remove the “AS” field from the tunnel endpoint field, and replace it with a reserved field..

The implementation page is on:

If you wish to provide information on the cisco implementation, you are welcome to add information on the page.
I can call for an update to the page from vendors.

[WG chair hat off[
[Document shepherd hat on]

The issue is during the edits the text from RFC6514 from Eric Rosen was unclear.  The text was:

   It has been suggested that it may sometimes be useful to attach a
   Tunnel Encapsulation attribute to a BGP UPDATE message that is also
   carrying a PMSI (Provider Multicast Service Interface) Tunnel
   attribute [RFC6514<>]4>].  If the PMSI Tunnel attribute specifies an IP
   tunnel, the Tunnel Encapsulation attribute could be used to provide
   additional information about the IP tunnel.  The usage of the Tunnel
   Encapsulation attribute in combination with the PMSI Tunnel attribute
   is outside the scope of this document.

Since the text itself was unclear what additional information could be provided, the authors removed it from the draft.

As we had not received any feedback about active RFC6514 interactions on the list.

[document shepherd off]

If you have an implementation of the interaction between the RF6514 and tunnel encapsulation, it would be valuable to provide:

a)  either a draft specifying the interaction you wish to IDR WG, or
b)  comments that could replace the original the original text.

Since the IDR draft has gone through multiple WG LC and a very complete review from Alvaro – so a quick response would be appreciated.   IMHO a draft on the interaction between RFC6514 and the tunnel-encapsulation draft – would be the best thing at this point.  Let me know if you are interested in working on such a draft.


From: Ali Sajassi (sajassi) []
Sent: Friday, July 31, 2020 1:54 AM
To: Susan Hares;;
Cc: 'Hu, Jun (Nokia - US/Mountain View)'
Subject: Re: IPSec Tunnels and draft-sajassi-bess-secure-evpn



Before getting to the discussions of the three IPsec proposals, there are some elements of draft-ietf-idr-tunnel-encaps-17.txt that I can see might have caused some confusions and I’d like to get those sorted out first.

The tunnel-encap draft specifies sub-tlv for VxLAN, VxLAN GDP, and NVGRE in sections 3.2.1, 3.2.2, and 3.2.3. I am not aware of any vendor that has implemented these sub-tlvs because the info in these sub-tlv already exist in EVPN routes (e.g., MAC addresses, Ethernet Tags, etc.) which they have implemented it. Therefore, all the vendors that I am aware of use Extended Community  defined in section 4.1  along with EVPN routes to signal VxLAN and GENEVE tunnel types. Furthermore, I am not aware of anyone using NVGRE encap! So, as the first step, we should remove these three sections from the draft if there is no objection.


From: Susan Hares <>
Date: Tuesday, July 28, 2020 at 8:30 AM
To: Cisco Employee <>om>, "" <>
Cc: "'Hu, Jun (Nokia - US/Mountain View)'" <>
Subject: IPSec Tunnels and draft-sajassi-bess-secure-evpn

Ali and bess WG:

IDR has 3 proposals for IPsec tunnels that impact draft-ietf-idr-tunnel-encaps-17.txt.  As an IDR co-chair/shepherd,  I have been discussing these three drafts (Ali and two other authors sets) to try to find out if we can have one general solutions.

The discussion has been very fruitful to point up BGP issues of interoperability, security, privacy, manageability, and scaling..  For example, there is a lack of a clear specification between RFC6514 (PMSI tunnel attribute) and the tunnel-encaps draft that specifies how these drafts interoperate.  I suspect the bess and idr chairs will need to discuss if tunnel-encaps has to address this point.

I wrote up my ideas in draft-hares-idr-bgp-ipsec-analysis-00.txt so the authors could tell me what I misunderstood.   You’ll find this draft stops half way.  I have the rest of the draft written, but I wanted feedback from all the author teams before sending it out.

After hearing some of the details from the authors, I would like to sponsor an IDR interim so we could discuss these issues at length.   If you think this is a good idea, please let me know.

One other thing… unfortunately, I scheduled a set of meetings for EDT time after IETF meetings this week.   Your next response will occur from 11-16 UTC on Wednesday.

Cheerily, Sue