Re: [bess] New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

"Dikshit, Saumya" <saumya.dikshit@hpe.com> Mon, 31 July 2023 04:10 UTC

Return-Path: <saumya.dikshit@hpe.com>
X-Original-To: bess@ietfa.amsl.com
Delivered-To: bess@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B5ED9C151067 for <bess@ietfa.amsl.com>; Sun, 30 Jul 2023 21:10:47 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.102
X-Spam-Level:
X-Spam-Status: No, score=-7.102 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H5=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=hpe.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id y7B-qHEYZM5Q for <bess@ietfa.amsl.com>; Sun, 30 Jul 2023 21:10:43 -0700 (PDT)
Received: from mx0a-002e3701.pphosted.com (mx0a-002e3701.pphosted.com [148.163.147.86]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 10FAFC151066 for <bess@ietf.org>; Sun, 30 Jul 2023 21:10:42 -0700 (PDT)
Received: from pps.filterd (m0134420.ppops.net [127.0.0.1]) by mx0b-002e3701.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 36V03dag032024; Mon, 31 Jul 2023 04:10:42 GMT
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hpe.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=pps0720; bh=zc/oiDssPn5jkkneKa0Ti6aFzTC405V7sWAj6pStqT0=; b=Ahep6L47nmae8dki9Jcr9HNKA/cGnc9PmMQ3/su89ZwTJx1HQPoH+kU8rmxlxh+F7DTA TTkPWjwHd0BLiIbE2obHwYQDtblVGXCRvZh84aQipdkkg4Om77I5j15QZGSMt1Kn+6G1 TCV6Y9V7987oIH9/+gi5gSMygVAzdfpjh3OVVVCHwYQZuaWkRzgBFUVoFRUJNAlZ/F9n z0wbO7WspBFQQM7yiV93vCiTZrIKk9HEu0g+nKs0od9wOlKbxvI9bkzZeXsE7QYSuBuw 3/vR+2MJZ16ZGoqWd5iXbDAd8ugvgVwbfND45xSs3IOR4J5m1JLp0FUJcoMQ3v8y6gZ4 vQ==
Received: from p1lg14880.it.hpe.com (p1lg14880.it.hpe.com [16.230.97.201]) by mx0b-002e3701.pphosted.com (PPS) with ESMTPS id 3s4r56v3e9-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 31 Jul 2023 04:10:40 +0000
Received: from p1wg14923.americas.hpqcorp.net (unknown [10.119.18.111]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by p1lg14880.it.hpe.com (Postfix) with ESMTPS id 4B76C800189; Mon, 31 Jul 2023 04:10:40 +0000 (UTC)
Received: from p1wg14927.americas.hpqcorp.net (10.119.18.117) by p1wg14923.americas.hpqcorp.net (10.119.18.111) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.42; Sun, 30 Jul 2023 16:10:40 -1200
Received: from p1wg14928.americas.hpqcorp.net (10.119.18.116) by p1wg14927.americas.hpqcorp.net (10.119.18.117) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.42; Sun, 30 Jul 2023 16:10:39 -1200
Received: from P1WG14918.americas.hpqcorp.net (16.230.19.121) by p1wg14928.americas.hpqcorp.net (10.119.18.116) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.42 via Frontend Transport; Sun, 30 Jul 2023 16:10:39 -1200
Received: from NAM12-BN8-obe.outbound.protection.outlook.com (192.58.206.38) by edge.it.hpe.com (16.230.19.121) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.42; Mon, 31 Jul 2023 04:10:38 +0000
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=fPQ4J+cUazgAXzptP2tGAXp5Ena3Hqt86A20EpuOYpTdGehjzO9Sb++6MXZ9rjLTOBEJ23iJy9nHxp2NW3eNUgcL+2pK/bRKE6hz6HsnKlgxzfpm5fkg7Lk9BgRXetWyBwX2hoWpkQkQlmOZMpDQJn8lCRFEExbA8pguIdLSkWQUtKRv/yC/u5/do20HM+zxtXZFnoXZ6nC35THxKnrTQ7XbLw0aA0Y9cbg39sLEzpbJZHEdcT2rBHJw/DW3T9zWMmLda6YH9+UOT28r9Qvc2kFEdnt/zNoSNlfANdKIlG62BLPWjKoe935bjbuvpwm7GwWL3cOHr6KYG+JZVI+Pbg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=jNcZfLQBRhSDVuq0LLGoxcqlf7UQNVH0luA2CQ/P15o=; b=W6f2Sb3TIkNlyduD//GbJCh8Tg7W8X5SLWJwOJSoQMAwLk3mH1KpvuVPOTHOpBcIwsmARtf0fm8vDWZxmG5Ffxc+2zxJTBqmzRSUJ8IfDdAAVg2asc7jgrzZOkDVE0fjK6FnZ5H4TWVtaHWcFxBKk5hwTMMLGdUNmhOL4on73E4R/c50TTP74bjpPiMNfbag9Xx8Az1hISPj6m1J+Xy4C5ImRkJdiPSlq/IguEjJ4edP3ehX4wkApWQE608/i+cTOIWhzEq6w0lIwRqse4v9qyZkdxpriOs1bGnbOWb+92NHdCNkBuJSE7pYgwCB/h9t8wxPAdd/7SYV2+MrogO9bg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=hpe.com; dmarc=pass action=none header.from=hpe.com; dkim=pass header.d=hpe.com; arc=none
Received: from SJ0PR84MB2110.NAMPRD84.PROD.OUTLOOK.COM (2603:10b6:a03:435::16) by LV8PR84MB3536.NAMPRD84.PROD.OUTLOOK.COM (2603:10b6:408:204::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6631.42; Mon, 31 Jul 2023 04:10:35 +0000
Received: from SJ0PR84MB2110.NAMPRD84.PROD.OUTLOOK.COM ([fe80::ab16:a3b4:3a62:6adc]) by SJ0PR84MB2110.NAMPRD84.PROD.OUTLOOK.COM ([fe80::ab16:a3b4:3a62:6adc%6]) with mapi id 15.20.6631.026; Mon, 31 Jul 2023 04:10:35 +0000
From: "Dikshit, Saumya" <saumya.dikshit@hpe.com>
To: Alexander Vainshtein <Alexander.Vainshtein@rbbn.com>
CC: "bess@ietf.org" <bess@ietf.org>, "Jorge Rabadan (Nokia)" <jorge.rabadan@nokia.com>
Thread-Topic: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt
Thread-Index: AQHZJPkZf9lJvbqowkmLIeTlGWkWuq6XqqgKgAAfTICAcLQdMIAAG1p0gAE87tCAAKiytIAAot5JgAHhipCAAHLNkIAA50SwgAAYUcCAAAV04IC/4PiwgAALSjCAAePuEA==
Date: Mon, 31 Jul 2023 04:10:35 +0000
Message-ID: <SJ0PR84MB2110D82ABD9742257F690FA99405A@SJ0PR84MB2110.NAMPRD84.PROD.OUTLOOK.COM>
References: <167335802203.3526.7709083484718132257@ietfa.amsl.com> <BY3PR08MB706054A8F12B416260C92930F7FF9@BY3PR08MB7060.namprd08.prod.outlook.com> <PH0PR03MB63001BC1D4F36913BD2DA4BFF6FF9@PH0PR03MB6300.namprd03.prod.outlook.com> <SJ0PR84MB2110564D9B87D59ECE38FA8894879@SJ0PR84MB2110.NAMPRD84.PROD.OUTLOOK.COM> <BY3PR08MB70605CEA1B4836825CDEC3FCF7879@BY3PR08MB7060.namprd08.prod.outlook.com> <SJ0PR84MB2110F1626B8CFBB08BD66EB794849@SJ0PR84MB2110.NAMPRD84.PROD.OUTLOOK.COM> <BY3PR08MB7060E7293AB37416AC3D9461F7849@BY3PR08MB7060.namprd08.prod.outlook.com> <PH0PR03MB63009D19EB88C9E2EF7D1FB3F6859@PH0PR03MB6300.namprd03.prod.outlook.com> <SJ0PR84MB2110EAE4831648F65E0B1811948A9@SJ0PR84MB2110.NAMPRD84.PROD.OUTLOOK.COM> <PH0PR03MB6300D3551A77243445216511F68A9@PH0PR03MB6300.namprd03.prod.outlook.com> <SJ0PR84MB21100D7DED58F85CC1361365948B9@SJ0PR84MB2110.NAMPRD84.PROD.OUTLOOK.COM> <PH0PR03MB63008DCBC1C7A4925B491DC9F68B9@PH0PR03MB6300.namprd03.prod.outlook.com> <PH0PR03MB630041B4C16D2E7996EA3585F68B9@PH0PR03MB6300.namprd03.prod.outlook.com> <SJ0PR84MB2110012107B5F8BB2C371CD69401A@SJ0PR84MB2110.NAMPRD84.PROD.OUTLOOK.COM> <PH0PR03MB6300877E119EDCDE0C031AB3F601A@PH0PR03MB6300.namprd03.prod.outlook.com>
In-Reply-To: <PH0PR03MB6300877E119EDCDE0C031AB3F601A@PH0PR03MB6300.namprd03.prod.outlook.com>
Accept-Language: en-IN, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: SJ0PR84MB2110:EE_|LV8PR84MB3536:EE_
x-ms-office365-filtering-correlation-id: c4b8da03-eff4-499c-245c-08db917c1706
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: GR3gKarjaUOeKslr0G7mDnbGb0Tduj8O3SfBx5xq2vtpYY4RIHaDGaXg2sT3jF/w5YIfBZmN05SkL0Jz0EmFPr5Juqa1H3oCeMcUEsPZyk5aST8uNxIkyS4gdYKVcLrBUINRIhGdrvhAS5I7S7j7CM6SQjqE+ejs7QtMc0JgTGYgBWDCbnGkLhFoBQ7ur31kivnWFOP3lyrzoPmpSzREd4Julu1j/XoSoT8PXGRHQB57owlb8SFqXMJYyUszFNg1e7z2sq9i7lRCvxcoYeN7wO0ZUSlHbKWQKATolryIsuDppJOWiy5yqv02z1ib5ttYU23iKxfH8GNW8NFngEBvg0vPqclfa8xG1JocolpsqLkslO5m2CD5ppSIwMJppZzrelzXJWcfvDMCAU5oJ/pEC+tJ/2A8yh2wsC/1lYgf8uH/GyPinpfzMSZw9pi5AaLR0/DP0VklitvDy7rt6edf5xyqQiAS+8D0w3rLru32ur2t77qMFAxN2krncOHTXjbuXFkDEHHgd1y42UNzBFY+coH3yFXpcQ3LpyZPl1ay8lULFJI37t3BHdewiMOuohUOSoXH3jE+o0jTWbZX1rkKH/gPPLQiK1q3FrrbfOLpvkUHk2gAkimFLmqEXHy4MaMV3rBG27eq9IzelNCbCAESsjWVUG76tyFPmnGobd2snkw=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SJ0PR84MB2110.NAMPRD84.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230028)(136003)(396003)(376002)(366004)(346002)(39860400002)(451199021)(166002)(38100700002)(82960400001)(122000001)(55016003)(86362001)(38070700005)(33656002)(9686003)(966005)(478600001)(45080400002)(71200400001)(7696005)(53546011)(186003)(6506007)(26005)(8676002)(8936002)(52536014)(5660300002)(76116006)(4326008)(6916009)(64756008)(66446008)(2906002)(66476007)(66556008)(66946007)(54906003)(41300700001)(15650500001)(316002)(30864003)(66574015)(83380400001)(579004)(559001)(10090945012); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: oNKrfPbHDw48LxnJWz5Gx13a/tDXgOmCo7IxZDepkVNcZ8alGXdHmHkuWUyeQDgE+bkw5PTbJXn89Y6Ci/Oq+RsFdgoTbwXbEF8eyPUy9lPrvJIhCjqpnCTTYhdUy6/rXbPTUIVBmgNcg2lLH1pMKFxspXOjRiOEFTKXeBMR2r0i2lr5czNBI8dMof7UYVWAZDRBkhKvBxp5m/eLU93vQoTw4vF92UJmdvgwmchbYxCr+5hUE0V5JRZhivwizDh3a955YEw3DHI6pVop0idv84S5RAwKU7jL7tflBQiQQ/G9STPdF1qs761ZGbpEuaFesovmySJloaDSuCAVLxzYSSW9lVYVGpE97RrwO6rNEENXkmrYjI5n7B0CQl6btzFdZ1INBauD/8poTQ0VwnITzqQWtNlPnmuPJNrfyskRG+jEJAUJhYXWTnJI6uak6HGg/vg/hIz0ebkwi8pdXC5xLM/a8daYPLB4e9q3TCHy0K3/EYgOshBRvhexFwsGi/oMmEtMhkh3j4sFCI8QfzNd/upOhIxQ6ZLpJ1lGaQrVrcBYG2ZWGs1ixrWAFj0sj12DGNJwEefRGgpH3PVrx0tb8e7ktwjdSwMMpRcfn/W96Msb++tfc9Im+g5lcw/yrIoxLsadIcS+DSm/ha7BzQfakRfnfBj+0hkIEd5a9Pk+QyxNlg46RIp+gvAnxuRrEitasSICh5kKOUFcV4RT7ujFzbmjN4L2cA4S7+MQ/k4a4QyR5vdyA5K7AX1cGh75dqodQz3DOO87Us97jB4bww/MblD/tpyrNBPsRZ7Olpl9olha+aX5GyqTOU0WYpVTMm2guvW0cKst1zVL3AYitbCvPCqcALS86BpLbpXjBxM5HpYxLqbODwN1qfke0bg1Xg14X8/XVJwuEqE0e/K4aEkiWzNua8ijlL/Xx/6FvUBS8DkRrOqH3ITYR8qYjA1w1ZVoCNqm0YCmi0lSkCaoAXW7pYMmV6QkjpmmoQWdKxpjrLOozgB8l016HEebARg4uLhK7eRxPpQ8wLgUDHFR7D8km3wdxwPxeSj5iTvqTj41raKUXEZVF1YAl9+tzMEUT9h57u6F5gzser08YsNDmAU/Xdfkn9i/+ytO7vIox9uuLZUN+n6QtFKY3TOuU2FilhEPo3sWW21SSApO8C7JJXrKdnRAKMiBS6lnqDntlGvthm5nWjBr/YI4uwKT2WTcL68+PB6FbulF/6CAN8uGL4ws+Cxn64D/6BgMOLi+YxeSOXXAWfOQVQBBgslXOgcNeFlC2N5RLFJVJiJfVJo9dLtVn/bjP6yNyVbCaycQQoAdbtU6h0AUT3Z54uzM/waqOl8ljGTl1z6SQRe/+J0EskhOEwwPNBSGb23Pf08M601xKgU7taH1pCme4HOunvWurMne6bfBhq6BH9yXLLbqNdrKQ6bMeJ02kY++yUSElKKFseB4P+7LWzx10LbbII3Pu1sKDC5L2nNmQCK4NsYbtFs/I4W6PAljScYKHtkT064CDKL/aTL7Sm2CBmXkfq9vdCucOQXwPMUmLNjq8vdd4KLkKHoFlaa3pkBWXKKUwWWjIDw4QHXMPHdNBBHJpNsZafmI
Content-Type: multipart/alternative; boundary="_000_SJ0PR84MB2110D82ABD9742257F690FA99405ASJ0PR84MB2110NAMP_"
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: SJ0PR84MB2110.NAMPRD84.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-Network-Message-Id: c4b8da03-eff4-499c-245c-08db917c1706
X-MS-Exchange-CrossTenant-originalarrivaltime: 31 Jul 2023 04:10:35.0820 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 105b2061-b669-4b31-92ac-24d304d195dc
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: gEO64sAZTJqsvmCMzMTRu0ADbzf1R3HI+cvVLhnug5GpgrCOVi+X376A/Ri5/7vASKd90CRKxrmkG4L8sKG7vA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: LV8PR84MB3536
X-OriginatorOrg: hpe.com
X-Proofpoint-GUID: ycsgPJuxlY-c3LsS7sDUiQ7pQIlSUZ5q
X-Proofpoint-ORIG-GUID: ycsgPJuxlY-c3LsS7sDUiQ7pQIlSUZ5q
X-Proofpoint-UnRewURL: 22 URL's were un-rewritten
MIME-Version: 1.0
X-HPE-SCL: -1
X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.254,Aquarius:18.0.957,Hydra:6.0.591,FMLib:17.11.176.26 definitions=2023-07-27_10,2023-07-26_01,2023-05-22_02
X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 phishscore=0 mlxlogscore=999 malwarescore=0 mlxscore=0 clxscore=1015 adultscore=0 spamscore=0 bulkscore=0 priorityscore=1501 suspectscore=0 impostorscore=0 lowpriorityscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2306200000 definitions=main-2307310037
Archived-At: <https://mailarchive.ietf.org/arch/msg/bess/88-h8rjuf6HANzah768Mrisyweg>
Subject: Re: [bess] New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt
X-BeenThere: bess@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: BGP-Enabled ServiceS working group discussion list <bess.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bess>, <mailto:bess-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bess/>
List-Post: <mailto:bess@ietf.org>
List-Help: <mailto:bess-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bess>, <mailto:bess-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 31 Jul 2023 04:10:47 -0000

Thanks Sasha, for the detailed design/flows for both the symmetric/asymmetric IRB flows.

Though I am still struggling to convince myself on the thumb rule for absorbing/not-absorbing the routes,
ONLY based on Route-Targets irrespective of nature of EVIs. Since control plane procedures ought to capture/reduce
error scenarios.

Regards,
Saumya.

From: Alexander Vainshtein [mailto:Alexander.Vainshtein@rbbn.com]
Sent: Thursday, July 27, 2023 1:19 PM
To: Dikshit, Saumya <saumya.dikshit@hpe.com>
Cc: bess@ietf.org; Jorge Rabadan (Nokia) <jorge.rabadan@nokia.com>
Subject: RE: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

Saumya,
I think I have already answered that: the operator should avoid re-use of RTs associated with IP-VPN services by EVPN services – and vice versa.
If this rule of the thumb is violated, the consequences are unpredictable and, most probably, catastrophic☹.

Regarding your specific question: I guess (FWIW) that the authors of RFC 9135 have been trying to define the behavior in the following scenario:

  1.  An EVI and an IP-VPN are instantiated in PE-1 and PE-2
     *   The EVI in both PEs:

                                                               i.      Represents a certain IP subnet SN1

                                                             ii.      Uses RT-EVI as its Import and Export RT

     *   The IP-VPN uses RT-IP (that is different from RT-EVI) as its Import and Export RT
  1.  IP-VRF and MAC-VRF that locally represent this EVI and this IP-VPN in PE-1 are connected by a Symmetric IRB
  2.  IP-VRF and MAC-VRF that locally represent this EVI and this IP-VPN in PE-2 are connected by an Asymmetric IRB (because it does not support Symmetric IRBs)
  3.  IP-VRF in PE-2 is connected to yet another subnet SN2
  4.  PE-1 and PE-2 advertise to their locally connected subnets:
     *   If VPN-IP AFI/SAFI(s) are enabled in both PEs, these routes can be advertised in the corresponding AFI/SAFI
     *   Alternatively these routes can be advertised as IP Prefix (EVPN RT-5) routes with RT-IP
In this case PE-2 would be able to send traffic it receives from SN2 with the destination being a specific host on the subnet SN1 that is reachable via PE-1 as following:

  1.  It will recognize the destination as belonging to a locally attached subnet and sends it via the Asymmetric IRB.
  2.  ARP Cache of the Asymmetric IRB (that is updated from the MAC/IP Advertisement route advertised by PE-1 for this host, so its lookup will yield the correct MACF address for this host.  As a consequence, the packet will be encapsulated into an Ethernet frame with the corresponding Destination MAC address, and injected into the local MAC-VRF
  3.  The FDB of the MAC-VRF in PE-2 will contain an entry (learned from the MAC/IP Advertisement route advertised by PE-1 for this host) that points to MAC-VRF and PE-1, and the encapsulated packet will be forwarded accordingly (this is what Asymmetric IRB is supposed to do).
  4.  The MAC-VRF in PE-1 will receive the encapsulated packet and forward via the matching local Attachment Circuit.
I do not think that RFC 9135 discusses what happens in the case of misconfiguration, nor do I think such discussion is necessary.

I hope this helps.
Regards,
Sasha

From: Dikshit, Saumya <saumya.dikshit@hpe.com<mailto:saumya.dikshit@hpe.com>>
Sent: Thursday, July 27, 2023 9:33 AM
To: Alexander Vainshtein <Alexander.Vainshtein@rbbn.com<mailto:Alexander.Vainshtein@rbbn.com>>
Cc: bess@ietf.org<mailto:bess@ietf.org>; Jorge Rabadan (Nokia) <jorge.rabadan@nokia.com<mailto:jorge.rabadan@nokia.com>>
Subject: [EXTERNAL] RE: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

Hi Sasha,

Thanks for the response. I am 4 months too early ☺

To further the discussion:
How should I co-relate  to the following text in https://www.rfc-editor.org/rfc/rfc9135.html#name-control-plane-receiving-pe<https://clicktime.symantec.com/15sM1H8mnTeTkMWo2VcyL?h=PB00_h9_Y3SfICxMyUqHLswwiKXoAYEuGrQyU9_s6Xo=&u=https://www.rfc-editor.org/rfc/rfc9135.html#name-control-plane-receiving-pe> :

If the receiving PE receives this route with both the MAC-VRF and IP-VRF Route Targets and the MAC/IP Advertisement route includes the MPLS Label2 field but the receiving PE only supports asymmetric IRB mode, then the receiving PE MUST ignore the MPLS Label2 field and install the MAC address in the corresponding MAC-VRF and (IP, MAC) association in the ARP table for that tenant (identified by the corresponding IP-VRF Route Target).


·       If the send side is configured with Route-Target-1 for MAC-VRF and Route-Target-2 for IP-VRF.

·       If the receive side (supports only asymmetric IRB), is configured with Route-Target-2 for MAC-VRF.
It should lead to receive side absorbing the Route, even though it’s a scenario of mis-configuration. Is there a way to corner these scenarios via control plane exchanges. ?

Regards,
Saumya,

From: Alexander Vainshtein [mailto:Alexander.Vainshtein@rbbn.com]
Sent: Monday, March 27, 2023 9:49 AM
To: Dikshit, Saumya <saumya.dikshit@hpe.com<mailto:saumya.dikshit@hpe.com>>
Cc: bess@ietf.org<mailto:bess@ietf.org>; Jorge Rabadan (Nokia) <jorge.rabadan@nokia.com<mailto:jorge.rabadan@nokia.com>>
Subject: RE: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

Saumya,
More of the same – quoting from Section 2 of RFC 4360<https://clicktime.symantec.com/15sLvSwVKqxsLQgsUwDpi?h=_xrRsRiWw4JhyYOWgE8EskHvwalDtWXD_YIvMknK0Xc=&u=https://www.rfc-editor.org/rfc/rfc4360#section-2> (the relevant text is highlighted):


   The Extended Communities Attribute is a transitive optional BGP
   attribute, with the Type Code 16.  The attribute consists of a set of
   "extended communities".  All routes with the Extended Communities
   attribute belong to the communities listed in the attribute.

The term “set” in this context (as opposed to “list”) means that the order in which specific Extended Communities appear in this attribute is not relevant.

Regards,
Sasha

From: Alexander Vainshtein
Sent: Monday, March 27, 2023 1:09 PM
To: Dikshit, Saumya <saumya.dikshit@hpe.com<mailto:saumya.dikshit@hpe.com>>
Cc: bess@ietf.org<mailto:bess@ietf.org>; Jorge Rabadan (Nokia) <jorge.rabadan@nokia.com<mailto:jorge.rabadan@nokia.com>>
Subject: RE: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

Saumya,
Lots of thanks for a prompt response.

I do not think that the order in which RTs appear in the list of extended communities has any significance in any application.
In particular, this order is not specified in RFC 9135, so that nothing prevents an otherwise interoperable implementation to add the IP-VRF Export RT first and the MAC-VRF RT second.

Regards,
Sasha

From: Dikshit, Saumya <saumya.dikshit@hpe.com<mailto:saumya.dikshit@hpe.com>>
Sent: Monday, March 27, 2023 11:56 AM
To: Alexander Vainshtein <Alexander.Vainshtein@rbbn.com<mailto:Alexander.Vainshtein@rbbn.com>>
Cc: bess@ietf.org<mailto:bess@ietf.org>; Jorge Rabadan (Nokia) <jorge.rabadan@nokia.com<mailto:jorge.rabadan@nokia.com>>
Subject: [EXTERNAL] RE: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

Hi Sasha,

I had picked up a very simple example, in context of Route-Type-1 handling as it’s ambiguous as compared to Route-Type-2 handling (2nd label and 2nd Route-Target can be associated with IP-VRF while processing). I am sure, there may be many-more combinations/deployments/configurations which can lead to issues, if it’s worth digging into them.
That’s even more a reason to call it out explicitly in this new draft and/or flag it off as IP-VRF and not leave it to the operator.

Coming to your below example:
>>> As a consequence, MAC-VRF in PE-3 will install this route, but it will not install any routes to MAC addresses that have been learned by the MAC-VRF in PE-1 from traffic.
[SD] PE-3 can still ignore absorbing anything against Route-Target-2 in MAC-VRF (from MAC/IP route), as it can take clue from the fact that Route-Target-2 (corresponding to Label-2) is the 2nd route-target carried in the MAC/IP route, other than Route-Target-1 (corresponding to Label-1). But I agree that MAC-only routes will not be absorbed at all as it will carry only Route-Target-1.

Regards,
Saumya.

From: Alexander Vainshtein [mailto:Alexander.Vainshtein@rbbn.com]
Sent: Sunday, March 26, 2023 6:25 PM
To: Dikshit, Saumya <saumya.dikshit@hpe.com<mailto:saumya.dikshit@hpe.com>>
Cc: bess@ietf.org<mailto:bess@ietf.org>; Jorge Rabadan (Nokia) <jorge.rabadan@nokia.com<mailto:jorge.rabadan@nokia.com>>
Subject: RE: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

Saumya,
My guess (FWIW) is that the operator should not “reuse” RTs used for L3 VPNs in EVPN – and vice versa.

If this rule of the thumb is violated, lots of unpleasant things can happen even without IP aliasing.

Egg,, consider the case in which:
·       PE1 contains a MAC-VRF with RT-1 and an IP-VRF with RT-2 that are connected by a Symmetric IRB
·       PE-2 contains an IP-VRF with RT-2
·       PE-3 contains a MAC-VRF with RT-2.
When MAC-VRF inPE-1 learns some IP→MAC pair {IP1, M1} from ARP/ND, it advertises an EVPN Type 2 route with RT-1 and Rt-2 attached. As a consequence, MAC-VRF in PE-3 will install this route, but it will not install any routes to MAC addresses that have been learned by the MAC-VRF in PE-1 from traffic.

My 2c,
Sasha

From: Dikshit, Saumya <saumya.dikshit@hpe.com<mailto:saumya.dikshit@hpe.com>>
Sent: Sunday, March 26, 2023 3:52 PM
To: Alexander Vainshtein <Alexander.Vainshtein@rbbn.com<mailto:Alexander.Vainshtein@rbbn.com>>; Jorge Rabadan (Nokia) <jorge.rabadan@nokia.com<mailto:jorge.rabadan@nokia.com>>
Cc: bess@ietf.org<mailto:bess@ietf.org>
Subject: [EXTERNAL] RE: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

Hi Sasha, Jorge and all

Consider the simplistic scenario of BGP-EVPN-Peers (and Vteps), PE1 and PE2 (might be in different/same fabrics/sites/pods), wherein,

·       PE1 supports both IP A-D and MAC A-D whereas

·       PE2 supports legacy of MAC A-D.

PE1 publishes:

·       MAC A-D with Route-Target1 (for EVI-1/VNI-1/Bride-domain-1) and

·       IP A-D (for EVI-2/VNI-2/local-VRF-x) with Route-Target2
indicating MAC aliasing and IP aliasing respectively.

Whereas, PE2 is configured for

·        (EVI-1/VNI-1/Bridge-domain-1) for importing with Route-Target1, and

·        (EVI-2/VNI-2/Bridge-domain-2) for importing with Route-Target2

PE2 can surely mistake IP A-D published by PE1 for a MAC A-D and
establishes it’s next-hop database (ecmp or otherwize) accordingly against the Bridge-domain-2 instead of ignoring the IP A-D advertisement.

The difference between IP A-D/MAC A-D (Route type-1) and the Route Type-2 is that

·       in Route Type-2, the second label and the second route-target imply that its being carried for IP-VRF

·       whereas , in Route Type-1, it comes down to configuration and operators prerogative to take care of it.


https://www.rfc-editor.org/rfc/rfc9135.html#section-5.2<https://clicktime.symantec.com/15sM1GSZo6UHTMFNWpX2g?h=G4kq24V2sHHnLgNQaaqdkxzq2a1liVTw7LqgPSNsECc=&u=https://www.rfc-editor.org/rfc/rfc9135.html#section-5.2>
If the receiving PE receives this route with both the MAC-VRF and IP-VRF Route Targets and the MAC/IP Advertisement route includes the MPLS Label2 field but the receiving PE only supports asymmetric IRB mode, then the receiving PE MUST ignore the MPLS Label2 field and install the MAC address in the corresponding MAC-VRF and (IP, MAC) association in the ARP table for that tenant (identified by the corresponding IP-VRF Route Target).

For above reasons, we should have an explicit flagging off and/or atleast a dedicate section in the draft for calling-out this scenario,
as we don’t have an organic/implicit way of distinguishing between IP-VRF and MAC-VRF related attributes being carried in Route-Type-1, unlike a Route-Type-2.

Regards,
Saumya.

From: Alexander Vainshtein [mailto:Alexander.Vainshtein@rbbn.com]
Sent: Saturday, March 25, 2023 6:43 AM
To: Jorge Rabadan (Nokia) <jorge.rabadan@nokia.com<mailto:jorge.rabadan@nokia.com>>; Dikshit, Saumya <saumya.dikshit@hpe.com<mailto:saumya.dikshit@hpe.com>>
Cc: bess@ietf.org<mailto:bess@ietf.org>
Subject: Re: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

Saumya, Jorge and all,
FWIW I concur with Jorge.

The draft states than an IP per EVI EVPN A-D route:
1.     Includes RD of IO-VEF in its NLRI
2.     Carries RT of IP-VRF.
Assuming that Import RTs of MAC-VRFs and IP-VRFs in any given PE are different, I do not see any potential for wrong mapping.

My 2c,
Sasha

Get Outlook for Android<https://clicktime.symantec.com/15sLvSFHLUnh3QRSyG7t4?h=GyX9YOygLsY9e_Nf9hF6oQ03ZR4tPLXHzRlhgVl7z-A=&u=https://aka.ms/AAb9ysg>

________________________________
From: Jorge Rabadan (Nokia) <jorge.rabadan@nokia.com<mailto:jorge.rabadan@nokia.com>>
Sent: Friday, March 24, 2023, 23:26
To: Dikshit, Saumya <saumya.dikshit@hpe.com<mailto:saumya.dikshit@hpe.com>>; Alexander Vainshtein <Alexander.Vainshtein@rbbn.com<mailto:Alexander.Vainshtein@rbbn.com>>
Cc: bess@ietf.org<mailto:bess@ietf.org> <bess@ietf.org<mailto:bess@ietf.org>>
Subject: [EXTERNAL] Re: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

Hi Saumya,

I don’t think there is any need for especial flagging and the route-target will identify in which VRF the route needs to be imported.
We have other cases in which a route type can be imported into a MAC-VRF or IP-VRF (see RFC9135) and there is no especial ‘flag’ for it. This has not caused any issues so I don’t see why A-D routes would create issues either, to me it is the same thing.

Thanks.
Jorge


From: Dikshit, Saumya <saumya.dikshit@hpe.com<mailto:saumya.dikshit@hpe.com>>
Date: Friday, March 24, 2023 at 6:50 AM
To: Jorge Rabadan (Nokia) <jorge.rabadan@nokia.com<mailto:jorge.rabadan@nokia.com>>, Alexander Vainshtein <Alexander.Vainshtein@rbbn.com<mailto:Alexander.Vainshtein@rbbn.com>>
Cc: bess@ietf.org<mailto:bess@ietf.org> <bess@ietf.org<mailto:bess@ietf.org>>
Subject: RE: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

CAUTION: This is an external email. Please be very careful when clicking links or opening attachments. See https://clicktime.symantec.com/15siFA3PedCRuwP2WEnEr?h=E0vKoxusvwRmg-2Wi4QRWfCEVPf2V0B7GpSJdjOAu1Q=&u=http://nok.it/ext<https://clicktime.symantec.com/15siFA3PedCRuwP2WEnEr?h=E0vKoxusvwRmg-2Wi4QRWfCEVPf2V0B7GpSJdjOAu1Q=&u=http://nok.it/ext> for additional information.


Thank You Jorge.

Since it’s already on the field, I have few follow up queries related to “Interworking with BGP-Peers capable of ONLY MAC-aliasing”:

As I understand that the draft does not proposes any new PDU constructs and leverages existing ones (as defined for MAC-aliasing in rfc7432) to publish IP A-D per ES and IP A-D per EVI (EVPN Route Type 1) for IP-aliasing and fast-convergence respectively.

For interworking with “BGP-EVPN peers” that comply only to MAC-aliasing and not to IP-aliasing, are there any explicit procedures defined in the draft ?

As it’s expected to be Route-Target based absorption/dropping of the IP A-D (per ES or EVI) NLRI,

is the ONLY implicit way for receive-side BGP-EVPN-Peers (only expecting MAC-aliasing in network) to ignore the IP A-D routes.

If “a” is true, then is there a possibility that EVI mappings (MPLS Labels, VNIs and corresponding Route-Targets) sent in IP A-D is being leveraged by MAC-Aliasing for an Layer-2 configuration (Bridge-domain and corresponding Route Targets) and can lead to error in processing.


Instead, will it apt to call out the IP A-D from MAC A-D via an explicit flagging in the route itself. It will save the receive side BGP-EVPN peer (only doing MAC-aliasing) from processing the IP A-D with no avail. Thus saving some processing cycles which may lead to an error state.

It will be great to have a section for “backward compatibility with MAC-aliasing ONLY peers”.

Regards,
Saumya.


From: Jorge Rabadan (Nokia) [mailto:jorge.rabadan@nokia.com]
Sent: Thursday, March 23, 2023 3:58 PM
To: Dikshit, Saumya <saumya.dikshit@hpe.com<mailto:saumya.dikshit@hpe.com>>; Alexander Vainshtein <Alexander.Vainshtein@rbbn.com<mailto:Alexander.Vainshtein@rbbn.com>>
Cc: bess@ietf.org<mailto:bess@ietf.org>
Subject: Re: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

Hi Saumya,

Yes, there are implementations deployed in networks.
For the vendor I’m aware of, it includes pretty much all transport tunnels - vxlan, mpls, sr-mpls, SRv6…
The use cases in the draft are agnostic of the transport.
Thx
Jorge
________________________________
From: Dikshit, Saumya <saumya.dikshit@hpe.com<mailto:saumya.dikshit@hpe.com>>
Sent: Thursday, March 23, 2023 09:51
To: Alexander Vainshtein <Alexander.Vainshtein@rbbn.com<mailto:Alexander.Vainshtein@rbbn.com>>; Jorge Rabadan (Nokia) <jorge.rabadan@nokia.com<mailto:jorge.rabadan@nokia.com>>
Cc: bess@ietf.org<mailto:bess@ietf.org> <bess@ietf.org<mailto:bess@ietf.org>>
Subject: RE: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt


CAUTION: This is an external email. Please be very careful when clicking links or opening attachments. See http://nok.it/ext<https://clicktime.symantec.com/15siFA3PedCRuwP2WEnEr?h=E0vKoxusvwRmg-2Wi4QRWfCEVPf2V0B7GpSJdjOAu1Q=&u=http://nok.it/ext> for additional information.


Hello Authors of draft-sajassi-bess-evpn-ip-aliasing,

If there is an implementation reference from any Vendor for this draft https://datatracker.ietf.org/doc/draft-sajassi-bess-evpn-ip-aliasing/<https://clicktime.symantec.com/15siKzEg7Et2KtCx3oBPU?h=wNU3T3Cevp1QqxepBtv7LOJDxf-F4f7-WvODlSy5Hos=&u=https://datatracker.ietf.org/doc/draft-sajassi-bess-evpn-ip-aliasing/>.
It will be good to know if the reference fabric for the implementation. Does it includes Vxlan, if not others ?

Regards,
Saumya.

From: BESS [mailto:bess-bounces@ietf.org] On Behalf Of Alexander Vainshtein
Sent: Tuesday, January 10, 2023 9:14 PM
To: Jorge Rabadan (Nokia) <jorge.rabadan@nokia.com<mailto:jorge.rabadan@nokia.com>>
Cc: bess@ietf.org<mailto:bess@ietf.org>
Subject: Re: [bess] New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

Jorge and all,
I have read the latest revision of the draft and I agree that it is ready for the WG adoption call.
From my POV it meets the two conditions that, IMHO, define WG adoption:
It addresses a real problem
It provides a reasonably good start for solution of this problem.

My 2c,
Sasha

From: BESS <bess-bounces@ietf.org<mailto:bess-bounces@ietf.org>> On Behalf Of Jorge Rabadan (Nokia)
Sent: Tuesday, January 10, 2023 3:52 PM
To: bess@ietf.org<mailto:bess@ietf.org>
Subject: [EXTERNAL] [bess] FW: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

FYI

We just updated this draft based on the comments made by Sasha on the list. We also fixed some nits and updated references.
We’d like to reiterate that document is ready for WG adoption call.

Thanks.
Jorge

From: internet-drafts@ietf.org<mailto:internet-drafts@ietf.org> <internet-drafts@ietf.org<mailto:internet-drafts@ietf.org>>
Date: Tuesday, January 10, 2023 at 2:40 PM
To: A. Sajassi <sajassi@cisco.com<mailto:sajassi@cisco.com>>, G. Badoni <gbadoni@cisco.com<mailto:gbadoni@cisco.com>>, J. Drake <jdrake@juniper.net<mailto:jdrake@juniper.net>>, Jorge Rabadan (Nokia) <jorge.rabadan@nokia.com<mailto:jorge.rabadan@nokia.com>>, L. Krattiger <lkrattig@cisco.com<mailto:lkrattig@cisco.com>>, P. Warade <pwarade@cisco.com<mailto:pwarade@cisco.com>>, S. Pasupula <surpasup@cisco.com<mailto:surpasup@cisco.com>>, Ali Sajassi <sajassi@cisco.com<mailto:sajassi@cisco.com>>, Gaurav Badoni <gbadoni@cisco.com<mailto:gbadoni@cisco.com>>, John Drake <jdrake@juniper.net<mailto:jdrake@juniper.net>>, Jorge Rabadan (Nokia) <jorge.rabadan@nokia.com<mailto:jorge.rabadan@nokia.com>>, Lukas Krattiger <lkrattig@cisco.com<mailto:lkrattig@cisco.com>>, Priyanka Warade <pwarade@cisco.com<mailto:pwarade@cisco.com>>
Subject: New Version Notification for draft-sajassi-bess-evpn-ip-aliasing-06.txt

A new version of I-D, draft-sajassi-bess-evpn-ip-aliasing-06.txt
has been successfully submitted by J. Rabadan and posted to the
IETF repository.

Name:           draft-sajassi-bess-evpn-ip-aliasing
Revision:       06
Title:          EVPN Support for L3 Fast Convergence and Aliasing/Backup Path
Document date:  2023-01-10
Group:          Individual Submission
Pages:          20
URL:            https://www.ietf.org/archive/id/draft-sajassi-bess-evpn-ip-aliasing-06.txt<https://clicktime.symantec.com/15siVeDMbsp2p1wKgTxN4?h=Bx1_zlXLVe5CXSl4uPQinOw4O-VdjSd1bRQf_MxBmjQ=&u=https://www.ietf.org/archive/id/draft-sajassi-bess-evpn-ip-aliasing-06.txt>
Status:         https://datatracker.ietf.org/doc/draft-sajassi-bess-evpn-ip-aliasing/<https://clicktime.symantec.com/15siKypngeSqz8HUbMA4p?h=izZF6rfMzUeFiWQGKAhvgPS53_OWNi_PQUtGVJSJxQo=&u=https://datatracker.ietf.org/doc/draft-sajassi-bess-evpn-ip-aliasing/>
Htmlized:       https://datatracker.ietf.org/doc/html/draft-sajassi-bess-evpn-ip-aliasing<https://clicktime.symantec.com/15siQp259G8SQ57Q8uZDS?h=oAVtm-7JQjfNt-rdM331nh6a308FM7ntGGsF4o4NBws=&u=https://datatracker.ietf.org/doc/html/draft-sajassi-bess-evpn-ip-aliasing>
Diff:           https://author-tools.ietf.org/iddiff?url2=draft-sajassi-bess-evpn-ip-aliasing-06<https://clicktime.symantec.com/15siF9dWE2mFaBTZ3nkvC?h=tpILk5e82UtksHG0WfCcO2FrK_oHNes6kqzFmThK-S8=&u=https://author-tools.ietf.org/iddiff?url2=draft-sajassi-bess-evpn-ip-aliasing-06>

Abstract:
   This document proposes an EVPN extension to allow several of its
   multihoming functions, fast convergence and aliasing/backup path, to
   be used in conjunction with inter-subnet forwarding.  The extension
   is limited to All-Active and Single-Active redundancy modes.




The IETF Secretariat

Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. and its Affiliates that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments.


Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. and its Affiliates that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments.

Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. and its Affiliates that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments.

Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. and its Affiliates that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments.