Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/2022 to 7/27/2022) - Operational Differences
Kaliraj Vairavakkalai <kaliraj@juniper.net> Fri, 22 July 2022 00:35 UTC
Return-Path: <kaliraj@juniper.net>
X-Original-To: idr@ietfa.amsl.com
Delivered-To: idr@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E796DC15A73D for <idr@ietfa.amsl.com>; Thu, 21 Jul 2022 17:35:15 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.687
X-Spam-Level:
X-Spam-Status: No, score=-2.687 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.582, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=juniper.net header.b=JGbkxU0F; dkim=pass (1024-bit key) header.d=juniper.net header.b=BTsU+JS2
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ihLHwV8hxiWw for <idr@ietfa.amsl.com>; Thu, 21 Jul 2022 17:35:11 -0700 (PDT)
Received: from mx0b-00273201.pphosted.com (mx0b-00273201.pphosted.com [67.231.152.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 01D24C13C534 for <idr@ietf.org>; Thu, 21 Jul 2022 17:35:03 -0700 (PDT)
Received: from pps.filterd (m0108163.ppops.net [127.0.0.1]) by mx0b-00273201.pphosted.com (8.17.1.5/8.17.1.5) with ESMTP id 26LG0XKe010502; Thu, 21 Jul 2022 17:35:03 -0700
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=PPS1017; bh=owrzfx+UGS1/m3JRNh8cRTTn6HVO4ci8sl9CJTq6EKc=; b=JGbkxU0FkWq7FhjKaCWyXqHZvq79loUxmlOTxWGlIchLxVzWXsLhkfXtm8AUGYC+fz76 y84gA3kEhvJZ5d3BfBRiR72t2YQ0lPc0P3nL3sqyDC8VIkASX6jAPLBuISKrlI+v1sf8 KCICGH72awUTHqW2AVAG/w+CpTBsx+ZVACR1dX8ugpg2l9JIsYPMaz7+N/ZTXWvlxIaB +g3RIsjA81aOQ4zTXhNcEEqpYAXh6EfPOWarRA48jgKp6rHJAvOaGiS4e6+eCiZ5Nf9l RXJbi94BgKA/p1MzUlCBKgS1O8Zh00pbGI8QTJ3DmknV9agyQulkaHAUiJcxu/2aSqlj qQ==
Received: from nam10-bn7-obe.outbound.protection.outlook.com (mail-bn7nam10lp2106.outbound.protection.outlook.com [104.47.70.106]) by mx0b-00273201.pphosted.com (PPS) with ESMTPS id 3hf9xpgttf-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 21 Jul 2022 17:35:02 -0700
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=LjuHOxxU7H8GJk4v6kTLHTs5zV7kzILD4aadIF2rgvpJVsCRuAniJ1x/c69sB31ppxofMD4DooRIpeglxSQiS9Cti5VppBmvFuf7hWYpYdqgoNJrLW42eZ1foozDA2d2EmUz9gsEYWUYUb9lq2nSaWawWk1Q7KWfMvzQKg4PDYKedJwnT5YwLeSzB7Pp8ryXSFKuWYowjQMWveJgcgzdFO+GlCOGgSDDutXLpnf/aNQJCWchroShtTHrNPZLEp6rFDKK/6fh0THc/WrkfMcyikbmfQfH7XQKRzyv+GCgKMBM27LpZNBN98gDAze0Eyhz6rKV6svxS0lgMhiYbwAPhQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=owrzfx+UGS1/m3JRNh8cRTTn6HVO4ci8sl9CJTq6EKc=; b=IiOb9ym8+/Kn7HmZ2KdNFMXDRUndb+6iKPz6MxSbVGY2zm/uGNEtyI6FoQPs2ZcAySfClOVFEQ9Y9eGdDwVIt06qqgwX5fj15lOzS8AhKtVQvXqY7sOnWUvR5Ntr9v0YOdo238zsc9gec08IeRhd5KM1v4mKJZrUw6BpKSYDODk3oNZtLHu8kG7Iv8X8dpA8bxGVrtIf4y9K2ItYDXB/kfl3sEbaU6ZbZENQNnepvymo9+HKYj5CZROZlwKQlHArrFvAduNvYK86flDBSWvDtvw/94IIKCUw1lXQ1fZx8gddXIJNxab0m78D6qn4Y3+wDbQnG7+VG0yZziAPS0RLig==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=owrzfx+UGS1/m3JRNh8cRTTn6HVO4ci8sl9CJTq6EKc=; b=BTsU+JS2qKiZBC1knkjmT1aGsgsBzAPb5oEogX486byUNCG++GM48fc0/280jsZ/wxXkK29MNMeNOCBOK5p9hv4DvRA1O1dpA7TdRp1sjy2+/T5uLtErW0V3P15IOQPR4fpVY+Wg9pWyro3S9WPu8lqDcdQ3BZXHU4xoexEJhfw=
Received: from SJ0PR05MB8632.namprd05.prod.outlook.com (2603:10b6:a03:394::12) by DM6PR05MB7115.namprd05.prod.outlook.com (2603:10b6:5:201::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5458.15; Fri, 22 Jul 2022 00:34:58 +0000
Received: from SJ0PR05MB8632.namprd05.prod.outlook.com ([fe80::5d4e:743b:9eb3:7002]) by SJ0PR05MB8632.namprd05.prod.outlook.com ([fe80::5d4e:743b:9eb3:7002%8]) with mapi id 15.20.5482.001; Fri, 22 Jul 2022 00:34:58 +0000
From: Kaliraj Vairavakkalai <kaliraj@juniper.net>
To: "bruno.decraene@orange.com" <bruno.decraene@orange.com>
CC: Susan Hares <shares@ndzh.com>, "idr@ietf.org" <idr@ietf.org>
Thread-Topic: [Idr] Part 3 of CAR/CT Adoption call (7/14/2022 to 7/27/2022) - Operational Differences
Thread-Index: AdiXvjmuH40+TjfISXyiOJBhpKkUGQDmK1RQAB67p+EARdgLMAAZfYmq
Date: Fri, 22 Jul 2022 00:34:58 +0000
Message-ID: <SJ0PR05MB8632DF223A5992BB23D75F2AA2919@SJ0PR05MB8632.namprd05.prod.outlook.com>
References: <BYAPR08MB4872312AE7023B3DDA2E598AB3889@BYAPR08MB4872.namprd08.prod.outlook.com> <15817_1658233882_62D6A41A_15817_488_1_d967d01af2f443b08a1e7babbea7ce5f@orange.com> <SJ0PR05MB863234B83DE36162A59C5AB7A28E9@SJ0PR05MB8632.namprd05.prod.outlook.com> <6002_1658409038_62D9504E_6002_180_1_bb924c29d203490b94f85dd8f574d0cd@orange.com>
In-Reply-To: <6002_1658409038_62D9504E_6002_180_1_bb924c29d203490b94f85dd8f574d0cd@orange.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
msip_labels: MSIP_Label_f47c794b-e3ab-43f0-9e0f-29fc3e503192_Enabled=True; MSIP_Label_f47c794b-e3ab-43f0-9e0f-29fc3e503192_SiteId=90c7a20a-f34b-40bf-bc48-b9253b6f5d20; MSIP_Label_f47c794b-e3ab-43f0-9e0f-29fc3e503192_SetDate=2022-07-21T13:10:36.0000000Z; MSIP_Label_f47c794b-e3ab-43f0-9e0f-29fc3e503192_Name=Orange_restricted_external.2; MSIP_Label_f47c794b-e3ab-43f0-9e0f-29fc3e503192_ContentBits=2; MSIP_Label_f47c794b-e3ab-43f0-9e0f-29fc3e503192_Method=Standard; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=True; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2022-07-21T22:13:57.0034953Z; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ContentBits=0; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Method=Standard
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 35c01803-b3a0-4b76-14ef-08da6b7a01d2
x-ms-traffictypediagnostic: DM6PR05MB7115:EE_
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: /Kbv/CbURZ7CUF7fw9xilBtWBbJD+mFqf2/fITX4dv33HuMmMmA4bTbBiZkPQaNFqkdLXHqB1o/EQxC/lptRXQDhEYtgrl4QXwhWXsnvCOCrD8GiEAhAo5YpyJZ1smrtQwjeN4+qzP9L/3iimRr9wJXpwapBcudhrnpzQ6DLpPAXZ+MWylB3NIWkEYzKvFxbGfRHTjqUGFPHvxqrlImHasMc20xoQTxvTjm5g5yYo0eUS6k4G7ehES+l3RwXZ9xuOWlIcx6Hxh+XsvcOHL9agUdNqSY+K/8xDp7aIrx4UO1xYM6Xin7tVQ4rxBmAoCKpuzE0RZB5qrvYADhMxRauK+cGqhMljVG2Frl5LkyF9yTomcwq3Lj5iOWdK3UFAqdTSDLZoq9OF0DmecaRUAQhFnuLmMb1MK8ZHBGNu6bJY45o8nvXXseRfUyCRANCzM4Ay3TbUd3gEpkogKB+xzHbarteJz2Em5YVJTv9+hSA9GAoT4OmbcNym5DEQaL7/8iQqSkLGIz3eexiLQ9sMjThTyMfl/7sEQE7GwQBjjXmJefmL3F/0u9yjd1tOmnQ+VtMnKWlsXIJJc99PGUlrjYTTRU/bZPvM6lsfvzzuZcuCQ/suyTvt9Jv3r/y5TRu5BSD87lzVpp5yONqjyRWbarYIPvbQwWMF1vzgZWp6vU/XpZLqo+vG03/smkg9gTVsWg23MTTkBX9LBuiOWFBNLeedBvlXQf5ZnSeqHKoUeYoNSNfhI/dNoI2TCxImRGYwJiDPs+qYsOoXNT5tc+uedqLSr9S0GKH8YQACYLQhAcXUS3bFCNlg9Lwfj8CBRZ/vFG84kxgNFZadbRIDYMNC2BE/yS/EtIMXGl7Tmwlqx9lNwtqR+Xx7F+iYKIyTPg6ytCN
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SJ0PR05MB8632.namprd05.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230016)(4636009)(346002)(376002)(396003)(366004)(136003)(39860400002)(9686003)(41300700001)(38100700002)(26005)(122000001)(7696005)(5660300002)(8936002)(55016003)(30864003)(8676002)(966005)(52536014)(83380400001)(33656002)(66574015)(6506007)(86362001)(66946007)(38070700005)(66476007)(71200400001)(4326008)(166002)(66556008)(478600001)(54906003)(53546011)(76116006)(64756008)(186003)(66446008)(2906002)(6916009)(316002)(99936003)(559001)(579004); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: ultKXcKU2CWwGYwx2Q8nRxmV0sAmayoXiL3n7AFzrAGuOhHaUS4Dyj1NF5FBw0q/pROpb5b56AbGVqSImYORcNTpNKl9WtvrK8WxC/z69qI7Glz1Zdh1NXgll4I94bSGzFLFJRSCgJOdChyaZKdef/2FcN5yGr3CMqLOhKOeR1w2NoBphwrcI5GA6i6Ts4gOZLH5y5eApMlN60NF+OK+JfmSWOsIJHekwQjAKqiECnDTyvXNS0C6mf+78jVQM2wWaZv9Hs70BzKjzbHaHHjZ2iQBBakrio5DdSjxzeUxP2pMx1oYsuM5D6Zn7bN1w05h4l7yTsV2GLAE62xTS80QB2uyTjWCtKZBSB4fYxN73gxPEcUoAC/0dIHHXcvtiUuTa3R+WKsAIxgCbQuB0sGda6pQ1HQ4o+Sl+iJ/NRXU56J92UotjwHc/Z0HUONUvdihuSl0OOQ3usUWYl1jywX5PaQ9yWfneHJpz4qsAy8BO3nSyjXes3akxL+WMAIOHrtH3TJpjv3HEd6cHvNqizZ4q0kJba20Z75isNUOFobJyX/+x2L9tXEdEgCIQzUCFe4zu61kH3LTie5dgMJELj1bLvvt0n8FsE2zl0K+juUxuwMnnZZCBunMccoB/SyrZRPYy3+9JKRgzP11jv3crG5XhrwXsRaGyeO3pOULVHfju+qhJeZRVmvYc3uFPyDLADZNvfxKhzYvTDGOQQkM5ufJnRNuOVivldR+y9NZmE9W2P/STv9RBn4qYWu5iyv5dhiQIB1UyKoy5zYbvxvSsRKvNtIfakM2E9JEQaqv4ElTEwkMuPc/9db9E6LN1S4GrJ6FLNAmx9AaUXMDTIO+Kj84aHv7wnX4BFJLPv0Bldcbo1a2GMXtc6BHqtE0/WORQm6ECsTP1jOthlW5rjH+wfFaszffbOCMRqfYBNmYeUdXoFMcVvnGZppE0FhHhM0Y6nqrjJ+bTQd+YdUeaSAF5tTiUBKosrMxFj1NaffCBYb61fn9nhru/t5rroOxBdt+KNaSb4PKQ5+WowDQ5KH/iXXH5k5Ahoe5i0YuZ9sB249z3qQOC/IgsQ05B4Q8hnuOxrTGoEMR5dApBw5BVsw/ELeAE03G68vCv6dIGJM5pwb/P499kgSk3ChTyv+smU5Hf1pv0qdEIVJO7e9IZBFm8odKGnMXOddglyqAtyrD6E/fCa0gvKneFJv7ZWGzI2i7YbX5rRZnDrN0JBg6AqPLh8o1NTJ5ie3so7vztqYPf5eckv/7a37/3rAhqacooyT+/zGqc/REtI15jRw8TG4NXRI8XaDY8UVuntC8/0Bj1GQ2y2VzA6Ae+UMYY3kC+ijiur0Hi73tyv/CgefFKxh2uLSk9Q6CFxms9iWsFV4w4hSSI6toqE19T2pUc9M7g35mXxA120DVXMiluODcT0N3ZB22W4SJOYTNEH6x5oK/8OQO59HN1WJrc19uVhJHEBPcitQpCevk8nHxrFaXB+ksXC6E8oQ9R/yqhhTL01wUJ770L91I+V8tgXLgA9XTU75+c1+7rW+ctNJgn97aEXOABThDMjUKV/sTtAX03d8QKGbcviYWMcxNsPKryhRlPAusGz079gm9Jkn1SaLKAcWiI/tfFQ==
Content-Type: multipart/related; boundary="_004_SJ0PR05MB8632DF223A5992BB23D75F2AA2919SJ0PR05MB8632namp_"; type="multipart/alternative"
MIME-Version: 1.0
X-OriginatorOrg: juniper.net
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: SJ0PR05MB8632.namprd05.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 35c01803-b3a0-4b76-14ef-08da6b7a01d2
X-MS-Exchange-CrossTenant-originalarrivaltime: 22 Jul 2022 00:34:58.6761 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: ASlo3hPI8KvVwqWP7g1q+jTEl8LY/IoNG4L+h2kPRC+L4v9lQdClAsSW8q4sDFcr7dQJ5oSgQ5tiofZTtXt/Rg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR05MB7115
X-Proofpoint-ORIG-GUID: ZnGEjsOahPfrm2LEwPFckwN2xv52nL36
X-Proofpoint-GUID: ZnGEjsOahPfrm2LEwPFckwN2xv52nL36
X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.883,Hydra:6.0.517,FMLib:17.11.122.1 definitions=2022-07-21_28,2022-07-21_02,2022-06-22_01
X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 lowpriorityscore=0 phishscore=0 clxscore=1015 malwarescore=0 suspectscore=0 mlxscore=0 bulkscore=0 impostorscore=0 priorityscore=1501 mlxlogscore=999 spamscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2206140000 definitions=main-2207210100
Archived-At: <https://mailarchive.ietf.org/arch/msg/idr/Ur67Wsp8ABmyIINGFi2uHjLg47I>
Subject: Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/2022 to 7/27/2022) - Operational Differences
X-BeenThere: idr@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Inter-Domain Routing <idr.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/idr>, <mailto:idr-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/idr/>
List-Post: <mailto:idr@ietf.org>
List-Help: <mailto:idr-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/idr>, <mailto:idr-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 22 Jul 2022 00:35:16 -0000
Bruno, inline pls. Thanks, Kaliraj From: bruno.decraene@orange.com <bruno.decraene@orange.com> Date: Thursday, July 21, 2022 at 6:10 AM To: Kaliraj Vairavakkalai <kaliraj@juniper.net> Cc: Susan Hares <shares@ndzh.com>, idr@ietf.org <idr@ietf.org> Subject: RE: [Idr] Part 3 of CAR/CT Adoption call (7/14/2022 to 7/27/2022) - Operational Differences [External Email. Be cautious of content] Hi Kaliraj, Thanks for taking the time to reply. Please see inline [Bruno] Orange Restricted From: Kaliraj Vairavakkalai <kaliraj@juniper.net> Sent: Wednesday, July 20, 2022 5:19 AM To: DECRAENE Bruno INNOV/NET <bruno.decraene@orange.com>; Susan Hares <shares@ndzh.com>; idr@ietf.org Subject: Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/2022 to 7/27/2022) - Operational Differences Hi Bruno, I feel like you may not be considering Anycast EP? [Bruno] - without “EP”: my reading is that implicitly, you means that Anycast (without “EP”) worst just fine with BGP CAR. So let’s make this explicit. KV> No. I meant ‘Anycast Endpoint’. I meant, CAR can mis-route for ‘Anycast Endpoints’ in non-agreeing color domains. - with “EP”: I’m not completely certain what “EP” means. From BGP-CT, “EP : End point, a loopback address in the network.”. Anycast EP is not self-explicit to me, KV> Anycast EP is an ‘Anycast IP-address’, that would be used as nexthop in BGP service route updates. but from below email, I’ll assume that it’s “anycast” but not really “any” i.e. Ingress wants visibility of each path and be able to select the one it want. KV> The mis-routing observation is for non-agreeing color domains, using anycast endpoints. Please see following threads that discuss possibility of Mis-routing, ECMP, and Color management problems with Anycast-EP deployments, when using Color in NLRI. https://mailarchive.ietf.org/arch/msg/idr/nAj25sX0x_lp09VEqUDSCxmDR_w/<https://urldefense.com/v3/__https:/mailarchive.ietf.org/arch/msg/idr/nAj25sX0x_lp09VEqUDSCxmDR_w/__;!!NEt6yMaO-gk!C4w6ZczSTEpo1-jQ373xH2qTNYLEQFnOgZ18EOZVMr6sKSlhs2Izv8MFExT4nVLKukZ1LU9GVhBEqU1zyVMBE8jSyw$> [Bruno] Honestly, I’m not seeing any “Mis-routing, ECMP, and color management problems”. I’m seeing some questions been asked. KV2> It is the second email-thread that talks about Misrouting. Pasting link again here: KV2> https://mailarchive.ietf.org/arch/msg/idr/yI9y1iik3hO-dATSrvi4ST4K9CY/ KV2> Shunwan seems to understand the problem. And DJ as-well. All DJ is saying is the color KV2> needs to be coordinated, and when doing so, the color-management problem appears for KV2> the ‘improving visibility to ingress’ case. I don’t feel that my email and your above thread are discussion the same point: KV2> They are related. I’ll try to connect the dots. Please read on.. - My original email is on NLRI.key. One want (at least) one path per (Intent, EndPoint). Hence IMO as per BGP (4271) BGP rule, the natural encoding of the NLRI.key is to include (EndPoint, Intent). KV2> So in the example (non agreeing color domains), @D2 (IP1,100), LCM=200 (from D3) (IP1,100) (from D4) KV2> The two routes indicate different ‘effective-intent’, even though they have same Color value in the NLRI. KV2> So path-selection uses these two routes to do ECMP/protection. Ref : https://datatracker.ietf.org/doc/html/draft-dskc-bess-bgp-car-04#section-2.7 - Your thread seems to be about color resolution/indirection between the service route and the transport route. KV2> It is about the resolution of the Transport-route(CAR) over the correct intent. KV2> because the ‘effective intent’ of these paths is not the same (one of them has an LCM) KV2> they resolve over different intents. But path-selection NLRI.key does not take this into account. KV2> So traffic intended for SLA 100 can get routed into SLA 200, or the reverse. Hence, mis-routing is possible. On this point, my co-authors would be much more competent to reply. A priori, it seems to me that the use of Local-Color-Mapping (LCM) Extended Community addresses your point (mapping to a third color if needed; which represent the intent as seen by the service). And, speaking for myself only, if you/the WG really want to have this resolution color always encoded in a community, one could possibly always attach this community (up to mandating this in the draft is needed). That seems like an optimization/minor point to me (i.e. nothing fundamental) KV2> From my analysis of CAR so far, I see the procedures specified there work for simple cases, that dont involve Anycast or Non-agreeing Color-domains. KV2> As a WG member, I feel necessary to alert the customers that they should consider these scenarios when deploying CAR. Once agreement is reached, KV2> it may be best to describe these as Caveats in the CAR draft. KV2> BGP-CT handles all these cases without exception, because it follows RFC-4364 procedures. Please read on. https://mailarchive.ietf.org/arch/msg/idr/OOZOBSyjdAYBar8NxvOqo6-5fAc/<https://urldefense.com/v3/__https:/mailarchive.ietf.org/arch/msg/idr/OOZOBSyjdAYBar8NxvOqo6-5fAc/__;!!NEt6yMaO-gk!C4w6ZczSTEpo1-jQ373xH2qTNYLEQFnOgZ18EOZVMr6sKSlhs2Izv8MFExT4nVLKukZ1LU9GVhBEqU1zyVONUnWQRA$> [Bruno] IP anycast, by definition, mandates coordination between the endpoints (‘ domains) to agree on the IP to use. So coordination is granted and IMO they should also coordinate on the color to use. (if it were me, I’d say that the “owner” of the IP address is the one choosing/allocating the color to use). With that, I think that the problem does not exist. KV2> The scenario being discussed here is administrative-domains which don’t have one Color-namespace across all the domains. KV2> Sure, the problem can be solved in different places. CT solves it in the protocol. In CAR operators coordinate that problem doesn’t happen. KV2> All customer networks may not be able to reach such an agreement, to have single color namespace. Especially across network mergers. (note that one could probably find a similar example with BGP-CT. With RD type 1, the administrator field is an IP address. An easy choice seems to use the IP address of the endpoint. In which case, it seems to me that with BGP-CT one could have (derived from your email) @D2 (01:IP1:O1:IP1), TCID=200 (from D3) (01:IP1:O1:IP1), TCID=100 (from D4) (01:IP1:O2:IP1), TCID=100 (from D3) (01:IP1:O2:IP1), TCID=200 (from D4) Note: 01:IP1:01:IP is RD:Endpoint and more precisely “RD type”:” Administrator subfield”: Assigned Number subfield:EndPoint IP address With that BGP-CT have the same problem KV2> Nope. CT doesn’t have a problem. Because the endpoint routes are organized in a Transport-Route-DB, which is per TC. KV2> So, we will have : KV2> TC100 TRDB : KV2> (IP1), (from D4) KV2> (IP1), (from D3) KV2> TC200 TRDB : KV2> (IP1), (from D3) KV2> (IP1), (from D4) KV2> So the path selection that happens in the TRDB (context of TCID) KV2> does not mix different SLAs, irrespective of what the NLRI key contains. (same NRLI.index for different intents). In both cases, the root cause is that the owner of IP1 needs to coordinate/maintain the sub allocations spaces (color for BGP-CAR, Assigned Number subfield for BGP-CT) Regards, --Bruno Further pls see inline for some responses on RD usage. KV> Thanks Kaliraj From: Idr <idr-bounces@ietf.org<mailto:idr-bounces@ietf.org>> on behalf of bruno.decraene@orange.com<mailto:bruno.decraene@orange.com> <bruno.decraene@orange.com<mailto:bruno.decraene@orange.com>> Date: Tuesday, July 19, 2022 at 5:31 AM To: Susan Hares <shares@ndzh.com<mailto:shares@ndzh.com>>, idr@ietf.org<mailto:idr@ietf.org> <idr@ietf.org<mailto:idr@ietf.org>> Subject: Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/2022 to 7/27/2022) - Operational Differences [External Email. Be cautious of content] Hi Sue, all, > This forum (Part 3) is place to discuss operational differences between the CAR and CT drafts. > These procedures for this mail thread are: > A. On original discussion on point in a draft > 1. Text in either the CAR or CT draft that is applicable to the operational difference. I think that a key point is the NLRI key, i.e. the Network Layer Reachability Information, aka the reachability that we are interested in. I’m assuming that it is clear that the reachability that we want to advertise is (EndPoint, Color). IOW, we want (at least) a path to each (EndPoint, Color). BGP CAR uses exactly that key: “NLRI Key: IP Prefix, Color” https://datatracker.ietf.org/doc/html/draft-dskc-bess-bgp-car-05#section-2.1<https://urldefense.com/v3/__https:/datatracker.ietf.org/doc/html/draft-dskc-bess-bgp-car-05*section-2.1__;Iw!!NEt6yMaO-gk!BUOqY4kARoJB8KWs7XqqThd3l2Sv8Ku8YKKxy3R_zz6aZR0rLFIRVHbu5DlIWdiV8gdIxjKLNk7ISrMEAcohYAerDQ$> “ 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | NLRI Length | Key Length | NLRI Type |Prefix Length | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | IP Prefix (variable) // +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | Color (4 octets) | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ » https://datatracker.ietf.org/doc/html/draft-dskc-bess-bgp-car-05#section-2.9.2<https://urldefense.com/v3/__https:/datatracker.ietf.org/doc/html/draft-dskc-bess-bgp-car-05*section-2.9.2__;Iw!!NEt6yMaO-gk!BUOqY4kARoJB8KWs7XqqThd3l2Sv8Ku8YKKxy3R_zz6aZR0rLFIRVHbu5DlIWdiV8gdIxjKLNk7ISrMEAcqJwMTh0w$> BGP CT uses a different key, namely (RD, EndPoint): KV> yes, and the color is carried in the RT. RD dont carry any meaning, just a distinguisher. KV> So path-selection happens for just ‘EP’ in context of a Color (Transport class Route DB). “When AFI/SAFI is 1/76, the Classful Transport NLRI Prefix consists of an 8-byte RD followed by an IPv4 prefix.” “ 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | Length | Label |Rsrv |S| +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ ~ Route Distinguisher (8 bytes) | | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | IPv4/IPv6 Prefix ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ Fig 2: SAFI 76 "Classful Transport" NLRI” “Route Distinguihser: 8 byte RD as defined in [RFC4364 Sec 4.2].” https://www.ietf.org/archive/id/draft-kaliraj-idr-bgp-classful-transport-planes-17.html#name-bgp-classful-transport-fami<https://urldefense.com/v3/__https:/www.ietf.org/archive/id/draft-kaliraj-idr-bgp-classful-transport-planes-17.html*name-bgp-classful-transport-fami__;Iw!!NEt6yMaO-gk!BUOqY4kARoJB8KWs7XqqThd3l2Sv8Ku8YKKxy3R_zz6aZR0rLFIRVHbu5DlIWdiV8gdIxjKLNk7ISrMEAcrmRg2_nQ$> > 2. Provide a sample topology. [cid:image001.jpg@01D89CFA.65ED09A0] > 3. Discuss the pros/cons clearly stating whether your post is a: pro, con, or clarifying question. BGP CAR uses the key/NLRI that we do want to propagate: (EndPoint, Color). That’s a good fit. BGP CT uses, as key, (RD, Endpoint), with RD as defined in RFC4364. Two observations: a) (RD, Endpoint) is not the NLRI that we want to reach. We want to reach (EndPoint, color) KV> EP with Transport-Target:0:<color> gives that info. RD is just the messenger, disambiguator KV> in BGP updates. b) In VPN/RFC4364, the purpose of the RD is to _distinguish_ EndPoint (IP prefix) because they are not unique across VPNs. That is not needed for the BGP color use case because EndPoint are Public (or a minimum agreed upon by a set of consenting adults) KV> Even here, an EP has a different personality in context of a transport-layer color. KV> E.g. in your topology, the reachability info to reach EP ‘E’ via a certain Color Gold KV> is different from the reachability info to reach same EP via a different color Bronze. KV> So though EP E is a provider-space ‘public’ IP-address, it has a different per color KV> persona/instance, which need to be distinguished in a BGP update. CAR uses KV> color to disambiguate those instances in a BGP-update, CT uses RD. “a” and “b” are two arguments against using (RD, EndPoint) as the NLRI.key. There has been some argument that RD may be useful to advertise multiple path for a destination (Endpoint, Color) or even to identify the source of the advertisement. - This is not inline with the definition of RD / RFC4364 which states “An RD is simply a number, and it does not contain any inherent information; it does not identify the origin of the route or the set of VPNs to which the route is to be distributed. The purpose of the RD is solely to allow one to create distinct routes to a common IPv4 address prefix. » https://datatracker.ietf.org/doc/html/rfc4364#section-4.1<https://urldefense.com/v3/__https:/datatracker.ietf.org/doc/html/rfc4364*section-4.1__;Iw!!NEt6yMaO-gk!BUOqY4kARoJB8KWs7XqqThd3l2Sv8Ku8YKKxy3R_zz6aZR0rLFIRVHbu5DlIWdiV8gdIxjKLNk7ISrMEAcpHQUYXfQ$> KV> RD does not identify destination or source of route, for route leaking purposes. But _when_ unique RDs are KV> in use, it does aid in troubleshooting. That is what we meant. We do recommend using unique-RDs, but not KV> mandatory. Same-RDs MAY be used when path-information need to be filtered out. KV> https://datatracker.ietf.org/doc/html/draft-kaliraj-idr-bgp-classful-transport-planes-17#section-10.9<https://urldefense.com/v3/__https:/datatracker.ietf.org/doc/html/draft-kaliraj-idr-bgp-classful-transport-planes-17*section-10.9__;Iw!!NEt6yMaO-gk!C4w6ZczSTEpo1-jQ373xH2qTNYLEQFnOgZ18EOZVMr6sKSlhs2Izv8MFExT4nVLKukZ1LU9GVhBEqU1zyVNMBqEirg$> KV> Deploying unique RDs is strongly RECOMMENDED because it helps in KV> troubleshooting by uniquely identifying originator of a route and KV> avoids path-hiding. KV> Following email from Balaji nicely summarises the benefits of using RD : KV> https://mailarchive.ietf.org/arch/msg/idr/mZEyLrvb2ooXDvGMryznZBac7BE/<https://urldefense.com/v3/__https:/mailarchive.ietf.org/arch/msg/idr/mZEyLrvb2ooXDvGMryznZBac7BE/__;!!NEt6yMaO-gk!C4w6ZczSTEpo1-jQ373xH2qTNYLEQFnOgZ18EOZVMr6sKSlhs2Izv8MFExT4nVLKukZ1LU9GVhBEqU1zyVOhWOcP8A$> That RD purpose is absolutely not needed in the use case that we are discussing, because the IP address prefix is unique/has a single meaning. KV> Consider Anycast use-cases, where the same EP may be used on multiple nodes, so not unique. So really no need to re-add a RD with public name space, which would typically contain …. an IP address in most discussions (and possibly the same IP address of the EndPoint if the route is sourced by the destination…). So in summary, the NLRI.key proposed in BGP CT (RD, EndPoint) is not a good fit. While the NLRI.key proposed in BGP CAR (EndPoint, Color) is the right fit. KV> Please see threads referred to in beginning on this email that describe problems because of color is carried in NLRI. Going further, let’s assume that we have a RD field because… we have one. What could be its use? One proposal was to advertise the source. But this explicitly contradicts RD definition in RFC4364 (cf above). This is also not the typical operational model, both for Internet and VPN, where the source is typically indicated using a community or extended community (e.g., site of origin). KV> It is good to hear consensus that things like SOO Community are in common use, which affect the update packing arguments. One proposal was to advertise multiple paths for the same destination. However: - RD(s) is(are) chosen by the originator ie. the egress domain. There is no reason that this AS choose the right number of paths as best fists all others (ingress, transit) ASes. E.g. in above figure, AS1 may advertise 3 RD/paths, while may be AS3 would be willing to have 5 RD/paths. KV> The RDs chosen by egress-domain are propagated as-is by transit domain to ingress. This model does not need additional KV> Colors in those transport-networks. The Egress may originate RD per service-function or stats-group. I agree that these KV> functions will be confined to egress-domain, as you note. E.g. for the ‘per-ASBR statistics usecase’ in topology above, KV> node E can use three RDs to get stats of traffic coming from three ASBRs (A12, B12, C12) in its domain, irrespective of KV> which ASBRs in other domains this traffic traversed. KV> Another example is : different service-funcions (SF1, SF2) can be attached to the node E, such that RD1:E, RD2:E can be KV> used to advertise these service functions with different UHP labels in BGP-CT, while using same Transport-class RT. So KV> provisioning new colored tunnels in the transport network is not required. KV> In CAR, for such usecases, operator will have the provisioning and management overhead of using distinct Colors KV> (because Color is the distinguisher in CAR NLRI), and will have to co-ordinate to resolve them over KV> the ‘same SLA tunnel’ in the transport-layer. And again, using multiple colors to represent same SLA prevents KV> ECMP/Protection between the CAR NLRIs. KV> Ref : https://mailarchive.ietf.org/arch/msg/idr/nAj25sX0x_lp09VEqUDSCxmDR_w/<https://urldefense.com/v3/__https:/mailarchive.ietf.org/arch/msg/idr/nAj25sX0x_lp09VEqUDSCxmDR_w/__;!!NEt6yMaO-gk!C4w6ZczSTEpo1-jQ373xH2qTNYLEQFnOgZ18EOZVMr6sKSlhs2Izv8MFExT4nVLKukZ1LU9GVhBEqU1zyVMBE8jSyw$> - It’s very possible that the number of RD be not even chosen by the egress AS. Based on Seamless MPLS work, I would assume that the route be either originated by the egress PE (in which case a single route/RD) is used, or by the ASBRs of the egress AS (in which case the number of route/RD is the number of ASBR of this AS, e.g. 3 in the above figure, irrespectively of other considerations). If a distinguisher field would be needed for some deployments, a priori I would personally not be opposed to have (EndPoint, Color, distinguisher) with distinguisher being a simple unsigned integer field. That been said, with a 32-bits color field, I feel like we already have plenty of room without adding a distinguisher. Thanks, Regards, --Bruno Orange Restricted From: Idr <idr-bounces@ietf.org<mailto:idr-bounces@ietf.org>> On Behalf Of Susan Hares Sent: Thursday, July 14, 2022 10:17 PM To: idr@ietf.org<mailto:idr@ietf.org> Subject: [Idr] Part 3 of CAR/CT Adoption call (7/14/2022 to 7/27/2022) - Operational Differences The IDR Adoption call for CAR and CT technologies is extended for an extra week (7/14/2022 to 7/27/2022). The IDR adoption call on Q2 has brought many discussions on pro/cons of the CAR and CT BGP technologies: https://mailarchive.ietf.org/arch/msg/idr/AP_ClbZgpkX6CNy7TaZiU8SMD5w/<https://urldefense.com/v3/__https:/mailarchive.ietf.org/arch/msg/idr/AP_ClbZgpkX6CNy7TaZiU8SMD5w/__;!!NEt6yMaO-gk!BUOqY4kARoJB8KWs7XqqThd3l2Sv8Ku8YKKxy3R_zz6aZR0rLFIRVHbu5DlIWdiV8gdIxjKLNk7ISrMEAcqHJPNgyQ$> Since the IDR chairs agree with the summary of Jeff Haas (IDR Co-chair) posted on March 21, 2022 – that for route resolution and route origination/propagation, BGP-CAR and BGP-CT are functionally identical, but operationally different. ( https://mailarchive.ietf.org/arch/msg/idr/e69NRd9i2aG0WUxFkShEfQHZsHo/<https://urldefense.com/v3/__https:/mailarchive.ietf.org/arch/msg/idr/e69NRd9i2aG0WUxFkShEfQHZsHo/__;!!NEt6yMaO-gk!BUOqY4kARoJB8KWs7XqqThd3l2Sv8Ku8YKKxy3R_zz6aZR0rLFIRVHbu5DlIWdiV8gdIxjKLNk7ISrMEAcrb_eR4Kg$> This forum (Part 3) is place to discuss operational differences between the CAR and CT drafts. These procedures for this mail thread are: A. On original discussion on point in a draft 1. Text in either the CAR or CT draft that is applicable to the operational difference. 2. Provide a sample topology. 3. Discuss the pros/cons clearly stating whether your post is a: pro, con, or clarifying question. Try to split clarifying question posts away from pro/con posts. Remember, you can post to this forum several times. In your technical discussion, define your terms and avoid value judgement. B. On a discussion based on message in Q2 or Q1 mail list: 1. Quote and link to Q1 or Q2 forum’s message. 2. Text in either the CAR or CT draft that is applicable to the problem (Either provide the text or give specific reference (section, paragraph, and line(s)). 3. Provide a sample topology. 4. Summarize your viewpoint as: correction, clarifying question, pro, or con. 5. Discuss the pro/con or text giving technical discussion. In your technical discussion avoid define terms, give specific examples in terms of draft text, sample topology, and facts. If you state an opinion, back it up with technical facts. If you are making a correction, assume the other person either misunderstood or has a difference of opinion. Respect each other as each IDR member is entitled to their opinion. As a group we are working toward excellent BGP in deployed technology. In your delightful passion on these two technology additions to BGP (CAR and CT), please adhere to these rules. Thank you, Susan Hares _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you. Juniper Business Use Only _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you. Juniper Business Use Only
- [Idr] Part 3 of CAR/CT Adoption call (7/14/2022 t… Susan Hares
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Reshma Das
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Natrajan Venkataraman
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Natrajan Venkataraman
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Natrajan Venkataraman
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Natrajan Venkataraman
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Susan Hares
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Susan Hares
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Susan Hares
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Susan Hares
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Susan Hares
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Dhananjaya Rao (dhrao)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Susan Hares
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Zhuangshunwan
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Natrajan Venkataraman
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Zhuangshunwan
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Natrajan Venkataraman
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Xiejingrong (Jingrong)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… bruno.decraene
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jeffrey Haas
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Natrajan Venkataraman
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Zhuangshunwan
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Zhuangshunwan
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Dhananjaya Rao (dhrao)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Dhananjaya Rao (dhrao)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Dhananjaya Rao (dhrao)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Ketan Talaulikar
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Zhuangshunwan
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Ketan Talaulikar
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Susan Hares
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jeffrey (Zhaohui) Zhang
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Aijun Wang
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Rajesh M
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Aijun Wang
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Dhananjaya Rao (dhrao)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… bruno.decraene
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… bruno.decraene
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jeffrey Haas
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… bruno.decraene
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… bruno.decraene
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Dhananjaya Rao (dhrao)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jeffrey Haas
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Natrajan Venkataraman
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Xiejingrong (Jingrong)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Swadesh Agrawal (swaagraw)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Swadesh Agrawal (swaagraw)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… bruno.decraene
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jeffrey Haas
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… bruno.decraene
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Ketan Talaulikar
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jeffrey Haas
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Ketan Talaulikar
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Ketan Talaulikar
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Swadesh Agrawal (swaagraw)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jeffrey Haas
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Gyan Mishra
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jeffrey Haas
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jeffrey Haas
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Srihari Sangli
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jeffrey Haas
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Dhananjaya Rao (dhrao)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jeffrey Haas
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Dhananjaya Rao (dhrao)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Natrajan Venkataraman
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Natrajan Venkataraman
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Shraddha Hegde
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Dhananjaya Rao (dhrao)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Xiejingrong (Jingrong)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Dhananjaya Rao (dhrao)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Shraddha Hegde
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… UTTARO, JAMES
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jeffrey Haas
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jeffrey Haas
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Robert Raszuk
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jeffrey Haas
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Xiejingrong (Jingrong)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Shraddha Hegde
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Srihari Sangli
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Swadesh Agrawal (swaagraw)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Dhananjaya Rao (dhrao)
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Gyan Mishra
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Kaliraj Vairavakkalai
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Rajesh M
- Re: [Idr] Part 3 of CAR/CT Adoption call (7/14/20… Jingrong Xie