Re: [Sidrops] [GROW] Deprecation of AS_SET and AS_CONFED_SET -- feedback requested

"Sriram, Kotikalapudi (Fed)" <kotikalapudi.sriram@nist.gov> Wed, 23 October 2019 15:45 UTC

Return-Path: <kotikalapudi.sriram@nist.gov>
X-Original-To: sidrops@ietfa.amsl.com
Delivered-To: sidrops@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E4FE91200DF; Wed, 23 Oct 2019 08:45:21 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.001
X-Spam-Level:
X-Spam-Status: No, score=-2.001 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nist.gov
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id HhsGvZLUOrN0; Wed, 23 Oct 2019 08:45:19 -0700 (PDT)
Received: from GCC02-DM3-obe.outbound.protection.outlook.com (mail-dm3gcc02on2120.outbound.protection.outlook.com [40.107.91.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3414512013B; Wed, 23 Oct 2019 08:45:19 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=SiAwcxJKvmW9mqRSKgiRz2e3KkxDpT3Xj8H8pQF/4H7+jasJi2w4wfLlRRfspfANSPl35iMxKHOU3eeABhqNyEH736wDxZU0iivViA8SjeB3wtmwulmPB8wvG7lmxcjuD+Sh3IN7JlbbND9VmtZp9Z9OTLg5f91UPTjEa34vPqxn+pBMUgQBkeFLFkgYgS+BfL6CgBBNkbc7AyEXF0TZHkcGv+RCdnHsKq95NnJqWIXnNYvopxbJxP1zYTbqveMJUqwN0dIjfkKBlLlcUAIOcYNspBnNibMnI9ovp6yaMGMhOMpvgN+X4rZsn0w8GlfHfqNZt2LIIpyS2uIMKUMLlw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=llzPa9//2trNfrh0BevsujoOJGe0zXTE45dAyRIrLrw=; b=hkqMMyJZybvWimAjMVcwv0LcYrQxAXq2gdjUb3LhaXK95uskgBsqMfcLBW6EIrRF2ss6/LWLX8sFIJpJvv0STeeqZF6dObeEyShMH0KXrX1Y0eUwzZSYhSD4ng9QzolVUcBFBm8oE4LU8Q3eKY75u9FSdX/UcZk3BmfjQtdVrxwmBaDW7pLjqS89Vy2uCHbZSH+Uim0S8HE2BZcjoHjHzjjs7it0DAsVxxKARycuYZbv8H88X/YadHH3Mhpx/bJHe7PuMl0FO7LHUbmRJ9c9lPLRUX2LCvF7Z+2Fp7gg33VyLD4rEbaIu93BeJvUjEUT+RZrh0a5NVi2JkHCEQ4EVQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nist.gov; dmarc=pass action=none header.from=nist.gov; dkim=pass header.d=nist.gov; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nist.gov; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=llzPa9//2trNfrh0BevsujoOJGe0zXTE45dAyRIrLrw=; b=zywIzMGeo0w8Qc8zuBanAeFoyGxhtYmZ6aI09uZeOxJdn8WSoT6Hz09CwQvcOUpLpDG8+LzXwGYnDaOoxKNYtVnc+yi/2S/njECdjkf6Fzoi90bTE9IKGE6mRRRzT3yUZyuYttclP2KH2aI6EK11DyxQmyv5afXB/0QVITt0JTo=
Received: from BL0PR0901MB4563.namprd09.prod.outlook.com (52.135.47.206) by BL0PR0901MB3732.namprd09.prod.outlook.com (52.132.25.25) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2347.22; Wed, 23 Oct 2019 15:45:17 +0000
Received: from BL0PR0901MB4563.namprd09.prod.outlook.com ([fe80::9cca:9bbb:99ac:f806]) by BL0PR0901MB4563.namprd09.prod.outlook.com ([fe80::9cca:9bbb:99ac:f806%5]) with mapi id 15.20.2387.019; Wed, 23 Oct 2019 15:45:17 +0000
From: "Sriram, Kotikalapudi (Fed)" <kotikalapudi.sriram@nist.gov>
To: Jared Mauch <jared@puck.nether.net>, Jeffrey Haas <jhaas@pfrc.org>
CC: IDR <idr@ietf.org>, GROW WG <grow@ietf.org>, Warren Kumari <warren@kumari.net>, "sidrops@ietf.org" <sidrops@ietf.org>
Thread-Topic: [GROW] [Sidrops] Deprecation of AS_SET and AS_CONFED_SET -- feedback requested
Thread-Index: AQHVeihPlTEW1P2ILEaAUTmwwiqSm6dJeyMAgB78u0s=
Date: Wed, 23 Oct 2019 15:45:17 +0000
Message-ID: <BL0PR0901MB4563AD37675891343119D058846B0@BL0PR0901MB4563.namprd09.prod.outlook.com>
References: <DM6PR09MB3019D019788E916525EDC3DC84D40@DM6PR09MB3019.namprd09.prod.outlook.com> <01c201d54d3c$74375ee0$5ca61ca0$@ndzh.com> <D49ED265-0C25-4FE0-BB02-4F176DA4BE5E@puck.nether.net> <69F03192-CE2E-4126-910D-A7E3B3AA8848@puck.nether.net> <BL0PR0901MB45639533E8F999FD6553191184860@BL0PR0901MB4563.namprd09.prod.outlook.com> <CAHw9_iJr=NaEWjMqmZjeWEwGmKfSNoAM58spsY+BSEa9ze3qYQ@mail.gmail.com> <B8F727FE-1155-4FB4-9A29-1740DF048C97@pfrc.org> <alpine.LFD.2.21.1909262319330.23402@bugs.loonybin.net> <20191003202515.GE28365@pfrc.org>, <BYAPR11MB37516DBEEE3BE2DE9787E11FC09F0@BYAPR11MB3751.namprd11.prod.outlook.com>
In-Reply-To: <BYAPR11MB37516DBEEE3BE2DE9787E11FC09F0@BYAPR11MB3751.namprd11.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=kotikalapudi.sriram@nist.gov;
x-originating-ip: [129.6.222.204]
x-ms-publictraffictype: Email
x-ms-office365-filtering-ht: Tenant
x-ms-office365-filtering-correlation-id: a2fc9499-1a6c-49a3-ef4f-08d757d000ce
x-ms-traffictypediagnostic: BL0PR0901MB3732:
x-ms-exchange-purlcount: 1
x-microsoft-antispam-prvs: <BL0PR0901MB37322D37C8918B71D2E502E1846B0@BL0PR0901MB3732.namprd09.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-forefront-prvs: 019919A9E4
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(136003)(39860400002)(346002)(376002)(366004)(396003)(189003)(199004)(6506007)(6116002)(76176011)(74316002)(478600001)(486006)(25786009)(66066001)(3846002)(7696005)(81166006)(8676002)(81156014)(86362001)(99286004)(256004)(102836004)(8936002)(476003)(71200400001)(316002)(54906003)(71190400001)(110136005)(11346002)(2906002)(229853002)(66556008)(186003)(14454004)(5660300002)(4326008)(33656002)(446003)(966005)(7736002)(305945005)(91956017)(76116006)(66946007)(9686003)(26005)(6436002)(6306002)(52536014)(66476007)(64756008)(55016002)(66446008)(6246003); DIR:OUT; SFP:1102; SCL:1; SRVR:BL0PR0901MB3732; H:BL0PR0901MB4563.namprd09.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: nist.gov does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: KqSbZj0Scar7eTwQN9H8wDS62sd4WHEKMT03i0SMnYRMJsygWNV6lacRWkzVeUhTI17O4ESGugV9pJn8OsPH6nTjd2b7ZOcynj2WlPzFh+XHLy0uoIjspCDUfC2w2OjXVSkIShy3eaNCPH2+ZHtXDInRO7AsCZ8SH+RkyfD3pFzh7iZzGLOmd2EP7vQBner1bvJCWnHVB0L+F7W93IC1xWRQxqMk8IRhNcrY5PyoFnAZT4/auJIc7POSUEJG6XQc2H1V+zJOOPHz9aLbMVtROrllnm629+FGvJcmPDTn52h20fqE38K7w4II8IriwCicpE5Lct7CFTNcnInHyWA4GXMAw3m+65zP/2qWJqwaNETrKrx6mbnFl86lA521Jx7mJibQJQQPIsodTpmwueNdEWHuuAdl+PWokBxjNbiNeGo53L4M4mLLtkVp7qYnGtgxAwtaicmh6g/z33z1b1seaoGI90o6GvCcMOAF8YR8IIw=
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: nist.gov
X-MS-Exchange-CrossTenant-Network-Message-Id: a2fc9499-1a6c-49a3-ef4f-08d757d000ce
X-MS-Exchange-CrossTenant-originalarrivaltime: 23 Oct 2019 15:45:17.3027 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 2ab5d82f-d8fa-4797-a93e-054655c61dec
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: hv1SiDCoHgDAIyIevts21n8gNuOO7idyoUztDlsurIzzlCy5AoHfJAvU8kXldUssimyS7Zith9oMqsf59n8/6g==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB3732
Archived-At: <https://mailarchive.ietf.org/arch/msg/sidrops/e-YqAYYvikGwycQsi08yL8lL6Lo>
Subject: Re: [Sidrops] [GROW] Deprecation of AS_SET and AS_CONFED_SET -- feedback requested
X-BeenThere: sidrops@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: A list for the SIDR Operations WG <sidrops.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/sidrops>, <mailto:sidrops-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/sidrops/>
List-Post: <mailto:sidrops@ietf.org>
List-Help: <mailto:sidrops-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/sidrops>, <mailto:sidrops-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 23 Oct 2019 15:45:22 -0000

Earlier in this thread, there was discussion about some measurements that were shared  (by Jared, Warren, myself).
Jeff's suggestion: why don't we list all routes with AS_SET in addition to the stats.
Now we have a detailed analysis (thanks once again to Lilia Hannachi my colleague at NIST):
https://www.nist.gov/sites/default/files/documents/2019/10/23/detailed-as_set-analysis.txt   

The analysis includes the following:
1. Summary stats
2. List of ASes (AGGREGATORs) Ranked according to # Routes with AS_SET
(including the organization name of the AGGREGATOR)
3. List of routes with AS_SET that seem meaningless or malformed.
4. List of routes with AS_SET that seem meaningful.
3. List of all routes with AS_SET (listed per AGGREGATOR)

The summary stats are copied here, but please see other details at the link provided.

AS_SET ANALYSIS (OREGON 2019-10-03:00)
The Routeviews OREGON collector peers with 43 ASes. 

Summary stats:

	Total # Updates : 30052331
	# Updates with AS_SET : 14348
	Percentage of Updates with AS_SET : 0.048%
	# Total # ASes (globally) : 66205
	# ASes that create Updates with AS_SET : 144
	% ASes that create Updates with AS_SET : 0.218%

	# Routes with AS_SET (after eliminating AS path redundancy): 477
	Explanation: These are routes with unique {prefix, AS_SET, 1st AS after AS_SET, AGGREGATOR} combinations.

Out of the 477 routes with AS_SETs:
	*** Identifying Routes with AS_SET that seem meaningless or malformed ***
	# Routes with only one AS in AS_SET : 383
	# Routes with Reserved ASN in AS_SET : 131
	# Routes with common AS in the AS_SEQUENCE and AS_SET : 139
	# Routes with repeated ASes in the AS_SET : 0
	# Routes that are /24 prefix (aggregate) announcements : 239
	Total # Routes that seem meaningless or malformed : 456

	Total # Routes that seem meaningful : 21

	Distribution of # unique ASes in the AS_SET : 1:383, 2:68, 3:14, 4:5, 5:2, 6:3, 23:1, 31:1

	# Routes with AS_SET where AGGREGATOR does not match the right most AS in AS_SEQUENCE : 47

	# Routes with unique {prefix, AS_SET, AGGREGATOR} : 469
	# Routes with unique {prefix, AS_SET} : 455

*** When there is an AGGREGATOR but no AS_SET ***
	# Unique prefixes (with or without AS_SET) : 826535
	# Unique prefixes without AS_SET but with AGGREGATOR: 75698
	% Unique prefixes without AS_SET but with AGGREGATOR: 9.158%

Sriram