Re: [Lsr] Dynamic flow control for flooding

"Les Ginsberg (ginsberg)" <ginsberg@cisco.com> Tue, 23 July 2019 20:29 UTC

Return-Path: <ginsberg@cisco.com>
X-Original-To: lsr@ietfa.amsl.com
Delivered-To: lsr@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 156D712096F for <lsr@ietfa.amsl.com>; Tue, 23 Jul 2019 13:29:39 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.499
X-Spam-Level:
X-Spam-Status: No, score=-14.499 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com header.b=GF06Ivw4; dkim=pass (1024-bit key) header.d=cisco.onmicrosoft.com header.b=d/IVASXt
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id iINhcPr7M3AW for <lsr@ietfa.amsl.com>; Tue, 23 Jul 2019 13:29:36 -0700 (PDT)
Received: from rcdn-iport-8.cisco.com (rcdn-iport-8.cisco.com [173.37.86.79]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 484271203C2 for <lsr@ietf.org>; Tue, 23 Jul 2019 13:29:36 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=13992; q=dns/txt; s=iport; t=1563913776; x=1565123376; h=from:to:subject:date:message-id:references:in-reply-to: mime-version; bh=/BNcIq/IBfxX2KbBWr7BqWtBW5n+nVnrdNLmqBWtE5w=; b=GF06Ivw4G1qbzgmCyt9C0QJAe08qtelaK+C2iQgxED8kbSDDOpKrDPEl eNfIE5nXDMlJ6lXH3v++XNbkS1wipnicyinS6tv004+anJjjJ3mpuvfSy rye35HalWrKi8U4t+iZ1n4zmuPKofnPdNB17HB7b0AF4q95VImtfqyTWD w=;
IronPort-PHdr: 9a23:p18xZRMy4t9tRGuwNm8l6mtXPHoupqn0MwgJ65Eul7NJdOG58o//OFDEu6w/l0fHCIPc7f8My/HbtaztQyQh2d6AqzhDFf4ETBoZkYMTlg0kDtSCDBj0LfjxZSEgE+xJVURu+DewNk0GUMs=
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0D9AQC+bTdd/5hdJa1mGwEBAQEDAQEBBwMBAQGBZ4EVL1ADbVUgBAsqhB2DRwOOAEyCD5J7hFWCUgNUCQEBAQwBAS0CAQGEQAIXgjcjOBMBAwEBBAEBAgEGbYUeDIVKAQEBAQMSEQoTAQE4DwIBBgIRBAEBKAMCAgIwFAkIAgQBCQkIGoMBgR1NAx0BAo8skGACgTiIYHGBMoJ5AQEFhQkYghMJgTSLXxeBQD+BEUaCHi4+hB0pNIJVMoImjCIzgiOEfogsjkUJAoIZlCeYCo01l1ACBAIEBQIOAQEFgWchgVhwFYMngkKDcYpTcoEpi2uCUgEB
X-IronPort-AV: E=Sophos;i="5.64,300,1559520000"; d="scan'208,217";a="601213001"
Received: from rcdn-core-1.cisco.com ([173.37.93.152]) by rcdn-iport-8.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 23 Jul 2019 20:29:34 +0000
Received: from XCH-ALN-015.cisco.com (xch-aln-015.cisco.com [173.36.7.25]) by rcdn-core-1.cisco.com (8.15.2/8.15.2) with ESMTPS id x6NKTXi2006058 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Tue, 23 Jul 2019 20:29:33 GMT
Received: from xhs-aln-001.cisco.com (173.37.135.118) by XCH-ALN-015.cisco.com (173.36.7.25) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Tue, 23 Jul 2019 15:29:33 -0500
Received: from xhs-rtp-002.cisco.com (64.101.210.229) by xhs-aln-001.cisco.com (173.37.135.118) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Tue, 23 Jul 2019 15:29:31 -0500
Received: from NAM05-CO1-obe.outbound.protection.outlook.com (64.101.32.56) by xhs-rtp-002.cisco.com (64.101.210.229) with Microsoft SMTP Server (TLS) id 15.0.1473.3 via Frontend Transport; Tue, 23 Jul 2019 16:29:31 -0400
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=bQqEInZ2mll66qBw1NJMeDbxyy4KZse00l0cUwu9ELF7FSRqhj0fWeFuUnO00FS91UVG5KQJ6rPN/prjoEcJqIJ4IcWsBv/elv3rDm5RiGTV60bwuC4koBj+tGP4fj3nJWXED+n9gBdWK/NTKckT0XMhUfwq2iETfdyoBdPejD4EnWDgZGF4Mae6AVmQ0e2HHPvHdTjE8UbypmYPkRxtRNi7rPDiSdYCfSBYhJieHbosWqjTL2LNC2WDEppgfGGYV9RFF53UnFU2TbqdHxnS6sQjuAX5RT9N4ZsuztKH85gcgDogy8RKEe5gsCKAUh3Jhfd/D2GRX6FD7sBWiKUAhA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=/BNcIq/IBfxX2KbBWr7BqWtBW5n+nVnrdNLmqBWtE5w=; b=FsXX3ZxaoHLMHEBWeG8PG2xNdbAtP1WiDT+aVTTK7P7mCjLbCF7ZbjrJNc2Ic13+wUL+nBKWWHYLiczEftFYWn/8cUjxm1PVE54GOg0KG82+TsK/bEgBgRjKjtHo6XYkQemvSMpZBdTTNdU4dbWVkmoO3B1oq/yZsqq6dhLcWfcP+WBAxggBQu4h5ZpPHYyMsSJ2/lA6aoSKTlfxer5iVq4GUzEiV/XokcWXGtRkvT+k2KtjqivfHseueIVA+idhWREsQDFxARrMKApzxcq98ZrXx76EU6oeTYLvvZnQGfOAUOUiaogxcVwn3CKCANOcidM8/SR6oju84+jN4nIVeA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1;spf=pass smtp.mailfrom=cisco.com;dmarc=pass action=none header.from=cisco.com;dkim=pass header.d=cisco.com;arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector2-cisco-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=/BNcIq/IBfxX2KbBWr7BqWtBW5n+nVnrdNLmqBWtE5w=; b=d/IVASXtY8WVCsj7AsiADrVg3ZTg2ntPLHFDqFDY3ERp0EPXUPAdRLlrE8S0ZJCQ4CORrP52vORzYg04Cwq01c3Q6bLX2EjC1IvRK78jP2jqehb00s0gkpAribSyi8lFrMBB9lR76cgIBguaWCkoKjSDdCCJKJAIkM59AS6OuvA=
Received: from BYAPR11MB3638.namprd11.prod.outlook.com (20.178.237.19) by BYAPR11MB3333.namprd11.prod.outlook.com (20.177.185.210) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2094.15; Tue, 23 Jul 2019 20:29:30 +0000
Received: from BYAPR11MB3638.namprd11.prod.outlook.com ([fe80::c8b3:b0b0:581d:e1ce]) by BYAPR11MB3638.namprd11.prod.outlook.com ([fe80::c8b3:b0b0:581d:e1ce%6]) with mapi id 15.20.2094.013; Tue, 23 Jul 2019 20:29:30 +0000
From: "Les Ginsberg (ginsberg)" <ginsberg@cisco.com>
To: Tony Li <tony.li@tony.li>, "lsr@ietf.org" <lsr@ietf.org>
Thread-Topic: [Lsr] Dynamic flow control for flooding
Thread-Index: AQHVQVt0dc+yhfYADEyrMMJ609g9uKbYO7Rg
Date: Tue, 23 Jul 2019 20:29:30 +0000
Message-ID: <BYAPR11MB36382C89363202D1B5659614C1C70@BYAPR11MB3638.namprd11.prod.outlook.com>
References: <CAMj-N0LdaNBapVNisWs6cbH6RsHiXd-EMg6vRvO_U+UQsYVvXw@mail.gmail.com>
In-Reply-To: <CAMj-N0LdaNBapVNisWs6cbH6RsHiXd-EMg6vRvO_U+UQsYVvXw@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=ginsberg@cisco.com;
x-originating-ip: [2001:420:c0c8:1006::374]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 86259e1a-c04c-4641-90e0-08d70fac7715
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600148)(711020)(4605104)(1401327)(2017052603328)(7193020); SRVR:BYAPR11MB3333;
x-ms-traffictypediagnostic: BYAPR11MB3333:
x-ms-exchange-purlcount: 2
x-microsoft-antispam-prvs: <BYAPR11MB333390A32D9C873295C81593C1C70@BYAPR11MB3333.namprd11.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-forefront-prvs: 0107098B6C
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(366004)(39860400002)(346002)(376002)(396003)(136003)(189003)(199004)(53754006)(229853002)(5660300002)(6116002)(14454004)(790700001)(256004)(486006)(2501003)(53936002)(55016002)(478600001)(9686003)(6306002)(54896002)(6436002)(25786009)(236005)(68736007)(71200400001)(33656002)(102836004)(6246003)(7696005)(8936002)(6506007)(99286004)(71190400001)(86362001)(7736002)(53546011)(76176011)(81166006)(66446008)(66946007)(66556008)(64756008)(52536014)(74316002)(316002)(66476007)(76116006)(8676002)(446003)(11346002)(110136005)(81156014)(46003)(186003)(476003)(2906002); DIR:OUT; SFP:1101; SCL:1; SRVR:BYAPR11MB3333; H:BYAPR11MB3638.namprd11.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: cisco.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: 5BdvVKtHSKJW0nCycaRIOqMJDt2mwQvXVBUoZwNiUD//bu+LcUCHn2rV9FCwpItkQRFS6xDGq2Q19DPypzfMMsHwwiVnwyYCsT2+J995DjndecHOWvPF//vf0WJM3PNh13ZQl4MLgUUSUu3JYNUpobgi3RoWSYbMmjP3TriwY78yYLHfCTpLAbQJh03gwuVfDgLwCJJua5l7zQHdJz8BadUeJNpwLlUilEZooi1fHGK+ItYbaTDZAZDV7PqZvjS6emF2N5R61CcZV0RLm1SevWoQWRfX+EBqRMnF1w72BLNgMfcM3NcjQ5UFlip5k38Hu9giPUgxtoXLVdZtnFigDQGCKmZUN9PbnFBkr/1ZgeSFTnuM6AZIx3Bn+wUg777MOBPyIwLPoIm6FnpOqIR00aWZWboi6ltY1ZPXn8grNU0=
Content-Type: multipart/alternative; boundary="_000_BYAPR11MB36382C89363202D1B5659614C1C70BYAPR11MB3638namp_"
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 86259e1a-c04c-4641-90e0-08d70fac7715
X-MS-Exchange-CrossTenant-originalarrivaltime: 23 Jul 2019 20:29:30.1908 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: ginsberg@cisco.com
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR11MB3333
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.36.7.25, xch-aln-015.cisco.com
X-Outbound-Node: rcdn-core-1.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/lsr/fQYQj5ZAKKkWbn43w1eOTJgzSmE>
Subject: Re: [Lsr] Dynamic flow control for flooding
X-BeenThere: lsr@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Link State Routing Working Group <lsr.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/lsr>, <mailto:lsr-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/lsr/>
List-Post: <mailto:lsr@ietf.org>
List-Help: <mailto:lsr-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/lsr>, <mailto:lsr-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 23 Jul 2019 20:29:39 -0000

Tony –

Thanx for picking up the discussion.
Thanx also for doing the math to show that bandwidth is not a concern. I think most/all of us knew that – but it is good to put that small question behind us.

I also think we all agree on the goal - which is to flood significantly faster than many implementations do today to handle deployments like the case you mention below.

Beyond this point, I have a different perspective.

As network-wide convergence depends upon fast propagation of LSP changes – which in turn requires consistent flooding rates on all interfaces enabled for flooding – a properly provisioned network MUST be able to sustain a consistent flooding rate or the operation of the network will suffer. We therefore need to view flow control issues as indicative of a problem.

It is a mistake to equate LSP flooding with a set of independent P2P “connections” – each of which can operate at a rate independent of the other.

If we can agree on this, then I believe we will have placed the flow control problem in its proper perspective – in which case it will become easier to agree on the best way to implement flow control.

   Les



From: Lsr <lsr-bounces@ietf.org<mailto:lsr-bounces@ietf.org>> On Behalf Of Tony Li
Sent: Tuesday, July 23, 2019 6:34 AM
To: lsr@ietf.org<mailto:lsr@ietf.org>
Subject: [Lsr] Dynamic flow control for flooding


Hi all,

I’d like to continue the discussion that we left off with last night.

The use case that I posited was a situation where we had 1000 LSPs to flood. This is an interesting case that can happen if there was a large network that partitioned and has now healed.  All LSPs from the other side of the partition are going to need to be updated.

Let’s further suppose that the LSPs have an average size of 1KB.  Thus, the entire transfer is around 1MB.

Suppose that we’re doing this on a 400Gb/s link. If we were to transmit the whole batch of LSPs at once, it takes a whopping 20us.  Not milliseconds, microseconds.  2x10^-5s.  Clearly, we are not going to be rate limited by bandwidth.

Note that 20us is an unreasonable lower bound: we cannot reasonably expect a node to absorb 1k PDUs back to back without loss today, in addition to all of it’s other responsibilities.

At the opposite end of the spectrum, suppose we transmit one PDU every 33ms.  That’s then going to take us 33 seconds to complete. Unreasonably slow.

How can we then maximize our goodput?  We know that the receiver has a set of buffers and a processing rate that it can support. The processing rate will vary, depending on other loads.

What we would like the transmitter to do is to transmit enough to create a small processing queue on the receiver and then transmit at the receiver’s processing rate.

Can we agree on this goal?

Tony