Re: [Ila] [5gangip] Scaling mapping systems (was Re: BOF Description)

Tom Herbert <tom@quantonium.net> Sun, 04 February 2018 15:48 UTC

Return-Path: <tom@quantonium.net>
X-Original-To: ila@ietfa.amsl.com
Delivered-To: ila@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id C5AEC1270AE for <ila@ietfa.amsl.com>; Sun, 4 Feb 2018 07:48:23 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.9
X-Spam-Level:
X-Spam-Status: No, score=-1.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=quantonium-net.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Rc5s90It1fX9 for <ila@ietfa.amsl.com>; Sun, 4 Feb 2018 07:48:21 -0800 (PST)
Received: from mail-wr0-x231.google.com (mail-wr0-x231.google.com [IPv6:2a00:1450:400c:c0c::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 495F612702E for <ila@ietf.org>; Sun, 4 Feb 2018 07:48:21 -0800 (PST)
Received: by mail-wr0-x231.google.com with SMTP id 35so266072wrb.13 for <ila@ietf.org>; Sun, 04 Feb 2018 07:48:21 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=quantonium-net.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=LBCv92KHsu1SL808cl+qXbYqVlXm/1lKri0cOrG8JBA=; b=THHG+jChYlCnHihlpsatQdD+As0SoAcV5bNH7NBBQcm7K1qmf4NEdkiXcinTDInJQ7 HhObX8XghVnrQUg6kZa3H0KBlTd2x4b3/lPogLm9RF5ykz0pwTJ2TfrKTlOR1Lxp/Q1U IZuyp1IXXiUsoKhQN2Nk5iq55Ntlu8DdseWDOHDR8N2yZ6gejZlzMO7nNrU+tiyWUha6 uzYAtrhYK1CIb94PSEZYHBEx4lCNlNmTHz3amZ+95QndzPgJ5+8WnoNLGU/AS3W7F5CE s8sWIsiDG9YLDLzJHcBJFnaROMwAa5Nr/FkRHgPPUNdmJG63ZIvfgwuIFc9MVjHFjBVj tJbA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=LBCv92KHsu1SL808cl+qXbYqVlXm/1lKri0cOrG8JBA=; b=ZWRE/uUngpQlHeUvyZm8nukOPMXpCgL25+6aMYstp4xbs8oHN+IZx6QxMSlEjnXXdX bJxm3h/4Ck26MeecdGDCA+Kz4G9c6iZ5KTJZnVrTLveNjozdlEzK6YTzTidwPBzGtTse +6yZiZgAD43rNVZoqkuvch14cgQ0bNY10pVUk2Aiu0P2M6NLWOGfKaVneuVj5bBYXP0d S8BNX6Pyja10P94x6i/s9nkpBkHAdXTRDaUmVwgM1LeZ3TPt/HSoq+qf/SgExHzcDtnl 8Kb6349UtoZr5TBWoARHaI1CVeXEHHQcLvYHxLSG4yiTUduagGm/up8mN1EW042nQ2CW N9ww==
X-Gm-Message-State: APf1xPCXYERiVIDHzpAqGBILYxmgvvcQ4pxs/CS0jCGERYkvj/KqwsPB g1Ia4bj8c0rgLkAWKpBDGo/o9SwqN08jJu9V8mRuSw==
X-Google-Smtp-Source: AH8x225EgXQvvUgx4xG+xy5imEHUfWXBFerjxzh7ntOY0RGE2mHXw44yguKqAgrOM18QW9BSgz9HDzDogSKT/vOUy60=
X-Received: by 10.223.170.12 with SMTP id p12mr1441971wrd.171.1517759299705; Sun, 04 Feb 2018 07:48:19 -0800 (PST)
MIME-Version: 1.0
Received: by 10.223.173.66 with HTTP; Sun, 4 Feb 2018 07:48:19 -0800 (PST)
In-Reply-To: <5067FA81-B416-4A19-9F11-A08B35BB8B6D@gmail.com>
References: <CALx6S37+1PK3ET7g+XsCHt6-CJrABLko0YbWgE12xFX=vL5OPA@mail.gmail.com> <5067FA81-B416-4A19-9F11-A08B35BB8B6D@gmail.com>
From: Tom Herbert <tom@quantonium.net>
Date: Sun, 04 Feb 2018 07:48:19 -0800
Message-ID: <CAPDqMeqNkiOWHOVU0AsUzFfPH60pTdS2x9CePhvZDhVLGJoGmw@mail.gmail.com>
To: Dino Farinacci <farinacci@gmail.com>
Cc: Tom Herbert <tom@herbertland.com>, 5GANGIP <5gangip@ietf.org>, Behcet Sarikaya <sarikaya@ieee.org>, ila@ietf.org, Alexandre Petrescu <alexandre.petrescu@gmail.com>, Lorenzo Colitti <lorenzo@google.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Archived-At: <https://mailarchive.ietf.org/arch/msg/ila/CpNu9yBtVLme8eflEVoKlSgnaD4>
Subject: Re: [Ila] [5gangip] Scaling mapping systems (was Re: BOF Description)
X-BeenThere: ila@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Identifier Locator Addressing <ila.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ila>, <mailto:ila-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ila/>
List-Post: <mailto:ila@ietf.org>
List-Help: <mailto:ila-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ila>, <mailto:ila-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 04 Feb 2018 15:48:24 -0000

On Sat, Feb 3, 2018 at 3:26 PM, Dino Farinacci <farinacci@gmail.com> wrote:
> On Fri, Feb 2, 2018 at 10:37 AM, Dino Farinacci <farinacci@gmail.com> wrote:
>>>
>>> The question to be answered is if all 10 million need to be stored in one place at the same time.
>>>
>>> Lorenzo, do you think the DNS is scaling? And if the mapping system is designed roughly the same way, could it scale?
>>>
>> Right, there now are many examples of sharded databases to draw
>> lessons from. At 10M entries per router, to get to 1B aggregate
>> mappings in a network that's 100 routers. Assuming a 5x replication
>> factor then network needs 500 identifier/locator routers. I would
>> target scaling this by two orders of magnitude within ten years to
>> accommodate influx of IoT devices and fined grained object addressing
>> in virtualization. I know this is simplistic math and scaling this is
>> a hard problem, but I believe it's a solvable problem.
>
> I think so too and has been an effort of mine for many years. And something I requested and wanted IDEAs to tackle.
>
>>
>>> Also, the other point you made about third-party dependency, is a another question about push versus pull style of operation.
>>>
>>
>> There is a related question that needs to be addressed and that's
>> DOSability of a mapping cache.
>>
>> For instance, from RFC6380:
>
> You mean RFC6830. And what you are commenting on below is the map-cache and not the global mapping system. That is the point I want to get Lorenzo’s opinion about.
>
Dino,

One question about the packet flow sequence in section 4.1 of RFC6830.
On a cache miss, what does an ITR do with the packet? Is it dropped,
queued for pending resolution, forwarded to a node that would have the
mapping, or other?

Thanks,
Tom