Re: [rrg] Geoff Huston's BGP/DFZ research - 300k DFZ prefixes are the tip of the iceberg

Paul Jakma <paul@jakma.org> Mon, 15 March 2010 17:15 UTC

Return-Path: <paul@jakma.org>
X-Original-To: rrg@core3.amsl.com
Delivered-To: rrg@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id C8C6E3A69E5 for <rrg@core3.amsl.com>; Mon, 15 Mar 2010 10:15:19 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.252
X-Spam-Level:
X-Spam-Status: No, score=-1.252 tagged_above=-999 required=5 tests=[AWL=-0.401, BAYES_05=-1.11, SARE_SUB_OBFU_Z=0.259]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id A40+KkKJKF86 for <rrg@core3.amsl.com>; Mon, 15 Mar 2010 10:15:18 -0700 (PDT)
Received: from hibernia.jakma.org (hibernia.jakma.org [212.17.55.49]) by core3.amsl.com (Postfix) with ESMTP id C760B3A6BC8 for <rrg@irtf.org>; Mon, 15 Mar 2010 10:13:49 -0700 (PDT)
Received: from stoner.gla.jakma.org (stoner.jakma.org [81.168.24.42]) (authenticated bits=0) by hibernia.jakma.org (8.14.3/8.14.3) with ESMTP id o2FHDGGx014998 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 15 Mar 2010 17:13:20 GMT
Date: Mon, 15 Mar 2010 17:13:11 +0000
From: Paul Jakma <paul@jakma.org>
To: Tony Li <tony.li@tony.li>
In-Reply-To: <C7C3234C.5EA7%tony.li@tony.li>
Message-ID: <alpine.LFD.2.00.1003151648550.4735@stoner.jakma.org>
References: <C7C3234C.5EA7%tony.li@tony.li>
User-Agent: Alpine 2.00 (LFD 1167 2008-08-23)
Mail-Copies-To: paul@jakma.org
Mail-Followup-To: paul@jakma.org
X-NSA: al aqsar fluffy jihad cute musharef kittens jet-A1 ear avgas wax ammonium bad qran dog inshallah allah al-akbar martyr iraq hammas hisballah rabin ayatollah korea revolt pelvix mustard gas x-ray british airways washington peroxide cool
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset="US-ASCII"; format="flowed"
X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.1.1 (hibernia.jakma.org [212.17.55.49]); Mon, 15 Mar 2010 17:13:23 +0000 (GMT)
Cc: RRG <rrg@irtf.org>, Robin Whittle <rw@firstpr.com.au>
Subject: Re: [rrg] Geoff Huston's BGP/DFZ research - 300k DFZ prefixes are the tip of the iceberg
X-BeenThere: rrg@irtf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: IRTF Routing Research Group <rrg.irtf.org>
List-Unsubscribe: <http://www.irtf.org/mailman/listinfo/rrg>, <mailto:rrg-request@irtf.org?subject=unsubscribe>
List-Archive: <http://www.irtf.org/mail-archive/web/rrg>
List-Post: <mailto:rrg@irtf.org>
List-Help: <mailto:rrg-request@irtf.org?subject=help>
List-Subscribe: <http://www.irtf.org/mailman/listinfo/rrg>, <mailto:rrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Mon, 15 Mar 2010 17:15:19 -0000

On Sun, 14 Mar 2010, Tony Li wrote:

> Actually, no growth in prefixes does not imply that there is no growth in
> the Internet.  You can still add customers within existing prefix
> allocations and improve your addressing efficiency.

Hehe, My implicit assumption is that there's no significant change in 
allocation densities. :) Stuff like that generally seems to be an 
administive issue, so it's maybe unlikely it can be affected through 
routing changes.

> First, no one is claiming that there is an imminent and urgent 
> problem. What I feel that we've shown is that we have a long term 
> systemic problem. Given that truly dealing with this issue does 
> appear to require major amounts of time to deploy, it only seems 
> reasonable to start dealing with it long before it becomes an 
> urgent problem.

> Please see my RAWS presentation.  It shows that prefix growth 
> exceeds the speedup that we can expect in DRAM.

I remember reading that.

> This in turn implies that BGP will take longer to converge at a 
> given node when that node has to process the full table.

That's the thing though, the most recent data doesn't seem to show 
any evidence of things like that. If per-node convergence was taking 
significantly longer (in the "scaling badly relative to prefix 
growth" sense), then Sigma(per-prefix per-node convergence) should be 
similarly increasing by at least the same amount and BGP observers 
ought to be able to see that, and so the data should show it.

Yet it doesn't seem to, right?

Further, even if the growth issues only affected a certain subset of 
prefixes, surely there'd be "side-band" issues. I.e. processing 
problems with certain prefixes should adversely affect the processing 
of other prefixes being processed around the same time.

I'm sorry for being such an arse with my scepticism, and I'll 
understand if people reply to me as if I'm half-wit, but if scaling 
is a problem surely it should be apparent in some data somewhere over 
the last decade+ that people have been worrying about it? Where's the 
smoking gun graph, based on real data, that shows the scaling 
problem? I'm somewhat willing to take your word as authoritative, but 
ideally we'd have graphs :).

I stress again that, despite taking this contrarian view of the 
scaling problem, I still think the work here is very important!

I just think this question must have a big impact on which classes of 
solutions are and are not viable.

regards,
-- 
Paul Jakma	paul@jakma.org	Key ID: 64A2FF6A
Fortune:
We don't understand the software, and sometimes we don't understand the
hardware, but we can *___see* the blinking lights!