Re: [RAM] Number of DFZ routers

Tony Li <tli@cisco.com> Mon, 28 May 2007 22:32 UTC

Return-path: <ram-bounces@iab.org>
Received: from [127.0.0.1] (helo=stiedprmman1.va.neustar.com) by megatron.ietf.org with esmtp (Exim 4.43) id 1HsnlP-0005qH-B7; Mon, 28 May 2007 18:32:31 -0400
Received: from [10.91.34.44] (helo=ietf-mx.ietf.org) by megatron.ietf.org with esmtp (Exim 4.43) id 1HsnlN-0005q9-DX for ram@iab.org; Mon, 28 May 2007 18:32:29 -0400
Received: from sj-iport-5.cisco.com ([171.68.10.87]) by ietf-mx.ietf.org with esmtp (Exim 4.43) id 1HsnlN-0004Tr-24 for ram@iab.org; Mon, 28 May 2007 18:32:29 -0400
Received: from sj-dkim-7.cisco.com ([171.68.10.88]) by sj-iport-5.cisco.com with ESMTP; 28 May 2007 15:32:22 -0700
X-IronPort-AV: i="4.14,587,1170662400"; d="scan'208"; a="158209726:sNHT44124480"
Received: from sj-core-4.cisco.com (sj-core-4.cisco.com [171.68.223.138]) by sj-dkim-7.cisco.com (8.12.11/8.12.11) with ESMTP id l4SMWMJL007899; Mon, 28 May 2007 15:32:22 -0700
Received: from xbh-sjc-211.amer.cisco.com (xbh-sjc-211.cisco.com [171.70.151.144]) by sj-core-4.cisco.com (8.12.10/8.12.6) with ESMTP id l4SMWFV1009736; Mon, 28 May 2007 22:32:15 GMT
Received: from xfe-sjc-212.amer.cisco.com ([171.70.151.187]) by xbh-sjc-211.amer.cisco.com with Microsoft SMTPSVC(6.0.3790.1830); Mon, 28 May 2007 15:32:15 -0700
Received: from [192.168.0.101] ([10.21.68.210]) by xfe-sjc-212.amer.cisco.com with Microsoft SMTPSVC(6.0.3790.1830); Mon, 28 May 2007 15:32:15 -0700
In-Reply-To: <Pine.GSO.4.33.0705281004210.18621-100000@iscserv1>
References: <Pine.GSO.4.33.0705281004210.18621-100000@iscserv1>
Mime-Version: 1.0 (Apple Message framework v752.3)
Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed
Message-Id: <BD785DA9-DA63-40CA-A70A-8B1A62B249B2@cisco.com>
Content-Transfer-Encoding: 7bit
From: Tony Li <tli@cisco.com>
Subject: Re: [RAM] Number of DFZ routers
Date: Mon, 28 May 2007 15:32:14 -0700
To: Ted Seely <tseely@sprint.net>
X-Mailer: Apple Mail (2.752.3)
X-OriginalArrivalTime: 28 May 2007 22:32:15.0257 (UTC) FILETIME=[0ACAF890:01C7A178]
DKIM-Signature: v=0.5; a=rsa-sha256; q=dns/txt; l=2767; t=1180391542; x=1181255542; c=relaxed/simple; s=sjdkim7002; h=Content-Type:From:Subject:Content-Transfer-Encoding:MIME-Version; d=cisco.com; i=tli@cisco.com; z=From:=20Tony=20Li=20<tli@cisco.com> |Subject:=20Re=3A=20[RAM]=20Number=20of=20DFZ=20routers |Sender:=20; bh=+QnkSJ6DpipBa39+mKcqRNG1rB2MkDk44x1KaD1txQM=; b=UUH1/b76WsJiV8HEmyVc4k/dveSn1ycGBq3JfJm2yzKjXdOFRblg+61bR+kJce0I2DL2iUU/ CmPFaZqAZqP+Jtm7n1kW+fLnC0n0DQbXfPAi9hiWsyh7klgwx2mgqfIO;
Authentication-Results: sj-dkim-7; header.From=tli@cisco.com; dkim=pass (sig from cisco.com/sjdkim7002 verified; );
X-Spam-Score: 0.0 (/)
X-Scan-Signature: c0bedb65cce30976f0bf60a0a39edea4
Cc: Robin Whittle <rw@firstpr.com.au>, ram@iab.org
X-BeenThere: ram@iab.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Routing and Addressing Mailing List <ram.iab.org>
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/ram>, <mailto:ram-request@iab.org?subject=unsubscribe>
List-Archive: <http://www1.ietf.org/pipermail/ram>
List-Post: <mailto:ram@iab.org>
List-Help: <mailto:ram-request@iab.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/ram>, <mailto:ram-request@iab.org?subject=subscribe>
Errors-To: ram-bounces@iab.org

On May 28, 2007, at 9:10 AM, Ted Seely wrote:

> Curious as to where you may be taking this?


Working backwards, these are exactly the questions that you have to  
ask if you're trying to determine how large a lookup result needs to  
be.  See Robin's previous work on SRAM lookups.

On May 27, 2007, at 3:35 PM, Robin Whittle wrote:
> Can anyone suggest the range of number of interfaces these
> routers have?  For instance, what is the largest number of
> interfaces on an operational router?


Chris and others have pointed out a limitation in IOS.  Note that  
this is not shared by XR and presumably JunOS.  In particular, from a  
router architecture viewpoint, what's even more relevant is the  
potential number of interfaces that COULD be required from a system.

Now, the currently largest system that I know of that's being  
publicly discussed is the CRS-1.  That's 97Tbps, although other,  
larger systems have been discussed and will almost certainly be  
necessary in the distant future.  Not everyone agrees with this.


> What would be a typical range of interface numbers for
> transit routers?


Today, I'd say that interfaces in the DFZ range from DS-3 to OC-768.   
For the architectural bound, we can look at the CRS with T-3's,  
giving us around 97Tbps/45Mbps ~= 2e6 interfaces.

It should be noted that some interface types (Ethernet) are multi- 
access and require a router to store not only an interface, but next  
hop information.  A reasonable guess right now is to provision for  
about 35e3 next hops per Ethernet interface.  This allows the same  
hardware to be sold into most enterprise accounts.

Net that leaves you at around 7e10 next hops.  Based on these types  
of numbers, many folks have pointed out that distributed systems may  
be more scalable if they perform multiple lookup stages.  Not  
everyone agrees with this.  The cost of going to multiple lookups is  
that it requires additional high-speed lookup hardware, right at the  
point of the highest bandwidth in the architecture, the interface  
between the internal fabric and a chassis.


> In addition to direct forwarding of Internet traffic, and
> handling the communications paths between the routers
> themselves, do transit routers often perform other functions,
> such as handling MPLS?


As noted, yes, this is required.  Also, a slew of other features that  
have forwarding time impact are also practical requirements in this  
market space.  For example, ACLs, policy based forwarding,  
accounting, and QoS all have non-trivial impacts on the forwarding  
plane and may directly impact your lookup.  There are a number of  
considerations that must be taken into account.

Tony


>

_______________________________________________
RAM mailing list
RAM@iab.org
https://www1.ietf.org/mailman/listinfo/ram