Re: [armd] address resolution requirement from hosts to overlay edge nodes. Any opinion?

Joel jaeggli <joelja@bogus.com> Wed, 15 February 2012 05:36 UTC

Return-Path: <joelja@bogus.com>
X-Original-To: armd@ietfa.amsl.com
Delivered-To: armd@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A861B21F8693 for <armd@ietfa.amsl.com>; Tue, 14 Feb 2012 21:36:55 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.739
X-Spam-Level:
X-Spam-Status: No, score=-102.739 tagged_above=-999 required=5 tests=[AWL=-0.139, BAYES_00=-2.599, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id l9N8yWptiqky for <armd@ietfa.amsl.com>; Tue, 14 Feb 2012 21:36:54 -0800 (PST)
Received: from nagasaki.bogus.com (nagasaki.bogus.com [IPv6:2001:418:1::81]) by ietfa.amsl.com (Postfix) with ESMTP id 8DCB721F8683 for <armd@ietf.org>; Tue, 14 Feb 2012 21:36:53 -0800 (PST)
Received: from Joels-MacBook-Pro.local (c-98-234-216-143.hsd1.ca.comcast.net [98.234.216.143]) (authenticated bits=0) by nagasaki.bogus.com (8.14.4/8.14.4) with ESMTP id q1F5aQsV014770 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NOT); Wed, 15 Feb 2012 05:36:27 GMT (envelope-from joelja@bogus.com)
Message-ID: <4F3B4459.2080907@bogus.com>
Date: Tue, 14 Feb 2012 21:36:25 -0800
From: Joel jaeggli <joelja@bogus.com>
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:9.0) Gecko/20111222 Thunderbird/9.0.1
MIME-Version: 1.0
To: AshwoodsmithPeter <Peter.AshwoodSmith@huawei.com>
References: <7AE6A4247B044C4ABE0A5B6BF427F8E291E2C8@dfweml503-mbx>
In-Reply-To: <7AE6A4247B044C4ABE0A5B6BF427F8E291E2C8@dfweml503-mbx>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (nagasaki.bogus.com [147.28.0.81]); Wed, 15 Feb 2012 05:36:28 +0000 (UTC)
Cc: Thomas Narten <narten@us.ibm.com>, "armd@ietf.org" <armd@ietf.org>, Igor Gashinsky <igor@yahoo-inc.com>
Subject: Re: [armd] address resolution requirement from hosts to overlay edge nodes. Any opinion?
X-BeenThere: armd@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion of issues associated with large amount of virtual machines being introduced in data centers and virtual hosts introduced by Cloud Computing." <armd.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/armd>, <mailto:armd-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/armd>
List-Post: <mailto:armd@ietf.org>
List-Help: <mailto:armd-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/armd>, <mailto:armd-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 15 Feb 2012 05:36:55 -0000

On 2/14/12 14:15 , AshwoodsmithPeter wrote:
> 
> Irrespective of what is right or wrong etc. technically, I think it
> would be very useful to have a taxonomy of the different applications
> that are using multicast / broadcast for things other than ARP.

ganglia is a common datacenter multicast user

vertica clusters can use broadcast for communication and span hundres of
nodes, however unwise that approach may be.

> The complexity of the underlay depends a lot on what happens with the
> use of multicast by the overlay.
> 
> For example. Assume Microsoft load balancing (for better or worse).
> If I remember correctly, and sombody correct me if I'm wrong, it
> generates multicast frames from otherwise unicast packets at the
> router so that multiple hosts all get copies and then only one
> responds for a given flow... or something like that.
> 
> So if we are using something like a VXLAN overlay we need to map the
> L2 multicast in the overlay to L3 multicast in the underlay or do
> head end replication in the overlay and get a wack load of duplicate
> frames on the first link from the router to the core "switch" (really
> it's a router). Not good. The solution presumably is to run
> potentially thousands of PIM-SM or something messages to
> generate/maintain the required multicast state in the IP underlay.
> 
> Anyway the behavior of the upper layer with respect to broadcast /
> multicast affects the choice of head end, (*,G) or (S,G) replication
> in the underlay, which affects the opex and capex of the entire
> solution, so I think its an important question to get a handle on
> earlier rather than later.
> 
> Peter
> 
> -----Original Message----- From: armd-bounces@ietf.org
> [mailto:armd-bounces@ietf.org] On Behalf Of Anoop Ghanwani Sent:
> Tuesday, February 14, 2012 4:53 PM To: Mike McBride Cc: Thomas
> Narten; armd@ietf.org; Igor Gashinsky Subject: Re: [armd] address
> resolution requirement from hosts to overlay edge nodes. Any
> opinion?
> 
> On Tue, Feb 14, 2012 at 1:16 PM, Mike McBride <mmcbride7@gmail.com>
> wrote:
> 
>> There are interesting challenges with unicast and multicast in big 
>> flat DC networks. That's why we are here. One of the constant
>> themes we hear with multicast is the FUD that it doesn't scale.
>> Especially from vendors who are pushing another solution or who
>> have a crappy multicast implementation. Meanwhile multicast is
>> being deployed in large scale networks without scaling issue.
> 
> Like I said earlier...we have large-scale multicast today, but those
> are purpose-built networks, and at least today, they are no where
> near the kinds of scale where people want to go with overlay 
> technology (in terms of size of network and traffic patterns).
> 
>> Large L2 overlay networks? I don't know. Would be good to find out
>> from the community about performance and scalability of multicast
>> in the DC.
> 
> Perhaps it's best we wait until the problems are little more
> obvious. Or may be they're just non-existent and I get proven wrong.
> Either way, it looks like the correct thing for now is to do
> nothing.
> 
> Anoop _______________________________________________ armd mailing
> list armd@ietf.org https://www.ietf.org/mailman/listinfo/armd 
> _______________________________________________ armd mailing list 
> armd@ietf.org https://www.ietf.org/mailman/listinfo/armd
>