Re: [v6ops] Interesting problems with using IPv6

Chuck Anderson <cra@WPI.EDU> Tue, 09 September 2014 14:22 UTC

Return-Path: <cra@WPI.EDU>
Received: from localhost ( []) by (Postfix) with ESMTP id E8C5A1A0B77 for <>; Tue, 9 Sep 2014 07:22:32 -0700 (PDT)
X-Virus-Scanned: amavisd-new at
X-Spam-Flag: NO
X-Spam-Score: -4.553
X-Spam-Status: No, score=-4.553 tagged_above=-999 required=5 tests=[BAYES_05=-0.5, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_MED=-2.3, RP_MATCHES_RCVD=-1.652, SPF_HELO_PASS=-0.001] autolearn=ham
Received: from ([]) by localhost ( []) (amavisd-new, port 10024) with ESMTP id dvEtyoJ_G4ct for <>; Tue, 9 Sep 2014 07:22:31 -0700 (PDT)
Received: from MAIL1.WPI.EDU (MAIL1.WPI.EDU []) by (Postfix) with ESMTP id F07B61A0BEA for <>; Tue, 9 Sep 2014 07:22:30 -0700 (PDT)
Received: from MAIL1.WPI.EDU (MAIL1.WPI.EDU []) by MAIL1.WPI.EDU (8.14.9/8.14.9) with ESMTP id s89EMTvU021188 for <>; Tue, 9 Sep 2014 10:22:29 -0400
X-DKIM: Sendmail DKIM Filter v2.8.3 MAIL1.WPI.EDU s89EMTvU021188
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple;; s=_dkim; t=1410272549; bh=KytXWspYOE1CVyGGr6xSUpTch9ZhzIW+auG/fQEpJbo=; h=Date:From:To:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Transfer-Encoding:In-Reply-To; b=Bo4R6JknPNOIglb1Gz+xJyr1g4XAwXBWvRXPOmpPhxpDq2ZrdxBOiITz8C4cackAc K69xUd0WsGGZUAEgqfSf+3x/fqqUZQcYAKtl5VL5T9zGoPbv0QKMvVzApmsuQcuctQ Owcu/3DkOa6alwacPL4TQ5UW5fP0JUZ9TWCqnrag=
Received: from MX3.WPI.EDU ( []) by MAIL1.WPI.EDU (8.14.9/8.14.9) with ESMTP id s89EMTWK021184 for <>; Tue, 9 Sep 2014 10:22:29 -0400
Received: from angus.ind.WPI.EDU (ANGUS.IND.WPI.EDU []) by MX3.WPI.EDU (8.14.4/8.14.4) with ESMTP id s89EMSJQ021753 for <>; Tue, 9 Sep 2014 10:22:29 -0400 (envelope-from cra@WPI.EDU)
Received: from angus.ind.WPI.EDU (localhost []) by angus.ind.WPI.EDU (8.14.4/8.14.4) with ESMTP id s89EMSdG014418 for <>; Tue, 9 Sep 2014 10:22:28 -0400
Received: (from cra@localhost) by angus.ind.WPI.EDU (8.14.4/8.14.4/Submit) id s89EMR8Q014416 for; Tue, 9 Sep 2014 10:22:27 -0400
X-Authentication-Warning: angus.ind.WPI.EDU: cra set sender to cra@WPI.EDU using -f
Date: Tue, 9 Sep 2014 10:22:27 -0400
From: Chuck Anderson <cra@WPI.EDU>
Message-ID: <20140909142226.GP15839@angus.ind.WPI.EDU>
References: <> <> <> <> <> <> <> <>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: 8bit
In-Reply-To: <>
User-Agent: Mutt/1.5.20 (2009-12-10)
Subject: Re: [v6ops] Interesting problems with using IPv6
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: v6ops discussion list <>
List-Unsubscribe: <>, <>
List-Archive: <>
List-Post: <>
List-Help: <>
List-Subscribe: <>, <>
X-List-Received-Date: Tue, 09 Sep 2014 14:22:33 -0000


In common practice, ARP doesn't need to scale to hundreds of IPv4
addresses per host.  Unforutnately, IPv6 SLAAC with Privacy Addressing
means that ND and hence MLD does need to scale much larger than ARP
ever did.  The cure of using Solicited Node multicast for ND is worse
than the disease of using broadcast for ARP.

It is not reasonable to expect a switch to scale to maintaining state
for 300 * (# of hosts connected) Solicited-Node multicast groups.
15,000 MLD groups for 48 hosts on a 48 port switch is unreasonable.
90,000 MLD groups for a 300 port switch stack is also unreasonable.
Most switches cannot handle that many IPv4 multicast groups--expecting
them to handle that many IPv6 multicast groups is unreasonable.

How many MLD reports per second have to be processed by the switch CPU
given reports every 150 seconds by each of the many Solicited Node
multicast groups on every connected host?  100 pps?  600 pps?

What are the scaling numbers for IGMP groups and MLD groups and how
many IGMP/MLD reports can be processed per second on commonly
available access-layer switches?

Having designed a ubiquitous protocol 16 years ago that can't be
implemented reasonably cheaply on current hardware is an operational
problem that can and should be dealt with by tweaking the protocol in
some cases.  I think the protocol change proposals put forward in the
article are a quite reasonable starting point for discussing how to
mitigate this issue and shouldn't be dismissed out of hand.

On Tue, Sep 09, 2014 at 10:43:07AM +0000, Hemant Singh (shemant) wrote:
> Agreed.  Just because one vendor’s switch melted an ipv6 network is not enough justification to change protocols.
> Hemant
> From: v6ops [] On Behalf Of Lorenzo Colitti
> Sent: Tuesday, September 09, 2014 6:29 AM
> To: Nick Hilliard
> Cc:; IPv6 Operations
> Subject: Re: [v6ops] Interesting problems with using IPv6
> On Tue, Sep 9, 2014 at 6:42 PM, Nick Hilliard <<>> wrote:
> This happened because the switch CPUs were overloaded with mld report packets due to end hosts on the extended L2 network replying to MLD all-groups queries every 150 seconds.
> So the switch was configured to send all-groups queries to all hosts, but did not have the CPU power to process them, and could not, or was not configured, to rate-limit them.
> News at 11: building a network beyond the capabilities of the gear that runs it will result in failure.
> That does not mean the protocol is flawed. ARP could have done the same thing, and in fact that was a common problem many years ago... except that these days ARP is usually processed on the fast path and it doesn't matter.