Re: [MBONED] [pim] [Msr6] MSR6 BOF 3rd Issue Category: More details are requested about the large scale use cases, including issue 8-11

Toerless Eckert <tte@cs.fau.de> Tue, 25 October 2022 22:15 UTC

Return-Path: <eckert@i4.informatik.uni-erlangen.de>
X-Original-To: mboned@ietfa.amsl.com
Delivered-To: mboned@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B5206C14F73F; Tue, 25 Oct 2022 15:15:49 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.66
X-Spam-Level:
X-Spam-Status: No, score=-1.66 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HEADER_FROM_DIFFERENT_DOMAINS=0.249, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01] autolearn=no autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id tY95Ls0AA_wE; Tue, 25 Oct 2022 15:15:47 -0700 (PDT)
Received: from faui40.informatik.uni-erlangen.de (faui40.informatik.uni-erlangen.de [IPv6:2001:638:a000:4134::ffff:40]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 04007C14CF1F; Tue, 25 Oct 2022 15:15:45 -0700 (PDT)
Received: from faui48e.informatik.uni-erlangen.de (faui48e.informatik.uni-erlangen.de [131.188.34.51]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (No client certificate requested) by faui40.informatik.uni-erlangen.de (Postfix) with ESMTPS id D8F42548516; Wed, 26 Oct 2022 00:15:40 +0200 (CEST)
Received: by faui48e.informatik.uni-erlangen.de (Postfix, from userid 10463) id CF2C24EBE2E; Wed, 26 Oct 2022 00:15:40 +0200 (CEST)
Date: Wed, 26 Oct 2022 00:15:40 +0200
From: Toerless Eckert <tte@cs.fau.de>
To: Dino Farinacci <farinacci@gmail.com>
Cc: Yisong Liu <liuyisong@chinamobile.com>, msr6@ietf.org, pim@ietf.org, BIER WG <bier@ietf.org>, mboned@ietf.org, Stig Venaas <stig@venaas.com>, hooman.bidgoli@nokia.com
Message-ID: <Y1hgDIgrF+gyLUMh@faui48e.informatik.uni-erlangen.de>
References: <02fc01d8e537$6037c7e0$20a757a0$@chinamobile.com> <1A893DF5-816E-4D09-AAC6-065BBD1BD409@gmail.com> <Y1X2kvbLv0qXtD8z@faui48e.informatik.uni-erlangen.de> <DDD735E2-0930-4CB8-8992-E3E74C715D16@gmail.com> <Y1a8+EK9qA2kKDBF@faui48e.informatik.uni-erlangen.de> <03B2B681-FE16-4961-8932-1F3F29932837@gmail.com> <Y1fk24n/Fc229HCb@faui48e.informatik.uni-erlangen.de> <2AB00AD9-8557-454D-A154-516435B8E2C2@gmail.com> <Y1hO8VZYREGzEadc@faui48e.informatik.uni-erlangen.de> <4AB2CEE4-1463-4CBA-8C2A-3146EF4F3EB0@gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
In-Reply-To: <4AB2CEE4-1463-4CBA-8C2A-3146EF4F3EB0@gmail.com>
Archived-At: <https://mailarchive.ietf.org/arch/msg/mboned/pYFY9xO_FuDS53_OwM5TXnmvR7Y>
Subject: Re: [MBONED] [pim] [Msr6] MSR6 BOF 3rd Issue Category: More details are requested about the large scale use cases, including issue 8-11
X-BeenThere: mboned@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Mail List for the Mboned Working Group <mboned.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/mboned>, <mailto:mboned-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/mboned/>
List-Post: <mailto:mboned@ietf.org>
List-Help: <mailto:mboned-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/mboned>, <mailto:mboned-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 25 Oct 2022 22:15:49 -0000

On Tue, Oct 25, 2022 at 02:10:22PM -0700, Dino Farinacci wrote:
> > I fully agree with the variable length, and i am still promoting this
> > idea as a further evolution of the IPv6 base header. But that does not neglect
> > the fact that we needed to also support long addresses to build the Internet of today.
> 
> Variable length addresses allows for longer addresses. And guess what, short ones too LOL.

Indeed. Given how successful the concept of embedding multicast into IP was in 1989 and
even more so later with IPv6 (RFC3306 and RFC3956) i am pretty sure that BIER would have
ended up putting the bitstring into IPv6 destination addresses if those could have gone
to eg: at least 512 bitlength or the like.

Remember that Cisco/Pierre-Pfister was making exactly that proposal in BIER, and i think many of
us (including me) liked that very much as the most obvious IPv6 method for BIER except
that the at most 80 bits where felt to be too short. Unfortunately BIER has since then
moved on to say that there is no space for headers other than RFC8296, which is a
bit the core of the problem we're overall discussing here. for IPv6.

*sigh*

> I view existing data-planes that put control stuff in the header at entries <= 4. Meaning labels or entries in ann SRH. For MPLS, that is small, for SR its large. But its still <= 4 things.
> 
> You are trying to support >= 100 and even 2 orders of magnitude more LOL!

Well, its not only number of items to act on, but the size and complexity of any
individual item to act on. Arguably, looking up an IPv6 address is more expensive
than looking up an IPv4 address. And its easily quantified by maximum packet
throughput numbers for one platform comparing IPv4/IPv6. and given the longer prefixes
that is often factor 2 more expensive.

SRH is actually interesting in as far as that the processing cost for the
CPU does not go up with length. Aka: doubling the size of the segment list
is not the same as doubling the length of an address. It is primarily the cost
of making up to N (256/512/...) bytes of the header accessible to forwarding
plane operations. Same concept wrt. CPU as MPLS, just higher cost because of
128 vs. 32 bits "addresses/SIDs".

Same with multicast: 
Lookup of BIER/BIER-TE bitstrings is proportionally expensive to their size,
like the lengths of prefixes in unicast addresses. Because routers always need
to examine and act on the whole bitstring.
With Recursive Bitstring Structures (RBS, draft-eckert-msr6-rbs for MSR6 and
draft-eckert-rbs independent of encap BIER/MSR6) we avoid that problem and turn
it into the same performance as SRH/MPLS: each router only need to look at small
bitstrings - as many bits as router has interfaces. 

> > Loss probability primarily comes with size of tree such as number of hops where
> > BER can happen. Luckily it seems that the faster we make optical links, the better we can
> > deal with that (energy consumption of transceivers doing all this FEC computations is not
> > even going up linearly with speed).
> 
> Umm, don't build an architecture where you have something else fix its shortcomings. Loss comes from many-to-1 output queues in routers. Its called congestion and we live with it every day. And it is relatively random so you can measure a probability to it.

Ok. didn't think you meant congestion loss, you didn't say so.

It's not a problem to build queues where the counted  qsize
of packets is only payload, not network header. But agreed on
queuing memory cost. Just well worth the price of admission IMHO.

Cheers
    Toerless

> 
> Dino
> 

-- 
---
tte@cs.fau.de