Re: [spring] “SRV6+” complexity in forwarding

Tom Herbert <tom@herbertland.com> Wed, 18 September 2019 15:57 UTC

Return-Path: <tom@herbertland.com>
X-Original-To: spring@ietfa.amsl.com
Delivered-To: spring@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1D148120A1E for <spring@ietfa.amsl.com>; Wed, 18 Sep 2019 08:57:15 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.897
X-Spam-Level:
X-Spam-Status: No, score=-1.897 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=herbertland-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 4xcp-lfB7rq0 for <spring@ietfa.amsl.com>; Wed, 18 Sep 2019 08:57:12 -0700 (PDT)
Received: from mail-ed1-x531.google.com (mail-ed1-x531.google.com [IPv6:2a00:1450:4864:20::531]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5E9A6120A2E for <spring@ietf.org>; Wed, 18 Sep 2019 08:57:11 -0700 (PDT)
Received: by mail-ed1-x531.google.com with SMTP id c4so496473edl.0 for <spring@ietf.org>; Wed, 18 Sep 2019 08:57:11 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=herbertland-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=Rlr5Ues7Obpf5Upe7egSXmpjexQyqLLa7psgqu5rw+0=; b=Lanzaxkc2Ml2e4wuawfEymGjBtEPeCpZ8nivMw+qVgHF/Prs3azPAXzE2o76JPl5xm iulSTmDhkwzBtmpR8QKyV1i+0IPIt4IuLeIP4W1MUTJ0eO1KUQdCC1JV8Lk/kmFVpsVf m9y81xai8GVIywroBHHGMR7Iv6gJAdad10GugEwjzXsxpT05rk3bCXTxEbSQ2E1HZerC HDi1YdETdH8KKlycezK/1nY3oDv1C7x6q1LMBJR4nNLoZib/z9w+3bPMBML+rIPsSpwk Y9lXj2za6MYC2kM5eiQEguROBo0gSkGQsbioIi5Q7GD1BKON7TkHbN856l1jkXAnxSLm dbIQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=Rlr5Ues7Obpf5Upe7egSXmpjexQyqLLa7psgqu5rw+0=; b=mcis8dVFxSdkzGhcahutkVm9vsschY5WG2ZQ1hAjJKXhDvusMlqhH47Uw6KAlGll7t ca0lAzmkaC7A95PueNgIt+k66IMcZMSj76LEN7ISy/47Ifu0jF4xZkNXfgzc6qvsEhg3 1vrcGupWjgUGdTZA8kQHH6G1LdRaM21hSDlTVxAjJ3ANPkUWoYNH7+lUoXK8B9+h9865 jN3Ym5ti2ZspS1vVknSew2F23WT0i7RW76BXC9iaZzcwVGwdSpqTJjEdpluBNj0JriLn pUFYMXErNH9lGUL2gGgI1EX92QhN9QebU6dk3ezAa8GobMTOOrIyfaTC1pSJcNOcQv7b t7wA==
X-Gm-Message-State: APjAAAVqIQFz0g1+vqNxGZl56F/WqFIFGYrk8uwFvhvQYsZX7+7fwyiY 1+ZXvULpXiYFKXgsakFZPl5vIFk9EuB30e+B2RONCw==
X-Google-Smtp-Source: APXvYqyzOgX+aB9blH9a2u3t6AwzLEjQAC6sKcIMNeirh4nKKPTdSt+Qcv0WiNQ42+XACPswadgdwpnPoFnbRU8neV4=
X-Received: by 2002:a50:dac2:: with SMTP id s2mr11162068edj.26.1568822229665; Wed, 18 Sep 2019 08:57:09 -0700 (PDT)
MIME-Version: 1.0
References: <CAHd-QWtA21+2Sm616Fnw0D-eB7SNb_BeG8-A-MCLLFgTwSpOsg@mail.gmail.com> <BYAPR05MB54632F09C712ADB30138CFA9AEBE0@BYAPR05MB5463.namprd05.prod.outlook.com> <BYAPR19MB3415D21403394F8129A4BAD8FCB90@BYAPR19MB3415.namprd19.prod.outlook.com> <30491F13-C652-45C3-AB2B-95F765FBB4EA@juniper.net> <65C5CB04-3A2F-4F83-A7C8-2045154F93AE@cisco.com> <BYAPR05MB5463EC3250F2A303A3641839AEBA0@BYAPR05MB5463.namprd05.prod.outlook.com> <91CBADAD-EFE6-46E1-A9D3-DAA111357179@juniper.net> <CAOj+MMGyUFRPDqCBo5SbLX486o_9GLpM6Zxf8KSt1voWiqhkGQ@mail.gmail.com> <E8D473B5-3E8D-4339-9A79-0CAE30750A55@juniper.net> <CAOj+MMFOy5PyTo=jPJkVrQOctdWjsTbD=7ix-2n89vodKzT3gQ@mail.gmail.com> <2F604D74-51CF-4F2F-AEA9-1CBDEEA9B9F7@gmail.com> <F09C2D09-D769-4817-AF73-97D6ED1BC4BF@lapishills.com> <201909120857387140042@chinatelecom.cn> <1568259664564.62561@bell.ca> <CAO42Z2wQ_8GEE+=nAMFBj+ape9Vf7fARVoOwGdCiUxdffkyXgw@mail.gmail.com> <BYAPR05MB5463A04B05B4BD6AA294F7F0AEB00@BYAPR05MB5463.namprd05.prod.outlook.com> <6EA6F7C0-BEB2-4749-A6AB-62B1337213B2@cisco.com> <BYAPR05MB5463426F1668202EE5F183EFAE8F0@BYAPR05MB5463.namprd05.prod.outlook.com> <634900D2-FBCE-47CF-8907-C8B9CB3A4102@cisco.com>
In-Reply-To: <634900D2-FBCE-47CF-8907-C8B9CB3A4102@cisco.com>
From: Tom Herbert <tom@herbertland.com>
Date: Wed, 18 Sep 2019 08:56:57 -0700
Message-ID: <CALx6S34=Tw-u4Hz-07-Rs-GjsungkqnD_fMoQnGc17u3VJhY1g@mail.gmail.com>
To: "Darren Dukes (ddukes)" <ddukes@cisco.com>
Cc: Ron Bonica <rbonica@juniper.net>, Rob Shakir <robjs@google.com>, SPRING WG <spring@ietf.org>, 6man <6man@ietf.org>, Robert Raszuk <robert@raszuk.net>, "xiechf@chinatelecom.cn" <xiechf@chinatelecom.cn>, Tarek Saad <tsaad.net@gmail.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Archived-At: <https://mailarchive.ietf.org/arch/msg/spring/Yxnrz77Ii1mHnPfxluu5Kw-JGRM>
Subject: Re: [spring] “SRV6+” complexity in forwarding
X-BeenThere: spring@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Source Packet Routing in NetworkinG \(SPRING\)" <spring.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/spring>, <mailto:spring-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/spring/>
List-Post: <mailto:spring@ietf.org>
List-Help: <mailto:spring-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/spring>, <mailto:spring-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 18 Sep 2019 15:57:15 -0000

On Wed, Sep 18, 2019 at 6:42 AM Darren Dukes (ddukes) <ddukes@cisco.com> wrote:
>
> Hi Ron.
>
> I summarized my argument as follows:
> "Regardless of ASIC capabilities there are two performance penalties you will not escape with PSSI+CRH+PPSI: TLV parsing and multiple lookups.”
>
> You’ve confirmed this additional overhead for "SRv6+".  Thanks.
>

Darren,

How does one escape the performance penalty of TLV processing in SRV6?

Tom


> You then say "So long as the ASIC can process enough packets per second to saturate the line cards, we are forwarding at full line rate."
>
> Yes this is true, but we can conclude: The complexity of "SRv6+" requires ASICs do much more work per packet vs SRv6.
>
> Thanks
>   Darren
>
>
> On Sep 16, 2019, at 9:59 PM, Ron Bonica <rbonica@juniper.net> wrote:
>
> Hi Darren,
>
> I think that your argument can be summarized as follows:
>
>
> SRv6 requires only two FIB searches
> SRv6+ requires 4 or more FIB searches
> Therefore, SRv6+ cannot possibly forward at line speed
>
>
> Have I summarized your argument correctly? If not, please set me straight. If so, please read on.
>
> First, SRv6+ never requires more than 4 FIB searches. The DOH that precedes the CRH contains, at most, one PSSI. Therefore SRv6+ requires four FIB searches, at most.
>
> Second, SRv6+ only requires 4 FIB searches the following case:
>
>
> The packet contains two instances of the DOH. (Most use-cases require only one.)
> The processing node is configured to process the PSSI. (Many ASIC-based devices, because of their role in the network, won’t support any per segment service instructions. This nodes will be configured to ignore the PSSI. That is why it is optional.)
>
>
> So, in most use-cases, SRv6+ requires only 3 FIB searches.
>
> So, you might now argue that:
>
>
> SRv6 requires only two FIB searches
> SRv6+ requires three and sometimes four FIB searches
> Therefore, SRv6+ cannot possibly forward at line speed
>
>
> Here, some slightly deeper thought might be required. A platform has two relevant resources:
>
>
> A route lookup ASIC, that can process some number of packets per second
> Some number of interfaces, that can forward some number of bits per second
>
>
> So long as the ASIC can process enough packets per second to saturate the line cards, we are forwarding at full line rate. So long as a platform has a sufficiently capable ASIC, it will be able to forward at line speed. But it’s a matter of how the platform is designed. If the ASIC is not sufficiently capable, of course, it will not forward at line speed.
>
> In your email, you say that I have been asked several times to report on the state of Juniper’s SRv6+ implementation. While I cannot provide details, you can assume that we wouldn’t be working on this if we thought that performance was going to be sub-optimal.
>
> You also suggest that Juniper’s is the only implementation. Are you sure that this is correct?
>
>                                                                                                                      Ron
>
>
>
>
>
> Juniper Business Use Only
> From: Darren Dukes (ddukes) <ddukes@cisco.com>
> Sent: Monday, September 16, 2019 4:38 PM
> To: Ron Bonica <rbonica@juniper.net>
> Cc: Mark Smith <markzzzsmith@gmail.com>; EXT - daniel.bernier@bell.ca <daniel.bernier@bell.ca>; xiechf@chinatelecom.cn; SPRING WG <spring@ietf.org>; 6man <6man@ietf.org>; Robert Raszuk <robert@raszuk.net>; Rob Shakir <robjs@google.com>; Tarek Saad <tsaad.net@gmail.com>
> Subject: “SRV6+” complexity in forwarding
>
> Hi Ron, I agree ASICs are always improving, indeed this is evident in the number of successful SRv6 deployments and multiple vendor implementations at line rate on merchant silicon, and multiple vendor ASICs.
>
> Is “SRv6+” (PSSI+CRH+PPSI) implemented and deployed at line rate?
> You’ve been asked this several times.  Since you’re the only implementor(?) and one operator is claiming deployment or testing, I am curious.
>
> Regardless of ASIC capabilities there are two performance penalties you will not escape with PSSI+CRH+PPSI: TLV parsing and multiple lookups.
>
> Requiring all segments in a CRH segment list to process an arbitrary length DOH+set of PSSI’s and other options is always very expensive.
> - It is expensive in SRAM as previously discussed in these threads.
> - It is expensive in parsing logic to know and process a set of TLVs in any ASIC or NP.
>
> Spreading PSSI, CRH, PPSI operations in multiple headers and multiple identifiers you now have multiple lookups at a node.
> 1 - lookup destination address
> 2 - lookup one or more PSSI and future destination options.
> 3 - lookup the CRH label or PPSI label.
> 4 - lookup new destination address
>
> Compare this with SRv6.
> 1 - lookup destination address
> 2 - lookup new destination address
>
> While ASICs are more capable and will continue to be more capable, these technical performance problems you introduce with PSSI+CRH+PPSI will not go away.
>
> Darren
>
>
>
> On Sep 12, 2019, at 12:34 PM, Ron Bonica <rbonica=40juniper.net@dmarc.ietf.org> wrote:
>
>
> --------------------------------------------------------------------
> IETF IPv6 working group mailing list
> ipv6@ietf.org
> Administrative Requests: https://www.ietf.org/mailman/listinfo/ipv6
> --------------------------------------------------------------------