recursive system dependencies (Was: Re: New Version Notification for draft-trossen-rtgwg-impact-of-dlts-00.txt)

Toerless Eckert <tte@cs.fau.de> Thu, 10 March 2022 08:53 UTC

Return-Path: <eckert@i4.informatik.uni-erlangen.de>
X-Original-To: routing-discussion@ietfa.amsl.com
Delivered-To: routing-discussion@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E51B03A0A04; Thu, 10 Mar 2022 00:53:12 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.661
X-Spam-Level:
X-Spam-Status: No, score=-1.661 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HEADER_FROM_DIFFERENT_DOMAINS=0.248, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2GMqX5luVK1J; Thu, 10 Mar 2022 00:53:08 -0800 (PST)
Received: from faui40.informatik.uni-erlangen.de (faui40.informatik.uni-erlangen.de [131.188.34.40]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 0819A3A07A3; Thu, 10 Mar 2022 00:53:07 -0800 (PST)
Received: from faui48e.informatik.uni-erlangen.de (faui48e.informatik.uni-erlangen.de [IPv6:2001:638:a000:4134::ffff:51]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by faui40.informatik.uni-erlangen.de (Postfix) with ESMTPS id 2020658C4AF; Thu, 10 Mar 2022 09:53:00 +0100 (CET)
Received: by faui48e.informatik.uni-erlangen.de (Postfix, from userid 10463) id E2DE04EA898; Thu, 10 Mar 2022 09:52:59 +0100 (CET)
Date: Thu, 10 Mar 2022 09:52:59 +0100
From: Toerless Eckert <tte@cs.fau.de>
To: Dirk Trossen <dirk.trossen=40huawei.com@dmarc.ietf.org>
Cc: "adrian@olddog.co.uk" <adrian@olddog.co.uk>, "rtgwg@ietf.org" <rtgwg@ietf.org>, "routing-discussion@ietf.org" <routing-discussion@ietf.org>, anima@ietf.org
Subject: recursive system dependencies (Was: Re: New Version Notification for draft-trossen-rtgwg-impact-of-dlts-00.txt)
Message-ID: <Yim8a6UPY8rZq92g@faui48e.informatik.uni-erlangen.de>
References: <164485138286.22125.17451234678560157962@ietfa.amsl.com> <239d4d5d00914c7aa8bf357bde929dd2@huawei.com> <8e6cb876102e494187a1821a2cb79c7b@huawei.com> <132001d833dc$15d8a190$4189e4b0$@olddog.co.uk> <1257684f830740fdb8dae5939b1de12e@huawei.com>
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
In-Reply-To: <1257684f830740fdb8dae5939b1de12e@huawei.com>
Archived-At: <https://mailarchive.ietf.org/arch/msg/routing-discussion/l2vIIky9kwZ3KR31cE3n3iJCJCI>
X-BeenThere: routing-discussion@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Routing Area General Discussion list <routing-discussion.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/routing-discussion>, <mailto:routing-discussion-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/routing-discussion/>
List-Post: <mailto:routing-discussion@ietf.org>
List-Help: <mailto:routing-discussion-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/routing-discussion>, <mailto:routing-discussion-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 10 Mar 2022 08:53:13 -0000

[adding anima]

One should not be surprised to see a lot of outages to be related to
loss of connectivity and/or control due to non-understood circular dependencies.
This is certainly true for several of the big outages reported, such as
some complex mutual automation control failure in Google a few years back,
and then the typical "routing broke, and we couldn't remotely access the
node we needed to fix... because routing broke". That issue of course
is resolveable by ACP/RFC8994 and lists a documented example of that issue
as investigated by FCC because the network was running 911 services and
was thus subject to regulation. When big OTT networks have outages, you
will of course almost never see a good root cause analysis publically because
there is no regulation that forces them to. Maybe a bit like how the banking
sector i think also has managed to keep a lot of its security issues under wraps.

We do also have in ANIMA participants interested in having those dependency
chains modelled, which would allow to discover loops that could result in blockage,
and to manage service instantiation in the order necessary to resolve dependencies
when they are resolvable. However:

I always look with marvel and dismay at those dependency resolution systems
found in linux distributions to (compile and) install packages. And that sounds
so simple that one should expect that it should not result in dependency resolution
failures when there are no actual circular ones, but in practice those issues occur
repeatedly, and one has to take really unnecessary brute-force resolution
measures even though in detailled analysis one could see a limited dependency
resolution chain, which the platform package management system just couldn't figure
out. Admittedly, this is more of a problem with more flexible systems such as
gentoo where you can have multiple versions of packages and also differently
parameterized packages(through parameterized compilation). But those are exactly
the minimum complexity requirements i would expect in an actual network services
(ever seen a netork service without per-deployment parameters ?).
So i fear that the more we're automating networks with SDN, the more we will run
in the buildup of system dependencies that can only be resolved automatically with
 "please reboot the continent wide network... now!".

Or else we could go back building simpler networks. Maybe bottom up like we
used to do instead of orchestrating a random complexity zoo like we do like to do
now in the times of automation...

Cheers
    Toerless

On Thu, Mar 10, 2022 at 06:49:07AM +0000, Dirk Trossen wrote:
> Have you seen anything like this and what do you think are the consequences?
> [DOT] What the consequences of this may be is difficult to judge IMO. Maybe an SDN-like situation, i.e., still having an IP-based control overlay which then manages the remaining IP service plane? Another possible direction to look into is using ANIMA concepts to bootstrap (and maintain) a DLT-like control overlay. But this is also why we are asking the community for possible network innovations that may help improve on the efficacy of DLTs. One approach we looked into, as an example but this still needs more work, is 'L3-based service routing' as a form of semantic routing (hence the hint to the semantic routing discussions in the draft). Here, we interpret the DLT as a service provided across the network. I could see this being provided as a baseline/bootstrap service through which to manage the (service routing) data that is being enriched over time by other services. But again, we were hoping to find more folks in the community who have thought deeper along those lines; we are ju
>  st at the start of doing so.
> 
> Thanks,
> Adrian
> 
> -----Original Message-----
> From: rtgwg <rtgwg-bounces@ietf.org> On Behalf Of Dirk Trossen
> Sent: 02 March 2022 13:16
> To: Dirk Trossen <dirk.trossen=40huawei.com@dmarc.ietf.org>; rtgwg@ietf.org; routing-discussion@ietf.org
> Subject: RE: New Version Notification for draft-trossen-rtgwg-impact-of-dlts-00.txt
> 
> All,
> 
> We have posted an updated to the draft below at https://datatracker.ietf.org/doc/draft-trossen-rtgwg-impact-of-dlts/. 
> 
> We now welcome Mike McBride and Xinxin Fan as additional co-authors and have also added language into the introduction to clarify our initial insights being limited to PoW -based DLT systems, which lead to some characteristic communication patterns and associated inefficiencies compared to, say, PoS-based systems. 
> 
> Please provide any comments you may have on the draft and/or its insights, including any interests in contributing in its expansion (e.g., to other DLT systems).
> 
> Best,
> 
> Dirk
> 
> -----Original Message-----
> From: routing-discussion [mailto:routing-discussion-bounces@ietf.org] On Behalf Of Dirk Trossen
> Sent: 14 February 2022 16:16
> To: rtgwg@ietf.org; routing-discussion@ietf.org
> Subject: FW: New Version Notification for draft-trossen-rtgwg-impact-of-dlts-00.txt
> 
> All,
> 
> We posted the draft below to continue a piece of work initiated in the Industry IoT Consortium (IIC) on understanding the "Impact of DLTs on provider networks", leading to the whitepaper at https://www.iiconsortium.org/pdf/2022-01-10-Impact-of-Distributed-Ledgers-on
> -Provider-Networks.pdf
> 
> With this draft, we solicit feedback from the wider IETF community on our insights regarding DLTs with the desire to broaden our findings with the expertise we can find here but also to capture possible network and routing innovations that may improve on the impacts we have identified.
> 
> If you have any comments or would like to contribute to this work, please do let us know, either on the list or directly to the authors.
> 
> Best,
> 
> Dirk (on behalf of the authors)
> 
> -----Original Message-----
> From: internet-drafts@ietf.org [mailto:internet-drafts@ietf.org]
> Sent: 14 February 2022 16:10
> To: David Guzman <david.guzman@huawei.com>; Dirk Trossen <dirk.trossen@huawei.com>
> Subject: New Version Notification for
> draft-trossen-rtgwg-impact-of-dlts-00.txt
> 
> 
> A new version of I-D, draft-trossen-rtgwg-impact-of-dlts-00.txt
> has been successfully submitted by Dirk Trossen and posted to the IETF
> repository.
> 
> Name:		draft-trossen-rtgwg-impact-of-dlts
> Revision:	00
> Title:		Impact of DLTs on Provider Networks
> Document date:	2022-02-14
> Group:		Individual Submission
> Pages:		16
> URL:
> https://www.ietf.org/archive/id/draft-trossen-rtgwg-impact-of-dlts-00.txt
> Status:
> https://datatracker.ietf.org/doc/draft-trossen-rtgwg-impact-of-dlts/
> Htmlized:
> https://datatracker.ietf.org/doc/html/draft-trossen-rtgwg-impact-of-dlts
> 
> 
> Abstract:
>    This document discusses the impact of distributed ledger technologies
>    being realized over IP-based provider networks.  The focus here lies
>    on the impact that the DLT communication patterns have on efficiency
>    of resource usage in the underlying networks.  We provide initial
>    insights into experimental results to quantify this impact in terms
>    of inefficient and wasted communication, aligned along challenges
>    that the DLT realization over IP networks faces.
> 
>    This document is intended to outline this impact but also
>    opportunities for network innovations to improve on the identified
>    impact as well as the overall service quality.  While this document
>    does not promote specific solutions that capture those opportunities,
>    it invites the wider community working on DLT and network solutions
>    alike to contribute to the insights in this document to aid future
>    research and development into possible solution concepts and
>    technologies.
> 
>    The findings presented here have first been reported within the
>    similarly titled whitepaper released by the Industry IoT Consortium
>    [IIC_whitepaper].
> 
>  
> 
> 
> 
> The IETF Secretariat
> 
> 
> _______________________________________________
> routing-discussion mailing list
> routing-discussion@ietf.org
> https://www.ietf.org/mailman/listinfo/routing-discussion
> 
> _______________________________________________
> rtgwg mailing list
> rtgwg@ietf.org
> https://www.ietf.org/mailman/listinfo/rtgwg
> 
> _______________________________________________
> rtgwg mailing list
> rtgwg@ietf.org
> https://www.ietf.org/mailman/listinfo/rtgwg

-- 
---
tte@cs.fau.de