Re: [Lsr] IP layer metrics collected by Edge routers - draft-dunbar-lsr-5g-edge-compute-ospf-ext (was: LSR Presentation Slot request)

"Joel M. Halpern" <jmh@joelhalpern.com> Wed, 14 July 2021 16:35 UTC

Return-Path: <jmh@joelhalpern.com>
X-Original-To: lsr@ietfa.amsl.com
Delivered-To: lsr@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2CE033A23A1 for <lsr@ietfa.amsl.com>; Wed, 14 Jul 2021 09:35:17 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level:
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, NICE_REPLY_A=-0.001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=joelhalpern.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id l-M0v1Or9Ovi for <lsr@ietfa.amsl.com>; Wed, 14 Jul 2021 09:35:12 -0700 (PDT)
Received: from mailb2.tigertech.net (mailb2.tigertech.net [208.80.4.154]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 165A63A239E for <lsr@ietf.org>; Wed, 14 Jul 2021 09:35:11 -0700 (PDT)
Received: from localhost (localhost [127.0.0.1]) by mailb2.tigertech.net (Postfix) with ESMTP id 4GQ35C4ZVkz1nsc7; Wed, 14 Jul 2021 09:35:11 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=joelhalpern.com; s=2.tigertech; t=1626280511; bh=SS06FZU0gUPEIRCCzuUlo+xRbjRpLXPPLCwOeb+j+qU=; h=Subject:To:References:From:Date:In-Reply-To:From; b=ckFuCoy1LP812RFhVmdRUUzb+zJKPiPWuuKKFnlvw59lLPfKx/R2KcSfOOAyOL/vg zv0JseotNfcD5RH50tz+5B1FIrefMZNU75yoaaceHh21F53mBllwesCCezZnUccIC9 EYCm64Ol/sGlDiq59r9vSsQpZt1oxdot+0I/4sVA=
X-Quarantine-ID: <j7a2AgqDAcny>
X-Virus-Scanned: Debian amavisd-new at b2.tigertech.net
Received: from [192.168.23.64] (50-233-136-230-static.hfc.comcastbusiness.net [50.233.136.230]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by mailb2.tigertech.net (Postfix) with ESMTPSA id 4GQ35B4gVjz1nsM6; Wed, 14 Jul 2021 09:35:10 -0700 (PDT)
To: Linda Dunbar <linda.dunbar@futurewei.com>, "Acee Lindem (acee)" <acee@cisco.com>, Yingzhen Qu <yingzhen.ietf@gmail.com>, "lsr@ietf.org" <lsr@ietf.org>
References: <CO1PR13MB49205570912CA823A3002A1685159@CO1PR13MB4920.namprd13.prod.outlook.com> <11585166-801F-4CE2-9E2B-D30141915776@cisco.com> <CO1PR13MB49205EA3E43CFD467DF5D5B185149@CO1PR13MB4920.namprd13.prod.outlook.com> <31B15269-2C13-401B-AFD6-D4EE6CA7A3A7@cisco.com> <CO1PR13MB4920490015739130CFA09E8D85149@CO1PR13MB4920.namprd13.prod.outlook.com> <1667A6AC-DDC9-46FA-AC6A-56E5260C2300@cisco.com> <CO1PR13MB4920D162D6BFCCCFC91D673F85139@CO1PR13MB4920.namprd13.prod.outlook.com>
From: "Joel M. Halpern" <jmh@joelhalpern.com>
Message-ID: <4aca097a-01bd-ff97-1b2d-26f3d1311587@joelhalpern.com>
Date: Wed, 14 Jul 2021 12:35:09 -0400
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0
MIME-Version: 1.0
In-Reply-To: <CO1PR13MB4920D162D6BFCCCFC91D673F85139@CO1PR13MB4920.namprd13.prod.outlook.com>
Content-Type: text/plain; charset="windows-1252"; format="flowed"
Content-Language: en-US
Content-Transfer-Encoding: 8bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/lsr/6NUY1E_knAGVdp9sjojI-njJ-uk>
Subject: Re: [Lsr] IP layer metrics collected by Edge routers - draft-dunbar-lsr-5g-edge-compute-ospf-ext (was: LSR Presentation Slot request)
X-BeenThere: lsr@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Link State Routing Working Group <lsr.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/lsr>, <mailto:lsr-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/lsr/>
List-Post: <mailto:lsr@ietf.org>
List-Help: <mailto:lsr-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/lsr>, <mailto:lsr-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 14 Jul 2021 16:35:17 -0000

If you want to experiment with unusual metrics, and minimize the degree 
to which you need consistency, maybe you should look at running a 
different routing protocol in this limited domain?  Rather than trying 
to make IS-IS and OSPF do something they are not designed for?  (While 
there are probably other alternatives, Babel comes to mind as a routing 
protocol designed with experimentaiton with metrics in mind.)

Yours,
Joel

On 7/14/2021 12:20 PM, Linda Dunbar wrote:
> Acee,
> 
> The “limited domain” per RFC8799  is a special purposed network that 
> have boundary, e.g. DetNet. For 5G EC, a Limited Domain network could be 
> built specifically for Unmanned Aerial Vehicles (UAV), as specified by 
> 3GPP 23.748.  This UAV Limited Domain network has routers and links that 
> connect the moving UAVs with the UAV control servers, the analytics 
> functions, and data storages; has boundary and  may not have access to 
> public internet.
> 
> Among those routers in the UAV Limited Domain, the routing distance 
> alone is no longer enough in computing the optimal Path. Therefore, IGP 
> is needed to distribute not only link bandwidth, but also the IP layer 
> Metrics specified by draft-dunbar-lsr-5g-edge-compute-ext, specifically:
> 
>   * Capacity Index:
> 
> Is used to differentiate the running environment of the attached 
> application server (analytics or data storages) that are identified by 
> their IP addresses.  At some sites, the IP address exposed to the 
> network is the App Layer Load balancer that have  many instances 
> attached.  At other sites,  the IP address exposed is the server 
> instance only.
> 
> “Capacity Index”, which is a numeric number configured by the Domain 
> Controller on all A-ERs in the domain consistently , is used to 
> represent the capacity of the application server attached to an A-ER.
> 
>   * Site preference index: 
> 
> Is used to describe some sites are more preferred than others for some 
> flows that are identified by the IP header fields. “Site Preference 
> Index”, which is a numeric number configured by the Domain Controller.
> 
>   * IP-Layer Metric for gauging the Load for the attached Prefix (i.e.,
>     App Server):
> 
> The Load Measurement to an attached IP prefix (App Server) is a weighted 
> combination of the number of packets/bytes to the IP prefix and the 
> number of packets/bytes from the IP prefix which are collected by the 
> A-ER that has the App Server directly attached.
> 
> An A-ER only collects those measurement for the prefixes instructed by 
> the Domain Controller .
> 
> The work proposed is for the LSR Chartered Work Item “4) Extensions for 
> source-destination routing”.
> 
> Is this description clear enough to move forward in the LSR WG?
> 
> Best regards, Linda Dunbar
> 
> *From:* Acee Lindem (acee) <acee@cisco.com>
> *Sent:* Tuesday, July 13, 2021 2:46 PM
> *To:* Linda Dunbar <linda.dunbar@futurewei.com>; Yingzhen Qu 
> <yingzhen.ietf@gmail.com>; lsr@ietf.org
> *Cc:* lsr-chairs@ietf.org
> *Subject:* Re: IP layer metrics collected by Edge routers - 
> draft-dunbar-lsr-5g-edge-compute-ospf-ext (was: LSR Presentation Slot 
> request)
> 
> We seem to be in a circular discussion – we’re not standardizing 
> loosely-defined metrics that only work in limited domains for OSPF and 
> IS-IS. It is not a question of where.
> 
> Acee
> 
> *From: *Linda Dunbar <linda.dunbar@futurewei.com 
> <mailto:linda.dunbar@futurewei.com>>
> *Date: *Tuesday, July 13, 2021 at 3:42 PM
> *To: *Acee Lindem <acee@cisco.com <mailto:acee@cisco.com>>, Yingzhen Qu 
> <yingzhen.ietf@gmail.com <mailto:yingzhen.ietf@gmail.com>>, 
> "lsr@ietf.org <mailto:lsr@ietf.org>" <lsr@ietf.org <mailto:lsr@ietf.org>>
> *Cc: *"lsr-chairs@ietf.org <mailto:lsr-chairs@ietf.org>" 
> <lsr-chairs@ietf.org <mailto:lsr-chairs@ietf.org>>
> *Subject: *RE: IP layer metrics collected by Edge routers - 
> draft-dunbar-lsr-5g-edge-compute-ospf-ext (was: LSR Presentation Slot 
> request)
> 
> Acee,
> 
> Limited domain also needs IS-IS and OSPF  routing protocol (among 
> routers in the limited domain). If not in LSR, where is the right place?
> 
> Linda
> 
> *From:* Acee Lindem (acee) <acee@cisco.com <mailto:acee@cisco.com>>
> *Sent:* Tuesday, July 13, 2021 2:24 PM
> *To:* Linda Dunbar <linda.dunbar@futurewei.com 
> <mailto:linda.dunbar@futurewei.com>>; Yingzhen Qu 
> <yingzhen.ietf@gmail.com <mailto:yingzhen.ietf@gmail.com>>; lsr@ietf.org 
> <mailto:lsr@ietf.org>
> *Cc:* lsr-chairs@ietf.org <mailto:lsr-chairs@ietf.org>
> *Subject:* Re: IP layer metrics collected by Edge routers - 
> draft-dunbar-lsr-5g-edge-compute-ospf-ext (was: LSR Presentation Slot 
> request)
> 
> Linda – we’re not doing routing for limited domains in LSR. It doesn’t 
> make any sense to go any further until you fix the draft or abandon it.
> 
> Thanks,
> 
> Acee
> 
> *From: *Linda Dunbar <linda.dunbar@futurewei.com 
> <mailto:linda.dunbar@futurewei.com>>
> *Date: *Tuesday, July 13, 2021 at 1:23 PM
> *To: *Acee Lindem <acee@cisco.com <mailto:acee@cisco.com>>, Yingzhen Qu 
> <yingzhen.ietf@gmail.com <mailto:yingzhen.ietf@gmail.com>>, 
> "lsr@ietf.org <mailto:lsr@ietf.org>" <lsr@ietf.org <mailto:lsr@ietf.org>>
> *Cc: *"lsr-chairs@ietf.org <mailto:lsr-chairs@ietf.org>" 
> <lsr-chairs@ietf.org <mailto:lsr-chairs@ietf.org>>
> *Subject: *RE: IP layer metrics collected by Edge routers - 
> draft-dunbar-lsr-5g-edge-compute-ospf-ext (was: LSR Presentation Slot 
> request)
> 
> Acee,
> 
> The scope of the draft is for IGP in the  Limited Domains per RFC8799, 
> i.e. the small number of routers in the 5G LDN domain. Not meant for 
> public Internet.
> 
> Answers to your questions are inserted below:
> 
> Linda
> 
> *From:* Acee Lindem (acee) <acee@cisco.com <mailto:acee@cisco.com>>
> *Sent:* Monday, July 12, 2021 7:06 PM
> *To:* Linda Dunbar <linda.dunbar@futurewei.com 
> <mailto:linda.dunbar@futurewei.com>>; Yingzhen Qu 
> <yingzhen.ietf@gmail.com <mailto:yingzhen.ietf@gmail.com>>; lsr@ietf.org 
> <mailto:lsr@ietf.org>
> *Cc:* lsr-chairs@ietf.org <mailto:lsr-chairs@ietf.org>
> *Subject:* Re: IP layer metrics collected by Edge routers - 
> draft-dunbar-lsr-5g-edge-compute-ospf-ext (was: LSR Presentation Slot 
> request)
> 
> Hi Linda,
> 
> *From: *Linda Dunbar <linda.dunbar@futurewei.com 
> <mailto:linda.dunbar@futurewei.com>>
> *Date: *Monday, July 12, 2021 at 5:41 PM
> *To: *Acee Lindem <acee@cisco.com <mailto:acee@cisco.com>>, Yingzhen Qu 
> <yingzhen.ietf@gmail.com <mailto:yingzhen.ietf@gmail.com>>, 
> "lsr@ietf.org <mailto:lsr@ietf.org>" <lsr@ietf.org <mailto:lsr@ietf.org>>
> *Cc: *"lsr-chairs@ietf.org <mailto:lsr-chairs@ietf.org>" 
> <lsr-chairs@ietf.org <mailto:lsr-chairs@ietf.org>>
> *Subject: *IP layer metrics collected by Edge routers - 
> draft-dunbar-lsr-5g-edge-compute-ospf-ext (was: LSR Presentation Slot 
> request)
> 
> Acee,
> 
> The draft-dunbar-lsr-5g-edge-compute-ospf-ext has two parts:
> 
> -Aggregated Cost Advertisement
> 
> -IP Layer App-Metrics Advertisements by OSPF
> 
> “Aggregated Cost” is only applicable to scenario where all the A-ER can 
> have a consistent algorithm to compute the Aggregated cost.
> 
> When it is not possible for all the egress edge routers to have a 
> consistent algorithm to compute the aggregated cost or some routers need 
> all the detailed IP Layer metrics for the App Servers for other 
> purposes, the raw IP layer metrics collected A-ER will be distributed. 
> Only the nodes that are capable of utilizing the metrics will process 
> the sub-TLV.
> 
> So, why would these “capable” nodes have a consistent algorithm for 
> using this complex set of metrics but the A-ERs would not have a 
> consistent algorithm for aggregating the cost?
> 
> [Linda] Example of the nodes that need the metrics: analytic function 
> (residing on one of the nodes in the LDN);  a small number of UPF 
> functions that need the metrics.
> 
> Since only a subset of routers within an IGP domain need to know those 
> detailed metrics, the draft used your suggested  OSPFv2 Extended Prefix 
> Opaque LSA for IPv4 and OSPFv3 Extended LSA with Intra-Area-Prefix TLV 
> to carry the detailed sub-TLVs.  For routers that don’t care about those 
> metrics, they can ignore them very easily.
> 
> This just doesn’t work. All routers in an IGP domain must use the same 
> algorithm. You can’t just draw a picture with an LDN directly connected 
> to a couple A-ERs say that the LDNs can use your metrics to route 
> application specific traffic. The problem could possibly be solved with 
> flex algorithm but it would require a lot more specification. I guess 
> with your simple topology different LDNs could use the metrics 
> differently as well? This would explain why you are not concerned with 
> “consistency”…  \
> 
> [Linda] The 5G LDN domain  is a limited domain per RFC 8799, and forms 
> its own IGP domain. The “consistency is only for the limited nodes that 
> are configured to utilize the IP layer metrics”. The IP Layer metrics is 
> for nodes in this limited domain to supplement the forwarding path 
> computation.
> 
> It worth noting that not all hosts (prefix) attached to an A-ER are 
> ANYCAST servers that need network optimization. An A-ER only needs to 
> advertise the App-Metrics for the ANYCAST addresses that match with the 
> configured ACLs.
> 
> Note that routes are based on IP prefixes and not applications while the 
> draft uses these two interchangeably.
> 
> [Linda] the Applications that need special consideration are identified 
> by its IP address.
> 
> Thanks,
> 
> Acee
> 
> Any other concerns?
> 
> Thank you
> 
> Linda Dunbar
> 
> *From:* Acee Lindem (acee) <acee@cisco.com <mailto:acee@cisco.com>>
> *Sent:* Monday, July 12, 2021 4:04 PM
> *To:* Linda Dunbar <linda.dunbar@futurewei.com 
> <mailto:linda.dunbar@futurewei.com>>; Yingzhen Qu 
> <yingzhen.ietf@gmail.com <mailto:yingzhen.ietf@gmail.com>>; lsr@ietf.org 
> <mailto:lsr@ietf.org>
> *Cc:* lsr-chairs@ietf.org <mailto:lsr-chairs@ietf.org>
> *Subject:* Re: [Lsr] LSR Presentation Slot Requests - IETF111
> 
> Speaking as WG member:
> 
> Hi Linda,
> 
> Even if you’ve added some IS-IS encodings, the draft still suffers from 
> the fundamental problem of the previous draft. If you can’t rely on the 
> A-ERs to consistently calculate an aggregated metric, how can you rely 
> on all the routers in the IGP routing domain to use complex set of 
> metrics to reach the least-loaded app server? Do we really want to talk 
> about this again?
> 
> Thanks,
> Acee
> 
> *From: *Linda Dunbar <linda.dunbar@futurewei.com 
> <mailto:linda.dunbar@futurewei.com>>
> *Date: *Monday, July 12, 2021 at 4:27 PM
> *To: *Yingzhen Qu <yingzhen.ietf@gmail.com 
> <mailto:yingzhen.ietf@gmail.com>>, "lsr@ietf.org <mailto:lsr@ietf.org>" 
> <lsr@ietf.org <mailto:lsr@ietf.org>>
> *Cc: *"lsr-chairs@ietf.org <mailto:lsr-chairs@ietf.org>" 
> <lsr-chairs@ietf.org <mailto:lsr-chairs@ietf.org>>
> *Subject: *RE: [Lsr] LSR Presentation Slot Requests - IETF111
> *Resent-From: *<alias-bounces@ietf.org <mailto:alias-bounces@ietf.org>>
> *Resent-To: *Acee Lindem <acee@cisco.com <mailto:acee@cisco.com>>, 
> Christian Hopps <chopps@chopps.org <mailto:chopps@chopps.org>>, Yingzhen 
> Qu <yingzhen.ietf@gmail.com <mailto:yingzhen.ietf@gmail.com>>
> *Resent-Date: *Monday, July 12, 2021 at 4:27 PM
> 
> Yingzhen and LSR Chairs,
> 
> We need a 10 minutes slot at IETF111 to present 
> https://datatracker.ietf.org/doc/draft-dunbar-lsr-5g-edge-compute/ 
> <https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdatatracker.ietf.org%2Fdoc%2Fdraft-dunbar-lsr-5g-edge-compute%2F&data=04%7C01%7Clinda.dunbar%40futurewei.com%7C492fc62171624e5792ea08d94636e9d9%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C0%7C637618023942568077%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=7f0TuUw7LVnzT2doHdN0CIJ4SinQP7KKzIUA61yBDrg%3D&reserved=0> 
> 
> 
> Speaker: Linda Dunbar.
> 
> This draft adds the IS-IS extension to the 
> draft-dunbar-lsr-5g-edge-compute-ospf-ext-04.
> 
> Thank you
> 
> Linda Dunbar
> 
> *From:* Lsr <lsr-bounces@ietf.org <mailto:lsr-bounces@ietf.org>> *On 
> Behalf Of *Yingzhen Qu
> *Sent:* Wednesday, June 30, 2021 4:00 PM
> *To:* lsr@ietf.org <mailto:lsr@ietf.org>
> *Cc:* lsr-chairs@ietf.org <mailto:lsr-chairs@ietf.org>
> *Subject:* [Lsr] LSR Presentation Slot Requests - IETF111
> 
> Hi all,
> 
> 
> The draft agenda for IETF111 has been posted: 
> https://datatracker.ietf.org/meeting/111/agenda 
> <https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdatatracker.ietf.org%2Fmeeting%2F111%2Fagenda&data=04%7C01%7Clinda.dunbar%40futurewei.com%7C492fc62171624e5792ea08d94636e9d9%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C0%7C637618023942578032%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=xI%2F46njm9a3I0qx7fDKRaULJ2qygqdDRT4QIBUtkBqQ%3D&reserved=0>. 
> 
> 
> LSR will have one meeting session: Friday, July 30, 2021 16:00-18:00 
>   Session III PDT
> 
> Please send slot requests to lsr-chairs@ietf.org 
> <mailto:lsr-chairs@ietf.org>. Please include name of the presenter, 
> pointer to the draft and time estimation including Q&A.
> 
> Thanks,
> 
> Yingzhen
> 
> 
> _______________________________________________
> Lsr mailing list
> Lsr@ietf.org
> https://www.ietf.org/mailman/listinfo/lsr
>