RE: The automatic policy exchange by draft-ietf-idr-rpd-05.txt can be used for draft-ietf-rtgwg-net2cloud-gap-analysis

[Linda Dunbar <[e-mail]>]

Jakob,

Don’t you think your described procedure is extremely configuration heavy and error prone?
If PE1 and PE2 is configured with FAT fingers causing the number not matching with the communities that CE10 is using, then this procedure won’t work.

Linda Dunbar

From: Jakob Heitz (jheitz) <[e-mail]>
Sent: Wednesday, July 29, 2020 3:43 PM
To: Linda Dunbar <[e-mail]>; Jakob Heitz (jheitz) <jheitz=[e-mail]>; Robert Raszuk <[e-mail]>; Lizhenbin <[e-mail]>
Cc: [e-mail]; [e-mail] [e-mail] <[e-mail]>; [e-mail]
Subject: RE: The automatic policy exchange by draft-ietf-idr-rpd-05.txt can be used for draft-ietf-rtgwg-net2cloud-gap-analysis

By sending the appropriate community or communities with its route.

Suppose it wants CE1 to use PE1 and CE2 to use PE2, then it would
attach the communities 65000:1001, 65000:2002 to that route.
For another route, it might attach different communities.
If it wants to direct the traffic of CE4 and/or CE3,
it would attach communities for them as well.

No policies are ephemeral. They are set once and endure.
The traffic direction is done by attaching communities to routes.

(I fixed my earlier error of MED values)

Regards,
Jakob.

From: Linda Dunbar <[e-mail]<mailto:[e-mail]>>
Sent: Wednesday, July 29, 2020 1:27 PM
To: Jakob Heitz (jheitz) <[e-mail]<mailto:[e-mail]>>; Jakob Heitz (jheitz) <jheitz=[e-mail]<mailto:jheitz=[e-mail]>>; Robert Raszuk <[e-mail]<mailto:[e-mail]>>; Lizhenbin <[e-mail]<mailto:[e-mail]>>
Cc: [e-mail]<mailto:[e-mail]>; [e-mail]<mailto:[e-mail]> [e-mail]<mailto:[e-mail]> <[e-mail]<mailto:[e-mail]>>; [e-mail]<mailto:[e-mail]>
Subject: RE: The automatic policy exchange by draft-ietf-idr-rpd-05.txt can be used for draft-ietf-rtgwg-net2cloud-gap-analysis

Jakob,

Thank you very much for writing down the detailed configuration.

Two questions on your suggested configuration:

  1.  How does “CE10 has full control over which CE it chooses at which site”? is it via changing the matching address in MED2 and MED1?



  1.  Are those changes via NETCON? Are you suggesting the NETCON configurations sent among PEs?



Thank you.

Linda

From: Jakob Heitz (jheitz) <[e-mail]<mailto:[e-mail]>>
Sent: Monday, July 27, 2020 6:20 PM
To: Jakob Heitz (jheitz) <jheitz=[e-mail]<mailto:jheitz=[e-mail]>>; Linda Dunbar <[e-mail]<mailto:[e-mail]>>; Robert Raszuk <[e-mail]<mailto:[e-mail]>>; Lizhenbin <[e-mail]<mailto:[e-mail]>>
Cc: [e-mail]<mailto:[e-mail]>; [e-mail]<mailto:[e-mail]> [e-mail]<mailto:[e-mail]> <[e-mail]<mailto:[e-mail]>>; [e-mail]<mailto:[e-mail]>
Subject: RE: The automatic policy exchange by draft-ietf-idr-rpd-05.txt can be used for draft-ietf-rtgwg-net2cloud-gap-analysis

Oops, I got the MEDs back-to-front. Thinking Local-pref.

Regards,
Jakob.

From: rtgwg <[e-mail]<mailto:[e-mail]>> On Behalf Of Jakob Heitz (jheitz)
Sent: Monday, July 27, 2020 3:46 PM
To: Linda Dunbar <[e-mail]<mailto:[e-mail]>>; Robert Raszuk <[e-mail]<mailto:[e-mail]>>; Lizhenbin <[e-mail]<mailto:[e-mail]>>
Cc: [e-mail]<mailto:[e-mail]>; [e-mail]<mailto:[e-mail]> [e-mail]<mailto:[e-mail]> <[e-mail]<mailto:[e-mail]>>; [e-mail]<mailto:[e-mail]>
Subject: RE: The automatic policy exchange by draft-ietf-idr-rpd-05.txt can be used for draft-ietf-rtgwg-net2cloud-gap-analysis

RPD is not automation.
Automation is an application program that senses the state of the network and then
instructs various network nodes to direct traffic in different ways.
That part may be manual or have a degree of automation attached to it.
RPD or netconf is just a way to signal the intention from the app to the nodes.
If there is no application program, then the process is still manual,
even if you have RPD.

RPD might work in the simple diagram you have drawn.
However, a PE does not have just a single vCPE.
Using RPD, you would apply the same policy to every vCPE on that PE.

An alternative solution using enduring policies is to set MED based on communities.
For each CE session, the PE would set a high MED by default.
Then each CE session would set a lower MED based on a community match.
Each CE session would match a different community at the cloud side PE.
That way, the CE at the enterprise can send the community that matches its chosen
PE at the cloud end.
You could make several variations using as-prepend, origin, cost-community,
color-community paired with SR-policy.
[An Ink Drawing]
On PE1, we configure (pseudocode):
router BGP x
  neighbor CE1
    route policy out
      if community matches 65000:1001 then
         set MED 1
      else
         set MED 2
      endif
    end
  end
  neighbor CE2
    route policy out
      if community matches 65000:1002 then
         set MED 1
      else
         set MED 2
      endif
    end
  end
end

On PE2, we configure:
router BGP x
  neighbor CE1
    route policy out
      if community matches 65000:2001 then
         set MED 1
      else
         set MED 2
      endif
    end
  end
  neighbor CE2
    route policy out
      if community matches 65000:2002 then
         set MED 1
      else
         set MED 2
      endif
    end
  end
end

On PE3, we configure:
router BGP x
  neighbor CE3
    route policy out
      if community matches 65000:3003 then
         set MED 1
      else
         set MED 2
      endif
    end
  end
  neighbor CE4
    route policy out
      if community matches 65000:3004 then
         set MED 1
      else
         set MED 2
      endif
    end
  end
end

On PE4, we configure:
router BGP x
  neighbor CE3
    route policy out
      if community matches 65000:4003 then
         set MED 1
      else
         set MED 2
      endif
    end
  end
  neighbor CE4
    route policy out
      if community matches 65000:4004 then
         set MED 1
      else
         set MED 2
      endif
    end
  end
end

Now, CE10 has full control over which CE it chooses at which site.
It can choose a different PE as bestpath for each CE for each route
and for each site.

Much more flexibility than the RPD draft.

It requires no coordination between route distribution and
ephemeral policy distribution.

Much more simplicity than the RPD draft.

You might argue that with ephemeral policy distribution, you can make
a wholesale change by changing just one policy and not re-advertising
all the routes. However, remember that if you make a policy change,
all the routes need to be readvertised anyway.

Regards,
Jakob.

From: Linda Dunbar <[e-mail]<mailto:[e-mail]>>
Sent: Sunday, July 26, 2020 2:54 PM
To: Robert Raszuk <[e-mail]<mailto:[e-mail]>>; Lizhenbin <[e-mail]<mailto:[e-mail]>>
Cc: Jakob Heitz (jheitz) <[e-mail]<mailto:[e-mail]>>; [e-mail]<mailto:[e-mail]>; [e-mail]<mailto:[e-mail]> [e-mail]<mailto:[e-mail]> <[e-mail]<mailto:[e-mail]>>; [e-mail]<mailto:[e-mail]>
Subject: The automatic policy exchange by draft-ietf-idr-rpd-05.txt can be used for draft-ietf-rtgwg-net2cloud-gap-analysis

Robert, Jakob, etc.

Thank you very much for detailed explanation of the issues.
One of the points you all raised is that p2p policies should be administrated by controller via NETCONF.

https://datatracker.ietf.org/doc/draft-ietf-rtgwg-net2cloud-gap-analysis/<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdatatracker.ietf.org%2Fdoc%2Fdraft-ietf-rtgwg-net2cloud-gap-analysis%2F&data=02%7C01%7Clinda.dunbar%40futurewei.com%7C89333027acd2498c1fd008d833fff82d%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C0%7C637316521774594105&sdata=INEOt%2F%2FstDbv7ooETdlbS6i%2FgKQnoUbrqH7ymSrNJ4E%3D&reserved=0> describes a scenario of one vCPE in cloud DC reachable by multiple PEs. Depending on the nature of the applications or/and network conditions, some applications may need to egress or ingress from PE1, others may need to egress or ingress from PE2.

Today’s Cloud DC configuration can use the AS Path metric to influence the preferred path to/from a specific PEs. But requires manual configuration.
After reading through the draft-ietf-idr-rpd-05, I think the automatic approach can make the change on demand. The policy change can be ephemeral.


Therefore, if one side doesn’t implement the feature, the “spray” doesn’t have any impact. The traffic egress or ingress to the peer network would just go with the configuration. If the “spray” is answered, then the performance can be improved.



[cid:image002.jpg@01D66659.819841D0]



If not using the automatic method proposed by draft-ietf-idr-rpd, do you have other suggestions?

Thank you very much.

Linda Dunbar
From: Robert Raszuk <[e-mail]<mailto:[e-mail]>>
Sent: Friday, July 24, 2020 2:50 PM
To: Linda Dunbar <[e-mail]<mailto:[e-mail]>>; Lizhenbin <[e-mail]<mailto:[e-mail]>>
Cc: Jakob Heitz (jheitz) <[e-mail]<mailto:[e-mail]>>; [e-mail]<mailto:[e-mail]>; [e-mail]<mailto:[e-mail]> [e-mail]<mailto:[e-mail]> <[e-mail]<mailto:[e-mail]>>
Subject: Re: [Idr] WG LC on draft-ietf-idr-rpd-05.txt (7/15 to 7/29/2020)

Linda,

It seems that authors of this document are strongly pushing to pass the last call irrespective of observations made by WG.

As said before and as reiterated by Jakob and Ketan BGP is not the right tool for p2p config push. We must stop adding such extensions to BGP like this one or BGP-LS or SR Policies if we really want to keep routing at some proper stability levels.

But even if you would convince everyone in IDR that this is all great the draft itself is so immature that I can't imagine why are we discussing last call at this time.

* Please observe that BGP state is ephemeral. When BGP sessions resets all state previously distributed is gone (modulo GR ...) Is the expectation here that state distributed by this new SAFI will persists ? If so for how long ? If not have you even considered the initial churn ?

* We have hooks to make sure LDP and IGP play in concert with BGP reachability. Would we need to now add to also wait for BGP policy to be received from controllers ?

* We have spent fair amount of time to make sure GR works well. Do you expect to now GR to recognize all policy parameters and sync deltas locally upon BGP sessions restarts ?

* Do you expect BGP implementations to now get busy with understanding all BGP policies syntax and semantics not in current terms how they are send or received in BGP UPDATEs but how they are applied implementation by implementation ...

* What happens when some implementation does not allow some policy defined in the draft ... for example flexible AS_PATH creation as defined in AS-Path Change sub-TLV ? Note that this section alone is catastrophic for BGP protocol to allow insertion of more then your own ASN into AS-PATH. Just looking at this alone should be enough to reject this draft.

And there are many many more real issues with this proposal  ....

See when document has low adoption bar it does not mean that it will also have the same low bar to progress it :)

Kind regards,
R.

PS. Let me cc GROW WG here as I think more operational review and comments would be highly valuable at this point.



On Fri, Jul 24, 2020 at 6:28 PM Linda Dunbar <[e-mail]<mailto:[e-mail]>> wrote:
Jakob,

Comparing Netconf with BGP  is not apple to apple comparison.
I remember a few years ago that  Netconf advocators have claimed that Netconf can replace PCE, replace BGP, replace xx, …

After many years debate,  many of the Netconf  limitations have been acknowledged,  that is why PCE still exists, so does BGP.

Other comments are inserted below:

From: Jakob Heitz (jheitz) <[e-mail]<mailto:[e-mail]>>
Sent: Thursday, July 23, 2020 5:37 PM
To: Linda Dunbar <[e-mail]<mailto:[e-mail]>>; [e-mail]<mailto:[e-mail]>
Subject: RE: WG LC on draft-ietf-idr-rpd-05.txt (7/15 to 7/29/2020)

Netconf provides needed features that BGP does not have:
- Atomic Transactions:
  If one configuration item fails, they all fail.
  They all either succeed or all fail. There is no partial success.
  Multiple configurations in one transaction are applied at the same time.
   . This avoids non-deterministic transient behavior between application of the first policy and the last.
[Linda] Just like Routes Advertisement, receivers can improperly install the routes into their RIB/FIB.  BGP has been running for over 3 decades. Those who don’t implement correctly eventually fix their bugs.
 If the Policies sent to peers are not enforced  as the RPD is asking for,  traffic might be sent to non-preferred links, just like a BGP receiver incorrectly processes the BGP route updates.

- Feedback:
  BGP is "spray and pray".
  Netconf provides an acknowledgement that the config either failed or was applied,
  which then allows the controller to take the next steps with
  reliable information about what configuration exists in the network.

[Linda]  BGP UPDATE is over reliable TCP transport and BGP protocol itself can guarantee the proper distribution of the UDPATE. Therefore, its “spray and pray” nature has its advantage of optimized processing. BGP  Route Update doesn’t expect confirmation from  the receivers.

- Persistence:
  If the BGP session were to go down, all the configuration it sent will be implicitly withdrawn.

If another AS would not allow a foreign AS to configure it with netconf,
it would not allow it with RPD either.
[Linda] That is very true. The originator can only “Pray” as BGP is intended for.

There are already ways in BGP for an AS to signal preference across AS boundaries:
Med, AS-path length, communities.

[Linda] All those methods you have mentioned require heavy duty configurations, which is difficult to change on the fly. The proposed method is a flexible method which allows policies to be changed on the fly (depending on real time traffic conditions).


Ketan and Robert added other objections.
[Linda] I have been studying their reasons for the objections.

Thank you very much for the explanation.

Linda Dunbar


Regards,
Jakob.

From: Linda Dunbar <[e-mail]<mailto:[e-mail]>>
Sent: Thursday, July 23, 2020 3:24 PM
To: Jakob Heitz (jheitz) <[e-mail]<mailto:[e-mail]>>; [e-mail]<mailto:[e-mail]>
Subject: RE: WG LC on draft-ietf-idr-rpd-05.txt (7/15 to 7/29/2020)

Jakob,

Can you elaborate those automation configuration methods that are much better and less error prone than the proposed one?
It will take a long time to dig through so many IDR emails to find them.

Thank you very much,
Linda Dunbar

From: Jakob Heitz (jheitz) <[e-mail]<mailto:[e-mail]>>
Sent: Thursday, July 23, 2020 5:20 PM
To: Linda Dunbar <[e-mail]<mailto:[e-mail]>>; [e-mail]<mailto:[e-mail]>
Subject: RE: WG LC on draft-ietf-idr-rpd-05.txt (7/15 to 7/29/2020)

Of course it's better than manual configuration.
That's not much of an argument, because there are plenty of
automatic configuration methods that are much better and
less error prone than this draft as I and others have pointed
out in previous emails.

Regards,
Jakob.

From: Idr <[e-mail]<mailto:[e-mail]>> On Behalf Of Linda Dunbar
Sent: Thursday, July 23, 2020 2:57 PM
To: [e-mail]<mailto:[e-mail]>
Subject: Re: [Idr] WG LC on draft-ietf-idr-rpd-05.txt (7/15 to 7/29/2020)

I support the WGLC for the draft. I think the proposed distribution of policy can scale much better and less error prone than any manual configuration.
_______________________________________________
Idr mailing list
[e-mail]<mailto:[e-mail]>
https://www.ietf.org/mailman/listinfo/idr<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ietf.org%2Fmailman%2Flistinfo%2Fidr&data=02%7C01%7Clinda.dunbar%40futurewei.com%7C89333027acd2498c1fd008d833fff82d%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C0%7C637316521774604060&sdata=kEZ3AlyS8OBJWOJdxqgk3fcid9oCJmjGOgtCRv9jmvw%3D&reserved=0>