Re: [Bier] draft-ietf-bier-ipv6-requirements-09

[Greg Shepherd <[e-mail]>]

Thank you Jeffrey and Gyan for sticking with the thread of the conversation
to advance the discussion. It's clear now that all of the
requirements discussed so far can be addressed by the BIERin6 draft if we
flesh out the discussed gaps.

I would like to see Jeffrey and Gyan take over as primary authors of
BIERin6 to include the gaps discussed here so that it fully encompases the
requirements so far described, for WG adoption.

Thanks,
Shep

On Mon, Nov 23, 2020 at 4:56 AM Jeffrey (Zhaohui) Zhang <[e-mail]>
wrote:

> Hi Gyan,
>
>
>
> Great that we reached consensus on BIERin6.
>
> Now there are two lingering points alluded to in this thread, but given
> it’s been such a long and deeply nested tread, I’ll start a new thread
> about it.
>
>
>
> Thanks.
>
> Jeffrey
>
>
>
> *From:* Gyan Mishra <[e-mail]>
> *Sent:* Monday, November 23, 2020 1:32 AM
> *To:* Jeffrey (Zhaohui) Zhang <[e-mail]>
> *Cc:* Alvaro Retana <[e-mail]>; BIER WG <[e-mail]>;
> [e-mail] <[e-mail]>; Tony Przygienda <
> [e-mail]>; draft-ietf-bier-ipv6-requirements <
> [e-mail]>; [e-mail]
> *Subject:* Re: draft-ietf-bier-ipv6-requirements-09
>
>
>
> *[External Email. Be cautious of content]*
>
>
>
> Hi Jeffrey
>
>
>
> That’s the last of my questions related to BIERin6.
>
>
>
> I thank you for taking the time to go over the BIERin6 draft in detail.
>
>
>
> We have reached consensus as well as are in sync,  and I now have a better
> understanding of BIERin6.
>
>
>
> During the discussions I did mention that maybe in BIERin6 optional IPv6
> tunneling should be removed, as it seemed to create some confusion, but now
> I am clear and as both the L2/tunnel and IPv6 L3/tunnel encapsulation
> single hop or multi hop tunnel both have the clean BIER layering and
> complement each other I agree they belong together in the same draft.
>
> Even though L2/tunnel exists today as part of RFC8296 it makes sense to be
> part of the overall BIERin6 solution.
>
>
>
> I am clear on the two IANA code points requests required for the optional
> IPV6 encapsulation option.
>
>
>
> Over the course of this thread we did touch on some technical reasons why
> IPV6 encapsulation is necessary which I you mentioned in some of your
> responses.
>
>
>
> Overall throughout the discussions I agree that BIERin6 IPV6 tunnel option
> and BIERv6 are not transitional and are long term solutions and there are
> reasons why that we can add to the requirements draft as to why IPV6
> encapsulation is necessary below:
>
>
>
> - Operator requirement for IPV6 encapsulated packets  and not L2
> encapsulation.
>
> -FRR
>
>
>
> I think we are all set to start updating the Requirements draft.
>
>
>
> In-line Gyan6>
>
>
>
> Kind Regards
>
>
>
> Gyan
>
>
>
> On Sun, Nov 22, 2020 at 10:39 PM Jeffrey (Zhaohui) Zhang <
> [e-mail]> wrote:
>
> Gyan,
>
>
>
> Please see zzh6> below.
>
>
>
> *From:* Gyan Mishra <[e-mail]>
> *Sent:* Sunday, November 22, 2020 9:49 PM
> *To:* Jeffrey (Zhaohui) Zhang <[e-mail]>
> *Cc:* Alvaro Retana <[e-mail]>; BIER WG <[e-mail]>;
> [e-mail] <[e-mail]>; Tony Przygienda <
> [e-mail]>; draft-ietf-bier-ipv6-requirements <
> [e-mail]>; [e-mail]
> *Subject:* Re: draft-ietf-bier-ipv6-requirements-09
>
>
>
> *[External Email. Be cautious of content]*
>
>
>
>
>
> Hi Jeffrey
>
>
>
> Agreed we have reached a consensus.
>
>
>
>
>
> Few more questions to iron out understanding.
>
>
>
> In line gyan4>
>
>
>
> Zzh6> Apparently there are still disconnects 😊
>
>  Gyan> Thank you for all the detailed responses.  We are in sync now!
>
> On Sun, Nov 22, 2020 at 8:06 PM Jeffrey (Zhaohui) Zhang <
> [e-mail]> wrote:
>
> Hi Gyan,
>
>
>
> Yes I believe we’ve reached consensus.
>
>
>
> Please see zzh5> below about some details.
>
>
>
> *From:* Gyan Mishra <[e-mail]>
> *Sent:* Sunday, November 22, 2020 4:19 PM
> *To:* Jeffrey (Zhaohui) Zhang <[e-mail]>
> *Cc:* Alvaro Retana <[e-mail]>; BIER WG <[e-mail]>;
> [e-mail] <[e-mail]>; Tony Przygienda <
> [e-mail]>; draft-ietf-bier-ipv6-requirements <
> [e-mail]>; [e-mail]
> *Subject:* Re: draft-ietf-bier-ipv6-requirements-09
>
>
>
> *[External Email. Be cautious of content]*
>
>
>
> Hi Jeffrey
>
>
>
> This has been a very informative exchange and extremely helpful for all of
> us to get onto the same page from a basic understanding POV.
>
>
>
> Much appreciated all your help and feedback helping clarify my confusion.
>
>
>
> I am answering in-line but now connecting the dots how is in today’s RFC
> 8296 Non MPLS BIER Ethernet going to transport IPv6?
>
>
>
> From your answers below it cannot work as we need two IANA code point one
> for IPv6 next header type and ICMPv6.
>
>
>
> Zzh5> The existing model/concept works except that we need to two code
> points if IPv6 tunneling is used for either getting over non-BFRs or for
> FRR. One may deem non-BFR as a short-term scenario but FRR will be here for
> the long run.
>
>
>
>     Gyan4>I am a little confused here with the code points.  For BIERin6
> “L2” BIER scenario RFC 8296 Non MPLS BIER Ethernet Ether type 0xAB37.
>
>
>
> Ethernet -0xAB37 l BIER | IPv6 | payload
>
>
>
> Zzh6> Note that IPv6 header is not needed – it should be Ethernet -0xAB37
> l BIER | payload. Of course, if SRv6 style VPN must be used, then IPv6
> header may be inserted between BIER and payload, only for the SRv6 style
> VPN purpose.
>
> Gyan> Understood
>
> Ethernet -0xAB37 l BIER l ICMPv6 | payload
>
>
>
> Zzh6> ICMP was mentioned not for encapsulation but for the following:
>
>  Gyan6>Understood
>
> Zzh6> 2.1.  IPv6 Options Considerations
>
>
>
>    For directly connected BIER routers, IPv6 Hop-by-Hop or Destination
>
>    options are irrelevant and SHOULD NOT be inserted by BFIR on the
>
>    BIERin6 packet.  In this case IPv6 header, Next Header field should
>
>    be set to TBD.  Any IPv6 packet arriving on BFRs and BFERs, with
>
>    multiple extension header where the last extension header has a Next
>
>    Header field set to TBD, SHOULD be discard and the node should
>
>    transmit an ICMP Parameter Problem message to the source of the
>
>    packet (BFIR) with an ICMP code value of TBD10 ('invalid options for
>
>    BIERin6').
>
>
>
> In this particular scenario where adjacent BFRs support Ethernet link
> layer in an IPV6 environment and  IPv6 or ICMPv6 encapsulation and the need
> for the next header code point above is the packet format:
>
>
>
> Excerpt from RFC 8296
>
>
>
>    Therefore, if a non-MPLS BIER packet is encapsulated in an Ethernet
>
>    header, the Ethertype MUST NOT be 0x8847 or 0x8848 [RFC5332 <https://urldefense.com/v3/__https:/tools.ietf.org/html/rfc5332__;!!NEt6yMaO-gk!TVpj_z-fpnhYihjYO4kRLRrvHGFDKTzS09SdN8jA-VKR14p1w2ObtXPqQ84ssHlj$>].  IEEE
>
>    has assigned Ethertype 0xAB37 for non-MPLS BIER packets.
>
>
>
>
>
> In the case of BIERin6 optional encapsulation option, in case where
> operators requires packets forwarded in IPv6 or tunneling over Non BFR
> packet format below:
>
>
>
> IPv6 outer header l BIER l Data
>
>
>
> So here the next header is BIER so corresponding next header code point.
>
>
>
>
>
> So below is for both cases IANA code point allocation for “L2” next header
> where next header is IPv6 or ICMPV6, and then the optional IPv6
> encapsulation option where the next header is BIER.
>
>
>
> Would those be two separate IANA code point requests I what I see from the
> packet format.
>
>
>
> IANA L2 scenario:
>
> 2 code point requests for L2 for next header IPv6 and ICMP
>
>
>
> Zzh6> I don’t follow what you’re talking about. If BIER header follows L2
> header directly, no new code point is needed. It’s just “Ethernet 0xAB37 |
> BIER | payload”.
>
>
>
>     Gyan6> Agreed.
>
>
>
> IANA optional IPv6 scenario:
>
> 1 code point request for IPv6 for next header BIER
>
>
>
> Zzh6> If IPv6 encapsulation is used, either on between directly connected
> BFRs or indirectly connected BFRs, a new “next header” code point is needed
> for BIER.
>
>  Gyan6>Understood
>
>
> 5
> <https://urldefense.com/v3/__https:/tools.ietf.org/html/draft-zhang-bier-bierin6-07*section-5__;Iw!!NEt6yMaO-gk!TVpj_z-fpnhYihjYO4kRLRrvHGFDKTzS09SdN8jA-VKR14p1w2ObtXPqQ_dVL5sH$>.
> IANA Considerations
>
>
>
>
>
>    IANA is requested to assign a new "BIER" type for "Next Header" in
>
>    the "Assigned Internet Protocol Numbers" registry.
>
>
>
>    IANA is requested to assign a new "BIERin6" type for "invalid
>
>    options" in the "ICMP code value" registry.
>
>
>
>    IANA is requested to assign a new "BIER IPv6 transportation Sub-sub-
>
>    TLV" type in the "OSPFv3 BIER Ethernet Encapsulation sub-TLV"
>
>    Registry.
>
>
>
>    IANA is requested to set up a new "BIER IPv6 transportation Sub-sub-
>
>    sub-TLV" type in the "IS-IS BIER Ethernet Encapsulation sub-sub-TLV"
>
>    Registry.
>
>
>
>
>
> My point is that the IANA allocation is different as the next header is
> different for the L2 scenario where next header is IPv6 or ICMPV6, and IPv6
> encapsulation scenario where the next header is BIER.
>
>
>
> Zzh6> If BIER header follows L2 header directly, BIER Ethertype is used
> (assuming Ethernet is the L2).
>
>  Gyan>Understood
>
> Based on this point I am making could we just do a RFC8296 bis version and
> add the IANA code points for IPv6 and ICMPv6.
>
>
>
> Zzh6> Given the confusion/contention that have happened in the last two
> years, it is much better to specifically have a spec dedicated to
> supporting BIER in IPv6.
>
>  Gyan6> I think now looking at it holistically speaking I can now see
> parity between the L2/tunnel and L3/tunnel both also having the clean
> layering.  So I can see why adding existing L2/tunnel to BIERin6 even
> though it already exists made sense to bundle into BIERin6 total solution.
>
> The BIERin6 draft would be much cleaner  and less confusing and also have
> direct parity with BIERv6 as now they both are geared to IPV6 environment
> solution IPV6 encapsulation use case.
>
>
>
>
>
> And it is for this reason BIERin6 even with optional IPv6 encapsulation
> removed, does in fact even for L2, BIERin6 introduces something new being
> the two code points for IPV6 environment and thus must be standards track.
>
>
>
> Zzh5> “even for L2” is not exactly right. It is when IPv6 tunneling is
> needed (for non-BFR or for FRR – and that is different from the optional
> IPv6 encapsulation between directly connected BFRs) where the two new code
> points are needed.
>
>  Gyan4>  For directly connected BFRs with L2 Ethernet RFC 8296 0xAB37, how
> are you using IPv6 tunneling?
>
> Zzh6> This is the disconnect that I mentioned at the very top.
>
> Zzh6> If IPv6 tunneling is needed between directly connected BFRs, the
> 0xAB37 is **not** used. Rather it is the following:
>
> Zzh6> “Ethernet  0x86DD (IPv6) | IPv6 | BIER | payload”.
>
> Gyan6> Yep standard IANA ether type for IPv6
>
>   With BIERin6 the Unicast tunneling over non BFRs can only be done with
> optional IPv6 encapsulation tunneling option.
>
> Do you agree with my overall assessment?
>
>
>
> Zzh5> Yes but minus the above minor detail. More zzh5> below.
>
>
>
>
>
> In-line Gyan3>
>
>
>
> On Sun, Nov 22, 2020 at 3:12 PM Jeffrey (Zhaohui) Zhang <
> [e-mail]> wrote:
>
> Hi Gyan,
>
>
>
> So now the focal question about BIERin6 is should it be an informational
> document (if the optional IPv6 encapsulation between directly connected
> BFRs is removed).
>
>
>
> The short answer is no. Please see zzh4> below.
>
>
>
> *From:* Gyan Mishra <[e-mail]>
> *Sent:* Sunday, November 22, 2020 1:22 PM
> *To:* Jeffrey (Zhaohui) Zhang <[e-mail]>
> *Cc:* Alvaro Retana <[e-mail]>; BIER WG <[e-mail]>;
> [e-mail] <[e-mail]>; Tony Przygienda <
> [e-mail]>; draft-ietf-bier-ipv6-requirements <
> [e-mail]>; [e-mail]
> *Subject:* Re: draft-ietf-bier-ipv6-requirements-09
>
>
>
> *[External Email. Be cautious of content]*
>
>
>
> Hi Jeffrey
>
>
>
> Please see in-line below
>
>
>
> On Sun, Nov 22, 2020 at 8:56 AM Jeffrey (Zhaohui) Zhang <
> [e-mail]> wrote:
>
> Hi Gyan,
>
>
>
> Please see zzh3> below.
>
>
>
> *From:* Gyan Mishra <[e-mail]>
> *Sent:* Saturday, November 21, 2020 8:45 PM
> *To:* Jeffrey (Zhaohui) Zhang <[e-mail]>
> *Cc:* Alvaro Retana <[e-mail]>; BIER WG <[e-mail]>;
> [e-mail] <[e-mail]>; Tony Przygienda <
> [e-mail]>; draft-ietf-bier-ipv6-requirements <
> [e-mail]>; [e-mail]
> *Subject:* Re: draft-ietf-bier-ipv6-requirements-09
>
>
>
> *[External Email. Be cautious of content]*
>
>
>
>
>
>
>
> On Sat, Nov 21, 2020 at 1:45 PM Jeffrey (Zhaohui) Zhang <
> [e-mail]> wrote:
>
> About the following:
>
>
>
>
>
> I would not think we are ready to adopt any non MPLS BIER in IPV6
> environment solution if we still do not have the requirements set as to the
> gap that is being filed and problem being solved that cannot be done today
> with non MPLS BIER Ethernet.
>
>
>
> GS - Agree.
>
>
>
>     Gyan> Agreed.  So to reiterate once we complete the requirements draft
> and then if both fit the Bill of the requirements draft, we can ask for
> Adoption of both drafts at once.
>
>
>
>
>
> Now it’s clear what the chair was requesting for the requirements draft.
> Quote from Greg’s reply to the other email:
>
> Gyan>Agreed
>
> Zzh2> The real questions are: 1) why do we need IPv6 encapsulation
> (BFIR->BFER or between adjacent BFRs) 2) Even if you do, where do you put
> the BIER header. 1) is a requirement question, and 2) is a solution
> question.
>
> GS - ^^^This. Thanks Jeffrey.
>
>  …
>
>      Gyan> Given what Greg and Tony stated as far as the requirements
> draft as what is missing related to the “why” we need any IPv6 environment
> solution I think “any” means any which include BIERin6.  We may need some
> clarification from the chairs on this.
>
>  Zzh2> My understanding is the question is “why we need IPv6
> encapsulation” (especially BFIR->BFER). BIERin6 does not
>
> require BFIR->BFER encapsulation, but it works nicely with that.
>
> GS - ^^^And this. As I said before, the WG had NO issues with BIERin6. The
> reqs draft came about as a means to document the WGs direction in this
> space in the light of BIERv6.
>
>
>
>
>
> So the requirements draft will discuss why IPv6 encapsulation is needed.
> As I mentioned in my previous email, even if there is a requirement for
> IPv6 encapsulation, BIERin6 works nicely with it, and works better with a
> clean layering architecture.
>
>  Gyan>Understood.  As I stated explicitly in the response to Greg above.
> What are your thoughts on what I stated that BIERin6 solution- if you
> remove the L2 links concept as that is Non MPLS BIER Ethernet RFC 8296
> (BIERin6 L2) which already exists today and would be used for Green field
> IPv6 environments, so imagine then the BIERin6 solution without the L2 do
> you agree that this solution as well as BIERv6 solutions in an IPV6
> environment is strictly only for transitional brown field deployments to
> tunnel unicast over “non BFR capable” routers?
>
> Zzh3> Having trouble zooming in on exactly you’re saying, but let me
> clarify that **BIERin6** works for **all** situations – and it is a **long
> term** solution:
>
>
>
>    Gyan2>Understand and agreed long term and everything stated below all
> situations, however you are missing my critical point that BIERin6 includes
> an “existing solution of RFC 8296 Non MPLS BIER Ethernet 0xAB37”.  So that
> already exists and to my original point and question from Greg why do we
> need IPV6 encapsulation if we already have a solution for BIER over L2
> links which is RFC 8296 Non MPLS BIER Ethernet 0xAB37. Because BIERin6 used
> an existing solution is makes NOT a new solution for IPV6 environments.  We
> end up in the circular argument.
>
>
>
> Zzh4> Now I understand what you’re talking about.
>
>    Gyan3> Glad we are in sync!
>
>
>
> Zzh4> Greg’s question “why do we need IPv6 encapsulation” is really for
> the BIERv6 solution, in particular for the BFIR->BFER case. Obviously,
> when tunneling is needed (e.g. to get around non-BFRs, or for FRR), IPv6
> encapsulation is needed as long as the tunnel is IPv6 (w/o using
> GRE/UDP/similar), for both BIERin6 and BIERv6.
>
>  Gyan> Agreed.  That is why I was thinking temporary but I think having in
> operators toolbox of options is extremely helpful even in future where all
> hardware is upgraded BFR capable their maybe a need to use IPV6
> encapsulation and not L2.  So I am in agreement we can definitely define
> reasons for why we need IPV6 encapsulation for future end state and not
> just interim transitional solution.
>
> Zzh4> BIERin6 **optionally** uses IPv6 encapsulation even between
> directly connected BFRs. The draft itself already explains the scenario:
>
>
>
>    The IPv6 encapsulation could be used even between two directly
>
>    connected BFRs in the following two cases:
>
>
>
>    o  An operator mandates all traffic to be carried in IPv6.
>
>
>
>    o  A BFR does not have BIER support in its "fast forwarding path" and
>
>       relies on "slow/software forwarding path", e.g. in environments
>
>       like [RFC7368] where high throughput multicast forwarding
>
>       performance is not critical.
>
>
>
>     Gyan> Good point.  So not only non directly connected “non BFRs” but
> directly connected “non BFRs” but important point that operator mandates
> traffic carried in IPv6.  That justification could definitely answer at
> least one of the “why” reasons for IPV6 encapsulation as we build the list.
>
> Zzh4> Notice that the above is really no different from the case where
> tunneling is used between non-directly connected BFRs.
>
>
>
>    Gyan3> Good point Agreed
>
>
>
> Zzh5> Notice that for the requirements draft, when you talk about IPv6
> encapsulation, there is a need to distinguish between BFIR->BFER multi-hop
> IPv6 encapsulation (as currently used in BIERv6) and hop-by-hop
> encapsulation. We can discuss that separately.
>
>
>
> Gyan4> Understood.  The main difference is BIERin6 optional IPV6
> environment solution involves encapsulation and decapsulation at BFR
> endpoints, where BIERv6 is multi-hop IPv6 encapsulation.
>
> Zzh6> Note that it is optional, per the operator’s choice (to mandate IPv6
> always).
>
> Zzh4> If the WG pushes back the above optional feature in BIERin6 until
> it’s been formally concluded in the requirements draft, while I think it is
> a bit unreasonable, we can remove the above for now and so that we can
> focus on the main point – existing solution can be used as is for IPv6.
>
>  Gyan> This thread is really helpful in getting both of is completely and
> fully synced up.  And as we get synced up I don’t think we want to remove
> the optimal feature.  Let’s wait for this thread to play out but so far I
> am thinking we keep optional in place.
>
> Let’s try it another way to help explain what I am trying to convey.
>
>
>
> Questions below.
>
>
>
> Can BIERin6 work today in IPv6 environment?
>
>
>
> Zzh4> Yes.
>
>
>
> How would it work?
>
>
>
> Zzh4> The draft already said it:
>
> Zzh4> 1. BIER header follows L2 header between directly connected BFRs;
> optionally a one-hop IPv6 tunnel can be used, and then the BIER header
> follows the IPv6 header which follows the L2 header
>
> Zzh4> 2. BIER header follows a tunnel header if tunneling is used (either
> IPv6 or some other tunnel)
>
>
>
> Does that solution already exist?
>
>
>
> Zzh4> Yes
>
>
>
> What is that solution?
>
>
>
> Zzh4> Existing non-MPLS BIER solution, but we do need two new code points
> for IPv6 environment.
>
>
>
> Can that solution be used for Greenfield deployments today?
>
>
>
> Zzh4> Yes
>
>
>
> Can that solution be used for Greenfield deployments in an IPV6
> environment?
>
>
>
> Zzh4> Yes
>
>
>
> In the future once the BIERin6 optional feature using IPV6 encapsulation
> is developed would that ever be utilized once all routers are BFR capable?
>
>
>
> Zzh4> It could be – up to the operator and depending on the deployment
> situation.
>
>
>
> Here is the crux of the questioning.
>
>
>
> What is the difference between BIERin6 L2 solution and RFC 8296 Non MPLS
> BIER Ethernet encapsulation 0xAB37?
>
>
>
> Zzh4> No difference, except that similar to Ethertype 0xAB37 we need an IP
> “next header” type assigned when IPv6 tunneling is needed; and we need
> another code point for ICMP6 (see IANA consideration section of BIERin6).
>
>
>
> Are they both one and the same?
>
>
>
> Zzh4> See above.
>
>
>
> If you removed the IPv6 encapsulation optional feature from  BIERin6, what
> are you left with?
>
>
>
> Zzh4> Existing solution, which is the beauty of BIERin6. Also please note
> that the optional feature is applying the typically multi-hop tunneling to
> one-hop tunneling; BIER on top of IPv6 tunneling is not special.
>
>  Gyan3> Understood.  Similar proven layering techniques
>
> Is what you are left with basically the existing solution defined in RFC
> 8296 Non MPLS BIER Ethernet 0xAB37?
>
>
>
> Zzh4> Yes
>
>
>
> If that is true then what is the purpose or benefit or need for BIERin6
> draft if we already have that L2 encapsulation solution defined in RFC 8296
> as “Non MPLS BIER Ethernet 0xAB37”?
>
>
>
> Zzh4> To be exact, it is not “L2 encapsulation solution”. Existing
> solution does use both L2 encapsulation, and when necessary tunnel
> encapsulation.
>
> Zzh4> First we need to assign an IP “next header” type for BIER (and an
> ICMP6 code point). Secondly, with the multi-year saga on BIER solution in
> IPv6 network, **it is clear how important for us to document how existing
> solution nicely work in an IPv6 network**. As Greg mentioned, BIERin6 did
> not move quickly because the optional feature was not considered by all as
> critical, but now with the confusion/contention introduced with BIERv6,
> it’s critical that we move quickly with BIERin6, even if we need to remove
> the optional feature temporarily if you demand that feature to be formally
> justified in the requirements draft first.
>
>
>
> Gyan3> Agreed with everything stated. So that is the gap and the two new
> code point allocations is what net new that gets added in the BIERin6 draft
> even if the optional IPv6 encapsulation was excluded
>
>
>
> Zzh5> To be exact, the optional IPv6 encapsulation is for between directly
> connected BFRs. Even when we exclude that one, If there are non-BFR or FRR
> situation, then IPv6 encapsulation and two new code points are needed
> (unless you use GRE/UDP/MPLS/other tunnels), but that IPv6 encapsulation is
> nothing different from any other types of tunnels.
>
>
>
>      Gyan4>  Please see the beginning of the email. I disagree.  See the
> packet format displayed.
>
> Zzh6> Please see my earlier response.
>
> Zzh3> 1. BIER directly over L2 links
>
> Zzh3> 2. BIER over **any** tunnels for whatever reasons (e.g. FRR):
>
> Zzh3>      2a. non-IPv6 tunnels
>
> Zzh3>      2b. IPv6 based tunnels
>
> Zzh3>             2b1. with UDP/GRE/whatever
>
> Zzh3>             2b2. Direct IPv6 encapsulation without UDP/GRE/whatever
>
> Zzh3>             2b3. With SRv6
>
> Zzh3>             2b4. Without SRv6
>
> Zzh3>             2b5. Whatever you can think of
>
>
>
> Zzh3>  This **not** a transitional solution. It works for greenfield,
> brownfield, forever-field. Whatever you throw at it. A greenfield IPv6
> environment still means IPv6 over L2 links and BIER can still be over L2
> links directly (and it is better that way – I’ve alluded to that here and
> there and can discuss that separately further).
>
>    Gyan2>Completely agree that because BIERin6 is using an existing L2
> solution layering already defined in RFC 8296 Non MPLS BIER Ethernet 0xAB37
> that BIERin6 draft is not introducing anything new if you exclude the IPV6
> encapsulation optional feature I would agree that then BIERin6 should
> really be an informational draft of how BIERin6 can be used specifically in
> IPv6 environments using L2 links BFR to BFR.
>
>
>
> Zzh4> It can’t be informational, for the reasons that I stated above.
>
>    Gyan3>Agreed and understand we need the two codepoints allocated for L2
> BIER to work in an IPv6 environment even if we excluded the optional IPV6
> encapsulation.
>
>
>
> Zzh5> To be exact, replace “L2 BIER” with “BIER over L2/tunnel” (which is
> an existing solution/model/concept), and add “between directly connected
> BFRs” after “optional IPv6 encapsulation”.
>
>
>
> Gyan4> I am not following.  My understanding is  L2 would be used for
> adjacent Ethernet  BFRs and to tunnel over Non BFRs the  optional IPv6
> tunnel solution would be used.
>
>
>
> Zzh6> No.
>
> Zzh6> Between adjacent BFRs, you can use either 0xAB37 w/o one-hop IPv6
> tunneling, or **optionally** not use 0xAB37 but use one-hop IPv6
> tunneling (that is the “optional IPv6 encapsulation” that I have been
> talking about).
>
> Zzh6> Using one-hop IPv6 tunneling in case of adjacent BFRs is no
> different from using IPv6 tunneling over non-BFRs (or for FRR purpose), and
> for the latter (non-BFR or FRR), tunneling is **not optional** (though of
> course you can use other types of tunnels instead of IPv6).
>
> Zzh6> Jeffrey
>
> Zzh5> Jeffrey
>
> Zzh3>  As stated in the requirements draft, it is an **independent** model
>
> Gyan> Agreed using existing copyrighted technology defined in RFC 8296 so
> if you removed the IPV6 encapsulation optional feature we should downgrade
> BIERin6 to informational as it is not introducing anything new.
>
> Or do you think that although we already have the RFC 8286 Non MPLS BIER
> Ethernet solution for IPV6 environments the goal is to have additional
> alternatives for operators for IPV6 environments that are L2 ethernet and
> /or other non Ethernet link layer which would be a remaining gap as to why
> an IPV6 encapsulation is needed.  I guess I  am somewhat answering that
> why question partially but let’s say a carrier packet switched network that
> used GMPLS / MPLS-TP but a new architecture non MPLS based that lives in an
> IPV6 environment- SRv6 a candidate but prove how L2 would not work and
> these two proposed solutions fill the gap.
>
>
>
> Zzh3> It is a bit hard to parse what you’re saying. As I said in my
> previous email, whatever the additional requirements draft discussion/work
> lead to (whether an IPv6 encapsulation is needed), it is **irrelevant**
> to the BIERin6 solution, because BIERin6 is an independent model and can
> work **with or without** IPv6 encapsulation nicely, because it makes use
> of time-proved architecture of clean layering.
>
>
>
>    Gyan2> Understood.  Yes it makes use of time proven architecture so
> then my question is what is the purpose of BIERin6 draft as technically it
> is not introducing anything new that requires it to be standards track.
>
>
>
> Zzh4> Please see above.
>
> Zzh3> If that discussion/work concludes that BIERv6 is warranted, it can
> be adopted at that time, but **there is no reason to delay the BIERin6**
> work.
>
> Gyan2>I believe BIERin6 if you remove the IPv6 encapsulation optional
> feature then BIERin6 draft can be adopted as informational.
>
> Zzh4> It can’t be informational for the reasons stated above.
>
> As I stated if BIERv6 and BIERin6 are really slated to be temporary until
> all brown field non BFR capable routers are upgraded then we don’t need to
> answer the questions as this is a temporary stop gap measure.
>
>
>
> Zzh3> I am sorry but it is **wrong** to say that BIERin6 is slated to be
> temporary. It is a solution that works now and for long term. If you’re
> specifically referring to the **optional** feature of using IPv6
> encapsulation even between directly connected BFRs in the BIERin6, I want
> to point out that, that is a small **optional** feature that **could** be
> removed for now just so that we can reduce the noise level at this time so
> that we can focus on the fundamentals.
>
>
>
>    Gyan2>yes please remove and make BIERin6 informational as it is not
> introducing anything new  and we can move to adopt as informational.
>
>
>
> Zzh4> Please see above why it can’t be informational.
>
> Zzh3> I am not sure if others will agree that BIERv6 was slated to be
> temporary either 😊
>
>
>
> Gyan2>I am not necessarily stating that BIERv6 is optional as we have to
> answer the million $$ question as why IPV6 encapsulation is needed that
> cannot be provided today with existing L2 solution. What made be even go
> down that road of “temporary solution” is the question as to why BIERin6
> has the L2 solution added to the solution,  almost as if the plan if you
> stepped back a bit and looked at the big picture was to make the IPv6
> encapsulation optional or we would not have added L2 to the BIERin6 draft
> in the first place.
>
>
>
> Zzh4> Please see earlier responses.
>
> Zzh4> Thanks!
>
> Zzh4> Jeffrey
>
> As such, we believe BIERin6 is already ready for adoption – though we’ll
> put out a revision to evaluate against the requirements draft. It is not
> reasonable or fair to delay the adoption of this one any further until the
> requirements draft justifies the other solution.
>
>  Gyan> Agreed.  Let’s have WG and chairs and AD chime in.
>
> Zzh3> Ah ha. Good and relieved to see “agreed” wording here. Thank you 😊
>
> Zzh3> Jeffrey
>
> Thanks.
>
> Jeffrey
>
>
>
> *From:* Gyan Mishra <[e-mail]>
> *Sent:* Friday, November 20, 2020 3:00 PM
> *To:* [e-mail]
> *Cc:* Alvaro Retana <[e-mail]>; BIER WG <[e-mail]>;
> Jeffrey (Zhaohui) Zhang <[e-mail]>; Tony Przygienda <
> [e-mail]>; draft-ietf-bier-ipv6-requirements <
> [e-mail]>; [e-mail] <
> [e-mail]>
> *Subject:* Re: draft-ietf-bier-ipv6-requirements-09
>
>
>
> *[External Email. Be cautious of content]*
>
>
>
>
>
> Hi Greg
>
>
>
> In-line
>
>
>
> Thank you again both you and Tony and Alvaro for all your guidance to help
> right the ship!!
>
>
>
> I will by “first round” when we meet in person — some day!!👍😁- maybe
> even second and third - or the night is on me if we can get this behind us.
> 😀
>
>
>
> Thanks
>
> On Thu, Nov 19, 2020 at 12:22 PM Greg Shepherd <[e-mail]> wrote:
>
> GS - inline:
>
>
>
> On Wed, Nov 18, 2020 at 7:14 AM Gyan Mishra <[e-mail]> wrote:
>
> All
>
>
>
> I would like to thank the Greg, Tony and Alvaro on their pointers and
> guidance this morning to help move the ball forward with the requirements
> draft.
>
>
>
> Thank you for your help.
>
>
>
>      Gyan> Welcome
>
>
>
> What I heard from Greg which rang out loud and clear and I mentioned to
> the requirements authors that today we have BIER MPLS where the BIER header
> is encoded into MPLS label stack layer 2 1/2 and we also have non MPLS BIER
> Ethernet ether type 0xAB37.
>
>
>
> GS - No, the BIER header is NOT 'encoded' in MPLS. MPLS encapsulates the
> BIER packet. Yes, the outer label included BIER specific information
> (Set-ID) with the intent of streamlining the forwarding process but without
> creating a dependency. We mirrored the format for Eth encap to ensure a
> single header format for the BIER architecture standard. It's important to
> mention there that the process to get to this point involved a 3-day
> design-team meeting where we worked hard, transparently and together and
> managed to conclude with a solution which resolved any conflict, satisfied
> everyone's concerns, and resulted in a clean, consistent message from a
> Working Group that was working under the 'experimental' banner. We moved
> from 'experimental' to standards track by listening to all the reasons we
> were started out as 'experimental' in the first place - ie This is the
> forwarding plane and will require new HW so the work from the WG must
> justify a new forwarding model and produce clear standards to follow.
>
>
>
>    Gyan> Thank you for clarification on BIER MPLS and important history on
> the BIER encapsulation types and how they came about and the evolution from
> Experimental to Standards Track.  I can see the simplicity single header
> format beauty behind the BIER architecture.
>
>
>
> So why do we need non MPLS BIER encapsulation in an IPV6 environment as
> that IPv6 environment can be supported by non MPLS BIER Ethernet.  The case
> and point here is that eventually just as ATM and Frame Relay now live in
> the technology graveyard so will at some point in time as SRv6 matures will
> become the end all be all “core transport” mechanism for all operators.
>
>
>
> GS - This is an opinion and not a technical argument. BTW, it is MY
> opinion that the largest early adopters for BIER will be financial
> networks, and more specifically financial trading floors. These networks
> are dedicated, high-speed, multipoint networks that will never adopt SRv6.
> Remember the IETF is to create standards that work best for everyone, not
> just to solve our individual network issues or vision.
>
>
>
>     Gyan> Understood.
>
>
>
> So that being said we need a another encapsulation method to carry BIER ,
> and per RFC 8296 that gap is filled with Non MPLS BIER Ethernet
> encapsulation today which will work for future SRv6 transport once MPLS
> goes by the wayside.
>
>
>
> GS - Just for clarity, RFC8296 works today regardless of any
> perceived transport wars. That's because a proper layered architecture
> avoids layer dependencies.
>
>
>
>      Gyan> Understood.  The BIER encapsulations types MPLS and Non MPLS
> defined in RFC 8296 works well with the RFC 8279 BIER 3 layer architecture,
> underlay, BIER layer, overlay which are independent of each other.  Makes
> sense.
>
>
>
> At the beginning of the presentation Greg corrected me and stated that
> that after the BIERin6 independent model draft was published, that the
> requirement draft came about to build a set of requirements as to the “why”
> we need BIER to work in a non MPLS BIER in an IPv6 environment when we
> already have the BIER Ethernet encapsulation that fits the bill and works.
>
>
>
> GS - Not exactly... Let me clarify:
>
>   BIERin6 first published in Oct 2017. I think the primary interest at the
> time was Homenet. The WG had no issues with the solution, but then neither
> had many members stepping up to help. Our AD's (and through extension the
> IAB) ingrained in us the need to remain diligent in the publication of our
> standards and only progress work that remained consistent with our existing
> work and showed community support. The first was true, the second was a
> little slight at the time.
>
>
>
>   April 2018 - the BIER Encap (misnomer) draft was published. It was
> pointed out from the beginning that there is a stark difference between
> encap and encode and that the WG has already published standards for
> encode. So the question was asked, why do you need a new encoding and
> encap. The answer given at the time was that there was a need to address
> non-BIER routers in the network and that this solution would be
> transitional. The WG pushed back that ANY transition mechanisms MUST NOT
> require HW changes. We also heard things like:
>
> "integrated into IPv6" - not true, it's merely BIER information encoded
> into extension headers. Operationally this is identical to BIERin6 encap,
> except that the former would require new HW, something our AD's made clear
> needs to be justified before progressing.
>
> "fast-path" - not true.
>
> I/We continued to ask questions trying to understand what benefits could
> be implied by encoding the BIER header into an IPv6 extension header rather
> than to just encap the BIER packet? And ultimately what is to be
> accomplished with any new encap now that we have RFC8296? The WG decided we
> needed a problem statement and requirements draft to guide any work in this
> space.
>
>
>
> The reqs draft was heavily weighted by BIEREncode draft authors and showed
> significant effort to direct the conversation. The WG was largely silent on
> any support either way. Mike came to me frustrated that nobody is stepping
> up to help. My reply was that if the WG doesn't show interest in the work,
> maybe that's your answer. Since then, more authors have been added.
>
>
>
>     Gyan> Thank you for the important clarification on history of how
> things transpired and how the requirements draft came about.  As well as
> history of BIERin6 and BIERv6.  Makes perfect sense as what triggered the
> requirements draft was the second solution BIERv6.
>
>
>
> Operationally as you stated as well as from the BIER layering perspective
> 2 out of the 3 layers ar identical as both have underlay and overlay and
> thus are mirrored on the encapsulation in the layering.
>
> As you mentioned the stark difference comes is the “BIER” layer where with
> BIERin6 it fits right in the middle of the inner and outer layer “encap”
> where with BIERv6 the additional encoding of the BIER header was the tricky
> part for sure.
>
>
>
> We leveraged following verbatim the IPv6 specification RFC 8200 to encode
> the BIER header in the DOH extended header for en route hop by hop BIFT
> processing very similar to hbh header processing.
>
>
>
> So there being the stark difference where BIERin6 was “encap” based and
> BIERv6 was “encap” + additional “encode” based, thus the pushback as to
> giving concrete reasoning for having a solution that requires the
> additional “encode”.  Agreed.
>
>
>
> Our answer as you stated has been that BIERv6 solution would be a
> transitional solution to accommodate “Non BFR” routers and that is still
> the case.  As stated with the BIERv6 integrated solution , the key problem
> that has to be solved to make that solution viable is where to put the BIER
> header.
>
>
>
> As “encap” was not an option as that would literally make BIERv6 identical
> to BIERin6 - thus the MAJOR challenge as to where to put the BIER header as
> there really is no other place other then in an extension header.  Another
> option that is still another viable option is picking a different header
> such as hbh to encode the BIER header.  We chose DOH as it had the options
> flag value option 3 for en route so at the time it made sense to go with
> DOH.  With many drafts looking at hbh for performance measurements in-situ
> hbh processing in the fast path, it is possible that hbh could still be a
> viable alternative.
>
>
>
> One other significant difference between BIERin6 and BIERv6 is that
> BIERin6 is to some degree a “pseudo” IPV6 environment solution as L2 links
> direct Non MPLS Ethernet encapsulation can be used to transport BIER
> packets.  So this is HUGE has far as stark difference and major advantage
> of BIERin6 over BIERv6.
>
>
>
> So with BIERin6 in an IPv6 environment, the IPv6 tunnel encapsulation and
> decapsulation for HBH BIFT processing only needs to be done in case of “Non
> BFR” routers present in “transitionary method”.
>
>
>
> “Between two BFRs,either a L2 link can be used directly or any tunnel (IPv6 or not) can be used for BIER transport.”
>
>
>
>     One example of this model is defined in [I-D.zhang-bier-bierin6 <https://urldefense.com/v3/__https:/tools.ietf.org/html/draft-ietf-bier-ipv6-requirements-08*ref-I-D.zhang-bier-bierin6__;Iw!!NEt6yMaO-gk!S_I_ZBufoz35JgFHlOwEI9ATFUpFwT0geRI2SpVviaQmC6aLofgyRk1guGv38Vu_$>],
>
>    where the BIER header and the payload following it are L2 payload
>
>    when feasible (e.g.  when two BFRs are directly connected) or IPv6
>
>    payload when IPv6 transport is needed/desired (e.g. when two BFRs are
>
>    not directly connected).  This is indicated by either a 0xAB37
>
>    Ethertype allocated to BIER or a new IPv6 Next-Header value to be
>
>    allocated by IANA.
>
>
>
> This does give BIERin6 significant advantage over BIERv6 that in a IPV6
> environment as BIERin6 can leverage existing RFC 8296 encapsulation non
> MPLS BIER Ethernet solution already in place today
>
>
>
> So to state differently how BIERin6 is envisioned as a “pseudo” IPv6
> encapsulation solution is that in Green field deployments we would only use
> L2 to connect BFRs via non MPLS BIER Ethernet ether type Oxab37 which then
> this would be case and point that you don’t need the BIERin6 solution to
> accomplish as that exists in RFC 8296.  Was this done on purpose- I think
> so as why reinvent the wheel so to speak.  Makes sense to me.
>
>
>
> BIERin6 using IPv6 encapsulation and decapsualation technique for BIER
> header transport would only be used in transition where non BFRs exist to
> tunnel unicast over for backwards compatibility for existing old hardware.
> Once all brown field Non BFR routers are upgraded in essence we are back to
> the original RFC 8296 non MPLS BIER Ethernet solution.
>
>
>
> So as we don’t want to reinvent the wheel as we already have a solution
> for IPV6 environment, these two solutions are transitional “interim” stop
> gap measures bandaid if you will to get to the end state solution we
> already have today for IPV6 environments.
>
>
>
> So I think it’s fair to state and please let me know if my extrapolation
> is way off base!
>
>
>
> As I stated earlier that in BIERin6 solution makes this crystal clear that
> we already have a solution for transporting BIER packets in a Non MPLS BIER
> IPV6 environment using RFC 8296 non MPLS BIER Ethernet ether type 0xab37.
>
>
>
> As the big million $$ - why do we need another solution for IPv6
> environment-  the answer is and correct me if I am off base = “we don’t”
>
>
>
> Both BIERin6 “encap” solution and BIERv6 “encap” + “encode” solution would
> only be used for brown field transitional sense and never was meant to be a
> long term - shall we say alternative solution to carry BIER packets.  Point
> being is we already have a solution so why reinvent the wheel.
>
>
>
> As far as IPV6 extended header usage and processing see below:
>
>
>
> With graconian routers of the past with extended header processing and on
> 6man and v6ops there have been many drafts written for best practices to
> not drop extended headers with fear of dos attack on the control plane but
> impacting legitimate customer traffic that used extended headers. Modern
> router processing of extension headers has advanced quite significantly
> over the past 20 years being able to process hbh as well as doh en route
> hop by hop at line rate in the forwarding plane fast path.  No new hardware.
>
>
>
> So that’s the million $$ question we are trying to solve here with the
> requirements draft.
>
>
>
> GS - Yes, but redefined as per my explanation above.
>
>
>
> As for the IPV6 6MAN questions, I was brought on board by Mike McBride as
> the IPv6 SME as well as multicast SME - but point being member of 6MAN for
> many years so a go between liaison with 6MAN related to any questions
> regarding following the IPV6 specification for extension header usage per
> RFC 8200.  Both solutions drafts had been reviewed by myself and 6MAN and
> no technical issues were found regarding the solutions.
>
>
>
> GS - Thank you.
>
>
>
>     Gyan> Welcome
>
>
>
> Alvaro mentioned as far as the list of requirements that they were fairly
> basic but maybe needed some more meat behind it such as the “support
> various L2 link types” but we did not specify.  In previous versions we
> stated L2 agnostic and then switched to various but being vague on which
> L2.  Alvaro also mentioned why OAM should be a requirement.  We may want to
> add a sentence on justification as to why we picked BIER IPv6 requirements
> as required versus optional.
>
>
>
> We need to add some more meat in the introduction or maybe even a separate
> section as to what gap is being filled by non MPLS BIER in IPv6 environment
> using IPv6 encapsulation and encoding the BIER header versus Non MPLS BIER
> Ethernet.  Also maybe use the requirements section to see if a new
> requirement that maybe a gap that is not covered by non MPLS BIER Ethernet
> that can be covered by non MPLS BIER in an IPv6 environment.
>
>
>
> At the end of the call when we rolled through the last two drafts and went
> into overtime I heard the ask for call for adoption for BIERin6 independent
> model.
>
>
>
> GS - Both v6 draft presentations asked for adoption. One of them had
> technical arguments for doing so. The other was list of grievances.
>
>
>
>      Gyan> Understood and duly noted
>
>
>
> https://datatracker.ietf.org/doc/draft-zhang-bier-bierin6/
> <https://urldefense.com/v3/__https:/datatracker.ietf.org/doc/draft-zhang-bier-bierin6/__;!!NEt6yMaO-gk!S_I_ZBufoz35JgFHlOwEI9ATFUpFwT0geRI2SpVviaQmC6aLofgyRk1guN2UjYuA$>
>
>
>
> I would not think we are ready to adopt any non MPLS BIER in IPV6
> environment solution if we still do not have the requirements set as to the
> gap that is being filed and problem being solved that cannot be done today
> with non MPLS BIER Ethernet.
>
>
>
> GS - Agree.
>
>
>
>     Gyan> Agreed.  So to reiterate once we complete the requirements draft
> and then if both fit the Bill of the requirements draft, we can ask for
> Adoption of both drafts at once.
>
>
>
> The flip side of the comment above is that if we are ready to adopt and we
> decided we can skip answering the “why” questions, so then do we need the
> requirements draft at all if that’s the case as we have made the decision
> to go with a single solution and are closing the door on any other
> options.  If the latter then we hang tight on any adoption of any solution
> and wait till the requirements draft is completed and adopted followed by
> moving forward with adopting any solutions.
>
>
>
> GS - Agree. And my suggestion for new authors on the reqs draft still
> stands. I'm not demanding, I'm suggesting, based on the document's history.
> Your presentation of the history of the draft made it clear that there has
> been little direction, less clarity, and potentially an excessive amount of
> motivation to justify one solution over the other, leaving us with the
> mushy reqs draft we have today. Let's get this draft right, then we will
> have the guidance to address any potential solutions.
>
>
>
>     Gyan> Agreed on all points.  I will captain and right the ship and get
> out of muddy waters to a crystal clear draft that can provide concrete
> guidance on a solution.   Please see my points above on the transitional
> aspects of this solution and if in the end state we would use the existing
> RFC 8296 Non MPLS BIER Ethernet in an IPV6 environment then that provides a
> lot of clarity to the team as to direction.  So that million $$ question
> goes away in essence as we have already answered our own question due to
> transitional nature of this IPV6 environment solution we are developing now
> with these two “non end state” transitional only solutions.
>
>
>
> Thanks,
>
> Greg
>
>
>
> Kind Regards
>
>
>
> Gyan
>
>
>
>
>
> --
>
> [image: Image removed by sender.]
> <https://urldefense.com/v3/__http:/www.verizon.com/__;!!NEt6yMaO-gk!S_I_ZBufoz35JgFHlOwEI9ATFUpFwT0geRI2SpVviaQmC6aLofgyRk1guBEzUU8q$>
>
> *Gyan Mishra*
>
> *Network Solutions Architect *
>
>
> *M 301 502-1347 **13101 Columbia Pike *
> <https://urldefense.com/v3/__https:/www.google.com/maps/search/13101*Columbia*Pike**BSilver*Spring,*MD?entry=gmail&source=g__;KyvCoCsrKw!!NEt6yMaO-gk!S_I_ZBufoz35JgFHlOwEI9ATFUpFwT0geRI2SpVviaQmC6aLofgyRk1guKR8EuJa$>
> Silver Spring, MD
> <https://urldefense.com/v3/__https:/www.google.com/maps/search/13101*Columbia*Pike**BSilver*Spring,*MD?entry=gmail&source=g__;KyvCoCsrKw!!NEt6yMaO-gk!S_I_ZBufoz35JgFHlOwEI9ATFUpFwT0geRI2SpVviaQmC6aLofgyRk1guKR8EuJa$>
>
>
>
> --
>
> [image: Image removed by sender.]
> <https://urldefense.com/v3/__http:/www.verizon.com/__;!!NEt6yMaO-gk!S_I_ZBufoz35JgFHlOwEI9ATFUpFwT0geRI2SpVviaQmC6aLofgyRk1guBEzUU8q$>
>
> *Gyan Mishra*
>
> *Network Solutions Architect *
>
>
> *M 301 502-1347 **13101 Columbia Pike*
> <https://urldefense.com/v3/__https:/www.google.com/maps/search/13101*Columbia*Pike**A0D*0A*Silver*0D*0A*Spring,*MD?entry=gmail&source=g__;KysrJSUrJSUrKw!!NEt6yMaO-gk!STxhGXVn_7l3akd-22ekvXgHaktg0upH7_YQ2V4lW3xymg0-tSVfW5z4OhjypH0r$>
>   Silver Spring, MD
> <https://urldefense.com/v3/__https:/www.google.com/maps/search/13101*Columbia*Pike**A0D*0A*Silver*Spring,*MD?entry=gmail&source=g__;KysrJSUrKys!!NEt6yMaO-gk!STxhGXVn_7l3akd-22ekvXgHaktg0upH7_YQ2V4lW3xymg0-tSVfW5z4OtK_wvtD$>
>
>
>
>
>
> Juniper Business Use Only
>
> --
>
> [image: Image removed by sender.]
> <https://urldefense.com/v3/__http:/www.verizon.com/__;!!NEt6yMaO-gk!STxhGXVn_7l3akd-22ekvXgHaktg0upH7_YQ2V4lW3xymg0-tSVfW5z4Oj4pKcqJ$>
>
> *Gyan Mishra*
>
> *Network Solutions Architect *
>
>
> *M 301 502-1347 **13101 Columbia Pike*
> <https://urldefense.com/v3/__https:/www.google.com/maps/search/13101*Columbia*Pike**A0D*0A*Silver*0D*0A*Spring,*MD?entry=gmail&source=g__;KysrJSUrJSUrKw!!NEt6yMaO-gk!U4fWui9a6AMmox_9HVOLuabWQsSUE43xFjGNG7ozUqEhzJuXaluJlznN0z_yUTbt$>
>   Silver Spring, MD
> <https://urldefense.com/v3/__https:/www.google.com/maps/search/13101*Columbia*Pike**A0D*0A*Silver*Spring,*MD?entry=gmail&source=g__;KysrJSUrKys!!NEt6yMaO-gk!U4fWui9a6AMmox_9HVOLuabWQsSUE43xFjGNG7ozUqEhzJuXaluJlznN02rdMzHa$>
>
>
>
>
>
> Juniper Business Use Only
>
> --
>
> [image: Image removed by sender.]
> <https://urldefense.com/v3/__http:/www.verizon.com/__;!!NEt6yMaO-gk!U4fWui9a6AMmox_9HVOLuabWQsSUE43xFjGNG7ozUqEhzJuXaluJlznN03dja8EJ$>
>
> *Gyan Mishra*
>
> *Network Solutions Architect *
>
>
> *M 301 502-1347 **13101 Columbia Pike*
> <https://urldefense.com/v3/__https:/www.google.com/maps/search/13101*Columbia*Pike**A0D*0A*Silver*0D*0A*Spring,*MD?entry=gmail&source=g__;KysrJSUrJSUrKw!!NEt6yMaO-gk!VCcJaZ8dtXUa9f6ssLdDxnziiSu3Yr8ckb108w5pho5p919JLUS76hRQuWI6UOan$>
>   Silver Spring, MD
> <https://urldefense.com/v3/__https:/www.google.com/maps/search/13101*Columbia*Pike**A0D*0A*Silver*Spring,*MD?entry=gmail&source=g__;KysrJSUrKys!!NEt6yMaO-gk!VCcJaZ8dtXUa9f6ssLdDxnziiSu3Yr8ckb108w5pho5p919JLUS76hRQuXLf1KCq$>
>
>
>
>
>
> Juniper Business Use Only
>
> --
>
> --
>
> [image: Image removed by sender.]
> <https://urldefense.com/v3/__http:/www.verizon.com/__;!!NEt6yMaO-gk!XDtgJDx3AuPsLEtWKNmJ-cMzKAtNsX_Xv7rPTyfejS7pxF9pMO9IQdFUWmsx5114$>
>
> *Gyan Mishra*
>
> *Network Solutions Architect *
>
>
>
> *M 301 502-1347 13101 Columbia Pike  *Silver Spring, MD
>
>
>
> Juniper Business Use Only
>