Re: [nvo3] I-D Action: draft-xia-nvo3-vxlan-qosmarking-01.txt

Benson Schliesser <bensons@queuefull.net> Fri, 14 November 2014 03:16 UTC

Return-Path: <bensons@queuefull.net>
X-Original-To: nvo3@ietfa.amsl.com
Delivered-To: nvo3@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6A0311A1BEB for <nvo3@ietfa.amsl.com>; Thu, 13 Nov 2014 19:16:45 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.6
X-Spam-Level:
X-Spam-Status: No, score=-2.6 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Sckv60EJmKZ1 for <nvo3@ietfa.amsl.com>; Thu, 13 Nov 2014 19:16:37 -0800 (PST)
Received: from mail-wi0-f178.google.com (mail-wi0-f178.google.com [209.85.212.178]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 0675C1A1BA3 for <nvo3@ietf.org>; Thu, 13 Nov 2014 19:16:36 -0800 (PST)
Received: by mail-wi0-f178.google.com with SMTP id bs8so1411603wib.5 for <nvo3@ietf.org>; Thu, 13 Nov 2014 19:16:34 -0800 (PST)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type; bh=sjhGZKtx4PGUmPFbDEVh2xJKarPaaODs11O244GGy34=; b=DcZu4C5P3tnLrQH9WGoF0cWyIOeh4SCxuy82D2tmb8G4NOeNafNppuntKcTcFeJPHh apU32Lp1ES0UaDjmG9HrOiM3NxvjRV2FllTksFZHpdVJ95x55dS5+9c3AI6RWJdWb1A7 o00UPWVe1HwDKcVI1TBLUIyhV/jYduUmE23N+3cxciWCoh8RLl4yYJKx/zXykBVU23uI KBjt5Fzp4Mo7D1i76G44xx3OGRYmMWSsr8FFwnBqwV7yOaXpNO1ZvCargMNdWFezRE3B RwAuKXfSLuTzwDUGXhVbm3PwzX/KyN/WXWAmhC78ebz9GUlNlpGBQNHDNEoT0U3HcBXm Lk+Q==
X-Gm-Message-State: ALoCoQk8UVa752ZlFZC8DMYWuCQxD7XI3o498tbuGpr/it3phfme0DqNzEXfXErKqeuAO40/JEl4
X-Received: by 10.180.150.138 with SMTP id ui10mr3664215wib.32.1415934994682; Thu, 13 Nov 2014 19:16:34 -0800 (PST)
Received: from dhcp-bbd0.meeting.ietf.org (dhcp-bbd0.meeting.ietf.org. [31.133.187.208]) by mx.google.com with ESMTPSA id dc8sm1664341wib.7.2014.11.13.19.16.30 for <multiple recipients> (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 13 Nov 2014 19:16:33 -0800 (PST)
Message-ID: <5465740B.1060305@queuefull.net>
Date: Thu, 13 Nov 2014 17:16:27 -1000
From: Benson Schliesser <bensons@queuefull.net>
User-Agent: Postbox 3.0.11 (Macintosh/20140602)
MIME-Version: 1.0
To: sarikaya@ieee.org
References: <20141110200919.27869.2915.idtracker@ietfa.amsl.com> <5461854F.3020305@gmail.com> <CAC8QAce9kWVp_3+MeMcNpFinhnTcCgk0k1eDtip2j47iCWAbpg@mail.gmail.com> <CAC8QAceh3xPsg-ADthB8WuO2YgLpvso9HAGc1jHnPQ6jBoFk7w@mail.gmail.com> <5463B636.9020501@queuefull.net> <4F0C8596-E563-43DA-8AF1-07DE58610C2A@gmail.com> <CAC8QAcemHNpci3mvxY9=V4aR_uF5DB6a4eKQiO2XLivjE7xhog@mail.gmail.com> <182B38DB-6C67-44C5-803E-44F03A8EA787@gmail.com> <CAC8QAcfvEYXEm+U1tJMVfNrzE7GLuFgvJ1Djvhw2TSrgO7FZdA@mail.gmail.com> <E1E0F148-2E28-478F-BF86-3927C2ADF5BF@gmail.com> <546534E9.6040206@queuefull.net> <CAC8QAce7eB+XFPa79O6RLjhH=OfdzoHc+UMxFFYePrW4u-W_ag@mail.gmail.com> <5465640F.70101@queuefull.net> <CAC8QAcdAxTq9UYOXaFcX9uu_3jCqfF5w49r5ds-dmMQ+4nU48A@mail.gmail.com>
In-Reply-To: <CAC8QAcdAxTq9UYOXaFcX9uu_3jCqfF5w49r5ds-dmMQ+4nU48A@mail.gmail.com>
Content-Type: multipart/alternative; boundary="------------050605020106080104060507"
Archived-At: http://mailarchive.ietf.org/arch/msg/nvo3/5Lw8OrKAwSbn6HH9Tml-gymqkaY
Cc: "nvo3@ietf.org" <nvo3@ietf.org>, Dino Farinacci <farinacci@gmail.com>, "draft-xia-nvo3-vxlan-qosmarking@tools.ietf.org" <draft-xia-nvo3-vxlan-qosmarking@tools.ietf.org>
Subject: Re: [nvo3] I-D Action: draft-xia-nvo3-vxlan-qosmarking-01.txt
X-BeenThere: nvo3@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "Network Virtualization Overlays \(NVO3\) Working Group" <nvo3.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/nvo3>, <mailto:nvo3-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/nvo3/>
List-Post: <mailto:nvo3@ietf.org>
List-Help: <mailto:nvo3-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nvo3>, <mailto:nvo3-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 14 Nov 2014 03:16:45 -0000

Hi, Behcet -

Just to conclude this topic:

I suspect that you think my question has been answered by your 
message(s), but it has not. So... At this point, I maintain my view that 
the NVO3 consensus is: there is no QoS gap that needs to be addressed in 
the overlap encap layer.

Cheers,
-Benson


> Behcet Sarikaya <mailto:sarikaya2012@gmail.com>
> November 13, 2014 at 4:23 PM
> Hi Benson,
> On Thu, Nov 13, 2014 at 8:08 PM, Benson Schliesser 
> <bensons@queuefull.net <mailto:bensons@queuefull.net>> wrote:
>
>     Hi, Behcet -
>
>     Quoting from my previous message: "one could imagine the NVE
>     imposing an underlay DSCP in IP2,
>
> Is IP2 outer IP header? I am assuming it is.
>
>     e.g. to discriminate between tenants."
>
> Not quite. We need to decide on DSCP or 802.1Q type of QoS marking. So 
> I think it is not that simple as you say.
>
>     This seems so obvious to me that I doubt anybody has bothered to
>     write it down...
>
>     It does seem like we should document a mechanism for configuration
>     of the NVE's QoS behavior. (E.g. as part of the NVO3 control plane
>     and/or in a YANG model for NVE management) But that's a different
>     topic.
>
> This is also part of our draft.
>
>     So, back to my question: Is there actually a problem that you
>     trying to solve that cannot be solved with the existing mechanisms?
>
>     If so, then I will reconsider my beliefs about WG consensus. But
>     if not, then I don't see why we're having this conversation.
>
> Please do so.
> Regards,
> Behcet
>
>     Thanks,
>     -Benson
>
>
>>     Behcet Sarikaya <mailto:sarikaya2012@gmail.com>
>>     November 13, 2014 at 4:00 PM
>>
>>     On Thu, Nov 13, 2014 at 4:47 PM, Benson Schliesser
>>     <bensons@queuefull.net <mailto:bensons@queuefull.net>> wrote:
>>
>>         Hi, Behcet -
>>
>>         Stepping back from the conversation about bits... What is the
>>         problem that you're trying to solve, Behcet?
>>
>>         I see multiple existing QoS mechanisms both in the underlay
>>         and in the overlay, and I don't see any QoS gap that needs to
>>         be addressed in the overlap encap layer. I believe that my
>>         point of view is consistent with the WG consensus at this point.
>>
>>     I am not familiar with any QoS mechanism that is based on the
>>     tenant, i.e static mapping.
>>     Let me know which document discusses it?
>>     Thx,
>>     Behcet
>>
>>         Thanks,
>>         -Benson
>>
>>>         Dino Farinacci <mailto:farinacci@gmail.com>
>>>         November 13, 2014 at 12:02 PM
>>>>         Sorry there are no EXP bits mentioned in RFC 7348. MPLS is
>>>>         out of scope.
>>>>         EXP is 3 bits long, DSCP is 6 bits and dividing it into two
>>>>         3 bit
>>>>         pieces, I am not sure if David will like it.
>>>
>>>         I am referring to user-priority bits below:
>>>
>>>
>>>         Dino
>>>
>>>         Benson Schliesser <mailto:bensons@queuefull.net>
>>>         November 12, 2014 at 9:34 AM
>>>         Hi, Behcet -
>>>
>>>         Perhaps I'm confused about what comment (from Dino) that you
>>>         are referring to... But in general, I think of it this way:
>>>
>>>         Assuming the encap stack looks something like: IP1 / Eth1 /
>>>         VXLAN / UDP / IP2 / Eth2  (progressing L->R as inner->outer)
>>>
>>>         Then e.g. tenant VMs can mark the IP1 and Eth1 headers with
>>>         whatever appropriate markings they desire. The NVE can mark
>>>         the IP2 and Eth2 headers with whatever appropriate markings.
>>>
>>>         Specifically, one could imagine the NVE copying the IP1 DSCP
>>>         codepoint into the IP2 header. Alternatively one could
>>>         imagine the NVE imposing an underlay DSCP in IP2, e.g. to
>>>         discriminate between tenants. Possibly, one could also
>>>         imagine some kind of translation policy which maps IP1
>>>         codepoints into IP2 codepoints. And that's not even
>>>         considering mechanisms that leverage the Eth headers, use
>>>         different encap stacks, etc.
>>>
>>>         Cheers,
>>>         -Benson
>>>
>>>         Behcet Sarikaya <mailto:sarikaya2012@gmail.com>
>>>         November 12, 2014 at 9:01 AM
>>>         Hi Dino,
>>>
>>>         Regarding your comment on copying IP header QoS bits into
>>>         VXLAN header,
>>>
>>>         note that IP packet is coming from the VMs.
>>>
>>>         Yes for dynamic marking these bits can be copied.
>>>         However, VMs may not be configured to mark these fields.
>>>
>>>         For static marking these bits can not be used because VMs
>>>         are not
>>>         aware of the VNI. So NVE has to do the static marking.
>>>
>>>         Hope this clarifies.
>>>
>>>         Regards,
>>>
>>>         Behcet
>>>
>>>         _______________________________________________
>>>         nvo3 mailing list
>>>         nvo3@ietf.org <mailto:nvo3@ietf.org>
>>>         https://www.ietf.org/mailman/listinfo/nvo3
>>>         Behcet Sarikaya <mailto:sarikaya2012@gmail.com>
>>>         November 10, 2014 at 5:47 PM
>>>         On Mon, Nov 10, 2014 at 9:41 PM, Brian E Carpenter
>>>         <brian.e.carpenter@gmail.com>  <mailto:brian.e.carpenter@gmail.com>  wrote:
>>>>         [resend with corrected address, sorry]
>>>>
>>>>         Hi,
>>>>
>>>>>           The first three bits (bits 5-7) are precedence bits. They are
>>>>>           assigned according to [RFC0791]. Precedence values '110' and '111'
>>>>>           are selected for routing traffic.
>>>>>
>>>>>           The last three bits (bits 8-10) are class selector bits. Thet are
>>>>>           assigned as follows:
>>>>>
>>>>>         001 - BK or background traffic
>>>>         ...
>>>>>         As can be seen the markings are the same as in IEEE 802.1p...
>>>>         This is not in any way compatible with RFC 2474, which also made the
>>>>         relevant part of RFC 791 obsolete.
>>>>
>>>>         If you want to be compatible with RFC 2474 you should not specify the
>>>>         bits at all - just say that they are exactly as defined in RFC 2474
>>>>         and the various PHB definitions that have been published.
>>>         I think that diffserv is less relevant in the context of VXLAN.
>>>
>>>>           If you
>>>>         want to be compatible with IEEE 802.1p that is a different matter,
>>>         Yes this is more relevant for VXLAN.
>>>
>>>>         but you cannot mix the two up in this way.
>>>         I now understand that we confused the two very different things.
>>>
>>>         Regards,
>>>
>>>         Behcet
>>>>              Brian
>>>>
>>>>
>>>>
>>>         _______________________________________________
>>>         nvo3 mailing list
>>>         nvo3@ietf.org  <mailto:nvo3@ietf.org>
>>>         https://www.ietf.org/mailman/listinfo/nvo3
>>
>>
>>     Benson Schliesser <mailto:bensons@queuefull.net>
>>     November 13, 2014 at 12:47 PM
>>     Hi, Behcet -
>>
>>     Stepping back from the conversation about bits... What is the
>>     problem that you're trying to solve, Behcet?
>>
>>     I see multiple existing QoS mechanisms both in the underlay and
>>     in the overlay, and I don't see any QoS gap that needs to be
>>     addressed in the overlap encap layer. I believe that my point of
>>     view is consistent with the WG consensus at this point.
>>
>>     Thanks,
>>     -Benson
>>
>>     Dino Farinacci <mailto:farinacci@gmail.com>
>>     November 12, 2014 at 8:06 PM
>>
>>     Exactly. Thanks Benson.
>>
>>     Dino
>>     Benson Schliesser <mailto:bensons@queuefull.net>
>>     November 12, 2014 at 9:34 AM
>>     Hi, Behcet -
>>
>>     Perhaps I'm confused about what comment (from Dino) that you are
>>     referring to... But in general, I think of it this way:
>>
>>     Assuming the encap stack looks something like: IP1 / Eth1 / VXLAN
>>     / UDP / IP2 / Eth2  (progressing L->R as inner->outer)
>>
>>     Then e.g. tenant VMs can mark the IP1 and Eth1 headers with
>>     whatever appropriate markings they desire. The NVE can mark the
>>     IP2 and Eth2 headers with whatever appropriate markings.
>>
>>     Specifically, one could imagine the NVE copying the IP1 DSCP
>>     codepoint into the IP2 header. Alternatively one could imagine
>>     the NVE imposing an underlay DSCP in IP2, e.g. to discriminate
>>     between tenants. Possibly, one could also imagine some kind of
>>     translation policy which maps IP1 codepoints into IP2 codepoints.
>>     And that's not even considering mechanisms that leverage the Eth
>>     headers, use different encap stacks, etc.
>>
>>     Cheers,
>>     -Benson
>>
>>     Behcet Sarikaya <mailto:sarikaya2012@gmail.com>
>>     November 12, 2014 at 9:01 AM
>>     Hi Dino,
>>
>>     Regarding your comment on copying IP header QoS bits into VXLAN
>>     header,
>>
>>     note that IP packet is coming from the VMs.
>>
>>     Yes for dynamic marking these bits can be copied.
>>     However, VMs may not be configured to mark these fields.
>>
>>     For static marking these bits can not be used because VMs are not
>>     aware of the VNI. So NVE has to do the static marking.
>>
>>     Hope this clarifies.
>>
>>     Regards,
>>
>>     Behcet
>>
>>     _______________________________________________
>>     nvo3 mailing list
>>     nvo3@ietf.org <mailto:nvo3@ietf.org>
>>     https://www.ietf.org/mailman/listinfo/nvo3
>
>
> Benson Schliesser <mailto:bensons@queuefull.net>
> November 13, 2014 at 4:08 PM
> Hi, Behcet -
>
> Quoting from my previous message: "one could imagine the NVE imposing 
> an underlay DSCP in IP2, e.g. to discriminate between tenants."
>
> This seems so obvious to me that I doubt anybody has bothered to write 
> it down...
>
> It does seem like we should document a mechanism for configuration of 
> the NVE's QoS behavior. (E.g. as part of the NVO3 control plane and/or 
> in a YANG model for NVE management) But that's a different topic.
>
> So, back to my question: Is there actually a problem that you trying 
> to solve that cannot be solved with the existing mechanisms?
>
> If so, then I will reconsider my beliefs about WG consensus. But if 
> not, then I don't see why we're having this conversation.
>
> Thanks,
> -Benson
>
>
> Behcet Sarikaya <mailto:sarikaya2012@gmail.com>
> November 13, 2014 at 4:00 PM
>
> On Thu, Nov 13, 2014 at 4:47 PM, Benson Schliesser 
> <bensons@queuefull.net <mailto:bensons@queuefull.net>> wrote:
>
>     Hi, Behcet -
>
>     Stepping back from the conversation about bits... What is the
>     problem that you're trying to solve, Behcet?
>
>     I see multiple existing QoS mechanisms both in the underlay and in
>     the overlay, and I don't see any QoS gap that needs to be
>     addressed in the overlap encap layer. I believe that my point of
>     view is consistent with the WG consensus at this point.
>
> I am not familiar with any QoS mechanism that is based on the tenant, 
> i.e static mapping.
> Let me know which document discusses it?
> Thx,
> Behcet
>
>     Thanks,
>     -Benson
>
>>     Dino Farinacci <mailto:farinacci@gmail.com>
>>     November 13, 2014 at 12:02 PM
>>>     Sorry there are no EXP bits mentioned in RFC 7348. MPLS is out
>>>     of scope.
>>>     EXP is 3 bits long, DSCP is 6 bits and dividing it into two 3 bit
>>>     pieces, I am not sure if David will like it.
>>
>>     I am referring to user-priority bits below:
>>
>>
>>     Dino
>>
>>     Benson Schliesser <mailto:bensons@queuefull.net>
>>     November 12, 2014 at 9:34 AM
>>     Hi, Behcet -
>>
>>     Perhaps I'm confused about what comment (from Dino) that you are
>>     referring to... But in general, I think of it this way:
>>
>>     Assuming the encap stack looks something like: IP1 / Eth1 / VXLAN
>>     / UDP / IP2 / Eth2  (progressing L->R as inner->outer)
>>
>>     Then e.g. tenant VMs can mark the IP1 and Eth1 headers with
>>     whatever appropriate markings they desire. The NVE can mark the
>>     IP2 and Eth2 headers with whatever appropriate markings.
>>
>>     Specifically, one could imagine the NVE copying the IP1 DSCP
>>     codepoint into the IP2 header. Alternatively one could imagine
>>     the NVE imposing an underlay DSCP in IP2, e.g. to discriminate
>>     between tenants. Possibly, one could also imagine some kind of
>>     translation policy which maps IP1 codepoints into IP2 codepoints.
>>     And that's not even considering mechanisms that leverage the Eth
>>     headers, use different encap stacks, etc.
>>
>>     Cheers,
>>     -Benson
>>
>>     Behcet Sarikaya <mailto:sarikaya2012@gmail.com>
>>     November 12, 2014 at 9:01 AM
>>     Hi Dino,
>>
>>     Regarding your comment on copying IP header QoS bits into VXLAN
>>     header,
>>
>>     note that IP packet is coming from the VMs.
>>
>>     Yes for dynamic marking these bits can be copied.
>>     However, VMs may not be configured to mark these fields.
>>
>>     For static marking these bits can not be used because VMs are not
>>     aware of the VNI. So NVE has to do the static marking.
>>
>>     Hope this clarifies.
>>
>>     Regards,
>>
>>     Behcet
>>
>>     _______________________________________________
>>     nvo3 mailing list
>>     nvo3@ietf.org <mailto:nvo3@ietf.org>
>>     https://www.ietf.org/mailman/listinfo/nvo3
>>     Behcet Sarikaya <mailto:sarikaya2012@gmail.com>
>>     November 10, 2014 at 5:47 PM
>>     On Mon, Nov 10, 2014 at 9:41 PM, Brian E Carpenter
>>     <brian.e.carpenter@gmail.com>  <mailto:brian.e.carpenter@gmail.com>  wrote:
>>>     [resend with corrected address, sorry]
>>>
>>>     Hi,
>>>
>>>>       The first three bits (bits 5-7) are precedence bits. They are
>>>>       assigned according to [RFC0791]. Precedence values '110' and '111'
>>>>       are selected for routing traffic.
>>>>
>>>>       The last three bits (bits 8-10) are class selector bits. Thet are
>>>>       assigned as follows:
>>>>
>>>>     001 - BK or background traffic
>>>     ...
>>>>     As can be seen the markings are the same as in IEEE 802.1p...
>>>     This is not in any way compatible with RFC 2474, which also made the
>>>     relevant part of RFC 791 obsolete.
>>>
>>>     If you want to be compatible with RFC 2474 you should not specify the
>>>     bits at all - just say that they are exactly as defined in RFC 2474
>>>     and the various PHB definitions that have been published.
>>     I think that diffserv is less relevant in the context of VXLAN.
>>
>>>       If you
>>>     want to be compatible with IEEE 802.1p that is a different matter,
>>     Yes this is more relevant for VXLAN.
>>
>>>     but you cannot mix the two up in this way.
>>     I now understand that we confused the two very different things.
>>
>>     Regards,
>>
>>     Behcet
>>>          Brian
>>>
>>>
>>>
>>     _______________________________________________
>>     nvo3 mailing list
>>     nvo3@ietf.org  <mailto:nvo3@ietf.org>
>>     https://www.ietf.org/mailman/listinfo/nvo3
>
>
> Benson Schliesser <mailto:bensons@queuefull.net>
> November 13, 2014 at 12:47 PM
> Hi, Behcet -
>
> Stepping back from the conversation about bits... What is the problem 
> that you're trying to solve, Behcet?
>
> I see multiple existing QoS mechanisms both in the underlay and in the 
> overlay, and I don't see any QoS gap that needs to be addressed in the 
> overlap encap layer. I believe that my point of view is consistent 
> with the WG consensus at this point.
>
> Thanks,
> -Benson
>
> Dino Farinacci <mailto:farinacci@gmail.com>
> November 12, 2014 at 8:06 PM
>
> Exactly. Thanks Benson.
>
> Dino