Re: [nvo3] Draft NVO3 WG Charter

<david.black@emc.com> Tue, 21 February 2012 18:25 UTC

Return-Path: <david.black@emc.com>
X-Original-To: nvo3@ietfa.amsl.com
Delivered-To: nvo3@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id DD49D21F88E2 for <nvo3@ietfa.amsl.com>; Tue, 21 Feb 2012 10:25:55 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -109.619
X-Spam-Level:
X-Spam-Status: No, score=-109.619 tagged_above=-999 required=5 tests=[AWL=0.980, BAYES_00=-2.599, RCVD_IN_DNSWL_HI=-8, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id j-gOtVCLlLnI for <nvo3@ietfa.amsl.com>; Tue, 21 Feb 2012 10:25:50 -0800 (PST)
Received: from mexforward.lss.emc.com (mexforward.lss.emc.com [128.222.32.20]) by ietfa.amsl.com (Postfix) with ESMTP id 2E71221F88D5 for <nvo3@ietf.org>; Tue, 21 Feb 2012 10:25:49 -0800 (PST)
Received: from hop04-l1d11-si01.isus.emc.com (HOP04-L1D11-SI01.isus.emc.com [10.254.111.54]) by mexforward.lss.emc.com (Switch-3.4.3/Switch-3.4.3) with ESMTP id q1LIPlqV020701 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 21 Feb 2012 13:25:48 -0500
Received: from mailhub.lss.emc.com (mailhub.lss.emc.com [10.254.222.129]) by hop04-l1d11-si01.isus.emc.com (RSA Interceptor); Tue, 21 Feb 2012 13:25:29 -0500
Received: from mxhub19.corp.emc.com (mxhub19.corp.emc.com [10.254.93.48]) by mailhub.lss.emc.com (Switch-3.4.3/Switch-3.4.3) with ESMTP id q1LIPMEi007866; Tue, 21 Feb 2012 13:25:28 -0500
Received: from mx14a.corp.emc.com ([169.254.1.157]) by mxhub19.corp.emc.com ([10.254.93.48]) with mapi; Tue, 21 Feb 2012 13:25:09 -0500
From: david.black@emc.com
To: pedro.r.marques@gmail.com
Date: Tue, 21 Feb 2012 13:25:08 -0500
Thread-Topic: [nvo3] Draft NVO3 WG Charter
Thread-Index: Aczwvw9M9rAuhhw+TKuwXUYpc/phNgABLvRg
Message-ID: <7C4DFCE962635144B8FAE8CA11D0BF1E05AEAEF8EA@MX14A.corp.emc.com>
References: <201202171451.q1HEptR3027370@cichlid.raleigh.ibm.com> <5E893DB832F57341992548CDBB333163A55C70661A@EMBX01-HQ.jnpr.net> <5E613872-0E27-46D2-8097-B31E7F0F37C5@mimectl> <5E893DB832F57341992548CDBB333163A55C70669D@EMBX01-HQ.jnpr.net> <B56CFB4A-2393-42C7-9A89-0AA397512F12@mimectl> <201202201430.q1KEUW158093@magenta.juniper.net> <7C4DFCE962635144B8FAE8CA11D0BF1E05AEAEF752@MX14A.corp.emc.com> <201202211331.q1LDVY173863@magenta.juniper.net> <7C4DFCE962635144B8FAE8CA11D0BF1E05AEAEF88B@MX14A.corp.emc.com> <CAMXVrt7oJXqv8HZobJD-Wfto1cjOq6Vxx3JaY3Fb7Qzam68zuQ@mail.gmail.com>
In-Reply-To: <CAMXVrt7oJXqv8HZobJD-Wfto1cjOq6Vxx3JaY3Fb7Qzam68zuQ@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-EMM-MHVC: 1
Cc: narten@us.ibm.com, jdrake@juniper.net, yakov@juniper.net, nvo3@ietf.org, afarrel@juniper.net, nitinb@juniper.net, rbonica@juniper.net
Subject: Re: [nvo3] Draft NVO3 WG Charter
X-BeenThere: nvo3@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "L2 \"Network Virtualization Over l3\" overlay discussion list \(nvo3\)" <nvo3.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/nvo3>, <mailto:nvo3-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/nvo3>
List-Post: <mailto:nvo3@ietf.org>
List-Help: <mailto:nvo3-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nvo3>, <mailto:nvo3-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 21 Feb 2012 18:25:56 -0000

Pedro,

> You misunderstood my message. My point is that for live migration L2
> transparency is not relevant but convergence time is quite critical.
> 
> I've not understood why you believe that the proposal "breaks live
> migration" specially after i pointed out that the routing
> configuration on the VM is a non-issue.

Could you supply the details of how it's a non-issue, including the
network response to the gratuitous ARPs and RARPs issued by existing
hypervisors?  Those details are not in the draft, and you might want
to put them into a revised version of the draft.

My interest is not so much in the requirements of VMs in principle,
but how this will co-exist in practice with existing hypervisor deployments.

> It is unclear to me whether you the "existing VM live migration
> implementations" that you are referring to perform storage access via
> direct L2 protocols. Direct L2 storage access is indeed a tradeoff
> versus scaling.

They generally do not use direct L2 storage access.  An FCoE initiator
in a VM would perform direct L2 storage access, but that's not a good
idea because most hypervisor softswitches do not support the DCB Ethernet
functionality required by FCoE.  Hypervisor use of FCoE is typically a
static configuration - a moved VM uses the destination hypervisor's FCoE
to access its storage, and does not move its FCoE session/connection
across hypervisors.  iSCSI, NFS and CIFS all use IP.

Thanks,
--David

> -----Original Message-----
> From: nvo3-bounces@ietf.org [mailto:nvo3-bounces@ietf.org] On Behalf Of Pedro Marques
> Sent: Tuesday, February 21, 2012 12:34 PM
> To: Black, David
> Cc: narten@us.ibm.com; jdrake@juniper.net; yakov@juniper.net; nvo3@ietf.org; afarrel@juniper.net;
> nitinb@juniper.net; rbonica@juniper.net
> Subject: Re: [nvo3] Draft NVO3 WG Charter
> 
> David,
> 
> On Tue, Feb 21, 2012 at 8:38 AM,  <david.black@emc.com> wrote:
> > For example, Pedro appears to have just confirmed that the l3vpn-end-system draft
> > made a design choice that breaks existing live VM migration implementations in
> > favor of improving network convergence.
> 
> You misunderstood my message. My point is that for live migration L2
> transparency is not relevant but convergence time is quite critical.
> 
> I've not understood why you believe that the proposal "breaks live
> migration" specially after i pointed out that the routing
> configuration on the VM is a non-issue.
> 
> >  A data center currently running one of
> > those existing VM live migration implementations may well prefer a less disruptive
> > scaling approach that doesn't have that side effect.
> 
> It is unclear to me whether you the "existing VM live migration
> implementations" that you are referring to perform storage access via
> direct L2 protocols. Direct L2 storage access is indeed a tradeoff
> versus scaling.
> 
> That tradeoff maybe attractive to small scale deployments while
> completely unacceptable to large scale ones. That is one of the things
> to keep in mind when the IETF considers data from "existing
> implementations".
> 
> >
> > Thanks,
> > --David
> >
> >> -----Original Message-----
> >> From: nvo3-bounces@ietf.org [mailto:nvo3-bounces@ietf.org] On Behalf Of Yakov Rekhter
> >> Sent: Tuesday, February 21, 2012 8:32 AM
> >> To: Black, David
> >> Cc: narten@us.ibm.com; jdrake@juniper.net; rbonica@juniper.net; nvo3@ietf.org; afarrel@juniper.net;
> >  > nitinb@juniper.net
> >> Subject: Re: [nvo3] Draft NVO3 WG Charter
> >>
> >> David,
> >>
> >> > Yakov,
> >> >
> >> > > What are the specific *technical* reason(s) why MPLS over GRE is
> >> > > a "non-starter" for (a) ToR switches, (b) datacenter access switches,
> >> > > and (c) hypervisor softswitches ?
> >> >
> >> > Sure, that was on my list of things to do, so thanks for asking, but
> >> > my original assertion was:
> >> >
> >> > > > > > BGP and MPLS are non-starters for a lot of datacenter-internal
> >> > > > > > networks.
> >> >
> >> > Let's start with one of the more important problems that has motivated
> >> > interest in overlays for virtual networking.  From the proposed charter:
> >> >
> >> >    Support for multi-tenancy has become a core requirement of data
> >> >    centers, especially in the context of data centers which include
> >> >    virtualized servers known as virtual machines (VMs).
> >> >
> >> > In these datacenters, there is a sizeable population of virtual machines
> >> > running using VLANs.  In a bit more detail, that means:
> >> >     - Data Plane: TCP/IP, Ethernet VLANs
> >> >     - Control Plane: IP Routing based on IGPs (e.g., OSPF), VLAN
> >> >             configuration, LLDP, etc.
> >> > Beyond that, management, operational practices and network admin skills
> >> > are matched to the environment.
> >> >
> >> > Again from the proposed charter:
> >> >
> >> >    Tenant isolation is primarily achieved today within data centers using
> >> >    Ethernet VLANs. But the 12-bit VLAN tag field isn't large enough to
> >> >    support existing and future needs.
> >> >
> >> > This is an incremental growth problem - the datacenter is running fine
> >> > with VLANs, but VLAN address space is being exhausted.  The solution
> >> > should be incremental in impact and incrementally deployable.
> >> >
> >> > Taking a look at MPLS and BGP, and assuming that the gaps previously
> >> > pointed out in the marques-l3vpn-end-system draft are addressed, I see
> >> > the following:
> >> >     - Introduce new data plane: MPLS
> >> >     - Introduce new control plane: BGP
> >> >     - Significant changes to management and operational practices
> >> >     - New network admin skills required
> >> > That's not the best incremental impact story.  The last one is particularly
> >> > important.
> >>
> >> From the proposed charter:
> >>
> >>   4) Develop requirements (and later a Standards Track protocol) for a
> >>   more scalable control plane for managing and distributing the mappings
> >>   of "inner" to "outer" addresses. We will develop a reusable framework
> >>   suitable for use by any mapping function in which there is a need to
> >>   map "inner" to outer addresses. Starting point:
> >>   draft-kreeger-nvo3-overlay-cp-00.txt
> >>
> >> Developing a new (Standards Track) protocol would introduce:
> >>
> >>    - new control plane
> >>    - significant changes to management and operational practices
> >>    - new network admin skills required
> >>
> >> So, developing a new protocol, as proposed in the charter, is
> >> certainly "not the best incremental impact story". Thus, following
> >> your line of reasoning, item 4 (developing a Standards Track protocol)
> >> should be removed from the charter. However, I don't recall seeing
> >> an e-mail from you suggesting to remove item 4 from the charter.
> >> Did I miss it ?
> >>
> >> Yakov.
> >> _______________________________________________
> >> nvo3 mailing list
> >> nvo3@ietf.org
> >> https://www.ietf.org/mailman/listinfo/nvo3
> >
> > _______________________________________________
> > nvo3 mailing list
> > nvo3@ietf.org
> > https://www.ietf.org/mailman/listinfo/nvo3
> _______________________________________________
> nvo3 mailing list
> nvo3@ietf.org
> https://www.ietf.org/mailman/listinfo/nvo3