Re: [nvo3] Shepherd's review of draft-ietf-nvo3-vmm-06
"Bocci, Matthew (Nokia - GB)" <matthew.bocci@nokia.com> Fri, 21 February 2020 11:24 UTC
Return-Path: <matthew.bocci@nokia.com>
X-Original-To: nvo3@ietfa.amsl.com
Delivered-To: nvo3@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BCA7112006F; Fri, 21 Feb 2020 03:24:30 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.9
X-Spam-Level:
X-Spam-Status: No, score=-1.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id MCTfKDw-RYpN; Fri, 21 Feb 2020 03:24:26 -0800 (PST)
Received: from EUR03-AM5-obe.outbound.protection.outlook.com (mail-eopbgr30099.outbound.protection.outlook.com [40.107.3.99]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 84126120096; Fri, 21 Feb 2020 03:24:25 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=N25rkA4J/2zJDYt6lB+XG+y+HFY7SkCnT9OeG91z0ufjw8qCgdc9nXoPqqXRK6ht61aG2eRw+X73E8bozd31yyB9pkHCTOaO4Twxh2O6yWWm9I+ILqCt2HeRsR8KTChjQ5YgFdLpYhuLuiYVjwW2VbO4tUyRn4hQy6g+Tagwt2XFNC0d34x643vu+vin88s8HecF4yzqFjIOKUMNYUfS4dDKJvWqw6iUsDV7pwfwBFT6aP+1rDguXLmo8u0knB4OzTQ8DBpJRG3tFV5qWDglTjpy4F/OJOy85niplcKHBQ2yHKpLXQqUF+h4BW6Rc+ZQmA6SXUPM5FLZZJ9SxPilLA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=dZryLEG5ny7ZYeSrhomVhf3JQ1ULAvZfDTk177fzSrc=; b=E/+Zw6kYGhln+TE+SgHsPjpA3r47nw54JljSbQj8MxK+nAi36qbWnhfBsPlFiWM58MOABwrhMO574hfWM0j4ntuWKntW/vopOZimXdbBIpKs2eqfF5+cfGfOWaYTGjXs1ziN54I4EbmkyneEtu4RDRRGb+BU6vGmsAUZZU7zX+6Ky0Cgce6dFNuj/gntTZvyqduRE2yulU7NWiSvlke025eZqjF/gAnBiHIBPhiGPqAo1W7+rH+Q+bDXW9tMfDfRtxcZCqC2c8r2XxUWa7w/xj/vA5BWpCC0vGI+HYu2kXohcvqu+vKSXouPK5vVL6q/Og+K3jrhUSsP67pamw4Meg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nokia.com; dmarc=pass action=none header.from=nokia.com; dkim=pass header.d=nokia.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com; s=selector1-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=dZryLEG5ny7ZYeSrhomVhf3JQ1ULAvZfDTk177fzSrc=; b=YJt2m+do5y9lLaYXqiDOdccGipIY5zS2ESGkMEKpKdk/nam0m0oe7ouIYlh9f+pC3yEqv8iRp4KIStqHGgvmAlCxgI5k8ll6TNKDCCGscj1pHBdvtCyKzZuxBPM2EsxsAEGWgNz4V/tAuSoBjSeMWQSOuplm8h5lSvS9EtSh6tg=
Received: from DB7PR07MB4106.eurprd07.prod.outlook.com (52.134.103.159) by DB7PR07MB4777.eurprd07.prod.outlook.com (52.135.141.149) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2750.15; Fri, 21 Feb 2020 11:24:23 +0000
Received: from DB7PR07MB4106.eurprd07.prod.outlook.com ([fe80::d1d:70e6:1bc8:7437]) by DB7PR07MB4106.eurprd07.prod.outlook.com ([fe80::d1d:70e6:1bc8:7437%7]) with mapi id 15.20.2750.021; Fri, 21 Feb 2020 11:24:23 +0000
From: "Bocci, Matthew (Nokia - GB)" <matthew.bocci@nokia.com>
To: Linda Dunbar <linda.dunbar@futurewei.com>, "draft-ietf-nvo3-vmm@ietf.org" <draft-ietf-nvo3-vmm@ietf.org>
CC: NVO3 <nvo3@ietf.org>
Thread-Topic: Shepherd's review of draft-ietf-nvo3-vmm-06
Thread-Index: AQHV506G8r/CExDZbUuMIkUXDsuycqgkibfQgAD6mQA=
Date: Fri, 21 Feb 2020 11:24:23 +0000
Message-ID: <29C0C34D-69DF-47D7-8ACD-2356FDB015BB@nokia.com>
References: <F3AE9A2C-20AA-452F-AC3B-DC1E4380634B@nokia.com> <MWHPR1301MB209646A4B133F35DFE3F57C385120@MWHPR1301MB2096.namprd13.prod.outlook.com>
In-Reply-To: <MWHPR1301MB209646A4B133F35DFE3F57C385120@MWHPR1301MB2096.namprd13.prod.outlook.com>
Accept-Language: en-GB, en-US
Content-Language: en-GB
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/10.22.0.200209
authentication-results: spf=none (sender IP is ) smtp.mailfrom=matthew.bocci@nokia.com;
x-originating-ip: [81.108.178.133]
x-ms-publictraffictype: Email
x-ms-office365-filtering-ht: Tenant
x-ms-office365-filtering-correlation-id: f4cbecb6-35d4-4129-2992-08d7b6c09a1d
x-ms-traffictypediagnostic: DB7PR07MB4777:
x-microsoft-antispam-prvs: <DB7PR07MB4777EF79742DEFBAC8AFA0A4EB120@DB7PR07MB4777.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-forefront-prvs: 0320B28BE1
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(4636009)(136003)(396003)(39860400002)(366004)(376002)(346002)(199004)(189003)(9326002)(8936002)(81166006)(86362001)(33656002)(81156014)(5660300002)(71200400001)(8676002)(478600001)(66476007)(91956017)(6506007)(66946007)(53546011)(55236004)(76116006)(26005)(66446008)(64756008)(66556008)(186003)(36756003)(316002)(2906002)(110136005)(4326008)(2616005)(6486002)(6512007); DIR:OUT; SFP:1102; SCL:1; SRVR:DB7PR07MB4777; H:DB7PR07MB4106.eurprd07.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1;
received-spf: None (protection.outlook.com: nokia.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: +4b+WivAM/S2omFiOBEDk6CrubeO4uWwdCKqAzhGqR8zS40nXzWpb4A3oNAjq49sscrYhRkKbX2hPD2acX+DJyLRnAh6eVZ3nIVwyl5zBaMoR+1sN5KZzMU7/R74MzV1mfFyrUdNeIsI0Hgt6V8JexVmApvtiCJEhbJjONuRJBXEhEe7l8vCKpFaO2AtxUYBcj7oONGA49Th1F7/TVtsEIV41Nv92obc8PyxlB3MrhJf4Bb1IvnzlWpaJECLsTU1Xa9W9x0Px4EdSCTOkMtVPbAlcVyxC5vHVKWLVKS620CBrapYLNYOnL4z/JCLc44zKmCJ2m9NSgKUc8ZsCdmfQk/kKRfMH7xkNKOQcGnoS0Jm53RvJ9e2Tqw+El6Y+B8RI8ajVZbZ5jcBV08Py3uZkHVlhmL8JLMo29kmQiQ0nt/eJgig7xw3i23Vpijp69SL
x-ms-exchange-antispam-messagedata: j3/lDpmZEG67jKovGh9nt4B5hMf4l3QEqpS+RHfI/546ywWzDc7G0DpY2TWt6sftocmCtJPIcz5chLHnixw0SK+KVOC83t9lNeGx1xut58aHewPNszDK2G4bPPwn9iWXnyxE2pj+oHZdeV0AbAm5BA==
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_29C0C34D69DF47D78ACD2356FDB015BBnokiacom_"
MIME-Version: 1.0
X-OriginatorOrg: nokia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: f4cbecb6-35d4-4129-2992-08d7b6c09a1d
X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Feb 2020 11:24:23.0223 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: M7Et372irX9xojS0Ka3jn3Zhf0Qgz9yDng9rvY656sdknMf20s6b/OPaqZtuftaedQgZq9ksMeb132FBTCdGsg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB7PR07MB4777
Archived-At: <https://mailarchive.ietf.org/arch/msg/nvo3/TtWbnbFGJ2tMewqK0nrEsf5owrg>
Subject: Re: [nvo3] Shepherd's review of draft-ietf-nvo3-vmm-06
X-BeenThere: nvo3@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Network Virtualization Overlays \(NVO3\) Working Group" <nvo3.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/nvo3>, <mailto:nvo3-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nvo3/>
List-Post: <mailto:nvo3@ietf.org>
List-Help: <mailto:nvo3-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/nvo3>, <mailto:nvo3-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 21 Feb 2020 11:24:31 -0000
Hi Linda, Thanks for your responses. I am fine with most of these. I have just a couple of comments below. Matthew From: Linda Dunbar <linda.dunbar@futurewei.com> Date: Friday, 21 February 2020 at 00:41 To: "Bocci, Matthew (Nokia - GB)" <matthew.bocci@nokia.com>, "draft-ietf-nvo3-vmm@ietf.org" <draft-ietf-nvo3-vmm@ietf.org> Cc: NVO3 <nvo3@ietf.org> Subject: RE: Shepherd's review of draft-ietf-nvo3-vmm-06 Matthew, Thank you very much for the detailed comments. They are very helpful. Inserted below are the detailed changes per your comments. Can you let us know if they are acceptable? Thank you. Linda From: Bocci, Matthew (Nokia - GB) <matthew.bocci@nokia.com> Sent: Wednesday, February 19, 2020 12:01 PM To: draft-ietf-nvo3-vmm@ietf.org Cc: NVO3 <nvo3@ietf.org> Subject: Shepherd's review of draft-ietf-nvo3-vmm-06 Authors Here is my document shepherd’s review. Please treat these comments as you would any other last call comment. Thanks Matthew The document is missing the definite article (‘the’, ‘a’ etc) in numerous places. Please go through the document carefully and correct these. [Linda] thank you. We are going through to add them. Please expand the term ‘DC’ on first use. [Linda] added. Section 3, Requirements VM mobility should not require changing their IP addresses after the move. MB> Who is ‘their’? Do you mean ‘a VM’s’ ? [Linda]. Yes. Changed the sentence to “Virtual machine (VM) mobility should not require changing VMs’ IP addresses after the move.” There exist "Hot Migration" where transport service continuity is maintained, and "Cold Migration" where the transport service needs to be restarted, i.e., execution of the tasks is stopped on the "Old" NVE, moved to the "New" NVE and the task is restarted. MB> What is the requirement here? Can you rephrase this paragraph? [Linda] Add the following sentences to the paragraph: “Not all DCs support “Hot Migration. DCs that only support Cold Migration should make their customers aware of the potential service interruption during the Cold migration.” 4.1. VM Migration in Layer-2 Network [...] Therefore, this scheme is highly desirable for utilization in large scale multi-tenant DCs. MB> Which scheme? Do you mean dynamic VM mobility? Please can you clarify this sentence. [Linda] Yes. Revised the sentence to the following: “Therefore, dynamic VM Mobility is highly desirable for large scale multi-tenant DCs.” [...] Such a change enables all NVEs to encapsulate the outgoing MAC frames with the current target NVE IP address. It may take some time to refresh the ARP/ND cache when a VM has moved to a New NVE. During this period, a tunnel is needed for that Old NVE to forward packets destined to the VM under the New NVE. MB> How does the old VM know which tunnel to use? [Linda] the procedure is explained in the paragraph right following this sentence: “In IPv4, the VM immediately after the move should send a gratuitous ARP request message containing its IPv4 and Layer 2 MAC address in its new NVE. This message's destination address is the broadcast address. Upon receiving this message, both Old and New NVEs should update the VM's ARP entry in the central directory at the NVA, to update its mappings to record the IPv4 address & MAC address of the moving VM along with the new NVE IPv4 address. An NVE-to-NVA protocol is used for this purpose [RFC8014].” [...] Reverse ARP (RARP) which enables the host to discover its IPv4 address when it boots from a local server [RFC0903], is not used by VMs because the VM already knows its IPv4 address. Next, we describe a case where RARP is used. MB> Please clarify. First you say RARP is not used, but then you say it is. Perhaps it is just the was this paragraph is phrased. [Linda] Changed the sentence to the following: “Reverse ARP (RARP) which enables the host to discover its IPv4 address when it boots from a local server [RFC0903], is not used by VMs if the VM already knows its IPv4 address (most common scenario). Next, we describe a case where RARP is used. 4.2. Task Migration in Layer-3 Network Layer-2 based DC networks become quickly prohibitive because ARP/neighbor caches don't scale. MB> That is a very strong statement for a BCP. Perhaps you mean to say that ARP/neighbour cache scalability considerations can limit the size of Layer-2 based DC networks? [Linda] That is correct. Changed to your suggested wording. [...] Cold task migration, which is a common practice in many data centers, involves the following steps: - Stop running the task. - Package the runtime state of the job. - Send the runtime state of the task to the new NVE where the task is to run. - Instantiate the task's state on the new machine. - Start the tasks continuing it from the point at which it was stopped. Address migration and connection migration in moving tasks or VMs are addressed next. MB> This last sentence seems redundant. I suggest removing it. [Linda] removed. Thanks. [...] 5. Handling Packets in Flight The Old NVE may receive packets from the VM's ongoing communications. These packets should not be lost; they should be sent to the New NVE to be delivered to the VM. The steps involved in handling packets in flight are as follows: Preparation Step: It takes some time, possibly a few seconds for a VM to move from its Old NVE to a New NVE. During this period, a tunnel needs to be established so that the Old NVE can forward packets to the New NVE. Old NVE gets New NVE address from NVA in the request to move the VM. The Old NVE can store the New NVE address for the VM with a timer. When the timer expired, the entry for the New NVE for the VM can be deleted. MB> How does the old NVE know this? I assume the NVA pushes this to the old NVE, but it is not at all clear from the text. Please clarify. [Linda] “Old NVE gets New NVE address from NVA in the request to move the VM”. Not clear? MB2> The directionality of the ‘request to move the NVE’ is not clear to me. I assume what happens is that when some entity decides to move the VM from one server to another then it tells the NVA to update all the NVEs in the DC VPN accordingly. So the NVA pushes the information about how to reach the VM at the new NVE from the old NVE. I don’t think the NVA actually moves the VM, since the NVA is just managing the network, not the spin up/down/migration of the VMs themselves. Likewise, I don’t think the NVE asks the NVA to move a VM as it is not much more than a tunnel endpoint. It would be helpful if you can clarify the sequence of steps and the directionality of any messaging here. [...] 6. Moving Local State of VM MB> This whole section seems to be out of scope of the DC VPN network. Therefore, I would think it is out of scope of this draft and should be removed. [Linda] How about we remove the description for the detailed State Transferring. And states that it is out of the scope of this document? 6. Moving Local State of VM In addition to the VM mobility related signaling (VM Mobility Registration Request/Reply), the VM state needs to be transferred to the New NVE. The state includes its memory and file system if the VM cannot access the memory and the file system after moving to the New NVE. The mechanism of transferring VM States and file system is out of the scope of this document. [...] There is also a Hot Standby option in addition to the Hot Mobility, where there are VMs in both primary and secondary NVEs. MB> This section title says Hot Mobility, but only talks about Hot Standby. [Linda] Added a new subtitle “Other VM Mobility Options” They have identical information and can provide services simultaneously as in load-share mode of operation. If the VM in the primary NVE fails, there is no need to actively move the VM to the secondary NVE because the VM in the secondary NVE already contains identical information. The Hot Standby option is the costliest mechanism, and hence this option is utilized only for mission-critical applications and services. In Hot Standby option, regarding TCP connections, one option is to start with and maintain TCP connections to two different VMs at the same time. The least loaded VM responds first and starts providing service while the sender (origin) still continues to receive Ack from the heavily loaded (secondary) VM and chooses not to use the service of the secondary responding VM. If the situation (loading condition of the primary responding VM) changes the secondary VM may start providing service to the sender (origin). [...] 8. VM Operation Once a VM moves to a new NVE, the VM's IP address does not change and the VM should be able to continue to receive packets to its address(es). MB> How does that work for the hot standby case? Do you swap the old/new VM IP addresses? [Linda] moved the description of the behaviour on Hot VM Mobility to be under the Section 7 (Handling Hot, Warm and Cold VM Mobility). Changed the section title to “VM Lifecycle Management” (which is out of the scope of the document).
- [nvo3] Shepherd's review of draft-ietf-nvo3-vmm-06 Bocci, Matthew (Nokia - GB)
- Re: [nvo3] Shepherd's review of draft-ietf-nvo3-v… Linda Dunbar
- Re: [nvo3] Shepherd's review of draft-ietf-nvo3-v… Bocci, Matthew (Nokia - GB)
- Re: [nvo3] Shepherd's review of draft-ietf-nvo3-v… Bocci, Matthew (Nokia - GB)
- Re: [nvo3] Shepherd's review of draft-ietf-nvo3-v… Linda Dunbar
- Re: [nvo3] Shepherd's review of draft-ietf-nvo3-v… Linda Dunbar