Re: [Nfvrg] Research Group Preparation (a.k.a. "Last Call") for draft-irtf-nfvrg-gaps-network-virtualization

Pierre Lynch <PLynch@ixiacom.com> Tue, 27 June 2017 10:08 UTC

Return-Path: <PLynch@ixiacom.com>
X-Original-To: nfvrg@ietfa.amsl.com
Delivered-To: nfvrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 62A64127275 for <nfvrg@ietfa.amsl.com>; Tue, 27 Jun 2017 03:08:30 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.8
X-Spam-Level:
X-Spam-Status: No, score=-4.8 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-2.8, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=ixiacom.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id X3PiYm4ydqky for <nfvrg@ietfa.amsl.com>; Tue, 27 Jun 2017 03:08:27 -0700 (PDT)
Received: from NAM02-SN1-obe.outbound.protection.outlook.com (mail-sn1nam02on0057.outbound.protection.outlook.com [104.47.36.57]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id E99B7127010 for <nfvrg@irtf.org>; Tue, 27 Jun 2017 03:08:26 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ixiacom.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=eIx+nsSHnK8TRvrJGlEp7Iwt8UmGtPCARsPRGYLfE/g=; b=hsPyNVReWu+rwqWdSwIkd4d2hYvpnEzZzmyzIQMnyO8YY+tRe7eJu4gA/gfzc9VyM5xLUXEcsGkLJIUl2eHR3ZZvUxM03BZNWvaNVK07oyOMbTJWkYB0nKVUiFpd6Mr8Y+Du/jJjJ1QSgnw7p3rwqh1LmuPpDep5FZFOYYjOBsU=
Received: from BN3PR0601MB1121.namprd06.prod.outlook.com (10.160.157.147) by BN3PR0601MB1122.namprd06.prod.outlook.com (10.160.157.148) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1199.15; Tue, 27 Jun 2017 10:08:24 +0000
Received: from BN3PR0601MB1121.namprd06.prod.outlook.com ([10.160.157.147]) by BN3PR0601MB1121.namprd06.prod.outlook.com ([10.160.157.147]) with mapi id 15.01.1199.019; Tue, 27 Jun 2017 10:08:24 +0000
From: Pierre Lynch <PLynch@ixiacom.com>
To: "Dirk.von-Hugo@telekom.de" <Dirk.von-Hugo@telekom.de>
CC: "nfvrg@irtf.org" <nfvrg@irtf.org>, "cjbc@it.uc3m.es" <cjbc@it.uc3m.es>
Thread-Topic: [Nfvrg] Research Group Preparation (a.k.a. "Last Call") for draft-irtf-nfvrg-gaps-network-virtualization
Thread-Index: AQHS7y1Qo7J06MhK7UKzIQLvwuVTgg==
Date: Tue, 27 Jun 2017 10:08:24 +0000
Message-ID: <86A2B332-790F-4A63-9B2D-E46FE59A4B22@ixiacom.com>
References: <CAFL1SJQhzK1-jYcJtmv5JYAnXDNybS=mq3qNMsx5Tzk0WyOLDw@mail.gmail.com> <9254b66d9ff84432ab47e61a7858db26@HE105831.emea1.cds.t-internal.com>
In-Reply-To: <9254b66d9ff84432ab47e61a7858db26@HE105831.emea1.cds.t-internal.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: telekom.de; dkim=none (message not signed) header.d=none;telekom.de; dmarc=none action=none header.from=ixiacom.com;
x-ms-publictraffictype: Email
x-microsoft-exchange-diagnostics: 1; BN3PR0601MB1122; 7:bEt5f/8rrfIWdTNtyBnN66GGz7XpA3b7hzEcdRAN0KOJvcahLPiHo9jWV3aB5EwzQPgysswumU8TQ248DJZ6Py+Au2LRCAnvjKSedlGnmqfQA99SaHN/Gie6nlij7KK8g6SSBmDPkhSsr6krsAj7Pxsq7HVfcaShuR6uUfmx0zfreJAp2BwHGb0T5TqWFa/q+juUPnqkJd6ngJcPQKR7eqTPLjUzZda4MxxObRy9vsEHQeiy5zA5QAmA0Cku43BskPv2jtvrE5ldq6kTAk3F/7x+s89O/NXh1SBIJeS/3Ojjm+aGf7ZcYhgD1iQXB0lIVcWSi+dUM2bzl99DpfrWQrsb2zIYx5EUlU9BafmD6y8flfgrqByoU6qGWS+W7RjcaQyeVsLVkYW8rwOHhUm82oNRUK6M+n3Mef8eXo4OuER/YacGoZLoB3lQ1atCziYA8wHbglrAe8UCcwEJZnEtB7ZPGw0IEtGiN4bIPcmlA/4tv5LfO+FAWy6E6kNQPJxeVz/F20S6uxCn0pFXBply2527F3KJOPYABitoeR2PyJ6JFUYfdrX7j5gmG9XB9KVcke+Z0r5rFn9t3KFBS3C6AOSaazluKEp+y0sOgD4ZMtdvJ8+HFl9+/pwpPTqFvTC+mpcZPEP7hqESb/qcmYWHLIgvPNNJJ4zTrw7xWDE/NDp9ac7u2U1lLr7hf1hgEP5AvQ9oQZi0m3nzhzIwEXzSone+5c+bcEnFnrelKq5Y+GuFfrD9kWu6v6b2sCKptRYr+7Yt/qzdSdYJCpdqRQzgRAbXCKuuj0IkDiFKxsusI0o=
x-ms-office365-filtering-correlation-id: 336ec18e-6627-4ca5-cfe9-08d4bd4472ad
x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(2017030254075)(300000503095)(300135400095)(201703131423075)(201703031133081)(201702281549075)(300000504095)(300135200095)(300000505095)(300135600095); SRVR:BN3PR0601MB1122;
x-ms-traffictypediagnostic: BN3PR0601MB1122:
x-microsoft-antispam-prvs: <BN3PR0601MB112260F33D1C59C249451B5DCDDC0@BN3PR0601MB1122.namprd06.prod.outlook.com>
x-exchange-antispam-report-test: UriScan:(278178393323532)(40392960112811)(120809045254105)(236129657087228)(189930954265078)(48057245064654)(148574349560750)(219752817060721)(92977632026198)(50300203121483);
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(601004)(2401047)(8121501046)(5005006)(100000703101)(100105400095)(10201501046)(3002001)(93006095)(93001095)(6041248)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123564025)(20161123558100)(20161123562025)(20161123560025)(20161123555025)(6072148)(100000704101)(100105200095)(100000705101)(100105500095); SRVR:BN3PR0601MB1122; BCL:0; PCL:0; RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095); SRVR:BN3PR0601MB1122;
x-forefront-prvs: 0351D213B3
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(39840400002)(39450400003)(39410400002)(39850400002)(39400400002)(377454003)(25724002)(24454002)(40134004)(252514010)(6306002)(8676002)(53546010)(53946003)(2351001)(6512007)(7906003)(54906002)(81166006)(53936002)(99286003)(230783001)(4326008)(83716003)(33656002)(2900100001)(54896002)(25786009)(2906002)(236005)(8936002)(5660300001)(2501003)(86362001)(189998001)(5640700003)(14454004)(102836003)(2950100002)(6246003)(606005)(6916009)(110136004)(38730400002)(50986999)(54356999)(966005)(6436002)(36756003)(76176999)(6506006)(72206003)(80792005)(82746002)(229853002)(3660700001)(77096006)(478600001)(6486002)(45080400002)(122556002)(3280700002); DIR:OUT; SFP:1101; SCL:1; SRVR:BN3PR0601MB1122; H:BN3PR0601MB1121.namprd06.prod.outlook.com; FPR:; SPF:None; MLV:sfv; LANG:en;
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/alternative; boundary="_000_86A2B332790F4A639B2DE46FE59A4B22ixiacomcom_"
MIME-Version: 1.0
X-OriginatorOrg: ixiacom.com
X-MS-Exchange-CrossTenant-originalarrivaltime: 27 Jun 2017 10:08:24.3500 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 069fd614-e3f8-4372-8e18-cd06724a9b23
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN3PR0601MB1122
X-MS-Exchange-CrossPremises-AuthAs: Internal
X-MS-Exchange-CrossPremises-AuthMechanism: 04
X-MS-Exchange-CrossPremises-AuthSource: BN3PR0601MB1121.namprd06.prod.outlook.com
X-MS-Exchange-CrossPremises-TransportTrafficType: Email
X-MS-Exchange-CrossPremises-TransportTrafficSubType:
X-MS-Exchange-CrossPremises-SCL: 1
X-MS-Exchange-CrossPremises-messagesource: StoreDriver
X-MS-Exchange-CrossPremises-BCC:
X-MS-Exchange-CrossPremises-originalclientipaddress: 136.56.53.184
X-MS-Exchange-CrossPremises-transporttraffictype: Email
X-MS-Exchange-CrossPremises-transporttrafficsubtype:
X-MS-Exchange-CrossPremises-antispam-scancontext: DIR:Originating; SFV:NSPM; SKIP:0;
X-MS-Exchange-CrossPremises-processed-by-journaling: Journal Agent
X-OrganizationHeadersPreserved: BN3PR0601MB1122.namprd06.prod.outlook.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/nfvrg/GAdntbVcVKfU0a_KW9GcUZmJ6ZY>
Subject: Re: [Nfvrg] Research Group Preparation (a.k.a. "Last Call") for draft-irtf-nfvrg-gaps-network-virtualization
X-BeenThere: nfvrg@irtf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: "Network Function Virtualization Research Group \(NFVRG\) discussion list" <nfvrg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/nfvrg>, <mailto:nfvrg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nfvrg/>
List-Post: <mailto:nfvrg@irtf.org>
List-Help: <mailto:nfvrg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/nfvrg>, <mailto:nfvrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Tue, 27 Jun 2017 10:08:30 -0000

Hello Dirk,

I am helping Carlos deal with the comments with the section that I wrote (4.10 testing). I’d like to try to understand the comment you made below for page 25. I’ll try to explain what I am trying to say, and maybe we can converge.



p.25:
IMO most of the text is true in any test case and very general (not VNF specific) as “The only variables in the testing should be those controlling the SUT itself”
… the workload type the expected VNF will be => … the workload type the expected VNF will be characterized by [?]


“The only variables in the testing should be those controlling the SUT itself”

The whole point here is that the SUT (VNF in the discussion in the document) is not isolated from an environment in the case of NFV. The environment, that I call “test environment” in the document, in the case of a VNF under test, is the NVFI and MANO. You can’t test the VNF without those components being present, so the only thing you can do is to control the test environment (MANO + NFVI) such that it is constant. You should only modify configurations related to the SUT (VNF in this case). This is a major difference with PNF testing, and that’s been acknowledged in other bodies as well (ETSI NFV for example)

the workload type the expected VNF will be => … the workload type the expected VNF will be characterized by [?]

A VNF will have a certain workload type. It will be control plane, or packet forwarding, or encryption, for example. The point is to identify the nature of the workload, in order to determine the metrics that should be measured in a performance test of the NFVI. That will become the characterization metrics. That’s the thought process. That will become the metrics used for NFVI characterization

Thanks,

Pierre




On Jun 9, 2017, at 9:41 AM, Dirk.von-Hugo@telekom.de<mailto:Dirk.von-Hugo@telekom.de> wrote:

Dear authors, all
I have read the 05 version and think the document is nearly ready for publication – provided some nits are corrected and clarifications addressed. In the following I tried to not repeat what has already been said earlier – sorry in case I didn’t succeed ;-/

p.3:
load- aware => load-aware

p.7:
requires of complex => requires complex

p.10:
In addition to the these interactions => In addition to these interactions
with each oter? etc. => with each other? etc.

p.15:
SR-IOV, NUMA, DPDK, etc : Should the acronyms be explained?

p.18:
looked as well. => looked at as well.

p.19:

a battery life thousands of times longer compared to => a battery life time exceeding by a factor of thousands that of
if this new market provides performance that are adequate with => if the new business model enables performance that meets  [?]
The widespread of system and network virtualization technologies => The widespread use/discussion/practice of system and network virtualization technologies
is responsible of the reliability => is responsible for the reliability

p.20:
situations in which an VNO requires => situations in which a VNO requires
protocol proposed by the WEBPUSH WG => add reference here: [RFC8030] ?
to rely on specific adatpation mechanisms => to rely on specific adaptation mechanisms
An specific example can be => A specific example can be

p.21:
network, not necessary on the direct data path => network, not necessarily on the direct data path

p.23:
administrative domain controlled by an operator => administrative domain controlled by (exactly) one operator
Especially, if each data center is protected => This holds true/this is the case in particular, if each data center is protected [no complete sentence otherwise IMO]

p.25:
IMO most of the text is true in any test case and very general (not VNF specific) as “The only variables in the testing should be those controlling the SUT itself”
… the workload type the expected VNF will be => … the workload type the expected VNF will be characterized by [?]

p.26:
collection of new functionality / set of functionality => collection of new functionalities / set of functionalities [?]

Thanks and Best Regards
Dirk
From: Nfvrg [mailto:nfvrg-bounces@irtf.org<mailto:nfvrg-bounces@irtf.org>] On Behalf Of Diego R. Lopez
Sent: 28 April 2017 18:14
To: nfvrg@irtf.org<mailto:nfvrg@irtf.org>
Subject: [Nfvrg] Research Group Preparation (a.k.a. "Last Call") for draft-irtf-nfvrg-gaps-network-virtualization

Hi,

As discussed and agreed in our meeting in Chicago, this message is to open the equivalent of a last-call for our draft on NFV research challenges (https://datatracker.ietf.org/doc/draft-irtf-nfvrg-gaps-network-virtualization/<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdatatracker.ietf.org%2Fdoc%2Fdraft-irtf-nfvrg-gaps-network-virtualization%2F&data=02%7C01%7Cplynch%40ixiacom.com%7C5581fbf76d1b46fa785608d4af3d4f83%7C069fd614e3f843728e18cd06724a9b23%7C0%7C0%7C636326125245796125&sdata=eF1jz8quEahMoOz7ximuQNUnyijVV5e3OTXsxUVeqxI%3D&reserved=0>)mp;reserved=0>). Note I use the term “equivalent to last-call”, as the IRTF process described in RFC 5743 uses the term “Research Group Preparation”. Let me remind you the summarized IRTF process as described in RFC 5743:

   o  The Research Group (RG) performs a thorough technical and

      editorial review of the document and agrees it should be

      published.



   o  The Internet Research Steering Group (IRSG) reviews the document

      and approves it for publication.

   o  The Internet Engineering Steering Group (IESG) reviews the

      document to assure that there are no conflicts with current or

      expected standardization activities.



   o  The document is submitted to the RFC Editor for publication.

So we are starting the first step above, and all of you are encouraged to review the document and share your comments and opinions about moving it forward towards publication. Since it is advisable to put a deadline for this kind of process, let’s go for a one month period, that is until the 28th May.

Be goode,

--
"Esta vez no fallaremos, Doctor Infierno"

Dr Diego R. Lopez
Telefonica I+D
http://people.tid.es/diego.lopez/<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpeople.tid.es%2Fdiego.lopez%2F&data=02%7C01%7Cplynch%40ixiacom.com%7C5581fbf76d1b46fa785608d4af3d4f83%7C069fd614e3f843728e18cd06724a9b23%7C0%7C0%7C636326125245796125&sdata=xsx%2FvnNmakAKBz8ZLkjxDZH8KrUbeyx5SMOvVeFm0jg%3D&reserved=0>

e-mail: diego.r.lopez@telefonica.com<mailto:diego.r.lopez@telefonica.com>
Tel:    +34 913 129 041<tel:+34%20913%2012%2090%2041>
Mobile: +34 682 051 091<tel:+34%20682%2005%2010%2091>
----------------------------------

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição

_______________________________________________
Nfvrg mailing list
Nfvrg@irtf.org<mailto:Nfvrg@irtf.org>
https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.irtf.org%2Fmailman%2Flistinfo%2Fnfvrg&data=02%7C01%7Cplynch%40ixiacom.com%7C5581fbf76d1b46fa785608d4af3d4f83%7C069fd614e3f843728e18cd06724a9b23%7C0%7C0%7C636326125245796125&sdata=jyCuF53c6tAQ868ykzif6HZNEascCJgUfQSQ2S6wmHs%3D&reserved=0