Re: [Nfvrg] Research Group Preparation (a.k.a. "Last Call") for draft-irtf-nfvrg-gaps-network-virtualization

<Dirk.von-Hugo@telekom.de> Wed, 28 June 2017 07:14 UTC

Return-Path: <prvs=345c55d1b=Dirk.von-Hugo@telekom.de>
X-Original-To: nfvrg@ietfa.amsl.com
Delivered-To: nfvrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id EC9E312EB9B for <nfvrg@ietfa.amsl.com>; Wed, 28 Jun 2017 00:14:29 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.331
X-Spam-Level:
X-Spam-Status: No, score=-2.331 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=1.989, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=telekom.de
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Szyd5DjPytGx for <nfvrg@ietfa.amsl.com>; Wed, 28 Jun 2017 00:14:25 -0700 (PDT)
Received: from mailout34.telekom.de (MAILOUT34.telekom.de [80.149.113.196]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 996B012EB8E for <nfvrg@irtf.org>; Wed, 28 Jun 2017 00:14:23 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telekom.de; i=@telekom.de; q=dns/txt; s=dtag1; t=1498634064; x=1530170064; h=from:to:cc:subject:date:message-id:references: in-reply-to:mime-version; bh=I+hXXeK616Sw/dVvX5AkGEReuy7StQag7oAQC6Lq+tw=; b=bjQBQYIfi3l7xaeXtpTO3bAjWfj6lI+JyEMLd89NbXtFXuHzWLuBkzmp KOysnFrxvll/GfFDBWY7tAmLsk1puFfJb5otvOTQ7fNOplSLIVn0lhTJE emn+xXJtyNLYl9lJpHmR+/B37V1+JcQ+2Ahdk4NEbBzKa4fmapZh/o4Tw RlnYOs/HR7uyVS94HM7LtjtRPaVxU3Oh/7k/B+dtneJxJOgwNXv9hH/el Oq8+jXwftHNAz3VvJL7YAjuLsEevfzVPqfOh42cQod+Gvm1dyFh0jUnWk iA3IvxyATurgNzD9eMipsOEvXOCy3nrxIlZoL+Z7dvH+4ZJAEgZYdDwSU g==;
Received: from qdezc2.de.t-internal.com ([10.171.255.37]) by MAILOUT31.telekom.de with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 28 Jun 2017 09:14:21 +0200
X-IronPort-AV: E=Sophos;i="5.40,274,1496095200"; d="scan'208,217";a="618083854"
Received: from he105829.emea1.cds.t-internal.com ([10.169.119.32]) by qde0ps.de.t-internal.com with ESMTP/TLS/AES256-SHA; 28 Jun 2017 09:14:21 +0200
Received: from HE105831.EMEA1.cds.t-internal.com (10.169.119.34) by HE105829.emea1.cds.t-internal.com (10.169.119.32) with Microsoft SMTP Server (TLS) id 15.0.1263.5; Wed, 28 Jun 2017 09:14:20 +0200
Received: from HE105831.EMEA1.cds.t-internal.com ([fe80::68a7:ffa4:81be:3178]) by HE105831.emea1.cds.t-internal.com ([fe80::68a7:ffa4:81be:3178%26]) with mapi id 15.00.1263.000; Wed, 28 Jun 2017 09:14:20 +0200
From: <Dirk.von-Hugo@telekom.de>
To: <PLynch@ixiacom.com>
CC: <nfvrg@irtf.org>, <cjbc@it.uc3m.es>
Thread-Topic: [Nfvrg] Research Group Preparation (a.k.a. "Last Call") for draft-irtf-nfvrg-gaps-network-virtualization
Thread-Index: AQHS7y1UPZ7d+IwdIEmAL2MCqINAf6I52xcw
Date: Wed, 28 Jun 2017 07:14:20 +0000
Message-ID: <247cd0665a8f43dfa97519f4bcdca199@HE105831.emea1.cds.t-internal.com>
References: <CAFL1SJQhzK1-jYcJtmv5JYAnXDNybS=mq3qNMsx5Tzk0WyOLDw@mail.gmail.com> <9254b66d9ff84432ab47e61a7858db26@HE105831.emea1.cds.t-internal.com> <86A2B332-790F-4A63-9B2D-E46FE59A4B22@ixiacom.com>
In-Reply-To: <86A2B332-790F-4A63-9B2D-E46FE59A4B22@ixiacom.com>
Accept-Language: de-DE, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-exchange-transport-fromentityheader: Hosted
x-originating-ip: [10.117.17.14]
Content-Type: multipart/alternative; boundary="_000_247cd0665a8f43dfa97519f4bcdca199HE105831emea1cdstintern_"
MIME-Version: 1.0
Archived-At: <https://mailarchive.ietf.org/arch/msg/nfvrg/wkDY1PQT0PBO_etvzYk7dR1Qaa4>
Subject: Re: [Nfvrg] Research Group Preparation (a.k.a. "Last Call") for draft-irtf-nfvrg-gaps-network-virtualization
X-BeenThere: nfvrg@irtf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: "Network Function Virtualization Research Group \(NFVRG\) discussion list" <nfvrg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/nfvrg>, <mailto:nfvrg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nfvrg/>
List-Post: <mailto:nfvrg@irtf.org>
List-Help: <mailto:nfvrg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/nfvrg>, <mailto:nfvrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Wed, 28 Jun 2017 07:14:30 -0000

Dear Pierre,
Thanks for your clarification. If I would have read it more attentively from the beginning I may have not been misled. Perhaps in the first sentence something could be added as: ‘here – in comparison to other situations, as e.g. PNF testing - dedicated effort has to be spent for controlling the test environment (NFVI and MANO) to remain unchanged during the whole test’ ?
The second issue now is also clear. I simply missed the word ‚type‘ … ;-(

Thanks for your helping work!
Best Regards
Dirk

From: Pierre Lynch [mailto:PLynch@ixiacom.com]
Sent: Dienstag, 27. Juni 2017 12:08
To: von Hugo, Dirk
Cc: nfvrg@irtf.org; cjbc@it.uc3m.es
Subject: Re: [Nfvrg] Research Group Preparation (a.k.a. "Last Call") for draft-irtf-nfvrg-gaps-network-virtualization

Hello Dirk,

I am helping Carlos deal with the comments with the section that I wrote (4.10 testing). I’d like to try to understand the comment you made below for page 25. I’ll try to explain what I am trying to say, and maybe we can converge.



p.25:
IMO most of the text is true in any test case and very general (not VNF specific) as “The only variables in the testing should be those controlling the SUT itself”
… the workload type the expected VNF will be => … the workload type the expected VNF will be characterized by [?]


“The only variables in the testing should be those controlling the SUT itself”

The whole point here is that the SUT (VNF in the discussion in the document) is not isolated from an environment in the case of NFV. The environment, that I call “test environment” in the document, in the case of a VNF under test, is the NVFI and MANO. You can’t test the VNF without those components being present, so the only thing you can do is to control the test environment (MANO + NFVI) such that it is constant. You should only modify configurations related to the SUT (VNF in this case). This is a major difference with PNF testing, and that’s been acknowledged in other bodies as well (ETSI NFV for example)

the workload type the expected VNF will be => … the workload type the expected VNF will be characterized by [?]

A VNF will have a certain workload type. It will be control plane, or packet forwarding, or encryption, for example. The point is to identify the nature of the workload, in order to determine the metrics that should be measured in a performance test of the NFVI. That will become the characterization metrics. That’s the thought process. That will become the metrics used for NFVI characterization

Thanks,

Pierre




On Jun 9, 2017, at 9:41 AM, Dirk.von-Hugo@telekom.de<mailto:Dirk.von-Hugo@telekom.de> wrote:

Dear authors, all
I have read the 05 version and think the document is nearly ready for publication – provided some nits are corrected and clarifications addressed. In the following I tried to not repeat what has already been said earlier – sorry in case I didn’t succeed ;-/

p.3:
load- aware => load-aware

p.7:
requires of complex => requires complex

p.10:
In addition to the these interactions => In addition to these interactions
with each oter? etc. => with each other? etc.

p.15:
SR-IOV, NUMA, DPDK, etc : Should the acronyms be explained?

p.18:
looked as well. => looked at as well.

p.19:

a battery life thousands of times longer compared to => a battery life time exceeding by a factor of thousands that of
if this new market provides performance that are adequate with => if the new business model enables performance that meets  [?]
The widespread of system and network virtualization technologies => The widespread use/discussion/practice of system and network virtualization technologies
is responsible of the reliability => is responsible for the reliability

p.20:
situations in which an VNO requires => situations in which a VNO requires
protocol proposed by the WEBPUSH WG => add reference here: [RFC8030] ?
to rely on specific adatpation mechanisms => to rely on specific adaptation mechanisms
An specific example can be => A specific example can be

p.21:
network, not necessary on the direct data path => network, not necessarily on the direct data path

p.23:
administrative domain controlled by an operator => administrative domain controlled by (exactly) one operator
Especially, if each data center is protected => This holds true/this is the case in particular, if each data center is protected [no complete sentence otherwise IMO]

p.25:
IMO most of the text is true in any test case and very general (not VNF specific) as “The only variables in the testing should be those controlling the SUT itself”
… the workload type the expected VNF will be => … the workload type the expected VNF will be characterized by [?]

p.26:
collection of new functionality / set of functionality => collection of new functionalities / set of functionalities [?]

Thanks and Best Regards
Dirk
From: Nfvrg [mailto:nfvrg-bounces@irtf.org<mailto:nfvrg-bounces@irtf.org>] On Behalf Of Diego R. Lopez
Sent: 28 April 2017 18:14
To: nfvrg@irtf.org<mailto:nfvrg@irtf.org>
Subject: [Nfvrg] Research Group Preparation (a.k.a. "Last Call") for draft-irtf-nfvrg-gaps-network-virtualization

Hi,

As discussed and agreed in our meeting in Chicago, this message is to open the equivalent of a last-call for our draft on NFV research challenges (https://datatracker.ietf.org/doc/draft-irtf-nfvrg-gaps-network-virtualization/<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdatatracker.ietf.org%2Fdoc%2Fdraft-irtf-nfvrg-gaps-network-virtualization%2F&data=02%7C01%7Cplynch%40ixiacom.com%7C5581fbf76d1b46fa785608d4af3d4f83%7C069fd614e3f843728e18cd06724a9b23%7C0%7C0%7C636326125245796125&sdata=eF1jz8quEahMoOz7ximuQNUnyijVV5e3OTXsxUVeqxI%3D&reserved=0>)mp;reserved=0>). Note I use the term “equivalent to last-call”, as the IRTF process described in RFC 5743 uses the term “Research Group Preparation”. Let me remind you the summarized IRTF process as described in RFC 5743:

   o  The Research Group (RG) performs a thorough technical and

      editorial review of the document and agrees it should be

      published.



   o  The Internet Research Steering Group (IRSG) reviews the document

      and approves it for publication.

   o  The Internet Engineering Steering Group (IESG) reviews the

      document to assure that there are no conflicts with current or

      expected standardization activities.



   o  The document is submitted to the RFC Editor for publication.
So we are starting the first step above, and all of you are encouraged to review the document and share your comments and opinions about moving it forward towards publication. Since it is advisable to put a deadline for this kind of process, let’s go for a one month period, that is until the 28th May.

Be goode,

--
"Esta vez no fallaremos, Doctor Infierno"

Dr Diego R. Lopez
Telefonica I+D
http://people.tid.es/diego.lopez/<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpeople.tid.es%2Fdiego.lopez%2F&data=02%7C01%7Cplynch%40ixiacom.com%7C5581fbf76d1b46fa785608d4af3d4f83%7C069fd614e3f843728e18cd06724a9b23%7C0%7C0%7C636326125245796125&sdata=xsx%2FvnNmakAKBz8ZLkjxDZH8KrUbeyx5SMOvVeFm0jg%3D&reserved=0>

e-mail: diego.r.lopez@telefonica.com<mailto:diego.r.lopez@telefonica.com>
Tel:    +34 913 129 041<tel:+34%20913%2012%2090%2041>
Mobile: +34 682 051 091<tel:+34%20682%2005%2010%2091>
----------------------------------

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição

_______________________________________________
Nfvrg mailing list
Nfvrg@irtf.org<mailto:Nfvrg@irtf.org>
https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.irtf.org%2Fmailman%2Flistinfo%2Fnfvrg&data=02%7C01%7Cplynch%40ixiacom.com%7C5581fbf76d1b46fa785608d4af3d4f83%7C069fd614e3f843728e18cd06724a9b23%7C0%7C0%7C636326125245796125&sdata=jyCuF53c6tAQ868ykzif6HZNEascCJgUfQSQ2S6wmHs%3D&reserved=0