Re: [Gen-art] Gen-ART LC review of draft-ietf-bmwg-issu-meth-01

"Roni Even" <ron.even.tlv@gmail.com> Thu, 02 July 2015 04:50 UTC

Return-Path: <ron.even.tlv@gmail.com>
X-Original-To: gen-art@ietfa.amsl.com
Delivered-To: gen-art@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D6DDE1B2E52; Wed, 1 Jul 2015 21:50:02 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.999
X-Spam-Level:
X-Spam-Status: No, score=-1.999 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7YnSRfm2afDF; Wed, 1 Jul 2015 21:50:00 -0700 (PDT)
Received: from mail-wg0-x229.google.com (mail-wg0-x229.google.com [IPv6:2a00:1450:400c:c00::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4D9DE1B2E51; Wed, 1 Jul 2015 21:50:00 -0700 (PDT)
Received: by wgck11 with SMTP id k11so52732118wgc.0; Wed, 01 Jul 2015 21:49:59 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:to:cc:references:in-reply-to:subject:date:message-id :mime-version:content-type:thread-index:content-language; bh=yC6us122tyXSb4QFLv91RGGKpwXtEkJ3bx3oqLn/lfw=; b=wel8ULKAThxReFmE0bnboxTgYuORq+/3olHfmAqFGWcnI1+xLPEI0P00en8vwNrmOT hDWrf38J52W7l/4ILDkQnznZUng+XNnOoGkZhdTn+eZ+XTW2pMS1u4tOOB7W428M/zZV DzR7QY6dPS43Dx9mwnFZsq5M15Ed7yVXCe3IL/StGgh/xd0RKX6oBwFxivooVwV0p6Uz gMkppJNu19z1NBp26cLJMPVg8a1/DR7R/gMi3Z9H5vm+FCvXkaSf6kFC9vEK72y6IFxw PpA6LyXDOWmfGU9Jz912htmsd/s+2qEncQ5VoCWvm2px0fJmdMaVHsDuMBt2TqxX26RB cpyw==
X-Received: by 10.180.208.7 with SMTP id ma7mr51985610wic.0.1435812599037; Wed, 01 Jul 2015 21:49:59 -0700 (PDT)
Received: from RoniE (bzq-79-182-9-168.red.bezeqint.net. [79.182.9.168]) by mx.google.com with ESMTPSA id ck18sm5913666wjb.47.2015.07.01.21.49.56 (version=TLSv1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Wed, 01 Jul 2015 21:49:58 -0700 (PDT)
From: Roni Even <ron.even.tlv@gmail.com>
To: 'Sarah Banks' <sbanks@encrypted.net>
References: <0d5201d0b428$1b604590$5220d0b0$@gmail.com> <31168F63-A7E7-4223-8405-ABA2C42E3A68@encrypted.net>
In-Reply-To: <31168F63-A7E7-4223-8405-ABA2C42E3A68@encrypted.net>
Date: Thu, 02 Jul 2015 07:49:54 +0300
Message-ID: <0d7e01d0b482$8ba21db0$a2e65910$@gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="----=_NextPart_000_0D7F_01D0B49B.B0F06720"
X-Mailer: Microsoft Outlook 14.0
Thread-Index: AQM8lNkFqv6PrNJwyUcNq6TP3Mup+AGU4N6CmuMyKwA=
Content-Language: en-us
Archived-At: <http://mailarchive.ietf.org/arch/msg/gen-art/LkraX9JEmHBZsg3tL5FXHPJ5rJ0>
Cc: gen-art@ietf.org, draft-ietf-bmwg-issu-meth.all@tools.ietf.org, ietf@ietf.org
Subject: Re: [Gen-art] Gen-ART LC review of draft-ietf-bmwg-issu-meth-01
X-BeenThere: gen-art@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "GEN-ART: General Area Review Team" <gen-art.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/gen-art>, <mailto:gen-art-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/gen-art/>
List-Post: <mailto:gen-art@ietf.org>
List-Help: <mailto:gen-art-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/gen-art>, <mailto:gen-art-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 02 Jul 2015 04:50:03 -0000

Hi Sarah,

What you are saying make sense and I see no problem with having guidelines for a report for the manufacturers. In my view the content of such report will be defined by service providers as part of their product evaluation, so the full list can serve them as a check list for defining their preferred report.

Regards

Roni

 

From: Sarah Banks [mailto:sbanks@encrypted.net] 
Sent: 01 July, 2015 10:29 PM
To: Roni Even
Cc: draft-ietf-bmwg-issu-meth.all@tools.ietf.org; ietf@ietf.org; gen-art@ietf.org
Subject: Re: Gen-ART LC review of draft-ietf-bmwg-issu-meth-01

 

Hi Roni,

          Thanks for your review of the draft, and comments below. With regards to the lack of any specific procedure, the idea was to provide several procedures, and allow the tester to choose, based on their testing needs/topology/etc. However, once a test has been chosen, we felt it best to have SOMETHING defined as required output, otherwise, how would you be able to compare ISSU results across vendors, apples to apples? To that end, we specified a short list of required info for the report, and then a longer list of optional information to include. So part of the info is required, and part isn't, and since part is, we chose to describe both in normative language. Does this make sense?

 

Thanks

Sarah

 

On Jul 1, 2015, at 11:02 AM, Roni Even <ron.even.tlv@gmail.com> wrote:

 

I am the assigned Gen-ART reviewer for this draft. For background on Gen-ART, please see the FAQ at < <http://wiki.tools.ietf.org/area/gen/trac/wiki/GenArtfaq> http://wiki.tools.ietf.org/area/gen/trac/wiki/GenArtfaq>.

Please resolve these comments along with any other Last Call comments you may receive.

Document:  draft-ietf-bmwg-issu-meth-01
Reviewer: Roni Even

Review Date: 2015–7-1

IETF LC End Date: 2015–7-2

IESG Telechat date: 

 

Summary: This draft is ready for publication as an Informational  RFC.

 

 

Major issues:

 

Minor issues:

 

According to the abstract this document specifies a set of common methodologies and procedures designed to characterize the overall behavior of a Device Under Test (DUT), subject to an ISSU event. My reading is that it captures the typical procedures and as such is an informational document. It does not recommend any specific procedure yet it RECOMMEND in section 7 defines normative recommendation of which parameters SHOULD be reported in what I understand is a written statement.  I was wondering if all parameters are needed and when you can report only part of them , maybe just make it non normative 

 

Nits/editorial comments: