Re: REVISED Last Call: <draft-ietf-pwe3-vccv-impl-survey-results-02.txt> (The Pseudowire (PW) & Virtual Circuit Connectivity Verification (VCCV) Implementation Survey Results) to Informational RFC

"Andrew G. Malis" <agmalis@gmail.com> Thu, 05 September 2013 17:22 UTC

Return-Path: <agmalis@gmail.com>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id CADAD11E81DD; Thu, 5 Sep 2013 10:22:10 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.599
X-Spam-Level:
X-Spam-Status: No, score=-2.599 tagged_above=-999 required=5 tests=[AWL=0.000, BAYES_00=-2.599, HTML_MESSAGE=0.001, NO_RELAYS=-0.001]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id dvWU9ROtq-lX; Thu, 5 Sep 2013 10:22:09 -0700 (PDT)
Received: from mail-we0-x22c.google.com (mail-we0-x22c.google.com [IPv6:2a00:1450:400c:c03::22c]) by ietfa.amsl.com (Postfix) with ESMTP id 3170311E81C7; Thu, 5 Sep 2013 10:22:08 -0700 (PDT)
Received: by mail-we0-f172.google.com with SMTP id w61so935396wes.17 for <multiple recipients>; Thu, 05 Sep 2013 10:22:08 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=zUmAdQ2VTlTwzYes2kJ31kORNXSWp+DQ7N1T0Wneaxk=; b=XJfccs7iEGbEmAhXC9loNx8u6HevMrQQ0aB08praDzcS+RtkyE24C9Wfc7b3UZ5Lge M1DUjt0DOLX7xx3gn4MfujqT8rIu6G3ET1TTzATjPEZQHkumS8MTRFV3pfO7L9ChkhJb 3T/hjWzNXL5efge0sBTDB0S176+KcVzDoslhPD04vlNM4yoWg27yDdWUlOPhMqZ4lqi+ vY+VukLfcZlw2WrCyfmkVqXTJZEmcfQhhWn5YbgtDNXcAmBzKMPcjtHXYijIg7BsY716 ZyuD7hWZhMDOfzSPq6cJmlmd5ZuiVqAHNRTLeuEO3SelQws5BErlL++HDIYxEnOMSuej MGHA==
X-Received: by 10.180.184.107 with SMTP id et11mr7231012wic.60.1378401728365; Thu, 05 Sep 2013 10:22:08 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.216.255.20 with HTTP; Thu, 5 Sep 2013 10:21:48 -0700 (PDT)
In-Reply-To: <CADnDZ8-5qFgDNDT8r4Aheot_u-wR25KV8-wpOppukhTO2ejW=g@mail.gmail.com>
References: <20130904123609.1411.82860.idtracker@ietfa.amsl.com> <CADnDZ8-5qFgDNDT8r4Aheot_u-wR25KV8-wpOppukhTO2ejW=g@mail.gmail.com>
From: "Andrew G. Malis" <agmalis@gmail.com>
Date: Thu, 05 Sep 2013 13:21:48 -0400
Message-ID: <CAA=duU2X5noRAFs8fyJTkW4h7vUPbVtb2eJb3Y+xeiTVYbeAqA@mail.gmail.com>
Subject: Re: REVISED Last Call: <draft-ietf-pwe3-vccv-impl-survey-results-02.txt> (The Pseudowire (PW) & Virtual Circuit Connectivity Verification (VCCV) Implementation Survey Results) to Informational RFC
To: Abdussalam Baryun <abdussalambaryun@gmail.com>
Content-Type: multipart/alternative; boundary="001a11c227ee60897a04e5a62976"
Cc: IETF Discussion <ietf@ietf.org>, IESG <iesg@ietf.org>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/ietf>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 05 Sep 2013 17:22:11 -0000

Abdussalam,

Many thanks for your review and comments on the draft. I have some answers
inline.

On Wed, Sep 4, 2013 at 10:24 PM, Abdussalam Baryun <
abdussalambaryun@gmail.com> wrote:

> The Reviewer: Abdussalam Baryun
> Date: 05.09.2013
> I-D name: draft-ietf-pwe3-vccv-impl-survey-results
> Received your Request dated 04.09.2013
> ++++++++++++++++++++++++++
>
> The reviewer supports the draft subject to amendments. Overall the
> survey is not easy to be used as source of information related to such
> technology users, but easier as source of information related to
> respondings of companies.
>
> AB> I prefer the title to start as: A Survey of ..........
>

Andy> The draft is reporting the results of the survey, rather than being
the survey, so the title couldn't start as you suggested. A possibility
could be "The Results of a Survey on Pseudowire (PW) & Virtual Circuit
Connectivity Verification (VCCV) Implementations", but I think the existing
title is more concise.

Abstract> This survey of the PW/VCCV user community was conducted to
> determine implementation trends. The survey and results is presented
> herein.
>
> AB> How did the survey determine implementations related to users (are
> they general known or uknown or chosen by authors...etc). What kind of
> results?
>

Andy> The survey was of service providers deploying pseudowires and VCCV.
The "users", in this case, are service providers.


> AB> the abstract starts interesting but ends making the results not
> clear what it was (good, reasonable, expected, positive, had
> conclusions..etc)?
> AB> The draft states that it has no conclusion, because it is not
> intended for that but to help in knowing results to help in other
> future drafts. However, the abstract mentions that the survey
> conducted to determine (not understood how to determine without
> conclusions or analysis).
>

Andy> It wasn't the job of the people conducting the survey to draw
conclusions from the results, it was for them to report the results so that
the working group could collectively draw conclusions in their ongoing
work. At the time, the WG needed information on which combinations of PW
and VCCV options were actually in use, and the survey was used to collect
that information.


> Introduction>
> In order to assess the best approach to address the observed
> interoperability issues, the PWE3 working group decided to solicit
> feedback from the PW and VCCV user community regarding
> implementation.  This document presents the survey and the
> information returned by the user community who participated.
>
> AB> the introduction needs to show the importance of the survey, or
> what makes such decision from the WG (i.e. seems like the WG has not
> cover all types of community, not sure)?
> AB> Why did the WG decide the survey by using questionnair?
>

Andy> The part of the Introduction on page 3 provides the background,
rationale, and importance of the survey. We used a questionnaire as that
form of survey is easiest for the respondents and allowed us to use
SurveyMonkey to conduct the survey.


> AB> suggest amending> the document presents the questionnair form
> questions and information returned ......
>

Andy> We could change the sentence to say "This document presents the
survey questionnaire and the information returned by the user community who
participated."


> Sections 1.1 1.2 and 1.3>
> ......questions based on direction of the WG chairs......
> There were seventeen responses to the survey that met the validity
> requirements in
> Section 3.  The responding companies are listed below in Section 2.1.
>
> AB> Why were thoes methodologies and why that way of quetions chosen
> for this survey? The answer to this is important for the document
> (informational) and future drafts.
>

Andy> While the survey questions were originally suggested by the WG
chairs, they were written by the survey authors and reviewed by the WG
prior to the collection of results. We could add that if you like.


> AB> The reason of the survey's methodology should be mentioned in
> clear section,  as the athors' opinion.
>
> Section 1.2> Form>
> Why the form did not make security consideration related to
> implementations in the form questions? which then may be used in
> security section.
>

Andy> Because security information wasn't the subject of the survey.


> Results section 2>
> AB> are difficult to read or find related to section 1.2.
> AB> Usually the section mixes between what was returned and what was
> given. It is prefered to have two separate sections as 1 (what was
> given including the form), and what was returned as results.
>

The questions are in section 1.2, and the results are in section 2.


> Regards
> AB
>

Thanks again,
Andy