Re: [Gen-art] Genart last call review of draft-ietf-netvc-testing-08

Alissa Cooper <alissa@cooperw.in> Wed, 12 June 2019 18:08 UTC

Return-Path: <alissa@cooperw.in>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E1208120158; Wed, 12 Jun 2019 11:08:37 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.701
X-Spam-Level:
X-Spam-Status: No, score=-2.701 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=cooperw.in header.b=uKaN0JQh; dkim=pass (2048-bit key) header.d=messagingengine.com header.b=elHX1WIV
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Zyrt4DlZUipk; Wed, 12 Jun 2019 11:08:34 -0700 (PDT)
Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 513E6120075; Wed, 12 Jun 2019 11:08:31 -0700 (PDT)
Received: from compute7.internal (compute7.nyi.internal [10.202.2.47]) by mailout.nyi.internal (Postfix) with ESMTP id 472B721EA0; Wed, 12 Jun 2019 14:08:30 -0400 (EDT)
Received: from mailfrontend2 ([10.202.2.163]) by compute7.internal (MEProxy); Wed, 12 Jun 2019 14:08:30 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cooperw.in; h= content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; s=fm3; bh=5 GDXPLUEuO81OzbWr68S2GJWhdAYBgp7i5C5FIZQPFw=; b=uKaN0JQhLgnb05buT aCAAc1VvgAxAVBPxvdLd7KYHCTCCb/52dMPycQy9gygDu9ixOB67BwCWRqNCsgv7 6CH4msdl1VVzLjnLfrgAN+TZGFOQPLHDcncH9dhSAfw1wLXS38msMO2w1G5ImQQ/ xP21AcfgMXTo71zVi8xdLzYxAWojwTb2bLrS9aLWM9vLiOz71sQpWwqjsB46io+6 khcmue6EJ/mVf++kg+Miid4J+/CAp9s90nEvf1PHhvomh9J/wU9vM8OazLTq9zGL xBQSXebHyLVjxdUH19DWUmwVNUFisWiIiAcYeDinjonbB30roYTylibHw45sJkPN u+ZRA==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; bh=5GDXPLUEuO81OzbWr68S2GJWhdAYBgp7i5C5FIZQP Fw=; b=elHX1WIVHtyenTcMdp1Ft46kD3tkkLC89pA/OI5rgQwe9cQyr3NbGdhud wD/SL30Ng1HibP8JKL8XMBCIEaX4fk1cCtMVWMsdydVKMAEQOYOScOFqXlGv7Iwx iHWegOOVy8eacUL6dGv6d/h1jbddLBw9KkWSG5bmUkseZbZDxhEqvKq68OP1Bzae I86lDWxSWd7BTeMrTIGVUHLvunIRxp/dvDvUG5wmPNsQln0J4918n0WpRf/4f1wZ vISqQTcEZpTCB6nGGFobMk3dMnYiDqcPPPEtiZIhUYODzqcbt9wiLlPV7vIOmgMw WquxnLiY+UHgbGfEsyWlb721Z5oQQ==
X-ME-Sender: <xms:nT8BXXqpaKVX3gUbGnMSlBv2dbI_ht4EEG_LzeF3GBn1CmJtT7pSYw>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduuddrudehjedguddvjecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmd enucfjughrpegtggfuhfgjfffgkfhfvffosehtqhhmtdhhtddvnecuhfhrohhmpeetlhhi shhsrgcuvehoohhpvghruceorghlihhsshgrsegtohhophgvrhifrdhinheqnecuffhomh grihhnpehivghtfhdrohhrghenucfkphepudelledrudekjedrvdduledrfeelnecurfgr rhgrmhepmhgrihhlfhhrohhmpegrlhhishhsrgestghoohhpvghrfidrihhnnecuvehluh hsthgvrhfuihiivgeptd
X-ME-Proxy: <xmx:nT8BXeQQ6LoVmauB4nBlqEPodRAEPoBxqzpZw_1xGrzGqAfjKsxyqw> <xmx:nT8BXaluTALcBDKA9bkWGbfKdnUvbH67Igm4HyLRRxlxrFz0HS8jUA> <xmx:nT8BXUyKUBXXzleMETcanl2_DIf0XvWAPWJ8o2iLx2roEqKysxJbvw> <xmx:nj8BXUzlzvVB2U0o67SVC_NE1d57cKV1BBlmtk3I0nQOs_XGkYyuTQ>
Received: from static-219-39.meetings.nanog.org (unknown [199.187.219.39]) by mail.messagingengine.com (Postfix) with ESMTPA id 72E5038008D; Wed, 12 Jun 2019 14:08:29 -0400 (EDT)
Content-Type: text/plain; charset="us-ascii"
Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\))
Subject: Re: [Gen-art] Genart last call review of draft-ietf-netvc-testing-08
From: Alissa Cooper <alissa@cooperw.in>
In-Reply-To: <155956316822.24369.4530339060904691343@ietfa.amsl.com>
Date: Wed, 12 Jun 2019 14:08:28 -0400
Cc: IETF Gen-ART <gen-art@ietf.org>, draft-ietf-netvc-testing.all@ietf.org, video-codec@ietf.org, ietf@ietf.org
Content-Transfer-Encoding: quoted-printable
Message-Id: <13A74BDC-D5CB-4516-878F-098673E15641@cooperw.in>
References: <155956316822.24369.4530339060904691343@ietfa.amsl.com>
To: Francesca Palombini <francesca.palombini@ericsson.com>
X-Mailer: Apple Mail (2.3445.9.1)
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/GLo0TxSkhgUHpeZFN9uuqRGA60o>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 12 Jun 2019 18:08:38 -0000

Francesca, thanks for your review. I entered a DISCUSS ballot to get IANA considerations and security considerations added.

Alissa

> On Jun 3, 2019, at 7:59 AM, Francesca Palombini via Datatracker <noreply@ietf.org> wrote:
> 
> Reviewer: Francesca Palombini
> Review result: Ready with Nits
> 
> I am the assigned Gen-ART reviewer for this draft. The General Area
> Review Team (Gen-ART) reviews all IETF documents being processed
> by the IESG for the IETF Chair.  Please treat these comments just
> like any other last call comments.
> 
> For more information, please see the FAQ at
> 
> <https://trac.ietf.org/trac/gen/wiki/GenArtfaq>.
> 
> Document: draft-ietf-netvc-testing-08
> Reviewer: Francesca Palombini
> Review Date: 2019-06-02
> IETF LC End Date: 2019-06-04
> IESG Telechat date: Not scheduled for a telechat
> 
> Summary: This draft is basically ready for publication, but has nits that
> should be fixed before publication.
> 
> Major issues: N/A
> 
> Minor issues: N/A
> 
> Nits/editorial comments:
> 
> * The document is missing the IANA section and Security Considerations section.
> Although they do not apply (as the shepherd noted), these sections are
> required. (See https://tools.ietf.org/html/rfc7322#section-4.8.5 and
> https://tools.ietf.org/html/rfc7322#section-4.8.3)
> 
> * Outdated reference: A later version (-09) exists of
> draft-ietf-netvc-requirements-08
> 
> All following comments are suggestions that would have helped a non-expert
> reader (feel free to disregard):
> 
> * Section 2 - Subjective testing is mentioned in the first sentence with no
> introduction. Although quite clear, a short definition or a reference to
> literature would have been helpful.
> 
> * Section 2, second to last paragraph - The text is somewhat not well
> formulated. "... even if the group agrees that a particular test is
> important... then the test should be discarded. This ensures that only
> important tests be done; in particular, the tests that are important to
> participants" I understand that the paragraph was meant to underline the
> necessity of selecting tests that participants can/will complete in a timely
> fashion. But the formulation is not great: the group agrees on a particular
> test is important, but if it is not completed it is not important?
> 
> * There are several acronym across the document that could have been expanded
> on first use, or used a reference to the definition: PMF, PSNR, PSNR-HVS-M, CQP
> 
> * Section 3.7 - "This metric is focused on quality degradation due compression
> and rescaling" missing "to"
> 
> * Section 5.2 - It would have been good to explicitly write out here what the
> parenthesis after each test indicates (resolution, bit depth, etc)
> 
> * Section 5.2.2 - "High bit depth" could you quantify more precisely what high
> is here?
> 
> * Section 5.2.4 and 5.2.5 - Does "old version" mean this should be seen as
> deprecated?
> 
> (Please keep my address in the To: field if you want to make sure I see any
> response to this thread)
> 
> Thanks,
> Francesca
> 
> _______________________________________________
> Gen-art mailing list
> Gen-art@ietf.org
> https://www.ietf.org/mailman/listinfo/gen-art