Re: [Gen-art] Genart last call review of draft-ietf-netvc-testing-08
Alissa Cooper <alissa@cooperw.in> Wed, 12 June 2019 18:08 UTC
Return-Path: <alissa@cooperw.in>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E1208120158; Wed, 12 Jun 2019 11:08:37 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.701
X-Spam-Level:
X-Spam-Status: No, score=-2.701 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=cooperw.in header.b=uKaN0JQh; dkim=pass (2048-bit key) header.d=messagingengine.com header.b=elHX1WIV
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Zyrt4DlZUipk; Wed, 12 Jun 2019 11:08:34 -0700 (PDT)
Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 513E6120075; Wed, 12 Jun 2019 11:08:31 -0700 (PDT)
Received: from compute7.internal (compute7.nyi.internal [10.202.2.47]) by mailout.nyi.internal (Postfix) with ESMTP id 472B721EA0; Wed, 12 Jun 2019 14:08:30 -0400 (EDT)
Received: from mailfrontend2 ([10.202.2.163]) by compute7.internal (MEProxy); Wed, 12 Jun 2019 14:08:30 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cooperw.in; h= content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; s=fm3; bh=5 GDXPLUEuO81OzbWr68S2GJWhdAYBgp7i5C5FIZQPFw=; b=uKaN0JQhLgnb05buT aCAAc1VvgAxAVBPxvdLd7KYHCTCCb/52dMPycQy9gygDu9ixOB67BwCWRqNCsgv7 6CH4msdl1VVzLjnLfrgAN+TZGFOQPLHDcncH9dhSAfw1wLXS38msMO2w1G5ImQQ/ xP21AcfgMXTo71zVi8xdLzYxAWojwTb2bLrS9aLWM9vLiOz71sQpWwqjsB46io+6 khcmue6EJ/mVf++kg+Miid4J+/CAp9s90nEvf1PHhvomh9J/wU9vM8OazLTq9zGL xBQSXebHyLVjxdUH19DWUmwVNUFisWiIiAcYeDinjonbB30roYTylibHw45sJkPN u+ZRA==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; bh=5GDXPLUEuO81OzbWr68S2GJWhdAYBgp7i5C5FIZQP Fw=; b=elHX1WIVHtyenTcMdp1Ft46kD3tkkLC89pA/OI5rgQwe9cQyr3NbGdhud wD/SL30Ng1HibP8JKL8XMBCIEaX4fk1cCtMVWMsdydVKMAEQOYOScOFqXlGv7Iwx iHWegOOVy8eacUL6dGv6d/h1jbddLBw9KkWSG5bmUkseZbZDxhEqvKq68OP1Bzae I86lDWxSWd7BTeMrTIGVUHLvunIRxp/dvDvUG5wmPNsQln0J4918n0WpRf/4f1wZ vISqQTcEZpTCB6nGGFobMk3dMnYiDqcPPPEtiZIhUYODzqcbt9wiLlPV7vIOmgMw WquxnLiY+UHgbGfEsyWlb721Z5oQQ==
X-ME-Sender: <xms:nT8BXXqpaKVX3gUbGnMSlBv2dbI_ht4EEG_LzeF3GBn1CmJtT7pSYw>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduuddrudehjedguddvjecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmd enucfjughrpegtggfuhfgjfffgkfhfvffosehtqhhmtdhhtddvnecuhfhrohhmpeetlhhi shhsrgcuvehoohhpvghruceorghlihhsshgrsegtohhophgvrhifrdhinheqnecuffhomh grihhnpehivghtfhdrohhrghenucfkphepudelledrudekjedrvdduledrfeelnecurfgr rhgrmhepmhgrihhlfhhrohhmpegrlhhishhsrgestghoohhpvghrfidrihhnnecuvehluh hsthgvrhfuihiivgeptd
X-ME-Proxy: <xmx:nT8BXeQQ6LoVmauB4nBlqEPodRAEPoBxqzpZw_1xGrzGqAfjKsxyqw> <xmx:nT8BXaluTALcBDKA9bkWGbfKdnUvbH67Igm4HyLRRxlxrFz0HS8jUA> <xmx:nT8BXUyKUBXXzleMETcanl2_DIf0XvWAPWJ8o2iLx2roEqKysxJbvw> <xmx:nj8BXUzlzvVB2U0o67SVC_NE1d57cKV1BBlmtk3I0nQOs_XGkYyuTQ>
Received: from static-219-39.meetings.nanog.org (unknown [199.187.219.39]) by mail.messagingengine.com (Postfix) with ESMTPA id 72E5038008D; Wed, 12 Jun 2019 14:08:29 -0400 (EDT)
Content-Type: text/plain; charset="us-ascii"
Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\))
Subject: Re: [Gen-art] Genart last call review of draft-ietf-netvc-testing-08
From: Alissa Cooper <alissa@cooperw.in>
In-Reply-To: <155956316822.24369.4530339060904691343@ietfa.amsl.com>
Date: Wed, 12 Jun 2019 14:08:28 -0400
Cc: IETF Gen-ART <gen-art@ietf.org>, draft-ietf-netvc-testing.all@ietf.org, video-codec@ietf.org, ietf@ietf.org
Content-Transfer-Encoding: quoted-printable
Message-Id: <13A74BDC-D5CB-4516-878F-098673E15641@cooperw.in>
References: <155956316822.24369.4530339060904691343@ietfa.amsl.com>
To: Francesca Palombini <francesca.palombini@ericsson.com>
X-Mailer: Apple Mail (2.3445.9.1)
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/GLo0TxSkhgUHpeZFN9uuqRGA60o>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 12 Jun 2019 18:08:38 -0000
Francesca, thanks for your review. I entered a DISCUSS ballot to get IANA considerations and security considerations added. Alissa > On Jun 3, 2019, at 7:59 AM, Francesca Palombini via Datatracker <noreply@ietf.org> wrote: > > Reviewer: Francesca Palombini > Review result: Ready with Nits > > I am the assigned Gen-ART reviewer for this draft. The General Area > Review Team (Gen-ART) reviews all IETF documents being processed > by the IESG for the IETF Chair. Please treat these comments just > like any other last call comments. > > For more information, please see the FAQ at > > <https://trac.ietf.org/trac/gen/wiki/GenArtfaq>. > > Document: draft-ietf-netvc-testing-08 > Reviewer: Francesca Palombini > Review Date: 2019-06-02 > IETF LC End Date: 2019-06-04 > IESG Telechat date: Not scheduled for a telechat > > Summary: This draft is basically ready for publication, but has nits that > should be fixed before publication. > > Major issues: N/A > > Minor issues: N/A > > Nits/editorial comments: > > * The document is missing the IANA section and Security Considerations section. > Although they do not apply (as the shepherd noted), these sections are > required. (See https://tools.ietf.org/html/rfc7322#section-4.8.5 and > https://tools.ietf.org/html/rfc7322#section-4.8.3) > > * Outdated reference: A later version (-09) exists of > draft-ietf-netvc-requirements-08 > > All following comments are suggestions that would have helped a non-expert > reader (feel free to disregard): > > * Section 2 - Subjective testing is mentioned in the first sentence with no > introduction. Although quite clear, a short definition or a reference to > literature would have been helpful. > > * Section 2, second to last paragraph - The text is somewhat not well > formulated. "... even if the group agrees that a particular test is > important... then the test should be discarded. This ensures that only > important tests be done; in particular, the tests that are important to > participants" I understand that the paragraph was meant to underline the > necessity of selecting tests that participants can/will complete in a timely > fashion. But the formulation is not great: the group agrees on a particular > test is important, but if it is not completed it is not important? > > * There are several acronym across the document that could have been expanded > on first use, or used a reference to the definition: PMF, PSNR, PSNR-HVS-M, CQP > > * Section 3.7 - "This metric is focused on quality degradation due compression > and rescaling" missing "to" > > * Section 5.2 - It would have been good to explicitly write out here what the > parenthesis after each test indicates (resolution, bit depth, etc) > > * Section 5.2.2 - "High bit depth" could you quantify more precisely what high > is here? > > * Section 5.2.4 and 5.2.5 - Does "old version" mean this should be seen as > deprecated? > > (Please keep my address in the To: field if you want to make sure I see any > response to this thread) > > Thanks, > Francesca > > _______________________________________________ > Gen-art mailing list > Gen-art@ietf.org > https://www.ietf.org/mailman/listinfo/gen-art
- Genart last call review of draft-ietf-netvc-testi… Francesca Palombini via Datatracker
- Re: [Gen-art] Genart last call review of draft-ie… Alissa Cooper