Re: [IPP] Posted 1.1 release candidate tools

"Kennedy, Smith (Wireless & IPP Standards) via ipp" <ipp@pwg.org> Sat, 16 May 2020 23:08 UTC

Return-Path: <ipp-bounces@pwg.org>
X-Original-To: ietfarch-ipp-archive@ietfa.amsl.com
Delivered-To: ietfarch-ipp-archive@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id C56583A0BD3 for <ietfarch-ipp-archive@ietfa.amsl.com>; Sat, 16 May 2020 16:08:16 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.698
X-Spam-Level:
X-Spam-Status: No, score=-0.698 tagged_above=-999 required=5 tests=[DKIM_INVALID=0.1, DKIM_SIGNED=0.1, HTML_MESSAGE=0.001, MAILING_LIST_MULTI=-1, MIME_HTML_MOSTLY=0.1, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=fail (1024-bit key) reason="fail (message has been altered)" header.d=hp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id RCLWswfGjQjO for <ietfarch-ipp-archive@ietfa.amsl.com>; Sat, 16 May 2020 16:08:14 -0700 (PDT)
Received: from mail.pwg.org (mail.pwg.org [50.116.7.199]) by ietfa.amsl.com (Postfix) with ESMTP id B86853A0BD6 for <ipp-archive2@ietf.org>; Sat, 16 May 2020 16:08:14 -0700 (PDT)
Received: by mail.pwg.org (Postfix, from userid 1002) id 7359A448B; Sat, 16 May 2020 23:08:13 +0000 (UTC)
Received: from mail.pwg.org (localhost [IPv6:::1]) by mail.pwg.org (Postfix) with ESMTP id A4E193E77; Sat, 16 May 2020 23:08:08 +0000 (UTC)
X-Original-To: ipp@pwg.org
Delivered-To: ipp@pwg.org
Received: by mail.pwg.org (Postfix, from userid 1002) id CE439259F; Sat, 16 May 2020 23:08:06 +0000 (UTC)
Received: from us-smtp-delivery-162.mimecast.com (us-smtp-delivery-162.mimecast.com [63.128.21.162]) by mail.pwg.org (Postfix) with ESMTPS id 03205269F for <ipp@pwg.org>; Sat, 16 May 2020 23:08:04 +0000 (UTC)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hp.com; s=mimecast20180716; t=1589670483; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=6/Z9X03QM6hZf4fwFkgcR46A+yEyiaB+a7e5Wocn0mQ=; b=ZKG0dGHYztVLdUBlVKWiPMI8HQWfh02PfkLkCNhjH/1sLetXGkvjkglef+IDShUJf+btuX LcX2jCKKMJCCDYRu09YRnvq7vKTKXRl4hweuL4rNM6HrKymc7Xvlo4sZAc2gZ6dgT3oKwo Nx22OZFlFK+Y/Rj8etX3QA0ej0X5fGA=
Received: from NAM12-MW2-obe.outbound.protection.outlook.com (mail-mw2nam12lp2041.outbound.protection.outlook.com [104.47.66.41]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-392-e60GiqqHP6CfHJoFc8Ksxw-1; Sat, 16 May 2020 19:07:59 -0400
X-MC-Unique: e60GiqqHP6CfHJoFc8Ksxw-1
Received: from CS1PR8401MB0632.NAMPRD84.PROD.OUTLOOK.COM (2a01:111:e400:7514::18) by CS1PR8401MB0423.NAMPRD84.PROD.OUTLOOK.COM (2a01:111:e400:7513::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3000.24; Sat, 16 May 2020 23:07:57 +0000
Received: from CS1PR8401MB0632.NAMPRD84.PROD.OUTLOOK.COM ([fe80::e1db:1790:ed1b:f6f3]) by CS1PR8401MB0632.NAMPRD84.PROD.OUTLOOK.COM ([fe80::e1db:1790:ed1b:f6f3%7]) with mapi id 15.20.3000.022; Sat, 16 May 2020 23:07:56 +0000
To: Michael Sweet <msweet@msweet.org>
Thread-Topic: [IPP] Posted 1.1 release candidate tools
Thread-Index: AQHWDeOtb0IKyVdDFk6nGwZ/XzKAe6irkeKA
Date: Sat, 16 May 2020 23:07:56 +0000
Message-ID: <5D41B566-E9AC-47F1-ADDD-B1EB9C83712A@hp.com>
References: <77A43605-2C50-4076-835A-0BE5AEAA2125@msweet.org>
In-Reply-To: <77A43605-2C50-4076-835A-0BE5AEAA2125@msweet.org>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
x-mailer: Apple Mail (2.3608.80.23.2.2)
x-originating-ip: [174.27.55.247]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 6e9a93d5-33b4-42df-21a7-08d7f9edf873
x-ms-traffictypediagnostic: CS1PR8401MB0423:
x-microsoft-antispam-prvs: <CS1PR8401MB04236EA2F78DBCE839614A429EBA0@CS1PR8401MB0423.NAMPRD84.PROD.OUTLOOK.COM>
x-ms-oob-tlc-oobclassifiers: OLM:569;
x-forefront-prvs: 040513D301
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: M54/3bJMRmWm5xA1UrXgr9QcWsD8m6jiS6WSdoh2gHRqghLfL3Wz1bJ8SuMoos/iRNUrCan+HmbH6J1r32/8olcPuLndDTXYlhBDwERENejW8p1UN2GkAfPgN1fJu6ShVnrXPw+mhybc+ty0umeYVrm77ZaPjGvLcbhM9nUGF/uJn/iQgofp8lpExkE+6K5k1Q+5yi3+8QAbv802TdTg7ob6zUOV4mzhw3A/ZwqbCZS620iWpJ0/F0mhE5pAsfrYHTbiwuAacEkIwFSSbT8XjHyufwLqQ/4KB1/wigaOslriwMIpJ4TemZPFEQvPxLkkeRYsb7VPrcBilMthoO5klCS2sGP276tSIIYHz1TahUMksrwmJ/PmjPQBAf99cWac+cWyMLdgudMLskPiSdyw0jIQktwsP5QINUxrbtfQ9pvI8DxM2PNEnL5cIYufebatE07KVfBzfZCtFAaLhqMuzjtsoD6n6M21Z1tPJ7xL6G0FKMVJQf1QA4TNMx+J06YPUQMD6SQMErpwI6dAXoMtmA==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CS1PR8401MB0632.NAMPRD84.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFTY:; SFS:(39860400002)(136003)(346002)(396003)(376002)(366004)(6512007)(4326008)(36756003)(99936003)(166002)(186003)(26005)(6916009)(8936002)(5660300002)(6486002)(53546011)(8676002)(6506007)(66946007)(54906003)(76116006)(91956017)(2906002)(966005)(316002)(66446008)(64756008)(66556008)(66476007)(66616009)(478600001)(86362001)(2616005)(71200400001)(33656002); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata: Mv6sW6ox4JCaJ4Azq6GVp0LmtBWeWfjhOgnSm5Hu6i0SL2vS5IpO22FHv79UP03hp3GYkWEwxNlJBGl5vh9EgYCn/qhz0BvkcA0qYN2zmvQNcxaMIdv/6CYm0RaAbrxHcBewH/cz6eOOsMJ6E9tIqKRTe4x6raSjA7fopii2OmcOlvpb0WHvYfalN0+euGqYYlhb0pYLwSjcPx8kJOKk7Ncwn88MqTRp0euYCm0I3gMofkl+qt2nrLs4hN7LG9k2Yd02YCug+vfXMz4wQL/HCFEH5raJN3G4t8EiE+r2F6UkftrYM9BIyRgYX3lBu2uQsrBO1dTmuy6QITfkrb6abv7Wc4ZICiefzT09NMiJ+gD34ZPKvORzLO8JIUzMCZbqYPHEB/CU6IHPsNi4V/rQdRPZLzt8kztXT421GxXU/93pvfeHdQigQ/INrKf2CkjMtiLSBMtf3i9ugRgZGnLe7esGDOJICn0lR5c+bUp+LrI=
x-ms-exchange-transport-forked: True
MIME-Version: 1.0
X-OriginatorOrg: hp.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 6e9a93d5-33b4-42df-21a7-08d7f9edf873
X-MS-Exchange-CrossTenant-originalarrivaltime: 16 May 2020 23:07:56.5055 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: ca7981a2-785a-463d-b82a-3db87dfc3ce6
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: RNhp+N2tg7dYD0S7a4jPxpNDAcbx8UDLYDe3MXQ/kurLwmsVD3XRqDY/u8Dtutuj2RnR/y4TodkDYxd+4cKXXA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CS1PR8401MB0423
X-Mimecast-Spam-Score: 0
X-Mimecast-Originator: hp.com
Cc: PWG IPP WG Reflector <ipp@pwg.org>, PWG IPP Everywhere Self-Certification Reflector <ippeveselfcert@pwg.org>
Subject: Re: [IPP] Posted 1.1 release candidate tools
X-BeenThere: ipp@pwg.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: ISTO-PWG Internet Printing Protocol workgroup discussion forum <ipp.pwg.org>
List-Unsubscribe: <https://www.pwg.org/mailman/options/ipp>, <mailto:ipp-request@pwg.org?subject=unsubscribe>
List-Archive: <http://www.pwg.org/pipermail/ipp/>
List-Post: <mailto:ipp@pwg.org>
List-Help: <mailto:ipp-request@pwg.org?subject=help>
List-Subscribe: <https://www.pwg.org/mailman/listinfo/ipp>, <mailto:ipp-request@pwg.org?subject=subscribe>
From: "Kennedy, Smith \(Wireless & IPP Standards\) via ipp" <ipp@pwg.org>
Reply-To: "Kennedy, Smith \(Wireless & IPP Standards\)" <smith.kennedy@hp.com>
Content-Type: multipart/mixed; boundary="===============9186035701960502406=="
Errors-To: ipp-bounces@pwg.org
Sender: "ipp" <ipp-bounces@pwg.org>

Hi Mike,

Just now getting time to test these tools with a printer that is already IPP Everywhereâ„¢ 1.0 certified, and I'm observing some interesting deltas / issues.

1. The printer is failing test I-10:

    I-10. Get-Printer-Attributes Operation (default)                     [FAIL]
        RECEIVED: 13004 bytes in response
        status-code = successful-ok (successful-ok)
        EXPECTED: finishing-template-supported
        EXPECTED: finishing-template-supported
        EXPECTED: finishings-col-database OF-TYPE collection (got no-value)
        EXPECTED: finishings-col-database/finishing-template OF-TYPE keyword|name (got no-value)
        EXPECTED: finishings-col-default OF-TYPE collection (got no-value)
        EXPECTED: finishings-col-default/finishing-template OF-TYPE keyword|name (got no-value)
        EXPECTED: finishings-col-ready OF-TYPE collection (got no-value)
        EXPECTED: finishings-col-ready/finishing-template OF-TYPE keyword|name (got no-value)

Here's a dump of the Printer's attributes relating to finishing:

Serenity: ipptool-server-captures [503]$ grep finishing _Kennedy\ DeskJet\ 3755_.conf
ATTR keyword job-creation-attributes-supported "copies","finishings","finishings-col","job-pages-per-set","sides","orientation-requested","media","print-quality","printer-resolution","output-bin","media-col","output-mode","print-content-optimize","pclm-source-resolution","print-color-mode","ipp-attribute-fidelity","job-name","page-ranges","multiple-document-handling","job-mandatory-attributes","print-rendering-intent","print-scaling"
ATTR no-value finishings-col-database
ATTR no-value finishings-col-ready
ATTR keyword finishings-col-supported "finishing-template"
ATTR enum finishings-default 3
ATTR no-value finishings-col-default
ATTR enum finishings-supported 3

The problematic line in ipp-tests.test seems to be this:

EXPECT finishings-supported OF-TYPE enum IN-GROUP printer-attributes-tag DEFINE-MATCH HAVE_FINISHINGS

Since the Printer's "finishings-supported" contains only 3 (none), I think the line should instead be:

EXPECT finishings-supported OF-TYPE enum IN-GROUP printer-attributes-tag WITH-VALUE >3 DEFINE-MATCH HAVE_FINISHINGS


2. The new "I-9" test for Identify-Printer never gets exercised because it has SKIP-IF-NOT-DEFINED HAVE_IDENTIFY_PRINTER at the start, but HAVE_IDENTIFY_PRINTER isn't defined until test I-10. I moved I-9 to after I-10.7 and renumbered so that I-10.7 is now I-9.7, I-9 is now I-10. Now it gets executed.

3. The current I-10.5 and I-10.6 are failing on my IPP Everywhere 1.0 certified printer. I'm wondering whether these tests ought to be enabled only if some DEFINE is defined ("PEDANTIC" / "WARNINGS" etc.). I know they should pass, but if that hasn't been exercised previously, that can cause some additional thrash. I don't want to lower the bar and remove those tests, but if there was some grace period, that might help teams who are trying to certify in the near term. I'm not sure what others think. Asking my firmware teams whether fixing that in pending devices' certifications will cause thrash.

Still testing but wanted to share this for now.

Smith

/**
    Smith Kennedy
    HP Inc.
*/

> On Apr 8, 2020, at 2:23 PM, Michael Sweet via ipp <ipp@pwg.org> wrote:
> 
> All,
> 
> I have posted the first release candidate of the IPP Everywhere 1.1 Printer Self-Certification Tools to:
> 
> https://ftp.pwg.org/pub/pwg/ipp/wd/sw-ippeveselfcert11-20200408-macos.zip <https://ftp.pwg.org/pub/pwg/ipp/wd/sw-ippeveselfcert11-20200408-macos.zip>
> https://ftp.pwg.org/pub/pwg/ipp/wd/sw-ippeveselfcert11-20200408-rhel.tar.gz <https://ftp.pwg.org/pub/pwg/ipp/wd/sw-ippeveselfcert11-20200408-rhel.tar.gz>
> https://ftp.pwg.org/pub/pwg/ipp/wd/sw-ippeveselfcert11-20200408-ubuntu.tar.gz <https://ftp.pwg.org/pub/pwg/ipp/wd/sw-ippeveselfcert11-20200408-ubuntu.tar.gz>
> https://ftp.pwg.org/pub/pwg/ipp/wd/sw-ippeveselfcert11-20200408-windows.msi <https://ftp.pwg.org/pub/pwg/ipp/wd/sw-ippeveselfcert11-20200408-windows.msi>
> 
> These tools incorporate the new "ippevesubmit" tool for submitting your self-certification results, fix all of the known issues in the previous version of the tools, and follow the latest draft of the IPP Everywhere 1.1 and IPP Everywhere 1.1 Printer Self-Certification Manual documents:
> 
> https://ftp.pwg.org/pub/pwg/ipp/wd/wd-ippeve11-20200326.pdf <https://ftp.pwg.org/pub/pwg/ipp/wd/wd-ippeve11-20200326.pdf>
> https://ftp.pwg.org/pub/pwg/ipp/wd/wd-ippeveselfcert11-20200312.pdf <https://ftp.pwg.org/pub/pwg/ipp/wd/wd-ippeveselfcert11-20200312.pdf>
> 
> ________________________
> Michael Sweet
> 
> 
> 
> _______________________________________________
> ipp mailing list
> ipp@pwg.org
> https://www.pwg.org/mailman/listinfo/ipp <https://www.pwg.org/mailman/listinfo/ipp>

_______________________________________________
ipp mailing list
ipp@pwg.org
https://www.pwg.org/mailman/listinfo/ipp