IETF Logo Mail Archive

Re: [tap] Valids subtests (was: RFC Status?)

Ovid <publiustemp-tapx@yahoo.com> Wed, 17 September 2014 20:33 UTC

Return-Path: <publiustemp-tapx@yahoo.com>
X-Original-To: tap@ietfa.amsl.com
Delivered-To: tap@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 7206F1A1F04 for <tap@ietfa.amsl.com>; Wed, 17 Sep 2014 13:33:03 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.649
X-Spam-Level:
X-Spam-Status: No, score=-3.649 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RP_MATCHES_RCVD=-1.652, SPF_PASS=-0.001, URIBL_DBL_ABUSE_REDIR=0.001, URIBL_DBL_REDIR=0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id fMsD4asyYQqg for <tap@ietfa.amsl.com>; Wed, 17 Sep 2014 13:33:01 -0700 (PDT)
Received: from nm25.bullet.mail.ne1.yahoo.com (nm25.bullet.mail.ne1.yahoo.com [98.138.90.88]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 95BC11A1F73 for <tap@ietf.org>; Wed, 17 Sep 2014 13:33:01 -0700 (PDT)
Received: from [98.138.100.112] by nm25.bullet.mail.ne1.yahoo.com with NNFMP; 17 Sep 2014 20:33:00 -0000
Received: from [98.138.86.156] by tm103.bullet.mail.ne1.yahoo.com with NNFMP; 17 Sep 2014 20:33:00 -0000
Received: from [127.0.0.1] by omp1014.mail.ne1.yahoo.com with NNFMP; 17 Sep 2014 20:33:00 -0000
X-Yahoo-Newman-Property: ymail-5
X-Yahoo-Newman-Id: 889450.85294.bm@omp1014.mail.ne1.yahoo.com
Received: (qmail 68624 invoked by uid 60001); 17 Sep 2014 20:33:00 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1410985980; bh=ko3VyQ+VWQVYx7YdSOcsuli+B3cvKluhInZFp7eRsuY=; h=References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type; b=PNF/RT8xjAQje9Zuwr6QO7P/2LK5jrLWVWLuXJg0AmTP9hVS/QQX5CHVs31XEz9yeXEbzrJ6ffFCfq4UQykj0iZF9IOSvIGBySDKv9dYwCzRdKbMyJLyN6BTF/rYJGo1Ytm55vH4OtQwF64g6NgXPNo4JXrL4KMjS0cS4Yx9j+0=
X-YMail-OSG: XTJBYLwVM1mqDDkoVwGkVtF6qJjbbtTldVJlBFTM.uR6WDG kJpcTpzYpfwoI3A_flZxLFkfhb1qteDWQB.fMNpzuO7h_4p6fmeP6d3Q0wG9 4_9jZgf64A1kt53X1_ejnNS84wTxsaMpNc6d7BFyhFsagCwGaEJyR2_o6QCq 47upMwSho9UpI6wFGfKzZpznGWEcTAs._uSX49Hbua5fuwfJFlSCiw_0uJoV ezH95ZCUTqZQaVJELe8Oa6xewqrlL_QIP9w28fiHL5d0BqO1RLoPryg39Uol 7q23q5StIAiNs3M89tsdy1eAsnFmTPV68SZfLRJJE7XzDRbLZRueDbASKNyj .rxRqMWqGI8Z7Ow6Joi4Qa718cTpIjdPGh5niSXk_DZllnbBkf7T7aty2I_x JNH4yNTIFRNZ.0Lu_BOejZoLN.2i9OFV.0N5gSFjoynMpjHO8Y9HyGLajw5r CEouS1Pf6FtLtnglpXbVnA66WwyAx_yo0gCDwQ8pOOJoQMzZfq7LjnRC6Ad1 EJhq5fLvnj_SJizkJ1uO4wjho7kw9L.LReRSxtzml7IDVJMA2jYw76nygFw. 13Wte9DdH2qXCedYU.v0SduREuptsJnJbzqFWcjNZoP.lkYLye8C744ueopJ fsdAyz7Of5Lk0nfh0wHo3bW_5MFZjthL0lmY2fT5n65GtTZHG4NLIcP0a8K_ bTwzrFWqN_G1EsGCINRWv4w6d5BMKTtvqTGf7h8WEDzjTg2iSGkWfhpu6R2y eO61wQQXQgdzyzYUjtfWxzm8cIhT5.Xln6Q--
Received: from [2.6.227.184] by web126106.mail.ne1.yahoo.com via HTTP; Wed, 17 Sep 2014 13:33:00 PDT
X-Rocket-MIMEInfo: 002.001, QnJ1bm8sCgpJIHJlYWxpemVkIHRoYXQgcmVmZXJyaW5nIHlvdSB0byB0aGUgZ3JhbW1hciBpcyB0aGUgc2FtZSBhcyBSVEZNIGFuZCB0aGF0J3Mgbm90IGZhaXIgd2hlbiB0aGVyZSBhcmUgcXVlc3Rpb25zIGFib3V0IHRoZSBGTSA6KQoKICAgIDEuLjIKICAgIG9rIDEgLSBmb28KICAgICAgICBub3Qgb2sgMSAtIHNvbWUgdGV4dAogICAgb2sgMiAtIGJhciBwYXNzZWQKICAgICAgICBub3Qgb2sgMSAtIGFub3RoZXIgdGV4dAoKVGhlIGFib3ZlIGlzIG5vdCB2YWxpZCBiZWNhdXNlIHRoZXJlIG11c3QgYWx3YXkBMAEBAQE-
X-Mailer: YahooMailWebService/0.8.203.696
References: <CAP4gcszybVr5Hw3mg=uTi8tqpA3wEVwo=zf2876RWhy_CmozZw@mail.gmail.com> <CAHhgV8jr6ZnsfUkpFC4OL0AwRX-aen7v-7KjcN3e0_19s7steg@mail.gmail.com> <1410980929.82809.YahooMailNeo@web126106.mail.ne1.yahoo.com> <1410981416.81953.YahooMailNeo@web163504.mail.gq1.yahoo.com> <1410982831.46047.YahooMailNeo@web126105.mail.ne1.yahoo.com> <1410984733.67023.YahooMailNeo@web163504.mail.gq1.yahoo.com>
Message-ID: <1410985980.76329.YahooMailNeo@web126106.mail.ne1.yahoo.com>
Date: Wed, 17 Sep 2014 13:33:00 -0700
From: Ovid <publiustemp-tapx@yahoo.com>
To: "Bruno P. Kinoshita" <brunodepaulak@yahoo.com.br>
In-Reply-To: <1410984733.67023.YahooMailNeo@web163504.mail.gq1.yahoo.com>
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="1181703601-1886687861-1410985980=:76329"
Archived-At: http://mailarchive.ietf.org/arch/msg/tap/nUMx5X18XHjNnneMEBiZ6kJSNgw
Cc: "tap@ietf.org" <tap@ietf.org>
Subject: Re: [tap] Valids subtests (was: RFC Status?)
X-BeenThere: tap@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: Ovid <publiustemp-tapx@yahoo.com>
List-Id: Test Anything Protocol WG discussions <tap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tap>, <mailto:tap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tap/>
List-Post: <mailto:tap@ietf.org>
List-Help: <mailto:tap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Sep 2014 20:33:03 -0000

Bruno,

I realized that referring you to the grammar is the same as RTFM and that's not fair when there are questions about the FM :)

    1..2
    ok 1 - foo
        not ok 1 - some text
    ok 2 - bar passed
        not ok 1 - another text

The above is not valid because there must always be summary ok/not ok lines *after* the subtest and the subtest must have a leading XOR trailing plan (in other words, not both) with the same indentation level as the subtest and the summary line *must* have an ok/not ok status that matches the results of the subtest. The following would be valid:

    1..2
        not ok 1 - some text
        1..1
    not ok 1 - foo (because the subtest did not pass)
        1..2
        ok 1 - another text
        not ok 2 - whee! # TODO (todo tests are always considered as passing)
    ok 2 - bar passed (because the subtest did pass)


Best,
Ovid 

--
IT consulting, training, international recruiting
       http://www.allaroundtheworld.fr/.
Buy my book! - http://bit.ly/beginning_perl
Live and work overseas - http://www.overseas-exile.com/

v2.23.0 | Report a Bug | By Email