IETF Logo Mail Archive

Re: [tap] Valids subtests (was: RFC Status?)

Ovid <publiustemp-tapx@yahoo.com> Wed, 17 September 2014 20:40 UTC

Return-Path: <publiustemp-tapx@yahoo.com>
X-Original-To: tap@ietfa.amsl.com
Delivered-To: tap@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BFC131A6F03 for <tap@ietfa.amsl.com>; Wed, 17 Sep 2014 13:40:26 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.049
X-Spam-Level:
X-Spam-Status: No, score=-3.049 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, J_CHICKENPOX_31=0.6, RCVD_IN_DNSWL_NONE=-0.0001, RP_MATCHES_RCVD=-1.652, SPF_PASS=-0.001, URIBL_DBL_ABUSE_REDIR=0.001, URIBL_DBL_REDIR=0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id G-udBSf8LdtZ for <tap@ietfa.amsl.com>; Wed, 17 Sep 2014 13:40:23 -0700 (PDT)
Received: from nm13.bullet.mail.ne1.yahoo.com (nm13.bullet.mail.ne1.yahoo.com [98.138.90.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 9E8481A6EE8 for <tap@ietf.org>; Wed, 17 Sep 2014 13:40:23 -0700 (PDT)
Received: from [98.138.226.180] by nm13.bullet.mail.ne1.yahoo.com with NNFMP; 17 Sep 2014 20:40:22 -0000
Received: from [98.138.89.233] by tm15.bullet.mail.ne1.yahoo.com with NNFMP; 17 Sep 2014 20:40:22 -0000
Received: from [127.0.0.1] by omp1048.mail.ne1.yahoo.com with NNFMP; 17 Sep 2014 20:40:22 -0000
X-Yahoo-Newman-Property: ymail-3
X-Yahoo-Newman-Id: 874769.97223.bm@omp1048.mail.ne1.yahoo.com
Received: (qmail 79582 invoked by uid 60001); 17 Sep 2014 20:40:22 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1410986422; bh=duuJ+wvQInF+E+syO843Ybud++x6uTzCv61c2gfFiF8=; h=References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type; b=nlO2xkitRD60uxyJgV0I+b34Kz5pGjAoVePatjUK7AKKIn5zGo1Dr3+D/APqp34r+KQZX+c/Kr1ZJf35iIaOgbsHrRYVVuTR8wvIqkoUlEVn3xokGyNFuRWAPyaSy+pNPjZX7wshtW3IaCdoartk05lqJlmntxykHbwOvgwoKRM=
X-YMail-OSG: Z4DwYesVM1mnZsKOu.fnXu.MHCAi5t6QOH.z4WWHYdF9mcN mBi7.dXLzV6Mh8WqFD1Y3ThxWnmkq5oE.huAgSCWr6rd98Ivabq3Tb5uB9Cw 2lEfmIZojEVggnePboBWv2bbPlTm5gJzJwsczhtbnkkGoJuY2xxlLYBQ5wO9 ryO_dSUeQwhSL5299Q_fsCuR9pXsvbAdNtlPRpyrXZW40i7QTnJi55yNcWaQ 43YEX5ayheiFg7ucVsN4tOryqWcUSMgOGn1v1jQ.D_Hg5..sjd99V22gDU_h .Jaa1qCt6G30dSDNWXQKk_8EqbBdNpH1HCFbOgjwpG64ED5f4fMcUDndv6Da ULcIezQCI7xp0W11YQO48tQNN9K0n05ff5edg33tvMIinWgu_TUKHCtZQEoP QIc7k279a8PBzjvsrnTMJIeAZirfZGwiTgkMBiI83XvDo.otA1N.kDILBsNu UJDD7_iX2l4w244Tb4L914LVzTxtttEwlAcOuR1DMhjz4tfQEaGeZllUFa3u NqjwlIHgz_pKuII6zD66LQSplCawFa.nVqPrOAIxiqNWNd.5Tn9Tys0hA_CI LzsU36oiGsidIugOut1wJmUGI_II2AQAwv7IKKmtaY1OZrDWBQVZDtb5s1sS YYnWql1Exq1.fBWff.E4vsRDWL0bkzQdb4EgTIjF3yMbrlQilV5FEtF_Gqk. 74aV2oGOzuY9wnIqMvn4PE6OM1OOevMDDDUxvddsXSkwt7AEStmgLqxy5.KQ 0zOiRWovtFYh31oIErmHeDMS4Oaq9ZUdWloID
Received: from [2.6.227.184] by web126106.mail.ne1.yahoo.com via HTTP; Wed, 17 Sep 2014 13:40:22 PDT
X-Rocket-MIMEInfo: 002.001, QnJ1bm8sCgpJcyB0aGVyZSBhIGdpdCBwcm9qZWN0IGZvciB0aGlzIGFueXdoZXJlPyBJIGhhdmVuJ3Qgd3JpdHRlbiBhbnkgSmF2YSBmb3IgYSB3aGlsZSBhbmQgd2l0aCBteSBjb21wYW55LCBJIGRvbid0IGhhdmUgYSBsb3Qgb2Ygc3BhcmUgdGltZSwgYnV0IEknZCBiZSBoYXBweSB0byB0YWtlIGEgbG9vay4KIApCZXN0LApPdmlkCi0tCklUIGNvbnN1bHRpbmcsIHRyYWluaW5nLCBpbnRlcm5hdGlvbmFsIHJlY3J1aXRpbmcKICAgICAgIGh0dHA6Ly93d3cuYWxsYXJvdW5kdGhld29ybGQuZnIvLgpCdXkgbXkBMAEBAQE-
X-Mailer: YahooMailWebService/0.8.203.696
References: <CAP4gcszybVr5Hw3mg=uTi8tqpA3wEVwo=zf2876RWhy_CmozZw@mail.gmail.com> <CAHhgV8jr6ZnsfUkpFC4OL0AwRX-aen7v-7KjcN3e0_19s7steg@mail.gmail.com> <1410980929.82809.YahooMailNeo@web126106.mail.ne1.yahoo.com> <1410981416.81953.YahooMailNeo@web163504.mail.gq1.yahoo.com> <1410982831.46047.YahooMailNeo@web126105.mail.ne1.yahoo.com> <1410984733.67023.YahooMailNeo@web163504.mail.gq1.yahoo.com> <1410985980.76329.YahooMailNeo@web126106.mail.ne1.yahoo.com> <1410986289.81577.YahooMailNeo@web163505.mail.gq1.yahoo.com>
Message-ID: <1410986422.56518.YahooMailNeo@web126106.mail.ne1.yahoo.com>
Date: Wed, 17 Sep 2014 13:40:22 -0700
From: Ovid <publiustemp-tapx@yahoo.com>
To: "Bruno P. Kinoshita" <brunodepaulak@yahoo.com.br>
In-Reply-To: <1410986289.81577.YahooMailNeo@web163505.mail.gq1.yahoo.com>
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="1181703601-1737780821-1410986422=:56518"
Archived-At: http://mailarchive.ietf.org/arch/msg/tap/gwisQPLoi--U2X7Ye5aniiSMxw4
Cc: "tap@ietf.org" <tap@ietf.org>
Subject: Re: [tap] Valids subtests (was: RFC Status?)
X-BeenThere: tap@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: Ovid <publiustemp-tapx@yahoo.com>
List-Id: Test Anything Protocol WG discussions <tap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tap>, <mailto:tap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tap/>
List-Post: <mailto:tap@ietf.org>
List-Help: <mailto:tap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Sep 2014 20:40:27 -0000

Bruno,

Is there a git project for this anywhere? I haven't written any Java for a while and with my company, I don't have a lot of spare time, but I'd be happy to take a look.
 
Best,
Ovid
--
IT consulting, training, international recruiting
       http://www.allaroundtheworld.fr/.
Buy my book! - http://bit.ly/beginning_perl
Live and work overseas - http://www.overseas-exile.com/


On Wednesday, 17 September 2014, 22:38, Bruno P. Kinoshita <brunodepaulak@yahoo.com.br> wrote:
 

>
>
>Haha, thanks Ovid!
>
>
>Well, turns out tap4j TAP parser is likely broken for subtests then :)
>
>
>I'll probably spend some time writing a new parser - which I'll try to make more compatible with Perl tools and with existing grammars. 
>
>
>But some definitive documentation for subtests in TAP website would be grand too.
>
>
>Cheers
>Bruno
>
>
>
>>________________________________
>> From: Ovid <publiustemp-tapx@yahoo.com>
>>To: Bruno P. Kinoshita <brunodepaulak@yahoo.com.br> 
>>Cc: "tap@ietf.org" <tap@ietf.org> 
>>Sent: Wednesday, September 17, 2014 5:33 PM
>>Subject: Re: [tap] Valids subtests (was:  RFC Status?)
>> 
>>
>>
>>Bruno,
>>
>>
>>I realized that referring you to the grammar is the same as RTFM and that's not fair when there are questions about the FM :)
>>
>>
>>    1..2
>>    ok 1 - foo
>>        not ok 1 - some text
>>    ok 2 - bar passed
>>        not ok 1 - another text
>>
>>
>>The above is not valid because there must always be summary ok/not ok lines *after* the subtest and the subtest must have a leading XOR trailing plan (in other words, not both) with the same indentation level as the subtest and the summary line *must* have an ok/not ok status that matches the results of the subtest. The following would be valid:
>>
>>
>>    1..2
>>        not ok 1 - some text
>>        1..1
>>    not ok 1 - foo (because the subtest did not pass)
>>        1..2
>>        ok 1 - another text
>>        not ok 2 - whee! # TODO (todo tests are always considered as passing)
>>    ok 2 - bar passed (because the subtest did pass)
>>
>>
>>
>>
>>
>>
>>
>>Best,
>>Ovid 
>>
>>--
>>IT consulting, training, international recruiting
>>       http://www.allaroundtheworld.fr/.
>>Buy my book! - http://bit.ly/beginning_perl
>>Live and work overseas - http://www.overseas-exile.com/
>>
>>
>
>

v2.23.0 | Report a Bug | By Email