Re: [tap] Valids subtests (was: RFC Status?)
"Bruno P. Kinoshita" <brunodepaulak@yahoo.com.br> Wed, 17 September 2014 21:02 UTC
Return-Path: <brunodepaulak@yahoo.com.br>
X-Original-To: tap@ietfa.amsl.com
Delivered-To: tap@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8C8FC1A6F2C for <tap@ietfa.amsl.com>; Wed, 17 Sep 2014 14:02:24 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.75
X-Spam-Level:
X-Spam-Status: No, score=-0.75 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, J_CHICKENPOX_31=0.6, RCVD_IN_DNSWL_NONE=-0.0001, REPTO_QUOTE_YAHOO=0.646, URIBL_DBL_ABUSE_REDIR=0.001, URIBL_DBL_REDIR=0.001] autolearn=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id b_WxIFm5v-aT for <tap@ietfa.amsl.com>; Wed, 17 Sep 2014 14:02:23 -0700 (PDT)
Received: from nm26-vm9.bullet.mail.gq1.yahoo.com (nm26-vm9.bullet.mail.gq1.yahoo.com [98.136.216.136]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 22FD01A6F34 for <tap@ietf.org>; Wed, 17 Sep 2014 14:02:22 -0700 (PDT)
Received: from [98.137.12.63] by nm26.bullet.mail.gq1.yahoo.com with NNFMP; 17 Sep 2014 21:02:21 -0000
Received: from [98.137.12.208] by tm8.bullet.mail.gq1.yahoo.com with NNFMP; 17 Sep 2014 21:02:21 -0000
Received: from [127.0.0.1] by omp1016.mail.gq1.yahoo.com with NNFMP; 17 Sep 2014 21:02:21 -0000
X-Yahoo-Newman-Property: ymail-3
X-Yahoo-Newman-Id: 828694.99089.bm@omp1016.mail.gq1.yahoo.com
Received: (qmail 76372 invoked by uid 60001); 17 Sep 2014 21:02:21 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com.br; s=s1024; t=1410987741; bh=OIgtmZ7jUdjrJH0rEBBln2MsREKFDtuRbDrPmAztS1Y=; h=References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type; b=jGZIlCFQ4Uhlex37KiczC5H04U5hfQQdMGI/sKwA/lw/YX39mfsoVMzi7EBNbfzT/10fe3m5+VS9y2PCByg9b0M3gK/0vO9VMlc8qeqK89aFJKP+eBwuKPdIFYMvO3FQ5sAwiE905kBAcjZWmNRtBbkncixt+c0uHwRUipio/+Q=
X-YMail-OSG: 8.AZHOcVM1nYA533XFbqPggbgCUp2oHulJMQFNY627.uw_D NWjIvVtIr07YSdjpPPMRugKD9DF.xcNwSrlH9PsiwJlbOOMKZTr.B8EhiUvw Vvhs8DmZ0ihEyC3ZXsnwRxsq.pBI9d2NIoAAv0lGTRHC9kjjDYyh.NsFDfJH qO4IBLRStqdN8.VpwpOE8KPRm9VWr3l5X4Sc0auVeikviKi8_LGkER9Qf5Ud IiRHReuDjLJyKddkivzG.q2TNTWFagcfcuTPMsMGx52OhdWmDE.2nbspO.Fr _kNxCj4AaTsOosjqrwksalx.IdbTpHtA3V9HqDEkcf.RMwF7.fH7EYdCAqHp dQqOdWxJqaYF3h8O24orM_Jd.jqOsZi5i3ljyfu93QDeanOIhyd_p1ZeFzDv Y_D3a2ezlFWmzth9UXNcQ4r6j8WySo.V7N1yib8F7OMFX1dDycgwyfoKdOmq mYKRwsYcTYKGOOIrp8j.j0GoAMv6leRV7JjCsMCZ.ad.MALD5mIpbokySzKj QWyk6q8R3Wq2qj6mj6wm9jzwtj1z.._RSJgKeI_pIzl0DdMnnFJTjpR4Z2qS re04ElLfZ6Cg4XcjD4SIEjbZi7Z8fou58bOdLmfzkvKtU_tjlXk7IasW8tgR UnSR0JXoIzpnG90HNx1C.WfYYzUdgujzvrNfEFsoWCAGmhHp4OnLoVSCjsEt WvdgB2jUssCyFoU50aUEQr0qifT8B6USf.rkwQlXFp3PQyZdrjvivYGYX5b0 fAlNNdH_6Qcm.abXIpVYkN0DnAVtOJ.qwu1TPn8R85412S1U1kIE1cKBNyBW ceo.7VaHW9HxjSWDR395gU4pmMWLv4oPn.qCcc9Q_6ofknKOXL8X5StT4nO8 c2go0K66Tl.EQvrRvn7vh2be.j6vr09C2k6rTJRdrfqklvkXj0wUBC9sl7Rb 8KiCdIqBUvaSZFWIbi7Cwdg--
Received: from [189.50.161.77] by web163504.mail.gq1.yahoo.com via HTTP; Wed, 17 Sep 2014 14:02:21 PDT
X-Rocket-MIMEInfo: 002.001, VGhlIHNvdXJjZSBjb2RlIGlzIGhvc3RlZCBhdCBbMV0uIFRoZSB3ZWIgc2l0ZSBpcyBnZW5lcmF0ZWQgZHVyaW5nIHRoZSByZWxlYXNlIHByb2Nlc3MgYXQgWzJdLiBUaGUgdGVzdCBhcHAgaXMgZGVwbG95ZWQgYXQgWzNdICh0aG91Z2ggaXQgaXMgb3V0ZGF0ZWQgYW5kIG5lZWRzIHRvIGJlIHVwZGF0ZWQpLiAKCkkgZmlyc3QgdHJpZWQgd3JpdGluZyBhIHBhcnNlciBieSB0YWtpbmcgYSBsb29rIGF0IHNuYWtlLXlhbWwsIGJ1dCBlbmRlZCB1cCBkZXBlbmRpbmcgYSBsb3Qgb24gcmVnZXgncy4gU28gcHJvYmEBMAEBAQE-
X-Mailer: YahooMailWebService/0.8.203.696
References: <CAP4gcszybVr5Hw3mg=uTi8tqpA3wEVwo=zf2876RWhy_CmozZw@mail.gmail.com> <CAHhgV8jr6ZnsfUkpFC4OL0AwRX-aen7v-7KjcN3e0_19s7steg@mail.gmail.com> <1410980929.82809.YahooMailNeo@web126106.mail.ne1.yahoo.com> <1410981416.81953.YahooMailNeo@web163504.mail.gq1.yahoo.com> <1410982831.46047.YahooMailNeo@web126105.mail.ne1.yahoo.com> <1410984733.67023.YahooMailNeo@web163504.mail.gq1.yahoo.com> <1410985980.76329.YahooMailNeo@web126106.mail.ne1.yahoo.com> <1410986289.81577.YahooMailNeo@web163505.mail.gq1.yahoo.com> <1410986422.56518.YahooMailNeo@web126106.mail.ne1.yahoo.com>
Message-ID: <1410987741.9968.YahooMailNeo@web163504.mail.gq1.yahoo.com>
Date: Wed, 17 Sep 2014 14:02:21 -0700
From: "Bruno P. Kinoshita" <brunodepaulak@yahoo.com.br>
To: Ovid <publiustemp-tapx@yahoo.com>
In-Reply-To: <1410986422.56518.YahooMailNeo@web126106.mail.ne1.yahoo.com>
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="1159194385-1228104412-1410987741=:9968"
Archived-At: http://mailarchive.ietf.org/arch/msg/tap/LH_TV2HUhDNC2T3T0TjgJYw7mMc
Cc: "tap@ietf.org" <tap@ietf.org>
Subject: Re: [tap] Valids subtests (was: RFC Status?)
X-BeenThere: tap@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: "Bruno P. Kinoshita" <brunodepaulak@yahoo.com.br>
List-Id: Test Anything Protocol WG discussions <tap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tap>, <mailto:tap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tap/>
List-Post: <mailto:tap@ietf.org>
List-Help: <mailto:tap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Sep 2014 21:02:25 -0000
The source code is hosted at [1]. The web site is generated during the release process at [2]. The test app is deployed at [3] (though it is outdated and needs to be updated). I first tried writing a parser by taking a look at snake-yaml, but ended up depending a lot on regex's. So probably that's a part that could be reworked to better represent grammars such as the one you posted earlier. Please, feel free to submit issues, pull requests, comments/suggestions :) Thanks! [1] https://github.com/tupilabs/tap4j [2] http://tap4j.org [3] http://instanttap.appspot.com/ >________________________________ > From: Ovid <publiustemp-tapx@yahoo.com> >To: Bruno P. Kinoshita <brunodepaulak@yahoo.com.br> >Cc: "tap@ietf.org" <tap@ietf.org> >Sent: Wednesday, September 17, 2014 5:40 PM >Subject: Re: [tap] Valids subtests (was: RFC Status?) > > > >Bruno, > > >Is there a git project for this anywhere? I haven't written any Java for a while and with my company, I don't have a lot of spare time, but I'd be happy to take a look. > >Best, >Ovid >-- >IT consulting, training, international recruiting > http://www.allaroundtheworld.fr/. >Buy my book! - http://bit.ly/beginning_perl >Live and work overseas - http://www.overseas-exile.com/ > > > >On Wednesday, 17 September 2014, 22:38, Bruno P. Kinoshita <brunodepaulak@yahoo.com.br> wrote: > > >> >> >>Haha, thanks Ovid! >> >> >>Well, turns out tap4j TAP parser is likely broken for subtests then :) >> >> >>I'll probably spend some time writing a new parser - which I'll try to make more compatible with Perl tools and with existing grammars. >> >> >>But some definitive documentation for subtests in TAP website would be grand too. >> >> >>Cheers >>Bruno >> >> >> >>>________________________________ >>> From: Ovid <publiustemp-tapx@yahoo.com> >>>To: Bruno P. Kinoshita <brunodepaulak@yahoo.com.br> >>>Cc: "tap@ietf.org" <tap@ietf.org> >>>Sent: Wednesday, September 17, 2014 5:33 PM >>>Subject: Re: [tap] Valids subtests (was: RFC Status?) >>> >>> >>> >>>Bruno, >>> >>> >>>I realized that referring you to the grammar is the same as RTFM and that's not fair when there are questions about the FM :) >>> >>> >>> 1..2 >>> ok 1 - foo >>> not ok 1 - some text >>> ok 2 - bar passed >>> not ok 1 - another text >>> >>> >>>The above is not valid because there must always be summary ok/not ok lines *after* the subtest and the subtest must have a leading XOR trailing plan (in other words, not both) with the same indentation level as the subtest and the summary line *must* have an ok/not ok status that matches the results of the subtest. The following would be valid: >>> >>> >>> 1..2 >>> not ok 1 - some text >>> 1..1 >>> not ok 1 - foo (because the subtest did not pass) >>> 1..2 >>> ok 1 - another text >>> not ok 2 - whee! # TODO (todo tests are always considered as passing) >>> ok 2 - bar passed (because the subtest did pass) >>> >>> >>> >>> >>> >>> >>> >>>Best, >>>Ovid >>> >>>-- >>>IT consulting, training, international recruiting >>> http://www.allaroundtheworld.fr/. >>>Buy my book! - http://bit.ly/beginning_perl >>>Live and work overseas - http://www.overseas-exile.com/ >>> >>> >> >> > >
- [tap] RFC Status? Andrew de Andrade
- Re: [tap] RFC Status? Gaurav Vaidya
- Re: [tap] RFC Status? Bruno P. Kinoshita
- Re: [tap] RFC Status? Andrew de Andrade
- Re: [tap] RFC Status? Bruno P. Kinoshita
- Re: [tap] RFC Status? Andrew de Andrade
- Re: [tap] RFC Status? Ovid
- Re: [tap] RFC Status? Ovid
- Re: [tap] RFC Status? Bruno P. Kinoshita
- Re: [tap] RFC Status? Jonathan Kingston
- Re: [tap] RFC Status? Andrew de Andrade
- Re: [tap] RFC Status? Bruno P. Kinoshita
- Re: [tap] RFC Status? Jonathan Kingston
- Re: [tap] RFC Status? Salve J Nilsen
- Re: [tap] RFC Status? Bruno P. Kinoshita
- Re: [tap] RFC Status? Ovid
- Re: [tap] RFC Status? Andrew de Andrade
- Re: [tap] RFC Status? Ovid
- Re: [tap] RFC Status? Andrew de Andrade
- Re: [tap] RFC Status? Andrew de Andrade
- Re: [tap] RFC Status? Gaurav Vaidya
- Re: [tap] RFC Status? Leon Timmermans
- Re: [tap] RFC Status? Ovid
- Re: [tap] RFC Status? Leon Timmermans
- Re: [tap] RFC Status? Andrew de Andrade
- Re: [tap] RFC Status? Ovid
- [tap] Valids subtests (was: RFC Status?) Bruno P. Kinoshita
- Re: [tap] Valids subtests (was: RFC Status?) Ovid
- Re: [tap] RFC Status? Ovid
- Re: [tap] RFC Status? Ovid
- Re: [tap] Valids subtests (was: RFC Status?) Bruno P. Kinoshita
- Re: [tap] Valids subtests (was: RFC Status?) Ovid
- Re: [tap] Valids subtests (was: RFC Status?) Ovid
- Re: [tap] Valids subtests (was: RFC Status?) Bruno P. Kinoshita
- Re: [tap] Valids subtests (was: RFC Status?) Ovid
- Re: [tap] Valids subtests (was: RFC Status?) Bruno P. Kinoshita
- Re: [tap] Valids subtests (was: RFC Status?) Andrew Rodland
- Re: [tap] Valids subtests (was: RFC Status?) Ovid
- Re: [tap] Valids subtests (was: RFC Status?) Bruno P. Kinoshita
- Re: [tap] RFC Status? Steffen Schwigon
- Re: [tap] Valids subtests (was: RFC Status?) Andrew Rodland
- Re: [tap] RFC Status? Leon Timmermans
- Re: [tap] RFC Status? Leon Timmermans
- Re: [tap] RFC Status? Steffen Schwigon
- Re: [tap] RFC Status? Leon Timmermans
- Re: [tap] RFC Status? Leon Timmermans