Re: [tap] RFC Status?

[Andrew de Andrade <[e-mail]>]

On Mon, Aug 11, 2014 at 3:41 PM, Bruno P. Kinoshita <
[e-mail]> wrote:

> > Yes, this all helps a bunch. I've been using substack's tape (
> https://github.com/substack/tape) and isaacs' tap (
> https://github.com/isaacs/node-tap) modules thus far.
>
> I've seen some users reporting issues in the tap-plugin for Jenkins where
> they were using node-tap. Hadn't heard about tape before.
>

If you have links to those issues, that would be most appreciated, since
I'll report them to isaacs. These days I'm using only substack/tape since
I'm doing mostly browser testing. Right now, I'm focused on aggregating the
test results. Once I try out a CI solution like Strider, Jenkins or Travis,
I planned on using tap. If you send me those issues, I might be able to
patch them once I get around to using tap with a CI server.


>
> > What I did just find is an implementation from Ovid from earlier this
> year in March:
> >
> >
> http://blogs.perl.org/users/ovid/2014/03/perlqa-hackathon-in-lyon---day-1.html
> https://github.com/Ovid/tap-stream
>
> I liked Ovid's implementation. One thing that i have added to my TODO list
> is to look at his examples and use some of them as regression tests in
> tap4j. I think it goes along with your previous suggestion of a set of
> tests for TAP (as in JSON?).
>

Yeah, standardized test suites are immensely useful. I'm not entirely
certain how it would work in this case of testing TAP compliancy though. I
guess JSON is one option (but wouldn't we then be defining yet another test
protocol?). JSON is the logical approach since it would mean that the TAP
examples server as tests for the JSON and vice versa, and all languages
have mature libraries for consuming JSON and working with JSON.

Even if there isn't a clear way to automate checking if an implementation
is correct (since the tests for each would have to be written in the
language of each implementation), just having a corpus of known valid
examples, would be immensely useful.


> > Seeing that Ovid is still actively working on this stuff (comments on
> tap on perlqa3 as recent as April this year), is it save to assume that
> there are ideas here that will make it into version 14? The test blocks you
> pointed to does reference version 14 in the example -->
> https://web.archive.org/web/20110611083916/http://testanything.org/wiki/index.php/Test_Blocks
>
> I'm not sure. Do you know if Ovid is in this list? Maybe we should check
> with him if he has interest in joining the thread and help crafting TAP 14
> too?
>
>

I emailed him at the email listed on his github profile. I reckon if he is
interested (or still subscribed via a different email address he's used in
the past), he'll participate directly.