[tap] Indicating errors in the test suite

[Salve J Nilsen <[e-mail]>]

Hey!

Just wanted to get some clarity, to see if I've understood things 
correctly.

In any test suite we have basically two error conditions:

1) Errors in the code that's being tested with the test suite. This is
    the main purpose of a test suite.

2) Errors in the test suite code itself.


Detecting cases of 1) is pretty straightforward as long as you have 
tests for it, but for detecting 2) we just have four "indirect" 
indicators of their presence:

1) "not ok # SKIP" - We intended to skip, but failed somehow
2) "ok # TODO" - A test unexpectedly succeeded
3) Mismatch between plan and number of tests that were done.
4) Shell return codes that are unexpected.

- Do we have any other indicators?
- Should we say something about subprocess return codes in the TAP
   standard?


- Salve

-- 
#!/usr/bin/perl
sub AUTOLOAD{$AUTOLOAD=~/.*::(\d+)/;seek(DATA,$1,0);print#  Salve Joshua Nilsen
getc DATA}$"="'};&{'";@_=unpack("C*",unpack("u*",':4@,$'.#     <[e-mail]>
'2!--"5-(50P%$PL,!0X354UC-PP%/0\`'."\n"));eval "&{'@_'}";   __END__ is near! :)