IETF Logo Mail Archive

Re: [tap] Weird thought for the day: "skip 71 - reason"

Salve J Nilsen <sjn@pvv.org> Fri, 05 March 2010 15:56 UTC

Return-Path: <sjn@pvv.ntnu.no>
X-Original-To: tap@core3.amsl.com
Delivered-To: tap@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 9FA5B28C197 for <tap@core3.amsl.com>; Fri, 5 Mar 2010 07:56:40 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.6
X-Spam-Level:
X-Spam-Status: No, score=-2.6 tagged_above=-999 required=5 tests=[AWL=0.000, BAYES_00=-2.599, NO_RELAYS=-0.001]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id c7t2BBMt7uHA for <tap@core3.amsl.com>; Fri, 5 Mar 2010 07:56:39 -0800 (PST)
Received: from decibel.pvv.ntnu.no (decibel.pvv.ntnu.no [IPv6:2001:700:300:1900::1:2]) by core3.amsl.com (Postfix) with ESMTP id 575BD28C160 for <tap@ietf.org>; Fri, 5 Mar 2010 07:56:39 -0800 (PST)
Received: from sjn by decibel.pvv.ntnu.no with local (Exim 4.69) (envelope-from <sjn@pvv.ntnu.no>) id 1NnZtI-00006Z-2w; Fri, 05 Mar 2010 16:56:40 +0100
Date: Fri, 5 Mar 2010 16:56:40 +0100 (CET)
From: Salve J Nilsen <sjn@pvv.org>
X-X-Sender: sjn@decibel.pvv.ntnu.no
To: Ovid <publiustemp-tapx@yahoo.com>
In-Reply-To: <411886.95806.qm@web65707.mail.ac4.yahoo.com>
Message-ID: <alpine.DEB.1.00.1003051654320.2167@decibel.pvv.ntnu.no>
References: <411886.95806.qm@web65707.mail.ac4.yahoo.com>
User-Agent: Alpine 1.00 (DEB 882 2007-12-20)
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed
Cc: tap@ietf.org
Subject: Re: [tap] Weird thought for the day: "skip 71 - reason"
X-BeenThere: tap@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: Test Anything Protocol WG discussions <tap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tap>
List-Post: <mailto:tap@ietf.org>
List-Help: <mailto:tap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 05 Mar 2010 15:56:40 -0000

Ovid said:
>
> What does a skipped "not ok" test mean? Its behaviour is undefined. 
> This means that different parsers might implement this in different 
> ways.  It's an obscure edge case, but with greater adoption of TAP, 
> it might crop up.

http://testanything.org/wiki/index.php/TAP_at_IETF:_Draft_Standard#The_.22SKIP.22_directive

   "Since the test was skipped, the test result is expected to be "ok"
   (indicating that the test was skipped correctly). A skipped test
   with a result of "not ok" is suspicious, and the TAP consumer should
   report a warning."

I think this is pretty clear.... It means "something funky is going on 
in your test suite."


- Salve

-- 
#!/usr/bin/perl
sub AUTOLOAD{$AUTOLOAD=~/.*::(\d+)/;seek(DATA,$1,0);print#  Salve Joshua Nilsen
getc DATA}$"="'};&{'";@_=unpack("C*",unpack("u*",':4@,$'.#     <sjn@foo.no>
'2!--"5-(50P%$PL,!0X354UC-PP%/0\`'."\n"));eval "&{'@_'}";   __END__ is near! :)

v2.8.7 | Report a Bug | By Email