Re: [tap] Weird thought for the day: "skip 71 - reason"

Steffen Schwigon <ss5@renormalist.net> Sun, 07 March 2010 11:42 UTC

Return-Path: <ss5@renormalist.net>
X-Original-To: tap@core3.amsl.com
Delivered-To: tap@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 352BC28C15A for <tap@core3.amsl.com>; Sun, 7 Mar 2010 03:42:11 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.599
X-Spam-Level:
X-Spam-Status: No, score=-2.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id uyYn8fhCm571 for <tap@core3.amsl.com>; Sun, 7 Mar 2010 03:42:09 -0800 (PST)
Received: from h132974.serverkompetenz.net (renormalist.net [81.169.141.46]) by core3.amsl.com (Postfix) with ESMTP id AD86B28C12E for <tap@ietf.org>; Sun, 7 Mar 2010 03:42:09 -0800 (PST)
Received: by h132974.serverkompetenz.net (Postfix, from userid 1000) id B77F39AD4AB; Sun, 7 Mar 2010 12:42:12 +0100 (CET)
To: Salve J Nilsen <sjn@pvv.org>
References: <411886.95806.qm@web65707.mail.ac4.yahoo.com> <alpine.DEB.1.00.1003051654320.2167@decibel.pvv.ntnu.no>
From: Steffen Schwigon <ss5@renormalist.net>
Date: Sun, 07 Mar 2010 12:42:12 +0100
In-Reply-To: <alpine.DEB.1.00.1003051654320.2167@decibel.pvv.ntnu.no> (Salve J. Nilsen's message of "Fri\, 5 Mar 2010 16\:56\:40 +0100 \(CET\)")
Message-ID: <87k4towe7f.fsf@renormalist.net>
User-Agent: Gnus/5.11 (Gnus v5.11) Emacs/22.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Cc: tap@ietf.org
Subject: Re: [tap] Weird thought for the day: "skip 71 - reason"
X-BeenThere: tap@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: Test Anything Protocol WG discussions <tap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tap>
List-Post: <mailto:tap@ietf.org>
List-Help: <mailto:tap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 07 Mar 2010 11:42:11 -0000

Salve J Nilsen <sjn@pvv.org> writes:
> Ovid said:
>>
>> What does a skipped "not ok" test mean? Its behaviour is
>> undefined. This means that different parsers might implement this in
>> different ways.  It's an obscure edge case, but with greater
>> adoption of TAP, it might crop up.
>
> http://testanything.org/wiki/index.php/TAP_at_IETF:_Draft_Standard#The_.22SKIP.22_directive
>
>   "Since the test was skipped, the test result is expected to be "ok"
>   (indicating that the test was skipped correctly). A skipped test
>   with a result of "not ok" is suspicious, and the TAP consumer should
>   report a warning."
>
> I think this is pretty clear.... It means "something funky is going on
> in your test suite."

I agree. That's ok and enough.
I put more explanations in my neighbor post.

Kind regards,
Steffen 
-- 
Steffen Schwigon <ss5@renormalist.net>