[tap] interpretation of results

Michael Peters <mpeters@plusthree.com> Wed, 04 March 2009 15:32 UTC

Return-Path: <mpeters@plusthree.com>
X-Original-To: tap@core3.amsl.com
Delivered-To: tap@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 054D03A679F for <tap@core3.amsl.com>; Wed, 4 Mar 2009 07:32:48 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.74
X-Spam-Level:
X-Spam-Status: No, score=-0.74 tagged_above=-999 required=5 tests=[BAYES_20=-0.74]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id HeNhgAVHuRA9 for <tap@core3.amsl.com>; Wed, 4 Mar 2009 07:32:47 -0800 (PST)
Received: from mail.plusthree.com (mail.plusthree.com [70.42.42.197]) by core3.amsl.com (Postfix) with ESMTP id 381F33A6CA8 for <tap@ietf.org>; Wed, 4 Mar 2009 07:32:44 -0800 (PST)
Received: from localhost.localdomain (dsl093-241-113.ral1.dsl.speakeasy.net [66.93.241.113]) (authenticated bits=0) by mail.plusthree.com (8.14.2/8.14.2) with ESMTP id n24FGdhl027712 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for <tap@ietf.org>; Wed, 4 Mar 2009 10:16:40 -0500
Message-ID: <49AE9EAA.60508@plusthree.com>
Date: Wed, 04 Mar 2009 10:30:50 -0500
From: Michael Peters <mpeters@plusthree.com>
User-Agent: Thunderbird 2.0.0.19 (X11/20090105)
MIME-Version: 1.0
To: TAP <tap@ietf.org>
Content-Type: text/plain; charset="UTF-8"; format="flowed"
Content-Transfer-Encoding: 7bit
Subject: [tap] interpretation of results
X-BeenThere: tap@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: Test Anything Protocol WG discussions <tap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tap>
List-Post: <mailto:tap@ietf.org>
List-Help: <mailto:tap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Mar 2009 15:32:48 -0000

Given this TAP:

1..3
ok 1
not ok 2

Does it mean that 1 of 2 tests failed and we had a bad plan? Or does it mean the 
plan was right, but only 1 of 3 tests passed. Or in other words, is there a 3rd 
implicit failed test in there?

Smolder currently shows the user that 1 or 2 tests failed. Just wondering if 
this should be changed.
http://sourceforge.net/tracker/?func=detail&atid=818650&aid=2658074&group_id=161136

-- 
Michael Peters
Plus Three, LP