IETF Logo Mail Archive

Re: [tap] Thinking big

Michael Peters <mpeters@plusthree.com> Wed, 10 March 2010 20:02 UTC

Return-Path: <mpeters@plusthree.com>
X-Original-To: tap@core3.amsl.com
Delivered-To: tap@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 471783A69F2 for <tap@core3.amsl.com>; Wed, 10 Mar 2010 12:02:55 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.14
X-Spam-Level:
X-Spam-Status: No, score=-0.14 tagged_above=-999 required=5 tests=[BAYES_20=-0.74, J_CHICKENPOX_43=0.6]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id vjfK4OW5npQG for <tap@core3.amsl.com>; Wed, 10 Mar 2010 12:02:54 -0800 (PST)
Received: from mail.plusthree.com (mail.plusthree.com [70.42.42.197]) by core3.amsl.com (Postfix) with ESMTP id 6CD823A6926 for <tap@ietf.org>; Wed, 10 Mar 2010 12:02:54 -0800 (PST)
Received: from [10.0.0.2] (dsl093-241-113.ral1.dsl.speakeasy.net [66.93.241.113]) (authenticated bits=0) by mail.plusthree.com (8.14.2/8.14.2) with ESMTP id o2AJw1Ab005154 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 10 Mar 2010 14:58:03 -0500
Message-ID: <4B97FAA8.8090300@plusthree.com>
Date: Wed, 10 Mar 2010 15:01:44 -0500
From: Michael Peters <mpeters@plusthree.com>
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.8) Gecko/20100301 Fedora/3.0.3-1.fc11 Thunderbird/3.0.3
MIME-Version: 1.0
To: Salve J Nilsen <sjn@pvv.org>
References: <411886.95806.qm@web65707.mail.ac4.yahoo.com> <D9F21163-EC5A-4023-BD5D-9FCF60A86FBE@hexten.net> <91241.45851.qm@web65716.mail.ac4.yahoo.com> <alpine.DEB.1.00.1003102033060.2167@decibel.pvv.ntnu.no>
In-Reply-To: <alpine.DEB.1.00.1003102033060.2167@decibel.pvv.ntnu.no>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Cc: tap@ietf.org
Subject: Re: [tap] Thinking big
X-BeenThere: tap@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: Test Anything Protocol WG discussions <tap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tap>
List-Post: <mailto:tap@ietf.org>
List-Help: <mailto:tap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 10 Mar 2010 20:02:55 -0000

On 03/10/2010 02:55 PM, Salve J Nilsen wrote:

> What I'd love to see, is any necessary support in the protocol to let me
> save the complete results of a test run together with any related
> information that might be necessary to figure out why a failure happened.

This is why I created TAP::Harness::Archive. A TAP archive is basically 
a tarball of tap streams and a META.yml file which describes the test 
run. This includes in what order the files ran in, how long they took to 
run, etc. It also allows any extra files that might be important to 
tracking down a failure (like log files, etc).

-- 
Michael Peters
Plus Three, LP

v2.8.7 | Report a Bug | By Email