IETF Logo Mail Archive

Re: [tap] Thinking big

Salve J Nilsen <sjn@pvv.org> Wed, 10 March 2010 20:08 UTC

Return-Path: <sjn@pvv.ntnu.no>
X-Original-To: tap@core3.amsl.com
Delivered-To: tap@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id DD5B93A6A10 for <tap@core3.amsl.com>; Wed, 10 Mar 2010 12:08:23 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.3
X-Spam-Level:
X-Spam-Status: No, score=-2.3 tagged_above=-999 required=5 tests=[AWL=-0.300, BAYES_00=-2.599, J_CHICKENPOX_43=0.6, NO_RELAYS=-0.001]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id loqpLzqEeAOr for <tap@core3.amsl.com>; Wed, 10 Mar 2010 12:08:23 -0800 (PST)
Received: from decibel.pvv.ntnu.no (decibel.pvv.ntnu.no [IPv6:2001:700:300:1900::1:2]) by core3.amsl.com (Postfix) with ESMTP id B99863A6963 for <tap@ietf.org>; Wed, 10 Mar 2010 12:08:22 -0800 (PST)
Received: from sjn by decibel.pvv.ntnu.no with local (Exim 4.69) (envelope-from <sjn@pvv.ntnu.no>) id 1NpSCc-0006Ye-Gu; Wed, 10 Mar 2010 21:08:22 +0100
Date: Wed, 10 Mar 2010 21:08:22 +0100 (CET)
From: Salve J Nilsen <sjn@pvv.org>
X-X-Sender: sjn@decibel.pvv.ntnu.no
To: Michael Peters <mpeters@plusthree.com>
In-Reply-To: <4B97FAA8.8090300@plusthree.com>
Message-ID: <alpine.DEB.1.00.1003102103550.2167@decibel.pvv.ntnu.no>
References: <411886.95806.qm@web65707.mail.ac4.yahoo.com> <D9F21163-EC5A-4023-BD5D-9FCF60A86FBE@hexten.net> <91241.45851.qm@web65716.mail.ac4.yahoo.com> <alpine.DEB.1.00.1003102033060.2167@decibel.pvv.ntnu.no> <4B97FAA8.8090300@plusthree.com>
User-Agent: Alpine 1.00 (DEB 882 2007-12-20)
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed
Cc: tap@ietf.org
Subject: Re: [tap] Thinking big
X-BeenThere: tap@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: Test Anything Protocol WG discussions <tap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tap>
List-Post: <mailto:tap@ietf.org>
List-Help: <mailto:tap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 10 Mar 2010 20:08:24 -0000

Michael Peters said:
> On 03/10/2010 02:55 PM, Salve J Nilsen wrote:
>
>> What I'd love to see, is any necessary support in the protocol to 
>> let me save the complete results of a test run together with any 
>> related information that might be necessary to figure out why a 
>> failure happened.
>
> This is why I created TAP::Harness::Archive. A TAP archive is 
> basically a tarball of tap streams and a META.yml file which 
> describes the test run. This includes in what order the files ran 
> in, how long they took to run, etc. It also allows any extra files 
> that might be important to tracking down a failure (like log files, 
> etc).

Right. Are there any specific features in the TAP stream you're 
missing? (E.g. system information, uname(1) output, timestamps, perl 
version, module versions, ..)

Or approaching from another directions: Do you know of any very useful 
features available some continuous integration frameworks (or similar) 
that could me made better or possible with the right kind of 
environment/meta information from each single test run?


- Salve

-- 
#!/usr/bin/perl
sub AUTOLOAD{$AUTOLOAD=~/.*::(\d+)/;seek(DATA,$1,0);print#  Salve Joshua Nilsen
getc DATA}$"="'};&{'";@_=unpack("C*",unpack("u*",':4@,$'.#     <sjn@foo.no>
'2!--"5-(50P%$PL,!0X354UC-PP%/0\`'."\n"));eval "&{'@_'}";   __END__ is near! :)

v2.8.7 | Report a Bug | By Email