[tap] My TAP agenda for the QA Hackathon

Michael G Schwern <schwern@pobox.com> Tue, 17 March 2009 21:14 UTC

Return-Path: <schwern@pobox.com>
X-Original-To: tap@core3.amsl.com
Delivered-To: tap@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 38E403A6836 for <tap@core3.amsl.com>; Tue, 17 Mar 2009 14:14:37 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.74
X-Spam-Level:
X-Spam-Status: No, score=-0.74 tagged_above=-999 required=5 tests=[BAYES_20=-0.74]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id QEoQj9ybkWzI for <tap@core3.amsl.com>; Tue, 17 Mar 2009 14:14:36 -0700 (PDT)
Received: from sasl.smtp.pobox.com (a-sasl-quonix.sasl.smtp.pobox.com [208.72.237.25]) by core3.amsl.com (Postfix) with ESMTP id 349ED3A67FA for <tap@ietf.org>; Tue, 17 Mar 2009 14:14:34 -0700 (PDT)
Received: from localhost.localdomain (unknown [127.0.0.1]) by a-sasl-quonix.sasl.smtp.pobox.com (Postfix) with ESMTP id A8C73745C for <tap@ietf.org>; Tue, 17 Mar 2009 17:15:17 -0400 (EDT)
Received: from windhund.local (unknown [97.120.1.233]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by a-sasl-quonix.sasl.smtp.pobox.com (Postfix) with ESMTPSA id 52548745B for <tap@ietf.org>; Tue, 17 Mar 2009 17:15:17 -0400 (EDT)
Message-ID: <49C012E3.6030208@pobox.com>
Date: Tue, 17 Mar 2009 14:15:15 -0700
From: Michael G Schwern <schwern@pobox.com>
User-Agent: Thunderbird 2.0.0.19 (Macintosh/20081209)
MIME-Version: 1.0
To: TAP <tap@ietf.org>
X-Enigmail-Version: 0.95.7
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: 7bit
X-Pobox-Relay-ID: B6FCE504-1338-11DE-BB40-C5D912508E2D-02258300!a-sasl-quonix.pobox.com
Subject: [tap] My TAP agenda for the QA Hackathon
X-BeenThere: tap@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: Test Anything Protocol WG discussions <tap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tap>
List-Post: <mailto:tap@ietf.org>
List-Help: <mailto:tap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 17 Mar 2009 21:14:37 -0000

As some of you know, there's going to be a QA Hackathon in Birmingham, UK in a
week and a half.  http://qa-hackathon.org/  Myself, AndyA, Ovid and a few
others on here will be attending.  Last year in Oslo we got a lot of stuff
discussed about TAP and it was great.

Here's my agenda for this year:

I would like the focus to be about resolving existing problems and completing
proposed solutions rather than opening new discussions.  We half completed a
lot of stuff at the last hackathon and I want that old business closed.  I
want to walk out with a solid protocol and some prototype implementations.

First is getting the IETF draft done fully describing TAP in its current
state.  This includes a working grammar and all corner cases resolved.

Second, I would like to discuss a deprecation policy.  This includes revising
the version numbering and a list of things we would like to official deprecate
as part of the first IETF draft goes out.

Third, I would like to firmly resolve the extensions discussed at the last
hackathon.  First and foremost, I want to see the format of the structured
diagnostics resolved: YAML or JSON or something else; key reservation.  I want
nested/sub tests.  I want a logging syntax.

Fourth, I want the TAP test suite completed.  Mainly for the writer but also
for the reader.

Finally, I want a reference implementation of a TAP writer preferably working
directly from the grammar.

There will be plenty of work for programmers and non programmers alike.  TO
THE ANGRY DOME!


-- 
124. Two drink limit does not mean first and last.
    -- The 213 Things Skippy Is No Longer Allowed To Do In The U.S. Army
           http://skippyslist.com/list/