Re: [tap] RFC Status?

Leon Timmermans <fawaka@gmail.com> Tue, 23 September 2014 21:52 UTC

Return-Path: <fawaka@gmail.com>
X-Original-To: tap@ietfa.amsl.com
Delivered-To: tap@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 01B071A1BD8 for <tap@ietfa.amsl.com>; Tue, 23 Sep 2014 14:52:44 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.1
X-Spam-Level:
X-Spam-Status: No, score=-0.1 tagged_above=-999 required=5 tests=[BAYES_40=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id SSI6V6CtaT04 for <tap@ietfa.amsl.com>; Tue, 23 Sep 2014 14:52:41 -0700 (PDT)
Received: from mail-ie0-x22d.google.com (mail-ie0-x22d.google.com [IPv6:2607:f8b0:4001:c03::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 68EDC1A1B44 for <tap@ietf.org>; Tue, 23 Sep 2014 14:52:41 -0700 (PDT)
Received: by mail-ie0-f173.google.com with SMTP id tr6so10558534ieb.32 for <tap@ietf.org>; Tue, 23 Sep 2014 14:52:40 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=mGcktyTLIdauvgYdxWc1PavICXGXGW82A6ghPSNRenA=; b=Pq5OoZgxdLRDEOa74DKuP3pgTpQ7EO8yEzOmZqv61UBvjj7o6ZOZUuu7T1cJX37XTi wkmlTDNwxy4CkUcRqJMBM+KRLhpIlfcQiksGkhnvJwO41Dsoz4Vo3+4WNnX3/NehybZF HKBHrtQrX5Pebkzd2142qeEhc6h/21HW7AaKMBo+ymXcJtQAS6R9XLSHCDlumZQNi4kN jg82EpzwU9szndMhEPYr4A/RdRJNp49+uaUrYL6sOSUp97ZHgQWp/2gbTuL9+1hDUg0a ycq1fTXyv+Dc/zZEEyvPmpu8Vh6oGScDedqeLO9IZ8cXygp0rbDVqBgcIgzmFwHyIbMd 0LCw==
X-Received: by 10.43.70.142 with SMTP id yg14mr4068347icb.94.1411509160391; Tue, 23 Sep 2014 14:52:40 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.50.109.198 with HTTP; Tue, 23 Sep 2014 14:52:20 -0700 (PDT)
In-Reply-To: <87ppeof4oa.fsf@renormalist.net>
References: <CAP4gcszybVr5Hw3mg=uTi8tqpA3wEVwo=zf2876RWhy_CmozZw@mail.gmail.com> <CAHhgV8jr6ZnsfUkpFC4OL0AwRX-aen7v-7KjcN3e0_19s7steg@mail.gmail.com> <1410980929.82809.YahooMailNeo@web126106.mail.ne1.yahoo.com> <87bnqbwqhe.fsf@renormalist.net> <CAHhgV8gny-6ZJuec_83h0C+WbjAMXUA+JqLC6xgZj6FUAO-JTg@mail.gmail.com> <87ppeof4oa.fsf@renormalist.net>
From: Leon Timmermans <fawaka@gmail.com>
Date: Tue, 23 Sep 2014 23:52:20 +0200
Message-ID: <CAHhgV8g2RRb5nvSjjZhDfMyB+DY+M0LE9+A4-vhZ3koFq-muqw@mail.gmail.com>
To: Steffen Schwigon <ss5@renormalist.net>
Content-Type: multipart/alternative; boundary="bcaec517aa8e1a3d450503c296dc"
Archived-At: http://mailarchive.ietf.org/arch/msg/tap/fcv63o3VQTdO3WbHWUJAB7ZduwE
Cc: "tap@ietf.org" <tap@ietf.org>
Subject: Re: [tap] RFC Status?
X-BeenThere: tap@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Test Anything Protocol WG discussions <tap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tap>, <mailto:tap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tap/>
List-Post: <mailto:tap@ietf.org>
List-Help: <mailto:tap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 23 Sep 2014 21:52:44 -0000

On Mon, Sep 22, 2014 at 10:19 AM, Steffen Schwigon <ss5@renormalist.net>
wrote:

> Leon Timmermans <fawaka@gmail.com> writes:
> > On Fri, Sep 19, 2014 at 5:59 PM, Steffen Schwigon <ss5@renormalist.net>
> wrote:
> >     And here I seriously start to panic if that opinion should ever lead
> to
> >     deprecating YAMLish, as 1) it much better fits the philosophy of
> TAP's
> >     line-based'ness, 2) is easier to generate with line based tools,
> like in
> >     a shell-only world, and 3) zillions of test results are already
> based on
> >     it for the last 6 years. I'm not exaggerating here.
> >
> > I wasn't aware of anyone actually outputting YAML. Can you tell us more
> about this?
>
> With great pleasure. :-) Here we go:
>
> The Tapper test infrastructure (http://tapper-testing.org/) consumes it
> with the help of TAP::DOM, Data::DPath (and a handful marines), and it's
> generated for embedded benchmark data in projects like Perl::Formance
> (http://perlformance.net/), general supporting data in libs like
> "bash-test-utils"
> (
> https://github.com/tapper/Tapper-autoreport/blob/master/bash-test-utils.md
> )
> and similar, but less public projects. In general we use it in a
> restricted world like OS testing with only shell/printf/printk
> available.
>
> These projects might not look very active but that's only lack of github
> pushes due to lack of tuits (usually just once a year during the Perl QA
> hackathons). They are in very heavy use.
>
> Slide decks (bit old but still valid):
>  - http://tapper-testing.org/docs/yapc_eu_2011_tapjuggling.pdf - pg. 23,
> 37, 41
>  -
> http://tapper-testing.org/docs/linuxcon_eu_2011_linux_and_virtualization_testing_with_tapper.pdf
> pg. 35, 43
>

Right. I see in your docs you're using two spaces (like the website
suggests). I'd really like to pin that down, unlike the \s+ on the website;
that's fuzzier than I like.

How do you visualize the data?


> Two details make it harder to generate JSON than YAMLish:
>  - on generating: JSON is oversensitive to trailing comma before closing
> brackets/braces.
>    If you generate it from templates, like Template-Toolkit, you go mental.
>

Interesting. Never thought about it like that.

Leon