Re: [hybi] New WebSocket testsuite release

Tobias Oberstein <tobias.oberstein@tavendo.de> Fri, 14 March 2014 20:26 UTC

Return-Path: <tobias.oberstein@tavendo.de>
X-Original-To: hybi@ietfa.amsl.com
Delivered-To: hybi@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5507E1A01AC for <hybi@ietfa.amsl.com>; Fri, 14 Mar 2014 13:26:43 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.899
X-Spam-Level:
X-Spam-Status: No, score=-1.899 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id iJhtzE_rS28p for <hybi@ietfa.amsl.com>; Fri, 14 Mar 2014 13:26:40 -0700 (PDT)
Received: from EXHUB020-4.exch020.serverdata.net (exhub020-4.exch020.serverdata.net [206.225.164.31]) by ietfa.amsl.com (Postfix) with ESMTP id 36EA11A0196 for <hybi@ietf.org>; Fri, 14 Mar 2014 13:26:40 -0700 (PDT)
Received: from EXVMBX020-12.exch020.serverdata.net ([169.254.3.76]) by EXHUB020-4.exch020.serverdata.net ([206.225.164.31]) with mapi; Fri, 14 Mar 2014 13:26:33 -0700
From: Tobias Oberstein <tobias.oberstein@tavendo.de>
To: Joakim Erdfelt <joakim@intalio.com>
Date: Fri, 14 Mar 2014 13:26:31 -0700
Thread-Topic: [hybi] New WebSocket testsuite release
Thread-Index: Ac8/w0O8gJZvziKPTleGbks83xWq7wAACCtQ
Message-ID: <634914A010D0B943A035D226786325D44473A2CB10@EXVMBX020-12.exch020.serverdata.net>
References: <634914A010D0B943A035D226786325D44473A2CAF0@EXVMBX020-12.exch020.serverdata.net> <CAG4zZZDwnVkwfqpnOfqOoffpmm0uGmZV6wHJJa8GBdn_NKSFOA@mail.gmail.com>
In-Reply-To: <CAG4zZZDwnVkwfqpnOfqOoffpmm0uGmZV6wHJJa8GBdn_NKSFOA@mail.gmail.com>
Accept-Language: de-DE, en-US
Content-Language: de-DE
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: de-DE, en-US
Content-Type: multipart/alternative; boundary="_000_634914A010D0B943A035D226786325D44473A2CB10EXVMBX02012ex_"
MIME-Version: 1.0
Archived-At: http://mailarchive.ietf.org/arch/msg/hybi/qQUXBDdZGvAs6svTOVh0jF6BSAQ
Cc: "hybi@ietf.org" <hybi@ietf.org>
Subject: Re: [hybi] New WebSocket testsuite release
X-BeenThere: hybi@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Server-Initiated HTTP <hybi.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hybi>, <mailto:hybi-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/hybi/>
List-Post: <mailto:hybi@ietf.org>
List-Help: <mailto:hybi-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hybi>, <mailto:hybi-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 14 Mar 2014 20:26:43 -0000

no, sorry, lack of time (this whole testsuite baby already ate much much more time I ever planned for)

"opening handshake" testing is still missing ..

the fuzzing kicks in after handshake .. also rgd permessage-deflate .. but it will catch if the implementation is wrong wrt to the negotiated parameters.

Von: Joakim Erdfelt [mailto:joakim@intalio.com]
Gesendet: Freitag, 14. März 2014 21:23
An: Tobias Oberstein
Cc: hybi@ietf.org
Betreff: Re: [hybi] New WebSocket testsuite release

Any new negotiation checks yet?

Such as the more strict Sec-WebSocket-Protocol rules from Chrome 33 (courtesy of the Javascript WebSocket API)?


--
Joakim Erdfelt <joakim@intalio.com<mailto:joakim@intalio.com>>
webtide.com<http://www.webtide.com/> - intalio.com/jetty<http://intalio.com/jetty>
Expert advice, services and support from from the Jetty & CometD experts
eclipse.org/jetty<http://eclipse.org/jetty/> - cometd.org<http://cometd.org/>

On Fri, Mar 14, 2014 at 1:14 PM, Tobias Oberstein <tobias.oberstein@tavendo.de<mailto:tobias.oberstein@tavendo.de>> wrote:
Hello,

we've just released a new version 0.6.1 of Autobahn|Testsuite which now includes >500 test cases in total.

https://pypi.python.org/pypi/autobahntestsuite

The new test cases are all for "permessage-deflate" (test sections 12 and 13) and now cover

- various different parameter negotiations
- message fragmentation with permessage-deflate

everything of course both for testee clients and testee servers.

Here are Chrome and Autobahn (client) .. scroll down to sections 12/13 for the new tests:

http://autobahn.ws/testsuite/reports_20140314/clients/index.html

Roadmap:
If time permits, we'll be working on adding "permessage-priority" to both Autobahn|Python and Autobahn|Testsuite
https://github.com/oberstet/permessage-priority/blob/master/draft-oberstein-hybi-permessage-priority.txt

Cheers,
/Tobias

_______________________________________________
hybi mailing list
hybi@ietf.org<mailto:hybi@ietf.org>
https://www.ietf.org/mailman/listinfo/hybi