Re: Add extension work to Interop matrix

Lucas Pardue <lucaspardue.24.7@gmail.com> Tue, 07 January 2020 23:27 UTC

Return-Path: <lucaspardue.24.7@gmail.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E23ED120025 for <quic@ietfa.amsl.com>; Tue, 7 Jan 2020 15:27:58 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.748
X-Spam-Level:
X-Spam-Status: No, score=-1.748 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 82EH2_7oFViT for <quic@ietfa.amsl.com>; Tue, 7 Jan 2020 15:27:57 -0800 (PST)
Received: from mail-ua1-x92a.google.com (mail-ua1-x92a.google.com [IPv6:2607:f8b0:4864:20::92a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B6FD31207FE for <quic@ietf.org>; Tue, 7 Jan 2020 15:27:57 -0800 (PST)
Received: by mail-ua1-x92a.google.com with SMTP id 1so441453uao.1 for <quic@ietf.org>; Tue, 07 Jan 2020 15:27:57 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=fp7kFa4S5/+vm5MMhM90B4vl1mghNX3OnjhN+uB1Jfo=; b=FXRuHDB11NGCYpGjIQmfFou2Y2U+mGCxtcs8uLv5Z23I1OR0UNh20jtApZ3JObt27/ 84xYz1kLE4hzlzTN8Xlo06bH/ccIwqqK6KsrvN4lo8Kc8NyESYt+svuBa5E7jve293zA ogObKvodvNO20h1vNN60nguyGLUwvaHXeFTTy4zOW6CXwWbn6r8q6tBILyv/n9qKQlIn ZDTm7Fvyjbo6Oitn3BPnlEoVd0PzEo4TCns3KCrcFmHESf1yFfNLkM/Gv0G4Ff1180bn Pkc9r5fAAJQSu+/UlE3ZPoqIm6ok1ZUP5clsduKYXU3N5QGy7tkKsLJR2PEYKAZkqWWl wOLA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=fp7kFa4S5/+vm5MMhM90B4vl1mghNX3OnjhN+uB1Jfo=; b=Bc1lJ5s+2m0kOlDBm6ML3DLL9QT/mD7t6LdBGFN+GFBOPQwyGVZkiiC03BkveGFhFR f6aOoIpj1EkyaOqUPCSGkF920yp7bqaH7QFPAmE4Pf1XOC9QJ0jatHt9Gnd5ri0dOCZv M9RuBcX7FueqKOwnQOpeyAuN+Fvf6GSbjLvn6Cv4Uv/80rUBOM8BBNwfZo2bUotLeMWk 3+4p7h0XoryNkt9UhAN6gsyk8UMH3SVrJNC740ftx+y+XGRvQVrm8qj3YVO0bVPXFuvv uAKmsvtSmCvwVbTC1SP/gSmz085Iah1SklgTVovV4J35sA9FhKOPKXZHczJ6I98eE6Df Pkiw==
X-Gm-Message-State: APjAAAWv/ZQ5jk2a7uTFWtNdJ3ru8PPgFAIYLm2MPS3pqeYB/0egufyT CRzKCvA1+kGSqR8xybl+IKxx+Xx+UA+xBL/a4RM=
X-Google-Smtp-Source: APXvYqy9A0HxENKnAGK4un/IZuaI1qwVTgj4YaBmL9yL6OAb2ivjL7I3I80ioFq4vsnnR9nWWBAiTDGRF5W04X0XUv4=
X-Received: by 2002:ab0:71da:: with SMTP id n26mr1406249uao.102.1578439676795; Tue, 07 Jan 2020 15:27:56 -0800 (PST)
MIME-Version: 1.0
References: <20200107143114.GC14229@ubuntu-dmitri> <CALGR9oZ=nSsTeS02gmspTLAs1hFjJt2b+AmVUyMkGU1CuDHNCw@mail.gmail.com> <20200107155627.GF14229@ubuntu-dmitri> <CALGR9oZ_F86rVxDvY3dJYxKzAX+HHp=tZM1vBgiwFkdZTbAZtA@mail.gmail.com> <20200107184912.GH14229@ubuntu-dmitri> <CALGR9oYpB5dMOz5g=9a2mScO_2r_53xrmPnUFcXa2veXq0oKaw@mail.gmail.com> <8a6f9655780d4d4ba276d42ea36b645f@ustx2ex-dag1mb5.msg.corp.akamai.com>
In-Reply-To: <8a6f9655780d4d4ba276d42ea36b645f@ustx2ex-dag1mb5.msg.corp.akamai.com>
From: Lucas Pardue <lucaspardue.24.7@gmail.com>
Date: Tue, 07 Jan 2020 23:27:46 +0000
Message-ID: <CALGR9ob5LiQ2bdoo2pNLGS4VXp=iJQZB8ped4zFOSEy1vWwPSw@mail.gmail.com>
Subject: Re: Add extension work to Interop matrix
To: "Lubashev, Igor" <ilubashe@akamai.com>
Cc: IETF QUIC WG <quic@ietf.org>
Content-Type: multipart/alternative; boundary="0000000000003c1f00059b952010"
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/uH_uKjBgDdZTwGmKfWuvtdnQQ_4>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 07 Jan 2020 23:27:59 -0000

On Tue, 7 Jan 2020, 22:43 Lubashev, Igor, <ilubashe@akamai.com> wrote:

> Lucas, I think you are worried that letters were used to identify required
> features of QUIC V1, and adding optional “extension” letters to the mix
> would cause confusion.  Is that correct?
>

Yes my main concern is avoiding overloading things.

>  A single matrix with letters proved to be an effective way to summarize
> and report on the interop, so it is pretty clear why people interested in
> implementing extensions want to record their progress in this way.  Would
> it make more sense to you if there was a clear separation of QUIC V1
> feature interop from Extension interop results?  Like two matrices: “QUIC
> V1” and “Extensions”?
>
I think this is a good articulation of the benefit. Adding non WG
extensions to the matrix makes reporting on interop during the QUIC
sessions clunky.

IMO separating out V1 from other stuff is useful. Whether that's a single
matrix for all extensions or a collection of them is something that can be
worked through.

I am supportive of extension work and now seems like a good time to distill
what worked well and create some patterns to help and empower people,
rather than have them reinvent or feel restricted.

Extensions vary in their complexity, so it's hard to predict what letters
would be useful to articulate each features and interop tests. Just
considering DATAGRAM, this immediately gets complicated with the nuance of
HTTP/3 datagram. I can think of several useful tests in this domain. We
made some interop headway in Singapore, it would be nice to have a record
of that.

Cheers
Lucas

>