RE: Add extension work to Interop matrix

"Lubashev, Igor" <ilubashe@akamai.com> Tue, 07 January 2020 22:43 UTC

Return-Path: <ilubashe@akamai.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9024F1200A3 for <quic@ietfa.amsl.com>; Tue, 7 Jan 2020 14:43:36 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2
X-Spam-Level:
X-Spam-Status: No, score=-2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=akamai.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id iIWYF5Ty54Kv for <quic@ietfa.amsl.com>; Tue, 7 Jan 2020 14:43:35 -0800 (PST)
Received: from mx0b-00190b01.pphosted.com (mx0b-00190b01.pphosted.com [IPv6:2620:100:9005:57f::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1D6A2120025 for <quic@ietf.org>; Tue, 7 Jan 2020 14:43:35 -0800 (PST)
Received: from pps.filterd (m0122330.ppops.net [127.0.0.1]) by mx0b-00190b01.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 007Mge7Z004919; Tue, 7 Jan 2020 22:43:33 GMT
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=akamai.com; h=from : to : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=jan2016.eng; bh=wMlW5Fv6xCDLI9byLlQ8xm8DUmumrHKe1EvS9AmQdFA=; b=CNlHLpBGzlu04u8mND8nmLzIlbJKyFEz7KJlOEhTaue2EVkNsTokzt3tJzEzKxp62puP Kg9UkpvKCi/IMpID8q4BwiwiQjZvVNpRUqUEsmihsNr9cAsnwZ+IaykOnR/5uYohs8p8 59s3/whYbRgHi00Q1tMluU+z5k8a1MXNq1cFrF2HbV5Dc+o4He4yy6fIu5fbzQgauk2S //VWtAFFM3w30m522XIkTj89HtXOI8cvNSuffHFDDTP63vbmBFQIjiwRtGJPUStz8kJF PHQNfioHK5vIL4tsNhexaA6whJoIahTDpt5cW+EjmhI7QgM2oK1nSKUmfKX3LDX1nAW7 aA==
Received: from prod-mail-ppoint5 (prod-mail-ppoint5.akamai.com [184.51.33.60] (may be forged)) by mx0b-00190b01.pphosted.com with ESMTP id 2xcbhgwss0-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 07 Jan 2020 22:43:32 +0000
Received: from pps.filterd (prod-mail-ppoint5.akamai.com [127.0.0.1]) by prod-mail-ppoint5.akamai.com (8.16.0.27/8.16.0.27) with SMTP id 007MWPw0003688; Tue, 7 Jan 2020 14:43:31 -0800
Received: from email.msg.corp.akamai.com ([172.27.165.113]) by prod-mail-ppoint5.akamai.com with ESMTP id 2xasjaxsrc-5 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Tue, 07 Jan 2020 14:43:29 -0800
Received: from USTX2EX-DAG1MB5.msg.corp.akamai.com (172.27.165.123) by ustx2ex-dag1mb1.msg.corp.akamai.com (172.27.165.119) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Tue, 7 Jan 2020 16:42:19 -0600
Received: from USTX2EX-DAG1MB5.msg.corp.akamai.com ([172.27.165.123]) by ustx2ex-dag1mb5.msg.corp.akamai.com ([172.27.165.123]) with mapi id 15.00.1473.005; Tue, 7 Jan 2020 16:42:19 -0600
From: "Lubashev, Igor" <ilubashe@akamai.com>
To: Lucas Pardue <lucaspardue.24.7@gmail.com>, IETF QUIC WG <quic@ietf.org>
Subject: RE: Add extension work to Interop matrix
Thread-Topic: Add extension work to Interop matrix
Thread-Index: AQHVxWcmFO4FvlorkkiDPV0H6cxhlKfftLwAgAALFICAAB6rgIAAEZqAgAAIFoD//8/ZIA==
Date: Tue, 07 Jan 2020 22:42:19 +0000
Message-ID: <8a6f9655780d4d4ba276d42ea36b645f@ustx2ex-dag1mb5.msg.corp.akamai.com>
References: <20200107143114.GC14229@ubuntu-dmitri> <CALGR9oZ=nSsTeS02gmspTLAs1hFjJt2b+AmVUyMkGU1CuDHNCw@mail.gmail.com> <20200107155627.GF14229@ubuntu-dmitri> <CALGR9oZ_F86rVxDvY3dJYxKzAX+HHp=tZM1vBgiwFkdZTbAZtA@mail.gmail.com> <20200107184912.GH14229@ubuntu-dmitri> <CALGR9oYpB5dMOz5g=9a2mScO_2r_53xrmPnUFcXa2veXq0oKaw@mail.gmail.com>
In-Reply-To: <CALGR9oYpB5dMOz5g=9a2mScO_2r_53xrmPnUFcXa2veXq0oKaw@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-exchange-transport-fromentityheader: Hosted
x-originating-ip: [172.19.116.113]
Content-Type: multipart/alternative; boundary="_000_8a6f9655780d4d4ba276d42ea36b645fustx2exdag1mb5msgcorpak_"
MIME-Version: 1.0
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2020-01-07_07:, , signatures=0
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 mlxscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1911140001 definitions=main-2001070178
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.138, 18.0.572 definitions=2020-01-07_07:2020-01-07, 2020-01-07 signatures=0
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 adultscore=0 mlxlogscore=999 bulkscore=0 impostorscore=0 mlxscore=0 spamscore=0 malwarescore=0 suspectscore=0 clxscore=1015 lowpriorityscore=0 priorityscore=1501 phishscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-1910280000 definitions=main-2001070179
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/rDsgyTBkd-aGD8U9OlXyuJl0w54>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 07 Jan 2020 22:43:36 -0000

Lucas, I think you are worried that letters were used to identify required features of QUIC V1, and adding optional “extension” letters to the mix would cause confusion.  Is that correct?

A single matrix with letters proved to be an effective way to summarize and report on the interop, so it is pretty clear why people interested in implementing extensions want to record their progress in this way.  Would it make more sense to you if there was a clear separation of QUIC V1 feature interop from Extension interop results?  Like two matrices: “QUIC V1” and “Extensions”?


  *   Igor


From: Lucas Pardue <lucaspardue.24.7@gmail.com>

On Tue, Jan 7, 2020 at 6:49 PM Dmitri Tikhonov <dtikhonov@litespeedtech.com<mailto:dtikhonov@litespeedtech.com>> wrote:

I get the feeling we are talking past each other.  Do you not
acknowledge the evanescent nature of the Interop matrix

You want to impose artificial strictures on the way the Interop
results are recorded because it may scale poorly, but this argument
is invalid:  To "scale," we can simply choose to do record things
differently for the next Interop.

The standardisation process is iterative but to date we've followed a fairly rudimentary pattern where each incarnation of the matrix relates to a specific implementation draft, which in turn relates to some set of versioned drafts. The proposal changes the pattern to now consider extensions. Across the sheets we have little evidence of burning or substituted letters, so its not clear how people would read into such a occurrence.

The scaling problem is not invalid. Parsing the interop matrix, even in its current form, is not user-friendly, especially for those not actively engaged in the process.

We all share the matrix. Adding letters might help you but it doesn't help me.

Lucas


  - Dmitri.