RE: Header Compression: Reference set choice

Mike Bishop <Michael.Bishop@microsoft.com> Tue, 30 July 2013 23:25 UTC

Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B7E9421E8100 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Tue, 30 Jul 2013 16:25:51 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.467
X-Spam-Level:
X-Spam-Status: No, score=-7.467 tagged_above=-999 required=5 tests=[AWL=0.000, BAYES_00=-2.599, RCVD_IN_DNSWL_HI=-8, UNRESOLVED_TEMPLATE=3.132]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2TRYXiusGh-W for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Tue, 30 Jul 2013 16:25:45 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id 8472721E80D5 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Tue, 30 Jul 2013 16:25:45 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1V4JH3-0005al-PM for ietf-http-wg-dist@listhub.w3.org; Tue, 30 Jul 2013 23:24:13 +0000
Resent-Date: Tue, 30 Jul 2013 23:24:13 +0000
Resent-Message-Id: <E1V4JH3-0005al-PM@frink.w3.org>
Received: from lisa.w3.org ([128.30.52.41]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <Michael.Bishop@microsoft.com>) id 1V4JGo-0005ZR-7M for ietf-http-wg@listhub.w3.org; Tue, 30 Jul 2013 23:23:58 +0000
Received: from co1ehsobe006.messaging.microsoft.com ([216.32.180.189] helo=co1outboundpool.messaging.microsoft.com) by lisa.w3.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.72) (envelope-from <Michael.Bishop@microsoft.com>) id 1V4JGm-0003BV-QE for ietf-http-wg@w3.org; Tue, 30 Jul 2013 23:23:58 +0000
Received: from mail152-co1-R.bigfish.com (10.243.78.226) by CO1EHSOBE036.bigfish.com (10.243.66.101) with Microsoft SMTP Server id 14.1.225.22; Tue, 30 Jul 2013 23:23:30 +0000
Received: from mail152-co1 (localhost [127.0.0.1]) by mail152-co1-R.bigfish.com (Postfix) with ESMTP id 2CCDB18020A for <ietf-http-wg@w3.org>; Tue, 30 Jul 2013 23:23:30 +0000 (UTC)
X-Forefront-Antispam-Report: CIP:131.107.125.8; KIP:(null); UIP:(null); IPV:NLI; H:TK5EX14HUBC102.redmond.corp.microsoft.com; RD:autodiscover.service.exchange.microsoft.com; EFVD:NLI
X-SpamScore: -13
X-BigFish: VS-13(zz9371Ic89bh542Idb82hd997mzz1f42h208ch1ee6h1de0h1fdah2073h1202h1e76h1d1ah1d2ah1fc6hzz1de098h1033IL17326ah1de096h8275dh1de097hz2fh2a8h683h839h947hd24hf0ah1288h12a5h12a9h12bdh137ah13b6h1441h1504h1537h153bh162dh1631h1758h18e1h1946h19b5h1b0ah1d07h1d0ch1d2eh1d3fh1de9h1dfeh1dffh1e1dh17ej9a9j1155h)
Received-SPF: pass (mail152-co1: domain of microsoft.com designates 131.107.125.8 as permitted sender) client-ip=131.107.125.8; envelope-from=Michael.Bishop@microsoft.com; helo=TK5EX14HUBC102.redmond.corp.microsoft.com ; icrosoft.com ;
X-Forefront-Antispam-Report-Untrusted: CIP:157.56.240.21; KIP:(null); UIP:(null); (null); H:BL2PRD0310HT003.namprd03.prod.outlook.com; R:internal; EFV:INT
Received: from mail152-co1 (localhost.localdomain [127.0.0.1]) by mail152-co1 (MessageSwitch) id 1375226607996533_13243; Tue, 30 Jul 2013 23:23:27 +0000 (UTC)
Received: from CO1EHSMHS006.bigfish.com (unknown [10.243.78.245]) by mail152-co1.bigfish.com (Postfix) with ESMTP id E5AEA100047 for <ietf-http-wg@w3.org>; Tue, 30 Jul 2013 23:23:27 +0000 (UTC)
Received: from TK5EX14HUBC102.redmond.corp.microsoft.com (131.107.125.8) by CO1EHSMHS006.bigfish.com (10.243.66.16) with Microsoft SMTP Server (TLS) id 14.16.227.3; Tue, 30 Jul 2013 23:23:27 +0000
Received: from ch1outboundpool.messaging.microsoft.com (157.54.51.113) by mail.microsoft.com (157.54.7.154) with Microsoft SMTP Server (TLS) id 14.3.136.1; Tue, 30 Jul 2013 23:22:18 +0000
Received: from mail140-ch1-R.bigfish.com (10.43.68.254) by CH1EHSOBE009.bigfish.com (10.43.70.59) with Microsoft SMTP Server id 14.1.225.22; Tue, 30 Jul 2013 23:20:31 +0000
Received: from mail140-ch1 (localhost [127.0.0.1]) by mail140-ch1-R.bigfish.com (Postfix) with ESMTP id 402542007A for <ietf-http-wg@w3.org.FOPE.CONNECTOR.OVERRIDE>; Tue, 30 Jul 2013 23:20:31 +0000 (UTC)
X-Forefront-Antispam-Report-Untrusted: SFV:NSPM; SFS:(13464003)(377454003)(189002)(199002)(46102001)(47446002)(19580395003)(4396001)(54356001)(74876001)(77982001)(83322001)(80976001)(33646001)(79102001)(76482001)(19580385001)(19580405001)(54316002)(83072001)(65816001)(59766001)(63696002)(56816003)(49866001)(74706001)(561944002)(31966008)(16406001)(77096001)(81342001)(74502001)(81542001)(74662001)(76576001)(80022001)(53806001)(50986001)(47736001)(47976001)(76786001)(56776001)(69226001)(15202345003)(74316001)(51856001)(76796001)(74366001)(557034004)(24736002)(3826001); DIR:OUT; SFP:; SCL:1; SRVR:BY2PR03MB025; H:BY2PR03MB025.namprd03.prod.outlook.com; CLIP:2001:4898:80e0:ed43::70; RD:InfoNoRecords; MX:1; A:1; LANG:en;
Received: from mail140-ch1 (localhost.localdomain [127.0.0.1]) by mail140-ch1 (MessageSwitch) id 1375226429786053_21667; Tue, 30 Jul 2013 23:20:29 +0000 (UTC)
Received: from CH1EHSMHS031.bigfish.com (snatpool3.int.messaging.microsoft.com [10.43.68.227]) by mail140-ch1.bigfish.com (Postfix) with ESMTP id BBC6338005E; Tue, 30 Jul 2013 23:20:29 +0000 (UTC)
Received: from BL2PRD0310HT003.namprd03.prod.outlook.com (157.56.240.21) by CH1EHSMHS031.bigfish.com (10.43.70.31) with Microsoft SMTP Server (TLS) id 14.16.227.3; Tue, 30 Jul 2013 23:20:29 +0000
Received: from BY2PR03MB025.namprd03.prod.outlook.com (10.255.240.39) by BL2PRD0310HT003.namprd03.prod.outlook.com (10.255.97.38) with Microsoft SMTP Server (TLS) id 14.16.341.1; Tue, 30 Jul 2013 23:20:28 +0000
Received: from BY2PR03MB025.namprd03.prod.outlook.com (10.255.240.39) by BY2PR03MB025.namprd03.prod.outlook.com (10.255.240.39) with Microsoft SMTP Server (TLS) id 15.0.731.16; Tue, 30 Jul 2013 23:20:26 +0000
Received: from BY2PR03MB025.namprd03.prod.outlook.com ([169.254.8.202]) by BY2PR03MB025.namprd03.prod.outlook.com ([169.254.8.202]) with mapi id 15.00.0731.000; Tue, 30 Jul 2013 23:20:26 +0000
From: Mike Bishop <Michael.Bishop@microsoft.com>
To: RUELLAN Herve <Herve.Ruellan@crf.canon.fr>, "ietf-http-wg@w3.org" <ietf-http-wg@w3.org>
Thread-Topic: Header Compression: Reference set choice
Thread-Index: AQHOjTSJ6FyTjasTx0SXocMiJofNQ5l92DJQ
Date: Tue, 30 Jul 2013 23:20:25 +0000
Message-ID: <3ae445ca04f24fcda596dd818f3daef4@BY2PR03MB025.namprd03.prod.outlook.com>
References: <6C71876BDCCD01488E70A2399529D5E52F456E58@ADELE.crf.canon.fr>
In-Reply-To: <6C71876BDCCD01488E70A2399529D5E52F456E58@ADELE.crf.canon.fr>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [2001:4898:80e0:ed43::70]
x-forefront-prvs: 0923977CCA
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OrganizationHeadersPreserved: BY2PR03MB025.namprd03.prod.outlook.com
X-FOPE-CONNECTOR: Id%0$Dn%*$RO%0$TLS%0$FQDN%$TlsDn%
X-FOPE-CONNECTOR: Id%59$Dn%W3.ORG$RO%2$TLS%6$FQDN%corpf5vips-237160.customer.frontbridge.com$TlsDn%
X-FOPE-CONNECTOR: Id%59$Dn%CRF.CANON.FR$RO%2$TLS%6$FQDN%corpf5vips-237160.customer.frontbridge.com$TlsDn%
X-CrossPremisesHeadersPromoted: TK5EX14HUBC102.redmond.corp.microsoft.com
X-CrossPremisesHeadersFiltered: TK5EX14HUBC102.redmond.corp.microsoft.com
X-OriginatorOrg: microsoft.com
X-FOPE-CONNECTOR: Id%0$Dn%*$RO%0$TLS%0$FQDN%$TlsDn%
Received-SPF: pass client-ip=216.32.180.189; envelope-from=Michael.Bishop@microsoft.com; helo=co1outboundpool.messaging.microsoft.com
X-W3C-Hub-Spam-Status: No, score=-1.5
X-W3C-Hub-Spam-Report: RCVD_IN_DNSWL_LOW=-0.7, RP_MATCHES_RCVD=-1.544, SPF_PASS=-0.001, UNRESOLVED_TEMPLATE=0.716
X-W3C-Scan-Sig: lisa.w3.org 1V4JGm-0003BV-QE f0ea7fe48509f80d9f7c77a6b681e49f
X-Original-To: ietf-http-wg@w3.org
Subject: RE: Header Compression: Reference set choice
Archived-At: <http://www.w3.org/mid/3ae445ca04f24fcda596dd818f3daef4@BY2PR03MB025.namprd03.prod.outlook.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/18993
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

Couldn't this also be closely approached simply by allowing a range of Indexed Headers along with a HEADERS flag to clear the reference set before processing the frame?

This implies that the interesting headers need to be contiguous in the table.  That's not necessarily the case (in my implementations so far, anyway), and would require some form of insert mechanism to make it really convenient for a compressor to leverage it, as you mention in 6.4.  If Range were an operation, multiple disjoint ranges could be quickly added, helping to alleviate that need.

If we're going to introduce multiple reference sets, I'd be more inclined to the version that appeared in Roberto's original proposals of being able to select from a bounded number of reference sets for each header set.  Each reference set begins empty, gets filled the first time it's used, and remains thereafter.

-----Original Message-----
From: RUELLAN Herve [mailto:Herve.Ruellan@crf.canon.fr] 
Sent: Tuesday, July 30, 2013 7:53 AM
To: ietf-http-wg@w3.org
Subject: Header Compression: Reference set choice

We did some work on the diff part of the header compression format, and are proposing enhancements to the choice of the reference set used to encode a new header set (i.e. the starting point for the diff). This is detailed in a draft:
http://tools.ietf.org/html/draft-ruellan-reference-set-definition-00

This is still work in progress, as we didn't have time to do enough measurement, in particular on long lasting connections.

Comments are welcome,

Hervé.