Re: New Version Notification for draft-vkrasnov-h2-compression-dictionaries-01.txt

Jyrki Alakuijala <jyrki@google.com> Thu, 03 November 2016 10:36 UTC

Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4765112995C for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 3 Nov 2016 03:36:14 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.997
X-Spam-Level:
X-Spam-Status: No, score=-7.997 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_SORBS_SPAM=0.5, RP_MATCHES_RCVD=-1.497, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=google.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zMsgGfmJqbdK for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 3 Nov 2016 03:36:13 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3CB091298C6 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Thu, 3 Nov 2016 03:36:13 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.80) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1c2FKH-00034q-SJ for ietf-http-wg-dist@listhub.w3.org; Thu, 03 Nov 2016 10:32:53 +0000
Resent-Date: Thu, 03 Nov 2016 10:32:53 +0000
Resent-Message-Id: <E1c2FKH-00034q-SJ@frink.w3.org>
Received: from titan.w3.org ([128.30.52.76]) by frink.w3.org with esmtps (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from <jyrki@google.com>) id 1c2FKC-00030H-Tp for ietf-http-wg@listhub.w3.org; Thu, 03 Nov 2016 10:32:48 +0000
Received: from mail-oi0-f41.google.com ([209.85.218.41]) by titan.w3.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.84_2) (envelope-from <jyrki@google.com>) id 1c2FK6-0006PU-Ry for ietf-http-wg@w3.org; Thu, 03 Nov 2016 10:32:43 +0000
Received: by mail-oi0-f41.google.com with SMTP id 128so78036530oih.0 for <ietf-http-wg@w3.org>; Thu, 03 Nov 2016 03:32:22 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=lRMYDtuHsNuUxvsgz/KyyuU8zj3rUt1mCdaS40MsHDA=; b=IXwh1npyj7O2yJSbEjq8arUV5q7jBMPOgDRZLOcb/bZjCmBxFUoRY59oaDkOopkm9q lmpXjSG6uDj+Hm0IdZIjRe4HHPoWIxYy4KytDX8LbdRGkSqTNJwycY2IxB64ZLkgqEXZ WkY9eki4XX8lTuVnHEMj2vmAx+ZhVNn6dFxQVQLLehwHRqZ5kj8Th6vPKAOKyPpzNxcr HDfSQg6AqQumwGDKgJggQMbsLU6WVrf8sL/TyN4jzbHl9Ug6jTNaiuBE3RxEAX8REGd4 ZE+vaYfls8xbr74nlLzO4fMrw7FsA5Ng1Z18dM2F8yRWdWAvB5aXAmETiREyTuacY0+8 3VeA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=lRMYDtuHsNuUxvsgz/KyyuU8zj3rUt1mCdaS40MsHDA=; b=AEHCL2cg8/i2sSCD93KA+LmxVEXM1gJBZJoalEYF5rVQLPG/vSd/owpI7/5hPpA6Bz tUqmcZA9pMV/+qVWWWXs5DaETzuftLyfp2098pP5r5waKCRjBapS6LRj2Iwiyqz3TGHL kUbMMKHNIr0fGMYuc1wda3OVaYHplIUpBCoqJKWA50lt3q08+2C9xnyWGRr4tOGp+s2E d0BimBLmRVewTrXIt0dX7sDVyRNhyN9ATMNMVtlb6yALcY4r4hcsLLbQQ297GPzxW1t8 oJxNJKpnH9oxJlM+sFB2finJUR/wLoGNTeJtUl52XSd7ExinNoaT0Az0wzzz9UXD5FpZ AsoQ==
X-Gm-Message-State: ABUngvfca49udhT3XtMu6daNMNPvv6qVm7rx5kt6o0akWnkt3ikDddo3+vXW5edKpwLm7Tfx4P7TNPDkARG45EZa
X-Received: by 10.107.17.205 with SMTP id 74mr7894929ior.96.1478169135614; Thu, 03 Nov 2016 03:32:15 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.64.225.115 with HTTP; Thu, 3 Nov 2016 03:32:14 -0700 (PDT)
In-Reply-To: <568945A1-75B6-4E9D-9021-38479FC55580@cloudflare.com>
References: <147793576451.32369.14134057573457350871.idtracker@ietfa.amsl.com> <3669167D-26AC-4B78-8175-99B0028B6891@cloudflare.com> <CABkgnnXqHP6RNpHBcFStO5TWz8Sq6Uqs7KMWFof88RjxhoW-Qg@mail.gmail.com> <06396a0d-a0c1-19fc-85d5-6ddfb9bcf39f@gmx.de> <CABkgnnWFds=rYHc-ufCynXg701ekQ6MJTrbXXZrV0ozRod6HzA@mail.gmail.com> <D8E74F06-A6CC-4EA9-9D7C-EFD043F72624@cloudflare.com> <CANatvzzZOvPWrdQqNfV4VSiZ4cb2zt36f1-mKTrxTS8kW6eSuw@mail.gmail.com> <CACweHND+E7D0oKR+_2sKVOqrAwx_hQW9Z=MAmDFGfbqEzR4xGQ@mail.gmail.com> <568945A1-75B6-4E9D-9021-38479FC55580@cloudflare.com>
From: Jyrki Alakuijala <jyrki@google.com>
Date: Thu, 03 Nov 2016 11:32:14 +0100
Message-ID: <CAPapA7TfTMdOA4XB=9b6959CUxqfZFe=A8nVnQB3xd3pG8HBRg@mail.gmail.com>
To: Vlad Krasnov <vlad@cloudflare.com>
Cc: Matthew Kerwin <matthew@kerwin.net.au>, Martin Thomson <martin.thomson@gmail.com>, HTTP Working Group <ietf-http-wg@w3.org>
Content-Type: multipart/alternative; boundary="001a113eec1a3f8ac6054063126b"
Received-SPF: pass client-ip=209.85.218.41; envelope-from=jyrki@google.com; helo=mail-oi0-f41.google.com
X-W3C-Hub-Spam-Status: No, score=-6.3
X-W3C-Hub-Spam-Report: AWL=1.215, BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, RP_MATCHES_RCVD=-2.294, SPF_PASS=-0.001, W3C_AA=-1, W3C_IRA=-1, W3C_WL=-1
X-W3C-Scan-Sig: titan.w3.org 1c2FK6-0006PU-Ry 51ae2b49b2b1fb7c9afac5a5df6c546d
X-Original-To: ietf-http-wg@w3.org
Subject: Re: New Version Notification for draft-vkrasnov-h2-compression-dictionaries-01.txt
Archived-At: <http://www.w3.org/mid/CAPapA7TfTMdOA4XB=9b6959CUxqfZFe=A8nVnQB3xd3pG8HBRg@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/32835
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

On Thu, Nov 3, 2016 at 6:43 AM, Vlad Krasnov <vlad@cloudflare.com> wrote:

> This is indeed not unlike SDCH and “quasi dictionaries” only your
> dictionary defined by a stream and not a different url. In fact it can be
> used with SDCH just as well.
> My proposal tries to be as algorithm agnostic as possible.
> However brolti compresses much better in that case. In fact from what I
> have seen brotli+”quasi” beats sdch+”quasi”+brotli (but maybe
> sdch+”quasi”+brotli+”quasi” will do even better?).
>

Yes, this is consistent with our experiments. Brotli + custom dictionary is
more efficient than SDCH + custom dictionary with further gzip or brotli
compression.

With small (~150 kB) dictionaries brotli wins SDCH by 10-20 % (20 % at
brotli quality 11, 10 % at quality 6), with larger (1 MB) dictionaries
more, 20-30 % (30 % at brotli quality 11, 20 % at quality 6). The larger
the custom dictionary, the more powerful brotli comes in comparison to
SDCH. All our experiments indicate that SDCH is fully redundant and can be
abandoned if we add custom dictionary support to brotli content encoding.