Re: Multi-GET, extreme compression?

William Chan (陈智昌) <willchan@chromium.org> Mon, 18 February 2013 01:32 UTC

Return-Path: <ietf-http-wg-request@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4C10721F8B4C for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Sun, 17 Feb 2013 17:32:07 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.047
X-Spam-Level:
X-Spam-Status: No, score=-9.047 tagged_above=-999 required=5 tests=[AWL=0.029, BAYES_00=-2.599, FM_FORGED_GMAIL=0.622, HTML_MESSAGE=0.001, J_CHICKENPOX_43=0.6, MIME_8BIT_HEADER=0.3, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7uLchSj2evLU for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Sun, 17 Feb 2013 17:32:06 -0800 (PST)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) by ietfa.amsl.com (Postfix) with ESMTP id 1A52321E805D for <httpbisa-archive-bis2Juki@lists.ietf.org>; Sun, 17 Feb 2013 17:32:06 -0800 (PST)
Received: from lists by frink.w3.org with local (Exim 4.72) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1U7FZV-0005al-Hp for ietf-http-wg-dist@listhub.w3.org; Mon, 18 Feb 2013 01:31:09 +0000
Resent-Date: Mon, 18 Feb 2013 01:31:09 +0000
Resent-Message-Id: <E1U7FZV-0005al-Hp@frink.w3.org>
Received: from maggie.w3.org ([128.30.52.39]) by frink.w3.org with esmtp (Exim 4.72) (envelope-from <willchan@google.com>) id 1U7FZM-0005a1-O3 for ietf-http-wg@listhub.w3.org; Mon, 18 Feb 2013 01:31:00 +0000
Received: from mail-qa0-f54.google.com ([209.85.216.54]) by maggie.w3.org with esmtps (TLS1.0:RSA_ARCFOUR_SHA1:16) (Exim 4.72) (envelope-from <willchan@google.com>) id 1U7FZL-0001UO-29 for ietf-http-wg@w3.org; Mon, 18 Feb 2013 01:31:00 +0000
Received: by mail-qa0-f54.google.com with SMTP id hg5so1058285qab.20 for <ietf-http-wg@w3.org>; Sun, 17 Feb 2013 17:30:33 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=DYxAP0btR4cvqz6aX6vmTkdC3qYkv97o5Mt5/zUXWeI=; b=hZltMD8XtnObjyb/Q5Vxcp364TItAhhP41YqZOcLVab8ejjcTTC0CStcQX4cfe+8/4 PcDfFP+DOEu2EIuFk7mIcQZxs1AYdfRisC+LItCv+ekFf1feayP/a0qurGN55ZKQyzmf aJ2kxFiKRPQEdJO8LbfbHtkgndSGOZzkZ4TW1gCAgQVwOjk6kD4hxtJH29RV21gxgB5l I5pSF1tp/Vnfsi/nnm842nkMVz4V9Mc+huH+JeHlo9k+St2hYno/83e9R81D0rycBMB2 bpThMq1BD1lYMACH1Fkcni5SRy894QbsLBXOW7B6i9fk0RM5+PlNjw2e3SqTRcSnxsBk p/8w==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=chromium.org; s=google; h=mime-version:x-received:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=DYxAP0btR4cvqz6aX6vmTkdC3qYkv97o5Mt5/zUXWeI=; b=hEk/PTyqaPCKgEoqerUKrbH58U9pefOxjP80YvdwLbcauPH99g2e1tHcKo9D3500sG vZphVDLotN9x6JBXkcJTRN556xs2YudnzyWByPckesDzzjfm6c4VaLwpxJU+JoI6+3Ji 0VqIgxtQob13I4aXVrUsIi3S8j4MvLDLPlnbI=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :x-gm-message-state; bh=DYxAP0btR4cvqz6aX6vmTkdC3qYkv97o5Mt5/zUXWeI=; b=c0XJ3cuNBhEE90/xpI0C9ZXy8tvauTeXxZlZZ5KNYMlc/MxE5ZeRwWBpk+E0dJJvAo hEIgWkOmH+u8y4Vhoixn+Z/27K9EC/QDsEikyXT+/O6cIq94YsDhChy9MF+cyT4s0rp9 K/YF/86eV16LN0Azud4MGgF5vfjPtuYNcKSAiRHlCiIcHn4cfXvPyBPRQ1vOC0CaMRsP 4dT2i4+kxzUhMWp7a+PxhVzrDVQD/IsfAf5ACLI0YUuTmgAYMprn/yKSVcOL7NyGCwjd 02uAxq0UxxRPH1OoU2N1YzKwsIddDDE3c0djaswPpipeFgwjrj90u+vazxiT/C6dQ3Z5 +bEg==
MIME-Version: 1.0
X-Received: by 10.49.127.15 with SMTP id nc15mr4260757qeb.61.1361151032953; Sun, 17 Feb 2013 17:30:32 -0800 (PST)
Sender: willchan@google.com
Received: by 10.229.135.210 with HTTP; Sun, 17 Feb 2013 17:30:32 -0800 (PST)
In-Reply-To: <CABP7RbfVvZnYPPsRvzmC0BtCiPBxQmYXHTRKtq8XE7Z2wY2EfA@mail.gmail.com>
References: <CAMm+LwiF6EM8_aQgUm=nPS5XqaG25iRGNke_rnHTM1vTGMXdfg@mail.gmail.com> <A6A82B6EF92590887D2A23D5@cyrus.local> <D9118B58-F53F-4F75-8292-2B990172E234@opengroupware.org> <CABP7RbcX2OqttZuYeuYxhyOgE_ax0M67L1ywPy_VDpW1upM69Q@mail.gmail.com> <CAP+FsNeWDBTBYJ0P-URbO5avbUno5etKid10RM+dRwDWAUys2w@mail.gmail.com> <CABP7RbfVvZnYPPsRvzmC0BtCiPBxQmYXHTRKtq8XE7Z2wY2EfA@mail.gmail.com>
Date: Sun, 17 Feb 2013 17:30:32 -0800
X-Google-Sender-Auth: covISm5z2uD3piXNMyGkzacizoE
Message-ID: <CAA4WUYioRAOEbjU32yEaJuWDAySiZF=OfKXcF-8esqTP0uqwtQ@mail.gmail.com>
From: "William Chan (陈智昌)" <willchan@chromium.org>
To: James M Snell <jasnell@gmail.com>
Cc: Roberto Peon <grmocg@gmail.com>, Helge Heß <helge.hess@opengroupware.org>, HTTP Working Group <ietf-http-wg@w3.org>, Phillip Hallam-Baker <hallam@gmail.com>, Cyrus Daboo <cyrus@daboo.name>
Content-Type: multipart/alternative; boundary="047d7b6dc3acce0c7304d5f5abe1"
X-Gm-Message-State: ALoCoQlALm8tP++niY2TXx2kGv4RIWhwV1QTvuzR5cy/wLy3Ti2odFX+ff8N16h5xWRD6qxpqYcAm4HzYyqRzqRR/9Xh/ByMyGkyopxJjoD6aeDvj15n97H7c61V0LoxE1lKMFy9iBjKRoGZEyHLBKiaw4QEQmS973uxA19V1zcPOSz3TBk528auHAimdupxXmzwb/2mu78c
Received-SPF: pass client-ip=209.85.216.54; envelope-from=willchan@google.com; helo=mail-qa0-f54.google.com
X-W3C-Hub-Spam-Status: No, score=-4.7
X-W3C-Hub-Spam-Report: AWL=-1.435, BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, RP_MATCHES_RCVD=-0.556, SPF_PASS=-0.001
X-W3C-Scan-Sig: maggie.w3.org 1U7FZL-0001UO-29 eb8221c433101ae7a8ed4eafd1a74a50
X-Original-To: ietf-http-wg@w3.org
Subject: Re: Multi-GET, extreme compression?
Archived-At: <http://www.w3.org/mid/CAA4WUYioRAOEbjU32yEaJuWDAySiZF=OfKXcF-8esqTP0uqwtQ@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/16645
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

I'm having difficulty grokking this proposal. Can you describe more clearly
how this would work with the web platform? Specifically, what kind of
markup in a HTML document should cause a browser to use a MGET for a
resource set as you describe it.

Also, how does this work for HTTP/1.X? Since we'll be living in a
transitional world for awhile, I'd like to understand how this allows for
HTTP/1.X semantics backwards compatibility.


On Sun, Feb 17, 2013 at 4:58 PM, James M Snell <jasnell@gmail.com> wrote:

> A requester does not necessarily need to know everything they are
> getting in advance.
>
> That is, assume that a server defines a set of N resources and assigns
> that set a singular url that represents the entire collection. When I
> do..
>
>   MGET /resource/set HTTP/2.0
>
> The server responds by opening N server-push response streams back to
> the client, each associated with the original MGET. Each would have
> it's own Content-Location and Cache-Control mechanisms allowing
> intermediate caches to still do the right thing. The client does not
> necessarily know what all it is getting from the server in advance but
> knows it needs to be prepared to handle multiple items.
>
> Alternatively, the MGET could include multiple individual URLs, in
> which case it still actually behaves the same way. The only difference
> is that the client has a better understanding of exactly what it's
> wanting to retrieve.
>
> example:
>
> MGET /assets/*.js HTTP/2.0   --> Get all the javascript files
> MGET /assets/*.png HTTP/2.0  --> Get all the image files
>
> If the cache is able to keep track of exactly which resources were
> pushed in response to the MGET, then caches could keep right on doing
> the right thing.
>
> Since the resources are sent via server push, the server is
> responsible for determining the priority for which resources get sent.
>
> Yes, largely theoretical and easily abused for sure. But ought to at
> least be something worth investigating.
>
> - James
>
> On Sun, Feb 17, 2013 at 3:19 PM, Roberto Peon <grmocg@gmail.com> wrote:
> > MGET (or whatever batch request) implies you know all of what you're
> > requesting when you're requesting it, which is rarely the case.
> > As a result, my guess is that this won't solve the prioritization issue
> for
> > the browser.
> > -=R
> >
> >
> > On Sun, Feb 17, 2013 at 3:07 PM, James M Snell <jasnell@gmail.com>
> wrote:
> >>
> >> An mget that leverages server push in http/2 and individual cacheable
> >> response streams would be very interesting and could address at least
> some
> >> of the prioritization issues.
> >>
> >> On Feb 17, 2013 12:17 PM, "Helge Heß" <helge.hess@opengroupware.org>
> >> wrote:
> >>>
> >>> On Feb 17, 2013, at 11:18 AM, Cyrus Daboo <cyrus@daboo.name> wrote:
> >>> > We added a multiget REPORT to CalDAV (RFC4791) and CardDAV (RFC6352)
> >>> > which is used by clients when sync'ing a lot of resources (e.g.,
> initial
> >>> > account setup). The one major criticism has been lack of
> cacheability of the
> >>> > individual resources included in the multiget.
> >>>
> >>> The other major criticisms being:
> >>> a) content needs to be XML encoded
> >>> b) only allows for GETs, not for other operations
> >>>
> >>> I'd also like to see a generic, HTTP-level BATCH request. Please lets
> not
> >>> do 'just' an MGET.
> >>>
> >>> hh
> >>>
> >>>
> >
>
>