RE: Informal meeting on blind caching

Mike Bishop <Michael.Bishop@microsoft.com> Mon, 08 August 2016 20:03 UTC

Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 787FA12B03F for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Mon, 8 Aug 2016 13:03:08 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -8.267
X-Spam-Level:
X-Spam-Status: No, score=-8.267 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-1.247, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=microsoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id PkSQmOJSoVJl for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Mon, 8 Aug 2016 13:03:04 -0700 (PDT)
Received: from frink.w3.org (frink.w3.org [128.30.52.56]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 30FC212B057 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Mon, 8 Aug 2016 13:03:04 -0700 (PDT)
Received: from lists by frink.w3.org with local (Exim 4.80) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1bWqhk-00018R-Tc for ietf-http-wg-dist@listhub.w3.org; Mon, 08 Aug 2016 19:59:20 +0000
Resent-Date: Mon, 08 Aug 2016 19:59:20 +0000
Resent-Message-Id: <E1bWqhk-00018R-Tc@frink.w3.org>
Received: from lisa.w3.org ([128.30.52.41]) by frink.w3.org with esmtps (TLS1.2:DHE_RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from <Michael.Bishop@microsoft.com>) id 1bWqhd-00017F-N9 for ietf-http-wg@listhub.w3.org; Mon, 08 Aug 2016 19:59:13 +0000
Received: from mail-sn1nam02on0125.outbound.protection.outlook.com ([104.47.36.125] helo=NAM02-SN1-obe.outbound.protection.outlook.com) by lisa.w3.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:256) (Exim 4.80) (envelope-from <Michael.Bishop@microsoft.com>) id 1bWqhW-00048o-Tm for ietf-http-wg@w3.org; Mon, 08 Aug 2016 19:59:09 +0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=y/+XQj45kDE9K3nV07reEWBHClEeFXPCtGxuxLrsOFo=; b=jGpwK4HdanR5W6legwvRNyf9T/iwIvb8w1pRxAggoaD1745+1XK8t8wglvf8u3OlY2l20J1oxG2MzfAfeItQidoa3SCG+TPgPYNj6SvL9QxbgLwQF/YsHFOIKPk5OiqchNRB8d/95iZDl/q+ZBiNh1Im3DsGTLhIAGLH6HSqpWc=
Received: from BLUPR03MB1330.namprd03.prod.outlook.com (10.163.80.20) by BLUPR03MB1330.namprd03.prod.outlook.com (10.163.80.20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.549.15; Mon, 8 Aug 2016 19:41:23 +0000
Received: from BLUPR03MB1330.namprd03.prod.outlook.com ([10.163.80.20]) by BLUPR03MB1330.namprd03.prod.outlook.com ([10.163.80.20]) with mapi id 15.01.0549.025; Mon, 8 Aug 2016 19:41:23 +0000
From: Mike Bishop <Michael.Bishop@microsoft.com>
To: Erik Nygren <erik@nygren.org>, Richard Bradbury <richard.bradbury@rd.bbc.co.uk>
CC: "ietf-http-wg@w3.org Group" <ietf-http-wg@w3.org>
Thread-Topic: Informal meeting on blind caching
Thread-Index: AQHR4E3T8KOJkwtpMUekZfv+z68li6AsJAEAgAF6TgCAAFqMgIARngqw
Date: Mon, 08 Aug 2016 19:41:22 +0000
Message-ID: <BLUPR03MB13309B2448CA66DE2B701600871B0@BLUPR03MB1330.namprd03.prod.outlook.com>
References: <CABkgnnXYSxyS2hg5aUxT8R2c_M44OoR=g8-7U1iGjNeqXT-zJQ@mail.gmail.com> <57988DF6.9010501@rd.bbc.co.uk> <03a5d205-4713-bd10-35ab-8efefbdce525@rd.bbc.co.uk> <CAKC-DJhpGy-senisEFaANrLDXE5_AtZK9kP32rX41OXVYKYXxQ@mail.gmail.com>
In-Reply-To: <CAKC-DJhpGy-senisEFaANrLDXE5_AtZK9kP32rX41OXVYKYXxQ@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=Michael.Bishop@microsoft.com;
x-originating-ip: [2001:4898:80e8:d::390]
x-ms-office365-filtering-correlation-id: adf08e28-74dd-4cb3-a4c3-08d3bfc3fac2
x-microsoft-exchange-diagnostics: 1; BLUPR03MB1330; 6:SMtlvqT/vcjK5FTdG5ypRRHfSZXUCkyNmtjysgxrTsGHPOR4Ju/EULmTcVoAixb3pR/ipIP9QVZq6ktqfSFAgjGFUfc5LvUCulbG2sNPxAjh/6F9TA6v4DxNFqyRG7ykqMO3lc4AsR9R0UykrjvJlT7c03aix9n6umivK2KCASZ+b/g7KBDGNCG38ksAemgSUlFfSAFMPq16+pewOMHjmH5SbagOot6EnTpQyt98DcnEHwKog6EAJNUJ/xpYjMA+iVVx9/MtvbmmKYKkGqo+gEL/zeuS0rLOCOrLa1zo5PAyzn4tnzpJNZoGKQkFagQ4pUUsQuUjFoI5GDB0a154+w==; 5:+pBG2cZnOyllDLFBdr8zVBT71X1SIV24jwrElDGj4NHr3skB5f74jB3dtMlceFpbLUB7GZG3POjsvsZZ/6H9Z3hdkFWJSuwJpOW00kX6oFDEN+0sojXXhkLeXT3WzKQGjNqc755+rR4z6LdGTrWx7w==; 24:cDr58ELU7d/zY707QggGX7FpT6cV6y+Q0MZJGM+aPXkg3Qm+ozeU6AK18CY7Rz0SXZexEnzAo/OkDbEr365Q67+quit/wN+SXA/+t0UEuN0=; 7:0EsKQLphZLxEqM5nNLzQ6AN725Ix0UjaYc9cStRVRKfyxyR5lhpUxF6WO8rkVFA7zMUOyFfSADBJb4UrZy0Lu0Ip2aQtbsiUTAz5tLZsebGqNGHAdlNPlcpOrWwozMn05wcnXlz4NT0NX8pmfOoo3xIhDhVtgVxz+JCcgdX1Nbbq8iIbTlEcEi6qajTTDdUsYc1r0Sy3Iao7O1k1PFTEnJQr3Ml/9mcTiHSp4LE8Eqkpexz5UwD260L5njrNtuD8
x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BLUPR03MB1330;
x-microsoft-antispam-prvs: <BLUPR03MB13304159C1BDC0083DB8C758871B0@BLUPR03MB1330.namprd03.prod.outlook.com>
x-exchange-antispam-report-test: UriScan:(158342451672863)(127952516941037)(21748063052155);
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(61425038)(6040159)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001)(6055026)(61426038)(61427038); SRVR:BLUPR03MB1330; BCL:0; PCL:0; RULEID:; SRVR:BLUPR03MB1330;
x-forefront-prvs: 00286C0CA6
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(7916002)(199003)(24454002)(189002)(51694002)(377454003)(7846002)(7696003)(19609705001)(74316002)(19580395003)(8990500004)(122556002)(7736002)(92566002)(8936002)(2906002)(106116001)(97736004)(86612001)(68736007)(3280700002)(9686002)(16236675004)(5001770100001)(3660700001)(105586002)(5002640100001)(106356001)(99286002)(7906003)(4326007)(8676002)(81156014)(586003)(81166006)(93886004)(76576001)(101416001)(76176999)(6116002)(19300405004)(10090500001)(77096005)(189998001)(2900100001)(87936001)(50986999)(5005710100001)(33656002)(19580405001)(19617315012)(2950100001)(11100500001)(5890100001)(54356999)(19625215002)(10290500002)(10400500002)(86362001)(790700001)(102836003)(15975445007)(3826002); DIR:OUT; SFP:1102; SCL:1; SRVR:BLUPR03MB1330; H:BLUPR03MB1330.namprd03.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en;
received-spf: None (protection.outlook.com: microsoft.com does not designate permitted sender hosts)
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/alternative; boundary="_000_BLUPR03MB13309B2448CA66DE2B701600871B0BLUPR03MB1330namp_"
MIME-Version: 1.0
X-OriginatorOrg: microsoft.com
X-MS-Exchange-CrossTenant-originalarrivaltime: 08 Aug 2016 19:41:23.2544 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLUPR03MB1330
Received-SPF: pass client-ip=104.47.36.125; envelope-from=Michael.Bishop@microsoft.com; helo=NAM02-SN1-obe.outbound.protection.outlook.com
X-W3C-Hub-Spam-Status: No, score=-1.5
X-W3C-Hub-Spam-Report: BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, W3C_NW=0.5
X-W3C-Scan-Sig: lisa.w3.org 1bWqhW-00048o-Tm 89a4b38e95688d41c4bd69cd555abbef
X-Original-To: ietf-http-wg@w3.org
Subject: RE: Informal meeting on blind caching
Archived-At: <http://www.w3.org/mid/BLUPR03MB13309B2448CA66DE2B701600871B0@BLUPR03MB1330.namprd03.prod.outlook.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/32228
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <http://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

I would go a little further and say that, at least initially, how the closer node gets the content is entirely an implementation detail and out of scope for the IETF, regardless of working group.

While you’re right that this isn’t restricted to CDNs, that’s the mental model that makes it easiest to understand.  There are several use-cases, each of which will have a different means of acquiring the content – and those means don’t need to be specified by this group in most cases.  If the origin is a CDN while the less-trusted server is a CDN node in an unsecured location, the content acquisition is entirely internal.  For the blind caching case, both servers are the same machine, so the acquisition is internal in an even-more-literal sense.  If the origin is a customer while the less-trusted server is a CDN, that mirrors existing deployments; we don’t seem to have a problem configuring where the CDN goes to get updated versions of a cached resource today, and I would imagine similar techniques could be applied here satisfactorily.

If use-cases arise beyond those that require an explicit “how do I find encrypted content <foo>?” protocol, we can pursue it then.  Let’s not muddy the waters in advance.

From: nygren@gmail.com [mailto:nygren@gmail.com] On Behalf Of Erik Nygren
Sent: Thursday, July 28, 2016 7:32 AM
To: Richard Bradbury <richard.bradbury@rd.bbc.co.uk>
Cc: ietf-http-wg@w3.org Group <ietf-http-wg@w3.org>
Subject: Re: Informal meeting on blind caching

For the "Blind caching in a CDN edge cache that is acting as a delegated origin server" scenario I think we'd be better off separating out the high-level mechanism (ie, getting oob-encoding) right from the actual business model and implementation details for how the caches get populated.  The former is something we can tractably do here (have a way to delegate content bodies out to third-parties) but the latter is something that could easily fill up its own working group to get all of the details worked through.

I also think that we shouldn't refer to "CDN" in this scenario as much as referring to delegating between a server acting as an authoritative origin and a collection of servers at a lower trust level.  (In some deployment scenarios, the former might be a CDN and the latter might be either a different trust tier of CDN nodes or federated-but-less-trusted partners.)
The specific blind caching with a configured proxy cache is a well-defined use-case, but the others have many different ways to implement that trying to standardize something now before there has been more experience with implementations and business models seems like asking for trouble (and is something that some of us may be less interested in than in defining common underlying mechanisms and affordances to allow developing technologies in this area).

        Erik



On Thu, Jul 28, 2016 at 5:07 AM, Richard Bradbury <richard.bradbury@rd.bbc.co.uk<mailto:richard.bradbury@rd.bbc.co.uk>> wrote:
On 27/07/2016 11:33, Richard Bradbury wrote:
On 17/07/2016 18:03, Martin Thomson wrote:

We are having a meeting on blind caching on Tuesday 08:30 in

Charlottenburg I.  Folks who are interested are invited to join us.



Rough agenda is to discuss what this is, the status of specs and

implementations.  Then we are looking to get some input on the work

that has been done and what might need to happen next.



For those not familiar with this, the following drafts are recommended reading:

https://tools.ietf.org/html/draft-thomson-http-scd

https://tools.ietf.org/html/draft-thomson-http-bc

https://tools.ietf.org/html/draft-reschke-http-oob-encoding

https://tools.ietf.org/html/draft-thomson-http-mice

https://tools.ietf.org/html/draft-ietf-httpbis-encryption-encoding


Hi. Thanks for an interesting session last week.

Based on my reading of the Internet Drafts I think these are the two main Use Cases under consideration here:

  1.  Blind caching in a CDN edge cache that is acting as a delegated origin server.

     *   Described in draft-thomson-http-scd.
     *   Making use of the techniques described in draft-reschke-http-oob-encoding, draft-thomson-http-mice and draft-ietf-httpbis-encryption-encoding.

  1.  Blind caching in an explicitly configured proxy server.

     *   Described in draft-thomson-http-bc.
     *   Making use of the techniques described in draft-reschke-http-oob-encoding, draft-thomson-http-mice and draft-ietf-httpbis-encryption-encoding.

The discussion in Berlin last Tuesday morning flowed fairly freely between the two Use Cases, so I just wanted to check my understanding.


OK. Now I feed I understand Use Case 2 better, I attach a couple of sequences describing my (incomplete) understanding of Use Case 1 above. The main question in my mind here is whether the resources are explicitly pushed into the CDN cache (what I have called "Mode P") or whether they are retrieved on demand from the origin server by the CDN only on cache miss ("Mode G").

Perhaps you are looking to support both modes of operation? The Internet Draft could usefully clarify this.
Mode G
In the cache pull-through mode, there appears to be a requirement for the CDN to know the resource mapping in order to support the URL obfuscation feature. But that appears to negate one of the key benefits of the feature – keeping the mapping secret from the CDN provider. I'm clearly missing something here. Or maybe URL obfuscation just doesn't fly in this mode, which would be a shame since this is our primary mode of operation for some media types.
Mode P
With the push mode, the resource mapping can remain secret to the origin server, which is great. But the mechanism for pushing content onto the CDN remains a bit of a mystery, so I have made an educated guess on my diagram. Perhaps you intend this mechanism to remain private? In which case, perhaps the Internet Draft could include a note to this effect?

Clarifications and comments gratefully received.

Regards,

--

Richard Bradbury | Lead Research Engineer

BBC Research & Development

Centre House, 56 Wood Lane, London  W12 7SB.

T: 0303 040 9672  F: 020 8811 8815