Re: New Draft: draft-ohanlon-transport-info-header

"Piers O'Hanlon" <piers.ohanlon@bbc.co.uk> Mon, 25 November 2019 16:55 UTC

Return-Path: <ietf-http-wg-request+bounce-httpbisa-archive-bis2juki=lists.ie@listhub.w3.org>
X-Original-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Delivered-To: ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 202661209A1 for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Mon, 25 Nov 2019 08:55:36 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.652
X-Spam-Level:
X-Spam-Status: No, score=-2.652 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HEADER_FROM_DIFFERENT_DOMAINS=0.249, MAILING_LIST_MULTI=-1, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id uW1aqtf1xeEq for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Mon, 25 Nov 2019 08:55:34 -0800 (PST)
Received: from frink.w3.org (frink.w3.org [IPv6:2603:400a:ffff:804:801e:34:0:38]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5E472120A43 for <httpbisa-archive-bis2Juki@lists.ietf.org>; Mon, 25 Nov 2019 08:55:29 -0800 (PST)
Received: from lists by frink.w3.org with local (Exim 4.89) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1iZHbT-0006Qx-TN for ietf-http-wg-dist@listhub.w3.org; Mon, 25 Nov 2019 16:52:47 +0000
Resent-Date: Mon, 25 Nov 2019 16:52:47 +0000
Resent-Message-Id: <E1iZHbT-0006Qx-TN@frink.w3.org>
Received: from uranus.w3.org ([128.30.52.58]) by frink.w3.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.89) (envelope-from <piers.ohanlon@bbc.co.uk>) id 1iZHbR-0006QK-9a for ietf-http-wg@listhub.w3.org; Mon, 25 Nov 2019 16:52:45 +0000
Received: from www-data by uranus.w3.org with local (Exim 4.92) (envelope-from <piers.ohanlon@bbc.co.uk>) id 1iZHbQ-0007vr-Vb for ietf-http-wg@listhub.w3.org; Mon, 25 Nov 2019 16:52:44 +0000
Received: from titan.w3.org ([2603:400a:ffff:804:801e:34:0:4c]) by frink.w3.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.89) (envelope-from <piers.ohanlon@bbc.co.uk>) id 1iZHZ6-0006Nt-HD for ietf-http-wg@listhub.w3.org; Mon, 25 Nov 2019 16:50:20 +0000
Received: from mailout1.cwwtf.bbc.co.uk ([132.185.160.180]) by titan.w3.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from <piers.ohanlon@bbc.co.uk>) id 1iZHZ5-0004YM-2Z for ietf-http-wg@w3.org; Mon, 25 Nov 2019 16:50:20 +0000
Received: from BGB01XI1011.national.core.bbc.co.uk (bgb01xi1011.national.core.bbc.co.uk [10.161.14.15]) by mailout1.cwwtf.bbc.co.uk (8.15.2/8.15.2) with ESMTP id xAPGoFQr026234; Mon, 25 Nov 2019 16:50:15 GMT
Received: from BGB01XUD1009.national.core.bbc.co.uk ([10.161.14.7]) by BGB01XI1011.national.core.bbc.co.uk ([10.161.14.15]) with mapi id 14.03.0408.000; Mon, 25 Nov 2019 16:50:15 +0000
From: Piers O'Hanlon <piers.ohanlon@bbc.co.uk>
To: Patrick McManus <mcmanus@ducksong.com>
CC: Piers O'Hanlon <p.ohanlon@gmail.com>, Lucas Pardue <lucaspardue.24.7@gmail.com>, HTTP Working Group <ietf-http-wg@w3.org>
Thread-Topic: New Draft: draft-ohanlon-transport-info-header
Thread-Index: AQHVoSMuoLeOCPH9y0O/3xVovjDbQaeXJimAgACSr4CABBncAIAAM2KAgAAYdAA=
Date: Mon, 25 Nov 2019 16:50:14 +0000
Message-ID: <FC0A337E-C794-446A-B587-36FA4F57820D@bbc.co.uk>
References: <CAFWWCs4jSRbrK_-5mxM8w4YexYNKRuwGGJSK4iNrhr4en2Q=_w@mail.gmail.com> <CALGR9ob+EgQwC=VK80PPRWxABxi3AeLUpGXk=wzBK57H0OUzJw@mail.gmail.com> <CAFWWCs5u=qAjmhPek17YqN=AmVJgyCXEVkfP2RsQ5uM-DBZc0A@mail.gmail.com> <CAOdDvNrKSPwxNPDYW_0rqc78Zu4NJW9E49qGFt+nv7v3cUgTXg@mail.gmail.com> <CAFWWCs7XqVjOcNyt75P7enHXkAV3WzM8TDZLmUUaiDHFdT3QQQ@mail.gmail.com> <CAOdDvNo2dC77aQJif_351SR70J=judm+eKupm64=fSCY8212PA@mail.gmail.com>
In-Reply-To: <CAOdDvNo2dC77aQJif_351SR70J=judm+eKupm64=fSCY8212PA@mail.gmail.com>
Accept-Language: en-GB, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [172.19.161.213]
x-exclaimer-md-config: c91d45b2-6e10-4209-9543-d9970fac71b7
x-tm-as-product-ver: SMEX-12.5.0.1300-8.2.1013-24054.007
x-tm-as-result: No-37.179200-8.000000-10
x-tmase-matchedrid: cxtZ8fwm3r+7lpQUW6Uvz7iMC5wdwKqdwW1rM+V9HtKqvcIF1TcLYI+1 bntEYE/1wEzzkYmyTN69m4DeSuwpfnd6ayq/vuQx8pRHzcG+oi1YN1akkye0qJ+D2WKPwBVchGn S5XpjHWOPo/cIbNSZtrrLeEpjJBMWq87gT7hcKkKWLCkl1lq7B/ls1Rj4kmPIM+0ORd+uOyjEzv xFrQ97CQu4OCCot8UDQjMjmWybnZkPa80nUEFcbZVRzPxemJL0FJFr2qlKix8cvwPYmXKyH3DtE eqMO0esStrgShPsLJdUOGD4cXOO2w5xGkgZNT4Q081phgl5F/l+Mk6ACsw4Juouc5Rcf1B0M5BD 87b3pEbwYKShJdlqCezw0k3S3hZKue4A1S8vO3qzI1v7J4hECh5wkWJVFHWCl3JzVGvmhUVuXqz bk/eYwf9cYufMqxyuR1ZXupgJdHUgELemqB6vekhEDfw/93BuqQzUsXJNLuFJg8sTT3RzF/GeRO xbU0T2MzD7AFJYc3f3OTOlojTaUI3Ord6hZYnJ5cZrFB2JmACRPtwwl97om2RLrYSNnuTLJ5Nof wECYYVX2H7tCd42NV+24nCsUSFNt7DW3B48kkHdB/CxWTRRuyUIayx+Skid
x-tm-as-user-approved-sender: Yes
x-tm-as-user-blocked-sender: No
x-tmase-result: 10--37.179200-8.000000
x-tmase-version: SMEX-12.5.0.1300-8.2.1013-24054.007
Content-Type: text/plain; charset="utf-8"
Content-ID: <CD922681CC1643468E47680CB1545EBA@bbc.co.uk>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
Received-SPF: pass client-ip=132.185.160.180; envelope-from=piers.ohanlon@bbc.co.uk; helo=mailout1.cwwtf.bbc.co.uk
X-W3C-Hub-Spam-Status: No, score=-6.2
X-W3C-Hub-Spam-Report: BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, W3C_AA=-1, W3C_WL=-1
X-W3C-Scan-Sig: titan.w3.org 1iZHZ5-0004YM-2Z cdd956800fe905b920b518fa16bebb4c
X-caa-id: 3a842e0aab
X-Original-To: ietf-http-wg@w3.org
Subject: Re: New Draft: draft-ohanlon-transport-info-header
Archived-At: <https://www.w3.org/mid/FC0A337E-C794-446A-B587-36FA4F57820D@bbc.co.uk>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/37190
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <https://www.w3.org/Mail/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

> On 25 Nov 2019, at 15:22, Patrick McManus <mcmanus@ducksong.com> wrote:
> 
> A value like CWND is connection based
Yes the server sender cwnd for that particular connection between the “origin”* and the client.

> - it is a side channel for all of the transactions on the connection that is fed back through an http response header on one particular transaction.
The only transactions that traverse that connection are between the client and the “origin”.

> These transactions don't necessarily share the same origin (or the same auth properties).
> 
If they don’t share the same origin they’re transported on a different connection so would have a different CWND(s).

The CWND sent in a Transport-Info header would only be related to a single transport connection between one “origin" and one client over which flows transactions related to those entities. The transactions from the same origin to other clients would be over a different transport connection so the cwnd would be different.  Transactions that don’t share the same origin would be a different connection and contain yet another cwnd. 

*when I say “origin” I mean the last hop edge node of whatever CDN serves the origin.

Apologies if I’m missing your point but from what have you have described the side channel isn’t clear to me?

Piers

> On Mon, Nov 25, 2019 at 7:19 AM Piers O'Hanlon <p.ohanlon@gmail.com> wrote:
> Hi Patrick,
> 
> Thanks for your feedback.
> 
> I'm assuming most cross-origin issues should be dealt with by CORS but
> were you concerned with that suggestion that the header could be
> contained in an OPTIONS response? I can see that since such a response
> is not subject to CORS - such as in a CORS pre-flight request - then
> we could drop that as an approach and just keep to using HEAD requests
> as a mechanism to obtain the Transport-Info.
> 
> Let me know what if that doesn't address your issue or if you have any
> other concerns.
> 
> Piers
> 
> 
> On Fri, 22 Nov 2019 at 21:41, Patrick McManus <mcmanus@ducksong.com> wrote:
> >
> > To the extent that this leaks information across origins to js its probably a problem too.
> >
> > On Fri, Nov 22, 2019 at 8:58 PM Piers O'Hanlon <p.ohanlon@gmail.com> wrote:
> >>
> >> Hi Lucas,
> >>
> >> Thanks for bring that up - as you say Nginx's default for
> >> http2_max_requests is 1000, although it can be changed (and appears to
> >> be done so for RPC applications). I'm not sure how many other server
> >> implementations do this?
> >>
> >> Firstly, we can detect this through of the use of the dstport
> >> parameter - as a new TCP connection would use a different port.
> >> Although it could potentially lead to temporary loss of information
> >> for a time as discussed below.
> >>
> >> Secondly, the affect of this would be only apparent each time the
> >> request count is exceeded - so say every 1000 requests - when a switch
> >> over would occur. When a switch over does occur then it depends on the
> >> comparative duration of the data responses of interest, versus how
> >> often one wants to perform parallel HEAD/OPTION requests for
> >> Transport-Info. So for the case where where the frequency of parallel
> >> requests is about the same then I think it shouldn't matter much as
> >> with most server systems these days the congestion control parameters
> >> are cached in the kernel so a subsequent connection to the same
> >> destination would be preloaded with the cached metrics so the
> >> Transport-Info header would contain these. In the case where there's a
> >> series of long running responses then it might be an issue as after
> >> switch over point there would also be two parallel TCP connections to
> >> the same point but they would exist separately for a longer period so
> >> potentially the metrics obtained via subsequent HEAD/OPTIONS could be
> >> different as the cwnd can be reduced for low volume flows, though
> >> these would generally not be used since the dstport would not match so
> >> there could be a loss of information in this case.
> >>
> >> Cheers
> >>
> >> Piers
> >>
> >> On Fri, 22 Nov 2019 at 10:51, Lucas Pardue <lucaspardue.24.7@gmail.com> wrote:
> >> >
> >> > Hi Piers,
> >> >
> >> >
> >> >
> >> >
> >> > On Fri, 22 Nov 2019, 17:58 Piers O'Hanlon, <p.ohanlon@gmail.com> wrote:
> >> >>
> >> >> Hi all,
> >> >>
> >> >> - “It only provides information per response which isn’t very often”
> >> >> We mention in the draft that with H2+ one can send and arbitrary number of requests (using OPTIONS/HEAD) to obtain more measurements responses per unit time.
> >> >
> >> >
> >> > I have an observation but not sure it belongs in a document. Implementations such as nginx have a soft max number of HTTP/2 requests before closing the connection (default 1000 last I checked). If you're trying to sample the transport info to frequently you may end ip blowing it up. This seems unfortunate because the client use case is designed around making smarter transport related decisions.
> >> >
> >> > Cheers
> >> > Lucas
> >> >
> >> >>
> >> >> We would welcome any more feedback by email and/or Github issues
> >> >>
> >> >> Thanks,
> >> >>
> >> >> Piers O'Hanlon
> >>
>