Re: [Mops] Reminder: Video Ingest over QUIC Side Meeting Friday 7/30 18:00 UTC

"Holland, Jake" <jholland@akamai.com> Wed, 28 July 2021 22:57 UTC

Return-Path: <jholland@akamai.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1860B3A0659; Wed, 28 Jul 2021 15:57:43 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.447
X-Spam-Level:
X-Spam-Status: No, score=-2.447 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.452, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=0.1, RCVD_IN_DNSWL_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=akamai.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id H4zT7Ql1fseY; Wed, 28 Jul 2021 15:57:38 -0700 (PDT)
Received: from mx0a-00190b01.pphosted.com (mx0a-00190b01.pphosted.com [IPv6:2620:100:9001:583::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7E76D3A0652; Wed, 28 Jul 2021 15:57:38 -0700 (PDT)
Received: from pps.filterd (m0122332.ppops.net [127.0.0.1]) by mx0a-00190b01.pphosted.com (8.16.0.43/8.16.0.43) with SMTP id 16SMtFDL014298; Wed, 28 Jul 2021 23:57:32 +0100
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=akamai.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=jan2016.eng; bh=GTmAqj3u0EGY2znaLbFXRhRJCkBoRMT4fWzawvbBAcY=; b=BTYf/2Hzr7azwQRLv3IzvxA+o6iPmQWUtKgM9yZQd8EWdnNWIQ1h91Z7DQcC/pg7bZY3 8BxNQalj5yeH2zZrqD0oRnYUb4L5KWHoTt6FgGCEVEs2rfECfJ775x54X2GBGsPB4KOp Y83gFcU9m+Trd9wHwCieyB6AOHeAFlEDOYFPztURLpSlqfumRvmD8A2cX14ZoQUMEnP5 L3TAvXIULIZN8WFJprqVynIfwY7EqeT+9Tj9NGR8htabWa8dvm0RculMq7Fc21J9WMnK k52V8TaQ30hVbD2kmC/rRDAB+3tOL5J8sS+gSc+H4VL261MTpr+GZqdIHoeDBeW6pZAt IQ==
Received: from prod-mail-ppoint4 (a72-247-45-32.deploy.static.akamaitechnologies.com [72.247.45.32] (may be forged)) by mx0a-00190b01.pphosted.com with ESMTP id 3a36sb23dp-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 28 Jul 2021 23:57:31 +0100
Received: from pps.filterd (prod-mail-ppoint4.akamai.com [127.0.0.1]) by prod-mail-ppoint4.akamai.com (8.16.1.2/8.16.1.2) with SMTP id 16SMJY7l016575; Wed, 28 Jul 2021 18:57:29 -0400
Received: from email.msg.corp.akamai.com ([172.27.165.117]) by prod-mail-ppoint4.akamai.com with ESMTP id 3a36vkatbj-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Wed, 28 Jul 2021 18:57:29 -0400
Received: from USTX2EX-DAG1MB4.msg.corp.akamai.com (172.27.165.122) by ustx2ex-dag1mb1.msg.corp.akamai.com (172.27.165.119) with Microsoft SMTP Server (TLS) id 15.0.1497.23; Wed, 28 Jul 2021 17:57:29 -0500
Received: from USTX2EX-DAG1MB4.msg.corp.akamai.com ([172.27.165.122]) by ustx2ex-dag1mb4.msg.corp.akamai.com ([172.27.165.122]) with mapi id 15.00.1497.023; Wed, 28 Jul 2021 17:57:28 -0500
From: "Holland, Jake" <jholland@akamai.com>
To: David Schinazi <dschinazi.ietf@gmail.com>, Roberto Peon <fenix@fb.com>, Anna Brunström <anna.brunstrom@kau.se>, "nathalie.romomoreno@telekom.de" <nathalie.romomoreno@telekom.de>, "markus.amend@telekom.de" <markus.amend@telekom.de>
CC: Ian Swett <ianswett@google.com>, "mops@ietf.org" <mops@ietf.org>, "Das, Dibakar" <dibakar.das@intel.com>, Alan Frindell <afrind@fb.com>, "quic@ietf.org" <quic@ietf.org>, Kirill Pugin <ikir@fb.com>
Subject: Re: [Mops] Reminder: Video Ingest over QUIC Side Meeting Friday 7/30 18:00 UTC
Thread-Topic: [Mops] Reminder: Video Ingest over QUIC Side Meeting Friday 7/30 18:00 UTC
Thread-Index: AQHXg+6whE5wD+6LXkyEiMKg1sb5hatZN2gA//+nEQA=
Date: Wed, 28 Jul 2021 22:57:28 +0000
Message-ID: <85EBC68C-0B48-4A45-8F72-7A3C82D28812@akamai.com>
References: <7C8E8AF7-02FA-4AD5-9A53-3A7539758C55@fb.com> <MW3PR11MB4700AAF6E8BB1FE1275876A0E1EA9@MW3PR11MB4700.namprd11.prod.outlook.com> <CAKcm_gOKv+pOmjaEsP1G_MkpKV_PzRMeutBjH+0kw4omi7F74w@mail.gmail.com> <FB63F7E1-6827-4B97-B3D2-5AB5E3C5487E@fb.com> <CAPDSy+7aVAP8yw=K_SMrRDYJ_SVj0ixNpsGDhhDUhXOKU-HWWg@mail.gmail.com>
In-Reply-To: <CAPDSy+7aVAP8yw=K_SMrRDYJ_SVj0ixNpsGDhhDUhXOKU-HWWg@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/16.51.21071101
x-ms-exchange-messagesentrepresentingtype: 1
x-ms-exchange-transport-fromentityheader: Hosted
x-originating-ip: [172.27.118.139]
Content-Type: multipart/alternative; boundary="_000_85EBC68C0B484A458F727A3C82D28812akamaicom_"
MIME-Version: 1.0
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.391, 18.0.790 definitions=2021-07-28_12:2021-07-27, 2021-07-28 signatures=0
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 adultscore=0 malwarescore=0 suspectscore=0 phishscore=0 mlxlogscore=999 bulkscore=0 spamscore=0 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2107140000 definitions=main-2107280115
X-Proofpoint-GUID: xLf7dRw5DEYe9a6UGwRDrFp9oJiigvhQ
X-Proofpoint-ORIG-GUID: xLf7dRw5DEYe9a6UGwRDrFp9oJiigvhQ
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.391, 18.0.790 definitions=2021-07-28_12:2021-07-27, 2021-07-28 signatures=0
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 mlxscore=0 priorityscore=1501 lowpriorityscore=0 impostorscore=0 bulkscore=0 malwarescore=0 adultscore=0 suspectscore=0 phishscore=0 mlxlogscore=999 clxscore=1011 spamscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2107140000 definitions=main-2107280117
X-Agari-Authentication-Results: mx.akamai.com; spf=${SPFResult} (sender IP is 72.247.45.32) smtp.mailfrom=jholland@akamai.com smtp.helo=prod-mail-ppoint4
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/xXvLn8ZiRhANMjpbubiOJII9tY0>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 28 Jul 2021 22:57:43 -0000

And yet, we still can see network buffering to maintain packet ordering in new work today, including work specifically targeted at QUIC.

In the “CCID5” ANRW talk from Monday’s 2nd session, a reordering buffer was mentioned in the transparent proxy for the MP-DCCP tunnel they’re wrapping QUIC packets in to get multipath traffic-splitting during transport within wireless carriers (a proposal coming soon to tsvwg):
https://irtf.org/anrw/2021/program.html#:~:text=nathalie%20romo%20moreno

I asked specifically about the reordering buffer at the mic, since this kind of thing has made me sad before. (There was also a side discussion in the chat.)  I got the impression they believe they’re seeing some benefits to apps by including this reordering buffer in the network, citing the wider range of reordering that you get for split-path transport (as compared to the L2 forwarding case).

If there’s endpoint implementations that aren’t doing a good enough job here and therefore we’re seeing new network deployments that introduce buffering because their measurements indicate it’s helpful on common use cases, it could be worthwhile to get this straightened out before it gets too normalized and we start having networks reintroduce hol-blocking in a way that hurts some QUIC use cases in the name of helping others.

Although I expect this can and should be solved at the endpoints, if there is data showing that the ordering solves a real problem with current implementations, reasonable people can reasonably conclude that network buffering to maintain packet order is a good idea.

(Note: UDP client-side port might be an option for a network-visible signal that might “just work” for many (hopefully most?) ordering schemes to avoid buffering for ordering, but it might need some API support and it might lead to some other kinds of ugly nat problems if there’s too many flows doing it...)

+Anna, Nathalie and Markus.  Hopefully they can comment on this also.

Best,
Jake

From: David Schinazi <dschinazi.ietf@gmail.com>
Date: Wed,2021-07-28 at 2:16 PM
To: Roberto Peon <fenix@fb.com>
Cc: Ian Swett <ianswett@google.com>, "mops@ietf.org" <mops@ietf.org>, "Das, Dibakar" <dibakar.das@intel.com>, Alan Frindell <afrind@fb.com>, "quic@ietf.org" <quic@ietf.org>, Kirill Pugin <ikir@fb.com>
Subject: Re: [Mops] Reminder: Video Ingest over QUIC Side Meeting Friday 7/30 18:00 UTC

Why would we need a signal here? This applies to all traffic, be it TCP QUIC or anything else. Firmwares introducing latency to reorder packets was a reaction to bad implementations of TCP from a long time ago that have been fixed in systems that care about performance. In today's world, L2 is better off delivering any and all packets in the order they arrive instead of introducing buffer bloat.

David

On Wed, Jul 28, 2021 at 1:24 PM Roberto Peon <fenix=40fb.com@dmarc.ietf.org<mailto:40fb.com@dmarc.ietf.org>> wrote:
The ideal would be to have public bits that were intended to be interpreted by (as you say, visible to) those layers so any L2 could adapted appropriately without reinventing the wheel.
It isn’t just the local radio firmware that one needs to worry about—it is also the basestation(s) that may be “helping”.

Separately, but also important, is being able to get signals from the application about what tradeoffs should be at the network. I believe that this dovetails into many of the multipath issues, btw.

A couple potentially interesting params are:
  A bit to say please don’t HoL block
  Some kind of mechanism(s) to bound retries (e.g. “don’t retry bit”, but that is obviously not as expressive as throw out packet older than X microseconds)

-=R

From: QUIC <quic-bounces@ietf.org<mailto:quic-bounces@ietf.org>> on behalf of Ian Swett <ianswett=40google.com@dmarc.ietf.org<mailto:40google.com@dmarc.ietf.org>>
Date: Wednesday, July 28, 2021 at 12:42 PM
To: "Das, Dibakar" <dibakar.das@intel.com<mailto:dibakar.das@intel.com>>
Cc: Alan Frindell <afrind=40fb.com@dmarc.ietf.org<mailto:40fb.com@dmarc.ietf.org>>, "quic@ietf.org<mailto:quic@ietf.org>" <quic@ietf.org<mailto:quic@ietf.org>>, "mops@ietf.org<mailto:mops@ietf.org>" <mops@ietf.org<mailto:mops@ietf.org>>, Kirill Pugin <ikir@fb.com<mailto:ikir@fb.com>>
Subject: Re: Reminder: Video Ingest over QUIC Side Meeting Friday 7/30 18:00 UTC

Hi,

I can't answer for Alan, but my belief is yes.  Client wifi stacks sometimes also do some reordering(and introduce the corresponding latency), so if we could design an indication that in-order delivery has no value, it could be fairly widely applicable.

That being said, I don't know what the right mechanism is?  Would we need something visible to a network or can we get away with a socket option that propagates to the local 5G network or Wifi firmware when possible?

Ian

On Wed, Jul 28, 2021 at 3:15 PM Das, Dibakar <dibakar.das@intel.com<mailto:dibakar.das@intel.com>> wrote:
Hi Kirill, Alan,

I could not attend the call this week and wont be able to attend this side meeting either.

But I had a general question about the performance of all such QUIC based protocols over wireless. Typically, the 5G and WiFI MAC layers deliver frames in-order which sort of recreates the HOL blocking problem at lower layers. I would expect this to in turn prevent the QUIC protocol to achieve its full performance gains at least in some congested network scenarios. Considering that in-order delivery is made optional in 5G PDCP, I was wondering if there could be a value to have some signaling defined in the QUIC (or RUSH ?) protocol that would allow lower layers to make better decision about whether to enable/disable in-order delivery for certain streams.

I apologize in advance if this is not the right venue to ask questions.

Regards,
Dibakar



From: QUIC <quic-bounces@ietf.org<mailto:quic-bounces@ietf.org>> On Behalf Of Alan Frindell
Sent: Wednesday, July 28, 2021 8:42 AM
To: avt@ietf.org<mailto:avt@ietf.org>; wish@ietf.org<mailto:wish@ietf.org>; QUIC WG <quic@ietf.org<mailto:quic@ietf.org>>; mops@ietf.org<mailto:mops@ietf.org>
Cc: Kirill Pugin <ikir@fb.com<mailto:ikir@fb.com>>
Subject: Reminder: Video Ingest over QUIC Side Meeting Friday 7/30 18:00 UTC

Video Ingest over QUIC Side Meeting Friday 7/30 18:00 UTC / 11 Pacific

Link to draft agenda and video conference details: https://github.com/afrind/draft-rush/blob/main/meeting-materials/agenda.2021.07.03.md<https://urldefense.com/v3/__https:/github.com/afrind/draft-rush/blob/main/meeting-materials/agenda.2021.07.03.md__;!!GjvTz_vk!E0SzSsjcIQqc-TDdIf5-y7XjoWfnEA-7r9fdRAjEKZXc1GYhGomlKIXMwmDZ0Ls$>

-Alan