Re: Add deadline awareness to QUIC

Ian Swett <ianswett@google.com> Wed, 07 December 2022 15:14 UTC

Return-Path: <ianswett@google.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 334D8C1522A3 for <quic@ietfa.amsl.com>; Wed, 7 Dec 2022 07:14:26 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -17.596
X-Spam-Level:
X-Spam-Status: No, score=-17.596 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, ENV_AND_HDR_SPF_MATCH=-0.5, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001, USER_IN_DEF_DKIM_WL=-7.5, USER_IN_DEF_SPF_WL=-7.5] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=google.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id LCdtSLKhSkjQ for <quic@ietfa.amsl.com>; Wed, 7 Dec 2022 07:14:21 -0800 (PST)
Received: from mail-wm1-x32f.google.com (mail-wm1-x32f.google.com [IPv6:2a00:1450:4864:20::32f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 90119C1522A0 for <quic@ietf.org>; Wed, 7 Dec 2022 07:14:21 -0800 (PST)
Received: by mail-wm1-x32f.google.com with SMTP id ay40so7139609wmb.2 for <quic@ietf.org>; Wed, 07 Dec 2022 07:14:21 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=bprLgP+Iy8YWzJqCUBQUGUAWtu7m5RmSiX3ys4derdI=; b=nFxQRyEzTayjwN2hbW2pCjvNjIzOdDzz7H4HfyAPlnQl28gSVw6LECIiXBLSbPxmbn lOJ2tvOSe3WGcKh04/IDZ+T7sCxg3rlNROI/5UnNtsk5+k3F/CqTBKV7eSFMra83Enrk IJwF41/4ZiI659Di3Lv+Vk3VgPUXrjWUKDE2JNcRcpdyLvlgQNtxYKKs6Ph0yTa+5FoP /WcldNF9HuSlOJMadW69qlAypBPDhPa4gQXZ9JJDaRghIJdEww1R2GHFM8z+OnXO0vOq SRhGlyrfHu1kXaH0+1Xz3EDjOK1emvKzOhMYiC6HZR25SoGXjGdW1EPKEHrjw8fZCyi/ 3fKw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=bprLgP+Iy8YWzJqCUBQUGUAWtu7m5RmSiX3ys4derdI=; b=GhRyDvLPFbccZ4Qnpd63VT9gG/x5sJMmHPupoZSWNxK5/+6HBH0B65F/H3gxNTGWxG +yam1lTa4UtED6xh460/Yo8O7ru1oCazX4LxumKBY71v1qkAHf8sOo4ghFL/bueJ2tOb aScapq6kCvFZIFJen2MBjVumwFb2NrVN3XlGQDN2yPA3/2Xqp/PncNq6AcQ9kSds88gT QhXrsPy6AN1whBO5fxzEenxZi5nTGeVWaIB8paUlpQ0pNWfaxwKyRFuR9CR83a3r74aF iJVeb0oo6oAljBg3nOezzZMIT//6FbJ/dwT4ZhagFHvPnDNm6uHqqDdJ/TwYA9VP06cJ ftPA==
X-Gm-Message-State: ANoB5plwfpmN6TjR8U+9lSGeubkEOrl8vMZY6kFG4LEhHOm10nQsPm0F i7jZcxPpfGlD9osPz6XpdRYHOeiVnZqpMjaWH38JUg==
X-Google-Smtp-Source: AA0mqf5niRcXOxY4hMUbQuELPNnVCx1xRF2Ju0GmoHa14xec5Ejr5Vp9x+urZyiwNZzuASMH+2/H8ONJWRS7ftO1cQw=
X-Received: by 2002:a05:600c:4f54:b0:3d0:2d56:eb55 with SMTP id m20-20020a05600c4f5400b003d02d56eb55mr51328204wmq.176.1670426059905; Wed, 07 Dec 2022 07:14:19 -0800 (PST)
MIME-Version: 1.0
References: <CAAZo2nGK_HPbRKhW7fk8cBbZ5Y8HJOf737COKoFy=Xc6XHoL9g@mail.gmail.com> <797f896f-839b-3734-0c07-0465bfd7fe35@huitema.net> <CAC8QAcdeUvkGpoR4-dQp05cjW8QnHRVAvUkV5ASCZ=xpYG7Tfw@mail.gmail.com> <CAAZo2nGRRRoZmmb2yTCBm0MykQB0W6_vvdL3jTYyQhwkmm1gzA@mail.gmail.com> <CAKcm_gORtoZCbkxiqvoibaMnxKyPNw144vWQR+DuBmnVca13dA@mail.gmail.com> <44c4c970e53c453fb749eaae05260297@huawei.com>
In-Reply-To: <44c4c970e53c453fb749eaae05260297@huawei.com>
From: Ian Swett <ianswett@google.com>
Date: Wed, 07 Dec 2022 10:14:08 -0500
Message-ID: <CAKcm_gM3Jp9KWiQn-D6BoASfoq6KVB5TywFx3n8gAwkovcjoXA@mail.gmail.com>
Subject: Re: Add deadline awareness to QUIC
To: "Shihang(Vincent)" <shihang9=40huawei.com@dmarc.ietf.org>
Cc: Chuan Ma <simonkorl0228@gmail.com>, "sarikaya@ieee.org" <sarikaya@ieee.org>, Christian Huitema <huitema@huitema.net>, "quic@ietf.org" <quic@ietf.org>, "cuiyong@tsinghua.edu.cn" <cuiyong@tsinghua.edu.cn>
Content-Type: multipart/alternative; boundary="000000000000ed53bb05ef3e5fb4"
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/CgYN5BAD_WE8CIPP7gsjjI_Qwv0>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 07 Dec 2022 15:14:26 -0000

I can see how that would be useful, though I wonder if Christian (
draft-huitema-quic-ts
<https://datatracker.ietf.org/doc/draft-huitema-quic-ts/>) or my (
draft-smith-quic-receive-ts
<https://datatracker.ietf.org/doc/draft-smith-quic-receive-ts>/) timestamp
draffs might also provide the same delivery time functionality in a more
general way?

On Wed, Dec 7, 2022 at 7:59 AM Shihang(Vincent) <shihang9=
40huawei.com@dmarc.ietf.org> wrote:

> Hi Ian,
>
> Another author of DTP here.
>
> Thanks for your comment. Glad to hear that the deadline feature is useful
> inside Chromium. Can you talk a little bit more about those use cases?
>
>
>
> You are right that a simple deadline-awareness feature does not require
> new frames. We add new frames to build a feedback loop of the deadline
> delivery. The BLOCK_INFO frame which contains the start time stamp is sent
> from sender to receiver. The receiver calculates the difference of the
> expected deadline and the actual block completion time and sent it back to
> the sender. Sender then uses it to calibrate its estimation of delivery
> time. The sender can infer it from the ACK but it is affected by the ACK
> policy such as ACK frequency. We will update the draft to reflect these
> design considerations.
>
>
>
> Best,
>
> Hang
>
>
>
> *From:* QUIC <quic-bounces@ietf.org> *On Behalf Of *Ian Swett
> *Sent:* Monday, November 21, 2022 7:17 PM
> *To:* Chuan Ma <simonkorl0228@gmail.com>
> *Cc:* sarikaya@ieee.org; Christian Huitema <huitema@huitema.net>;
> quic@ietf.org; cuiyong@tsinghua.edu.cn
> *Subject:* Re: Add deadline awareness to QUIC
>
>
>
> This looks like it might be conflating a few features, some of which are
> very media specific and some which are more general, such as prioritization
> and deadline awareness.
>
>
>
> I may have missed it, but I'm not sure I understand why the deadline
> awareness requires a new frame.  For low latency media, the sender
> typically knows what the deadline is, so it has no need to communicate it
> to the peer, unless this design has relays in mind.  If so, Media over QUIC
> is even more the right venue for this.
>
>
>
> For example, the Chromium QUIC code has had a ttl feature for a few years
> that we've used for various use cases:
>
>
> https://source.chromium.org/chromium/chromium/src/+/main:net/third_party/quiche/src/quiche/quic/core/quic_stream.cc;l=1384
>
>
>
> Ian
>
>
>
> On Tue, Nov 15, 2022 at 11:03 AM Chuan Ma <simonkorl0228@gmail.com> wrote:
>
> Hello Huitema and Sarikaya, thanks for the reply.
>
> You are correct that some of our designs are similar to MoQ answers. For
> example, we both use partial delivery to improve real-time app delivery.
> Actually, we sent the draft to the MoQ mailing list and discussed the
> detailed design and which layer to place the module. But our draft focuses
> on providing general deadline-aware transport service as a QUIC extension
> which is out of the scope of MoQ. MoQ builds on top of QUIC and is
> explicitly tailored to media delivery.
>
> We would like to hear the opinion of the QUIC community to see the need
> for such a *general deadline-aware transport service*.
>
>
>
> On Tue, Nov 15, 2022 at 7:12 AM Behcet Sarikaya <sarikaya2012@gmail.com>
> wrote:
>
>
>
>
>
> On Mon, Nov 14, 2022 at 1:05 PM Christian Huitema <huitema@huitema.net>
> wrote:
>
> Hello Chuan Ma,
>
> Your draft aligns very much with some of the options investigated for
> "media over QUIC". Have you considered participating in that working group?
>
>
>
> I agree, this looks very much like media transmission material.
>
>
>
> Behcet
>
> -- Christian Huitema
>
> On 11/14/2022 10:20 AM, Chuan Ma wrote:
> > Dear all:
> >
> > I'm Chuan Ma from Tsinghua University. I want to discuss the deadline
> > awareness of the current application and whether we should add it to the
> > QUIC protocol.
> >
> > Applications may have specific deadline requirements for data
> transmission.
> > For instance, a video conference application may require sending the data
> > with a deadline of 200ms to enable live interaction. The application may
> > drop the data that misses the deadline, even if the data has already
> > reached the other end. In this case, it is possible to drop the data
> after
> > the given deadline from the sender to save bandwidth and decrease queuing
> > time. Deadline requirement is also helpful to offer deadline-aware
> > scheduling combined with QUIC stream priority. Such scheduling methods
> can
> > increase the punctuality of QUIC and allow more data to arrive on time.
> It
> > is possible to extend QUIC and offer deadline-aware transport as a
> service.
> >
> > Nowadays, deadline-aware data transmission is getting more and more
> > popular. Applications that emphasize real-time interaction, such as
> VR/AR,
> > gaming, and video conference, are drawing more and more attention. So
> > deadline-aware transport has a lot of use cases. However, currently, it
> is
> > the application that is responsible for realizing deadline-aware
> transport.
> > This transport service should be offered by the transport protocol but
> not
> > be left to the application. It is reasonable to provide such transport
> > service in a new transport protocol, and QUIC is a good base.
> >
> > We wrote a draft to show this idea in
> > https://datatracker.ietf.org/doc/draft-shi-quic-dtp/ and implemented a
> > protocol based on QUIC called DTP (Deadline-aware Transport Protocol) in
> > https://github.com/STAR-Tsinghua/DTP.git. We also built a live stream
> > prototype application to compare the performance between DTP and QUIC (
> > https://github.com/STAR-Tsinghua/LiveEvaluationSystem.git). We found
> that
> > DTP outperformed QUIC in improving data transmission punctuality and
> saving
> > bandwidth resources. We published the paper in ICNP22 and built several
> > systems like proxy and tunnel based on DTP. It would be a good idea to
> give
> > this method a try.
> >
> > We'd like to know what you think about this topic. Please let us know if
> > you have any comments.
> >
> > Best regards.
> >
> > Chuan Ma
> >
>
>