RE: New Liaison Statement, "LS on ATSSS Phase 2 conclusions"

Mikkel Fahnøe Jørgensen <mikkelfj@gmail.com> Thu, 03 December 2020 11:01 UTC

Return-Path: <mikkelfj@gmail.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 429443A0E96; Thu, 3 Dec 2020 03:01:31 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.096
X-Spam-Level:
X-Spam-Status: No, score=-2.096 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, UNPARSEABLE_RELAY=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id WzSrwUl2UXj6; Thu, 3 Dec 2020 03:01:27 -0800 (PST)
Received: from mail-yb1-xb35.google.com (mail-yb1-xb35.google.com [IPv6:2607:f8b0:4864:20::b35]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 95E773A0E94; Thu, 3 Dec 2020 03:01:27 -0800 (PST)
Received: by mail-yb1-xb35.google.com with SMTP id l14so1656628ybq.3; Thu, 03 Dec 2020 03:01:27 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:in-reply-to:references:mime-version:date:message-id:subject:to :cc; bh=mr0cPDEf6UNw1XL23QX/09Uw/GhPU6KSSrZXAaAkqF8=; b=d0TWkLiFBIM0Gl9yaLtPOFrWLxdSn1a2mjO3M5Vc/m2ijSpMlL3OX+5boGhPYXtSYd wf/6b7RVrI7VOOYIME8uhsILxmiUMfBSTk1RD9BOCMEOzIzlwFWtaZheRQNDB+awk2/u 9ELCI5//B+wCF5YsoTKYI2TSChAcyU8W2iduqL4Ir+c+H6W3w84P3ZtCnxWnmfen3fGk 9/jkWDi2FT/38pAEmJ/7UBTRrjvNybHCbWafrZz0RUr3cP4CXDQz7ziDZiEiAVCmqbwW lHkDBvr9kFdkKwVjuiTbI/mQMArkLTWmJtSlX1SO2V4bqH6cONkCVmX8Xhof+s2BjVsK 8caA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:in-reply-to:references:mime-version:date :message-id:subject:to:cc; bh=mr0cPDEf6UNw1XL23QX/09Uw/GhPU6KSSrZXAaAkqF8=; b=UcWMI51fgzs6HaG112zKPcY5glQBPB28sVh2+o1bNkP8wSqvLgWZ0IFdTlHqqiqdTw M7l4+xdvD9uGapNK4kTLFWDFNn640zenCNVimI+B0uHI8XdSfs+m5zCAU62NkezIVArq nj+SX6q6ClI/acOQaOCrr4rBA4fd3pwMkyW5NCmbs5yneolVeKfOhuPY1bYRPHMaO6K2 urmx0pgJVGgRWfM2dVfpUACgUYU4BeSp17Ggt2HUDVOrp0pQODhS12BC45tFqUSxOrew 5QFR+NlLzU59kICucuTnEOtCx+zjXVTnRaJRPlvD2uBc23wk8OFLSQbJe4PuR3CA+LGH lmsg==
X-Gm-Message-State: AOAM53290uuovW86/vMAjxxrXDgGOVCv17b9Pcfu07kIHTmX9hrPhakC EyEf451Soe+g45TuFDc02SfUSzeabrQ4JKr42f8ZfabR6QmYUNtY
X-Google-Smtp-Source: ABdhPJwK+lZNh/dG8ujPny+WnhZXGu7HL40ijBR3FSwb6DcmVtCqiLJNl3+CDPhQVocuiBTjhX6rv1bb0prK7CajrfA=
X-Received: by 2002:a25:d24c:: with SMTP id j73mr3815992ybg.489.1606993286657; Thu, 03 Dec 2020 03:01:26 -0800 (PST)
Received: from 1058052472880 named unknown by gmailapi.google.com with HTTPREST; Thu, 3 Dec 2020 03:01:26 -0800
From: Mikkel Fahnøe Jørgensen <mikkelfj@gmail.com>
In-Reply-To: <LEJPR01MB063596FB482D7ED3F81E2FBEFAF20@LEJPR01MB0635.DEUPRD01.PROD.OUTLOOK.DE>
References: <160675082221.16479.6130039061469494989@ietfa.amsl.com> <CAOYVs2ogM86kasog5T7-XG3Nx3kZGx6Vi1id=O=0yK6WK3LHOg@mail.gmail.com> <7047_1606815783_5FC61027_7047_384_1_6B7134B31289DC4FAF731D844122B36E3A64B1F1@OPEXCAUBM41.corporate.adroot.infra.ftgroup> <CANatvzwjyfrzoX6vA4S81hABQXcpYCJ7DWEDYBnNnRLFGWMgXg@mail.gmail.com> <LEJPR01MB0635396C6C147F869AFDCD14FAF40@LEJPR01MB0635.DEUPRD01.PROD.OUTLOOK.DE> <1927_1606850062_5FC6960E_1927_422_1_6B7134B31289DC4FAF731D844122B36E3A64C3E8@OPEXCAUBM41.corporate.adroot.infra.ftgroup> <CACpbDceeYDNV7mDcj1x4w21UE3nJggoxp0vNTd8M-yn3ShhYDg@mail.gmail.com> <BYAPR02MB5176090F48871DD8E9FB9904F7F20@BYAPR02MB5176.namprd02.prod.outlook.com> <LEJPR01MB0635AA0C1EF193B23922FFDFFAF20@LEJPR01MB0635.DEUPRD01.PROD.OUTLOOK.DE> <CAN1APddJzP=GHHE11Jfabgw57sxTtQyTjzJBhCLiG9b787Oeug@mail.gmail.com> <LEJPR01MB063596FB482D7ED3F81E2FBEFAF20@LEJPR01MB0635.DEUPRD01.PROD.OUTLOOK.DE>
MIME-Version: 1.0
Date: Thu, 03 Dec 2020 03:01:25 -0800
Message-ID: <CAN1APde=t0C+7P9nT1iqqs3ELxPrCVoZTB4EYJJHuf+tQ=paqQ@mail.gmail.com>
Subject: RE: New Liaison Statement, "LS on ATSSS Phase 2 conclusions"
To: jri.ietf@gmail.com, wzia@qti.qualcomm.com, markus.amend@telekom.de, lionel.morand@orange.com
Cc: quic@ietf.org, martenseemann@gmail.com, lucaspardue.24.7@gmail.com, 3gppliaison@etsi.org, salki@motorola.com, lars@eggert.org, gonzalo.camarillo@ericsson.com, chair@ietf.org, kazuhooku@gmail.com, martin.h.duke@gmail.com, statements@ietf.org, magnus.westerlund@ericsson.com
Content-Type: multipart/alternative; boundary="00000000000001f9e505b58d48ab"
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/zyEt_RpqGcfF-AC2FOeSTs4nEoE>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 03 Dec 2020 11:01:31 -0000

I’d suggest adding a priority scheme: for example only send datagrams on
the low latency path, or only on the slow path, or any path if you want to
maximize resources. If you restrict to one path you get sort-of ordering
without a lot of complexity. You might also want to allow fast path to move
to slow path when there is doubt about link quality, but such that only one
path is used at a time. This does not rule out reordering when switching
path, but a single path can also reorder.

In this way you get the desired profile without all the downsides, except
that you get a lower throughput.

Such a scheme does not need agreement on both ends. It doesn’t even need to
be specified in the protocol. It is an API design issue.


Kind Regards,
Mikkel Fahnøe Jørgensen


On 3 December 2020 at 11.14.10, markus.amend@telekom.de (
markus.amend@telekom.de) wrote:

Hi Mikkel,



that is the decisive question here. I’m convinced, that almost no
encapsulated service/transport, where the traffic is split over cellular
and Wi-Fi, can cope with the enormous out-of-order delivery due to the
latency differences. That means the multipath experience is probably worse
compared to traditional singe-path usage. Using datagram frames in the 3GPP
scenario does not imply that out-of-order delivery is accepted! That’s why
the LS points explicitly to that. Using in-order delivery from QUIC streams
will introduce re-transmission, right, that’s why it is not in focus of the
LS.



However, I also agree that strict re-ordering is not the solution, since
this causes HoL and it’s open how to deal with lost information. So
probably it’s time for some smart re-ordering mechanisms here?!



Br



Markus



*From:* Mikkel Fahnøe Jørgensen <mikkelfj@gmail.com>
*Sent:* Donnerstag, 3. Dezember 2020 11:01
*To:* jri.ietf@gmail.com; wzia@qti.qualcomm.com; Amend, Markus <
Markus.Amend@telekom.de>; lionel.morand@orange.com
*Cc:* quic@ietf.org; martenseemann@gmail.com; lucaspardue.24.7@gmail.com;
3gppliaison@etsi.org; salki@motorola.com; lars@eggert.org;
gonzalo.camarillo@ericsson.com; chair@ietf.org; kazuhooku@gmail.com;
martin.h.duke@gmail.com; statements@ietf.org; magnus.westerlund@ericsson.com
*Subject:* RE: New Liaison Statement, "LS on ATSSS Phase 2 conclusions"



Are the special ordering concerns beyond single streams?



I don’t think it is useful to reorder datagram frames and streams are by
definition ordered within a stream and not across streams in QUIC v1 and I
don’t see any multipath design that would change that.



If datagram frames were to be ordered, you would loose the ASAP property
you want from those frames, and if cross stream ordering is applied, you
introduce HoL.



Kind Regards,

Mikkel Fahnøe Jørgensen



On 3 December 2020 at 10.33.17, markus.amend@telekom.de (
markus.amend@telekom.de) wrote:

Full ACK. 3GPP requests MP-QUIC to be applied between UE and UPF.
Encapsulating the traffic from services on the UE into this MP-QUIC
connection allows communication with the respective remote servers.



Br



Markus



*From:* Waqar Zia <wzia@qti.qualcomm.com>
*Sent:* Donnerstag, 3. Dezember 2020 09:49
*To:* Jana Iyengar <jri.ietf@gmail.com>; lionel.morand@orange.com
*Cc:* magnus.westerlund@ericsson.com; lars@eggert.org; statements@ietf.org;
Apostolis Salkintzis <salki@motorola.com>; gonzalo.camarillo@ericsson.com;
3GPPLiaison@etsi.org; chair@ietf.org; lucaspardue.24.7@gmail.com;
martenseemann@gmail.com; Amend, Markus <Markus.Amend@telekom.de>;
quic@ietf.org; martin.h.duke@gmail.com; kazuhooku@gmail.com
*Subject:* RE: New Liaison Statement, "LS on ATSSS Phase 2 conclusions"



Hi Jana,



The diagram is the correct depiction as I see: the MP-QUIC connection is
indeed expected to be between the UE and the UPF, not between the UE and a
(3GPP-) external server. Hence the reordering that may happen due to use of
two different access technologies between the UE and UPF needs to be fixed
at the UPF for the uplink and at the UE for the downlink.



Best regards,

Waqar.



*From:* QUIC <quic-bounces@ietf.org> *On Behalf Of *Jana Iyengar
*Sent:* 03 December 2020 05:55
*To:* lionel.morand@orange.com
*Cc:* magnus.westerlund@ericsson.com; lars@eggert.org; statements@ietf.org;
Apostolis Salkintzis <salki@motorola.com>; gonzalo.camarillo@ericsson.com;
3GPPLiaison@etsi.org; chair@ietf.org; lucaspardue.24.7@gmail.com;
martenseemann@gmail.com; Markus.Amend@telekom.de; quic@ietf.org;
martin.h.duke@gmail.com; kazuhooku@gmail.com
*Subject:* Re: New Liaison Statement, "LS on ATSSS Phase 2 conclusions"



*CAUTION*: This email originated from outside of the organization.

Speaking only as a user of computer technology, thanks for making this more
palatable as a PDF. A few questions:



- I am a bit confused by the picture, and Spencer or someone else can point
me to something that I haven't read yet -- I thought the QUIC connection
was between the remote server and the UE, not between the UPF and the UE.
Am I missing something?

- Assuming that the QUIC connection is between the UE and the remote
server: Since only endpoints can see the packet numbers, how are the
packets supposed to be re-sequenced at any point in the middle (the UPF)?



Thanks!

- jana



On Tue, Dec 1, 2020 at 11:14 AM <lionel.morand@orange.com> wrote:

Including Apostolis into the loop.



*De :* Markus.Amend@telekom.de [mailto:Markus.Amend@telekom.de]
*Envoyé :* mardi 1 décembre 2020 12:07
*À :* kazuhooku@gmail.com; MORAND Lionel TGI/OLN <lionel.morand@orange.com>
*Cc :* magnus.westerlund@ericsson.com; statements@ietf.org;
gonzalo.camarillo@ericsson.com; 3GPPLiaison@etsi.org; chair@ietf.org;
lucaspardue.24.7@gmail.com; martenseemann@gmail.com; lars@eggert.org;
quic@ietf.org; martin.h.duke@gmail.com
*Objet :* RE: New Liaison Statement, "LS on ATSSS Phase 2 conclusions"



Thanks for raising this topic. With
https://tools.ietf.org/html/draft-amend-iccrg-multipath-reordering-01 we
consider exactly that and try to provide input to develop/discuss different
re-ordering strategies. My personal belief is, that without any re-ordering
implementation in the UPF or UE the end-to-end delivery will be worse.



*From:* QUIC <quic-bounces@ietf.org> *On Behalf Of *Kazuho Oku
*Sent:* Dienstag, 1. Dezember 2020 11:29
*To:* lionel.morand@orange.com
*Cc:* Magnus Westerlund <magnus.westerlund@ericsson.com>; Liaison Statement
Management Tool <statements@ietf.org>; gonzalo.camarillo@ericsson.com;
3GPPLiaison@etsi.org; chair@ietf.org; Lucas Pardue <
lucaspardue.24.7@gmail.com>; Marten Seemann <martenseemann@gmail.com>; Lars
Eggert <lars@eggert.org>; QUIC Discussion List <quic@ietf.org>; Martin Duke
<martin.h.duke@gmail.com>
*Subject:* Re: New Liaison Statement, "LS on ATSSS Phase 2 conclusions"



Lionel, thank you for converting the statement to PDF.



Reading the document, I have one question.



"The simultaneous transmission of a data flow across two accesses should
not result in out-of-order delivery"

I wonder what this sentence means. Is it suggesting that UPF (and possibly
UE) would buffer packets that arrive on the faster path until the packets
that were sent on the slower path reach that node? To give an example,
let's say that UE has sent three packets: packet 1 sent using WiFi, packet
2 using LTE, packet 3 using WiFi. UPF receives packets in the order of 1,
3, 2. Is UPF expected to postpone the forwarding of packet 3 until it
receives packet 2?

I raise the question, because during the interim, some have pointed out
that such buffering has negative effects on loss recovery, and that we
should devote our efforts to designing an end-to-end multi-path design,
rather than having an intermediary that aggregates paths (in this case UPF).





2020年12月1日(火) 18:43 <lionel.morand@orange.com>:

Hi,



Here is a pdf version.



Regards,



Lionel



*De :* Marten Seemann [mailto:martenseemann@gmail.com]
*Envoyé :* mardi 1 décembre 2020 05:17
*À :* Liaison Statement Management Tool <statements@ietf.org>
*Cc :* Lucas Pardue <lucaspardue.24.7@gmail.com>; Lars Eggert <
lars@eggert.org>; Magnus Westerlund <magnus.westerlund@ericsson.com>;
MORAND Lionel TGI/OLN <lionel.morand@orange.com>;
gonzalo.camarillo@ericsson.com; 3GPPLiaison@etsi.org; chair@ietf.org; QUIC
Discussion List <quic@ietf.org>; Martin Duke <martin.h.duke@gmail.com>
*Objet :* Re: New Liaison Statement, "LS on ATSSS Phase 2 conclusions"



Would it be possible to publish this document in a format that can be
opened by everyone without using proprietary software?



Thank you,

Marten



On Mon, Nov 30, 2020 at 10:40 PM Liaison Statement Management Tool <
statements@ietf.org> wrote:

Title: LS on ATSSS Phase 2 conclusions
Submission Date: 2020-11-30
URL of the IETF Web page: https://datatracker.ietf.org/liaison/1710/

From: Susanna Kooistra <3GPPLiaison@etsi.org>
To: Lars Eggert <lars@eggert.org>,Lucas Pardue <lucaspardue.24.7@gmail.com>
Cc: QUIC Discussion List <quic@ietf.org>,Martin Duke <
martin.h.duke@gmail.com>,Magnus Westerlund
<magnus.westerlund@ericsson.com>,Lucas
Pardue <lucaspardue.24.7@gmail.com>,Lars Eggert <lars@eggert.org>,
gonzalo.camarillo@ericsson.com,chair@ietf.org
Response Contacts: lionel.morand@orange.com,3GPPLiaison@etsi.org
Technical Contacts:
Purpose: For information

Body:
Attachments:

    S2-2009400_8852r02

https://www.ietf.org/lib/dt/documents/LIAISON/liaison-2020-11-30-3gpp-tsgsa-sa2-quic-ls-on-atsss-phase-2-conclusions-attachment-1.doc



_________________________________________________________________________________________________________________________



Ce message et ses pieces jointes peuvent contenir des informations
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez
recu ce message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les
messages electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere,
deforme ou falsifie. Merci.



This message and its attachments may contain confidential or
privileged information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and
delete this message and its attachments.

As emails may be altered, Orange is not liable for messages that have
been modified, changed or falsified.

Thank you.



-- 

Kazuho Oku

_________________________________________________________________________________________________________________________



Ce message et ses pieces jointes peuvent contenir des informations
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez
recu ce message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les
messages electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere,
deforme ou falsifie. Merci.



This message and its attachments may contain confidential or
privileged information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and
delete this message and its attachments.

As emails may be altered, Orange is not liable for messages that have
been modified, changed or falsified.

Thank you.