More details about multipath quic in Alibaba

Yanmei Liu <healing4d@gmail.com> Sun, 25 October 2020 06:45 UTC

Return-Path: <healing4d@gmail.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 130A43A12BE for <quic@ietfa.amsl.com>; Sat, 24 Oct 2020 23:45:45 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level:
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jtRiGccd3RnQ for <quic@ietfa.amsl.com>; Sat, 24 Oct 2020 23:45:43 -0700 (PDT)
Received: from mail-ed1-x52b.google.com (mail-ed1-x52b.google.com [IPv6:2a00:1450:4864:20::52b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id E96B63A12BC for <quic@ietf.org>; Sat, 24 Oct 2020 23:45:42 -0700 (PDT)
Received: by mail-ed1-x52b.google.com with SMTP id o18so6028930edq.4 for <quic@ietf.org>; Sat, 24 Oct 2020 23:45:42 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=KWoCw3pI5gU8ytb5/8BJwz/VsDVvn7MJSZ8Ds40HRX8=; b=MwXyqH7JeH3kthP+KvVX/TvOJrBwhCxXX+sVePaqsVvCh4dw+DzyE81AaOXe9pvI74 uG81WjFH7TPBEfs4AdA/actGpZUC3vZwAK8TB3jbp32IQFs2qNWiQPK/RgZ/VfNNnokP pODBbuOXXVEgsu/iSiNatnrtjL+imAfkS2Uak/wj2y/sxZyRmvn2+G3WpS9MQ1to5JJd AXL6JqqbhkVG9m1cWrjAIqG5RwS1QJVMZHa2hD55QFSvuv8eG5R5SXoz5F2XR8/TohGy Na2v8lmnxeHRyaQ83UJitBbGpKr6MNFBkeEmvhMcdl+AcH0Uyq5mODdXWZvHl6XLO3OJ nj2Q==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=KWoCw3pI5gU8ytb5/8BJwz/VsDVvn7MJSZ8Ds40HRX8=; b=Sz3UqDIsAxa00vA5EsXawktxeGM8r1KoUZKZGShxhoCP7YNZhfaA5ADDEv/WbfQYNc nOfZd18uW/6h/LKlQMxKcK4JtBiPvHLPe7CY1V5UiW+bwscQw99RwAx9Cb1U9Wd80hLo +3ET9N9Qv4xd2Oq7/aDCP0cBEk6OgIkwM8EeHwUtlywTgfQNbCUFNa0leLsSAegia6zC SoJjNjbR8TVzt+TfsFnGuQdAL4dCF4c1MSPRkZYJpUPpull83sOmCOkWFuSC8Eky6qLS Om0tNVA/NuhOfS8e9svfFLvT91kBd3btA4dQ//zBCSZXahW+LUFv8d1v2nI6QApsLZ4+ Rmcg==
X-Gm-Message-State: AOAM533EzbzQXusg4JvGEZvC5Ik3aEfvKPwvU1Jm3rDXcoiO9yASmqYY iTsUeNPqyeDBRRuJufjn1Cp78MPN1WvLTUJOZGF7Kjme6SS/Kg==
X-Google-Smtp-Source: ABdhPJxpDmIr3bnAZ9/Hx41Wgd/duxccQGZWlafriV+isJY9KtsyYt5RQRAWGGog3/ulFf3JBigBUqlLa8wuKEZg7TU=
X-Received: by 2002:a05:6402:754:: with SMTP id p20mr10209415edy.109.1603608340746; Sat, 24 Oct 2020 23:45:40 -0700 (PDT)
MIME-Version: 1.0
From: Yanmei Liu <healing4d@gmail.com>
Date: Sun, 25 Oct 2020 14:45:29 +0800
Message-ID: <CAMDWRAb5pWdYHwc5h6MSc6uprtUQ+bWniMWamiv+mVnX32yQXA@mail.gmail.com>
Subject: More details about multipath quic in Alibaba
To: quic@ietf.org, miaoji.lym@alibaba-inc.com, yunfei.ma@alibaba-inc.com, anqing.aq@alibaba-inc.com, hongqiang.liu@alibaba-inc.com
Content-Type: multipart/alternative; boundary="00000000000082561b05b279296e"
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/6VeOF3eTi7GQM_tvXhVuTjDEMDs>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 25 Oct 2020 06:45:45 -0000

Hi everyone,

After we introduced the use cases and requirements of Multipath QUIC
project at Alibaba in the IETF Interim meeting on Oct. 22rd., we have
received many questions from people who are curious about the details in
the working group, so we would like to give more information in this
mailing list.

- Q1: Do we care about cellular cost?
- Sure. Cellular cost is a very important factor that influences our packet
scheduler design. Some of our customers are sensitive about the cellular
cost and some do not, so they need different scheduling policies. For
customers who are sensitive about cellular cost, Alibaba have collaborated
with several mobile carriers, so customers can get enrolled in a special
data plan, which allows them to enjoy unlimited free cellular data when
using apps from Alibaba eco-system(i.e. alibaba traffic costs the user
nothing). For customers who are not sensitive about the data cost, for
example, professional streamers/Vloggers and customers who want to get high
quality services for business collaborations, they can turn on the
multi-path feature if they want.

- Q2: If someone who wants this could go off an cook up an extension and
get experience with it then come back with that experience?
- We completely agree that a large-scale deployment experience is needed to
draw a conclusion and inspire new innovations. Right now, we are doing the
extension described in
https://tools.ietf.org/html/draft-an-multipath-quic-00, which is integrated
in Taobao for short-form video streaming. The feature is already made
available for certain customers in China and we are working to expand the
scope.

- Q3: How to solve the linkability problem in multipath ?
- QUICv1 solves the linkablity problem with Connection ID’s re-negotiation
when connection migration happens. We reuse the mechanism from QUICv1 in
our multipath quic implementation. For each new sub-connection, client and
server need to exchange available unused Connection IDs before a client
tries to create a new sub-connnection. When client creates a new
sub-connection and sends packets on the new path, it uses the new
Connection IDs. As the process of the negotiation is encrypted, it would
not link the packets sent on new path with the previous path.

- Q4: Difference from early multipath QUIC proposals?
- First of all, we really appreciate the work of early proposals such as
[I-D.deconinck-quic-multipath]. However, in our implementation, we’ve found
that two things are extremely important and should impact the protocol
design. First, we build multi-paths based on the concept bi-directional
“sub-connections” in each new path, and find it’s the easiest way to
implement multipath because it readily fits into the nature of both
cellular and wifi links that cover the majority of multi-path applications.
In doing so, you can almost reuse all the design / implementations for
QUICv1 connections. Second,  the multi-path QUIC design needs dynamic
scheduling strategy. As is pointed in the answer to Q1 above, our customers
who want multipath have very different needs, so making the scheduler
dynamic allows us to fulfill the job.

We would like to know what people think about the draft, and all feedbacks
and suggestions are welcome.

Thanks,
Yanmei Liu