[tsvwg] Fwd: New Version Notification for draft-white-tsvwg-lld-00.txt

Luca Muscariello <luca.muscariello@gmail.com> Sun, 17 March 2019 08:02 UTC

Return-Path: <luca.muscariello@gmail.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 51113128B33 for <tsvwg@ietfa.amsl.com>; Sun, 17 Mar 2019 01:02:15 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.998
X-Spam-Level:
X-Spam-Status: No, score=-1.998 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7Aw5uBtXDBML for <tsvwg@ietfa.amsl.com>; Sun, 17 Mar 2019 01:02:12 -0700 (PDT)
Received: from mail-ot1-x32f.google.com (mail-ot1-x32f.google.com [IPv6:2607:f8b0:4864:20::32f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 666A812788C for <tsvwg@ietf.org>; Sun, 17 Mar 2019 01:02:12 -0700 (PDT)
Received: by mail-ot1-x32f.google.com with SMTP id g1so11872883otj.11 for <tsvwg@ietf.org>; Sun, 17 Mar 2019 01:02:12 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=t9HXeyIL1Jf2E6md8jZlhHO/MrV/Utyqat43hsBa8Jo=; b=pGBy82CWkUSoak8qODnrltJb7rUoZHyX2nliwGZtJrol/tNc3gLrPGCknNEdaOntwE 8RqeVuzaRze+vV0wpQfWhZ7Lt9qfVkJpyRYDo3bLWM59Z/TnwRQOd0cIZTs76jqSvukz oUBZCvLelrQ4k1VF8JupOtFTgznpnWPEGoOs24VMHBPc364L/K2aCOHgwAKUphZ3L5Ca NTrpUN6CePGBrnG5h22q4hyH3ofq/ZOR1akgIB7/Sb88YaQx+tzGVsvWSwmNjfLN41Pu HZ/vXhRNLH45PWy8o8wVnHGDGnd33IcKJjt/d5oqIR7HB07MS3MsWnYfHc6eP+EOo6lt BrWQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=t9HXeyIL1Jf2E6md8jZlhHO/MrV/Utyqat43hsBa8Jo=; b=iboEilUsulCzjPm9WzaqqlkYSH4LovS4ppygW2gIr45NDbSuIrbFyL3iRukUaU8XyK SMWQqHCj7n9bN1pzmdNM+5opSoUC3Wx8epTYXqiRDijB9NvCfxifUS+r97XF8YnK0/lH z8U4JTzwm+WZ18YsTl2XdblkXIfBTymgW3sYxwEhU/+g3VpFbFEhnJobxnR0aRzHDiC0 ZgjSL4QksDi4eGOfWe7ZoAqcoW3ezzsAzdJJCxKb4MR4Fho0o474yp7DyEzcIUaxxhm/ /upE870ErKAQb3/AccdJHU/dHsxD94SqhoHU6OH21QIBGeqWLTwoB0Hn/lMUVPU065CL +0qA==
X-Gm-Message-State: APjAAAXGt3JF5+2U5VtfdUVRmP+mGvqXk0ECiSRBPZX+XdyiYc8+S8qO ohFJrdshXUqHZOnrAc9R9qdnIf+PjCAYn8psEW8=
X-Google-Smtp-Source: APXvYqzqi8SYHQ/Jj8Oct2xSQ4SFIx8TcFDGxInvI1o6xfIgco+ilKR0N+F0Z8tIatrWGfAvCOubfZPbVIfRCeGAdCQ=
X-Received: by 2002:a9d:32e5:: with SMTP id u92mr7490157otb.208.1552809731566; Sun, 17 Mar 2019 01:02:11 -0700 (PDT)
MIME-Version: 1.0
References: <0289E1B3-9AFF-4633-A9B1-6BAEE96B7692@cablelabs.com> <CAHx=1M6US_HYjXfqtRr8RbGEe5QxPjjnivLkKMHHBpqMQRyP8g@mail.gmail.com> <C689234C-6A08-47B1-90B5-07DE77112BBD@cablelabs.com> <CAHx=1M5z4fpViHbV+3+VchpyXsPJwwCuhWzNvZ7EU-An3gS0qQ@mail.gmail.com> <300857A4-9483-473E-8D9E-799F6077A4FF@cablelabs.com> <CAHx=1M53q0DG8AmhSxQXFhDfr4UzgrRR+iebmCwrZMcVnMvS5g@mail.gmail.com>
In-Reply-To: <CAHx=1M53q0DG8AmhSxQXFhDfr4UzgrRR+iebmCwrZMcVnMvS5g@mail.gmail.com>
From: Luca Muscariello <luca.muscariello@gmail.com>
Date: Sun, 17 Mar 2019 09:02:00 +0100
Message-ID: <CAHx=1M4y=bEHQ1xt1G59B-DzuU195s4hMapAFmjP0UFqSn403A@mail.gmail.com>
To: Greg White <g.white@cablelabs.com>, tsvwg IETF list <tsvwg@ietf.org>
Content-Type: multipart/alternative; boundary="0000000000007430f2058445b099"
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/uSALIFDPXqkk6KzJebywH89Bhi0>
Subject: [tsvwg] Fwd: New Version Notification for draft-white-tsvwg-lld-00.txt
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 17 Mar 2019 08:02:16 -0000

One point that is not specified anywhere is when a mflow entry is removed
front the flow table.

As the table is used to blacklist mflows my intuition was that it has to be
based on some sort of timer. Which is another parameter to set in the
mechanism.

The table then is tracking flows that are in progress or maybe not. For
sure an entry is maintained even for flows w/o packets in the queues.  This
has poor scalability properties compared to fq where an entry is maintained
for flows with actual data in the queues.

The protection mechanism assumes that one queue has soft priority over  the
other. Strict priority would be stupid, so there must be a wfq weight to
schedule the classic queue less frequently. I did not find the magic number
that  is set in the DOCSIS specs but whatever number is chosen I wonder
which opitimization objective would be the foundation of that.
10%, 20%, 30% or any number would imply that if the priority queue is used
at 100% utilization the other apps would get a small fraction of the link
capacity.

What number is chosen and based on which calculations?

Thanks
Luca

On Fri 15 Mar 2019 at 00:42, Greg White <g.white@cablelabs.com> wrote:

> Yes, it is easy for applications to access the low latency queue, and the
> job of QP is to redirect those that shouldn’t have been there.  We could
> instead run all traffic through QP and let it be automatically sorted, but
> if there is some traffic that can be excluded a priori, then doing so
> reduces the queue delay (recall that the QP algorithm only sanctions
> packets if the queue delay is above the 1ms threshold), reduces the
> potential that a well-behaving application is sanctioned (perhaps due to
> hash collisions), etc.   Also, since sanctioning could result in
> out-of-order delivery for a microflow, presuming that this is ok for all
> applications might not be advisable.  We have some ideas in the works for
> modifications that might be useful to reduce the need for packet marking.
>
>
>
> I don’t believe that this mechanism increases DoSability (is that a word?)
> compared with single queue or fq systems, but would be interested in some
> validation of that.  Yes it is possible for a malicious sender to mark its
> packets as NQB, and send at a high rate with various port numbers (to get
> unique flow ids), and thus have some percentage of packets avoid
> sanctioning, and in the worst case drive queue delay up.  The default
> threshold values are being adjusted from what is shown in the spec
> currently, so when using the new default values, the worst case with
> carefully crafted attack streams is ~32 ms of queuing delay (which, using
> brute force, would require the malicious sender to launch ~400 Mbps of
> traffic at the QP function).  Similar traffic patterns in a single queue
> system (or fq) could, depending on egress rate, result in much more queue
> delay than this.   Also, if the attacker does not mark their packets NQB,
> then the system protects the NQB flows from the attack, so in this sense it
> is also slightly less susceptible than single queue (and maybe fq).
>
>
>
>
>
>
>
> *From: *Luca Muscariello <luca.muscariello@gmail.com>
> *Date: *Wednesday, March 13, 2019 at 4:07 PM
> *To: *Greg White <g.white@CableLabs.com>
> *Cc: *"tsvwg@ietf.org" <tsvwg@ietf.org>
> *Subject: *Re: [tsvwg] New Version Notification for
> draft-white-tsvwg-lld-00.txt
>
>
>
> Greg,
>
>
>
> Is there any intention to also grant access to the low latency queue to
> applications that do not mark?
>
> Also, if I got this whole mechanism right (big IF), it seems like entering
> the low latency queue is only based on marking.
>
> This way it looks like the queue is  easy to access and the mechanism
> reacts to bad behaviour afterwards.
>
> Does not this risk to create spurious packet enqueues into the low latency
> queue? Or worse malicious sources
>
> to make the low latency queue DoSable?
>
>
>
> Luca
>
>
>
>
>
>
>
>
>
> On Wed, Mar 13, 2019 at 2:03 PM Greg White <g.white@cablelabs.com> wrote:
>
> Luca,
>
>
>
> We may work on improving the informative text in that section in order to
> make the behavior more clear without puzzling through the pseudocode.
>
>
>
> 1.      A packet enters the QP algorithm if it is classified to the low
> latency queue.  By default, the intention is to use ((DSCP==NQB) OR
> (ECN==ECT(1)) OR (ECN==CE)) (see the NQB draft and ECN-L4S-ID draft) to
> identify likely NQB flows (but this can be changed if needed).  The
> algorithm of course doesn’t care how the packets get marked, but our view
> is that the original application (or OS) should be the one that does the
> marking. For either marking, there is no incentive to lie.
>
> 2.      The algorithm sanctions (redirects to the classic queue) on a
> per-packet basis.  So, a microflow that only briefly causes queuing will
> have some of its packets sanctioned during that episode only, and even
> during that episode, all of its packets are scored.  Note, in some cases
> this could result in out-of-order delivery, which might be a minor
> disincentive for persistently QB flows mismarking themselves as NQB.
>
> 3.      See above.
>
>
>
> Greg
>
>
>
> *From: *Luca Muscariello <luca.muscariello@gmail.com>
> *Date: *Wednesday, March 13, 2019 at 2:37 PM
> *To: *Greg White <g.white@CableLabs.com>
> *Cc: *"tsvwg@ietf.org" <tsvwg@ietf.org>
> *Subject: *Re: [tsvwg] New Version Notification for
> draft-white-tsvwg-lld-00.txt
>
>
>
> Greg,
>
>
>
> Thanks for the reference.
>
> I have a few questions. I read the document just once so, don't be
> surprised if I got something wrong.
>
>
>
> 1) A packet enters the low latency queue if it is marked. Who is
> responsible for the marking?
>
> Is the original application to do that?
>
>
>
> 2) Once a packet enters the low latency queue, the flow, or microflow,
>
> is tracked in a (micro)flow table by reporting a function of the queue
> occupancy.  How do updates of the table
>
> take place? Insert is clear unless the flow is banned, update is clear.
> Remove is only clear to me when the flow is moved
>
> out of the low latency queue once it  started to get too much resources.
> Remove in the general case is not clear to me. Timers?
>
>
>
> 3)  It seems like the mechanism trusts the packet marker until the queue
> protection mechanism takes
>
> a different decision. How can a marker be redeemed and related  packets be
> readmitted to the low latency queue?
>
>
>
>
>
> Thanks
>
> Luca
>
>
>
> On Mon, Mar 11, 2019 at 7:18 PM Greg White <g.white@cablelabs.com> wrote:
>
> Hi Luca,
>
> You can find the details in Annex P of the DOCSIS MULPIv3.1 spec.
> https://specification-search.cablelabs.com/CM-SP-MULPIv3.1
>
> -Greg
>
>
> From: Luca Muscariello <luca.muscariello@gmail.com>
> Date: Monday, March 11, 2019 at 6:26 PM
> To: Greg White <g.white@CableLabs.com>
> Cc: Dave Taht <dave@taht.net>, Jonathan Morton <chromatix99@gmail.com>, "
> tsvwg@ietf.org" <tsvwg@ietf.org>
> Subject: Re: [tsvwg] New Version Notification for
> draft-morton-taht-tsvwg-sce-00.txt
>
> Hi Greg,
>
> I'm curious about the queue protection function in the LLD document.
> It seems to assume that a flow table is maintained to determine if a flow
> has the right to enter the low latency queue.
>
> Can you give more details about that component? Or point me to a reference?
>
> Thanks
> Luca
>
>
> On 3/11/19, 5:29 PM, "tsvwg on behalf of Greg White" <
> tsvwg-bounces@ietf.org on behalf of g.white@CableLabs.com> wrote:
>
>     TSVWG,
>
>     I've posted a new informative draft that gives an overview of the new
> Low Latency DOCSIS specification (see links below).  This overview may be
> interesting to TSVWG participants because it includes support for L4S (
> https://datatracker.ietf.org/doc/html/draft-ietf-tsvwg-aqm-dualq-coupled)
> and for the NQB PHB (
> https://datatracker.ietf.org/doc/html/draft-white-tsvwg-nqb).
>
>     Best Regards,
>     Greg
>
>
>
>     On 3/11/19, 5:05 PM, "internet-drafts@ietf.org" <
> internet-drafts@ietf.org> wrote:
>
>
>         A new version of I-D, draft-white-tsvwg-lld-00.txt
>         has been successfully submitted by Greg White and posted to the
>         IETF repository.
>
>         Name:           draft-white-tsvwg-lld
>         Revision:       00
>         Title:          Low Latency DOCSIS - Technology Overview
>         Document date:  2019-03-11
>         Group:          Individual Submission
>         Pages:          25
>         URL:
> https://www.ietf.org/internet-drafts/draft-white-tsvwg-lld-00.txt
>         Status:
> https://datatracker.ietf.org/doc/draft-white-tsvwg-lld/
>         Htmlized:
> https://tools.ietf.org/html/draft-white-tsvwg-lld-00
>         Htmlized:
> https://datatracker.ietf.org/doc/html/draft-white-tsvwg-lld
>
>
>         Abstract:
>            NOTE: This document is a reformatted version of
> [LLD-white-paper].
>
>            The evolution of the bandwidth capabilities - from kilobits per
>            second to gigabits - across generations of DOCSIS cable
> broadband
>            technology has paved the way for the applications that today
> form our
>            digital lives.  Along with increased bandwidth, or "speed", the
>            latency performance of DOCSIS technology has also improved in
> recent
>            years.  Although it often gets less attention, latency
> performance
>            contributes as much or more to the broadband experience and the
>            feasibility of future applications as does speed.
>
>            Low Latency DOCSIS technology (LLD) is a specification
> developed by
>            CableLabs in collaboration with DOCSIS vendors and cable
> operators
>            that tackles the two main causes of latency in the network:
> queuing
>            delay and media acquisition delay.  LLD introduces an approach
>            wherein data traffic from applications that aren't causing
> latency
>            can take a different logical path through the DOCSIS network
> without
>            getting hung up behind data from applications that are causing
>            latency, as is the case in today's Internet architectures.  This
>            mechanism doesn't interfere with the way applications share the
> total
>            bandwidth of the connection, and it doesn't reduce one
> application's
>            latency at the expense of others.  In addition, LLD improves the
>            DOCSIS upstream media acquisition delay with a faster
> request-grant
>            loop and a new proactive scheduling mechanism.  LLD makes the
>            internet experience better for latency sensitive applications
> without
>            any negative impact on other applications.
>
>            The latest generation of DOCSIS equipment that has been
> deployed in
>            the field - DOCSIS 3.1 - experiences typical latency
> performance of
>            around 10 milliseconds (ms) on the Access Network link.
> However,
>            under heavy load, the link can experience delay spikes of 100
> ms or
>            more.  LLD systems can deliver a consistent 1 ms delay on the
> DOCSIS
>            network for traffic that isn't causing latency, imperceptible
> for
>            nearly all applications.  The experience will be more
> consistent with
>            much smaller delay variation.
>
>            LLD can be deployed by field-upgrading DOCSIS 3.1 cable modem
> and
>            cable modem termination system devices with new software.  The
>            technology includes tools that enable automatic provisioning of
> these
>            new services, and it also introduces new tools to report
> statistics
>            of latency performance to the operator.
>
>            Cable operators, DOCSIS equipment manufacturers, and application
>            providers will all have to act in order to take advantage of
> LLD.
>            This white paper explains the technology and describes the role
> that
>            each of these parties plays in making LLD a reality.
>
>
>
>
>         Please note that it may take a couple of minutes from the time of
> submission
>         until the htmlized version and diff are available at
> tools.ietf.org.
>
>         The IETF Secretariat
>
>
>
>