Re: [aqm] PIE vs. RED

"Francini, Andrea (Andrea)" <andrea.francini@alcatel-lucent.com> Fri, 14 August 2015 19:08 UTC

Return-Path: <andrea.francini@alcatel-lucent.com>
X-Original-To: aqm@ietfa.amsl.com
Delivered-To: aqm@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A78911A1B9E for <aqm@ietfa.amsl.com>; Fri, 14 Aug 2015 12:08:57 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.91
X-Spam-Level:
X-Spam-Status: No, score=-6.91 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_HI=-5, T_RP_MATCHES_RCVD=-0.01] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id rAUrTMt8Yj60 for <aqm@ietfa.amsl.com>; Fri, 14 Aug 2015 12:08:55 -0700 (PDT)
Received: from smtp-fr.alcatel-lucent.com (fr-hpida-esg-02.alcatel-lucent.com [135.245.210.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7E37B1A8718 for <aqm@ietf.org>; Fri, 14 Aug 2015 12:07:52 -0700 (PDT)
Received: from us70uusmtp3.zam.alcatel-lucent.com (unknown [135.5.2.65]) by Websense Email Security Gateway with ESMTPS id 399E4592D0DEF; Fri, 14 Aug 2015 19:07:47 +0000 (GMT)
Received: from US70UWXCHHUB02.zam.alcatel-lucent.com (us70uwxchhub02.zam.alcatel-lucent.com [135.5.2.49]) by us70uusmtp3.zam.alcatel-lucent.com (GMO) with ESMTP id t7EJ7nMH001251 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=FAIL); Fri, 14 Aug 2015 19:07:49 GMT
Received: from US70TWXCHMBA12.zam.alcatel-lucent.com ([169.254.6.242]) by US70UWXCHHUB02.zam.alcatel-lucent.com ([135.5.2.49]) with mapi id 14.03.0195.001; Fri, 14 Aug 2015 15:07:48 -0400
From: "Francini, Andrea (Andrea)" <andrea.francini@alcatel-lucent.com>
To: "Rong Pan (ropan)" <ropan@cisco.com>, Roland Bless <roland.bless@kit.edu>, Jonathan Morton <chromatix99@gmail.com>
Thread-Topic: [aqm] PIE vs. RED
Thread-Index: AQHQ1hj1JNTnP9Wpi0Omyy4DEGnv6J4KhuYQgABL4ID//8cFIIAAZecAgABuF+CAAKaKgIAAAc8AgAACXgD//8NLMA==
Date: Fri, 14 Aug 2015 19:07:48 +0000
Message-ID: <1BFAC0A1D7955144A2444E902CB628F865B082D6@US70TWXCHMBA12.zam.alcatel-lucent.com>
References: <55CC8D6B.7030007@kit.edu> <CAJq5cE2sNFvLPvrB82dRrN+nbZLNRuo+TmCVgSYCp4TumN70Sw@mail.gmail.com> <55CD1C9A.9040406@kit.edu> <1BFAC0A1D7955144A2444E902CB628F865B08093@US70TWXCHMBA12.zam.alcatel-lucent.com> <D1F2716B.654D%ropan@cisco.com> <1BFAC0A1D7955144A2444E902CB628F865B080C1@US70TWXCHMBA12.zam.alcatel-lucent.com> <D1F297FC.6569%ropan@cisco.com> <1BFAC0A1D7955144A2444E902CB628F865B081EF@US70TWXCHMBA12.zam.alcatel-lucent.com> <D1F37F18.658D%ropan@cisco.com> <D1F381A1.659F%ropan@cisco.com> <D1F383DB.65A8%ropan@cisco.com>
In-Reply-To: <D1F383DB.65A8%ropan@cisco.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [135.5.27.18]
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Archived-At: <http://mailarchive.ietf.org/arch/msg/aqm/prUilOTgpvFEnXr1eAK46GKYDz0>
Cc: "aqm@ietf.org" <aqm@ietf.org>
Subject: Re: [aqm] PIE vs. RED
X-BeenThere: aqm@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "Discussion list for active queue management and flow isolation." <aqm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/aqm>, <mailto:aqm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/aqm/>
List-Post: <mailto:aqm@ietf.org>
List-Help: <mailto:aqm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/aqm>, <mailto:aqm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 14 Aug 2015 19:08:57 -0000

Yes, with 10Mbps output rate the results in Figure 8 realign with the expectations. 

Because of the statement at the beginning of IV.A I had first thought that the 10Mbps setup should apply to Figure 8, but then the placement of the paragraph that describes the 100Mbps setup, titled "Performance Evaluation and Comparison", made me conclude that both of the remaining experiments in that section, not just the one in IV.A.5, used that same configuration. 

Thank you for clarifying,

Andrea

-----Original Message-----
From: Rong Pan (ropan) [mailto:ropan@cisco.com] 
Sent: Friday, August 14, 2015 2:41 PM
To: Francini, Andrea (Andrea); Roland Bless; Jonathan Morton
Cc: aqm@ietf.org
Subject: Re: [aqm] PIE vs. RED

It has been a while since I last read the paper in detail :-).

In IV A, we specified that unless otherwise specified, the link speed is
10Mbps and buffer size is 200KB.

Thanks,

Rong

On 8/14/15, 11:32 AM, "Rong Pan (ropan)" <ropan@cisco.com> wrote:

>>
>>
>>This is an omission in the paper, which we should specify. This
>>simulation
>>is done with 10Mbps link with 200KB of buffer. We did size our buffers
>>according to the BDP. As Jonathan rightly pointed out, "the queue size is
>>tuned for the maximum capability of the device and a pessimistic value
>>for
>>RTTĀ². Figure 7 is intended to show that in reality link speed may not get
>>to the max capacity, and hence well-intended BDP buffer sizing may cause
>>extreme delays, the time between 50-100s in the plot.
>>
>
>Just to make it clear, Figure 8 is run using 10Mbps link with 200KB
>buffer. 
>We should clearly specify in the paper, sorry for that.
>
>Figure 7 is run using 100Mbps with 2MB of buffer and in the middle of the
>simulation,
>the link speed is reduced to 20Mbps to illustrate the case where
>well-intended 
>buffer sizing might cause delay bloat.
>
>
>
>
>
>
>>
>>
>>>
>>>Thank you,
>>>
>>>Andrea
>>>
>>>-----Original Message-----
>>>From: Rong Pan (ropan) [mailto:ropan@cisco.com]
>>>Sent: Thursday, August 13, 2015 9:56 PM
>>>To: Francini, Andrea (Andrea); Roland Bless; Jonathan Morton
>>>Cc: aqm@ietf.org
>>>Subject: Re: [aqm] PIE vs. RED
>>>
>>>>>That's my point (and I believe also Roland's): In a direct
>>>>>experimental
>>>>>comparison, this good property of PIE would be better emphasized
>>>>>against
>>>>>a >>configuration of RED where the queue length thresholds are not
>>>>>grossly oversized.
>>>
>>>
>>>In our PIE paper (attached), Figure 8 shows the max latency of RED is
>>>around 100ms (which is very reasonable). PIE controls latency regardless
>>>of traffic intensity. It is the plot that you want.
>>>
>>>Thanks,
>>>
>>>Rong
>>>
>>>On 8/13/15, 5:25 PM, "Francini, Andrea (Andrea)"
>>><andrea.francini@alcatel-lucent.com> wrote:
>>>
>>>>> Delayed-based RED still would associate latency with drop
>>>>>probability:
>>>>> drop probability will only go up when queueing latency goes up. A
>>>>>higher
>>>>> drop probability can only be achieved via higher queueing latency.
>>>>>As
>>>>>we
>>>>> proved in PIE, the two can be made independent. We can maintain low
>>>>> latency regardless of traffic intensity.
>>>>> 
>>>>> Rong
>>>>
>>>>That's my point (and I believe also Roland's): In a direct experimental
>>>>comparison, this good property of PIE would be better emphasized
>>>>against
>>>>a configuration of RED where the queue length thresholds are not
>>>>grossly
>>>>oversized.
>>>>
>>>>By the way, Global Synchronization Protection (GSP) also drops/marks at
>>>>a
>>>>fixed delay level independently of the drop/mark rate that keeps the
>>>>queue stable. The draft that describes it
>>>>(https://tools.ietf.org/id/draft-lauten-aqm-gsp-02.txt) is still
>>>>active.
>>>>I have seen only marginal comments about GSP. Any specific reason why?
>>>>
>>>>Andrea 
>>>>
>>>>
>>>>On 8/13/15, 4:07 PM, "aqm on behalf of Francini, Andrea (Andrea)"
>>>><aqm-bounces@ietf.org on behalf of andrea.francini@alcatel-lucent.com>
>>>>wrote:
>>>>
>>>>>To second Roland's point, the advantage of PIE over RED should not be
>>>>>entirely in the use of delay-based thresholds instead of queue-length
>>>>>ones, otherwise it could be argued that a version of RED with
>>>>>delay-based
>>>>>thresholds is not too hard to design (Wolfram easily did it for his
>>>>>GSP
>>>>>scheme). 
>>>>>
>>>>>With such a RED version in place, hopefully PIE would still show
>>>>>better
>>>>>performance, so the same superiority should also emerge when the
>>>>>queue-length thresholds of conventional RED are reasonably tuned
>>>>>around
>>>>>the traffic scenario of each experiment.
>>>>>
>>>>>Andrea
>>>>>
>>>>>-----Original Message-----
>>>>>From: aqm [mailto:aqm-bounces@ietf.org] On Behalf Of Roland Bless
>>>>>Sent: Thursday, August 13, 2015 6:39 PM
>>>>>To: Jonathan Morton
>>>>>Cc: aqm@ietf.org
>>>>>Subject: Re: [aqm] PIE vs. RED
>>>>>
>>>>>Hi Jonathan,
>>>>>
>>>>>Am 13.08.2015 um 19:35 schrieb Jonathan Morton:
>>>>>> In the real world, the hardware buffer size is rarely matched to the
>>>>>> real BDP.  There are several reasons for this, but a couple of
>>>>>> fundamental ones are:
>>>>>> 
>>>>>> - BDP varies with RTT, which is in general different for flows
>>>>>> simultaneously using the same link/queue to reach different remote
>>>>>> hosts, and therefore cannot be accurately predicted by a hardware
>>>>>>vendor.
>>>>>
>>>>>Yep, sure. My point was not to promote setting the buffers according
>>>>>to
>>>>>"the BDP", but rather arguing that one should use comparable target
>>>>>settings when comparing AQMs, see below...
>>>>>
>>>>>> - Frequently, the queue size is tuned for the maximum capability of
>>>>>>the
>>>>>> device and a pessimistic value for RTT, but the same hardware is
>>>>>>more
>>>>>> often used (at least initially) at lower link speeds and thebqueue
>>>>>>size
>>>>>> is not adjusted to compensate.  Eg. DOCSIS 2 cable but DOCSIS 3
>>>>>>modem,
>>>>>> Ethernet NIC or switch capable of 1000Mbps but operating at 100 or
>>>>>>even
>>>>>> 10, 802.11ac wifi struggling with a marginal 802.11g link...
>>>>>> 
>>>>>> Thus substantially oversized raw buffers are quite normal.  It is
>>>>>>AQM's
>>>>>> job to keep the *actual* queue occupancy low; with a properly
>>>>>> functioning AQM, the effects of an oversized raw queue are nil.
>>>>>
>>>>>That's correct. However, IMHO if one compares AQMs one should set/tune
>>>>>the individual parameters of the AQMs so that they achieve a similar
>>>>>target value (and not more than an order of magnitude apart).
>>>>>This is probably relevant for the aqm eval guidelines, but
>>>>>I'll come up with a detailed review for the draft within the next
>>>>>days...
>>>>>
>>>>>Regards,
>>>>> Roland
>>>>>
>>>>>_______________________________________________
>>>>>aqm mailing list
>>>>>aqm@ietf.org
>>>>>https://www.ietf.org/mailman/listinfo/aqm
>>>>>
>>>>>_______________________________________________
>>>>>aqm mailing list
>>>>>aqm@ietf.org
>>>>>https://www.ietf.org/mailman/listinfo/aqm
>>>>
>>>
>>
>>_______________________________________________
>>aqm mailing list
>>aqm@ietf.org
>>https://www.ietf.org/mailman/listinfo/aqm
>