Re: [rmcat] test cases for coupled cc [was: Re: Review of draft-ietf-rmcat-eval-test-02]

Safiqul Islam <safiquli@ifi.uio.no> Wed, 10 February 2016 14:36 UTC

Return-Path: <safiquli@ifi.uio.no>
X-Original-To: rmcat@ietfa.amsl.com
Delivered-To: rmcat@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 775FB1B2B72 for <rmcat@ietfa.amsl.com>; Wed, 10 Feb 2016 06:36:24 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.9
X-Spam-Level:
X-Spam-Status: No, score=-1.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RP_MATCHES_RCVD=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id E-fMOT3ZYGJx for <rmcat@ietfa.amsl.com>; Wed, 10 Feb 2016 06:36:15 -0800 (PST)
Received: from mail-out4.uio.no (mail-out4.uio.no [IPv6:2001:700:100:10::15]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5E78E1B2B66 for <rmcat@ietf.org>; Wed, 10 Feb 2016 06:36:14 -0800 (PST)
Received: from mail-mx2.uio.no ([129.240.10.30]) by mail-out4.uio.no with esmtp (Exim 4.80.1) (envelope-from <safiquli@ifi.uio.no>) id 1aTVsJ-0005aM-94; Wed, 10 Feb 2016 15:36:11 +0100
Received: from mail-ex03.exprod.uio.no ([129.240.52.6]) by mail-mx2.uio.no with esmtps (TLSv1.2:AES256-SHA:256) (Exim 4.80) (envelope-from <safiquli@ifi.uio.no>) id 1aTVsI-0006Ym-Fa; Wed, 10 Feb 2016 15:36:11 +0100
Received: from mail-ex04.exprod.uio.no (2001:700:100:52::7) by mail-ex03.exprod.uio.no (2001:700:100:52::6) with Microsoft SMTP Server (TLS) id 15.0.1130.7; Wed, 10 Feb 2016 15:36:08 +0100
Received: from mail-ex04.exprod.uio.no ([fe80::5da2:f347:6a4b:effc]) by mail-ex04.exprod.uio.no ([fe80::5da2:f347:6a4b:effc%19]) with mapi id 15.00.1130.005; Wed, 10 Feb 2016 15:36:08 +0100
From: Safiqul Islam <safiquli@ifi.uio.no>
To: Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>
Thread-Topic: test cases for coupled cc [was: Re: [rmcat] Review of draft-ietf-rmcat-eval-test-02]
Thread-Index: AQHRY0lM+VftAzSKGkKCCoBjW8PXq58k8mKAgABXC4A=
Date: Wed, 10 Feb 2016 14:36:08 +0000
Message-ID: <FA953D22-37A1-4645-8F20-56C79A4B2806@ifi.uio.no>
References: <170F0EA5-EAB0-4B01-A8DF-56A0B2923A9A@ifi.uio.no> <56AA17AD.8060806@ericsson.com> <EA475291-B965-43EE-965B-F5435B595493@tik.ee.ethz.ch> <56BB01D5.5040902@ericsson.com>
In-Reply-To: <56BB01D5.5040902@ericsson.com>
Accept-Language: en-GB, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-exchange-messagesentrepresentingtype: 1
x-ms-exchange-transport-fromentityheader: Hosted
x-originating-ip: [129.240.169.59]
Content-Type: multipart/alternative; boundary="_000_FA953D2237A146458F2056C79A4B2806ifiuiono_"
MIME-Version: 1.0
X-UiO-SPF-Received:
X-UiO-Ratelimit-Test: rcpts/h 7 msgs/h 1 sum rcpts/h 10 sum msgs/h 1 total rcpts 2627 max rcpts/h 24 ratelimit 0
X-UiO-Spam-info: not spam, SpamAssassin (score=-6.0, required=5.0, autolearn=disabled, HTML_MESSAGE=0.001, RP_MATCHES_RCVD=-1.05, UIO_MAIL_IS_INTERNAL=-5, uiobl=NO, uiouri=NO)
X-UiO-Scanned: 029436F3420C49F657CC16FF8644E6D99AC33947
X-UiO-SPAM-Test: remote_host: 129.240.52.6 spam_score: -59 maxlevel 80 minaction 2 bait 0 mail/h: 171 total 1357315 max/h 1397 blacklist 0 greylist 0 ratelimit 0
X-UiOonly: 8129E71021A041E337563D03FDEE4535B3FF59C1
Archived-At: <http://mailarchive.ietf.org/arch/msg/rmcat/L9_5r4Y7tr_39BwP1dwRKJWuRI4>
Cc: "rmcat@ietf.org" <rmcat@ietf.org>, Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch>, "mramalho@cisco.com" <mramalho@cisco.com>, Anna Brunström <anna.brunstrom@kau.se>, Xiaoqing Zhu <xiaoqzhu@cisco.com>, Varun Singh <vsingh.ietf@gmail.com>
Subject: Re: [rmcat] test cases for coupled cc [was: Re: Review of draft-ietf-rmcat-eval-test-02]
X-BeenThere: rmcat@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "RTP Media Congestion Avoidance Techniques \(RMCAT\) Working Group discussion list." <rmcat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rmcat>, <mailto:rmcat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rmcat/>
List-Post: <mailto:rmcat@ietf.org>
List-Help: <mailto:rmcat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rmcat>, <mailto:rmcat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 10 Feb 2016 14:36:24 -0000

HI Zahed, Hi Mirja,

Please see inline

/Safiqul


On 10. feb. 2016, at 10.24, Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com<mailto:zaheduzzaman.sarker@ericsson.com>> wrote:

Hi Mirja,

please see inline....

On 2016-02-09 15:51, Mirja Kühlewind wrote:

The test cases in the draft were designed for end-point adaptation
algorithm without coupled congestion control in mind i.e. no need
for shared bottleneck detection and flow priority. In the last IETF
meeting we talked about the possibility of extending the test cases
to include coupled congestion control algorithm.

I believe we decided already at the last meeting that we need to
adapt this draft to include uses cases for coupled congestion (and
that’s why we asked Safiqul to propose some).

That is what I can also recall but didn't see anything in the meeting
minutes so was not sure what we agreed on. May be missed it in the meeting minutes.



Now if we extend the test cases then I don't think only adding the
two proposed test cases will be sufficient.

Yes, that might be true but adding these use cases below would
probably be a good starting point.

If I understand shafiqul's last mail, it is fine with only having test results with priority for 5.4 test case.

For simplicity, I suggested to use only test case 5.4, but I am not against using other cases.
I can add some recommendations for other cases too.



We will need to identify all the test cases those are suitable for
running with coupled congestion control.

Not sure, if you only have one flow that test case is simply not
suitable and that’s fine.
Yes, that is one identification criteria. But may be we dont need results for all the test cases who has more than one flow. see my previous comment.

+1



Like 5.2 can be run with priority per flow. By doing this we can
mention (in each test case or in one place in the document) that
one can run tests with flow priority and perhaps give some means to
evaluate the available capacity distribution with some equation
like the one mentioned here in the proposed test case 6.3.

Yes.

However, then this document also needs to include description for
shared bottleneck detection.

Why?
Bcos I dont think the document now even mention "shared bottleneck" and to me coupled congestion control does not make sense without shared bottleneck.

The document covers the basic scenarios where flows share a common bottleneck.  We can simply add a line saying “these additional coupled-cc test-cases are used for flows sharing a bottleneck”.


In the simplest form, we can perhaps assume that the identified
test cases have single bottleneck point.

Yes.


I think we need to discuss what is best possible way to extend the
test cases if we agreed to do that.

As I said I think we agreed already. Please following with Safiqul on
this!


But before that I would like to know if the WG is OK with extending
the test cases for coupled congestion control.

Any further feedback on this from the group is of course welcome!
Please speak up now!


And will it be a compulsory (candidate algorithms MUST present
results) or optional (candidate algorithms MAY present results)
part of the test case.

I guess only candidates that use coupled cc..?

hmm...

I am a bit confused now. Are we talking about test case(s) to evaluate the Coupled CC or the use of Coupled CC in the candidate CC?


Without making it compulsory, I suggested to add these in the other cases. We can perhaps say:

“When flows share a common bottleneck, combining their congestion controllers can be beneficial.
These additional test cases can be used to evaluate a congestion control mechanism when using a method to couple flows, such as [I-D.ietf-rmcat-coupled-cc]."

Does this put it better?

Regards,
Safiqul


BR

--
Zahed

==================================================
ANM ZAHEDUZZAMAN SARKER


Ericsson AB
Services, Media and Network Features
Laboratoriegränd 11
97128 Luleå, Sweden
Phone +46 10 717 37 43
Fax +46 920 996 21
SMS/MMS +46 76 115 37 43
zaheduzzaman.sarker@ericsson.com<mailto:zaheduzzaman.sarker@ericsson.com>
www.ericsson.com

==================================================