IETF Logo Mail Archive

Re: [rmcat] Wireless test cases

Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com> Wed, 02 March 2016 08:13 UTC

Return-Path: <zaheduzzaman.sarker@ericsson.com>
X-Original-To: rmcat@ietfa.amsl.com
Delivered-To: rmcat@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 7376D1A8A3B for <rmcat@ietfa.amsl.com>; Wed, 2 Mar 2016 00:13:19 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.9
X-Spam-Level:
X-Spam-Status: No, score=-3.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, MIME_8BIT_HEADER=0.3, RCVD_IN_DNSWL_MED=-2.3] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id f2lG4gSMHmqO for <rmcat@ietfa.amsl.com>; Wed, 2 Mar 2016 00:13:18 -0800 (PST)
Received: from sesbmg22.ericsson.net (sesbmg22.ericsson.net [193.180.251.48]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7965F1A8A29 for <rmcat@ietf.org>; Wed, 2 Mar 2016 00:13:17 -0800 (PST)
X-AuditID: c1b4fb30-f79096d000002f68-ee-56d6a09be40a
Received: from ESESSHC022.ericsson.se (Unknown_Domain [153.88.183.84]) by sesbmg22.ericsson.net (Symantec Mail Security) with SMTP id 89.87.12136.B90A6D65; Wed, 2 Mar 2016 09:13:15 +0100 (CET)
Received: from [150.132.141.43] (153.88.183.153) by smtp.internal.ericsson.com (153.88.183.86) with Microsoft SMTP Server id 14.3.248.2; Wed, 2 Mar 2016 09:13:15 +0100
To: "Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com>, Stefan Holmer <stefan@webrtc.org>, Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch>
References: <6902D83B-55B3-4D22-8B37-A71A89720DDF@tik.ee.ethz.ch> <1455913631142.29407@cisco.com> <56CD9506.7080902@tik.ee.ethz.ch> <1456332600778.99326@cisco.com> <41376CF6-1F97-45A5-A8E3-186DBB1219ED@tik.ee.ethz.ch> <56CEB129.10307@ericsson.com> <1456422154539.54776@cisco.com> <E0F7A68B07B53F4FBD12DABD61CBA90E17ED7425@ESESSMB307.ericsson.se> <CAEdus3LkKwvszS4vCu0L22-FvjnPxbmUhE4kN8gdvhzbJyAHdA@mail.gmail.com> <1456505429198.23062@cisco.com> <4423F12C-8D64-48EF-BEF2-017FB8171222@tik.ee.ethz.ch> <CAEdus3JyE28-Lv5gPwV+zLW6Ge7Xk_znNkK8hnTjr-BE6-dAtw@mail.gmail.com> <1456785789094.25849@cisco.com> <56D5A647.30200@ericsson.com> <1456848857820.89119@cisco.com>
From: Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>
Organization: Ericsson AB
Message-ID: <56D6A09B.9000207@ericsson.com>
Date: Wed, 02 Mar 2016 09:13:15 +0100
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.6.0
MIME-Version: 1.0
In-Reply-To: <1456848857820.89119@cisco.com>
Content-Type: text/plain; charset="windows-1252"; format="flowed"
Content-Transfer-Encoding: 8bit
X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFnrBLMWRmVeSWpSXmKPExsUyM2J7iO7sBdfCDObdULY48eMys8WG1VNY LFbf/MBm0XXwFLPF65ZlTA6sHlN+b2T1WLLkJ5PH3wutbB7HPnxl8/i9bxFbAGsUl01Kak5m WWqRvl0CV8aXe7sZC3aIVDx+uY+1gfGYQBcjJ4eEgInEjc5fLBC2mMSFe+vZQGwhgcOMEs++ Z3cxcgHZqxkl5j98wwiSEBbQkJj2sZ8ZJCEiMJdR4urmxywQVWtZJbrWHmUGqWIWyJZYcPkp UIKDg03ARuLxYj+QML+ApMSGht1gJbwC2hLdnX1g21gEVCS2Tp0IZosKxEgcf3eOEaJGUOLk zCdg13EK6EjsnrmGCWQks4C9xIOtZRCb5CWat85mBgkLCehKdL2Mm8AoNAtJ8yyEhllIGhYw Mq9iFC1OLU7KTTcy0kstykwuLs7P08tLLdnECAz/g1t+G+xgfPnc8RCjAAejEg/vB7lrYUKs iWXFlbmHGCU4mJVEeI17gUK8KYmVValF+fFFpTmpxYcYpTlYlMR5WT9dDhMSSE8sSc1OTS1I LYLJMnFwSjUw+h/aqLHzIMfEXMHNzixHBSx6S3YV3Duzx0kjkkmJ//SGx+csBVulZbafZ2WJ i4j2+xZ+v2FdTeH6ySzO9UtVI4T2uhzeoTuhZKbtG1cxX/bvT78KbTTf4uX4/lt2sJbBl0KN tuP3D38W44lfrBwu76yxNr08d0HxC5faw30vjveufyUf8m6+EktxRqKhFnNRcSIAOMBgl3sC AAA=
Archived-At: <http://mailarchive.ietf.org/arch/msg/rmcat/G3ctMLPwNleGUiWXbOeHnQ_7Yuk>
Cc: "rmcat WG (rmcat@ietf.org)" <rmcat@ietf.org>, Anna Brunström <anna.brunstrom@kau.se>
Subject: Re: [rmcat] Wireless test cases
X-BeenThere: rmcat@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "RTP Media Congestion Avoidance Techniques \(RMCAT\) Working Group discussion list." <rmcat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rmcat>, <mailto:rmcat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rmcat/>
List-Post: <mailto:rmcat@ietf.org>
List-Help: <mailto:rmcat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rmcat>, <mailto:rmcat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 02 Mar 2016 08:13:19 -0000

Ture, if we want to compare simulation results then it is best to use 
same simulator. But I would be happy just to see some results even 
without comparison.

BR

Zahed

On 2016-03-01 17:14, Xiaoqing Zhu (xiaoqzhu) wrote:
> I agree that from the perspective of wireless test case draft, having it implemented on multiple platforms is a good sign.
>
> However, my original point was that for the purpose of comparing across candidate solutions, one needs to run them on the same simulator/emulator.
>
> Thanks,
> Xiaoqing
> ________________________________________
> From: Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>
> Sent: Tuesday, March 1, 2016 8:25 AM
> To: Xiaoqing Zhu (xiaoqzhu); Stefan Holmer; Mirja Kühlewind
> Cc: rmcat WG (rmcat@ietf.org) Anna Brunström
> Subject: Re: [rmcat] Wireless test cases
>
> On 2016-02-29 23:43, Xiaoqing Zhu (xiaoqzhu) wrote:
>>
>> I still believe that it's important to understand candidate solution
>> behavior over wireless. My colleagues and I are actively working on
>> that.  I just don't think it's realistic to tie the progress of the
>> candidate solution drafts to such evaluations, for two reasons:
>>
>> a)  the wireless test case draft itself is still evolving;
>>
>> b)  folks have not yet converged on a common platform (testbed or
>> simulation) for carrying out wireless tests. That makes it hard
>> to compare across candidate solutions.
>
> I dont believe any convergence is required, it was not required for
> basic test cases. On the contrary I think folks should be allowed and
> able to implement the testcases from the draft in their preferred
> emulators or simulators. This will be a sign of good test case
> description. If they find it hard to do that then they can share the
> experience and we can improve the test cases.
>
> BR
> --
> Zahed
>
> ==================================================
> ANM ZAHEDUZZAMAN SARKER
>
>
> Ericsson AB
> Services, Media and Network Features
> Laboratoriegränd 11
> 97128 Luleå, Sweden
> Phone +46 10 717 37 43
> Fax +46 920 996 21
> SMS/MMS +46 76 115 37 43
> zaheduzzaman.sarker@ericsson.com
> www.ericsson.com
>
> ==================================================
>

-- 
Zahed

==================================================
ANM ZAHEDUZZAMAN SARKER


Ericsson AB
Services, Media and Network Features
Laboratoriegränd 11
97128 Luleå, Sweden
Phone +46 10 717 37 43
Fax +46 920 996 21
SMS/MMS +46 76 115 37 43
zaheduzzaman.sarker@ericsson.com
www.ericsson.com

==================================================

v2.36.0 | Report a Bug | By Email | System Status