IETF Logo Mail Archive

Re: [rmcat] Wireless test cases

"Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com> Tue, 01 March 2016 16:14 UTC

Return-Path: <xiaoqzhu@cisco.com>
X-Original-To: rmcat@ietfa.amsl.com
Delivered-To: rmcat@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 87CD61B2E1D for <rmcat@ietfa.amsl.com>; Tue, 1 Mar 2016 08:14:21 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.207
X-Spam-Level:
X-Spam-Status: No, score=-14.207 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, MIME_8BIT_HEADER=0.3, RCVD_IN_DNSWL_HI=-5, RP_MATCHES_RCVD=-0.006, SPF_PASS=-0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id VraWU9iTYDXy for <rmcat@ietfa.amsl.com>; Tue, 1 Mar 2016 08:14:20 -0800 (PST)
Received: from alln-iport-8.cisco.com (alln-iport-8.cisco.com [173.37.142.95]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id DCB1A1B2DEF for <rmcat@ietf.org>; Tue, 1 Mar 2016 08:14:19 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=2367; q=dns/txt; s=iport; t=1456848859; x=1458058459; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=w3JflZqoJnrMY4RkprLzKRa+JcakrlwA3eCkuGPLxfg=; b=h9W1kgLFQ984sV0uslayP5m5fJlgP5JR1EDwgcmS9RNfNjDBBMNnIqgM F73EPX4O4WMUdGo7U6m8holxzaNxAXLE1y4UcmaidWa1/nXxauKO6Ox5N hvvhxZ+Go0uwYtJitCaEFJLvQ8o3zMDccTBmRUoHz8QDK7W6du/ubjdBw 4=;
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0BCAgDWvtVW/5hdJa1egzpSbQaGAKU/AQQBjmkBDYFmHYV2AoFKOBQBAQEBAQEBZCeEQQEBAQRJMA4CAgEIEQQBAQEJJQ8MFx0IAgQBDQUbiATAGwEBAQEBAQEBAQEBAQEBAQEBAQEBARUEhg6EOoQzhDwFjWOJKwGIA4VejnaOSwEeAQFCg2Rqh0N+AQEB
X-IronPort-AV: E=Sophos;i="5.22,523,1449532800"; d="scan'208";a="244138667"
Received: from rcdn-core-1.cisco.com ([173.37.93.152]) by alln-iport-8.cisco.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 01 Mar 2016 16:14:19 +0000
Received: from XCH-ALN-018.cisco.com (xch-aln-018.cisco.com [173.36.7.28]) by rcdn-core-1.cisco.com (8.14.5/8.14.5) with ESMTP id u21GEJxT026860 (version=TLSv1/SSLv3 cipher=AES256-SHA bits=256 verify=FAIL); Tue, 1 Mar 2016 16:14:19 GMT
Received: from xch-rcd-016.cisco.com (173.37.102.26) by XCH-ALN-018.cisco.com (173.36.7.28) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Tue, 1 Mar 2016 10:14:18 -0600
Received: from xch-rcd-016.cisco.com ([173.37.102.26]) by XCH-RCD-016.cisco.com ([173.37.102.26]) with mapi id 15.00.1104.009; Tue, 1 Mar 2016 10:14:18 -0600
From: "Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com>
To: Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>, Stefan Holmer <stefan@webrtc.org>, Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch>
Thread-Topic: [rmcat] Wireless test cases
Thread-Index: AQHRaNy/VapPwARipkaYL6fylYsp7Z8z0rMzgAeuggD///D6r4AAaxCAgAD2roCAAEFM0IABUqOAgAAR4YCAAB8TBoAAaz4AgAR7ygCAAChdWIABdvqA//+462s=
Date: Tue, 01 Mar 2016 16:14:18 +0000
Message-ID: <1456848857820.89119@cisco.com>
References: <6902D83B-55B3-4D22-8B37-A71A89720DDF@tik.ee.ethz.ch> <1455913631142.29407@cisco.com> <56CD9506.7080902@tik.ee.ethz.ch> <1456332600778.99326@cisco.com> <41376CF6-1F97-45A5-A8E3-186DBB1219ED@tik.ee.ethz.ch> <56CEB129.10307@ericsson.com> <1456422154539.54776@cisco.com> <E0F7A68B07B53F4FBD12DABD61CBA90E17ED7425@ESESSMB307.ericsson.se> <CAEdus3LkKwvszS4vCu0L22-FvjnPxbmUhE4kN8gdvhzbJyAHdA@mail.gmail.com> <1456505429198.23062@cisco.com> <4423F12C-8D64-48EF-BEF2-017FB8171222@tik.ee.ethz.ch> <CAEdus3JyE28-Lv5gPwV+zLW6Ge7Xk_znNkK8hnTjr-BE6-dAtw@mail.gmail.com> <1456785789094.25849@cisco.com>,<56D5A647.30200@ericsson.com>
In-Reply-To: <56D5A647.30200@ericsson.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-exchange-transport-fromentityheader: Hosted
x-originating-ip: [10.24.146.86]
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Archived-At: <http://mailarchive.ietf.org/arch/msg/rmcat/0TouwXGKYJhBj7oTkgMErkrLHxQ>
Cc: "rmcat WG (rmcat@ietf.org)" <rmcat@ietf.org>, Anna Brunström <anna.brunstrom@kau.se>
Subject: Re: [rmcat] Wireless test cases
X-BeenThere: rmcat@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "RTP Media Congestion Avoidance Techniques \(RMCAT\) Working Group discussion list." <rmcat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rmcat>, <mailto:rmcat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rmcat/>
List-Post: <mailto:rmcat@ietf.org>
List-Help: <mailto:rmcat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rmcat>, <mailto:rmcat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 01 Mar 2016 16:14:21 -0000

I agree that from the perspective of wireless test case draft, having it implemented on multiple platforms is a good sign. 

However, my original point was that for the purpose of comparing across candidate solutions, one needs to run them on the same simulator/emulator. 

Thanks,
Xiaoqing
________________________________________
From: Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>
Sent: Tuesday, March 1, 2016 8:25 AM
To: Xiaoqing Zhu (xiaoqzhu); Stefan Holmer; Mirja Kühlewind
Cc: rmcat WG (rmcat@ietf.org) Anna Brunström
Subject: Re: [rmcat] Wireless test cases

On 2016-02-29 23:43, Xiaoqing Zhu (xiaoqzhu) wrote:
>
> I still believe that it's important to understand candidate solution
> behavior over wireless. My colleagues and I are actively working on
> that.  I just don't think it's realistic to tie the progress of the
> candidate solution drafts to such evaluations, for two reasons:
>
> a)  the wireless test case draft itself is still evolving;
>
> b)  folks have not yet converged on a common platform (testbed or
> simulation) for carrying out wireless tests. That makes it hard
> to compare across candidate solutions.

I dont believe any convergence is required, it was not required for
basic test cases. On the contrary I think folks should be allowed and
able to implement the testcases from the draft in their preferred
emulators or simulators. This will be a sign of good test case
description. If they find it hard to do that then they can share the
experience and we can improve the test cases.

BR
--
Zahed

==================================================
ANM ZAHEDUZZAMAN SARKER


Ericsson AB
Services, Media and Network Features
Laboratoriegränd 11
97128 Luleå, Sweden
Phone +46 10 717 37 43
Fax +46 920 996 21
SMS/MMS +46 76 115 37 43
zaheduzzaman.sarker@ericsson.com
www.ericsson.com

==================================================

v2.37.1 | Report a Bug | By Email | System Status