Re: [rmcat] Wireless test cases

Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch> Fri, 26 February 2016 17:10 UTC

Return-Path: <mirja.kuehlewind@tik.ee.ethz.ch>
X-Original-To: rmcat@ietfa.amsl.com
Delivered-To: rmcat@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F35731B2A38 for <rmcat@ietfa.amsl.com>; Fri, 26 Feb 2016 09:10:38 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.906
X-Spam-Level:
X-Spam-Status: No, score=-3.906 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, MIME_8BIT_HEADER=0.3, RCVD_IN_DNSWL_MED=-2.3, RP_MATCHES_RCVD=-0.006] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id EihW6pE8eUM6 for <rmcat@ietfa.amsl.com>; Fri, 26 Feb 2016 09:10:36 -0800 (PST)
Received: from smtp.ee.ethz.ch (smtp.ee.ethz.ch [129.132.2.219]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3544A1B2B93 for <rmcat@ietf.org>; Fri, 26 Feb 2016 09:10:35 -0800 (PST)
Received: from localhost (localhost [127.0.0.1]) by smtp.ee.ethz.ch (Postfix) with ESMTP id E93A9D9317; Fri, 26 Feb 2016 18:10:33 +0100 (MET)
X-Virus-Scanned: by amavisd-new on smtp.ee.ethz.ch
Received: from smtp.ee.ethz.ch ([127.0.0.1]) by localhost (.ee.ethz.ch [127.0.0.1]) (amavisd-new, port 10024) with LMTP id MnznZZqwr3-5; Fri, 26 Feb 2016 18:10:33 +0100 (MET)
Received: from [192.168.178.33] (x5f7025c8.dyn.telefonica.de [95.112.37.200]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: mirjak) by smtp.ee.ethz.ch (Postfix) with ESMTPSA id 41446D9303; Fri, 26 Feb 2016 18:10:33 +0100 (MET)
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 9.2 \(3112\))
From: Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch>
In-Reply-To: <1456505429198.23062@cisco.com>
Date: Fri, 26 Feb 2016 18:10:32 +0100
Content-Transfer-Encoding: quoted-printable
Message-Id: <4423F12C-8D64-48EF-BEF2-017FB8171222@tik.ee.ethz.ch>
References: <6902D83B-55B3-4D22-8B37-A71A89720DDF@tik.ee.ethz.ch> <1455913631142.29407@cisco.com> <56CD9506.7080902@tik.ee.ethz.ch> <1456332600778.99326@cisco.com> <41376CF6-1F97-45A5-A8E3-186DBB1219ED@tik.ee.ethz.ch> <56CEB129.10307@ericsson.com> <1456422154539.54776@cisco.com> <E0F7A68B07B53F4FBD12DABD61CBA90E17ED7425@ESESSMB307.ericsson.se> <CAEdus3LkKwvszS4vCu0L22-FvjnPxbmUhE4kN8gdvhzbJyAHdA@mail.gmail.com> <1456505429198.23062@cisco.com>
To: "Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com>
X-Mailer: Apple Mail (2.3112)
Archived-At: <http://mailarchive.ietf.org/arch/msg/rmcat/EXKvwD4sc7AwS_wqmoP2PsHquUI>
Cc: "rmcat WG (rmcat@ietf.org)" <rmcat@ietf.org>, Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>, Stefan Holmer <stefan@webrtc.org>, Anna Brunström <anna.brunstrom@kau.se>
Subject: Re: [rmcat] Wireless test cases
X-BeenThere: rmcat@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "RTP Media Congestion Avoidance Techniques \(RMCAT\) Working Group discussion list." <rmcat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rmcat>, <mailto:rmcat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rmcat/>
List-Post: <mailto:rmcat@ietf.org>
List-Help: <mailto:rmcat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rmcat>, <mailto:rmcat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 26 Feb 2016 17:10:39 -0000

Hi all,

thanks for you feedback.

This brings me back to my original question: Would the working group require to see evaluation results to the mobile and wireless test cases before moving to publication for experimental or are the basic test cases (in draft-ietf-rmcat-eval-test-02) sufficient to move on and classify the candidates to be safe for experimentation in the Internet?

Mirja


> Am 26.02.2016 um 17:50 schrieb Xiaoqing Zhu (xiaoqzhu) <xiaoqzhu@cisco.com>:
> 
> ​I will look into sharing the NS3 code/script for WiFi tests. 
> 
> As for LTE test cases:  it's good to know that it can be done.  But, since there is no precedence to follow, this may take substantial time and effort. So we may not get around to tackle that soon.
> 
> Thanks,
> Xiaoqing
>  
> From: Stefan Holmer <stefan@webrtc.org>
> Sent: Friday, February 26, 2016 12:55 AM
> To: Zaheduzzaman Sarker; Xiaoqing Zhu (xiaoqzhu); Mirja Kühlewind
> Cc: rmcat WG (rmcat@ietf.org) Anna Brunström
> Subject: Re: [rmcat] Wireless test cases
>  
> As a first step we'll probably look into at least some of the wifi test cases, but I don't know how soon we can have those done. Our current focus is on improving the loss-based part of GCC, and after that we can focus on further tests.
> 
> If it's reasonably simple to run lte tests then it sounds good to run some of those too. If we can share code to set up NS3 for wifi and lte tests, that would be great.
> 
> /Stefan
> 
> On Fri, Feb 26, 2016 at 8:51 AM Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com> wrote:
> Hi,
> 
> We didn't used NS-3 simulator to evaluation SCReAM over LTE, we used our proprietary simulator.
> However, I have looked into the NS-3 simulator and talked with the LTE module implementer of NS-3 (LUNA). My conclusion is, the draft can be realized in the NS-3 simulator.
> 
> BR
> 
> Zahed
> 
> > -----Original Message-----
> > From: Xiaoqing Zhu (xiaoqzhu) [mailto:xiaoqzhu@cisco.com]
> > Sent: den 25 februari 2016 18:43
> > To: Zaheduzzaman Sarker; Mirja Kühlewind
> > Cc: rmcat WG (rmcat@ietf.org) Anna Brunström
> > Subject: Re: [rmcat] Wireless test cases
> >
> > Thanks for the pointer, Zahed.  That's a good place to start.  Would it be
> > possible for you to share your NS-3 code/script for testing SCReAM over LTE?
> >
> > BTW, you may want to update the corresponding link in the wireless-test-case
> > document. Currently, the reference on [LTE-simulator] points to the NS-3
> > manual.
> >
> > Best,
> > Xiaoqing
> >
> > ________________________________________
> > From: Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>
> > Sent: Wednesday, February 24, 2016 11:45 PM
> > To: Mirja Kühlewind; Xiaoqing Zhu (xiaoqzhu)
> > Cc: rmcat WG (rmcat@ietf.org) Anna Brunström
> > Subject: Re: [rmcat] Wireless test cases
> >
> > Yes,
> >
> > NS-3 has necessary modules to run LTE simulations.
> >
> > https://www.nsnam.org/docs/models/html/lte.html
> >
> > BR
> >
> > Zahed
> >
> > On 02/24/2016 06:02 PM, Mirja Kühlewind wrote:
> > > Hi Xiaoqing,
> > >
> > >> Am 24.02.2016 um 17:50 schrieb Xiaoqing Zhu (xiaoqzhu)
> > <xiaoqzhu@cisco.com>:
> > >>
> > >> Hi Mirja, all,
> > >>
> > >> Zahed and I have indeed discussed about this in Yokohama. Maybe I did not
> > make it clear in my previous email, trying again.
> > >>
> > >> Basically, to carry out tests in Sec 3 (Cellular Network Specific Test Cases),
> > one needs to run it over a module that simulates packet behavior over cellular
> > links -- just like for the Wi-Fi portion of the test cases, we relied on the Wi-Fi
> > module in NS3 simulators to do so.
> > >>
> > >> What is missing is the cellular network simulator, preferably as a plug-in
> > module for NS3, over which we can run rate adaptation tests.
> > > I though that this is available in the mean time.
> > >
> > > Zahed, do you have link or is this already included in the latest version of ns-
> > 3?
> > >
> > > Mirja
> > >
> > >
> > >> Thanks,
> > >> Xiaoqing
> > >>
> > >>
> > >> ________________________________________
> > >> From: Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch>
> > >> Sent: Wednesday, February 24, 2016 3:33 AM
> > >> To: Xiaoqing Zhu (xiaoqzhu); rmcat WG (rmcat@ietf.org)
> > >> Cc: Anna Brunström; Zaheduzzaman Sarker
> > >> Subject: Re: [rmcat] Wireless test cases
> > >>
> > >> Hi Xiaoqing,
> > >>
> > >> On 19.02.2016 21:27, Xiaoqing Zhu (xiaoqzhu) wrote:
> > >>> As for Sec. 3 on Cellular Network Specific Test Cases, would
> > >>> appreciate more detailed information on how to set those up, or
> > >>> relevant pointers/code on cellular network simulators.
> > >> Can you let us/Zahed know what exactly you need/is missing?
> > >>
> > >> Thanks,
> > >> Mirja
> >
>