Re: [rmcat] Wireless test cases

Stefan Holmer <stefan@webrtc.org> Mon, 29 February 2016 13:38 UTC

Return-Path: <holmer@google.com>
X-Original-To: rmcat@ietfa.amsl.com
Delivered-To: rmcat@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id ACA271ACD3F for <rmcat@ietfa.amsl.com>; Mon, 29 Feb 2016 05:38:52 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 0.416
X-Spam-Level:
X-Spam-Status: No, score=0.416 tagged_above=-999 required=5 tests=[BAYES_05=-0.5, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FM_FORGED_GMAIL=0.622, HTML_MESSAGE=0.001, MIME_8BIT_HEADER=0.3, RP_MATCHES_RCVD=-0.006, SPF_PASS=-0.001] autolearn=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2P1uPbX-ezBI for <rmcat@ietfa.amsl.com>; Mon, 29 Feb 2016 05:38:50 -0800 (PST)
Received: from mail-ig0-x22f.google.com (mail-ig0-x22f.google.com [IPv6:2607:f8b0:4001:c05::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 9DEA31ACDB2 for <rmcat@ietf.org>; Mon, 29 Feb 2016 05:38:49 -0800 (PST)
Received: by mail-ig0-x22f.google.com with SMTP id y8so77867352igp.1 for <rmcat@ietf.org>; Mon, 29 Feb 2016 05:38:49 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=webrtc-org.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=dOwVIMPqmHxrVew9wl1Bk9epVus2S64Fsr9MQfdwGAA=; b=EdLgghrgmJ24i2HXIzH7RExjJOaObTGHEWcOU07xtsOiDhBeCx5kIQIPVF1Vzg/A2a Gael+dvYORplOxEXoR7kUA750p9wISGLHGW+3/yK4KE4CsDNL7832TFcNjwHYXf17cty owuEi9ssfE6V4KdIu2QUaGTDP3IWrmWs2U1DX+xfvvrlv+emwyQGCPCQwhnXQRFUvfCt ZzFNym/bhqTjNVJGxXebcR7Dpye5Ua6WC3EVuWLAMA17/CuC7hZKC+L4SuuaoCLSwXwF zcWGhPI/cEk9hVtL5KZn2m21QCg3KdUtkCT4rQDDlu2LoA3GTOYNAk5HbdftGKfZNyZI a4nA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=dOwVIMPqmHxrVew9wl1Bk9epVus2S64Fsr9MQfdwGAA=; b=f+vuuLhJo6MqqI9A3o9Htn0Eek1WG//Wvn1FbaNEZClXvEqkSkQvxeUoOSBccnSCKj hJ8AlWokBSbFtJ117eaeU7Anxm3nD2qKQ6D0Q73j2F0L19ZZqlLUf2PfBmATPxym8yvC Ko9ztS7BuEcjCCIfC6FZSou8J+IZhhFoCVOGsWSZDIN5pL1fpgynk0Y243w2kw2VO8zZ XFZkn6QOnexGjTcneO/KtbcdhQLA2Nxxqea1/W5DVWIMea2/qgJf9ckRfQ00JmQ7rtqB 2bUjgxNxuSEb2rnGgk95UCMWQKlfk5paUyl3kRXNNU2H1sgsQBtJDMVnzOkKMfneiKoE qXwQ==
X-Gm-Message-State: AD7BkJLTKC/WpjEfaqU9tlYCy46kr3tTLxJhOw+i+y3HHbBgYHYbxW7XLrEX6wBwVim51MLeK1kCRA589d+FwB9+
X-Received: by 10.50.79.137 with SMTP id j9mr10177155igx.65.1456753128924; Mon, 29 Feb 2016 05:38:48 -0800 (PST)
MIME-Version: 1.0
References: <6902D83B-55B3-4D22-8B37-A71A89720DDF@tik.ee.ethz.ch> <1455913631142.29407@cisco.com> <56CD9506.7080902@tik.ee.ethz.ch> <1456332600778.99326@cisco.com> <41376CF6-1F97-45A5-A8E3-186DBB1219ED@tik.ee.ethz.ch> <56CEB129.10307@ericsson.com> <1456422154539.54776@cisco.com> <E0F7A68B07B53F4FBD12DABD61CBA90E17ED7425@ESESSMB307.ericsson.se> <CAEdus3LkKwvszS4vCu0L22-FvjnPxbmUhE4kN8gdvhzbJyAHdA@mail.gmail.com> <1456505429198.23062@cisco.com> <4423F12C-8D64-48EF-BEF2-017FB8171222@tik.ee.ethz.ch>
In-Reply-To: <4423F12C-8D64-48EF-BEF2-017FB8171222@tik.ee.ethz.ch>
From: Stefan Holmer <stefan@webrtc.org>
Date: Mon, 29 Feb 2016 13:38:38 +0000
Message-ID: <CAEdus3JyE28-Lv5gPwV+zLW6Ge7Xk_znNkK8hnTjr-BE6-dAtw@mail.gmail.com>
To: Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch>, "Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com>
Content-Type: multipart/alternative; boundary="089e013a0c1ec6c05a052ce8c475"
Archived-At: <http://mailarchive.ietf.org/arch/msg/rmcat/_guBk_L5o4HAQlyY1ObN2WKLykA>
Cc: "rmcat WG (rmcat@ietf.org)" <rmcat@ietf.org>, Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>, Anna Brunström <anna.brunstrom@kau.se>
Subject: Re: [rmcat] Wireless test cases
X-BeenThere: rmcat@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "RTP Media Congestion Avoidance Techniques \(RMCAT\) Working Group discussion list." <rmcat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rmcat>, <mailto:rmcat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rmcat/>
List-Post: <mailto:rmcat@ietf.org>
List-Help: <mailto:rmcat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rmcat>, <mailto:rmcat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 29 Feb 2016 13:38:52 -0000

I don't think we should require mobile/wireless evaluation results before
experimental publication. I think we have proof enough from the base test
cases, especially with the extra artificial jitter and fast capacity
changes.

/Stefan

On Fri, Feb 26, 2016 at 6:10 PM Mirja Kühlewind <
mirja.kuehlewind@tik.ee.ethz.ch> wrote:

> Hi all,
>
> thanks for you feedback.
>
> This brings me back to my original question: Would the working group
> require to see evaluation results to the mobile and wireless test cases
> before moving to publication for experimental or are the basic test cases
> (in draft-ietf-rmcat-eval-test-02) sufficient to move on and classify the
> candidates to be safe for experimentation in the Internet?
>
> Mirja
>
>
> > Am 26.02.2016 um 17:50 schrieb Xiaoqing Zhu (xiaoqzhu) <
> xiaoqzhu@cisco.com>:
> >
> > ​I will look into sharing the NS3 code/script for WiFi tests.
> >
> > As for LTE test cases:  it's good to know that it can be done.  But,
> since there is no precedence to follow, this may take substantial time and
> effort. So we may not get around to tackle that soon.
> >
> > Thanks,
> > Xiaoqing
> >
> > From: Stefan Holmer <stefan@webrtc.org>
> > Sent: Friday, February 26, 2016 12:55 AM
> > To: Zaheduzzaman Sarker; Xiaoqing Zhu (xiaoqzhu); Mirja Kühlewind
> > Cc: rmcat WG (rmcat@ietf.org); Anna Brunström
> > Subject: Re: [rmcat] Wireless test cases
> >
> > As a first step we'll probably look into at least some of the wifi test
> cases, but I don't know how soon we can have those done. Our current focus
> is on improving the loss-based part of GCC, and after that we can focus on
> further tests.
> >
> > If it's reasonably simple to run lte tests then it sounds good to run
> some of those too. If we can share code to set up NS3 for wifi and lte
> tests, that would be great.
> >
> > /Stefan
> >
> > On Fri, Feb 26, 2016 at 8:51 AM Zaheduzzaman Sarker <
> zaheduzzaman.sarker@ericsson.com> wrote:
> > Hi,
> >
> > We didn't used NS-3 simulator to evaluation SCReAM over LTE, we used our
> proprietary simulator.
> > However, I have looked into the NS-3 simulator and talked with the LTE
> module implementer of NS-3 (LUNA). My conclusion is, the draft can be
> realized in the NS-3 simulator.
> >
> > BR
> >
> > Zahed
> >
> > > -----Original Message-----
> > > From: Xiaoqing Zhu (xiaoqzhu) [mailto:xiaoqzhu@cisco.com]
> > > Sent: den 25 februari 2016 18:43
> > > To: Zaheduzzaman Sarker; Mirja Kühlewind
> > > Cc: rmcat WG (rmcat@ietf.org); Anna Brunström
> > > Subject: Re: [rmcat] Wireless test cases
> > >
> > > Thanks for the pointer, Zahed.  That's a good place to start.  Would
> it be
> > > possible for you to share your NS-3 code/script for testing SCReAM
> over LTE?
> > >
> > > BTW, you may want to update the corresponding link in the
> wireless-test-case
> > > document. Currently, the reference on [LTE-simulator] points to the
> NS-3
> > > manual.
> > >
> > > Best,
> > > Xiaoqing
> > >
> > > ________________________________________
> > > From: Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>
> > > Sent: Wednesday, February 24, 2016 11:45 PM
> > > To: Mirja Kühlewind; Xiaoqing Zhu (xiaoqzhu)
> > > Cc: rmcat WG (rmcat@ietf.org); Anna Brunström
> > > Subject: Re: [rmcat] Wireless test cases
> > >
> > > Yes,
> > >
> > > NS-3 has necessary modules to run LTE simulations.
> > >
> > > https://www.nsnam.org/docs/models/html/lte.html
> > >
> > > BR
> > >
> > > Zahed
> > >
> > > On 02/24/2016 06:02 PM, Mirja Kühlewind wrote:
> > > > Hi Xiaoqing,
> > > >
> > > >> Am 24.02.2016 um 17:50 schrieb Xiaoqing Zhu (xiaoqzhu)
> > > <xiaoqzhu@cisco.com>:
> > > >>
> > > >> Hi Mirja, all,
> > > >>
> > > >> Zahed and I have indeed discussed about this in Yokohama. Maybe I
> did not
> > > make it clear in my previous email, trying again.
> > > >>
> > > >> Basically, to carry out tests in Sec 3 (Cellular Network Specific
> Test Cases),
> > > one needs to run it over a module that simulates packet behavior over
> cellular
> > > links -- just like for the Wi-Fi portion of the test cases, we relied
> on the Wi-Fi
> > > module in NS3 simulators to do so.
> > > >>
> > > >> What is missing is the cellular network simulator, preferably as a
> plug-in
> > > module for NS3, over which we can run rate adaptation tests.
> > > > I though that this is available in the mean time.
> > > >
> > > > Zahed, do you have link or is this already included in the latest
> version of ns-
> > > 3?
> > > >
> > > > Mirja
> > > >
> > > >
> > > >> Thanks,
> > > >> Xiaoqing
> > > >>
> > > >>
> > > >> ________________________________________
> > > >> From: Mirja Kühlewind <mirja.kuehlewind@tik.ee.ethz.ch>
> > > >> Sent: Wednesday, February 24, 2016 3:33 AM
> > > >> To: Xiaoqing Zhu (xiaoqzhu); rmcat WG (rmcat@ietf.org)
> > > >> Cc: Anna Brunström; Zaheduzzaman Sarker
> > > >> Subject: Re: [rmcat] Wireless test cases
> > > >>
> > > >> Hi Xiaoqing,
> > > >>
> > > >> On 19.02.2016 21:27, Xiaoqing Zhu (xiaoqzhu) wrote:
> > > >>> As for Sec. 3 on Cellular Network Specific Test Cases, would
> > > >>> appreciate more detailed information on how to set those up, or
> > > >>> relevant pointers/code on cellular network simulators.
> > > >> Can you let us/Zahed know what exactly you need/is missing?
> > > >>
> > > >> Thanks,
> > > >> Mirja
> > >
> >
>
>