Re: [rmcat] Last Call: <draft-ietf-rmcat-wireless-tests-08.txt>

"Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com> Thu, 27 February 2020 17:51 UTC

Return-Path: <xiaoqzhu@cisco.com>
X-Original-To: rmcat@ietfa.amsl.com
Delivered-To: rmcat@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id CF88D3A0E54; Thu, 27 Feb 2020 09:51:30 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.598
X-Spam-Level:
X-Spam-Status: No, score=-9.598 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com header.b=fwhPWqJx; dkim=pass (1024-bit key) header.d=cisco.onmicrosoft.com header.b=e91OB/jR
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id mFCS1YrWFWsv; Thu, 27 Feb 2020 09:51:28 -0800 (PST)
Received: from rcdn-iport-5.cisco.com (rcdn-iport-5.cisco.com [173.37.86.76]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A293C3A0E60; Thu, 27 Feb 2020 09:51:28 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=6306; q=dns/txt; s=iport; t=1582825888; x=1584035488; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-id:content-transfer-encoding: mime-version; bh=HJ2IPLHkCxWcoJukFgKuBXOCLuL2w8XpDNM2vdtlByk=; b=fwhPWqJxHCAEZaSuEse9Kvwa+1reKmLlN5bVp8TPYXogf753uJrim6pT GDm/Ktm2RchOwHL8A4yEESiB+hWEUk7UAYf5WdV/cN8oiy5VnoahbI7SO KiuvXgI9i30x7RBbkqxR78gA9Y3fV77p8GNvG00gm8nd2V/iJji8JWeOY Q=;
IronPort-PHdr: =?us-ascii?q?9a23=3AVrMImRdgHM1VEigRwtq9+5wDlGMj4e+mNxMJ6p?= =?us-ascii?q?chl7NFe7ii+JKnJkHE+PFxlwGQD57D5adCjOzb++D7VGoM7IzJkUhKcYcEFn?= =?us-ascii?q?pnwd4TgxRmBceEDUPhK/u/fy0zG91QVEJN9HCgOk8TE8H7NBXf?=
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: =?us-ascii?q?A0CdBQAhAVhe/4oNJK1mHAEBAQEBBwE?= =?us-ascii?q?BEQEEBAEBgXuBVFAFbFggBAsqhBSDRgOKZ4JfmBSBQoEQA1QJAQEBDAEBIwo?= =?us-ascii?q?CBAEBhEACF4FxJDgTAgMNAQEFAQEBAgEFBG2FNwyFYwEBAQECARILBhEMAQE?= =?us-ascii?q?lEgEPAgEGAg4KAgImAgICMBUQAgQBDQUigwQBgkoDDiABDpQWkGcCgTmIYnW?= =?us-ascii?q?BMoJ/AQEFgTMCDkGDDRiCDAMGgQ4qjCUagUE/gREnIIJMPoJkAQEDAYE/AQE?= =?us-ascii?q?GGoMRMoIskGWeRXAKgjyHUY8UHIJJiBuLfoRMjnCIfJJLAgQCBAUCDgEBBYF?= =?us-ascii?q?pIoFYcBVlAYJBUBgNjh2Dc4UUhUF0gSmOCgEB?=
X-IronPort-AV: E=Sophos;i="5.70,492,1574121600"; d="scan'208";a="486728409"
Received: from alln-core-5.cisco.com ([173.36.13.138]) by rcdn-iport-5.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 27 Feb 2020 17:51:26 +0000
Received: from XCH-RCD-003.cisco.com (xch-rcd-003.cisco.com [173.37.102.13]) by alln-core-5.cisco.com (8.15.2/8.15.2) with ESMTPS id 01RHpQPq026817 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Thu, 27 Feb 2020 17:51:27 GMT
Received: from xhs-aln-003.cisco.com (173.37.135.120) by XCH-RCD-003.cisco.com (173.37.102.13) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Thu, 27 Feb 2020 11:51:26 -0600
Received: from xhs-rtp-001.cisco.com (64.101.210.228) by xhs-aln-003.cisco.com (173.37.135.120) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Thu, 27 Feb 2020 11:51:24 -0600
Received: from NAM12-DM6-obe.outbound.protection.outlook.com (64.101.32.56) by xhs-rtp-001.cisco.com (64.101.210.228) with Microsoft SMTP Server (TLS) id 15.0.1473.3 via Frontend Transport; Thu, 27 Feb 2020 12:51:24 -0500
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=QlzeQ1f9sRVxDveOStpaDsMF25MczV4k60MBiCmqCPUwxlXVs5tURlpEO09t31064+WBMJf/LQw6rwQcwY3kh/kf8xmRbVaP+Rp3xewfPwcS9uIug8wDBcy19AkXInEF138v0eRpuTqz3KTAehl0rkaFZWanS8YwtFM8AHgRs34l/ZVFOjoE5TEhmy6HqAh3dD+6DUK1gWG5F9EbZNL/j2809aZedQ66N9eEP16Y1kIziD7TnFFG83x0FoHymygfT1/U20EnsYqpHFGj4WMwcKa4Fz9ADdCXJjL0n3uLkcDCLULhTAtvtv7oIQ7to6AxdJxM4yxsOAwySRVLynZtKA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=HJ2IPLHkCxWcoJukFgKuBXOCLuL2w8XpDNM2vdtlByk=; b=c8qsh3yxLhXlGjrzENH8w8rL9NBCbcJp5mIthGgIqWKgkkhSyoF8MG0L/qkvuPFJGZ2lFOmSi3uhydyL2WxqrXSqO72JgekenkdtfEx+mL/TApj7zFNZdZwXTrk21Pg2WPC261/G6AA7K6MbB8vAd6aQwQ6zd6l9zkgPJhwoe52zI9+ou85ApZV+Tb6iOILUuocPQGzJ7SgvBGOITRoRbg2cWZYKUiMO+TNp04h97VNreWDd7IaNHTnw6s953KWhepwyfvM4f06mzpjJ91PrcPSnbEqZQuliX1Va9jO9+ePvf26dLP26LtUNxFYUhafdH15sUYsbn4ysMh8M4Wp1YA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cisco.com; dmarc=pass action=none header.from=cisco.com; dkim=pass header.d=cisco.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector2-cisco-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=HJ2IPLHkCxWcoJukFgKuBXOCLuL2w8XpDNM2vdtlByk=; b=e91OB/jRgjGgf9MXYG2JAfPXjAaIE6WfDqwRNKhM9vzh9PUiiUpJxp0q2b4jUq+KpD452POmVzlCY4KMB68BtGykXOOhYRE40CjstaTTe+CKX/lV/ASmPvht7yWBDYPvT/R2v3mINXj3UWRr4BoSBI7ln+IaoCoFPUlpRJOY+Xw=
Received: from SN6PR11MB3166.namprd11.prod.outlook.com (2603:10b6:805:c5::17) by SN6PR11MB3088.namprd11.prod.outlook.com (2603:10b6:805:ce::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2772.15; Thu, 27 Feb 2020 17:51:24 +0000
Received: from SN6PR11MB3166.namprd11.prod.outlook.com ([fe80::450f:d0ec:d45c:fa20]) by SN6PR11MB3166.namprd11.prod.outlook.com ([fe80::450f:d0ec:d45c:fa20%7]) with mapi id 15.20.2772.012; Thu, 27 Feb 2020 17:51:24 +0000
From: "Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com>
To: Mirja Kuehlewind <ietf@kuehlewind.net>, "draft-ietf-rmcat-wireless-tests.all@ietf.org" <draft-ietf-rmcat-wireless-tests.all@ietf.org>
CC: "rmcat@ietf.org" <rmcat@ietf.org>
Thread-Topic: [rmcat] Last Call: <draft-ietf-rmcat-wireless-tests-08.txt>
Thread-Index: AQHVxYO7iG3CGcoiz0KV7/udB/MBvKgvG+iA
Date: Thu, 27 Feb 2020 17:51:23 +0000
Message-ID: <34E66341-871B-4D1F-BABA-40880E1F2990@cisco.com>
References: <157841942952.20942.7905543308082709172.idtracker@ietfa.amsl.com> <66FE5D2D-C3EC-4650-8405-98F235B2165D@kuehlewind.net>
In-Reply-To: <66FE5D2D-C3EC-4650-8405-98F235B2165D@kuehlewind.net>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/10.22.0.200209
authentication-results: spf=none (sender IP is ) smtp.mailfrom=xiaoqzhu@cisco.com;
x-originating-ip: [2001:420:30a:4e01:6008:3de4:5275:5a4c]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 97e6dda4-7ac9-4b10-6920-08d7bbada948
x-ms-traffictypediagnostic: SN6PR11MB3088:
x-microsoft-antispam-prvs: <SN6PR11MB3088147BCE9D440D36FBAAC0C9EB0@SN6PR11MB3088.namprd11.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:8882;
x-forefront-prvs: 03264AEA72
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(39860400002)(396003)(366004)(136003)(346002)(376002)(199004)(189003)(966005)(81166006)(5660300002)(2906002)(186003)(478600001)(8676002)(81156014)(6512007)(8936002)(71200400001)(4326008)(86362001)(110136005)(6486002)(2616005)(6506007)(66446008)(316002)(66556008)(66946007)(66476007)(64756008)(91956017)(36756003)(33656002)(76116006); DIR:OUT; SFP:1101; SCL:1; SRVR:SN6PR11MB3088; H:SN6PR11MB3166.namprd11.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1;
received-spf: None (protection.outlook.com: cisco.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: KKYB9TenZNKxHcXLf2H1P5yIZRI5w84UApYAIswwnREIsxTAUfM6IjoMcBeipVfi5lP+u7QIHglfVN7l64szA/l5i2QjGd2ZeWhn/FhZBTi+EbqM58iuiO80n3OrZzBNtgvEz06/Q4nlg0lpcjxY+zERsnrp4tILD7WVOR9Dw0xsg6OyYhZ2do839KEkCxOnD17ohkYCNaUtsrADliKENuenoP+YGS5bOf4ng7mA276YdCMEzBRZrYeNIOGcIqveHCmtvi/6jOT84bZJoFFLe394RM/hzGEeErYUT/r6NOEmELU2YuaUzlRnLp1SdBxrzme7zflsdAffwcN+KVZxbYm39Cty0nc2bXEqSjhaZa2f+vuqDp2S70y/5LwR/o/QQ++Qkwj8T8W5HgEvgZ4suzlq11CQ8VZ4UR6weXVyqYQpf/OOKipWP3KUPpg4UOLjVcWw+SotYAeNjIzqJzvY/E3f8AK26Ib9gZG+3RZ5GmV09N+cyUi4x+2+7YlM9PMhMbkbnc46aP1wObyFUE0tCw==
x-ms-exchange-antispam-messagedata: 4cvmtlKGin1Q6smfwVYquv3jqeEeOQANvnBJLpAy6+iozkU7j86krHl667cVVE/GJPCksSoSusDbfRfxJkoyq3h3yUkxMyWga+t+XWvXnXc283fDtnIyWMtU6QupCbVohA3aCRyeRCnZlt0IaTePVvNkKpzWm9wOUyn8GTAkiZc5ceoqJjTm+ZcMI2uxBzHAnpjCL5FXbNE8Hl1Y5OcTlg==
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="utf-8"
Content-ID: <AA59C3DEEC156743A53E9898CD18ACE5@namprd11.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 97e6dda4-7ac9-4b10-6920-08d7bbada948
X-MS-Exchange-CrossTenant-originalarrivaltime: 27 Feb 2020 17:51:23.7877 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: DBxCA/jH1Sx3RkJNzsIIHiJ2UKBcT+RT6tXBT4lw165lRj7vocQQ4sBicnaKE86yAY7ba/gxgL7Or6CzZv8nyQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN6PR11MB3088
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.37.102.13, xch-rcd-003.cisco.com
X-Outbound-Node: alln-core-5.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/rmcat/CGIlvU216cg5KTb4WQ2B9TkCKeA>
Subject: Re: [rmcat] Last Call: <draft-ietf-rmcat-wireless-tests-08.txt>
X-BeenThere: rmcat@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "RTP Media Congestion Avoidance Techniques \(RMCAT\) Working Group discussion list." <rmcat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rmcat>, <mailto:rmcat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rmcat/>
List-Post: <mailto:rmcat@ietf.org>
List-Help: <mailto:rmcat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rmcat>, <mailto:rmcat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 27 Feb 2020 17:51:37 -0000

Hi Mirja, 

Thanks a lot for your review of the draft. We've just uploaded a new revision (-09) to accommodate your comments. Please also see our responses inline below.

https://tools.ietf.org/html/draft-ietf-rmcat-wireless-tests-09

Let us know if you have any additional thoughts/comments. 

Cheers,
Xiaoqing, on behalf of all authors


On 1/7/20, 9:56 AM, "rmcat on behalf of Mirja Kuehlewind" <rmcat-bounces@ietf.org on behalf of ietf@kuehlewind.net> wrote:

    Hi authors,
    
    As you can see below I just requested IETF last call for draft-ietf-rmcat-wireless-tests. In my AD review I didn’t find anything important that needs to be addressed before IETF last call, so I didn’t send a separate AD review mail this time, however, I have a couple of small comments about reference that should be addressed before IESG evaluation:
    
    - It seems like [I-D.ietf-rmcat-eval-test] should be a normative reference the way it is cited in section 3.2.1.

[authors] Good point. This reference is now moved to the normative section.
    
    - Then, the notation "3GPP case 1 [Deployment]” in section 3.1.2 as well as similarity used in section 3.2.2 is quite confusing as squared brackets are also used for options. I recommend to rename the referent to e.g HO-deploy-3GPP and maybe even write then "3GPP case 1 (see [HO-deploy-3GPP])”.

[authors]  Agree.  Revised accordingly.
    
    - However, the other 3GPP reference probably don’t need to be normative as they only provide further information about mechanism that impact cellular network but don’t need to be known in detail to perform these tests, while the reference to IEEE802.11 maybe should be normative…?

[authors] Agree. The other 3GPP references are now in the informative section. The reference to IEEE802.11 is now normative.
    
    - There are two different references to ns-3. Please only use one!

[authors]. Thanks for catching this — an artifact from co-authors working on different parts of this draft.  The reference is now consolidated, and the information of both NS-2 and NS-3 has been updated to stay consistent with those in the recently published RFC 8698.

    - I don’t think the reference to RFC2914 necessarily needs to be normative.
    

[authors] Agree. Moved to informative instead.
    
    Also as usually when reviewing a document I of course have some more comments, however, they are mostly editorial:
    
    - Some of the Wi-Fi acronym are not spelled out or explained, e.g. MCS and EDCA/WMM. Maybe a few more sentences can be added to intro part in section 4.
    

[authors] Thanks for pointing this out. We've revised the sentence in the intro part of Sec. 4 to fully spell out EDCA (Enhanced Distributed Channel Access) and WMM (Wi-Fi Multi-Media) separately. The draft now introduces the full term before adding the acronym in the bracket. The draft now contains some explanation for MCS (Modulation and Coding Scheme) in the sub-paragraph starting with “The IEEE 802.11 standard (i.e., Wi-Fi) supports multi-rate transmission capabilities  …”.


    - The conclusion section is actually not needed/not a common thing, so I recommend just removing it.
    
[author] OK. Removed.

    - also in sec 4:
    "All test cases described below can be carried out using simulations, e.g. based on [ns-2] or [ns-3].”
    This should probably say some like “are recommended to be carried out using simulations” (similar as phrased at the end of the intro text in sec 3).
    
[authors] Good suggestion. The sentence is revised accordingly, as “We recommend to carry out the test cases as defined in this document using a simulator, such as [NS-2] or [NS-3]. ”

    - In section 3:
    "Even though 3GPP
       define QoS bearers [QoS-3GPP] to ensure high-quality user experience,
       adaptive real-time applications are desired.”
    Is desired the right word here? What do you mean?

[authors]  Thanks for pointing out this confusion. The text is now revised to “Even though 3GPP define QoS bearers [QoS-3GPP] to ensure high-quality user experience, it is still preferable to real-time applications to behave in an adaptive manner.”
    
    Thanks!
    Mirja
    
     
    
    > On 7. Jan 2020, at 18:50, DraftTracker Mail System <iesg-secretary@ietf.org> wrote:
    > 
    > 
    > Last Call Request has been submitted for
    > <draft-ietf-rmcat-wireless-tests-08.txt>
    > 
    > https://datatracker.ietf.org/doc/draft-ietf-rmcat-wireless-tests/
    >