Re: [rmcat] Opsdir last call review of draft-ietf-rmcat-wireless-tests-08

"Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com> Thu, 27 February 2020 17:44 UTC

Return-Path: <xiaoqzhu@cisco.com>
X-Original-To: rmcat@ietfa.amsl.com
Delivered-To: rmcat@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id DA50C3A0C77; Thu, 27 Feb 2020 09:44:35 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.6
X-Spam-Level:
X-Spam-Status: No, score=-9.6 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com header.b=ka0Xe+lb; dkim=pass (1024-bit key) header.d=cisco.onmicrosoft.com header.b=WzspsMOV
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id S7NKgOSC_7Q6; Thu, 27 Feb 2020 09:44:34 -0800 (PST)
Received: from alln-iport-6.cisco.com (alln-iport-6.cisco.com [173.37.142.93]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id CAA8B3A0538; Thu, 27 Feb 2020 09:44:33 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=5310; q=dns/txt; s=iport; t=1582825474; x=1584035074; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-id:content-transfer-encoding: mime-version; bh=qkENOsbLHl4nEQNAOuf78yB2fSohREqyyqJc1vdN5AI=; b=ka0Xe+lbtqhwrHgSRomaeDx3iMy9Swj0FauJwdZm+UY0AYsaSatjNKJU YprfnZBFHNnlCQDMEy57l+/H7gl3MvPv4qiUlbZYLMRyLmXfWKZ3RHNux sga++e6gMj7JMZzkwuzrFsEJ2ZXn9ZGb6UXX4WBFcwXSFBC6xTsKBXpKL k=;
IronPort-PHdr: 9a23:EXci2hS7p4s95hfCaD4dvCF2dNpsv++ubAcI9poqja5Pea2//pPkeVbS/uhpkESXBNfA8/wRje3QvuigQmEG7Zub+FE6OJ1XH15g640NmhA4RsuMCEn1NvnvOjw7FcNbRl9413q6KkNSXs35Yg6arw==
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0D4NwC+/1de/5xdJa1mHAEBAQEBBwEBEQEEBAEBgXsCgVJQBWxYIAQLKoEVgn+DRgOKZppzglIDVAkBAQEMAQEjCgIEAQGEQAIXgXEkOQUNAgMNAQEFAQEBAgEFBG2FNwyFZAIBAxIREQwBATcBDwIBCBoCJgICAjAVEAIEAQ0FIoMEAYJKAy4BDqUGAoE5iGJ1gTKCfwEBBYEzAoNWGIIMAwaBDiqMJRqBQT+BEScggkw+gmQBAQOBYoMRMoIskGWfNQqCPIdRhU2FFYQyHIJJiBuQSo5wiHySSwIEAgQFAg4BAQWBaiE3gSFwFWUBgkFQGA2OHYNzhRSFQXSBKY4KAQE
X-IronPort-AV: E=Sophos;i="5.70,492,1574121600"; d="scan'208";a="461624913"
Received: from rcdn-core-5.cisco.com ([173.37.93.156]) by alln-iport-6.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 27 Feb 2020 17:44:09 +0000
Received: from XCH-ALN-002.cisco.com (xch-aln-002.cisco.com [173.36.7.12]) by rcdn-core-5.cisco.com (8.15.2/8.15.2) with ESMTPS id 01RHi8CK028159 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Thu, 27 Feb 2020 17:44:09 GMT
Received: from xhs-rtp-001.cisco.com (64.101.210.228) by XCH-ALN-002.cisco.com (173.36.7.12) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Thu, 27 Feb 2020 11:44:08 -0600
Received: from xhs-aln-003.cisco.com (173.37.135.120) by xhs-rtp-001.cisco.com (64.101.210.228) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Thu, 27 Feb 2020 12:44:06 -0500
Received: from NAM12-BN8-obe.outbound.protection.outlook.com (173.37.151.57) by xhs-aln-003.cisco.com (173.37.135.120) with Microsoft SMTP Server (TLS) id 15.0.1473.3 via Frontend Transport; Thu, 27 Feb 2020 11:44:06 -0600
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=djy7PpXRY50avLPS9vzj5isZEn3+i41X1XWhvuEcARNZs1tEw3L9dVpt7/gBKuzXHu7haIrD0JkhgeawQTH4/FhdqPosMU6fUcEEl8byOuBtPaFg1V3zCKU6RQg7s5N4p744AL5atDei1FMY2lxxRkBjmDJI6h/FDdZpoVBFDfGA5lSyFe3+evntXf3G4Ta8nJQaxrh6sCj/sHWjulsb9j/s2p2O/97ou/tcmppLl9JaMLCSi+/Xc3E6g8GTZG/pMu1ed5K5jBFm0JQh8SIkg+6gJ6kMre1TJUaWX5td+TK10/FFvtu1bnvS1rYYPcCNJj0aoQ/6T5jC1/oh3Kg8bw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qkENOsbLHl4nEQNAOuf78yB2fSohREqyyqJc1vdN5AI=; b=R2aKV7noMy3sTkwdDdihVsN6Ud9hK0dxks64umdcq1UxIP9jMaUySltQKvzj6IsfnNhqfgZ8Eb89Eu9+rYJHasUptGS9eDQVCBn8rlCmCvhrjdpbUaq0WwOKuEmJoFlIl3RtK7nCmrwJzU4kptIwsFYWX3trh3cCxYTAcw9EibNT5+Ws7u38AZxYpZcSrmkAkpENZr3pN/bwg2Hrb6c/6UzEKg/rJovpC9ByYyRQGOVZyg2krb9l8gRw2OZtn9/SOgrMSeP/Ohu2CX1O+KBBpYzaPIUH8xKvjHTVbVsEabqpsy04SlaO4yyKShG4TmJD6L9M2l+l0tWT1XyvZtoTGA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cisco.com; dmarc=pass action=none header.from=cisco.com; dkim=pass header.d=cisco.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector2-cisco-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qkENOsbLHl4nEQNAOuf78yB2fSohREqyyqJc1vdN5AI=; b=WzspsMOV9N7QvKF1zcwprB2gVJEpGOMbcp2X9WZ/ME3rfyGtvhUlAjOE5O/X2NGvQ7JzkN9TXMchmleXuzGbw3pK0VKnp8aspW157dvxn6JIqC2Z0oHAVprEsfA3XI39EHV4rPRBpA29+vbOB0zz8N8kn1LY6kauH2h0Bjt2AiI=
Received: from SN6PR11MB3166.namprd11.prod.outlook.com (2603:10b6:805:c5::17) by SN6PR11MB2654.namprd11.prod.outlook.com (2603:10b6:805:54::31) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2772.15; Thu, 27 Feb 2020 17:44:05 +0000
Received: from SN6PR11MB3166.namprd11.prod.outlook.com ([fe80::450f:d0ec:d45c:fa20]) by SN6PR11MB3166.namprd11.prod.outlook.com ([fe80::450f:d0ec:d45c:fa20%7]) with mapi id 15.20.2772.012; Thu, 27 Feb 2020 17:44:05 +0000
From: "Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com>
To: Fred Baker <fredbaker.ietf@gmail.com>, "ops-dir@ietf.org" <ops-dir@ietf.org>
CC: "last-call@ietf.org" <last-call@ietf.org>, "draft-ietf-rmcat-wireless-tests.all@ietf.org" <draft-ietf-rmcat-wireless-tests.all@ietf.org>, "rmcat@ietf.org" <rmcat@ietf.org>
Thread-Topic: Opsdir last call review of draft-ietf-rmcat-wireless-tests-08
Thread-Index: AQHVykghUIoiL2dC6U6d4lsYD69YD6gvEFQA
Date: Thu, 27 Feb 2020 17:44:05 +0000
Message-ID: <AF5C775D-18CD-45C4-A52A-B41179159581@cisco.com>
References: <157894391210.32399.15426663013501101470@ietfa.amsl.com>
In-Reply-To: <157894391210.32399.15426663013501101470@ietfa.amsl.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/10.22.0.200209
authentication-results: spf=none (sender IP is ) smtp.mailfrom=xiaoqzhu@cisco.com;
x-originating-ip: [2001:420:30a:4e01:6008:3de4:5275:5a4c]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 60421b9f-f9f7-4410-34e2-08d7bbaca3e1
x-ms-traffictypediagnostic: SN6PR11MB2654:
x-microsoft-antispam-prvs: <SN6PR11MB26546CCF4B2AFAE1A10980B3C9EB0@SN6PR11MB2654.namprd11.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:8273;
x-forefront-prvs: 03264AEA72
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(136003)(366004)(396003)(346002)(376002)(39860400002)(189003)(199004)(186003)(6486002)(2906002)(8936002)(81166006)(8676002)(6512007)(86362001)(33656002)(110136005)(54906003)(316002)(81156014)(91956017)(76116006)(66946007)(64756008)(66556008)(66446008)(6506007)(5660300002)(4326008)(66476007)(36756003)(71200400001)(2616005)(478600001)(966005); DIR:OUT; SFP:1101; SCL:1; SRVR:SN6PR11MB2654; H:SN6PR11MB3166.namprd11.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: cisco.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: xvgENO3VnXhg/LLHC6yxCfjGRpGccuIQguAU3Pf5lcwdlYIT/eRgpzVZnQSqT3KSulJHc0bmENNOCs7dvaBdllnrHZWUUayajyT6iQB8hXgAswF36hSAfZRQH2pwlU2sxrn4ie2oU0uZtMrjinZn/cVq7YmPEfQyyxcXP2oSc9phvQ9IARD/I/QtttRCn8LWLuUWzbnR0b3p6wEqTrSrSfAKq6SrSlcvEXe9wNkZffIXGNxeT5/2ymord4lBl1yPLhliePjOYOlzl7BmRZ51HIJxxFtrLcEPUiRydLZhGbOmLS30NlH6dC1qTXirCq4JErphRZFXlRENPinm1vm1LWwu1OEG4KIhAguIR/fpZbJ01DIO9qoS2MILthj4cgodgEV0egf9cXzmwfbEVke9AdNQvGGQgtHY91uIIjsCRBkic1ofglUxMx9Uj2rCrdg0+0hD6K5C9P3VZIUmsM2v9gLJFDzR8uanfDpJ3RGpRdr7qOqs7jUs4TsHm5TA1IdxmNVcBtCC9L9ub1juRAv7qg==
x-ms-exchange-antispam-messagedata: IrEExpTr6/t23kX/MMyyB1fEwwswkwxoIMsfGEcUxC5HTyTY7jbsauRC7WILOVJrs93lqSomAhvuQoe0YU4R9R1vikgIKWMzqKQCMvUMt7U4/X1wFyj+DywVDavYhS18uBOHJ1AjFD9nmss71SPgXWf2KSs06fnKABIsWjnb4liVTnyP9pwdm5sSDuIgM03WJIwYV8sfQZoAwYXf7cbbRw==
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="utf-8"
Content-ID: <8DF8F942FBB7F947AAC5E7F710C83DF1@namprd11.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 60421b9f-f9f7-4410-34e2-08d7bbaca3e1
X-MS-Exchange-CrossTenant-originalarrivaltime: 27 Feb 2020 17:44:05.2370 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: j5gDv9qgT402RV6E7lGgcz4h2uXu5MvoCQKSOGBbuPjqCnzURfJQC+dgUMBZn2oex/KBgICeCtJXFnKrPHxwwA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN6PR11MB2654
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.36.7.12, xch-aln-002.cisco.com
X-Outbound-Node: rcdn-core-5.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/rmcat/znDLlSq2l9ZvtjGZOUINVUChZ_4>
Subject: Re: [rmcat] Opsdir last call review of draft-ietf-rmcat-wireless-tests-08
X-BeenThere: rmcat@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "RTP Media Congestion Avoidance Techniques \(RMCAT\) Working Group discussion list." <rmcat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rmcat>, <mailto:rmcat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rmcat/>
List-Post: <mailto:rmcat@ietf.org>
List-Help: <mailto:rmcat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rmcat>, <mailto:rmcat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 27 Feb 2020 17:44:36 -0000

Hi Fred, 

Many thanks for helping to review this draft and sharing your thoughts. We've uploaded a revised version (-09) and have accommodated your review comments. 

https://tools.ietf.org/html/draft-ietf-rmcat-wireless-tests-09

Please find our responses below  in line. Any further suggestions are, of course, always welcome. 

Best,
Xiaoqing, on behalf of all authors


On 1/13/20, 11:32 AM, "Fred Baker via Datatracker" <noreply@ietf.org> wrote:

    Reviewer: Fred Baker
    Review result: Has Nits
    
    Reviewer: Fred Baker
    Review Result: I have a few comments
    
    I have reviewed this document as part of the Operational directorate's ongoing
    effort to review all IETF documents being processed by the IESG. These comments
    were written with the intent of improving the operational aspects of the IETF
    drafts. Comments that are not addressed in last call may be included in AD
    reviews during the IESG review. Document editors and WG chairs should treat
    these comments just like any other last call comments.
    
    My first comment will probably be addressed by the RFC Editor, but I'll bring
    it up. In several places, the language of the document is awkward at best. One
    that sticks in my mind is the description of a network containing an 802.11b
    domain as containing an "abnomaly". I'm pretty sure it's a typo that a standard
    spell checker would have complained about, but Google thinks it's also a skin
    care product. The document would benefit from a spell check and an editing pass
    by a native English speaker.


[authors] Our apologies for the typos and thanks for catching it. The updated draft has
gone through one pass of editorial changes in an effort to improve its language usage.
Additional revision suggestions from the RFC Editor shall be very much appreciated.

    
    The second relates to a specific recommendation in the document concerning
    802.11b networks. The issue is that the dynamic range of 802.11 network speeds
    is very wide - 802.11b is theoretically capable of 11 MBPS, but typically
    achieves something on the order of 2-5 MBPS, while 802.11ac is theoretically
    capable of 1.3 GBPS. The difference in speed an introduce issues in network
    behavior. Where 802.11b is relevant, the document suggests that "additional
    test cases can be added" to cover the case. I suspect that the real issue isn't
    802.11b, although the paper cited refers to it; the issue is a network
    containing a mix of speeds with a broad range, with the slower ones perturbing
    the behavior of the faster ones. I'd suggest that the authors think about the
    fundamental issue, and make specific recommendations appropriate to the case
    (such as defining effective ranges for link speeds).


[authors] You are right that the fundamental issue is not 802.11b per se, but rather the effect of]
mixing heterogeneous link speeds over a wide range. So we’ve revised the sentence in
Sec.4 as:

	“Presence of legacy devices (e.g., ones operating only in IEEE 802.11b at a much lower
	PHY-layer link rate) can significantly slow down the rest of a modern Wi-Fi network. As
	discussed in [Heusse2003], the main reason for such anomaly is that legacy devices take
	much longer to transmit the same packet over a slower link than over a faster link, thereby
	consuming substantial portion of the transmission opportunities over the air.”

[authors ]The text of Sec. 4.3.2 (Effects of presence of legacy devices) has also been revised to emphasis
on the presence of devices with operating at heterogeneously link rates in these additional test cases,
instead of tying them with 802.11b.

    
    (for the record, I sent this to ops-dir@, but don't seem to be able to link to
    the post.)