Re: [rmcat] Ben Campbell's No Objection on draft-ietf-rmcat-video-traffic-model-06: (with COMMENT)

"Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com> Fri, 22 February 2019 04:46 UTC

Return-Path: <xiaoqzhu@cisco.com>
X-Original-To: rmcat@ietfa.amsl.com
Delivered-To: rmcat@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8B5191292F1; Thu, 21 Feb 2019 20:46:38 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.503
X-Spam-Level:
X-Spam-Status: No, score=-14.503 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com header.b=cVseRORI; dkim=pass (1024-bit key) header.d=cisco.onmicrosoft.com header.b=RHqq2el/
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id a7EBxpXwTQzF; Thu, 21 Feb 2019 20:46:36 -0800 (PST)
Received: from alln-iport-7.cisco.com (alln-iport-7.cisco.com [173.37.142.94]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 41D5F1275F3; Thu, 21 Feb 2019 20:46:36 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=5166; q=dns/txt; s=iport; t=1550810796; x=1552020396; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-id:content-transfer-encoding: mime-version; bh=LR3tUE0ckNsTu5SqiB5BtbsMa9XNiv4QYC559H8XzeU=; b=cVseRORI2cKtnCZruFm++ph7DHZpQrv1QZ1w7uGyYi67YOC5p0rlYEq5 hk7UwDaC1LhyCIXi6Rd1LGl7ztw3BASH7wmWQuAmJOVcuy8GL50vsQwRo BHz029tcei3Px8XOTAlIxUcc+p5/poq/6PNO0xMhh1brddJEX3V3m1WLa U=;
IronPort-PHdr: 9a23:GDbejh8+gd3QBv9uRHGN82YQeigqvan1NQcJ650hzqhDabmn44+8ZR7E/fs4iljPUM2b8P9Ch+fM+4HYEW0bqdfk0jgZdYBUERoMiMEYhQslVd6EAEriPv73Ryc7B89FElRi+iLzPA==
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0ANAADXfW9c/40NJK1lGwEBAQEDAQEBBwMBAQGBUQYBAQELAYEwUANndAQLJ4QHg0cDhFCLDYIymEMUgRADVAsBASMJhEACF4NjIjQJDQEDAQECAQECbRwMhUsGIxEMAQE3AQ8CAQgaAhkNAgICMBUQAgQBDQWDIAGBWgMVAQ6gbwKKFHGBL4J4AQEFgURBgwQYggsDBYELiz0XgUA/gTgME4FOfoMeAgECAYEqARIBH4MJMYImiggEmUkJAoc8iyAZgXGFWotAihovhU6MOQIEAgQFAg0BAQWBRzhlWBEIcBVlAYJBghw2gziFFIU/cgGBJ4wlgj4BAQ
X-IronPort-AV: E=Sophos;i="5.58,398,1544486400"; d="scan'208";a="239381937"
Received: from alln-core-8.cisco.com ([173.36.13.141]) by alln-iport-7.cisco.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 22 Feb 2019 04:46:35 +0000
Received: from XCH-ALN-015.cisco.com (xch-aln-015.cisco.com [173.36.7.25]) by alln-core-8.cisco.com (8.15.2/8.15.2) with ESMTPS id x1M4kZDF012401 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Fri, 22 Feb 2019 04:46:35 GMT
Received: from xhs-rtp-003.cisco.com (64.101.210.230) by XCH-ALN-015.cisco.com (173.36.7.25) with Microsoft SMTP Server (TLS) id 15.0.1395.4; Thu, 21 Feb 2019 22:46:34 -0600
Received: from xhs-rcd-003.cisco.com (173.37.227.248) by xhs-rtp-003.cisco.com (64.101.210.230) with Microsoft SMTP Server (TLS) id 15.0.1395.4; Thu, 21 Feb 2019 23:46:33 -0500
Received: from NAM05-DM3-obe.outbound.protection.outlook.com (72.163.14.9) by xhs-rcd-003.cisco.com (173.37.227.248) with Microsoft SMTP Server (TLS) id 15.0.1395.4 via Frontend Transport; Thu, 21 Feb 2019 22:46:33 -0600
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector1-cisco-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=LR3tUE0ckNsTu5SqiB5BtbsMa9XNiv4QYC559H8XzeU=; b=RHqq2el/3m2b2OFB8ZYz9UymZRnPolkxoZLVUO4kIavLycOQQ7wiieym2ytKY2A0wwaj5Muv8NABIDlarDNovexBO+ckQJWkybODS3RymDWF/uQMkHay72yORtR8ZqnCysNuejrURntc7r4dgKvA74MIm/JyavrlryKQcJr+oGE=
Received: from CY4PR11MB1559.namprd11.prod.outlook.com (10.172.70.138) by CY4PR11MB1863.namprd11.prod.outlook.com (10.175.62.139) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1643.16; Fri, 22 Feb 2019 04:46:32 +0000
Received: from CY4PR11MB1559.namprd11.prod.outlook.com ([fe80::d540:fdd4:ed72:856b]) by CY4PR11MB1559.namprd11.prod.outlook.com ([fe80::d540:fdd4:ed72:856b%7]) with mapi id 15.20.1643.014; Fri, 22 Feb 2019 04:46:32 +0000
From: "Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com>
To: Ben Campbell <ben@nostrum.com>, The IESG <iesg@ietf.org>
CC: "draft-ietf-rmcat-video-traffic-model@ietf.org" <draft-ietf-rmcat-video-traffic-model@ietf.org>, Colin Perkins <csp@csperkins.org>, "rmcat-chairs@ietf.org" <rmcat-chairs@ietf.org>, "rmcat@ietf.org" <rmcat@ietf.org>
Thread-Topic: Ben Campbell's No Objection on draft-ietf-rmcat-video-traffic-model-06: (with COMMENT)
Thread-Index: AQHUvctdJiBAnvqTrUCER2xcsFV7CqXq8vyA
Date: Fri, 22 Feb 2019 04:46:32 +0000
Message-ID: <508085E0-E433-4668-8E84-88DD3B148499@cisco.com>
References: <154942340750.32287.12671984588927271857.idtracker@ietfa.amsl.com>
In-Reply-To: <154942340750.32287.12671984588927271857.idtracker@ietfa.amsl.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/10.16.1.190220
authentication-results: spf=none (sender IP is ) smtp.mailfrom=xiaoqzhu@cisco.com;
x-originating-ip: [2001:420:c0cc:1003::16]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 491768f0-05a5-4dd3-ecc1-08d69880b79d
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(5600110)(711020)(4605104)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7153060)(7193020); SRVR:CY4PR11MB1863;
x-ms-traffictypediagnostic: CY4PR11MB1863:
x-ms-exchange-purlcount: 2
x-microsoft-exchange-diagnostics: 1;CY4PR11MB1863;23:XXcVyom/i3xbosw/7v4nEeB2d9D3jzLcEm4vhYYtsOZfRPrDgy89s6ctXVIOstOmaWw2rbt9JfWOJzdCBqXkwx+xe1JsD4N9jYz+ctNx0jVRcI5hLBz94PKFXetwYLYRZXQjuppwRAJV9mcfPKE1hqkqScuWouWqLqol3EI3zTtRMyGwQwT1ZUk55YrUqoJfmiMYZVMF8MV+VydeYnhWEwow1iGMN7LwosvvTzwaSouAT8UctHtVzqFm6Z4X6gFDLfWyVW2PJocyCVBH1Oioe2fBK9Vt63DGrbLu51J2594l7ZecP3sxHCh03ByHRJb9BUAMsEfJGHCGVEAruKKZlXSp7abdRZ+g9kMb8uO1L+WV2CvDchGMkvsMimN0iZ6YvkbLZz/cw81nsZaMEbvr/3Zv5NntR063nqaGllB2pOGe68mSsKcWJb9xXxLbOMnk3ckjT2ruB/G4zNZeQ6oP+glbLJWpS5vvh58M8TlWXi8b6OUc1h3Pq8LKPL3Hz2UXbj8a4lyaYQX19WJtbCmmw0509nsw93DI+bEjH/7GpixRbGAtufaUDfln/tGBf/4g/NfHQztJjTuXOoCbA0BOTmHn9R0E6Du3zr8SoRhK1TRafYE4X3gao+WEJstEmGhpUnXjVbfoPjNH4lZpv82iliuXFDGthjj8mb3/7iBcTEPw25SWDYg5iwDIlM1QIm03jpnSpZhgphpPZrLgB2a0E3E12tLn2LqIcQ1877jr/t8FLcS6kp9FXh8OQ4Rp3XizQfc5eQFZhoNNI/EBJLW4Pvg9Hlh0ABhJk2mSEKa7xWFnZIkxkYphi4f7qK0ZH+Uq5GxQf2et+zIyLVHH1+Cve/TqejwGDYXkbfQZxVJ7BtBTYN9gybMgIf+Vry0wtdnJ8sTgHf229uFV5LJY+4jvEBXmREQTTiJtBnSveqvpzI2aTlJcpFkqJm8+5S8+uOhDfViIIQtPMs2BzSwfAbSOBCrT4wNUgU1w1O1gDuqLl17+fp38dVENcs6+G618DtJeKXs2vIeCUb0A0oSEdsQU2nJlRPO5qV18UEsV/hVlIEL2apNuq68vPMY+RXF3AKubkQTCtWhYBOj9W+WdOBTRnpUnvKwI2AR1wTEb8tNGQfDV3RN2OSWwlbDdhehz/Q+AqBO7pBymvtbo6TV649+b97eKgnMKbBUxNrg/HIJPcs038wh9GBM9Hyl0jynfOgQdir5e5P7Z4EG6ytE1R/2n7BmhcjyfPZDjxTw6HBBGbWsQ3ZTVVlz5JNZwJ/OoZrDlWJxhDCe+L65V4lVXDKGqNg==
x-microsoft-antispam-prvs: <CY4PR11MB186346F03B67B3EBE953D1E0C97F0@CY4PR11MB1863.namprd11.prod.outlook.com>
x-forefront-prvs: 09565527D6
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(136003)(376002)(366004)(39860400002)(396003)(346002)(199004)(189003)(97736004)(106356001)(446003)(2616005)(11346002)(53936002)(486006)(966005)(8676002)(36756003)(6116002)(476003)(8936002)(81156014)(86362001)(105586002)(6306002)(81166006)(76176011)(478600001)(71200400001)(71190400001)(33656002)(99286004)(83716004)(66574012)(14444005)(46003)(25786009)(6512007)(186003)(256004)(6506007)(102836004)(4326008)(82746002)(58126008)(54906003)(2906002)(6246003)(110136005)(7736002)(305945005)(316002)(14454004)(229853002)(6436002)(5660300002)(68736007)(6486002); DIR:OUT; SFP:1101; SCL:1; SRVR:CY4PR11MB1863; H:CY4PR11MB1559.namprd11.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1;
received-spf: None (protection.outlook.com: cisco.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: qFP/42jQrcJAh3KxguAzWjiRMcpmIQqQHJsNHwIBPR3PkO/WOXFF19M5ASmXef9J+TctBBA3T8Zvr95YCbVKCTTZ/rEbcDPC2R/QcISZBAfd4dTK1IUAN69SBXga9VlS2OaS13MNKW9LCrGgMkhiNHoeOeUYCWnFsAfk+300ggAmil/VQiRWjNXqlYmPJLJoCbxCxHYa/GIA66j50HuMSj93OuiRVySbs0Kj7ZhziKTAo/RAdPOO61oYWoM6H/KA3gdsoDK60Rf6aROVkOmAqA2KIDhyudN8inNEO032cjKtdfCprPERxNTPdFT/DHUaVHPRBLPCOVWm8R3vrUF6dWEpsld0i0RlBcfwmlMut6aTEmp3zMCPDLRjBxKhjHaH326N9OZUd75sf3uBdzt3KXA5IvTY2Lvu79KZ8E0jF3E=
Content-Type: text/plain; charset="utf-8"
Content-ID: <17DABA1A5D783A4CA385A343FB9E8B56@namprd11.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 491768f0-05a5-4dd3-ecc1-08d69880b79d
X-MS-Exchange-CrossTenant-originalarrivaltime: 22 Feb 2019 04:46:32.2139 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR11MB1863
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.36.7.25, xch-aln-015.cisco.com
X-Outbound-Node: alln-core-8.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/rmcat/wno3qH8_unPihwvS4zYaDfHbkE8>
Subject: Re: [rmcat] Ben Campbell's No Objection on draft-ietf-rmcat-video-traffic-model-06: (with COMMENT)
X-BeenThere: rmcat@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "RTP Media Congestion Avoidance Techniques \(RMCAT\) Working Group discussion list." <rmcat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rmcat>, <mailto:rmcat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rmcat/>
List-Post: <mailto:rmcat@ietf.org>
List-Help: <mailto:rmcat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rmcat>, <mailto:rmcat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 22 Feb 2019 04:46:39 -0000

Hi Ben, 

Thanks for reviewing our draft.  We've recently updated it to version -07 and
tried to address your comments via our revision. 

Please find more detailed responses below inline (tagged [XZ]).  Let us know if
you have any further thoughts or suggestions. 

Best,
Xiaoqing (on behalf of all authors). 

On 2/5/19, 9:23 PM, "Ben Campbell" <ben@nostrum.com> wrote:

    Ben Campbell has entered the following ballot position for
    draft-ietf-rmcat-video-traffic-model-06: No Objection
    
    When responding, please keep the subject line intact and reply to all
    email addresses included in the To and CC lines. (Feel free to cut this
    introductory paragraph, however.)
    
    
    Please refer to https://www.ietf.org/iesg/statement/discuss-criteria.html
    for more information about IESG DISCUSS and COMMENT positions.
    
    
    The document, along with other ballot positions, can be found here:
    https://datatracker.ietf.org/doc/draft-ietf-rmcat-video-traffic-model/
    
    
    
    ----------------------------------------------------------------------
    COMMENT:
    ----------------------------------------------------------------------
    
    §3: I am a little surprised not to see much discussion of how much variation in
    behavior you expect from different real-world encoders. I think the models
    probably have enough knobs to handle this, but an overview discussion would be
    helpful.
    
[XZ] This is a great point. There were indeed quite some discussions about variations
in real-world encoder behaviors during WG meetings. You are right that the draft
should also capture this point. We added the following text in the last paragraph of
the intro to reflect this:

"...  The synthetic traffic model should also contain tunable parameters so that
it can be flexibly adjusted to reflect the wide variations in real-world live video
encoder behaviors.   ..."


    §6: From reading further, I understand the real-world encoder creates a library
    of frames to be sent during testing. If that is correct, it would be helpful to
    say a few words about it in the opening paragraphs.

[XZ] Instead of keeping a library of frames generated by real-world encoders, 
the traces of frame size and intervals (instead of the encoded frame contents
themselves) are used to drive the trace-based model. The wording in the final
paragraph of the intro section has been revised to describe the trace-based
model more clearly:

" ... The second is driven by frame size and interval traces recorded from
a real-world encoder ..." 

    §10: It's not obvious to me how the listed consideration is security related. I
    am willing to believe it is, but some words to tie it to security would be
    helpful.
    
[XZ] That’s a fair point and also raised by a few other reviewers.  We’ve revised
the text of the Security Considerations section in version -07, as below, to clarify
that the draft itself does not impose security concerns. Instead, the models described
herein can be used for evaluating candidate algorithms to prevent them from hurting
the Internet:
    
"The synthetic video traffic models as described in this draft do not
   impose any security threats.  They are designed to mimic realistic
   traffic patterns for evaluating candidate RTP-based congestion
   control algorithms, so as to ensure stable operations of the network.
   It is RECOMMENDED that candidate algorithms be tested using the video
   traffic models presented in this draft before wide deployment over
   the Internet.  If the generated synthetic traffic flows are sent over
   the Internet, they also need to be congestion controlled."