Re: [Gen-art] Genart last call review of draft-ietf-rmcat-video-traffic-model-06
"Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com> Thu, 21 February 2019 18:46 UTC
Return-Path: <xiaoqzhu@cisco.com>
X-Original-To: gen-art@ietfa.amsl.com
Delivered-To: gen-art@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0473013110A; Thu, 21 Feb 2019 10:46:13 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.502
X-Spam-Level:
X-Spam-Status: No, score=-14.502 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com header.b=N3DtuTKw; dkim=pass (1024-bit key) header.d=cisco.onmicrosoft.com header.b=gEjEP0i2
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id MFXhemfvef6K; Thu, 21 Feb 2019 10:46:10 -0800 (PST)
Received: from rcdn-iport-9.cisco.com (rcdn-iport-9.cisco.com [173.37.86.80]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5CD7C131108; Thu, 21 Feb 2019 10:46:10 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=7182; q=dns/txt; s=iport; t=1550774770; x=1551984370; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-id:content-transfer-encoding: mime-version; bh=nhknsnUrPMZ/bO6Dxre3SxeZXteKo82WtLkZ5aDgUkU=; b=N3DtuTKwRIwZ/d3Ul/0ZIeNEwcSdof8K/kFVxsKTwE4Gwk0JLQCnBejX DKS3se5b77ZZCgrsdU7UGaQDv6qk9s9ElvK18Pqvy6qH+8tT89+NkJ2MD clLRrcRJINgglrk7k/Xgn0wcbmjTweHVQaZSN4ma1WvWTgXRTtYf/4sbO o=;
IronPort-PHdr: 9a23:HojFchPDmI5AtkoxSKcl6mtXPHoupqn0MwgJ65Eul7NJdOG58o//OFDEu6w/l0fHCIPc7f8My/HbtaztQyQh2d6AqzhDFf4ETBoZkYMTlg0kDtSCDBjrLfftdj46AexJVURu+DewNk0GUMs=
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0AKAAA58W5c/49dJa1kGgEBAQEBAgEBAQEHAgEBAQGBUwMBAQEBCwGBMFADZ3QECyeEB4NHA49bgld8lyKBJANUCwEBJQeEQAIXg2MiNgcNAQMBAQIBAQJtHAyFSwYjBA0MAQE3AQ8CAQgOBgYCJgICAjAVEAIEAQ0FgyABgVoDFQEOoVUCihRxfDOCeAEBBYEwAQMCAoNNDQuCCwMFgQuLPReBQD+BEScfghc1glciJQIDhGcxgiaKOI0SBowFCQKHPIsgGYFxhVqLQIoaL4VOiRGDKAIEAgQFAg0BAQWBTgsmgVZwFWUBgkGCHAwXg0uFFIU/coEojmMBAQ
X-IronPort-AV: E=Sophos;i="5.58,396,1544486400"; d="scan'208";a="437539538"
Received: from rcdn-core-7.cisco.com ([173.37.93.143]) by rcdn-iport-9.cisco.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 21 Feb 2019 18:46:09 +0000
Received: from XCH-RCD-012.cisco.com (xch-rcd-012.cisco.com [173.37.102.22]) by rcdn-core-7.cisco.com (8.15.2/8.15.2) with ESMTPS id x1LIk95A022238 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Thu, 21 Feb 2019 18:46:09 GMT
Received: from xhs-aln-002.cisco.com (173.37.135.119) by XCH-RCD-012.cisco.com (173.37.102.22) with Microsoft SMTP Server (TLS) id 15.0.1395.4; Thu, 21 Feb 2019 12:46:08 -0600
Received: from xhs-aln-002.cisco.com (173.37.135.119) by xhs-aln-002.cisco.com (173.37.135.119) with Microsoft SMTP Server (TLS) id 15.0.1395.4; Thu, 21 Feb 2019 12:46:08 -0600
Received: from NAM02-BL2-obe.outbound.protection.outlook.com (173.37.151.57) by xhs-aln-002.cisco.com (173.37.135.119) with Microsoft SMTP Server (TLS) id 15.0.1395.4 via Frontend Transport; Thu, 21 Feb 2019 12:46:08 -0600
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector1-cisco-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=nhknsnUrPMZ/bO6Dxre3SxeZXteKo82WtLkZ5aDgUkU=; b=gEjEP0i24TAS7BOK8hW0PiH8L8cCuau/K/+qAIsidI56LzkOU1eXLCBNF3BJI6PNFExsdyHA360cloewpEbh2q+UTJ0T3/bFUFqTfKBu1cgZvHCV6deMtRj/ZreNdIVe0us8/roLrCketwkR5ULJQ9GxvmhCMDIIU+0EsBsj9TU=
Received: from CY4PR11MB1559.namprd11.prod.outlook.com (10.172.70.138) by CY4PR11MB1879.namprd11.prod.outlook.com (10.175.60.137) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1643.14; Thu, 21 Feb 2019 18:46:06 +0000
Received: from CY4PR11MB1559.namprd11.prod.outlook.com ([fe80::d540:fdd4:ed72:856b]) by CY4PR11MB1559.namprd11.prod.outlook.com ([fe80::d540:fdd4:ed72:856b%7]) with mapi id 15.20.1643.014; Thu, 21 Feb 2019 18:46:06 +0000
From: "Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com>
To: Ines Robles <mariainesrobles@googlemail.com>, "gen-art@ietf.org" <gen-art@ietf.org>
CC: "rmcat@ietf.org" <rmcat@ietf.org>, "draft-ietf-rmcat-video-traffic-model.all@ietf.org" <draft-ietf-rmcat-video-traffic-model.all@ietf.org>, "ietf@ietf.org" <ietf@ietf.org>
Thread-Topic: Genart last call review of draft-ietf-rmcat-video-traffic-model-06
Thread-Index: AQHUtCDJUAFo2HqN5kSdxec0ZXtv66XqXo+A
Date: Thu, 21 Feb 2019 18:46:06 +0000
Message-ID: <88D57E57-648C-4E24-A50E-790D9187B650@cisco.com>
References: <154836059538.29291.9954930741127591863@ietfa.amsl.com>
In-Reply-To: <154836059538.29291.9954930741127591863@ietfa.amsl.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/10.16.1.190220
x-originating-ip: [2001:420:c0cc:1006::51]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 50f2c31e-c2cb-4d03-20b7-08d6982cd6ae
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(5600110)(711020)(4605104)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7153060)(7193020); SRVR:CY4PR11MB1879;
x-ms-traffictypediagnostic: CY4PR11MB1879:
x-ms-exchange-purlcount: 2
x-microsoft-exchange-diagnostics: 1;CY4PR11MB1879;23:eeHcUMV6RkcLB8Xi4XLRvjDqiYjnUmUq7Vcf1rFizpVBBiRjj0dCyVdPGNj9cCIQbF3lHjtFsIOgvQxzS8R8Xu5g9X98N9LgVaIBFMm/xFAX3aH3Pa3DP/32D6OqoaUoa1xeuNp1T/oKg7zeCPunYTZphFUMhH0Ixj0jw07OdHeSjnEC8wI9SnQ3w/r9vxqKLFG5IZ9JSUFzgBQodPbJ3iK9MK1x6pX0ihucHTg0vY9GCLmAGUaJv4KkXIIaSdT7KtVTNjJAqMJHwEF8SiIXnAHZqE5rEui13/gQweEkJfLXdqdZO8K3jILLJqSQf3+GWB5wfyi2yJZd/EcRzL190QAPGPn7Nrsr8yLRkR3/a88+TEkX2KaEhKywgo1n844b+u3AeBod4uRSy1AiYY3NYjDNfQi2SQtrNqTuwva8EDcCN5VMcyVWEKb2X+PAxgCymXJPqiAvH1pk5TtztQXhR8jOr2dyFxXKqf5XEXuKHZx/IHYLa+ainig7mMmGy7BQ051aH1xsIDvH6fuPqucLUoZKzgPWbZgwHWx7Tk1SEypPIWSFafx6GyH+qxPAxmnj0HkRrQaTem+6UgTSpj2JeIVYACMntlI2kHWzkXfc1nCxE+uqe96nPl+dNd0HbtfVBxwhH+BBsE5/se3CnfI3fGif5IzqDbZufrcK4jEJQGbAYOHxrV3CCtCyf9dtZqXCbCRyJjcKhrwPgDfF3uVk1gckhqT3Tc1tn/4x7/vqNnobVDTjQCoLnlnFvlxZy8PYrtj+wMJ8TNsbFGCG7Qq8d5DO8xOPaqJGozvO7424c34MLCDMYMbB+7BJ/z/bEOGvyzuywgSpnetlgpQZbBRbVfriBqB8LrBOYf+hhGUrA5gqhuBpOqPIHQX+kS3UK5HEX/e23cVYdzl/FCXw38fKmoshbzN6d0c5wE0r8LT826wpTr31XpP2u9CcT9E3z01324h7e/lbuiHWWHW51nw6EUkruc16GTTvGGunTqGHh3HBK5aJEfsy7iYgUJu38IOzYx7gwNFhTKkZMsp3h67JbnG7JQP80vuc4YAL1uC4bMaZCnpcYc+UfgAvKIt0nbXzzQ4zDtfZB0lJ9FrhDhBMNlOZo89xETA5DENXLmHXCdvPOq2UMcl5wybFADe7Zp0u6TyeUV3OSwcoJX5q3Aee7Dnye7LEHUx4sYpFW6wXifW+wD+NeC5LkjtcILRO/8ovsuypm5LALFjrWCPmSpKDgSeJtPCTN9A+WW+VNTBc9xq/X8iFWClId8lEDqKzNxlyDpR3Ng7teN9s46Dua9MCZEel2MeXn3W71ANjcqA00YQ=
x-microsoft-antispam-prvs: <CY4PR11MB1879F76C4E503FB1EBA78131C97E0@CY4PR11MB1879.namprd11.prod.outlook.com>
x-forefront-prvs: 09555FB1AD
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(396003)(136003)(366004)(376002)(346002)(39860400002)(51914003)(189003)(199004)(7736002)(478600001)(11346002)(54906003)(2501003)(305945005)(58126008)(99286004)(110136005)(8676002)(68736007)(71200400001)(966005)(105586002)(106356001)(81166006)(8936002)(102836004)(81156014)(46003)(446003)(86362001)(486006)(83716004)(76176011)(2616005)(14454004)(316002)(71190400001)(36756003)(476003)(5660300002)(6506007)(6346003)(25786009)(256004)(6116002)(4326008)(229853002)(33656002)(186003)(82746002)(97736004)(6246003)(6436002)(53936002)(6512007)(6486002)(6306002)(2906002); DIR:OUT; SFP:1101; SCL:1; SRVR:CY4PR11MB1879; H:CY4PR11MB1559.namprd11.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: cisco.com does not designate permitted sender hosts)
authentication-results: spf=none (sender IP is ) smtp.mailfrom=xiaoqzhu@cisco.com;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: V9QzsQRw15n5ivNU/TFtSFtZn3jl5tIL645ecii+4Pko1mTBjeHbjXQwG4qmxtYIvkrICj9eDDUYELEwbORUHbfwGjak/2kEas7fY/7V1+mkNkIifR1NiQY5k8FMYqWsB2V30/Hku5OcXZ8PFoWm4OBChIgX0M4Vm69ZqWxh+JhzcOg4uR+iwBPXWNf3OBl2wS8vdAe6/ZBtITQehT7y68Asrajk7/6heGd9FlXpjifDVWTNjFsgY63LQyx+XJAuH6CeTxOpRMcLFwhsOz+GCSmyj3EJlcv/6K4MOJML0JHphw++R7BaSs1hRF6NlybVtwYVvu0quMjGhE/MyEK5/I/yxRb6uAkvAPaFIGe4ZVc8MR/+RcQ4AhIytRAxkH4gm4ZzEfo1m83oixVZTE2d0ihnSu3xrX6xd9G+J/C3hTc=
Content-Type: text/plain; charset="utf-8"
Content-ID: <E6ECB7F5D1CE6447860CC4608AB8953C@namprd11.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 50f2c31e-c2cb-4d03-20b7-08d6982cd6ae
X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Feb 2019 18:46:06.6432 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR11MB1879
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.37.102.22, xch-rcd-012.cisco.com
X-Outbound-Node: rcdn-core-7.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/gen-art/1rkV9Tz97NrAa4fVEwKJz5ejnBc>
Subject: Re: [Gen-art] Genart last call review of draft-ietf-rmcat-video-traffic-model-06
X-BeenThere: gen-art@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "GEN-ART: General Area Review Team" <gen-art.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/gen-art>, <mailto:gen-art-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/gen-art/>
List-Post: <mailto:gen-art@ietf.org>
List-Help: <mailto:gen-art-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/gen-art>, <mailto:gen-art-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 21 Feb 2019 18:46:13 -0000
Hi, Ines, Thanks a lot for your thorough review of this draft. We've updated to version -07 to incorporate your review comments. More detailed response inline below (tagged [XZ]). Best, Xiaoqing (on behalf of all authors). On 1/24/19, 2:10 PM, "Ines Robles" <mariainesrobles@googlemail.com> wrote: Reviewer: Ines Robles Review result: Ready I am the assigned Gen-ART reviewer for this draft. The General Area Review Team (Gen-ART) reviews all IETF documents being processed by the IESG for the IETF Chair. Please treat these comments just like any other last call comments. For more information, please see the FAQ at <https://trac.ietf.org/trac/gen/wiki/GenArtfaq>. Document: draft-ietf-rmcat-video-traffic-model-06 Reviewer: Ines Robles Review Date: 2019-01-24 IETF LC End Date: 2019-01-28 IESG Telechat date: Not scheduled for a telechat Summary: I believe the draft is technically good. This document is well written and clear to understand. This document describes two reference video traffic models for evaluating RTP congestion control algorithms. The first model statistically characterizes the behavior of a live video encoder in response to changing requests on target video rate. The second model is trace-driven, and emulates the output of actual encoded video frame sizes from a high-resolution test sequence. The document describes also how both approaches can be combined into a hybrid model. Additionally, The stand-alone traffic source module is available as an open source implementation, which I think it is very nice. :) I did not find issues. I have some minor questions/suggestions. Major issues: Not found Minor issues: Not found Nits/editorial comments: - Page 14: correponding -> corresponding [XZ] Thanks for the catch! Fixed. - steady state, sometimes appears as steady-state, it would be nice to unify these terms. [XZ] Thanks for pointing this out. We've completed one pass of purging to stick to "steady state" throughout. The only two excepts are out of grammatical considerations ("steady-state behavior" as in "five-year-old boy"). Some Questions/suggestions: 1- In Figure 1, would it be correct to add an input as a self-loop arrow indicating "dummy video frames"? (As previously was an input "raw video frames" e.g. in version 4 ) [XZ] We actually chose to take off the input of “raw video frames“ from version -04 since the synthetic video source does not need to perform any encoding process. Instead, it just needs to keep track of frame size and intervals, and generate dummy encoded video frames as output. To clarify, the output label has been revised to “dummy encoded video frames” 2- Would it be correct to add in: 2.1- Page 14: "...ongoing, steady-state behavior of a video..." => "...ongoing, steady-state behavior (fluctuation around a constant target rate) of a video..."? [1] [XZ] Thanks a lot for the suggestion. This sentence is now revised as follows: In general, the trace-driven model is more realistic for mimicking the ongoing, steady-state behavior of a video traffic source with fluctuations around a constant target rate. In contrast, the statistical model is more versatile for simulating the behavior of a video stream in transient, such as when encountering sudden rate changes. 2.2 - Page 8: "...is considered to be in a transient state...." => "...is considered to be in a transient state (reaction to abrupt changes in target rate)...."? [1] [1] Based in https://datatracker.ietf.org/meeting/101/materials/slides-101-rmcat-rmcat-video-traffic-model-00 - Slide 2 [XZ] This has been revised accordingly as well, as follows: The output bitrate R_o during the period [t, t+tau_v] is considered to be in a transient state when reacting to abrupt changes in target rate. 3- Would it be correct to add in the Figure 3 something like?: - R_v > R_v_previous for transient state - R_v <= R_v_previous for steady state [XZ] Thanks for this suggestion. However, adding the R_v > R_v_previous in the figure would not accurately reflect the criteria we’ve observed from the trace data we’ve collected (see reference [IETF-Interim]). In fact, I double checked on our trace data, and noticed that transient behavior is observed in the presence of rate change in both directions (e.g., +/-20%). I have revised the text accordingly: As shown in Figure 3, the video traffic model operates in a transient state if the requested target rate R_v is substantially different from the previous target, or else it operates in steady state. ... One example criterion for determining whether the traffic model should operate in a transient state is whether the rate change exceeds 10% of the previous target rate. ... Thanks for this document, Ines.
- [Gen-art] Genart last call review of draft-ietf-r… Ines Robles
- Re: [Gen-art] Genart last call review of draft-ie… Alissa Cooper
- Re: [Gen-art] Genart last call review of draft-ie… Xiaoqing Zhu (xiaoqzhu)
- Re: [Gen-art] Genart last call review of draft-ie… Ines Robles