Re: [Gen-art] Genart last call review of draft-ietf-rmcat-video-traffic-model-06

"Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com> Thu, 21 February 2019 18:46 UTC

Return-Path: <xiaoqzhu@cisco.com>
X-Original-To: gen-art@ietfa.amsl.com
Delivered-To: gen-art@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0473013110A; Thu, 21 Feb 2019 10:46:13 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.502
X-Spam-Level:
X-Spam-Status: No, score=-14.502 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com header.b=N3DtuTKw; dkim=pass (1024-bit key) header.d=cisco.onmicrosoft.com header.b=gEjEP0i2
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id MFXhemfvef6K; Thu, 21 Feb 2019 10:46:10 -0800 (PST)
Received: from rcdn-iport-9.cisco.com (rcdn-iport-9.cisco.com [173.37.86.80]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5CD7C131108; Thu, 21 Feb 2019 10:46:10 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=7182; q=dns/txt; s=iport; t=1550774770; x=1551984370; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-id:content-transfer-encoding: mime-version; bh=nhknsnUrPMZ/bO6Dxre3SxeZXteKo82WtLkZ5aDgUkU=; b=N3DtuTKwRIwZ/d3Ul/0ZIeNEwcSdof8K/kFVxsKTwE4Gwk0JLQCnBejX DKS3se5b77ZZCgrsdU7UGaQDv6qk9s9ElvK18Pqvy6qH+8tT89+NkJ2MD clLRrcRJINgglrk7k/Xgn0wcbmjTweHVQaZSN4ma1WvWTgXRTtYf/4sbO o=;
IronPort-PHdr: =?us-ascii?q?9a23=3AHojFchPDmI5AtkoxSKcl6mtXPHoupqn0MwgJ65?= =?us-ascii?q?Eul7NJdOG58o//OFDEu6w/l0fHCIPc7f8My/HbtaztQyQh2d6AqzhDFf4ETB?= =?us-ascii?q?oZkYMTlg0kDtSCDBjrLfftdj46AexJVURu+DewNk0GUMs=3D?=
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: =?us-ascii?q?A0AKAAA58W5c/49dJa1kGgEBAQEBAgE?= =?us-ascii?q?BAQEHAgEBAQGBUwMBAQEBCwGBMFADZ3QECyeEB4NHA49bgld8lyKBJANUCwE?= =?us-ascii?q?BJQeEQAIXg2MiNgcNAQMBAQIBAQJtHAyFSwYjBA0MAQE3AQ8CAQgOBgYCJgI?= =?us-ascii?q?CAjAVEAIEAQ0FgyABgVoDFQEOoVUCihRxfDOCeAEBBYEwAQMCAoNNDQuCCwM?= =?us-ascii?q?FgQuLPReBQD+BEScfghc1glciJQIDhGcxgiaKOI0SBowFCQKHPIsgGYFxhVq?= =?us-ascii?q?LQIoaL4VOiRGDKAIEAgQFAg0BAQWBTgsmgVZwFWUBgkGCHAwXg0uFFIU/coE?= =?us-ascii?q?ojmMBAQ?=
X-IronPort-AV: E=Sophos;i="5.58,396,1544486400"; d="scan'208";a="437539538"
Received: from rcdn-core-7.cisco.com ([173.37.93.143]) by rcdn-iport-9.cisco.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 21 Feb 2019 18:46:09 +0000
Received: from XCH-RCD-012.cisco.com (xch-rcd-012.cisco.com [173.37.102.22]) by rcdn-core-7.cisco.com (8.15.2/8.15.2) with ESMTPS id x1LIk95A022238 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Thu, 21 Feb 2019 18:46:09 GMT
Received: from xhs-aln-002.cisco.com (173.37.135.119) by XCH-RCD-012.cisco.com (173.37.102.22) with Microsoft SMTP Server (TLS) id 15.0.1395.4; Thu, 21 Feb 2019 12:46:08 -0600
Received: from xhs-aln-002.cisco.com (173.37.135.119) by xhs-aln-002.cisco.com (173.37.135.119) with Microsoft SMTP Server (TLS) id 15.0.1395.4; Thu, 21 Feb 2019 12:46:08 -0600
Received: from NAM02-BL2-obe.outbound.protection.outlook.com (173.37.151.57) by xhs-aln-002.cisco.com (173.37.135.119) with Microsoft SMTP Server (TLS) id 15.0.1395.4 via Frontend Transport; Thu, 21 Feb 2019 12:46:08 -0600
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector1-cisco-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=nhknsnUrPMZ/bO6Dxre3SxeZXteKo82WtLkZ5aDgUkU=; b=gEjEP0i24TAS7BOK8hW0PiH8L8cCuau/K/+qAIsidI56LzkOU1eXLCBNF3BJI6PNFExsdyHA360cloewpEbh2q+UTJ0T3/bFUFqTfKBu1cgZvHCV6deMtRj/ZreNdIVe0us8/roLrCketwkR5ULJQ9GxvmhCMDIIU+0EsBsj9TU=
Received: from CY4PR11MB1559.namprd11.prod.outlook.com (10.172.70.138) by CY4PR11MB1879.namprd11.prod.outlook.com (10.175.60.137) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1643.14; Thu, 21 Feb 2019 18:46:06 +0000
Received: from CY4PR11MB1559.namprd11.prod.outlook.com ([fe80::d540:fdd4:ed72:856b]) by CY4PR11MB1559.namprd11.prod.outlook.com ([fe80::d540:fdd4:ed72:856b%7]) with mapi id 15.20.1643.014; Thu, 21 Feb 2019 18:46:06 +0000
From: "Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com>
To: Ines Robles <mariainesrobles@googlemail.com>, "gen-art@ietf.org" <gen-art@ietf.org>
CC: "rmcat@ietf.org" <rmcat@ietf.org>, "draft-ietf-rmcat-video-traffic-model.all@ietf.org" <draft-ietf-rmcat-video-traffic-model.all@ietf.org>, "ietf@ietf.org" <ietf@ietf.org>
Thread-Topic: Genart last call review of draft-ietf-rmcat-video-traffic-model-06
Thread-Index: AQHUtCDJUAFo2HqN5kSdxec0ZXtv66XqXo+A
Date: Thu, 21 Feb 2019 18:46:06 +0000
Message-ID: <88D57E57-648C-4E24-A50E-790D9187B650@cisco.com>
References: <154836059538.29291.9954930741127591863@ietfa.amsl.com>
In-Reply-To: <154836059538.29291.9954930741127591863@ietfa.amsl.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/10.16.1.190220
x-originating-ip: [2001:420:c0cc:1006::51]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 50f2c31e-c2cb-4d03-20b7-08d6982cd6ae
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(5600110)(711020)(4605104)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7153060)(7193020); SRVR:CY4PR11MB1879;
x-ms-traffictypediagnostic: CY4PR11MB1879:
x-ms-exchange-purlcount: 2
x-microsoft-exchange-diagnostics: =?utf-8?B?MTtDWTRQUjExTUIxODc5OzIzOmVlSGNVTVY2UmtjTEI4WGk0WExSdmpEcWlZ?= =?utf-8?B?am5VbVVxN1ZjZjFyRml6cFZCQmlSamowZEN5VmRQR05qOWNDSVFiRjNsSGp0?= =?utf-8?B?RnNJT2d2UXh6UzhSOFh1NWc5WDk4TjlMZ1ZhSUJGTW0veEZBWDNhSDNQYTNE?= =?utf-8?B?UC8zMkQ2T3FvYVVvYTF4ZXVOcDFUL29LZzd6ZUNQdW5ZVFpwaEZVTWhIMEl4?= =?utf-8?B?ajBqdzA3T2RIZVNqbkVDOHdJOVNuUTN3L3I5dnhxS0xGRzVJWjlKU1VGemdC?= =?utf-8?B?UW9kUGJKM2lLOU1LMXg2cFgwaWh1Y0hUZzB2WTlHQ0xtQUdVYUp2NEtrWElJ?= =?utf-8?B?YVNkVDdLdFZUTmpKQXFNSkh3RUY4U2lJWG5BSFpxRTVyRXVpMTMvZ1F3ZUVr?= =?utf-8?B?SmZMWGRxZFpPOEszaklMTEpxU1FmMytHV0I1d2Z5aTJ5SlpkL0VjUnpMMTkw?= =?utf-8?B?UUFQR1BuN05yc3I4eUxSa1IzL2E4OCtURWtYMkthRWhLeXdnbzFuODQ0Yit1?= =?utf-8?B?M0FlQm9kNHVSU3kxQWlZWTNOWWpETmZRaTJTUXRyTnFUdXd2YThFRGNDTjVW?= =?utf-8?B?TWN5VldFS2IyWCtQQXhnQ3ltWEpQcWlBdkgxcGs1VHR6dFFYaFI4ak9yMmR5?= =?utf-8?B?RnhYS3FmNVhFWHVLSFp4L0lIWUxhK2FpbmlnN21NbUd5N0JRMDUxYUgxeHNJ?= =?utf-8?B?RHZINmZ1UHF1Y0xVb1pLemdQV2JaZ3dIV3g3VGsxU0V5cFBJV1NGYWZ4Nkd5?= =?utf-8?B?SCtxeFBBeG1uajBIa1JyUWFUZW0rNlVnVFNwajJKZUlWWUFDTW50bEkya0hX?= =?utf-8?B?emtYZmMxbkN4RSt1cWU5Nm5QbCtkTmQwSGJ0ZlZCeHdoSCtCQnNFNS9zZTND?= =?utf-8?B?bmZJM2ZHaWY1SXpxRGJadWZyY0s0akVKUUdiQVlPSHhyVjNDQ3RDeWY5ZHRa?= =?utf-8?B?cVhDYkNSeUpqY0tocndQZ0RmRjN1VmsxZ2NraHFUM1RjMXRuLzR4Ny92cU5u?= =?utf-8?B?b2JWRFRqUUNvTG5sbkZ2bHhaeThQWXJ0ait3TUo4VE5zYkZHQ0c3UXE4ZDVE?= =?utf-8?B?Tzh4T1BhcUpHb3p2Tzc0MjRjMzRNTENETVlNYkIrN0JKL3ovYkVPR3Z5enV5?= =?utf-8?B?d2dTcG5ldGxncFFaYkJSYlZmcmlCcUI4THJCT1lmK2hoR1VyQTVncWh1QnBP?= =?utf-8?B?cVBJSFFYK2tTM1VLNUhFWC9lMjNjVllkemwvRkNYdzM4Zkttb3NoYnpONmQw?= =?utf-8?B?YzV3RTByOExUODI2d3BUcjMxWHBQMnU5Q2NUOUUzejAxMzI0aDdlL2xidWlI?= =?utf-8?B?V1dIVzUxbnc2RVVrcnVjMTZHVFR2R0d1blRxR0hoM0hCSzVhSkVmc3k3aVln?= =?utf-8?B?VUp1MzhJT3pZeDdnd05GaFRLa1pNc3AzaDY3SmJuRzdKUVA4MHZ1YzRZQUwx?= =?utf-8?B?dUM0Yk1hWkNucGNZYytVZmdBdktJdDBuYlh6elE0ekR0ZlpCMGxKOUZyaERo?= =?utf-8?B?Qk1ObE9abzg5eEVUQTVERU5YTG1IWENkdlBPcTJVTWNsNXd5YkZBRGU3WnAw?= =?utf-8?B?dTZUeWVVVjNPU3djb0pYNXEzQWVlN0RueWU3TEVIVXg0c1lwRlc2d1hpZlcr?= =?utf-8?B?d0QrTmVDNUxranRjSUxSTy84b3ZzdXlwbTVMQUxGanJXQ1BtU3BLRGdTZUp0?= =?utf-8?B?UENUTjlBK1dXK1ZOVEJjOXhxL1g4aUZXQ2xJZDhsRURxS3pOeGx5RHBSM05n?= =?utf-8?Q?7teN9s46Dua9MCZEel2MeXn3W71ANjcqA00YQ=3D?=
x-microsoft-antispam-prvs: <CY4PR11MB1879F76C4E503FB1EBA78131C97E0@CY4PR11MB1879.namprd11.prod.outlook.com>
x-forefront-prvs: 09555FB1AD
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(396003)(136003)(366004)(376002)(346002)(39860400002)(51914003)(189003)(199004)(7736002)(478600001)(11346002)(54906003)(2501003)(305945005)(58126008)(99286004)(110136005)(8676002)(68736007)(71200400001)(966005)(105586002)(106356001)(81166006)(8936002)(102836004)(81156014)(46003)(446003)(86362001)(486006)(83716004)(76176011)(2616005)(14454004)(316002)(71190400001)(36756003)(476003)(5660300002)(6506007)(6346003)(25786009)(256004)(6116002)(4326008)(229853002)(33656002)(186003)(82746002)(97736004)(6246003)(6436002)(53936002)(6512007)(6486002)(6306002)(2906002); DIR:OUT; SFP:1101; SCL:1; SRVR:CY4PR11MB1879; H:CY4PR11MB1559.namprd11.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: cisco.com does not designate permitted sender hosts)
authentication-results: spf=none (sender IP is ) smtp.mailfrom=xiaoqzhu@cisco.com;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: V9QzsQRw15n5ivNU/TFtSFtZn3jl5tIL645ecii+4Pko1mTBjeHbjXQwG4qmxtYIvkrICj9eDDUYELEwbORUHbfwGjak/2kEas7fY/7V1+mkNkIifR1NiQY5k8FMYqWsB2V30/Hku5OcXZ8PFoWm4OBChIgX0M4Vm69ZqWxh+JhzcOg4uR+iwBPXWNf3OBl2wS8vdAe6/ZBtITQehT7y68Asrajk7/6heGd9FlXpjifDVWTNjFsgY63LQyx+XJAuH6CeTxOpRMcLFwhsOz+GCSmyj3EJlcv/6K4MOJML0JHphw++R7BaSs1hRF6NlybVtwYVvu0quMjGhE/MyEK5/I/yxRb6uAkvAPaFIGe4ZVc8MR/+RcQ4AhIytRAxkH4gm4ZzEfo1m83oixVZTE2d0ihnSu3xrX6xd9G+J/C3hTc=
Content-Type: text/plain; charset="utf-8"
Content-ID: <E6ECB7F5D1CE6447860CC4608AB8953C@namprd11.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 50f2c31e-c2cb-4d03-20b7-08d6982cd6ae
X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Feb 2019 18:46:06.6432 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR11MB1879
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.37.102.22, xch-rcd-012.cisco.com
X-Outbound-Node: rcdn-core-7.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/gen-art/1rkV9Tz97NrAa4fVEwKJz5ejnBc>
Subject: Re: [Gen-art] Genart last call review of draft-ietf-rmcat-video-traffic-model-06
X-BeenThere: gen-art@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "GEN-ART: General Area Review Team" <gen-art.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/gen-art>, <mailto:gen-art-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/gen-art/>
List-Post: <mailto:gen-art@ietf.org>
List-Help: <mailto:gen-art-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/gen-art>, <mailto:gen-art-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 21 Feb 2019 18:46:13 -0000

Hi, Ines, 

Thanks a lot for your thorough review of this draft. We've updated to version -07 to
incorporate your review comments.  More detailed response inline below (tagged [XZ]).

Best,
Xiaoqing (on behalf of all authors). 

On 1/24/19, 2:10 PM, "Ines Robles" <mariainesrobles@googlemail.com>; wrote:

    Reviewer: Ines Robles
    Review result: Ready
    
    I am the assigned Gen-ART reviewer for this draft. The General Area
    Review Team (Gen-ART) reviews all IETF documents being processed
    by the IESG for the IETF Chair.  Please treat these comments just
    like any other last call comments.
    
    For more information, please see the FAQ at
    
    <https://trac.ietf.org/trac/gen/wiki/GenArtfaq>;.
    
    Document: draft-ietf-rmcat-video-traffic-model-06
    Reviewer: Ines Robles
    Review Date: 2019-01-24
    IETF LC End Date: 2019-01-28
    IESG Telechat date: Not scheduled for a telechat
    
    Summary:
    
    I believe the draft is technically good. This document is well written and
    clear to understand.
    
    This document describes two reference video traffic models for evaluating RTP
    congestion control algorithms.  The first model statistically characterizes the
    behavior of a live video encoder in response to changing requests on target
    video rate.  The second model is trace-driven, and emulates the output of
    actual encoded video frame sizes from a high-resolution test sequence.  The
    document describes also how both approaches can be combined into a hybrid model.
    
    Additionally, The stand-alone traffic source module is available as an open
    source implementation, which I think it is very nice. :)
    
    I did not find issues. I have some minor questions/suggestions.
    
    Major issues: Not found
    
    Minor issues: Not found
    
    Nits/editorial comments:
    
    - Page 14: correponding -> corresponding

[XZ]  Thanks for the catch! Fixed. 

    
    - steady state, sometimes appears as steady-state, it would be nice to unify
    these terms.
    
[XZ] Thanks for pointing this out. We've completed one pass of purging to stick
to "steady state" throughout. The only two excepts are out of grammatical 
considerations ("steady-state behavior" as in "five-year-old boy"). 

    Some Questions/suggestions:
    
    1- In Figure 1, would it be correct to add an input as a self-loop arrow
    indicating "dummy video frames"? (As previously was an input "raw video frames"
    e.g. in version 4 )
    
[XZ] We actually chose to take off the input of “raw video frames“ from version -04 since
the synthetic video source does not need to perform any encoding process. Instead, it just
needs to keep track of frame size and intervals, and generate dummy encoded video frames
as output.  To clarify, the output label has been revised to “dummy encoded video frames”


    2- Would it be correct to add in:
    
    2.1- Page 14: "...ongoing, steady-state behavior of a video..." => "...ongoing,
    steady-state behavior (fluctuation around a constant target rate) of a
    video..."? [1]

[XZ] Thanks a lot for the suggestion. This sentence is now revised as follows: 

   In general, the trace-driven model is more realistic for mimicking
   the ongoing, steady-state behavior of a video traffic source with
   fluctuations around a constant target rate.  In contrast, the
   statistical model is more versatile for simulating the behavior of a
   video stream in transient, such as when encountering sudden rate
   changes.
    
    2.2 - Page 8: "...is considered to be in a transient state...." => "...is
    considered to be in a transient state (reaction to abrupt changes in target
    rate)...."? [1]
    
    [1] Based in
    https://datatracker.ietf.org/meeting/101/materials/slides-101-rmcat-rmcat-video-traffic-model-00
    - Slide 2

[XZ]  This has been revised accordingly as well, as follows: 

  The output bitrate R_o during the period [t, t+tau_v] is considered
   to be in a transient state when reacting to abrupt changes in target
   rate.
    
    3- Would it be correct to add in the Figure 3 something like?:
    
    - R_v > R_v_previous for transient state
    
    - R_v <= R_v_previous for steady state
  
[XZ]  Thanks for this suggestion. However, adding the R_v > R_v_previous
in the figure would not accurately reflect the criteria we’ve observed from
the  trace data we’ve collected (see reference [IETF-Interim]).  In fact, I double
checked on our trace data, and noticed that transient behavior is observed 
in the presence of rate change in both directions (e.g., +/-20%).  I have revised
the text accordingly:

As shown in Figure 3, the video traffic model operates in a transient
   state if the requested target rate R_v is substantially different
   from the previous target, or else it operates in steady state.
...
One example criterion for determining whether the
   traffic model should operate in a transient state is whether the rate
   change exceeds 10% of the previous target rate. ...


  
    Thanks for this document,
    
    Ines.