Re: [Gen-art] Genart last call review of draft-ietf-rmcat-video-traffic-model-06
Ines Robles <mariainesrobles@googlemail.com> Thu, 21 February 2019 19:46 UTC
Return-Path: <mariainesrobles@googlemail.com>
X-Original-To: gen-art@ietfa.amsl.com
Delivered-To: gen-art@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id C46AA130E6D; Thu, 21 Feb 2019 11:46:29 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.998
X-Spam-Level:
X-Spam-Status: No, score=-1.998 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=googlemail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id bIsdFWVW7GcJ; Thu, 21 Feb 2019 11:46:26 -0800 (PST)
Received: from mail-ed1-x533.google.com (mail-ed1-x533.google.com [IPv6:2a00:1450:4864:20::533]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A7FEC130DBE; Thu, 21 Feb 2019 11:46:26 -0800 (PST)
Received: by mail-ed1-x533.google.com with SMTP id g19so15210883edp.2; Thu, 21 Feb 2019 11:46:26 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=s8buWTRjX1dtkHISddOCyUFjl/L1lgXPM9eH/ttYWwM=; b=UuTLOtx0HgUopwJFZutGNZ0XU2cuhr7BVKbQ5GYgtmU1AIVucbELA6QSU/HfQ4jQpW UCIUE3uhVs3gDvPA95BO34OzUy7zXWK9BbeCnDR9HfixlOTj+vxXQbwwzCAM49u3BBrR 7Ot3nIho4sO+c1g//LKhOSlNtiAYUvRqR8EHug3tNhwlpJHLdqg6vinFn1x/nKMcaf1W yTE3wbY3XDRr1YmS1leRoZd6jQl0rzjKMnB9lCLn0yyLKDn0JA2mJN2IoBlEevT2KTzT z455DhASJHP6Ai/mbafNQLvv4/XPjxqgqvHOGoPA2Wm1HSWvw5zc+PL3BFKFQf1qq+LV pvag==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=s8buWTRjX1dtkHISddOCyUFjl/L1lgXPM9eH/ttYWwM=; b=hZOxDPk7XdG7lmouv+2A57CPVHp6xDu0VaYhIFE3rYMUrxM4GV37nFCmXRthSCwciF D51tmjOQKRGcwVkPMz7Mf8x+JSX/McEvWoFc+J03I8rW25blCnAUHnwjX5LxsLKXOG5c vADfzlSvuG1GU/xz/L9u3COKf/1ZBuLUsvftGBUZ3Pruec3k4AToL73/ZnVJFHmse++X pkENFTQlAcMpy7K8AwSXr9ruRiLrYObm4CXl04bfTzkT/Pxp8B3X8LioSH07EuH9DwRl rVKpvJqarS5BlZz9Xp4plmpwbgzLLpReys8XehiPhxO2+ovDrqN7KCvkMQt2NFhu4ZD0 Sq6g==
X-Gm-Message-State: AHQUAuYHOFer09jhyE0dgf4ubGxkTYuTbmVbtCdsjVcDb9f9IN4jxhax l9f6XY3Kx8RzGI/w8XYMruSe3TyT4Sh0GhS0pu0=
X-Google-Smtp-Source: AHgI3Iaq/7F9ZKNkINYrRLiNxrnclugvS+Xv5GFNO3JYdSKn+2S41mUQTziNMavdciw98rLqvgPwCGrgULkUGNNM5nw=
X-Received: by 2002:a50:b4f1:: with SMTP id x46mr125519edd.289.1550778384669; Thu, 21 Feb 2019 11:46:24 -0800 (PST)
MIME-Version: 1.0
References: <154836059538.29291.9954930741127591863@ietfa.amsl.com> <88D57E57-648C-4E24-A50E-790D9187B650@cisco.com>
In-Reply-To: <88D57E57-648C-4E24-A50E-790D9187B650@cisco.com>
From: Ines Robles <mariainesrobles@googlemail.com>
Date: Thu, 21 Feb 2019 21:46:12 +0200
Message-ID: <CAP+sJUe+UOT6D=h+k-V=jBBT=xcDo2NyFJZdm1U7-RD+NimnWw@mail.gmail.com>
To: "Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com>
Cc: "gen-art@ietf.org" <gen-art@ietf.org>, "rmcat@ietf.org" <rmcat@ietf.org>, "draft-ietf-rmcat-video-traffic-model.all@ietf.org" <draft-ietf-rmcat-video-traffic-model.all@ietf.org>, "ietf@ietf.org" <ietf@ietf.org>
Content-Type: multipart/alternative; boundary="000000000000be617805826cba19"
Archived-At: <https://mailarchive.ietf.org/arch/msg/gen-art/fl60ksdR8_DadyeSgDSncSY0NSw>
Subject: Re: [Gen-art] Genart last call review of draft-ietf-rmcat-video-traffic-model-06
X-BeenThere: gen-art@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "GEN-ART: General Area Review Team" <gen-art.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/gen-art>, <mailto:gen-art-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/gen-art/>
List-Post: <mailto:gen-art@ietf.org>
List-Help: <mailto:gen-art-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/gen-art>, <mailto:gen-art-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 21 Feb 2019 19:46:30 -0000
Hi Xiaoqing, Thanks a lot for the clarifications, I agree with your comments. Best Regards, Ines. On Thu, Feb 21, 2019 at 8:46 PM Xiaoqing Zhu (xiaoqzhu) <xiaoqzhu@cisco.com> wrote: > Hi, Ines, > > Thanks a lot for your thorough review of this draft. We've updated to > version -07 to > incorporate your review comments. More detailed response inline below > (tagged [XZ]). > > Best, > Xiaoqing (on behalf of all authors). > > On 1/24/19, 2:10 PM, "Ines Robles" <mariainesrobles@googlemail.com> > wrote: > > Reviewer: Ines Robles > Review result: Ready > > I am the assigned Gen-ART reviewer for this draft. The General Area > Review Team (Gen-ART) reviews all IETF documents being processed > by the IESG for the IETF Chair. Please treat these comments just > like any other last call comments. > > For more information, please see the FAQ at > > <https://trac.ietf.org/trac/gen/wiki/GenArtfaq>. > > Document: draft-ietf-rmcat-video-traffic-model-06 > Reviewer: Ines Robles > Review Date: 2019-01-24 > IETF LC End Date: 2019-01-28 > IESG Telechat date: Not scheduled for a telechat > > Summary: > > I believe the draft is technically good. This document is well written > and > clear to understand. > > This document describes two reference video traffic models for > evaluating RTP > congestion control algorithms. The first model statistically > characterizes the > behavior of a live video encoder in response to changing requests on > target > video rate. The second model is trace-driven, and emulates the output > of > actual encoded video frame sizes from a high-resolution test > sequence. The > document describes also how both approaches can be combined into a > hybrid model. > > Additionally, The stand-alone traffic source module is available as an > open > source implementation, which I think it is very nice. :) > > I did not find issues. I have some minor questions/suggestions. > > Major issues: Not found > > Minor issues: Not found > > Nits/editorial comments: > > - Page 14: correponding -> corresponding > > [XZ] Thanks for the catch! Fixed. > > > - steady state, sometimes appears as steady-state, it would be nice to > unify > these terms. > > [XZ] Thanks for pointing this out. We've completed one pass of purging to > stick > to "steady state" throughout. The only two excepts are out of grammatical > considerations ("steady-state behavior" as in "five-year-old boy"). > > Some Questions/suggestions: > > 1- In Figure 1, would it be correct to add an input as a self-loop > arrow > indicating "dummy video frames"? (As previously was an input "raw > video frames" > e.g. in version 4 ) > > [XZ] We actually chose to take off the input of “raw video frames“ from > version -04 since > the synthetic video source does not need to perform any encoding process. > Instead, it just > needs to keep track of frame size and intervals, and generate dummy > encoded video frames > as output. To clarify, the output label has been revised to “dummy > encoded video frames” > > > 2- Would it be correct to add in: > > 2.1- Page 14: "...ongoing, steady-state behavior of a video..." => > "...ongoing, > steady-state behavior (fluctuation around a constant target rate) of a > video..."? [1] > > [XZ] Thanks a lot for the suggestion. This sentence is now revised as > follows: > > In general, the trace-driven model is more realistic for mimicking > the ongoing, steady-state behavior of a video traffic source with > fluctuations around a constant target rate. In contrast, the > statistical model is more versatile for simulating the behavior of a > video stream in transient, such as when encountering sudden rate > changes. > > 2.2 - Page 8: "...is considered to be in a transient state...." => > "...is > considered to be in a transient state (reaction to abrupt changes in > target > rate)...."? [1] > > [1] Based in > > https://datatracker.ietf.org/meeting/101/materials/slides-101-rmcat-rmcat-video-traffic-model-00 > - Slide 2 > > [XZ] This has been revised accordingly as well, as follows: > > The output bitrate R_o during the period [t, t+tau_v] is considered > to be in a transient state when reacting to abrupt changes in target > rate. > > 3- Would it be correct to add in the Figure 3 something like?: > > - R_v > R_v_previous for transient state > > - R_v <= R_v_previous for steady state > > [XZ] Thanks for this suggestion. However, adding the R_v > R_v_previous > in the figure would not accurately reflect the criteria we’ve observed from > the trace data we’ve collected (see reference [IETF-Interim]). In fact, > I double > checked on our trace data, and noticed that transient behavior is observed > in the presence of rate change in both directions (e.g., +/-20%). I have > revised > the text accordingly: > > As shown in Figure 3, the video traffic model operates in a transient > state if the requested target rate R_v is substantially different > from the previous target, or else it operates in steady state. > ... > One example criterion for determining whether the > traffic model should operate in a transient state is whether the rate > change exceeds 10% of the previous target rate. ... > > > > Thanks for this document, > > Ines. > > > >
- [Gen-art] Genart last call review of draft-ietf-r… Ines Robles
- Re: [Gen-art] Genart last call review of draft-ie… Alissa Cooper
- Re: [Gen-art] Genart last call review of draft-ie… Xiaoqing Zhu (xiaoqzhu)
- Re: [Gen-art] Genart last call review of draft-ie… Ines Robles