Re: [Gen-art] [rmcat] Genart last call review of draft-ietf-rmcat-nada-11

"Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com> Sun, 25 August 2019 04:33 UTC

Return-Path: <xiaoqzhu@cisco.com>
X-Original-To: gen-art@ietfa.amsl.com
Delivered-To: gen-art@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4AC551200D8; Sat, 24 Aug 2019 21:33:40 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.5
X-Spam-Level:
X-Spam-Status: No, score=-14.5 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com header.b=H3imHHco; dkim=pass (1024-bit key) header.d=cisco.onmicrosoft.com header.b=FndaBIvI
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id MYDV01md5P9O; Sat, 24 Aug 2019 21:33:38 -0700 (PDT)
Received: from rcdn-iport-2.cisco.com (rcdn-iport-2.cisco.com [173.37.86.73]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id CCDA5120025; Sat, 24 Aug 2019 21:33:37 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=8524; q=dns/txt; s=iport; t=1566707617; x=1567917217; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-id:content-transfer-encoding: mime-version; bh=W8CfO0chn7w4JC3oW7Jl4o1aHiyPwoAF9l1EFxdUXbo=; b=H3imHHcotXmP93B6kyXfDRZLwbuDzykCGn2BAS9uqiDkZtc0CuMUXy5a CLrwyGHziql6rhTghxyoUHw6ikbXCSYmSSS8VwkKRZeWMi6LYdDKGtlGj Z9+xBUwosOWaUIRVLURjlP3EtkJJsAbw/KAoBSXv751hAgIjkruaF3MKA c=;
IronPort-PHdr: 9a23:1TawihUCDLKcnyua/jd90g4OOYXV8LGuZFwc94YnhrRSc6+q45XlOgnF6O5wiEPSA9yJ8OpK3uzRta2oGXcN55qMqjgjSNRNTFdE7KdehAk8GIiAAEz/IuTtankqHc1FTU1l4lmwMFNeH4D1YFiB6nA=
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0D4AABPD2Jd/4wNJK1kGgEBAQEBAgEBAQEHAgEBAQGBZ4FFUANtViAECyqEIYNHA4ptgjcll2iBQoEQA1QJAQEBDAEBJwYCAQGEPwIXglAjOBMCCgEBBAEBAQIBBgRthS0MhUsBAQEBAhIREQwBATcBDwIBCBQEAgIZDQICAjAVEAIEAQ0FGweDAAGBagMdAQ6eXgKBOIhhc4EygnsBAQWBMgEDAgKDRRiCFgMGgQwoi3IYgUA/gREnDBOBTn4+gjwlAQEBAoEmT4J0gliMcYIsm2pnCQKCHoZqiWODdhuCMocwjm2NaIE2hjWQOwIEAgQFAg4BAQWBZyGBWHAVOyoBgkGCQoNyhRSFP3IBEIEYjhcBAQ
X-IronPort-AV: E=Sophos;i="5.64,428,1559520000"; d="scan'208";a="623701763"
Received: from alln-core-7.cisco.com ([173.36.13.140]) by rcdn-iport-2.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 25 Aug 2019 04:33:36 +0000
Received: from XCH-RCD-016.cisco.com (xch-rcd-016.cisco.com [173.37.102.26]) by alln-core-7.cisco.com (8.15.2/8.15.2) with ESMTPS id x7P4Xapw020353 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Sun, 25 Aug 2019 04:33:36 GMT
Received: from xhs-aln-001.cisco.com (173.37.135.118) by XCH-RCD-016.cisco.com (173.37.102.26) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Sat, 24 Aug 2019 23:33:35 -0500
Received: from xhs-aln-003.cisco.com (173.37.135.120) by xhs-aln-001.cisco.com (173.37.135.118) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Sat, 24 Aug 2019 23:33:35 -0500
Received: from NAM03-BY2-obe.outbound.protection.outlook.com (173.37.151.57) by xhs-aln-003.cisco.com (173.37.135.120) with Microsoft SMTP Server (TLS) id 15.0.1473.3 via Frontend Transport; Sat, 24 Aug 2019 23:33:35 -0500
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=SNmMaN9unmJu9VI4C4tQd+TyelxB+zNRtwRlxNyJqR91uDZOiGT2z0qBNCw9Ehbq2lvPHkNamxwpkcT3PCI1f8WgHQisrXBcOgzlX10QsM0+gK+9Clj5tisJ+4O9OvcEwGFE11kuD7pmJMR60UgmkSDspPhiaBaaPNTmg2iXuskdUVS/NgAhwBc73yx8tBZLZzToBlc6ZWNBKfkeDn9o53N0z/incGt4gXp/4Fvvq0SSfwEwDvm+CGYSbQrLIFbqgznmdLINF2u8Cb96tUwk8bgHKWavgDNPGcCI2M8rDN3XbGYfWc+7uf9b/O+MOaX/KveEDSUfkS0FPZAur0Sorg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=W8CfO0chn7w4JC3oW7Jl4o1aHiyPwoAF9l1EFxdUXbo=; b=IKG0AVsh1Ww5hvfotLL+4z+TQlYX9DGKlBo7MRQqErP/FOdHdH1eXQKshNmqp2sVbKl/qweigdhjeljVIwMNMbPbfqiy0F1qhzkX7S5TCJL717jwoY4Rj/EREbe1PTzHzPRwt/NylZI18imwkMDcfO+lnhvKUtvhSF+KmTV0FhonpNpjzFX0NbkTxy+dYWhUxUcOiwG21i/tY1MZDHDoehCvm2DLL4YduuWee9pqGSG368OCTFrVgdW4r7q5Oezd7tq1O0GJlt+YaOHoHzJvX+HAIhUkhRhbCp12p5aTBEi3tPlo0NQuPEdwMHVRJ94xsTcEZ6uzblttqHsyhA7RGQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cisco.com; dmarc=pass action=none header.from=cisco.com; dkim=pass header.d=cisco.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector2-cisco-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=W8CfO0chn7w4JC3oW7Jl4o1aHiyPwoAF9l1EFxdUXbo=; b=FndaBIvIB+A55xWm1oyuwNX18A4a58uWMmX3oJ58r6kjVFDqmpj9BV5ZcZCZMRFnl3uu5WWCP6ikfZVK4Xrb/3pTPQ+bSXfC9NGTv78EMxVlLf1yw0fLB0FnVfQcNfxZ4cQQ7KZetCEE3QR9vzgtgLKcMKRgWIn27WHbdVThgNU=
Received: from CY4PR11MB1559.namprd11.prod.outlook.com (10.172.72.140) by CY4PR11MB1896.namprd11.prod.outlook.com (10.175.59.7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2178.18; Sun, 25 Aug 2019 04:33:34 +0000
Received: from CY4PR11MB1559.namprd11.prod.outlook.com ([fe80::53:33f3:ea63:7f72]) by CY4PR11MB1559.namprd11.prod.outlook.com ([fe80::53:33f3:ea63:7f72%3]) with mapi id 15.20.2199.020; Sun, 25 Aug 2019 04:33:34 +0000
From: "Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com>
To: "Joel M. Halpern" <jmh@joelhalpern.com>, "gen-art@ietf.org" <gen-art@ietf.org>
CC: "rmcat@ietf.org" <rmcat@ietf.org>, "draft-ietf-rmcat-nada.all@ietf.org" <draft-ietf-rmcat-nada.all@ietf.org>, "ietf@ietf.org" <ietf@ietf.org>
Thread-Topic: [rmcat] Genart last call review of draft-ietf-rmcat-nada-11
Thread-Index: AQHVS9uLwUJsS2RPN0qBU5Mw1V4jiKb4KBaAgAEYfQCAEdBlgA==
Date: Sun, 25 Aug 2019 04:33:33 +0000
Message-ID: <8253AE48-7084-4178-A1B1-94738215463F@cisco.com>
References: <156504341913.1947.3933210567772943756@ietfa.amsl.com> <34AB0964-230B-40F2-A865-08F568E72A85@cisco.com> <375e0240-1983-53e6-8e6f-d4d71c6e13c3@joelhalpern.com>
In-Reply-To: <375e0240-1983-53e6-8e6f-d4d71c6e13c3@joelhalpern.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/10.1c.0.190812
authentication-results: spf=none (sender IP is ) smtp.mailfrom=xiaoqzhu@cisco.com;
x-originating-ip: [2001:420:c0cc:1007::f]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 911aa047-a5d1-4230-5f06-08d7291563be
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600166)(711020)(4605104)(1401327)(2017052603328)(7193020); SRVR:CY4PR11MB1896;
x-ms-traffictypediagnostic: CY4PR11MB1896:
x-ms-exchange-purlcount: 5
x-microsoft-antispam-prvs: <CY4PR11MB18961F9F6F804EC4548647DCC9A60@CY4PR11MB1896.namprd11.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-forefront-prvs: 01401330D1
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(39860400002)(136003)(346002)(376002)(366004)(396003)(189003)(199004)(76176011)(36756003)(66946007)(6306002)(66446008)(64756008)(66556008)(66476007)(4326008)(478600001)(33656002)(6116002)(91956017)(86362001)(76116006)(229853002)(6512007)(53936002)(66574012)(5660300002)(99286004)(54906003)(6436002)(11346002)(305945005)(7736002)(316002)(446003)(53546011)(2616005)(6506007)(58126008)(6486002)(110136005)(966005)(6246003)(8936002)(2906002)(486006)(186003)(256004)(14444005)(81156014)(25786009)(81166006)(8676002)(476003)(14454004)(2501003)(71200400001)(71190400001)(46003)(102836004); DIR:OUT; SFP:1101; SCL:1; SRVR:CY4PR11MB1896; H:CY4PR11MB1559.namprd11.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: cisco.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: aqW4fp4lnZs985QyOvgE5EDeAYxCo7N1nCHhduGNrWjN+cyk+oiQgfyTvLc+7Q/bNyX/cqavszZ1kHYKY3IubvK8XTPOJu1cSYyGPn7NTgpvNBkAdaVbR3uoZr1jX41t2mDqrjsWDvAgRD9eJsdY72+onql7icrH1xFodH7Z+n7rI0PwGKKhBtSaNWsH8IONhnd78MBkNM3xTKgsgbiUUA3QMnP4qmiOkkNWaQEQkS9OzxTtSTFI9ab/w/yB7A13OI5VPahdgbz4vf6tnYXKL5oeMcc+nV8tggYWRXyK6GVzXjvKpe536xRiQsyatEA5jU8+m1pQoKZ5JIopH7UZvr+UJB23yqAqzTvo/uQy4y0YN7vGYquIWnBhtb6MbVLV1uQIVvt8ghVlBrQRVXxDvd3kemA8HpDNgIO0d4J7ULk=
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="utf-8"
Content-ID: <5F4A94A3E657D54D88F5614DFAC1F998@namprd11.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 911aa047-a5d1-4230-5f06-08d7291563be
X-MS-Exchange-CrossTenant-originalarrivaltime: 25 Aug 2019 04:33:33.9067 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: tQyp5dELtbTzT7AgsYQlEU3vpQjNEwH2li+/566wHhsXFxZ4o0XD1qEIhEww1RHsXVbprbJD0FojcD+MRknRoA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR11MB1896
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.37.102.26, xch-rcd-016.cisco.com
X-Outbound-Node: alln-core-7.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/gen-art/bGsyI9C0_qXizX2cZUsXrOVBH7o>
Subject: Re: [Gen-art] [rmcat] Genart last call review of draft-ietf-rmcat-nada-11
X-BeenThere: gen-art@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "GEN-ART: General Area Review Team" <gen-art.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/gen-art>, <mailto:gen-art-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/gen-art/>
List-Post: <mailto:gen-art@ietf.org>
List-Help: <mailto:gen-art-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/gen-art>, <mailto:gen-art-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 25 Aug 2019 04:33:40 -0000

Hi Joel, 

Just wanted to update that we've submitted the revised draft (-12) where changes as stated below for addressing your comments. 

https://tools.ietf.org/html/draft-ietf-rmcat-nada-12

Thanks again for reviewing this draft and helping to improve it. 

Best,
Xiaoqing

On 8/13/19, 10:31 AM, "rmcat on behalf of Joel M. Halpern" <rmcat-bounces@ietf.org on behalf of jmh@joelhalpern.com> wrote:

    Thank you.  Those changes will address my concerns very effectively.
    Yours,
    Joel
    
    On 8/13/2019 11:26 AM, Xiaoqing Zhu (xiaoqzhu) wrote:
    > Dear Joel,
    > 
    > Many thanks for your review of this draft.  Please find our responses as below, tagged [Authors].
    > 
    > Best,
    > Xiaoqing (on behalf of all authors)
    > 
    > On 8/5/19, 5:17 PM, "Joel Halpern via Datatracker" <noreply@ietf.org> wrote:
    > 
    >      Reviewer: Joel Halpern
    >      Review result: Almost Ready
    >      
    >      I am the assigned Gen-ART reviewer for this draft. The General Area
    >      Review Team (Gen-ART) reviews all IETF documents being processed
    >      by the IESG for the IETF Chair.  Please treat these comments just
    >      like any other last call comments.
    >      
    >      For more information, please see the FAQ at
    >      
    >      <https://trac.ietf.org/trac/gen/wiki/GenArtfaq>.
    >      
    >      Document: draft-ietf-rmcat-nada-11
    >      Reviewer: Joel Halpern
    >      Review Date: 2019-08-05
    >      IETF LC End Date: 2019-08-12
    >      IESG Telechat date: Not scheduled for a telechat
    >      
    >      Summary: This document is almost ready for publication as an Experimental RFC
    >      
    >      Major issues:
    >         It is unclear reading this RFC how the observation information is to be
    >         communicated from the receiver to the sender.  At first I thought it was to
    >         use the RTP Receiver report.  But there is no description of how to map the
    >         fields to that report.   Then section 5.3 describes requirements for a
    >         reporting mechanism, but does not seem to actually define one.   Thus, I am
    >         left unclear how independent interoperable implementations of this draft can
    >         be created.
    >      
    > [Authors]  Thanks for raising this point. The feedback format is a topic covered
    > by another currently pending draft (https://tools.ietf.org/html/draft-ietf-avtcore-cc-feedback-message-04),
    > which indeed aims at ensuring interoperability of independent implementations of
    > RMCAT congestion control solutions.  Therefore, in this draft we only specified what type
    > of information is needed (e.g., receiving rate) and the unit and bit budget it is expressed
    > in (e.g., in bps in 32 bits) in the feedback from the receiver.  We also pointed out in Sec. 6.4
    > that an alternative way to implement this draft would be to leverage feedback messages
    > that contain per-packet information (e.g., delay and loss info) and to move all the calculations
    > from the receiver to the sender.
    > 
    > [Author] Given the above considerations, we refrained from specifying a specific feedback
    > format. However, we should perhaps add a reference pointing to the cc-feedback-message draft.
    > Will do that in the next revision.
    > 
    >      Minor issues:
    >          The document has 7 front page authors.   The shepherd writeup does not
    >          comment on this. The shepherd writeup seems quite sparse.  II would have
    >          expected some reference to the experimental behavior described in the draft.
    >      
    > [Authors] Thanks for raising the concern about long list of front page authors. We got some
    > additional guidance from the AD and will make some adjustments accordingly.
    > 
    > [Authors] As for comments on the experimental behavior: we have presented in recent IETF meetings
    > on several sets of real-world evaluations of one implementation of NADA.  But, admittedly, the draft
    > is lagging behind in not yet adding pointers to those results. Your suggestion is a great one and we'll add
    > corresponding pointer (see links below) and related discussions in the next version.
    >   
    > * https://datatracker.ietf.org/meeting/103/materials/slides-103-rmcat-nada-implementation-in-mozilla-browser-00
    > * https://datatracker.ietf.org/meeting/105/materials/slides-105-rmcat-nada-update-02.pdf
    > 
    > 
    >          This comment is just to confirm that I am reading the draft correctly.  It
    >          looks like when the observed delay cross the delay boundary, the reporting
    >          system reports using a smaller delay than actually approved (slightly more
    >          than 1/9th of observed delay when delay is 3*QTH).  I presume this is
    >          intentional, and that the various analysis pointed to evaluate the risks of
    >          such false reporting?
    > 
    > [Authors]  Yes, your understanding is correct. The main motivation for this "delay warping"
    > In the presence of persistently high queuing delay *and* presence of loss is to help the flow to
    > sustain a more fair rate when competing against aggressive loss-based flows.  Will follow your
    > advice and add some discussions on the potential risks involved in performing this "delay warping".
    >      
    >          Is it intentional in section 4.3 in the pseudo-code that the rate clipping
    >          (to keep the rate between RMIN and RMAX) is only applied to the gradual
    >          rate change, not to the accelerated rate change?  The later code says that
    >          the clipping is always applied, which is what I would expect.
    >      
    > [Authors]  Thanks to the catch. The clipping is always applied.  Will fix the text accordingly.
    > 
    >      Nits/editorial comments:
    >      
    >      
    > [Authors]  Thanks again for your above comments. Our next round of revision (version -12) will incorporate
    > changes as mentioned in our above response.
    >