Re: [Tsv-art] [manet] Tsvart early review of draft-ietf-manet-dlep-credit-flow-control-09

Eric Kinzie <ekinzie@labn.net> Fri, 23 February 2024 21:06 UTC

Return-Path: <ekinzie@labn.net>
X-Original-To: tsv-art@ietfa.amsl.com
Delivered-To: tsv-art@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D318EC14F68B; Fri, 23 Feb 2024 13:06:28 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.911
X-Spam-Level:
X-Spam-Status: No, score=-6.911 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=labn.onmicrosoft.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YdMbi4L70Ysz; Fri, 23 Feb 2024 13:06:28 -0800 (PST)
Received: from NAM02-SN1-obe.outbound.protection.outlook.com (mail-sn1nam02on2096.outbound.protection.outlook.com [40.107.96.96]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id F1225C14F685; Fri, 23 Feb 2024 13:06:27 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Dz4OBDVdypfuKXqT+B3sGfSR+jAD/uozgV6OYS4JNQbso5QqWzYaLk/jTy62jMn2XYqoUXtSBYtMAnDoyocwePXfdK86AQGqIeRWneMSztpDsQ6IPgbLqiHEWywYlzkZzLfyl6hRHJTPuWp9pKSEYyCst4+7BOZfRYrBgZ0F34db6ULsQW9XduIJ9BwMDGfxxHU/rnRo/R9+Z2vL1FiRc2Zs1Nr/WAvCcdTPgwwu/De/Bpg/F+AlRDV/U4le/tIwg1wnjiQB298fDHKlciTu+QO23rlsfMH/Ki2N7ryeiLw6q6Eleseft9qWFAZOCeiD0f5m9+5vpMfKbQonDtRjYw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=cF/unRoqFRP9JGyYI3eNEguC5VDP1hRvIxgdRH/G2S0=; b=QNpQaGfs+i3/EwtQOBOqTQMCposYcF9COCIfAVm7iQda4gPeFZ16BcN380JqdI+GrKgori56XNURs6p8NcsSoxvPIdobZQKkI+DQvb9RQ3JeG1hqHE0kqn94jXzLffqTZxtXf9u7lGNIcvfCQ99o/ktluBAViCpE35l+Qg8jV+ynytj2LJTvBsja2ftyhax3n6XCQuizEP6CT4kqSLegZYsI2ZMlECp4/eJZCfdN3Mh+w9PkZ9WrldwfIL+tuKT5pG7s6n6rem6VTWyg/XgMSSEsK6kZn+u7pq6JEgSDma2o/6/ei+H2j45s4GOkXc/mxJgRvsR5VZpeGU9d4YRKdw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=labn.net; dmarc=pass action=none header.from=labn.net; dkim=pass header.d=labn.net; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=labn.onmicrosoft.com; s=selector2-labn-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=cF/unRoqFRP9JGyYI3eNEguC5VDP1hRvIxgdRH/G2S0=; b=TsbWHZNY2BdAe4YrBrDs5lRWj69s45x6PM85bTLS2X0P/0xbp2K2HQYdr05VCx/SGdiQL4z3jd7b/HsaMCOr48GL8u8auIINLq+vaTdpuyftdql11MinlCt9StcuonEYcil20OXmpuY826r5rtfGySqQznnBufi8d7zN8dqxwM4=
Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=labn.net;
Received: from PH7PR14MB5619.namprd14.prod.outlook.com (2603:10b6:510:1f4::21) by DM4PR14MB6428.namprd14.prod.outlook.com (2603:10b6:8:10c::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7316.22; Fri, 23 Feb 2024 21:06:25 +0000
Received: from PH7PR14MB5619.namprd14.prod.outlook.com ([fe80::68c0:d039:4fbb:88ad]) by PH7PR14MB5619.namprd14.prod.outlook.com ([fe80::68c0:d039:4fbb:88ad%4]) with mapi id 15.20.7292.036; Fri, 23 Feb 2024 21:06:24 +0000
Date: Fri, 23 Feb 2024 16:06:18 -0500
From: Eric Kinzie <ekinzie@labn.net>
To: "Black, David" <David.Black@dell.com>
Cc: Henning Rogge <hrogge@gmail.com>, "Black, David" <David.Black=40dell.com@dmarc.ietf.org>, Don Fedyk <dfedyk@labn.net>, "Velt, R. (Ronald) in 't" <Ronald.intVelt=40tno.nl@dmarc.ietf.org>, Lou Berger <lberger@labn.net>, "tsv-art@ietf.org" <tsv-art@ietf.org>, MANET IETF <manet@ietf.org>
Message-ID: <ZdkIyvWnihSMS7r0@DESKTOP-P76AGAJ>
References: <5d1bf77b-6391-65b2-8ca2-57d6736b0439@labn.net> <18399f51-73d3-25e6-c8e7-1acb7d30aace@labn.net> <MN2PR19MB4045DE0B35B5349A686465F183189@MN2PR19MB4045.namprd19.prod.outlook.com> <a13273b2-6cbe-00ff-25bd-df6c6c623dde@labn.net> <MN2PR19MB4045F38BCD91EB884D142BB7839A9@MN2PR19MB4045.namprd19.prod.outlook.com> <f255fd472a714dea95161209cd55dbb0@tno.nl> <PH7PR14MB53683A3705671E1D5DE87041BB412@PH7PR14MB5368.namprd14.prod.outlook.com> <MN2PR19MB4045C7EB432E61B258212FAF83452@MN2PR19MB4045.namprd19.prod.outlook.com> <CAGnRvuojopZsM0MsXuKQ0fEi+ntbAExvKtCFWuCjZOagLLGRDA@mail.gmail.com> <MN2PR19MB4045B0E04EC921E01B014E4C83452@MN2PR19MB4045.namprd19.prod.outlook.com>
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
In-Reply-To: <MN2PR19MB4045B0E04EC921E01B014E4C83452@MN2PR19MB4045.namprd19.prod.outlook.com>
X-ClientProxiedBy: CH0PR03CA0071.namprd03.prod.outlook.com (2603:10b6:610:cc::16) To PH7PR14MB5619.namprd14.prod.outlook.com (2603:10b6:510:1f4::21)
MIME-Version: 1.0
X-MS-PublicTrafficType: Email
X-MS-TrafficTypeDiagnostic: PH7PR14MB5619:EE_|DM4PR14MB6428:EE_
X-MS-Office365-Filtering-Correlation-Id: 762af682-1a5d-4de3-7c11-08dc34b34aaa
X-MS-Exchange-SenderADCheck: 1
X-MS-Exchange-AntiSpam-Relay: 0
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: iV8FxkhTKlVkmYCZ93pBQ8qOhMdIxbl+ufuPySrIfylJ1/s/HBf9jBTmsZvkB9NPjGdQzt/fWxpCTFKknmwecPhL7LFVCFxPN2tXIM7Tsefte12zMWDBunEPH84dQqvLiXwG6/b4PqUgJcMSPpF8oHbJ9ZQ/KT/M8Iv7vZE/ECT1wOMn+ZLiRZDJp+a98UrDSRlR5u0F4Vr59oj4Exz5v6pDhpBAdfhdvgTeox9ZlhergLPCfwczjxtjrZwrEzvlpQ4WeYSaMtMrEUQ3USWPfk/h0YuGSvW0XkTfN1DaldwmwaHjtzS0rO8E9SWg9eSjI2kMISqA+JCcilaeXAFd8aOoo/g4/v+JVaxhsbMKH+8dX6k/hZLOO3zGVOFdsRznW1bZhNq+ZRJfqwcYNbKanwv8uqw0p8AKLMZ2GvSBl5z08u9hkcezAHZddKyIWfqao1rIDPOXCHpUENf0XWP23PAgYdMjpE/V8wPgTYvoeoPYZbnbTu9ov/3q4qmg5o7WpySW4umke5D4aNJ2icGm+smjrnMOk5KaU2p+GIux7d0=
X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:PH7PR14MB5619.namprd14.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031); DIR:OUT; SFP:1102;
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: ozMIvndd6UtGryCtQrJbO74NkX1Md8rNGbKrilMP/NiCRYEfj1OeX9JOxqWO4/C7Ft7g55h1RfiMgENT/YyoRtCaKUrCtQSiHXpUg3hCN1Tpz8DQI1rL6d/3isplUmXVv59mTnLBW9V8dzWjZpe/u77WZdzGMmDM5tPrrOGvrPXgMLJwgMuEstEEV5khvKE5XdGhTOv/xcIjWrczXCeVg8wHKW0BpoFKgLd+XEyqC2Y9if/V4ftR75OtSSmz914WxdZIii1L/uagSAeHwUDwQ5OFOYiLkCYyrjYWmMUZDSXf12TKLjjSm0o6mPohDcNu61CkP23TiWtzlVPbEAdX2TSCkLGPWPhx4eQogLojF90ANBu3MBuRhV9AOST5axC0FQUhmu8Jt80qnWmwoZvNcuVFV8/2np6FHx75CAUMSis/K+8VoADINcMIsX6WGjF0d9XD6f/SWxg3+oKLRcVn7gggvzBp9Jh/JAyktoGjZJXyyexaMpf7tZ7IRJMdj+8XIdu9WoJZihckOidMSRDVO6yvq0Lm/v+6OacD6kW8Ady/4bjuyb6Z8dD3GUUBFMyb0iYhLz8/WSH9OoVQqLydSxmtd5jpnDgCtSvcm1sLYL1K4gIde8HO2v8hNNJJ75eZ9TqiOfC1Z0KlsWSEecHSkXrQCAlnA8z+GqDjLcAWPrywlgi5QCcutXAtATHrViyfeeeltyDYHX1qPUScJVEvjLvrGjeDGQx8CD/pcsFoK/A9zIibTBVSlMwdjlpEHRadISNp46MxU9dH7g17t/oiQVHwAs4HIeuhoFq7Lk10/EXBELSd2f0WvxiBgwUt5BS+BQ8jvvf6PXADzb7ODRE77Y+LjYe0Zy/3T7WaOhjFEVPrBfbIa2jcvhK4rz4bMOaOcA6oGatgn7PIPO39pKHu1HmnNiJce2o59pD+mfTPf+DIKsTQ4xioUYeHmgtfMJdqncH7swTydR1gPwo3P5P7pUZ6temACfIJMXuVYdtDFumRNm45Phvi1JrshHaiHhCGp34C+HLgFLFhd1t8hpcJHvS5ov0edScDWfL2cEhtFXLNzVVoObbu40lGdpLxybyT5rrS8i4TcQJslpxClI6RsMh+gfnX95oWizQM446CTb3NTn3m7Gxk06uO9rJCE1v0A07ONpgt4zr70ctGJV+ikQBVkmnuI0m5xaOUigcXLPcpTFClqr6B5xp1RA9nPwpP64EWPFUbbyGPYWJVxPdZfdwF83pk5XYLNJYF4kSVgl2fMY5TTB5E89U3KHHkDeEEtDZRemEdQvcq/SqwF4rYU4BfPEda2o0VQKjc8KZkghxbVKv36YXIU/RiJy5QL/sq9GeBQ+gBP4u22lRt5wMreKTcUtrxFPyDEyqLyvYV6+kXd2ESVCzFNovbK771arAARv9aKiMFjV0jVMxzP/PRveigE5fFveKlNjag9F7mccFEeMfIUWVsc/aHyLNcv2CJClbDtxJOdio01w6YApQzQW7ZM/eXM8v51NCxUGDeyP5Te0Ff2oGhuKy9jPVOme1Voz6ZdGyNZsEaH8NOzKyfw4D0sgtuvucUAGgPUK5dDas7mGllVJ0UsXyJVgGvzjph
X-OriginatorOrg: labn.net
X-MS-Exchange-CrossTenant-Network-Message-Id: 762af682-1a5d-4de3-7c11-08dc34b34aaa
X-MS-Exchange-CrossTenant-AuthSource: PH7PR14MB5619.namprd14.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Feb 2024 21:06:24.3036 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: eb60ac54-2184-4344-9b60-40c8b2b72561
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: m6JYCdMf2naTL86ngJXahOC74jGQkiBLHMiDnJQ1tUPma70L/2ZSFwvuYGgoNqCktOA//sgUxfjj/NDLo8zaWQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR14MB6428
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsv-art/qADaSDy2uj8FlRx6XO7OC-6Nqpk>
Subject: Re: [Tsv-art] [manet] Tsvart early review of draft-ietf-manet-dlep-credit-flow-control-09
X-BeenThere: tsv-art@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Transport Area Review Team <tsv-art.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsv-art>, <mailto:tsv-art-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsv-art/>
List-Post: <mailto:tsv-art@ietf.org>
List-Help: <mailto:tsv-art-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsv-art>, <mailto:tsv-art-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 23 Feb 2024 21:06:28 -0000

I hope you don't mind me jumping into the middle of this.  Lou Berger
pointed out this draft to me.  I have one comment about this, below.

On Wed Feb 07 23:22:39 +0000 2024, Black, David wrote:
> > The feature here is that the radio can be "sure" that the router has
> > done something stupid so it's easy to decide "just drop it and maybe
> > log a local error".
> 
> I'm not thrilled about taking a bad situation and making it worse -  this is not quite attempting to make a "right" out of "two wrongs" but it is still not good.
> 
> In looking back on this, I may not have correctly understood how Credit Window Initialize works.   Going back to the problem scenario described in my review:
> 
> >> E.g., suppose we
> >>  have a very slow modem with a 1kbyte queue and there could be 512 bytes in flight
> >>  between router and modem.  If the Credit Window Status arrives with 512 bytes in
> >>  flight behind it, and the modem immediately does a Credit Window Initialization to 1k,
> >>  the router can then send another 1k for a total of 1.5k which overruns the 1k modem
> >>  queue by 50% (oops).
> 
> This example assumes that Credit Window Initialization sets the Credit Window Max Size to 1k and applies 1k in credits.  That's not a good assumption - those are separate values in Credit Window Initialize that don't have to be the same - if only 512 bytes of credits are applied because the Max Window Size is only increasing by 512 bytes, then the 1k modem queue is not overrun.  That would be much better - it does require that "applied" mean "added" in the following text in section 2.3.1:
> 
> Credit Value:
>     A 64-bit unsigned integer representing the credits, in octets, to be applied to the Credit Window. This value includes MAC headers as seen on the link between the modem and router. 
> 
> Is that change (applied -> added) reasonable?
> 
> In the reverse direction, there's "no free lunch" - if the Window size has to be dramatically decreased (e.g., radio conditions suddenly went seriously downhill), the number of outstanding credits has to be decreased, and scenarios are possible in which there's no choice but to drop traffic that was sent using credits that (in effect) no longer exist.  The suggestion for section 2.3.4 is a starting point to address this:
> 
> > I would suggest adding a sentence to the last paragraph of section 2.3.4., Credit Window Status, to clarify this re-synchronization process,
> > e.g., "The modem MAY, at its discretion, after sending the Session Update Message with one or more Credit Window Initialization Data Items,
> > discard any further packets matching the indicated FIDs until it receives a Session Update Response Message from the router." Thoughts?
> 
> Perhaps: "The modem MAY, at its discretion, after sending the Session Update Message with one or more Credit Window Initialization Data Items that decrease the Credit Window Max Size, discard packets that
> - match the indicated FIDs, cause outstanding traffic for that FID at the modem to exceed the corresponding new Credit Window Max Size, and arrive before the modem receives a corresponding Session Update Response Message from the router.
> 
> In the last bullet, the change from "until" to "arrive before" is subtle - once that message arrives, the router will be operating with the correct credit window parameters, so it's better to drop traffic that arrived earlier (when the router may not have been operating with the correct window parameters) even if that traffic is queued in the modem and is not dropped until after that message arrives.

I think it should be possible to have a "graceful" reduction in the
Credit Window with somthing along the lines of:

"The modem MAY, at its discretion, after sending the Session Update
Message with one or more Credit Window Initialization Data Items that
decrease the Credit Window Max Size, continue processing received packets
that match the indicated FIDs with an unmodified Credit Window Max Size
that arrive before the modem receives the corresponding Session Update
Response Message.  However, during this time no additional credits for
those FIDs are issued.  After the router's Session Update Response Message
is received, the modem waits for each affected window to drain until it
reaches the new Credit Window Max Size.  At this point the modem resumes
issuing credits for that FID, limited by the new Credit Window Max Size."

Misbehaving routers that send packets in the absence of credits will
still result in those packets being dropped.  But, otherwise, we avoid
dropping packets at the receiver simply as a side effect of the change.

Eric