Re: [ippm] [tsvwg] [iccrg] New Internet Draft: Congestion Signaling (CSIG)

Vidhi Goel <vidhi_goel@apple.com> Tue, 12 September 2023 23:59 UTC

Return-Path: <vidhi_goel@apple.com>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D4EA9C15C522 for <ippm@ietfa.amsl.com>; Tue, 12 Sep 2023 16:59:06 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.107
X-Spam-Level:
X-Spam-Status: No, score=-2.107 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=apple.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id bbmMVmVQBF1v for <ippm@ietfa.amsl.com>; Tue, 12 Sep 2023 16:59:06 -0700 (PDT)
Received: from ma-mailsvcp-mx-lapp03.apple.com (ma-mailsvcp-mx-lapp03.apple.com [17.32.222.24]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 00D0DC13AE3C for <ippm@ietf.org>; Tue, 12 Sep 2023 16:59:05 -0700 (PDT)
Received: from rn-mailsvcp-mta-lapp03.rno.apple.com (rn-mailsvcp-mta-lapp03.rno.apple.com [10.225.203.151]) by ma-mailsvcp-mx-lapp03.apple.com (Oracle Communications Messaging Server 8.1.0.23.20230328 64bit (built Mar 28 2023)) with ESMTPS id <0S0W00N7WAIC5C30@ma-mailsvcp-mx-lapp03.apple.com> for ippm@ietf.org; Tue, 12 Sep 2023 15:59:05 -0700 (PDT)
X-Proofpoint-ORIG-GUID: gB1B8DBLdJ3XYwDM6b-vPGvUMHvuqtjT
X-Proofpoint-GUID: gB1B8DBLdJ3XYwDM6b-vPGvUMHvuqtjT
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.601, 18.0.957 definitions=2023-09-12_22:2023-09-05, 2023-09-12 signatures=0
X-Proofpoint-Spam-Details: rule=interactive_user_notspam policy=interactive_user score=0 mlxlogscore=999 bulkscore=0 phishscore=0 adultscore=0 suspectscore=0 spamscore=0 malwarescore=0 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2308100000 definitions=main-2309120195
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=apple.com; h=from : message-id : content-type : mime-version : subject : date : in-reply-to : cc : to : references; s=20180706; bh=BZn7rWqgzWhrUaH/4cEdhv2aR2y0X8JVrJRfq87W+2Q=; b=XofNKTHSzeavYG22J3eMjF5yg9WDKNNXCqIwprkuvbA9JiIntDPuKAGuo8aIQj9Jrj1R AcPdW7qBAHROmzd0dw+abs7jG2FYkG8gy+Wcg+8yYOAFWnH1WcC/aoewvunJSf17C6tC fD5zUoG4zHq4j/Lj57BQSgoxO2Us9mMagJDUTPALTgKBX6QgrDyyO1bhpzzKW3sFHa0O adcdJTnI4etCBfqJILKOR8lQnexaka/4pUMGKiTmVLI37CK83NrRT4qVg6E5U7i6qnWh ULsZKiQuyFDeY/IAvlX4udSjCe48F2LP3Uf94dWSKAH+acRlYyDNnwE9vpOKqAxhbQup GA==
Received: from rn-mailsvcp-mmp-lapp04.rno.apple.com (rn-mailsvcp-mmp-lapp04.rno.apple.com [17.179.253.17]) by rn-mailsvcp-mta-lapp03.rno.apple.com (Oracle Communications Messaging Server 8.1.0.23.20230328 64bit (built Mar 28 2023)) with ESMTPS id <0S0W00ULRAIDEUJ0@rn-mailsvcp-mta-lapp03.rno.apple.com>; Tue, 12 Sep 2023 15:59:02 -0700 (PDT)
Received: from process_milters-daemon.rn-mailsvcp-mmp-lapp04.rno.apple.com by rn-mailsvcp-mmp-lapp04.rno.apple.com (Oracle Communications Messaging Server 8.1.0.23.20230328 64bit (built Mar 28 2023)) id <0S0W00400AFX5S00@rn-mailsvcp-mmp-lapp04.rno.apple.com>; Tue, 12 Sep 2023 15:59:01 -0700 (PDT)
X-Va-A:
X-Va-T-CD: c50b807927a27c9d70f2046ab21408dd
X-Va-E-CD: f0df63e9f51d1d452d2d01a095503cef
X-Va-R-CD: 5a38939273de612c810050b5136fd72a
X-Va-ID: 5d7f8283-c507-4659-9077-6c819f908926
X-Va-CD: 0
X-V-A:
X-V-T-CD: c50b807927a27c9d70f2046ab21408dd
X-V-E-CD: f0df63e9f51d1d452d2d01a095503cef
X-V-R-CD: 5a38939273de612c810050b5136fd72a
X-V-ID: 767bfe20-9bbf-455e-b7f4-86f4837b7b9c
X-V-CD: 0
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.601, 18.0.957 definitions=2023-09-12_22:2023-09-05, 2023-09-12 signatures=0
Received: from smtpclient.apple (vmini.scv.apple.com [17.192.154.43]) by rn-mailsvcp-mmp-lapp04.rno.apple.com (Oracle Communications Messaging Server 8.1.0.23.20230328 64bit (built Mar 28 2023)) with ESMTPSA id <0S0W001QGAICS500@rn-mailsvcp-mmp-lapp04.rno.apple.com>; Tue, 12 Sep 2023 15:59:01 -0700 (PDT)
From: Vidhi Goel <vidhi_goel@apple.com>
Message-id: <2F15B386-EFF2-4637-8A3D-AF3CDD61114D@apple.com>
Content-type: multipart/alternative; boundary="Apple-Mail=_67FAB590-6EC3-4C43-8276-4B58C5F7BAF9"
MIME-version: 1.0 (Mac OS X Mail 16.0 \(3731.700.2\))
Date: Tue, 12 Sep 2023 15:58:50 -0700
In-reply-to: <2cc3f954aa2447dcb475f2a630841859@huawei.com>
Cc: "Huangyihong (Rachel)" <rachel.huang=40huawei.com@dmarc.ietf.org>, Tom Herbert <tom=40herbertland.com@dmarc.ietf.org>, Abhiram Ravi <abhiramr=40google.com@dmarc.ietf.org>, IETF IPPM WG <ippm@ietf.org>, tsvwg <tsvwg@ietf.org>, "ccwg@ietf.org" <ccwg@ietf.org>, "iccrg@irtf.org" <iccrg@irtf.org>, Nandita Dukkipati <nanditad@google.com>, Naoshad Mehta <naoshad@google.com>, Jai Kumar <jai.kumar@broadcom.com>
To: "Shihang(Vincent)" <shihang9=40huawei.com@dmarc.ietf.org>
References: <92a6a6b54105447db6998d15961b1f8e@huawei.com> <2cc3f954aa2447dcb475f2a630841859@huawei.com>
X-Mailer: Apple Mail (2.3731.700.2)
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/RoAiPX8dMBRXK3sMrMyEGe1qZvI>
X-Mailman-Approved-At: Tue, 12 Sep 2023 17:11:29 -0700
Subject: Re: [ippm] [tsvwg] [iccrg] New Internet Draft: Congestion Signaling (CSIG)
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 12 Sep 2023 23:59:06 -0000

Not sure why we are coming up with so many new techniques when ECN just works fine. 
ECN is a 2 bit field (not 1 bit) and seems to be sufficient to indicate extent of congestion by marking it per packet. Adding more complexity to any layer whether it is L2 or L3 doesn’t work well in deployments. Our goal should be to simplify things and only add new headers if absolutely necessary.

Vidhi

> On Sep 12, 2023, at 3:12 AM, Shihang(Vincent) <shihang9=40huawei.com@dmarc.ietf.org> wrote:
> 
> Hi,
> I agree L2 may not be the best choice to carry the congestion signaling end-to-end and more bits are needed. We have submitted a draft to carry the multi-bits congestion signaling in L3. We call it Advanced ECN. See https://datatracker.ietf.org/doc/draft-shi-ccwg-advanced-ecn/. 
>  
> Thanks,
> Hang
>  
> From: CCWG <ccwg-bounces@ietf.org> On Behalf Of Huangyihong (Rachel)
> Sent: Tuesday, September 12, 2023 5:41 PM
> To: Tom Herbert <tom=40herbertland.com@dmarc.ietf.org>; Abhiram Ravi <abhiramr=40google.com@dmarc.ietf.org>
> Cc: IETF IPPM WG <ippm@ietf.org>; tsvwg <tsvwg@ietf.org>; ccwg@ietf.org; iccrg@irtf.org; Nandita Dukkipati <nanditad@google.com>; Naoshad Mehta <naoshad@google.com>; Jai Kumar <jai.kumar@broadcom.com>
> Subject: Re: [CCWG] [iccrg] [tsvwg] New Internet Draft: Congestion Signaling (CSIG)
>  
> Hi,
>  
> I also have the same feeling. Implementing in L2 may be difficult to be used in e2e transport. Of course it can work well in limited domain, like DC or HPC clusters. However, I also look for some solutions that could be able to go through internet. We have submitted a draft to describe the transport challenges. See https://datatracker.ietf.org/doc/html/draft-huang-tsvwg-transport-challenges.
>  
> I share the same opinion that the congestion signal is useful and current 1-bit ECN solution is not fully sufficient. But I also feel like the more straight way is to extend L3, or l4, like update IOAM, to carry the information. For L2 solution, it should be developed together with IEEE 802.1.
>  
> BR,
> Rachel
>  
> 发件人: iccrg <iccrg-bounces@irtf.org <mailto:iccrg-bounces@irtf.org>> 代表 Tom Herbert
> 发送时间: 2023年9月10日 0:10
> 收件人: Abhiram Ravi <abhiramr=40google.com@dmarc.ietf.org <mailto:abhiramr=40google.com@dmarc.ietf.org>>
> 抄送: IETF IPPM WG <ippm@ietf.org <mailto:ippm@ietf.org>>; tsvwg <tsvwg@ietf.org <mailto:tsvwg@ietf.org>>; ccwg@ietf.org <mailto:ccwg@ietf.org>; iccrg@irtf.org <mailto:iccrg@irtf.org>; Nandita Dukkipati <nanditad@google.com <mailto:nanditad@google.com>>; Naoshad Mehta <naoshad@google.com <mailto:naoshad@google.com>>; Jai Kumar <jai.kumar@broadcom.com <mailto:jai.kumar@broadcom.com>>
> 主题: Re: [iccrg] [tsvwg] New Internet Draft: Congestion Signaling (CSIG)
>  
> Hi, thanks for draft!
>  
> The first thing that stands out to me is the carrier of the new packet headers. In the forward path it would be in L2 and in reflection it would be L4. As the draft describes, this would entail having to support the protocol in multiple L2 and multiple L4 protocols-- that's going to be a pretty big lift! Also, L2 is not really an end-to-end protocol (would legacy switches in the path also forward the header)l?).
>  
> The signaling being described in the draft is network layer information, and hence IMO should be conveyed in network layer headers. That's is L3 which conveniently is the average of L2+L4 :-)
>  
> IMO, the proper carrier of the signal data is Hop-by-Hop Options. This is end-to-end and allows modification of data in-flight. The typical concern with Hop-by-Hop Options is high drop rates on the Internet, however in this case the protocol is explicitly confined to a limited domain so I don't see that as a blocking issue for this use case.
>  
> The information being carried seems very similar to that of IOAM (IOAM uses Hop-by-Hop Options and supports reflection). I suppose the differences are that this protocol is meant to be consumed by the transport Layer and the data is a condensed summary of path characteristics. IOAM seems pretty extensible, so maybe it could be adapted to carry the signals of this draft?
>  
> A related proposal might be FAST draft-herbert-fast. Where the CSIG is network to host signaling, FAST is host to network signaling for the purposes of requesting network services. These might be complementary and options for both may be in the same packet. FAST also uses reflection, so we might be able to leverage some common implementation at a destination.
>  
> Tom
>  
> On Fri, Sep 8, 2023, 7:43 PM Abhiram Ravi <abhiramr=40google.com@dmarc.ietf.org <mailto:40google.com@dmarc.ietf.org>> wrote:
> Hi IPPM folks,
>  
> I am pleased to announce the publication of a new internet draft, Congestion Signaling (CSIG): https://datatracker.ietf.org/doc/draft-ravi-ippm-csig/ 
>  
> CSIG is a new end-to-end packet header mechanism for in-band signaling that is simple, efficient, deployable, and grounded in concrete use cases of congestion control, traffic management, and network debuggability. We believe that CSIG is an important new protocol that builds on top of existing in-band network telemetry protocols.
>  
> We encourage you to read the CSIG draft and provide your feedback and comments. We have also cc'd the TSVWG, CCWG, and ICCRG mailing lists, as we believe that this work may be of interest to their members as well.
>  
> Thank you for your time and consideration.
>  
> Sincerely,
> Abhiram Ravi
> On behalf of the CSIG authors