[Bier] Re: Invitation to the "AI Network Multicast" side meeting at IETF 126

Yisong Liu <liuyisong@chinamobile.com> Mon, 27 July 2026 00:44 UTC

Return-Path: <liuyisong@chinamobile.com>
X-Original-To: bier@mail2.ietf.org
Delivered-To: bier@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id DB2B411EFE35D; Sun, 26 Jul 2026 17:44:28 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ietf.org; s=ietf1; t=1785113068; bh=TnNdy7/kZUY/BCW5BJJwSf5aZvn1t+eQy9K4PDAgwx0=; h=Date:From:To:Cc:References:Subject; b=wV1k9LlYsbJk+8WxHdEq/t7o/ObRGPtM8deeCWKt6HxnIkitEySSq8Vp0joSJViQS m5J/gLWKtYoCqeM+8JEQFn1XSkStw1sv5G2jpkMcuH+1h3U2VLbwlS+HCwympfyGX0 6inVyNXatNCZWF3ZKvmFDGrv0XX1CLA6yKRQuaPQ=
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -1.696
X-Spam-Level:
X-Spam-Status: No, score=-1.696 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_INVALID=0.1, DKIM_SIGNED=0.1, HTML_FONT_FACE_BAD=0.001, HTML_MESSAGE=0.001, RCVD_IN_VALIDITY_CERTIFIED_BLOCKED=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=no autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=fail (1024-bit key) reason="fail (body has been altered)" header.d=chinamobile.com
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 6-uGlsBCesXj; Sun, 26 Jul 2026 17:44:27 -0700 (PDT)
Received: from cmccmta8.chinamobile.com (cmccmta8.chinamobile.com [111.22.67.151]) by mail2.ietf.org (Postfix) with ESMTP id 44F1F11EFE357; Sun, 26 Jul 2026 17:44:14 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=chinamobile.com; s=default; l=0; h=from:subject:message-id:to:cc:mime-version; bh=47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU=; b=rAyAxMQP5LjFE4XFhnQDal4QRg4BOzycXZZon9EnCjAEze+6RmClT105xtTnZ4f65p/M2FkXrSl5L u/7wG+mdiJaZjR5R/XNzYfhbuMNjw/L4OmfoEKnNUuUGP5EtmcqcscXElV1nrRiGc6/hysrIbEetVV FHxJNBHjIhi8FHfY=
X-RM-TagInfo: emlType=0
X-RM-SPAM-FLAG: 00000000
Received: from mail.dlp.master (unknown[10.188.0.87]) by rmmx-syy-dmz-app02-12002 (RichMail) with SMTP id 2ee26a66a9d68fc-a4013; Mon, 27 Jul 2026 08:44:06 +0800 (CST)
X-RM-TRANSID: 2ee26a66a9d68fc-a4013
Received: from spf.mail.chinamobile.com (unknown [10.230.70.214]) by mail.dlp.master (Postfix) with ESMTP id 6F4C315A019D; Mon, 27 Jul 2026 08:40:29 +0800 (CST)
X-RM-SPAM-FLAG: 00000000
Received: from liuyisong@chinamobile.com ( [10.1.6.55] ) by ajax-webmail-syy-spmd05-11015 (Richmail) with HTTP; Mon, 27 Jul 2026 08:44:05 +0800 (CST)
Date: Mon, 27 Jul 2026 08:44:05 +0800
From: Yisong Liu <liuyisong@chinamobile.com>
To: mcast4ai <mcast4ai@ietf.org>, rtgwg <rtgwg@ietf.org>, pim <pim@ietf.org>, bier <bier@ietf.org>, mboned <mboned@ietf.org>
Message-ID: <2b076a6698f0b2f-0001e.Richmail.00007002259940896586@chinamobile.com>
References: <2b076a59bb929d5-00053.Richmail.00003032357910695576@chinamobile.com>
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="----=_Part_357614_473927528.1785113045531"
X-Priority: 3
X-RM-TRANSID: 2b076a6698f0b2f-0001e
X-PARTNER-PROJECT-ID: 0
X-RM-OA-ENC-TYPE: 0
X-RM-FontColor: 0
X-CLIENT-INFO: X-TIMING=0&X-MASSSENT=0&X-SENSITIVE=0
X-Mailer: Richmail_Webapp(V2.5.01)
Message-ID-Hash: YESYSTPROW5HDPZGEDNRUIZWPKYQITO7
X-Message-ID-Hash: YESYSTPROW5HDPZGEDNRUIZWPKYQITO7
X-MailFrom: liuyisong@chinamobile.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-bier.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: MikeMcBride <mmcbride7@gmail.com>, YisongLiu <liuyisong_ietf@163.com>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [Bier] Re: Invitation to the "AI Network Multicast" side meeting at IETF 126
List-Id: "\"Bit Indexed Explicit Replication discussion list\"" <bier.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/bier/hT5dv_7FSkwsnvZ7IILoZiE-jDY>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bier>
List-Help: <mailto:bier-request@ietf.org?subject=help>
List-Owner: <mailto:bier-owner@ietf.org>
List-Post: <mailto:bier@ietf.org>
List-Subscribe: <mailto:bier-join@ietf.org>
List-Unsubscribe: <mailto:bier-leave@ietf.org>

Dear All,



Thank you very much for your interest in the side meeting. The discussions were truly insightful. Key takeaways are summarized below: 


1.Standard multicast protocols (PIM-SM, BIER etc.) forward and replicate packets but lack in-network reduction capabilities – they cannot aggregate multiple incoming gradient streams from GPUs as required for All-Reduce collectives. ACK aggregation is also a transport-layer issue that affects scalability. This is a fundamental interactivity gap.


2.The decision on whether to extend existing protocols or create a new one still requires further evaluation and discussion. A draft of draft-mcbride-mcast4ai-p2mp-mechanism-evaluation has analyzed this question and was presented at the PIM WG. 


3.No strict dependency on UEC however, a clear understanding of layer interactions is needed. Wim Hendrixx will invite a UEC representative to the next meeting for cross-coordination.


4.Failure scenarios are being addressed by the FANN set of solutions within the AI context.


5. Whether to form a BoF or a new WG will be decided until after further discussion. The problem is clearly defined, but further discussion is required. Participants are encouraged to continue conversations on the mcast4ai mailing list, with optional CC to other WGs (e.g., PIM) to broaden input.


 


Whether you attended the side meeting or not, you can find the presentation materials shared on GitHub for your reference: https://github.com/MCAST4AI/IETF-MCAST4AI/tree/main/IETF126.


Please find the meeting recording at the link: 


https://ietf.webex.com/recordingservice/sites/ietf/recording/e4c830e4caa74bedb95beb93df1aa3d2/playback


Due to a slight delay in starting the recording, the opening overview was not captured. We apologize for any inconvenience.


 


If you have any questions, please feel free to raise them on the mcast4ai mailing list. 


 


Thank you again for your participation and support.




Best Regards
Yisong




----邮件原文----

发件人:Yisong Liu  <liuyisong@chinamobile.com>

收件人:mcast4ai  <mcast4ai@ietf.org>,rtgwg  <rtgwg@ietf.org>,pim  <pim@ietf.org>,bier  <bier@ietf.org>,mboned  <mboned@ietf.org>

抄 送: MikeMcBride  <mmcbride7@gmail.com>,YisongLiu  <liuyisong_ietf@163.com>

发送时间:2026-07-17 15:35:31

主题:Invitation to the "AI Network Multicast" side meeting at IETF 126




Dear All,





We will organize a side meeting of AI Network Multicast on Tuesday, July 21, 9:15-10:45 (Europe/Vienna), in room Grand Klimt Hall 3. If you are interested in AIDC or network layer multicast, please come to the side meeting to discuss. If you are remote participant, please access the meeting via the link: https://ietf.webex.com/meet/sidemeetings2


 


This side meeting builds on previous side meeting discussions and will dive deeper into AI-specific multicast use cases and requirements, including MoE token dispatch, while conducting preliminary technical analyses of potential solutions such as BIER enhancements and new protocol designs, with emphasis on reliability, scalability, and quantitative performance evaluation to guide future standardization.


 


Please check the initial agenda of the side meeting in the following: 


0. Welcome & Review  Chairs 


1. Multicast Problem Statement for AIDC  ( Junye Zhang, Remote, China Mobile)  


Abstract: Multicast is a promising technique for enhancing the efficiency of point-to-multipoint data transmission during LLM training and inference in AI Data Centers (AIDCs). However, AIDCs demand bidirectional interaction, lossless reliability, microsecond scale dynamics, sparse groups, and simple control/data planes. This talk will give a brief problem statement of multicast in AIDCs.


2.Can LLMs Reason Structurally? Benchmarking via the lens of Data Structures, with possible benefit from Multicast ( Yingxi Li, Remote, Stanford University) 


Abstract: As large language models (LLMs) are increasingly deployed on complex tasks that demand multi-step decision-making, evaluating their algorithmic reasoning capabilities becomes critical. This talk introduces DSR-Bench, a diagnostic benchmark grounded in data structures, designed to assess structural reasoning—the ability to perceive and manipulate relational patterns such as order, hierarchy, and connectivity, including the benchmark design, the evaluation methodology, and key empirical findings. The talk concludes with a brief discussion of potential implications for AI data-center networks, raising the question of whether efficient multicast communication could benefit long-context inference, inference-time search, and distributed model execution.


3.In-Network Computing on Switches (IFEC): Remodeling Multicast and Accelerating Communication for AI Clusters  (Changwang Lin, On-site, Alibaba & H3C)


Abstract: Describe an innovative collaborative computing paradigm named IFEC (In Fabric Extended-Computation). Its core objective is to address the worsening cross-xPU communication bottlenecks in large-scale AI training and inference, driven by rising model parallelism and the widespread adoption of architectures such as MoE.


4.  Multicast in Scale-Up (Haibo Wang, On-site, Huawei)


Abstract: With the rapid development of AI services, optimizing AI cluster performance has become increasingly important. Notably, some AI service scenarios may exhibit multicast-like communication patterns (e.g., MOE dispatch).Traditional network multicast relies on single-direction forwarding, which conflicts with key AI service requirements: interactivity, reliability, dynamics, and sparsity. These mismatches introduce significant challenges in scale-out network. Interestingly, when AI services operate within a scale-up network, these challenges become more manageable. Consequently, we propose first focusing on leveraging multicast to enhance scale-up AI service performance, before extending the solution to broader distributed deployments.


5. Open Discussion


 


Welcome to join us! We hope to see you there!


If you have any questions, please feel free to contact us: liuyisong@chinamobile.com, mmcbride7@gmail.com






Best Regards

Yisong