Re: [bmwg] Considerations for Benchmarking Network Performance in Satellite Internet Constellations

"zeqilai@tsinghua.edu.cn" <zeqilai@tsinghua.edu.cn> Tue, 25 October 2022 02:19 UTC

Return-Path: <zeqilai@tsinghua.edu.cn>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 45A6FC1522AF for <bmwg@ietfa.amsl.com>; Mon, 24 Oct 2022 19:19:34 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.004
X-Spam-Level:
X-Spam-Status: No, score=-7.004 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_FONT_FACE_BAD=0.001, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=tsinghua.edu.cn
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7iLnWjJJndV3 for <bmwg@ietfa.amsl.com>; Mon, 24 Oct 2022 19:19:26 -0700 (PDT)
Received: from azure-sdnproxy.icoremail.net (azure-sdnproxy.icoremail.net [52.187.6.220]) by ietfa.amsl.com (Postfix) with SMTP id 0B0DEC1524B0 for <bmwg@ietf.org>; Mon, 24 Oct 2022 19:18:42 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tsinghua.edu.cn; s=dkim; h=Received:Date:From:To:Cc:Subject: References:Mime-Version:Message-ID:Content-Type; bh=bZBryCfJAaII pHSPrI4LYOvi3Su25wOYRtTvmLJAM/4=; b=I91zWMt6CQgWwMKyBC7ynTS6pksN EFRbfQTg4Ln+zzzYxo9KwY/nDfbIIv31oCS4yhMjGHUKkw5wBMe7Rc/A1R19d7lV BODl8NAUsdhvmwpgGRXwfmC2cbbZKufzxtC3isCJdvh+qFvl2JNVRVg89jZYh/Ev Os6lauYmu1PNPIk=
Received: from LAPTOP-CLAPEBH8 (unknown [58.206.199.137]) by web4 (Coremail) with SMTP id ywQGZQAXV3Z+R1djqgyNAQ--.30022S2; Tue, 25 Oct 2022 10:18:38 +0800 (CST)
Date: Tue, 25 Oct 2022 10:19:01 +0800
From: "zeqilai@tsinghua.edu.cn" <zeqilai@tsinghua.edu.cn>
To: acmorton <acmorton@att.com>, bmwg <bmwg@ietf.org>
Cc: lihewu <lihewu@cernet.edu.cn>, qi-zhang19 <qi-zhang19@tsinghua.org.cn>, wuqian <wuqian@cernet.edu.cn>, dengyt21 <dengyt21@mails.tsinghua.edu.cn>
References: <2022102423385896819316@tsinghua.edu.cn>, <CH0PR02MB7980C734B48167B80999AEE2D32E9@CH0PR02MB7980.namprd02.prod.outlook.com>
X-Priority: 3
X-GUID: F9429B5E-3656-4B3D-BFF8-3CB9B5BCDD4E
X-Has-Attach: no
X-Mailer: Foxmail 7.2.24.96[cn]
Mime-Version: 1.0
Message-ID: <2022102510190181351620@tsinghua.edu.cn>
Content-Type: multipart/alternative; boundary="----=_001_NextPart305176471543_=----"
X-CM-TRANSID: ywQGZQAXV3Z+R1djqgyNAQ--.30022S2
X-Coremail-Antispam: 1UD129KBjvJXoW7WF1ftr15WrWrury5WFWrGrg_yoW8Zw4rpF sYga4ay39rKF1ayw4xAa1SkF98uws3JrWDCFy8G34xKws8KFy0qr42q34ag3yUur9Iyw1Y v3yjvw1Uu3WYyFJanT9S1TB71UUUUUUqnTZGkaVYY2UrUUUUjbIjqfuFe4nvWSU5nxnvy2 9KBjDU0xBIdaVrnRJUUUPK14x267AKxVWUJVW8JwAFc2x0x2IEx4CE42xK8VAvwI8IcIk0 rVWrJVCq3wAFIxvE14AKwVWUJVWUGwA2ocxC64kIII0Yj41l84x0c7CEw4AK67xGY2AK02 1l84ACjcxK6xIIjxv20xvE14v26w1j6s0DM28EF7xvwVC0I7IYx2IY6xkF7I0E14v26r4U JVWxJr1l84ACjcxK6I8E87Iv67AKxVW0oVCq3wA2z4x0Y4vEx4A2jsIEc7CjxVAFwI0_Gc CE3s1le2I262IYc4CY6c8Ij28IcVAaY2xG8wAqx4xG67k08I80eVW7JVWxJwAqx4xG6c80 4VAFz4xC04v7Mc02F40Ew4AK048IF2xKxVW8JVW5JwAqx4xG6xAIxVCFxsxG0wAqx4xG6I 80eVAYj480w7AI67kE8s4l5I8CrVC2j2CEb7xGj4kF0VAqx4xJMcIj6xIIjxv20xvE14v2 6r1j6r18McIj6I8E87Iv67AKxVWUJVW8JwAm72CE4IkC6x0Yz7v_Jr0_Gr1lF7I21c0EjI I2zVCS5cI20VAGYxC7Mx8GjcxK6IxK0xIIj40E5I8CrwCY02Avz4vE14v_Gr1l4I8I3I0E 4IkC6x0Yz7v_Jr0_Gr1lx2IqxVAqx4xG67AKxVWUGVWUWwC20s026x8GjcxK67AKxVWUGV WUWwC2zVAF1VAY17CE14v26r126r1DMIIF0xvE2Ix0cI8IcVAFwI0_Jr0_JF4lIxAIcVC0 I7IYx2IY6xkF7I0E14v26r1j6r4UMIIF0xvE42xK8VAvwI8IcIk0rVWUJVWUCwCI42IY6I 8E87Iv67AKxVWUJVW8JwCI42IY6I8E87Iv6xkF7I0E14v26r1j6r4UYxBIdaVFxhVjvjDU 0xZFpf9x0pRAsqJUUUUU=
X-CM-SenderInfo: p2htxztdl632xlqjx3vdohv3gofq/
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/uaBJdxXon_KZVwVZmxO-QYaoTMQ>
X-Mailman-Approved-At: Tue, 25 Oct 2022 05:37:26 -0700
Subject: Re: [bmwg] Considerations for Benchmarking Network Performance in Satellite Internet Constellations
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 25 Oct 2022 02:19:34 -0000

Dear Al:

Thanks a lot for your suggestions! We fully agree that the scope of work should be determined in accordance with the charter.
 
IMO, I think that: (1) a series of recommendations concerning the network performance characteristics of inter-networking technologies for integrating future LEO satellites and terrestrial networks, and (2) benchmark methodologies for related LEO satellite devices/systems, should fit the BMWG charter. 
 
In particular, works fitting the charter may include:
 
(1) describing the class of network functions, systems, or services that play a critical role in emerging LEO satellite Internt. 
 
For example, the inter-networking approach for integrating satellites and terrestrial facilities, a new routing mechanism in an integrated space and terrestrial environment, or a user terminal for connecting LEO satellites.
 
(2) discussing the key performance characteristics that are pertinent to LEO integrated space and terrestrial networks.
 
For example, the coverage, user-perceived latency/bandwidth/jitter, etc.
 
(3) clarifying a set of important metrics that can help to describe the above characteristics.
 
For example, the constellation architecture, network topology, hardware capability of the ground facilities, etc.
 
(4) specifying the concrete methodology to reasonably collect the above characteristics.
 
(5) concrete benchmarking methodology and test cases.
 
(6) describing requirements for the result reporting format.
 
We elaborate our preliminary considerations in our submitted draft, and hope it can help to narrow down the work scope, and stimulate more discussions on benchmarking recommendations for the upcoming LEO satellite networks.
 
Thanks!

Best regards,
Zeqi Lai


zeqilai@tsinghua.edu.cn
 
From: MORTON JR., AL
Date: 2022-10-25 06:00
To: zeqilai@tsinghua.edu.cn; bmwg
CC: lihewu; qi-zhang19; wuqian; dengyt21
Subject: RE: [bmwg] Considerations for Benchmarking Network Performance in Satellite Internet Constellations
Thanks for this update, Zeqi Lai.
 
Speaking as a participant, I think that LEO satellite technology may see more common usage in our communications of the future. It would be worthwhile to discover the scope of work that fits the bmwg charter, so that this WG can play a useful role in the big LEO picture.
 
regards,
Al
 
From: bmwg <bmwg-bounces@ietf.org> On Behalf Of zeqilai@tsinghua.edu.cn
Sent: Monday, October 24, 2022 11:39 AM
To: bmwg <bmwg@ietf.org>
Cc: lihewu <lihewu@cernet.edu.cn>; qi-zhang19 <qi-zhang19@tsinghua.org.cn>; wuqian <wuqian@cernet.edu.cn>; dengyt21 <dengyt21@mails.tsinghua.edu.cn>
Subject: [bmwg] Considerations for Benchmarking Network Performance in Satellite Internet Constellations
 
Dear BMWG:
 
Hope this email finds you all well!
 
Last time we reported our preliminary considerations for the problems and requirements of of evaluation methodology for futuristic integrated space and terrestrial networks. (you can find our previous slides here: https://datatracker.ietf.org/doc/slides-112-bmwg-problems-and-requirements-of-evaluation-methodology-for-integrated-space-and-terrestrial-networks/00/). We got a lot of valuable advice from that meeting. Many thanks!
 
We are still working on this timely topic. Recently, according to our latest research progress, we make several new considerations for benchmarking the network performance of emerging satellite Internet constellations.
 
Specifically, we describe these aspects that are mostly related to the network performance benchmarking for recent satellite Internet constellation and their integration with existing terrestrial networks, including multiple networking models, a potential benchmarking approach in the laboratory environment, critical configuration parameters, and several suggested test cases. (please see details in: https://datatracker.ietf.org/doc/draft-lai-bmwg-sic-benchmarking/).
 
Any comments, questions, comments are more than welcome!
 
Thanks a lot in advance : )
 
Best regards.
Zeqi Lai


zeqilai@tsinghua.edu.cn