[icnrg] Enabling Ensemble Reinforcement Learning with ICN in Mobile Edge Computing Environments
Dirk Kutscher <ietf@dkutscher.net> Tue, 15 October 2024 10:08 UTC
Return-Path: <ietf@dkutscher.net>
X-Original-To: icnrg@ietfa.amsl.com
Delivered-To: icnrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 98E52C14F616 for <icnrg@ietfa.amsl.com>; Tue, 15 Oct 2024 03:08:07 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.102
X-Spam-Level:
X-Spam-Status: No, score=-2.102 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=dkutscher.net
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id JSwro5H4HodQ for <icnrg@ietfa.amsl.com>; Tue, 15 Oct 2024 03:08:03 -0700 (PDT)
Received: from mout.kundenserver.de (mout.kundenserver.de [212.227.126.135]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BCAB3C14F6F3 for <icnrg@irtf.org>; Tue, 15 Oct 2024 03:08:02 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dkutscher.net; s=s1-ionos; t=1728986880; x=1729591680; i=ietf@dkutscher.net; bh=JW/y+yFd9ZAxZ58UPgVx/NaBsfqbqH0O/hhSIqsoJ6o=; h=X-UI-Sender-Class:From:To:Subject:Date:Message-ID:MIME-Version: Content-Type:cc:content-transfer-encoding:content-type:date:from: message-id:mime-version:reply-to:subject:to; b=vFP4B0ZQLqNJOrGvjB43XjjLlmPjWS4ei3cBc/Ft/9jLUzjQ7IcrA76WdKCP0Kj2 Inw1HQVxm47mou40vu74HXpMy33CFJvToFcAb6o87hycSrnMK1C1qwr2kea5DY6Fd RCLjpUFtb7DfuwIqaeWifECYehMGBvWTCLF3HGer9pV0a27gI03LmahLxQ6pU+hcR lrZgf11VLBDfFXmPx7Hw/MOjtCnvmOkyHiCCqxtOg0fj0MiXMar/wRzDDuK4OXnkX T/Xc5axOJP7JuLBN2RNZxwql4pjTWBOtgHcqOuit/DmdZ7XKIEVYaAyHtOplA/gz7 TkUWh2fHyz5cA2KkiA==
X-UI-Sender-Class: 55c96926-9e95-11ee-ae09-1f7a4046a0f6
Received: from [10.13.134.230] ([125.34.248.215]) by mrelayeu.kundenserver.de (mreue009 [212.227.15.167]) with ESMTPSA (Nemesis) id 1MgNlH-1tamNT0jGB-00nNyC for <icnrg@irtf.org>; Tue, 15 Oct 2024 12:08:00 +0200
From: Dirk Kutscher <ietf@dkutscher.net>
To: ICNRG <icnrg@irtf.org>
Date: Tue, 15 Oct 2024 18:07:56 +0800
X-Mailer: MailMate (1.14r5937)
Message-ID: <034F9647-18B6-4130-9E59-4FC7D3C61E98@dkutscher.net>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=_MailMate_5BC4BF57-5E73-44C6-8AE4-549D40259CBC_="; micalg="pgp-sha512"; protocol="application/pgp-signature"
X-Provags-ID: V03:K1:lZixgLN/EPy7IZ0p8ax8IwVSW/cczu7sZYW/sONtEQZhW84rtGb aTYKAuuN8wKeQWCujbMyAsbGupSPrYP0fZGvyYpdkL8yyc3sdAhLo38a9NF+xTFjgxE6p5/ rsjdzU2oeGKrhwBhUaEhYIPXkZ42qCNMZTur5BRbykv9gciq+G+M2LD5ozCrIllIRMw2M3z v5YHsnNlOkw/QTYpYVQng==
UI-OutboundReport: notjunk:1;M01:P0:AdqQCIsODKw=;qO9p84EHScSg7H+a86nzrIhPLM4 324APKETK/H2UXgjJJXa3uvSsO1/KKqvN+3abpKeAlVyuwZQ0aKygrHui2LVmctFG9VDJlcYU essWUOlBXXFyvFhGAdssGfQaZ6JT2i7vm9yiViuOv6Q+2VftzDktXMMDhgFesJeedMFEFyILj Gw5wjYTF7dXkTze0soJR+yoANDYrbmfMqBONGH9sjJ9DvtzSKnp4bCpzsXmm8jHgmxiSv9u8l JX2Kt0lMtpPq/6OUHxXiEN5z9SU8kArDDH51ZjUi0st2HYhokJ4QLVKng9P3MyRlE/WjjmuMx oyyezsg4KWaPpGBMutTByTQbIbFW4le8TdU/KEIemMP8qeC7vQi99mCWLkti1EhNeDd1I/PbA Y49SnIfvNvpmKIeeybWFcvBtI6Hdf9mqZ5iXnwGuVkYcp/xQod9d/Sir/47qN4uFBgknzTtdG nVrvXWfw8lMOENHE8sxyYF0QntkZ1zJYDnNBvrpmbo/a9Hw92GpDwOXUQK6WB6Y/Vlg21n6v4 wW6S/j8/lwG+OqfcUKjVTF/7xG3bjtMghqrOQsxSyyIigu1hzKg9y0T0OvJmHOr2AzBgjiwG8 mtUD1MCu24vtbJ1oU4mmz3j8V+ef94z5+U6U9RCgwXatyfafD8b+oRxKtVuZWUYJFoW+O3CtO XJc3niVim+q7Xtm+a26Buv8akm5enU+ciA0oHofzJiZMfzROgxgC4IBqKDLv9EzQTetmHUsjt I9W0Sxw2y4cNRZGmwdDgo66prNz6k6C6A==
Message-ID-Hash: 5BHRFOTVZGGXV264KFBVGJR3QM6E23I6
X-Message-ID-Hash: 5BHRFOTVZGGXV264KFBVGJR3QM6E23I6
X-MailFrom: ietf@dkutscher.net
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-icnrg.irtf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [icnrg] Enabling Ensemble Reinforcement Learning with ICN in Mobile Edge Computing Environments
List-Id: Information-Centric Networking research group discussion list <icnrg.irtf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/icnrg/ohoEJoO__JPvhaUz6W2eUID40sQ>
List-Archive: <https://mailarchive.ietf.org/arch/browse/icnrg>
List-Help: <mailto:icnrg-request@irtf.org?subject=help>
List-Owner: <mailto:icnrg-owner@irtf.org>
List-Post: <mailto:icnrg@irtf.org>
List-Subscribe: <mailto:icnrg-join@irtf.org>
List-Unsubscribe: <mailto:icnrg-leave@irtf.org>
Hello, this could be of interest to some: Huang, Yaodong & Kong, Biying & Feng, Wenliang & Mo, Changkang & Liu, Han & Yuan, Yukun & Cui, Laizhong. (2024). [Enabling Ensemble Reinforcement Learning with ICN in Mobile Edge Computing Environments](https://www.researchgate.net/publication/382081506_Enabling_Ensemble_Reinforcement_Learning_with_ICN_in_Mobile_Edge_Computing_Environments). ## Abstract Smart devices now own the capability to conduct machine learning tasks. Such capabilities offer the potential to improve the learning efficiency and accuracy for certain difficult learning tasks with information sharing among edge devices. In this paper, we discuss the implementation of ensemble reinforcement learning in mobile edge computing environments in real-time. We propose a novel system using Information-centric Networking to facilitate fast and efficient multicast transmission over edge devices. The system improves the efficiency and accuracy of ensemble reinforcement learning over edge devices by using targeted data transmission. To achieve efficient and instant transmission, we propose a new transport layer protocol as the middleware for upper-layer learning data and lower-layer ICN links and radios. We implement the proposed system using real edge devices and conduct experiments with several training testbeds to evaluate the performances. The results from the experiments show that the system can achieve up to 28.47% better reward within the same iterations compared to traditional multicast networks and 7.26 times reward compared to training without instant information sharing. -- Dirk
- [icnrg] Enabling Ensemble Reinforcement Learning … Dirk Kutscher