[nmrg] Graph Neural Networking challenge 2021 - Creating a Scalable Network Digital Twin

José Suárez-Varela <jsuarezv@ac.upc.edu> Fri, 04 June 2021 08:02 UTC

Return-Path: <jsuarezv@ac.upc.edu>
X-Original-To: nmrg@ietfa.amsl.com
Delivered-To: nmrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 327ED3A2E2B for <nmrg@ietfa.amsl.com>; Fri, 4 Jun 2021 01:02:49 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.625
X-Spam-Level:
X-Spam-Status: No, score=-0.625 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URI_DOTEDU=1.273] autolearn=no autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id pLPYTEXUjqG9 for <nmrg@ietfa.amsl.com>; Fri, 4 Jun 2021 01:02:43 -0700 (PDT)
Received: from roura.ac.upc.es (roura.ac.upc.es [147.83.33.10]) by ietfa.amsl.com (Postfix) with ESMTP id F06243A2E33 for <nmrg@irtf.org>; Fri, 4 Jun 2021 01:02:42 -0700 (PDT)
Received: from correu-2.ac.upc.es (correu-2.ac.upc.es [147.83.30.92]) by roura.ac.upc.es (8.13.8/8.13.8) with ESMTP id 15482dwd017020 for <nmrg@irtf.org>; Fri, 4 Jun 2021 10:02:39 +0200
Received: from [10.8.0.46] (gw-5-vpn.ac.upc.es [147.83.30.82]) by correu-2.ac.upc.es (Postfix) with ESMTPSA id 2A2171DF for <nmrg@irtf.org>; Fri, 4 Jun 2021 10:02:34 +0200 (CEST)
To: nmrg@irtf.org
From: José Suárez-Varela <jsuarezv@ac.upc.edu>
Message-ID: <56fdf32b-cac4-d7ec-b1fc-f83e91b4d58e@ac.upc.edu>
Date: Fri, 04 Jun 2021 10:02:36 +0200
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.2
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="------------A11F82F863811184EA863480"
Content-Language: es-ES
Archived-At: <https://mailarchive.ietf.org/arch/msg/nmrg/fJEVBf9o3AsR-i_kj3E7IpefDf4>
Subject: [nmrg] Graph Neural Networking challenge 2021 - Creating a Scalable Network Digital Twin
X-BeenThere: nmrg@irtf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Network Management Research Group discussion list <nmrg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/nmrg>, <mailto:nmrg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nmrg/>
List-Post: <mailto:nmrg@irtf.org>
List-Help: <mailto:nmrg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/nmrg>, <mailto:nmrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Fri, 04 Jun 2021 08:02:49 -0000

[Apologies if you receive multiple copies of this email]

Dear Colleagues,

We are glad to announce the "Graph Neural Networking challenge 2021", an 
international competition on Graph Neural Networks applied to computer 
networks, organized as part of the "ITU AI/ML in 5G Challenge".

Challenge description: Creating a Scalable Network Digital Twin

Top-3 teams will have access to the global round of the "ITU AI/ML in 5G 
Challenge <https://aiforgood.itu.int/ai-ml-in-5g-challenge/>". This 
competition attracted over 1,300 participants around the world in the 
last edition, and there were attractive cash prizes for winners.

We provide several resources and tips to easily start working on the 
challenge (See “Main Resources”).

Registration is now open and free of charge for all participants 
(Deadline Aug 31st).

Website: https://bnn.upc.edu/challenge/gnnet2021 
<https://bnn.upc.edu/challenge/gnnet2021>

Registration: https://bnn.upc.edu/challenge/gnnet2021/registration 
<https://bnn.upc.edu/challenge/gnnet2021/registration>

Please, do not hesitate to contact us for questions or 
comments.<mailto:gnnetchallenge@bnn.upc.edu>

=====================================================

[Overview]

Graph Neural Networks (GNN) have produced groundbreaking applications in 
many fields where data is fundamentally structured as graphs (e.g., 
chemistry, physics, biology, recommender systems). In the field of 
computer networks, this new type of neural networks is being rapidly 
adopted for a wide variety of use cases, particularly for those 
involving complex graphs (e.g., performance modeling, routing 
optimization, resource allocation in wireless networks).

The Graph Neural Networking challenge 2021 brings a fundamental 
limitation of existing GNNs: their lack of generalization capability to 
larger graphs. In order to achieve production-ready GNN-based solutions, 
we need models that can be trained in network testbeds of limited size 
(e.g., at the vendor’s networking lab), and then be directly ready to 
operate with guarantees in real customer networks, which are often much 
larger in number of nodes. In this challenge, participants are asked to 
design GNN-based models that can be trained on small network scenarios 
(up to 50 nodes), and after that scale successfully to larger networks 
not seen before, up to 300 nodes. Solutions with better scalability 
properties will be the winners.

[Problem statement]

The goal of this challenge is to create a scalable Network Digital Twin 
based on neural networks, which can accurately estimate QoS performance 
metrics given a network state snapshot. More in detail, solutions must 
predict the per-path mean delay given: (i) a network topology, (ii) a 
traffic matrix, and (iii) a routing configuration.

As a baseline, we provide RouteNet, a GNN model recently proposed to 
estimate end-to-end performance metrics (e.g., delay, jitter, loss) in 
networks. However, RouteNet does not scale well to networks considerably 
larger than those observed during the training phase. As a result, it 
does not perform well when applied to this challenge.

Participants are encouraged to update RouteNet or submit their own 
neural network models.

[Main resources]

- Summary slides (with some tips for participants)

- Baseline GNN model: Open source implementation of RouteNet, including 
a tutorial on how to use it and modify fundamental characteristics of 
the model

- Training/validation datasets

- Python API to easily read and process the datasets

- Mailing list for participants and people interested (Link to 
subscribe:https://mail.bnn.upc.edu/cgi-bin/mailman/listinfo/challenge2021 
<https://mail.bnn.upc.edu/cgi-bin/mailman/listinfo/challenge2021>).

[Timeline]

* Registration open to participants: Deadline Aug 31st
* Evaluation phase: Sep 16th
* Winners (top 3) official announcement: Oct 31st
* Final awards and presentation: Dec 2021

Best regards,

José Suárez-Varela

------------------------

Postdoctoral researcher

Barcelona Neural Networking center (BNN-UPC)

Universitat Politècnica de Catalunya

Contact: gnnetchallenge@bnn.upc.edu <mailto:gnnetchallenge@bnn.upc.edu>