Re: [alto] IETF 114 ALTO Hackathon projects
"Y. Richard Yang" <yry@cs.yale.edu> Wed, 20 July 2022 01:58 UTC
Return-Path: <yang.r.yang@gmail.com>
X-Original-To: alto@ietfa.amsl.com
Delivered-To: alto@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 435E3C15A736; Tue, 19 Jul 2022 18:58:22 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.412
X-Spam-Level:
X-Spam-Status: No, score=-6.412 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, FREEMAIL_FORGED_FROMDOMAIN=0.248, FREEMAIL_FROM=0.001, HEADER_FROM_DIFFERENT_DOMAINS=0.248, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id RPV9l7BUJizj; Tue, 19 Jul 2022 18:58:21 -0700 (PDT)
Received: from mail-yw1-f169.google.com (mail-yw1-f169.google.com [209.85.128.169]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 410B9C1594A8; Tue, 19 Jul 2022 18:58:21 -0700 (PDT)
Received: by mail-yw1-f169.google.com with SMTP id 00721157ae682-31e67c46ba2so12158777b3.2; Tue, 19 Jul 2022 18:58:21 -0700 (PDT)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=SIUduPzr4wVsM+/a0svTWMB4P1NKaDDF1UGCX4O8jg8=; b=XhB3d67s3NfYydoKDB7nk8vNlZjhzI2dTq086jWhWtLbMyqo3dnyDotOr8g2XGJM7v eInyClBjY1kQw8AWo6+TuI327zAnonN83oImLvnHQTUrvhuPeFNLPaFtqTN6piveWF2v giLidihDGv7QLWZq4p47wLYoIT3/qoidy5jyCH12EdZFCC0BbMQ1HJl3F8odX+/LXKwC MNBEN6jedvW5SqvExgXFX4EDx+Jc5bVmpKj3G0s62Zgeu50cqMXcQA1N6VLUPObC4HHf P/RJvPFdrt5kKY2RHFyt0pclrlM6LIWkvZyVKdqrymntVy7ZpP/mAC2trP0T8mVSjI5M +E8A==
X-Gm-Message-State: AJIora/2+9eLe2u1bgI811UJlZyjc8K+9UgINWzw92QhdupgxTNjXjod 0e40v51rrVDnEXmV2I2l+04B1aPlAqokJccPebU=
X-Google-Smtp-Source: AGRyM1u7seQwKGqe8l/dwa3kslV8XuxnlCePt1hRBm2AJl1Z7GsHOdT7EfcpNkE/H5UkTG8N4FaER/KtuuoP59mtGL0=
X-Received: by 2002:a05:690c:708:b0:31e:5ba7:9e38 with SMTP id bs8-20020a05690c070800b0031e5ba79e38mr6293622ywb.320.1658282300265; Tue, 19 Jul 2022 18:58:20 -0700 (PDT)
MIME-Version: 1.0
References: <SN6PR02MB5375149B197B2278E061009EF6869@SN6PR02MB5375.namprd02.prod.outlook.com>
In-Reply-To: <SN6PR02MB5375149B197B2278E061009EF6869@SN6PR02MB5375.namprd02.prod.outlook.com>
From: "Y. Richard Yang" <yry@cs.yale.edu>
Date: Tue, 19 Jul 2022 18:58:09 -0700
Message-ID: <CANUuoLrh5OiJ5OyHhqaJz-X08Zbh2s1x+p8Z-2jTz-ddi=4sQg@mail.gmail.com>
To: Jordi Ros Giralt <jros@qti.qualcomm.com>, Mario Lassnig <mario.lassnig@cern.ch>, Mihai Patrascoiu <mihai.patrascoiu@cern.ch>, Steven Murray <Steven.Murray@cern.ch>
Cc: "alto@ietf.org" <alto@ietf.org>, "alto-chairs@ietf.org" <alto-chairs@ietf.org>
Content-Type: multipart/alternative; boundary="00000000000071d7f405e432ef2a"
Archived-At: <https://mailarchive.ietf.org/arch/msg/alto/dKb-9M149rtHJHbaUCnoUUk1tyY>
Subject: Re: [alto] IETF 114 ALTO Hackathon projects
X-BeenThere: alto@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: "Application-Layer Traffic Optimization \(alto\) WG mailing list" <alto.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/alto>, <mailto:alto-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/alto/>
List-Post: <mailto:alto@ietf.org>
List-Help: <mailto:alto-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/alto>, <mailto:alto-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 20 Jul 2022 01:58:22 -0000
Hi all, During the weekly ALTO meeting today, we discussed the coming hackathon and Qin suggested that we send an update to the mailing list on the FTS+ALTO project, and here is the update: - In short, if you want to work on ALTO integration with production, open projects, this can be a wonderful project to work on: it may help both ALTO (in terms of its crucial deployment mandate) and the largest data-intensive science projects at CERN. Specifically: - For those who have not tracked the hackathon, as Jordi said, it is a continuation of the 113 Hackathon. In particular, the 113 Hackathon focused on the integration with Rucio, which is a wonderfully designed tool used widely in CERN and some other projects for data movement of a large amount of data (PB -> EB). In 113, the hackathon modified the manual workflow, which is the workflow to select the source to download a dataset when a client issues a download command. The other workflow of Rucio is the automatic workflow, which selects the sources and destinations to realize user-specified replication rules. In our original plan, 114 would focus on the automatic workflow. However, the team realized that Rucio is built on top of FTS, which is the main tool used at CERN to schedule which transfer is scheduled at what time, where Rucio is at a higher layer providing the transfers for FTS to schedule. - The 114 hackathon includes 2 objectives: (1) introducing resource control to FTS, and (2) evaluating an alternative design of FTS core: the FTS Optimizer. Hence, the work includes 3 components, integrating the FTS production code and framework: (1/basic) allow FTS to specify resource control goal and use ALTO to map FTS control state (called links in FTS, where a link is a pair consisting of a source node to a destination node, where a node is called RSE) to network state; (2/basic) implement a full zero-order algorithm, to achieve fully efficient, zero-order gradient control as FTS Optimizer; (3/stretch) realize a composition framework to compose end-to-end resource performance function, including both zero-order and first-order gradient, covering the bottleneck structure. The project is exciting both in terms of its technical content and also in terms of its potential impacts. The hackathon project will work under the guidance of the Rucio project lead (Dr. Mario Lassnig) and the FTS project lead (Mihai Patrascoiu and Steven Murray); all cc'd in this email. This can be a wonderful opportunity for IETF, the networked systems community and the data-intensive sciences communities to work together. Please feel free to reach out to us (Jordi, Mahdi and me) if you want to join the hackathon or later. Thanks, Richard on behalf of the IETF 114 ALTO+FTS Hackathon Team On Tue, Jul 12, 2022 at 1:14 AM Jordi Ros Giralt <jros@qti.qualcomm.com> wrote: > Hi all, > > I have uploaded to the IETF Hackathon Wiki the project description for > ALTO. The proposed project is a natural evolution from the work done during > the 113 Hackathon. I want to also thank and credit Jensen for providing the > initial plan for the Hackathon. > > https://trac.ietf.org/trac/ietf/meeting/wiki/114hackathon > > You will also see that in addition to the ALTO hackathon, Ziyang will be > leading a second project under the name "The SDN-based MPTCP-aware and > MPQUIC-aware Transmission Control Model using ALTO". Many thanks Ziyang for > leading this very interesting project too. > > Jordi > On behalf of ALTO Hackathon group > _______________________________________________ > alto mailing list > alto@ietf.org > https://www.ietf.org/mailman/listinfo/alto >
- [alto] IETF 114 ALTO Hackathon projects Jordi Ros Giralt
- Re: [alto] IETF 114 ALTO Hackathon projects Y. Richard Yang
- Re: [alto] IETF 114 ALTO Hackathon projects Mihai Patrascoiu
- Re: [alto] IETF 114 ALTO Hackathon projects Y. Richard Yang
- Re: [alto] IETF 114 ALTO Hackathon projects Harvey Newman
- Re: [alto] IETF 114 ALTO Hackathon projects Mario Lassnig