Re: [ippm] [EXT] Re: Explicit Flow Measurements implementations

Nilo Massimo <massimo.nilo@telecomitalia.it> Tue, 23 March 2021 11:31 UTC

Return-Path: <massimo.nilo@telecomitalia.it>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E00773A0ED3 for <ippm@ietfa.amsl.com>; Tue, 23 Mar 2021 04:31:50 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.089
X-Spam-Level:
X-Spam-Status: No, score=-2.089 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, SPF_PASS=-0.001, T_REMOTE_IMAGE=0.01, URIBL_BLOCKED=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=telecomitalia.it
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id g81NyaftiuHm for <ippm@ietfa.amsl.com>; Tue, 23 Mar 2021 04:31:42 -0700 (PDT)
Received: from mx08.telecomitalia.it (mx08.telecomitalia.it [156.54.232.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 66A933A0EEB for <ippm@ietf.org>; Tue, 23 Mar 2021 04:31:40 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; d=telecomitalia.it; s=selector1; c=relaxed/relaxed; q=dns/txt; i=@telecomitalia.it; t=1616499092; x=2480412692; h=MIME-Version:From:Date:Message-ID:Subject:To; bh=D8oQQTW8GjIIfCcHxFNDRHq9iJZGPGBovgtF3HHRhQE=; b=ISXhAK789dsPGE7WBKaX14xKxDwwByjwvAQmDsJ/syPKniE281xqEcgMnvyCrlDM 2tJokgqxIqR0D48aKEtTF2Myb5ZB/7EBkLRmcWKrPICsPTu/PzTg4JGMi+CEdbII mmZM4yqFp30t+JoOb3RwApu+oqSk4Q0AVJWxAfbl+sgu8Jk4xT0O7k4WC+pkPXzM W2d2FqFvvDVLvRWZMAgYX5I5jir4C4eNYaMPCUNCOWsIOrFdcnkDgJjl/T656vQY DbZ/kRZVw1Dt5w9Ax+ojd8XffryL8j31SOHUTgRZd6vjR/ewho9UsFihaO7eqTbX Fhy03Y2dh8giGHlEgkRi4w==;
X-AuditID: 0a5a2d18-1c1c970000006e7b-d3-6059d194625e
Received: from TELMBXD15BA020.telecomitalia.local ( [10.90.43.81]) by mx08.telecomitalia.it () with SMTP id 4D.75.28283.491D9506; Tue, 23 Mar 2021 12:31:32 +0100 (CET)
From: Nilo Massimo <massimo.nilo@telecomitalia.it>
To: Ian Swett <ianswett=40google.com@dmarc.ietf.org>, Marcus Ihlar <marcus.ihlar@ericsson.com>, "Lubashev, Igor" <ilubashe@akamai.com>, "Dmitri Tikhonov" <dtikhonov@litespeedtech.com>, "alexandre.ferrieux@orange.com" <alexandre.ferrieux@orange.com>, Isabelle Hamchaoui <isabelle.hamchaoui@orange.com>
CC: "IETF IPPM WG (ippm@ietf.org)" <ippm@ietf.org>, "quic@ietf.org" <quic@ietf.org>, "explicit-meas@ietf.org" <explicit-meas@ietf.org>, "emile.stephan@orange.com" <emile.stephan@orange.com>, Mirja Kuehlewind <mirja.kuehlewind@ericsson.com>
Thread-Topic: [EXT] Re: Explicit Flow Measurements implementations
Thread-Index: Adcb7bJIyLvzSKs4Qxi8ut7TQxlpSQDdAK8AABmznAA=
Date: Tue, 23 Mar 2021 11:31:32 +0000
Message-ID: <b9d62224070a432fb6fb518169db5746@TELMBXC15BA020.telecomitalia.local>
References: <5e32f9e61db74620b4e08cb12b90311d@TELMBXC15BA020.telecomitalia.local> <CAKcm_gNE657KXC8P7pggYta99hFi4jPg076B4Ckfi1O2B1p4Uw@mail.gmail.com>
In-Reply-To: <CAKcm_gNE657KXC8P7pggYta99hFi4jPg076B4Ckfi1O2B1p4Uw@mail.gmail.com>
Accept-Language: it-IT, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
msip_labels: MSIP_Label_d6986fb0-3baa-42d2-89d5-89f9b25e6ac9_Enabled=true; MSIP_Label_d6986fb0-3baa-42d2-89d5-89f9b25e6ac9_SetDate=2021-03-23T11:31:30Z; MSIP_Label_d6986fb0-3baa-42d2-89d5-89f9b25e6ac9_Method=Standard; MSIP_Label_d6986fb0-3baa-42d2-89d5-89f9b25e6ac9_Name=Uso Interno; MSIP_Label_d6986fb0-3baa-42d2-89d5-89f9b25e6ac9_SiteId=6815f468-021c-48f2-a6b2-d65c8e979dfb; MSIP_Label_d6986fb0-3baa-42d2-89d5-89f9b25e6ac9_ActionId=8174c5b4-28c8-4dea-8ac5-e6259fdad43f; MSIP_Label_d6986fb0-3baa-42d2-89d5-89f9b25e6ac9_ContentBits=2
x-ms-exchange-transport-fromentityheader: Hosted
x-originating-ip: [10.115.6.17]
x-ti-disclaimer: ADBanner
Content-Type: multipart/alternative; boundary="_000_b9d62224070a432fb6fb518169db5746TELMBXC15BA020telecomit_"
MIME-Version: 1.0
X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFupik+LIzCtJLcpLzFFi42LhitIO1J1yMTLBoL/Z2GLZD3mLLxPYLA7u /8FisWTDWWaLhz+/Mlo0Naxgtuh58I7Z4tLBj+wWB1++YrXoXPqa3aJnAbcDt8fkIwuYPU4s u8Lq8evrVTaPJUt+Mnk82Xac2aPl2Um2ALaoBkabxLy8/JLEklSFlNTiZFsll8zi5JzEzNzU IgVHFyegZGqRkkJmiq2SmZJCQU5icmpual6JrVJiQUFqXoqSHZcCBrABKsvMU0jNS85PycxL t1XyDPbXtbAwtdQ1VLILLE0tLslXyE0tLk5MT8/MV0iYJ5rx4tM8poLWLsaK5ZsWszUwXqru YuTgkBAwkXi+k6OLkYtDSGAlo8Tu/r3sXYycHGwCRhKnV/xiBUmICGxhktjUNZsdxGEW+Moo 8fL3aVaQKmEBR4mrL38zgtgiAk4Sq5uWMUHYVhI7n85iBrFZBFQldi+aDWbzCgRK7Gr8zAKx bgajxL7Xy8AGcQIlJh5eD9bMKCArMWH3IrChzALiEreezAeLSwgISCzZc54ZwhaVePn4H9h5 vAILWSRmLbrMBpEwkNi6dB8LhC0v8WHyZKi4pMThw5vYIIbmS7zo7GCDuEhQ4uTMJywTGMVm Idk3C0nZLCRlEHE9iRtTp7BB2NoSyxa+ZoawdSVm/DvEgiy+gJF9FaNoboWBhV5Jak5qcn5u ZkliTmaiXmbJJkZw6tOV2MF45OIbvUOMTByMhxglOJiVRHhbwiMShHhTEiurUovy44tKc1KL DzH6AINyIrOUaHI+MPnmlcQbmpqZmhsbmZkamJpZ4hBWEuddsz0yQUggHZj2slNTC1KLYMYx cXBKNTCtDyqfLnkwfGXApSeR04SO2rXNLWZ4YPmC6Ws3+2YHPq9tC26f07l17s+TdtufXg/D F63LdHJjbK5R9+895fNtcxbzJobdLHIO/i8EzAomu771fK84e/flZU7Trom19Uk8eDCnqZaZ obVKxGfLgVjTjm2bZD482fHHkYXXqb1XtnbLx+J/9lclJjounGcx+5B+uYb9/oS0L3MTlDcy vLPMPuc7q2j9w3M7Lz+58ayE5Wfc1+XZVsHPH7vW8rKpcW52O9T56XyeUMovPuZSl6jzbd+M NZIj5pxlUdHyelmccNGv1Mqz4ublaSdXHK6N9H7Kv2NdqVtgx8Oje5QjFyU+OzvrRfy+rQGb JAwLI2YrsRRnJBpqMRcVJwIABC1WrR0EAAA=
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/cj-ul81vg2xiEZblnOmx8Nfj944>
X-Mailman-Approved-At: Tue, 23 Mar 2021 08:02:26 -0700
Subject: Re: [ippm] [EXT] Re: Explicit Flow Measurements implementations
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 23 Mar 2021 11:31:51 -0000

Hi Ian,
thank you for your reply.

As for our TIM activities, we will collect the material and in the next days we plan to share it via email in the IPPM WG.

Best Regards,
Massimo

____________________

TIM - Telecom Italia
Via G. Reiss Romoli, 274
10148 - Torino (Italy)
____________________

From: Ian Swett <ianswett=40google.com@dmarc.ietf.org>
Sent: lunedì 22 marzo 2021 23:24
To: Nilo Massimo <massimo.nilo@telecomitalia.it>
Cc: IETF IPPM WG (ippm@ietf.org) <ippm@ietf.org>rg>; quic@ietf.org; Dmitri Tikhonov <dtikhonov@litespeedtech.com>om>; Lubashev, Igor <ilubashe@akamai.com>om>; alexandre.ferrieux@orange.com; Isabelle Hamchaoui <isabelle.hamchaoui@orange.com>om>; explicit-meas@ietf.org; Mirja Kuehlewind <mirja.kuehlewind@ericsson.com>om>; emile.stephan@orange.com; Marcus Ihlar <marcus.ihlar@ericsson.com>
Subject: [EXT] Re: Explicit Flow Measurements implementations

Thanks for the summary.

Is there a plan to share(via email or presentation) what's been learned from those experiments with the IETF?  If they've been shared in the past and I forgot, please just add relevant links to this thread so they're easy for people to find.

Thanks, Ian

On Thu, Mar 18, 2021 at 7:57 AM Nilo Massimo <massimo.nilo=40telecomitalia.it@dmarc.ietf.org<mailto:40telecomitalia.it@dmarc.ietf.org>> wrote:
Hi All.

After the "Explicit Flow Measurements" draft presentation (https://datatracker.ietf.org/doc/html/draft-mdt-ippm-explicit-flow-measurements-01) in the IPPM WG on March 12th, it was asked by Ian Sweet and Martin Duke if there are any implementations of the EFM methodology on servers and clients.

Here is a list of some implementations made by the authors of the draft.

TIM/Telecom Italia has realized an implementation for delay measurement with:
- a client and a passive observer on mobile user devices, built in Android using Quic-Go (with gomobile binding) and spindump library.
  The observer executes delay measurements, both with Spin bit and Delay bit marking methods.
  The client app exchange QUIC traffic marked for Spin bit/Delay bit versus a server.

- a server built by mean of Quic-Go, generates marked traffic and supports delay measurements with Spin bit and Delay bit methods.

  (Draft https://datatracker.ietf.org/doc/html/draft-cnbf-ippm-user-devices-explicit-monitoring-01)
  This implementation have been tested on TIM production network, both with mobile and fixed access.

- Other implementations for loss algorithms (QR and T) have been tested in our lab with good results and we are planning to move them in production network for some services under our control.

Akamai and Orange have built a monitoring system with QL marking, specifically for loss measurements.
Their implementation has already been used in CDN servers to make EFM.
Litespeed Tech also implemented QL marking in their lsquic library.

Moreover, Ericsson is carrying out several monitoring initiatives using the SpinBit for delay EFM.

Best Regards,
Massimo and Fabio
 ____________________
TIM - Telecom Italia
Via G. Reiss Romoli, 274
10148 - Torino (Italy)
____________________


TIM - Uso Interno - Tutti i diritti riservati.

Questo messaggio e i suoi allegati sono indirizzati esclusivamente alle persone indicate. La diffusione, copia o qualsiasi altra azione derivante dalla conoscenza di queste informazioni sono rigorosamente vietate. Qualora abbiate ricevuto questo documento per errore siete cortesemente pregati di darne immediata comunicazione al mittente e di provvedere alla sua distruzione, Grazie. 

This e-mail and any attachments is confidential and may contain privileged information intended for the addressee(s) only. Dissemination, copying, printing or use by anybody else is unauthorised. If you are not the intended recipient, please delete this message and any attachments and advise the sender by return e-mail, Thanks. 

Rispetta l'ambiente. Non stampare questa mail se non è necessario.