From nobody Tue Mar 23 04:32:53 2021 Return-Path: X-Original-To: explicit-meas@ietfa.amsl.com Delivered-To: explicit-meas@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 7933D3A0EDB for ; Tue, 23 Mar 2021 04:31:50 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -2.089 X-Spam-Level: X-Spam-Status: No, score=-2.089 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, SPF_PASS=-0.001, T_REMOTE_IMAGE=0.01, URIBL_BLOCKED=0.001] autolearn=unavailable autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=telecomitalia.it Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Rn40S-k1pnZb for ; Tue, 23 Mar 2021 04:31:41 -0700 (PDT) Received: from mx08.telecomitalia.it (mx08.telecomitalia.it [156.54.232.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 81E1E3A0EE5 for ; Tue, 23 Mar 2021 04:31:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; d=telecomitalia.it; s=selector1; c=relaxed/relaxed; q=dns/txt; i=@telecomitalia.it; t=1616499092; x=2480412692; h=MIME-Version:From:Date:Message-ID:Subject:To; bh=D8oQQTW8GjIIfCcHxFNDRHq9iJZGPGBovgtF3HHRhQE=; b=ISXhAK789dsPGE7WBKaX14xKxDwwByjwvAQmDsJ/syPKniE281xqEcgMnvyCrlDM 2tJokgqxIqR0D48aKEtTF2Myb5ZB/7EBkLRmcWKrPICsPTu/PzTg4JGMi+CEdbII mmZM4yqFp30t+JoOb3RwApu+oqSk4Q0AVJWxAfbl+sgu8Jk4xT0O7k4WC+pkPXzM W2d2FqFvvDVLvRWZMAgYX5I5jir4C4eNYaMPCUNCOWsIOrFdcnkDgJjl/T656vQY DbZ/kRZVw1Dt5w9Ax+ojd8XffryL8j31SOHUTgRZd6vjR/ewho9UsFihaO7eqTbX Fhy03Y2dh8giGHlEgkRi4w==; X-AuditID: 0a5a2d18-1c1c970000006e7b-d3-6059d194625e Received: from TELMBXD15BA020.telecomitalia.local ( [10.90.43.81]) by mx08.telecomitalia.it () with SMTP id 4D.75.28283.491D9506; Tue, 23 Mar 2021 12:31:32 +0100 (CET) From: Nilo Massimo To: Ian Swett , Marcus Ihlar , "Lubashev, Igor" , "Dmitri Tikhonov" , "alexandre.ferrieux@orange.com" , Isabelle Hamchaoui CC: "IETF IPPM WG (ippm@ietf.org)" , "quic@ietf.org" , "explicit-meas@ietf.org" , "emile.stephan@orange.com" , Mirja Kuehlewind Thread-Topic: [EXT] Re: Explicit Flow Measurements implementations Thread-Index: Adcb7bJIyLvzSKs4Qxi8ut7TQxlpSQDdAK8AABmznAA= Date: Tue, 23 Mar 2021 11:31:32 +0000 Message-ID: References: <5e32f9e61db74620b4e08cb12b90311d@TELMBXC15BA020.telecomitalia.local> In-Reply-To: Accept-Language: it-IT, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: MSIP_Label_d6986fb0-3baa-42d2-89d5-89f9b25e6ac9_Enabled=true; MSIP_Label_d6986fb0-3baa-42d2-89d5-89f9b25e6ac9_SetDate=2021-03-23T11:31:30Z; MSIP_Label_d6986fb0-3baa-42d2-89d5-89f9b25e6ac9_Method=Standard; MSIP_Label_d6986fb0-3baa-42d2-89d5-89f9b25e6ac9_Name=Uso Interno; MSIP_Label_d6986fb0-3baa-42d2-89d5-89f9b25e6ac9_SiteId=6815f468-021c-48f2-a6b2-d65c8e979dfb; MSIP_Label_d6986fb0-3baa-42d2-89d5-89f9b25e6ac9_ActionId=8174c5b4-28c8-4dea-8ac5-e6259fdad43f; MSIP_Label_d6986fb0-3baa-42d2-89d5-89f9b25e6ac9_ContentBits=2 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.115.6.17] x-ti-disclaimer: ADBanner Content-Type: multipart/alternative; boundary="_000_b9d62224070a432fb6fb518169db5746TELMBXC15BA020telecomit_" MIME-Version: 1.0 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFupik+LIzCtJLcpLzFFi42LhitIO1J1yMTLBoL/Z2GLZD3mLLxPYLA7u /8FisWTDWWaLhz+/Mlo0Naxgtuh58I7Z4tLBj+wWB1++YrXoXPqa3aJnAbcDt8fkIwuYPU4s u8Lq8evrVTaPJUt+Mnk82Xac2aPl2Um2ALaoBkabxLy8/JLEklSFlNTiZFsll8zi5JzEzNzU IgVHFyegZGqRkkJmiq2SmZJCQU5icmpual6JrVJiQUFqXoqSHZcCBrABKsvMU0jNS85PycxL t1XyDPbXtbAwtdQ1VLILLE0tLslXyE0tLk5MT8/MV0iYJ5rx4tM8poLWLsaK5ZsWszUwXqru YuTgkBAwkXi+k6OLkYtDSGAlo8Tu/r3sXYycHGwCRhKnV/xiBUmICGxhktjUNZsdxGEW+Moo 8fL3aVaQKmEBR4mrL38zgtgiAk4Sq5uWMUHYVhI7n85iBrFZBFQldi+aDWbzCgRK7Gr8zAKx bgajxL7Xy8AGcQIlJh5eD9bMKCArMWH3IrChzALiEreezAeLSwgISCzZc54ZwhaVePn4H9h5 vAILWSRmLbrMBpEwkNi6dB8LhC0v8WHyZKi4pMThw5vYIIbmS7zo7GCDuEhQ4uTMJywTGMVm Idk3C0nZLCRlEHE9iRtTp7BB2NoSyxa+ZoawdSVm/DvEgiy+gJF9FaNoboWBhV5Jak5qcn5u ZkliTmaiXmbJJkZw6tOV2MF45OIbvUOMTByMhxglOJiVRHhbwiMShHhTEiurUovy44tKc1KL DzH6AINyIrOUaHI+MPnmlcQbmpqZmhsbmZkamJpZ4hBWEuddsz0yQUggHZj2slNTC1KLYMYx cXBKNTCtDyqfLnkwfGXApSeR04SO2rXNLWZ4YPmC6Ws3+2YHPq9tC26f07l17s+TdtufXg/D F63LdHJjbK5R9+895fNtcxbzJobdLHIO/i8EzAomu771fK84e/flZU7Trom19Uk8eDCnqZaZ obVKxGfLgVjTjm2bZD482fHHkYXXqb1XtnbLx+J/9lclJjounGcx+5B+uYb9/oS0L3MTlDcy vLPMPuc7q2j9w3M7Lz+58ayE5Wfc1+XZVsHPH7vW8rKpcW52O9T56XyeUMovPuZSl6jzbd+M NZIj5pxlUdHyelmccNGv1Mqz4ublaSdXHK6N9H7Kv2NdqVtgx8Oje5QjFyU+OzvrRfy+rQGb JAwLI2YrsRRnJBpqMRcVJwIABC1WrR0EAAA= Archived-At: X-Mailman-Approved-At: Tue, 23 Mar 2021 04:32:51 -0700 Subject: Re: [Explicit-meas] [EXT] Re: Explicit Flow Measurements implementations X-BeenThere: explicit-meas@ietf.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "This mailing list is intended for discussions relating to Explicit Flow Measurements Techniques." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Mar 2021 11:31:50 -0000 --_000_b9d62224070a432fb6fb518169db5746TELMBXC15BA020telecomit_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hi Ian, thank you for your reply. As for our TIM activities, we will collect the material and in the next days= we plan to share it via email in the IPPM WG. Best Regards, Massimo ____________________ TIM - Telecom Italia Via G. Reiss Romoli, 274 10148 - Torino (Italy) ____________________ From: Ian Swett Sent: luned=EC 22 marzo 2021 23:24 To: Nilo Massimo Cc: IETF IPPM WG (ippm@ietf.org) ; quic@ietf.org; Dmitri Tikh= onov ; Lubashev, Igor ; al= exandre.ferrieux@orange.com; Isabelle Hamchaoui ; explicit-meas@ietf.org; Mirja Kuehlewind ; emile.stephan@orange.com; Marcus Ihlar Subject: [EXT] Re: Explicit Flow Measurements implementations Thanks for the summary. Is there a plan to share(via email or presentation) what's been learned from= those experiments with the IETF? If they've been shared in the past and I= forgot, please just add relevant links to this thread so they're easy for p= eople to find. Thanks, Ian On Thu, Mar 18, 2021 at 7:57 AM Nilo Massimo > wrote: Hi All. After the "Explicit Flow Measurements" draft presentation (https://datatrack= er.ietf.org/doc/html/draft-mdt-ippm-explicit-flow-measurements-01) in the IP= PM WG on March 12th, it was asked by Ian Sweet and Martin Duke if there are= any implementations of the EFM methodology on servers and clients. Here is a list of some implementations made by the authors of the draft. TIM/Telecom Italia has realized an implementation for delay measurement with= : - a client and a passive observer on mobile user devices, built in Android u= sing Quic-Go (with gomobile binding) and spindump library. The observer executes delay measurements, both with Spin bit and Delay bit= marking methods. The client app exchange QUIC traffic marked for Spin bit/Delay bit versus= a server. - a server built by mean of Quic-Go, generates marked traffic and supports d= elay measurements with Spin bit and Delay bit methods. (Draft https://datatracker.ietf.org/doc/html/draft-cnbf-ippm-user-devices-= explicit-monitoring-01) This implementation have been tested on TIM production network, both with= mobile and fixed access. - Other implementations for loss algorithms (QR and T) have been tested in o= ur lab with good results and we are planning to move them in production netw= ork for some services under our control. Akamai and Orange have built a monitoring system with QL marking, specifical= ly for loss measurements. Their implementation has already been used in CDN servers to make EFM. Litespeed Tech also implemented QL marking in their lsquic library. Moreover, Ericsson is carrying out several monitoring initiatives using the= SpinBit for delay EFM. Best Regards, Massimo and Fabio ____________________ TIM - Telecom Italia Via G. Reiss Romoli, 274 10148 - Torino (Italy) ____________________ TIM - Uso Interno - Tutti i diritti riservati. Questo messaggio e i suoi allegati sono indirizzati esclusivamente alle pers= one indicate. La diffusione, copia o qualsiasi altra azione derivante dalla= conoscenza di queste informazioni sono rigorosamente vietate. Qualora abbia= te ricevuto questo documento per errore siete cortesemente pregati di darne= immediata comunicazione al mittente e di provvedere alla sua distruzione, G= razie. This e-mail and any attachments is confidential and may contain privileged i= nformation intended for the addressee(s) only. Dissemination, copying, print= ing or use by anybody else is unauthorised. If you are not the intended reci= pient, please delete this message and any attachments and advise the sender= by return e-mail, Thanks. Rispetta l'ambiente. Non stampare questa mail se non =E8 necessario. --_000_b9d62224070a432fb6fb518169db5746TELMBXC15BA020telecomit_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable

Hi Ian,

thank you for your reply.

 = ;

As for our TIM activities, we will collect the material and in the next= days we plan to share it via email in the IPPM WG.

 

Best Regards,

Massimo

 = ;

__________= __________

 = ;

TIM - Tele= com Italia

Via G. Rei= ss Romoli, 274

10148 - To= rino (Italy)

__________= __________

 = ;

From: Ian Swett <ianswett=3D40google.com@dmarc.ietf.org>
Sent: luned=EC 22 marzo 2021 23:24
To: Nilo Massimo <massimo.nilo@telecomitalia.it>
Cc: IETF IPPM WG (ippm@ietf.org) <ippm@ietf.org>; quic@ietf.org= ; Dmitri Tikhonov <dtikhonov@litespeedtech.com>; Lubashev, Igor <il= ubashe@akamai.com>; alexandre.ferrieux@orange.com; Isabelle Hamchaoui <= ;isabelle.hamchaoui@orange.com>; explicit-meas@ietf.org; Mirja Kuehlewind <mirja.kuehlewind@ericsson.com>; emile.stephan@orang= e.com; Marcus Ihlar <marcus.ihlar@ericsson.com>
Subject: [EXT] Re: Explicit Flow Measurements implementations

 

Thanks for the summary.

 

Is there a plan to share(via email or presentation) w= hat's been learned from those experiments with the IETF?  If they've be= en shared in the past and I forgot, please just add relevant links to this t= hread so they're easy for people to find.

 

Thanks, Ian

 

On Thu, Mar 18, 2021 at 7:57 AM Nilo Massimo <mass= imo.nilo=3D40telecomita= lia.it@dmarc.ietf.org> wrote:

Hi All.<= /span>

 

After th= e "Explicit Flow Measurements" draft presentation (https://datatracker.ietf.org/doc/= html/draft-mdt-ippm-explicit-flow-measurements-01) in the IPPM WG on March 12th, it was asked by Ian Sweet and Martin Duke if= there are any implementations of the EFM methodology on servers and clients= .

 

Here is= a list of some implementations made by the authors of the draft.

 

TIM/Tele= com Italia has realized an implementation for delay measurement with:=

- a clie= nt and a passive observer on mobile user devices, built in Android using Qui= c-Go (with gomobile binding) and spindump library.

  T= he observer executes delay measurements, both with Spin bit and Delay bit ma= rking methods.

  T= he client app exchange QUIC traffic marked for Spin bit/Delay bit versus a s= erver.

 

- a serv= er built by mean of Quic-Go, generates marked traffic and supports dela= y measurements with Spin bit and Delay bit methods.

 

 &n= bsp;(Draft https://dat= atracker.ietf.org/doc/html/draft-cnbf-ippm-user-devices-explicit-monitoring-= 01)

 &n= bsp;This implementation have been tested on TIM production network, both wit= h mobile and fixed access.

 

- O= ther implementations for loss algorithms (QR and T) have been tested in= our lab with good results and we are planning to move them in production network for some services under our control.

 

Akamai a= nd Orange have built a monitoring system with QL marking, specifically= for loss measurements.

Their implemen= tation has already been used in CDN servers to make EFM.

Litespee= d Tech also implemented QL marking in their lsquic library.

 

Moreover= , Ericsson is carrying out several monitoring initiatives using the SpinBit= for delay EFM.

 

Best Reg= ards,

Massimo and Fabio

 ____________________

TIM - Telecom Italia

Via G. Reiss Romoli, 274

10148 - Torino (Italy)<= /o:p>

____________________

 

TIM - Uso Interno - Tutti i diritti riservati.


Questo messaggio e i suoi allegati sono indirizzati esclusivamente alle= persone indicate. La diffusione, copia o qualsiasi altra azione derivante d= alla conoscenza di queste informazioni sono rigorosamente vietate. Qualora a= bbiate ricevuto questo documento per errore siete cortesemente pregati di da= rne immediata comunicazione al mittente e di provvedere alla sua distruzione= , Grazie.

This e-mail and any attachments is confidential and may contain privil= eged information intended for the addressee(s) only. Dissemination, copying,= printing or use by anybody else is unauthorised. If you are not the intende= d recipient, please delete this message and any attachments and advise the s= ender by return e-mail, Thanks.

Rispetta l'ambiente. Non stampare questa mail se non è necessa= rio.
--_000_b9d62224070a432fb6fb518169db5746TELMBXC15BA020telecomit_--