Re: [ippm] [EXT] Re: Explicit Flow Measurements implementations

Ian Swett <ianswett@google.com> Tue, 23 March 2021 13:32 UTC

Return-Path: <ianswett@google.com>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F0C9D3A0AB5 for <ippm@ietfa.amsl.com>; Tue, 23 Mar 2021 06:32:07 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -17.589
X-Spam-Level:
X-Spam-Status: No, score=-17.589 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, ENV_AND_HDR_SPF_MATCH=-0.5, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_REMOTE_IMAGE=0.01, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5, USER_IN_DEF_SPF_WL=-7.5] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=google.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Va2RUQg8K2sA for <ippm@ietfa.amsl.com>; Tue, 23 Mar 2021 06:32:03 -0700 (PDT)
Received: from mail-wm1-x32d.google.com (mail-wm1-x32d.google.com [IPv6:2a00:1450:4864:20::32d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id E7A3B3A09E0 for <ippm@ietf.org>; Tue, 23 Mar 2021 06:32:02 -0700 (PDT)
Received: by mail-wm1-x32d.google.com with SMTP id z6-20020a1c4c060000b029010f13694ba2so10821809wmf.5 for <ippm@ietf.org>; Tue, 23 Mar 2021 06:32:02 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=l2+F+jgaEDorc2WHPRMGND9odYLU8DJXnB6N6ME3Hps=; b=G1XS9itWei4aYN3LMUKZfwVqny55OVe3hWy3Xs6Sm20OiGs3oH/7k9dBj5nckz14U2 gnbhxZjY86hPoVUcqfkyGHCwXur4sbQYq/2OUCiIg73/viUj2vv1KJE1zwSbwrNCjXYi 6nAEw8kIe+imudfQTZ19cMDhjTW3NTBBLBjeKJ0b7er5DrufLbjqVyvZi6Ug6M/pnFAq T3DJh95cXIo5ge55neobqJTTeZr874ITmxzXCnuhLVJZBKmhH8byaWoocx4c7NXscVhp zaAhNiPFvndjIMF7ObAk/mYO7LMH84Cv9Is8++dp32QjP6boE/bXmQBRKxR0+mo51Ptb Cbbg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=l2+F+jgaEDorc2WHPRMGND9odYLU8DJXnB6N6ME3Hps=; b=GXU4xnjVSMiTZIwrFRAxIv5jOCLlv62P0h06n67K9Z0IFNIrL6p5rGf1aQzwbMmmR7 wJGzSzeHdp9PBZGYO/vIc2cp8Yun3t5zLSzdoa6Bi1TRYVcRcXb3gh2OTbpg2J7jkJe1 7rr6hxQ8zyUpGJ4BwNsb0nGYdOJ5a7qZuDZhGlQJLrRJxY0qEiPHmx3XBMCQnjd0RENM GAWmxKLUOhk4tUPMsaMVRm+qwVNAseUGBS5FktVcMSCU1O3bLVsNgXXg+Lypq24rjXFR 8Dp0TFnGOYckczEtHNB6rgI+9Habj+dC+29kmvH9lg7TxN/f/nutYdwsSJJY0qwPW5YP B4hw==
X-Gm-Message-State: AOAM532GyZkRCyiRlXeIYOWw7XbkCFV0wQmTpyvI7QMJnFLSupRWgEea 9cI+TAV8q6wE/jFRC4J3WKDk12OSrMCUbdnke6v8CA==
X-Google-Smtp-Source: ABdhPJxhlp17vV6bk8VLNMPH18uO1VzpzM/B192144XTpQCGDvs9zU0prXMnH3g5kzMFi8GeYNR/jTKGIkNGA9k44Lw=
X-Received: by 2002:a05:600c:4108:: with SMTP id j8mr3297876wmi.183.1616506316209; Tue, 23 Mar 2021 06:31:56 -0700 (PDT)
MIME-Version: 1.0
References: <5e32f9e61db74620b4e08cb12b90311d@TELMBXC15BA020.telecomitalia.local> <CAKcm_gNE657KXC8P7pggYta99hFi4jPg076B4Ckfi1O2B1p4Uw@mail.gmail.com> <b9d62224070a432fb6fb518169db5746@TELMBXC15BA020.telecomitalia.local>
In-Reply-To: <b9d62224070a432fb6fb518169db5746@TELMBXC15BA020.telecomitalia.local>
From: Ian Swett <ianswett@google.com>
Date: Tue, 23 Mar 2021 09:31:44 -0400
Message-ID: <CAKcm_gMojJwOSeuTpeUr1QiEJ=2y6m6BNZANR0KxeqwLaMnT5A@mail.gmail.com>
To: Nilo Massimo <massimo.nilo=40telecomitalia.it@dmarc.ietf.org>
Cc: Marcus Ihlar <marcus.ihlar@ericsson.com>, "Lubashev, Igor" <ilubashe@akamai.com>, Dmitri Tikhonov <dtikhonov@litespeedtech.com>, "alexandre.ferrieux@orange.com" <alexandre.ferrieux@orange.com>, Isabelle Hamchaoui <isabelle.hamchaoui@orange.com>, "IETF IPPM WG (ippm@ietf.org)" <ippm@ietf.org>, "quic@ietf.org" <quic@ietf.org>, "explicit-meas@ietf.org" <explicit-meas@ietf.org>, "emile.stephan@orange.com" <emile.stephan@orange.com>, Mirja Kuehlewind <mirja.kuehlewind@ericsson.com>
Content-Type: multipart/alternative; boundary="000000000000c1bc6f05be3434c4"
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/RZG3Iuuf3o30TZ4hg0jdt5aSLDA>
X-Mailman-Approved-At: Tue, 23 Mar 2021 08:02:26 -0700
Subject: Re: [ippm] [EXT] Re: Explicit Flow Measurements implementations
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 23 Mar 2021 13:32:12 -0000

Great, thanks!

On Tue, Mar 23, 2021 at 7:31 AM Nilo Massimo <massimo.nilo=
40telecomitalia.it@dmarc.ietf.org> wrote:

> Hi Ian,
>
> thank you for your reply.
>
>
>
> As for our TIM activities, we will collect the material and in the next
> days we plan to share it via email in the IPPM WG.
>
>
>
> Best Regards,
>
> Massimo
>
>
>
> ____________________
>
>
>
> TIM - Telecom Italia
>
> Via G. Reiss Romoli, 274
>
> 10148 - Torino (Italy)
>
> ____________________
>
>
>
> *From:* Ian Swett <ianswett=40google.com@dmarc.ietf.org>
> *Sent:* lunedì 22 marzo 2021 23:24
> *To:* Nilo Massimo <massimo.nilo@telecomitalia.it>
> *Cc:* IETF IPPM WG (ippm@ietf.org) <ippm@ietf.org>; quic@ietf.org; Dmitri
> Tikhonov <dtikhonov@litespeedtech.com>; Lubashev, Igor <
> ilubashe@akamai.com>; alexandre.ferrieux@orange.com; Isabelle Hamchaoui <
> isabelle.hamchaoui@orange.com>; explicit-meas@ietf.org; Mirja Kuehlewind <
> mirja.kuehlewind@ericsson.com>; emile.stephan@orange.com; Marcus Ihlar <
> marcus.ihlar@ericsson.com>
> *Subject:* [EXT] Re: Explicit Flow Measurements implementations
>
>
>
> Thanks for the summary.
>
>
>
> Is there a plan to share(via email or presentation) what's been learned
> from those experiments with the IETF?  If they've been shared in the past
> and I forgot, please just add relevant links to this thread so they're easy
> for people to find.
>
>
>
> Thanks, Ian
>
>
>
> On Thu, Mar 18, 2021 at 7:57 AM Nilo Massimo <massimo.nilo=
> 40telecomitalia.it@dmarc.ietf.org> wrote:
>
> Hi All.
>
>
>
> After the "Explicit Flow Measurements" draft presentation (
> https://datatracker.ietf.org/doc/html/draft-mdt-ippm-explicit-flow-measurements-01)
> in the IPPM WG on March 12th, it was asked by Ian Sweet and Martin Duke if
> there are any implementations of the EFM methodology on servers and clients.
>
>
>
> Here is a list of some implementations made by the authors of the draft.
>
>
>
> TIM/Telecom Italia has realized an implementation for delay measurement
> with:
>
> - a client and a passive observer on mobile user devices, built in Android
> using Quic-Go (with gomobile binding) and spindump library.
>
>   The observer executes delay measurements, both with Spin bit and Delay
> bit marking methods.
>
>   The client app exchange QUIC traffic marked for Spin bit/Delay bit
> versus a server.
>
>
>
> - a server built by mean of Quic-Go, generates marked traffic and supports
> delay measurements with Spin bit and Delay bit methods.
>
>
>
>   (Draft
> https://datatracker.ietf.org/doc/html/draft-cnbf-ippm-user-devices-explicit-monitoring-01
> )
>
>   This implementation have been tested on TIM production network, both
> with mobile and fixed access.
>
>
>
> - Other implementations for loss algorithms (QR and T) have been tested in
> our lab with good results and we are planning to move them in production
> network for some services under our control.
>
>
>
> Akamai and Orange have built a monitoring system with QL marking,
> specifically for loss measurements.
>
> Their implementation has already been used in CDN servers to make EFM.
>
> Litespeed Tech also implemented QL marking in their lsquic library.
>
>
>
> Moreover, Ericsson is carrying out several monitoring initiatives using
> the SpinBit for delay EFM.
>
>
>
> Best Regards,
>
> Massimo and Fabio
>
>  ____________________
>
> TIM - Telecom Italia
>
> Via G. Reiss Romoli, 274
>
> 10148 - Torino (Italy)
>
> ____________________
>
>
>
> TIM - Uso Interno - Tutti i diritti riservati.
>
>
> ------------------------------
> <https://on.tim.it/banner-mail-dip>
> Questo messaggio e i suoi allegati sono indirizzati esclusivamente alle
> persone indicate. La diffusione, copia o qualsiasi altra azione derivante
> dalla conoscenza di queste informazioni sono rigorosamente vietate. Qualora
> abbiate ricevuto questo documento per errore siete cortesemente pregati di
> darne immediata comunicazione al mittente e di provvedere alla sua
> distruzione, Grazie.
>
> * This e-mail and any attachments is confidential and may contain
> privileged information intended for the addressee(s) only. Dissemination,
> copying, printing or use by anybody else is unauthorised. If you are not
> the intended recipient, please delete this message and any attachments and
> advise the sender by return e-mail, Thanks. *
>
> *Rispetta l'ambiente. Non stampare questa mail se non è necessario.*
>