Re: [Explicit-meas] Explicit Flow Measurements implementations

Ian Swett <ianswett@google.com> Mon, 22 March 2021 22:24 UTC

Return-Path: <ianswett@google.com>
X-Original-To: explicit-meas@ietfa.amsl.com
Delivered-To: explicit-meas@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3E6343A1438 for <explicit-meas@ietfa.amsl.com>; Mon, 22 Mar 2021 15:24:42 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -15.689
X-Spam-Level:
X-Spam-Status: No, score=-15.689 tagged_above=-999 required=5 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, ENV_AND_HDR_SPF_MATCH=-0.5, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_REMOTE_IMAGE=0.01, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5, USER_IN_DEF_SPF_WL=-7.5] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=google.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id tEiPFPZBSDU5 for <explicit-meas@ietfa.amsl.com>; Mon, 22 Mar 2021 15:24:38 -0700 (PDT)
Received: from mail-wm1-x330.google.com (mail-wm1-x330.google.com [IPv6:2a00:1450:4864:20::330]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 237E93A1458 for <explicit-meas@ietf.org>; Mon, 22 Mar 2021 15:24:33 -0700 (PDT)
Received: by mail-wm1-x330.google.com with SMTP id z6-20020a1c4c060000b029010f13694ba2so9763476wmf.5 for <explicit-meas@ietf.org>; Mon, 22 Mar 2021 15:24:32 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=rC9UWVZu8lgIZ6MtYCwbdgDE/NOyLDp0F3V+abRTwhw=; b=hck8DUuqO72irtcOLJxJkGdssn2bXCE4LUk8NAcJ0LV6kAy884/DZP67+Y3KfX8JLI 2hgT2kovlJz0bYaP7BwpBnKB/KemrpqqZ5ve9k9+QE801xIUaTW8WJgdJMX+uiiHIdaT 0my1kZ4fvws0isNV8BB0Fbl/j3chuCg8Htgo6wTYf1vaM+uVsUwExD6iceqd4RDW5hDy hngni0oPp/enevg9XqArCsiBsQI7E1+Oz4fS09CX/QpnQgXTnbXSmDAqQvsaocMehaGJ rv1YpisJbS2zGBu7FwqXOs7xPZvUoGpwE8ls1VbXwQwhsNFFnrmObfnqvQ+zePc4a8H2 /Rew==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=rC9UWVZu8lgIZ6MtYCwbdgDE/NOyLDp0F3V+abRTwhw=; b=k4eIioUMQNt0BbYLcB4z0/1EHVtAhj45EViesYDFClhKQbKFe0KeVn6buRaLKJsFya t6RyltQWY+TewvRrt4wRN9tHTbPgOKMfjtsF+AhmHl4/mD1oS3VXKur9Ipf7twAOAklk +KydV6kZN8TN8vHg1SzmYSHT+CYaQM4kWCQZUGmiOyRmMfcqpvXGM8Q3MmtEP+menYfK ZvYf2z0OfK6Hi1sIG1Un+UjX71G+MKKr4/XLMh0lVNb2B0jS0EUxDfZxad6OOXDu+UMN Mmzeec239PyIK0Z3hTBNUOGzTuIV0VmJCAEg5HN4Y/YCvW7xqDRDdZ/YF30T8LjoM1Te TlUQ==
X-Gm-Message-State: AOAM530h4g+dq9GLmnKyHHGXCMea+v2MyaK5MLyNGkvbWVeGlScxMUyH hRX2XfEY0yyhN6CKZgKaW/BOMR26Eieml1DaT5SZEg==
X-Google-Smtp-Source: ABdhPJzt6ufmhfdruLgx3jbJxXYRdQm2nJ/ceyMCOHBktCuZT3SUWH/tPoTtHnEYYOcNgf/weobqS7ixKkwwTzHmmVk=
X-Received: by 2002:a05:600c:4108:: with SMTP id j8mr462928wmi.183.1616451866301; Mon, 22 Mar 2021 15:24:26 -0700 (PDT)
MIME-Version: 1.0
References: <5e32f9e61db74620b4e08cb12b90311d@TELMBXC15BA020.telecomitalia.local>
In-Reply-To: <5e32f9e61db74620b4e08cb12b90311d@TELMBXC15BA020.telecomitalia.local>
From: Ian Swett <ianswett@google.com>
Date: Mon, 22 Mar 2021 18:24:14 -0400
Message-ID: <CAKcm_gNE657KXC8P7pggYta99hFi4jPg076B4Ckfi1O2B1p4Uw@mail.gmail.com>
To: Nilo Massimo <massimo.nilo=40telecomitalia.it@dmarc.ietf.org>
Cc: "IETF IPPM WG (ippm@ietf.org)" <ippm@ietf.org>, "quic@ietf.org" <quic@ietf.org>, Dmitri Tikhonov <dtikhonov@litespeedtech.com>, "Lubashev, Igor" <ilubashe@akamai.com>, "alexandre.ferrieux@orange.com" <alexandre.ferrieux@orange.com>, Isabelle Hamchaoui <isabelle.hamchaoui@orange.com>, "explicit-meas@ietf.org" <explicit-meas@ietf.org>, Mirja Kuehlewind <mirja.kuehlewind@ericsson.com>, "emile.stephan@orange.com" <emile.stephan@orange.com>, Marcus Ihlar <marcus.ihlar@ericsson.com>
Content-Type: multipart/alternative; boundary="00000000000049ff7a05be278750"
Archived-At: <https://mailarchive.ietf.org/arch/msg/explicit-meas/0ai2pHuqFQfPbnhZdXrYTYO261w>
X-Mailman-Approved-At: Mon, 22 Mar 2021 23:35:48 -0700
Subject: Re: [Explicit-meas] Explicit Flow Measurements implementations
X-BeenThere: explicit-meas@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "This mailing list is intended for discussions relating to Explicit Flow Measurements Techniques." <explicit-meas.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/explicit-meas>, <mailto:explicit-meas-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/explicit-meas/>
List-Post: <mailto:explicit-meas@ietf.org>
List-Help: <mailto:explicit-meas-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/explicit-meas>, <mailto:explicit-meas-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 22 Mar 2021 22:24:47 -0000

Thanks for the summary.

Is there a plan to share(via email or presentation) what's been learned
from those experiments with the IETF?  If they've been shared in the past
and I forgot, please just add relevant links to this thread so they're easy
for people to find.

Thanks, Ian

On Thu, Mar 18, 2021 at 7:57 AM Nilo Massimo <massimo.nilo=
40telecomitalia.it@dmarc.ietf.org> wrote:

> Hi All.
>
>
>
> After the "Explicit Flow Measurements" draft presentation (
> https://datatracker.ietf.org/doc/html/draft-mdt-ippm-explicit-flow-measurements-01)
> in the IPPM WG on March 12th, it was asked by Ian Sweet and Martin Duke if
> there are any implementations of the EFM methodology on servers and clients.
>
>
>
> Here is a list of some implementations made by the authors of the draft.
>
>
>
> TIM/Telecom Italia has realized an implementation for delay measurement
> with:
>
> - a client and a passive observer on mobile user devices, built in Android
> using Quic-Go (with gomobile binding) and spindump library.
>
>   The observer executes delay measurements, both with Spin bit and Delay
> bit marking methods.
>
>   The client app exchange QUIC traffic marked for Spin bit/Delay bit
> versus a server.
>
>
>
> - a server built by mean of Quic-Go, generates marked traffic and supports
> delay measurements with Spin bit and Delay bit methods.
>
>
>
>   (Draft
> https://datatracker.ietf.org/doc/html/draft-cnbf-ippm-user-devices-explicit-monitoring-01
> )
>
>   This implementation have been tested on TIM production network, both
> with mobile and fixed access.
>
>
>
> - Other implementations for loss algorithms (QR and T) have been tested in
> our lab with good results and we are planning to move them in production
> network for some services under our control.
>
>
>
> Akamai and Orange have built a monitoring system with QL marking,
> specifically for loss measurements.
>
> Their implementation has already been used in CDN servers to make EFM.
>
> Litespeed Tech also implemented QL marking in their lsquic library.
>
>
>
> Moreover, Ericsson is carrying out several monitoring initiatives using
> the SpinBit for delay EFM.
>
>
>
> Best Regards,
>
> Massimo and Fabio
>
>
>
> ____________________
>
> TIM - Telecom Italia
>
> Via G. Reiss Romoli, 274
>
> 10148 - Torino (Italy)
>
> ____________________
>
>
>
> TIM - Uso Interno - Tutti i diritti riservati.
>
> ------------------------------
> <https://on.tim.it/banner-mail-dip>
> Questo messaggio e i suoi allegati sono indirizzati esclusivamente alle
> persone indicate. La diffusione, copia o qualsiasi altra azione derivante
> dalla conoscenza di queste informazioni sono rigorosamente vietate. Qualora
> abbiate ricevuto questo documento per errore siete cortesemente pregati di
> darne immediata comunicazione al mittente e di provvedere alla sua
> distruzione, Grazie.
>
> * This e-mail and any attachments is confidential and may contain
> privileged information intended for the addressee(s) only. Dissemination,
> copying, printing or use by anybody else is unauthorised. If you are not
> the intended recipient, please delete this message and any attachments and
> advise the sender by return e-mail, Thanks. *
>
> *Rispetta l'ambiente. Non stampare questa mail se non è necessario.*
>