From nobody Mon Mar 29 06:04:24 2021
Return-Path: <spencerdawkins.ietf@gmail.com>
X-Original-To: explicit-meas@ietfa.amsl.com
Delivered-To: explicit-meas@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1])
 by ietfa.amsl.com (Postfix) with ESMTP id 212963A1164;
 Mon, 29 Mar 2021 06:04:22 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.097
X-Spam-Level: 
X-Spam-Status: No, score=-2.097 tagged_above=-999 required=5
 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1,
 DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001,
 HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001,
 URIBL_BLOCKED=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key)
 header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44])
 by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id HupBQIvO_N5w; Mon, 29 Mar 2021 06:04:17 -0700 (PDT)
Received: from mail-yb1-xb33.google.com (mail-yb1-xb33.google.com
 [IPv6:2607:f8b0:4864:20::b33])
 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
 (No client certificate requested)
 by ietfa.amsl.com (Postfix) with ESMTPS id 426DD3A1166;
 Mon, 29 Mar 2021 06:04:17 -0700 (PDT)
Received: by mail-yb1-xb33.google.com with SMTP id l15so13755501ybm.0;
 Mon, 29 Mar 2021 06:04:17 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; 
 h=mime-version:references:in-reply-to:from:date:message-id:subject:to
 :cc; bh=BgVYwPGT/ot4JaqROQ8c+KVkAZWIyicV6yM1zyNlyjI=;
 b=KzJ2aYrIZ9DR3fzL1z1I7Elt20dNlwCkqaHnduVoJeuxOf6yBO9vf45IMp5HIY4f9C
 Pgve8DsaJsUiybi81bZqsqrvrHx1VAT7ZVCKVNOowl0STEsgGJ1YfEmMK9mmiwQ3qBlW
 C4cE1ULDGMFpvcxet8D/fPieaVK5ri3HodJ6wNB7dLX7EGVklvihQfDIl3kklTDYvbPe
 IlgL3DuGcrFarZZ4c+oRj3HplEGdOv+wxCscDAkIjul4FSSwo2WV/qvmJsbOcf+gvFsx
 IkMqijDP/28P5cwBKVBcVsFYvxSrJ7GNGmiQ3QbmlbfAr2g8jUMaHNsQJ3i47PyayzxY
 LkEA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:mime-version:references:in-reply-to:from:date
 :message-id:subject:to:cc;
 bh=BgVYwPGT/ot4JaqROQ8c+KVkAZWIyicV6yM1zyNlyjI=;
 b=T3MsUrXrOyZGwKX2JGrMMvhv5j+sYqq2BHWckpfuBfh794R/HnuY/e4m5fqwr/vlDZ
 ZkY3kLuJRAkqqofC4qJv0aEsSkXVmVE5fBItEPBcm/1pfSGq0FWivwCoPs3f1GpFWA/k
 /Dzi0625Z1bFkJPCTgQfnYI7YmrG2TwHbWxXnn0B+51v+WUWq5dJku+Lu2zaBChxjakw
 +pZIoArXceaqEDMB0NPzKTq5R2esvnpYObzurn0k3n7p9Rwwn9yHmuOmJ0WEUt1HSXHM
 6b9ILDgYQbV/CQDXVi1SPt+GbKQEFxuNpOdgJ6A+1u/5UntqBnJthhg0I7OIc1fD/K3W
 MJdg==
X-Gm-Message-State: AOAM533hGieG/SZ+kVF1WIxLV9iKQURMoSEG58F+dtwzQJsJBsP7/jz5
 sOT007fu7yj0sMrLJk9V6tGH2Jm00acMUmCYZzE=
X-Google-Smtp-Source: ABdhPJxys3BOIXXDX4DgRCkQnMERq0r4UOTnA3LlRa5M4IfYA+hyXKU8RSemeYWZraEO0cCKMHZCsEHsscziCrbBCqI=
X-Received: by 2002:a25:6814:: with SMTP id d20mr37979161ybc.53.1617023054713; 
 Mon, 29 Mar 2021 06:04:14 -0700 (PDT)
MIME-Version: 1.0
References: <8f60ffc8e0fd4376ba911c03f5c43039@TELMBXD14BA020.telecomitalia.local>
 <56398ea2e37a4a6ca53e85eb39add9a2@usma1ex-dag1mb5.msg.corp.akamai.com>
 <CAKcm_gNb-J59S3w806V4h2P_K5TkozRXNJCpNmMHbUcSOVjnUQ@mail.gmail.com>
In-Reply-To: <CAKcm_gNb-J59S3w806V4h2P_K5TkozRXNJCpNmMHbUcSOVjnUQ@mail.gmail.com>
From: Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com>
Date: Mon, 29 Mar 2021 08:03:48 -0500
Message-ID: <CAKKJt-dXpDGF79_5HJ1aQanPyJBcPEizvKt4rJBJ2jsNthOaJw@mail.gmail.com>
To: Ian Swett <ianswett=40google.com@dmarc.ietf.org>
Cc: "Lubashev, Igor" <ilubashe@akamai.com>,
 "explicit-meas@ietf.org" <explicit-meas@ietf.org>, 
 "tsvwg@ietf.org" <tsvwg@ietf.org>,
 "IETF IPPM WG (ippm@ietf.org)" <ippm@ietf.org>, 
 "alexandre.ferrieux@orange.com" <alexandre.ferrieux@orange.com>, 
 "HAMCHAOUI Isabelle IMT/OLN" <isabelle.hamchaoui@orange.com>, 
 Cociglio Mauro <mauro.cociglio=40telecomitalia.it@dmarc.ietf.org>, 
 "quic@ietf.org" <quic@ietf.org>
Content-Type: multipart/alternative; boundary="000000000000c516a405beac8445"
Archived-At: <https://mailarchive.ietf.org/arch/msg/explicit-meas/2Ket29tKj7hPkJIQRxyEsK-Xre4>
Subject: Re: [Explicit-meas] Comparing Alternate Marking and Explicit Flow
 Measurements (Spin bit, ...)
X-BeenThere: explicit-meas@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "This mailing list is intended for discussions relating to Explicit
 Flow Measurements Techniques." <explicit-meas.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/explicit-meas>,
 <mailto:explicit-meas-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/explicit-meas/>
List-Post: <mailto:explicit-meas@ietf.org>
List-Help: <mailto:explicit-meas-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/explicit-meas>,
 <mailto:explicit-meas-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 29 Mar 2021 13:04:22 -0000

--000000000000c516a405beac8445
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hi, Ian,

On Mon, Mar 29, 2021 at 7:01 AM Ian Swett <ianswett=3D
40google.com@dmarc.ietf.org> wrote:

> Thanks for the maprg slides Igor, it's great to hear you'd enable this if
> it was standardized.
>
> <Taking off my WG chair hat>
>

I didn't notice that you're an IPPM co-chair - congratulations to you, and
to IPPM!


> Has Akamai conducted any privacy analysis it would be willing to share
> with the IETF?  For this to be widely deployed, I think that will need to
> be done, similar to the spin bit.
>

Exactly, because (please see below)


> On Sat, Mar 27, 2021 at 4:29 PM Lubashev, Igor <ilubashe@akamai.com>
> wrote:
>
>> Thank you, Mauro.
>>
>> I would like to point out to IPPM WG that some of the proposed
>> measurement techniques have already been implemented and had been runnin=
g
>> on the Internet in 2019 and 2020.  Namely, Akamai has implemented Loss B=
its
>> (L+Q) and enabled them on a large portion of QIUC traffic served to Oran=
ge
>> Telecom users in several countries, while Orange implemented observers t=
hat
>> collected and analyzed the measurements.  We have discussed the
>> measurements and techniques in MAPRG during IETF-105 (and at other WGs a=
nd
>> meetings).
>>
>> Here is our IETF-105 MAPRG presentation discussing the data
>> https://datatracker.ietf.org/meeting/105/materials/slides-105-maprg-pack=
et-loss-signaling-for-encrypted-protocols-01
>> .
>>
>> In short, we found that unidirectional observations of QUIC traffic with
>> L+Q bits alone to be effective for measuring both upstream and downstrea=
m
>> packet loss and characterizing the magnitude of packet reordering.
>>
>> During the last meeting Ian asked whether Akamai would implement and
>> enable these measurements techniques for QUIC on the large scale, if all
>> the relevant drafts get standardized by IETF.  The answer is that, yes, =
we
>> would.  We are very interested in doing what it takes to improve Interne=
t
>> performance for the users, and we would work hard to implement technique=
s
>> that can help network operators to improve QOS on their networks.
>>
>> - Igor
>>
>> > -----Original Message-----
>> > From: Cociglio Mauro <mauro.cociglio=3D40telecomitalia.it@dmarc.ietf.o=
rg>
>> > Sent: Tuesday, March 16, 2021 9:48 AM
>> > To: IETF IPPM WG (ippm@ietf.org) <ippm@ietf.org>;
>> explicit-meas@ietf.org
>> > Cc: quic@ietf.org; tsvwg@ietf.org
>> > Subject: [ippm] Comparing Alternate Marking and Explicit Flow
>> > Measurements (Spin bit, ...)
>> >
>> > Hi.
>> > Last Friday during the IPPM meeting,  after the "Explicit Flow
>> Measurements"
>> > draft presentation
>> > (
>> https://urldefense.com/v3/__https://tools.ietf.org/html/draft-mdt-ippm-
>> > explicit-flow-measurements-01__;!!GjvTz_vk!CC-VjNQml5au1pXfCN50J-D-
>> > O99Zvrz686frIu4shWxPEipwQd7TTuOM3NTyNCU$ ), Greg Mirsky raised an
>> > issue that I think is very important.
>> > The question is about differences and similarities between the two
>> types of
>> > production traffic packet marking for performance measurements, propos=
ed
>> > in IETF and initiated in the IPPM WG: Alternate Marking and Explicit
>> Flow
>> > Measurements.
>> >
>> > The first technique known as Alternate Marking or AM/PM (Alternate
>> > Marking Performance Monitoring) is defined, in general terms, in RFC83=
21
>> > (the point-to-point version) and RFC8889 (the multipoint version).
>> > It is essentially a Telco measurement, born to measure packet delay an=
d
>> loss
>> > between the input and output of a network, or between 2 internal point=
s
>> of
>> > the network, in order to identify and localize a problem. It is a
>> network
>> > measure and it is the network operator that performs the marking by
>> > modifying packets on the fly.
>> > The strength of this technique comes from the decoupling of marking an=
d
>> > measurement. We can mark all traffic, using a fixed marking interval
>> (typically
>> > "big": from 1 second up to 5 minutes), then we decide what to measure
>> > based on the resources I want to use. In case of packet loss measureme=
nt
>> > we can start from a single packet counter for all traffic for each
>> measurement
>> > point (possibility described in RFC8889), to have a network
>> measurement, to
>> > arrive to a counter for each point-to-point connection you want to
>> monitor
>> > (as described in RFC8321).
>> > In order to obtain the measurement it is necessary to compare the data
>> > collected from at least 2 measurement points (counters for packet loss=
,
>> > timestamps for delay). Then a "communication" between measurement
>> > points, or with a Network Measurement Center, is needed.
>> > There are already commercial implementations of this technique (also f=
or
>> > IPv4) and IETF drafts that are standardizing it for various protocols
>> (IPv6,
>> > MPLS, Segment Routing, BIER, ...).
>> > The Alternate Marking methodology is evolving into the draft "Big Data
>> > AltMark" (
>> https://urldefense.com/v3/__https://tools.ietf.org/html/draft-
>> > c2f-ippm-big-data-alt-mark-01__;!!GjvTz_vk!CC-VjNQml5au1pXfCN50J-D-
>> > O99Zvrz686frIu4shWxPEipwQd7TTuOM_yNIIgs$ ) that defines point-to-point
>> > flows measurements applying post processing to performance data
>> collected
>> > by sampling a single network multipoint flow.
>> >
>> > The second marking technique for performance monitoring of packet
>> > networks has been called Explicit Flow Measurements (EFM), and is more
>> > recent because it's born with the Spin bit RTT measurement. And it cam=
e
>> > about primarily to have an end-to-end performance measure, from the
>> > terminal, on which an application is running, to the server at the
>> opposite
>> > end of the network. EFM can be seen as complementary measures to
>> > Alternate Marking.
>>
>
> One question on this.  As a QUIC WG member I was under the impression the
> spin bit would enable measurement within networks, but I agree that it is
> best as an end-to-end measurement.  However, network endpoints can and
> do(ie: qlog) export metrics and traces to provide detailed information
> that's much richer than spin or loss bits, which makes me less clear on t=
he
> value of EFM.  Igor indicated it worked as intended, but there is the
> separate question of whether it provides enough value on top of endpoint
> logging and Alternate Marking.
>

Brian Trammell and I have both been chatting with the TSV ADs about topics
that the PLUS BOF was relevant to. My recollection from
https://datatracker.ietf.org/doc/minutes-96-plus/ was that most of the
concern expressed by the SEC types in the room was about endpoints sending
information to network entities that the user was not aware of (and, truth
be told, that one concern detailed PLUS forevermore). (*)

(*) corrections on that point are welcome, but I'd be surprised if anyone
offered one. It wasn't a close BOF result.

It's obvious to me that relying on qlog plus delivery of qlog output to
network elements would be useful, and a lot more likely to be accurate than
inferences from a heavily encrypted byte stream, but please ask very early
in the process whether there's a similar concern about unwitting (from the
user's perspective) leakage to operators, or just bite the bullet and do
the privacy analysis now.

And Good Luck.

Best,

Spencer


> > It requires certain characteristics of the protocols to which it can be
>> applied,
>> > which are client-server, and it is particularly convenient for
>> protocols that
>> > prevent the marking of packets on the fly (e.g. QUIC), because the
>> marking
>> > occurs only on the end-points of the connection.
>> > The disadvantage with respect to the previous technique is that it
>> always
>> > works for client-server point-to-point connection, it is not possible =
to
>> > aggregate measurements saving on monitoring resources as described in
>> > RFC8889. The advantage is that it can also work with a single monitori=
ng
>> > point, even if having more points enhances it and allows intradomain
>> > measurements. With a single measurement point you can obtain end-to-en=
d
>> > measures (Spin bit, Delay bit for delay and Loss bit, rT loss bit for
>> packet loss)
>> > or end-to-observer measures (sQuare bit and Reflection bit for packet
>> loss).
>> > End-to-observer measurements and scalability considerations make it
>> > particularly convenient to place a measurement point on the client (se=
e
>> >
>> https://urldefense.com/v3/__https://tools.ietf.org/html/draft-cnbf-ippm-
>> > user-devices-explicit-monitoring-01__;!!GjvTz_vk!CC-VjNQml5au1pXfCN50J=
-
>> > D-O99Zvrz686frIu4shWxPEipwQd7TTuOMvZGbbWs$ ).
>> >
>> > Best Regards.
>> >
>> > Mauro
>> > _____________________
>> > Mauro Cociglio
>> > TIM - Telecom Italia
>> > Via G. Reiss Romoli, 274
>> > 10148 - Torino (Italy)
>> > Tel.: +390112285028 <+39%20011%20228%205028>
>> > Mobile: +393357669751 <+39%20335%20766%209751>
>> > _____________________
>> >
>> >
>> > TIM - Uso Interno - Tutti i diritti riservati.
>> >
>> > Questo messaggio e i suoi allegati sono indirizzati esclusivamente all=
e
>> > persone indicate. La diffusione, copia o qualsiasi altra azione
>> derivante dalla
>> > conoscenza di queste informazioni sono rigorosamente vietate. Qualora
>> > abbiate ricevuto questo documento per errore siete cortesemente pregat=
i
>> di
>> > darne immediata comunicazione al mittente e di provvedere alla sua
>> > distruzione, Grazie.
>> >
>> > This e-mail and any attachments is confidential and may contain
>> privileged
>> > information intended for the addressee(s) only. Dissemination, copying=
,
>> > printing or use by anybody else is unauthorised. If you are not the
>> intended
>> > recipient, please delete this message and any attachments and advise t=
he
>> > sender by return e-mail, Thanks.
>> >
>> > Rispetta l'ambiente. Non stampare questa mail se non =C3=A8 necessario=
.
>> >
>> > _______________________________________________
>> > ippm mailing list
>> > ippm@ietf.org
>> > https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/ippm=
_
>> > _;!!GjvTz_vk!CC-VjNQml5au1pXfCN50J-D-
>> > O99Zvrz686frIu4shWxPEipwQd7TTuOMMXmeW4s$
>>
>

--000000000000c516a405beac8445
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Hi, Ian,=C2=A0</div><br><div class=3D"gmail_quote"><d=
iv dir=3D"ltr" class=3D"gmail_attr">On Mon, Mar 29, 2021 at 7:01 AM Ian Swe=
tt &lt;ianswett=3D<a href=3D"mailto:40google.com@dmarc.ietf.org">40google.c=
om@dmarc.ietf.org</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote"=
 style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);p=
adding-left:1ex"><div dir=3D"ltr"><div dir=3D"ltr">Thanks for the maprg sli=
des Igor, it&#39;s great to hear you&#39;d enable this if it was standardiz=
ed.<div><br></div><div>&lt;Taking off my WG chair hat&gt;</div></div></div>=
</blockquote><div><br></div><div>I didn&#39;t notice that you&#39;re an IPP=
M co-chair - congratulations to you, and to IPPM!=C2=A0</div><div>=C2=A0</d=
iv><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bord=
er-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr"><div =
dir=3D"ltr"><div>Has Akamai conducted any privacy analysis it would be will=
ing to share with the IETF?=C2=A0 For this to be widely deployed, I think t=
hat will need to be done, similar to the spin bit.<br></div></div></div></b=
lockquote><div><br></div><div>Exactly, because (please see below)</div><div=
>=C2=A0</div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px =
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"=
ltr"><div dir=3D"ltr"><div></div></div><div class=3D"gmail_quote"><div dir=
=3D"ltr" class=3D"gmail_attr">On Sat, Mar 27, 2021 at 4:29 PM Lubashev, Igo=
r &lt;<a href=3D"mailto:ilubashe@akamai.com" target=3D"_blank">ilubashe@aka=
mai.com</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote" style=3D"=
margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-lef=
t:1ex">Thank you, Mauro.<br>
<br>
I would like to point out to IPPM WG that some of the proposed measurement =
techniques have already been implemented and had been running on the Intern=
et in 2019 and 2020.=C2=A0 Namely, Akamai has implemented Loss Bits (L+Q) a=
nd enabled them on a large portion of QIUC traffic served to Orange Telecom=
 users in several countries, while Orange implemented observers that collec=
ted and analyzed the measurements.=C2=A0 We have discussed the measurements=
 and techniques in MAPRG during IETF-105 (and at other WGs and meetings).<b=
r>
<br>
Here is our IETF-105 MAPRG presentation discussing the data <a href=3D"http=
s://datatracker.ietf.org/meeting/105/materials/slides-105-maprg-packet-loss=
-signaling-for-encrypted-protocols-01" rel=3D"noreferrer" target=3D"_blank"=
>https://datatracker.ietf.org/meeting/105/materials/slides-105-maprg-packet=
-loss-signaling-for-encrypted-protocols-01</a>.<br>
<br>
In short, we found that unidirectional observations of QUIC traffic with L+=
Q bits alone to be effective for measuring both upstream and downstream pac=
ket loss and characterizing the magnitude of packet reordering.<br>
<br>
During the last meeting Ian asked whether Akamai would implement and enable=
 these measurements techniques for QUIC on the large scale, if all the rele=
vant drafts get standardized by IETF.=C2=A0 The answer is that, yes, we wou=
ld.=C2=A0 We are very interested in doing what it takes to improve Internet=
 performance for the users, and we would work hard to implement techniques =
that can help network operators to improve QOS on their networks.<br>
<br>
- Igor<br>
<br>
&gt; -----Original Message-----<br>
&gt; From: Cociglio Mauro &lt;mauro.cociglio=3D<a href=3D"mailto:40telecomi=
talia.it@dmarc.ietf.org" target=3D"_blank">40telecomitalia.it@dmarc.ietf.or=
g</a>&gt;<br>
&gt; Sent: Tuesday, March 16, 2021 9:48 AM<br>
&gt; To: IETF IPPM WG (<a href=3D"mailto:ippm@ietf.org" target=3D"_blank">i=
ppm@ietf.org</a>) &lt;<a href=3D"mailto:ippm@ietf.org" target=3D"_blank">ip=
pm@ietf.org</a>&gt;; <a href=3D"mailto:explicit-meas@ietf.org" target=3D"_b=
lank">explicit-meas@ietf.org</a><br>
&gt; Cc: <a href=3D"mailto:quic@ietf.org" target=3D"_blank">quic@ietf.org</=
a>; <a href=3D"mailto:tsvwg@ietf.org" target=3D"_blank">tsvwg@ietf.org</a><=
br>
&gt; Subject: [ippm] Comparing Alternate Marking and Explicit Flow<br>
&gt; Measurements (Spin bit, ...)<br>
&gt; <br>
&gt; Hi.<br>
&gt; Last Friday during the IPPM meeting, =C2=A0after the &quot;Explicit Fl=
ow Measurements&quot;<br>
&gt; draft presentation<br>
&gt; (<a href=3D"https://urldefense.com/v3/__https://tools.ietf.org/html/dr=
aft-mdt-ippm-" rel=3D"noreferrer" target=3D"_blank">https://urldefense.com/=
v3/__https://tools.ietf.org/html/draft-mdt-ippm-</a><br>
&gt; explicit-flow-measurements-01__;!!GjvTz_vk!CC-VjNQml5au1pXfCN50J-D-<br=
>
&gt; O99Zvrz686frIu4shWxPEipwQd7TTuOM3NTyNCU$ ), Greg Mirsky raised an<br>
&gt; issue that I think is very important.<br>
&gt; The question is about differences and similarities between the two typ=
es of<br>
&gt; production traffic packet marking for performance measurements, propos=
ed<br>
&gt; in IETF and initiated in the IPPM WG: Alternate Marking and Explicit F=
low<br>
&gt; Measurements.<br>
&gt; <br>
&gt; The first technique known as Alternate Marking or AM/PM (Alternate<br>
&gt; Marking Performance Monitoring) is defined, in general terms, in RFC83=
21<br>
&gt; (the point-to-point version) and RFC8889 (the multipoint version).<br>
&gt; It is essentially a Telco measurement, born to measure packet delay an=
d loss<br>
&gt; between the input and output of a network, or between 2 internal point=
s of<br>
&gt; the network, in order to identify and localize a problem. It is a netw=
ork<br>
&gt; measure and it is the network operator that performs the marking by<br=
>
&gt; modifying packets on the fly.<br>
&gt; The strength of this technique comes from the decoupling of marking an=
d<br>
&gt; measurement. We can mark all traffic, using a fixed marking interval (=
typically<br>
&gt; &quot;big&quot;: from 1 second up to 5 minutes), then we decide what t=
o measure<br>
&gt; based on the resources I want to use. In case of packet loss measureme=
nt<br>
&gt; we can start from a single packet counter for all traffic for each mea=
surement<br>
&gt; point (possibility described in RFC8889), to have a network measuremen=
t, to<br>
&gt; arrive to a counter for each point-to-point connection you want to mon=
itor<br>
&gt; (as described in RFC8321).<br>
&gt; In order to obtain the measurement it is necessary to compare the data=
<br>
&gt; collected from at least 2 measurement points (counters for packet loss=
,<br>
&gt; timestamps for delay). Then a &quot;communication&quot; between measur=
ement<br>
&gt; points, or with a Network Measurement Center, is needed.<br>
&gt; There are already commercial implementations of this technique (also f=
or<br>
&gt; IPv4) and IETF drafts that are standardizing it for various protocols =
(IPv6,<br>
&gt; MPLS, Segment Routing, BIER, ...).<br>
&gt; The Alternate Marking methodology is evolving into the draft &quot;Big=
 Data<br>
&gt; AltMark&quot; (<a href=3D"https://urldefense.com/v3/__https://tools.ie=
tf.org/html/draft-" rel=3D"noreferrer" target=3D"_blank">https://urldefense=
.com/v3/__https://tools.ietf.org/html/draft-</a><br>
&gt; c2f-ippm-big-data-alt-mark-01__;!!GjvTz_vk!CC-VjNQml5au1pXfCN50J-D-<br=
>
&gt; O99Zvrz686frIu4shWxPEipwQd7TTuOM_yNIIgs$ ) that defines point-to-point=
<br>
&gt; flows measurements applying post processing to performance data collec=
ted<br>
&gt; by sampling a single network multipoint flow.<br>
&gt; <br>
&gt; The second marking technique for performance monitoring of packet<br>
&gt; networks has been called Explicit Flow Measurements (EFM), and is more=
<br>
&gt; recent because it&#39;s born with the Spin bit RTT measurement. And it=
 came<br>
&gt; about primarily to have an end-to-end performance measure, from the<br=
>
&gt; terminal, on which an application is running, to the server at the opp=
osite<br>
&gt; end of the network. EFM can be seen as complementary measures to<br>
&gt; Alternate Marking.<br></blockquote><div><br></div><div>One question on=
 this.=C2=A0 As a QUIC WG member I was under the impression the spin bit wo=
uld enable measurement within networks, but I agree that it is best as an e=
nd-to-end measurement.=C2=A0 However, network endpoints can and do(ie: qlog=
) export metrics and traces to provide detailed information that&#39;s much=
 richer than spin or loss bits, which makes me less clear on the value of E=
FM.=C2=A0 Igor indicated it worked as intended, but there is the separate q=
uestion of whether it provides enough value on top of endpoint logging and =
Alternate Marking.</div></div></div></blockquote><div><br></div><div>Brian =
Trammell and I have both been chatting with the TSV ADs about topics that t=
he PLUS BOF was relevant to. My recollection from=C2=A0<a href=3D"https://d=
atatracker.ietf.org/doc/minutes-96-plus/">https://datatracker.ietf.org/doc/=
minutes-96-plus/</a> was that most of the concern expressed by the SEC type=
s in the room was about endpoints sending information to network entities t=
hat the user was not aware of (and, truth be told, that one concern detaile=
d PLUS forevermore). (*)</div><div><br></div><div>(*) corrections on that p=
oint are welcome, but I&#39;d be surprised if anyone offered one. It wasn&#=
39;t a close BOF result.=C2=A0</div><div><br></div><div>It&#39;s obvious to=
 me that relying on qlog plus delivery of qlog output to network elements w=
ould be useful, and a lot more likely to be accurate than inferences from a=
 heavily encrypted byte stream, but please ask very early in the process wh=
ether there&#39;s a similar concern about unwitting (from the user&#39;s pe=
rspective) leakage to operators, or just bite the bullet and do the privacy=
 analysis now.</div><div><br></div><div>And Good Luck.=C2=A0</div><div><br>=
</div><div>Best,</div><div><br></div><div>Spencer</div><div>=C2=A0</div><bl=
ockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-lef=
t:1px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr"><div class=
=3D"gmail_quote"><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px =
0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">&gt; It =
requires certain characteristics of the protocols to which it can be applie=
d,<br>
&gt; which are client-server, and it is particularly convenient for protoco=
ls that<br>
&gt; prevent the marking of packets on the fly (e.g. QUIC), because the mar=
king<br>
&gt; occurs only on the end-points of the connection.<br>
&gt; The disadvantage with respect to the previous technique is that it alw=
ays<br>
&gt; works for client-server point-to-point connection, it is not possible =
to<br>
&gt; aggregate measurements saving on monitoring resources as described in<=
br>
&gt; RFC8889. The advantage is that it can also work with a single monitori=
ng<br>
&gt; point, even if having more points enhances it and allows intradomain<b=
r>
&gt; measurements. With a single measurement point you can obtain end-to-en=
d<br>
&gt; measures (Spin bit, Delay bit for delay and Loss bit, rT loss bit for =
packet loss)<br>
&gt; or end-to-observer measures (sQuare bit and Reflection bit for packet =
loss).<br>
&gt; End-to-observer measurements and scalability considerations make it<br=
>
&gt; particularly convenient to place a measurement point on the client (se=
e<br>
&gt; <a href=3D"https://urldefense.com/v3/__https://tools.ietf.org/html/dra=
ft-cnbf-ippm-" rel=3D"noreferrer" target=3D"_blank">https://urldefense.com/=
v3/__https://tools.ietf.org/html/draft-cnbf-ippm-</a><br>
&gt; user-devices-explicit-monitoring-01__;!!GjvTz_vk!CC-VjNQml5au1pXfCN50J=
-<br>
&gt; D-O99Zvrz686frIu4shWxPEipwQd7TTuOMvZGbbWs$ ).<br>
&gt; <br>
&gt; Best Regards.<br>
&gt; <br>
&gt; Mauro<br>
&gt; _____________________<br>
&gt; Mauro Cociglio<br>
&gt; TIM - Telecom Italia<br>
&gt; Via G. Reiss Romoli, 274<br>
&gt; 10148 - Torino (Italy)<br>
&gt; Tel.: <a href=3D"tel:+39%20011%20228%205028" value=3D"+390112285028" t=
arget=3D"_blank">+390112285028</a><br>
&gt; Mobile: <a href=3D"tel:+39%20335%20766%209751" value=3D"+393357669751"=
 target=3D"_blank">+393357669751</a><br>
&gt; _____________________<br>
&gt; <br>
&gt; <br>
&gt; TIM - Uso Interno - Tutti i diritti riservati.<br>
&gt; <br>
&gt; Questo messaggio e i suoi allegati sono indirizzati esclusivamente all=
e<br>
&gt; persone indicate. La diffusione, copia o qualsiasi altra azione deriva=
nte dalla<br>
&gt; conoscenza di queste informazioni sono rigorosamente vietate. Qualora<=
br>
&gt; abbiate ricevuto questo documento per errore siete cortesemente pregat=
i di<br>
&gt; darne immediata comunicazione al mittente e di provvedere alla sua<br>
&gt; distruzione, Grazie.<br>
&gt; <br>
&gt; This e-mail and any attachments is confidential and may contain privil=
eged<br>
&gt; information intended for the addressee(s) only. Dissemination, copying=
,<br>
&gt; printing or use by anybody else is unauthorised. If you are not the in=
tended<br>
&gt; recipient, please delete this message and any attachments and advise t=
he<br>
&gt; sender by return e-mail, Thanks.<br>
&gt; <br>
&gt; Rispetta l&#39;ambiente. Non stampare questa mail se non =C3=A8 necess=
ario.<br>
&gt; <br>
&gt; _______________________________________________<br>
&gt; ippm mailing list<br>
&gt; <a href=3D"mailto:ippm@ietf.org" target=3D"_blank">ippm@ietf.org</a><b=
r>
&gt; <a href=3D"https://urldefense.com/v3/__https://www.ietf.org/mailman/li=
stinfo/ippm_" rel=3D"noreferrer" target=3D"_blank">https://urldefense.com/v=
3/__https://www.ietf.org/mailman/listinfo/ippm_</a><br>
&gt; _;!!GjvTz_vk!CC-VjNQml5au1pXfCN50J-D-<br>
&gt; O99Zvrz686frIu4shWxPEipwQd7TTuOMMXmeW4s$<br>
</blockquote></div></div>
</blockquote></div></div>

--000000000000c516a405beac8445--

