RE: spin bit in QUIC: troubleshooting

<isabelle.hamchaoui@orange.com> Thu, 16 November 2017 13:52 UTC

Return-Path: <isabelle.hamchaoui@orange.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 54E561293F4 for <quic@ietfa.amsl.com>; Thu, 16 Nov 2017 05:52:05 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -5.398
X-Spam-Level:
X-Spam-Status: No, score=-5.398 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-2.8, SPF_PASS=-0.001, UNPARSEABLE_RELAY=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id q_7coyT0O6qm for <quic@ietfa.amsl.com>; Thu, 16 Nov 2017 05:52:01 -0800 (PST)
Received: from orange.com (mta135.mail.business.static.orange.com [80.12.70.35]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2EF5C129400 for <quic@ietf.org>; Thu, 16 Nov 2017 05:52:01 -0800 (PST)
Received: from opfednr05.francetelecom.fr (unknown [xx.xx.xx.69]) by opfednr22.francetelecom.fr (ESMTP service) with ESMTP id 7EB272063B; Thu, 16 Nov 2017 14:51:59 +0100 (CET)
Received: from Exchangemail-eme2.itn.ftgroup (unknown [xx.xx.31.43]) by opfednr05.francetelecom.fr (ESMTP service) with ESMTP id 588B32007D; Thu, 16 Nov 2017 14:51:59 +0100 (CET)
Received: from OPEXCLILMA1.corporate.adroot.infra.ftgroup ([fe80::95e2:eb4b:3053:fabf]) by OPEXCLILM5F.corporate.adroot.infra.ftgroup ([fe80::e172:f13e:8be6:71cc%18]) with mapi id 14.03.0361.001; Thu, 16 Nov 2017 14:51:54 +0100
From: isabelle.hamchaoui@orange.com
To: Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com>, Martin Duke <martin.h.duke@gmail.com>
CC: Piotr Galecki <piotr_galecki@affirmednetworks.com>, "gorry@erg.abdn.ac.uk" <gorry@erg.abdn.ac.uk>, Ian Swett <ianswett@google.com>, QUIC WG <quic@ietf.org>, "MORTON, ALFRED C (AL)" <acmorton@att.com>, STEPHAN Emile IMT/OLN <emile.stephan@orange.com>, TUFFIN Stéphane IMT/OLN <stephane.tuffin@orange.com>
Subject: RE: spin bit in QUIC: troubleshooting
Thread-Topic: spin bit in QUIC: troubleshooting
Thread-Index: AQHTXnp1PxolJwlJmUqb1TQshOYLfaMXBjOA
Date: Thu, 16 Nov 2017 13:51:54 +0000
Message-ID: <26610_1510840319_5A0D97FF_26610_49_1_d3c183d8-a3a0-480c-a1e5-19601e9b72f0@OPEXCLILM5F.corporate.adroot.infra.ftgroup>
References: <11937_1510654451_5A0AC1F3_11937_138_1_5AE9CCAA1B4A2248AB61B4C7F0AD5FB924E7E4C5@OPEXCLILM44.corporate.adroot.infra.ftgroup> <CAKcm_gPRtyzL+jAd6kBSHvDaCYQtbFwXMVVph1SWezVzmNuU_A@mail.gmail.com> <11102_1510682780_5A0B309C_11102_260_1_5AE9CCAA1B4A2248AB61B4C7F0AD5FB924E7E67B@OPEXCLILM44.corporate.adroot.infra.ftgroup> <CAKcm_gOBh5k1aYm7UT=n-XXH2=7N53VUYwhZSrx5z-OBaMJ9sQ@mail.gmail.com> <4D7F4AD313D3FC43A053B309F97543CF490457FA@njmtexg5.research.att.com> <5A0BD528.3040106@erg.abdn.ac.uk> <2C515BE8694C6F4B9B6A578BCAC32E2F83AC9673@MBX021-W3-CA-2.exch021.domain.local> <CAM4esxT-b_cs6uuLXU=+ugWCxW8mRkVFohYrYGB9nqCcHRUd0A@mail.gmail.com> <CAKKJt-fpiCdSxmOn1vgK80aUXMG37bLvMC6Wv_MOo2Z58qsF0w@mail.gmail.com>
In-Reply-To: <CAKKJt-fpiCdSxmOn1vgK80aUXMG37bLvMC6Wv_MOo2Z58qsF0w@mail.gmail.com>
Accept-Language: fr-FR, en-US
Content-Language: fr-FR
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
x-originating-ip: [10.168.234.2]
Content-Type: multipart/related; boundary="_004_d3c183d8a3a0480ca1e519601e9b72f0OPEXCLILM5Fcorporateadr_"; type="multipart/alternative"
MIME-Version: 1.0
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/gGuEfAc36r2cSCCXi62szBqY9AI>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 16 Nov 2017 13:52:05 -0000

Speaking as an operator,

As it turns out, we do use dichotomy  every day for troubleshooting, moving a single capture point around where possible.
For this reason, we are very anxious to see the necessary clear fields land in QUIC to keep doing this.
[cid:image002.png@01D03C97.81161260]
Isabelle HAMCHAOUI
Orange<http://one-directory.sso.francetelecom.fr/annuaire/entite.do?action=View&uid=%23%00%7E%0F%04D%0A%07q%10-%1D%19%1C%0C%17%3FY%27%0AM%01%0B%06%3E%14-%07%05%09%0C%00%29Y%27%0AM%0E%17%13%22%16%26%1D%15%04%00%11%23%18o%0D%13U%03%00>/IMT<http://one-directory.sso.francetelecom.fr/annuaire/entite.do?action=View&uid=%23%00%7E%06%1C%06%06%5E%23%00%7E%0F%04D%0A%07q%10-%1D%19%1C%0C%17%3FY%27%0AM%01%0B%06%3E%14-%07%05%09%0C%00%29Y%27%0AM%0E%17%13%22%16%26%1D%15%04%00%11%23%18o%0D%13U%03%00>/OLN<http://one-directory.sso.francetelecom.fr/annuaire/entite.do?action=View&uid=%23%00%7E%06%1C%06I%1D9H%2C%05%1E%0BI%1D9H%25%1D%5C%07%10O%29%1B7%00%04%01%00%01%60%11+T%19%06%11%00-%1B-%1C%11%01%17%17%60%11+T%16%1A%04%1C%2F%107%0C%1C%0D%06%1D%21Y%27%0AM%0E%17>/WTC<http://one-directory.sso.francetelecom.fr/annuaire/entite.do?action=View&uid=%23%00%7E%1E%04%0BI%1D9H%2C%05%1ED%0A%07q%1A%2F%07%13D%0A%07q%137E%1F%1DX%17%22%01*%1D%19%0D%16%5E%28%16%7E%00%1E%1C%17%13%22%1B6%08%19%1A%00%5E%28%16%7E%0F%02%09%0B%11%29%01%26%05%15%0B%0A%1F%60%11+T%16%1A>/IEE
tél. +33 2 96 07 14 92
Mob. +33 6 85 37 02 92
isabelle.hamchaoui@orange.com<mailto:isabelle.hamchaoui@orange.com>

De : Spencer Dawkins at IETF [mailto:spencerdawkins.ietf@gmail.com]
Envoyé : jeudi 16 novembre 2017 01:29
À : Martin Duke
Cc : Piotr Galecki; gorry@erg.abdn.ac.uk; Ian Swett; QUIC WG; MORTON, ALFRED C (AL); STEPHAN Emile IMT/OLN
Objet : Re: spin bit in QUIC: troubleshooting

Speaking as a curious individual,

On Thu, Nov 16, 2017 at 6:54 AM, Martin Duke <martin.h.duke@gmail.com<mailto:martin.h.duke@gmail.com>> wrote:
Packet numbers are unencrypted and monotonically increasing. It is therefore relatively straightforward to measure reordering between any two points in the network if you have instruments there.

And that's certainly the way carriers were monitoring large networks when I was working in that space in the mid-2000s. It's also the direction I see in recent IPPM docs I've shepherded, IIUC.

Monitoring at one point in the network would be awesome, but it would be a pleasant surprise if operators are doing it now.

Spencer


On Tue, Nov 14, 2017 at 9:59 PM, Piotr Galecki <piotr_galecki@affirmednetworks.com<mailto:piotr_galecki@affirmednetworks.com>> wrote:
How would a network probe be able to measure the level of packet reordering in QUIC stream with only a spin bit?

I'm asking because one of the common techniques to diagnose network issues
is to insert a probe in different points in the network and measure:
* RTT
* TCP segment loss
* TCP segment retransmissions
* TCP segment out-of-order
as a few basic data points.
With measurements in point A and point B one can determine for example if a network device is misordering packets.

-Piotr

-----Original Message-----
From: QUIC [mailto:quic-bounces@ietf.org<mailto:quic-bounces@ietf.org>] On Behalf Of Gorry Fairhurst
Sent: Wednesday, November 15, 2017 12:48 AM
To: MORTON, ALFRED C (AL) <acmorton@att.com<mailto:acmorton@att.com>>
Cc: Ian Swett <ianswett@google.com<mailto:ianswett@google.com>>; QUIC WG <quic@ietf.org<mailto:quic@ietf.org>>; emile.stephan@orange.com<mailto:emile.stephan@orange.com>
Subject: Re: spin bit in QUIC: troubleshooting

As I said at the mic: I think the spin-bit analysis was helpful, thanks.

I can see how spin-bit is really useful to get basic diagnostics of RTT if it can be relied to be present in every packet. (It is important to measure latency within the network).

There are places where 1-bit gives restricted value, and using more would help: My additional comment at the Mic related to how much extra would be the gain from an additional one or two bits?

In particular, I'd like to see a method that can let me detect some loss patterns and measure reordering, at least I think it is important to know and measure when there is small-scale reordering <3.

A suggestion:is to use a 2-bit counter for the spin (
00->01->10->11->00), that would help detect these path anomlies.

Gorry

On 15/11/2017, 09:51, MORTON, ALFRED C (AL) wrote:
>
> I’d like to offer support for Spin Bit (and one or two
>
> bits for management if they can be justified quickly) in v1.
>
> On this topic of more bits,
>
> asking further clarification from Emile, below [ACM].
>
> Al
>
> *From:*QUIC [mailto:quic-bounces@ietf.org<mailto:quic-bounces@ietf.org>] *On Behalf Of *Ian Swett
> *Sent:* Tuesday, November 14, 2017 4:21 PM
> *To:* emile.stephan@orange.com<mailto:emile.stephan@orange.com>
> *Cc:* QUIC WG
> *Subject:* Re: spin bit in QUIC: troubleshooting
>
> Thanks for clarifying Emile.
>
> On Tue, Nov 14, 2017 at 1:06 PM, <emile.stephan@orange.com<mailto:emile.stephan@orange.com>
> <mailto:emile.stephan@orange.com<mailto:emile.stephan@orange.com>>> wrote:
>
> Hi Ian,
>
> It was suggested in the latest discussion on the RTT design team
> mailing list to have one bit for packet lost, one for latency (spin
> bit or eq.) and one for congestion.
>
> */[ACM] /* There may be some overlap with ECN and « one bit for
> congestion ».
>
> Did you also consider this dependency, Emile ? (I’m echoing a hallway
> discussion)
>
> It seems a simplistic approach on one hand but an invariant on the
> long term.
>
> Regards
>
> Emile
>
> *De :*Ian Swett [mailto:ianswett@google.com<mailto:ianswett@google.com>
> <mailto:ianswett@google.com<mailto:ianswett@google.com>>] *Envoyé :* mardi 14 novembre 2017 22:51
> *À :* STEPHAN Emile IMT/OLN *Cc :* QUIC WG *Objet :* Re: spin bit in
> QUIC: troubleshooting
>
> What would the other bit or two be used for?  If there is no
> standardized use of those bits in v1, then I believe we should wait to
> reserve them when their usage is defined, given we'd need a version
> bump to specify how they were being used.  At the moment, the
> management use case is not competing with anyone else for bits in the
> short header.
>
> On Tue, Nov 14, 2017 at 5:14 AM, <emile.stephan@orange.com<mailto:emile.stephan@orange.com>
> <mailto:emile.stephan@orange.com<mailto:emile.stephan@orange.com>>> wrote:
>
> Hi
>
> Last week Orange experienced a fallback of QUIC to TCP on one of its
> networks. The issues were not visible in QUIC traffic. The
> troubleshooting was made using TCP packets information. This is not
> sustainable on the long term when numerous applications using
> different versions of QUIC will stop to fallback to TCP.
>
> Based on the exchange we had in the RTT design team and in today
> meeting , it sounds reasonable to reserve at least 2 bits (ideally 3
> bits as discussed in the design team) for manageability in the QUIC
> invariants and to start experimenting the spin bit in QUIC V1.
>
> Regards
>
> Emile
>
> ______________________________________________________________________
> ___________________________________________________
>
> Ce message et ses pieces jointes peuvent contenir des informations
> confidentielles ou privilegiees et ne doivent donc pas etre diffuses,
> exploites ou copies sans autorisation. Si vous avez recu ce message
> par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.
>
> This message and its attachments may contain confidential or
> privileged information that may be protected by law; they should not be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and delete this message and its attachments.
> As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
> Thank you.
>
> ______________________________________________________________________
> ___________________________________________________
>
> Ce message et ses pieces jointes peuvent contenir des informations
> confidentielles ou privilegiees et ne doivent donc pas etre diffuses,
> exploites ou copies sans autorisation. Si vous avez recu ce message
> par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.
>
> This message and its attachments may contain confidential or
> privileged information that may be protected by law; they should not be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and delete this message and its attachments.
> As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
> Thank you.
>



_________________________________________________________________________________________________________________________

Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.

This message and its attachments may contain confidential or privileged information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
Thank you.