Re: spin bit in QUIC: troubleshooting

Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com> Thu, 16 November 2017 00:28 UTC

Return-Path: <spencerdawkins.ietf@gmail.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B6B5C120227 for <quic@ietfa.amsl.com>; Wed, 15 Nov 2017 16:28:49 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.998
X-Spam-Level:
X-Spam-Status: No, score=-1.998 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id k2U1CaLjI_oA for <quic@ietfa.amsl.com>; Wed, 15 Nov 2017 16:28:47 -0800 (PST)
Received: from mail-yw0-x22f.google.com (mail-yw0-x22f.google.com [IPv6:2607:f8b0:4002:c05::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BC54912714F for <quic@ietf.org>; Wed, 15 Nov 2017 16:28:46 -0800 (PST)
Received: by mail-yw0-x22f.google.com with SMTP id k3so18002020ywk.8 for <quic@ietf.org>; Wed, 15 Nov 2017 16:28:46 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=igbGUUQMjNuX2P7+IV4mIc3P2/B0tP4nuioYZwXp0P0=; b=lXVzjmsVqHplrUlqLevrUrANd6yfgPaaX41r9l8f3pEyRnZeGWsNHichdT1xMedCJu Keqfwthjv8W5vkqQ5kCpI5J2HTtwXYp+14B4a7x/dhfo9NV8N6YJnDekFo+9vwVPBgMO 04CeYDustG32srxdawLQuHUNH0JFSrw4hTpW24Z8g0/FJ65yYBjzVh66mpE7R8KWB2GH 0EHualQrjBmhvitA/VrsWZBrCPuLznY6E5kXv+ikJY5f+nr+euPvjTCbxOgkP/r4fVlo ps4O91nAg9AofArUIhznMWrs8o1w3GNfZciK7Cvt2RYZTqx5Dd9PjF78VrxhR/3WiVpI GLkQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=igbGUUQMjNuX2P7+IV4mIc3P2/B0tP4nuioYZwXp0P0=; b=MeAvf+dcykb48qfIq70gq1HwWuomS/CpGcAESN2Iy//l7zHRdSQwwjtMviUEF6UYWK vg+GXba9ySzATuD88h58MkI619Cmpqmk9lpEHLx7Tbwxla/5/bQtjdUFMh7GRMNoDrq6 /W7HXtR231v2B9F8ydiDBK5G3UFKVsf9S36/lRv1VJ6eBeHGig5jmEDGI1spxfVvYOzB SA0GsjgF4rc16WAzfmAnnUpG2nz51WrTqfoiE2szursjiJBN/X2ddnTCns+j8z+iFu2d Jx/+gd7LLGy7sCzHNjhCtFSYhCYZNubh/hwVwzapmH54SkMXBcTm/id8fSq2KurnBJKg 4I1g==
X-Gm-Message-State: AJaThX7oJAcqWGkDPz0r2qNIIcjZYwQSF+9VFtyudY3fsTAJOV7TZ5WL yT2G0TMX7MTipWyKfTAA0prg7mQzlsnaiLcEbO4=
X-Google-Smtp-Source: AGs4zMbyNlKA1Gp6qRMvOwpsetrBklyaE+oHGd1699Wk1v0eUzb8RC6+/R5EMP4VIEefxRiBMd096nCessK1Su9lcgc=
X-Received: by 10.37.252.5 with SMTP id v5mr1565265ybd.518.1510792125897; Wed, 15 Nov 2017 16:28:45 -0800 (PST)
MIME-Version: 1.0
Received: by 10.37.135.75 with HTTP; Wed, 15 Nov 2017 16:28:45 -0800 (PST)
In-Reply-To: <CAM4esxT-b_cs6uuLXU=+ugWCxW8mRkVFohYrYGB9nqCcHRUd0A@mail.gmail.com>
References: <11937_1510654451_5A0AC1F3_11937_138_1_5AE9CCAA1B4A2248AB61B4C7F0AD5FB924E7E4C5@OPEXCLILM44.corporate.adroot.infra.ftgroup> <CAKcm_gPRtyzL+jAd6kBSHvDaCYQtbFwXMVVph1SWezVzmNuU_A@mail.gmail.com> <11102_1510682780_5A0B309C_11102_260_1_5AE9CCAA1B4A2248AB61B4C7F0AD5FB924E7E67B@OPEXCLILM44.corporate.adroot.infra.ftgroup> <CAKcm_gOBh5k1aYm7UT=n-XXH2=7N53VUYwhZSrx5z-OBaMJ9sQ@mail.gmail.com> <4D7F4AD313D3FC43A053B309F97543CF490457FA@njmtexg5.research.att.com> <5A0BD528.3040106@erg.abdn.ac.uk> <2C515BE8694C6F4B9B6A578BCAC32E2F83AC9673@MBX021-W3-CA-2.exch021.domain.local> <CAM4esxT-b_cs6uuLXU=+ugWCxW8mRkVFohYrYGB9nqCcHRUd0A@mail.gmail.com>
From: Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com>
Date: Thu, 16 Nov 2017 08:28:45 +0800
Message-ID: <CAKKJt-fpiCdSxmOn1vgK80aUXMG37bLvMC6Wv_MOo2Z58qsF0w@mail.gmail.com>
Subject: Re: spin bit in QUIC: troubleshooting
To: Martin Duke <martin.h.duke@gmail.com>
Cc: Piotr Galecki <piotr_galecki@affirmednetworks.com>, "gorry@erg.abdn.ac.uk" <gorry@erg.abdn.ac.uk>, Ian Swett <ianswett@google.com>, QUIC WG <quic@ietf.org>, "MORTON, ALFRED C (AL)" <acmorton@att.com>, "emile.stephan@orange.com" <emile.stephan@orange.com>
Content-Type: multipart/alternative; boundary="f403045db63efe6367055e0eb3da"
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/dVmt0WZaviK_5o12hGVWolsLR3M>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 16 Nov 2017 00:28:50 -0000

Speaking as a curious individual,

On Thu, Nov 16, 2017 at 6:54 AM, Martin Duke <martin.h.duke@gmail.com>
wrote:

> Packet numbers are unencrypted and monotonically increasing. It is
> therefore relatively straightforward to measure reordering between any two
> points in the network if you have instruments there.
>

And that's certainly the way carriers were monitoring large networks when I
was working in that space in the mid-2000s. It's also the direction I see
in recent IPPM docs I've shepherded, IIUC.

Monitoring at one point in the network would be awesome, but it would be a
pleasant surprise if operators are doing it now.

Spencer


>
> On Tue, Nov 14, 2017 at 9:59 PM, Piotr Galecki <piotr_galecki@
> affirmednetworks.com> wrote:
>
>> How would a network probe be able to measure the level of packet
>> reordering in QUIC stream with only a spin bit?
>>
>> I'm asking because one of the common techniques to diagnose network issues
>> is to insert a probe in different points in the network and measure:
>> * RTT
>> * TCP segment loss
>> * TCP segment retransmissions
>> * TCP segment out-of-order
>> as a few basic data points.
>> With measurements in point A and point B one can determine for example if
>> a network device is misordering packets.
>>
>> -Piotr
>>
>> -----Original Message-----
>> From: QUIC [mailto:quic-bounces@ietf.org] On Behalf Of Gorry Fairhurst
>> Sent: Wednesday, November 15, 2017 12:48 AM
>> To: MORTON, ALFRED C (AL) <acmorton@att.com>
>> Cc: Ian Swett <ianswett@google.com>; QUIC WG <quic@ietf.org>;
>> emile.stephan@orange.com
>> Subject: Re: spin bit in QUIC: troubleshooting
>>
>> As I said at the mic: I think the spin-bit analysis was helpful, thanks.
>>
>> I can see how spin-bit is really useful to get basic diagnostics of RTT
>> if it can be relied to be present in every packet. (It is important to
>> measure latency within the network).
>>
>> There are places where 1-bit gives restricted value, and using more would
>> help: My additional comment at the Mic related to how much extra would be
>> the gain from an additional one or two bits?
>>
>> In particular, I'd like to see a method that can let me detect some loss
>> patterns and measure reordering, at least I think it is important to know
>> and measure when there is small-scale reordering <3.
>>
>> A suggestion:is to use a 2-bit counter for the spin (
>> 00->01->10->11->00), that would help detect these path anomlies.
>>
>> Gorry
>>
>> On 15/11/2017, 09:51, MORTON, ALFRED C (AL) wrote:
>> >
>> > I’d like to offer support for Spin Bit (and one or two
>> >
>> > bits for management if they can be justified quickly) in v1.
>> >
>> > On this topic of more bits,
>> >
>> > asking further clarification from Emile, below [ACM].
>> >
>> > Al
>> >
>> > *From:*QUIC [mailto:quic-bounces@ietf.org] *On Behalf Of *Ian Swett
>> > *Sent:* Tuesday, November 14, 2017 4:21 PM
>> > *To:* emile.stephan@orange.com
>> > *Cc:* QUIC WG
>> > *Subject:* Re: spin bit in QUIC: troubleshooting
>> >
>> > Thanks for clarifying Emile.
>> >
>> > On Tue, Nov 14, 2017 at 1:06 PM, <emile.stephan@orange.com
>> > <mailto:emile.stephan@orange.com>> wrote:
>> >
>> > Hi Ian,
>> >
>> > It was suggested in the latest discussion on the RTT design team
>> > mailing list to have one bit for packet lost, one for latency (spin
>> > bit or eq.) and one for congestion.
>> >
>> > */[ACM] /* There may be some overlap with ECN and « one bit for
>> > congestion ».
>> >
>> > Did you also consider this dependency, Emile ? (I’m echoing a hallway
>> > discussion)
>> >
>> > It seems a simplistic approach on one hand but an invariant on the
>> > long term.
>> >
>> > Regards
>> >
>> > Emile
>> >
>> > *De :*Ian Swett [mailto:ianswett@google.com
>> > <mailto:ianswett@google.com>] *Envoyé :* mardi 14 novembre 2017 22:51
>> > *À :* STEPHAN Emile IMT/OLN *Cc :* QUIC WG *Objet :* Re: spin bit in
>> > QUIC: troubleshooting
>> >
>> > What would the other bit or two be used for?  If there is no
>> > standardized use of those bits in v1, then I believe we should wait to
>> > reserve them when their usage is defined, given we'd need a version
>> > bump to specify how they were being used.  At the moment, the
>> > management use case is not competing with anyone else for bits in the
>> > short header.
>> >
>> > On Tue, Nov 14, 2017 at 5:14 AM, <emile.stephan@orange.com
>> > <mailto:emile.stephan@orange.com>> wrote:
>> >
>> > Hi
>> >
>> > Last week Orange experienced a fallback of QUIC to TCP on one of its
>> > networks. The issues were not visible in QUIC traffic. The
>> > troubleshooting was made using TCP packets information. This is not
>> > sustainable on the long term when numerous applications using
>> > different versions of QUIC will stop to fallback to TCP.
>> >
>> > Based on the exchange we had in the RTT design team and in today
>> > meeting , it sounds reasonable to reserve at least 2 bits (ideally 3
>> > bits as discussed in the design team) for manageability in the QUIC
>> > invariants and to start experimenting the spin bit in QUIC V1.
>> >
>> > Regards
>> >
>> > Emile
>> >
>> > ______________________________________________________________________
>> > ___________________________________________________
>> >
>> > Ce message et ses pieces jointes peuvent contenir des informations
>> > confidentielles ou privilegiees et ne doivent donc pas etre diffuses,
>> > exploites ou copies sans autorisation. Si vous avez recu ce message
>> > par erreur, veuillez le signaler a l'expediteur et le detruire ainsi
>> que les pieces jointes. Les messages electroniques etant susceptibles
>> d'alteration, Orange decline toute responsabilite si ce message a ete
>> altere, deforme ou falsifie. Merci.
>> >
>> > This message and its attachments may contain confidential or
>> > privileged information that may be protected by law; they should not be
>> distributed, used or copied without authorisation.
>> > If you have received this email in error, please notify the sender and
>> delete this message and its attachments.
>> > As emails may be altered, Orange is not liable for messages that have
>> been modified, changed or falsified.
>> > Thank you.
>> >
>> > ______________________________________________________________________
>> > ___________________________________________________
>> >
>> > Ce message et ses pieces jointes peuvent contenir des informations
>> > confidentielles ou privilegiees et ne doivent donc pas etre diffuses,
>> > exploites ou copies sans autorisation. Si vous avez recu ce message
>> > par erreur, veuillez le signaler a l'expediteur et le detruire ainsi
>> que les pieces jointes. Les messages electroniques etant susceptibles
>> d'alteration, Orange decline toute responsabilite si ce message a ete
>> altere, deforme ou falsifie. Merci.
>> >
>> > This message and its attachments may contain confidential or
>> > privileged information that may be protected by law; they should not be
>> distributed, used or copied without authorisation.
>> > If you have received this email in error, please notify the sender and
>> delete this message and its attachments.
>> > As emails may be altered, Orange is not liable for messages that have
>> been modified, changed or falsified.
>> > Thank you.
>> >
>>
>
>