Re: Proposal to replace ACK block count with ACK length

Eric Rescorla <ekr@rtfm.com> Fri, 15 June 2018 16:11 UTC

Return-Path: <ekr@rtfm.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0D8F812F18C for <quic@ietfa.amsl.com>; Fri, 15 Jun 2018 09:11:46 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.909
X-Spam-Level:
X-Spam-Status: No, score=-1.909 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, T_DKIMWL_WL_MED=-0.01] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=rtfm-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id PRKtTEPXendF for <quic@ietfa.amsl.com>; Fri, 15 Jun 2018 09:11:43 -0700 (PDT)
Received: from mail-ot0-x229.google.com (mail-ot0-x229.google.com [IPv6:2607:f8b0:4003:c0f::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 031E8130E37 for <quic@ietf.org>; Fri, 15 Jun 2018 09:11:43 -0700 (PDT)
Received: by mail-ot0-x229.google.com with SMTP id q17-v6so11572855otg.2 for <quic@ietf.org>; Fri, 15 Jun 2018 09:11:42 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rtfm-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=0SFkjg2NgfmhyTUvjTs3L3MkZdgePf1aZttYfvtbtJE=; b=DCvDU3xacfD8pXUvCVq9M/OaLawhhV/dKHIsvDApGAr5ocOS4qLt8zgweZgARiXvO3 eP84EHWNt9rNKZXA59oBeDea27x8LvJztTA2x7RVrBu/fSbHqCQ3PElVTN+ZMyU7HcvN oCFAuDaVvDQdsLWaAqkw1sA02KyJyc4GamwvkV/W4gPa1MEweqfIe1XLyGXQXSZqHl38 HemExI8Ff8ri7PYNcOPY6iIpnvfVkJuGxkjqEQeZcD3QMTItRR8E278QAM24z3dhVMok 8sTrZukGPKNa8i+rx6Uuw+RYofhtRkxK502Ej71dyH3Z2lvHPRKdzB/8NAuLosnyRC3Q ytGA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=0SFkjg2NgfmhyTUvjTs3L3MkZdgePf1aZttYfvtbtJE=; b=jUDNBTg/3vOvxC/mlOWtbqu5tRA+3kL0czUq/PaXsiIVhBwearkyRZPuhIEVc0RZs2 YPKYxM5WQKmpuJtFMPPhNJFEHmEZqPwQfRcFXpOAXpCf0LXB552qpS2KFe/2v1D899m3 UjBdtf2HdCztViE5mkSd7tHN/mnqQqMlHv9RQnmZn9wk16w6V4HzaNJ1aiwAucuA9Lo1 4S48u8jS/tHGeg4Myuu1mmY4mC1eY0Tr/AxOokVYyajKKcriUKWaLcCqiHUeTul5Nj9G BtpifPccOxev0aFE4tOKe/fF6SduIqOuxbtZdM9lfKYTEbz7ZP4TheXbIZwKl1Mktd+h 9U3A==
X-Gm-Message-State: APt69E2XMFXgH6M6I6xdKsJiLaX+y1/5vOTsvOaVtfnBbBCrg8HflPNS ipS3KXGskKx/RjqEF65GD04ff9xXncCKnsjxT2pqrg==
X-Google-Smtp-Source: ADUXVKK/Pb21GPjmCCPbo/7Mtx39B5jVUYhY8HU72uU48ggSdYe7PhhFJNNODSHSSBKc3AwN636l32tXiXUPQ0+ft98=
X-Received: by 2002:a9d:4905:: with SMTP id e5-v6mr1473920otf.101.1529079102344; Fri, 15 Jun 2018 09:11:42 -0700 (PDT)
MIME-Version: 1.0
Received: by 2002:ac9:3a8a:0:0:0:0:0 with HTTP; Fri, 15 Jun 2018 09:11:01 -0700 (PDT)
In-Reply-To: <1F436ED13A22A246A59CA374CBC543998B833B91@ORSMSX111.amr.corp.intel.com>
References: <1F436ED13A22A246A59CA374CBC543998B832414@ORSMSX111.amr.corp.intel.com> <20180611154244.GA27622@ubuntu-dmitri> <CACpbDcdxzRxeiN93kKoj__vo2TERm4QZKqaesL=jr4wQUN1gXA@mail.gmail.com> <1F436ED13A22A246A59CA374CBC543998B833B91@ORSMSX111.amr.corp.intel.com>
From: Eric Rescorla <ekr@rtfm.com>
Date: Fri, 15 Jun 2018 09:11:01 -0700
Message-ID: <CABcZeBOjjRrX+AsXdgcUKpL=ciL8U_U1+WVAhQv-ZjwGxkQxYw@mail.gmail.com>
Subject: Re: Proposal to replace ACK block count with ACK length
To: "Deval, Manasi" <manasi.deval@intel.com>
Cc: Jana Iyengar <jri.ietf@gmail.com>, QUIC WG <quic@ietf.org>
Content-Type: multipart/alternative; boundary="000000000000baa327056eb078ce"
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/8qyaPFsCtzx1yj8kgc-_YSWgQa4>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.26
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 15 Jun 2018 16:11:46 -0000

I agree with Manasi here. This change would allow ack frame parsing to be
more self-contained, which is an advantage for the parser and also
potentially for parallelism (because you can quickly find the frame and
then process it in parallel).

-Ekr


On Mon, Jun 11, 2018 at 5:22 PM, Deval, Manasi <manasi.deval@intel.com>
wrote:

> In general, varints require some specific logic for parsing. To skip over
> any header, I have to read every single varint. As the code sees Stream and
> ACK headers most frequently, that is my focus.  The Stream frame has a
> length in its third field.
>
>
>
> ACK parsing, however, needs 6 + 2*num_blocks reads to identify length.
> There are two reads each for ‘largest acknowledged’, ‘ACK delay’ and ‘ACK
> block count’. The pain point is the total number of cycles parse an ACK. If
> I am processing 10M pps, where 10% - 30% of the packets have a piggybacked
> ACK, these cycles becomes a significant bottleneck.
>
>
>
> Thanks,
>
> Manasi
>
>
>
>
>
>
>
> *From:* QUIC [mailto:quic-bounces@ietf.org] *On Behalf Of *Jana Iyengar
> *Sent:* Monday, June 11, 2018 3:11 PM
> *To:* Deval, Manasi <manasi.deval@intel.com>; QUIC WG <quic@ietf.org>
> *Subject:* Re: Proposal to replace ACK block count with ACK length
>
>
>
> You're right that we no longer have the ability to skip an ACK frame, and
> this crept in when we moved to varints.
>
> I believe your problem though is generally true of most frames not just
> ACKs, since ids, packet numbers, and numbers in all frames are now all
> varints. To skip any frame, you'll need to parse the varint fields in those
> frames. If you have logic to process and skip varints, then skipping the
> ack block section is merely repeating this operation (2*num_block+1) times.
> Do you see specific value in skipping ACK frames over the other control
> frames?
>
>
>
>
>
> On Mon, Jun 11, 2018 at 8:43 AM Dmitri Tikhonov <
> dtikhonov@litespeedtech.com> wrote:
>
> On Mon, Jun 11, 2018 at 03:33:35PM +0000, Deval, Manasi wrote:
> > -        Moving the ACK length to the front of the ACK allows the
> >          flexibility of either reading the entire ACK or reading the
> >          first 16 bits and skipping over the length. This is a useful
> >          feature for the case where ACK processing is split into
> >          multiple layers. Depending on the processor this is run on,
> >          there are different advantages -
>
> Just a note.  In my experience, the cost of parsing an ACK frame is
> negligible compared to the cost of processing an ACK frame: that is,
> poking at various memory locations to discard newly ACKed packets.
>
>   - Dmitri.
>
>