Re: [tsvwg] RDMA Support by UDP FRAG Option
"C. M. Heard" <heard@pobox.com> Mon, 21 June 2021 18:06 UTC
Return-Path: <heard@pobox.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BA3673A1407 for <tsvwg@ietfa.amsl.com>; Mon, 21 Jun 2021 11:06:12 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.199
X-Spam-Level:
X-Spam-Status: No, score=-0.199 tagged_above=-999 required=5 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=pobox.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id e81Tpsa0gnhl for <tsvwg@ietfa.amsl.com>; Mon, 21 Jun 2021 11:06:08 -0700 (PDT)
Received: from pb-smtp1.pobox.com (pb-smtp1.pobox.com [64.147.108.70]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7D1D03A1406 for <tsvwg@ietf.org>; Mon, 21 Jun 2021 11:06:07 -0700 (PDT)
Received: from pb-smtp1.pobox.com (unknown [127.0.0.1]) by pb-smtp1.pobox.com (Postfix) with ESMTP id 2C42DC64E4 for <tsvwg@ietf.org>; Mon, 21 Jun 2021 14:06:03 -0400 (EDT) (envelope-from heard@pobox.com)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed; d=pobox.com; h= mime-version:references:in-reply-to:from:date:message-id:subject :to:cc:content-type; s=sasl; bh=j5JcCr9OwoRum4oxa/6d4o5ccfTXRrz9 JW34oSWK/T0=; b=qP+P+G4HHkXfMBWN9jpsSYVOlq99biU09q03hXyPRveAtNx1 PVzFAx5GFsOe6M4jtxfxIv5X85dv0+0YVtBjmQk6NHz/0PeFkQVJRRGGdP73SvaN uJXTvzVT5EMXA5EJ1P54r5IH/AKQH07AlgtmOOfAosHm3nENcdNgHij25fQ=
Received: from pb-smtp1.nyi.icgroup.com (unknown [127.0.0.1]) by pb-smtp1.pobox.com (Postfix) with ESMTP id 21985C64E3 for <tsvwg@ietf.org>; Mon, 21 Jun 2021 14:06:03 -0400 (EDT) (envelope-from heard@pobox.com)
Received: from mail-io1-f44.google.com (unknown [209.85.166.44]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pb-smtp1.pobox.com (Postfix) with ESMTPSA id 6A7FEC64DF for <tsvwg@ietf.org>; Mon, 21 Jun 2021 14:06:02 -0400 (EDT) (envelope-from heard@pobox.com)
Received: by mail-io1-f44.google.com with SMTP id d9so8023142ioo.2 for <tsvwg@ietf.org>; Mon, 21 Jun 2021 11:06:02 -0700 (PDT)
X-Gm-Message-State: AOAM531quiJkx0rS+a/qMk3bCh/uMYdTyc9WqLqaa0Y4IqPA9UCTtVMj 2/G+ICRcn06n4imJdEUrrROjIZOM99RXyP0Es1w=
X-Google-Smtp-Source: ABdhPJygZdl1lvEhNIQ5g7DsxiD5KDj1JpB9C/tGBacbVzMHNbOuulUUoGRyHzPvNHcb3aL8rIB5O7hZNVgxJ65xpTM=
X-Received: by 2002:a02:94af:: with SMTP id x44mr18842551jah.79.1624298760290; Mon, 21 Jun 2021 11:06:00 -0700 (PDT)
MIME-Version: 1.0
References: <CACL_3VEyLdQZ-3hvzXxyA8ehtWs2hXESZ2OqyAx+BeSg85+-cA@mail.gmail.com> <CACL_3VFE4TjKvmkfZjvNpWo6vVfKjz5w85=Q+yqnYZKcwbYLmQ@mail.gmail.com> <63FFC34B-2179-47F1-B325-21CAC3D1543A@strayalpha.com> <CACL_3VHTfxWaBj7TFEmBXBqovrrAj7XuFEZFUag_iBHr3Hx09g@mail.gmail.com> <0EBFC9B0-591A-4860-B327-6E617B83F4D1@strayalpha.com> <CALx6S34pT81TbfQDk2vKF8wBrXL312As79K=rEzUQ3Lmg7UvpA@mail.gmail.com> <7C51D926-9DBB-41F5-93B2-10F716F672B1@strayalpha.com> <CALx6S37uN8TsXQZ3cv5jmxwxSyBRjK=-GQ_MsWxPWSs21XoGHw@mail.gmail.com> <CACL_3VEx7+VnLz7OLdXyhZU41e+-oBz3dc8JdMV_7pLMfic6=w@mail.gmail.com> <fcc8762f-c042-7999-d2e4-f28384950a19@erg.abdn.ac.uk> <CALx6S36sWGcZmFpAhF4DfOMyf6Z0w5F9bemNfeM1yWV-r0M+BA@mail.gmail.com> <8af3abf9-943f-13c1-e239-5efca27cf68c@erg.abdn.ac.uk> <CACL_3VHdyLAmzMbWsTVfJD+4tTzsMvcTzKS1B1CAdZ3k5U957g@mail.gmail.com> <CALx6S34DUrUBYd94LPPg4Hgh0FnZYZjZ4eKEYuaxb-7zbzb=pQ@mail.gmail.com> <CACL_3VEq9R=HmWXGbu_zcrgWfG0=q0z+HWM3cQ9Vh68hTCUR-w@mail.gmail.com> <CALx6S35bdGwY8FagGn8x5CaO4O3zW3U+NnB5ejC7bB6BHsXtJg@mail.gmail.com> <CACL_3VFwUJzT7uiXh33gBffboqqb51uFWJAEh290SsD0=aAzaQ@mail.gmail.com> <CALx6S34Lai=YS8i1VTC1zKHqsCTt_XUeKfwob7Qe_BA49bHC3A@mail.gmail.com> <CACL_3VFZphux8uCqh6seVgTEjyjOhCjGd-jHtdGc0fR9opKWUg@mail.gmail.com> <CALx6S34Yrph523yd0vx9EsCscwrjJY2ek6VrEj+7zCDGTLyuPA@mail.gmail.com> <48E7C759-957B-4E96-8A55-581AC40E5B28@strayalpha.com> <CALx6S36diVj2cd3JKBhvhA7xv3X5Wne9YO+v2sThX9jD-5tbEQ@mail.gmail.com> <F3DA8FA4-D335-42D2-B5F4-7DFDC866A2CA@strayalpha.com> <CALx6S35GJC_fq8wnehGSHY7WTW7YU7NA4wOSNoEGUF5w+pNx6g@mail.gmail.com> <4BA67B6B-E60F-474B-AD78-1FED2C3A58AD@strayalpha.com> <CALx6S36QNH9EvFB-mSHJMokFxHUFqv=16FMbAT=y1h7oGb7JEg@mail.gmail.com> <CACL_3VHSFCv-wNFZJQAdvjHK1RkDPsy019S_=rVDxNboCy5Rsw@mail.gmail.com> <CALx6S37P4OksrGbMtp5n2mM_hQSnaAH9=W5PVhbgbjdA5GsWrg@mail.gmail.com>
In-Reply-To: <CALx6S37P4OksrGbMtp5n2mM_hQSnaAH9=W5PVhbgbjdA5GsWrg@mail.gmail.com>
From: "C. M. Heard" <heard@pobox.com>
Date: Mon, 21 Jun 2021 11:05:48 -0700
X-Gmail-Original-Message-ID: <CACL_3VEQm_UEMLrLnxqqd57j7PX8fzV0CzVUbzonaRUzkt1MAg@mail.gmail.com>
Message-ID: <CACL_3VEQm_UEMLrLnxqqd57j7PX8fzV0CzVUbzonaRUzkt1MAg@mail.gmail.com>
To: Tom Herbert <tom@herbertland.com>
Cc: Joseph Touch <touch@strayalpha.com>, Gorry Fairhurst <gorry@erg.abdn.ac.uk>, TSVWG <tsvwg@ietf.org>
Content-Type: multipart/alternative; boundary="0000000000009dc76405c54a8677"
X-Pobox-Relay-ID: 56F4BFC4-D2BB-11EB-997B-8B3BC6D8090B-06080547!pb-smtp1.pobox.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/Oje7-Ijceu679bIP-fLHVkRctDU>
Subject: Re: [tsvwg] RDMA Support by UDP FRAG Option
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 21 Jun 2021 18:06:13 -0000
On Mon, Jun 21, 2021 at 9:46 AM Tom Herbert wrote: > On Mon, Jun 21, 2021, 9:31 AM C. M. Heard wrote: > >> On Mon, Jun 21, 2021 at 7:34 AM Tom Herbert wrote: >> >>> In my opinion, the best chance for UDP options to be deployable and >>> successful is to require that the surplus area always sums to zero. >>> >> >> Tom, >> >> Had that statement been "the best chance for UDP options to be deployable >> and successful is to require that the surplus area always sums to the >> ones-complement of the surplus area length." But the statement above, taken >> literally, is NOT TRUE. >> >> You may remember the lengthy discussion that centered around the >> discovery by the Aberdeen group (Fairhurst, Jones, and Zullo) that a >> significant proportion of paths across the Internet BLOCK packets with a >> surplus area, even if the UDP checksum is correct, unless it has been >> arranged that the checksum ALSO comes to (ones complement) zero when >> computed over the IP payload length and with the IP payload length >> substituted for the UDP length in the pseudo-header. >> >> See >> https://datatracker.ietf.org/meeting/103/materials/slides-103-maprg-a-tale-of-two-checksums-tom-jones >> >> I'm pretty sure that you knew of this, but forgot, because I saw messages >> in the archive wherein you discussed this matter with Raffaele Zullo. >> > > Yes, I am aware of that. That is in fact a bug (middle boxes also > shouldn't be looking at UDP checksum in the first). The fix in the draft > will workaround that particular bug, but that would conflict with devices > that include the surplus area in their computation but use the correct > length in the pseudo header. Unfortunately these are conflicting > requirements, so 100% correctness across all currently deployed devices may > be impossible. > That's true, it's not possible to compensate for all of the middlebox bugs. But thanks to the work of the Aberdeen group, we have some actual data. They found that found that paths that passed only the following oddball combinations "3rd CS" == "Full Payload Checksum, UDP length Pseudoheader" "4th CS" == "UDP Length Checksum, IP length Pseudoheader" were MUCH smaller in number than those that worked with CCO (" Full Payload Checksum, IP length Pseudoheader"). The chosen solution works for the majority of cases and so is a logical choice. On the host side we at least have some control, for instance we could > disable TX checksum offload if [ ... ] the device can[not] do it correctly. > RX offload would simply fail if the device doesn't do it right and host > would do checksum in CPU. The software stack can reworked to deal with any > use case and protocol agnostic offloads can work, but as I said the > simplest solution to that end would be surplus area summing to zero. > Making the surplus area sum to zero may well make SOME host software easier to update to be compatible with UDP options, and it would work around SOME host bugs. But it would cause UDP options to fail over 25% - 25% of Internet paths. Note the word PATH, which includes middleboxes AND hosts. That IMO is not a good design tradeoff. Mike >
- [tsvwg] A counterproposal to Section 5.5 of draft… C. M. Heard
- Re: [tsvwg] A counterproposal to Section 5.5 of d… Joseph Touch
- Re: [tsvwg] A counterproposal to Section 5.5 of d… C. M. Heard
- [tsvwg] RDMA Support by UDP FRAG Option C. M. Heard
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joseph Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joseph Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option C. M. Heard
- Re: [tsvwg] RDMA Support by UDP FRAG Option Gorry Fairhurst
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option Gorry Fairhurst
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joseph Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joe Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option C. M. Heard
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joe Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option C. M. Heard
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joseph Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joseph Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option C. M. Heard
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joseph Touch
- [tsvwg] incorrectly coalesce packets [was: Re: RD… Rodney W. Grimes
- Re: [tsvwg] RDMA Support by UDP FRAG Option Rodney W. Grimes
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joseph Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joseph Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option C. M. Heard
- Re: [tsvwg] incorrectly coalesce packets [was: Re… Joseph Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joseph Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joseph Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joseph Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joseph Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option C. M. Heard
- Re: [tsvwg] RDMA Support by UDP FRAG Option C. M. Heard
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option C. M. Heard
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joe Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joe Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Tom Herbert
- Re: [tsvwg] RDMA Support by UDP FRAG Option C. M. Heard
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joe Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joseph Touch
- Re: [tsvwg] RDMA Support by UDP FRAG Option C. M. Heard
- Re: [tsvwg] RDMA Support by UDP FRAG Option Joseph Touch