Re: [tsvwg] RDMA Support by UDP FRAG Option

Tom Herbert <tom@herbertland.com> Thu, 17 June 2021 17:30 UTC

Return-Path: <tom@herbertland.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3D4DB3A27B0 for <tsvwg@ietfa.amsl.com>; Thu, 17 Jun 2021 10:30:27 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.897
X-Spam-Level:
X-Spam-Status: No, score=-1.897 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=herbertland-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 6kwlKoXZ3pi8 for <tsvwg@ietfa.amsl.com>; Thu, 17 Jun 2021 10:30:22 -0700 (PDT)
Received: from mail-ej1-x634.google.com (mail-ej1-x634.google.com [IPv6:2a00:1450:4864:20::634]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id DC2C13A27AE for <tsvwg@ietf.org>; Thu, 17 Jun 2021 10:30:21 -0700 (PDT)
Received: by mail-ej1-x634.google.com with SMTP id gt18so11062545ejc.11 for <tsvwg@ietf.org>; Thu, 17 Jun 2021 10:30:21 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=herbertland-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=tYqy+GsDVbYOj8gdH0ar6mQHtr1skNwQVM8QbIOh61I=; b=cJK2mF2HnYxlimG3foT9z8zVcQIfATnjXuoGKhalGDtUnsYV3k6GInsdifOI1P40pl Q5rUIgFgaHM1SXuu62FS6QH36MmiQsXTsO35yJeAXjmiehqHT0taioC4QcTgUS3d6ca9 QaVlJ0IuxliVzFLex263uIqb6DMXkMaxYCpspmbBdd/Dsv9scLwzd9Y24RnNxBYC4Se4 a05uLzAzhdyC/nrkimt6z0osdA8ERLYhZqOiwi2Ll6//dNuhtVhlIWCuigyN0KwDgEb6 Y3sAArNzDcCYlQBPWjxD5khTbDLKmnwnUlIkHXGFUu0nCyscJy6ON8h1airoufi5nRPk w4LQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=tYqy+GsDVbYOj8gdH0ar6mQHtr1skNwQVM8QbIOh61I=; b=X8kyx3ZNofF7qjsLwyTHOQdyVpONcbwEIUcBE6I+lzt15igGxxxxDAJLk0eHnmXtcy 0EJESRTdVk0f9aKNTZ9aVcFyARcA708m/luzPbMYW5m6Bm6qX0SZOAMK+NP7MBhIoAcy QISZyfJ7LJ7DWq950e10Yr0hpyn6eH8++II5oeb4FZ+f7NRPxuO5pwfrH1RUDYTneHtI 9o8Ow5BFmDdLn4EhFPdJj5vND4syNa4KBEiCTOefH7obL6Lyoxk2HTrT4xMvzykZl3bt Ipl0/DmXrNh7Fl0r9tnInO3hphGEqTgAr0DLD7sTnb2uYj+p0WjyxZzWhXbvzfqHRwyf jrCQ==
X-Gm-Message-State: AOAM531B5q6g3WeyuL9j3UXJsg3ihvDmY6u8kHM5JYVHz9sKq7QNrAsu XdCofMT6JvAYhwd++GpjXKZbO/1aH2sgjP8Zhp75EA==
X-Google-Smtp-Source: ABdhPJxR4LzTIbnUgyAl2OOGLy8IFfmxC/LUOwV5f4SeIEs1rdFiq9zXFld3lQ5A+U/KwE/Ex/hVZF5E6ZZuYfscvmY=
X-Received: by 2002:a17:906:4c58:: with SMTP id d24mr4025858ejw.298.1623951019424; Thu, 17 Jun 2021 10:30:19 -0700 (PDT)
MIME-Version: 1.0
References: <CACL_3VEyLdQZ-3hvzXxyA8ehtWs2hXESZ2OqyAx+BeSg85+-cA@mail.gmail.com> <CACL_3VFE4TjKvmkfZjvNpWo6vVfKjz5w85=Q+yqnYZKcwbYLmQ@mail.gmail.com> <63FFC34B-2179-47F1-B325-21CAC3D1543A@strayalpha.com> <CACL_3VHTfxWaBj7TFEmBXBqovrrAj7XuFEZFUag_iBHr3Hx09g@mail.gmail.com> <0EBFC9B0-591A-4860-B327-6E617B83F4D1@strayalpha.com> <CALx6S34pT81TbfQDk2vKF8wBrXL312As79K=rEzUQ3Lmg7UvpA@mail.gmail.com> <7C51D926-9DBB-41F5-93B2-10F716F672B1@strayalpha.com> <CALx6S37uN8TsXQZ3cv5jmxwxSyBRjK=-GQ_MsWxPWSs21XoGHw@mail.gmail.com> <CACL_3VEx7+VnLz7OLdXyhZU41e+-oBz3dc8JdMV_7pLMfic6=w@mail.gmail.com> <fcc8762f-c042-7999-d2e4-f28384950a19@erg.abdn.ac.uk>
In-Reply-To: <fcc8762f-c042-7999-d2e4-f28384950a19@erg.abdn.ac.uk>
From: Tom Herbert <tom@herbertland.com>
Date: Thu, 17 Jun 2021 10:30:08 -0700
Message-ID: <CALx6S36sWGcZmFpAhF4DfOMyf6Z0w5F9bemNfeM1yWV-r0M+BA@mail.gmail.com>
To: Gorry Fairhurst <gorry@erg.abdn.ac.uk>
Cc: "C. M. Heard" <heard@pobox.com>, Joseph Touch <touch@strayalpha.com>, TSVWG <tsvwg@ietf.org>
Content-Type: text/plain; charset="UTF-8"
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/_SF9ZBJCWipNBIWi6LNRHZQxBtY>
Subject: Re: [tsvwg] RDMA Support by UDP FRAG Option
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 17 Jun 2021 17:30:27 -0000

On Thu, Jun 17, 2021 at 7:41 AM Gorry Fairhurst <gorry@erg.abdn.ac.uk> wrote:
>
> I'd personally perfer the simpler formats - unless someone tells me that
> coping with message buffers is made much easier by any more fiddlesome
> (re)ordering of bytes.
>
> When teh dust has settled, I expect we should see an updated
> fragmentation text.  I suspect we should consider the final format for
> suitability for offload (perhaps Tom Herbert would look?) and for ease
> of processing in message nbuffere (Tom Jones offered to look).

Gorry,

Please look at draft-herbert-udp-space-hdr-01 for my proposal as to
how the UDP surplus space should be formatted. If there is interest, I
could update draft to include considerations for UDP options
fragmentation and reassembly offload as well as header/data split
which is needed for zero-copy receive (i.e. packet headers are DMA'ed
into one set of buffers to be processed by the stack, payload is
DMA'ed to another set of buffers to be processed by the application).

Tom

>
> Gorry
>