Re: Impact of hardware offloads on network stack performance

"Eggert, Lars" <lars@netapp.com> Thu, 10 May 2018 14:03 UTC

Return-Path: <lars@netapp.com>
X-Original-To: quic@ietfa.amsl.com
Delivered-To: quic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 166DE12E049 for <quic@ietfa.amsl.com>; Thu, 10 May 2018 07:03:29 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.21
X-Spam-Level:
X-Spam-Status: No, score=-4.21 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=netapp.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id bNvlxFkoRN34 for <quic@ietfa.amsl.com>; Thu, 10 May 2018 07:03:27 -0700 (PDT)
Received: from mx143.netapp.com (mx143.netapp.com [IPv6:2620:10a:4005:8000:2306::c]) (using TLSv1.2 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id AE3DD124235 for <quic@ietf.org>; Thu, 10 May 2018 07:03:27 -0700 (PDT)
X-IronPort-AV: E=Sophos;i="5.49,385,1520924400"; d="asc'?scan'208";a="258088661"
Received: from vmwexchts04-prd.hq.netapp.com ([10.122.105.32]) by mx143-out.netapp.com with ESMTP; 10 May 2018 07:03:27 -0700
Received: from VMWEXCCAS06-PRD.hq.netapp.com (10.122.105.22) by VMWEXCHTS04-PRD.hq.netapp.com (10.122.105.32) with Microsoft SMTP Server (TLS) id 15.0.1320.4; Thu, 10 May 2018 07:03:26 -0700
Received: from NAM03-BY2-obe.outbound.protection.outlook.com (10.120.60.153) by VMWEXCCAS06-PRD.hq.netapp.com (10.122.105.22) with Microsoft SMTP Server (TLS) id 15.0.1320.4 via Frontend Transport; Thu, 10 May 2018 07:03:27 -0700
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=tCv2LjVqQEhhTuxbLwCld/nzXMf1pwVD8FcA1QW5z1w=; b=qzkx/D8Hk3vxWCBivIsjuHsDg4f4bZqAhkLh0ZCEB4+oj/w/XeTQA3b21lLIxs4+5pxM96ftZDqQCXQjyzUc7TrHSr1bZGPpD1BeyEu0hr6Wk59K4dpY1BeTzzANP1c7N2PkVlmsXicwHTebMXvKqUIEebQr+tS4U32v4+xeP70=
Received: from BY2PR06MB1765.namprd06.prod.outlook.com (10.163.33.19) by BY2PR06MB089.namprd06.prod.outlook.com (10.242.43.21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.755.16; Thu, 10 May 2018 14:03:25 +0000
Received: from BY2PR06MB1765.namprd06.prod.outlook.com ([fe80::7d12:230a:1ce3:5f60]) by BY2PR06MB1765.namprd06.prod.outlook.com ([fe80::7d12:230a:1ce3:5f60%13]) with mapi id 15.20.0735.019; Thu, 10 May 2018 14:03:25 +0000
From: "Eggert, Lars" <lars@netapp.com>
To: Boris Pismenny <borisp@mellanox.com>
CC: Mikkel Fahnøe Jørgensen <mikkelfj@gmail.com>, Watson Ladd <watsonbladd@gmail.com>, craigt <c@gryning.com>, "Lubashev, Igor" <ilubashe@akamai.com>, Roberto Peon <fenix@fb.com>, Mike Bishop <mbishop@evequefou.be>, Ian Swett <ianswett=40google.com@dmarc.ietf.org>, Praveen Balasubramanian <pravb@microsoft.com>, IETF QUIC WG <quic@ietf.org>, "Deval, Manasi" <manasi.deval@intel.com>
Subject: Re: Impact of hardware offloads on network stack performance
Thread-Topic: Impact of hardware offloads on network stack performance
Thread-Index: AdPMUbL7T8nZAW2ySiO289IPTC0ttgAApm4AADSbFZAACUWYgAAFkLQAACA3b/AAAajkgANRfL2AAAA3SQAAAHMwgAAAR/kAAAEuygAAAJMTgAAAxh6AAAICTwABULcLAAH1RkWAAAFsVQAAABcZgAAAb8KAAABmhYAAADTmAA==
Date: Thu, 10 May 2018 14:03:24 +0000
Message-ID: <9E549481-9B80-4DED-AC37-DC0C91AEBCDE@netapp.com>
References: <CY4PR21MB0630CE4DE6BA4EDF54A1FEB1B6A40@CY4PR21MB0630.namprd21.prod.outlook.com> <1F436ED13A22A246A59CA374CBC543998B60C7AD@ORSMSX111.amr.corp.intel.com> <CAN1APdc3y0EwFqeYVvZs7MtBHhS_9CzwGmcwRqi_6GHWzF3_2Q@mail.gmail.com> <1F436ED13A22A246A59CA374CBC543998B60C851@ORSMSX111.amr.corp.intel.com> <CAN1APdcPkO-HfXqqvjeee6K8U8KSZQdtx=6fW1vZo+H6pKfzzQ@mail.gmail.com> <CAKcm_gP8TRPT7yi1y=mU5Fvq7xB5-1ieyKFLQMPomfabYbkcxA@mail.gmail.com> <bf540ec1f6f045aca1cf2379380630b5@usma1ex-dag1mb5.msg.corp.akamai.com> <SN1PR08MB185446750FCDA2B58C9833C8DA890@SN1PR08MB1854.namprd08.prod.outlook.com> <CACsn0cmJcAxORo4Cd-qyGJL3ZOT5Yz0WgdMqv_AGi4DjedyzFA@mail.gmail.com> <A6F55755-D7E1-40E4-8EC3-D5FE77A2EDBE@fb.com> <CAK-1kemWAW+2Sk5aKJ+RXKUAyjFii4MRH=xK7SE0mr=tbCiRfw@mail.gmail.com> <CAN1APddgX6=CxKdUA718=95EeCUPS60vVxbGFDHa7-eRjw7BxA@mail.gmail.com> <98A67023-AE1D-48EE-BD75-7D03E05E980D@netapp.com> <CAN1APdf2VKXB-sO97S=n5rCC4t6YZL22T=xdxPba9SgRAPKwLA@mail.gmail.com> <5213b2f5-c795-9d54-72b8-01a4a6db03ee@mellanox.com>
In-Reply-To: <5213b2f5-c795-9d54-72b8-01a4a6db03ee@mellanox.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
x-mailer: Apple Mail (2.3445.6.18)
authentication-results: spf=none (sender IP is ) smtp.mailfrom=lars@netapp.com;
x-originating-ip: [62.189.0.100]
x-ms-publictraffictype: Email
x-microsoft-exchange-diagnostics: 1; BY2PR06MB089; 7:raw2njuB2OxqzooIi901mK1kc5+iT8FDRyTTFik9QgyxAPdWyDhigWa9hSC9KyzSD+Gxg702BX5CG5JrZEWtvFDmxaxlL9mztNRUace+0/+HrGaWWa23qWV1SPQdqu/fMPwFcNCY61P1EF1xh5kJgcOx3BcSfex4VzN6x3CSNxTbxNX5fDq58yMBcuL0W3V8WdbFkoEIuyHifwi1pziond25Auq7L+nlNWtoKtNw4EYbntAIUlbzCHacA5dG2e97
x-ms-exchange-antispam-srfa-diagnostics: SOS;
x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(4534165)(4627221)(201703031133081)(201702281549075)(5600026)(2017052603328)(49563074)(7193020); SRVR:BY2PR06MB089;
x-ms-traffictypediagnostic: BY2PR06MB089:
x-microsoft-antispam-prvs: <BY2PR06MB089BB0B5C3B1DFAD0EE92BAA7980@BY2PR06MB089.namprd06.prod.outlook.com>
x-exchange-antispam-report-test: UriScan:;
x-ms-exchange-senderadcheck: 1
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(8211001083)(102415395)(6040522)(2401047)(5005006)(8121501046)(10201501046)(93006095)(93001095)(3002001)(3231254)(944501410)(52105095)(6055026)(149027)(150027)(6041310)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123560045)(20161123564045)(20161123558120)(20161123562045)(6072148)(201708071742011); SRVR:BY2PR06MB089; BCL:0; PCL:0; RULEID:; SRVR:BY2PR06MB089;
x-forefront-prvs: 066898046A
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(396003)(39380400002)(39860400002)(346002)(366004)(376002)(377424004)(189003)(199004)(82746002)(93886005)(36756003)(6506007)(39060400002)(486006)(6512007)(4326008)(99936001)(2616005)(476003)(8936002)(11346002)(446003)(8666007)(66066001)(6486002)(81156014)(6436002)(81166006)(26005)(5660300001)(186003)(3660700001)(57306001)(50226002)(25786009)(102836004)(5250100002)(6916009)(54906003)(6246003)(33656002)(76176011)(53546011)(83716003)(86362001)(53936002)(478600001)(316002)(14454004)(99286004)(106356001)(68736007)(97736004)(105586002)(3280700002)(2900100001)(7416002)(7736002)(229853002)(305945005)(8676002)(3846002)(6116002)(2906002)(4001150100001); DIR:OUT; SFP:1101; SCL:1; SRVR:BY2PR06MB089; H:BY2PR06MB1765.namprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: netapp.com does not designate permitted sender hosts)
x-microsoft-antispam-message-info: lXsOoWzTk4pi/4B2i4PSLz2ubuR90TpTCDdrswaS2l5uq0D7Fe6+zYgPUBCzzqlo/GdvXwxXjmCS4IqOiUiCFoJOcbP9C4E226RUEZR3sZRfNefnxByrYNm3jqLKFrB3NEjag+411trQaJocqXXnvFwd2MBBnOSQm5S69S3MumlfbTGjxyPhJ/g9b/frDts6
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/signed; boundary="Apple-Mail=_C3996F64-80FA-4249-8776-79ED6290501B"; protocol="application/pgp-signature"; micalg="pgp-sha512"
MIME-Version: 1.0
X-MS-Office365-Filtering-Correlation-Id: b74f2c59-53ec-49b5-4cc7-08d5b67ecc43
X-MS-Exchange-CrossTenant-Network-Message-Id: b74f2c59-53ec-49b5-4cc7-08d5b67ecc43
X-MS-Exchange-CrossTenant-originalarrivaltime: 10 May 2018 14:03:24.9546 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY2PR06MB089
X-OriginatorOrg: netapp.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/quic/Po9hfm9DsneyuCEzozUCtU146M0>
X-BeenThere: quic@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Main mailing list of the IETF QUIC working group <quic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/quic>, <mailto:quic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/quic/>
List-Post: <mailto:quic@ietf.org>
List-Help: <mailto:quic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/quic>, <mailto:quic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 10 May 2018 14:03:29 -0000

On 2018-5-10, at 14:57, Boris Pismenny <borisp@mellanox.com> wrote:
> Also, is there a reason to prefer netmap over other userspace network stacks like DPDK/VPP/etc?

For me personally, the netmap API is a lot more minimal and therefore easier to integrate. DPDK really wants to take over scheduling, memory management and all kinds of other stuff besides packet I/O. YMMV.

Lars