IETF Logo Mail Archive

Re: [tsvwg] Switch testing at 25G with ECN --SCE Draft

Greg White <g.white@CableLabs.com> Thu, 08 August 2019 22:58 UTC

Return-Path: <g.white@CableLabs.com>
X-Original-To: tsvwg@ietfa.amsl.com
Delivered-To: tsvwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2FB0B12003E for <tsvwg@ietfa.amsl.com>; Thu, 8 Aug 2019 15:58:53 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.999
X-Spam-Level:
X-Spam-Status: No, score=-1.999 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cablelabs.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id hIIQiUxif18r for <tsvwg@ietfa.amsl.com>; Thu, 8 Aug 2019 15:58:49 -0700 (PDT)
Received: from NAM04-SN1-obe.outbound.protection.outlook.com (mail-eopbgr700132.outbound.protection.outlook.com [40.107.70.132]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 0A28E12002F for <tsvwg@ietf.org>; Thu, 8 Aug 2019 15:58:48 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=BWB7CsPETjQHOBv/yuQ921zJ4PdXXWZAqhd5qOB/BUsAv8g9H9Ru2bspJiclMc+MEO139bqS1qQsTEVoAdr2DxebYE34HmdS/Sc0+jtIZnA7DNLBymkuWYH0Ts9C8v8oh9q5BgFyw23B7BShnq/x0IYjv75r/Ni6V1OsLFqf4g6N1n4xl1W0imQJWtr1hNtpb+uswc7hFKz8W66kGRGrHsGafD8kkC1PWYrM7Ky/iMEMTKNzCRBiMwlJXmFO4e1XlbA5ORnhPov2JaLvnWi1h17oBMX1tX7Tmj8c3Dy6S4bDhKk497qBIS7VkzCHSMc6jjME53Tr+ZL//sqy13B9fA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=EpgKRwc6o5Sufvx4EwM6RB6P/RsEk3F2jxDPqXJx4C4=; b=LD+9kyvzCmfURarRoFZyW4CIwoNxZ4QKn0SOXNBeXy3lhG7pd1rceDjq3STam9oNbx21tmKm8yyJKudquzW8qivUuC90oY30YB/PJ89shY2sgoNK9Bci0LxPFmexV3Zmb26Zj3U19WhTT4uIsSljlWdPdaQrwmEVCRz4lqCrqNwfskcga0JuCHWztGto9JDvdghMBtyqvI77dXBf6Rpim7k6JBKKAylBH23YpDEvPmCgUC+dAmlwH/bKhJrz1NVBTzfVhR/xy39D3gXessN0KaghLq0uPPCcngVP1x+avXEU/fRdbJwESuw+eExd2EMnxbiH17XzClDl0pIfbOLHuQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cablelabs.com; dmarc=pass action=none header.from=cablelabs.com; dkim=pass header.d=cablelabs.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cablelabs.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=EpgKRwc6o5Sufvx4EwM6RB6P/RsEk3F2jxDPqXJx4C4=; b=YddPYXdSzmCMzHTEL7fqC8z9VyITJOoXOOKMpn2GWc5mggs2W7W8zZC7zSNCARK/nYhJUnCYpx05JmWMw99rrRIL7sn7o5ud3Vh4gdM9FGsQwlQ25/NRG/CKFVGTGR9G44efaIdWwpouaAcZ5CaM1cT/vbbiv7mvwchauo8Uf60=
Received: from SN6PR06MB4655.namprd06.prod.outlook.com (52.135.117.85) by SN6PR06MB5245.namprd06.prod.outlook.com (20.177.254.88) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2157.18; Thu, 8 Aug 2019 22:58:46 +0000
Received: from SN6PR06MB4655.namprd06.prod.outlook.com ([fe80::d33:804d:d298:58b3]) by SN6PR06MB4655.namprd06.prod.outlook.com ([fe80::d33:804d:d298:58b3%3]) with mapi id 15.20.2136.022; Thu, 8 Aug 2019 22:58:46 +0000
From: Greg White <g.white@CableLabs.com>
To: "Scaglione, Giuseppe" <giuseppe.scaglione@hpe.com>, "tsvwg@ietf.org" <tsvwg@ietf.org>
Thread-Topic: [tsvwg] Switch testing at 25G with ECN --SCE Draft
Thread-Index: AQHVTjzVagH3r6fcc06dVlu/ZJB8+Q==
Date: Thu, 08 Aug 2019 22:58:46 +0000
Message-ID: <A8E3F5E9-443D-4F5A-9336-9A0E2E72C278@cablelabs.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/10.1a.0.190530
authentication-results: spf=none (sender IP is ) smtp.mailfrom=g.white@CableLabs.com;
x-originating-ip: [192.160.73.16]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 9a35abb0-cd12-4dfe-f387-08d71c53f819
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600148)(711020)(4605104)(1401327)(2017052603328)(49563074)(7193020); SRVR:SN6PR06MB5245;
x-ms-traffictypediagnostic: SN6PR06MB5245:
x-ms-exchange-purlcount: 3
x-microsoft-antispam-prvs: <SN6PR06MB52458722744FE157D4668E67EED70@SN6PR06MB5245.namprd06.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-forefront-prvs: 012349AD1C
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(376002)(136003)(39840400004)(366004)(396003)(346002)(189003)(199004)(54094003)(2616005)(3846002)(99286004)(476003)(2501003)(9326002)(14454004)(8676002)(8936002)(186003)(81156014)(81166006)(296002)(66066001)(966005)(71190400001)(478600001)(256004)(26005)(5024004)(102836004)(99936001)(6506007)(53546011)(14444005)(36756003)(316002)(606006)(25786009)(71200400001)(58126008)(110136005)(486006)(6116002)(6246003)(53936002)(790700001)(6486002)(236005)(86362001)(229853002)(861006)(66446008)(733005)(66576008)(66946007)(66556008)(6436002)(5660300002)(33656002)(91956017)(76116006)(66476007)(64756008)(6306002)(2906002)(54896002)(7736002)(6512007)(54556002)(85282002); DIR:OUT; SFP:1102; SCL:1; SRVR:SN6PR06MB5245; H:SN6PR06MB4655.namprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: CableLabs.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: bGpUTFdji/at2nh+BMgrODSNh+8ld5MuXAb2vRLpDr2D7xjeVxm6aFcMgtwTYkSe6lprhnB3gPrgMHcFf+1C9YVdgcsNKeGv6lmZBQv7XFev2kJ7vNgNRDma2Yd6qA6yK3wpEpJzjy8YmW/hr9d8uq/XnDEgpvSl+11FyPi5VfVTi3C/QjO6w6z5PoONjfOdtVASfo5EQQl9Jqb4PbTQ/y9GjfMX/bjenIGEObZQeLZ8fJLhu3RXJFtV7EsvPltFJb5VjPi0k0IaPRXJX7AkD5qAthU2Cj8iwKeyP7zZLlG0tf+hg7Dc137uvjupz58MwE3Xd8M7kjN0oCL70YtSZt7t0n5g0ew7Ha0LP9cyNaj9oktwvh1s75K5458CprVb/XY5hjBwRDp/rvhxdHsy4rh5WQ1uT6u/bK/B+nNArGE=
x-ms-exchange-transport-forked: True
Content-Type: multipart/related; boundary="_005_A8E3F5E9443D4F5A93369A0E2E72C278cablelabscom_"; type="multipart/alternative"
MIME-Version: 1.0
X-OriginatorOrg: cablelabs.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 9a35abb0-cd12-4dfe-f387-08d71c53f819
X-MS-Exchange-CrossTenant-originalarrivaltime: 08 Aug 2019 22:58:46.5148 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: ce4fbcd1-1d81-4af0-ad0b-2998c441e160
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: g.white@cablelabs.com
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN6PR06MB5245
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsvwg/Ks41sAByk2dMVvCcEI-yqgyBpjo>
Subject: Re: [tsvwg] Switch testing at 25G with ECN --SCE Draft
X-BeenThere: tsvwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Working Group <tsvwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsvwg/>
List-Post: <mailto:tsvwg@ietf.org>
List-Help: <mailto:tsvwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsvwg>, <mailto:tsvwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 08 Aug 2019 22:58:53 -0000

Hi Giuseppe,

Thanks for sharing your work.   At the TSVWG meeting at IETF105 it was mentioned that there was a hardware implementation of SCE running in a 25Gbps switch (1:47:30 in https://www.ietf.org/audio/ietf105/ietf105-placeducanada-20190726-1220.mp3).  I presume this is the implementation that was being referred to.

If I’m reading this correctly, the marking implementation in the switch is actually DCTCP-style (marking CE based on instantaneous queuing delay) in a single queue, rather than SCE-style.   The CE marks are then transformed into SCE marking by the receiver itself before being handed to dctcp-sce or reno-sce.  So, in essence this test appears to be a study of various AQM ramp options and modified ECN congestion responses in a homogeneous DCTCP datacenter environment, rather than being an SCE experiment specifically.

Could you provide some information on the buffer size?  It looks like it may be ~200us.   How does this marking approach compare to existing DCTCP deployments (i.e. do they generally use a hard marking threshold or do they similarly use a ramp)?  Have you thought about adjusting the ramp so that 100% marking occurs before you reach the tail drop limit?  I wonder if that would eliminate the packet drops.

For comparison, you may as well use stock DCTCP which would avoid the receiver needing to translate the CE marks into SCE marks, since DCTCP can just interpret the CE marks directly.   But, I didn’t think that the goal of SCE was to replace DCTCP in datacenters anyway…

Are the tables missing some data?  I don’t see the bandwidth/retries/packet drop data for the continuous TCP connections.

Also, do you have an explanation for Pic 1, where the ping time when the link is idle is almost double the ping time when the link is saturated?

Best Regards,
Greg



From: tsvwg <tsvwg-bounces@ietf.org> on behalf of "Scaglione, Giuseppe" <giuseppe.scaglione@hpe.com>
Date: Tuesday, August 6, 2019 at 3:36 PM
To: "tsvwg@ietf.org" <tsvwg@ietf.org>
Subject: [tsvwg] Switch testing at 25G with ECN --SCE Draft

Greetings,

The attached document contains data collected testing with an Ethernet switch and the new TCP-dctcp-sce and TCP-reno-sce algorithms, draft-morton-taht-tsvwg-sce-00.

Best regards,


Giuseppe Scaglione
Distinguished Technologist
R&D Lab Hardware
Aruba Networks
Hewlett Packard Enterprise
8000 Foothills Blvd.  (MS 5555)
Roseville, CA   95747
Tel : 1-916-471-9189
[cid:image001.jpg@01D11639.32250950][cid:image001.png@01D0EBC2.DCD78900]

v2.23.0 | Report a Bug | By Email