Re: [tcpm] Hystart survey of large server operators
Neal Cardwell <ncardwell@google.com> Thu, 29 July 2021 16:59 UTC
Return-Path: <ncardwell@google.com>
X-Original-To: tcpm@ietfa.amsl.com
Delivered-To: tcpm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1])
by ietfa.amsl.com (Postfix) with ESMTP id 49AC83A0DF6
for <tcpm@ietfa.amsl.com>; Thu, 29 Jul 2021 09:59:17 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -18.097
X-Spam-Level:
X-Spam-Status: No, score=-18.097 tagged_above=-999 required=5
tests=[BAYES_00=-1.9, DKIMWL_WL_MED=-0.499, DKIM_SIGNED=0.1,
DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1,
ENV_AND_HDR_SPF_MATCH=-0.5, HTML_MESSAGE=0.001, SPF_HELO_NONE=0.001,
SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5,
USER_IN_DEF_SPF_WL=-7.5] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key)
header.d=google.com
Received: from mail.ietf.org ([4.31.198.44])
by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024)
with ESMTP id TVjnv6V4ebDC for <tcpm@ietfa.amsl.com>;
Thu, 29 Jul 2021 09:59:11 -0700 (PDT)
Received: from mail-ej1-x62c.google.com (mail-ej1-x62c.google.com
[IPv6:2a00:1450:4864:20::62c])
(using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
(No client certificate requested)
by ietfa.amsl.com (Postfix) with ESMTPS id 8928D3A0DEB
for <tcpm@ietf.org>; Thu, 29 Jul 2021 09:59:11 -0700 (PDT)
Received: by mail-ej1-x62c.google.com with SMTP id yk17so4141182ejb.11
for <tcpm@ietf.org>; Thu, 29 Jul 2021 09:59:11 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025;
h=mime-version:references:in-reply-to:from:date:message-id:subject:to
:cc; bh=XSLKSSwGRpfZcrcGzaPMANDIFJu1pCXMCeDOkR39eig=;
b=DyPlrku8YZ48e1C6Njx8rU0p0KBmgwrplnwPZFZdQJMtM1v+e8LcJ/iPsdy3yM4Z5Y
XoNZ2mRoP6fV2HKmBHAXHQceGSRcaC7TMRZE1EznghYAwsvOA49+bP+C6Pp/tTOPb+Lc
+LCU5zIKA8aM23qofUauAoolBX55WqYQNKnlpEU+eS/a2wDK+bOTDLdOze2b5J6x+3n6
cm3sPR/ofxUI9oWQQL806NTNPb2im7yZ29Sr6su+GUbJ3T2lkvSQN24wLz4XzakKHacI
Hs7MwFgNvs/4d+8VfSGAZiIBswTKWrb2D06bgNjy5By/y/1ax+LPVFxekRyRkaH5NQKa
enCg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20161025;
h=x-gm-message-state:mime-version:references:in-reply-to:from:date
:message-id:subject:to:cc;
bh=XSLKSSwGRpfZcrcGzaPMANDIFJu1pCXMCeDOkR39eig=;
b=dgZBnThcABVvzaFSkd2OKWOWBpKX+ongreAURdLH5T3i1HvvSohazLAZxMl/5OndH8
WpeTPVhdiETAk2Jr4X0Blvdl3dYgHJzepVdzCrY0shnwjzUF9nPl52nvhAdBSyBGLJvd
8FTBCA+UagSEwoxRpakp3NeDhmuLpT0EsSv99nZmRaCMw5hMHeLKbkr1XXswNY8AXvJO
Snb0ubfwqRKSXP557fKsU03ZzwlZgAC0VX7/aFRjBcrgI+rbL1+6KcZo+spWWCxrkEBs
9hVN+j6eeQQWHf8m0iGe5Sw3Qz+/+pEJBXSwE7Hs0jh1wuuTFOFi+FgqZYuM/cx7bg/Q
ElAQ==
X-Gm-Message-State: AOAM531xWAGFn7RZSWm/Qu3unbsO0S3iJ59UW/R306aU0gQd3So19WVb
QIejUavew8QdgOSS9foBc0Xs1NvJ0RqcfXP38QeX2g==
X-Google-Smtp-Source: ABdhPJx0rQb/90je5n1EmRocmSKToSgR4Ky7KFb4jhGY5cjnDbNl2Q54kYRfFmsDgnPtpwO6E+iw8gb5sbJc44bsLNI=
X-Received: by 2002:a17:906:e0ce:: with SMTP id
gl14mr5574236ejb.168.1627577948957;
Thu, 29 Jul 2021 09:59:08 -0700 (PDT)
MIME-Version: 1.0
References: <162610476442.30543.4667406094304409800@ietfa.amsl.com>
<98289918-67d1-2be1-723d-2df66be46fac@bobbriscoe.net>
<PH0PR00MB1030126A3220BC056A406490B6E99@PH0PR00MB1030.namprd00.prod.outlook.com>
<PH0PR00MB1030E0697BE8E93074B901D2B6E99@PH0PR00MB1030.namprd00.prod.outlook.com>
<84ac0f00-b828-2503-fd7c-0ef7c6465768@bobbriscoe.net>
<CAK6E8=f7qKDs-MFr4G6bpz82Swn3iCJEkWLL5yr+vV8z9zMb=Q@mail.gmail.com>
<004bfb54-32d6-0758-cd36-df52542c5a9d@bobbriscoe.net>
<4c203f66-6429-d717-8213-8bdf9d3a7b2a@huitema.net>
<CAK6E8=dpdFjcEoPkMORw+CjFAmpo+ZtS-Scj6qh9oYSmbtZyWA@mail.gmail.com>
<a746b460-cce8-c061-ae11-5773a70c2a0a@bobbriscoe.net>
<CAK6E8=drA5B+giL9uKh8ZbYwbex26k6_d3iOGj5TO5tn48+=Hw@mail.gmail.com>
In-Reply-To: <CAK6E8=drA5B+giL9uKh8ZbYwbex26k6_d3iOGj5TO5tn48+=Hw@mail.gmail.com>
From: Neal Cardwell <ncardwell@google.com>
Date: Thu, 29 Jul 2021 12:58:51 -0400
Message-ID: <CADVnQy=b-Ba8xs3fp6N8yWmorG-F8mAE8KRjCVfpkBi_sLr=pg@mail.gmail.com>
To: Yuchung Cheng <ycheng@google.com>
Cc: Bob Briscoe <ietf@bobbriscoe.net>, huitema@huitema.net,
"tcpm@ietf.org" <tcpm@ietf.org>,
"draft-ietf-tcpm-hystartplusplus@ietf.org"
<draft-ietf-tcpm-hystartplusplus@ietf.org>
Content-Type: multipart/alternative; boundary="0000000000007e5d1e05c84605c8"
Archived-At: <https://mailarchive.ietf.org/arch/msg/tcpm/CvJiFg6ChoDZToC3mzpsZ-aft9A>
Subject: Re: [tcpm] Hystart survey of large server operators
X-BeenThere: tcpm@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: TCP Maintenance and Minor Extensions Working Group <tcpm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tcpm>,
<mailto:tcpm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tcpm/>
List-Post: <mailto:tcpm@ietf.org>
List-Help: <mailto:tcpm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tcpm>,
<mailto:tcpm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 29 Jul 2021 16:59:21 -0000
On Thu, Jul 29, 2021 at 12:40 PM Yuchung Cheng <ycheng@google.com> wrote: > > > On Thu, Jul 29, 2021 at 9:28 AM Bob Briscoe <ietf@bobbriscoe.net> wrote: > >> Yuchung, >> >> On 29/07/2021 00:35, Yuchung Cheng wrote: >> >> same experience with Chrisitian >> >> For more than half a decade Google traffic used Linux CUBIC Hystart. This >> includes google.com and YouTube public Internet traffic, as well as >> internal Google TCP traffic. When we deployed pacing around 2013 we >> disabled the Hystart ACK-train mechanism (that Hystart++ prohibits now) as >> it causes false SS exit. But we continued to use the stock Hystart Delay >> mechanism. ~2014-15 we switched to BBR which uses a different startup more >> robust to delay jitters. >> >> >> [BB] You or Neal (sry can't remember which) were one of those I surveyed >> who said they had disabled Hystart. So perhaps this was a misunderstanding >> over the ACK-train part. >> > Yes this must be mis-communication. Since that was in 2018, it's either > "we don't use hystart b/c BBR doesn't use hystart" or "we don't use hystart > ack-train when hystart was used in Cubic before BBR". > Yes, my sense of our experience with CUBIC Hystart matches Yuchung's, including the likely sources of mis-communication. thanks, neal
- [tcpm] I-D Action: draft-ietf-tcpm-hystartplusplu… internet-drafts
- [tcpm] Full review of: draft-ietf-tcpm-hystartplu… Bob Briscoe
- [tcpm] Full review of: draft-ietf-tcpm-hystartplu… Bob Briscoe
- Re: [tcpm] Full review of: draft-ietf-tcpm-hystar… Bob Briscoe
- Re: [tcpm] [EXTERNAL] Full review of: draft-ietf-… Praveen Balasubramanian
- Re: [tcpm] [EXTERNAL] Full review of: draft-ietf-… Praveen Balasubramanian
- Re: [tcpm] [EXTERNAL] Full review of: draft-ietf-… Praveen Balasubramanian
- Re: [tcpm] [EXTERNAL] Full review of: draft-ietf-… Praveen Balasubramanian
- [tcpm] Hystart survey of large server operators Bob Briscoe
- Re: [tcpm] Hystart survey of large server operato… Yuchung Cheng
- Re: [tcpm] Hystart survey of large server operato… Bob Briscoe
- Re: [tcpm] Hystart survey of large server operato… Christian Huitema
- Re: [tcpm] Hystart survey of large server operato… Yuchung Cheng
- Re: [tcpm] Hystart survey of large server operato… Bob Briscoe
- Re: [tcpm] Hystart survey of large server operato… Yuchung Cheng
- Re: [tcpm] Hystart survey of large server operato… Neal Cardwell
- Re: [tcpm] Hystart survey of large server operato… Junho Choi