Re: [v6ops] Server load balancing using the flow label

Brian E Carpenter <brian.e.carpenter@gmail.com> Mon, 31 October 2011 20:33 UTC

Return-Path: <brian.e.carpenter@gmail.com>
X-Original-To: v6ops@ietfa.amsl.com
Delivered-To: v6ops@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F235B11E823D for <v6ops@ietfa.amsl.com>; Mon, 31 Oct 2011 13:33:01 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -103.211
X-Spam-Level:
X-Spam-Status: No, score=-103.211 tagged_above=-999 required=5 tests=[AWL=-0.212, BAYES_00=-2.599, J_CHICKENPOX_13=0.6, RCVD_IN_DNSWL_LOW=-1, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id GjIOxml7cKbj for <v6ops@ietfa.amsl.com>; Mon, 31 Oct 2011 13:33:01 -0700 (PDT)
Received: from mail-gy0-f172.google.com (mail-gy0-f172.google.com [209.85.160.172]) by ietfa.amsl.com (Postfix) with ESMTP id 37A2311E823C for <v6ops@ietf.org>; Mon, 31 Oct 2011 13:33:01 -0700 (PDT)
Received: by gyh20 with SMTP id 20so7558664gyh.31 for <v6ops@ietf.org>; Mon, 31 Oct 2011 13:33:00 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=message-id:date:from:organization:user-agent:mime-version:to:cc :subject:references:in-reply-to:content-type :content-transfer-encoding; bh=teX7/ZG35VESoTBFH2jL1H4975m4AG3I6E9GSC4xVdQ=; b=nN+2G0SNSXGOLiUv/DZTAYcRfc11sxxkOTo5IQ92MatSY/T1i5/A/qDvWe0+PYPZU8 gtfRMft+pUoRA8crtp3/U4CSrtOFK1KOvPDLeKFYTo9gJzUNQKbnqk1fpRAi8fhR9PIB k4MIwzlNiydqBHcc4I7WeH/4mkrf9Kq0U2wZM=
Received: by 10.236.79.103 with SMTP id h67mr19080976yhe.122.1320093180778; Mon, 31 Oct 2011 13:33:00 -0700 (PDT)
Received: from [130.216.38.124] (stf-brian.sfac.auckland.ac.nz. [130.216.38.124]) by mx.google.com with ESMTPS id c68sm27502688yhi.7.2011.10.31.13.32.58 (version=SSLv3 cipher=OTHER); Mon, 31 Oct 2011 13:32:59 -0700 (PDT)
Message-ID: <4EAF05E3.7060306@gmail.com>
Date: Tue, 01 Nov 2011 09:32:35 +1300
From: Brian E Carpenter <brian.e.carpenter@gmail.com>
Organization: University of Auckland
User-Agent: Thunderbird 2.0.0.6 (Windows/20070728)
MIME-Version: 1.0
To: "George, Wes" <wesley.george@twcable.com>
References: <4EA8767B.1040509@gmail.com> <DCC302FAA9FE5F4BBA4DCAD46569377914516296CC@PRVPEXVS03.corp.twcable.com>
In-Reply-To: <DCC302FAA9FE5F4BBA4DCAD46569377914516296CC@PRVPEXVS03.corp.twcable.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
Cc: IPv6 Operations <v6ops@ietf.org>
Subject: Re: [v6ops] Server load balancing using the flow label
X-BeenThere: v6ops@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: v6ops discussion list <v6ops.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/v6ops>, <mailto:v6ops-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/v6ops>
List-Post: <mailto:v6ops@ietf.org>
List-Help: <mailto:v6ops-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/v6ops>, <mailto:v6ops-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 31 Oct 2011 20:33:02 -0000

Thanks, Wes, good comments that I pretty much agree with.

As for reflecting the same flow label back, it isn't immediately
obvious why this would help, but (skipping a longish argument about
uniform statistical distribution of flow labels) I don't think it
can possibly be harmful. You could do it quite cheaply by saving the
inbound label in the TCB at syn/ack time.

Regards
   Brian

On 2011-11-01 03:56, George, Wes wrote:
> I've read and support this being discussed/adopted
> 
> Some specific comments:
> 
> DNS-based loadbalancing is a good bit more complicated in a lot of cases, and as you note, may be used in combination with other methods. While it may still fall out of scope for this document, you may want to consider the case where a DNS server is involved in some manner of coarse geographical distribution of requests, either to a formalized CDN or simply to a more regionally-appropriate data center. I don't think that it materially changes the way that FL would be handled, but might be worth mentioning for the sake of completeness.
> 
> To the meat of the document:
> I think you're missing an opportunity for some clearer and stronger language regarding implementation of the flow label as described in 3697bis given your audience on this draft. A lot of the traffic in the case you're discussing is asymmetric, with the far larger flow occurring in the opposite (outbound) direction. While it is interesting to use this in the inbound direction as a means to manage server load, a couple of things to consider:
> 1) draft should strongly recommend that the source servers implement 3697bis on *outbound* traffic so that the networks in the path may use that to enhance load-balancing (via 6man-flow-ecmp) - if they're going to the trouble of using flow label as another input to improve inbound LB, it follows that they'd want to be able to take advantage of it in the opposite direction, and there may be some considerations involved in doing this at scale in a scenario with hundreds of servers behind a single set of uplinks, especially involving FL collisions and how they are handled.
> 2) When both ends have implemented 3697bis, I'm wondering if there are any considerations/benefits to using the same flow label value in each direction? That is, both the HTTP GETS and the responses use the same FL? While typically these are considered different flows, I'm thinking that perhaps there is value in being able to see the traffic as a consolidated flow. It would require some state or an algorithm to drive this behavior, and that is not currently covered in the FL drafts. I haven't given that a huge amount of thought yet, so I submit it for the WG's review...
> 
> Wes George
> 
> 
>> -----Original Message-----
>> From: v6ops-bounces@ietf.org [mailto:v6ops-bounces@ietf.org] On Behalf
>> Of Brian E Carpenter
>> Sent: Wednesday, October 26, 2011 5:07 PM
>> To: IPv6 Operations
>> Subject: [v6ops] Server load balancing using the flow label
>>
>> Hi,
>>
>> If you haven't done so, please have a look at
>> https://datatracker.ietf.org/doc/draft-carpenter-v6ops-label-balance/
>>
>> We'd like to briefly introduce this in Taipei, but some feedback before
>> then would be very helpful. It's a fairly simple draft relying on the
>> updated flow label standard that is in the RFC Editor queue. We can
>> discuss whether it belongs in v6ops, but it doesn't define any new
>> protocol.
>>
>> --
>> Regards
>>    Brian Carpenter + Sheng Jiang
>>
>>
>> _______________________________________________
>> v6ops mailing list
>> v6ops@ietf.org
>> https://www.ietf.org/mailman/listinfo/v6ops
> 
> This E-mail and any of its attachments may contain Time Warner Cable proprietary information, which is privileged, confidential, or subject to copyright belonging to Time Warner Cable. This E-mail is intended solely for the use of the individual or entity to which it is addressed. If you are not the intended recipient of this E-mail, you are hereby notified that any dissemination, distribution, copying, or action taken in relation to the contents of and attachments to this E-mail is strictly prohibited and may be unlawful. If you have received this E-mail in error, please notify the sender immediately and permanently delete the original and any copy of this E-mail and any printout.
>