Re: [v6ops] draft-cc-v6ops-wlcg-flow-label-marking-00.txt

Brian E Carpenter <brian.e.carpenter@gmail.com> Thu, 29 June 2023 22:50 UTC

Return-Path: <brian.e.carpenter@gmail.com>
X-Original-To: v6ops@ietfa.amsl.com
Delivered-To: v6ops@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1A893C14CE51 for <v6ops@ietfa.amsl.com>; Thu, 29 Jun 2023 15:50:33 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.096
X-Spam-Level:
X-Spam-Status: No, score=-2.096 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, NICE_REPLY_A=-0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id whoNyVTpaGZz for <v6ops@ietfa.amsl.com>; Thu, 29 Jun 2023 15:50:30 -0700 (PDT)
Received: from mail-pl1-x62a.google.com (mail-pl1-x62a.google.com [IPv6:2607:f8b0:4864:20::62a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B59EBC14CE44 for <v6ops@ietf.org>; Thu, 29 Jun 2023 15:50:30 -0700 (PDT)
Received: by mail-pl1-x62a.google.com with SMTP id d9443c01a7336-1b7ef3e74edso7994165ad.0 for <v6ops@ietf.org>; Thu, 29 Jun 2023 15:50:30 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1688079029; x=1690671029; h=content-transfer-encoding:in-reply-to:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=ZhIB3gzsQ0GMCULsA1A3YtWguay8g+3tLxrCG2HHm7I=; b=VV6ChZxbQ9qcdzMa46pia2rhGGX/4mAkY/YFtOjqqozT/Ven8QMaG238o/tMnqZwxk gcVSyedYcr5xCvkJ5AYsdn20APBaYKkFV772nLy3cLA/Bz6SO4eCJ8PZHJyzz3m8MU4p YYaZpxIZLGvXbq/bpWZhbq6982IgkY9giQLZ5TaEijZCx5YlZVgmnh9meYoBjnCk9kJf YGDFOzVD1ZDOgCb+TFXD3352qHFz65iTmuhWB85klzOTvUWYaUD9UTS3MYtXwDxNHg9/ +uNUK/9tT/l0gO82432e58fQtkHqAnOdkVeK3EqstOu1bVw/9oSo6LmZMP3D5+X5vI6i 65XQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1688079029; x=1690671029; h=content-transfer-encoding:in-reply-to:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=ZhIB3gzsQ0GMCULsA1A3YtWguay8g+3tLxrCG2HHm7I=; b=ErZQe3vYXYLQRqikSvXVF5xuLJS6fYJS2v92lEfIKVLTYNdeXhSg7yqtVWebeaOQ7o weR4CzYpXLB7DyVUjsk+oKuQEvViP54XtBEYUbb6zfKvDPPyuD18Ji/ZFHs/drWkBNmh luNuffqT7Lz4yWVFI4CUEBQG6li6+Ab0XRWY/VA3fqYN+NRZs6Rtv6563EzCM61OBA8D RidlwST1HPnj8vCAvf6ePFTVEdyIC7uufAcdUPPhKM2VCgH8T9QcfKFg2Nxd4vNaGBFz fgGWTczSVQYnEsIIfK2j1X3UZTAswlAtvp6sSFHsJKmLDuMGWx2jjpXcL4Fl3/SodmEd fYjA==
X-Gm-Message-State: ABy/qLZOqDHUoYOyjTfDP2M4cukDP6fSN/i2MD4GvTh0cpXznFB7FZcp WnRalBUo9ibzjYp9wLzl8OSakQmojZvxrA==
X-Google-Smtp-Source: APBJJlEPoKxnYKaUMzZFq21Wrp//ZSOA49cT8qEEyvBOix4sZSH2482wmkbqtgPRKxjgKsPoFDnnKg==
X-Received: by 2002:a17:90a:9ed:b0:263:2a37:31b with SMTP id 100-20020a17090a09ed00b002632a37031bmr669811pjo.14.1688079029313; Thu, 29 Jun 2023 15:50:29 -0700 (PDT)
Received: from ?IPV6:2406:e003:1184:f001:abb6:ea4f:cf8e:1d0d? ([2406:e003:1184:f001:abb6:ea4f:cf8e:1d0d]) by smtp.gmail.com with ESMTPSA id k7-20020a17090a658700b00262eccfa29fsm7448685pjj.33.2023.06.29.15.50.27 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 29 Jun 2023 15:50:28 -0700 (PDT)
Message-ID: <9e2081c4-896f-9a7b-71e3-5a88457d4659@gmail.com>
Date: Fri, 30 Jun 2023 10:50:24 +1200
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.10.0
Content-Language: en-US
To: "Dale W. Carder" <dwcarder@es.net>, v6ops@ietf.org
References: <ZJ3g8L16euGgDLuI@dwc-desktop.local>
From: Brian E Carpenter <brian.e.carpenter@gmail.com>
In-Reply-To: <ZJ3g8L16euGgDLuI@dwc-desktop.local>
Content-Type: text/plain; charset="UTF-8"; format="flowed"
Content-Transfer-Encoding: 7bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/v6ops/EIfYfzda1fTwAugq-zs8x4lnUK8>
Subject: Re: [v6ops] draft-cc-v6ops-wlcg-flow-label-marking-00.txt
X-BeenThere: v6ops@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: v6ops discussion list <v6ops.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/v6ops>, <mailto:v6ops-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/v6ops/>
List-Post: <mailto:v6ops@ietf.org>
List-Help: <mailto:v6ops-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/v6ops>, <mailto:v6ops-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 29 Jun 2023 22:50:33 -0000

Hi Dale,

Thanks for documenting this.

As well as the impact on ECMP/LAG (where you might add a reference to
RFC 6438), could you also mention the impact on server load balancing
(RFC 7098)? The real issue here is that with only 5 random bits, the
probability of two very large flows hashing to the same path or server
is higher than we'd like. But since the WLCG flows are *all* very large,
this presumably doesn't matter so much in your use case?

I'd never thought about using a Hamming code to generate flow labels.
But since a given flow must use the same flow label throughout, you can
only use the regular 5-tuple as input to the Hamming code. I don't
believe that a Hamming code will give you a discrete uniform distribution,
but I'm not an expert in that area. An expert known as ChatGPT says:
"No, a Hamming code does not produce a discrete uniform distribution...
The non-uniformity of the distribution arises from the fact that Hamming
codes prioritize error detection and correction capabilities over
uniformity of codeword distribution."

So I think that simply using a stateless hash is the best way. These
days I like FNV (draft-eastlake-fnv) which is easy and cheap to implement.

Regards
    Brian Carpenter

On 30-Jun-23 07:52, Dale W. Carder wrote:
> Hi folks,
> 
> We have submitted this draft documenting our experimental use of the
> IPv6 flow label for packet marking and the considerations we had made
> along the way that sort of got us to this point.
> 
> I'm hoping we could get some initial discussion underway here before
> IETF 117.  Thanks!
> 
> Dale
> 
> ----- Forwarded message from internet-drafts@ietf.org -----
>> Date: Thu, 29 Jun 2023 12:18:53 -0700
>> From: internet-drafts@ietf.org
>> Subject: New Version Notification for draft-cc-v6ops-wlcg-flow-label-marking-00.txt
>>
>>
>> A new version of I-D, draft-cc-v6ops-wlcg-flow-label-marking-00.txt
>> has been successfully submitted by Dale W. Carder and posted to the
>> IETF repository.
>>
>> Name:		draft-cc-v6ops-wlcg-flow-label-marking
>> Revision:	00
>> Title:		Use of the IPv6 Flow Label for WLCG Packet Marking
>> Document date:	2023-06-29
>> Group:		Individual Submission
>> Pages:		15
>> URL:            https://www.ietf.org/archive/id/draft-cc-v6ops-wlcg-flow-label-marking-00.txt
>> Status:         https://datatracker.ietf.org/doc/draft-cc-v6ops-wlcg-flow-label-marking/
>> Html:           https://www.ietf.org/archive/id/draft-cc-v6ops-wlcg-flow-label-marking-00.html
>> Htmlized:       https://datatracker.ietf.org/doc/html/draft-cc-v6ops-wlcg-flow-label-marking
>>
>>
>> Abstract:
>>     This document describes an experimentally deployed approach currently
>>     used within the Worldwide Large Hadron Collider Computing Grid (WLCG)
>>     to mark packets with their project (experiment) and application.  The
>>     marking uses the 20-bit IPv6 Flow Label in each packet, with 15 bits
>>     used for semantics and 5 bits for entropy.  Alternatives, in
>>     particular use of IPv6 Extension Headers (EH), were considered but
>>     found to not be practical.  The WLCG is one of the largest worldwide
>>     research communities and has adopted IPv6 heavily for movement of
>>     many tens of PB of data annually, with the ultimate goal of running
>>     IPv6 only.
>>
>>                                                                                    
>>
>>
>> The IETF Secretariat
>>
>>
> 
> ----- End forwarded message -----
> 
> _______________________________________________
> v6ops mailing list
> v6ops@ietf.org
> https://www.ietf.org/mailman/listinfo/v6ops