Re: [IPFIX] Options Templates, Templates, and related Data Sets sent in separate transport sessions

"Aitken, Paul" <paitken@ciena.com> Mon, 05 February 2024 10:17 UTC

Return-Path: <prvs=6765fa2450=paitken@ciena.com>
X-Original-To: ipfix@ietfa.amsl.com
Delivered-To: ipfix@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1B0CDC14F6F0 for <ipfix@ietfa.amsl.com>; Mon, 5 Feb 2024 02:17:37 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.103
X-Spam-Level:
X-Spam-Status: No, score=-7.103 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=ciena.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id sIccYXE2NCSK for <ipfix@ietfa.amsl.com>; Mon, 5 Feb 2024 02:17:32 -0800 (PST)
Received: from mx0a-00103a01.pphosted.com (mx0a-00103a01.pphosted.com [67.231.144.234]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id DEB35C14F6EE for <ipfix@ietf.org>; Mon, 5 Feb 2024 02:17:32 -0800 (PST)
Received: from pps.filterd (m0174892.ppops.net [127.0.0.1]) by mx0a-00103a01.pphosted.com (8.17.1.24/8.17.1.24) with ESMTP id 4158uZTX009000; Mon, 5 Feb 2024 05:17:30 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ciena.com; h= from:to:subject:date:message-id:references:in-reply-to :content-type:content-id:content-transfer-encoding:mime-version; s=06252019; bh=tbCXqfBT4besvvMAXL5hU1KLCYACbOtuRPY3gQAIi5Y=; b= asJoTfjf9UBXamCQFiUTaJ3341rfJJWAbCXEPRJGSK/VHZmxkHrW2/tftA5PSoXA 1y0MmZ1GxGMMk5dPHTVNHSM9+4B9PM+qwn+p1Up3qqEcXwry3l6VDgQy79dGt47Q f1yJQ+mK4Cco8cB1biK9SDZcVGFS73HeXzwj/x7g1FauS2T7yaIBSkJDvOrr8ax6 MYqxUBKzZi6tN2sN5dSQV3qZN/DGfNg/1uMZRJjwocsw31uQKZhZm60BOPu15iaa vVQq76AUpmeXKGPkfR9RXNpO+tNDS8nyzI4f+L5rBJJLRDdnb6mIaI1eHVyrB2G2 LzuHmiirNkNJyng0ITBIxA==
Received: from nam10-mw2-obe.outbound.protection.outlook.com (mail-mw2nam10lp2101.outbound.protection.outlook.com [104.47.55.101]) by mx0a-00103a01.pphosted.com (PPS) with ESMTPS id 3w2vkx05u1-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 05 Feb 2024 05:17:30 -0500 (EST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=W4K1wh/wlVRlZb//Rmhi7Rj2eGrpITpyEry4S6uSkSwBj6G8P5RTQkqWcagfmcSZPD3EmQ7Y7CIVRZclkACJN2iEdGyGifu4L5YNj0A9ztsDXNJzHgTZJhzjnEtvWTuuFkG0PMZcm5EY7tFY1AQFbc+/4IYAo3LS2s8dflbiZ1n/VXvLcOGrac4OjVGpH6Q1N6mu02N2WngG7NUUXXP6qKY05BdLSY1Mgr/RTlcAbnI8n5REzB2JVCjgomW8SK2t7qAucq3AjA80AwtABAqbWBgKEPDylRMzqxmoNJmvTIiq6cqKNuJp886WfGYJ4AiGNUxZzfFYDzuJIVPxZTgzZg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=tbCXqfBT4besvvMAXL5hU1KLCYACbOtuRPY3gQAIi5Y=; b=XrIahAtMf9jDJF03+5wZqQ0j6h00DXfDdCWKX9tzlqlDacIdeytnGgrH9dIv9mIAiLfEtuOayYjTBhgeGeu54QLpA7ORjsW7AGN+S+OtaNvjtbJICsekmjK9MHGIsIZNEeiAOM8o9kUQ8G+UBL6cpTsdSCXDrm4U65d0PqtzkIbRxa4xntBqbVQxgB2N9Q/I1rxYfezb3XckIamRpIFTBTWD0+5peYU/IYuLj89H8lQJTIPnLovjZ9x3EfBgW6OKb9BIgmMvo22Dg+NcxqMVJ9EsZJs2hD7NfnZOXc/ZiL5uppgmAykLwzgKJOtIU5Dyn/IOCGnUVZHhe343CgPTzQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ciena.com; dmarc=pass action=none header.from=ciena.com; dkim=pass header.d=ciena.com; arc=none
Received: from SN6PR04MB4573.namprd04.prod.outlook.com (2603:10b6:805:ae::30) by DM6PR04MB7083.namprd04.prod.outlook.com (2603:10b6:5:24e::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7249.34; Mon, 5 Feb 2024 10:17:27 +0000
Received: from SN6PR04MB4573.namprd04.prod.outlook.com ([fe80::9905:4572:e30a:c738]) by SN6PR04MB4573.namprd04.prod.outlook.com ([fe80::9905:4572:e30a:c738%4]) with mapi id 15.20.7249.032; Mon, 5 Feb 2024 10:17:27 +0000
From: "Aitken, Paul" <paitken@ciena.com>
To: Garri Djavadyan <g.djavadyan@gmail.com>, "ipfix@ietf.org" <ipfix@ietf.org>
Thread-Topic: [IPFIX] Options Templates, Templates, and related Data Sets sent in separate transport sessions
Thread-Index: AQHaWByEDaPXUo8PtU6ddoMgTJJPwg==
Date: Mon, 05 Feb 2024 10:17:27 +0000
Message-ID: <7a9c6493-ac7e-4cd1-9703-a5f33f1b7330@ciena.com>
References: <095e959a3b1f5c557fe1e463754379edc21b32ea.camel@gmail.com>
In-Reply-To: <095e959a3b1f5c557fe1e463754379edc21b32ea.camel@gmail.com>
Accept-Language: en-GB, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: SN6PR04MB4573:EE_|DM6PR04MB7083:EE_
x-ms-office365-filtering-correlation-id: f1dfad4d-4d02-4c1a-6e94-08dc2633a753
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 1s2fjv/vHcYvezws3o055YYSe72ClpYp6Zm8VLdztGMjgfDN5wFfX7UnQlqDlL7NDlHiEhx1ty6dlIywksbSzTPQNksMbhUpwD06csyh2lX852qWl3T+RO7XCQUsqc+KpvX0d8eZ2qrvJN6l3DpRhqsrCAz0XOfdwyjwElJU+peQxa6H62HP7jU7zd8d+Qc+60g7mSXFAANHmr9CIGozj7in4EC7zUglbP201v/6KhATVMxLxOtFHZ6j68qO8Ylql+mOLoiZdp9p6TAYWVfAPX12P4Fj8Nvc03QXPwimZmI2CZVC1VmX/LVUwf9l+iEVdyMEV5R2xh07aEBVEhAHv13YCR2b4TxFdARiYn72rRvbNKWhIxawxISYbNG/+1J4weupXi6uQ0/3WgnLgYD8pvR+7IuFGP8h4N3tvTXVEPX1mRgASBBSjz2+pQzGft1V/4aqzE0wWkfpDpEaZqoK5bn5j0tGP6n/xRvMF8FNA+ShJoHXIVcNRSIrqTFwI+/7h8Y3VWJKhO7j9K9HBGBDcU1sMyRSqth4VpCa+UoMs20Gsw32GUk9Yu1eabI832jZ9/C7BsWLLQhRjo4sCjNLXXRgzFjtNuAWEi444jsGVTysgWaooT8/mx3J2RCJqHeK4VR/w03opIl485e7en2Bfw==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SN6PR04MB4573.namprd04.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(39860400002)(346002)(396003)(366004)(376002)(136003)(230922051799003)(64100799003)(186009)(1800799012)(451199024)(5660300002)(41300700001)(2906002)(8936002)(8676002)(66556008)(66476007)(316002)(66446008)(64756008)(66946007)(38070700009)(76116006)(110136005)(36756003)(122000001)(31696002)(86362001)(478600001)(6512007)(2616005)(71200400001)(83380400001)(26005)(53546011)(6506007)(6486002)(966005)(31686004)(38100700002)(45980500001); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: ZO36rXD7DJHD/vG0ltMWxzCs5PTcwewuWmSiuKcc0+Jag0KAxwR2jN7t/0YQotBOoXY2N7JbuIqbeZb0TCMqzcfSCopG4snK2or9FwDSskCc2wUc6jSRZUdKCpDG42ERAiZRe8rxHblWIq0QFCoIOoB5yRZ4/GVVfwVdxC6D94YmGOiqtazjj/EYX1wvNXLpn41rddkz1HKMFo85dD79eEKBuVsn+BbfUK8m1Mh9ThvhXFbQ4DNnxec3w1y5DwmVaJ8mmZmrHFlZfdzhFnaTZKPcrkN6xB+Qx8aFluFHyk44bps31jG+xXJRgJCgGJmfMQesFMu3XG8s/Zv2C9xOCopKq2DncE5M59pOD2sf90kTd6yrAjZkAohha4eljYV1O1zXruFD5qhgLyfQJ6oIWL6/+bkRgh6PnuCcgiCXc/rYGGabnKJPz4NXhNmh9UnSWLoYF2oT2deLZzlnjkRRVlf//59e5f/Ur3MSz689yO1tDlKQT5HvRLcpsUlEJELNQCllLnMLbAEtVg/axmYrho/lFOHn63KXistqUbrY37bV9rwGCOwA6Lm2jpncCDGBIg79YRv7OCKQh89HlqNo2HmLpyBZanX3HZ12qzv6oIvFhoOEUtO3moiwfMRtmOP1Dr+zksJJ4tKd+71icHLdPYhroVbO30mdcAp6m9YhCHBlK5IvT4J+uzzh3OcSjV77kRj3WP1TC3I0PAR7ruhwBqqYMD6SkozVfKZeDwipIWmMfhluTxyfyoSk3klfoYnGYLnXfEuKUhtG3JS5H/+shXTHlMmWlZRDIpkZrzw3dpNc6+zmiEJjd7SsJqpxh/VNZlHg89TferxS8N0k3YHBL9VQIceYSmWkUI1fb8GVgzU2UtPdLjx02igWRquEsDNu80nl4BRaDmFF4EBwffQ7uDGZDvAiUWlD8pY52kJeeJVG2oO2g5ZOovPZ3H7QxlF0c41bSKbFnaWkGXXSOeysBBEQ3LpWnbRndlDGG/T51g3fgZGFAnuPs806Omzl76hDjXc2CBxtXdkmAdEiu9LBbyOU2ps09DiXr4C6obASTaI4vc8LqMA8iUQzkgyk3p+PGUedHDymO5CXnBdhkH+sQnEggnjsJVQONV2yHrUBTSQOPphfabbYbKrpAqKQvw1ByKKdIgtaf1079+GA5scJ2h5CoBbRyQHqQHM03tpH/sKCuOqSjQKEtIxWm/o4tfvkPBQyTVrOUvylQjIWK9d4EhJ9HqgtCPiaBQaIKbCmf4gqCX2qVv8liJ0q8iy5KQg4CTdO0o80aFBmgMPPFwVlfK1f+RGUJpHmIlfhSK2ZnMIvP7D+V8O7Ge3Fb/wLq5MLtzJjpjOkfJjJTyvEal03CBN2JCJ4ZTZ+NZ8fc4Nbo55AR4k4Eb3QvG+V3jHPAoRv8HsnbYGA2vEtO+u1EHIaMcRom0e5G5iUf8L6FlyR+7q0XyF7NPI6rVuiNSRDBFrVH8FtJuuZWKElxIj+moZ8VbCshO38qJbIC/teZmfaNWcPGiPq+escQN5fboM8bg5sBaqx5AGCEX1KoWt41cU0QWdBInYbURNqxosH5OiiZbrKZIsw1oWc5I3X1XjxKufk
Content-Type: text/plain; charset="utf-8"
Content-ID: <C9F670F075C43E4A85AD95D439C76399@namprd04.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: ciena.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: SN6PR04MB4573.namprd04.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: f1dfad4d-4d02-4c1a-6e94-08dc2633a753
X-MS-Exchange-CrossTenant-originalarrivaltime: 05 Feb 2024 10:17:27.1658 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 457a2b01-0019-42ba-a449-45f99e96b60a
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: FEk0X8PcDdUpgNb6qBizTo7NucB70Kyo9lpIRHDnM/wll9vqpeThN/zaLOIgxm2S6e1wQEuVLOX9JD1srgQZ3Q==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR04MB7083
X-Proofpoint-GUID: CSQrib4dImI_HmLb7a8iX9GcgSdWtsHv
X-Proofpoint-ORIG-GUID: CSQrib4dImI_HmLb7a8iX9GcgSdWtsHv
X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.272,Aquarius:18.0.1011,Hydra:6.0.619,FMLib:17.11.176.26 definitions=2024-02-05_05,2024-01-31_01,2023-05-22_02
Archived-At: <https://mailarchive.ietf.org/arch/msg/ipfix/lOa4rgZNKMD_JgpwSnPKJNgHXoo>
Subject: Re: [IPFIX] Options Templates, Templates, and related Data Sets sent in separate transport sessions
X-BeenThere: ipfix@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: IPFIX WG discussion list <ipfix.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ipfix>, <mailto:ipfix-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ipfix/>
List-Post: <mailto:ipfix@ietf.org>
List-Help: <mailto:ipfix-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ipfix>, <mailto:ipfix-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 05 Feb 2024 10:17:37 -0000

Garri,

 From the receiver's point of view, the different transport sessions are 
independent export streams which could come from different Exporters. 
The receiver can't tell whether these come from one exporter or two. The 
data in the "options" Export Stream cannot be scoped to data in the 
other stream as Template IDs are unique per Transport Session and the 
Observation Domain is locally unique to the Exporting Process and 
multiple EPs may be in play.

Only SCTP provides multiple streams; TPC and UDP do not. See section 6.1 
of RFC 5153.

P.


On 03/02/24 14:38, Garri Djavadyan wrote:
> Hi IPFIX experts,
>
>
> Recently, my colleagues and I faced an IPFIX exporter implementation
> that sends IPFIX messages with the Template and related Data Sets in
> one transport UDP session and the Options Template and related Data
> Sets in another transport UDP session (sourced from a different UDP
> port) to the same IPFIX collector port.
>
> While trying to understand this behaviour, I checked RFC7011 and a few
> related RFCs but could not find any notes suggesting use cases when it
> might be necessary. Also, I could not find any notes prohibiting this.
>
> However, we know of at least one use case when sending the
> aforementioned 4 IPFIX messages over 2 separate transport sessions is
> undesirable. For example, when multiple self-sufficient IPFIX
> collectors are listening on the same UDP socket using the socket option
> SO_REUSEPORT (for horizontal scaling), the kernel-level load-balancing
> algorithm can distribute 2 related sessions of the same exporter to
> different processes. As a result, the process receiving the Flow
> Records, cannot process them properly without the related Options. In
> theory, it can also happen in the environments where layer-4 load-
> balancers are used to distribute transport UDP sessions between IPFIX
> collecting hosts.
>
> Considering this, could you please help answer the following question?
>
> Did I interpret the IPFIX RFCs correctly and the mentioned exporter's
> behaviour is a compliant implementation?
>
> There is a note in the "Template Management" section 8 of RFC7011
> saying:
>
>     Options Templates and Templates that are related or interdependent
>     (e.g., by sharing common properties as described in [RFC5473])
>     SHOULD be sent together in the same IPFIX Message.
>
> but the Templates and the Options Templates in the case that I
> mentioned are not interdependant by the common properties per RFC5473.
>
>
>
> Thank you in advance!
>
>
> Kind regards,
> Garri Djavadyan
>   
>
> _______________________________________________
> IPFIX mailing list
> IPFIX@ietf.org
> https://urldefense.com/v3/__https://www.ietf.org/mailman/listinfo/ipfix__;!!OSsGDw!J3DauxNGB6V13gsv8HRy629ddHwNTtJFeE5njPIdVQCVssXh2upsaiMkWBlmd8llnYXke9dEef0WZvmNag$ [ietf[.]org]