Re: [IPFIX] unobserved fields

Paul Aitken <paitken@cisco.com> Fri, 07 December 2012 19:01 UTC

Return-Path: <paitken@cisco.com>
X-Original-To: ipfix@ietfa.amsl.com
Delivered-To: ipfix@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8D30321F854D for <ipfix@ietfa.amsl.com>; Fri, 7 Dec 2012 11:01:46 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -10.599
X-Spam-Level:
X-Spam-Status: No, score=-10.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_HI=-8]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id l5qagQ5mCSBB for <ipfix@ietfa.amsl.com>; Fri, 7 Dec 2012 11:01:46 -0800 (PST)
Received: from ams-iport-2.cisco.com (ams-iport-2.cisco.com [144.254.224.141]) by ietfa.amsl.com (Postfix) with ESMTP id 6223421F8538 for <ipfix@ietf.org>; Fri, 7 Dec 2012 11:01:44 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=1051; q=dns/txt; s=iport; t=1354906904; x=1356116504; h=message-id:date:from:mime-version:to:cc:subject: references:in-reply-to:content-transfer-encoding; bh=mTGA1UoRv7HCp9oP3DbDNqG9/uYSsmSAnwplDn2rFxo=; b=MrFTPrBPCZaQ9gy0QzJ8UZGBfDogYHafd2nKtdDf3r2AliBawdO5Qw9W 5Z76zpM4gnbwpC5WMKyIISaRm6tOwY2UlXOJsTnrsE8lYan+6l0F/mi90 Z9ahM2C2W6EPVTQh2f5dfWQd1jXJxXXKk7p3DnunwidQl2sIWsg1pH7RB Q=;
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: ApcHAGs8wlCQ/khR/2dsb2JhbABEg0e6cxZzgh4BAQEDAThAAQULCyEWDwkDAgECAUUGDQEHAQGIBwbCJoxKhDgDlgWFa4pdgnOBbQ
X-IronPort-AV: E=McAfee;i="5400,1158,6919"; a="78900660"
Received: from ams-core-1.cisco.com ([144.254.72.81]) by ams-iport-2.cisco.com with ESMTP; 07 Dec 2012 19:01:43 +0000
Received: from [10.61.88.204] (ams3-vpn-dhcp6349.cisco.com [10.61.88.204]) by ams-core-1.cisco.com (8.14.5/8.14.5) with ESMTP id qB7J1gRw008134; Fri, 7 Dec 2012 19:01:42 GMT
Message-ID: <50C23D17.3030503@cisco.com>
Date: Fri, 07 Dec 2012 19:01:43 +0000
From: Paul Aitken <paitken@cisco.com>
User-Agent: Mozilla/5.0 (X11; Linux i686; rv:17.0) Gecko/17.0 Thunderbird/17.0
MIME-Version: 1.0
To: Andrew Feren <andrewf@plixer.com>
References: <50C2314C.20300@plixer.com>
In-Reply-To: <50C2314C.20300@plixer.com>
Content-Type: text/plain; charset="ISO-8859-1"; format="flowed"
Content-Transfer-Encoding: 7bit
Cc: IETF IPFIX Working Group <ipfix@ietf.org>
Subject: Re: [IPFIX] unobserved fields
X-BeenThere: ipfix@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: IPFIX WG discussion list <ipfix.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ipfix>, <mailto:ipfix-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/ipfix>
List-Post: <mailto:ipfix@ietf.org>
List-Help: <mailto:ipfix-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ipfix>, <mailto:ipfix-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 07 Dec 2012 19:01:46 -0000

Andrew,

> My earlier email about Extended Field Specifiers reminded me of an 
> other draft (draft-aitken-ipfix-unobserved-fields) that doesn't seem 
> to have gone anywhere, but that I would love to move forward. Having a 
> standard way to know if  field is unobserved/NULL for a given flow 
> would be very valuable.

It's not that this draft didn't go anywhere. Rather, I've written all I 
can for now, yet the WG isn't in a position to adopt the work. However 
it's a real issue that needs to be solved -in fact, we're already using 
some of the techniques in this document - so in my mind it's only "on 
hold" until I think of something to add and/or the WG can adopt it.

You're right, Extended Field Specifiers would allow us to tag each field 
with an "Observed" attribute with advantages:

     - we wouldn't need to change fields to varlen just to report length 
= 0.

     - we could have a many-valued reason rather than a boolean.
         ie, we can report why the value is not available or not applicable.

P.