Re: [sip-clf] IETF 76 Minutes posted -> IPFIX questions

"David B Harrington" <dbharrington@comcast.net> Wed, 02 December 2009 13:36 UTC

Return-Path: <dbharrington@comcast.net>
X-Original-To: sip-clf@core3.amsl.com
Delivered-To: sip-clf@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id F095A3A688D for <sip-clf@core3.amsl.com>; Wed, 2 Dec 2009 05:36:21 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.74
X-Spam-Level:
X-Spam-Status: No, score=-0.74 tagged_above=-999 required=5 tests=[BAYES_20=-0.74]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id IApdg9wj4UTW for <sip-clf@core3.amsl.com>; Wed, 2 Dec 2009 05:36:21 -0800 (PST)
Received: from QMTA01.westchester.pa.mail.comcast.net (qmta01.westchester.pa.mail.comcast.net [76.96.62.16]) by core3.amsl.com (Postfix) with ESMTP id D937228C1DD for <sip-clf@ietf.org>; Wed, 2 Dec 2009 05:36:20 -0800 (PST)
Received: from OMTA12.westchester.pa.mail.comcast.net ([76.96.62.44]) by QMTA01.westchester.pa.mail.comcast.net with comcast id CCtD1d0020xGWP851DbdEJ; Wed, 02 Dec 2009 13:35:37 +0000
Received: from Harrington73653 ([24.147.240.98]) by OMTA12.westchester.pa.mail.comcast.net with comcast id CDcD1d002284sdk3YDcDdU; Wed, 02 Dec 2009 13:36:13 +0000
From: David B Harrington <dbharrington@comcast.net>
To: 'SIP-CLF Mailing List' <sip-clf@ietf.org>
References: <AB7C6B627BD942D4AF57826079B0EA90@china.huawei.com>
Date: Wed, 02 Dec 2009 08:36:12 -0500
Message-ID: <108601ca7354$69e0d5b0$a1135d85@china.huawei.com>
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Mailer: Microsoft Office Outlook 11
In-Reply-To: <AB7C6B627BD942D4AF57826079B0EA90@china.huawei.com>
Thread-Index: AcpzT0+vwKyeCHsER1OaA4fuiZY9wAAACZug
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3198
X-Mailman-Approved-At: Wed, 02 Dec 2009 06:38:56 -0800
Subject: Re: [sip-clf] IETF 76 Minutes posted -> IPFIX questions
X-BeenThere: sip-clf@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: SIP Common Log File format discussion list <sip-clf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/sip-clf>, <mailto:sip-clf-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/sip-clf>
List-Post: <mailto:sip-clf@ietf.org>
List-Help: <mailto:sip-clf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/sip-clf>, <mailto:sip-clf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 02 Dec 2009 13:36:22 -0000

Hi,

I have a concern with sipclf.
I have been looking at "How to have a successful BOF":

the goal of the
   BOF is to demonstrate that the community has agreement that:

      - there is a problem that needs solving, and the IETF is the
right
        group to attempt solving it.

      - the scope of the problem is well defined and understood, that
        is, people generally understand what the WG will work on (and
        what it won't) and what its actual deliverables will be.

Note the emphasis on what ***problem*** needs to be solved. 
The sipclf community decided "we need a logging file format"
That is not a clear problem description; that is a solution - a
partial solution.

The members of the sipclf WG have very different problems they are
trying to solve.
Some want to dump everything so they can later grep to find entries.
Some express concern about dumping everything and think maybe filters
are needed to limit what gets dumped.
Some want a dump from a single device.
Some want to be able to reconstruct SIP conversations across multiple
devices.

I do not think the WG has consensus on what ***problem*** is being
solved.
The appropriate file format to use for a solution depends a lot on
what problem you are trying to solve, and how the information will get
used (and possibly moved).

Some think the apache file format is a great starting place. I have
concerns about modeling sipclf after a web-server logging format. Web
servers typically run on hosts, with lots of CPU cycles and lots of
disk storage. Very appropriate for logging EVERYTHING. Maybe I just
don't know SIP well enough to understand the environments in which it
runs. Where does SIP typically run? on hosts? on routers? on
middleboxes? in embedded systems? Would these environments have the
same resources that web server environments typically have?

IPFIX may not be the right solution. But IPFIX has considered issues
of CPU impact, limited storage, filters to select subsets of
information to log, how to move the data off the box quickly, etc. The
sipclf WG has not done that analysis because it is starting with a
presumption of what they want for a solution, apparently without
agreement on the problem to be solved.

I question whether a simple ascii dump is the right answer. And I
don't think the WG has done the necessary analysis of requirements
based on the various problems to be solved, and the environments that
must be supported.
 
dbh