Re: [bmwg] WGLC: draft-ietf-bmwg-ipflow-meth-00 - New Version draft-ietf-bmwg-ipflow-meth-02.txt

Brian Trammell <trammell@tik.ee.ethz.ch> Wed, 22 June 2011 09:11 UTC

Return-Path: <trammell@tik.ee.ethz.ch>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 24E4B11E80CE for <bmwg@ietfa.amsl.com>; Wed, 22 Jun 2011 02:11:03 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -5.999
X-Spam-Level:
X-Spam-Status: No, score=-5.999 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, J_CHICKENPOX_13=0.6, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9D2Ppn70vLok for <bmwg@ietfa.amsl.com>; Wed, 22 Jun 2011 02:11:02 -0700 (PDT)
Received: from smtp.ee.ethz.ch (smtp.ee.ethz.ch [129.132.2.219]) by ietfa.amsl.com (Postfix) with ESMTP id 4D16411E80CF for <bmwg@ietf.org>; Wed, 22 Jun 2011 02:11:01 -0700 (PDT)
Received: from localhost (localhost [127.0.0.1]) by smtp.ee.ethz.ch (Postfix) with ESMTP id 32258D9324; Wed, 22 Jun 2011 11:11:09 +0200 (MEST)
X-Virus-Scanned: by amavisd-new on smtp.ee.ethz.ch
Received: from smtp.ee.ethz.ch ([127.0.0.1]) by localhost (.ee.ethz.ch [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 24XVKa2v1Ux5; Wed, 22 Jun 2011 11:11:08 +0200 (MEST)
Received: from [195.37.70.143] (unknown [195.37.70.143]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: briant) by smtp.ee.ethz.ch (Postfix) with ESMTPSA id AABA0D930E; Wed, 22 Jun 2011 11:11:08 +0200 (MEST)
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: text/plain; charset="us-ascii"
From: Brian Trammell <trammell@tik.ee.ethz.ch>
In-Reply-To: <C95CC96B171AF24CA1BB6CA3C52D0BA0A3F270@XMB-AMS-212.cisco.com>
Date: Wed, 22 Jun 2011 11:10:48 +0200
Content-Transfer-Encoding: quoted-printable
Message-Id: <911E7F36-9D10-45DB-BDC3-A16418FB6DEF@tik.ee.ethz.ch>
References: <4DF60A70.4070902@cisco.com> <4DFF103A.1000209@cisco.com> <C95CC96B171AF24CA1BB6CA3C52D0BA0A3F270@XMB-AMS-212.cisco.com>
To: Jan Novak <janovak@cisco.com>
X-Mailer: Apple Mail (2.1084)
Cc: "Paul Aitken (paitken)" <paitken@cisco.com>, bmwg@ietf.org, Al Morton <acmorton@att.com>
Subject: Re: [bmwg] WGLC: draft-ietf-bmwg-ipflow-meth-00 - New Version draft-ietf-bmwg-ipflow-meth-02.txt
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/bmwg>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 22 Jun 2011 09:11:03 -0000

Hi, Jan,

I've reviewed the -01 and -02 diff and agree that the document is greatly improved; this revision, after addressing Paul's comments, should be ready to go.

I have two points of discussion/clarifiction, inline, below.

Best regards,

Brian

> 2) Export of options and templates
> 
>> Also, I didn't yet read anything about allowing for export templates
>> and/or options. Should these be included or excluded from the 
>> measurements?
> 
> I would like to strongly disagree here. We had extensive discussions 
> about it already with one of the previous reviewers and I always
> pointed to the definition of Control Information by RFC5470
> (and I think also other IPFIX documents) section 2 which in
> my opinion covers for the export of options and templates but I never
> got
> any answer regarding that - neither from you yet.
> The reviewed document has explicit statements about export of this
> information
> in several places unless my understanding of the RFC5470 definition is
> wrong.
> I hope not though since I wouldn't like to dive into the definitions of
> what those are in IPFIX. I hope you can comfirm that.

The issue here is that template and option export should (in the normal case) be negligible in terms of export bandwidth (i.e., data records should  far, far outnumber options records and templates), the performance of exporting and/or collecting processes may be significantly impacted by the number of _simultaneous_ templates or options in effect on a transport session at any given time. Template lookup should be O(log t) at worst (unless you're being incredibly lazy), but might need to be done for every set (which implies O(n log t)). So at the very least, there should be parameters for the number of active templates in the session during benchmarking -- even if that number is 1.

> 3) Packet Sampling 
> 
>> PJ: I'd like to see a greater discussion of the relevance of sampling, 
>> throughout this document. I've already indicated a few places where
> sampling 
>> would impact the test.
> 
> Packet sampling is out of the scope of this document. If you prefer I
> will
> replace section 4.5 of the reviewed document with an explicit statement
> saying just that instead. It is a separate I would say research subject
> which can be undertaken by a future work/document.

Packet/flow sampling, however, is one of the approaches often used in production networks when flow collection performance is insufficient... so at the very least there should be a strong statement that this document applies to situations without packet or flow sampling. 

> 
> -----Original Message-----
> From: Paul Aitken (paitken) 
> Sent: 20 June 2011 10:18
> To: Jan Novak (janovak); Al Morton
> Cc: bmwg@ietf.org
> Subject: Re: WGLC: draft-ietf-bmwg-ipflow-meth-00
> 
> Jan,
> 
> In reviewing this draft, I objected to numerous places where you 
> discussed the cache as holding Flow Records.
> 
> eg, "the cache doesn't hold flow records, because the cache is a 
> function of the metering process while flow records are a product of the
> 
> exporting process."
> 
> While RFC 5101 (IPFIX) doesn't specifically mention caches, it does say:
> 
>       The Metering Process generates Flow Records.
> 
> 
> And
> 
>       The Metering Process consists of a set of functions that includes
>       packet header capturing, timestamping, sampling, classifying, and
>       maintaining Flow Records.
> 
> 
> "maintaining Flow Records" could be interpreted as cache maintenance.
> 
> So I'll relax my objection because this isn't clearly defined in IPFIX.
> 
> Thanks,
> P.
> 
> 
> On 13/06/11 14:02, Paul Aitken wrote:
>> Al, Jan,
>> 
>> I've attached a version of draft-ietf-bmwg-ipflow-meth-01 with 
>> numerous comments inline (look for "PJ:").
>> 
>> I've made numerous small changes directly to the text. Hopefully you 
>> can see those with in the change history (see "track changes").
>> 
>> I anticipate an updated document and a further WGLC.
>> 
>> Cheers,
>> P.
> 
> <bmwg-PJ-review-1.txt>_______________________________________________
> bmwg mailing list
> bmwg@ietf.org
> https://www.ietf.org/mailman/listinfo/bmwg