RE: [bmwg] Is the BMWG a proper home for this I-D?ch
Russ White <ruwhite@cisco.com> Mon, 04 October 2004 15:07 UTC
Received: from megatron.ietf.org (megatron.ietf.org [132.151.6.71]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id LAA12476 for <bmwg-archive@lists.ietf.org>; Mon, 4 Oct 2004 11:07:34 -0400 (EDT)
Received: from localhost.localdomain ([127.0.0.1] helo=megatron.ietf.org) by megatron.ietf.org with esmtp (Exim 4.32) id 1CEUNR-0007o6-KQ; Mon, 04 Oct 2004 11:03:49 -0400
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by megatron.ietf.org with esmtp (Exim 4.32) id 1CEUL4-0007U2-3G for bmwg@megatron.ietf.org; Mon, 04 Oct 2004 11:01:22 -0400
Received: from ietf-mx.ietf.org (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id LAA12048 for <bmwg@ietf.org>; Mon, 4 Oct 2004 11:01:19 -0400 (EDT)
Received: from rtp-iport-2.cisco.com ([64.102.122.149]) by ietf-mx.ietf.org with esmtp (Exim 4.33) id 1CEUUA-00076M-Cn for bmwg@ietf.org; Mon, 04 Oct 2004 11:10:46 -0400
Received: from rtp-core-1.cisco.com (64.102.124.12) by rtp-iport-2.cisco.com with ESMTP; 04 Oct 2004 11:00:48 -0400
X-BrightmailFiltered: true
Received: from cisco.com (shako.cisco.com [64.102.17.78]) by rtp-core-1.cisco.com (8.12.10/8.12.6) with ESMTP id i94F0br5024253; Mon, 4 Oct 2004 11:00:37 -0400 (EDT)
Received: from russpc.Whitehouse.intra (rtp-vpn1-216.cisco.com [10.82.224.216]) by cisco.com (8.8.8-Cisco List Logging/8.8.8) with ESMTP id LAA15862; Mon, 4 Oct 2004 11:00:27 -0400 (EDT)
Date: Mon, 04 Oct 2004 11:00:03 -0400
From: Russ White <ruwhite@cisco.com>
To: Jim McQuaid <jim.mcquaid@netiq.com>
Subject: RE: [bmwg] Is the BMWG a proper home for this I-D?ch
In-Reply-To: <613E3F060982754CBF2FC6751E82679B0587EC50@ralexch01.netiq.local>
Message-ID: <Pine.WNT.4.61.0410041058310.3668@russpc.Whitehouse.intra>
References: <613E3F060982754CBF2FC6751E82679B0587EC50@ralexch01.netiq.local>
X-X-Sender: ruwhite@shako.cisco.com
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset="US-ASCII"; format="flowed"
X-Spam-Score: 0.0 (/)
X-Scan-Signature: e1b0e72ff1bbd457ceef31828f216a86
Cc: "Howard C. Berkowitz" <hcb@gettcomm.com>, bmwg@ietf.org
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.5
Precedence: list
Reply-To: Russ White <riw@cisco.com>
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
Sender: bmwg-bounces@ietf.org
Errors-To: bmwg-bounces@ietf.org
Okay, it's been a couple of months since we've talked about this.... Have we reached any concensus on it? If BMWG isn't going to take it on, I need to get with the ADs and see what can be done about pushing it as an individual contribution (though I still think it's more benchmarking related than real world testing, after re-reading it). If anyone would like to contribute more considerations, to make the draft "wider," those would be welcome, too. :-) Russ On Wed, 7 Apr 2004, Jim McQuaid wrote: > You make an excellent point (can it be tested with created traffic or does > it require live network traffic in some form). That's the "bench" in > benchmark; it can be done with lab equipment. > > I would agree with that distinction. On the other hand, if there is > enthusiasm to do this work within BMWG, tthat may be more important than > legalisms, however sound. > > Jim McQuaid > > -----Original Message----- > From: Howard C. Berkowitz [mailto:hcb@gettcomm.com] > Sent: Wednesday, April 07, 2004 9:29 AM > To: bmwg@ietf.org > Subject: RE: [bmwg] Is the BMWG a proper home for this I-D? > > > At 10:56 AM +0000 4/7/04, Jim McQuaid wrote: >> <sorry for the blank reply> >> >> At the time the IPPM was "spun off" of the BMWG, the general understanding >> was that BMWG would look at "things" more or less in isolation, although >> that concept is somewhat elastic. IPPM would look at end to end network >> kinds of performance issues. >> >> It seems clear to me that convergence is a performance characteristic of >> complete networks and primarily an end to end or at least, core element to >> core element characteristic. >> >> My thought would be that this is interesting and useful work but not >> necessarily for BMWG. >> >> Jim McQuaid > > > I don't completely disagree with you. I do feel that single-platform > performance definition and benchmarking is definitely within the > scope of BMWG, and some of my comments relating to clarifying test > methods (e.g., black box vs. white box vs. passive analysis) > definitely can be applied to one box. BMWG has always looked at > forwarding plane performance of single boxes, and I really don't > think we are straying far to look at there control plane performance. > > You are correct that IPPM, as well as some of the internet > scalability issues both in the IETF and IRTF, are probably better > places for end-to-end convergence. > > At least in the case of BGP, however, there is a meaningful > intermediate level that isn't single box and isn't end-to-end: > convergence within an AS, and conceivably subsets thereof such as > route reflector clusters. Similar points can be made about > intra-area convergence in OSPF and ISIS. Where do these fit? > > I'm inclined to say BMWG, and let me suggest what might be a very > crude rule of thumb in saying BMWG or not-BMWG. Many of the > Internet-wide experiments have to rely on sampling live data, with > perhaps some selective probes. Single-box, or small-system-of-boxes > measurement, plausibly can be done with an artificial benchmark in a > testing lab. > > Given the name of this group, perhaps, then, the decision if > something belongs here depends on asking the question early, "can the > measurement be made with a synthetic benchmark and test equipment," > or does some of it really have to come from sampling and probing live > networks? If the former, it's BMWG eligible. If the latter, it's > interesting, might even warrant BMWG liaison and/or help in placing > it elsewhere, but shouldn't stay in BMWG. > > > > _______________________________________________ > bmwg mailing list > bmwg@ietf.org > https://www1.ietf.org/mailman/listinfo/bmwg > > _______________________________________________ > bmwg mailing list > bmwg@ietf.org > https://www1.ietf.org/mailman/listinfo/bmwg > __________________________________ riw@cisco.com CCIE <>< Grace Alone _______________________________________________ bmwg mailing list bmwg@ietf.org https://www1.ietf.org/mailman/listinfo/bmwg
- RE: [bmwg] Is the BMWG a proper home for this I-D… Jim McQuaid
- RE: [bmwg] Is the BMWG a proper home for this I-D? scott bradner
- RE: [bmwg] Is the BMWG a proper home for this I-D… Russ White
- RE: [bmwg] Is the BMWG a proper home for this I-D… sporetsky
- RE: [bmwg] Is the BMWG a proper home for this I-D… Russ White
- RE: [bmwg] Is the BMWG a proper home for this I-D… sporetsky
- RE: [bmwg] Is the BMWG a proper home for this I-D… Russ White
- RE: [bmwg] Is the BMWG a proper home for this I-D… Russ White
- RE: [bmwg] Is the BMWG a proper home for this I-D… Jim McQuaid
- RE: [bmwg] Is the BMWG a proper home for this I-D? Howard C. Berkowitz
- RE: [bmwg] Is the BMWG a proper home for this I-D… Russ White
- RE: [bmwg] Is the BMWG a proper home for this I-D… sporetsky
- RE: [bmwg] Is the BMWG a proper home for this I-D… Russ White
- RE: [bmwg] Is the BMWG a proper home for this I-D… Michele Bustos
- RE: [bmwg] Is the BMWG a proper home for this I-D… sporetsky
- RE: [bmwg] Is the BMWG a proper home for this I-D… sporetsky
- RE: [bmwg] Is the BMWG a proper home for this I-D… Michele Bustos
- RE: [bmwg] Is the BMWG a proper home for this I-D… Russ White
- RE: [bmwg] Is the BMWG a proper home for this I-D… Jim McQuaid
- RE: [bmwg] Is the BMWG a proper home for this I-D… Russ White
- RE: [bmwg] Is the BMWG a proper home for this I-D… Robert Holley (rholley)
- RE: [bmwg] Is the BMWG a proper home for this I-D… sporetsky
- RE: [bmwg] Is the BMWG a proper home for this I-D? Howard C. Berkowitz
- RE: [bmwg] Is the BMWG a proper home for this I-D? scott bradner
- RE: [bmwg] Is the BMWG a proper home for this I-D? Howard C. Berkowitz
- RE: [bmwg] Is the BMWG a proper home for this I-D? David Newman
- RE: [bmwg] Is the BMWG a proper home for this I-D? scott bradner
- RE: [bmwg] Is the BMWG a proper home for this I-D… Russ White
- RE: [bmwg] Is the BMWG a proper home for this I-D? Henk Uijterwaal (RIPE NCC)