RE: [bmwg] Is the BMWG a proper home for this I-D?ch

[[e-mail]]

Which is the preferred working group is a worthwhile discussion to continue.
The other item worth discussing is the goal of the work item.  This is
important because it helps guide the action items to the point that the wg
knows when it is done.  We know that you have proposed a BCP for network
convergence that will not include Methodology.  Your focus is "to provide
guidance to testers".  How will this be achieved?  What will be covered?
How would we know when it is done?

BTW, A lot of the questions being asked with this thread are typically
covered in a Working Group Proposal.  Maybe it would be beneficial to
complete that for this proposed work item.

Scott

-----Original Message-----
From: Russ White [mailto:[e-mail]]
Sent: Tuesday, October 05, 2004 3:11 PM
To: Jim McQuaid
Cc: [e-mail]; [e-mail]; [e-mail]
Subject: RE: [bmwg] Is the BMWG a proper home for this I-D?ch



> This thread is tending toward the "polemic."  I suggest we all obtain and 
> read the current charters for the WGs in question.  A charter can always 
> be amended, but it's a good starting point.

So, let's start with this: IPPM is in the transport working group, while 
BMWG is in operations. That seems to imply something different than 
anything said on this thread, thus far. IPPM seems to deal with traffic 
flow measurement, the measurement of transport, while BMWG seems to deal 
with network measurement, in terms of benchmarking. So, from this angle, a 
best practices on routing protocols convergence wouldn't fit within IPPM, 
since it's not a transport issue at all.

> I think the issue isn't so much "real world networks" versus "lab 
> networks." The original IPPM / BMWG split might be better thought of in 
> terms of audience.  IPPM was for network operators & planners.  BMWG was 
> one element of that, of course, but clearly *was* started with an eye 
> toward providing a standard to replace manufacturers marketing claims 
> back at the start of the router wars, so it was element-oriented and 
> somewhat more enterprise useful compared to network operator useful.

Even in terms of this, all the users of the tests you're talking about, the 
people using the products of the BMWG to evaluate vendor's testing, would 
be network operators, correct? So, that split doesn't make much sense to 
me, either, based on the terms listed here. If such a best practices 
document were to serve as guidance to test developers, I don't see where 
the conflict with what you're saying above comes in.

Now, finally, to the charters themselves. IPPM's charter says:

--

The IPPM WG will produce documents that define specific metrics and
procedures for accurately measuring and documenting these metrics.
The metrics are:

   - connectivity
   - one-way delay and loss
   - round-trip delay and loss
   - delay variation
   - loss patterns
   - packet reordering
   - bulk transport capacity
   - link bandwidth capacity

--

I don't see anything in there about routing protocols convergence, which is 
what the draft in question is/would be, if we continue to work on it. 
BTW--to make certain we come to agreement on at least this one point--the 
draft in question is about routing protocols convergence. Is there anyone 
who reads something else into it?

There's a section on measuring routing protocols convergence through 
traffic flow, but that's no different than 
draft-ietf-bmwg-igp-dataplane-conv-meth-03.txt. In fact, I don't see this 
document as being any different than draft-ietf-bmwg-hash-stuffing-00.txt, 
which is already a working group document. If we reject this document on 
those grounds, then the WG should reconsider the acceptance of those two 
documents, as well.

Based on IPPM's charter (quoted above) and area (transport), there's no way 
a routing protocols document would fit there.

Now, let's turn to BMWG's charter:

--

The major goal of the Benchmarking Methodology Working Group is to make
a series of recommendations concerning the measurement of the
performance characteristics of various internetworking technologies;
further, these recommendations may focus on the systems or services
that are built from these technologies.

....

An ongoing task is to provide a forum for discussion regarding the
advancement of measurements designed to provide insight on the
operation internetworking technologies.

--

I assume there's a missing "of" in the last sentence quoted above. Now, 
since this draft does/would apply to in the lab benchmarks, their 
construction and understanding their results, about specifically about an 
internetworking technology (routing protocols), and their performance.... I 
just don't see how this doesn't fit into the BMWG charter as it sits today. 
The last paragraph certainly implies this as well.

I don't read anything in the charter that limits the BMWG to only specific 
point tests, nor do I see anything placing routing protocols within IPPM's 
charter.

Does anyone see anything different in this?

:-)

Russ


__________________________________
[e-mail] CCIE <>< Grace Alone

_______________________________________________
bmwg mailing list
[e-mail]
https://www1.ietf.org/mailman/listinfo/bmwg