Re: [bmwg] RE: [Sipping] Draft: SIP Performance Metrics
nahum@watson.ibm.com Sun, 25 June 2006 21:23 UTC
Received: from [127.0.0.1] (helo=stiedprmman1.va.neustar.com) by megatron.ietf.org with esmtp (Exim 4.43) id 1Fuc4t-0003Bk-VE; Sun, 25 Jun 2006 17:23:35 -0400
Received: from [10.91.34.44] (helo=ietf-mx.ietf.org) by megatron.ietf.org with esmtp (Exim 4.43) id 1Fuc4s-000351-3x; Sun, 25 Jun 2006 17:23:34 -0400
Received: from igw2.watson.ibm.com ([129.34.20.6]) by ietf-mx.ietf.org with esmtp (Exim 4.43) id 1Fuc4q-0004gN-Nq; Sun, 25 Jun 2006 17:23:34 -0400
Received: from sp1n294en1.watson.ibm.com (sp1n294en1.watson.ibm.com [129.34.20.40]) by igw2.watson.ibm.com (8.12.11.20060308/8.13.1/8.13.1-2005-04-25 igw) with ESMTP id k5PLNmJb015415; Sun, 25 Jun 2006 17:23:48 -0400
Received: from sp1n294en1.watson.ibm.com (localhost [127.0.0.1]) by sp1n294en1.watson.ibm.com (8.11.7-20030924/8.11.7/01-14-2004_2) with ESMTP id k5PLNBT255066; Sun, 25 Jun 2006 17:23:11 -0400
Received: from mgsmtp00.watson.ibm.com (mgsmtp00.watson.ibm.com [9.2.40.58]) by sp1n294en1.watson.ibm.com (8.11.7-20030924/8.11.7/01-14-2004_1) with ESMTP id k5PLNAu223922; Sun, 25 Jun 2006 17:23:10 -0400
Received: from barcelona.watson.ibm.com (barcelona.watson.ibm.com [9.2.14.135]) by mgsmtp00.watson.ibm.com (8.12.11/8.12.11/2005/09/01) with ESMTP id k5PMFfdw017650; Sun, 25 Jun 2006 18:15:41 -0400
Received: from barcelona.watson.ibm.com (localhost.localdomain [127.0.0.1]) by barcelona.watson.ibm.com (8.12.8/8.12.8) with ESMTP id k5PLN99t004373; Sun, 25 Jun 2006 17:23:09 -0400
Received: (from nahum@localhost) by barcelona.watson.ibm.com (8.12.8/8.12.8/Submit) id k5PLN77N004371; Sun, 25 Jun 2006 17:23:07 -0400
Date: Sun, 25 Jun 2006 17:23:07 -0400
From: nahum@watson.ibm.com
To: sporetsky@reefpoint.com
Subject: Re: [bmwg] RE: [Sipping] Draft: SIP Performance Metrics
Message-ID: <20060625212307.GA4278@barcelona.watson.ibm.com>
References: <496A8683261CD211BF6C0008C733261A0803CCCD@email.quarrytech.com>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
In-Reply-To: <496A8683261CD211BF6C0008C733261A0803CCCD@email.quarrytech.com>
User-Agent: Mutt/1.4.1i
X-Spam-Score: 0.2 (/)
X-Scan-Signature: 3971661e40967acfc35f708dd5f33760
Cc: Daryl.Malas@Level3.com, dromasca@avaya.com, sipping@ietf.org, bmwg@ietf.org, eburger@cantata.com
X-BeenThere: sipping@ietf.org
X-Mailman-Version: 2.1.5
Precedence: list
Reply-To: Erich Nahum <nahum@watson.ibm.com>
List-Id: "SIPPING Working Group \(applications of SIP\)" <sipping.ietf.org>
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/sipping>, <mailto:sipping-request@ietf.org?subject=unsubscribe>
List-Post: <mailto:sipping@ietf.org>
List-Help: <mailto:sipping-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/sipping>, <mailto:sipping-request@ietf.org?subject=subscribe>
Errors-To: sipping-bounces@ietf.org
On Sun, Jun 25, 2006 at 08:07:35AM -0400, sporetsky@reefpoint.com wrote: > The authors of this work have been in regular communication from Erich M. > Nahum of SPEC. Here is a snip from one of the emails that well summmarizes > the relationship: Actually, I'm from IBM, not SPEC. SPEC is just a consortium of its member companies/organizations. Sort of like IETF. -Erich > > -----Original Message----- > > From: nahum@watson.ibm.com [mailto:nahum@watson.ibm.com] > > Sent: Friday, May 26, 2006 2:51 PM > > To: Vijay K. Gurbani > > Cc: Malas, Daryl; sipping@ietf.org; acmorton@att.com; bmwg@ietf.org > > Subject: [bmwg] SPEC SIP Benchmarking Effort > > > > [snip] > > > > I have been organizing the SPEC SIP benchmarking effort, and would > > love to get participation from IETF folks. It seems like the two > > activities could be very complementary. > > > > Based on what I've seen, it seems like the IETF BMWG and Daryl Malas' > > draft posted on SIPPING a few days ago are more oriented towards defining > > the proper methods and metrics to measure (e.g., call success rate, > defects > > per million, etc.). > > > > In contrast, SPEC wants to develop and distribute common code for > > benchmarking, as is done with SPECWeb and SPECJAppServer. That code can > > and should use the standardized peformance definitions agreed to by > > SIPPING and/or BMWG. > > Scott > > -----Original Message----- > From: Romascanu, Dan (Dan) [mailto:dromasca@avaya.com] > Sent: Sunday, June 25, 2006 6:00 AM > To: Burger, Eric; Malas, Daryl > Cc: sipping@ietf.org; bmwg@ietf.org > Subject: RE: [bmwg] RE: [Sipping] Draft: SIP Performance Metrics > > > Eric, > > >From the bmwg charter: > > > The major goal of the Benchmarking Methodology Working Group is to > make > a series of recommendations concerning the measurement of the > performance characteristics of various internetworking technologies; > > To the extend that we consider SIP an internetworking technology, I > believe that the scope of the 'SIP Performance Metrics' draft is within > the scope of what bmwg is doing for a while, quite successfully, some > say. > > On a more 'philosophical plan', there is nothing that says that the IETF > work must strictly deal with defining the bits in the Internet Protocols > - see http://www.ietf.org/internet-drafts/draft-hoffman-taobis-08.txt. > And in any case, measuring how a protocol or a device implementing a > protocol behaves can be considered also 'DIRECTLY related to protocol > development'. > > Dan > > PS - This does not mean that I do not have my own questions about the > I-D :-) > > PPS - If we end by deciding that we do this work in the IETF we should > certainly coordinate with other organizations developing standards, > performance measurement and test methodologies in this space. > > > > > > > > > -----Original Message----- > > From: Burger, Eric [mailto:eburger@cantata.com] > > Sent: Friday, June 23, 2006 11:18 PM > > To: Malas, Daryl > > Cc: sipping@ietf.org; bmwg@ietf.org > > Subject: [bmwg] RE: [Sipping] Draft: SIP Performance Metrics > > > > More to the point, is this work appropriate for the IETF at > > all? I would offer that if we needed additions to SIP to > > instrument it for monitoring, then sure. However, I think > > this would much better be done in another venue such as the > > SIP Forum or IMS Forum or even SPEC. If it turns out that > > there need to be some SIP changes, then we could bring that > > to the IETF. > > > > We have way too much on our plate as it is. > > > > > > > > Disclaimer: I'm on the boards of both the SIP Forum and IMS Forum. > > However, this isn't make-work for those groups. Rather, this > > is a plea to NOT make more work in the IETF that is not > > DIRECTLY related to protocol development. > > > > -----Original Message----- > > From: Henning Schulzrinne [mailto:hgs@cs.columbia.edu] > > Sent: Wednesday, May 24, 2006 2:44 PM > > To: Vijay K. Gurbani > > Cc: Malas, Daryl; sipping@ietf.org; acmorton@att.com; bmwg@ietf.org > > Subject: Re: [Sipping] Draft: SIP Performance Metrics > > > > A working group has just been formed (this week) in the SPEC > > consortium. > > > > Vijay K. Gurbani wrote: > > > Daryl: There is work starting in the BMWG along SIP performance > > > metrics, being worked by Scott Poretsky and me. At the > > very least, we > > > should co-ordinate your draft with the thoughts there, and then can > > > figure out with the help of chairs and ADs as to where the > > work should > > > proceed. > > > > > > I have also heard about some performance metrics work in TISPAN and > > > SPEC, but I do not have any more details about these. > > > > > > > _______________________________________________ > > Sipping mailing list https://www1.ietf.org/mailman/listinfo/sipping > > This list is for NEW development of the application of SIP > > Use sip-implementors@cs.columbia.edu for questions on current > > sip Use sip@ietf.org for new developments of core SIP > > > > _______________________________________________ > > bmwg mailing list > > bmwg@ietf.org > > https://www1.ietf.org/mailman/listinfo/bmwg > > > > _______________________________________________ > bmwg mailing list > bmwg@ietf.org > https://www1.ietf.org/mailman/listinfo/bmwg > > _______________________________________________ > Sipping mailing list https://www1.ietf.org/mailman/listinfo/sipping > This list is for NEW development of the application of SIP > Use sip-implementors@cs.columbia.edu for questions on current sip > Use sip@ietf.org for new developments of core SIP -- Erich M. Nahum IBM T.J. Watson Research Center Research Staff Member P.O. Box 704 nahum@watson.ibm.com Yorktown Heights NY 10598 _______________________________________________ Sipping mailing list https://www1.ietf.org/mailman/listinfo/sipping This list is for NEW development of the application of SIP Use sip-implementors@cs.columbia.edu for questions on current sip Use sip@ietf.org for new developments of core SIP
- [Sipping] Draft: SIP Performance Metrics Malas, Daryl
- Re: [Sipping] Draft: SIP Performance Metrics Vijay K. Gurbani
- Re: [Sipping] Draft: SIP Performance Metrics Henning Schulzrinne
- [Sipping] SPEC SIP Benchmarking Effort nahum
- RE: [Sipping] Draft: SIP Performance Metrics Burger, Eric
- RE: [bmwg] RE: [Sipping] Draft: SIP Performance M… Romascanu, Dan (Dan)
- RE: [bmwg] RE: [Sipping] Draft: SIP Performance M… sporetsky
- Re: [bmwg] RE: [Sipping] Draft: SIP Performance M… nahum
- Re: [bmwg] RE: [Sipping] Draft: SIP Performance M… Dale.Worley