Re: [bmwg] In Service Software Upgrade Draft

"MORTON, ALFRED C (AL)" <acmorton@att.com> Tue, 08 July 2014 12:16 UTC

Return-Path: <acmorton@att.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 7952E1B2824 for <bmwg@ietfa.amsl.com>; Tue, 8 Jul 2014 05:16:57 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.852
X-Spam-Level:
X-Spam-Status: No, score=-4.852 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3, RP_MATCHES_RCVD=-0.651, SPF_HELO_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id gAqf1Ux9WoqY for <bmwg@ietfa.amsl.com>; Tue, 8 Jul 2014 05:16:56 -0700 (PDT)
Received: from mail-pink.research.att.com (mail-pink.research.att.com [204.178.8.22]) by ietfa.amsl.com (Postfix) with ESMTP id 053541B281B for <bmwg@ietf.org>; Tue, 8 Jul 2014 05:16:56 -0700 (PDT)
Received: from mail-azure.research.att.com (unknown [135.207.255.18]) by mail-pink.research.att.com (Postfix) with ESMTP id 6132C1208CA; Tue, 8 Jul 2014 08:21:09 -0400 (EDT)
Received: from njfpsrvexg8.research.att.com (unknown [135.207.255.243]) by mail-azure.research.att.com (Postfix) with ESMTP id 94E5BE041A; Tue, 8 Jul 2014 08:16:55 -0400 (EDT)
Received: from NJFPSRVEXG8.research.att.com ([fe80::cdea:b3f6:3efa:1841]) by njfpsrvexg8.research.att.com ([fe80::cdea:b3f6:3efa:1841%13]) with mapi; Tue, 8 Jul 2014 08:16:55 -0400
From: "MORTON, ALFRED C (AL)" <acmorton@att.com>
To: "Banks, Sarah" <sbanks@akamai.com>, "bmwg@ietf.org" <bmwg@ietf.org>
Date: Tue, 08 Jul 2014 08:16:53 -0400
Thread-Topic: In Service Software Upgrade Draft
Thread-Index: Ac+aKgFw6Rod06flRqOt2m1XJoeB9AAe6J7A
Message-ID: <2845723087023D4CB5114223779FA9C80189AAD6DE@njfpsrvexg8.research.att.com>
References: <CFE05E75.675E%sbanks@akamai.com>
In-Reply-To: <CFE05E75.675E%sbanks@akamai.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Archived-At: http://mailarchive.ietf.org/arch/msg/bmwg/tNFoO-opzxh6NoHelpp-Xpt4I7w
Subject: Re: [bmwg] In Service Software Upgrade Draft
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 08 Jul 2014 12:16:57 -0000

> -----Original Message-----
> From: bmwg [mailto:bmwg-bounces@ietf.org] On Behalf Of Banks, Sarah
...
> 	The ISSU draft is in a pretty solid state, from the authors point of
> view. We wanted to solicit a bit of feedback, and make sure we've covered
> all bases. There was some discussion around the authors as to adding some
> text around timers and counters in the draft - do you trust the DUT?
> Should you confirm these outside of the DUT? Etc. Thoughts?
> 
> Kind regards,
> Sarah & Fernando & Gery
> 

I gave this topic some thought last week:

http://tools.ietf.org/html/draft-morton-bmwg-virtual-net-01#section-4.2

   ... external observations remain essential as the
   basis for Benchmarks.  Internal observations with fixed specification
   and interpretation may be provided in parallel, to assist the
   development of operations procedures when the technology is deployed,
   for example.  Internal metrics and measurements from Open Source
   implementations may be the only direct source of performance results
   in a desired dimension, but corroborating external observations are
   still required to assure the integrity of measurement discipline was
   maintained for all reported results.

This text is new and isn't agreed yet, it's my thoughts on the topic.
Al
(as a participant)