Re: [Gen-art] Gen-ART Telechat review of draft-ietf-lmap-use-cases-05

Ben Campbell <ben@nostrum.com> Tue, 16 December 2014 15:26 UTC

Return-Path: <ben@nostrum.com>
X-Original-To: gen-art@ietfa.amsl.com
Delivered-To: gen-art@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 10A261A1B06 for <gen-art@ietfa.amsl.com>; Tue, 16 Dec 2014 07:26:40 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 0.39
X-Spam-Level:
X-Spam-Status: No, score=0.39 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, MANGLED_LIST=2.3, T_RP_MATCHES_RCVD=-0.01] autolearn=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id b2NuUn8uDjwT for <gen-art@ietfa.amsl.com>; Tue, 16 Dec 2014 07:26:33 -0800 (PST)
Received: from nostrum.com (raven-v6.nostrum.com [IPv6:2001:470:d:1130::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 0647A1A1B30 for <gen-art@ietf.org>; Tue, 16 Dec 2014 07:26:32 -0800 (PST)
Received: from [10.0.1.23] (cpe-173-172-146-58.tx.res.rr.com [173.172.146.58]) (authenticated bits=0) by nostrum.com (8.14.9/8.14.7) with ESMTP id sBGFQQBQ051077 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 16 Dec 2014 09:26:27 -0600 (CST) (envelope-from ben@nostrum.com)
X-Authentication-Warning: raven.nostrum.com: Host cpe-173-172-146-58.tx.res.rr.com [173.172.146.58] claimed to be [10.0.1.23]
Content-Type: text/plain; charset="us-ascii"
Mime-Version: 1.0 (Mac OS X Mail 8.1 \(1993\))
From: Ben Campbell <ben@nostrum.com>
In-Reply-To: <A2E337CDB7BC4145B018B9BEE8EB3E0D413BCFADE0@EMV67-UKRD.domain1.systemhost.net>
Date: Tue, 16 Dec 2014 09:26:26 -0600
X-Mao-Original-Outgoing-Id: 440436386.756208-b15d99046ab3b9b0c60b543e37c11138
Content-Transfer-Encoding: quoted-printable
Message-Id: <1336E4FD-6827-46C6-BE93-8D0DA39CDDB4@nostrum.com>
References: <9AED4E17-CB69-4F9B-8808-4EB66EADB327@nostrum.com> <, > <A8ABCD69-B386-40E6-BBA7-66B0FBDA770B@piuha.net> <A2E337CDB7BC4145B018B9BEE8EB3E0D413BA1078B@EMV67-UKRD.domain1.systemhost.net> <4FE28586-2FB8-491F-82FC-F8B50AC56F5C@nostrum.com> <A2E337CDB7BC4145B018B9BEE8EB3E0D413BCFADE0@EMV67-UKRD.domain1.systemhost.net>
To: philip.eardley@bt.com
X-Mailer: Apple Mail (2.1993)
Archived-At: http://mailarchive.ietf.org/arch/msg/gen-art/pqDsYHOtTY5MU9XCovJSIMjiJvc
Cc: draft-ietf-lmap-use-cases.all@tools.ietf.org, gen-art@ietf.org
Subject: Re: [Gen-art] Gen-ART Telechat review of draft-ietf-lmap-use-cases-05
X-BeenThere: gen-art@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "GEN-ART: General Area Review Team" <gen-art.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/gen-art>, <mailto:gen-art-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/gen-art/>
List-Post: <mailto:gen-art@ietf.org>
List-Help: <mailto:gen-art-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/gen-art>, <mailto:gen-art-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 16 Dec 2014 15:26:40 -0000

Thanks! More inline:

> On Dec 16, 2014, at 3:12 AM, philip.eardley@bt.com wrote:
> 
> Thanks!
> phil
> 
>> 
>>> OLD
>>> 
>>>     o Understanding the quality experienced by customers. Alongside
>>>     benchmarking competitors, gaining better insight into the user's
>>>     service through a sample panel of the operator's own customers.
>>>     The ISP requires a performance viewpoint of the end-to-end
>>>     perspective, which includes: home/enterprise networks; peering
>>>     points; Content Delivery Networks (CDNs); etc.
>>> 
>>> PROPOSED NEW
>>> 
>>>     o Understanding the quality experienced by customers. The
>> network operator would like to gain better insight into the end-to-end
>> performance experienced by its customers. This could incorporate home
>> and enterprise networks, and the impact of peering, caching and Content
>> Delivery Networks (CDNs).	
>> 
>> Looks good, but do you expect the last sentence to be exhaustive, or
>> are those just examples?
> 
> "End-to-end" could, for instance, incorporate home and enterprise networks, and the impact of peering, caching and Content Delivery Networks (CDNs).
> 

Works for me!

> 
>> 
>> 
>>>>> - 3.1, 1st para:
>>>>> 
>>>>> Can you provide a definition or reference for "mean opinion score"?
>>>> 
>>>> Not addressed.
>>> 
>>> If a reference is really needed, then i guess
>> http://en.wikipedia.org/wiki/Mean_opinion_score will do.
>>> 	
>> 
>> On a quick search, it looks like that's at least discussed (and maybe
>> defined) in ITU-T P.800.
>> 
>> http://www.itu.int/rec/T-REC-P.800-199608-I/en
> 
> I'll add whichever reference you prefer - wiki or P.800 which is specifically about telephony.
> The context is:
> <<This involves
>   relating the pure network parameters to something like a 'mean
>   opinion score' which will be service dependent (for instance web
>   browsing QoE is largely determined by latency above a few Mb/s).

On reflection, given the context of this being a very "informational" reference, and that there doesn't seem to be an authoritative source for the term when used outside of telephony, it's not a big deal one way or another. The wiki link would be sufficient, as would a one sentence explanation along the lines as an "aggregation of subjective user experience measurements."


>>> 
> 
>> 
>> [...]
>> 
>>> 
>>>>> -- 4.2, 3rd paragraph:
>>>>> Can you offer a definition for "probes"?
>>>> Not addressed.
>>> 
>>> I don't want to address this one. Formal terminology is in the LMAP
>> framework, including the definition of "measurement agent". In this
>> document we used the more informal term "probe", as it seems easy to
>> understand without a formal definition. Since this use cases doc might
>> have a wider readership, we wanted to avoid terminology and just give
>> the reader the motivations and usages of LMAP measurement information.
>> 
>> Could you offer an informal definition, or a "such as [example]" sort
>> of thing? "Probe" has many meanings. Context might be enough for some
>> readers, but possibly not all.
> 
> In S3.1 probe is first mentioned. So then I'll add this text:-
> 
> NEW
> (A probe is a device or piece of software that makes measurements and reports the results, under the control of the measurement system. Implementation options are discussed in Section 5.)
> 
> And in S5
> OLD
> One way involves a special hardware device that is connected directly
>   to the home gateway.
> ...
> Another approach involves implementing the measurement capability as
>   a webpage or an "app" that end users are encouraged to download onto
>   their mobile phone or computing device.
> 
> NEW
> One type of probe is a special hardware device that is connected directly
>   to the home gateway.
> ...
> Another type of probe involves implementing the measurement capability as
>   a webpage or an "app" that end users are encouraged to download onto
>   their mobile phone or computing device.

That helps, thanks!

>> 
>>> _______________________________________________
>>> Gen-art mailing list
>>> Gen-art@ietf.org
>>> https://www.ietf.org/mailman/listinfo/gen-art