Re: [lmap] I-D Action: draft-ietf-lmap-information-model-12.txt

[Juergen Schoenwaelder <[e-mail]>]

Dear Michael,

what is a 'test server' - the 'thing' a measurement task on a
measurement agent runs a test against? If so, this is outside the
scope of the information model. Even if the 'test server' would be run
under the control of an LMAP measurement agent, it would be a task,
i.e., the CAC (Call Admission Control?) would have to be implemented
as part of the measurement task, not in the LMAP scheduler.

The only thing that _could_ be relevant for the LMAP information model
that I see in your message is throttling, i.e., suspending schedules
if there are too many failures.

/js

On Wed, Nov 16, 2016 at 03:56:43PM +0000, Bugenhagen, Michael K wrote:
> Phil, Juergen,
> 
> I apologize ahead of time for the long-winded retrospect… but here’s something I’ve run across you may be able to consider in your framework.
> 
>         I reviewed the draft, and one thing that seems to be missing here is any “NAK” from the test server when it’s busy or overloading.
> 
> Given the MA’s can automatically delay testing due to “cross traffic” there should be some CAC state tracking so Op’s knows what is happening when tests don’t get run because the test server was busy.    This is kind of controller 101 for capacity planning, and ops’ traffic engineering for the testing, and of course logging.
> 
>     I’m not sure there is a “test server behavior” that tracks this in the information model, but all the current carrier grade systems (systems that telecoms use) have them.
> It would be “nice” if the MA knew why a test server ignored a test (I’m assuming they only allow so many connections so a failed / timed out test can occur), but I’m not sure if there are any provisions for this.
> 
>    In the past I have seen “test software” (MA’s ) get turned up without telling the “op’s teams” who maintain the servers – which results in “HOT” servers that give bad results because they don’t have any CAC, or throttling on how many tests are concurrently run, and ended up as a congestion point.   – this fails the ISO9k & 7K testing standards for the most part.
> 
>       Given the criticality of this, it’s a best practice to communicate the test server NAK / Busy, .. to the MA’s so the system is more full proof.
>    Especially when the customer, and the test server may be two different unaffiliated parties.
> 
> So – test system best practices would say -… make sure you have a CAC on the test servers and communicate that to the MA’s so they know what’s going on.
> 
> Best,
> Mike
> 
> 
> 
> 
> 
> 
> 
> 
> On 11/16/16, 9:42 AM, "lmap on behalf of [e-mail]" <[e-mail] on behalf of [e-mail]> wrote:
> 
>     The Section 4 example is about timing of events & schedules - pipelining /serialise etc - which is useful.
> 
>     I meant something like: take some variant of the example in RFC7594 and explain how to use the information model
>     <<   The Controller instructs one or more MAs and communicates the set of
>        Measurement Tasks an MA should perform and when.  For example, it may
>        instruct an MA at a home gateway: "Measure the 'UDP latency' with
>        www.example.org; repeat every hour at xx.05".  The Controller also
>        manages an MA by instructing it on how to report the Measurement
>        Results, for example: "Report results once a day in a batch at 4am".
>     >>
> 
>     Strictly speaking this is not needed, but I think it would be useful, as the information model is now quite abstract (eg measurement tasks and registries no longer immediately obvious - as they're just tasks & registires). If other people think this is pointless, then I'm ok.
> 
> 
>     -----Original Message-----
>     From: Juergen Schoenwaelder [mailto:[e-mail]]
>     Sent: 16 November 2016 09:42
>     To: Eardley,PL,Philip,TUB8 R <[e-mail]>
>     Cc: [e-mail]; [e-mail]
>     Subject: Re: [lmap] I-D Action: draft-ietf-lmap-information-model-12.txt
> 
>     Phil,
> 
>     I am not sure which example you find missing. There is an example for an execution in section 4. There is no concrete serialization example because the information model is abstract and does not define any serialization rules. A concrete example (in XML serialization) can be found in the YANG data model - and the grand plan was to have the JSON serialization of the same model in the RESTCONF document.
> 
>     /js
> 
>     On Wed, Nov 16, 2016 at 09:07:16AM +0000, [e-mail] wrote:
>     > Sorry for having been quiet on this recently. Thanks for all the work on this Juergen.
>     >
>     > I think it would be good to have a section that provides an example - to act as some kind of link from the architecture doc to the info model. The info model is now more generic (eg no specific measurement tasks) - so I think it would be useful to show a simple example with measurement & reporting.
>     >
>     > Thanks,
>     > phil
>     >
>     > -----Original Message-----
>     > From: lmap [mailto:[e-mail]] On Behalf Of MORTON, ALFRED
>     > C (AL)
>     > Sent: 16 November 2016 02:38
>     > To: [e-mail]
>     > Subject: Re: [lmap] I-D Action:
>     > draft-ietf-lmap-information-model-12.txt
>     >
>     > Hi Juergen,
>     >
>     > In the latest Info Model...
>     > > -----Original Message-----
>     > ...
>     > >
>     > > There's also a htmlized version available at:
>     > > https://tools.ietf.org/html/draft-ietf-lmap-information-model-12
>     > >
>     > [ACM]
>     > The metric registry has become generic:
>     >
>     > 3.10.  Common Objects: Registry Information
>     >
>     >    Tasks and actions can be associated with entries in a registry.  A
>     >    registry object refers to an entry in a registry (identified by a
>     >    URI) and it may define a set of roles.
>     >
>     > 3.10.1.  Definition of ma-registry-obj
>     >
>     >      object {
>     >          uri                 ma-registry-uri;
>     >         [string              ma-registry-role<0..*>;]
>     >      } ma-registry-obj;
>     >
>     >    The ma-registry-obj refers to an entry of a registry and it defines
>     >    the associated role(s).  The ma-registry-obj consists of the
>     >    following elements:
>     >
>     >    ma-registry-uri:          A URI identifying an entry in a registry.
>     >
>     >    ma-registry-role:         An optional and possibly empty unordered
>     >                              set of roles for the identified registry
>     >                              entry.
>     > -=-=-=-=-=-=-=-=-
>     >
>     > It's not clear to me how the generic object works with respect to the performance metric registry. It was clear when the metric aspect was prominent (ma-metric-registry-obj).
>     > This may be because the idea of an LMAP task registry has been mentioned, but I haven't seen any details about the LMAP task registry and maybe an example would help.
>     > It would be good to see how the LMAP Task Registry and IANA Performance metrics registry are used together.
>     >
>     > Since I'm mostly interested in using LMAP for control and reporting of registered performance metrics, the composition of these measurement tasks should be as straightforward as possible.
>     >
>     > A follow-up question is how this will change the data model, which still appears to contain specific references to metrics.
>     >
>     > regards,
>     > Al
>     >
>     >
>     > _______________________________________________
>     > lmap mailing list
>     > [e-mail]
>     > https://www.ietf.org/mailman/listinfo/lmap
>     >
>     > _______________________________________________
>     > lmap mailing list
>     > [e-mail]
>     > https://www.ietf.org/mailman/listinfo/lmap
> 
>     --
>     Juergen Schoenwaelder           Jacobs University Bremen gGmbH
>     Phone: [phone]         Campus Ring 1 | 28759 Bremen | Germany
>     Fax:   [phone]         <http://www.jacobs-university.de/>
> 
>     _______________________________________________
>     lmap mailing list
>     [e-mail]
>     https://www.ietf.org/mailman/listinfo/lmap
> 
> 
> This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
> _______________________________________________
> lmap mailing list
> [e-mail]
> https://www.ietf.org/mailman/listinfo/lmap

-- 
Juergen Schoenwaelder           Jacobs University Bremen gGmbH
Phone: [phone]         Campus Ring 1 | 28759 Bremen | Germany
Fax:   [phone]         <http://www.jacobs-university.de/>