Re: [lmap] I-D Action: draft-ietf-lmap-information-model-12.txt

Phil, Juergen,

I apologize ahead of time for the long-winded retrospect… but here’s something I’ve run across you may be able to consider in your framework.

        I reviewed the draft, and one thing that seems to be missing here is any “NAK” from the test server when it’s busy or overloading.

Given the MA’s can automatically delay testing due to “cross traffic” there should be some CAC state tracking so Op’s knows what is happening when tests don’t get run because the test server was busy.    This is kind of controller 101 for capacity planning, and ops’ traffic engineering for the testing, and of course logging.

    I’m not sure there is a “test server behavior” that tracks this in the information model, but all the current carrier grade systems (systems that telecoms use) have them.
It would be “nice” if the MA knew why a test server ignored a test (I’m assuming they only allow so many connections so a failed / timed out test can occur), but I’m not sure if there are any provisions for this.

   In the past I have seen “test software” (MA’s ) get turned up without telling the “op’s teams” who maintain the servers – which results in “HOT” servers that give bad results because they don’t have any CAC, or throttling on how many tests are concurrently run, and ended up as a congestion point.   – this fails the ISO9k & 7K testing standards for the most part.

      Given the criticality of this, it’s a best practice to communicate the test server NAK / Busy, .. to the MA’s so the system is more full proof.
   Especially when the customer, and the test server may be two different unaffiliated parties.

So – test system best practices would say -… make sure you have a CAC on the test servers and communicate that to the MA’s so they know what’s going on.

Best,
Mike

On 11/16/16, 9:42 AM, "lmap on behalf of philip.eardley@bt.com" <lmap-bounces@ietf.org on behalf of philip.eardley@bt.com> wrote:

    The Section 4 example is about timing of events & schedules - pipelining /serialise etc - which is useful.

    I meant something like: take some variant of the example in RFC7594 and explain how to use the information model
    <<   The Controller instructs one or more MAs and communicates the set of
       Measurement Tasks an MA should perform and when.  For example, it may
       instruct an MA at a home gateway: "Measure the 'UDP latency' with
       www.example.org; repeat every hour at xx.05".  The Controller also
       manages an MA by instructing it on how to report the Measurement
       Results, for example: "Report results once a day in a batch at 4am".
    >>

    Strictly speaking this is not needed, but I think it would be useful, as the information model is now quite abstract (eg measurement tasks and registries no longer immediately obvious - as they're just tasks & registires). If other people think this is pointless, then I'm ok.

    -----Original Message-----
    From: Juergen Schoenwaelder [mailto:j.schoenwaelder@jacobs-university.de]
    Sent: 16 November 2016 09:42
    To: Eardley,PL,Philip,TUB8 R <philip.eardley@bt.com>
    Cc: acmorton@att.com; lmap@ietf.org
    Subject: Re: [lmap] I-D Action: draft-ietf-lmap-information-model-12.txt

    Phil,

    I am not sure which example you find missing. There is an example for an execution in section 4. There is no concrete serialization example because the information model is abstract and does not define any serialization rules. A concrete example (in XML serialization) can be found in the YANG data model - and the grand plan was to have the JSON serialization of the same model in the RESTCONF document.

    /js

    On Wed, Nov 16, 2016 at 09:07:16AM +0000, philip.eardley@bt.com wrote:
    > Sorry for having been quiet on this recently. Thanks for all the work on this Juergen.
    >
    > I think it would be good to have a section that provides an example - to act as some kind of link from the architecture doc to the info model. The info model is now more generic (eg no specific measurement tasks) - so I think it would be useful to show a simple example with measurement & reporting.
    >
    > Thanks,
    > phil
    >
    > -----Original Message-----
    > From: lmap [mailto:lmap-bounces@ietf.org] On Behalf Of MORTON, ALFRED
    > C (AL)
    > Sent: 16 November 2016 02:38
    > To: lmap@ietf.org
    > Subject: Re: [lmap] I-D Action:
    > draft-ietf-lmap-information-model-12.txt
    >
    > Hi Juergen,
    >
    > In the latest Info Model...
    > > -----Original Message-----
    > ...
    > >
    > > There's also a htmlized version available at:
    > > https://tools.ietf.org/html/draft-ietf-lmap-information-model-12
    > >
    > [ACM]
    > The metric registry has become generic:
    >
    > 3.10.  Common Objects: Registry Information
    >
    >    Tasks and actions can be associated with entries in a registry.  A
    >    registry object refers to an entry in a registry (identified by a
    >    URI) and it may define a set of roles.
    >
    > 3.10.1.  Definition of ma-registry-obj
    >
    >      object {
    >          uri                 ma-registry-uri;
    >         [string              ma-registry-role<0..*>;]
    >      } ma-registry-obj;
    >
    >    The ma-registry-obj refers to an entry of a registry and it defines
    >    the associated role(s).  The ma-registry-obj consists of the
    >    following elements:
    >
    >    ma-registry-uri:          A URI identifying an entry in a registry.
    >
    >    ma-registry-role:         An optional and possibly empty unordered
    >                              set of roles for the identified registry
    >                              entry.
    > -=-=-=-=-=-=-=-=-
    >
    > It's not clear to me how the generic object works with respect to the performance metric registry. It was clear when the metric aspect was prominent (ma-metric-registry-obj).
    > This may be because the idea of an LMAP task registry has been mentioned, but I haven't seen any details about the LMAP task registry and maybe an example would help.
    > It would be good to see how the LMAP Task Registry and IANA Performance metrics registry are used together.
    >
    > Since I'm mostly interested in using LMAP for control and reporting of registered performance metrics, the composition of these measurement tasks should be as straightforward as possible.
    >
    > A follow-up question is how this will change the data model, which still appears to contain specific references to metrics.
    >
    > regards,
    > Al
    >
    >
    > _______________________________________________
    > lmap mailing list
    > lmap@ietf.org
    > https://www.ietf.org/mailman/listinfo/lmap
    >
    > _______________________________________________
    > lmap mailing list
    > lmap@ietf.org
    > https://www.ietf.org/mailman/listinfo/lmap

    --
    Juergen Schoenwaelder           Jacobs University Bremen gGmbH
    Phone: +49 421 200 3587         Campus Ring 1 | 28759 Bremen | Germany
    Fax:   +49 421 200 3103         <http://www.jacobs-university.de/>

    _______________________________________________
    lmap mailing list
    lmap@ietf.org
    https://www.ietf.org/mailman/listinfo/lmap

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.