Re: [Netconf] Fwd: Regarding complete device configuration sync to NMS

Shiva Kumar Pathori <pathori@gmail.com> Fri, 04 September 2015 02:21 UTC

Return-Path: <pathori@gmail.com>
X-Original-To: netconf@ietfa.amsl.com
Delivered-To: netconf@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5D4C21B2CA4; Thu, 3 Sep 2015 19:21:45 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.999
X-Spam-Level:
X-Spam-Status: No, score=-1.999 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, SPF_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id gwsT39qWg_aO; Thu, 3 Sep 2015 19:21:42 -0700 (PDT)
Received: from mail-oi0-x234.google.com (mail-oi0-x234.google.com [IPv6:2607:f8b0:4003:c06::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B6FC21B3593; Thu, 3 Sep 2015 19:21:42 -0700 (PDT)
Received: by oixx17 with SMTP id x17so4698708oix.0; Thu, 03 Sep 2015 19:21:42 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=hEYE8Q7nsl4ualyIdVonpUAcAh9TL/j8LdMbP+Lc4mg=; b=tUPUcgEvRi4XUta5X5K8yLLrj9+2zQGWfh/38+CqZCOuNeC4kuhEPPJNANDo5hXa8S yhIt06zkvPseVREtwZiIhAYPxsSEnLnSqDRD+Vdzz+8GVf3B6Ooyt7JrI43kN5CKF4hO Klygg6GowmIWyrfJEmGccTbLXBOXHpDm+VRRoru70wcIIF12hbDilcUhZOtEprQ5zT73 s+YqEI1lqkIRo63jbKtscDrdY8LoWPA9fI8/paF6fyo6vbGm2NzY8T5pqV7g4r6S/jDm FGw4/wVonhuRZLd+KUvTEhFIV3RumqG7ZulSVTzSzWXX+u/ghnkQr+2zaBW8CjSRsrWk UEiQ==
MIME-Version: 1.0
X-Received: by 10.202.200.79 with SMTP id y76mr855180oif.5.1441333302177; Thu, 03 Sep 2015 19:21:42 -0700 (PDT)
Received: by 10.60.46.97 with HTTP; Thu, 3 Sep 2015 19:21:42 -0700 (PDT)
Received: by 10.60.46.97 with HTTP; Thu, 3 Sep 2015 19:21:42 -0700 (PDT)
In-Reply-To: <CABCOCHS0P2AugRTSB31Gzr3q_ymSWfvnYJzfn0kx9n5MJW-XEA@mail.gmail.com>
References: <CABCOCHQE4zGcrLKyb0XEEbBVGbHLAr8LJVFnRzCm1_Xap4MTkQ@mail.gmail.com> <20150903171049.GA30863@elstar.local> <CABCOCHTeSxEVmJ5ZqMohJXb4LFO4J=WiMgH=yMu5QuTt8oqVUg@mail.gmail.com> <20150903.215033.1871297355299522194.mbj@tail-f.com> <CAJtYN8KfBb1OyXvCXO6+Rej+vKx+QA7vQQQXzjSo5mW9E=rtDw@mail.gmail.com> <CAJtYN8LMLZ0N4F9BBcL-UMzpr0YpC9JunjDfq_PT7hkxONNjaA@mail.gmail.com> <CABCOCHS0P2AugRTSB31Gzr3q_ymSWfvnYJzfn0kx9n5MJW-XEA@mail.gmail.com>
Date: Fri, 04 Sep 2015 07:51:42 +0530
Message-ID: <CAJtYN8J40g5SN0yVtsbnN-QZMxON7V0CHnF4-NHEj0L7RDQtcA@mail.gmail.com>
From: Shiva Kumar Pathori <pathori@gmail.com>
To: Andy Bierman <andy@yumaworks.com>
Content-Type: multipart/alternative; boundary="001a1134fe1a7ab689051ee28f78"
Archived-At: <http://mailarchive.ietf.org/arch/msg/netconf/A5DKSpkCMdnvC3s1VwfFqLLmv_w>
Cc: netconf-request@ietf.org, netconf@ietf.org
Subject: Re: [Netconf] Fwd: Regarding complete device configuration sync to NMS
X-BeenThere: netconf@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Network Configuration WG mailing list <netconf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netconf>, <mailto:netconf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netconf/>
List-Post: <mailto:netconf@ietf.org>
List-Help: <mailto:netconf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netconf>, <mailto:netconf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 04 Sep 2015 02:21:45 -0000

This method is similar to the draft
https://datatracker.ietf.org/doc/draft-liu-netconf-multiple-replies/?include_text=1.
Where as Client has to send multiple get-block RPC to get the complete
data. In this method all such replies will be put in multiple files and
zipped. This will reduce the RPC message interaction between client and
server.
On 04-Sep-2015 7:40 am, "Andy Bierman" <andy@yumaworks.com> wrote:

>
>
> On Thu, Sep 3, 2015 at 6:43 PM, Shiva Kumar Pathori <pathori@gmail.com>
> wrote:
>
>> I mean the zip file in fact contains proper <rpc-reply> with multiple
>> files. Each file is of one complete XML document.
>>
>
>
> The <rpc-reply> is an XML instance document.
> Why would there be multiple "files" in response to 1 <get> or <get-config>?
>
> I suggest you implement this and report the memory usage compared to
> streaming
> buffer-at-a-time with SSH, and also compare the number of bytes on the
> wire for each approach.
>
> BTW, do you intend this for config only (<get-config>) or all data (<get>)?
>
>
> Andy
>
> @Kent,
>> By the way, please share me some details about the multiple  reply draft.
>> I would like to work on it.
>> On 04-Sep-2015 1:20 am, "Martin Bjorklund" <mbj@tail-f.com> wrote:
>>
>> Andy Bierman <andy@yumaworks.com> wrote:
>> > On Thu, Sep 3, 2015 at 10:10 AM, Juergen Schoenwaelder <
>> > j.schoenwaelder@jacobs-university.de> wrote:
>> >
>> > > On Thu, Sep 03, 2015 at 09:46:15AM -0700, Andy Bierman wrote:
>> > > > On Thu, Sep 3, 2015 at 9:40 AM, Juergen Schoenwaelder <
>> > > > j.schoenwaelder@jacobs-university.de> wrote:
>> > > >
>> > > > > On Thu, Sep 03, 2015 at 04:17:22PM +0000, Kent Watsen wrote:
>> > > > > > [hit the wrong button before]
>> > > > > >
>> > > > > >
>> > > > > > Hi Shiva,
>> > > > > >
>> > > > > > > I would like to propose one method to get the complete
>> > > > > > > configuration through zip file to NMS. I feel this method
>> will be
>> > > > > > >effective instead of <get> without any filter. Please advice.
>> > > > > >
>> > > > > > Like a <copy-config> with a parameter indicating compression.
>> Then,
>> > > to
>> > > > > > avoid the zip file being base64 encoded, another parameter
>> indicate
>> > > where
>> > > > > > to put the file (tftp://, ftp://, etc.), or wait for the
>> > > > > multiple-replies
>> > > > > > draft to provide a better solution for bulk transfer.
>> > > > > >
>> > > > > > In the meanwhile, a custom RPC could define this behavior
>> > > immediately.
>> > > > >
>> > > > > If the goal to reduce bits on the wire, certain secure transports
>> can
>> > > > > do compression transparently for you (and it then works for
>> everything
>> > > > > exchanged in a session, not just a get without filters).
>> > > > >
>> > > > >
>> > > > Yes, but it would be nice if NETCONF was not so "cache-unfriendly".
>> > > > RESTCONF has Entity tags to help the client only retrieve data
>> > > > when it has changed.  Pub/sub offers a way to push only the data
>> > > > that has changed.  A "get without filters" should be a rare event
>> > > > if the protocol is designed correctly.
>> > > >
>> > >
>> > > I guess we agree that it is unclear why he asked the question, that is
>> > > which problem he is actually trying to solve.
>> > >
>> > >
>> > Devices that are large enough to make this worthwhile generally
>> > no not store the contents of <get> in memory in 1 process.
>>
>> I think he meant <get-config>, but it doesn't matter for the
>> discussion.
>>
>> > Building a giant response file then compressing it would not work.
>> > Lossless compression that works on an arbitrary chunk of data at a time
>> > would be OK.
>>
>> ... which SSH provides already.
>>
>>
>> /martin
>>
>>
>> _______________________________________________
>> Netconf mailing list
>> Netconf@ietf.org
>> https://www.ietf.org/mailman/listinfo/netconf
>>
>>
>