Re: [Netconf] Fwd: Regarding complete device configuration sync to NMS

Andy Bierman <andy@yumaworks.com> Fri, 04 September 2015 02:10 UTC

Return-Path: <andy@yumaworks.com>
X-Original-To: netconf@ietfa.amsl.com
Delivered-To: netconf@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 046601B375A for <netconf@ietfa.amsl.com>; Thu, 3 Sep 2015 19:10:50 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.978
X-Spam-Level:
X-Spam-Status: No, score=-1.978 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, FM_FORGED_GMAIL=0.622, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id j1za6aaLugPe for <netconf@ietfa.amsl.com>; Thu, 3 Sep 2015 19:10:48 -0700 (PDT)
Received: from mail-lb0-f179.google.com (mail-lb0-f179.google.com [209.85.217.179]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 079B91AC3F6 for <netconf@ietf.org>; Thu, 3 Sep 2015 19:10:48 -0700 (PDT)
Received: by lbcjc2 with SMTP id jc2so3781087lbc.0 for <netconf@ietf.org>; Thu, 03 Sep 2015 19:10:46 -0700 (PDT)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=y+ATm/iS9sUosORGrv/Qhab0ZD9Je2Z13w9ZV4lqRgE=; b=WNJ4Bf9JrDm4tM5qkeWnm9+FmM5t9z6QaBo172DoBGuhAjaQtl1Hei+aAyG5ffUOPa novXz2Kg1l3m4NuJ4+CmWlIK1JEdlriZZ5wiam2BdxoQ6UQogTovKz0rQkGtRlpU0fbe zXwUdnaaQR4PDyC4z84JVFBgs+R0H9IAoY5b66ENDtXqCt/jXwTn06AP2vsc8hg/dbAL 9ARYjBovCWcdjnNbba0ZkpHa7PSh0m162X97TjtpRAtkZR43hM8mtx/9HNgkDKHfQIGr BnmUkteNH33d+3AoWAAeQtiudtgxn+ANIAMCZLzVvLyZhlKEvYzMbM0SkP1M5ycRPbuM Hl5g==
X-Gm-Message-State: ALoCoQlS+dPeueONM+3e2w+kj/84GYt7c8fVtgLiJ5IpJJwc7sbSq6UGXPGBccZxSSudkR3UeJ/4
MIME-Version: 1.0
X-Received: by 10.152.120.74 with SMTP id la10mr1041808lab.37.1441332646316; Thu, 03 Sep 2015 19:10:46 -0700 (PDT)
Received: by 10.112.200.104 with HTTP; Thu, 3 Sep 2015 19:10:46 -0700 (PDT)
In-Reply-To: <CAJtYN8LMLZ0N4F9BBcL-UMzpr0YpC9JunjDfq_PT7hkxONNjaA@mail.gmail.com>
References: <CABCOCHQE4zGcrLKyb0XEEbBVGbHLAr8LJVFnRzCm1_Xap4MTkQ@mail.gmail.com> <20150903171049.GA30863@elstar.local> <CABCOCHTeSxEVmJ5ZqMohJXb4LFO4J=WiMgH=yMu5QuTt8oqVUg@mail.gmail.com> <20150903.215033.1871297355299522194.mbj@tail-f.com> <CAJtYN8KfBb1OyXvCXO6+Rej+vKx+QA7vQQQXzjSo5mW9E=rtDw@mail.gmail.com> <CAJtYN8LMLZ0N4F9BBcL-UMzpr0YpC9JunjDfq_PT7hkxONNjaA@mail.gmail.com>
Date: Thu, 03 Sep 2015 19:10:46 -0700
Message-ID: <CABCOCHS0P2AugRTSB31Gzr3q_ymSWfvnYJzfn0kx9n5MJW-XEA@mail.gmail.com>
From: Andy Bierman <andy@yumaworks.com>
To: Shiva Kumar Pathori <pathori@gmail.com>
Content-Type: multipart/alternative; boundary="089e0122902263262e051ee2680a"
Archived-At: <http://mailarchive.ietf.org/arch/msg/netconf/gibFntMXM2CJri-IgkaOLor78TE>
Cc: netconf-request@ietf.org, Netconf <netconf@ietf.org>
Subject: Re: [Netconf] Fwd: Regarding complete device configuration sync to NMS
X-BeenThere: netconf@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Network Configuration WG mailing list <netconf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netconf>, <mailto:netconf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netconf/>
List-Post: <mailto:netconf@ietf.org>
List-Help: <mailto:netconf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netconf>, <mailto:netconf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 04 Sep 2015 02:10:51 -0000

On Thu, Sep 3, 2015 at 6:43 PM, Shiva Kumar Pathori <pathori@gmail.com>
wrote:

> I mean the zip file in fact contains proper <rpc-reply> with multiple
> files. Each file is of one complete XML document.
>


The <rpc-reply> is an XML instance document.
Why would there be multiple "files" in response to 1 <get> or <get-config>?

I suggest you implement this and report the memory usage compared to
streaming
buffer-at-a-time with SSH, and also compare the number of bytes on the wire
for each approach.

BTW, do you intend this for config only (<get-config>) or all data (<get>)?


Andy

@Kent,
> By the way, please share me some details about the multiple  reply draft.
> I would like to work on it.
> On 04-Sep-2015 1:20 am, "Martin Bjorklund" <mbj@tail-f.com> wrote:
>
> Andy Bierman <andy@yumaworks.com> wrote:
> > On Thu, Sep 3, 2015 at 10:10 AM, Juergen Schoenwaelder <
> > j.schoenwaelder@jacobs-university.de> wrote:
> >
> > > On Thu, Sep 03, 2015 at 09:46:15AM -0700, Andy Bierman wrote:
> > > > On Thu, Sep 3, 2015 at 9:40 AM, Juergen Schoenwaelder <
> > > > j.schoenwaelder@jacobs-university.de> wrote:
> > > >
> > > > > On Thu, Sep 03, 2015 at 04:17:22PM +0000, Kent Watsen wrote:
> > > > > > [hit the wrong button before]
> > > > > >
> > > > > >
> > > > > > Hi Shiva,
> > > > > >
> > > > > > > I would like to propose one method to get the complete
> > > > > > > configuration through zip file to NMS. I feel this method will
> be
> > > > > > >effective instead of <get> without any filter. Please advice.
> > > > > >
> > > > > > Like a <copy-config> with a parameter indicating compression.
> Then,
> > > to
> > > > > > avoid the zip file being base64 encoded, another parameter
> indicate
> > > where
> > > > > > to put the file (tftp://, ftp://, etc.), or wait for the
> > > > > multiple-replies
> > > > > > draft to provide a better solution for bulk transfer.
> > > > > >
> > > > > > In the meanwhile, a custom RPC could define this behavior
> > > immediately.
> > > > >
> > > > > If the goal to reduce bits on the wire, certain secure transports
> can
> > > > > do compression transparently for you (and it then works for
> everything
> > > > > exchanged in a session, not just a get without filters).
> > > > >
> > > > >
> > > > Yes, but it would be nice if NETCONF was not so "cache-unfriendly".
> > > > RESTCONF has Entity tags to help the client only retrieve data
> > > > when it has changed.  Pub/sub offers a way to push only the data
> > > > that has changed.  A "get without filters" should be a rare event
> > > > if the protocol is designed correctly.
> > > >
> > >
> > > I guess we agree that it is unclear why he asked the question, that is
> > > which problem he is actually trying to solve.
> > >
> > >
> > Devices that are large enough to make this worthwhile generally
> > no not store the contents of <get> in memory in 1 process.
>
> I think he meant <get-config>, but it doesn't matter for the
> discussion.
>
> > Building a giant response file then compressing it would not work.
> > Lossless compression that works on an arbitrary chunk of data at a time
> > would be OK.
>
> ... which SSH provides already.
>
>
> /martin
>
>
> _______________________________________________
> Netconf mailing list
> Netconf@ietf.org
> https://www.ietf.org/mailman/listinfo/netconf
>
>