Re: [netconf] Current activities on RESTCONF/NETCONF to support paging

Mikael Abrahamsson <swmike@swm.pp.se> Thu, 14 March 2019 09:41 UTC

Return-Path: <swmike@swm.pp.se>
X-Original-To: netconf@ietfa.amsl.com
Delivered-To: netconf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2A457128B36 for <netconf@ietfa.amsl.com>; Thu, 14 Mar 2019 02:41:35 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.3
X-Spam-Level:
X-Spam-Status: No, score=-4.3 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=swm.pp.se
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id cY7DzKl4aTj7 for <netconf@ietfa.amsl.com>; Thu, 14 Mar 2019 02:41:32 -0700 (PDT)
Received: from uplift.swm.pp.se (ipv6.swm.pp.se [IPv6:2a00:801::f]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 9DBCC1288AB for <netconf@ietf.org>; Thu, 14 Mar 2019 02:41:32 -0700 (PDT)
Received: by uplift.swm.pp.se (Postfix, from userid 501) id 62C01B3; Thu, 14 Mar 2019 10:41:30 +0100 (CET)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=swm.pp.se; s=mail; t=1552556490; bh=Ce6WL7FDr9nnYJ7cNgZ0wj5SoGEpd8oI9BZoVoq6xKk=; h=Date:From:To:cc:Subject:In-Reply-To:References:From; b=ksVgxuCmtUIBX+FbfHICSwjOOFckGPTojueZM8uHOcSZKlpOUeehiSixBv+rJcfv3 ar66ORFP0VgVW+fFQCnHgaVgCX7nqW2GTdpH1Uk9HCcXJffyx/HQKQnHHbwK1cjUgN yE5uP6sbsShp+KuoUVGxgxaxf3hsUR8EgjQ+ELy8=
Received: from localhost (localhost [127.0.0.1]) by uplift.swm.pp.se (Postfix) with ESMTP id 6091EB2; Thu, 14 Mar 2019 10:41:30 +0100 (CET)
Date: Thu, 14 Mar 2019 10:41:30 +0100
From: Mikael Abrahamsson <swmike@swm.pp.se>
To: Juergen Schoenwaelder <j.schoenwaelder@jacobs-university.de>
cc: "Wisotzky, Sven (Nokia - DE/Stuttgart)" <sven.wisotzky@nokia.com>, "netconf@ietf.org" <netconf@ietf.org>
In-Reply-To: <20190314093552.3pwa7ptrre4t2stk@anna.jacobs.jacobs-university.de>
Message-ID: <alpine.DEB.2.20.1903141039020.3161@uplift.swm.pp.se>
References: <C88A38CA-44B5-42A0-9DFA-A67AE5456951@nokia.com> <20190314093552.3pwa7ptrre4t2stk@anna.jacobs.jacobs-university.de>
User-Agent: Alpine 2.20 (DEB 67 2015-01-07)
Organization: People's Front Against WWW
MIME-Version: 1.0
Content-Type: text/plain; charset="US-ASCII"; format="flowed"
Archived-At: <https://mailarchive.ietf.org/arch/msg/netconf/QOa5C5ZfttcJ_ZscANulFatZZXQ>
Subject: Re: [netconf] Current activities on RESTCONF/NETCONF to support paging
X-BeenThere: netconf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NETCONF WG list <netconf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netconf>, <mailto:netconf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netconf/>
List-Post: <mailto:netconf@ietf.org>
List-Help: <mailto:netconf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netconf>, <mailto:netconf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 14 Mar 2019 09:41:35 -0000

On Thu, 14 Mar 2019, Juergen Schoenwaelder wrote:

> One of the issues to consider is that depending on the datastore
> accessed, the data can change more or less rapidly and it is unclear
> whether you want servers to maintain potentially big amounts of state
> between requests. If you retrieve data in chunks, the question is
> whether you can simply put the data back together or the client side
> or whether this may lead to data that never really existed in that
> form on the server. With RESTCONF, etags may help to check whether the
> resource queried remains consistent (but then the server still has to
> be able to decide etag changes).
>
> But backing up for this discussion of details, I agree that this is a
> problem worth solving by standardizing a common solution.

We have run into several use-cases where we'd like to be able to handle 
tens of millions of entries and still keep it declarative configuration 
and stay away from RPCs (which is what often is suggested).

Examples of these use-cases are AFTR binding tables (think huge NAT/tunnel 
box), DHCP servers (with millions of leases potentially also configured 
static leases) and DNS servers (tens of millions of DNS zones).

So yes, I fully support working on solving this problem-space.

-- 
Mikael Abrahamsson    email: swmike@swm.pp.se