Re: [netconf] restconf collections

Kent Watsen <kent+ietf@watsen.net> Sat, 26 September 2020 18:57 UTC

Return-Path: <01000174cbc7532c-81a16bed-e752-4e61-9a97-dfc95be744b5-000000@amazonses.watsen.net>
X-Original-To: netconf@ietfa.amsl.com
Delivered-To: netconf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 910C43A03C9 for <netconf@ietfa.amsl.com>; Sat, 26 Sep 2020 11:57:54 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.894
X-Spam-Level:
X-Spam-Status: No, score=-1.894 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=amazonses.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id TfIGK4o6DzKR for <netconf@ietfa.amsl.com>; Sat, 26 Sep 2020 11:57:53 -0700 (PDT)
Received: from a48-92.smtp-out.amazonses.com (a48-92.smtp-out.amazonses.com [54.240.48.92]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2FEBE3A0317 for <netconf@ietf.org>; Sat, 26 Sep 2020 11:57:53 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=224i4yxa5dv7c2xz3womw6peuasteono; d=amazonses.com; t=1601146672; h=From:Message-Id:Content-Type:Mime-Version:Subject:Date:In-Reply-To:Cc:To:References:Feedback-ID; bh=DpIKh0e/f0rcysCoeCBLKTgF/J7FydeNwsOI8sysK94=; b=CbFaLNoKacELU0kR7CFMT7k7djJCZi6BdrAuZS3qnKPgjGQ7+Jrkc5Qc633j8ngy O+Nh+DaTjgFg82ETVtuJlLeh899TNY6gm+nmZNwkTSXI8kA/0ADa2jDKEUHUXqnKYnI FKzExaV072RVZ+Y1w1+ZRxzTUpOI0Ahup3JooydI=
From: Kent Watsen <kent+ietf@watsen.net>
Message-ID: <01000174cbc7532c-81a16bed-e752-4e61-9a97-dfc95be744b5-000000@email.amazonses.com>
Content-Type: multipart/alternative; boundary="Apple-Mail=_3877FE33-0692-4B20-9219-E5823051AAB4"
Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.80.23.2.2\))
Date: Sat, 26 Sep 2020 18:57:51 +0000
In-Reply-To: <CABCOCHRzK8658NuwH4rBrmUg-T1KFWA0nZ2RJf_Kd9Q0TFka0g@mail.gmail.com>
Cc: "netconf@ietf.org" <netconf@ietf.org>
To: Andy Bierman <andy@yumaworks.com>
References: <B8F9A780D330094D99AF023C5877DABAADA1006E@dggeml511-mbs.china.huawei.com> <01000174cb6ea9ee-d7716c10-a691-4a97-9e99-022e4c0ef55a-000000@email.amazonses.com> <CABCOCHRzK8658NuwH4rBrmUg-T1KFWA0nZ2RJf_Kd9Q0TFka0g@mail.gmail.com>
X-Mailer: Apple Mail (2.3608.80.23.2.2)
X-SES-Outgoing: 2020.09.26-54.240.48.92
Feedback-ID: 1.us-east-1.DKmIRZFhhsBhtmFMNikgwZUWVrODEw9qVcPhqJEI2DA=:AmazonSES
Archived-At: <https://mailarchive.ietf.org/arch/msg/netconf/20w7S6JqRWUY_gJmNKbM7zxkbp4>
Subject: Re: [netconf] restconf collections
X-BeenThere: netconf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: NETCONF WG list <netconf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/netconf>, <mailto:netconf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netconf/>
List-Post: <mailto:netconf@ietf.org>
List-Help: <mailto:netconf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/netconf>, <mailto:netconf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 26 Sep 2020 18:57:54 -0000

> The <get-bulk> operation is not stateful.
>  http://www.netconfcentral.org/modulereport/yumaworks-getbulk <http://www.netconfcentral.org/modulereport/yumaworks-getbulk>
This RPC is effectively 1-1 with RC query params approach being discussed.  I like it.

The “count” param is like “limit”, and “list-test” is like a “where”.

One difference is that <get-bulk> uses "last-keys” instead of an integral “offset”.   Any thoughts about the pros and cons?  I imagine performance depends on the backend database used.  For instance, SQL supports “offset” so, to support "last-keys” instead would entail a first query to determine the offset for a key.

Missing is a “sort”.  That said, of the four params mentioned (limit, offset, where, sort), it might be least important.  At least, a general sort is…and then there is the nasty issue of sorting a user-sorted list.  A likely must-have fallback would be “direction” so, e.g., queries return the most-recent (not the oldest) entires in a time-series list (e.g., a log).  A “direction” parameter would also work well on a user-sorted list.


> There are 3 completely different approaches:
> 
>   1) stateless
>   2) stateful
>   3) stateful snapshot
> 
> How to efficiently iterate through data that is changing constantly?
> This problem is harder than it looks.

Agreed.  I recommend we NOT try to solve that problem.


K.