[netmod] Re: Fwd: [onions] FW: New Version Notification for draft-cardona-claise-onion-yang-coverage-00.txt

Ladislav Lhotka <ladislav@lhotka.name> Tue, 16 September 2025 17:06 UTC

Return-Path: <ladislav@lhotka.name>
X-Original-To: netmod@mail2.ietf.org
Delivered-To: netmod@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id A864063BCDC6 for <netmod@mail2.ietf.org>; Tue, 16 Sep 2025 10:06:01 -0700 (PDT)
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -1.205
X-Spam-Level:
X-Spam-Status: No, score=-1.205 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, MIME_HTML_ONLY=0.1, MIME_HTML_ONLY_MULTI=0.001, MIME_QP_LONG_LINE=0.001, MPART_ALT_DIFF=0.79, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=no autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=lhotka.name header.b="Ie3t6kJs"; dkim=pass (2048-bit key) header.d=lhotka.name header.b="D5dG6a4i"
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id LwMlBeMfEYKI for <netmod@mail2.ietf.org>; Tue, 16 Sep 2025 10:06:00 -0700 (PDT)
Received: from trail.lhotka.name (trail.lhotka.name [77.48.224.143]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id E64AE63BCDB2 for <netmod@ietf.org>; Tue, 16 Sep 2025 10:05:59 -0700 (PDT)
Received: by trail.lhotka.name (Postfix, from userid 109) id A34B8860A55; Tue, 16 Sep 2025 19:05:52 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=lhotka.name; s=202504; t=1758042352; bh=xX2qt65fof7jqxPnMEELSRADOGgWWasIQ5qYt0rcNY4=; h=From:Subject:Date:References:Cc:In-Reply-To:To:From; b=Ie3t6kJsutwZW6DaA25cyylfEJ1OchPlGQKwGVFZyK/mnz4bxGKbcFiqOHfQEe3c+ AHiB0UjEQYZ974/sEkMB4FcmEg9GIjjW8+1oL0kWqX5GXF8dmcIaBX+NtvK0nuw6k4 IbDjhOjzX/qWL+2O1u4PQ9o4XNi4Op9ptDZ6Urc8uC+Tps745xd4cQ0xWcOzHnmJ1f 4Q7apqN3A0N5ZhMPfbLEGalgR3/wZntcX5ntu6+wNsjsnFwGqNmoK+20GzXgM7iill qv+zIDxVbmMNs9DPm6d59qnEhUX0KX9GFcFtTIGCHBl8ALai+R9MapuiNKDPhSGrTi zAfltnTDQA97g==
Received: from smtpclient.apple (ogg3tj.static.otenet.gr [94.71.88.39]) by trail.lhotka.name (Postfix) with ESMTPSA id E6FC3860175; Tue, 16 Sep 2025 19:05:50 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=lhotka.name; s=202504; t=1758042351; bh=xX2qt65fof7jqxPnMEELSRADOGgWWasIQ5qYt0rcNY4=; h=From:Subject:Date:References:Cc:In-Reply-To:To:From; b=D5dG6a4iby/WUeETyGCmmiyrTleVJcPvmepxNOpDThQT0avC46TIwJ1kYFSHjF/YZ RbGDLEWtIplORNGsxABP6Ak0I6zk4I2gmOFaqSOJdlvyPzngEmqbAefpiqmVW5Fd63 56vsicV2r7+33RC84XWV1zbNQ02gOj38urweitmO/HWAZWalnIu2zrQjSqHGEflKAE PFbHfrLfHTNClomZTELHU/SvONLGH/5W5M8mHiOxwGHmNpxVZmVXERdY3Vq8j9LKtI lBuAZV+P9b5SF+JowX9INmlH5fLr1a28JVixy6/unG0uDoGZMkT54sQcYYa29sjLvx oIVwsu+BGHVpg==
Content-Type: multipart/alternative; boundary="Apple-Mail-51F71103-C2B1-40F9-8FB7-F49BE9D51925"
Content-Transfer-Encoding: 7bit
From: Ladislav Lhotka <ladislav@lhotka.name>
Mime-Version: 1.0 (1.0)
Date: Tue, 16 Sep 2025 20:05:38 +0300
Message-Id: <112900FE-EA1B-4D6E-98D0-F3AC5C365E6C@lhotka.name>
References: <d04b3608-d683-4822-9ca6-952a90d68d57@everything-ops.net>
In-Reply-To: <d04b3608-d683-4822-9ca6-952a90d68d57@everything-ops.net>
To: benoit@everything-ops.net
X-Mailer: iPad Mail (22G100)
Message-ID-Hash: M6NN4W7YLHKXSFNYHTTLPUOXXBOTL5W6
X-Message-ID-Hash: M6NN4W7YLHKXSFNYHTTLPUOXXBOTL5W6
X-MailFrom: ladislav@lhotka.name
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-netmod.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: Working Group NETMOD <netmod@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [netmod] Re: Fwd: [onions] FW: New Version Notification for draft-cardona-claise-onion-yang-coverage-00.txt
List-Id: NETMOD WG list <netmod.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/netmod/U8FY-Z9lvS3gR89xjXCRNm6dqDE>
List-Archive: <https://mailarchive.ietf.org/arch/browse/netmod>
List-Help: <mailto:netmod-request@ietf.org?subject=help>
List-Owner: <mailto:netmod-owner@ietf.org>
List-Post: <mailto:netmod@ietf.org>
List-Subscribe: <mailto:netmod-join@ietf.org>
List-Unsubscribe: <mailto:netmod-leave@ietf.org>

Hi Benoit,

FWIW, yangson [1] allows for printing ascii tree with indicated coverage of each schema node by preceding validations, like this:
>>> print(dm.ascii_tree(no_types=True, val_count=True), end='')
+--rw example-2:bag {1}
   +--ro bar {1}
   +--rw baz? {0}
   +--rw foo# [number] {5}
      +--rw in-words? {5}
      +--rw number {5}
      +--rw prime? {3}

See [2] for details.

Cheers, Lada

PS. I have to acknowledge this was originally Kent’s idea.

Ladislav Lhotka
PGP Key ID: 0xB8F92B08A9F76C67

16. 9. 2025 v 10:48, benoit@everything-ops.net:

 FYI.

Regards, Camilo and Benoit


-------- Forwarded Message --------
Subject: [onions] FW: New Version Notification for draft-cardona-claise-onion-yang-coverage-00.txt
Date: Mon, 15 Sep 2025 12:21:09 -0500
From: Camilo Cardona <camilo@gin.ntt.net>
To: onions@ietf.org


Hello all,

While working on a large YANG module, we developed a prototype for a tool to measure how much of a module is “covered” by instance examples. In the process of thinking about how to share the tool more broadly, we started asking ourselves what would be needed to automate the process end-to-end.

This led us to write a draft, link below this email.
The document proposes:

- A way to consistently extract example instances from IETF documents.

- Validate those examples against the YANG modules they use.

- Calculate a coverage view of the module based on those examples.

The main goal of this is to end up with at least one tool that will be available to implement this process. Such a tool could help authors and reviewers improve the design of YANG models by making gaps in examples and coverage visible.

Although ONION is still taking shape, its focus YANG tooling made us think this would be the right place to start presenting the work and gathering feedback.

Comments, suggestions, and reactions are welcome.

Thanks,
Camilo

On 15/9/25, 12:17, "internet-drafts@ietf.org <mailto:internet-drafts@ietf.org>" <internet-drafts@ietf.org <mailto:internet-drafts@ietf.org>> wrote:


A new version of Internet-Draft
draft-cardona-claise-onion-yang-coverage-00.txt has been successfully
submitted by Camilo Cardona and posted to the
IETF repository.


Name: draft-cardona-claise-onion-yang-coverage
Revision: 00
Title: Guidelines for YANG Example Validation and Coverage Analysis in IETF Documents
Date: 2025-09-15
Group: Individual Submission
Pages: 12
URL: https://www.ietf.org/archive/id/draft-cardona-claise-onion-yang-coverage-00.txt" rel="nofollow">https://www.ietf.org/archive/id/draft-cardona-claise-onion-yang-coverage-00.txt https://www.ietf.org/archive/id/draft-cardona-claise-onion-yang-coverage-00.txt" rel="nofollow"><https://www.ietf.org/archive/id/draft-cardona-claise-onion-yang-coverage-00.txt>
Status: https://datatracker.ietf.org/doc/draft-cardona-claise-onion-yang-coverage/" rel="nofollow">https://datatracker.ietf.org/doc/draft-cardona-claise-onion-yang-coverage/ https://datatracker.ietf.org/doc/draft-cardona-claise-onion-yang-coverage/" rel="nofollow"><https://datatracker.ietf.org/doc/draft-cardona-claise-onion-yang-coverage/>
HTMLized: https://datatracker.ietf.org/doc/html/draft-cardona-claise-onion-yang-coverage" rel="nofollow">https://datatracker.ietf.org/doc/html/draft-cardona-claise-onion-yang-coverage https://datatracker.ietf.org/doc/html/draft-cardona-claise-onion-yang-coverage" rel="nofollow"><https://datatracker.ietf.org/doc/html/draft-cardona-claise-onion-yang-coverage>




Abstract:


This document defines guidelines for including YANG example instances
in IETF documents in a way that enables automatic extraction and
validation. It introduces the concept of YANG module "coverage" to
measure how thoroughly example instances exercise a YANG module's
data nodes. The goal is to improve the quality and usability of YANG
models in IETF documents by providing authors with tools to validate
their examples and assess coverage completeness.






The IETF Secretariat








_______________________________________________
onions mailing list -- onions@ietf.org
To unsubscribe send an email to onions-leave@ietf.org
_______________________________________________
netmod mailing list -- netmod@ietf.org
To unsubscribe send an email to netmod-leave@ietf.org