Re: [yang-doctors] automating yang doctor reviews

Kent Watsen <kwatsen@juniper.net> Tue, 24 April 2018 20:07 UTC

Return-Path: <kwatsen@juniper.net>
X-Original-To: yang-doctors@ietfa.amsl.com
Delivered-To: yang-doctors@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D28B412D940 for <yang-doctors@ietfa.amsl.com>; Tue, 24 Apr 2018 13:07:35 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.7
X-Spam-Level:
X-Spam-Status: No, score=-2.7 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=juniper.net
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qxmr1U4E7Ws5 for <yang-doctors@ietfa.amsl.com>; Tue, 24 Apr 2018 13:07:33 -0700 (PDT)
Received: from mx0a-00273201.pphosted.com (mx0a-00273201.pphosted.com [208.84.65.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id C924212D87C for <yang-doctors@ietf.org>; Tue, 24 Apr 2018 13:07:33 -0700 (PDT)
Received: from pps.filterd (m0108158.ppops.net [127.0.0.1]) by mx0a-00273201.pphosted.com (8.16.0.22/8.16.0.22) with SMTP id w3OJZCDs025691; Tue, 24 Apr 2018 12:36:09 -0700
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=PPS1017; bh=RekrUtbsajI93qOBPaz29TugHgi67PaASC05suAUx5Y=; b=GoT3XKEABY/Z1HurCUh7B11VHm1l/nhH2cg6RQRi8AGeA/+8H07QF4bnFq+7NR4dlbLC M6klISW2X5FRSK/H921oyriYjVR/wRtJsaPoF0KeImmkxXAOSTlb/f+j/Giw7ySiD0sY l+dfOSk0jUtfBUa+Kl6W9y7ui4rSHHlXQytxiOin4XkZlpYyAo7qFLcToRb+q25pGUSN O0JYdY89wK/vojxSzkmFHdZ2PgAEVtfToOhg6WEW5938Xjfkqq9FTeAvP8SaYD6GJEOl Fp7G9xDy7RIS7SABBZFng4Q56h6jsN6iKS6LkmntbfwEpALP8Sq3Gxu2JIbAaHPmVjRT Aw==
Received: from nam02-bl2-obe.outbound.protection.outlook.com (mail-bl2nam02lp0081.outbound.protection.outlook.com [207.46.163.81]) by mx0a-00273201.pphosted.com with ESMTP id 2hj93mr73h-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Tue, 24 Apr 2018 12:36:09 -0700
Received: from DM5PR05MB3484.namprd05.prod.outlook.com (10.174.240.147) by DM5PR05MB2924.namprd05.prod.outlook.com (10.168.176.136) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.715.13; Tue, 24 Apr 2018 19:36:07 +0000
Received: from DM5PR05MB3484.namprd05.prod.outlook.com ([fe80::173:36cf:42b7:5965]) by DM5PR05MB3484.namprd05.prod.outlook.com ([fe80::173:36cf:42b7:5965%6]) with mapi id 15.20.0715.015; Tue, 24 Apr 2018 19:36:07 +0000
From: Kent Watsen <kwatsen@juniper.net>
To: Andy Bierman <andy@yumaworks.com>
CC: "yang-doctors@ietf.org" <yang-doctors@ietf.org>
Thread-Topic: [yang-doctors] automating yang doctor reviews
Thread-Index: AQHT2zKO/z8cMyy250C9E9+CDPU0IaQO1pmAgAE27QA=
Date: Tue, 24 Apr 2018 19:36:07 +0000
Message-ID: <8D1A39C4-A910-43CB-AC60-3743E110DF32@juniper.net>
References: <51E10A3A-FF6F-4A14-AAD6-BBD12041EF2F@juniper.net> <CABCOCHS5nf+z5ABnuWfbV15qi5pVGNVFWMLm6Oi6KkCjkbX+Nw@mail.gmail.com>
In-Reply-To: <CABCOCHS5nf+z5ABnuWfbV15qi5pVGNVFWMLm6Oi6KkCjkbX+Nw@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/f.20.0.170309
x-originating-ip: [66.129.241.14]
x-ms-publictraffictype: Email
x-microsoft-exchange-diagnostics: 1; DM5PR05MB2924; 7:GU5O3lS24VemA1smq761/ISmBDABZYUNt3saysudIkUjPhjyVk8K/2qLU8h67890mNKBHtGjWPp3QYyx/X8Oy/uVu3S8NDQAoqWgodVaqbJXkcZk0pCUZEUeh92KIWQLad+unrepUWRfqY70/G7tk9SUiBxVOoLBrcARjqXEPp3JQVFw0l1D+tIsTk0oO8ItZD/Qy1LqrTDM2iMpNIA8zs02urNmAFhCUUuHqU53uBxFJMob/mXSzpzF7PpV4+P7
x-ms-exchange-antispam-srfa-diagnostics: SOS;
x-ms-office365-filtering-ht: Tenant
x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(48565401081)(5600026)(4534165)(4627221)(201703031133081)(201702281549075)(2017052603328)(7153060)(7193020); SRVR:DM5PR05MB2924;
x-ms-traffictypediagnostic: DM5PR05MB2924:
x-microsoft-antispam-prvs: <DM5PR05MB2924266DE31E2C84FD015B50A5880@DM5PR05MB2924.namprd05.prod.outlook.com>
x-exchange-antispam-report-test: UriScan:(28532068793085)(21748063052155)(17755550239193);
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(8211001083)(6040522)(2401047)(5005006)(8121501046)(10201501046)(93006095)(93001095)(3002001)(3231232)(944501410)(52105095)(6055026)(6041310)(20161123562045)(20161123558120)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123560045)(20161123564045)(6072148)(201708071742011); SRVR:DM5PR05MB2924; BCL:0; PCL:0; RULEID:; SRVR:DM5PR05MB2924;
x-forefront-prvs: 0652EA5565
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(346002)(39380400002)(39860400002)(376002)(396003)(366004)(189003)(199004)(68736007)(2900100001)(106356001)(105586002)(82746002)(6436002)(3660700001)(2906002)(6916009)(8936002)(97736004)(33656002)(8676002)(81156014)(81166006)(7736002)(3280700002)(229853002)(9326002)(3846002)(6116002)(6486002)(6306002)(6246003)(476003)(2616005)(53936002)(6512007)(58126008)(316002)(54896002)(4326008)(83716003)(446003)(11346002)(486006)(478600001)(99286004)(102836004)(5250100002)(59450400001)(76176011)(6506007)(25786009)(26005)(186003)(66066001)(86362001)(5660300001)(36756003)(14454004); DIR:OUT; SFP:1102; SCL:1; SRVR:DM5PR05MB2924; H:DM5PR05MB3484.namprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: juniper.net does not designate permitted sender hosts)
x-microsoft-antispam-message-info: qtWS8n8Hv37jwgAm04PXhwJwwaKjV4Ie9Bqb0Ks/OUaOgADRnw4kUl4wbtB/PKmgfQlfVk8hoToV7oOwlKdA4PTwFliYfcZKtc2kgMHTGQq/nbxS/KrRuxXhZPcK2t8g6qVYtN1Kjjgx+Jlfj3Oz+1GaX7Deb0/WlFZjx1X9rcchFzpHLkW4f0E5dB4IrGJq
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/alternative; boundary="_000_8D1A39C4A91043CBAC603743E110DF32junipernet_"
MIME-Version: 1.0
X-MS-Office365-Filtering-Correlation-Id: f282567f-767e-4d2b-3343-08d5aa1aa00f
X-OriginatorOrg: juniper.net
X-MS-Exchange-CrossTenant-Network-Message-Id: f282567f-767e-4d2b-3343-08d5aa1aa00f
X-MS-Exchange-CrossTenant-originalarrivaltime: 24 Apr 2018 19:36:07.3475 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM5PR05MB2924
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2018-04-24_05:, , signatures=0
X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=707 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1711220000 definitions=main-1804240186
Archived-At: <https://mailarchive.ietf.org/arch/msg/yang-doctors/Se-V4V-sU8y5X8Xh14Ca4oTWE_4>
Subject: Re: [yang-doctors] automating yang doctor reviews
X-BeenThere: yang-doctors@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Email list of the yang-doctors directorate <yang-doctors.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/yang-doctors>, <mailto:yang-doctors-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/yang-doctors/>
List-Post: <mailto:yang-doctors@ietf.org>
List-Help: <mailto:yang-doctors-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/yang-doctors>, <mailto:yang-doctors-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 24 Apr 2018 20:07:36 -0000


Hi Andy,

> The draft is not fully-specified for features like validation of examples.
> This might be difficult to automate.

The draft intends to support the validation of examples (see Section 6.2), which would presumably be encoded inside XML2RFC's  <sourcecode> element.   I agree that the current text is weak, is this what you mean by "not fully-specified"?

> Validation of YANG trees seems like a complex exercise.
> Automatic generation of tree diagrams would be a great feature.

Correct, the draft avoids trying to *validate* tree-diagrams by instead focusing on enabling the tree-diagrams to be generated (see the "gen" attribute defined in Section 6.1)

> Andy

Kent