Re: [Tools-discuss] Updated survey (was: Proposed survey on I-D authoring tools)

"Salz, Rich" <rsalz@akamai.com> Thu, 01 October 2020 19:19 UTC

Return-Path: <rsalz@akamai.com>
X-Original-To: tools-discuss@ietfa.amsl.com
Delivered-To: tools-discuss@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D0C863A0E60; Thu, 1 Oct 2020 12:19:48 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.299
X-Spam-Level:
X-Spam-Status: No, score=-3.299 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-1.2, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=akamai.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id yMHvNpqWOuII; Thu, 1 Oct 2020 12:19:46 -0700 (PDT)
Received: from mx0b-00190b01.pphosted.com (mx0b-00190b01.pphosted.com [IPv6:2620:100:9005:57f::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7F6003A0E5E; Thu, 1 Oct 2020 12:19:46 -0700 (PDT)
Received: from pps.filterd (m0050102.ppops.net [127.0.0.1]) by m0050102.ppops.net-00190b01. (8.16.0.42/8.16.0.42) with SMTP id 091JBMIM014748; Thu, 1 Oct 2020 20:19:44 +0100
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=akamai.com; h=from : to : subject : date : message-id : references : in-reply-to : content-type : content-id : content-transfer-encoding : mime-version; s=jan2016.eng; bh=tX/WfyB3GwpE1C5TKLGlTKUoPsvPAaCbht9n0kglqMY=; b=I6pjiMyoIYTvOMpwmRA+Knotv+6qWCuMrLeyYa68utX4SMtmKB8Sp3BeD2JFav/wjDe8 GxPWWbT4isa1JAS1a9dv1u/kQeImtEyBzNL4clrA5ZSEtCzHSDjcya0KjmDK7jLsPLGF adlSdqhha58+qZAezZXnTS1LFF4YFfN0gobJcHvCoAwqkSOcv3YoY19JA62RaRRnM7UJ lumTkhTBAodS56fK5GuyvNuDu4QdNGxGMSrCqXrj/urdFm8hnL9ZV6fAMSd1uziNWyyZ aNnCpTvaVkVym8jsXzyj9sCV75WAqqGNSNtdv36VoTeaNO2skHG6j6y+vUFFxYtUh/cZ oA==
Received: from prod-mail-ppoint7 (a72-247-45-33.deploy.static.akamaitechnologies.com [72.247.45.33] (may be forged)) by m0050102.ppops.net-00190b01. with ESMTP id 33stqq78qj-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 01 Oct 2020 20:19:44 +0100
Received: from pps.filterd (prod-mail-ppoint7.akamai.com [127.0.0.1]) by prod-mail-ppoint7.akamai.com (8.16.0.42/8.16.0.42) with SMTP id 091J5CtU005589; Thu, 1 Oct 2020 15:19:43 -0400
Received: from email.msg.corp.akamai.com ([172.27.123.31]) by prod-mail-ppoint7.akamai.com with ESMTP id 33t0yxvwe6-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Thu, 01 Oct 2020 15:19:43 -0400
Received: from USMA1EX-DAG1MB1.msg.corp.akamai.com (172.27.123.101) by usma1ex-dag1mb3.msg.corp.akamai.com (172.27.123.103) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Thu, 1 Oct 2020 15:19:42 -0400
Received: from USMA1EX-DAG1MB1.msg.corp.akamai.com ([172.27.123.101]) by usma1ex-dag1mb1.msg.corp.akamai.com ([172.27.123.101]) with mapi id 15.00.1497.006; Thu, 1 Oct 2020 15:19:42 -0400
From: "Salz, Rich" <rsalz@akamai.com>
To: Jay Daley <jay@ietf.org>, RFC Interest <rfc-interest@rfc-editor.org>, Tools Discussion <tools-discuss@ietf.org>
Thread-Topic: [Tools-discuss] Updated survey (was: Proposed survey on I-D authoring tools)
Thread-Index: AQHWmBWW1WHgz0i8SkSwLgPYTDy5RamDH3SA
Date: Thu, 1 Oct 2020 19:19:41 +0000
Message-ID: <AF96541D-F47A-4766-A80B-9FEEB8A8BC81@akamai.com>
References: <71CCD4C4-2CBA-4AD3-A254-2F19B261D882@ietf.org> <m2lfgqq2ww.wl-randy@psg.com> <1071F4D3-3F36-4012-9CBB-19DDDE6D0564@ietf.org> <m2h7req25a.wl-randy@psg.com> <9F1ABBE7-DC90-4C3C-8493-E89243C73C4C@ietf.org> <m24knepwg4.wl-randy@psg.com> <A62BA403-01EC-4142-A91C-6E675C1E1942@ietf.org> <19017.1601561002@localhost> <4B2B4A68-AC82-4455-A9D1-30F3789038F9@ietf.org> <68CF84A2-7B5F-42A4-B4B7-B68C875591FA@tzi.org> <6F989ED3-4CD5-4E46-A410-965DA76E3F58@ietf.org> <E909F63E-F780-4171-B88D-D094EAC233CF@ietf.org>
In-Reply-To: <E909F63E-F780-4171-B88D-D094EAC233CF@ietf.org>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/16.40.20081201
x-ms-exchange-messagesentrepresentingtype: 1
x-ms-exchange-transport-fromentityheader: Hosted
x-originating-ip: [172.27.118.139]
Content-Type: text/plain; charset="utf-8"
Content-ID: <3374DAE34EAA4D4BB7A96C4A45B8D862@akamai.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.235, 18.0.687 definitions=2020-10-01_07:2020-10-01, 2020-10-01 signatures=0
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 mlxscore=0 bulkscore=0 mlxlogscore=999 phishscore=0 adultscore=0 spamscore=0 suspectscore=0 malwarescore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2006250000 definitions=main-2010010154
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.235, 18.0.687 definitions=2020-10-01_07:2020-10-01, 2020-10-01 signatures=0
Archived-At: <https://mailarchive.ietf.org/arch/msg/tools-discuss/1xokic9D3JJxU0S4nBFc3sxo8-w>
Subject: Re: [Tools-discuss] Updated survey (was: Proposed survey on I-D authoring tools)
X-BeenThere: tools-discuss@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF Tools Discussion <tools-discuss.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tools-discuss>, <mailto:tools-discuss-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tools-discuss/>
List-Post: <mailto:tools-discuss@ietf.org>
List-Help: <mailto:tools-discuss-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-discuss>, <mailto:tools-discuss-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 01 Oct 2020 19:19:49 -0000

I think it will be useful to know this kind of stuff, and folks must recognize it's a "point in time" status.

I worry about how long it will take to do the survey, but c'est la vie.

On 10/1/20, 1:09 PM, "Jay Daley" <jay@ietf.org> wrote:

    The updated survey is below.  Please note that 

    - this doesn’t show the links
    - I am still not sure how to point people to their Datatracker stats page
    - the flow logic may change when the survey is tested.

    Further feedback is most welcome.

    Jay

    # Question Plan

    [PAGE] 
    Introduction

    [HELPTEXT]
    Thank you for taking part in this survey.  This survey has been sent to everyone who has authored an Internet-Draft (I-D) in the last five years and is open to anyone who has ever authored an I-D.

    We are hoping to understand what formats and tools you use to author I-Ds, from drafting to submission.

    In particular, we are hoping to find out more about the use (or non-use) of the v3 XML format for I-Ds, which became the publication format for RFCs on 16 September 2019.

    [QUESTION - Multiple Choice]
    Approximately, how many I-Ds have you authored in total (different I-Ds not versions of the same I-D)?
    If you need a reminder then your Datatracker page will have the details. 
    	• 0
    	• 1-5
    	• 6-10
    	• 11-20
    	• 21-50
    	• 51+

    [QUESTION - Matrix/Rating Scale]
    Approximately, how many times have you submitted a draft (both a new draft and a new version) to the Datatracker?
    Items
    	• 0
    	• 1-10
    	• 11-20
    	• 21-50
    	• 50-100
    	• 101+
    Scale
    	• In total
    	• Last 2 years (Since September 2018)
    	• Last year (since September 2019)

    [QUESTION - Multiple Choice]
    How many RFCs have you authored?
    	• 0
    	• 1-5
    	• 6-10
    	• 11-20
    	• 21-50
    	• 51+


    [PAGE]
    Drafting to submission

    [LOGIC]
    Only get here if they have authored an I-D.

    [QUESTION - Matrix/Rating Scale]
    How often have you used the following document format(s) and associated output process(es) (editor/template/converter) when authoring an I-D? (Ignore any you don’t know about)
    Items
    	• Plain text using no markup
    	• Plain text using a different output process
    	• Markdown using the kramdown-rfc2629 converter
    	• Markdown using the mmark converter
    	• Markdown using the draftr converter
    	• Markdown using the Pandoc2rfc converter
    	• Markdown using a different output process
    	• XML using the xml2rfc-xxe editor plugin
    	• XML using xml2rfc to create plain text for submission
    	• XML using a different output process
    	• AsciiDoc using the metanorma-ietf (formerly known as asciidoctor-rfc) converter
    	• AsciiDoc using a different output process
    	• TeX / LaTeX using the lyx2rfc editor plugin
    	• TeX / LaTeX using a different output process
    	• nroff using the Nroff Edit editor
    	• nroff using nroff2xml template
    	• nroff using a different output process
    	• .doc/.docx using Joe Touch’s Word Template (RFC5385)
    	• .doc/.docx using a different output process (This means specifically using rich text styles that a template/convertor will recognise)
    	• Other format (Only use this option if you author in a different format to all of those above) [PLEASE SPECIFY what format you author in and what output process you use]
    Scale
    	• Always
    	• Very often
    	• Sometimes
    	• Rarely
    	• Never [Ensure this is scored as 0]

    [QUESTION - Comment Box]
    If you answered “a different output process” in the question above then please specify what it is?

    [QUESTION - Checkboxes]
    How did you choose the document format(s) and associated output process(es) that you use? (Check all that apply)
    	• I researched the tools
    	• I decided on my authoring format first and then chose a tool that uses that
    	• I saw a presentation on one of the tools at an IETF meeting
    	• Another author of my document chose for me
    	• The I-D I wanted to contribute to was already drafted in one of these tools
    	• Someone else helped me set up my tools
    	• Other [PLEASE SPECIFY]

    [QUESTION - Matrix/Rating Scale]
    How often have you used the following template(s) when drafting an I-D? (Ignore any you don’t know about)
    Items
    	• A copy of a previous I-D / RFC
    	• A template from https://urldefense.proofpoint.com/v2/url?u=https-3A__tools.ietf.org_tools_templates_&d=DwIGaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=4LM0GbR0h9Fvx86FtsKI-w&m=xVHNxz6VGHMvSCNgEu_8tuBVqta0NSRyqdqKWHi40mo&s=DSnQGm6Hyl9_OfYe6k4icoHs57aG-7m1z883qZRIVYM&e=  
    	• A template that came with my chosen authoring tool/process
    	• My own
    	• Other [PLEASE SPECIFY]
    Scale
    	• Always
    	• Very often
    	• Sometimes
    	• Rarely
    	• Never [Ensure this is scored as 0]

    [QUESTION - Matrix/Rating Scale]
    How often do you use the following checking tools? (Ignore any you don’t know about)
    Items
    	• I validate against the RelaxNG schema for the RFC XML in my XML editor 
    	• Bill’s ABNF parser to check ABNF
    	• idnits to check a draft before submission 
    	• idspell to check a draft for spelling errors
    	• pyang to check YANG modules
    	• RFC dependency checker
    	• rfcdiff to find diffs between versions of drafts
    	• SMICng to check MIBs
    	• smilint to check MIBs
    	• svgcheck to check a draft for SVG schema compliance 
    	• xml2rfc validator to validate RFC XML
    	• YANG validator to check YANG modules
    Scale
    	• Always
    	• Very often
    	• Sometimes
    	• Rarely
    	• Never [Ensure this is scored as 0]

    [QUESTION - Matrix/Rating Scale]
    How often do you use the following conversion tools? (Ignore any you don’t know about)
    Items
    	• bibtext2rfc to convert bibtext citations into bibxml references
    	• bibxml2md to convert bibxml references into markdown
    	• Doublespace tool to change spacing between sentences to two spaces
    	• id2xml to convert a plain text I-D into XML
    	• rfc2629xslt to convert RFC XML to another format
    	• xml2rfc to convert RFC XML to another format
    Scale
    	• Always
    	• Very often
    	• Sometimes
    	• Rarely
    	• Never [Ensure this is scored as 0]

    [QUESTION - Checkboxes]
    How do you run your tools? (Check all that apply)
    	• Locally
    	• On a private hosted server
    	• On an IETF public web service
    	• On a third-party public web service 
    	• Other [PLEASE SPECIFY]

    [QUESTION - Multiple Choice]
    Do you run an automated build process?
    	• Yes - I-D Template
    	• Yes - Using GitHub CI/CD
    	• Yes - Using Gitlab CI/CD
    	• Yes - Using Jenkins
    	• Yes - Using CircleCI
    	• Yes - Other [PLEASE SPECIFY]
    	• No


    [PAGE]
    XML v3

    [QUESTION - Multiple Choice]
    How do you rate your knowledge of the v3 official RFC/I-D XML format?
    	• Excellent
    	• Good
    	• Fair
    	• Poor
    	• None

    [QUESTION - Matrix/Rating Scale]
    How satisfied are you with the following characteristics of the v3 XML format?
    Items
    	• Ease of use
    	• Features
    	• Documentation
    	• Tools support
    	• Other [PLEASE SPECIFY]
    Scale
    	• Very satisfied
    	• Satisfied
    	• Neutral
    	• Dissatisfied
    	• Very dissatisfied
    	• N/A

    [QUESTION - Matrix/Rating Scale]
    How important are the following characteristics of the v3 XML format to you?
    Items
    	• Ease of use
    	• Features
    	• Documentation
    	• Tools support
    	• Other [PLEASE SPECIFY]
    Scale
    	• Very important
    	• Important
    	• Neutral
    	• Unimportant
    	• Very unimportant
    	• N/A

    [QUESTION - Comment Box]
    What more needs to be done to support the rollout of the v3 XML format?


    [PAGE]
    State of the current authoring tools landscape

    [QUESTION - Matrix/Rating Scale]
    How satisfied are you with the following characteristics of authoring tools?
    Items
    	• Ease of use
    	• Integration with IETF processes
    	• Support for the full range of tags / metadata
    	• Control of output
    	• Support of various output formats
    	• Integration with version control systems
    	• Speed at which new features are added
    	• Overall quality
    	• Choice of different tools
    	• Other [PLEASE SPECIFY]
    Scale
    	• Very satisfied
    	• Satisfied
    	• Neutral
    	• Dissatisfied
    	• Very dissatisfied
    	• N/A

    [QUESTION - Matrix/Rating Scale]
    How Important are the following characteristics of authoring tools to you?
    Items
    	• Ease of use
    	• Integration with IETF processes
    	• Support for the full range of tags / metadata
    	• Control of output
    	• Support of various output formats
    	• Integration with version control systems
    	• Speed at which new features are added
    	• Overall quality
    	• Choice of different tools
    	• Other [PLEASE SPECIFY]
    Scale
    	• Very important
    	• Important
    	• Neutral
    	• Not important
    	• Not at all important
    	• N/A

    [QUESTION - Multiple Choice]
    Should the IETF invest in a new, modern toolchain for authoring drafts?
    	• Strongly agree
    	• Agree
    	• Neutral
    	• Disagree
    	• Strongly disagree

    [QUESTION - Matrix/Rating Scale]
    How important is it for you for any new tool to support the following authoring formats? 
    Items
    	• Plain text
    	• Markdown
    	• XML
    	• nroff
    	• AsciiDoc
    	• Some form of WYSIWYG (e.g. MS Word or LibreOffice)
    	• Other [PLEASE SPECIFY]
    Scale
    	• Very important
    	• Important
    	• Neutral
    	• Not important
    	• Not at all important
    	• N/A

    [QUESTION - Comment Box]
    Do you have any more feedback on authoring tools and formats?

    -- 
    Jay Daley
    IETF Executive Director
    jay@ietf.org

    ___________________________________________________________
    Tools-discuss mailing list
    Tools-discuss@ietf.org
    https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ietf.org_mailman_listinfo_tools-2Ddiscuss&d=DwIGaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=4LM0GbR0h9Fvx86FtsKI-w&m=xVHNxz6VGHMvSCNgEu_8tuBVqta0NSRyqdqKWHi40mo&s=IClP4a41N1JspVd_SfEh2fZUdJ0sZGo86bjQaPPWsfE&e= 

    Please report datatracker.ietf.org and mailarchive.ietf.org
    bugs at https://urldefense.proofpoint.com/v2/url?u=http-3A__tools.ietf.org_tools_ietfdb&d=DwIGaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=4LM0GbR0h9Fvx86FtsKI-w&m=xVHNxz6VGHMvSCNgEu_8tuBVqta0NSRyqdqKWHi40mo&s=i5rznLdvxJkg5w8D-bVLZ8y7-yi7o2X3opal9vPIlOE&e= 
    or send email to datatracker-project@ietf.org

    Please report tools.ietf.org bugs at
    https://urldefense.proofpoint.com/v2/url?u=http-3A__tools.ietf.org_tools_issues&d=DwIGaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=4LM0GbR0h9Fvx86FtsKI-w&m=xVHNxz6VGHMvSCNgEu_8tuBVqta0NSRyqdqKWHi40mo&s=63Mz1exu5UWe_yZecJIBR0XSFuZeFruwNhEjH8PjKbM&e= 
    or send email to webmaster@tools.ietf.org