Re: [TOOLS-DEVELOPMENT] Making SOWs accessible to a broader pool

Roman Danyliw <rdd@cert.org> Thu, 27 June 2019 01:47 UTC

Return-Path: <rdd@cert.org>
X-Original-To: tools-development@ietfa.amsl.com
Delivered-To: tools-development@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BE9BA1200C5 for <tools-development@ietfa.amsl.com>; Wed, 26 Jun 2019 18:47:45 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.999
X-Spam-Level:
X-Spam-Status: No, score=-1.999 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cert.org
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 1Pe2w8wJpMkl for <tools-development@ietfa.amsl.com>; Wed, 26 Jun 2019 18:47:43 -0700 (PDT)
Received: from veto.sei.cmu.edu (veto.sei.cmu.edu [147.72.252.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 6B20D12006B for <tools-development@ietf.org>; Wed, 26 Jun 2019 18:47:43 -0700 (PDT)
Received: from delp.sei.cmu.edu (delp.sei.cmu.edu [10.64.21.31]) by veto.sei.cmu.edu (8.14.7/8.14.7) with ESMTP id x5R1lbXZ023182; Wed, 26 Jun 2019 21:47:37 -0400
DKIM-Filter: OpenDKIM Filter v2.11.0 veto.sei.cmu.edu x5R1lbXZ023182
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cert.org; s=yc2bmwvrj62m; t=1561600057; bh=GhFmxOeP/rEIoiE5BsirmVzRBKcNAFfIxhWlERnO478=; h=From:To:CC:Subject:Date:References:In-Reply-To:From; b=FfiMODS7QToAo6y1WtUEh2NoSf0Mu0NPsLCWCDBdcsvWl3g5zRyD+3II3hfhXh07t ZsAdHVdGS9IXa7uuNV53TiUcYfAXqxHXd6hJDAK3dOKMoaB0mSBOzmqJCnUyiEbrBt Z/dtnNw9yXoJQdxeDr5Nmyq72M25mwol42gHyoFY=
Received: from CASSINA.ad.sei.cmu.edu (cassina.ad.sei.cmu.edu [10.64.28.249]) by delp.sei.cmu.edu (8.14.7/8.14.7) with ESMTP id x5R1lYst000965; Wed, 26 Jun 2019 21:47:34 -0400
Received: from MARATHON.ad.sei.cmu.edu ([10.64.28.250]) by CASSINA.ad.sei.cmu.edu ([10.64.28.249]) with mapi id 14.03.0439.000; Wed, 26 Jun 2019 21:47:34 -0400
From: Roman Danyliw <rdd@cert.org>
To: Alissa Cooper <alissa@cooperw.in>, IETF Tools Development <tools-development@ietf.org>
Thread-Topic: [TOOLS-DEVELOPMENT] Making SOWs accessible to a broader pool
Thread-Index: AQHVLF0Zf4vOS9E+e0eNkWk6akIJTaauck4A
Date: Thu, 27 Jun 2019 01:47:33 +0000
Message-ID: <359EC4B99E040048A7131E0F4E113AFC01B33AAC33@marathon>
References: <8EEB78FC-4F6A-40F5-8486-03B3F664BED3@cooperw.in>
In-Reply-To: <8EEB78FC-4F6A-40F5-8486-03B3F664BED3@cooperw.in>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [10.64.22.6]
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
Archived-At: <https://mailarchive.ietf.org/arch/msg/tools-development/MdxF7AsLCnzQoqfGwwj7FdytZdg>
Subject: Re: [TOOLS-DEVELOPMENT] Making SOWs accessible to a broader pool
X-BeenThere: tools-development@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Tools Development list server <tools-development.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tools-development>, <mailto:tools-development-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tools-development/>
List-Post: <mailto:tools-development@ietf.org>
List-Help: <mailto:tools-development-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-development>, <mailto:tools-development-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 27 Jun 2019 01:47:46 -0000

Hi!

I agree with Alissa's assessment about the lack of accessibility in the current text.  I only have a sample size of reading exactly one SOW (the Automatic Agenda Builder under discussion) so I can't frame my comments below relative to anything I've seen in the past.

IMO, someone without deep engagement with the IETF (infrastructure or community processes) would have a lot of trouble understanding what this SOW is about.  Could they figure it out, sure -- all of the information is there.  However, have we made it enticing enough that it's worth the effort -- that's my concern.  I don't have a sense of whether we're wading through too many bids and don't know how to down-select; or typically one or two best case.  To project the challenges from my day job, I'm guessing the latter.  Am I wrong?

I think the proposed boiler-plate area identified below are a good idea.

I don't know how applicable this feedback is beyond this SoW (as I said, I haven't seen the others) ...

** Per the Deliverables:
-- Is it assumed that it will be a waterfall delivery process? Or will there be sprints/incremental drops of functionality?
-- I would have expected more guidance on what tech stack the contractor MUST use (e.g., is the GUI supposed to be browser web app? Could the scheduling back-end be in COBOL/language not in our current stack)
-- are there deadlines for completion; a schedule to start

** Per the Contractor Instructions (also read for the first time), I was expecting to see language about:
-- an acceptance testing process -- the contractor says they are done, but how does the customer validate that it is done?
-- secure development lifecycle activities
-- documentation
-- guidance on end-user platform constraints (e.g., if it’s a web app, it should work on xx browsers)
-- POCs
-- packaging (e.g., rpm/deb scripts; container config)

** Swap the Objective and Deliverable sections.  The top-level overview in the Objective is a more gentle opening to the materials.

Again, the new guy so I'm not sure how much of this is old ground.

Roman

> -----Original Message-----
> From: TOOLS-DEVELOPMENT [mailto:tools-development-bounces@ietf.org]
> On Behalf Of Alissa Cooper
> Sent: Wednesday, June 26, 2019 4:24 PM
> To: IETF Tools Development <tools-development@ietf.org>
> Subject: [TOOLS-DEVELOPMENT] Making SOWs accessible to a broader pool
> 
> I’m wondering if there are some steps we could take to write our SOWs in
> such a way as to make them accessible and understandable to a broader
> pool of potential bidders. I’ve noticed that recent ones tend to use a lot of
> IETF-specific jargon and acronyms without explanation and assume
> significant familiarity with the existing infrastructure and code base. Might it
> be possible to develop some boilerplate text that could be re-used across
> datatracker-focused RFPs that provides an introduction to the IETF, an
> introduction to the project, a description of the technologies in use, and
> links to the source code and other relevant information?
> 
> Thanks,
> Alissa
> _______________________________________________
> TOOLS-DEVELOPMENT mailing list
> TOOLS-DEVELOPMENT@ietf.org
> https://www.ietf.org/mailman/listinfo/tools-development