Re: [Tools-team] Web interface for feedback on candidates

Brian E Carpenter <brc@zurich.ibm.com> Fri, 03 March 2006 07:50 UTC

Received: from [127.0.0.1] (helo=stiedprmman1.va.neustar.com) by megatron.ietf.org with esmtp (Exim 4.43) id 1FF53K-0000bk-JH; Fri, 03 Mar 2006 02:50:18 -0500
Received: from [10.91.34.44] (helo=ietf-mx.ietf.org) by megatron.ietf.org with esmtp (Exim 4.43) id 1FF53I-0000Ww-OY; Fri, 03 Mar 2006 02:50:16 -0500
Received: from mtagate4.de.ibm.com ([195.212.29.153]) by ietf-mx.ietf.org with esmtp (Exim 4.43) id 1FF53G-0000vy-61; Fri, 03 Mar 2006 02:50:16 -0500
Received: from d12nrmr1607.megacenter.de.ibm.com (d12nrmr1607.megacenter.de.ibm.com [9.149.167.49]) by mtagate4.de.ibm.com (8.12.10/8.12.10) with ESMTP id k237oDVV201236; Fri, 3 Mar 2006 07:50:13 GMT
Received: from d12av01.megacenter.de.ibm.com (d12av01.megacenter.de.ibm.com [9.149.165.212]) by d12nrmr1607.megacenter.de.ibm.com (8.12.10/NCO/VER6.8) with ESMTP id k237oU7t024432; Fri, 3 Mar 2006 08:50:30 +0100
Received: from d12av01.megacenter.de.ibm.com (loopback [127.0.0.1]) by d12av01.megacenter.de.ibm.com (8.12.11/8.13.3) with ESMTP id k237oCpx016116; Fri, 3 Mar 2006 08:50:12 +0100
Received: from sihl.zurich.ibm.com (sihl.zurich.ibm.com [9.4.16.232]) by d12av01.megacenter.de.ibm.com (8.12.11/8.12.11) with ESMTP id k237oCGG016101; Fri, 3 Mar 2006 08:50:12 +0100
Received: from zurich.ibm.com (sig-9-145-132-49.de.ibm.com [9.145.132.49]) by sihl.zurich.ibm.com (AIX4.3/8.9.3p2/8.9.3) with ESMTP id IAA65096; Fri, 3 Mar 2006 08:50:11 +0100
Message-ID: <4407F531.1090106@zurich.ibm.com>
Date: Fri, 03 Mar 2006 08:50:09 +0100
From: Brian E Carpenter <brc@zurich.ibm.com>
Organization: IBM
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.6) Gecko/20040113
X-Accept-Language: en, fr, de
MIME-Version: 1.0
To: Henrik Levkowetz <henrik@levkowetz.com>
Subject: Re: [Tools-team] Web interface for feedback on candidates
References: <62173B970AE0A044AED8723C3BCF23810CF42AC7@ma19exm01.e6.bcs.mot.com> <44078EF4.8060504@levkowetz.com>
In-Reply-To: <44078EF4.8060504@levkowetz.com>
Content-Type: text/plain; charset=us-ascii; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Score: 0.0 (/)
X-Scan-Signature: 082a9cbf4d599f360ac7f815372a6a15
Cc: Eastlake III Donald-LDE008 <Donald.Eastlake@motorola.com>, tools-team@ietf.org, nomcom05@ietf.org
X-BeenThere: tools-team@ietf.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: "The purpose of the TOOLS team is to provide IETF feedback and guidance during the development of software tools to support various parts of IETF activities." <tools-team.ietf.org>
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www1.ietf.org/pipermail/tools-team>
List-Post: <mailto:tools-team@ietf.org>
List-Help: <mailto:tools-team-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=subscribe>
Errors-To: tools-team-bounces@ietf.org

Henrik,

The inability to see what one said is fundamentally annoying.
After I was caught by this on the first round of feedback,
I prepared all my comments on the second round in advance and
saved to disk; but I *still* wish I had the comments from the
first round. At the very least, they should be displayed
unencrypted for confirmation, with an explicit warning that
pressing the next button will render them into garbage.

It made the job much, much harder than in previous years and
makes it impossible to do intelligent follow up if something changes.

     Brian

Henrik Levkowetz wrote:
> Hi Donald,
> 
>   These are good points.  Together with the current and next nomcom
> chair I'll try to fix all of these except for the possibility of
> going back later to review what said.  This is not possible without 
> changing one fundamental characteristic of the system, which is that
> all comments are GPG encrypted with the nomcom public GPG key before
> being committed to disk in order to ensure that only nomcom will be
> able to read them.
> 
> Regards,
> 
> 	Henrik
> 
> on 2006-03-02 23:40 Eastlake III Donald-LDE008 said the following:
> 
>>Hi,
>>
>>I'd like to provide some feedback on the web interface tool for feedback to the nomcom on candidates, which I used to comment on INT AD candidates this past nomcom cycle. Due to the nature of this interface, I provided poorer feedback than I have with previous nomcoms.
>>
>>In the past, when asked for feedback on candidates, I've generally prepared one email message. The preparation of this email message has never been linear for me. Commenting on one candidate makes me think of things that I had not mentioned about other candidates. In some cases, I decide to go back and comment on some aspect of all of the names I have been presented with after mentioning this aspect on some later candidates in the list when I had not mentioned it on earlier ones in my first pass.
>>
>>I'm sure having the tool split out comments by candidate, which I assume it does, is more convenient for the nomcom than getting aggregate text messages. But, if I am any guide, the nomcom is getting nicely sorted but inferior quality feedback.
>>
>>At an absolute minimum, the tool should display text telling the person providing feedback that they might find it better to compose all of their comments separately as one document and then cut and paste from their to the web tool. But, in fact, it gives no such hint and just sucks your comments one at a time into a black hole giving no feedback on who you have already commented on or what your comments were or that your submission succeeded. So you can't even glance at your previous comments in preparing later ones. In fact, the almost total lack of user feedback from the tool initially gave me the impression that it wasn't working. I had no positive confirmation that comments were accepted nor any idea what would happen if I provided comments twice on the same candidate. Would later ones override earlier ones or would they just be appended? There was no way to tell. And, in fact, to this day, I have no actual evidence that my comments got through.
>>
>>The right design would provide a commenter with simultaneous entry fields for all those they have been asked to comment on, allow them to repeatedly edit the various comments on the various candidates until they thought they were good (which would be the normal characteristic of an HTML FORM with multiple entry fields), and then, after special confirmation by the commenter, send them to the nomcom with a clear success message back to the commenter both on the web page and via email including a copy of their comments. There must be a clear statement of what happens if you comment again later, which I assume should be to append your later comments to your earlier comments.
>>
>>If I'm presented with this interface in the future, I sure hope I'll remember separately compose one document commenting on all the candidates and them cut and paste from the document into the multiple web forms...
>>
>>Donald
>>
>> =========================================================
>> Donald E. Eastlake III       Donald.Eastlake@Motorola.com
>> Motorola Laboratories              +1-508-786-7554 (work)
>> 111 Locke Drive                    +1-508-634-2066 (home)
>> Marlboro, MA 01752 USA
>>
>>_______________________________________________
>>Tools-team mailing list
>>Tools-team@ietf.org
>>https://www1.ietf.org/mailman/listinfo/tools-team
>>
> 
> 


_______________________________________________
Tools-team mailing list
Tools-team@ietf.org
https://www1.ietf.org/mailman/listinfo/tools-team