Re: [Manycouches] [Daniel Kahn Gillmor] [Tools-discuss] polls "show of hands": can we include a "i don't understand" or "not enough information" option

Stephen Farrell <stephen.farrell@cs.tcd.ie> Thu, 19 November 2020 23:48 UTC

Return-Path: <stephen.farrell@cs.tcd.ie>
X-Original-To: manycouches@ietfa.amsl.com
Delivered-To: manycouches@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4034D3A1965 for <manycouches@ietfa.amsl.com>; Thu, 19 Nov 2020 15:48:51 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2
X-Spam-Level:
X-Spam-Status: No, score=-2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, NICE_REPLY_A=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cs.tcd.ie
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Gb2COFSXTrwk for <manycouches@ietfa.amsl.com>; Thu, 19 Nov 2020 15:48:49 -0800 (PST)
Received: from mercury.scss.tcd.ie (mercury.scss.tcd.ie [134.226.56.6]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 9774F3A13F2 for <manycouches@ietf.org>; Thu, 19 Nov 2020 15:48:04 -0800 (PST)
Received: from localhost (localhost [127.0.0.1]) by mercury.scss.tcd.ie (Postfix) with ESMTP id 37C29BE7B; Thu, 19 Nov 2020 23:48:03 +0000 (GMT)
X-Virus-Scanned: Debian amavisd-new at scss.tcd.ie
Received: from mercury.scss.tcd.ie ([127.0.0.1]) by localhost (mercury.scss.tcd.ie [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YH4s-aLq3YjQ; Thu, 19 Nov 2020 23:48:01 +0000 (GMT)
Received: from [10.244.2.119] (95-45-153-252-dynamic.agg2.phb.bdt-fng.eircom.net [95.45.153.252]) by mercury.scss.tcd.ie (Postfix) with ESMTPSA id B2F31BE74; Thu, 19 Nov 2020 23:48:00 +0000 (GMT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cs.tcd.ie; s=mail; t=1605829680; bh=v5UEGFL8MqwNRfijvMI+w2TSjjkEh+Fq0WtRWEJkUrI=; h=Subject:To:Cc:References:From:Date:In-Reply-To:From; b=FMVdZliraaXbgDdM6gaVIKWLc7l7WDJQXH2JBR7sxrTe0wcM8tKt7ZnSewbN6bdtK nEq4DZlhDxMoYTkUrmKTBN/lwgNA8cdhgxfRshyLltq+8ixTEZ7zPdyzdU5qh4HAJG tohFnU0G3tt+m7q4P1RkXqbH4V4a51y7plSTGS9Q=
To: Martin Duke <martin.h.duke@gmail.com>, Daniel Kahn Gillmor <dkg@fifthhorseman.net>, manycouches@ietf.org
Cc: shmoo@ietf.org, ietf@meetecho.com, Eric Rescorla <ekr@rtfm.com>
References: <87ima2bkgb.fsf@fifthhorseman.net> <87sg959sdg.fsf@fifthhorseman.net> <CAM4esxTD3yyVSnZ1FWGQVsf6rK7dDA9o0Ezv3D4D9rtLUZ9TTg@mail.gmail.com>
From: Stephen Farrell <stephen.farrell@cs.tcd.ie>
Message-ID: <969ced6f-b697-8e2e-4e82-cc8f3d56c7f1@cs.tcd.ie>
Date: Thu, 19 Nov 2020 23:47:59 +0000
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.3.2
MIME-Version: 1.0
In-Reply-To: <CAM4esxTD3yyVSnZ1FWGQVsf6rK7dDA9o0Ezv3D4D9rtLUZ9TTg@mail.gmail.com>
Content-Type: multipart/signed; micalg="pgp-sha256"; protocol="application/pgp-signature"; boundary="dXE91fAIj62lA26LVN1Jb9kwQRcFldaS2"
Archived-At: <https://mailarchive.ietf.org/arch/msg/manycouches/j8fsvgq6PIMEDK9MNhl9jTNXUFw>
Subject: Re: [Manycouches] [Daniel Kahn Gillmor] [Tools-discuss] polls "show of hands": can we include a "i don't understand" or "not enough information" option
X-BeenThere: manycouches@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "List is a design team list to identify issues that would arise should an IETF meeting ever be held with O\(1000\) 'remote' participants." <manycouches.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/manycouches>, <mailto:manycouches-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/manycouches/>
List-Post: <mailto:manycouches@ietf.org>
List-Help: <mailto:manycouches-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/manycouches>, <mailto:manycouches-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 19 Nov 2020 23:48:56 -0000

Riffing on that:

It's traditional at BoFs to question the question. I
missed that this time. Offering a time for that to
happen, and for the session chairs to edit the question
is, I think, important.

I'd also argue for a "wrong question" answer option
regardless of the above and I bet it'd win a load of
times:-)

S.

On 19/11/2020 23:20, Martin Duke wrote:
> [adding manycouches, because cuz there's no shmoo@ list]
> 
> Hi dkg,
> 
> Thanks for the input!
> 
> We consciously decided to implement a bare-bones version of this tool, to
> gather just this kind of feedback, before prioritizing enhancements. We
> (meaning the IESG committee handling remote meeting issues) will definitely
> consider this as a next step.
> 
> I filed a tracking issue for this in the document github:
> https://github.com/martinduke/draft-duke-shmoo-virtual-hum/issues/3
> 
> Martin
> 
> On Thu, Nov 19, 2020 at 2:57 PM Daniel Kahn Gillmor <dkg@fifthhorseman.net>
> wrote:
> 
>> hi shmoo folks--
>>
>> (not subscribed, please keep me in cc)
>>
>> I made the attached suggestion for augmenting the "show of hands" tool
>> over on tools-discuss, and Alessandro from Meetecho rightly re-pointed
>> me to this list for discussion of draft-duke-shmoo-show-of-hands.
>>
>> In the thread over on tools-discuss, ekr (in cc) raised a suggestion
>> (which i like) pushing for something like the "alternate architecture"
>> described in §4.1 of draft-duke-shmoo-show-of-hands-00.
>>
>> I suspect ekr's suggestion would be a heavier engineering lift than my
>> simple proposal here -- maybe it'd make sense to consider implementing
>> the simple thing first, and then flesh out the more complex approach?
>>
>> Thanks for thinking through this kind of information-gathering tool.
>> there are so many ways to do it, and each choice has a real impact on
>> the ways that we think about the decisions we're making in this group.
>>
>>      --dkg
>>
>>
>>
>>
>> ---------- Forwarded message ----------
>> From: Daniel Kahn Gillmor <dkg@fifthhorseman.net>
>> To: tools-discuss@ietf.org
>> Cc:
>> Bcc:
>> Date: Wed, 18 Nov 2020 13:15:16 -0500
>> Subject: [Tools-discuss] polls "show of hands": can we include a "i don't
>> understand" or "not enough information" option
>> Currently, when there's a show of hands in meetecho, there are two
>> actions any participant can take:
>>
>>   - raise my hand
>>   - do not raise my hand
>>
>> in my experience, if a meeting has 100 participants, you're lucky to get
>> 50 that select either of the above options.  At least half tend to give
>> no response at all.
>>
>> There are two reasons to give neither response though:
>>
>>   - the question is confusing, invalid, wrong, i didn't understand it, or
>>     i'm not sure of the answer
>>
>>   - i am asleep/bored/not paying attention
>>
>> It'd be nice to be able to to distinguish between these two large
>> classes of non-responding participants.  This is akin to including an
>> "N/A" or "Don't know" answer in a multiple choice survey.
>>
>> Could such a option be added?  I don't want clutter with a dozen extra
>> options, but it would be useful to know how many people are paying
>> attention but object to the binary framing for whatever reason.
>>
>>         --dkg
>> ___________________________________________________________
>> Tools-discuss mailing list
>> Tools-discuss@ietf.org
>> https://www.ietf.org/mailman/listinfo/tools-discuss
>>
>> Please report datatracker.ietf.org and mailarchive.ietf.org
>> bugs at http://tools.ietf.org/tools/ietfdb
>> or send email to datatracker-project@ietf.org
>>
>> Please report tools.ietf.org bugs at
>> http://tools.ietf.org/tools/issues
>> or send email to webmaster@tools.ietf.org
>>
> 
> 
> _______________________________________________
> Manycouches mailing list
> Manycouches@ietf.org
> https://www.ietf.org/mailman/listinfo/manycouches
>