WG Meeting Structure / Alternate Room Layout

Adam Roach <adam@nostrum.com> Thu, 27 June 2019 21:31 UTC

Return-Path: <adam@nostrum.com>
X-Original-To: wgchairs@ietfa.amsl.com
Delivered-To: wgchairs@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id DEBE7120168 for <wgchairs@ietfa.amsl.com>; Thu, 27 Jun 2019 14:31:02 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.979
X-Spam-Level:
X-Spam-Status: No, score=-1.979 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, T_SPF_HELO_PERMERROR=0.01, T_SPF_PERMERROR=0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nostrum.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9N_ivIQgyCLz for <wgchairs@ietfa.amsl.com>; Thu, 27 Jun 2019 14:31:01 -0700 (PDT)
Received: from nostrum.com (raven-v6.nostrum.com [IPv6:2001:470:d:1130::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2CE10120114 for <wgchairs@ietf.org>; Thu, 27 Jun 2019 14:31:01 -0700 (PDT)
Received: from MacBook-Pro.roach.at (99-152-146-228.lightspeed.dllstx.sbcglobal.net [99.152.146.228]) (authenticated bits=0) by nostrum.com (8.15.2/8.15.2) with ESMTPSA id x5RLUwle077818 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO) for <wgchairs@ietf.org>; Thu, 27 Jun 2019 16:31:00 -0500 (CDT) (envelope-from adam@nostrum.com)
DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=nostrum.com; s=default; t=1561671060; bh=xMX3qzjnUe6tHQE3Rg4DTsegEdduUPgL6mSDx6i5q4g=; h=To:From:Subject:Date; b=OStLsx3jyjBUshwCEHKHqI/nNs/vmPgWk3fpCoeYbcvoSHWsG6OArlFnSPSv7juxl ENF6R4q225I6yJkYoRJyeeLfTjuN+Y1URy7X95aDqM1jLB9creo+EOw0PHGiRc0/Cv REwZt+N+njCjjEpLvimXD3HBoVWyic3kPNqaxzBU=
X-Authentication-Warning: raven.nostrum.com: Host 99-152-146-228.lightspeed.dllstx.sbcglobal.net [99.152.146.228] claimed to be MacBook-Pro.roach.at
To: IETF WG Chairs <wgchairs@ietf.org>
From: Adam Roach <adam@nostrum.com>
Subject: WG Meeting Structure / Alternate Room Layout
Message-ID: <d2038208-afbc-d7b8-0893-25447d02061b@nostrum.com>
Date: Thu, 27 Jun 2019 16:30:53 -0500
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:60.0) Gecko/20100101 Thunderbird/60.7.2
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Transfer-Encoding: 8bit
Content-Language: en-US
Archived-At: <https://mailarchive.ietf.org/arch/msg/wgchairs/dhThhe3jtucuXfnNUBRmme96LTs>
X-BeenThere: wgchairs@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Working Group Chairs <wgchairs.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/wgchairs>, <mailto:wgchairs-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/wgchairs/>
List-Post: <mailto:wgchairs@ietf.org>
List-Help: <mailto:wgchairs-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/wgchairs>, <mailto:wgchairs-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 27 Jun 2019 21:31:03 -0000

Hi. I'm following up from a recent thread on this mailing list ("WG meeting
structure" [1]) discussing the prospect of running additional meetings 
with a
"U-Shaped" table structure for the purpose of facilitating more natural
back-and-forth discussion of topics.

As many of you will probably recall, we ran an experiment at IETF 98 in 
Chicago
in which several working groups opted in to using such a layout. Those 
groups
that participated were QUIC, REGEXT, NFV, LAMPS, and HTTPBIS.

The stated goal of this experiment was basically the same as the goal put
forth in the thread cited above: to reduce the formality of a strict
microphone queue and encourage a more free-flowing back-and-forth 
exchange, in
the hope that this more informal style of discussion would lead to more 
rapid
progress.

The feedback that the IESG received immediately following the experiment was
mixed, with significantly more negative feedback than positive.


An exhaustive list of the positive feedback received follows:

   1.  A QUIC chair indicated: “seems to have worked well.”

   2.  One QUIC attendee noted that it “allowed a much greater
       volume of comments to be made by cutting down on overhead.”

   3.  Remote participants were able to more easily see expressions/
       reactions of people at the table


The negative feedback included the following points:

   1.  It is hard to tell who is speaking (almost everyone who gave
       feedback mentioned this)

   2.  Chairs found that sitting with their back to room was sub-optimal
       (almost all chairs indicated this). This had two reported impacts:

       –  The chairs can’t see people queuing at the floor mic

       –  The chairs don’t get a good feel for room assent/dissent

   3.  Single mic for non-table participants required long walks for
       some people (several participants indicated this)

   4.  Division between table and non-table perceived as elitist,
       especially when off-mic side-conversations broke out at the
       table (2 comments)

   5.  Having to turn head 90° to see the slides is uncomfortable
       (2 comments)

   6.  Chairs had no dedicated space, no dedicated mic, were pulled
       aside by neighboring IETFers into side conversations during
       meetings.

   7.  Several people who elected to sit at the table were not active
       participants, and took up space that was needed by active
       participants. Attempts to relocate these people were awkward
       and occasionally ineffective.

   8.  People were reluctant to fill in on “side” seating area, opting
       instead to stand at the back of the room.


While the volume of negative feedback was significantly greater than the
volume of positive feedback, there are two factors that should also be
taken into consideration. The first is that people are typically more
proactive about giving negative feedback than positive, so actual sentiment
on the topic may skew more positive than the preceding summary indicates.
The second is that several of the issues described in the "negative 
feedback"
list are not inherent in the revised layout, and may be possible to 
address if
the experiment were re-run.

Unfortunately, while there were plans to solicit feedback on this room 
layout
as part of the post-meeting survey for IETF 98, due to a technical 
issue, that
survey was never distributed to the IETF community.

In the more recent thread on this WG Chairs mailing list, the following 
issues
were either re-iterated from the initial feedback above, or mentioned by 
more
than one person:

     - Remote participants found meetings in the alternate layout more
       difficult to follow.

     - Many people who could not fit at the front tables felt excluded.

     - Everyone (both local and remote) had difficulty figuring out who was
       speaking, including Jabber scribes.

     - The style of queuing discipline required for this layout is
       unfamiliar to existing WG chairs, and many did a poor job with it.
       Non-front-row and remote participants particularly suffer from this.

     - There was no direction for chairs to face where they could see
       everything that was going on.

At the same time, there were approximately as many comments that such an
alternate layout seemed like a good idea to try. It was unclear in some 
cases
whether commenters were aware of the previous experiment or the community's
comments on it.

There were several suggestions for incremental improvements on the previous
experiment, both in the post-IETF-98 feedback and during the more recent
discussion on the WG Chairs list. Some of these included:

     * Place chairs where they can see the microphone

     * Give chairs dedicated table/mic

     * Experiment with shape of “U”
         – Face toward room instead of away from it
         – Make into open “V” facing room

     * Use two or more screens to display slides

     * Only allow this layout for very small groups

     * Use more and/or a different style of microphones


Given the foregoing, including in particular those aspects of negative
feedback that are inherent to the layout, the IESG would like feedback 
from the
chairs regarding whether a re-run of the experiment might be worthwhile.

/a
____
[1] 
https://mailarchive.ietf.org/arch/msg/wgchairs/rMPdilySo8XNU84623TQt5lRnJY