Re: Moderation at scale is hard^Wimpossible, or Why we really can't use Facebook for technical discussion.

John Levine <johnl@taugh.com> Mon, 07 June 2021 20:17 UTC

Return-Path: <johnl@iecc.com>
X-Original-To: ietf@ietfa.amsl.com
Delivered-To: ietf@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F26FF3A0D1A for <ietf@ietfa.amsl.com>; Mon, 7 Jun 2021 13:17:35 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.85
X-Spam-Level:
X-Spam-Status: No, score=-1.85 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.249, RCVD_IN_DNSWL_BLOCKED=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=iecc.com header.b=YSEAVFhn; dkim=pass (2048-bit key) header.d=taugh.com header.b=LlkY3TnH
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id x9QWh5vdf5GB for <ietf@ietfa.amsl.com>; Mon, 7 Jun 2021 13:17:30 -0700 (PDT)
Received: from gal.iecc.com (gal.iecc.com [IPv6:2001:470:1f07:1126:0:43:6f73:7461]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4EAD53A0CFF for <ietf@ietf.org>; Mon, 7 Jun 2021 13:17:30 -0700 (PDT)
Received: (qmail 63301 invoked from network); 7 Jun 2021 20:17:27 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=iecc.com; h=date:message-id:from:to:cc:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:cleverness; s=f741.60be7ed7.k2106; bh=2iLqdvYeSSmpkcPdgZwrU21DiYkN7HlJOH5sC1i2E90=; b=YSEAVFhn5T2FPICOPXMdEyS1lpxsBmlw3Z5yjKyZofT6A5JZyBt+SQNsZ00WXzCHdUU9lNnIfSsTHEE8T3uLESN7DW4cC+RJb5dLyU+LGoieT/+OkDO6QOG1+UIYYbLg/9oWgMwfJbk6tdM7lE60nh58z8bHqbMqgOnHiO52FcIBpOKGAukxg7aLMlAp8GW8amPEUpl3ArdpzsrAvCzZgN/dJkHclYtvWWBWc++QtOoP0YCVvZBPPjKq7Iz/oEVfk0mpkR/Fnr4vjJpa/9KXNpNYdtY6pDeOyr6cgeeci22g+39j5LX3X06ukS9G6mHN4+JXKZ6uwIsOI7G1kOXP5A==
DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=taugh.com; h=date:message-id:from:to:cc:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:cleverness; s=f741.60be7ed7.k2106; bh=2iLqdvYeSSmpkcPdgZwrU21DiYkN7HlJOH5sC1i2E90=; b=LlkY3TnHXWM95Oh5ZREYofpIfpF4p4Ro9d3Yo+AjbEGdYHCCwwefkQPmdkE12mEw/bGwgGNh+Av2jvVQE0xd64bTXSD95DbvMfZ5AfT6e6HKxqFlNKLWB3Cz08WzIR04stMJANFkDojm8ZwnpNIMR0cQCZNdnWSHTd+NMui890UyLoGzo1LBEdqCpqGah5GGms9/8ukA2A1lRjvQLx0AmN6KMgErGJ1al30KDZkaXCXt8rMVVAdte3pSGXa4tRuSx7Igz54Dfi/fXKdTUH1LkAt8QF+2HB7Vq5C6ck6D+/3MoCdxLvbrzZikTjwtShbImlZSLsq1pPpx99XfY2Kjuw==
Received: from ary.qy ([IPv6:2001:470:1f07:1126::78:696d:6170]) by imap.iecc.com ([IPv6:2001:470:1f07:1126::78:696d:6170]) with ESMTPS (TLS1.2 ECDHE-RSA AES-256-GCM AEAD) via TCP6; 07 Jun 2021 20:17:26 -0000
Received: by ary.qy (Postfix, from userid 501) id 427F8D49730; Mon, 7 Jun 2021 16:17:26 -0400 (EDT)
Date: Mon, 07 Jun 2021 16:17:26 -0400
Message-Id: <20210607201726.427F8D49730@ary.qy>
From: John Levine <johnl@taugh.com>
To: ietf@ietf.org
Cc: phill@hallambaker.com
Subject: Re: Moderation at scale is hard^Wimpossible, or Why we really can't use Facebook for technical discussion.
In-Reply-To: <CAMm+LwiwvCdup0y7ruPSt5uM+uAQRwO+jCNu0Dscoh+8i_nkqA@mail.gmail.com>
Organization: Taughannock Networks
X-Headerized: yes
Cleverness: minimal
Mime-Version: 1.0
Content-type: text/plain; charset="utf-8"
Content-transfer-encoding: 8bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/ietf/GPy4x-b25aZv97Ux9xv3nPpZC-0>
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ietf/>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 07 Jun 2021 20:17:41 -0000

It appears that Phillip Hallam-Baker <phill@hallambaker.com> said:
>Slashdot has a rather less respectful audience yet their karma system
>produces vastly better results. But the biggest takeaway for me is that one
>size fits all does not work for curation or moderation.

Sure, but differences in scale have qualitatitive as well as quantitative effects.

Facebook has 2 billion users who send about a million messages a
second. Slashdot has 4 million users who send about a three messages
per minute. (These are numbers from their web sites. Slashdot also
owns the much larger Sourceforge which I'm not counting here.)

FB is big enough that there are entire businesses and political
campaigns that live on it, with large financial consequences depending
on who sees what. The stakes are much higher, and the scale is so huge
that no matter how large their farm of human moderators, the humans
will never see more than a miniscule slice of the traffic.

Large platforms know that their moderation software sometimes guesses
wrong, and they deliberately make it fail safe -- compare the effects
of taking down your snarky message or Dean's vs. leaving up actual
death threats.  Is that really surprising?  Perhaps the message here is
that Facebook is not the ideal venue for nuanced political debate.
Once again, on a free service, you often get what you pay for.

For some interesting insights into moderation at scale, this blog
post about a suit challenging the new Florida anti-moderation law
has links to declarations from people involved in moderation at
large online providers including Youtube, Facebook, and Etsy.

https://blog.ericgoldman.org/archives/2021/06/plaintiffs-request-preliminary-injunction-against-floridas-censorship-law-sb-7072-netchoice-v-moody.htm

R's,
John