Re: [sipcore] draft-ietf-sipcore-callinfo-spam-01 - SIP entities

Henning Schulzrinne <Henning.Schulzrinne@fcc.gov> Wed, 19 July 2017 18:33 UTC

Return-Path: <Henning.Schulzrinne@fcc.gov>
X-Original-To: sipcore@ietfa.amsl.com
Delivered-To: sipcore@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 96D7212EAB0 for <sipcore@ietfa.amsl.com>; Wed, 19 Jul 2017 11:33:25 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.9
X-Spam-Level:
X-Spam-Status: No, score=-1.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=fccoffice.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id yF7-OMtW1zCw for <sipcore@ietfa.amsl.com>; Wed, 19 Jul 2017 11:33:23 -0700 (PDT)
Received: from mx0a-0024ed01.pphosted.com (mx0a-0024ed01.pphosted.com [148.163.149.208]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3862312711E for <sipcore@ietf.org>; Wed, 19 Jul 2017 11:33:23 -0700 (PDT)
Received: from pps.filterd (m0102172.ppops.net [127.0.0.1]) by mx0a-0024ed01.pphosted.com (8.16.0.21/8.16.0.21) with SMTP id v6JITpVZ015572; Wed, 19 Jul 2017 18:33:19 GMT
Received: from gcc01-dm2-obe.outbound.protection.outlook.com (mail-dm2gcc01lp0047.outbound.protection.outlook.com [23.103.198.47]) by mx0a-0024ed01.pphosted.com with ESMTP id 2bqc70k8v2-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Wed, 19 Jul 2017 18:33:18 +0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fccoffice.onmicrosoft.com; s=selector1-fcc-gov; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=dGUvS1l5tEX451Vwrs/FomrAwo3AhKrhoTE0eRgMbuM=; b=vfzZjR00YcvYLRE7BWVL8WtdMg4wFM61/tHYArfBdRDgUoeXREMrmE0KE+ZFvQP7oXai6VIaJgxvP+4BRJn2mVQDlW4PJOLvyOzCrsMTnEeS/O6xQTpFfDXJ7qdGysw3XVmCpNkTGJWdtHEiy6TGwo5oQH4uxILs2IqisZQskKQ=
Received: from CY1PR09MB0760.namprd09.prod.outlook.com (10.161.173.151) by CY1PR09MB0757.namprd09.prod.outlook.com (10.161.173.149) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1261.13; Wed, 19 Jul 2017 18:33:17 +0000
Received: from CY1PR09MB0760.namprd09.prod.outlook.com ([10.161.173.151]) by CY1PR09MB0760.namprd09.prod.outlook.com ([10.161.173.151]) with mapi id 15.01.1261.024; Wed, 19 Jul 2017 18:33:17 +0000
From: Henning Schulzrinne <Henning.Schulzrinne@fcc.gov>
To: "Asveren, Tolga" <tasveren@sonusnet.com>, Paul Kyzivat <pkyzivat@alum.mit.edu>, "sipcore@ietf.org" <sipcore@ietf.org>
Thread-Topic: [sipcore] draft-ietf-sipcore-callinfo-spam-01 - SIP entities
Thread-Index: AQHS//8f86lEHhh9VUKR5rSbwxo4z6Ja0ofAgABzoYCAAC1loIAAAo2A
Date: Wed, 19 Jul 2017 18:33:17 +0000
Message-ID: <CY1PR09MB07606A3F6AD98F8CB7235FD5EAA60@CY1PR09MB0760.namprd09.prod.outlook.com>
References: <CY1PR09MB07602078727954F586DCBDD3EAA10@CY1PR09MB0760.namprd09.prod.outlook.com> <SN2PR03MB235023C01D8658B9B25A3577B2A60@SN2PR03MB2350.namprd03.prod.outlook.com> <75f4364f-a10d-18eb-f547-8bdb17acef78@alum.mit.edu> <SN2PR03MB23509530AE70988D06A97191B2A60@SN2PR03MB2350.namprd03.prod.outlook.com>
In-Reply-To: <SN2PR03MB23509530AE70988D06A97191B2A60@SN2PR03MB2350.namprd03.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: sonusnet.com; dkim=none (message not signed) header.d=none;sonusnet.com; dmarc=none action=none header.from=fcc.gov;
x-originating-ip: [192.104.54.21]
x-ms-publictraffictype: Email
x-microsoft-exchange-diagnostics: 1; CY1PR09MB0757; 7:DWMp6jiwe6nnlAAnaTHtbNMZptP/XIQDaYCZ2qvbUuuSOba8iz7e2ejYKA2RBRb3p+jU1Of/V+7wjquQ1d9mVIAwGkP8IOuk05ZRYdIj8yku+dGb4Ei4yLHBYUzl16JF8p8FyKOQyL63HCA5jBvzqEd8Fb4N9IFJ2G7W2/YKXrjEVyZa8LUrjwAnMRBuheih/y+bMGEz9Uyxop23gSmEsyT4EeAHNH/KRVZOjF7FCBkEjjTB4vAt4B0y4aLn7wdFFHPRRTlsS2sTBQjiVWBnPXvGQjYk9MV07pjdzbNUrTUMLv0n00j8YJ+v77WuH/C16pIX6KWjNLVtQEp7igw9HPlQlKvd8Vrhs4AD86L6omO4FZ9gEamiHylkH10J7aKdvMULT6+/92CErK8B6Cyi8gYB14YeSpgOa+ZPFlLpOH9jGfgrDRH45vm8QdSjeIJukSOB1LaHAFv4AiPXy4NQG3vbtSDlyv7ES4FMJrXJfkHQTkwPQalMYzJMRy8MbQ37LQo4zJIKInU+GBQGGruJYq+3PG9wtuadr34uu32TzcR5kSv4ttqn1CNi8EFxPawmeHJFd9L21s7xAlFZ1ZzQD9wzr+9U5SameWqbhvlh7BsoMHTqQs3vHxaUqBO+KPGiWUgDQudk7319OCtohG1ZKVTnwzsb3WccoxDGC5mYbkHy2O/R5Hs9orfzlVwZ81ttlsbjgQ4Nb+CvpMdMsFR3NARm2uBQ3DQolveRXNlaw9cEhVqw0W5rgGEMQ/aiD+JcuqllfrGBY+/ij/uulJJ6UMxZfnzcGxPC+tit4SQEcXQ=
x-ms-office365-filtering-correlation-id: 8346a832-8cd7-47c8-5f61-08d4ced49fb0
x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(2017030254075)(300000503095)(300135400095)(2017052603031)(201703131423075)(201703031133081)(300000504095)(300135200095)(300000505095)(300135600095)(300000506095)(300135500095); SRVR:CY1PR09MB0757;
x-ms-traffictypediagnostic: CY1PR09MB0757:
x-exchange-antispam-report-test: UriScan:(236129657087228)(48057245064654)(247924648384137);
x-microsoft-antispam-prvs: <CY1PR09MB0757DF44951FE27EDE9304F1EAA60@CY1PR09MB0757.namprd09.prod.outlook.com>
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(601004)(2401047)(5005006)(8121501046)(2017060910075)(100000703101)(100105400095)(93006095)(93001095)(10201501046)(3002001)(6041248)(20161123558100)(20161123560025)(20161123564025)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123562025)(20161123555025)(6072148)(100000704101)(100105200095)(100000705101)(100105500095); SRVR:CY1PR09MB0757; BCL:0; PCL:0; RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095); SRVR:CY1PR09MB0757;
x-forefront-prvs: 0373D94D15
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(6009001)(39850400002)(39840400002)(39450400003)(39400400002)(39410400002)(13464003)(377454003)(229853002)(38730400002)(102836003)(6116002)(6436002)(93886004)(230783001)(3280700002)(2906002)(25786009)(74316002)(189998001)(2950100002)(9686003)(55016002)(53936002)(3660700001)(77096006)(2171002)(99286003)(305945005)(6246003)(33656002)(72206003)(14454004)(7696004)(8676002)(3846002)(7736002)(81166006)(66066001)(6506006)(478600001)(53546010)(2501003)(5660300001)(50986999)(2900100001)(76176999)(8936002)(54356999)(86362001); DIR:OUT; SFP:1102; SCL:1; SRVR:CY1PR09MB0757; H:CY1PR09MB0760.namprd09.prod.outlook.com; FPR:; SPF:None; MLV:sfv; LANG:en;
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: fcc.gov
X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Jul 2017 18:33:17.1419 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 72970aed-3669-4ca8-b960-dd016bc72973
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY1PR09MB0757
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:, , definitions=2017-07-19_12:, , signatures=0
X-Proofpoint-Spam-Reason: safe
Archived-At: <https://mailarchive.ietf.org/arch/msg/sipcore/kpiyASs2JT6VcLNvcR_rpmvImQk>
Subject: Re: [sipcore] draft-ietf-sipcore-callinfo-spam-01 - SIP entities
X-BeenThere: sipcore@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: SIP Core Working Group <sipcore.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/sipcore>, <mailto:sipcore-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/sipcore/>
List-Post: <mailto:sipcore@ietf.org>
List-Help: <mailto:sipcore-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/sipcore>, <mailto:sipcore-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 19 Jul 2017 18:33:26 -0000

This type of labeling is very common for email spam filters. It's essentially the same as "There's a 47% chance of rain today." Except that meteorologists are smart enough not to say 47%, but rather 50%.

It is better than the "According to the polls, candidate H has an 89% chance of winning the election." (Any semblance of initials to real persons has a 1-in-26 chance of being made up.)

Theoretically, unlike for elections and somewhat similar to the weather case, this is testable: You could take all the 50% spam or rain predictions, check with some reliable metric (human or rain gauge) whether the spam or rain happened and compare your results, i.e., roughly one in two such predictions should indeed turn out to be spam or rain. (It's more complicated than that, but we're getting pretty close to the philosophical debate of what probabilities mean when making predictions, which is apparently a rather unsettled scientific question.)

To actually answer your question: I don't think this is useful except as a rough way for users to trade false-positive/false-negative penalties. For example, they may discard all 80%+ probability calls, route 30-80% calls to voicemail and ring the below-30% calls. The thresholds are arbitrary, but users may tune them based on experience ("all the calls in voicemail were spam, so I can go lower").

Some people pack an umbrella when there's a 20% chance of rain, others are more willing to risk getting wet. By the way, it is well-known that meteorologists over-predict rain since nobody complains if they did not get soaked.

Henning

-----Original Message-----
From: sipcore [mailto:sipcore-bounces@ietf.org] On Behalf Of Asveren, Tolga
Sent: Wednesday, July 19, 2017 2:11 PM
To: Paul Kyzivat <pkyzivat@alum.mit.edu>; sipcore@ietf.org
Subject: Re: [sipcore] draft-ietf-sipcore-callinfo-spam-01 - SIP entities

Let me ask this question then:
What would "spam with a likelihood of 47%" mean? Will the specification detail how this percentage need to be calculated? Otherwise how can the end-device take some action based on this value? One could argue that all these are "implementation dependent" but honestly I think this would just create confusion/chaos in practice and likely to be not useful.

Thanks,
Tolga