Re: [dmarc-ietf] Aggregate Reporting - "Not Evaluated" result

"Brotman, Alex" <Alex_Brotman@comcast.com> Mon, 03 October 2022 14:26 UTC

Return-Path: <Alex_Brotman@comcast.com>
X-Original-To: dmarc@ietfa.amsl.com
Delivered-To: dmarc@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9040BC14F613 for <dmarc@ietfa.amsl.com>; Mon, 3 Oct 2022 07:26:47 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.104
X-Spam-Level:
X-Spam-Status: No, score=-2.104 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=comcast.com header.b=fD3eSkx1; dkim=pass (1024-bit key) header.d=comcastcorp.onmicrosoft.com header.b=EE6RxrOW
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id CZ_yxT4juDY3 for <dmarc@ietfa.amsl.com>; Mon, 3 Oct 2022 07:26:43 -0700 (PDT)
Received: from mx0a-00143702.pphosted.com (mx0a-00143702.pphosted.com [148.163.145.77]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 0E6D4C1522D0 for <dmarc@ietf.org>; Mon, 3 Oct 2022 07:26:43 -0700 (PDT)
Received: from pps.filterd (m0184893.ppops.net [127.0.0.1]) by mx0a-00143702.pphosted.com (8.17.1.5/8.17.1.5) with ESMTP id 293DjQ71003803; Mon, 3 Oct 2022 10:26:41 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=comcast.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=20190412; bh=vEPgZZGOpw/VetwNyKlDgjpCrHBnYGhEPpNsBm1c+0I=; b=fD3eSkx1/aeGJd4LrBrJh+dQ6dIjpuEfWlAjX2wiLsY501ZSEu+c1Cq+E9yo0CRETm+H 1k4vzWVe/hy0yDZwA+p47x6qb/EYnGwv5l920zoNYpqLOPBrzDUVlcFyXYkRBLCOc+X7 zwmI309LoFaxcx16sQnfZU6jn081x7BN8F5HhJHZZkBThacIhrAJzeoWBa1y5J4+9/D8 sNJ8Y9ZCybEOUZznUKEKzwiE4BANRofKNTHfl9HSCgdBNuphNUrOX0NPnRi2iv1znaS5 TxAvIebvG3GJJajPDDRuFZFAkO2Qb2DXqMlrOBrse/Pfoe7tnMUs3H/5mS9LmMsEsfvr JA==
Received: from nam10-mw2-obe.outbound.protection.outlook.com (mail-mw2nam10lp2109.outbound.protection.outlook.com [104.47.55.109]) by mx0a-00143702.pphosted.com (PPS) with ESMTPS id 3jxgqhcrga-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 03 Oct 2022 10:26:40 -0400
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=aLLJsIOYBarPHqrusyQcXb5FiyxE6V2EQIZiLp+xrhBqJuZ4o6lIMvhlggnuUv8aRRmxEeLMeoQr1iplDHqa+sCjrz7uX/AdHewvHPpImpMU17MR4m4Ke0kIqYOz4hBvreLi/cmUj8X9flBoEtJr3SIy2/kIVJhoLxcfKXJH+fOHVH+Sb2zqw7z00tnU7kPLPIaHyZ4QzvjdCRiUiB4qS6Mj0nSXzL729MFk1zNT6d3ZE0+rw4aPM7mQpnHA8HeBAVULB8DFkl2Bj+rcebVF+svY0/jYT8rwprJ2wAtwAPbgttcrjDmkC3dKZtbK6ajxeTZ6L6+qgwrRJJWWIkZyfA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=vEPgZZGOpw/VetwNyKlDgjpCrHBnYGhEPpNsBm1c+0I=; b=m3ckPMecHIryoi5x1YxlVSNzOpH76TRQJR+/OrEj9znCZXUUpm/okI/n5/dqIl01kxepEIvj7AovDTU49Du9XBw2o8rrg1Qx1wNqO9ROOYf1wATXevLOyLE5/Len88+F1p/+EE3Q8m38ZC1kLzM3//paF0VmylUkM0r11Gw+7hbx0cv5sy17Z1cbLduCobY0xEPYmDEcG5fFD9RxpFpwHf41792i6E6vJZCiPYbVOTYKoPUh93r1K7EewQVXxpN9EC6sqt19X20i+Y25ZA9t1MyM1FBQS2RAuyV+HPwBOSqmJHPuQM/rtxRVPbHcVSRfPYwXMwZ14eOxWeRK+k6NGQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=comcast.com; dmarc=pass action=none header.from=comcast.com; dkim=pass header.d=comcast.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=comcastcorp.onmicrosoft.com; s=selector1-comcastcorp-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=vEPgZZGOpw/VetwNyKlDgjpCrHBnYGhEPpNsBm1c+0I=; b=EE6RxrOWCiOQ9RawHKbwEXnAiuiFH+nmgwr2D1Wm8EBqjDa+ahZjaNc9rjV0TC9o7k38irikKxOmNg07x+ut4UO2kDUEmu7QOGikkmghnekofw/yTMrKQar6jJQtnreg8G5Dtxy+pThqZbFt4mB/tw9Hls/BiENf//cCz33Eq0E=
Received: from MN2PR11MB4351.namprd11.prod.outlook.com (2603:10b6:208:193::31) by CH0PR11MB5689.namprd11.prod.outlook.com (2603:10b6:610:ec::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5676.24; Mon, 3 Oct 2022 14:26:34 +0000
Received: from MN2PR11MB4351.namprd11.prod.outlook.com ([fe80::c4c1:9c7:254b:c9]) by MN2PR11MB4351.namprd11.prod.outlook.com ([fe80::c4c1:9c7:254b:c9%4]) with mapi id 15.20.5676.030; Mon, 3 Oct 2022 14:26:34 +0000
From: "Brotman, Alex" <Alex_Brotman@comcast.com>
To: "Murray S. Kucherawy" <superuser@gmail.com>, Todd Herr <todd.herr=40valimail.com@dmarc.ietf.org>
CC: Douglas Foster <dougfoster.emailstandards@gmail.com>, IETF DMARC WG <dmarc@ietf.org>
Thread-Topic: [dmarc-ietf] Aggregate Reporting - "Not Evaluated" result
Thread-Index: AQHY1oj0jtN281tk3E+Gp9px0T6h7q37lr4AgABdcoCAAK+KAIAAENWAgAAGGDA=
Date: Mon, 03 Oct 2022 14:26:34 +0000
Message-ID: <MN2PR11MB43514940B87730CC9D476AACF75B9@MN2PR11MB4351.namprd11.prod.outlook.com>
References: <165046214335.10055.16398898629460366752@ietfa.amsl.com> <CAH48ZfxZOq68=P-Qxjvjk1c8PxWAWDvaBPPQcb4DWmd6cL=u4Q@mail.gmail.com> <CAJ4XoYen6n06L1UBqzu9nr2jCC7v_-GOAdJXMzCks6d-AaKqUA@mail.gmail.com> <CAH48ZfzVt=+yoj280VxL_SV+YM4C7eqMWhL=41YpVybaPmLcLg@mail.gmail.com> <CAHej_8mgKjpo6DDbOS9bBdTarThKOa9F55QBtrM6G-oq1YfX+w@mail.gmail.com> <CAL0qLwYjYY4OvShqACWPz0vdJcAubdU1csFFVSkqzsReZSZxuw@mail.gmail.com>
In-Reply-To: <CAL0qLwYjYY4OvShqACWPz0vdJcAubdU1csFFVSkqzsReZSZxuw@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: MN2PR11MB4351:EE_|CH0PR11MB5689:EE_
x-ms-office365-filtering-correlation-id: 2aa961ce-d1fb-416d-9030-08daa54b4617
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: LqF5a4vzBkUorO0yRG3TbOMX1p76CXe3+17UWDuIeu6WkKuwfRD+i9j8uB31z47sj8Js/iwFAxr2C8Qn+6I0cVObAm8tmM2MUWSl/RHT4sea2K9UvtEAbmkpmwTpVfDkCrZgDqR4bI+OxFk2DGCNj1XnuyaJPx5j90C5wnznjkD+WJt5w6nGgFFvIGxdPmhqWYnpS/yBY5OWAMVvipq9hl/29njDAzpVsA/LVU19aSgpo6fH2MejJZq8zi5sVnFEC23capWdR0tT0w6qw2I4m1eDRhgztc0Jf0AhiDACgbNyjWZkJsEw9c2ovYJMxDjpY7npZABws3POltofPrbijBjAvY5kuLtJf9c6QhPl/V7B5csiPncxPMk71tvqZ9nmRAT939FwRQiW/qPqfG4Xa2KkzASzR3ph/+faezMy8g4AAP1GpDIaMd5jklhOLmqzM8bZqqGUsSXM0DnqePoxvUo3+/ewLHeb52kM+HOyZXhW/TdN8XYjtvyWI8ycazrLlDb/AQPs7QutiYOGpYOtETfdV1GlNu5SCy1qstuvcgGVEzuaqQ7zkBLSz2Rk6DxBoIS5/NT9G7ZCyvQz0j8mV8/pEtl87o/hSjSsvZVe2hiIFg1jYOBFQnJ8FdemPPudvwdsHMZ98sJB6g6marbU8RpUUv5fI/SSbMvIaK7SjRbUIJIscA4ObybvEGNN1KZbghfiG4hzbd+5vJlOtGERxlol0eXzeW/W/wk+D395oXz/UwEcyak2Cgj1w0PN8JlymNwxggsrZpdYjBe0Ctz89w==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:MN2PR11MB4351.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230022)(4636009)(136003)(396003)(39860400002)(366004)(346002)(376002)(84050400002)(451199015)(53546011)(9686003)(7696005)(6506007)(76116006)(66946007)(54906003)(8676002)(316002)(478600001)(71200400001)(110136005)(66476007)(55016003)(66446008)(64756008)(66556008)(4326008)(122000001)(38100700002)(82960400001)(86362001)(38070700005)(186003)(33656002)(83380400001)(5660300002)(8936002)(41300700001)(52536014)(2906002); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: 9unT8rXJ4+GPaQVPb+86Q7hKcXg0r0leznEgXh+Ts2gdCYZiqXGY6bIfzeMg7Va/oiYpnSIyb0VvRyqvQDqOJISWqEX69SOvmUIllx3hP1XEkXYKsXkj37BuPTagvs/R/7DTlkIV9C7vTnQCfj/Oh+i4OkdbPFnAPLTHeSOIfbORp6u1xyx7tDZBdcwDZVPzxDQ99UZNxwy/s1db4EIiTKCWcnCGkW5hWdlDyXY2rd18KkSIig62DQi9McQCrxowhNqpOP1e8ciOxTju38mb6MmRU/x7wad9+6cGSWHKms2vp1LWhK1XoUg+eXD+6y/V3wNWh8FdNd1l0Bg8KaM9bO9wyXfbO2426dRFVuaZ2UsW0JNBwelUJYHKUTkaQLTFlIA5CBHGTO5HkO1wfIOn8GMWbLN9bLSsSIz40KePY3xau2fxl0dsnRwa8TobeEkSIYZsVX7jQ2KVuUzDqcBpRUZe0u82QSe/Onr13qSZ5LJj6h52BmqsO+mnVrmPJuOmyLDzfdAzSofIThOod2sfMuktUQsGIg1EC4ApmY3VzzAWsw/o4L1DhUt0RAj9CP82ZwmaKdO6ziNUHJCJ8zVnv4oeTc8EGqRIBnFYJk0yrIQHnC/uU2F+lyQrx1b9tIJy1yhdPvaJQss8I4k3COdCj3GhKS9apx7/EtF/XIbmMUScLteAAhJxc31L3V+lRkRSP74/fF1rnhwNJq3llshkUlK1NKT8y+Sw+tnUTcqmYeVu6U/B2bNkUVI7ZTnTZ60rtkM7JphaNT701cXMu6SLUnmlk+I8T8z6dr/sGC1WfRaOTXe/WZW+NaPgAZLka1l/Pm3IGf7nLdb0c3iuIw0ofUaGoWCKrBp1/O20G/7RInrwjYniMK0oEHTTVOoicwBJ1ChG7IJV4UPzJy3Ywi2wqCvm49F6E2iANjJgAkfSiZbzhalIs2AzxDMrkmnCdJc5w5oDM+tG0CxR/s5C0ddeuIQ6CgfPCvPrdcjsxeo0mne2d1SLloJYEH+lzxgZ4wmjpymj3yVNH/4+4CfkO5SUe9zj5xMWLAka0vGUibvwVXnNk9HqoXHuglzjisj3QBqGhP1IuaJMXLxZG6Na0J4mINXvhwkvDzUUKBnnXTXG3FsRY/UJjS69e5YPnM6WtxeiGeWafDhnJ8HIjDKjzhci6advF/pql+NAq3F/eD+6ohc7xiKmspUXatKX3WYtliQtipJUxhiVyvOzI+c3gY7Eb0aOkMxtBzeS4Zdg5uZ6O0iy6AkP2SNBKUbrqZE3MHD2Q9Ue/Hw3qk/p9lUTsv9DSKNewbGOpDjFS9/6v/NGxh2kp3jrXEM2g6IObpv1eTZ+n5mtDKzMzBKHSgla5cyj2gHuArkuJBKj4Wz16OEVhf7ZN1tRCQSYLpgtCOMgeNPzVs51DrRKpIdf/+BDzRh17vIyB8DM6TU6/2nOUo33ZyKndINsr5s6m7M021uop7a/OpIdMWSBD2lZoMc08kRYhHxBQMYunH81i36O14yTH6LhloFbIA+Z26Uw0+TBOg+qcH9fZPobYO1Crw+5GzPjHKBr4hPyhhxMpP2Jmb07pNzwyWX0d5fpOi3fV+xbC2N0BepZ6jkFROW3xhiRaWfVeOij4JNVjb9y4xsBFCiMz+EHtnXnS8L4rwwOTf3LLDiRIjMF4VRPjr0+XKEZ6nC+0Q==
Content-Type: multipart/alternative; boundary="_000_MN2PR11MB43514940B87730CC9D476AACF75B9MN2PR11MB4351namp_"
MIME-Version: 1.0
X-OriginatorOrg: comcast.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: MN2PR11MB4351.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 2aa961ce-d1fb-416d-9030-08daa54b4617
X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Oct 2022 14:26:34.2801 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 906aefe9-76a7-4f65-b82d-5ec20775d5aa
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: G4UIXNYNLTFpPXGYFzmU/CDLpeItROXLWlW/7AgOBErgYIoSwRO6xVlnN6h324S2bXEsEtJonARkvPIMUipOaQsQwDYuggiFrDFfdfqj+Vg=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH0PR11MB5689
X-Proofpoint-GUID: RM-VxH7pHt246Uus9IYrXS-BFrklreuz
X-Proofpoint-ORIG-GUID: RM-VxH7pHt246Uus9IYrXS-BFrklreuz
X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.895,Hydra:6.0.528,FMLib:17.11.122.1 definitions=2022-10-03_02,2022-09-29_03,2022-06-22_01
X-Proofpoint-Spam-Reason: safe
Archived-At: <https://mailarchive.ietf.org/arch/msg/dmarc/1mS_sEX98QmEnYfwKgS3uD3DGlI>
Subject: Re: [dmarc-ietf] Aggregate Reporting - "Not Evaluated" result
X-BeenThere: dmarc@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: "Domain-based Message Authentication, Reporting, and Compliance \(DMARC\)" <dmarc.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/dmarc>, <mailto:dmarc-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/dmarc/>
List-Post: <mailto:dmarc@ietf.org>
List-Help: <mailto:dmarc-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/dmarc>, <mailto:dmarc-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 03 Oct 2022 14:26:47 -0000

So we would likely need a section in the core document with a SHOULD for evaluation (if it’s not already there), and then a section in the aggregate reporting for a MUST for reporting on evaluated information (if they choose to send reports at all), correct?

--
Alex Brotman
Sr. Engineer, Anti-Abuse & Messaging Policy
Comcast

From: dmarc <dmarc-bounces@ietf.org> On Behalf Of Murray S. Kucherawy
Sent: Monday, October 3, 2022 10:03 AM
To: Todd Herr <todd.herr=40valimail.com@dmarc.ietf.org>
Cc: Douglas Foster <dougfoster.emailstandards@gmail.com>; IETF DMARC WG <dmarc@ietf.org>
Subject: Re: [dmarc-ietf] Aggregate Reporting - "Not Evaluated" result

On Mon, Oct 3, 2022 at 9:03 AM Todd Herr <todd.herr=40valimail.com@dmarc.ietf.org<mailto:40valimail.com@dmarc.ietf.org>> wrote:
On Sun, Oct 2, 2022 at 10:34 PM Douglas Foster <dougfoster.emailstandards@gmail.com<mailto:dougfoster.emailstandards@gmail.com>> wrote:
I am starting from the viewpoint that (a) reporting is a courtesy provided by the evaluator to the domain owner, and (b) the evaluator will do so in the context of his own interest, which includes filtering messages with maximum possible efficiency.

It is only a courtesy if the evaluator is not interested in promoting more widespread adoption of authentication.

For those evaluators who want to maximize adoption of authentication (because authenticated identifiers are ones to which reputation can be reliably attached and used in handling decisions) it is beneficial to the evaluator to provide reports to all who solicit them, so as to ensure that the report receivers can address shortcomings in their authentication processes.

I believe that the evaluators wanting to promote more widespread adoption of authentication far outnumber those who don't.

(No hat.)
I think if the consensus concurs with this perspective, then this is something the document should say explicitly (if it doesn't already).  Specifically, I think the case is being made here that all methods SHOULD be evaluated, with no short-circuiting, and the results of all of them need to be included in any report that's generated, so that the report recipient doesn't get only a partial view of what the world is seeing.

Meanwhile, there's clearly a bar someplace with regard to whether an operator chooses to generate reports.  I'm sure they all think operators support the idea of email authentication, but it's not clear whether they are prepared to make the investment to do so beyond getting the filtering part of DMARC working.  As Doug put it, it depends on "the context of his own interest".  I'm not sure this document making a normative assertion about that part of the question will move the needle at all.

-MSK