Re: [dmarc-ietf] Aggregate Reporting - "Not Evaluated" result

Scott Kitterman <sklist@kitterman.com> Wed, 19 October 2022 13:59 UTC

Return-Path: <sklist@kitterman.com>
X-Original-To: dmarc@ietfa.amsl.com
Delivered-To: dmarc@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1E579C14CF14 for <dmarc@ietfa.amsl.com>; Wed, 19 Oct 2022 06:59:05 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.108
X-Spam-Level:
X-Spam-Status: No, score=-7.108 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=neutral reason="invalid (unsupported algorithm ed25519-sha256)" header.d=kitterman.com header.b=kp6Vbvlf; dkim=pass (2048-bit key) header.d=kitterman.com header.b=PJpUDFgY
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7DNAjJmnRJZX for <dmarc@ietfa.amsl.com>; Wed, 19 Oct 2022 06:59:01 -0700 (PDT)
Received: from interserver.kitterman.com (interserver.kitterman.com [64.20.48.66]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1363EC14CF12 for <dmarc@ietf.org>; Wed, 19 Oct 2022 06:59:00 -0700 (PDT)
Received: from interserver.kitterman.com (interserver.kitterman.com [64.20.48.66]) by interserver.kitterman.com (Postfix) with ESMTPS id D1CB1F80315; Wed, 19 Oct 2022 09:58:58 -0400 (EDT)
DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/simple; d=kitterman.com; i=@kitterman.com; q=dns/txt; s=201903e; t=1666187938; h=date : from : to : subject : in-reply-to : references : message-id : mime-version : content-type : content-transfer-encoding : from; bh=sD+3T4TJ1r9ghtW/4mM+aOyQ+kMnI1l3pTJ1qbTPju0=; b=kp6VbvlfRsJJ4Jr6QsWTDPABbMudgVz3UaVLfgP4uMR+IoMRwNm/NfgSx4J63QLrleuWx Ed/UMGFuQME0wbBDQ==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kitterman.com; i=@kitterman.com; q=dns/txt; s=201903r; t=1666187938; h=date : from : to : subject : in-reply-to : references : message-id : mime-version : content-type : content-transfer-encoding : from; bh=sD+3T4TJ1r9ghtW/4mM+aOyQ+kMnI1l3pTJ1qbTPju0=; b=PJpUDFgYUYx3WujmdRhRV0V9cuYFiP3+cX9qFcvN+LFVrkgoMZ1rYMdvNL7o2AcQhU4pA 3AaKPJDpZrksXxp+1O27qBj3SHNawUjSYJUjB5YFpoTbQnUQ7GDtbKnUgyEuRL/iNuzrVQE K1zCaWF3SPTcRXzkjtmeFLgKh1J46i9g6UExB8LdtOeEGL3SpSjUQmeaSCKVeeHMyvbuEN7 eQBpvlWmBULtrjlBzpndC2OrwDKtvzcU/TPIR88GdRPAHsT9HfyHztWoHhtMdUtxaLpD031 lNTkwbYKR+b8TkvZIG5+y3CmZqUB+OBDEZLWppVCvAtztN/MUInKnxyhCgZg==
Received: from [127.0.0.1] (static-72-81-252-22.bltmmd.fios.verizon.net [72.81.252.22]) by interserver.kitterman.com (Postfix) with ESMTPSA id 8612BF80301; Wed, 19 Oct 2022 09:58:58 -0400 (EDT)
Date: Wed, 19 Oct 2022 13:58:59 +0000
From: Scott Kitterman <sklist@kitterman.com>
To: dmarc@ietf.org
In-Reply-To: <CAJ4XoYf_fCOciUPtgUVtFptB7uMvJ69MJmWjtiw4VRiy5o08JA@mail.gmail.com>
References: <CAH48ZfxZOq68=P-Qxjvjk1c8PxWAWDvaBPPQcb4DWmd6cL=u4Q@mail.gmail.com> <F945F4A4-198A-4D7C-BCC9-F3B5F8FC8C26@marmot-tech.com> <3AEAC3A6-23A5-416F-B362-9B19CEF90F68@kitterman.com> <CAJ4XoYf_fCOciUPtgUVtFptB7uMvJ69MJmWjtiw4VRiy5o08JA@mail.gmail.com>
Message-ID: <FCE0708E-CE6A-4E0A-B5D0-F735779FFAFC@kitterman.com>
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable
Archived-At: <https://mailarchive.ietf.org/arch/msg/dmarc/cxqVpwYnSFFN-TDQc_C414bwiSI>
Subject: Re: [dmarc-ietf] Aggregate Reporting - "Not Evaluated" result
X-BeenThere: dmarc@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: "Domain-based Message Authentication, Reporting, and Compliance \(DMARC\)" <dmarc.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/dmarc>, <mailto:dmarc-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/dmarc/>
List-Post: <mailto:dmarc@ietf.org>
List-Help: <mailto:dmarc-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/dmarc>, <mailto:dmarc-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 19 Oct 2022 13:59:05 -0000


On October 19, 2022 12:44:16 PM UTC, Dotzero <dotzero@gmail.com> wrote:
>On Tue, Oct 18, 2022 at 11:18 PM Scott Kitterman <sklist@kitterman.com>
>wrote:
>
>>
>>
>> On October 18, 2022 10:16:44 PM UTC, Neil Anuskiewicz <
>> neil@marmot-tech.com> wrote:
>> >
>> >
>> >> On Oct 2, 2022, at 11:01 AM, Douglas Foster <
>> dougfoster.emailstandards@gmail.com> wrote:
>> >>
>> >> 
>> >> In many cases, an evaluator can determine a DMARC PASS result without
>> evaluating every available identifier.
>> >> If a message has SPF PASS with acceptable alignment, the evaluator has
>> no need to evaluate any DKIM signatures to know that the message produces
>> DMARC PASS.
>> >I think it’s critical to DMARC that receivers do things like evaluate and
>> report on DKIM whether or not SPF passes and is alignment. Without this, it
>> would make it harder for senders to notice and remediate gaps in their
>> authentication. Since there’s not a downside (that I know of), I’d say this
>> should be a MUST if at all possible.
>>
>>
>> What is the interoperability problem that happens if evaluators don't do
>> that?
>>
>> Scott K
>>
>
>Scott, What is the interoperability problem is evaluators didn't provide
>reports at all? Reporting isn't a "must" for interoperability but it
>certainly helps improve outcomes instead of senders flying blind.

I read the email as suggesting a MUST for reporting both SPF and DKIM results if you report results at all, which would, I think lead to exactly the situation you're concerned about.  I'm skeptical of any kind of MUST around reporting since that's generally reserved for things that impact interoperability.  I do agree it should be encouraged.

Mostly, at the moment, I'm trying to understand the proposed change and the rationale.

Scott K