Re: [Vcon] Email metadata in vCon

Dan Petrie <dan.ietf@sipez.com> Thu, 04 April 2024 23:05 UTC

Return-Path: <dan.ietf@sipez.com>
X-Original-To: vcon@ietfa.amsl.com
Delivered-To: vcon@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 25039C151089 for <vcon@ietfa.amsl.com>; Thu, 4 Apr 2024 16:05:24 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.876
X-Spam-Level:
X-Spam-Status: No, score=-1.876 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_KAM_HTML_FONT_INVALID=0.01, T_REMOTE_IMAGE=0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=yahoo.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id kY_1NnPZFi1a for <vcon@ietfa.amsl.com>; Thu, 4 Apr 2024 16:05:19 -0700 (PDT)
Received: from sonic304-22.consmr.mail.ne1.yahoo.com (sonic304-22.consmr.mail.ne1.yahoo.com [66.163.191.148]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A6F31C14F685 for <vcon@ietf.org>; Thu, 4 Apr 2024 16:05:19 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1712271918; bh=TX/bkgLp53xcgv73TqZ2gKtMnEUClp5Ijryg3ftXR4s=; h=Date:From:To:Cc:In-Reply-To:References:Subject:From:Subject:Reply-To; b=XWhYd86Y8ZAe9jrrO6tn5P0OWFtGYZJFojB4wXfQcHzOP0n3Gf9QgeLyfhBc1SYDADl3Bemvii2EXWbFVWpNFOfUm42cjAXxawI1+lUmKCNx0NddL3ZXQe4S107Qo63WtHuHHZya2cYobm9W5ZWGKVujYIBVcD5DD3M0Yvcctnv9b+GWEeJaM2a4qGaMlHLZdy4Zb2Dd3zh3GfeNP2YZlRkr2ZMVTu+vI43NJoHecKG8cWD9ayJ1VI+WPHVfZ3guWR/0F+8DTfHQLDSL5BCZl1IclxWbk8E7vWKHWiIv1Jc6+6/p6MbPVk5p8buJALCcY6hDdNKropjeZT5v+E42LA==
X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1712271918; bh=4M6T5Gh5nTLINkeiuJKG2V2jEFbpG4hsv5WbxeJP11I=; h=X-Sonic-MF:Date:From:To:Subject:From:Subject; b=UGFeuWkKgYEHqjfdAu/s9AMQd+8AIrx1itINtLXrFCCMOj57oZUXqBePKVNPsBjoGkqD5nDltjDI9zVOh5WlFzVN4MtefZa9eRJ8cJA+AiU5tFSKGz8YSv+hIHyWtvEZMgT1r957E4UhAj+2383c9iMQgZusCvzmnHxxMjjwFfX6GLGB3DOetqOfxyFQow3aojOd5O8OliyA3fhIO9QdPQX0WEHe7GO0vRPc3eRI1uYxewy34VBBvq7mnvRn2Cn6A0p398hZdl2CBXEQejGNXCMJgTQMI04W5OEaEYOJaCFXyrMM6RfG8EjYDoF9Qpm3BN5KiHE2L6X0h7uMEVDjZA==
X-YMail-OSG: PocWPw8VM1l92.Jb5I9bw6d8.LgxRmaxYErBKrcRGrTEI1OKC_jmfL.2BedidBc a1tAyBjE8uxQo65wm1Resy0o96KL0hiaqri3MSKmy72vYL.GgoMX07bDbi9F4RI26eV7fRp05OFg d7EI_VjsP_cTL6ykrXaLyKLNVMThVO_9qDzuZuGP3XKDQ15RN84VB4cSRjtq6QoGxodgCiBFVtmY pg5zc4VvH.VuIrkYTXURd_vxY3LKgpbb04XPKVCXzohNlCiyQogNh.wO1PwkJvTpQbEemt8dO_yH DHq_exmoIccM3UpY6OR_9TVNHzf2jCUKkiO_ruiYd.PnoqI.e3OL64.h6idCWRS.0E1lRUL1CxFT jZS6Cto31SrHK40SltxuFdoGNT6n.f1jdShCAHFP.Rb9g9Stg2CUJ8muRYpavDl6JjYV.Yej2IOW UWvqv_JiKO8gzbrDtcjlbyelmCBVp8UBR97yITmul7R.maYgWCTk87oQYiwvNiiNBAlKo7VwYjEV L4JCFe.PSbGKlE1f2OmIoRrrOb9PCyw7p5oIIXHdLESqTglBNx9uZlwqefCj.vBs_dI.0.0VEgBD QDybt6zF6BL78K_2hixKDocsJlT2WXH_Hilxrs3IhozTcVlvdktHXy_VH9TklLU94DjpYtbyRJKe sb7KYRdVOYyQTPxtmrDIThd63LcPnVpI9xvxcf_tvbzmdX.uVTlg_vKHjcFefjaX6CSl01.YvxXp 9o6dS1lfNj3ht3xpelxVfBF2Fr8wmCFMi5.uJxAZ7FEVbIBcqctH_PZv5cnnshq6ijAEU2yfN6mC xk8W6md4Yyc.lxUSyVBNHE_W.s6dzbGTZaPSAadde7s1oSgu18h4gV43sO5i4Xn.itkSqFMculv1 g4f_b1MqcKOAENSYrstE.Y13MtwSjDfjqwQgy8i8ePMu__hKFGrdV0m4qHlHY7fKgXDsZ8mGKz4W N9X6nRtntXyZTbymGpcU5fzxTzO8mx8WKzjr_jn6KpYa7kA2u7o1fg_CZmCs5_1bHxEB52sX7ZfI 0BpbipziebEBhIxWZoJyikrJpy758Vls86fZ1bmAJKH4Q7hZnV8zESaTgaGNRLif8E5DFQk27kY0 MIQTOUziFRmu6KCpbSuo9f2RrYABjb3e6JzG3GnJHveHchtekugc_c5kQX5UOmu3RKurrbiyDA3l MwvmNTohOlFn8QcoinXs4dwtt6jEpNq0BtfQPhbK9gA57XDh7hGacrNP6ieNwVkviW0lX7P0RkjI VVT9ftiqjcus1.GiDfKBIBwsFZhqimgidnS855CFdaDFZgmutLf7P6xwRGV5WCOBS2eGaWrZE5xm uZUlLuWXRJHdtsvFP3cgg4694aPO83CC3K0m4HpH61cAUrSOKqkIu_bCEs442E485iFSIq0IA4bF VgFYbftntAv2HiT8Kc_H0oTf6g6Xrc6kKvSY9tmqAyEJDe6Kww5wFNv8M4wi8OSpG3HyOQa892nj x4knIqsCZe_rteEwecw9zduvMeRF2AOEFyQ3kmgG3eAzkIW7jP4bM3Y5.hy9p62Ii7jUmQsb0Xs7 ETqb7wW7BwsOCmqT0cZ9PiKEq7.aHWTN3kxOavqtJb1S3TEdtZQTnOxz4OMBjrZQTct708kZ0FN5 5R2EW0yI2ne6K6jVa19npEXMcoog9JHxDOqn9TB0ddNvC4YlA0JzxeI1QM.X1tMKVGDpoPKCgLgV ahAY.aHUa5DwBSZ3rZasqtL637QByWapdvyYPGfRRXCCNSG.AUrvtEGNdQzKT_X3tU2vXaggRCrC XndKlpry44leUdRRFe2BrJ0gFWYtn_0qpU2dJGvdZ_lcbuZUunDFV.C3scAHMXpUo.sEn8eujGSS vgceTI_zs6GShuFv_1mSBC_GkW5gUkMKWz1vCYMtvd6_tDTxS7rMNIskoyN3fDF5h4eJD7.ImdGs XLmB4GWm_bX4cg2sNuh0shqbw7rLysFs0Uq5WOaXGS5sThWeTnnT13aZZXQC1uTY6Hlm.v_NqLzf dOXHzqUytvc_jiBb.NEhzrAbQzlczdneKwuVVFVD33KvC6UjPMfi8MLTkUNRY6LaMD8R50ojeQxT trQc1bmVKccs0mIWIB2kX2rFYX8a8nVUsrFrwoNIKr1vwTNvMYqslux1nuBhF9ihsvWVihGW6xM5 GJAowXALgjoHgJKqYqSxBFd67RAksfKAQVZbclTSuFfMiwEg6yUOIPdyEM.g49vBk2FTBI20I3P. h5Ait6E2HjPotaIDZZyC4KqoqJxL1BNXudCDJxg--
X-Sonic-MF: <dan.ietf@sipez.com>
X-Sonic-ID: 4187841c-41ae-4ad5-b08e-5d0ff1707438
Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.ne1.yahoo.com with HTTP; Thu, 4 Apr 2024 23:05:18 +0000
Date: Thu, 04 Apr 2024 23:05:16 +0000
From: Dan Petrie <dan.ietf@sipez.com>
To: Orie Steele <orie@transmute.industries>
Cc: vCon WG <vcon@ietf.org>, Alexey Melnikov <alexey.melnikov@isode.com>, Daniel Kahn Gillmor <dkg@fifthhorseman.net>
Message-ID: <155734004.4688980.1712271916204@mail.yahoo.com>
In-Reply-To: <CAN8C-_L6AXGaPx_SE_4Cjk7=i8jUzwx=NcAGTZ1VhbBeQrfufA@mail.gmail.com>
References: <923730760.1991278.1711573128213.ref@mail.yahoo.com> <923730760.1991278.1711573128213@mail.yahoo.com> <CAN8C-_LqL_UWW+5NPJ0QzFzOOFtqoP61wU_HEwW9rGOWq9iefw@mail.gmail.com> <CAN8C-_JZXGZzVQVsY50qNtyQ5Te-55vSTrtj-0O0=C=0_kfaGw@mail.gmail.com> <CAN8C-_L6AXGaPx_SE_4Cjk7=i8jUzwx=NcAGTZ1VhbBeQrfufA@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="----=_Part_4688979_1500455209.1712271916201"
X-Mailer: WebService/1.1.22205 YMailNorrin
Archived-At: <https://mailarchive.ietf.org/arch/msg/vcon/TPUgQdo64tSLkRKvuEPoJhPr2uQ>
Subject: Re: [Vcon] Email metadata in vCon
X-BeenThere: vcon@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: container for conversation data <vcon.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/vcon>, <mailto:vcon-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/vcon/>
List-Post: <mailto:vcon@ietf.org>
List-Help: <mailto:vcon-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/vcon>, <mailto:vcon-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 04 Apr 2024 23:05:24 -0000

 Hi Orie:Thank you for exploring SMPT with respect to vCon.
There are two aspects of this.  Part of the goal of vCon is to abstract the metadata to a common set across all communications modes (SMS, email, web chat, phone, video conference).  If we just encapsulate SMTP in JSON, we have not accomplished this.  It's important to find the common data across the communications modes and map them to an abstraction.  This allows the consumer of a vCon to do things like get the data, or parties, or text to the conversation and know have to know any details about the communication mode and and its protocol or format specifics.  What I am looking for feedback on, is what of the SMTP headers, do people feel is the metadata that should be abstracted in the vCon and may be common with other communications modes.
On the other hand we are also trying to contain or reference all of these communications in their various modes and format.  We could just contain the whole SMTP message if we wanted to with no loss of data.  I am not sure we need a loss less capture in all cases though.  Perhaps is is sufficient in the SMTP case, to contain the body/multipart-mime and some small portion of the SMTP headers, loosing most of the transport details.
Cheers,Dan

    On Thursday, April 4, 2024 at 03:05:57 PM EDT, Orie Steele <orie@transmute.industries> wrote:  
 
 Following up on this, I was reading https://www.rfc-editor.org/rfc/rfc4155.txt recently.

I wonder if there are JSON Email representations that vCon might more directly defer to?

I was hoping there might be some JSON based email representation that vCon could cite or otherwise use without redefining terms.

I came across:

https://datatracker.ietf.org/doc/draft-ietf-sml-structured-email/

I wonder if JSON-LD for vCon had been previously discussed, or had there been any conversation about how vCon and SML might fit together or not?

OS



On Wed, Mar 27, 2024 at 4:47 PM Orie Steele <orie@transmute.industries> wrote:

Context for Dan and Alexey:

- https://datatracker.ietf.org/doc/charter-ietf-vconhttps://datatracker.ietf.org/doc/draft-petrie-vcon

We had some hallway conversations at IETF 119, about using vCon & SCITT for transparency and archival purposes.

Regards,

OS 
On Wed, Mar 27, 2024 at 2:44 PM Orie Steele <orie@transmute.industries> wrote:

Adding a few email experts (I am not an email expert).

These parameters look correct to me for vCon, but I am not sure if there are additional email details that should be considered for archival use cases.

I also wonder if there is any encryption or signing information which might be retained in a useful way, such that a holder of a vCon and some trust roots might confirm that parts of a vCon have not been tampered with, without using the custom JOSE approaches in the draft today.

I'm thinking specifically of the case where I might know that a Party had a particular key at a point in time, and I might be able to use that key to verify an email message that had been archived in vCon.

I suppose there could also be DMARC / DKIM fields that we might expect to see preserved per message.

Regards,

OS
On Wed, Mar 27, 2024 at 2:03 PM Dan Petrie <dan.ietf@sipez.com> wrote:

Hi Orie:You are probably swamped, catching up after IETF 119.  When you have a few minutes, it would be great to have your input on this.
I think that you have worked with email in a vCon more than many people have so far.  However, if anyone else on the list has any thoughts on this, I would greatly appreciate your input too.
I have done a little work putting email messages into a vCon, one message per dialog.  Mostly, my use was in some simple unit tests and in generating examples for the I-D.  The table below maps the SMTP headers that I have put into a vCon.  
Are there any other SMTP header fields or metadata that you think should be possible to include in a vCon?
Do you agree with the mapping from SMTP to vCon parameters?
Cheers,Dan






-- 




ORIE STEELE
Chief Technology Officer
www.transmute.industries






-- 




ORIE STEELE
Chief Technology Officer
www.transmute.industries






-- 




ORIE STEELE
Chief Technology Officer
www.transmute.industries