[Ppm] [PPM] [CFRG] VDAF to Support Federated Machine Learning

Junye Chen <junyec@apple.com> Tue, 05 March 2024 20:47 UTC

Return-Path: <junyec@apple.com>
X-Original-To: ppm@ietfa.amsl.com
Delivered-To: ppm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8E0CFC14F618 for <ppm@ietfa.amsl.com>; Tue, 5 Mar 2024 12:47:16 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 0.595
X-Spam-Level:
X-Spam-Status: No, score=0.595 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, GB_SUMOF=5, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=no autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=apple.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9P3p-ow7DoVG for <ppm@ietfa.amsl.com>; Tue, 5 Mar 2024 12:47:13 -0800 (PST)
Received: from rn-mailsvcp-mx-lapp03.apple.com (rn-mailsvcp-mx-lapp03.apple.com [17.179.253.24]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 127CCC14F616 for <ppm@ietf.org>; Tue, 5 Mar 2024 12:47:13 -0800 (PST)
Received: from rn-mailsvcp-mta-lapp03.rno.apple.com (rn-mailsvcp-mta-lapp03.rno.apple.com [10.225.203.151]) by rn-mailsvcp-mx-lapp03.rno.apple.com (Oracle Communications Messaging Server 8.1.0.23.20230328 64bit (built Mar 28 2023)) with ESMTPS id <0S9W00GJY72OWX30@rn-mailsvcp-mx-lapp03.rno.apple.com> for ppm@ietf.org; Tue, 05 Mar 2024 12:47:12 -0800 (PST)
X-Proofpoint-GUID: 6zCQnjDL9W33FiEOT1ADHczfOEkZJ2c_
X-Proofpoint-ORIG-GUID: 6zCQnjDL9W33FiEOT1ADHczfOEkZJ2c_
X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.272,Aquarius:18.0.1011,Hydra:6.0.619,FMLib:17.11.176.26 definitions=2024-03-05_17,2024-03-05_01,2023-05-22_02
X-Proofpoint-Spam-Details: rule=interactive_user_notspam policy=interactive_user score=0 mlxlogscore=999 mlxscore=0 phishscore=0 suspectscore=0 adultscore=0 bulkscore=0 spamscore=0 malwarescore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2311290000 definitions=main-2403050166
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=apple.com; h=from : content-type : mime-version : subject : message-id : date : to; s=20180706; bh=vvrCbaqsB8rZelfh6C0BGb+TeBfCx7rPHqX9EPUfuJE=; b=NEmVJrJ+LYukWbRUmtn0NNemTuXooh9rJvt7DCaID+RAaWDJ9J3byB0NTIgkOAo0/zhw Kv3R/UzsmsG6dirDy/AiOjMgko8P5U7CCeFLWGOrTIrWBBz6pt/xIFzsP344dtvZGpEw XKuTAsnkK6pRbcuX0lSCJp8EiKUNRyMLZ/nJYs0Mnq+A6SHpxZB/TzgAak9lSf7exc53 vidcvl3q6Rqr3RgKgMqrJhYI8rQIfYbaff/trfaLTsA06LCa/s5hJg0Pj9lGMRhwGA23 WW57ykswkOVTzp2rpWus4oEXnGQaJ7anw3n/KcUK07rkfCds/3dqGF/Q1oJwBuk+SYY2 hQ==
Received: from rn-mailsvcp-policy-lapp01.rno.apple.com (rn-mailsvcp-policy-lapp01.rno.apple.com [17.179.253.18]) by rn-mailsvcp-mta-lapp03.rno.apple.com (Oracle Communications Messaging Server 8.1.0.23.20230328 64bit (built Mar 28 2023)) with ESMTPS id <0S9W00T0K72ONB50@rn-mailsvcp-mta-lapp03.rno.apple.com>; Tue, 05 Mar 2024 12:47:12 -0800 (PST)
Received: from process_milters-daemon.rn-mailsvcp-policy-lapp01.rno.apple.com by rn-mailsvcp-policy-lapp01.rno.apple.com (Oracle Communications Messaging Server 8.1.0.22.20230228 64bit (built Feb 28 2023)) id <0S9W00X0071IIR00@rn-mailsvcp-policy-lapp01.rno.apple.com>; Tue, 05 Mar 2024 12:47:12 -0800 (PST)
X-Va-A:
X-Va-T-CD: 4d9400d6a1b3ad2a1b95138edef86a27
X-Va-E-CD: d4ea3761c316d1a81d4ed96f250e6c7c
X-Va-R-CD: 282aeb9877b03101136ba3fd73afd661
X-Va-ID: 50aff6db-905d-4ee9-80d0-2d884b89e422
X-Va-CD: 0
X-V-A:
X-V-T-CD: 4d9400d6a1b3ad2a1b95138edef86a27
X-V-E-CD: d4ea3761c316d1a81d4ed96f250e6c7c
X-V-R-CD: 282aeb9877b03101136ba3fd73afd661
X-V-ID: e14293ff-ebd0-47b9-a5cf-0f5f23c3e912
X-V-CD: 0
X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.272,Aquarius:18.0.1011,Hydra:6.0.619,FMLib:17.11.176.26 definitions=2024-03-05_17,2024-03-05_01,2023-05-22_02
Received: from smtpclient.apple (unknown [17.11.232.204]) by rn-mailsvcp-policy-lapp01.rno.apple.com (Oracle Communications Messaging Server 8.1.0.22.20230228 64bit (built Feb 28 2023)) with ESMTPSA id <0S9W00YI672NDT00@rn-mailsvcp-policy-lapp01.rno.apple.com>; Tue, 05 Mar 2024 12:47:12 -0800 (PST)
From: Junye Chen <junyec@apple.com>
Content-type: multipart/alternative; boundary="Apple-Mail=_64A5CBEB-780C-4A2B-BCAD-86ED463731F7"
MIME-version: 1.0 (Mac OS X Mail 16.0 \(3774.500.32\))
Message-id: <8DA1542A-259F-4B07-BDC1-FF7F4DC88CD6@apple.com>
Date: Tue, 05 Mar 2024 12:47:00 -0800
To: ppm@ietf.org, cfrg@irtf.org
X-Mailer: Apple Mail (2.3774.500.32)
Archived-At: <https://mailarchive.ietf.org/arch/msg/ppm/zia29bHwTO_lO6jVi-Cics_0itA>
Subject: [Ppm] [PPM] [CFRG] VDAF to Support Federated Machine Learning
X-BeenThere: ppm@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Privacy Preserving Measurement technologies <ppm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ppm>, <mailto:ppm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ppm/>
List-Post: <mailto:ppm@ietf.org>
List-Help: <mailto:ppm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ppm>, <mailto:ppm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 05 Mar 2024 20:47:16 -0000

Hi PPM & CFRG,

We recently proposed a new VDAF [1]: Private Inexpensive Norm Enforcement (PINE) [2] to support federated machine learning use cases. The idea of federated learning is to train machine learning models with gradients (i.e. model updates) from client devices, without the raw client data leaving the devices. PINE is based on a recent paper [3].

PINE VDAF can be used to verify and aggregate client gradients, expressed as vectors of floating point numbers, with bounded “L2-norm”, which is computed by taking the square root of the sum of squares of all vector entries. Its design is based largely on Prio3 [4] in that the norm is computed and verified using an FLP, but it uses a new technique for verifying the correctness of the norm computation that is incompatible with Prio3. The communication cost and computation cost of PINE should be much better compared to those of Prio3 with a new validity circuit.

We will spend some time discussing this new VDAF in CFRG in IETF119, and also its application on DAP [5] in the next PPM meeting as well. In the meantime, feel free to take a look at the draft and the draft repository [6] which has a reference implementation. Thanks!

Best,
Junye

[1]: https://datatracker.ietf.org/doc/draft-irtf-cfrg-vdaf/08/
[2]: https://datatracker.ietf.org/doc/draft-chen-cfrg-vdaf-pine/00/
[3]: https://arxiv.org/abs/2311.10237
[4]: https://www.ietf.org/archive/id/draft-irtf-cfrg-vdaf-08.html#name-prio3
[5]: https://datatracker.ietf.org/doc/draft-ietf-ppm-dap/10/
[6]: https://github.com/junyechen1996/draft-chen-cfrg-vdaf-pine