Re: [MLS] TreeKEM: An alternative to ART

Eric Rescorla <ekr@rtfm.com> Thu, 03 May 2018 22:31 UTC

Return-Path: <ekr@rtfm.com>
X-Original-To: mls@ietfa.amsl.com
Delivered-To: mls@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9FE1A12DA26 for <mls@ietfa.amsl.com>; Thu, 3 May 2018 15:31:11 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.908
X-Spam-Level:
X-Spam-Status: No, score=-1.908 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, T_DKIMWL_WL_MED=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=rtfm-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id GeBXX7ROJAFv for <mls@ietfa.amsl.com>; Thu, 3 May 2018 15:31:07 -0700 (PDT)
Received: from mail-ot0-x230.google.com (mail-ot0-x230.google.com [IPv6:2607:f8b0:4003:c0f::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 29AE512DA29 for <mls@ietf.org>; Thu, 3 May 2018 15:31:07 -0700 (PDT)
Received: by mail-ot0-x230.google.com with SMTP id t1-v6so22474476oth.8 for <mls@ietf.org>; Thu, 03 May 2018 15:31:07 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rtfm-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=52906xOrIU1iCj3Y5VxIY7iGoJHDpldsl4pAB/TTIuE=; b=oWJWLSm1sn5AzcfGXTrmF9qAhYDRQayT4sYIsOL3xtL79nP2iuF530noBY4SXukHXf mFKt+mPkDpaur2UGx52B0c01rFGyYzxX3K5mHp4qlcX/UstgJ1A26dF+MJasGT3ruUZo GS9XbAshQXRhLrMI3eDDXUyF7cNZDJ4SimpBwh1UJ+NG423Ten9fh8sTAYIlV6VVTNGb EaPSPa7ctXfgCOF8cmFa2leW798ruTWsyzhC/rpn2jdu6dGI58H41n8hfaRrdDfdTD/F f6NOGyLUy37Lm9NGsN/BLJ+0SUCpHN+MlgxIxRlFdMVTavmPEZ5pcYhVeAFN3toGuEdY hcHA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=52906xOrIU1iCj3Y5VxIY7iGoJHDpldsl4pAB/TTIuE=; b=HifwwNKW2SIkwQXijexTORskZwH59txPeBsYxVfy27R5qIxFEAy5Dk8giHxY2TrYiQ CnMyMfhxQ5pg9RkzG21VgpnDl6+FIZ25+D0eNcgpvfd8JiqIZck/bGwji/O/GkEm7aBu B8JRuw6TyBcMcWYKArPlO8H+Cd++E98nUaWdmGzrGXe1366g9JEiravVNCWeo27O2MUx TxjVIVxNMc1DsJm3BJgAUHVGCtfl6yFfDJZlG1zrdrl0EUcGjakV87n/HM+cIWJvVL6i SEYZY5+zYx85E1jybAbl39q/0dOEXz71Mm8vzamZcLgX/O8zTcJVAHndPB2K93scs6Kz jS9g==
X-Gm-Message-State: ALQs6tD57Q2/YhxT52SAUUmjSMyNwtVaSj3MsCpY9QEmsYcaMZr5eDyU wy+ROpvru8/QHT5bLGsckr5xzBdsvfGbvKnkI0iIuw==
X-Google-Smtp-Source: AB8JxZopsB/oeUrMpjxVWwFKVx+9oTNnJJK+GCk2RyqWE6c0tD/cCpD9ZShRLzm6YZiIzicwlXhGmwElCHZ62JRyH5A=
X-Received: by 2002:a9d:72c6:: with SMTP id d6-v6mr4946398otk.392.1525386666353; Thu, 03 May 2018 15:31:06 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.201.118.130 with HTTP; Thu, 3 May 2018 15:30:25 -0700 (PDT)
In-Reply-To: <CAL02cgTpwZQboYZ-wjUGPG3ACsORxJuk9_sneKcFD+=rMSuyuA@mail.gmail.com>
References: <CABcZeBOGJTYTGqYLhqafM=yE9hCZP06KbjKfBqMVTr=yoUYUrw@mail.gmail.com> <CABcZeBOTTe=8mw3q7FXNLWD7pe=XTuKj3P3C1=-GXHZSFQybzw@mail.gmail.com> <CAL02cgRn6wHMDoCL+UCaHtD8GV30=+aSrvCY+Jf64tKtqkfV2Q@mail.gmail.com> <1525379746.825004.1360053824.4E4ADFCA@webmail.messagingengine.com> <CAL02cgTpwZQboYZ-wjUGPG3ACsORxJuk9_sneKcFD+=rMSuyuA@mail.gmail.com>
From: Eric Rescorla <ekr@rtfm.com>
Date: Thu, 3 May 2018 15:30:25 -0700
Message-ID: <CABcZeBN8adkXcTc+qiJwu5197vu6ybnvLY1ekjtwvVzpGoRicA@mail.gmail.com>
To: Richard Barnes <rlb@ipv.sx>
Cc: Katriel Cohn-Gordon <me@katriel.co.uk>, mls@ietf.org
Content-Type: multipart/alternative; boundary="00000000000064b463056b54c234"
Archived-At: <https://mailarchive.ietf.org/arch/msg/mls/S_AeWEX_RoCpCEOrxnZit_ipxn8>
Subject: Re: [MLS] TreeKEM: An alternative to ART
X-BeenThere: mls@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Messaging Layer Security <mls.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/mls>, <mailto:mls-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/mls/>
List-Post: <mailto:mls@ietf.org>
List-Help: <mailto:mls-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/mls>, <mailto:mls-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 03 May 2018 22:31:12 -0000

On Thu, May 3, 2018 at 3:21 PM, Richard Barnes <rlb@ipv.sx> wrote:

>
>
> On Thu, May 3, 2018 at 4:35 PM Katriel Cohn-Gordon <me@katriel.co.uk>
> wrote:
>
>> Thanks for this, it seems like a solid proposal and has a lot of good
>> points! A couple of things I particularly like:
>>
>>
>>    - using an abstract KEM instead of DH arithmetic is a nice, clean
>>    separation
>>    - it could well be more amenable to formal analysis, particularly for
>>    symbolic tools which can struggle with complicated DH trickery
>>
>>
>>
>>
>> One thing I would like to understand better is how the PCS guarantees
>> interact with merged updates. I think (please correct me if I am wrong!)
>> that a key insight is that the tree is not really part of the update
>> process at all. Instead, the PCS guarantees seem to come from the fact that
>> each agent's update hashes a fresh secret value N into the master secret
>> chain, and the tree is kind of like a broadcast encryption scheme for
>> distributing N.
>>
>
> Yes, I think that's an accurate way to think about it.  To put it slightly
> differently, for a member X to update, it broadcasts a fresh secret value
> to the whole group except old-X, which everyone hashes into the running
> group secret.  The upshot of that in the merged-update case is that if you
> get updates from X, Y, Z, and apply them all, you are secure unless someone
> compromises all three of X, Y, and Z -- just as if they had been issued in
> sequence instead of in parallel.
>
>
>
>> If that's correct, it might be a good separation to make in the
>> design/analysis, and perhaps even a good idea to separate out the fresh
>> value that gets hashed into the master secret chain from the keys used in
>> the tree. (I am a little worried about attacks whereby an adversary manages
>> to receive and decrypt say h^2(k), and then derive h^5(k) and hash it into
>> the master secret to break PCS. Having agents generate one set of keys for
>> the tree and another key for the master chain might help a compositional
>> proof.)
>>
>
> I think this can be done, but it might be expensive in terms of bytes.
> When you send an update, you need to distribute:
>
> 1. A new root secret to everyone
> 2. Private keys for nodes in your direct path, to other nodes in the
> corresponding subtrees (and not others)
> 3. Public keys for nodes in your direct path, to nodes with those nodes in
> their copaths
>

Nit: I don't think you actually need to send the public keys. It's helpful,
sure,  but you don't need it to process the update, and there are
operations where those keys aren't enough (delete of an arbitrary node).

-Ekr


>
>
>>
>> best,
>> Katriel
>>
>> On Thu, 3 May 2018, at 3:36 PM, Richard Barnes wrote:
>>
>> Just for context: Note that TreeKEM, like ART, is an "inner loop" /
>> "subroutine" for MLS.  It handles the establishment of a key that's
>> confidential to the group members.  There's still a need for more mechanism
>> to provide authentication.
>>
>> Speaking of protocol, in protocol terms, TreeKEM, while we haven't
>> elaborated a precise protocol, if you look at the very basic sketch that's
>> in the repo EKR linked, the protocol looks very similar to what we have for
>> ART now.  Basically, where ART sends public keys, TreeKEM needs to send
>> (public key, PKE ciphertext) pairs.  So there's a bit of additional
>> communications overhead, but not a dramatic reworking of the messages.
>>
>> Having spent some time with this approach, I appreciate that it can be
>> kind of hard to digest; it has a few more moving parts than ART.  I would
>> be happy to set up a call sometime if people wanted to talk this through.
>>
>> --Richard
>>
>> On Thu, May 3, 2018 at 10:33 AM Eric Rescorla <ekr@rtfm.com> wrote:
>>
>> Oops. I forgot to attach the paper.
>>
>>
>> On Thu, May 3, 2018 at 7:26 AM, Eric Rescorla <ekr@rtfm.com> wrote:
>>
>> Hi folks,
>>
>> Several of us (Karthik, Richard, and I) have been working on an
>> alternative to ART which we call TreeKEM. TreeKEM parallels ART in
>> many ways, but is more cryptographically efficient and is much better
>> at handling concurrent changes. The most common behaviors (updating
>> ones own key) can be executed completely concurrently, merging all the
>> requested changes.
>>
>> We've attached a draft technical paper describing the details, and
>> some slides, but here's a brief overview of TreeKEM.
>>
>> Code: https://github.com/bifurcation/treekem, https://github.com/
>> bifurcation/treekem
>> Explainer slides: https://docs.google.com/presentation/d/
>> 1myiQ22ddxHAcF8uCJBXk9cdJMvAQfAw9nmKiqE5seJc/edit?usp=sharing
>>
>> As with ART, TreeKEM addresses the scaling problem by arranging nodes
>> in a binary tree. In the steady state, each node i has a key pair but
>> instead of having two siblings do DH to determine their shared key, we
>> derive the shared key by hashing the key of the last node to update.
>> As before, each node knows all the keys to its parents.
>>
>> Imagine we have the four node tree a, b, c, d which was constructed
>> in that order. The private keys at each vertex are shown below.
>>
>>        H^2(d)
>>       /     \
>>     H(b)    H(d)
>>     / \     / \
>>    a   b   c   d
>>
>>
>> UPDATES
>> Now say that b wants to update its key to b', giving us the tree:
>>
>>        H^2(b')
>>       /     \
>>     H(b')   H(d)
>>     / \     / \
>>    a   b'  c   d
>>
>> This requires providing
>>
>>   - a with H(b') -- note that a can compute H^2(b') for itself.
>>   - c and d with H^2(b')
>>
>> Recall that you can encrypt to any subset of the tree by just
>> encrypting to the appropriate set of parent nodes. So, we can
>> do this by sending:
>>
>>   - E(pubkey(a), H(b'))
>>   - E(pubkey(H^2(d)), H^2(b'))
>>
>> Where pubkey(k) gives the public key derived from private key k.
>>
>> As with ART, you then mix the new tree root (H^2(b')) into the current
>> operational keys and use the result to derive the actual working keys.
>>
>>
>> CONCURRENT UPDATES
>> The big win in TreeKEM is that you can handle an arbitrary number
>> of concurrent updates, just by applying them in order. Again,
>> consider our starting tree, but assume that b and c both try to
>> update at once. a thus receives two updates
>>
>>   - E(pubkey(a), H(b'))       [b's update]
>>   - E(pubkey(H(b)), H^2(c'))  [c's update]
>>
>> If we apply these in order b, c we get the tree:
>>
>>        H^2(c')
>>       /     \
>>     H(b')   H(c')
>>     / \     / \
>>    a   b'  c   d
>>
>> a can easily compute this.
>>
>> In order to make this work, we need two things:
>>
>> 1. a needs to keep a copy of its current tree around until it has
>>    received all updates based on that tree
>> 2. there needs to be an unambiguous ordering of updates
>>
>> The way to handle (1) is probably to have some defined "window"
>> of time during which an update can be received. The node needs
>> to hold onto its old key until that window has passed. (2) can
>> be handled by having the messaging system provide a consistent
>> order and then agreeing to apply updates consecutively. If we
>> want to concurrently apply other changes, we may need to sort
>> based on change type within the window.
>>
>>
>> ADDS
>> In order to add itself to the group (USERADD), a node merely puts
>> itself at the right position in the tree and, generates a random key,
>> and then sends the appropriate keying material to everyone in its path
>> to the root.
>>
>> In order to add another node to the group (GROUPADD), the adding
>> node does exactly the same thing as with a USERADD, but also sends
>> a copy of the new key to the node being added.. Note that this creates
>> a double-join, which we will cover later.
>>
>>
>> REMOVAL
>> In order to remove another node from the tree, the removing node
>> sends the same message that the evicted node would have sent if
>> it had sent an update, but with a new key not known to the evicted
>> node (note that this naturally omits the evicted node, because you
>> encrypt to the co-path). This also creates a double-join, where the
>> removing node knows the dummy key.
>>
>>
>>
>> STATE
>> In order to receive messages, a node need only keep its secret keys,
>> which range between 1 key (if it was the last to update) and log(N)
>> keys (in the worst case).
>>
>> In the best case, in order to update, a node needs to also know
>> the public keys for everyone on its co-path. However.
>>
>> In order to be able to do deletes, a node also needs to be able
>> to get the public key for any node in the tree (leaf or internal).
>> It's easy to see this by realizing that to delete a node you need
>> to encrypt a new key to its sibling, and so to delete any node,
>> you need to be able to access every node's public key. However,
>> a node need not store this information, but can retrieve it
>> on demand when it needs to delete another node.
>>
>>
>> EFFICIENCY
>> The paper contains more details. but generally TreeKEM is somewhat
>> more efficient in terms of asymmetric crypto operations than ART.
>>
>>
>> DOUBLE JOINS
>> Like ART, TreeKEM has double-join problems whenever one group member
>> provides a service (or a disservice, in the case of remove) for another
>> group member. In the case of GROUPADD, the double join will resolve itself
>> as soon as the added node updates its key. However in the case of
>> REMOVE, this cannot happen, and so double join needs to be
>> dealt with in some other way.
>>
>> One option is to have selective updates: each node keeps track of
>> extra tree state and uses it to control its updates. For instance,
>> if we never send updates to deleted nodes, than as soon as a deleted
>> node's sibling sends an update, the double-join will be resolved.
>> In a more sophisticated -- but also more expensive to implement --
>> version, we track which nodes control the keys of other nodes and
>> REMOVE all affected nodes when we do a delete.
>> -Ekr
>>
>> *_______________________________________________*
>> MLS mailing list
>> MLS@ietf.org
>> https://www.ietf.org/mailman/listinfo/mls
>>
>>
>> _______________________________________________
>> MLS mailing list
>> MLS@ietf.org
>> https://www.ietf.org/mailman/listinfo/mls
>>
>
> _______________________________________________
> MLS mailing list
> MLS@ietf.org
> https://www.ietf.org/mailman/listinfo/mls
>
>