Re: [Hipsec] HIT collision probability

Robert Moskowitz <rgm@htt-consult.com> Mon, 05 May 2014 20:50 UTC

Return-Path: <rgm@htt-consult.com>
X-Original-To: hipsec@ietfa.amsl.com
Delivered-To: hipsec@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E2A751A0601 for <hipsec@ietfa.amsl.com>; Mon, 5 May 2014 13:50:50 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.55
X-Spam-Level:
X-Spam-Status: No, score=-2.55 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RP_MATCHES_RCVD=-0.651] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id sVDA8LZtPVIU for <hipsec@ietfa.amsl.com>; Mon, 5 May 2014 13:50:48 -0700 (PDT)
Received: from klovia.htt-consult.com (klovia.htt-consult.com [IPv6:2607:f4b8:3:0:218:71ff:fe83:66b9]) by ietfa.amsl.com (Postfix) with ESMTP id BE0FA1A0549 for <hipsec@ietf.org>; Mon, 5 May 2014 13:50:47 -0700 (PDT)
Received: from localhost (unknown [127.0.0.1]) by klovia.htt-consult.com (Postfix) with ESMTP id D4A836347E; Mon, 5 May 2014 20:50:42 +0000 (UTC)
X-Virus-Scanned: amavisd-new at localhost
Received: from klovia.htt-consult.com ([127.0.0.1]) by localhost (klovia.htt-consult.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id PDwpyxz9iEW5; Mon, 5 May 2014 16:50:31 -0400 (EDT)
Received: from lx120e.htt-consult.com (lx120e2.htt-consult.com [208.83.67.155]) (Authenticated sender: rgm@htt-consult.com) by klovia.htt-consult.com (Postfix) with ESMTPSA id 251F56345E; Mon, 5 May 2014 16:50:31 -0400 (EDT)
Message-ID: <5367F996.4050005@htt-consult.com>
Date: Mon, 05 May 2014 16:50:30 -0400
From: Robert Moskowitz <rgm@htt-consult.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.4.0
MIME-Version: 1.0
To: Rene Struik <rstruik.ext@gmail.com>, hip WG <hipsec@ietf.org>
References: <53665F53.6010006@htt-consult.com> <5367DD73.5000007@htt-consult.com> <5367E74D.3020501@gmail.com> <5367F243.5010003@htt-consult.com> <5367F35F.6020604@gmail.com>
In-Reply-To: <5367F35F.6020604@gmail.com>
Content-Type: multipart/alternative; boundary="------------010800080900070208030805"
Archived-At: http://mailarchive.ietf.org/arch/msg/hipsec/8sCM3ZH5yfhPLjoa_2FTsbRzPiY
Subject: Re: [Hipsec] HIT collision probability
X-BeenThere: hipsec@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "This is the official IETF Mailing List for the HIP Working Group." <hipsec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hipsec>, <mailto:hipsec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/hipsec/>
List-Post: <mailto:hipsec@ietf.org>
List-Help: <mailto:hipsec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hipsec>, <mailto:hipsec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 05 May 2014 20:50:51 -0000

On 05/05/2014 04:23 PM, Rene Struik wrote:
> Hi Bob:
>
> Let me clarify, the quantity p(k,n) below is the probability that k 
> randomly picked elements taken from an n-set are all different (i.e., 
> no collision occurs). You may be looking for the probability of having 
> at least one collision, which is 1 - p(k,n).
>
> I hope this helps.

that was it.  I missed that smallish detail.  thanks.

>
> Rene
>
> On 5/5/2014 4:19 PM, Robert Moskowitz wrote:
>>
>> On 05/05/2014 03:32 PM, Rene Struik wrote:
>>> Hi Bob:
>>>
>>> The formula is roughly p(k,n)=1*(1-1/n)*(1-2/n)*...*(1 - {k-1}/n), 
>>> which can be approximated as roughly e^{-k^2/(2n)}, where n is the 
>>> size of the set one takes uniformly selected samples from and where 
>>> k is the number of drawn samples.
>>
>> I am doing something wrong in LibreCalc with the formula:
>>
>> =EXP(-(B6^2)/(2*C6))
>>
>> Where B6 is the cell with K (3.86e+12) and C6 is n (2^96).  I am 
>> getting an answer of 99%.
>>
>>
>>>
>>> Rene
>>>
>>> On 5/5/2014 2:50 PM, Robert Moskowitz wrote:
>>>>
>>>> On 05/04/2014 11:40 AM, Robert Moskowitz wrote:
>>>>> What population of HIs is needed for a 1%, 10%, 50% probability of 
>>>>> a HIT collision?
>>>>>
>>>>> I had the math once (like back in '99 or '00) and can't find it 
>>>>> (probably did not survive the Eudora to Thunderbird migration). 
>>>>> Thought I actually had this in a very early draft, but could not 
>>>>> find any such beast.  Of course that would have been for HIPv1 
>>>>> HITs, not HIPv2.
>>>>>
>>>>> Any help on the math would be appreciated.  Also does it change 
>>>>> with PK algorithm or key length?  (seems not to me).
>>>>
>>>> Using the code at: http://en.wikipedia.org/wiki/Birthday_attack
>>>> and compiling and running it via: 
>>>> http://www.compileonline.com/compile_cpp11_online.php
>>>>
>>>> I get the following probablities for HIT collisions:
>>>>
>>>> First the population of HITs (96 bits of hash) is: 7.9×10²^(8)
>>>>
>>>> Then the probablities of collision are:
>>>>
>>>> .01%    3.98076e+12
>>>> .1%    1.25911e+13
>>>> 1%    3.99066e+13
>>>> 10%    1.29209e+14
>>>>
>>>> And thus if each person in the world (7B) had 5 endpoints with HITs 
>>>> on them, the probablity
>>>> of a collision would be 10^-6 %   (p=e-8, pop=3.98066e+10).
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Hipsec mailing list
>>>> Hipsec@ietf.org
>>>> https://www.ietf.org/mailman/listinfo/hipsec
>>>
>>>
>>> -- 
>>> email:rstruik.ext@gmail.com  | Skype: rstruik
>>> cell: +1 (647) 867-5658 | US: +1 (415) 690-7363
>>
>
>
> -- 
> email:rstruik.ext@gmail.com  | Skype: rstruik
> cell: +1 (647) 867-5658 | US: +1 (415) 690-7363