Re: [Secdispatch] Clarification for a question about OCSP caching from Nick (Cloudflare)

Carrick Bartle <> Tue, 26 November 2019 13:42 UTC

Return-Path: <>
Received: from localhost (localhost []) by (Postfix) with ESMTP id 4F8C3120121 for <>; Tue, 26 Nov 2019 05:42:52 -0800 (PST)
X-Virus-Scanned: amavisd-new at
X-Spam-Flag: NO
X-Spam-Score: -2.447
X-Spam-Status: No, score=-2.447 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: (amavisd-new); dkim=pass (2048-bit key)
Received: from ([]) by localhost ( []) (amavisd-new, port 10024) with ESMTP id INmUjBPusqsK for <>; Tue, 26 Nov 2019 05:42:49 -0800 (PST)
Received: from ( []) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by (Postfix) with ESMTPS id 16B2412009C for <>; Tue, 26 Nov 2019 05:42:49 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;; s=1a1hai; t=1574775767; bh=H9FNFy3myCG9ZYfgfhaLuuIR8P9gqdzJJ3n5ORGADgY=; h=From:Message-Id:Content-Type:Subject:Date:To; b=p0qCuNfVOyjMgbAxmcgJHiJH5p7hwwzeca5DdwC7fvDAu0FVzdaW2qtps/Pi1Tiad O3BK+nRNemAbEATKZDZHE/o0kpjbua++oRuITAtmecy4d4jF7PVNp3253m5wfWt6re y/DcJ/AH5iUuLAdoahGIX9xupXucnQjS/PTehYlgLWeTpSrzrVK8KDkyNB5Nv56XMV txNtZnMHkO/EnQOFWkVX9DWxMSe/VcMhkWuKYzgICIEwvY7baDKEOheCOUpgT5Oz4t ydxaO2he5bZzcbQUFKezl3kQAtHIAG9yC1w09Kp3PusMjk9w5bpakp/vxDzgs4wEUS ofuZCR5HudWEA==
Received: from [] (unknown []) by (Postfix) with ESMTPSA id ED968C1341; Tue, 26 Nov 2019 13:42:46 +0000 (UTC)
From: Carrick Bartle <>
Message-Id: <>
Content-Type: multipart/alternative; boundary="Apple-Mail=_E744FC56-9C01-4621-B755-A52D7B54E6F8"
Mime-Version: 1.0 (Mac OS X Mail 13.0 \(3594.4.19\))
Date: Tue, 26 Nov 2019 05:42:45 -0800
In-Reply-To: <>
Cc: Nick Sullivan <>, IETF SecDispatch <>, Tim Hollebeek <>
To: "Dr. Pala" <>
References: <> <> <>
X-Mailer: Apple Mail (2.3594.4.19)
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2019-11-26_03:, , signatures=0
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 mlxscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1908290000 definitions=main-1911260123
Archived-At: <>
Subject: Re: [Secdispatch] Clarification for a question about OCSP caching from Nick (Cloudflare)
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Security Dispatch <>
List-Unsubscribe: <>, <>
List-Archive: <>
List-Post: <>
List-Help: <>
List-Subscribe: <>, <>
X-List-Received-Date: Tue, 26 Nov 2019 13:42:52 -0000

Hi Max,

What's the current proposal? The draft <> doesn't appear to contain details beyond the notion of providing ranges and information about the entire chain, and it doesn't seem to address the issues raised in the PKIX and LAMPS discussions linked here <>.

At Apple, we also cache OCSP responses in a compressed form, i.e. in Bloom filters. Having the option to receive CRLs in a compressed format like that would definitely be more efficient for us. I'm not convinced that ranges would be as helpful. CRLs are helpful when someone is compiling an entire catalog of revoked certificates. OCSP is helpful when you want to check the revocation status of one particular certificate. If OCSP is instead a hybrid of these two approaches, this assumes that the client is going to want data on the other certificates in the range they receive (many of which won't even exist, since, as someone commented in the pkix thread, serial numbers are often (usually?) randomized). I'm not sure how often that additional revocation information is actually going to be useful to the client. Statistics on that is the sort of data that would be helpful in evaluating this proposal. If it turns out, for instance, that providing ranges ends up saving only, say, 0.1% of OCSP requests, it probably wouldn't be worth the effort.

As for returning revocation data for the entire chain, the question must be asked: which chain? In some cases, certificates are cross-signed, and so there is no one chain to provide revocation data for. Is the client effectively going to delegate finding the best chain to the OCSP responder? I'm not sure that's in the client's best interest, and I'm not sure OCSP responders are going to want to bother handling that.


> On Nov 20, 2019, at 2:47 PM, Dr. Pala <> wrote:
> Hi Nick,
> thanks for the reply. My comments are inline...
> On 11/20/19 1:07 PM, Nick Sullivan wrote:
>> Hi Max,
>> Thanks for your clarification. I now understand the work is aimed at optimizing the number of signatures by the CA's OCSP responder and the number of bytes of unique OCSP data.
> Yes, that is correct. The other optimization is about the ability to provide responses for the whole chain in a single message.
>> Currently, the number of OCSP signatures the CA needs to do is linear in the number of active certificates. This proposal changes this so that the number of signatures is linear in the number of revocations of active certificates. It's conceptually similar to NSEC in that way: it's a cover proposal in which the artifacts are constant size, but require a linear number signatures in the size of the revocation set. Contrast this with CRLs, which require a constant number of signatures, but are linear in the size of the revocation set. So maybe the goals could be better phrased in terms of lowering the cost of generating compared to OCSP and distributing compared to CRLs.
> I am not sure I follow. In PKIs, today, we use both mechanisms. This is because usually the CRLs are used as a backup mechanism for OCSP - we also need to support both because of Certification Policies (exactly as in the Internet PKI environment), therefore it is not a choice :D The proposed approach can be used to (a) limit the amount of data that needs to be generated, stored, and transferred when pre-computing responses, and (b) to compute all responses and serve them from memory - even small instances without any hardware acceleration could achieve reasonable performances (also for shorter validity periods in responses).
>> This proposal implies a middle-ground PKI deployment that has enough revocations for CRL to be inefficient but not enough to cause the negative space of the serial number to be of the same order as the number of certificates. It would be great to see examples of PKIs that motivate this optimization, which is why I suggested that data could help.
> Technically, you are correct. If we could predict the size of CRLs, we could potentially try to understand what that threshold is. However, as I explained in the presentation, the size is fairly unpredictable. That is why we primarily use OCSP today.
>> I should also note that while this proposal reduces the number of OCSP signatures (which can be on the order of 104 signatures for 2-year certs), the impact is less dramatic for CAs that issue shorter-lived certs. For example, Let's Encrypt only signs around 13 OCSP responses for each of their 3-month certificates.
> That is correct, the impact is less with short-lived certificates because in those environment, the population of active certificates is usually smaller. If the population is still large, you still have the same problem.
> You mention that your OCSP responses have a 7 days validity, correct ? My question is: which considerations went into deciding such a large validity period for the OCSP responses (7 days) ? Maybe costs considerations drove the decision ? From a security standpoint, such long validity periods blinds clients from detecting revocation that might happen during the 7-days validity period (the problem is worse now with the deployment of OCSP stapling because clients do not fetch fresh responses at connect time, AFAIK, if stapling is supported). I would expect that few minutes validity windows or maybe few hours would be a better choice - but how much does that cost to Let's Encrypt ?
> The Cable industry has used certificates, for few decades now, for different purposes - as a hardware certification tool and to secure our networks - in this environment, the typical life-span of a certificate is many years (up to 20) and it is tied to the envisioned life-span of the device (no renewal). As you can see, in our environment, CRLs will never be an option and OCSP simply costs too much (for an infrastructure that, over all, has an active population of several hundreds million of active certificates - we might be even beyond that with just the three OpenCable, PacketCable, and DOCSIS).
> Ultimately, we need to work on the solution so that we can have our vendors to integrate it in their products, like CableModes, that are going to be deployed (and provide internet connectivity) for hundreds of millions of households for the next 10 to 20 years. We need to lower the security risks associated with the infrastructures that brings Internet to many of us - revocation is important to prevent possible compromises to go undetected. I think that everybody who has Cable should support this work that is going to directly impact them for many years. 
> Cheers,
> Max
> P.S.: I also have other personal motivations for this work. I think that this is also the right thing to do for non-technical reasons - I come from the OpenSource world that so much has give for the success of the Internet but where there is no money. More efficient technologies could be leveraged by communities around the world who deserve good security but costs get in the way. I know it is not a technical detail, but I think we shall always try to have these considerations in our minds - making the world a better place and less wasteful (energy) is an amendable goal in general and emerging communities could really benefit from our work.
>> On Tue, Nov 19, 2019 at 9:11 PM Dr. Pala < <>> wrote:
>> Hi Nick, all,
>> at the end of the second presentation on lowering the costs of revocation, if I am not mistaken, your question/comment (Nick) was about the fact that Cloudflare hosts / serve most of the cached OCSP responses and that the system does not have issues.
>> I am not sure if this comment is pertinent to what we are trying to solve here... let me elaborate a bit more.
>> The work we have been doing around the proposed topic of work is aimed at lowering the cost of generating and distributing these large volumes of signed data when there is actually no need for that. By optimizing the protocol to provide range responses (or other methods, if we decide to go with a different approaches), we can reduce the number of signatures needed from a CA and their distribution - very expensive operations.
>> In other words, the proposal is not aimed at fixing any caching issues because, as you noticed in your comment, that works just fine. The proposal at hand, instead, is about fixing a problem that CAs are facing today - high costs of deploying and running such systems.
>> On the other hand, your comment made me think about the caching service you mentioned and its associated costs. 
>> Is it a service for which your company charge CAs ? If so, would you be able to share what are currently the costs incurred by CAs to leverage your service ? (I totally understand if you are not willing to - after all, this is usually the secret sauce :D)
>> Last but not least, I also would like to point out that optimizing the revocation can also help open-source communities, small companies, universities, non-profit, etc. by enabling them to deploy cost-efficient systems that can provide good quality of service using less resources (computational, storage, network).
>> Please let me know,
>> Cheers,
>> Max
>> P.S.: If we could combine this idea with OCSP over DNS, we could really provide access to revocation technology for everybody, not just who can afford the price. Unfortunately we know how that discussion went, and I still think it is a very evident mistake not doing it  (I am still working on this in my spare time - I think it is of enormous value for emerging countries to have access to cheap secure technologies and, in my opinion, IETF is dropping / has dropped the ball on this for not-so-honorable reasons, I suspect...). I hope We can fix it in the open-source community.
>> -- 
>> Best Regards,
>> Massimiliano Pala, Ph.D.
>> OpenCA Labs Director
>> <dhmacjdifkefaoin.png>
> -- 
> Best Regards,
> Massimiliano Pala, Ph.D.
> OpenCA Labs Director
> <ijeffbhlgncflbab.png>
> _______________________________________________
> Secdispatch mailing list
> <>
> <>