Re: [Doh] [DNSOP] [dns-privacy] Do53 vs DoT vs DoH Page Load Performance Study at ANRW

Willem Toorop <willem@nlnetlabs.nl> Wed, 24 July 2019 21:18 UTC

Return-Path: <willem@nlnetlabs.nl>
X-Original-To: doh@ietfa.amsl.com
Delivered-To: doh@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E1CB7120372; Wed, 24 Jul 2019 14:18:10 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.999
X-Spam-Level:
X-Spam-Status: No, score=-6.999 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nlnetlabs.nl
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id A_-Zk3iRKwwq; Wed, 24 Jul 2019 14:18:09 -0700 (PDT)
Received: from dicht.nlnetlabs.nl (dicht.nlnetlabs.nl [IPv6:2a04:b900::1:0:0:10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 511441202A7; Wed, 24 Jul 2019 14:18:09 -0700 (PDT)
Received: from [10.0.1.190] (modemcable171.137-178-173.mc.videotron.ca [173.178.137.171]) by dicht.nlnetlabs.nl (Postfix) with ESMTPSA id B9FBF113D0; Wed, 24 Jul 2019 23:18:04 +0200 (CEST)
Authentication-Results: dicht.nlnetlabs.nl; dmarc=fail (p=none dis=none) header.from=nlnetlabs.nl
Authentication-Results: dicht.nlnetlabs.nl; spf=fail smtp.mailfrom=willem@nlnetlabs.nl
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=nlnetlabs.nl; s=default; t=1564003085; bh=p6stGxKZbKPizs+mW8CTrg0eBwswg9fgLlduVG20WjA=; h=To:Cc:References:From:Subject:Date:In-Reply-To; b=KhFdwQKbTqIZjA16hI6E6bYwKfEl4aNIwkgHRYTS9/bhTFd1cGGOOl/lnSQEtQEy9 qPFciFCqeP91L7o1/Y+vmPyk7OdBNY/PELCQWyNzsJ4pZ+GJ5ABrROStd+VmzkNrV5 6GrpwInQdO8NZQXUUZ3xG3nMSDJa2fpO6JH77WIg=
To: Puneet Sood <puneets=40google.com@dmarc.ietf.org>, Kevin Borgolte <kevin@iseclab.org>
Cc: DoH WG <doh@ietf.org>, add@ietf.org, pschmitt@cs.princeton.edu, dnsop WG <dnsop@ietf.org>, feamster@uchicago.edu, jordanah@princeton.edu, dns-privacy@ietf.org, Rob Sayre <sayrer@gmail.com>, ahounsel@cs.princeton.edu
References: <402781F4-33D8-4FD4-8087-FDCEFFF2D549@iseclab.org> <CAChr6SwBKOymQjKsN+GEnygn5ogJb6WUMd=jxRrV2eQWwdiBcg@mail.gmail.com> <267CBE74-9DC5-40D8-A61F-7C566644A1CB@iseclab.org> <CA+9_gVsKKOtiu6EXK+mrF_kkva-cORLuU2p3zijbPUvSVF5K5g@mail.gmail.com>
From: Willem Toorop <willem@nlnetlabs.nl>
Openpgp: preference=signencrypt
Autocrypt: addr=willem@nlnetlabs.nl; prefer-encrypt=mutual; keydata= mQINBE1s81EBEACuJzGgccrmYEAzHc//vBq66gH7orM0GtKfQZHh4uR1FMxZXl07WevUYNuB ywTpinU9rpY1Q3S4w6QgNklgpsaHXmbOpyFjJ8FpllV8TRPiXiNrNxTpMnlb6InoszopX69t kBVHTP6cJkNgPx6R4BM0ARqEGQmOL8mAcoWyGVzbsamuGRaia54zs/kc3i9yiqEzRkoQmfwr 7sr49n7gOpmaqXvonOSiUvgEziep77emMcqVa/qZxR1r7KUq85qTNTqsQwl2cQdKS7WwOeuG 6ZIJmJ1bakriKzLBYF5xIHKSYJW0ZA20tNFrVKgTkEjiXvAJh4HlJEIi35tqa/IzWUJSc1ai nhBjxbwSl8BRq5aaPgwB+xXiDqY6BrQW1slvl5TF2A6Xr7JJ0rkH3EZgXxABAZ3WJ3RLwq1z 8jnNYj+UW/mSLsbOtgfOiBhFUXMZneHvVVvz6F6XAtyrejDl5sD2gnzm1VDfK6T6bvLtR7zr kWre0lpycDmgmUKgaEiXzfLvwT9RaWk8GdqU2GG+QOiwf+hT0peDieuodjMr59sUbx7GqVe/ 45rJBRSx+HCl2Jm7Th2Xr0kpStCd7ebVoEq9wpMyu+dM9wOTtibA9P3+9u4rAdimpAdQxEbh WbRNCng2EVhThbqRK3cTZLbtqKaWgAJqa/IQVpL9b5ps8Z4JVQARAQABtCNXaWxsZW0gVG9v cm9wIDx3aWxsZW1AbmxuZXRsYWJzLm5sPokCPgQTAQIAKAIbIwYLCQgHAwIGFQgCCQoLBBYC AwECHgECF4AFAlbUE5oFCRDr7kkACgkQ5fj4IS93pJiGfA/8C1+/M+EaQItVzQ/iPCbagBTq WOSispMzJne9gmimJzPs+lxgnrXOuYlIBywHpWB2Jmz45h+Cc4+di48WQfV9tHENn9MVFkwK zSdcY6v5eot6xSY5FRHS226MPR9UJ8/z5PvlizZUVbbM+Ngxg3Rx045Q0FnQm0o5VasEJ1Po R3CSiELJoZ13ukTk5pQlKyVknUKH1E1ds+Xtg1jpZBqiLiBzcLkKWYqBvrXI6XAEPr+woRgj 3xV8P24Uj232uK7xoe82jWIeZWXt/AbHBSmNOWPIgMd9i3FjdeTDml5sZSy3BlDYMr8hINen hYLhdLpJnXwPcsaj0ivcV+xSjLtSh0mE4gudcVhk5XR1M6emSlATC6+Bqn0M9JNTn4SHhkNS yo87aPwKqWFDlvjAZlRyPym9miJBlzech2uOlYSk6GFuead7MpGAipf5PwNNRKDMDi3y+H47 YG2izbrqj3cOZdqZmErwrzCU8xVkxzY/EY6w/MNMFNeqmXVGxzIZ8y9KAjH6JO96M/AxS4mX HJh1ocfHtSm90Ahy/HPJK+2+5+IgkAymKsvyIbvjs7FccMUo+OiSPWYi+xO/NXA4pBlUuGmV 55Kog7ym1flzo8OD9uHfLPrVORBHgnsITbzf9vgJ0emy8fxMCkzFT334gC1OVhD1ff1frbPX yVbcGI8AO+q5Ag0ETWzzUQEQAKTs4hWz94K66PtsHj/cBtHmJCJx9BsHP8eoUjd4iBR7cWgT Tgt1PGCNBzCPGIuUia808dqxu1L8OWjQpwXDCjXqAibn0mCJMRONVszxJKkjYnZGKGOo8cg7 OmQBZyEd6qrfxVf/dwHLsdQTJZzz9bGOxuYVAAu0q3PHW5gGFc+pp3eN47qzGMxEjsoETj/c laxjqisohG13/hkP6PvDoD7OOdOGdQQP8b4GRBD6rZ/FqMLv4C80zDnzCH1rLpNGQplf1any 06WTAsDL4f6gEALH62TIxOX4U7WxeuvHxyKXOAuN+ex/MvF2az124YbcWC7t1dqVW3ys20zK aememyXSKxV6aMn4KBcJF3CdM1oABZDyviL9el7Q/yQylpZC6El4QowaPIOAuzOdIc6cuM6P TWvBArcKVgQhWfJshfeFmfkxpz/hWc9K40yCjmb+hPZIr3RbXSsQItUUkBqOSMHNroIgX+Ia WMq3e7yMHdMqlKr0lU52lfBbfECjleB/NO4K3SGJBPzTgLtze+LsWxSJQoQMWKv6ISwQrW3r smUjqgQNrSGROX3rRy8Nvuzravs4a3FmdUpHIWw2KfY2M6AsX9HBFuRsimgqFjQm5VbqXA7N tHJCnA1RvqXlg/iJ5w+DElHosxwjHS+UbejDGmVQ+ITqlh3991osPjZq1Iy1ABEBAAGJAiUE GAECAA8CGwwFAlbUE5oFCRDr7kkACgkQ5fj4IS93pJjBwxAAnko5CSFDX/ZqW97satNacACH SAOOM8/jz1p2QtJSwbrbLsJRMpN1mSnjXWPBTmXoP4SGHGtxTVZxrYCpSMEHMqOV4yK3QlUn QXnf+CSvo2Ud3rpCh/lFLVHqG2Sy5Ietf/T+GGsoPd9DIdTHO0aFlW2yRQPxSrbYpv1v2aAC gRO4114qkex2j36diqlLod/OU4OQ51nuSesjTrUM9Fz6ikBJ1UDjakjAXe/HiRxUmdv4LANC mso+Gn17Co5lUdpn3fa8zTwNNAgLm6RBiBSSdaYExM9ir6pHrcWL5N+iZKnVmfE5CBufziZq 7V1E3I4FRuvDN4echbf58c6YxBQDsd9VZMJeFWY60w4JEXpHQdt129GS1FN/2PQ8NmAUXYCk YYk6Lv1tnGJCSLnD3ObLyWm+sjA5yAK2H8WU+nutsDF63yFJujNMpmB3bi9+699TzsyQNVKd 2fH38cgk1gZFb6Nbx9+lrTIwzAJJlOu8UwbR0HgGuRmrWp0EIm3tcy4xqWF3CavnM22BAOKK KH+qnwx8BRrx58coHQFMswW4W7Bo+jpKbQJ4RV2cXUEbmHbYUoXDHZyv/RzOI46dXAoWFc3o CoqLqpsZYZstJ4UJHXB5aHi1zxJDwzKxsflmSKfIUr3glRWCy/ylcPMEXzPBb3qbGFMUboio UjqLuNV4SSY=
Message-ID: <0e59fc40-e25d-68b0-6759-b20484277086@nlnetlabs.nl>
Date: Wed, 24 Jul 2019 17:18:03 -0400
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.8.0
MIME-Version: 1.0
In-Reply-To: <CA+9_gVsKKOtiu6EXK+mrF_kkva-cORLuU2p3zijbPUvSVF5K5g@mail.gmail.com>
Content-Type: text/plain; charset=utf-8
Content-Language: en-US
Content-Transfer-Encoding: 8bit
Archived-At: <https://mailarchive.ietf.org/arch/msg/doh/1LvXjsTQ5JzVXKXKHDNLTEpC8f0>
X-Mailman-Approved-At: Wed, 24 Jul 2019 15:18:25 -0700
Subject: Re: [Doh] [DNSOP] [dns-privacy] Do53 vs DoT vs DoH Page Load Performance Study at ANRW
X-BeenThere: doh@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: DNS Over HTTPS <doh.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/doh>, <mailto:doh-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/doh/>
List-Post: <mailto:doh@ietf.org>
List-Help: <mailto:doh-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/doh>, <mailto:doh-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 24 Jul 2019 21:18:11 -0000

On 21-07-19 16:26, Puneet Sood wrote:
> * The experiment was run from Princeton, New Jersey in Northeast US.
> The location is in a very well connected part of the world between
> network peering points in NYC and Washington DC. You will not see much
> difference (due to network latency) between the cloud providers and
> the default (local) Do53. Running the experiment from locations which
> are further away from cloud providers would provide another
> interesting set of data.

Thanks for this Puneet and for stating this at the microphone during the
presentation.  I have some numbers that support this.

At the hackathon at the African Internet Summit in Kampala Uganda one
month ago, I participated with a team using RIPE Atlas to compare
response time of the locally configured resolvers of RIPE Atlas probes
in the Africa region, to the cloud resolvers 1.1.1.1, 8.8.8.8 and 9.9.9.9.

On UDP, on the median, local resolvers returned responses 27 times
quicker than the fastest cloud resolver: 2ms RTT for the local resolver
versus 55ms for the fastest cloud resolver (which was 9.9.9.9). On TCP,
local resolvers provide responses at least 6 times quicker. 14ms versus
94ms (again Quad9).

We also measured DoT which had +-3 times longer response time than TCP
on the cloud DNS providers.  There were only very few probes with
resolvers other than the quads that supported DoT, but those were also
remote given their long round trip times.

See also our post/report on:

https://labs.ripe.net/Members/willem_toorop/hackathon-africa-internet-summit-2019