Re: [Doh] [Ext] DNS Camel thoughts: TC and message size

Martin J. Dürst <duerst@it.aoyama.ac.jp> Thu, 07 June 2018 12:40 UTC

Return-Path: <duerst@it.aoyama.ac.jp>
X-Original-To: doh@ietfa.amsl.com
Delivered-To: doh@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id C087113111E for <doh@ietfa.amsl.com>; Thu, 7 Jun 2018 05:40:55 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.911
X-Spam-Level:
X-Spam-Status: No, score=-1.911 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=itaoyama.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id uQV2UhRWhcSi for <doh@ietfa.amsl.com>; Thu, 7 Jun 2018 05:40:50 -0700 (PDT)
Received: from JPN01-TY1-obe.outbound.protection.outlook.com (mail-ty1jpn01on0107.outbound.protection.outlook.com [104.47.93.107]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BC1C413111C for <doh@ietf.org>; Thu, 7 Jun 2018 05:40:49 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=itaoyama.onmicrosoft.com; s=selector1-it-aoyama-ac-jp; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=APX7TIqxQaMtIfe4yW5IL2RhHUgGvlTlrhxC8O3A8MQ=; b=Ln8SGPo3vv32Bqp3L7rerzuZ0uN+c34MdQHIqsvClks/JWnWU4K11P99wY+QU6/i0gafvCRgjiSNtPkYGf96Ut6BvsmjRcoMpBz8qNLBZmMksprPL93xYjmXTFYS0wTlGtLRgmfD+bu1ADEJFVLRB0MtZj1kKsjVNhvuORHVoS8=
Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=duerst@it.aoyama.ac.jp;
Received: from [192.168.1.5] (220.108.140.211) by OSBPR01MB1542.jpnprd01.prod.outlook.com (2603:1096:603:3::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.841.17; Thu, 7 Jun 2018 12:40:46 +0000
To: bert hubert <bert.hubert@powerdns.com>, Patrick McManus <pmcmanus@mozilla.com>
Cc: Paul Hoffman <paul.hoffman@icann.org>, DoH WG <doh@ietf.org>
References: <20180606093212.GA23880@server.ds9a.nl> <alpine.DEB.2.11.1806061501340.10764@grey.csi.cam.ac.uk> <F5774061-35B9-477F-ADDA-8BB3472F30EF@icann.org> <CAOdDvNq9g3ghbg9fkfhP+ZA4-6E5oDNFCGo6NN9bydqUX76cLA@mail.gmail.com> <20180607093647.GB32326@server.ds9a.nl>
From: "Martin J. Dürst" <duerst@it.aoyama.ac.jp>
Organization: Aoyama Gakuin University
Message-ID: <527501e1-5a0e-fa58-9394-436daf88a77b@it.aoyama.ac.jp>
Date: Thu, 07 Jun 2018 21:40:45 +0900
User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.8.0
MIME-Version: 1.0
In-Reply-To: <20180607093647.GB32326@server.ds9a.nl>
Content-Type: text/plain; charset="utf-8"; format="flowed"
Content-Language: en-US
Content-Transfer-Encoding: 7bit
X-Originating-IP: [220.108.140.211]
X-ClientProxiedBy: TYAPR01CA0106.jpnprd01.prod.outlook.com (2603:1096:404:2a::22) To OSBPR01MB1542.jpnprd01.prod.outlook.com (2603:1096:603:3::17)
X-MS-PublicTrafficType: Email
X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(4534165)(4627221)(201703031133081)(201702281549075)(5600026)(2017052603328)(7153060)(7193020); SRVR:OSBPR01MB1542;
X-Microsoft-Exchange-Diagnostics: 1; OSBPR01MB1542; 3:a4i4FTQFovsQdgWUluqWwmirAd5xn9uDnUUZKyHCIN4iQBYyOU9UGwFcdAgU84agoRap7xw4Cok+H1HZljZEWNEwDEQo2aQkHz6PXAvAoT5ma3WDf31AIf6eHY5WTVE/kzD/hvh9SAbiJMSczZJ8FOL4TgNltTsbmlpWNrnRggn2B20n86Ho2doUd4jrTCJyjkmwDQNDx7+d6THGApSlNuXsvGnO/oyPOG0fAhs1K1qatyusoznfJ5T5L9C+iVki; 25:Gj13FzJcI6nXHEo8+mPyaMO8kugzvN8DF1Aj+ZyWWd97RAx6W5zxSSu785yvar8MnteVAXm/GNHgwnX+Gw+2I7jDXDVMiMU5v8z5m6pXC6YeZLBJqhV0FC0jgMxZGdWZhK9hO0xGWjoKyu6SCyUSSTQR6UDya5+gnI4mSTjNZMo5fU50F9aqMe8MDWkwc6O+SlqfW1Jp7d33b89UEMOlZIxkdPJ0QJrdvjhwDii+OT/YzhGEY9STuzr0yoaTVIy0/0INwvqbIXWv8KaLDIbqMEn0PmarGQdbLB3HcUWDxk60+3Agf2ePUYEFSz016LQ7vptiKqsAk7MKZbZzxjZB+w==; 31:2zx53Y3oZaJLcSzst5h6C3xOixBxQh/moANpSY6Y7BKx+MtE3nn9WKWKVRN3d/Ph3My5IhaCyc18gdx4w121v8frZj5VOOkVd7jJBkXmXznfMQTUuFoz+nQarRVxeEzo9kXW8Osa6k6LPHrYTVi75s8X+wrC8UqUQ4nvBrkcL7PKfId6AikZALpWAYVZcEEkmGJogQiexzMujcrJNIPx18qTEUTSsbGHoZRjbfRVBhw=
X-MS-TrafficTypeDiagnostic: OSBPR01MB1542:
X-Microsoft-Antispam-PRVS: <OSBPR01MB1542DB5D20CDB3A9E6B761FCCA640@OSBPR01MB1542.jpnprd01.prod.outlook.com>
X-Exchange-Antispam-Report-Test: UriScan:;
X-MS-Exchange-SenderADCheck: 1
X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(8121501046)(5005006)(93006095)(93001095)(10201501046)(3002001)(3231254)(944501410)(52105095)(149027)(150027)(6041310)(201703131423095)(201702281529075)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123560045)(20161123562045)(20161123558120)(20161123564045)(6072148)(201708071742011)(7699016); SRVR:OSBPR01MB1542; BCL:0; PCL:0; RULEID:; SRVR:OSBPR01MB1542;
X-Microsoft-Exchange-Diagnostics: 1; OSBPR01MB1542; 4:112rqVnsAQNa9qTiIlHs8grln0XT1I3B/WM2SKzNH5ni5rDXaKJmskCUBeEiPbBvZYEY7pjiK2FHg1sK4nR0kedOlXl5QNkKcWjymMMWkA+6BESFyeMleh46XZMC9gdHy967ChJX23b9jyjrKgtVsE7CbmVcGQOiwOAW4/WszsB0djAuZojG7tL0CIKv7d/K/Xxemrd6rBDHfQ1d0NltXFhHU/AkoeAsXlEs5WEJZpp9d6RupQinHLnheSCJVnoNfRqbHQixDCAh0j1apVzxYg==
X-Forefront-PRVS: 06968FD8C4
X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10019020)(6049001)(376002)(396003)(366004)(39840400004)(39380400002)(346002)(199004)(189003)(77096007)(3846002)(81156014)(81166006)(6116002)(26005)(65806001)(65956001)(31686004)(47776003)(8676002)(66066001)(68736007)(23676004)(229853002)(74482002)(65826007)(5660300001)(186003)(16526019)(106356001)(64126003)(50466002)(478600001)(230700001)(117156002)(105586002)(8936002)(2906002)(15650500001)(7736002)(2616005)(52116002)(25786009)(97736004)(305945005)(486006)(53936002)(956004)(11346002)(476003)(93886005)(4326008)(86362001)(6246003)(31696002)(59450400001)(67846002)(36916002)(386003)(53546011)(16576012)(316002)(786003)(110136005)(2486003)(54906003)(58126008)(76176011)(52146003)(446003)(6486002); DIR:OUT; SFP:1102; SCL:1; SRVR:OSBPR01MB1542; H:[192.168.1.5]; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:0; MX:1;
Received-SPF: None (protection.outlook.com: it.aoyama.ac.jp does not designate permitted sender hosts)
X-Microsoft-Exchange-Diagnostics: 1;OSBPR01MB1542;23:nEpQTYZqr3vdvJixmNEUUYEBef3ntb/JrIavLGDWIlivb9HSBn23v4qwbiFDCujfjiIGENBL0NvbyInO4FxajXT2ReX1cvSi40+KG1iwikACyBxosv3fO9nuzqui4bi9n3KEbgYSRP4UYGF69/fnwv9gAp3HcX2Xk2bu7pCW0DjhLKFCNbnB9m9FqNH5l1qL2fd0dcyKj77/udotFJ2kXesOzWhNtltm2uKiopkUgXC65deRhM2qDMb7Z7e92/dj77mdZNx7P/ZOP74Ua65K/jM6YtSg7O3oMZlHwu8lqpSuMgmyAp0xWEXsBXj16mlexkAgiLm2//RdKfk8cNxiy2Cgi93zGVIwhoKbnQ3n8mTg7EnVgOQsmrC9+buV6H7pyRO8200ftRQPeWudY73XG4m4goH/QQRjOnph8aL1yyW4byKtKtK+yFFBOYLGb8w7cc2Jf4Pjw4wjOpeW6bCnRE7XJMrwdREodp0rYZCMBKqs+VAWhmpSk5fIihHE2oe6bGUzQCz4tO5lEP0zgU+G3O9RdOgWJxneFl0mr8NKXP1Mz3Ftos2XOaLyLE7OEHGDFK2U04XMSbigOamQf/BtJRrOgcJaCpdwFUC3rPT7vMcEkSNImBLAZKB85qbmTp9UXrC1TG/NsGQ/lO8c9e8x33jhnR4lMwE1eSkNxUvRdy6HSkZFD+NY1sr+UtHtAHI+NbHD8Sc4RJEcoCGgzy4LchF3Vor3Z2iP8VOx8GSGRkGGSaaTpGyJ5Fq0PtJ+gXnmkRR3XMi/K21nADtaOAra5t1dUYD8NjNmieAoyQsstdjGbY6Ew/U0SBY8byGgfahfyqlckI89F3wlzTHaiiHrKq7qzl3MlmFe+k03nBfABuH9l7QbaW3+CnfJdJzuCtx0aeNGKqdP5wvbq/iyzSY6SCUoKb28BiTSqlsvOpr50JlnYEDyR2rS8TOEAswu5Etj/8S5iMzaGuR6vK/2K3EYuob0jXL/u0SEZmmnxZBdCkStnbZ6x/IRjNMur5JOZ+nPraLdMPnZKGNXvWcNJwf/LfCgQ9ySBY7kAm5QHm1ikk8dlUL7fkuI64d+Fho3ZOPvfGu0miWrwY5xmtyEHsqhhUzlA4vp7RwMLFYJCUKFwfbV4nJepp9PABolCjkKPVUXxL5DYahpbIUx3qyuEtnmOCJ2ktfAw61atXTIxsmS5GPYqRUEjF7RHkEwNfdMz+sakpkFGuXm+iqiGsZF7HxfJA3a9P7ruiux19OK/7tMwpZCwK1aGx3wxmjllt4tGiy+DVma3LsPWZC9uxGNY4QoWZ/CkdrYSJKdmu3aKTCLKw5383ix4R73p4Uwe2BmWYCfEJHCPhR27jysqgJdRq5pFdto/pRyJSDRylO591mXVcud25r/t7/zrc8ogX+bLIzCpnaaBj+QHiUIdy0gng6ajJgJ3ZyO+lHmjO7sAT+N+SoBc0UEBaoYV94uO/pMDf1JiIXU/fdKfFZ7+7BBXv9FEJUCJx79GiP5SBZcAEZjmFD5+M0dYtxHapMJ6ke5FqhlYrzayvxMmFnwaU+EdmcCMQV9tJhzMCyyVVdZ+1oXYnA=
X-Microsoft-Antispam-Message-Info: y9OpILFv2dTVd+BXycMrGu7U1TG43ieOefB/scVyn29G1lKbVSFIWTmI+DXwKWFpnIcY+9wx7ZNhca5f7lvL0/FpZmdiw5/orJbfFK5z80tFPt64J0xWFxi14I1sEDnagEaxOC4JfcbUBfIUi6CR+G2ahp5ESm/YVwRjAuUqlQGxlFF/4OdpB1remM+3bLmo
X-Microsoft-Exchange-Diagnostics: 1; OSBPR01MB1542; 6:JbWFzLukr9h6k71YTTBWfrVHhmMMiSTF6xr3DFtm55hM0ZHJWmfvkImkpSeS5OKugPwNSGa/x5gSj3zg+Lsi4NB5fa09JLmrRwBUot53v900cSMS4++3Ev+yqr3LTXVwuH62f9QTlAzOFArBYxTLjvfv77kV2riKDXxQXbIj/uMyupM/h8XYBMnoFajb6RR7293A8v6Ot+de2cFL5jui7RvLb4HVpFyPKuCkaazSbNe0Z2KpRu1wO9g9B8FuZuqWzwmWbbMLUpfTTP5koKxpBslHzTSQGLhJoDeNbTw/eRxyr5N2+fLHIF91O3YfBKS+pc5eDVaovK3BDs2qRTNJqiTUgwQqTSdgyZgcDDM9g5cdqwanwhux11hzAM7a91ejsIIi9KQi5wWbhRePaxbeYGqssYKprj82sJfcEgEpmcaCHK6iryNqWgbYJ+FI2u7KzLyO/Ya7HXCq2OjSUmSTRA==; 5:ebtVZArvR6G2IrRX9pgZ9gimHJRMJQp6KzkoVmCez2yiO5NKEPvk5tmrVxjj7Cnvr7kfbJyCgvilK7YbfB40I0qKOf+W4vmXIoI3iCrMyTTGWeDoR1BQ9hbOimz2UAC7A972m6QwqHx4dgNAk6RFaDwXuKHvpg2QAQT/BiryaY4=; 24:ZnQyTzVRRPM7scfPgO93X47OBtehns2XBKkZ4nvcx7Pj9eiIlOpeA15MRtuOPWtNjkaXgBTkz2DwoYZFYHgFou2Pktf8isz2f+zOVeDFDNs=
SpamDiagnosticOutput: 1:99
SpamDiagnosticMetadata: NSPM
X-Microsoft-Exchange-Diagnostics: 1; OSBPR01MB1542; 7:s8Xwd509nX59DGmOl+E8kFsxjJkcuIt91zA0UTmbTXWLnBpVMIeQrB09BIv4UaKYei7nJAYCMdXzZ+bfKcL/p7oLxh5xiQ+7sgbsU3bRKMopD4UoeW+FFUamrm8daKdHu1HiEWgZZBZxYDZEwG4mx6XrNidJ8SAeol73nsTXnZ8A4y1kenpzfnqSbhrbZAzGbjI/NcMuVA0/f8TWue5mK5Xi/weVzYn8kqjjxjbAg18KQVYrQXO9UZynzWCUjFro
X-MS-Office365-Filtering-Correlation-Id: 6736f301-72eb-432d-ad6c-08d5cc73e4bf
X-OriginatorOrg: it.aoyama.ac.jp
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Jun 2018 12:40:46.9792 (UTC)
X-MS-Exchange-CrossTenant-Network-Message-Id: 6736f301-72eb-432d-ad6c-08d5cc73e4bf
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: e02030e7-4d45-463e-a968-0290e738c18e
X-MS-Exchange-Transport-CrossTenantHeadersStamped: OSBPR01MB1542
Archived-At: <https://mailarchive.ietf.org/arch/msg/doh/hPfmJU339-FSTgEWIYRHICKC968>
Subject: Re: [Doh] [Ext] DNS Camel thoughts: TC and message size
X-BeenThere: doh@ietf.org
X-Mailman-Version: 2.1.26
Precedence: list
List-Id: DNS Over HTTPS <doh.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/doh>, <mailto:doh-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/doh/>
List-Post: <mailto:doh@ietf.org>
List-Help: <mailto:doh-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/doh>, <mailto:doh-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 07 Jun 2018 12:40:56 -0000

Hello Bert,

On 2018/06/07 18:36, bert hubert wrote:
> On Thu, Jun 07, 2018 at 09:19:06AM +0200, Patrick McManus wrote:
>> it seems possible that this is a property of the default media type not of
>> DoH. e.g. a negotiated json response wouldn't have this kind of limitation.
>> Does that make sense?
> 
> Firstly, it is not a media type limitation. It is a question of if we want
> to extend DNS into a territory where it has never been before. The moment
> 100 kilobyte DNS answers become possible, we need to redo a ton of software.
> This is true if the end transport is JSON or a DNS message wrapped into an
> HTTP response.

I think I agree with Patrick that it is a media type limitation. I might 
be wrong, but I don't see a way for a JSON-based format to be as 
efficient as the binary DNS format(s). Even if it were possible, a JSON 
format could contain lots of additional spaces without changing the 
meaning of the message at all.

So for a JSON message, there's not limit of 64K on the actual message 
length. But there is (or should be) an *indirect* limitation that can 
roughly be expressed as "a JSON message, when converted to a binary 
format, has to fit into 64K".

> Before typing a lot more characters on this, can I ask who is actually
> arguing that we need bigger DNS messages?  Who is hurting under the 65536
> byte constraint?  DNS over HTTPS implies that we have access to HTTPS.  This
> protocol supports messages as large as you want.
> 
> The one reason you might like DNS to be able to do something new and large
> is because you might have no alternate way of getting large data.
> 
> So I ask, who wants to fundamentally extend the DNS protocol with messages
> of a size never seen or supported? Who is the customer?

Not me, at least not for now.

Regards,    Martin.