Re: [ire] Extended verification process of the escrow deposit files

Gustavo Lozano <gustavo.lozano@icann.org> Mon, 17 December 2012 21:39 UTC

Return-Path: <gustavo.lozano@icann.org>
X-Original-To: ire@ietfa.amsl.com
Delivered-To: ire@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D7FAC21F8971 for <ire@ietfa.amsl.com>; Mon, 17 Dec 2012 13:39:37 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.599
X-Spam-Level:
X-Spam-Status: No, score=-6.599 tagged_above=-999 required=5 tests=[AWL=0.000, BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zy0FPBhqCZXO for <ire@ietfa.amsl.com>; Mon, 17 Dec 2012 13:39:37 -0800 (PST)
Received: from EXPFE100-2.exc.icann.org (expfe100-2.exc.icann.org [64.78.22.237]) by ietfa.amsl.com (Postfix) with ESMTP id 4DD2A21F8949 for <ire@ietf.org>; Mon, 17 Dec 2012 13:39:37 -0800 (PST)
Received: from EXVPMBX100-1.exc.icann.org ([64.78.22.232]) by EXPFE100-2.exc.icann.org ([64.78.22.237]) with mapi; Mon, 17 Dec 2012 13:39:31 -0800
From: Gustavo Lozano <gustavo.lozano@icann.org>
To: Christopher Browne <cbbrowne@afilias.info>
Date: Mon, 17 Dec 2012 13:39:30 -0800
Thread-Topic: [ire] Extended verification process of the escrow deposit files
Thread-Index: Ac3cnv+jgmBzXepdRoK1XtSSPK82rA==
Message-ID: <CCF4CFB2.6C64%gustavo.lozano@icann.org>
In-Reply-To: <CANfbgbbZ7aA89XcFXfSMh2XpjVoGUyfkx_K9y0+3kDZGqnzLiw@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/14.2.5.121010
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Cc: "ire@ietf.org" <ire@ietf.org>
Subject: Re: [ire] Extended verification process of the escrow deposit files
X-BeenThere: ire@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Internet Registration Escrow discussion list." <ire.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ire>, <mailto:ire-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/ire>
List-Post: <mailto:ire@ietf.org>
List-Help: <mailto:ire-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ire>, <mailto:ire-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 17 Dec 2012 21:39:37 -0000

Christopher,

Comments below.

On 12/14/12 8:07 AM, "Christopher Browne" <cbbrowne@afilias.info> wrote:

>On Thu, Dec 13, 2012 at 7:28 PM, Gustavo Lozano
><gustavo.lozano@icann.org> wrote:
>> In case of differentials deposits, the escrow agent shall use the last
>>full
>> and all the differentials deposits to perform the extended verification
>> process.
>>
>>
>> I am interested in your feedback regarding:
>>
>>  1. Other tests that you consider should be present in the draft.
>
>In keeping with James Mitchell's comments about "the quick brown fox
>jumps over the lazy dog", which could be set as a domain name, which
>may be "structurally valid," but structurally nonsense, I would
>suggest that mere comparison of escrow deposits is nowhere near
>sufficient.
>
>We could have a near-infinite number of policies, for each bit of the
>escrow format, and someone with a Markov Chain generator could make up
>a conforming escrow file out of random, but still policy-conforming,
>junk.  Verifying that it's not just junk requires looking to other
>sources such as WHOIS or DNS.

GL. The objective of this extended verification procedure is to verify
that the escrow deposit file appears to be consistent.

>
>I daresay I have seen all the cases he mentions as problems, and more.
> Most typical and painful to resolve is to receive phone numbers not
>complying with the ITU E164 standard. My "favourite" was receiving
>contact <contact:id> values that did not conform to RFC 5733, so that
>I had to remap them to new values in multiple places before
>proceeding.
>
>A more legitimate test would be more "end-to-end"; it would compare
>escrow with other notionally authoritative sources.
>
>The approach that comes to mind is to select data from 4 sources and
>make sure that they match:
>
>The data sources:
>
>1.  Escrow is the one that is obviously at hand;
>
>2.  Zone files tend to be not difficult to obtain, and they indicate
>the state of the resolving portions of the 'portfolio' of domains in a
>registry;
>
>3.  WHOIS reports information on the state of the registry, albeit on
>a one-by-one per-request basis;
>
>4.  Submitting DNS requests to the authoritative DNS resolver for the
>registry returns authoritative information on resolution information
>for active domains.
>
>#1 and #2 (perhaps just #1) are available "en masse", for the entire
>registry.
>
>A test that escrow matches against the registry would be to pick a
>sample of domain names from sources 1 (escrow) and 2 (zone file), and
>agree them against WHOIS (#3) and the DNS resolver (#4).
>
>It would not be reasonable to try to do this with all names in the
>registry; a reasonably small statistically random sample should, if
>collected regularly, provide confidence that samples taken from escrow
>match against the "real data" in the registry.  Using stratification
>would be appropriate to make sure that different sorts of cases get
>examined (or perhaps avoided - it's desirable not to have many "false
>mismatches" as would happen when objects legitimately change between
>the time escrow is dumped and when validation tests are done.)

GL. As you mentioned this steps are appropriate for an audit procedure. I
will send your suggestions to the persons involved in the audit process
for new gTLD.


>Over time, a validation involving doing a domain data reconciliation
>of even as small a sample as a few dozen names per day should provide
>useful assurance that the sources are not vastly out of sync,
>particularly if discrepancies get escalated into larger targeted
>samples.  Note that this is the standard sort of thing you'll find in
>literature on auditing procedures.