Re: [Last-Call] Last Call: <draft-koster-rep-06.txt> (Robots Exclusion Protocol) to Informational RFC

Ted Hardie <ted.ietf@gmail.com> Tue, 08 March 2022 09:19 UTC

Return-Path: <ted.ietf@gmail.com>
X-Original-To: last-call@ietfa.amsl.com
Delivered-To: last-call@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1B94F3A0D77 for <last-call@ietfa.amsl.com>; Tue, 8 Mar 2022 01:19:04 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.107
X-Spam-Level:
X-Spam-Status: No, score=-7.107 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id SY0kPsnQZoVs for <last-call@ietfa.amsl.com>; Tue, 8 Mar 2022 01:18:59 -0800 (PST)
Received: from mail-io1-xd2a.google.com (mail-io1-xd2a.google.com [IPv6:2607:f8b0:4864:20::d2a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 96C283A0D75 for <last-call@ietf.org>; Tue, 8 Mar 2022 01:18:59 -0800 (PST)
Received: by mail-io1-xd2a.google.com with SMTP id c23so20251124ioi.4 for <last-call@ietf.org>; Tue, 08 Mar 2022 01:18:59 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=zjCsugeMeAaD0vLtETIsqguUeP+4gT1V9U0AZCZAzCk=; b=GNruU/0+rzAD+nOhdVpRQoHZwjUC9VIZ1Cs178qyStk2sg6PeDhGKUxDlYxWEyLGQ2 JNZghtIeSwCaaChVJQOPQKe0v2vgN13W7ASG5dK5cVls3gmUwJbvTpXI/Q/hKXIIFVQo wzzRekcLCAkep6wRAkvUdhG7DFzGQz1vK6yoJ+1axQMPIb+PboxRfT+DuKGBpwsrt1hM 5SUF8TERkV4yO2RIJbD9tadOvba1QodqRxyfkpDgbtx/99o4z15RTIbUiocyUeey3Rea vFX7mTuVfrbZeWYCsC3SkA4mGD7fUXlsc+DI8TKGym1ljbIkc0aZIyb9Ek2sK2+HT8z6 DNyQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=zjCsugeMeAaD0vLtETIsqguUeP+4gT1V9U0AZCZAzCk=; b=g01L9U7xlMqLPofn92EI2jnghEce4Y78nr+aTIETitvfC4QKB8qx5tOuBej2P4sTAm DpPs+6TX3JPi4Hr+LcXRm+OiwawmDEORhZk5q7V/q8UDT9j0Hg6OYzzCJC/oqzEV7M5y MY+CZhQPayme4j3OHd6FottXlT8fEptH9iBLW0Vl4f0FD6PvtGuEwNxpcsgiiXYl/zgH pwDHoaVhaAb2QV3djrm8rLEhFsAKZ8e1261/49zIgCisiK2wgUXsvJs1U3bLqiBpk1h2 xJfbfMrMK9eci39fcfgxdpmv53hEkktVKQA0cOhyHX+0c5lsUMQnAEdlS2iJNhgoAF1r uwAA==
X-Gm-Message-State: AOAM532km69TMf0I07/QEGmEgysRvrzTNVuHnjaALeZOG4zyV1Q2jSbE UPY8Zu5Y3NhHa1Xgz05+qAroIHDRnpTVkBdn5+WnKPD8BGszvA==
X-Google-Smtp-Source: ABdhPJy7B+FpKIGBS3l7sFYzRrNIDNDKiyVNE+ujIPw4DcsQE7gP/hbuuvCZ4hOroMC7ab8+yOB1FWobdLuAAtJiAKo=
X-Received: by 2002:a05:6638:13cc:b0:317:d7e6:a2b3 with SMTP id i12-20020a05663813cc00b00317d7e6a2b3mr2273015jaj.41.1646731138611; Tue, 08 Mar 2022 01:18:58 -0800 (PST)
MIME-Version: 1.0
References: <20220228222932.825F33844270@ary.qy> <245C65D2-EC38-4C49-9CA0-3DD687CB37DA@mnot.net>
In-Reply-To: <245C65D2-EC38-4C49-9CA0-3DD687CB37DA@mnot.net>
From: Ted Hardie <ted.ietf@gmail.com>
Date: Tue, 8 Mar 2022 09:18:32 +0000
Message-ID: <CA+9kkMAnmoJ0n3mPscZvc6kbyOZjQU78vb+iA0Pw5Qq=_kKZEw@mail.gmail.com>
To: Mark Nottingham <mnot@mnot.net>
Cc: John Levine <johnl@taugh.com>, last-call@ietf.org
Content-Type: multipart/alternative; boundary="0000000000008ebbb505d9b1787b"
Archived-At: <https://mailarchive.ietf.org/arch/msg/last-call/kDsCVuDsMYsNqUUvu0VYnrzbVA0>
Subject: Re: [Last-Call] Last Call: <draft-koster-rep-06.txt> (Robots Exclusion Protocol) to Informational RFC
X-BeenThere: last-call@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF Last Calls <last-call.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/last-call>, <mailto:last-call-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/last-call/>
List-Post: <mailto:last-call@ietf.org>
List-Help: <mailto:last-call-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/last-call>, <mailto:last-call-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 08 Mar 2022 09:19:04 -0000

Hi Mark,

On Mon, Feb 28, 2022 at 10:56 PM Mark Nottingham <mnot@mnot.net> wrote:

>
>
> > On 1 Mar 2022, at 9:29 am, John Levine <johnl@taugh.com> wrote:
> >
> > Most importantly, the copyright license is broken. At the top it has
> > the "no derivatives" license, which is fine,
>
> Ah - I missed, that, thanks for pointing it out.
>
> I'm uncomfortable leaving change control for a key interoperability
> mechanism in the search market in the hands of one competitor, yet blessing
> it as part of the IETF stream. I think the IETF as a whole should be
> uncomfortable with that too, given current competition enforcement trends.
>

Having the original author of the spec be the principal author here is a
bit of a bulwark against that, as I don't believe he is or would be
interested in handing change control over to Google. I also believe Gary
and the other authors have reached out to the rest of the relevant
community (though my change in employer means I know longer have the
relevant e-mails to cite).

On the more general topic of why this has the "no derivatives" clause,  I
understand your reluctance, but I think this is a case where the
combination is valid.  First, it's important to note that the specification
was brought to the IETF for substantive review, to make sure that the
elements it uses (like ABNF) were being used in the right way and to
eliminate any possibility of ambiguity.  From my perspective, that's been
very useful and it would not have occurred to the same extent had this gone
directly to the ISE.

However, this spec reflects operations which have been stable/backwards
compatible for a very long time.  Given that, it is important to the
community which deploys this that it be fairly difficult to amend.  One way
to achieve that would have been to make this standards track; that would
require standards action to update or obsolete it later.  When we discussed
that back at the beginning of this process, though, it was pretty clear
that some folks would use the working group discussion around that to try
to insert functionality that would result in breaking changes.  While it
would have been kind of unlikely for any of those to win out against the
need for maintaining interoperability, the result would have been a pretty
big increase in the amount of effort needed to get this published.

Another option for getting an archival spec with a high bar for change was
this one:  an IETF informational with a no-derivatives clause. That gave
the full benefit of IETF review and made the bar for amendment high enough
to allay the concerns of the original author and the relevant community.
It had this clause when Adam agreed to sponsor it and it has had it in
every iteration since, so I thought this was well understood.  As shepherd,
my apologies if it was not.

There is another option that gets the full set of characteristics needed:
AD sponsored on the standards track.  At the time this went through the
first set of discussions that was something folks had become very reluctant
to do.  If it is on the table, I personally believe that a standards track
document with the usual clauses would work as well.  Those can't be
superseded or amended without serious work and plenty of time for the
relevant community to chip in.

But, absent that, I think this kind of document is why BCP78 permits this
combination: documents which need and have received significant IETF review
but which also have a significant external community for whom the usual
clauses result in a risk of inappropriate later amendments. To put this
slightly differently, I think you'll see that this falls under the logic in
RFC 5378, Section 3, in the penultimate paragraph.

If you and the broader community prefer the standards track approach, now
would be a good time to let the sponsoring AD know.

regards,

Ted Hardie



>
> As such, I believe this draft should either a) drop the "no derivatives"
> clause (preferred), or b) seek publication on a different stream.
>
> Cheers,
>
> --
> Mark Nottingham   https://www.mnot.net/
>
> --
> last-call mailing list
> last-call@ietf.org
> https://www.ietf.org/mailman/listinfo/last-call
>