RE: What's an experiment?

"Brian Rosen" <br@brianrosen.net> Wed, 15 February 2006 19:37 UTC

Received: from localhost.cnri.reston.va.us ([127.0.0.1] helo=megatron.ietf.org) by megatron.ietf.org with esmtp (Exim 4.32) id 1F9SSx-0000hz-J0; Wed, 15 Feb 2006 14:37:31 -0500
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by megatron.ietf.org with esmtp (Exim 4.32) id 1F9SSv-0000gW-5E for ietf@megatron.ietf.org; Wed, 15 Feb 2006 14:37:29 -0500
Received: from ietf-mx.ietf.org (ietf-mx [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id OAA25727 for <ietf@ietf.org>; Wed, 15 Feb 2006 14:35:41 -0500 (EST)
Received: from cdx28.winwebhosting.com ([70.85.255.82]) by ietf-mx.ietf.org with esmtp (Exim 4.43) id 1F9Sh0-0005cU-88 for ietf@ietf.org; Wed, 15 Feb 2006 14:52:02 -0500
Received: from neustargw.va.neustar.com ([209.173.53.233] helo=BROSENLT41XP) by cdx28.winwebhosting.com with esmtpa (Exim 4.52) id 1F9SSc-0005wP-7M; Wed, 15 Feb 2006 13:37:10 -0600
From: Brian Rosen <br@brianrosen.net>
To: 'Brian E Carpenter' <brc@zurich.ibm.com>, 'IETF discussion list' <ietf@ietf.org>
Date: Wed, 15 Feb 2006 14:37:13 -0500
Message-ID: <05b401c63267$3a2c4d40$640fa8c0@cis.neustar.com>
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Mailer: Microsoft Office Outlook 11
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2670
In-Reply-To: <43F3437B.8040506@zurich.ibm.com>
Thread-Index: AcYyQhivCxxfYyKMTCG5kcSThcqT3gAI5vcA
X-PopBeforeSMTPSenders: br@brianrosen.net,brosen
X-AntiAbuse: This header was added to track abuse, please include it with any abuse report
X-AntiAbuse: Primary Hostname - cdx28.winwebhosting.com
X-AntiAbuse: Original Domain - ietf.org
X-AntiAbuse: Originator/Caller UID/GID - [0 0] / [47 12]
X-AntiAbuse: Sender Address Domain - brianrosen.net
X-Spam-Score: 0.0 (/)
X-Scan-Signature: 02ec665d00de228c50c93ed6b5e4fc1a
Content-Transfer-Encoding: 7bit
Cc:
Subject: RE: What's an experiment?
X-BeenThere: ietf@ietf.org
X-Mailman-Version: 2.1.5
Precedence: list
Reply-To: br@brianrosen.net
List-Id: IETF-Discussion <ietf.ietf.org>
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=unsubscribe>
List-Post: <mailto:ietf@ietf.org>
List-Help: <mailto:ietf-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/ietf>, <mailto:ietf-request@ietf.org?subject=subscribe>
Sender: ietf-bounces@ietf.org
Errors-To: ietf-bounces@ietf.org

I believe if the community does not have confidence that the protocol will
actually work on the Internet, then we are experimenting.  I think this
definition would cover a number of protocols we would now consider for
Proposed Standard (rather than Informational), and pushes us back towards
"Running Code".

A protocol that has no implementations and is significantly new and
different that we cannot inspect the document to have confidence it will
work as intended would be Experimental.   This is both a complexity and an
exposition test as well as a measure of how similar a protocol is to other
protocols we know work as intended.

I think that when an author, or an entire work group, dreams up a
significant new protocol and brings forth a complex document with no code,
then we have a research and development effort underway, which should be
allowed to complete; that is, test it.  We have a product (a real standard),
when we show that our research worked.  As with most research and
experimentation, it is not necessary to have market acceptance to have a
successful research project.  It is nice, and a good indicator that the
protocol works.

Brian

-----Original Message-----
From: ietf-bounces@ietf.org [mailto:ietf-bounces@ietf.org] On Behalf Of
Brian E Carpenter
Sent: Wednesday, February 15, 2006 10:07 AM
To: IETF discussion list
Subject: What's an experiment?

When considering some recent appeals, the IESG discovered that
we have very little guidance about the meaning of "experiments"
in relation to Experimental RFCs. RFC 2026 refers to work which
is "part of some research or development effort" and the IESG
has adopted some guidelines to discriminate between Experimental
and Informational documents (see
http://www.ietf.org/u/ietfchair/draft-iesg-info-exp-01.html ).
But beyond that, we do not know what constitutes an acceptable
experiment on the Internet.

The IESG notes that the community could establish a variety of
guidelines describing what is and is not acceptable in experiments.
Historically, the IESG has made decisions based on its perception
that there is a strong desire in the community to publish technology
that is being deployed experimentally.  We encourage community discussion
and development of more specific guidelines on operational conflicts
caused by experiments and how this should affect what we choose to
publish.  (However we recommend that such discussion
focus on the general issue rather than the specifics of any case.)

   Brian Carpenter
   for the IESG




_______________________________________________
Ietf mailing list
Ietf@ietf.org
https://www1.ietf.org/mailman/listinfo/ietf


_______________________________________________
Ietf mailing list
Ietf@ietf.org
https://www1.ietf.org/mailman/listinfo/ietf