[icnrg] Interop testing?
"Mosko, Marc <mmosko@parc.com>" <mmosko@parc.com> Tue, 23 July 2019 16:23 UTC
Return-Path: <mmosko@parc.com>
X-Original-To: icnrg@ietfa.amsl.com
Delivered-To: icnrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id CE7B8120121 for <icnrg@ietfa.amsl.com>; Tue, 23 Jul 2019 09:23:27 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.901
X-Spam-Level:
X-Spam-Status: No, score=-1.901 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=parc.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0Y474hFI2Umk for <icnrg@ietfa.amsl.com>; Tue, 23 Jul 2019 09:23:26 -0700 (PDT)
Received: from NAM05-CO1-obe.outbound.protection.outlook.com (mail-eopbgr720065.outbound.protection.outlook.com [40.107.72.65]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3D6891200BA for <icnrg@irtf.org>; Tue, 23 Jul 2019 09:23:26 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=U32+VGTDslNfLRFYSARmQlDM5yLdcj6JItcHhBY3C76kuf27WxiaIOGen77A7EY2EO5UOjEQZBr2Rw6j5wC21dSLx9PP9Jtlbghfg2SYusjZa/au4mv5k5k6dT/NCIbXgW9uZeR6vSb5drgxLFWM2JFw21tZ4OQSfRau3HI0K9TDCYEL65IHM1u7JEFV23kYOxjaONui+NccE6Wb1wBemX8IR0T7fJ8rBJyFtSnpVj4YQhPb9vZqgPFBSOUhozUhO0JdlnmaCMmD+JBbXrgUKznIX66qVxopLYIiXN4mI5aYtQN7v5rG0T+2lEEULysIwyP2yrdtYTuP/5wyF8qvUw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=a8a8croyEaF1IuXQxhrmWCtWmdPO7+TCb9I/+FKE0HY=; b=WHm+v9qPwShclYXgp6rN9rEMY8qAAYfq7/kFN9SEovd9njbjJTVPrwURkEldeM/O+kY8528Vf2jg3XR3sEQLgu8X9EE0LLtSpLnBX10+mw2hBGobyxgsgWbcC2ExiqL9vcRzJT8TaDCOTML3t68yFXtXrfsFPwTlJhg4/giCpgjnL5BagfxLJJXS5G+xSkMv2/CPkkny7jcq4JC+EXJXlEzedIdCTHpeeacbs+Ub6P9yJILyACKLlYb7q8aIBmATlgvHVfLVNdfVmGFPkUlpDFZDmeFKYVgIVgWhmGkuIhzG3cpkKS0qwaFRRhEvdylCIQj+a+Gy5UV6OUdYIsk6fw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1;spf=pass smtp.mailfrom=parc.com;dmarc=pass action=none header.from=parc.com;dkim=pass header.d=parc.com;arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=parc.onmicrosoft.com; s=selector1-parc-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=a8a8croyEaF1IuXQxhrmWCtWmdPO7+TCb9I/+FKE0HY=; b=ZeR5mb9Lqtcl8iYwkQh0FRTkxUU3/WzlR76tgb8bG9neNf8DJbXmX4MctstYhuTzt0nkvSUVTzDWB1Ta/X6BeXPfbqQf98eAtaIKURitRc3Y4F4hktQ5MAxKHHxck+3yVOjmxFIV6Nm4s+KZsQPd/FEbIy6k3hCONHWOGnyBg10=
Received: from BYAPR15MB3272.namprd15.prod.outlook.com (20.179.57.152) by BYAPR15MB3224.namprd15.prod.outlook.com (20.179.56.222) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2115.10; Tue, 23 Jul 2019 16:23:24 +0000
Received: from BYAPR15MB3272.namprd15.prod.outlook.com ([fe80::fc8e:f281:bd9a:4ca2]) by BYAPR15MB3272.namprd15.prod.outlook.com ([fe80::fc8e:f281:bd9a:4ca2%5]) with mapi id 15.20.2094.017; Tue, 23 Jul 2019 16:23:24 +0000
From: "Mosko, Marc <mmosko@parc.com>" <mmosko@parc.com>
To: icnrg <icnrg@irtf.org>
Thread-Topic: Interop testing?
Thread-Index: AQHVQXHupgVeIm2Th0qjzh1bnIz4QA==
Date: Tue, 23 Jul 2019 16:23:24 +0000
Message-ID: <BYAPR15MB32726D142A48FFA67925CB0EADC70@BYAPR15MB3272.namprd15.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=mmosko@parc.com;
x-originating-ip: [207.115.96.130]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 857eff3e-a166-4199-2930-08d70f8a15cd
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600148)(711020)(4605104)(1401327)(2017052603328)(7193020); SRVR:BYAPR15MB3224;
x-ms-traffictypediagnostic: BYAPR15MB3224:
x-microsoft-antispam-prvs: <BYAPR15MB3224AE134F3C3B9B29A63F74ADC70@BYAPR15MB3224.namprd15.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-forefront-prvs: 0107098B6C
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(136003)(396003)(39840400004)(366004)(346002)(376002)(199004)(189003)(2906002)(81166006)(81156014)(8676002)(8936002)(7116003)(33656002)(91956017)(52536014)(3846002)(55016002)(6116002)(86362001)(76116006)(53936002)(256004)(74316002)(305945005)(3480700005)(7736002)(6916009)(102836004)(71190400001)(14454004)(71200400001)(9686003)(478600001)(7696005)(5660300002)(25786009)(99286004)(186003)(316002)(66446008)(64756008)(66556008)(66476007)(66946007)(68736007)(3450700001)(486006)(4744005)(476003)(36542004)(66066001)(26005)(6436002); DIR:OUT; SFP:1101; SCL:1; SRVR:BYAPR15MB3224; H:BYAPR15MB3272.namprd15.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1;
received-spf: None (protection.outlook.com: parc.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: juAD826sU2fD4OiIxM+JqvyO3z4ADBLTjyxccaV8k8kERAnAVfT28JfmzcK1QFBgXOqzkcZ3JQN8yYdkm41Wd9/DuESjcyk5VRxz5UBDYVMbiwHTjfFSWJELflM3oXnmRk6auuJZewJhHzq/5lXZU8f3BkujW5W/HH8ObCgAsCwMXwR/n64U466vDdqg8TQYW1t7r8gyGOiJyIAUg2oDcylpej3Zq/As4opqnfB2pCt8rrOKbkA8BfZZJ54O3ancJCjbWXDX0fvIAbZsNP9pjzOf8wrWF7nli0/nrMulpTJattWl0OI9iFxNVBxTfJenNNCpyDIZr0lY3rE+6pH2mMd8JpgTbwjTO67h3dj/PaJpLzCg7qBFZ+wITYiVPOxFcLlUIYDpHAwyi3vwn2lzpW0BO0TYdD8pAMCl/h3jJW8=
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: parc.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 857eff3e-a166-4199-2930-08d70f8a15cd
X-MS-Exchange-CrossTenant-originalarrivaltime: 23 Jul 2019 16:23:24.0915 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 733d6903-c9f1-4a0f-b05b-d75eddb52d0d
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: mmosko@parc.com
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR15MB3224
Archived-At: <https://mailarchive.ietf.org/arch/msg/icnrg/aBt4Z2E7tq3IAaPcv_R0clmaKpk>
Subject: [icnrg] Interop testing?
X-BeenThere: icnrg@irtf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Information-Centric Networking research group discussion list <icnrg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/icnrg>, <mailto:icnrg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/icnrg/>
List-Post: <mailto:icnrg@irtf.org>
List-Help: <mailto:icnrg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/icnrg>, <mailto:icnrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Tue, 23 Jul 2019 16:23:28 -0000
Now that we have the RFCs out, do we want to have a round of interop / conformance testing? My idea is that there would be separate client library tests and forwarder tests. For the forwarder tests, we would generate some test vectors of Interests and Content Objects and expected results (i.e. should fail or should succeed). We could then write test rigs for each implementation (cicn, ccn-lite, cefore, etc.), connect them in topologies and run various consumers & publishers. It may be that a single test rig could be used for all implementations. For example, use a ccn-lite forwarder (A) and cicn (B) with a test rig (T) connected T-A-B-A-B-T. For client library tests, I'm not sure what would be a good way to do that. There's a few ideas, but I'd like to hear what people think of this. Marc
- Re: [icnrg] Interop testing? Marie-Jose Montpetit
- [icnrg] Interop testing? Mosko, Marc <mmosko@parc.com>
- Re: [icnrg] Interop testing? Börje Ohlman