Re: [icnrg] Interop testing?

Marie-Jose Montpetit <marie@mjmontpetit.com> Tue, 23 July 2019 17:17 UTC

Return-Path: <marie@mjmontpetit.com>
X-Original-To: icnrg@ietfa.amsl.com
Delivered-To: icnrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id C72111205F3 for <icnrg@ietfa.amsl.com>; Tue, 23 Jul 2019 10:17:20 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.895
X-Spam-Level:
X-Spam-Status: No, score=-1.895 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, UNPARSEABLE_RELAY=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=mjmontpetit-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id FlFxGE8F9Jw1 for <icnrg@ietfa.amsl.com>; Tue, 23 Jul 2019 10:17:18 -0700 (PDT)
Received: from mail-io1-xd33.google.com (mail-io1-xd33.google.com [IPv6:2607:f8b0:4864:20::d33]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4605B1205FD for <icnrg@irtf.org>; Tue, 23 Jul 2019 10:17:18 -0700 (PDT)
Received: by mail-io1-xd33.google.com with SMTP id k8so83533866iot.1 for <icnrg@irtf.org>; Tue, 23 Jul 2019 10:17:18 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mjmontpetit-com.20150623.gappssmtp.com; s=20150623; h=from:in-reply-to:references:mime-version:date:message-id:subject:to :cc; bh=G7cKyx8Q+ardDTXQZV0gu9v5nHgK0S63OOUE9WxKUt8=; b=vwUVjxcfITdxooe/4BV2hkaY8AluzmzynrUkPFGjnQ6JP1AsFKf5X/9zEOotdYtcrD BgaHhuGa/HOQT7bbnN7pCNzE0M4cvGzDflr4EUYRw7AicB3VYZKMtTuN+81ubNIPKt2S rOe0wTVr0aWsaX7WMruGAiYBGUmeJiysjQwB9rNTpmh4hV1GcYxwqlXj6hoCYGUqltLM +tReXLlUauIeKbyIT5LJhZ0zdIPqXPrwAmSkWJipqQCJWsO/3arYjSZAwY9txl9HgaoJ VOjF1oKeQNqbM4mw+2HVlgyTIEg1q9zhYP451HE80iRVA+CykmYBKl5OZI3N6H/0hI8y SBwQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:in-reply-to:references:mime-version:date :message-id:subject:to:cc; bh=G7cKyx8Q+ardDTXQZV0gu9v5nHgK0S63OOUE9WxKUt8=; b=PAVrRVVIKoyyoNFaW72GgXLPtnrXqZ1PeYry36e+Qzqv5ke1Vszw9hezbiqIrVIkdq GuzFo5c6mlpkuMdf96rqsQvSgjTa7cMcI2HaiQ6aFmk/0v4yB4U25OYcdWxzLy6/ywYh o1muYSEKz69H03XAhNstQS64M4j4qESN8tzyPGRlKErOi8FHjzmb/K8u1GHCmzmI7mRu KFm/ZRr7goCPM7UFq0RupHXgQsJ4w7uyHSi4bvujdhkKR+dvj9Vvp/5KbBeTN4Xr3O/n yKdZ2QMBDAJ9qqz4yg23V5qmx943X/QOYCAGywVqdh/iCh/1OPoU4BO+FfewbZYR3Bjw toWA==
X-Gm-Message-State: APjAAAWzNfK53nVs6uBMJ7a7aphQ51xHLei1JMfcXgsIr5HxOe8vBz5w jJq4zbB7EIKARr3Q1u/48PmBy6XRtvEfIVqSNE0=
X-Google-Smtp-Source: APXvYqyPdbWUi639sy7t/vjCKe0BC/chCfnVWUjD1/t2STyCiNXTv8ZMA5fcMpaLEs4tqoDsx0PwzyPws+6Apn+z+Eg=
X-Received: by 2002:a5d:8c81:: with SMTP id g1mr6305947ion.239.1563902237572; Tue, 23 Jul 2019 10:17:17 -0700 (PDT)
Received: from 895490483151 named unknown by gmailapi.google.com with HTTPREST; Tue, 23 Jul 2019 13:17:16 -0400
From: Marie-Jose Montpetit <marie@mjmontpetit.com>
In-Reply-To: <81CBAAB9-9808-468F-B725-B4382A8295A5@abc.se>
References: <81CBAAB9-9808-468F-B725-B4382A8295A5@abc.se>
MIME-Version: 1.0
Date: Tue, 23 Jul 2019 13:17:16 -0400
Message-ID: <CAPjWiCQq-EEtbDD1=PGxzUeN9JfnQ0w=eMCB0=OdEwN5d8S6vA@mail.gmail.com>
To: =?UTF-8?Q?B=C3=B6rje_Ohlman?= <borje.ohlman@abc.se>, "Mosko, Marc <mmosko@parc.com>" <mmosko@parc.com>
Cc: icnrg <icnrg@irtf.org>
Content-Type: multipart/alternative; boundary="00000000000055993b058e5c5d37"
Archived-At: <https://mailarchive.ietf.org/arch/msg/icnrg/q_9m6GKuBW0oehFudEleo371EXI>
Subject: Re: [icnrg] Interop testing?
X-BeenThere: icnrg@irtf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Information-Centric Networking research group discussion list <icnrg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/icnrg>, <mailto:icnrg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/icnrg/>
List-Post: <mailto:icnrg@irtf.org>
List-Help: <mailto:icnrg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/icnrg>, <mailto:icnrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Tue, 23 Jul 2019 17:17:21 -0000

Hackatons are cool :)

Marie-José Montpetit, Ph.D.
Research Affiliate, MIT Media Laboratory
mariejose@mjmontpetit.com
mariejo@mit.edu

On July 23, 2019 at 12:54:14 PM, Börje Ohlman (borje.ohlman@abc.se) wrote:

> Sounds like a good idea. Maybe we should go for doing a hackathon in
> Singapore instead of an interim meeting.
>
> Börje
>
> 23 juli 2019 kl. 12:23 skrev Mosko, Marc <mmosko@parc.com> <
> mmosko@parc.com>gt;:
>
> Now that we have the RFCs out, do we want to have a round of interop /
> conformance testing?
> My idea is that there would be separate client library tests and forwarder
> tests.
>
> For the forwarder tests, we would generate some test vectors of Interests
> and Content Objects and expected results (i.e. should fail or should
> succeed). We could then write test rigs for each implementation (cicn,
> ccn-lite, cefore, etc.), connect them in topologies and run various
> consumers & publishers. It may be that a single test rig could be used for
> all implementations. For example, use a ccn-lite forwarder (A) and cicn (B)
> with a test rig (T) connected T-A-B-A-B-T.
>
> For client library tests, I'm not sure what would be a good way to do
> that. There's a few ideas, but I'd like to hear what people think of this.
>
> Marc
>
> _______________________________________________
> icnrg mailing list
> icnrg@irtf.org
> https://www.irtf.org/mailman/listinfo/icnrg
>
>
> _______________________________________________
> icnrg mailing list
> icnrg@irtf.org
> https://www.irtf.org/mailman/listinfo/icnrg
>