Re: [T2TRG] CoRAL Dictionaries and the side meeting yesterday

Klaus Hartke <hartke@projectcool.de> Fri, 06 December 2019 15:59 UTC

Return-Path: <hartke@projectcool.de>
X-Original-To: t2trg@ietfa.amsl.com
Delivered-To: t2trg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3B9E0120019 for <t2trg@ietfa.amsl.com>; Fri, 6 Dec 2019 07:59:27 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.899
X-Spam-Level:
X-Spam-Status: No, score=-1.899 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id rvAA1aW07HUE for <t2trg@ietfa.amsl.com>; Fri, 6 Dec 2019 07:59:25 -0800 (PST)
Received: from wp382.webpack.hosteurope.de (wp382.webpack.hosteurope.de [IPv6:2a01:488:42:1000:50ed:8597::]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2E1D71200D7 for <T2TRG@irtf.org>; Fri, 6 Dec 2019 07:59:25 -0800 (PST)
Received: from mail-qk1-f171.google.com ([209.85.222.171]); authenticated by wp382.webpack.hosteurope.de running ExIM with esmtpsa (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) id 1idG0p-0007tN-Aw; Fri, 06 Dec 2019 16:59:23 +0100
Received: by mail-qk1-f171.google.com with SMTP id d124so6861670qke.6 for <T2TRG@irtf.org>; Fri, 06 Dec 2019 07:59:23 -0800 (PST)
X-Gm-Message-State: APjAAAVQx54kI3tQtqv2ptBmYY0SLrLkqIGaJ4zeJpsIjOoiy5KMNdsc 7heMnkLDmXQ5yFZ30YM6mKH1ClNwyWFzU/iKMuc=
X-Google-Smtp-Source: APXvYqyYwIpPoRZsxWXmLVErQFe4Fbqkq0yNl1Jiu+pn5nFJ63G7ds9FxO8IPhqQW1TfCHQpfRbgrRMZWeJGIT+KtoQ=
X-Received: by 2002:a05:620a:6db:: with SMTP id 27mr336024qky.453.1575647962221; Fri, 06 Dec 2019 07:59:22 -0800 (PST)
MIME-Version: 1.0
References: <01c301d59f42$deb32d00$9c198700$@augustcellars.com> <CAAzbHvYXJwhRo9Bhq_r5nq0=-sa8D_Gnj6MpDfcPiGs-HS_ctg@mail.gmail.com> <04bd01d5a24b$eb9bf090$c2d3d1b0$@augustcellars.com>
In-Reply-To: <04bd01d5a24b$eb9bf090$c2d3d1b0$@augustcellars.com>
From: Klaus Hartke <hartke@projectcool.de>
Date: Fri, 06 Dec 2019 16:58:46 +0100
X-Gmail-Original-Message-ID: <CAAzbHvYaqd1=WndHuQixPSFim-KkMs+V-oomkg9tv0HE=ST0mA@mail.gmail.com>
Message-ID: <CAAzbHvYaqd1=WndHuQixPSFim-KkMs+V-oomkg9tv0HE=ST0mA@mail.gmail.com>
To: Jim Schaad <ietf@augustcellars.com>
Cc: T2TRG@irtf.org
Content-Type: text/plain; charset="UTF-8"
X-bounce-key: webpack.hosteurope.de; hartke@projectcool.de; 1575647965; 893ed732;
X-HE-SMSGID: 1idG0p-0007tN-Aw
Archived-At: <https://mailarchive.ietf.org/arch/msg/t2trg/zJX7RylkneFqr3w_ysZ_lmrtAW4>
Subject: Re: [T2TRG] CoRAL Dictionaries and the side meeting yesterday
X-BeenThere: t2trg@irtf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IRTF Thing-to-Thing Research Group <t2trg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/t2trg>, <mailto:t2trg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/t2trg/>
List-Post: <mailto:t2trg@irtf.org>
List-Help: <mailto:t2trg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/t2trg>, <mailto:t2trg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Fri, 06 Dec 2019 15:59:27 -0000

Hi Jim,

good points.

> 1. There needs to be a way to do some compression of CIRIs in the document.

Overall, there are currently two compression mechanisms in
draft-ietf-core-coral-01: The compression of CIRIs (which is done by
omitting the parts that are present in a specific other CIRI) and the
compression of whole CIRIs/values (which is done by replacing them
with a pointer into a dictionary).

I think we might see even better results if we expand the scope of
compression, for example, by introducing the equivalent of base fields
in SenML [1]. For that, I propose we create a collection of real-world
CoRAL documents that we can use to find redundancies and evaluate
ideas. Maybe we can find a simple compression mechanism that works
well for everything.

> 2. It seems that there needs to be some way of being able to announce which version of a dictionary is understood by an entity.

I'd really like to avoid that :)

Klaus

[1] https://tools.ietf.org/html/rfc8428#section-4.1