Re: [core] Designs to resolve streaming issues in SenML

Michael Koster <michaeljohnkoster@gmail.com> Sat, 16 January 2016 19:06 UTC

Return-Path: <michaeljohnkoster@gmail.com>
X-Original-To: core@ietfa.amsl.com
Delivered-To: core@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2005C1A9092 for <core@ietfa.amsl.com>; Sat, 16 Jan 2016 11:06:00 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2
X-Spam-Level:
X-Spam-Status: No, score=-2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, SPF_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id dcqfe_1sGHwE for <core@ietfa.amsl.com>; Sat, 16 Jan 2016 11:05:59 -0800 (PST)
Received: from mail-pf0-x230.google.com (mail-pf0-x230.google.com [IPv6:2607:f8b0:400e:c00::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id E744D1A9091 for <core@ietf.org>; Sat, 16 Jan 2016 11:05:58 -0800 (PST)
Received: by mail-pf0-x230.google.com with SMTP id q63so139004102pfb.1 for <core@ietf.org>; Sat, 16 Jan 2016 11:05:58 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=3O1FpJLsMISdDUJJi45ClU3Kj+6HvNuiAH/TxBcAeJU=; b=sX8uPt8TPFifZQrAU7BGHdKhRdSScIdFVT3KvMBpaILqBEiB40lgGEoRF6Awt2QBVQ UnTOTmtuzarbzFvkz0wXG0Cy91V3bIU4+ss79NwwIbq7nI9AuMVHpF2McPOKO2sVsZmy ysmUmP9f7e+sJLUVKgI3mGcBLWfgoU8RMg2dgpHXjO0Vfov7gRNLOHIhK9ssdIz6lLhG cNtg/5gyiYbw7sI3Jg+Fbe7M043VWRBBibId+4mGisl22VVsVz1AYRm+MfS1DnHyT+jb l8cxl6Pvl9m0/ur5wmNAUs4he5L1RM/jL2wkcT+Jfnk79GGC1hU1ZdJlTXNZqN0jQRXu /TJg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:content-type:mime-version:subject:from :in-reply-to:date:cc:content-transfer-encoding:message-id:references :to; bh=3O1FpJLsMISdDUJJi45ClU3Kj+6HvNuiAH/TxBcAeJU=; b=QYz6HZZKJ23uE3B2hxAjVNxyMHu2OjndsOWodJx61QCq37HngwpfXe+bjUtDvKznT8 eIHpe1Bpl5NBiYF6ROdTjj4t2/MOIOzDtcBQ04MXMVVdf7uZjjXKhrGqibG5tn1K9oc0 JS0lrf0LhfIS1FinopqLFfacfeZsIPb/0bZgrDgu9epzdO5ZqzOiUiHYXbbTErGFwEa3 rO64x5TRWpLeg+r2XBgDTmuiDo1XSawuC9Io5b12aIxzXM7v2ce8jyDToNdJg3OBc6MG O3qrhZii8kchWwMSwRmT4JSBPKtoH7VpHdLReLh5m1Z+9kvqb5pvBwlmG1LCMOQDPfYu JMoA==
X-Gm-Message-State: ALoCoQkx+Z1o31yrAtG0U6HBzmiHvOAS7XebhZ2dx2XZEZxZMCUEhJpwWFmWwgzvGnhG4YkCm/5eFSKyelontWKkJkVrcLdV7Q==
X-Received: by 10.98.2.150 with SMTP id 144mr24594199pfc.11.1452971158553; Sat, 16 Jan 2016 11:05:58 -0800 (PST)
Received: from [10.0.0.21] (108-201-184-41.lightspeed.sntcca.sbcglobal.net. [108.201.184.41]) by smtp.gmail.com with ESMTPSA id 89sm22217998pfs.63.2016.01.16.11.05.57 (version=TLSv1/SSLv3 cipher=OTHER); Sat, 16 Jan 2016 11:05:58 -0800 (PST)
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\))
From: Michael Koster <michaeljohnkoster@gmail.com>
In-Reply-To: <56702BF4-625F-4364-9D2D-76912CC8F7EB@gmail.com>
Date: Sat, 16 Jan 2016 11:05:56 -0800
Content-Transfer-Encoding: quoted-printable
Message-Id: <C6B54A85-E0E4-42CE-84DD-B820CE7262BF@gmail.com>
References: <175A1806-ACB0-4FC7-A318-2A58FF66CDD2@cisco.com> <20160116132751.GB18563@hephaistos.amsuess.com> <CC28D44A-DBC0-446D-90A8-3E329FC3F0AF@gmail.com> <0D5538ED-D126-4A1B-AFDD-D9D54580D48B@gmail.com> <569A91FD.3020709@tzi.org> <56702BF4-625F-4364-9D2D-76912CC8F7EB@gmail.com>
To: Carsten Bormann <cabo@tzi.org>
X-Mailer: Apple Mail (2.2104)
Archived-At: <http://mailarchive.ietf.org/arch/msg/core/KFWofpxMaqCuA_7OBAS5ql_hDjQ>
Cc: "Cullen Jennings (fluffy)" <fluffy@cisco.com>, core <core@ietf.org>, Christian Amsüss <c.amsuess@energyharvesting.at>
Subject: Re: [core] Designs to resolve streaming issues in SenML
X-BeenThere: core@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "Constrained RESTful Environments \(CoRE\) Working Group list" <core.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/core>, <mailto:core-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/core/>
List-Post: <mailto:core@ietf.org>
List-Help: <mailto:core-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/core>, <mailto:core-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 16 Jan 2016 19:06:00 -0000

And maps must be consumed before processing. So keep your maps small and use arrays

> On Jan 16, 2016, at 11:03 AM, Michael Koster <michaeljohnkoster@gmail.com> wrote:
> 
> The processing rule is each array element may (must in some cases) be processed in sequence
> 
>> On Jan 16, 2016, at 10:54 AM, Carsten Bormann <cabo@tzi.org> wrote:
>> 
>> Michael Koster wrote:
>>> allow measurement data within the base element using the “e” key.
>> 
>> The reason -02 doesn't do that is that a sequentially operating
>> implementation may get process the "e" key before the base values,
>> possibly requiring it to buffer the values.  That's why we tried to
>> separate the measurements from the base values into different maps.
>> 
>> Grüße, Carsten
>