Re: [Json] JSON Log file encoding JSON-L

Nico Williams <nico@cryptonector.com> Wed, 07 May 2014 16:40 UTC

Return-Path: <nico@cryptonector.com>
X-Original-To: json@ietfa.amsl.com
Delivered-To: json@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8A6FA1A03BD for <json@ietfa.amsl.com>; Wed, 7 May 2014 09:40:12 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.044
X-Spam-Level:
X-Spam-Status: No, score=-1.044 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FM_FORGED_GMAIL=0.622, IP_NOT_FRIENDLY=0.334] autolearn=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0dZ_sJRWVrBk for <json@ietfa.amsl.com>; Wed, 7 May 2014 09:40:11 -0700 (PDT)
Received: from homiemail-a89.g.dreamhost.com (sub4.mail.dreamhost.com [69.163.253.135]) by ietfa.amsl.com (Postfix) with ESMTP id E59121A0395 for <json@ietf.org>; Wed, 7 May 2014 09:40:11 -0700 (PDT)
Received: from homiemail-a89.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a89.g.dreamhost.com (Postfix) with ESMTP id DED2E318071 for <json@ietf.org>; Wed, 7 May 2014 09:40:07 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=cryptonector.com; h= mime-version:in-reply-to:references:date:message-id:subject:from :to:cc:content-type:content-transfer-encoding; s= cryptonector.com; bh=URUPV8lrviljnHnSlHMB72z4srA=; b=IjJo4o64w/M KMo5F7Tr9Jc4ML0fJqtv+/4j1JgopOlBklx7BuGTaTsOvGnA9x1GYIDRdlHEzS92 WjkXMMtC/aavDzew6kkMyN1ZxEGxJqWv8M9YuWoY4g8SeHI0HYr2VgJXzUmDNevC 8VLGg/FCSoiZjw5Kr64EyebHfwPXpUtc=
Received: from mail-wg0-f51.google.com (mail-wg0-f51.google.com [74.125.82.51]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: nico@cryptonector.com) by homiemail-a89.g.dreamhost.com (Postfix) with ESMTPSA id 8ED95318065 for <json@ietf.org>; Wed, 7 May 2014 09:40:07 -0700 (PDT)
Received: by mail-wg0-f51.google.com with SMTP id x13so1243070wgg.34 for <json@ietf.org>; Wed, 07 May 2014 09:40:06 -0700 (PDT)
MIME-Version: 1.0
X-Received: by 10.194.143.109 with SMTP id sd13mr1014155wjb.95.1399480806440; Wed, 07 May 2014 09:40:06 -0700 (PDT)
Received: by 10.216.29.200 with HTTP; Wed, 7 May 2014 09:40:06 -0700 (PDT)
In-Reply-To: <255B9BB34FB7D647A506DC292726F6E11545BD241D@WSMSG3153V.srv.dir.telstra.com>
References: <CAMm+LwjB-51z4GoeC0riehmJg1HAddmLAyfMsVOCVM80i=RiMA@mail.gmail.com> <B9D8B85D-EF2C-4B3A-90A4-873C714C06FA@tzi.org> <CAK3OfOhGpUatFotCPwpHw=wu4zphxWOAk6dvX2UOZJRzw23JEA@mail.gmail.com> <CAK3OfOh1R851pBETEJtzM7_rCvrhxedCn5v5==nHumstE9VSRA@mail.gmail.com> <255B9BB34FB7D647A506DC292726F6E11545BD241D@WSMSG3153V.srv.dir.telstra.com>
Date: Wed, 07 May 2014 11:40:06 -0500
Message-ID: <CAK3OfOjd9A_UWH=N8RA7S_HAsW8G43Q_NuJ97zTBO8qhbHE4kg@mail.gmail.com>
From: Nico Williams <nico@cryptonector.com>
To: "Manger, James" <James.H.Manger@team.telstra.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Archived-At: http://mailarchive.ietf.org/arch/msg/json/IZ5V_ujeU0cQSxO8ZRZi_Ia3sdM
Cc: Phillip Hallam-Baker <hallam@gmail.com>, JSON WG <json@ietf.org>
Subject: Re: [Json] JSON Log file encoding JSON-L
X-BeenThere: json@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "JavaScript Object Notation \(JSON\) WG mailing list" <json.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/json>, <mailto:json-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/json/>
List-Post: <mailto:json@ietf.org>
List-Help: <mailto:json-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/json>, <mailto:json-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 07 May 2014 16:40:12 -0000

On Tue, May 6, 2014 at 9:05 PM, Manger, James
<James.H.Manger@team.telstra.com> wrote:
>> Thank you Carsten.  I think I'll do the following: a) add RS to the
> whitespace list for JSON text sequence separators, b) RECOMMEND
> surrounding JSON texts with RS in log-like sequences.  Then JSON
> sequences will be meet the needs of logs.
>
> Don’t do that. Surely no one uses RS anymore; and certainly no one who uses JSON. It doesn't make much sense to use SEPARATOR TWO without using ONE, THREE and FOUR.

RS would be used to help distinguish incomplete (because interrupted) entries.

> We now have Nico’s JSON Text Sequences [draft-williams-json-text-sequence],

It's actually a WG work item now, since the charter now includes this work.

> and Phillip’s JSON Log Format (JSON-L) [draft-hallambaker-jsonl].
>
> They are basically the same. Can we just keep one? Probably the more generic JSON Text Sequences.

I agree.

However, PHB has a point about recovery from corruption.  My proposed
JSON Sequence work does nothing about that.  An OPTIONAL RS would.

I.e., loggers could (but wouldn't have to) emit RS JSON_TEXT RS NL to
make resynchronization possible.  Other use cases could just emit
JSON_TEXT NL (or any other whitespace.

Nico
--