Re: [6lo] Questions and comments regarding draft-ietf-6lo-ghc-00.

Thomas Björklund <thomas.bjorklund@effnet.com> Fri, 07 February 2014 07:23 UTC

Return-Path: <thomas.bjorklund@effnet.com>
X-Original-To: 6lo@ietfa.amsl.com
Delivered-To: 6lo@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 276AA1A05B7 for <6lo@ietfa.amsl.com>; Thu, 6 Feb 2014 23:23:31 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.6
X-Spam-Level:
X-Spam-Status: No, score=-1.6 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, MIME_8BIT_HEADER=0.3] autolearn=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id GSCD4-9XIlIl for <6lo@ietfa.amsl.com>; Thu, 6 Feb 2014 23:23:29 -0800 (PST)
Received: from lists.levonline.com (lists.levonline.com [217.70.33.37]) by ietfa.amsl.com (Postfix) with ESMTP id D08641A05AC for <6lo@ietf.org>; Thu, 6 Feb 2014 23:23:28 -0800 (PST)
Received: from traktor2.skognet.levonline.com (webhotel.fordon.levonline.com [217.70.32.2]) by lists.levonline.com (Postfix) with ESMTP id C49C73A1EAF for <6lo@ietf.org>; Fri, 7 Feb 2014 08:22:38 +0100 (CET)
Received: from jocke-win7.stationsgatan.effnet.se (c-fe0571d5.04-205-6c756c1.cust.bredbandsbolaget.se [213.113.5.254]) (authenticated bits=0) by traktor2.skognet.levonline.com (8.13.8/8.13.8) with ESMTP id s177NPdp032352 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for <6lo@ietf.org>; Fri, 7 Feb 2014 08:23:25 +0100
X-Origin-Levonline: a0927314
Message-ID: <52F489E8.5030702@effnet.com>
Date: Fri, 07 Feb 2014 08:23:20 +0100
From: Thomas Björklund <thomas.bjorklund@effnet.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.1.0
MIME-Version: 1.0
To: 6lo@ietf.org
References: <52F23FE4.7020805@effnet.com> <52F344BA.6000500@effnet.com> <C028112C-26D4-4E6C-A2A0-2D9A6170352A@tzi.org>
In-Reply-To: <C028112C-26D4-4E6C-A2A0-2D9A6170352A@tzi.org>
X-Enigmail-Version: 1.6
Content-Type: text/plain; charset="windows-1252"
Content-Transfer-Encoding: 8bit
Subject: Re: [6lo] Questions and comments regarding draft-ietf-6lo-ghc-00.
X-BeenThere: 6lo@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "Mailing list for the 6lo WG for Internet Area issues in IPv6 over constrained node networks." <6lo.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/6lo>, <mailto:6lo-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/6lo/>
List-Post: <mailto:6lo@ietf.org>
List-Help: <mailto:6lo-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/6lo>, <mailto:6lo-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 07 Feb 2014 07:23:31 -0000

Hi,

Thanks for your prompt reply!

2014-02-06 11:13, Carsten Bormann wrote:

>> 2) In the paragraph above Figure 9, one can read "Note that the
>> compressed output exposes an inefficiency in the simple-minded
>> compressor used to generate it". I find the compressed output optimal
>> with respect to size. What is sub optimal with the compressed output
>> in Figure 9?
>
> I’m afraid I already forgot (I think it was about using one more
> “mode-switch” than needed).  But I can look at it again.

It would be interesting to know, but it is not of great importance to me.

>> 3) I think that it somewhere in the draft should be a reference to James
>> Storer and Thomas Szymanski's description of LZSS in the article "Data
>> compression via textual substitution", since the algorithm proposed for
>> compression is very similar to theirs, so that the interested reader can
>> learn more about the background.
> 
> I was very careful (too careful maybe) to avoid superfluous references to
> anything post LZ77. Now LZSS is old enough that it should be patent-safe,
> so that is a good suggestion (a JACM reference never hurts, even if it
> doesn’t help very much :-).
> 
> Do I actually propose an algorithm for compression?

Imho the use of a preloaded dictionary which is incrementally extended
with the plain text, backreferences into the dictionary to represent
strings, and the ability to represent strings without references into
the dictionary is a description of an method/algorithm for compression,
and this is also pretty much what LZSS is about.

>> 4b) What sort of packet trace was used to generate the static part of
>> the dictionary? Is it possible to get a copy of it?
> 
> The traces we have are on http://svn.tools.ietf.org/svn/wg/6lowpan/packets
> Not much, but it seems a bit hard to get real-world pcaps from people in
> this space. If you have more that can be published this way, I’d sure like
> to put them up there!

Unfortunately I have no IEEE 802.15.4/6LoWPAN traffic to share, but
couldn't one just use regular IPv6 traffic for generating the
dictionary? The reason why I focus so much on the initial dictionary and
how it was generated is that the frequency of 0x00 is quite high, both
in the static part of the dictionary and in the pseudo header,
especially if link-local addresses are used. Thanks to the existence of
the "append zeros" code byte my gut feeling is that that the initial
dictionary might be of better use with a different content.

/Thomas