Re: [Cellar] On the multiplicity of Info elements

Dave Rice <dave@dericed.com> Mon, 11 January 2016 21:27 UTC

Return-Path: <dave@dericed.com>
X-Original-To: cellar@ietfa.amsl.com
Delivered-To: cellar@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B2A941A9176 for <cellar@ietfa.amsl.com>; Mon, 11 Jan 2016 13:27:14 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.121
X-Spam-Level:
X-Spam-Status: No, score=-1.121 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, SPF_NEUTRAL=0.779] autolearn=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id GUrtYP-_FaPz for <cellar@ietfa.amsl.com>; Mon, 11 Jan 2016 13:27:11 -0800 (PST)
Received: from s172.web-hosting.com (s172.web-hosting.com [68.65.122.110]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id EEF141A9174 for <cellar@ietf.org>; Mon, 11 Jan 2016 13:27:10 -0800 (PST)
Received: from user-387g4ij.cable.mindspring.com ([208.120.18.83]:34035 helo=[10.0.1.64]) by server172.web-hosting.com with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (Exim 4.86) (envelope-from <dave@dericed.com>) id 1aIjzW-002Qlb-6T; Mon, 11 Jan 2016 16:27:10 -0500
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 9.2 \(3112\))
From: Dave Rice <dave@dericed.com>
In-Reply-To: <5693D5D6.6030709@xiph.org>
Date: Mon, 11 Jan 2016 16:27:04 -0500
Content-Transfer-Encoding: quoted-printable
Message-Id: <F6B37DB3-EDCB-4BD2-9B0D-F8A4F353F36E@dericed.com>
References: <CAHUoETLC4dQQ7=TOuTXZ3aDjKCCJgz2s-8Gb33MoSAP3hgRQiQ@mail.gmail.com> <BEA72D66-EA3D-4CF0-987D-836E95287F39@dericed.com> <20151230091811.GA19636@bunkus.org> <CAOXsMFLCbe-W=h+tQpdRa8Nh0jz=xdbZTXEmoXsgQTbA=4OPCQ@mail.gmail.com> <C0E5EBA2-2A56-46F9-A049-629EFB11F280@dericed.com> <CAOXsMF+gc0d2LEisfHm0jnjDGQKcYquEMBt7FnZ_uuSNF=C0iw@mail.gmail.com> <568AC10F.9030303@gmx.de> <CAOXsMFKJJhzU-3CYqguDePY42T+Vvhx9ytAfvoM6xyqaZY+N4g@mail.gmail.com> <FCC4DC05-44CD-4C2B-8C59-8E3E5B494DC0@dericed.com> <568D6710.8000605@gmx.de> <692F039A-180D-4535-B4A1-529A777573F5@dericed.com> <5693D5D6.6030709@xiph.org>
To: "Timothy B. Terriberry" <tterribe@xiph.org>
X-Mailer: Apple Mail (2.3112)
X-OutGoing-Spam-Status: No, score=-1.0
X-AntiAbuse: This header was added to track abuse, please include it with any abuse report
X-AntiAbuse: Primary Hostname - server172.web-hosting.com
X-AntiAbuse: Original Domain - ietf.org
X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12]
X-AntiAbuse: Sender Address Domain - dericed.com
X-Get-Message-Sender-Via: server172.web-hosting.com: authenticated_id: dave@dericed.com
X-Authenticated-Sender: server172.web-hosting.com: dave@dericed.com
X-Source:
X-Source-Args:
X-Source-Dir:
X-From-Rewrite: unmodified, already matched
Archived-At: <http://mailarchive.ietf.org/arch/msg/cellar/f3xy4waECqN4HC97sqUTWyCA2WI>
Cc: cellar@ietf.org
Subject: Re: [Cellar] On the multiplicity of Info elements
X-BeenThere: cellar@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Codec Encoding for LossLess Archiving and Realtime transmission <cellar.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/cellar>, <mailto:cellar-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cellar/>
List-Post: <mailto:cellar@ietf.org>
List-Help: <mailto:cellar-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/cellar>, <mailto:cellar-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 11 Jan 2016 21:27:14 -0000

> On Jan 11, 2016, at 11:18 AM, Timothy B. Terriberry <tterribe@xiph.org> wrote:
> 
> Dave Rice wrote:
>> Listing reasons to not have a CRC Child Element seems awkward.
>> Realistically I think the primary reason that CRC elements are not
>> used is because many muxers don’t support adding them, although the
>> EBML specification has long contained: "All level 1 elements SHOULD
>> include a CRC-32.” Instead of addressing reasons why not I added
> 
> So this is really, "SHOULD, unless it is too much work for you to bother”?

That does seem honest. ;)

From a sample set of 59,881 Matroska files uploaded to archive.org only 119 of them include CRC-32 Elements. Almost 0.2%! Additionally the webm Document Type lists the CRC-32 Element as unsupported. So I think it’s true that it’s rarely bothered with. The implementation of CRC-32 Elements does add many complications and perhaps demand has been too low to resolve them. Moritz may have comments here.

> I say this as someone who has had every SHOULD in one of my own drafts systematically dissected with the question, "Why not MUST? When would it be okay to violate this SHOULD?" late in the review process. I am trying to save you pain further down the line.

Historically both Matroska and EBML specs have said that "All level 1 elements should include a CRC-32” with a lower-case “should” (that ’should’ was capitalized in a recent review); however the implementation of this recommendation has been minimal.  To change the SHOULD to a MUST, would invalidate approximately 99.8% of Matroska files and 100% of webm files. I realize that this reason alone may not make good language within an RFC.

On the other hand, through discussion here, I do see the use of CRC-32 Elements to be more meaningful especially in the two use cases of the CELLAR working group title: archiving and transmission. 

Perhaps the recommendation for CRC-32 usage (in Level 1 Elements and Identically-Recurring Elements) should be removed from the EBML Specification and moved to the Matroska EBML Schema.

For any webm lurkers, was there any reason (that could be useful here) to set the CRC-32 Element to “Unsupported” within the webm specification?

Other suggestions?

Dave Rice