Re: [Cellar] TrackTypes for non-standard data formats

Matt Gruenke <matt.gruenke@gmail.com> Fri, 28 April 2017 02:55 UTC

Return-Path: <matt.gruenke@gmail.com>
X-Original-To: cellar@ietfa.amsl.com
Delivered-To: cellar@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3F6CB1296B0 for <cellar@ietfa.amsl.com>; Thu, 27 Apr 2017 19:55:32 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.999
X-Spam-Level:
X-Spam-Status: No, score=-1.999 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id j6KNZaXr5HHv for <cellar@ietfa.amsl.com>; Thu, 27 Apr 2017 19:55:29 -0700 (PDT)
Received: from mail-pg0-x22e.google.com (mail-pg0-x22e.google.com [IPv6:2607:f8b0:400e:c05::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4E2951293F4 for <cellar@ietf.org>; Thu, 27 Apr 2017 19:53:20 -0700 (PDT)
Received: by mail-pg0-x22e.google.com with SMTP id t7so7546133pgt.3 for <cellar@ietf.org>; Thu, 27 Apr 2017 19:53:20 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=b7fOW1f3fcGggJq5UdQcW2cXIXbPuWZWPnmlHmD+0Q4=; b=FFJImDI8BXTYKkG1Vo55jsWK4gzOJT+UmLAY6kl220qSBeiDvx/3bVPaSg8w+fY4/r JLhemoW7Oc/CPUJlpLKSQbAntNI9ymq6eASUTdYcTCkg0MVnih61RxwuKgY7h16xBUpq LjRWCHM8fHnGZMHAMDewjQF0zePAEnIx0YweNlMu/FRKLWAqUKL5F8KLqDB+0tGZLM/c ZByy0ITLkt0u7FqY+l9QYA1PvpBuXaraMIYGYDAbCTq6jrR1r4HyuDDWM+RE/zDsIHug x7kUdiRfodNxTgVZkh2WXOF4FNBpoMqi53K3eG0HQfQW5zDRk9XE47pHYBAJPxCUOTHq Tj4w==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=b7fOW1f3fcGggJq5UdQcW2cXIXbPuWZWPnmlHmD+0Q4=; b=RlJyaDpsM7Wlr+ejYKg49hgc5u3kj/iREn7BCmiDKFIGHo7bDvuPMKpkwvTn3V65m6 Fi6wZl8b0FGAQT8dJ1aeEcSvivRQ8xUHCTUvVMVH8orGpJYfOOPahZb0njfxmZdwBZP2 yVgtSm53TFnSkItEKztKFfDd/lLARhuh9sV01/VuQcfTeSLl4jL9OtBUHF/nB/VSpqHL uxdZpDhnPzghs6jZhZNlLZSkveOSftA1pFpVPc1mZ4BrZoFOuE7mGd8ZuiXRow1RZT3o j4vkZoBX7rH1zNCsEOgoVIlPL/nPcoCPrFmBZYO1fTkK0YJGQMod+HoJlNRO0gpjRSVP BBzQ==
X-Gm-Message-State: AN3rC/710vRbsAPTtiiig4QIKWi6OQ4LtgeKj8r1i9/gM1QfbVymAvCT 0rghllTMYN8K1Vdfs0dP4SDxsN4BYQ==
X-Received: by 10.99.163.67 with SMTP id v3mr9294646pgn.206.1493347999916; Thu, 27 Apr 2017 19:53:19 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.100.148.101 with HTTP; Thu, 27 Apr 2017 19:53:19 -0700 (PDT)
In-Reply-To: <CAOXsMF+E=E0iCqxJt8fQT1HvM85gUjHGA7Hh4ZPUX3f23UxxwQ@mail.gmail.com>
References: <CAJKCwWir0qPzJUKveNYw-v1DTvaMEQVKVvNKoHBnjZSJm7ck=A@mail.gmail.com> <90625ABD-48AE-41CC-AFE1-24BD57A62415@dericed.com> <CAJKCwWj0L3sn8iQ+w1QNNcVJPrknNcj4EQp2fafAwYf1T1-ycQ@mail.gmail.com> <CAOXsMFJ9fz_xomFDTPhEhJHjSXwdD45NWqvUGwqK++8r-afi-Q@mail.gmail.com> <CAJKCwWibuaXFQk2NWE=hW+wYZb8KHOLtBsY8OyNDKhV7-R4nyg@mail.gmail.com> <CAOXsMF+E=E0iCqxJt8fQT1HvM85gUjHGA7Hh4ZPUX3f23UxxwQ@mail.gmail.com>
From: Matt Gruenke <matt.gruenke@gmail.com>
Date: Thu, 27 Apr 2017 22:53:19 -0400
Message-ID: <CAJKCwWhb7fUcKfoSLUnd8SMH=XyOEazoxObHWTSa0O9rMFxpOg@mail.gmail.com>
To: Steve Lhomme <slhomme@matroska.org>
Cc: Codec Encoding for LossLess Archiving and Realtime transmission <cellar@ietf.org>
Content-Type: multipart/alternative; boundary="f4030436399c0faca7054e312dbe"
Archived-At: <https://mailarchive.ietf.org/arch/msg/cellar/wQEJD0MTH7xcWJwpGbtn29iZBAs>
Subject: Re: [Cellar] TrackTypes for non-standard data formats
X-BeenThere: cellar@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Codec Encoding for LossLess Archiving and Realtime transmission <cellar.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/cellar>, <mailto:cellar-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cellar/>
List-Post: <mailto:cellar@ietf.org>
List-Help: <mailto:cellar-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/cellar>, <mailto:cellar-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 28 Apr 2017 02:55:32 -0000

On Wed, Apr 26, 2017 at 4:47 AM, Steve Lhomme <slhomme@matroska.org> wrote:

> 2017-02-27 3:21 GMT+01:00 Matt Gruenke <matt.gruenke@gmail.com>:
>


> > In all of the examples I mentioned, I can foresee cases where these would
> > need to be time-stamped frames that might have a different sampling rate
> > than the video or audio streams, if present.  In fact, this is the case
> for
> > one camera I've used, where the depth sensor operates at a different rate
> > than the primary image sensor.
>
> There is no 'sampling rate' in Matroska. Only the timestamp of a Block
> matters. So audio/video/other don't need to share anything in that
> regard.
>

What I meant by 'sampling rate' wasn't that there would be some exact frame
rate.  I simply meant that there might not be a 1-to-1 relationship between
frames of different types.  Again, to use the example of a certain camera
with a depth sensor, it can capture RGB frames at a different rate than
depth frames.

I mention this simply to point out that the depth frames seem like they
belong in their own track.


Matt