[AVTCORE] Re: New draft: Absolute Capture Timestamp RTP header extension

Bernard Aboba <bernard.aboba@gmail.com> Thu, 31 October 2024 20:35 UTC

Return-Path: <bernard.aboba@gmail.com>
X-Original-To: avt@ietfa.amsl.com
Delivered-To: avt@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1B681C169400 for <avt@ietfa.amsl.com>; Thu, 31 Oct 2024 13:35:36 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.103
X-Spam-Level:
X-Spam-Status: No, score=-2.103 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_BLOCKED=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id oDCQk9LzWZRf for <avt@ietfa.amsl.com>; Thu, 31 Oct 2024 13:35:35 -0700 (PDT)
Received: from mail-pj1-x1033.google.com (mail-pj1-x1033.google.com [IPv6:2607:f8b0:4864:20::1033]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 67158C137360 for <avt@ietf.org>; Thu, 31 Oct 2024 13:35:35 -0700 (PDT)
Received: by mail-pj1-x1033.google.com with SMTP id 98e67ed59e1d1-2e91403950dso1007604a91.3 for <avt@ietf.org>; Thu, 31 Oct 2024 13:35:35 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1730406934; x=1731011734; darn=ietf.org; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=oIaoDjF8+sWjvbKMA7eoFnTbdJmbNFJj1dg24TUhw8U=; b=CcRxEaKjXgp/UWVxwGLAqW1hoyRAaM8KajWgWCEjZZqlr64wNgeieeB1rrFm5iWa3x ISDDR/SVe6l7GgukcGmTI6gspxzI1wgJNwgGBdA5hJRVAffCJ0N3h9aDRmcQNKFsYwj6 6rgp7l4QXvxlN+vYxI6kleAbohsZB7g6jR4luGBwY2TiJjti8h8V5tf84Ku0lo6M0uWB Qf5G4mY5QA/mOs5kmfWa25lO8EXDoMCIrSKC8mwciu8s2T4510lm2d/X8oB2GDZlBwr/ cc0YsliYFMX90TLaLAOTenjbiqh/AzF8Xg3fQRCNOGi/FTAuvovFppcyrzH5g8UcL9jS /ghg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1730406934; x=1731011734; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=oIaoDjF8+sWjvbKMA7eoFnTbdJmbNFJj1dg24TUhw8U=; b=Bt43Kq8geQqmSds98qN9V8zk9kHZA9Y5qExkLOjPvThURB2eNY4CvRrR6ORSRJGrA4 9uTdp4TTw0EOAjjZgQwUyjgQuiuMsVGFBvvDyaEZ08aAsVyVZwdhxqnEBwIf11v8gWkr bzRjPaYrgeYDr/zs6mgl6+59nAmZns+w+E9q6CwIA2pkFnhGfIh6TFu3Jm8IFYGbczvc ZqjjG1bUnRimSvZX//DPvfx2hOtmFJ2L9BgBwfO6RWgmh6klCcCP7Ywjw2a9bgiBQz7v 8D40k3SnW3779NQTjNSN4+nvtyWSEILmOZzBfYYx5q4DUhj2bwTtUvL2TujvFku4X3X2 CGtQ==
X-Gm-Message-State: AOJu0Yxw+x/CJ+jFc5xK/8ZfKvCXv2KKZokW9fFyJFc7Dg0IJ5nhbzeU Qrc2V9omhSFDhnHyzywvGedPLNrQ9ST+oHxkVGHGmBJy1FLkOXE+OxMwbvFpyt4cpdGdmTt32gJ 052VjZuAxHnLhQUNhQP3saOXJuIbPtkNVZwQ=
X-Google-Smtp-Source: AGHT+IEdIdWdoJZMClgc9m+PcWQpXu+QXkDox4Vy9YQNVfN6JOd0X6LtWArppdEgMgnal07RWbL8JTPy2OqRi7kGCH8=
X-Received: by 2002:a17:90a:d481:b0:2e0:d957:1b9d with SMTP id 98e67ed59e1d1-2e8f1071c8dmr24786955a91.13.1730406934421; Thu, 31 Oct 2024 13:35:34 -0700 (PDT)
MIME-Version: 1.0
References: <16ad18c7-6a14-48d3-9960-2a5785e58e05@alvestrand.no> <CA+ag07bZxCQfiC1vJ03zkO+8ncpLyatfzr9D1V0Zv5+ox0K4Og@mail.gmail.com>
In-Reply-To: <CA+ag07bZxCQfiC1vJ03zkO+8ncpLyatfzr9D1V0Zv5+ox0K4Og@mail.gmail.com>
From: Bernard Aboba <bernard.aboba@gmail.com>
Date: Thu, 31 Oct 2024 13:35:23 -0700
Message-ID: <CAOW+2du8HNuA9WPqZL8WYA78-5voJRE13QfK8L-bQJJ4FSOhCw@mail.gmail.com>
To: IETF AVTCore WG <avt@ietf.org>
Content-Type: multipart/alternative; boundary="000000000000a4b0230625cbc294"
Message-ID-Hash: A4IN5IOYRGAPFQFYZMWJZVKXMQ36MFET
X-Message-ID-Hash: A4IN5IOYRGAPFQFYZMWJZVKXMQ36MFET
X-MailFrom: bernard.aboba@gmail.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-avt.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [AVTCORE] Re: New draft: Absolute Capture Timestamp RTP header extension
List-Id: Audio/Video Transport Core Maintenance <avt.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/avt/Ot2UWQNt-FfQJPep01YDAc9QPyM>
List-Archive: <https://mailarchive.ietf.org/arch/browse/avt>
List-Help: <mailto:avt-request@ietf.org?subject=help>
List-Owner: <mailto:avt-owner@ietf.org>
List-Post: <mailto:avt@ietf.org>
List-Subscribe: <mailto:avt-join@ietf.org>
List-Unsubscribe: <mailto:avt-leave@ietf.org>

I am also interested in seeing this draft advanced.

Some comments:

Section 1

"However, when multiple hops and multiple systems are involved, this task
becomes more difficult; in particular, when one desires to synchronize
media from multiple sources with independent clocks, where the media may
have traveled over multiple network hops between the source and
destination.This memo describes one mechanism for providing more
information to make such synchronization possible."

[BA]  Is the sole use case for this document "lip sync" from a single
source?  Or are other use cases possible too (e.g. synchronized concert)?

As written, this section could be interpreted to apply to a wide range of
RTP topologies described in RFC 7667. Since RTCP termination is mentioned
in Section 3, this does not appear to be the intent.  I'd suggest adding a
paragraph describing the RTP topologies to which this specification applies
(e.g. Section 3.6 and 3.7 of RFC 7667)

Section 3.1.2.1

" Absolute capture timestamp is the NTP timestamp of when the first frame
in a packet was originally captured. This timestamp MUST be based on the
same clock as the clock used to generate NTP timestamps for RTCP sender
reports on the capture system."

[BA] Does this imply that the RTCP SR NTP timestamp from the capturing
system is placed in this field?

Section 3.1.2.2

   Estimated capture clock offset is the sender's estimate of the offset
   between its own NTP clock and the capture system's NTP clock.  The
   sender is here defined as the system that owns the NTP clock used to
   generate the NTP timestamps for the RTCP sender reports on this
   stream.  The sender system is typically either the capture system or
   a mixer.


[BA] In an RTCP-terminating topology wouldn't the mixer/SFM be the
sender?  In what topology would the capture system be the sender?


Section 3.1.3.2

   An intermediate system (e.g. mixer) MAY adjust these timestamps as
   needed.  It MAY also choose to rewrite the timestamps completely,
   using its own NTP clock as reference clock, if it wants to present
   itself as a capture system for A/V-sync purposes.


[BA] Wouldn't this behavior be governed by the topology? For example, an
RTCP-terminating middle box uses its own NTP clock, but presumably a
translator would not.

On Wed, Oct 30, 2024 at 10:57 AM Sergio Garcia Murillo <
sergio.garcia.murillo@gmail.com> wrote:

> Hi all, as I probably won't be able to make it to next Monday's meeting, I
> would like to express my support for this header extension in advance.
>
> At Dolby Millicast we have been extensively using the non-standard version
> available in Google Chrome extensively, both for calculating e2e delays and
> for synchronization of media and metadata, being much more easy to handle
> that the codec specific counterparts (like the H264 SEI pic timing).
>
> Being able to standardize it would allow us to expose it in the w3c apis
> and make it easier to obtain from javascript.
>
> Best regards
> Sergio
>
> On Fri, Oct 4, 2024 at 10:26 AM Harald Alvestrand <harald@alvestrand.no>
> wrote:
>
>> I have now submitted an I-D based on the technology I presented at the
>> last IETF about "absolute" timestamps for RTP.
>>
>> It is here:
>>
>> https://datatracker.ietf.org/doc/draft-alvestrand-avtcore-abs-capture-time/
>>
>> I plan to ask for agenda time in Dublin to discuss the draft.
>> Comments welcome - the source is on github here:
>>
>> https://github.com/alvestrand/id-abs-capture-timestamp
>>
>> Harald
>>
>> _______________________________________________
>> Audio/Video Transport Core Maintenance
>> To unsubscribe send an email to avt-leave@ietf.org
>>
> _______________________________________________
> Audio/Video Transport Core Maintenance
> To unsubscribe send an email to avt-leave@ietf.org
>