Re: [avtext] framemarking: add frame size info

Miguel París Díaz <mparisdiaz@gmail.com> Tue, 30 August 2016 10:37 UTC

Return-Path: <mparisdiaz@gmail.com>
X-Original-To: avtext@ietfa.amsl.com
Delivered-To: avtext@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9727612B071 for <avtext@ietfa.amsl.com>; Tue, 30 Aug 2016 03:37:21 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.699
X-Spam-Level:
X-Spam-Status: No, score=-2.699 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id sD9gv5dme8T5 for <avtext@ietfa.amsl.com>; Tue, 30 Aug 2016 03:37:19 -0700 (PDT)
Received: from mail-wm0-x235.google.com (mail-wm0-x235.google.com [IPv6:2a00:1450:400c:c09::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id CE36F12D0A9 for <avtext@ietf.org>; Tue, 30 Aug 2016 03:37:18 -0700 (PDT)
Received: by mail-wm0-x235.google.com with SMTP id q128so114576328wma.1 for <avtext@ietf.org>; Tue, 30 Aug 2016 03:37:18 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=DDOuxS/49Esa5ozifgB1KdltD1ygOwTSEcad0jjHqrk=; b=jJjEJo4m4t3SwJ1D2oUq+fQ3mpYKlh2HEupD4SlR/d5Nvkhuqk1sf80Ky+AuBh6S42 9VU2I69iP2fAVQl2NezMouFDfz2hdwI4RqUE9uEDGqWd94l9wDZDl/7KNY64J5MXZ0qH RP0AeHtvb/9kLkI/TOIZIchfr2MignSvXnkPQCiBad2D7OKsaqKa3e4rtXqM16+CR4lX 131I3+S82HQIvJwL9I5sjC3m+QxIx0GLdJaA++Yw0wG+tfLTuMrI6V/AVvmVEfqK057/ QvuX0uKO/oMVaquyPoZ/O2gozc43cOoXZ/TNQZakaJUC3kAlgG/QAqSlY98H9QTl2W94 Ya5g==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=DDOuxS/49Esa5ozifgB1KdltD1ygOwTSEcad0jjHqrk=; b=NGauq6NWVuR/E1EP/NcMU6yKAQUYp0jznD6kGAPvbrPh9yaoylhJrLRxd2VJfE7WHj Za/iflCuEaaCAZaK+ASiQri5y5KofXpc6t3wMHGHtCtY/NVsBDYBl78jQT4flUIX4LSA jBWgCwC2KqDrv3oHWGWuJbVyrLYzhODKnvxzaJE+auEXVhKPXfKJ8/6snEXGvfIRDCXK Jy2vXO+U/jxOC9QG1co0UrK98GxFcldztTLwvYGLWpkaVpnGeTOBVdi5BJa27ji+OHWj 4LLPS07gCl8xef8d9ZuoNFIFSZPHfwRTgsEH1+1SlxZGaAtXwJuSy2nkiIEk9VqZOSxq N/qw==
X-Gm-Message-State: AE9vXwMgik7WP9lAGqmVBut4cYvRgzoEtWxH5ek6wLwIQdyrrK76B+uIO14LO136+YE3BTsXuA5iuIZAODOR8Q==
X-Received: by 10.28.147.69 with SMTP id v66mr591689wmd.70.1472553437358; Tue, 30 Aug 2016 03:37:17 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.194.57.208 with HTTP; Tue, 30 Aug 2016 03:37:16 -0700 (PDT)
In-Reply-To: <B4BD5FDA-FB39-4714-92A3-EE647A8D06D9@vidyo.com>
References: <CAEn+E3h-b=8VEkhZ56Z9Ww+mTCA2H1B93UAkgbfmySyi2CnvnA@mail.gmail.com> <em8de2860d-9b70-44ce-87e5-3c6ecb1fb1ee@sydney> <B4BD5FDA-FB39-4714-92A3-EE647A8D06D9@vidyo.com>
From: Miguel París Díaz <mparisdiaz@gmail.com>
Date: Tue, 30 Aug 2016 12:37:16 +0200
Message-ID: <CAEn+E3jt9gzKU748uJrxAsu6eY-c5G23_=u6SHLRAv=oD4Z-ow@mail.gmail.com>
To: Jonathan Lennox <jonathan@vidyo.com>
Content-Type: multipart/alternative; boundary="001a114715de8bf29c053b479066"
Archived-At: <https://mailarchive.ietf.org/arch/msg/avtext/lby4SR8xqm2De-x2Aw6M9CqGeNU>
Cc: "avtext@ietf.org" <avtext@ietf.org>
Subject: Re: [avtext] framemarking: add frame size info
X-BeenThere: avtext@ietf.org
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: Audio/Video Transport Extensions working group discussion list <avtext.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/avtext>, <mailto:avtext-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/avtext/>
List-Post: <mailto:avtext@ietf.org>
List-Help: <mailto:avtext-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/avtext>, <mailto:avtext-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 30 Aug 2016 10:37:21 -0000

I assume that the media distributor has the information from the SDP (it
performs the SDP negotiation which each "client"), but the point is that
encoders may change the video size depending on the available bandwidth,
the complexivity of the video source, etc., unless the sender forces the
encoders' configuration with a fix frame size...


2016-08-26 19:07 GMT+02:00 Jonathan Lennox <jonathan@vidyo.com>:

> (As an individual.)
>
> In the latest version of simulcast the media distributor would need the
> RID values, not the PT values, but the idea is the same — it needs the SDP.
>
> Note that if the media distributor doesn’t have information from the SDP
> it can’t reliably identify the frame marking header extension at all, since
> header extension IDs are negotiated. So I’m not sure how much benefit there
> is to putting the size in the header extension.
>
> That said, if we envision a scenario where encoders might be frequently
> changing their video size (in response to available network bandwidth, or
> the like), it might be useful for encoders to be able to indicate the
> current size they’re encoding without needing to send updated SDP all the
> time.
>
> On Aug 26, 2016, at 12:52 PM, Paul E. Jones <paulej@packetizer.com> wrote:
>
> Miguel,
>
> You make the assumption that the media distributor will not see the SDP, I
> suppose.  While certainly a valid model, I'll admit that I had personally
> assumed any media forwarding function would see the SDP (or at least be
> told the PT values and any relevant flow information similar to what RFC
> 6236 provides) and would thus know which PT values correspond to what video
> resolutions if simulcast is employed.
>
> Paul
>
> ------ Original Message ------
> From: "Miguel París Díaz" <mparisdiaz@gmail.com>
> To: avtext@ietf.org
> Sent: 8/25/2016 10:12:48 AM
> Subject: [avtext] framemarking: add frame size info
>
> Hello,
> it would be great having frame size (width and height) info in the Frame
> Marking RTP header extension [1].
>
> Why?
> For example, in the case of using simulcast in an SFU, selecting the
> stream by the size would ease the application development and improve the
> experience of the users.
> Application developers don't usually have deep knowledge about media like
> bitrate, etc., but they know which video size has to be rendered in the
> GUI, which may depend on the client where the app is running: a mobile, a
> PC with a 13"· screen, a PC with 27" screen, etc.
>
> In this way and taking a videoconference app as example, if a participant
> select another participant to be rendered as main video, the app could ask
> the SFU to select the video quality that better matches to 800x600 size.
>
> What do you think about this idea?
>
> Thanks and best regards!!
>
> Refs
> [1] https://tools.ietf.org/html/draft-ietf-avtext-framemarking-02
>
> --
> Miguel París Díaz
> ------------------------------------------------------------------------
> Computer/Software engineer.
> Researcher and architect in http://www.kurento.org
> http://twitter.com/mparisdiaz
> ------------------------------------------------------------------------
>
> _______________________________________________
> avtext mailing list
> avtext@ietf.org
> https://www.ietf.org/mailman/listinfo/avtext
>
>
>


-- 
Miguel París Díaz
------------------------------------------------------------------------
Computer/Software engineer.
Researcher and architect in http://www.kurento.org
http://twitter.com/mparisdiaz
------------------------------------------------------------------------