[clue] New draft on controlling codec parameters; draft-westerlund-avtext-codec-operation-point-00

[Bo Burman <[e-mail]>]

Hi,

My colleagues and I have a proposal for an RTCP extension to AVPF CCM allowing a media receiver to dynamically ask the media sender to use a certain codec configuration (called a Codec Operation Point, COP). We see this as being used both in WEBRTC (RTCWEB WG) and Video Conferencing / Telepresence (CLUE WG). Additional applications are expected.

The proposal is not intended to replace or conflict with codec negotiation taking place during SDP Offer / Answer, but rather optimize and fine-tune codec usage within the limits established by SDP O/A.

The draft defines a set of what is believed generally useful and reasonably codec-independent set of parameters. Those parameters can be used by a media sender to describe the codec configuration (Codec Operation Point) used to generate the media stream to the media receiver. The media receiver can in turn examine the parameter values in the announced Codec Operation Point and use the same set of defined parameters to ask the media sender to use other, more suitable values for those parameters. It is the media sender's responsibility to decide if such request can be honored or not. If the request is accepted, the media sender then changes the media stream accordingly and sends another Codec Operation Point announcement with the changed parameter values.

One possible example is to let a video media receiver control the encoded video resolution based on decoded video window display size.

https://datatracker.ietf.org/doc/draft-westerlund-avtext-codec-operation-point/

This draft is designed to:

* Allow for minimal implementation. The media sender need only announce COP support for the payload types it wishes to make controllable. It is not a requirement to support all parameter types, and receive support for each parameter type is signaled explicitly in SDP. Unsupported parameter types can safely be ignored.

* Be extensible. It is for example easy to define more parameter types in extensions to this draft. New message types and result codes can also be defined as extensions.

* Be possible to use both in point-to-point, in multipoint (conferencing), and even some specific multicast situations.

* Be responsive. The user at the media receiver can request and experience the result of changes in a dynamic and interactive fashion. The codec control signaling need only traverse the media path and uses the most responsive RTCP mode available, AVPF.

* Support single layer as well as multi-layered (scalable) media streams. A multi-layered media stream can easily be described and configured by using multiple, simultaneously active Codec Operation Points.

* Be as media and codec agnostic as possible. The defined parameter types are chosen to be as generic as possible and should therefore apply to many different codecs. Some media type awareness is however included in the chosen set of parameters.

* Be robust. It leaves to the media sender to decide exactly what is changed. A media sender that receives a request to set a certain value for a parameter can choose another value that is seen as more appropriate, or even choose to not change anything at all. "Unreasonable" requests can thus safely be ignored.

* Be flexible in what type of parameter value restrictions that can be described. A request can use either an exact single value, an open-ended minimum or maximum restriction, or a range of values. It is also possible to use a "target" value, standalone or in combination with a range, to express a preference. It is even possible to specify a set of prioritized, alternative configurations that the media sender can choose from.

* Allow for advertised, synchronized configuration changes. The Codec Operation Point notification can be time stamped some time into the future, allowing the media receiver some time for informed preparation (if needed) before the actual media stream change occurs.

We would like to see this work as WG item in AVTEXT WG.

If you have input, please provide comments to the AVTEXT WG (reply-to set there).

Best Regards

Bo Burman

----------------------------------------------------------------------
Multimedia Technologies, Ericsson Research EAB/TVM
----------------------------------------------------------------------
Ericsson AB                 | Phone  [phone]
Färögatan 6                 | Mobile [phone]
SE-164 80 Stockholm, Sweden | mailto: [e-mail]
----------------------------------------------------------------------