RE: [AVT] Requirements draft on video control

"Even, Roni" <roni.even@polycom.co.il> Wed, 09 July 2003 06:39 UTC

Received: from optimus.ietf.org (ietf.org [132.151.1.19] (may be forged)) by ietf.org (8.9.1a/8.9.1a) with ESMTP id CAA20219 for <avt-archive@odin.ietf.org>; Wed, 9 Jul 2003 02:39:55 -0400 (EDT)
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 19a8bw-0005pE-HI for avt-archive@odin.ietf.org; Wed, 09 Jul 2003 02:39:28 -0400
Received: (from exim@localhost) by www1.ietf.org (8.12.8/8.12.8/Submit) id h696dS3j022386 for avt-archive@odin.ietf.org; Wed, 9 Jul 2003 02:39:28 -0400
Received: from localhost.localdomain ([127.0.0.1] helo=www1.ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 19a8bV-0005n0-M6; Wed, 09 Jul 2003 02:39:01 -0400
Received: from odin.ietf.org ([132.151.1.176] helo=ietf.org) by optimus.ietf.org with esmtp (Exim 4.20) id 19a7n5-0007up-W4 for avt@optimus.ietf.org; Wed, 09 Jul 2003 01:46:56 -0400
Received: from ietf-mx (ietf-mx.ietf.org [132.151.6.1]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id BAA22922; Wed, 9 Jul 2003 01:46:53 -0400 (EDT)
Received: from ietf-mx ([132.151.6.1]) by ietf-mx with esmtp (Exim 4.12) id 19a7n2-0003kJ-00; Wed, 09 Jul 2003 01:46:52 -0400
Received: from 212.199.61.2.forward.012.net.il ([212.199.61.2] helo=accord-ntsrv3.polycom.co.il) by ietf-mx with esmtp (Exim 4.12) id 19a7n1-0003k8-00; Wed, 09 Jul 2003 01:46:51 -0400
Received: by ACCORD-NTSRV3 with Internet Mail Service (5.5.2656.59) id <31W6KGSH>; Wed, 9 Jul 2003 08:46:24 +0300
Message-ID: <C550397C3B6AEB418E62170D9E349CE213727F@ACCORD-NTSRV3>
From: "Even, Roni" <roni.even@polycom.co.il>
To: 'Gary Sullivan' <garysull@windows.microsoft.com>, Andrea Basso <Andrea_Basso@nmss.com>, avt@ietf.org, avt-admin@ietf.org, mmusic@ietf.org
Cc: casner@acm.org, jo@tzi.uni-bremen.de, magnus.westerlund@ericsson.com, csp@csperkins.org, Orit Levin <orit@radvision.com>, "Even, Roni" <roni.even@polycom.co.il>, nismail@cisco.com
Subject: RE: [AVT] Requirements draft on video control
Date: Wed, 09 Jul 2003 08:46:19 +0300
X-Mailer: Internet Mail Service (5.5.2656.59)
Sender: avt-admin@ietf.org
Errors-To: avt-admin@ietf.org
X-BeenThere: avt@ietf.org
X-Mailman-Version: 2.0.12
Precedence: bulk
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/avt>, <mailto:avt-request@ietf.org?subject=unsubscribe>
List-Id: Audio/Video Transport Working Group <avt.ietf.org>
List-Post: <mailto:avt@ietf.org>
List-Help: <mailto:avt-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/avt>, <mailto:avt-request@ietf.org?subject=subscribe>

Hi Gary

About
"It is also possible to obtain random access recovery without a fast
update.  This is sometimes called "gradual decoder refresh".  See for
example the recovery point SEI message in H.264/AVC."

In case of a video switch in a multipoint conference there is a need to get
a new recovery point since the decoder will receive a stream without a
previous recovery point. The procedure in H.241 allows for either a full
picture at once or gradual recovery based on an SEI recovery point message.
Both method are fine as an encoder response to a fast update request.

Regards
Roni Even

-----Original Message-----
From: Gary Sullivan [mailto:garysull@windows.microsoft.com]
Sent: Wednesday, July 09, 2003 3:03 AM
To: Andrea Basso; avt@ietf.org; avt-admin@ietf.org; mmusic@ietf.org
Cc: casner@acm.org; jo@tzi.uni-bremen.de; magnus.westerlund@ericsson.com;
csp@csperkins.org; Orit Levin; Roni Even; nismail@cisco.com
Subject: RE: [AVT] Requirements draft on video control



Much of the content of this ID will look familiar to those with
experience with ITU-T systems control specifications (such as H.245).

Some of it seems like it could use a bit of updating in that regard
(e.g., videofastupdateGOB).
Draft Recommendation H.241 is one good place to look for such
information.

Section 3 is a bit confused in its terminology.  For example it seems to
say that intra frames are also known as inter frames, which is
definitely not the case.  It mixes the terms "predictive" and
"prediction" and seems to consider a "reference" frame to be synonymous
with an intra frame.  The terms "picture" and "frame" are also kind of
mixed up.

A more consistent terminology would be as follows:

An intra picture is a picture that can be decoded without first decoding
any other picture.

A predicted (or non-intra) picture is a picture that may require data
from one or more previously-decoded pictures in order to be properly
decoded.

A reference picture is a picture that is stored in the decoder for use
as a reference in the decoding process of some subsequent picture in the
bitstream.

A non-reference picture is a picture that is not used as a reference for
the decoding process of any other picture in the bitstream.

The concepts of intra versus non-Intra and reference versus
non-reference are independent.  A particular picture can (in general) be
any one of the four types (intra reference, non-intra reference, intra
non-reference, non-intra non-reference).

A "fast update", also known as an "instantaneous decoder refresh",
involves sending an intra picture and thereafter refraining from using
any picture sent prior to that intra picture as a reference for the
decoding process of any subsequent picture sent in the stream.

In particular it is worth noting that some concepts that applied to some
older codecs are not really valid in general and should be avoided
(e.g., that a non-reference picture is called a B picture or that an
intra picture is the same thing as a fast update or that an intra
picture is always a reference picture).

The characterization of a "slice" or "GOB" as being a "stripe" is not
really quite right.  For example, a single slice in MPEG-1, H.263 Annex
O, or MPEG-4 can consist of a few macroblocks at the right edge of one
row and a few macroblocks at the left edge of the next row (i.e., two
distinct rectangular regions quite far apart from each other in the
picture can be in a single slice).  A GOB in H.261 CIF consists of THREE
partial rows of macroblocks extending only halfway across a picture.
And in H.264/AVC, a slice can be ANY collection of macroblocks scattered
around absolutely anywhere in the picture (by use of a feature known as
a "slice group map").

In regard to section 5.1 VideoFreezePicture, I believe H.262 (also known
as MPEG-2 Video) also supports a freeze picture release within the ITU-T
extension.

It is also possible to obtain random access recovery without a fast
update.  This is sometimes called "gradual decoder refresh".  See for
example the recovery point SEI message in H.264/AVC.

Best Regards,

Gary Sullivan


+> -----Original Message-----
+> From: avt-admin@ietf.org [mailto:avt-admin@ietf.org] On 
+> Behalf Of Andrea Basso
+> Sent: Monday, July 07, 2003 2:34 PM
+> To: avt@ietf.org; avt-admin@ietf.org; mmusic@ietf.org
+> Cc: casner@acm.org; jo@tzi.uni-bremen.de; 
+> magnus.westerlund@ericsson.com; csp@csperkins.org; Orit 
+> Levin; Roni Even; nismail@cisco.com
+> Subject: [AVT] Requirements draft on video control
+> 
+> 
+> Attached you will find draft-basso-avt-videoconreq-00.txt
+> 
+> Abstract:
+> 
+> A variety of communication services such as video
+> conferencing and video messaging rely on the capability of video
+> encoders and decoders to exchange control commands. This document
+> outlines this set of commands as well as the requirements for
+> their transport.
+> 
+> Comments are more than welcome.
+> 
+> 
+> 
+> 
+> 
+> Andrea Basso
+> NMS Communications
+> (732) 936-2118
+> (See attached file: draft-basso-avt-videoconreq-00.zip)
+> 

_______________________________________________
Audio/Video Transport Working Group
avt@ietf.org
https://www1.ietf.org/mailman/listinfo/avt