RE: [AVT] RE: [MMUSIC] questions about grouping media streams in RTP andSDP (RFC3388 etc), advice needed

"Thomas Schierl" <schierl@hhi.fhg.de> Thu, 07 June 2007 21:47 UTC

Return-path: <avt-bounces@ietf.org>
Received: from [127.0.0.1] (helo=stiedprmman1.va.neustar.com) by megatron.ietf.org with esmtp (Exim 4.43) id 1HwPpG-0003P8-Bh; Thu, 07 Jun 2007 17:47:26 -0400
Received: from [10.91.34.44] (helo=ietf-mx.ietf.org) by megatron.ietf.org with esmtp (Exim 4.43) id 1HwPpF-0003Nx-S2; Thu, 07 Jun 2007 17:47:25 -0400
Received: from mail.hhi.fraunhofer.de ([193.174.67.45]) by ietf-mx.ietf.org with esmtp (Exim 4.43) id 1HwPpE-0002p2-LW; Thu, 07 Jun 2007 17:47:25 -0400
Received: by mail.hhi.fraunhofer.de (Postfix, from userid 65534) id BD4E71D88F82; Thu, 7 Jun 2007 23:47:23 +0200 (CEST)
Received: from ipam040189 (DNab423247.Stanford.EDU [171.66.50.71]) (using TLSv1 with cipher RC4-MD5 (128/128 bits)) (Client did not present a certificate) by mail.hhi.fraunhofer.de (Postfix) with ESMTP id 8E49B1D88F5A; Thu, 7 Jun 2007 23:47:15 +0200 (CEST)
From: Thomas Schierl <schierl@hhi.fhg.de>
To: "'Even, Roni'" <roni.even@polycom.co.il>, 'Dave Singer' <singer@apple.com>, 'mmusic' <mmusic@ietf.org>, 'IETF AVT WG' <avt@ietf.org>
References: <000101c7a92b$c4752d50$595c40ab@ipam040189> <144ED8561CE90C41A3E5908EDECE315C049E7C50@IsrExch01.israel.polycom.com>
Subject: RE: [AVT] RE: [MMUSIC] questions about grouping media streams in RTP andSDP (RFC3388 etc), advice needed
Date: Thu, 07 Jun 2007 14:47:12 -0700
Organization: HHI/FhG
Message-ID: <009701c7a94d$6a4bb1b0$473242ab@ipam040189>
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Mailer: Microsoft Office Outlook 11
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028
Thread-Index: AcenhyxcbwKgryeQTM2S+JPzrTemewBpEXzgAATpg+AAAz/K0A==
In-Reply-To: <144ED8561CE90C41A3E5908EDECE315C049E7C50@IsrExch01.israel.polycom.com>
X-Spam-Checker-Version: SpamAssassin 2.64 (2004-01-11) on mail.hhi.fraunhofer.de
X-Spam-Level:
X-Spam-Status: No, hits=-104.9 required=5.0 tests=BAYES_00, USER_IN_WHITELIST autolearn=ham version=2.64
X-alterMIME: Yes
X-Spam-Score: 0.0 (/)
X-Scan-Signature: 17bdfcaea25d1444baef0e24abc38874
Cc: "'Clinton Priddle (KI/EAB)'" <clinton.priddle@ericsson.com>, Stephan.Wenger@nokia.com
X-BeenThere: avt@ietf.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Audio/Video Transport Working Group <avt.ietf.org>
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/avt>, <mailto:avt-request@ietf.org?subject=unsubscribe>
List-Post: <mailto:avt@ietf.org>
List-Help: <mailto:avt-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/avt>, <mailto:avt-request@ietf.org?subject=subscribe>
Errors-To: avt-bounces@ietf.org

Hi Roni,

Then it would be something like we call 'mdc'. But I would like to put that
into an extra dependency type, since the characteristics of the streams are
different, even if they could be used exchangeable. But there is one main
stream, let us say. And that one should be identifiable.

Thomas

> -----Original Message-----
> From: Even, Roni [mailto:roni.even@polycom.co.il]
> Sent: Thursday, June 07, 2007 1:07 PM
> To: Thomas Schierl; Dave Singer; mmusic; IETF AVT WG
> Cc: Stephan.Wenger@nokia.com; Clinton Priddle (KI/EAB)
> Subject: RE: [AVT] RE: [MMUSIC] questions about grouping media streams in
> RTP andSDP (RFC3388 etc), advice needed
> 
> Hi,
> My view is that you have similarity in the need for dependencies between
> streams but the grouping logic is different.
> In the layered codec the grouping is for a group that you can use all or
> part of while in the repair case you may take one or the other.
> 
> Roni Even
> 
> > -----Original Message-----
> > From: Thomas Schierl [mailto:schierl@hhi.fhg.de]
> > Sent: Thursday, June 07, 2007 8:46 PM
> > To: 'Dave Singer'; Even, Roni; 'mmusic'; 'IETF AVT WG'
> > Cc: Stephan.Wenger@nokia.com; 'Clinton Priddle (KI/EAB)'
> > Subject: RE: [AVT] RE: [MMUSIC] questions about grouping media streams
> in
> > RTP andSDP (RFC3388 etc), advice needed
> >
> > Hi Dave,
> >
> > I think there is a strong relation of your problem and the
> >
> http://tools.ietf.org/wg/mmusic/draft-schierl-mmusic-layered-codec-03.tx
> t
> > In this draft, we described media dependency in general, not only for
> > scalable video. Currently, two types of dependencies are defined:
> layered
> > and mdc assuming the media is partially transported in different RTP
> > sessions. There is not requirement, that the part of the media is
> > independently decodable. It would be easy to integrate your needs, if
> they
> > should not be already covered.
> >
> >
> > Thomas
> >
> > > -----Original Message-----
> > > From: Dave Singer [mailto:singer@apple.com]
> > > Sent: Tuesday, June 05, 2007 8:34 AM
> > > To: Even, Roni; mmusic; IETF AVT WG
> > > Cc: Clinton Priddle (KI/EAB)
> > > Subject: [AVT] RE: [MMUSIC] questions about grouping media streams
> in
> > RTP
> > > andSDP (RFC3388 etc), advice needed
> > >
> > > At 10:03  +0300 5/06/07, Even, Roni wrote:
> > > >Dave,
> > > >For layered encoding there is a proposal for a new grouping
> attribute
> > in
> > > >http://tools.ietf.org/wg/mmusic/draft-schierl-mmusic-layered-codec-
> > 03.tx
> > > >t
> > >
> > > I don't think this is a layered coding issue, either, alas.
> > >
> > > >I looked at RFC3388 and I think that FID is not the answer to your
> > > >requirement as you mentioned
> > > >
> > > >To me it looks like what you are looking for is a way to specify
> > > >alternate offers.
> > >
> > > No, these streams are not alternatives to each other in the regular
> > > sense.  Nor is this really used in offer/answer;  it's more an issue
> > > for multicast.  In multicast, you open the tune-in stream and the
> > > base stream, grab the first I-frame that arrives (in either) and
> then
> > > drop the tune-in stream.
> > >
> > > Yes, we're aware that the recipient needs to be able to tell which
> is
> > > the base and which is the tune-in.
> > >
> > > >If this is the case I have similar requirements and
> > > >would be happy to support such work.
> > > >
> > > >You also need a way to give semantics to the "repair" stream, this
> can
> > > >be done based on the content attribute from RFC 4796 or using a
> > > >dependency attribute see in Schierl's draft. The mid tag is not
> enough
> > > >for the receiver to know what you meant by this offer and which
> stream
> > > >is the repair.
> > > >
> > > >Here is an example for a solution using a new Alternatives grouping
> > > >attribute and giving semantics to the repair stream
> > > >
> > > >By using the grouping attribute in the offer you can know if the
> > > >answerer understood the grouping since if he does not than he will
> send
> > > >an answer with no a=group
> > > >
> > > >v=0
> > > >o=bob 280744730 28977631 IN IP4 host.example.com
> > > >s=
> > > >t=0 0
> > > >
> > > >a=group:ALTS 1 2
> > > >a=group:ALTS 1 3
> > > >
> > > >m=audio 6886 RTP/AVP 0
> > > >c=IN IP6 2001:0600::1
> > > >a=mid:1
> > > >
> > > >m=video 9000 RTP/AVP 100
> > > >c=IN IP4 192.0.2.2
> > > >a=rtpmap:100 H263-1998
> > > >a=mid:2
> > > >
> > > >m=video 9002 RTP/AVP 101
> > > >c=IN IP4 192.0.2.2
> > > >a=rtpmap:101 H263-1998
> > > >a=mid:3
> > > >a=content:repair=2 or a=depend:repair=2
> > > >
> > > >
> > > >Roni Even
> > > >
> > > >>  -----Original Message-----
> > > >>  From: Dave Singer [mailto:singer@apple.com]
> > > >>  Sent: Monday, June 04, 2007 7:19 PM
> > > >>  To: mmusic; IETF AVT WG
> > > >>  Cc: Clinton Priddle (KI/EAB)
> > > >>  Subject: [MMUSIC] questions about grouping media streams in RTP
> and
> > > >SDP
> > > >>  (RFC3388 etc), advice needed
> > > >>
> > > >>  Hi
> > > >>
> > > >>  we have a need to group together two media streams, in the style
> of
> > > >RFC
> > > >>  3388 <http://www.ietf.org/rfc/rfc3388.txt> but we're unsure
> whether
> > an
> > > >>  existing group type is suitable or not, and if it's not, we'd
> like
> > to
> > > >>  agree on a new one, and document it (presumably in an RFC).
> > > >>
> > > >>  What we have is a normal media stream, and a separate 'repair'
> or
> > > >>  'entry' stream, that can be used when tuning in, or after loss,
> but
> > is
> > > >>  otherwise un-needed.  An example might be a video stream with a
> low
> > > >>  I-frame interval (say every 15 seconds), with a repair stream
> which
> > > >has
> > > >>  only I-frames that are equivalent to the time-parallel non-I
> frame,
> > at
> > > >a
> > > >>  frequency of say 1 per second.
> > > >>
> > > >>  It's not clear to us whether this is "one media flow" in the
> sense
> > of
> > > >>  FID, or not.  The example offers AMR and GSM audio, which are
> > > >>  alternatives, and DTMF tones along with audio, which are
> > supplementary
> > > >>  to each other.  Perhaps we fall afoul of this restriction:
> > > >>
> > > >>  "An application that encodes the same media using different
> codecs
> > > >>  simultaneously MUST NOT use FID to group those media lines."
> > > >>
> > > >>  or this one, for layered encoding:
> > > >>
> > > >>  "FID MUST NOT be used to group "m" lines that do not represent
> the
> > > >same
> > > >>  information."  (Though how DTMF tones and their associated audio
> > pass
> > > >>  this test is not clear).
> > > >>
> > > >>  Nor is it clear that the FEC group of RFC 4756 is right, either.
> > For
> > > >a
> > > >>  start, we may wish to use this new ID in combination with FEC,
> and
> > > >>  secondly this tune-in stream has different characteristics.  For
> > > >>  example, one can typically ignore all FEC and (as long as there
> are
> > no
> > > >>  errors) decode the stream correctly.  Ignoring the tune-in
> stream
> > > >  > entirely may mean that you will never find a tune-in point,
> making
> > > the
> > > >>  normal stream useless.
> > > >>
> > > >>  So, can we use FID for associating a repair stream with its base
> (we
> > > >tag
> > > >>  the streams so we know which is which, of course)?
> > > >>
> > > >>  p.s. RFC 4756 claims in the IANA section that the FEC group is
> > > >>  registered under SDP characteristics, but actually I can find no
> > > >>  registry anywhere in IANA of group types.
> > > >>
> > > >>
> > > >>  --
> > > >>  David Singer
> > > >>  Apple/QuickTime
> > > >>
> > > >>  _______________________________________________
> > > >>  mmusic mailing list
> > > >>  mmusic@ietf.org
> > > >>  https://www1.ietf.org/mailman/listinfo/mmusic
> > >
> > >
> > > --
> > > David Singer
> > > Apple/QuickTime
> > >
> > > _______________________________________________
> > > Audio/Video Transport Working Group
> > > avt@ietf.org
> > > https://www1.ietf.org/mailman/listinfo/avt


_______________________________________________
Audio/Video Transport Working Group
avt@ietf.org
https://www1.ietf.org/mailman/listinfo/avt