Re: [rtcweb] Mute implementations (Re: More Comments on draft-ietf-rtcweb-use-cases-and-requirements-07)

Stefan Hakansson LK <stefan.lk.hakansson@ericsson.com> Thu, 14 June 2012 13:10 UTC

Return-Path: <stefan.lk.hakansson@ericsson.com>
X-Original-To: rtcweb@ietfa.amsl.com
Delivered-To: rtcweb@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A663221F865E for <rtcweb@ietfa.amsl.com>; Thu, 14 Jun 2012 06:10:25 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -5.849
X-Spam-Level:
X-Spam-Status: No, score=-5.849 tagged_above=-999 required=5 tests=[AWL=-0.200, BAYES_00=-2.599, HELO_EQ_SE=0.35, J_CHICKENPOX_41=0.6, RCVD_IN_DNSWL_MED=-4]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id PR3+eT+dpxHa for <rtcweb@ietfa.amsl.com>; Thu, 14 Jun 2012 06:10:25 -0700 (PDT)
Received: from mailgw1.ericsson.se (mailgw1.ericsson.se [193.180.251.45]) by ietfa.amsl.com (Postfix) with ESMTP id 9236B21F86B7 for <rtcweb@ietf.org>; Thu, 14 Jun 2012 06:10:24 -0700 (PDT)
X-AuditID: c1b4fb2d-b7fc66d000006fdc-50-4fd9e2bff60b
Received: from esessmw0197.eemea.ericsson.se (Unknown_Domain [153.88.253.125]) by mailgw1.ericsson.se (Symantec Mail Security) with SMTP id 3C.05.28636.FB2E9DF4; Thu, 14 Jun 2012 15:10:23 +0200 (CEST)
Received: from [150.132.142.244] (153.88.115.8) by esessmw0197.eemea.ericsson.se (153.88.115.88) with Microsoft SMTP Server id 8.3.264.0; Thu, 14 Jun 2012 15:10:23 +0200
Message-ID: <4FD9E2BE.2080907@ericsson.com>
Date: Thu, 14 Jun 2012 15:10:22 +0200
From: Stefan Hakansson LK <stefan.lk.hakansson@ericsson.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:12.0) Gecko/20120430 Thunderbird/12.0.1
MIME-Version: 1.0
To: rtcweb@ietf.org
References: <5A2F246E-9D77-4B72-B3F1-681B00FA99FD@cisco.com> <F3D4ABD6AB47084B84337CF4F3446A464B2F11B52E@ESESSCMS0362.eemea.ericsson.se> <AAB6A6B6-BEC7-436C-B1EB-2C117596C7C6@cisco.com> <F3D4ABD6AB47084B84337CF4F3446A464B2F2631AC@ESESSCMS0362.eemea.ericsson.se> <9F33F40F6F2CD847824537F3C4E37DDF021B53@MCHP04MSX.global-ad.net> <CA+9kkMCL1k3x2hYi632nDU2g6CtOq3O7risDi38+7FTeWkxcGA@mail.gmail.com> <9F33F40F6F2CD847824537F3C4E37DDF0223ED@MCHP04MSX.global-ad.net> <4FD89773.3090506@ericsson.com> <9F33F40F6F2CD847824537F3C4E37DDF02594D@MCHP04MSX.global-ad.net> <4FD9AD1E.6060504@alvestrand.no>
In-Reply-To: <4FD9AD1E.6060504@alvestrand.no>
Content-Type: text/plain; charset="ISO-8859-1"; format="flowed"
Content-Transfer-Encoding: 7bit
X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFvrNJMWRmVeSWpSXmKPExsUyM+Jvre7+Rzf9Df72KFus/dfO7sDosWTJ T6YAxigum5TUnMyy1CJ9uwSujJ/PLjIW/JKu2NB7g6WB8aBYFyMnh4SAicTanctZIGwxiQv3 1rN1MXJxCAmcYpTo+tbMAuGsZZQ49PY0E0gVr4C2xNfrG9lAbBYBVYmtyx6yg9hsAjYSa7un ANVwcIgKhEmsfqABUS4ocXLmE7AFIgLCEltf9YKNERYolLg/6SArxPxzLBJz5mwBm8MpoCux 8nUT2HxmAVuJC3Ous0DY8hLb385hBrGFgGrevb7HOoFRYBaSHbOQtMxC0rKAkXkVo3BuYmZO ermhXmpRZnJxcX6eXnHqJkZgAB7c8lt3B+OpcyKHGKU5WJTEebmS9vsLCaQnlqRmp6YWpBbF F5XmpBYfYmTi4JRqYEx+YP6pV5JhzWXd8oyPVjtzd6jwq/+03vyyyLWI+fXsOT7TOKQnHm7+ yHvyDg/bmpqm0vIattNbbr2fwMdkKyTfzqXJLmGbrZCvJWs569OVfw5zP3/zvZk4R09batmr uv+ZG/gP/wg4dKN2zZGn543aVjCcOfDbhGvdHyGz/p319TrzzJtTjyqxFGckGmoxFxUnAgB7 UE4bDgIAAA==
Subject: Re: [rtcweb] Mute implementations (Re: More Comments on draft-ietf-rtcweb-use-cases-and-requirements-07)
X-BeenThere: rtcweb@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Real-Time Communication in WEB-browsers working group list <rtcweb.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/rtcweb>
List-Post: <mailto:rtcweb@ietf.org>
List-Help: <mailto:rtcweb-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rtcweb>, <mailto:rtcweb-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 14 Jun 2012 13:10:25 -0000

On 06/14/2012 11:21 AM, Harald Alvestrand wrote:
> Changing the subject line again, since we're discussing how to do
> mute, not whether to do it.....
>
> On 06/14/2012 11:15 AM, Hutton, Andrew wrote:
>> On 13 June 2012 15:37 Stefan Hakansson wrote:
>>
>>> This is my personal understanding:
>>>
>>> - the API (and this part has been there for a long time) allows
>>> the application to disable/enable individual tracks of
>>> MediaStreams - So say you have a MediaStream (one audio track,
>>> one video track in this example) that is rendered using a video
>>> element; disabling audio would lead to silence, disabling video
>>> to that the video stops - The question is: what should happen if
>>> the MediaStream is connected to a PeerConnection and sent to a
>>> peer? - using recvonly does not seem appropriate as that would
>>> stop all ssrc:s belonging to the same m-line - and the app only
>>> disabled one - one option could be to simply stop sending the RTP
>>> packets for this track. I don't know how reliable that would be.
>> In the case of outgoing media then I think mute should simply
>> disconnect the source (e.g. microphone) and there is no impact on
>> RTP other than depending on the codec silence will be transmitted
>> or SID frame etc. There is also no impact on RTCP which continues.
>>
>> This is different to setting the direction to be recvonly which
>> would completely stop the outgoing RTP packets and would normally
>> be signaled to the remote party. This should of course be achieved
>> using setLocalDescription.
>
> Just to add to the complexity of the "mute" case:
>
> When an audio stream is muted, should there be comfort noise sent? If
> yes, what should determine the noise level?

To me it feels as that ideally we should stop sending RTP (and make the 
other end know that the track is disabled). If we go to comfort noise 
state, the track in the MediaStream at the other end would still be 
active (even though what is played could be very low level comfort 
noise), but to reflect the local state the remote track should go to 
"muted", shouldn't it?


>
> (people who've never had to deal with comfort noise can safely tune
> out at this point)
>
>>
>>
>>> - I think there has been proposals signaling this in SDP or in
>>> RTCP, but I don't think there was ever any conclusion
>> If we are talking about a local mute then I don't see any need to
>> signal this but again this is different to changing the direction
>> attribute in SDP.
>>
>>> For the other part, muting incoming media, this is simple: the
>>> app (at receiving browser) could just disable the tracks it wants
>>> in the incoming MediaStreams. A related question is if this
>>> should be signaled back to the sender (so it could stop sending).
>>> This is essentially a question of efficiency/optimization, and
>>> nothing stops the app from signaling that now using an app
>>> specific protocol (perhaps carried over the data channel), but
>>> perhaps this should be brought into SDP or RTCP.
>>>
>> If the application wants to ask the remote party to pause sending
>> of RTP then it should surely do this in SDP by setting the
>> direction attribute appropriately (i.e. sendonly or inactive).
>>
>> Regards Andy
>>
>> _______________________________________________ rtcweb mailing
>> list rtcweb@ietf.org https://www.ietf.org/mailman/listinfo/rtcweb
>
> _______________________________________________ rtcweb mailing list
> rtcweb@ietf.org https://www.ietf.org/mailman/listinfo/rtcweb