[MMUSIC] pause/resume in draft-ietf-mmusic-sdp-simulcast

Matthew Kaufman <mkaufman@bluejeans.com> Tue, 09 July 2019 23:09 UTC

Return-Path: <mkaufman@bluejeans.com>
X-Original-To: mmusic@ietfa.amsl.com
Delivered-To: mmusic@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 534A51200F6 for <mmusic@ietfa.amsl.com>; Tue, 9 Jul 2019 16:09:23 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.699
X-Spam-Level:
X-Spam-Status: No, score=-2.699 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=bluejeans.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id A9h2mZB7X5Ls for <mmusic@ietfa.amsl.com>; Tue, 9 Jul 2019 16:09:19 -0700 (PDT)
Received: from mx0b-00292101.pphosted.com (mx0b-00292101.pphosted.com [148.163.152.156]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id F31EE120075 for <mmusic@ietf.org>; Tue, 9 Jul 2019 16:09:18 -0700 (PDT)
Received: from pps.filterd (m0114297.ppops.net [127.0.0.1]) by mx0b-00292101.pphosted.com (8.16.0.27/8.16.0.27) with SMTP id x69N53Mp029694 for <mmusic@ietf.org>; Tue, 9 Jul 2019 23:09:17 GMT
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bluejeans.com; h=from : to : subject : date : message-id : content-type : mime-version; s=pod032818; bh=85RfzfUBhn1Z2h9E81lmjJbwXqBb4Ma7ct0cu115bec=; b=OqSLth2fwD7cgi6zP1QqzSngvMTkDOJVYaVCFxRNFJJebTbySK7crkgaxNYa779MCQCL OWPGXpqKu77M/h5mK59erWTNwJdGcNr6jsVsVVVGqusXx2iwqWw5RW8G4SFU3A6FHeTE NWt3+oiBUdsqNtDroXj49Fv3gZvwJ08/l46QQIIckeNOdyi9QslwsAWCYR9xscqCnLQ/ RQfHLOjBhwdbBahmVWTDWEBJ4eGLIpDmzhlTCM9gUUYyWpuMGx+uA3ue8h9qj2ahZaTx 7/lZRJ93BUhm0LwLT+MBvZh7cXmy/CrXmXydmc/FQKCB95mI/0g5+qrITR9BfLpEZwBw Ww==
Received: from nam04-sn1-obe.outbound.protection.outlook.com (mail-sn1nam04lp2052.outbound.protection.outlook.com [104.47.44.52]) by mx0b-00292101.pphosted.com with ESMTP id 2tjmbk1wjv-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT) for <mmusic@ietf.org>; Tue, 09 Jul 2019 23:09:17 +0000
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=hliVM+I1roYQL82vqLCOJ5pcLt+Djs5nnUCc1u8rWrHrjLFH3xMuG9M0lfZmXfooGo2+6zSUZY86oZYuzwzLcf72twZrcc7E818W06/btuFQXzfks7wgx3Row7MBFu8UavMx/FiL515HUzVA8Yb7PSShNu7gmFDOUOvzDTqFbVw2fwbvrjERbZuXA3ANWWvBCgb96WYjI8XpDS5xD+9CS0otYL16Yfaz4FwYeIHUq9X8acPXQk3UyVSev2/Vz2ZcwobLCfNSI+4gt0qWbIbmMis3sPv3mAtVVSYsqNI0qGmBXPWYFKJoaSkSkG7TNomm2QngtDKDX+eMl/iXw0slrA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=85RfzfUBhn1Z2h9E81lmjJbwXqBb4Ma7ct0cu115bec=; b=mdkzNo3jW3o6hvwJR8T+JCg8ElvGDEMeeXMdmX61rlEISWhgHozWMuPDYK5Az9JAAuklh4e05F4pFOGQVgx3Wu885V/v3YylO+W/m8axDoUWu9TII+ehpdti5w7l8woYd36dYwSdQ25svFv/JO8ShoZ6w7jZIeHc4FjIb8laBomSDp8qbfA2mF3dz3wuWV55PxI/xJfjKiAGne027vcSVXvoNn7aQsND29xVjoa0NSaMXapf2PxyqoPbuW5PtbDIbt0NQreYfNgeyel3bHLFKZUPYaIw65jrJYWpLDD2y9PJDrg9Fe9UBuqXWbsn1z1+MVn0Bp1W88DUpoWs7fq3Hw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1;spf=pass smtp.mailfrom=bluejeans.com;dmarc=pass action=none header.from=bluejeans.com;dkim=pass header.d=bluejeans.com;arc=none
Received: from BY5PR13MB3585.namprd13.prod.outlook.com (10.255.154.206) by BY5PR13MB2933.namprd13.prod.outlook.com (10.255.162.160) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2073.6; Tue, 9 Jul 2019 23:09:16 +0000
Received: from BY5PR13MB3585.namprd13.prod.outlook.com ([fe80::e9fb:9928:d30a:b39a]) by BY5PR13MB3585.namprd13.prod.outlook.com ([fe80::e9fb:9928:d30a:b39a%7]) with mapi id 15.20.2073.008; Tue, 9 Jul 2019 23:09:16 +0000
From: Matthew Kaufman <mkaufman@bluejeans.com>
To: "mmusic@ietf.org" <mmusic@ietf.org>
Thread-Topic: pause/resume in draft-ietf-mmusic-sdp-simulcast
Thread-Index: AQHVNqtUqDex179l60GYkf7WovizTQ==
Date: Tue, 09 Jul 2019 23:09:15 +0000
Message-ID: <BY5PR13MB3585763210697D5EC6A48FA9CEF10@BY5PR13MB3585.namprd13.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [71.198.232.35]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: e2ade9ac-cb80-402e-186e-08d704c276e1
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600148)(711020)(4605104)(1401327)(2017052603328)(7193020); SRVR:BY5PR13MB2933;
x-ms-traffictypediagnostic: BY5PR13MB2933:
x-microsoft-antispam-prvs: <BY5PR13MB29338590FD51709D276B3291CEF10@BY5PR13MB2933.namprd13.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-forefront-prvs: 0093C80C01
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(346002)(396003)(376002)(39850400004)(366004)(136003)(189003)(199004)(6116002)(5640700003)(3846002)(74316002)(2501003)(6436002)(2906002)(68736007)(53936002)(316002)(66066001)(33656002)(14454004)(6506007)(9686003)(54896002)(66946007)(7696005)(14444005)(186003)(55016002)(71190400001)(486006)(71200400001)(19627405001)(102836004)(8676002)(26005)(1730700003)(81156014)(81166006)(105004)(7736002)(6916009)(25786009)(5660300002)(86362001)(256004)(8936002)(52536014)(99286004)(478600001)(476003)(2351001)(66556008)(66446008)(64756008)(66476007)(76116006); DIR:OUT; SFP:1101; SCL:1; SRVR:BY5PR13MB2933; H:BY5PR13MB3585.namprd13.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: bluejeans.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: aD02ClPkjdh6dZ5WqtkM/uP39PUdl1S8bF+R4UQbLbBKCdc5CLUPXFNo0zuyN4jiKaAFyUU0DWs8WWDPhMWYfJdnRA0BxCDm2vP8661ynYsJ6a6EiAG02cXwncizPRcNlwTE15cmgTeJrcl9cNlv+uJioPmx/oS6gCmN3b8zAdhI7EMAExAMrFF8pj3EQYDQADHh4kPUGnW9giuAjJxfor+K44ag6OYaFxm8tHbF6GVFmiGptuCMCySboHw3mUEaTZQc6M+mqUejBxdO2Wa6LBO5xyAa7+xAz4JudUXnkLom7Z0dP8ENPQtqyuHibjJbVSnyqeT640sVQu0lHjogiTEul7eSDT5wAMsJdPoOev+kpmtiECxwh4JRJW42LBil6r+BiRzME/QNc01ArppC28axkgbldEJNaHw4c1MEBzY=
Content-Type: multipart/alternative; boundary="_000_BY5PR13MB3585763210697D5EC6A48FA9CEF10BY5PR13MB3585namp_"
MIME-Version: 1.0
X-OriginatorOrg: bluejeans.com
X-MS-Exchange-CrossTenant-Network-Message-Id: e2ade9ac-cb80-402e-186e-08d704c276e1
X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Jul 2019 23:09:15.9405 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 78d2bd57-5099-4199-92a8-4626e5d3c18b
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: mkaufman@bluejeans.com
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY5PR13MB2933
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2019-07-09_09:, , signatures=0
X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=630 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1810050000 definitions=main-1907090276
Archived-At: <https://mailarchive.ietf.org/arch/msg/mmusic/NtaVkueSCb0MsnYr91vxArCpTZI>
Subject: [MMUSIC] pause/resume in draft-ietf-mmusic-sdp-simulcast
X-BeenThere: mmusic@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Multiparty Multimedia Session Control Working Group <mmusic.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/mmusic>, <mailto:mmusic-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/mmusic/>
List-Post: <mailto:mmusic@ietf.org>
List-Help: <mailto:mmusic-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/mmusic>, <mailto:mmusic-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Jul 2019 23:09:24 -0000

Issue 1 - Shouldn't stream pause/resume be required?

If I'm a SFM and you are sending me multiple simulcast streams and I decide that nobody is watching one of them, it is wasteful of bandwidth and power (CPU) for you to continue sending a stream I don't want. Likewise if I'm a client and you're sending me simulcast streams directly. I believe that for this reason, pause/resume should be mandatory in this draft. All of the below issues rely on having pause/resume messaging for their successful resolution.

Furthermore, I believe that we must require that TMMBR 0 NOT be used for pause of simulcast streams, because of the relevant note in section 5.5 of RFC 7728. (See Issue 3 below)

Issue 2 - What to send in the media (or signaling) layer when bitrate adaptation says there's not enough bandwidth to send?

If I'm a SFM and I'm receiving your three streams that you are sending (ex., 180P, 480P, 720P all with temporal scaling) and you decide that you can't send the 720P any more, how can I tell the difference between "sender ran out of bandwidth" and "sender is broken"? In particular, if I have subscribers to your 720P stream, and you ran out of bandwidth, I need to know ASAP to start forwarding them the 480P stream instead. Thus an indication that you have paused, preferably in the media stream itself, would be useful... and furthermore, it would be nice to know why you've chosen to do that.

This can be (largely) solved by requiring senders to use the PAUSED indication for this case, and calling that out explicitly in section 7.1 (or elsewhere) of the draft (though as a receiver, it would be nice to know the difference between the various reasons a sender might have appeared to me to have unilaterally decided to pause)

Issue 3 - What to send when bitrate adaptation says there's not enough bandwidth to send *and* pause has been requested for a lower bandwidth stream?

If I'm a SFM and I'm receiving your three streams (ex., 180P, 480P, and 720P) and I note that my viewers are only watching your 720P it would save bandwidth and CPU to send you a pause for the 180P and 480P streams. Once I request that of you, and these are paused, what are you allowed to do when bandwidth adaptation determines that there isn't sufficient bandwidth to send the 720P? Can you unilaterally un-pause the 480P stream in order to keep sending video, or are you forced to stop the 720P and hope the SFM guesses properly that it needs to request un-pause of the 480P?

Likewise, what if the lower resolution streams were signaled as initially paused? Can the sender unilaterally un-pause one in order to use it instead of a higher-bandwidth choice?

I believe the answer here lies in RFC 7728, where an RTP sender may due to local considerations choose to resume at any time, however because TMMBR 0 prohibits this, TMMBR 0 must not be used to pause simulcast streams that a remote sender may need to begin using in order to bandwidth-adapt.

This required behavior (unilateral unpause if necessary) should be noted in section 7.1 of the draft.


Matthew Kaufman