[AVTCORE] Discussion: RTP/SDP Signaling for Opus Multistream (multi‑Opus)

Sun Shin <sushin@nvidia.com> Mon, 20 October 2025 18:01 UTC

From: Sun Shin <sushin@nvidia.com>
To: "avt@ietf.org" <avt@ietf.org>
Thread-Topic: Discussion: RTP/SDP Signaling for Opus Multistream (multi‑Opus)
Thread-Index: AQHcQek8YXho4HnhrkG6KxzhNo8Abg==
Date: Mon, 20 Oct 2025 17:57:56 +0000
Message-ID: <CH2PR12MB951735E9E754FB881C5D9875B2F5A@CH2PR12MB9517.namprd12.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
msip_labels:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nvidia.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: CH2PR12MB9517:EE_|CY5PR12MB6106:EE_
x-ms-office365-filtering-correlation-id: 632554a7-a7dd-489a-d0a9-08de10023345
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;ARA:13230040|376014|1800799024|366016|38070700021|8096899003|13003099007;
x-microsoft-antispam-message-info: jB/ZIMMzFA/MAV52KKbKGr59a5jl7r0hS7G+4vI61sEIIF5IV8+PKoKxyVaQro0cGhICPmiv38j9aJUkzdAjalH/fVBgSoIOYDZiMcmUb3isJaaWp+T/JM9hbE2Xgi9LzVI5WMM6WcHGwx6QEXXnWheQbPoe4j9RJFfC7auz0DUbbsakP/FISg5FZkdpBkVXaoOBhr9BVy6sVwZ+Ad32HONSXGQz+PRPsbKEVgvcUpj53aAdxhu63P7AGQ916q4ouOmgK0A/xdEmKm9j0pNyZE2KEOF/J0GNDgiEzQpqCZ8pPQLpBgd1vQD7bwNx8zFJi0z1GTPJcdKfbAyLfQoCFp+VNE66bcOkxHbbNCZZsDImIiW4APeTfG1N3psSczchrdLqNQTt34RysHJWmBIBCj/glmLYJe2lRNkKrwYAwD/jVNOebab1dH0CYu051X8I5T+en0icg8r4Nu1vshymkNNtJqGeab6jEydcYRho/Re4MIuNaqPds0y22Ywo9yGNx12mcrpEOZ7H+tSSbyqNNlZD1f9+GP76UuHHtiUPgLtz432EZRrWU7JSzADnVh6Kbt5tVpekyWUFX+5Mn34Mnoq7v+RLSOKR2GX1k7t95RW+vvaqZSm6W98t4yP3FkBMFcVMYuNDhXTG3go1leKbY3fnmzlJftRCeMEka2FmRQsaeVGG4orUCweoB47TmfHrqkwZFsd3V5+76mmLv6EIZ7JGk8B1h/7xAkQob8dfvIkuYXGFngma1ZmEGHanQxYWm9HSVnNhv9XKw2Ap/FsvVWKmae0os7yZ+fHRa0ejC9tELlJCh85TkOYamUQMIG9x8/5tayiUky2bStCEqFiEZf3BvJqhDNVySdUdSzN6145peKPeLXp1VPdS8QIkR03N70hr1kT1Zhm28lKPJd+FJDkXboZ1qk5WSsVAd120+8XngUnklA7svzGQSGUECAKZ8fVhRvKfV/ldR0ERHlLom3ll7IL2orjq+G+xlb1sm6hw5PKDh7LV2R5PvPciKFsZJIfAa/o+i8K7FS+gHU6FDvMr5KC4b46UsYI/IAsqlJ8HSwBmp2BcQAlaVdPSnOYfV0M9HkT2PHLJ6GHeFPdxM3k/hnwzMxNL+9PMV31LGmAnGZ/rXGQU3m3rHJAekDNZNgRY700dnj6x4JIrLBaL/t6x/ie1otxoEhNJfkFEvUCMRk+uPst2XifdfXxAuvgAEsYyjvDLDJp9FdtiHj1aij4SBUOAcr2VKmBcZdGmhX5XUnhDLFnLVDCw1Lx2JhNcTzrlklDoruB4Sh4eKUjxf2BWlFcD8hZ1/VnA+3nE2iMOh5pWRzT4VgASrk8BOb0w4/WL3ldAP4CsgYri4ChLZ5gXB1Co1ur0USleDLMlq0aMHN6s5GflTsxj8oRWQgWJqFgqUpvlrw3deY931iERaZ7W27FW3xZgVzJjCYuTpJJ1oNhkCyhWgs9jzab0q9LQ
x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CH2PR12MB9517.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(376014)(1800799024)(366016)(38070700021)(8096899003)(13003099007);DIR:OUT;SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: kPIpe2vvEGKRafVjy78y7zTUCKe6Q4zQEMWfcuDxqZ217FYK7n0ID3mO1SkEojgGlZujBM58fibxHNoDeXMdd2mzrdk6YHse9846JN/0M9Z8/LJ+UFSwgMcMhJkWdnCgUqV7fdJLIgo59H7wV8M0e7CueAvO3lmyPn5wQ0WWDYI8KJ7JuCIOpJBJH1QXskBeggS9Zxnhn/4Dr5aA0qdr/SVxwfRfQbff/f8NCX7FPom/cjc8s7gQW9jkduo6wyYFXNLNwAGfqH33hHiU9unXmUQ4M0phcLJQQqLtaOL87n/YJOMo3LwFxfR7EIrlRIZjOJ30ZuQEQ1raFjYLttjZyA1DqM7tEnn0iQI2GNGmpLc28NDdfnx5La2498Vg3ubamoQoH3IRvuc/Dt8HH53HARozYhjKV4ji2hMT2VPYpWTK5pRptNverG9CWuyqPam9Riea9fS42nuq/Y191PrPFEwGkPhrWP0OUb58ezpStJ6PU2yIpj5JGKEpsWJwmnn+B4sd5CqDIOzCw3XN1WyGtP9xR3/E4G8qohBgGaFDEO04sdDKzY9cKJLJIsRdwKKHXcq20MKmJ9pMiUfTADdYVf94VkqqFc42a9goqrHPCH81iaGJI9sGugoMEf7ZfSor4JWHTFlti4RllZvQZcdL13Ka14LpKmXu/qwQfE3Lu/Ah/XsIcGM8gHWWPzuBFboOpLxdvTamZXmMk8i88RaRPc+twDrTB3TgciP3+TheyIx+sAFLIl7aiff62mk2s79YUc2d2J/u5H7mOio7DW8u9NecpH9RLRUB6/I/VT7zZWuSGQyKlWrBTscihwb+9VRFZD6EurLC9NZgu5ue3K1brPuiyFcktZWgUPcOINanLA+/opOfaLZXnPOjBcYG5+HzV7HJp0dbQqvoauyvKu0mu+/mADCBJi6vDScCgKbGCTgQVOYDu/z25OfRzdkyZ2yXbckPUq6UKNxF+lT1N5Aq8NhjoQZXOnrh8vXiZ0xg+TBGzSPswr86b7AfNUFIDNR/1CBdmz7kWTQZDDKrxbgJYOShzLM8DWUqoyCzEEYkuhlQuWpu7fQ5sNDoI8PNZM6n4Q93nuB1RIz9hXGOD8V0xCNt5BxTDk9DNVyeQw7CLcVvPmCi+Io3TgDhteuET72DCDnMWdsIqvhvB6d9S0P4x4ahok+9BkH5kFY/jwEU+OuRdT4K2EI8URcF8MU5qugvZ4ucYVyZ1HXamNoj6a02q4RimD1wjvSxuqFrF/7hvzm4zEXxrUKSyNaB3Bnc4XBvCQVlBzzPbEif51jhyIKrcn4DuW1p1xIAdIB7/u7wBH/4r3dulUzgU1Ofxs1mT/hIvt7gtQlUGQmV5FNENUunFXj/gJx0OUBJhyOf2UlCZB/Z9U8qBToeMv/r3UOBAUsqPGUUW7Wx+LO/8HgIadxjs7xrOmd4gjJkXscQuvq+MFBUPvJZkUY4zSR0IdAqijYVbFYVdSO2j0YfxDIQ4tnvNMFBf/JCclfee/gkaDUpTlY5kSAV9EPjOG7/Gq/Ks0mumGPU9EkpZGDQqxfwng5aIRhqfflom/s5Yr+IiqndfHM=
Content-Type: multipart/alternative; boundary="_000_CH2PR12MB951735E9E754FB881C5D9875B2F5ACH2PR12MB9517namp_"
MIME-Version: 1.0
X-OriginatorOrg: Nvidia.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: CH2PR12MB9517.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 632554a7-a7dd-489a-d0a9-08de10023345
X-MS-Exchange-CrossTenant-originalarrivaltime: 20 Oct 2025 17:57:56.8902 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 43083d15-7273-40c1-b7db-39efd9ccc17a
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: yx2PFJzR16lNoZ4uKHBVwiDz+8nWn+odezVCeEGgbJ/XUjOdwAXanMKYxtNsX+qNqqfIJoaZ/7VPsyGvuSc57w==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY5PR12MB6106
Message-ID-Hash: XA5TJBUNKBR4GH3BTQBMJH3DDCRHHUBD
X-Message-ID-Hash: XA5TJBUNKBR4GH3BTQBMJH3DDCRHHUBD
X-MailFrom: sushin@nvidia.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-avt.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [AVTCORE] Discussion: RTP/SDP Signaling for Opus Multistream (multi‑Opus)
List-Id: Audio/Video Transport Core Maintenance <avt.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/avt/KvAcFp2D2cY5WVlcl1tuyJAIntE>
List-Archive: <https://mailarchive.ietf.org/arch/browse/avt>
List-Help: <mailto:avt-request@ietf.org?subject=help>
List-Owner: <mailto:avt-owner@ietf.org>
List-Post: <mailto:avt@ietf.org>
List-Subscribe: <mailto:avt-join@ietf.org>
List-Unsubscribe: <mailto:avt-leave@ietf.org>

Hi AVTCORE,
I’d like to initiate a discussion and request feedback on standardizing RTP/SDP signaling for Opus multistream (“multi‑Opus”) to support multichannel layouts (e.g., 5.1, 7.1) in real‑time communications like WebRTC<https://webrtc-review.googlesource.com/c/src/+/129768>.
Problem

  *   RFC 7587<https://www.rfc-editor.org/rfc/rfc7587> defines mono/stereo SDP signaling and excludes multistream.
  *   RFC 6716<https://www.rfc-editor.org/rfc/rfc6716> supports multistream (up to 255 channels) but lacks RTP/SDP signaling.
  *   RFC 7845<https://www.rfc-editor.org/rfc/rfc7845> defines channel mapping families for Ogg but not for RTP/SDP.
  *   Non‑standard SDP usage (e.g., in libwebrtc<https://webrtc-review.googlesource.com/c/src/+/129768>, GStreamer<https://gstreamer.freedesktop.org/documentation/rtp/rtpopuspay.html?gi-language=c>) exists but lacks interoperability.

Proposal Scope Define an RTP/SDP profile for Opus multistream that:

  *   Uses a distinct encoding name (multiopus/48000/<channels>).
  *   Specifies fmtp parameters: num_streams, coupled_streams, channel_mapping, and optionally mapping_family.
  *   Reuses RFC 7845<https://www.rfc-editor.org/rfc/rfc7845> mapping semantics.
  *   Defines Offer/Answer behavior and provides examples (e.g., 5.1, 7.1).
  *   Offers backward compatibility guidance with opus/48000/2.

Relationship Summary

  *   RFC 6716<https://www.rfc-editor.org/rfc/rfc6716>: codec spec (multistream capability).
  *   RFC 7845<https://www.rfc-editor.org/rfc/rfc7845>: Ogg encapsulation (mapping families).
  *   RFC 7587<https://www.rfc-editor.org/rfc/rfc7587>: RTP payload (mono/stereo only).
  *   This draft: RTP/SDP signaling for multistream, reusing RFC 7845 <https://www.rfc-editor.org/rfc/rfc7845> semantics.

Use Cases

  *   Cloud gaming, immersive media: negotiate multichannel audio without hacks.
  *   Interop: align existing “multiopus” deployments under a standard.

Draft : https://datatracker.ietf.org/doc/draft-shin-avtcore-rtp-multi-opus/
Title: RTP/SDP Signaling for Opus Multistream
Questions for the WG

  1.  Should we use a distinct encoding name (“multiopus”) or extend “opus” with new fmtp?
  2.  Should mapping_family be registered via IANA for well-known layouts?
  3.  How should this interact with existing Opus fmtp (e.g., stereo/sprop-stereo) and downmix guidance?

Next Steps If there’s interest, I’d like to present this in an upcoming AVTCORE session and work toward WG adoption.
Best regards,
Sun Shin
NVIDIA <sushin@nvidia.com>
GitHub link: https://github.com/xingri/multi-opus

[AVTCORE] Discussion: RTP/SDP Signaling for Opus … Sun Shin
[AVTCORE] Re: Discussion: RTP/SDP Signaling for O… Marius Kleidl