Distributed Multimodal Synchronization Protocol [dmsp]

Chris Cross <xcross@us.ibm.com> Tue, 07 March 2006 18:58 UTC

Received: from [] (helo=stiedprmman1.va.neustar.com) by megatron.ietf.org with esmtp (Exim 4.43) id 1FGhNq-0001OM-W3; Tue, 07 Mar 2006 13:58:10 -0500
Received: from [] (helo=ietf-mx.ietf.org) by megatron.ietf.org with esmtp (Exim 4.43) id 1FGhNl-0001Hl-VC; Tue, 07 Mar 2006 13:58:05 -0500
Received: from e32.co.us.ibm.com ([]) by ietf-mx.ietf.org with esmtp (Exim 4.43) id 1FGhEr-0006Fb-U2; Tue, 07 Mar 2006 13:48:56 -0500
Received: from d03relay04.boulder.ibm.com (d03relay04.boulder.ibm.com []) by e32.co.us.ibm.com (8.12.11/8.12.11) with ESMTP id k27ImrZ1025722; Tue, 7 Mar 2006 13:48:53 -0500
Received: from d03av03.boulder.ibm.com (d03av03.boulder.ibm.com []) by d03relay04.boulder.ibm.com (8.12.10/NCO/VER6.8) with ESMTP id k27IpgLf152596; Tue, 7 Mar 2006 11:51:42 -0700
Received: from d03av03.boulder.ibm.com (loopback []) by d03av03.boulder.ibm.com (8.12.11/8.13.3) with ESMTP id k27Imqm4003829; Tue, 7 Mar 2006 11:48:52 -0700
Received: from d03nm119.boulder.ibm.com (d03nm119.boulder.ibm.com []) by d03av03.boulder.ibm.com (8.12.11/8.12.11) with ESMTP id k27ImqbX003801; Tue, 7 Mar 2006 11:48:52 -0700
Subject: Distributed Multimodal Synchronization Protocol [dmsp]
To: speechsc@ietf.org, discuss@apps.ietf.org, ietf@ietf.org
X-Mailer: Lotus Notes Release 7.0 HF85 November 04, 2005
Message-ID: <OFCB0A2565.19B43E1B-ON8525712A.005C6B64-8525712A.00674A6B@us.ibm.com>
From: Chris Cross <xcross@us.ibm.com>
Date: Tue, 7 Mar 2006 13:48:12 -0500
X-MIMETrack: Serialize by Router on D03NM119/03/M/IBM(Release 6.53HF654 | July 22, 2005) at 03/07/2006 11:51:26
MIME-Version: 1.0
X-Spam-Score: 0.5 (/)
X-Scan-Signature: bcd240e64c427d3d3617cfc704e7fd7f
Cc: dmsp@ietf.org
X-BeenThere: dmsp@ietf.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Distributed Multimodal Synchronization Protocol <dmsp.ietf.org>
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/dmsp>, <mailto:dmsp-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www1.ietf.org/pipermail/dmsp>
List-Post: <mailto:dmsp@ietf.org>
List-Help: <mailto:dmsp-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/dmsp>, <mailto:dmsp-request@ietf.org?subject=subscribe>
Content-Type: multipart/mixed; boundary="===============1178771064=="
Errors-To: dmsp-bounces@ietf.org

Hi Everyone,
I'm sending a note to your list to make the members aware of this activity.
The I-D "Distributed Multimodal Synchronization Protocol " (dmsp) can be
found at http://www.ietf.org/internet-drafts/draft-engelsma-dmsp-01.txt. We
have a mailing list at dmsp@ietf.org and a twice monthly phone conference.

Dmsp is being developed to enable distributed multimodal systems. I've been
invited to present an overview at both the apps and rai general meetings in
Dallas. We welcome your attendance at these presentations and interested
individuals' participation in our mail list and conference calls.

At the bottom of this note is a draft charter we've discussed on the list
that gives a more detailed description of dmsp.


Chris Cross
Multimodal Browser Architect
IBM Boca Raton
voice 561.862.2102
mobile 561.317.0700
fax 501.641.6727

The convergence of wireless communications with information technology and
the miniaturization of computing platforms have resulted in advanced mobile
devices that offer high resolution displays, application programs with
graphical user interfaces, and access to the internet through full function
web browsers.

Mobile phones now support most of the functionality of a laptop computer.
However the miniaturization that has made the technology possible and
commercially successful also puts constraints on the user interface. Tiny
displays and keypads significantly reduce the usability of application

Multimodal user interfaces, UIs that offer multiple modes of interaction,
have been developed that greatly improve the usability of mobile devices.
In particular multimodal UIs that combine speech and graphical interaction
are proving themselves in the marketplace.

However, not all mobile devices provide the computing resources to perform
speech recognition and synthesis locally on the device. For these devices
it is necessary to distribute the speech modality to a server in the

The Distributed Multimodal Working Group will develop the protocols
necessary to control, coordinate, and synchronize distributed modalities in
a distributed Multimodal system. There are several protocols and standards
necessary to implement such a system including DSR and AMR speech
compression, session control, and media streaming. However, the DM WG will
focus exclusively on the synchronization of modalities being rendered
across a network, in particular Graphical User Interface and Voice Servers.

The DM WG will develop an RFC for a Distributed Multimodal Synchronization
Protocol that defines the logical message set to effect synchronization
between modalities and enough background on the expected multimodal system
architecture (or reference architecture defined elsewhere in W3C or OMA) to
present a clear understanding of the protocol. It will investigate existing
protocols for the transport of the logical synchronization messages and
develop an RFC detailing the message format for commercial alternatives,
including, possibly, HTTP and SIP.

While not being limited to these, for simplicity of the scope the protocol
will assume RTP for carriage of media, SIP and SDP for session control, and
DSR and AMR for speech compression. The working group will not consider the
authoring of applications as it will be assumed that this will be done with
existing W3C markup standards such as XHTML and VoiceXML and commercial
programming languages like Java and C/C++.

It is expected that we will coordinate our work in the IETF with the W3C
Multimodal Interaction Work Group.

The following are our goals for the Working Group.

Date Milestone
TBD Submit Internet Draft Describing DMSP (standards track)
TBD Submit Drafts to IESG for publication
TBD 2006 Submit DMSP specification to IESG
Dmsp mailing list