Using Tap-and-talk

Artigo
07/05/2006

(Basic Speech Control Sample)

This sample illustrates using a multimodal input method that is particularly useful for applications running on Windows Mobile-based Pocket PC 2003 (Pocket PC) or Tablet PC. The method is referred to as "tap-and-talk" because on devices like Tablet PC, the user taps a control with his or her input stylus and then speaks in order to input data. In this sample, the user clicks a button, waits for an audio meter to appear, and then speaks the input data.

The sample has four buttons labeled instructions, city, date, and Speak all. Next to the button labeled city is a DropDownList control listing the city names London, New York, and Tokyo. A Calendar control is displayed below the date button.

Use the speech recognition capability of the application to enter information into the DropDownList and Calendar controls, either independently or simultaneously. Enter information into an individual control by clicking the button associated with that control. Wait for an audio meter to appear, and then speak the information appropriate for that control (a city name for the DropDownList, or a date for the Calendar). Enter information into both the DropDownList and Calendar controls simultaneously by clicking the Speak all button. Wait for an audio meter to appear, and then speak both a city name and a date. The function of the Speak all button in this sample is similar to the function of a mixed-initiative QA control in a voice-only application.

Click instructions to hear instructions for using the sample.

Featured Highlights

A Speak all button for multimodal applications.

Running the Sample

Click Start, and then click Run.
In the Run window, type https://localhost/Speech/Samples/TapAndTalk/Page1.aspx, and press ENTER.
Click Speak all and wait for the audio meter to appear.
After the audio meter appears, say London, New York, or Tokyo followed by a date in the future. For example, say Tokyo, November 10th or London on December 20th.

The audio meter disappears, the selected city name appears in the drop-down list, and the selected date is highlighted on the calendar.

Running the Sample on Windows Mobile 2003 (Pocket PC) Devices

Running this sample on Pocket PC devices requires the use of Microsoft Speech Engine Services (SES) and Speech Add-in for Microsoft Pocket Internet Explorer. SES is a component of Microsoft Speech Server (MSS). The Speech Add-in for Microsoft Pocket Internet Explorer installer is available on the MSS CD.

To run Tap-and-talk on a Pocket PC

Open the web.config file that is contained in the Samples directory on the Web server, and specify the name of the Speech Server being used. The name of the server should be specified as the value of the value attribute in the add element. The add element is contained within the appSettings element.
Add the name of the Web server to the Trusted Sites list on the Speech Server.

Note See the document entitled "Adding or Removing a Trusted Site" in the MSS documentation. In the MSS documentation, this document is located at: Microsoft Speech Server > Administering Speech Server > Administering Speech Server using MMC > Administering Speech Engine Services > Adding or Removing a Trusted Site.
Request that the Speech Server Administrator add the Pocket PC user account name to the Access Control List (ACL) of the Speech Server.

Note For detailed instructions, see the document entitled "Granting Access to Speech Engine Services (SES)" in the MSS documentation. In the MSS documentation, this document is located at: Microsoft Speech Server > Deploying Speech Applications > Application Deployment Step-by-Step > Granting Client Access to SES.

Remarks

Although the Speak all button triggers recognition of both a city name and date, the user is not required to say both when using the Speak all button.
No global commands are supported in this sample.

Partilhar via