KR20160050723A - Method and apparatus for outputting sentence and command - Google Patents

Abstract

A method for outputting a document and a command in a terminal is provided. The method for outputting a document or a command comprises the following steps: obtaining one document file from a document stored in a local storage device or documents existed on a remote server; obtaining a sentence to be outputted as a voice by processing the document file, and obtaining a sentence to be outputted to a screen based on a preset element from the sentence to be outputted as a voice; and outputting the sentence to be outputted as a voice by converting the sentence into a voice, and outputting the sentence to be outputted to a screen to a screen of the terminal.

Description

TECHNICAL FIELD The present invention relates to a method and apparatus for outputting sentences and commands,

The present invention relates to a method and apparatus for outputting a sentence and a command to be outputted as a voice to a screen.

As the mobile communication service evolves, the user can receive various services through the terminal in a fixed environment as well as a mobile environment. For example, a DAB (Digital Audio Broadcasting) service can be provided. DAB is a digital radio broadcasting system for providing radio programs, video programs, or data services to mobile environments, including fixed environments, and provides character-based data services.

A large number of users who are provided with the service through the DAB are often vehicle users. The driver selects and provides a desired broadcast while checking program information and additional information displayed in letters. At this time, the process of confirming the displayed characters through the terminal may be a safety problem.

In addition, situations may arise where the user can not view the screen while the service is provided through the terminal.

SUMMARY OF THE INVENTION The present invention provides a method and apparatus for outputting information by voice using an extensible markup language (XML) technology capable of exchanging information in an interactive manner between a user and a terminal .

The output method according to an aspect of the present invention for achieving the above object is a method for obtaining a document stored in a local storage device or one of documents existing on a remote server in a method in which a terminal outputs a document and a command word ; Processing the document file to obtain a sentence to be output as a voice, and obtaining a sentence to be output to a screen based on a predetermined element from a sentence to be output as the voice; And a step of outputting a sentence to be output to the screen to the screen of the terminal.

According to the embodiment of the present invention, all or a part of the sentences included in the XML element dialog are outputted to the screen, and user input information such as a voice command or a button key specified in the dialog is displayed on the screen, It is possible to improve the action.

Also, in a mobile broadcasting environment such as a digital radio, a user can conveniently listen to program information and additional information by voice, and at the same time, perceive related information through the output screen. In particular, in the case of a voice command, the interaction effect can be doubled by checking and commanding in advance through the output screen.

1 is a conceptual diagram of a method of outputting a character and a command according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating an XML document structure for outputting a text and an audio of a command and simultaneously outputting a screen according to an embodiment of the present invention.
3 is a diagram illustrating a structure of a document and command output apparatus according to an embodiment of the present invention.
4 is a flowchart of a document and command output method according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise.

Hereinafter, a method and apparatus for outputting characters and commands according to an embodiment of the present invention will be described with reference to the drawings.

1 is a conceptual diagram of a method of outputting a character and a command according to an embodiment of the present invention.

The dialogue mechanism corresponding to the interaction between the user and the terminal can be described using XML (extensible markup language). VoiceXML, which is a voice expanding language, can be used. VoiceXML enables contents or services by voice. It realizes telephone connection or voice connection to database, website information, the Internet, etc., and at the same time, Provide an easy response service. VoiceXML provides voice-based user interface technology with input using automatic speech recognition (ASR) and dual tone multi frequency (DTMF), and output using voice and TTS (text to speech).

As shown in FIG. 1, VoiceXML defines an element < form > corresponding to a dialogue in an integrated form of user voice input and voice output. By using these elements, continuous conversation between the user and the terminal is possible. Through this conversation, the terminal can perform a variety of operations in the form of providing the information desired by the user and receiving a command from the user.

Specifically, the <form> element corresponds to one dialog. The actual speech output is placed in the <prompt> element, which is normally output to the sound through TTS. In another output method, it is also possible to reproduce the recorded voice file and output information by sound.

When a sentence located in the <prompt> element of FIG. 1 is outputted as a voice and then a voice is issued in response to a sentence output by the user as a voice, processing according to the matters described in the <filled> element is performed. For example, if a user responds to a sentence output by voice and gives a voice command of "yes", the terminal recognizes the command and performs the operation described in the <goto> element (or the <link> element) . For example, as shown in FIG. 1, a URL (uniform resource locator) address described in the < goto > element is moved to a document designated by the address. On the other hand, if the user enters a command that is not "yes", it moves to "main_dialog", for example, according to the action described in the <goto> element. As you can see, moving to another dialog or document uses a <goto> or <link> element. According to this method, a message such as " Special CDs are on sale. Please visit our web site, www.worlddab.com or if you say "yes ", you access it" Can be output.

In the embodiment of the present invention, a message output by such a voice is processed as a character and also outputted as a screen. As shown in the right side of FIG. 1, all or part of the sentences output by voice on the screen of the terminal can be output as characters, and a speech keyword or button key to be input is output to the screen .

When outputting the information output by voice to the screen, the user can additionally confirm the information that he or she does not know well by voice or sometimes wants to check through the screen. In addition, in the case of voice commands, it is difficult to memorize various types of voice commands to be input. However, it is possible to identify keywords to be input through a voice command displayed on the screen.

As described above, the user can conveniently search for and access desired services, programs, or specific information while viewing the screen as needed while listening to the information output through the terminal. When the method according to the embodiment of the present invention is applied to a mobile broadcast, it is possible to improve the viewing environment of a digital radio for a listener in a mobile environment such as a driver. The terminal outputs the additional information or the data service of the radio program by voice and allows the user to access the information by inputting the user's command by voice. This capability allows the operator to easily access and obtain relevant information about the service, program or supplementary data of the digital radio without being disturbed by the operation.

In the embodiment of the present invention, an XML element having the following structure is used in order to enable output of text and command words as well as display output simultaneously.

FIG. 2 is a diagram illustrating an XML document structure for outputting a text and an audio of a command and simultaneously outputting a screen according to an embodiment of the present invention. Here, a method of enabling screen output of the sentence and the command illustrated in Fig. 1 will be described as an example.

In the embodiment of the present invention, in a dialog box described in the <form> element in the XML document, a sentence located in the <prompt> element is outputted as a voice and a part or all of the sentence located in the <prompt> element is also output to the screen. The <disp> element is additionally defined and used to distinguish a particular character or sub-sentence within a sentence to be displayed on the screen. While interpreting the sentence in the <prompt> element, <disp> ... When the </ disp> element is recognized, <disp> ... </ disp> Only the characters or sentences within the range specified by the element are selected and displayed on the screen. Specifically, as exemplified in FIG. 2, the &quot; Special CDs are on sales. &Quot;, " please visit our web site, www.worlddab.com or if you say " , Only the two sentences "CDs are on sales" and "www.worlddab.com" corresponding to the sentence separated by the <disp> element are displayed on the screen. As a matter of course, the entire sentence output by voice may be output to the screen.

As described above, according to the embodiment of the present invention, the whole or a part of the sentences in the dialog to be outputted are outputted to the screen, the voice command and the button key defined by the user input are also outputted on the screen, It is possible to input the user's command by voice and access the corresponding information.

3 is a diagram illustrating a structure of a document and command output apparatus according to an embodiment of the present invention.

3, the document and command output apparatus 100 according to the embodiment of the present invention includes a document handler 110, an application engine 120, and an input / output component processing unit 130).

The document processing unit 110 constitutes documents outputted as a voice and / or a screen. Specifically, the document processing unit 110 fetches a document stored in a local storage device or a document existing on a remote server, processes the document so that movement of a document and movement of a dialogue can be freely performed according to a predetermined flow, To the execution unit (120).

For this, the document processing unit 110 may include a local storage document processing unit 111 and a remote storage document processing unit 112. For example, the local storage document processing unit 111 delivers the data received from the broadcast or the document included therein to the application execution unit 120. [ The remote storage document processing unit 112 fetches a corresponding document from a device such as a server existing remotely via a network, and transfers the document to the application execution unit 120.

The document transmitted to the application execution unit 120 through the document processing unit 110 may be an XML document as shown in FIG. 2, and may be composed of a first element (for example, a <form> element) Dialog corresponding sentences are described, and a sentence to be outputted as a voice is specified corresponding to a second element (for example, a < prompt > element). And a part or all of the sentences to be output by voice corresponding to the third element (for example, the < disp > element) are also output to the screen. Through these elements, the flow specified in the dialog is processed.

The application execution unit 120 interprets and executes the document delivered from the document processing unit 110. [ To this end, the application execution unit 120 includes an XML parser 121. The XML interpreter 121 interprets the XML document and controls the specified flow. The XML interpreter 121 interprets the dialog to execute the voice input / output, and controls the application according to the specified flow in each dialog. Specifically, it recognizes that one dialog is defined by the first element in the XML document, and treats the sentence described in correspondence with the second element with a sentence to be outputted as a voice. In the sentence corresponding to the second element, the portions delimited by the third element are processed into a sentence to be outputted to the screen. And a sentence to be outputted as a voice and a sentence to be outputted as a screen to the input / output component processing unit 130, respectively.

The application execution unit 120 is interlocked with the document processing unit 110 and the input / output component processing unit 130, and performs all the interfaces and integration processes related to the XML parser 121.

The input / output component processing unit 130 includes a voice input / output processing unit 131 and a graphic input / output processing unit 132. In addition, it further includes a command storage unit 133 for storing voice commands.

The audio input / output processing unit 131 includes a voice recognizer (ASR) 1311 for recognizing a voice and processing it as a voice input, and a voice output unit (TTS) 1312 for outputting a voice as a voice. And a file player 1313.

The speech recognizer 1311 recognizes the user's command input by voice and searches for the registered speech keywords stored in the command storage unit 133 based on the recognized command and is mapped in advance to the found voice command Perform an operation. For example, a dialog and a document previously mapped to a voice command.

The voice output unit 1312 converts the sentence into voice, that is, sound and outputs the voice. In particular, a sentence to be output as a voice provided from the application execution unit 120 is converted into sound and output.

The file player 1312 reproduces the sound source files stored or downloaded and reproduces them as sounds.

The graphic input / output processing unit 132 includes a display unit 1321 for outputting characters and graphics to a screen, and further includes an input unit 1322 such as a button and a touch pad.

The display unit 1321 processes a sentence to be output to a screen provided from the application execution unit 120 and outputs the processed text to a screen. The output object of the display unit 1321 includes a sub sentence or a specific character distinguished by a whole sentence in a dialog or a third element (<disp> element) to be output by voice. In the case of the screen output, it is possible to output the screen in various forms without limitation to the specific method.

Also, the display unit 1321 may output the voice command specified in the <grammar> element or the related voice input related element (also called the fourth element) in the XML document to the screen or may be stored in the command storage unit 133, Commands (global speech keywords) can be displayed on the screen. In addition, keys, numbers, and screen touches of the buttons can be graphically processed and output to the screen.

The input unit 1322 transmits information input through the buttons and the touch pad to the application executing unit 132. [

4 is a flowchart of a document and command output method according to an embodiment of the present invention.

As shown in FIG. 4, the document and command output apparatus 100 fetches documents stored in a local storage device or documents existing on a remote server, and moves documents and moves dialogs freely according to a predetermined flow. (S100). Here, as shown in FIG. 2, the document is composed of an XML document, and one dialog corresponding sentences are described by a first element (for example, a < form > element), and a second element the <prompt> element), and a part or all of a sentence to be output by voice corresponding to the third element (for example, the <disp> element) is also output to the screen Is specified.

Thereafter, the document and command output apparatus 100 interprets and executes the document (S110). Recognizes that one dialog is defined by the first element in the XML document, and processes the sentence described in correspondence with the second element into a sentence to be outputted as a voice. Then, in the sentence corresponding to the second element, the portions delimited by the third element are processed into a sentence to be outputted to the screen (S120).

The document and command output apparatus 100 converts sentences to be output as sounds into sounds and outputs the sounds, and in some cases, reproduces sound files stored or downloaded and reproduces sounds. In addition, the document and command output apparatus 100 processes a sentence to be output as a screen and outputs it to the screen (S130). As shown in Fig. 2, the entire sentence in the dialog is outputted as a voice, and a sub-sentence divided by the third element (< disp element) in the sentence is output to the screen. And outputs the voice command specified on the fourth element (such as a <grammar> element) to the screen, or outputs the stored or reserved voice command to the screen.

Thereafter, the document and command output apparatus 100 performs an operation corresponding to the user input (S140). Specifically, the user recognizes the input voice according to the output of the sentence, processes it as a voice input, and performs an operation previously mapped to a voice command corresponding to a user's voice command. Also, the document and command output apparatus 100 processes information input through the buttons and the touch pad, and performs corresponding operations.

The embodiments of the present invention are not limited to the above-described apparatuses and / or methods, but may be implemented through a program for realizing functions corresponding to the configuration of the embodiment of the present invention, a recording medium on which the program is recorded And such an embodiment can be easily implemented by those skilled in the art from the description of the embodiments described above.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

Claims (1)

In the manner in which the terminal outputs documents and commands,
Obtaining a document file stored in a local storage device or one of documents existing on a remote server;
Processing the document file to obtain a sentence to be output as a voice, and obtaining a sentence to be output to a screen based on a predetermined element from a sentence to be output as the voice; And
Converting a sentence to be output by the voice into sound and outputting a sentence to be output to the screen to the screen of the terminal
/ RTI &gt;

Images