KR101537693B1 - Terminal and method for controlling the same - Google Patents

Abstract

The present invention relates to a terminal capable of avoiding repetitive errors that may occur during speech recognition, and a control method thereof, and more particularly, to a terminal and a control method thereof that are capable of accurately detecting voice information with a voice recognition error in the voice information, And a memory for storing information related to the generation and processing of the error in the database according to the control of the control unit.

Description

[0001] TERMINAL AND METHOD FOR CONTROLLING THE SAME [0002]

The present invention relates to a terminal that can avoid repetitive errors that may occur during voice recognition, and a control method thereof.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

In recent years, efforts have been made to apply a voice recognition function to a mobile terminal. However, an error may occur because a complete speech recognition can not always be expected. In particular, when the same error repeatedly occurs, there is a problem that the error situation can not be escaped or the same error processing routine must be executed every time.

The present invention relates to a terminal capable of avoiding the same error that may repeatedly occur during speech recognition and a control method thereof.

In addition, the present invention relates to a terminal and a control method thereof, which allow a user to input information directly when an identical error occurs repeatedly during speech recognition, thereby allowing an error situation to be escaped.

In addition, the present invention relates to a terminal capable of processing an error by allowing information to be input as a minimum unit for voice recognition when the same error repeatedly occurs during voice recognition, and a control method thereof.

The present invention also relates to a terminal and a control method thereof for storing a record of a processing method when an error situation occurs, and for handling an error using the stored method when the same error occurs.

A terminal related to an embodiment of the present invention for realizing the above-mentioned problem is characterized in that a microphone for inputting voice information from a user and voice information having a voice recognition error in the voice information are corrected to correct voice information, And a memory for storing information related to the generation and processing of the error in the database under the control of the control unit.

According to another aspect of the present invention, there is provided a method for correcting voice information in which an error has occurred, the method comprising: receiving voice information from a user and detecting a voice recognition error in the voice information; When the error processing is completed, information related to the occurrence and processing of the error is stored in a specific database so that the same information can be referred to when the same error occurs.

The terminal according to at least one embodiment of the present invention configured as described above stores a record of a method of processing when an error condition is exited, and when the same error occurs, the terminal can process the error using the stored method do.

In addition, the present invention divides voice information in which an error occurred during speech recognition into a minimum unit and re-inputs the same, or directly inputs a key input or a touch input method from a user to correct an error.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), navigation and the like. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only And a Digital Broadcasting System (ISDB-T) (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that they may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the usage right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) (Universal Subscriber Identity Module, USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

2A is a perspective view of an example of a mobile terminal or a mobile terminal according to the present invention.

The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding a synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, the interface 170, and the like may be disposed in the front body 101 have.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 151 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion and may be employed in any manner as long as the user operates in a tactile manner.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 To the touch recognition mode of the touch screen.

FIG. 2B is a rear perspective view of the portable terminal shown in FIG. 2A.

Referring to FIG. 2B, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to the camera 121 (see FIG. 2A), and may be a camera having different pixels from the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body so as to be rotatable or pop-upable.

A flash 123 and a mirror 124 are additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output unit 152 'may implement the stereo function together with the sound output unit 152 (see FIG. 2A), and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for talking and the like, a broadcast signal reception antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the portable terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the terminal body or may be detachable from the outside of the terminal body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may also be of a light transmission type like the display unit 151. [ In this case, if the display unit 151 is configured to output time information on both sides, the time information can be recognized through the touch pad 135 as well. The information output on both sides may be all controlled by the touch pad 135. [ Alternatively, a display may be additionally mounted on the touch pad 135, and a touch screen may be disposed on the rear case 102 as well.

The touch pad 135 operates in correlation with the display portion 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. [ The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Hereinafter, a related operation of the display unit 151 and the touch pad 135 will be described with reference to FIGS. 3A and 3B.

3A and 3B are front views of a portable terminal for explaining an operation state of the portable terminal according to the present invention.

Various types of time information can be displayed on the display unit 151. [ These pieces of information can be displayed in the form of letters, numbers, symbols, graphics, or icons.

At least one of the letters, numbers, symbols, graphics, or icons may be displayed in a predetermined arrangement for inputting such information, thereby being implemented as a keypad. Such a keypad may be called a so-called " soft key ".

FIG. 3A shows a touch input to a soft key through a front surface of a terminal body.

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with each other.

For example, an output window 151a and an input window 151b are displayed on the upper and lower portions of the display unit 151, respectively. The output window 151a and the input window 151b are areas allocated for outputting or inputting information, respectively. In the input window 151b, a soft key 151c in which a number for inputting a telephone number or the like is displayed is output. When the soft key 151c is touched, the number corresponding to the touched soft key is displayed on the output window 151a. When the first operation unit 131 is operated, call connection to the telephone number displayed on the output window 151a is attempted.

FIG. 3B shows the input of a touch applied to the soft key through the rear surface of the terminal body. FIG. 3A shows a case where the terminal body is vertically arranged, and FIG. 3B shows a case where the terminal body is arranged horizontally. The display unit 151 may be configured to convert the output screen according to the arrangement direction of the terminal body.

3B shows that the text input mode is activated in the portable terminal. The display unit 151 displays an output window 151a 'and an input window 151b'. In the input window 151b ', a plurality of soft keys 151c' displayed with at least one of letters, symbols, and numbers may be arranged. The soft keys 151c 'may be arranged in the form of a QWERTY key.

When the soft keys 151c 'are touched through the touch pad 135 (see FIG. 2B), characters, numbers, symbols corresponding to the touched soft keys are displayed on the output window 151a'. As described above, the touch input through the touch pad 135 is advantageous in that the soft key 151c 'can not be blocked by the finger when the touch is input, compared with the touch input through the display unit 151. [ In the case where the display unit 151 and the touch pad 135 are formed to be transparent, the fingers located on the rear side of the terminal body can be visually confirmed, thereby enabling a more accurate touch input.

The display unit 151 or the touch pad 135 may be configured to receive a touch input by scrolling, as well as the input method described in the above embodiments. The user can move a cursor or a pointer located on an object displayed on the display unit 151, for example, an icon or the like, by scrolling the display unit 151 or the touch pad 135. [ Further, when the finger is moved on the display portion 151 or the touch pad 135, the path along which the finger moves may be visually displayed on the display portion 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the terminal may be executed in response to a case where the display unit 151 (touch screen) and the touch pad 135 are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the terminal body using the thumb and index finger. The one function may be activation or deactivation of the display unit 151 or the touch pad 135, for example.

The proximity sensor 141 described with reference to Fig. 1 will be described in more detail with reference to Fig.

4 is a conceptual diagram for explaining the proximity depth of the proximity sensor.

As shown in FIG. 4, when a pointer such as a user's finger, a pen, or the like approaches the touch screen, the proximity sensor 141 disposed in or near the touch screen senses the proximity sensor and outputs a proximity signal.

The proximity sensor 141 may be configured to output different proximity signals according to the distance between the proximity-touched pointer and the touch screen (hereinafter referred to as "proximity depth").

In Fig. 4, for example, a cross section of a touch screen on which a proximity sensor capable of sensing three proximity depths is disposed is illustrated. Of course, proximity sensors that detect less than three or more than four proximity depths are also possible.

Specifically, when the pointer is completely in contact with the touch screen (d0), it is recognized as a contact touch. If the pointer is located on the touch screen at a distance less than the distance d1, it is recognized as a proximity touch of the first proximity depth. If the pointer is located on the touch screen at a distance d1 or less and less than the distance d2, the pointer is recognized as a proximity touch of the second proximity depth. If the pointer is located on the touch screen at a distance d2 or more and less than the distance d3, it is recognized as a proximity touch of the third proximity depth. If the pointer is located at a distance d3 or more on the touch screen, it is recognized that the proximity touch is released.

Accordingly, the controller 180 can recognize the proximity touch as various input signals according to the proximity depth and proximity position of the pointer, and perform various operation control according to the various input signals.

In the mobile terminal according to the present invention, an algorithm for speech recognition and an algorithm for STT (Speech To Text) are stored in the memory 160, and an arbitrary function provided in the mobile terminal and an STT function So that the voice inputted by the user can be converted into text. Then, the converted text can be outputted to the execution screen of the function. Here, the specific function includes a function of creating text such as a text message or a mail. When the text message or the mail creation function is executed, the control unit 180 automatically activates the voice recognition function and the STT function .

5 is a flowchart illustrating an example of a menu control method using voice commands of a mobile terminal according to an embodiment of the present invention. Figure 1 will also be referred to for the following discussion. Referring to FIG. 5, the controller 180 determines whether the voice recognition function is activated (S101).

The voice recognition function can be activated by a user by selecting a specific hardware button provided on the mobile terminal or a software button displayed on the display module 151 or by operation of a specific menu displayed on the display module 151 have. Alternatively, it can be activated by a specific sound or sound, a close-range or remote radio signal, or the body motion information including the user's hand gesture or gesture.

The specific sound or sound may include a kind of impact sound having a specific level or more. Sounds or sounds above the specified level can be detected using a simple sound level detection algorithm.

The sound level detection algorithm is relatively simpler than the speech recognition algorithm and thus can consume less resources of the mobile terminal. The sound level detection algorithm (or circuit) may be configured separately from the speech recognition algorithm (or circuit), or may be implemented in a manner that restricts some functions of the speech recognition algorithm.

The wireless signal may be received through the wireless communication unit 110 and the gesture or gesture of the user may be received through the sensing unit 140. [ In one embodiment of the present invention, the wireless communication unit 110, the user input unit 130, and the sensing unit 140 may be collectively referred to as a signal input unit. .

The activation of the voice recognition function of the user is advantageous because it allows the user to know that he or she intends to use voice commands for controlling the mobile terminal. That is, the user first recognizes that he / she intends to perform a physical operation of the mobile terminal and input a voice command or an instruction into the mobile terminal, and thus activates a specific function by saying more clearly or slowly. The user speaks more slowly or more clearly, thereby increasing the likelihood of correctly recognizing the voice command. That is, in one embodiment of the present invention, the voice recognition function is not activated by speaking into the mobile terminal but is activated by operating a button on the mobile terminal.

The control unit 180 starts activation of the voice recognition function based on the number of times the user has touched a specific button or a part of the touch screen and the time when the user has touched a part or the specific button of the touch screen Or terminate it. The user can also configure how the controller 180 activates the speech recognition function using the appropriate menu options provided by the present invention. For example, the user can set the voice recognition activation setting based on (1) the number of times the voice activation button is selected (X), (2) the voice recognition activation setting based on the time (X) A voice recognition activation setting when the buttons X and Y are selected, and the like. Thereafter, the user may input the X and Y values to variably set the manner in which the controller 180 determines that the voice activation function is activated. That is, according to an exemplary embodiment of the present invention, the user may actively associate with the voice activation function of the mobile terminal of the user, so that the control unit 180 may determine the correct function corresponding to the voice command of the user . This allows the user to adjust the voice activation function as needed.

The control unit 180 may maintain the activated state of the voice recognition function when the set button (s) is touched or selected, and may stop the voice recognition function when the set button (s) is released. In addition, the control unit 180 can maintain the activation of the voice recognition function for a predetermined time after the set button (s) is touched or selected, and when the predetermined time elapses, the voice recognition function is stopped or terminated can do. In another embodiment, the controller 180 may store voice commands received in the memory 160 while the voice recognition function is maintained in the activated state.

In FIG. 5, the area of the database referred to in order to recognize the meaning of the voice command may be specified as an area related to a specific function or menu on the mobile terminal (S102). For example, the specified domain may be specified as an area related to menus output to the display unit 151 or sub-menus of a specific menu selected from the menus. As described above, since the area of the database to be referred to is specified to recognize the voice command, the recognition rate for the voice command can be further increased. Examples of the area include an e-mail area, a received call area, and a multimedia area.

The information related to the submenus may be a database. The information may be in the form of a key word, and a plurality of information may correspond to one function or menu. In addition, the database may be composed of a plurality of databases according to the characteristics of information, and may be stored in the memory 160.

In addition, the information configured in each database may be updated through learning. In addition, the area of each database may be specified as an area related to a currently displayed function or menu in order to improve the recognition rate of a voice command. Also, the area may be changed as the steps of the menu become deeper.

Once the voice recognition function is activated (Yes in S101) and the area is specified (S102), the controller 180 determines whether the user has input a voice command (S103). If the control unit 108 determines that the user has input a voice command (Yes at S103), the control unit 108 determines the context of the voice command or the command entered through the microphone 122 based on the specific database, And analyzes the contents to determine the meaning of the voice command (S104).

The control unit 108 may determine the meaning of the voice directive or the command based on the language type and the acoustic type of the connected area. Specifically, the language type is associated with the word itself, and the acoustic type corresponds to the way the word was uttered (e.g., the frequency component of a uttered word or phrase). By using the language and sound types together with the specific area and state of the mobile terminal 100, the control unit 108 can effectively determine the meaning of the inputted voice command or directive.

The control unit 108 temporarily saves the input voice command and can start the voice recognition function immediately after the activation of the voice recognition function is completed or can be performed simultaneously with the voice command being input in the activated state of the voice recognition function have.

On the other hand, if the voice command is not completely input (NO in S103), the controller 180 may still perform other functions. For example, if the user performs another function by touching menu options or if the user presses a button on the mobile terminal (YES in S109), the controller 180 performs the selected function (S110).

If the meaning of the voice command is determined (S104), the controller 180 may output the result (S105). The resultant value is used to execute a menu corresponding to the meaning of the voice command or a service, a control signal for controlling a specific component of the terminal, or data for displaying information related to the recognized voice command .

Meanwhile, when the result is output or executed, the controller 180 may receive confirmation from the user whether the result is correct (S106). For example, when the recognition rate of the voice command is low or a plurality of semantics are recognized, the controller 180 may output a plurality of menus related to the respective semantics and execute the selected menus at step S107. Or simply whether or not a specific menu having a high recognition rate is executed, and can execute or display a corresponding function or a menu by receiving a selection or a response from the user.

The control unit 180 may output a message or voice to the user to confirm whether the specific menu is executed or not (for example, respond to Yes / No). The control unit 180 does not execute or execute a function corresponding to a specific menu or option according to a user's response. If the user does not respond within a certain time period (e.g., 5 seconds), the control unit 180 may also immediately execute the particular menu or option. That is, when there is no response from the user, the controller 180 determines that the answer is 'No Response' and executes the function or menu automatically.

That is, it is possible to re-receive a voice command input or display a plurality of menus having a recognition rate of a predetermined level or higher or a plurality of menus that can be judged to have a similar meaning, thereby performing an error processing procedure. The user selects one of the plurality of menus. If the number of functions or menus having a recognition rate higher than a predetermined level is less than a predetermined number (for example, two), the control unit 180 can automatically execute the corresponding function or menu.

6A is a schematic diagram for explaining a method of activating a voice recognition function of a mobile terminal according to an embodiment of the present invention. As shown in the display screen 410, the user can activate the voice recognition function by touching the soft button 411. [ The user can also terminate the voice recognition function by releasing the soft button 411. [ More specifically, the user can activate the voice recognition function by touching the soft button 411 and continue touching the soft button 411 or the hard button 412 until the voice command is completed . That is, the user can release the soft button 411 or the hard button 412 when the voice command is completed. Accordingly, the controller 180 can recognize the time when the voice command is input and the time when the voice command is completed. As described above, since the user can make such a determination directly, the accuracy of the interpretation of the inputted voice command word can be improved.

For example, when the user touches the soft button 411 for the first time, the control unit 180 recognizes the start of the voice activation. When the user touches the soft button 411 twice, And the like. Other selection methods are also possible. In addition, as shown in the display screen 410 of FIG. 6A, the voice activation and deactivation can be performed by operating the hard button 412 on the terminal without using the soft button 411. [0060] FIG.

In addition, the soft button 411 shown on the display screen 410 may be a single soft button that the user presses or releases to activate / deactivate the voice recognition function, or 1. the start of voice activation; And a menu button for generating a menu list such as voice activation stop. The soft button 411 may also be displayed, for example, during a standby state.

In another example, as shown in the display screen 420, the user can activate and deactivate the speech recognition function by touching any location on the screen. The display screen 430 shows another example in which the user activates and deactivates the speech recognition function by generating a sound or sound effect of a certain level or higher. For example, the user may clap to generate an impact sound.

Therefore, according to an embodiment of the present invention, the speech recognition function can be implemented in two modes. For example, the speech recognition function may be implemented in a first mode for detecting a specific sound or sound effect above a certain level, and a second mode for recognizing a voice command and determining the meaning of the voice command. If the sound or sound effect is above a certain level in the first mode, the second mode is activated to recognize the voice command

The display screen 440 shows another way for the user to activate and deactivate the speech recognition function. In this example, the control unit 180 is configured to interpret the user's body motion to start and end the voice activation function. For example, as shown in the display screen 440, the control unit 180 interprets an action of moving the user's hand toward the display as a command for activating the voice recognition function, The user interprets the act of separating the hand as a command to terminate the voice activation function. A local or remote radio signal may also be used to start and stop the speech recognition function.

Therefore, according to the embodiment of the present invention, since the voice activation function is started and stopped, the voice recognition function is not continuously performed. That is, when the voice recognition function is continuously maintained in the activated state, the amount of resources on the mobile terminal increases in comparison with the embodiment of the present invention.

5, when the voice recognition function is activated, the controller 180 displays a domain of a specific database used as a reference for voice command recognition on the display 151 And specifies the area associated with the menu list. Thereafter, when a particular menu is selected or executed from the menu list, the region of the database may be specified as information associated with the selected menu or submenus of the particular menu.

In addition, when the specific menu is selected or executed through a voice command or a touch input, the controller 180 can output help information related to the submenus of the specific menu in the form of a voice message, a popup window, or a balloon have. For example, as shown in FIG. 6B, when the user selects the 'multimedia menu' through a touch or a voice operation, the controller 180 displays the submenus of the 'multimedia menu' , A camera, a text viewer, a game, and the like) as balloon-shaped help information 441. Alternatively, the control unit 180 may output a voice signal 442 including the help information. The user may then use a voice command or select one of the displayed help options in a touch operation.

6C shows an embodiment in which a user selects a menu item using his / her body motion (in this example, the user's hand gesture). More specifically, if the user moves his or her finger near the menu item 443, the control unit 180 displays the submenus 444 associated with the menu 443. The controller 180 may recognize the user's body motion information through the sensing unit 140, for example. In addition, the displayed help information can be displayed so that transparency or brightness can be controlled according to the distance of the user. That is, the closer the user's hand is, the greater the degree of highlighting of the displayed items.

As described above, the controller 180 may be configured to determine start and stop of the voice recognition function based on various different methods. For example, the user can select / manipulate soft or hard buttons, and can touch any location on the touch screen. The control unit 180 may also maintain the activation of the voice recognition function for a predetermined time and then automatically terminate the activation after the predetermined time elapses. Also, the controller 180 may maintain the activation only during a specific button or touch operation, and may automatically terminate the activation when the input is released. The control unit 180 may also terminate the activation process if the voice command is not input for a predetermined time period.

7A is a flowchart illustrating a method of recognizing voice commands in a mobile terminal according to an embodiment of the present invention. 7A, when the voice recognition function is activated, the controller 180 displays a domain of a database that can be used as a reference for recognizing a voice command on the display 151 (S201), or a submenu of the menu, or an area related to the currently executed function or menu (S201). The user also inputs the voice command using an accurate menu name or a natural language (e.g., English) (S202).

The controller 180 then stores the input voice command in the memory 160 (S203). In addition, when the voice command is input under a specified area, the controller 180 analyzes the context and contents of the voice command based on the specified area using a voice recognition algorithm. In addition, the voice command may be converted into text type information for analysis (S204) and then stored in a specific database of the memory 160. [ However, the step of converting the voice command into the text type information may be omitted.

Then, in order to analyze the context and contents of the voice command, the controller 180 detects a specific word or keyword of the voice command (S205). Based on the detected words or keywords, the controller 180 analyzes the context and contents of the voice command, and determines the meaning of the voice command by referring to information stored in the specific database (S206) .

In addition, as described above, the database used as a reference includes the specified area, and functions or menus corresponding to the meaning of the voice command determined based on the database are executed (S207). For example, if it is assumed that text is input by using the STT function after executing the text message creation function, the priority order of the information range for recognizing the voice command may be a command for modifying the text, And may be set to commands related to the search or transmission of the other party. In addition, since the database for speech recognition is characterized by each function associated with the currently executed function or menu, the recognition rate and the speed of recognizing the voice command are improved and the amount of resources used on the terminal can be reduced have. In addition, the recognition rate means a matching rate with a predetermined name in a specific menu.

The recognition rate for the input voice command may also be determined by the number of information associated with the particular functions or menus of the voice command. Thus, the recognition rate for the input voice command is improved if the information exactly matches a particular function or menu (e.g., a menu name) included in the voice command.

More specifically, FIG. 7B is a schematic diagram illustrating a method of recognizing voice commands of a terminal according to an embodiment of the present invention. As shown in FIG. 7B, the user inputs a voice command in a natural language consisting of six words 'I want to send text messages'. In this case, the recognition rate may be determined based on the number of meaningful words (e.g., send, text, messages) associated with a particular menu (e.g., text message). In addition, the control unit 180 may determine whether the words included in the voice command are meaningful words related to a specific function or a menu, based on the information stored in the database. For example, the meaningless words included in the natural language voice command irrelevant to the specific menu may be subject (I), preposition (to), and the like.

In addition, the natural language is a language commonly used by people, and has a concept opposite to an artificial language. In addition, the natural language can be processed using a natural language processing algorithm. The natural language may or may not include the exact name associated with a particular menu, which may cause difficulty in fully recognizing the voice command. Therefore, according to an embodiment of the present invention, when the voice command has a recognition rate of a predetermined level or higher (for example, 80%), the controller 180 determines that the recognition is correct.

In addition, when the controller 180 determines that the plurality of menus have a similar meaning, the controller 180 displays the plurality of menus, and the user selects one of the displayed menus, To be executed. In addition, a menu having a relatively high recognition rate can be displayed preferentially and displayed more clearly than other menus.

For example, FIG. 8 is a schematic diagram illustrating a method for displaying menus for a voice recognition rate of a mobile terminal according to an embodiment of the present invention. 8, a menu icon with a relatively high recognition rate may be displayed in the center portion of the display screen 510, or may be displayed larger or darker as shown in the display screen 520 . The menu icon having the higher recognition rate is also displayed preferentially, and subsequently, the menus having a relatively low recognition rate are sequentially displayed.

In addition, the controller 180 can display the plurality of menus clearly by changing at least one of size, position, color, and brightness of the menus, or by highlighting the menus in order of higher recognition rate. The transparency of the menus can be changed or controlled as appropriate.

In addition, as shown in the lower portion of Fig. 8, the menu having a relatively high selection rate by the user can be updated or set to have a recognition rate. That is, the controller 180 stores the history of the user selection (S231), performs a learning process (S232), and sets a specific recognition rate for the menu option selected by the user to be higher than other menu options (S233). That is, the number of times the menu is selected by the user may be applied to the recognition rate of the menu. Therefore, a voice command inputted with the same or similar pronunciation or content thereafter can have different recognition rates according to the number of times the user selects a specific menu.

For example, the controller 180 may store a time when the user performs a specific function. For example, a user can check e-mail or missed messages as soon as they wake up Monday through Friday. This time information can be used to improve the recognition rate. The state of the mobile terminal (e.g., standby mode, etc.) may be used to improve the recognition rate. For example, the user may first check for an e-mail or a missed message when the user turns on the mobile terminal, and the mobile terminal is opened in a closed state.

9 is a diagram for explaining a voice command recognition method of a mobile terminal according to another embodiment of the present invention. As shown in FIG. 9, the user activates the voice recognition function and inputs the voice command (I want to send text messages). The control unit 180 then specifies an area of the database for voice command recognition as an area related to the displayed submenu. Thereafter, the control unit 180 interprets the voice command (S241), and displays a plurality of menus having a probability of more than a specific value (for example, 80%) in this example (S242). As shown in the display screen 610 of FIG. 9, the control unit displays four multimedia menus.

The control unit 180 also explicitly displays the menu with the highest probability (e.g., the 'Send Text' menu option 621 in this example). The user can then select any one of the displayed menus and perform a function corresponding to the selected menu. 9, the user selects the Send Text menu option 621 and the control unit 180 displays the selected Send Text menu option 621, as shown in the display screen 620, Lt; / RTI >

Further, as shown in step S242 in the lower portion of Fig. 9, the control unit 180 can also perform the function immediately, if it is determined that only one menu is higher than the predetermined possibility. That is, when it is determined that the Send Text menu option 621 is the only menu having a high recognition rate or possibility equal to or higher than a predetermined threshold value, the control unit 180 may allow the user to select the Send Text menu option 621 without having to select the Send Text menu option 621 , And immediately displays the Send Text related menus, as shown in the display screen (620).

Further, as described above in connection with FIG. 6B, the control unit 180 may also select a specific menu via a voice command or a touch input according to an operating state or mode (e.g., a mode indicating a voice recognition function) The user can output the help information related to the submenus to the user in the form of a speech or text balloon. In addition, the user can set the operation mode for outputting the help using the appropriate menu options provided in the configuration menus. Thus, the user can operate the terminal of the present invention without having a high level of skill. That is, most older users may not be skilled at operating various different menus provided to the terminal. However, with the terminal of the present invention, even a user who is not familiar with the complicated user interfaces provided to the terminal can easily operate the mobile terminal.

In addition, when the control unit 180 recognizes that the voice command has a plurality of meanings (for example, if the natural voice command (for example, I want to send text messages) does not include an accurate menu name, That is, when the menu is in the 'message transmission' category but does not include the correct name among 'Send photo', 'Send mail' and 'outbox' %) Or more.

10 is a schematic diagram showing a plurality of databases used by the controller 180 to recognize voice commands of a mobile terminal according to an embodiment of the present invention. In the present embodiment, the databases may store information used by the controller 180 to determine the meaning of voice commands, and may be any number of databases depending on the characteristics of the information. In addition, each of the databases configured according to the information characteristic may be updated through continuous learning under the control of the control unit 180.

For example, when the user pronounces " waiting "but is recognized as" eighteen ", the user changes the word "waiting" So that the same pronunciation input by the user thereafter can be recognized as "waiting ".

As shown in FIG. 10, each of the databases according to the information characteristic includes a first database 161, a second database 162, a third database 163, and a fourth database 164. In the present embodiment, the first database 161 stores voice information for recognizing phonemes, syllables, or morpheme units received through the microphone, and the second database 162 stores the recognized voice Based on the information, information for judging the overall meaning of the voice command (for example, grammar, pronunciation accuracy, sentence structure, etc.) is stored. In addition, the third database 163 stores information related to the functions or services of the mobile terminal, and the fourth database 164 stores the information related to the functions of the mobile terminal, And stores the message or voice information to be output from the terminal. In addition, the present invention can display an operation state or an operation mode to which a voice command recognition function or STT function is applied by using an indicator or icon of a specific shape. A specific sound or voice may be output and the user may be notified when the indicator or icon is output.

Hereinafter, embodiments related to a control method that can be implemented in the terminal configured as above will be described with reference to the accompanying drawings. The following embodiments can be used alone or in combination with each other. In addition, the embodiments described below may be used in combination with the above-described user interface (UI). In addition, the description of the parts overlapping with those described above can be omitted for convenience.

11 is a flowchart illustrating a method for processing an error generated during speech recognition of a terminal according to the present invention.

As shown, when the user inputs a voice (S301), it is assumed that the controller 180 has not correctly recognized the voice. That is, it is assumed that a speech recognition error has occurred (S302). The user can input a command for executing a specific menu by voice or information corresponding to an information item of a specific menu.

Whether or not the error has occurred can be determined by various methods.

For example, as one method of determining the occurrence of an error, a message for confirming the voice recognized by the control unit 180 may be output, and the user may confirm the received message. As another method, the control unit 180 may detect the voice recognition rate and determine whether the recognition rate falls below a specific value.

When a voice recognition error occurs as described above, the controller 180 executes an algorithm for processing the error (S303).

There are various algorithms for handling the error.

For example, it is possible to provide an algorithm for processing errors by dividing the unrecognized voice information into specific units (e.g., words, phrases). Alternatively, when the same error occurs consecutively, the user can input the correct information directly through key input or touch input, thereby providing an algorithm for handling the error.

Then, the execution result of the error processing algorithm can be learned (S304). That is, the error occurrence and the processing method thereof are stored in a specific database, and the error can be automatically processed when the same error occurs again.

12A and 12B are diagrams illustrating an example of methods for detecting an error occurrence in a terminal according to the present invention. For convenience, a method of detecting an error generated when setting an alarm by voice will be described.

As shown in FIG. 12A, the user can select the alarm menu and then input the information (e.g., date, time) to be input to the menu by voice. For example, when the voice information 711 is inputted as "May tenth, two thousand eight, eleven AM" on May 10, 2008 after the alarm menu is selected, (712), and automatically inputs information corresponding to each information item (e.g., date, time) of the menu. At this time, the controller 180 may output a message 710 to guide the user to input information when the alarm menu is selected. It is assumed that a speech recognition error of the time information 713 has occurred.

When inputting the information items, the control unit 180 can confirm to the user whether the input information is correct or not. That is, the control unit 180 can confirm whether there is an error in the voice information recognized by the user by receiving a response from the user.

For example, as shown in FIG. 12B, a question may be output to confirm whether the recognized information is information input by a user. The question may be a form 721 for asking all the input information at once, or a form 722 for asking for each item. At this time, if the user makes an affirmative response (Yes in 723), the user can proceed to the next step (725). If the negative response is made, the user can reenter the information (724).

Alternatively, the information of the next item can be automatically input (726) without asking each time when inputting the information for each item (that is, without waiting for the user's response). At this time, the user can stop the information input when there is an error. That is, if the user inputs a command to stop inputting information (Yes in 727), the information can be re-entered (728). If the user does not input the information input stop command, the system can automatically proceed to the next step (729).

The above-described method is a method that can detect an error through confirmation by the user when the voice recognition rate is not less than a certain rate (for example, 80%) and only some of the entire voice information has an error.

However, when the voice recognition rate is smaller than a specific ratio (YES in 730), the control unit 180 can automatically detect an error. If the voice recognition rate of the voice information input as described above is low or the voice information that is not related to the information items of the menu is input, the controller 180 may request re-input of the entire voice information (731).

13A and 13B are diagrams illustrating an example of methods for processing a voice recognition error generated in a terminal related to the present invention. For convenience, a method for handling an error generated when setting an alarm by voice will be described.

As shown in FIG. 13A, when the voice information inputted by the user is not correctly recognized, the user can select the information item 713 which is not correctly input by the touch input. Then, it is possible to re-input the correct information 741 corresponding to the information item by voice. The control unit 180 recognizes the newly input voice information and corrects the information item 742. [

If the voice information input from the user is not correctly recognized, the controller 180 divides the voice information into specific units (e.g., words and phrases), and then inquires whether the divided information is correct or not Can be output. If the information is not correct, it may be required to correct the information. For example, a question on a word-by-word basis means that a question is divided into a word unit representing each piece of information by "month → day → year → time" A question on a phrase basis means to ask two or more pieces of information together, such as "month + day".

In addition, the controller 180 may divide the information items to be input into the specific menu (e.g., alarm) and request the user to re-input the correct information for each item. For example, as shown in FIG. 13B, after outputting a message such as " Tell me the Month 751 ", the user responds to the message and displays a month 752 When inputting by voice, the corresponding information item 753 is corrected by the received response. Then, in succession, "Tell me the date (754)", the user can input the following information and input the corresponding information.

In each of the above error processing methods, the information to be corrected may be re-input by voice or input by a key or touch. Then, the control unit 180 can display the information item requesting re-entry or the information item selectively input by the user with highlighting. The highlighting method may, for example, display information items using flashing, underlined, or background colors.

FIGS. 14A and 14B are exemplary diagrams showing processing methods when a speech recognition error occurs repeatedly according to the present invention.

When a voice recognition error occurs as shown in FIG. 14A (S401), the controller 180 can re-input voice information and perform voice recognition (S402). When the error correction is completed by the re-inputted voice information (YES in S403), the controller 180 stores the error processing result (S406).

If the error correction is not completed, that is, if the same voice recognition error occurs again (NO in S403), the control unit 180 can re-enter the voice information for a predetermined number of times (NO in S404). However, if the error is not processed even after re-inputting the predetermined number of times or more information to process the same voice recognition error (YES in S404), the control unit 180 performs an operation for leaving the error processing routine (S405 ). For example, the control unit 180 may abandon information input using speech recognition. Then, information can be input directly from the user using key input or touch input (S405).

For this, the controller 180 may display the soft keypad 761 on the screen as shown in FIG. 14B. Accordingly, the user can directly input specific information using the soft keypad or the hard keypad to correct the error.

When the processing of the error is completed by re-inputting the voice information or by directly inputting the user's key as described above, the controller 180 may store the error processing information in the specific database 165 (S406). That is, the error processing procedure can be learned.

15 is an exemplary diagram for explaining a process of learning speech recognition errors processed in a terminal according to the present invention.

As described above, after the speech recognition error is generated and the processing of the error is completed, the controller 180 learns the information generated in the processing, thereby referring to the same to avoid the same error in the future. This is because, when the user pronounces a specific word or sentence, the user habitually inputs it in the same manner.

In order to learn the error process, the controller 180 may organize the information generated in the error process into a specific table format and store the information in the database 165. The database includes information related to the erroneously recognized sentence 771, the erroneous word or phrase 772, the finally corrected word or phrase 773, or the finally corrected sentence 774, Lt; / RTI >

For example, when a user inputs a specific sentence by voice and a voice recognition error occurs with respect to the inputted sentence, the control unit 180 detects a word or phrase in which the error occurred in the sentence. In order to detect a portion where an error has occurred in the input voice information, the method described in FIG. 12 or FIG. 13 may be selectively used. If correct information corresponding to the detected word or phrase is received and the error is corrected, the correct information is stored. Accordingly, the control unit 180 learns pronunciation of the information in which the speech recognition error occurs.

When the same word, phrase, or sentence is input from the user, the error can be handled by referring to the stored database information.

Further, according to an embodiment of the present invention, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention;

FIG. 2A is a front perspective view of a portable terminal according to an embodiment of the present invention; FIG.

FIG. 2B is a rear perspective view of a portable terminal according to an embodiment of the present invention; FIG.

3A and 3B are front views of a portable terminal for explaining an operation state of the portable terminal according to the present invention.

4 is a conceptual diagram for explaining the proximity depth of the proximity sensor;

5 is a flowchart of an example of a menu control method using voice in a mobile terminal according to the present invention.

FIG. 6A is an exemplary view for explaining a method of activating a voice recognition function of a mobile terminal according to the present invention; FIG.

6B and 6C are diagrams for explaining a help information output method of the mobile terminal according to the present invention;

FIG. 7A is a flowchart for explaining a voice command recognition method of a mobile terminal according to the present invention; FIG.

FIG. 7B is an exemplary diagram for explaining a speech recognition method of a mobile terminal according to the present invention; FIG.

8 is a diagram for explaining a menu display method according to a voice recognition rate of a mobile terminal according to the present invention.

FIG. 9 is an exemplary diagram for explaining a voice command recognition method of a mobile terminal according to the present invention; FIG.

10 is an exemplary diagram illustrating a configuration of a database for voice command recognition of a mobile terminal according to the present invention.

11 is a flow chart illustrating a method for processing errors generated during speech recognition of a terminal according to the present invention.

12A and 12B illustrate examples of methods of detecting an error occurrence in a terminal according to the present invention.

13A and 13B illustrate examples of methods of processing a voice recognition error generated in a terminal according to the present invention.

14A and 14B are diagrams showing examples of processing methods when a speech recognition error occurs repeatedly according to the present invention.

15 is an exemplary diagram for explaining a process of learning a speech recognition error processed in a terminal according to the present invention;

Claims (16)

A display unit; A microphone for receiving voice information; And Outputting the text information in which the voice information is converted by the STT function to the display unit and outputting a message for requesting re-input of the text information when a stop request for outputting the text information is received, And a controller for executing a function corresponding to the text information if a stop request for an output is not received. The method according to claim 1, Further comprising a memory, Wherein, Storing the voice information, text information and re-inputted information in the memory as information related to an error occurring in recognition of the voice information when the information is re-input corresponding to the message, And corrects the same error by using information related to the error when an error that occurs in recognition of the audio information occurs in the new audio information after the new audio information is input by the microphone. . delete The apparatus of claim 1, Detects a voice recognition rate for the voice information, and determines that an error has occurred in recognition of the voice information if the voice recognition rate is less than a predetermined value. The apparatus of claim 1, The message including information for requesting division of the text information into specific units and outputting the information, And corrects the text information for each specific unit when the information is re-input for each specific unit. The apparatus of claim 1, And outputs a soft keypad for re-inputting the text information by touch input to the display unit when the stop request is received. 3. The method of claim 2, Wherein a sentence, a word or a clause in which an error occurs in recognition of the voice information, a word or a phrase re-inputted corresponding to the message, or a sentence is stored in a table format. Receiving voice information; Outputting the text information in which the voice information is converted by the STT function to the display unit; And Outputting a message requesting re-input of the text information when a stop request for the output of the text information is received, and executing a function corresponding to the text information if a stop request for outputting the text information is not received And a control unit for controlling the terminal. 9. The method of claim 8, Storing the voice information, the text information and the re-entered information in a memory as information related to an error occurring in the recognition of the voice information when the information is re-input in response to the message; And Further comprising the step of correcting the same error by using information related to the error when new audio information is input and an error that occurs in recognition of the audio information occurs in the new audio information, A method of controlling a terminal. delete 9. The method of claim 8, Detecting a voice recognition rate for the voice information; and determining that an error has occurred in the voice information recognition if the voice recognition rate is less than a predetermined value. 9. The method of claim 8, Wherein the message includes information for requesting division of the text information into specific units, and when the information is re-inputted for each specific unit, the text information is corrected for each specific unit . 9. The method of claim 8, Wherein the re-input of the text information in response to the message comprises receiving information directly from a user through key input or touch input. 14. The method of claim 13, further comprising: And outputting a soft keypad to the display unit. 9. The method of claim 8, And when the stop request is received, displaying the highlighted information item to be re-entered on the text information. 10. The method of claim 9, Wherein a sentence, a word or a paragraph in which an error occurs in recognition of the voice information, a word or phrase re-entered corresponding to the message, or a sentence is stored in a table format.

Images