KR102594683B1 - Electronic device for speech recognition and method thereof - Google Patents

Abstract

An electronic device and a voice recognition method thereof are provided. The voice recognition method of this electronic device includes the steps of receiving a trigger voice, analyzing the trigger voice and storing characteristics of the user's voice for voice recognition, and, when the user's voice is input, determining whether the user's voice corresponds to the characteristics of the user's voice. It includes the step of determining whether or not the user's voice corresponds to the characteristics of the user's voice, and performing voice recognition on the user's voice. As a result, users can easily use the voice recognition function of the electronic device.

Description

Electronic device and its voice recognition method { ELECTRONIC DEVICE FOR SPEECH RECOGNITION AND METHOD THEREOF }

The present invention relates to an electronic device and a voice recognition method thereof, and more specifically, to an electronic device capable of performing voice recognition using a trigger voice and a voice recognition method thereof.

Users want to use electronic devices more conveniently. Accordingly, technology for easily controlling electronic devices is gradually developing. In other words, technology for easily controlling electronic devices started from controlling electronic devices through an input unit attached to the electronic device, and has developed into a method using an external remote controller that can be controlled from a short distance. Recently, as the use of display units including touch panels in electronic devices has become common, technology for controlling electronic devices using touch input is commonly used.

However, the method of controlling an electronic device by touch has the inconvenience that the user must be within a touching distance of the electronic device. Therefore, the need to control electronic devices within a short distance of the user without an external device such as a remote controller has increased.

Accordingly, voice recognition technology has been developed, but there is a problem that voice recognition technology responds not only to the user's voice but also to external noise (for example, the sound of a companion animal). Therefore, in order to respond only to the user's voice, a method of pressing a button attached to the electronic device or a remote controller was used every time a voice to control the electronic device was uttered.

However, this method caused inconvenience to the user because it required the user to press a button attached to the electronic device or a remote controller every time he or she spoke.

Accordingly, there is a need for technology that allows users to easily use the voice recognition function even when there is external noise or a plurality of users.

The present invention was developed in response to the above-mentioned needs, and the purpose of the present invention is to provide an electronic device and a voice recognition method thereof that allow users to easily use a voice recognition function.

According to an embodiment of the present invention for achieving the above object, a voice recognition method of an electronic device includes the steps of, when a user voice is input, determining whether the input user voice corresponds to a trigger voice, and the user voice is a trigger voice. If determined, converting the mode of the electronic device to a voice recognition mode, analyzing the user's voice and storing characteristics of the user's voice, if a control voice for controlling the electronic device is input, the control It may include analyzing the voice and comparing the characteristics of the analyzed control voice with the characteristics of the user's voice, and performing a function corresponding to the control voice based on the comparison result.

Meanwhile, the storing step may be characterized by storing at least one of the energy of the user's voice, frequency bandwidth, resonance value when the user's voice is uttered, and voice signal-to-noise ratio as a characteristic of the user's voice.

In the performing step, data obtained by analyzing at least one of the energy of the control voice, the frequency bandwidth, the ringing value when the control voice is uttered, and the voice signal-to-noise ratio are analyzed to determine the energy of the trigger voice, the frequency bandwidth, and the trigger voice. If at least one of the ringing value and voice signal-to-noise ratio during utterance is within a preset range of the analyzed data, a function corresponding to the control voice may be performed.

Meanwhile, in the comparing step, when a plurality of user voices are input, the plurality of user voices are analyzed, and at least one of the results of analyzing the plurality of user voices matches the analysis result of the stored user voice. The method may further include determining one user voice as the control voice, and the performing step may be characterized by performing a function corresponding to the determined at least one control voice.

And, if the characteristics of the analyzed control voice do not correspond to the user voice characteristics, the method may further include bypassing the control voice.

Meanwhile, the method of claim 1, when the user's voice is determined to be a trigger voice and the mode of the electronic device is converted to a voice recognition mode, the step of displaying a UI indicating that the voice recognition mode is in the state may be further included. .

And the displaying step may be characterized by displaying an indicator on the UI when a function corresponding to the control voice is performed according to the comparison result.

Meanwhile, the trigger voice may be a voice preset to switch the mode of the electronic device to a voice recognition mode for performing voice recognition.

Additionally, the user voice and the control voice may be received through a microphone included in at least one of an external device or the electronic device.

Meanwhile, if the control voice is not input for a preset time, the method may further include terminating the voice recognition mode.

Meanwhile, according to an embodiment of the present invention, an electronic device includes a voice receiving unit that receives a user's voice, a voice signal analysis unit that analyzes the received voice, a storage unit that stores characteristics of the user's voice, and the input user voice. It is determined whether the user's voice corresponds to the trigger voice, and if the user's voice is determined to be a trigger voice, the mode of the electronic device is converted to a voice recognition mode, the user's voice is analyzed, and the characteristics of the user's voice are stored in the storage. and a control unit configured to control the electronic device, wherein, when a control voice for controlling the electronic device is input, the control unit controls the voice signal analysis unit to analyze the control voice, and determines the characteristics of the analyzed control voice to the user. It may be characterized in that it compares the characteristics of the voice and performs a function corresponding to the control voice based on the comparison result.

And the control unit may be characterized in that it controls the storage unit to store at least one of the energy of the user's voice, the frequency bandwidth, the resonance value when the user's voice is uttered, and the voice signal-to-noise ratio as a characteristic of the user's voice. there is.

Meanwhile, the control unit analyzes at least one of the energy of the control voice, the frequency bandwidth, the ringing value when the control voice is uttered, and the voice signal-to-noise ratio. The energy of the trigger voice, the frequency bandwidth, and the trigger voice If at least one of the resonance value at the time of speech and the voice signal-to-noise ratio is within a preset range of the analyzed data, the control may be performed to perform a function corresponding to the control voice.

And the control unit, when a plurality of user voices are input through the voice receiver, controls the voice signal analysis unit to analyze the plurality of user voices, and selects the stored user voice among the results of analyzing the plurality of user voices. It may be characterized by determining at least one user voice that matches the analysis result as the control voice and controlling it to perform a function corresponding to the determined at least one control voice.

Meanwhile, the control unit may be configured to control the control voice to be bypassed if the analyzed characteristics of the control voice do not correspond to the user voice characteristics.

And further comprising a display unit, wherein the control unit controls the display unit to display a UI indicating the voice recognition mode state when the user's voice is determined to be a trigger voice and the mode of the electronic device is converted to the voice recognition mode. It can be characterized as:

Meanwhile, the control unit may control the display unit to display an indicator on the UI when performing a function corresponding to the control voice according to the comparison result.

In addition, the trigger voice may be a voice preset to change the mode of the electronic device to a voice recognition mode for performing the voice recognition.

Meanwhile, it may further include a communication unit, wherein the control unit controls the communication unit to receive the input voice when the user voice and the control voice are input through an external device.

The control unit may control the voice recognition mode to end when the control voice is not input for a preset time.

According to various embodiments of the present invention, the user can easily use the voice recognition function of the electronic device by determining whether the user's voice uttered is intentional by the user.

1 is a diagram illustrating a method of inputting a trigger voice to an electronic device according to an embodiment of the present invention;
Figure 2 is a diagram illustrating a method of inputting a trigger voice using an external device according to an embodiment of the present invention;
3 is a block diagram briefly illustrating the configuration of an electronic device according to an embodiment of the present invention;
4 is a block diagram specifically illustrating the configuration of an electronic device according to an embodiment of the present invention;
Figure 5 is a flowchart showing a method of performing voice recognition by analyzing a user's voice according to an embodiment of the present invention;
Figure 6 is a flowchart showing a method of analyzing a user's voice to perform voice recognition and terminating the voice recognition mode, according to an embodiment of the present invention; and
7 to 10 are diagrams showing a UI display according to an embodiment of the present invention.

Hereinafter, various embodiments of the present invention will be described in more detail with reference to the attached drawings. In describing the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description will be omitted. The terms described below are defined in consideration of the functions in the present invention, and may vary depending on the intention or custom of the user or operator. Therefore, the definition should be made based on the contents throughout this specification.

FIG. 1 is a diagram illustrating a user uttering a trigger voice to use the voice recognition function of the electronic device 100, according to an embodiment of the present invention. In FIG. 1, a TV is shown as an example of the electronic device 100, but this is only an example. The electronic device 100 includes a mobile phone with a voice recognition function, a tablet PC, a digital camera, a camcorder, a laptop PC, a PDA, etc. It can be implemented with various electronic devices such as:

The electronic device 100 may include a microphone. Accordingly, the electronic device 100 can receive the user's voice spoken within a certain distance. Additionally, the voice received from the user can be analyzed to determine whether it is a trigger voice. That is, the trigger voice may be a short word with a preset length of three syllables, such as “Hi TV.”

If it is determined that the received voice is a preset trigger voice, the electronic device 100 may change the mode of the electronic device 100 to the voice recognition mode. Additionally, the electronic device 100 may store characteristics of the user's voice included in the trigger voice.

Specifically, the characteristics of the user's voice may include the user's speech condition and speech environment. The user's speech condition may include the energy of the user's voice and the frequency band distribution of the user's voice. And the speech environment may include the resonance value (RT) or speech signal-to-noise ratio (SNR) at the time of speech.

That is, the characteristics of the user's voice may include the energy of the user's voice, the frequency band distribution of the user's voice, the resonance value (RT) at the time of voice utterance, or the voice signal-to-noise ratio (SNR).

For example, the volume of the user's voice that uttered a trigger voice such as "Hi TV", frequency band distribution according to the user's gender or age, etc., the resonance value of the user's voice that varies depending on the location of the electronic device 100, or Voice signal-to-noise ratio (SNR), which varies depending on a quiet room, the presence of a construction site outside, the presence of companion animals, the number of people present indoors, etc., may correspond to the characteristics of the user's voice.

When the user's voice is input after storing the result of analyzing the trigger voice as a characteristic of the user's voice, the electronic device 100 analyzes the input user's voice and determines whether it corresponds to the characteristic of the stored user's voice. That is, the electronic device 100 determines whether the characteristics of the input user voice are similar to the characteristics of the user voice described above.

And, if it is determined that the input user voice has characteristics similar to those of the stored user voice, voice recognition is performed on the user voice. For example, if the user utters “Hi TV” as a trigger voice and “channel 13” as the characteristic of the same user voice, the electronic device 100 may change the displayed channel to channel 13.

Meanwhile, FIG. 2 is a diagram illustrating a user uttering a trigger voice using the remote control 10 including a microphone to use the voice recognition function of the electronic device 100, according to an embodiment of the invention. .

Specifically, when the user's voice is received through the remote control 10 and the voice recognition function is performed, the user can press the input button 20 to receive the voice of the remote control 10 and then utter the user's voice. . At this time, the first user voice received after pressing the input button 20 may be the trigger voice. That is, even if a phrase such as “Hi TV” is preset as a trigger voice in the electronic device 100, a signal that a voice is input through the input button 20 has been received, so after pressing the input button 20, the first The user voice received may be the trigger voice.

Accordingly, as shown in FIG. 2, when the input button 20 is pressed by the user and a user voice called “channel ship” is received, the electronic device 100 may recognize “channel ship” as a trigger voice. Then, the electronic device 100 switches to the voice recognition mode by a trigger voice called “Channel Ship” and voice recognition is performed. That is, the electronic device 100 can change the displayed channel to number ten (10).

With the electronic device described above, a user can easily use the voice recognition function of the electronic device by uttering a trigger voice. The specific voice recognition method of the electronic device will be described later.

Figure 3 is a block diagram briefly illustrating the configuration of an electronic device according to an embodiment of the present invention. As shown in FIG. 3, the electronic device 100 includes a voice reception unit 110, a voice signal analysis unit 120, a storage unit 130, and a control unit 140. At this time, the electronic device 100 may be a TV, but this is only an example and can be implemented as various electronic devices such as a tablet PC with a voice recognition function, a digital camera, a camcorder, a laptop PC, a PDA, a mobile phone, etc. there is.

The voice receiver 110 is a component for receiving user voice input. The voice receiver 110 may include a microphone (not shown) and can receive a user's voice through the microphone. A microphone may be included in the electronic device 100. Additionally, the microphone may be included in an external device. For example, the external device may be a remote control, and the remote control may receive the user's voice through a microphone and transmit it to the voice receiver 110.

That is, the voice receiver 110 receives the user's voice input through the microphone and processes it into electrical voice data. Then, the voice receiving unit 110 transmits the processed voice data to the voice signal analysis unit 120.

The voice signal analysis unit 120 is a component for analyzing the voice received through the voice receiver 110. For example, the voice signal analysis unit 120 may analyze the user's voice to obtain the energy, frequency band distribution, or reverberation time (RT) of the user's voice.

Additionally, when the user's voice is received, noise around the user is often also received. Accordingly, the voice signal analysis unit 120 may analyze the user's voice to obtain the user's voice signal-to-noise ratio (SNR).

Meanwhile, the storage unit 130 may store various results analyzed by the voice signal analysis unit 120. Specifically, the storage unit 130 may store the characteristics of the analyzed user's voice, that is, the energy of the received user's voice, the frequency band distribution, the resonance value of the user's voice, or the signal-to-noise ratio of the user's voice.

And the storage unit 130 can store various software modules and data for driving the electronic device 100. For example, the storage unit 130 may store software including a voice recognition module, a base module, a sensing module, a communication module, a presentation module, a web browser module, and a service module.

Meanwhile, the control unit 140 is a component that controls the overall operation of the electronic device 100. In particular, the control unit 140 may determine whether the voice input through the voice receiver 110 corresponds to the trigger voice.

The trigger voice is a voice used to change the mode of the electronic device 100 to a voice recognition mode for performing voice recognition. Specifically, the trigger voice may be a word with a length of three syllables preset in the electronic device 100. For example, the electronic device 100 may be initially set to “Hi TV” as the trigger voice. In other words, the trigger voice is the user's voice that uttered a preset phrase received through the voice receiver 110 as described above, or the first input when an input button included in an external device of the electronic device 100, such as a remote control, is pressed. It may be a user voice.

If the control unit 140 determines that the input voice corresponds to a trigger voice, the control unit 140 may change the mode of the electronic device 100 to a voice recognition mode. Additionally, the control unit 140 may analyze the trigger voice through the voice signal analysis unit 120 and control the storage unit 130 to store user voice characteristics.

Characteristics of the user's voice may include energy of the user's voice, frequency band distribution, resonance value of the user's voice, or signal-to-noise ratio of the user's voice, which are examples of results analyzed by the voice signal analysis unit 120.

Additionally, when a control voice for controlling the electronic device 100 is input, the control unit 140 may control the voice signal analysis unit 120 to analyze the control voice.

The control unit 140 may compare the characteristics of the analyzed control voice with the characteristics of the user's voice stored in the storage unit 130. And the control unit 140 can control to perform a function corresponding to the control voice based on the comparison result.

Specifically, data analyzed at least one of the energy of the control voice input through the voice receiver 110, the frequency bandwidth, the ringing value when the control voice is uttered, or the voice signal-to-noise ratio is the energy of the user voice corresponding to the trigger voice, If at least one of the frequency bandwidth, ringing value when the trigger voice is uttered, or voice signal-to-noise ratio is within a preset range, the control unit 140 may control the data to perform a function corresponding to the control voice.

Additionally, the control unit 140 may control the storage unit 130 to store the user speech condition or user speech environment of the user voice analyzed through the voice signal analysis unit 120 as a characteristic of the user voice.

Meanwhile, the control unit 140 can control the voice recognition mode to end when a preset time has elapsed. That is, even when the user's voice input through the voice receiver 110 is determined to be a trigger voice and the voice recognition mode is performed, if a preset time is elapsed because the control voice is not input, the controller 140 switches on the voice recognition mode. You can control it to end.

Additionally, if the characteristics of the control voice analyzed by the voice signal analysis unit 120 do not correspond to the user voice characteristics stored in the storage unit 130, the control unit 140 may control the control voice to be bypassed.

Meanwhile, according to FIG. 4, the electronic device 100 includes a voice reception unit 110, a voice signal analysis unit 120, a storage unit 130, a control unit 140, an image reception unit 150, an image processing unit 160, It may include a display unit 170, an audio processing unit 180, an audio output unit 190, a communication unit 200, and an input unit 210. FIG. 4 illustrates various components comprehensively, taking the case where the electronic device 200 is a device equipped with various functions such as a voice recognition function, a communication function, a video playback function, a display function, etc. Therefore, depending on the embodiment, some of the components shown in FIG. 4 may be omitted or changed, and other components may be added.

The voice receiver 110 is a component for receiving user voice input. The voice receiver 110 may include a microphone (not shown) and may receive a user's voice through the microphone. A microphone may be included in the electronic device 100. Additionally, the microphone may be included in an external device. For example, the external device may be a remote control, and the remote control may receive the user's voice through a microphone and transmit it to the voice receiver 110.

That is, the voice receiver 110 receives the user's voice input through the microphone and processes it into electrical voice data. Then, the voice receiving unit 110 transmits the processed voice data to the voice signal analysis unit 120.

The voice signal analysis unit 120 is a component for analyzing the voice received through the voice receiver 110. For example, the voice signal analysis unit 120 may analyze the user's voice to obtain the energy, frequency band distribution, or reverberation time (RT) of the user's voice.

Additionally, when the user's voice is received, noise around the user is often also received. Accordingly, the voice signal analysis unit 120 may analyze the user's voice to obtain the user's voice signal-to-noise ratio (SNR).

Meanwhile, the storage unit 130 may store various results analyzed by the voice signal analysis unit 120. Specifically, the storage unit 130 may store the characteristics of the analyzed user's voice, that is, the energy of the received user's voice, the frequency band distribution, the resonance value of the user's voice, or the signal-to-noise ratio of the user's voice.

And the storage unit 130 can store various software modules and data for driving the electronic device 100. For example, the storage unit 130 may store software including a voice recognition module, a base module, a sensing module, a communication module, a presentation module, a web browser module, and a service module.

Meanwhile, the control unit 140 is a component that controls the overall operation of the electronic device 100. In particular, the control unit 140 may determine whether the voice input through the voice receiver 110 corresponds to the trigger voice.

The trigger voice is a voice used to change the mode of the electronic device 100 to a voice recognition mode for performing voice recognition. Specifically, the trigger voice may be a word with a length of three syllables preset in the electronic device 100. For example, the electronic device 100 may be initially set to “Hi TV” as the trigger voice. That is, the trigger voice is the user's voice that uttered a preset phrase received through the voice receiver 110 as described above, or the first voice received after pressing the input button included in an external device of the electronic device 100, such as a remote control. It may be a user voice.

Specifically, when the preset phrase is "Hi TV" and "Hi TV" is input through the microphone, the control unit 140 converts the mode of the electronic device 100 to voice recognition mode, and the input user voice " The voice signal analysis unit 120 can be controlled to analyze “Hi TV”. The microphone may be included in the electronic device 100 or may be included in a device external to the electronic device 100, such as a remote control. Additionally, when a user command to press an input button included in the remote control is input and a voice is input first, the control unit 140 may determine that the first voice input is a trigger voice.

That is, when the control unit 140 determines that the input voice corresponds to a preset trigger voice, the control unit 140 converts the mode of the electronic device 100 to voice recognition mode and analyzes the trigger voice through the voice signal analysis unit 120. Thus, the storage unit 130 can be controlled to store user voice characteristics. For example, the control unit 140 may control the storage unit 130 to store the results of analyzing the energy of the trigger voice, the frequency bandwidth, the resonance value when the trigger voice is uttered, or the voice signal-to-noise ratio.

After converting to the voice recognition mode, when a control voice is input through the voice receiver 110, the controller 140 can control the voice signal analysis unit 120 to analyze the control voice. The control voice may include any user voice that can control the functions of the electronic device 100. Additionally, the control unit 140 may control the voice signal analysis unit 120 to recognize and analyze a user's voice with energy exceeding a preset level as a control voice.

For example, when a control voice called “channel thirteen” is received through the voice receiver 110 after conversion to the voice recognition mode, the control unit 140 controls the voice signal “channel thirteen” through the voice signal analysis unit 120. It can be controlled to analyze the energy of the voice, frequency bandwidth, resonance value when uttering the control voice, or voice signal-to-noise ratio.

The energy, frequency bandwidth, and utterance of the trigger voice of the trigger voice stored in the storage unit 130 are analyzed results such as the energy, frequency bandwidth, and ringing value or voice signal-to-noise ratio of the control voice called "Channel 13" when the control voice is uttered. If the result of analyzing the resonance value of the poem or the voice signal-to-noise ratio falls within a preset range, the control unit 140 performs voice recognition on the control voice and changes the channel of the image displayed by the electronic device 100 to thirteen times. It can be changed to .

Alternatively, when an input button included in an external device is pressed and a user voice called “channel thirteen” is received, the control unit 140 may determine “channel thirteen” as the trigger voice. And by the above-described method, the control unit 140 can analyze “channel thirteen”, store the analysis results as characteristics of the user's voice, and convert the mode of the electronic device 100 to the voice recognition mode. Additionally, by performing voice recognition, the channel of the image displayed by the electronic device 100 can be changed to number thirteen (13).

After changing the channel of the video to be displayed to number 13, when a control voice saying “volume up” is received through the voice receiver 110, the controller 140 receives the control voice through the voice signal analysis unit 120. is analyzed to determine whether the analysis result falls within a preset range of the characteristics of the user's voice. If the analysis result falls within a preset range of the characteristics of the generated user's voice, the control unit 140 may perform voice recognition and control the electronic device 100 to increase the volume of the image displayed.

Meanwhile, when a plurality of user voices are received through the voice reception unit 110 after conversion to the voice recognition mode, the control unit 140 may control the voice signal analysis unit 120 to analyze each of the plurality of user voices. And, among the plurality of user voices, a user voice that has analysis results similar to the characteristic results of the user voice stored in the storage unit 130 may be determined as the control voice. The control unit 140 may perform voice recognition according to the determined control voice.

For example, the first, second, and third users are speaking near the electronic device 100, and the first user utters “Hi TV,” a preset trigger voice, through the voice receiver 110. When the first user's voice is received and the control unit 140 converts the mode of the electronic device 100 to the voice recognition mode, the control unit 140 uses the voice signal analysis unit 120 to analyze the first user's trigger voice. can be controlled.

Specifically, the voice signal analysis unit 120 may analyze the energy of the first user's voice and the frequency band distribution of the first user's voice. Additionally, the voice signal analysis unit 120 may analyze the resonance value (RT) at the time of the first user's voice utterance and the first user's voice signal-to-noise ratio (SNR). Additionally, the control unit 140 may control the storage unit 130 to store the analysis result of the first user's trigger voice as a characteristic of the user's voice.

After the characteristics of the user's voice for the trigger voice are stored, the first, second, and third users utter "volume up", "end", and "channel thirteen", respectively, and the voice of each user is transmitted through the voice receiver 110. When this is input, the control unit 140 can control the voice signal analysis unit 120 to analyze the input voice of each user.

The voice signal analysis unit 120 may analyze at least one of the energy, frequency band distribution, resonance value, and voice signal-to-noise ratio of each user's voice. Additionally, the control unit 140 may compare the analysis results for the characteristics of each user's voice with the characteristics of the user's voice stored in the storage unit 130. That is, the control unit 140 may determine that the result of analyzing “volume up” uttered by the same user is most similar to the characteristics of the user's voice stored in the storage unit 130. Accordingly, the control unit 140 may control the electronic device 100 to increase the volume according to “volume up.”

Additionally, the control unit 140 may bypass utterances of second and third users whose voice characteristics and analysis results are different from those of the user stored in the storage unit 130. Accordingly, the electronic device 100 receives “end” and “channel thirteen” through the voice receiver 110, but does not perform the corresponding function.

Meanwhile, the control unit 140 can perform voice recognition and control the voice recognition of the user's voice to end when a preset time has elapsed. That is, even if a command to end voice recognition is not input from the user, if the user's voice, including the control voice, is not received through the voice receiver 110 for a preset time, the controller 140 determines that the electronic device 100 You can control to end voice recognition.

Additionally, if the characteristics of the control voice analyzed by the voice signal analysis unit 120 do not correspond to the user voice characteristics stored in the storage unit 130, the control unit 140 may control the control voice to be bypassed.

For example, the control unit 140 analyzes the user's voice determined as a trigger voice through the voice signal analysis unit 120 and stores the utterance energy of the voice and the voice signal-to-noise ratio as characteristics of the user's voice. control.

After the characteristics of the user's voice are stored, when a control voice is received through the voice receiver 110, the control unit 140 analyzes the user's voice through the voice signal analysis unit 120 and stores the user voice in the storage unit 130. Determine whether it corresponds to the characteristics of the voice. And, if the control unit 140 determines that the user's voice does not correspond to the characteristics of the user's voice because the trigger voice is different from the utterance energy or voice signal-to-noise ratio, the electronic device 100 is controlled by the user voice received as described above. It can be controlled to bypass the received user voice so that it is not controlled.

Meanwhile, the video receiver 150 receives video data through various sources. For example, the video receiver 150 can receive broadcast data from an external broadcasting station, can receive video data in real time from an external server, and can receive video data stored in the internal storage unit 130. there is.

The image processing unit 160 is a component that processes image data received from the image receiving unit 150. The image processing unit 160 can perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion on image data.

The display unit 170 displays at least one of video frames processed by the image processing unit 160 from the image data received from the image receiving unit 150 and various screens generated by the graphics processing unit 143.

In particular, the display unit 170 may display a UI indicating that it is in voice recognition mode. For example, if “Hi TV” is input through the voice receiver 110, and “Hi TV” input through the voice signal analysis unit 120 is analyzed and determined to be a trigger voice, the display unit 170 A UI may be displayed indicating that the trigger voice has been recognized and that the electronic device 100 is in a voice recognition mode.

Specifically, as shown in FIG. 7, the display unit 170 can display, as an example of a voice recognition function, “You can say the following: Channel 19, volume up.” Additionally, the display unit 170 may display “What would you like to do?” as a phrase indicating that it is ready to receive the user's voice.

Additionally, when a control voice is input in the voice recognition mode and a function corresponding to the control voice is performed, the display unit 170 may display an indicator on the UI under the control of the control unit 140.

Specifically, in the voice recognition mode, while the control voice is input through the voice receiver 110 and the control voice is analyzed through the voice signal analysis unit 120, the display unit 170 is used to inform that the control voice is being analyzed. A part of the display unit 170 may display a preset color (for example, white), or an indicator that blinks a preset color (for example, white) may be displayed. The indicator as described above is only an example, and the display unit 170 may display various types of indicators on the UI indicating that the voice recognition mode is in the state.

For example, as shown in FIG. 8, the display unit 170 may display an indicator on a microphone-shaped icon included in the UI. Additionally, to indicate that the voice is being recognized, the display unit 170 may display a phrase such as “Voice is being recognized.”

Meanwhile, a UI indicating the voice recognition mode state may be displayed on a portion of the display unit 170. For example, as shown in FIG. 9, even when a trigger voice and a control voice are input, the display unit 170 continues to display the content and notifies a portion of the display unit 170 that it is in the voice recognition mode. UI can be displayed.

And even when a control voice is input and the control voice is analyzed, as shown in FIG. 10, the display unit 170 continues to display the content and notifies a part of the display unit 170 that it is in the voice recognition mode. You can display indicators on the UI.

The audio processing unit 180 is a component that processes audio data. The audio processing unit 180 may perform various processing such as decoding, amplification, noise filtering, etc. on audio data. Audio data processed in the audio processing unit 180 may be output to the audio output unit 190.

The audio output unit 190 is configured to output various notification sounds or voice messages as well as various audio data processed by the audio processing unit 180. At this time, the audio output unit 190 may be implemented as a speaker, but this is only an example and may be implemented as an audio terminal.

The communication unit 200 is configured to communicate with various types of external devices according to various types of communication methods. The communication unit 200 may include various communication modules such as a USB module, Wi-Fi module, Bluetooth module, and NFC module. At this time, the Wi-Fi module, Bluetooth module, and NFC module perform communication in the WiFi method, Bluetooth method, and NFC method, respectively. Among these, the NFC module refers to a module that operates in the NFC (Near Field Communication) method using the 13.56MHz band among various RF-ID frequency bands such as 135kHz, 13.56MHz, 433MHz, 860~960MHz, 2.45GHz, etc. When using a Wi-Fi module or a Bluetooth module, various connection information such as SSID and session key are first transmitted and received, and various information can be transmitted and received after establishing a communication connection using this.

Additionally, when the user voice and control voice are input through an external device, the communication unit 200 can receive the input voice. For example, when a user's voice is input through a microphone included in the remote control, the electronic device 100 may receive the voice input through the communication unit 200.

The input unit 210 receives user commands for controlling the overall operation of the electronic device 100. At this time, the input unit 210 may be implemented as a remote control including four directional keys up, down, left, and right and a confirmation key, but this is only an example and may be implemented by various input devices such as a touch screen, mouse, pointing device, etc. You can.

Additionally, when the input unit 210 is implemented as a remote control, the remote control may include an input button for receiving voice. The user can press the input button on the remote control and then speak the user's voice. Additionally, the first user voice received after pressing the input button can be the trigger voice.

Meanwhile, as shown in FIG. 4, the control unit 140 includes RAM 141, ROM 142, graphics processing unit 143, main CPU 144, and first to n interfaces 145-1 to 145-n. ), including bus 146. At this time, RAM 141, ROM 142, graphics processing unit 143, main CPU 144, first to n interfaces (145-1 to 145-n), etc. may be connected to each other through bus 146. .

The ROM 142 stores a set of instructions for booting the system. When a turn-on command is input and power is supplied, the main CPU 144 copies the O/S stored in the storage unit 130 to the RAM 141 according to the command stored in the ROM 142 and executes the O/S. to boot the system. When booting is complete, the main CPU 144 copies various application programs stored in the storage unit 130 to the RAM 141 and executes the application programs copied to the RAM 141 to perform various operations.

The graphics processing unit 143 uses a calculation unit (not shown) and a rendering unit (not shown) to create a screen including various objects such as icons, images, and text. The calculation unit uses control commands received from the input unit 210 to calculate attribute values such as coordinates, shape, size, color, etc. for each object to be displayed according to the layout of the screen. The rendering unit generates screens with various layouts including objects based on the attribute values calculated by the calculation unit. The screen generated by the rendering unit is displayed within the display area of the display unit 170. In particular, the graphics processing unit 143 may generate a UI indicating that the trigger voice has been recognized and that the user voice can be received.

The main CPU 144 accesses the storage unit 130 and performs booting using the O/S stored in the storage unit 130. And the main CPU 144 performs various operations using various programs, contents, data, etc. stored in the storage unit 130.

Additionally, the first to n interfaces 295-1 to 295-n are connected to the various components described above.

Meanwhile, Figure 5 is a flowchart showing a method of performing voice recognition by analyzing a user's voice according to an embodiment of the present invention.

First, the electronic device 100 receives a user's voice (S500). The electronic device 100 may receive a user's voice input through a microphone included in the electronic device 100. Additionally, the user's voice can be input through a microphone included in an external device such as a remote control.

The electronic device 100 determines whether the input user voice corresponds to the trigger voice (S510). The trigger voice may be a voice used to switch the mode of the electronic device to a voice recognition mode for performing voice recognition. Additionally, the trigger voice may be preset in the electronic device 100, or may be set to a specific phrase with a certain length according to the user's settings. For example, when the trigger voice is preset to “Hi, TV,” the electronic device 100 determines whether the received user voice is “Hi, TV.” And when the received user voice is determined to be “Hi, TV” (S510-Y), the electronic device 100 changes the mode of the electronic device to the voice recognition mode (S520).

Meanwhile, when the user voice is received through an external device such as a remote control, the electronic device 100 recognizes the first received user voice as a trigger voice after the input button included in the external device such as a remote control is pressed. You can. In other words, even if the trigger voice is preset to “Hi TV,” the electronic device 100 detects the input “channel thirteen” as the first input after the input button included in an external device such as a remote control is pressed. “Thirteen” itself can be recognized as a trigger voice.

Then, the electronic device 100 analyzes the user voice determined to be the trigger voice and stores the characteristics of the user voice (S530). Specifically, the characteristics of the user's voice may include the user's speech condition and speech environment. The user's speech condition may include the energy of the user's voice and the frequency band distribution of the user's voice. And the speech environment may include the resonance value (RT) or speech signal-to-noise ratio (SNR) at the time of the user's voice speech. That is, the characteristics of the user's voice may include the energy of the user's voice, the frequency band distribution of the user's voice, the resonance value (RT) at the time of voice utterance, or the voice signal-to-noise ratio (SNR).

When a control voice for controlling the electronic device 100 is input (S540-Y), the electronic device 100 analyzes the control voice and compares the characteristics of the control voice with the characteristics of the user's voice (S550). The control voice may include any user voice that can control the functions of the electronic device 100. Additionally, the electronic device 100 may recognize and analyze a user's voice with energy exceeding a preset level as a control voice.

Then, the electronic device 100 performs a function corresponding to the control voice based on the comparison result (S560). Specifically, data analyzing at least one of the energy of the control voice, the frequency bandwidth, the ringing value when the control voice is uttered, or the voice signal-to-noise ratio corresponds to the energy, frequency bandwidth, and trigger voice of the user's voice corresponding to the trigger voice. If at least one of the resonance value or the voice signal-to-noise ratio when the user's voice is uttered is within a preset range, the electronic device 100 performs a function corresponding to the control voice.

The input user voice "Hi TV" is determined to be a trigger voice, and the mode of the electronic device 100 is converted to voice recognition mode, and the energy of "Hi TV" and the resonance value at the time of uttering "Hi TV" are converted into user voice characteristics. After saving, an example is given where the electronic device 100 receives the control voice “channel thirteen”.

The electronic device 100 analyzes the energy of the input control voice “channel thirteen” and the resonance value at the time the control voice is uttered. And, if the analyzed data falls within the error range of 10% of the data value of the user voice characteristics of the stored trigger voice, the electronic device 100 may determine that the user who uttered the trigger voice and the user who uttered the control voice are the same. there is. Additionally, the electronic device 100 may determine that the input control voice was intentionally uttered by the user to control the electronic device 100. Accordingly, the electronic device 100 can control the displayed image to change to channel number 13.

Meanwhile, the 10% error range of the comparison data is only an example, and may vary depending on the initial settings and environment of the electronic device 100.

In addition, utterance energy and resonance value are only examples of the characteristics of the user's voice, and the user who utters the voice, such as the frequency band distribution of the voice, the echo value (RT) when the voice is uttered, and the voice signal-to-noise ratio (SNR), etc. Of course, all values that vary depending on the speech environment can be analyzed and stored as user voice recognition conditions.

Meanwhile, Figure 6 is a flowchart illustrating a method of analyzing a user's voice, performing voice recognition, and terminating the voice recognition mode, according to an embodiment of the present invention.

First, the electronic device 100 receives a user's voice (S600). The electronic device 100 may receive a user's voice input through a microphone included in the electronic device 100. Additionally, the user's voice can be input through a microphone included in an external device such as a remote control.

The electronic device 100 determines whether the input user voice corresponds to the trigger voice (S610). The trigger voice may be a voice used to switch the mode of the electronic device to a voice recognition mode for performing voice recognition. Additionally, the trigger voice may be preset in the electronic device 100, or may be set to a specific phrase with a certain length according to the user's settings. For example, when the trigger voice is preset to “Hi, TV,” the electronic device 100 determines whether the received user voice is “Hi, TV.” And when the received user voice is determined to be “Hi, TV” (S610-Y), the electronic device 100 changes the mode of the electronic device to the voice recognition mode (S620).

Meanwhile, when the user voice is received through an external device such as a remote control, the electronic device 100 recognizes the first received user voice as a trigger voice after the input button included in the external device such as a remote control is pressed. You can. In other words, even if the trigger voice is preset to “Hi TV,” the electronic device 100 detects the input “channel thirteen” as the first input after the input button included in an external device such as a remote control is pressed. “Thirteen” itself can be recognized as a trigger voice.

Then, the electronic device 100 analyzes the user voice determined to be the trigger voice and stores the characteristics of the user voice (S630). Specifically, the characteristics of the user's voice may include the user's speech condition and speech environment. The user's speech condition may include the energy of the user's voice and the frequency band distribution of the user's voice. And the speech environment may include the resonance value (RT) or speech signal-to-noise ratio (SNR) at the time of the user's voice speech. That is, the characteristics of the user's voice may include the energy of the user's voice, the frequency band distribution of the user's voice, the resonance value (RT) at the time of voice utterance, or the voice signal-to-noise ratio (SNR).

When a control voice for controlling the electronic device 100 is input (S640-Y), the electronic device 100 analyzes the control voice and compares the characteristics of the control voice with the characteristics of the user's voice (S650). The control voice may include any user voice that can control the functions of the electronic device 100. Additionally, the electronic device 100 may recognize and analyze a user's voice with energy exceeding a preset level as a control voice.

If the characteristics of the analyzed control voice are within the preset range of the characteristics of the stored user voice (S660-Y), the electronic device 100 performs a function corresponding to the control voice (S670).

Meanwhile, if the characteristics of the analyzed control voice do not fall within the preset range of the characteristics of the stored user voice (S660-N), the electronic device 100 bypasses the control voice (S680).

The input user voice "Hi TV" is determined to be a trigger voice, and the mode of the electronic device 100 is converted to voice recognition mode, and the energy of "Hi TV" and the resonance value at the time of uttering "Hi TV" are converted into user voice characteristics. After saving, an example is given where the electronic device 100 receives the control voice “channel thirteen”.

The electronic device 100 analyzes the energy of the input control voice “channel thirteen” and the resonance value at the time the control voice is uttered. And, if the analyzed data falls within the error range of 10% of the data value of the user voice characteristics of the stored trigger voice, the electronic device 100 may determine that the user who uttered the trigger voice and the user who uttered the control voice are the same. there is. Additionally, the electronic device 100 may determine that the input control voice was intentionally uttered by the user to control the electronic device 100. Accordingly, the electronic device 100 can control the displayed image to change to channel number 13.

On the other hand, the data analyzing the energy of the input control voice "Channel Thirteen" and the sound value at the time of utterance of the control voice fall within the 10% error range of the data analyzing the energy and sound value at the time of utterance of the trigger voice "Hi TV". If not, the electronic device 100 may bypass the input control voice “channel thirteen”. Accordingly, the electronic device 100 may not change the channel of the image being displayed.

Meanwhile, the 10% error range of the comparison data is only an example, and may vary depending on the initial settings and environment of the electronic device 100.

In addition, utterance energy and resonance value are only examples of the characteristics of the user's voice, and the user who utters the voice, such as the frequency band distribution of the voice, the echo value (RT) when the voice is uttered, and the voice signal-to-noise ratio (SNR), etc. Of course, all values that vary depending on the speech environment can be analyzed and stored as user voice recognition conditions.

Meanwhile, when a preset time is elapsed (S690-Y), the electronic device 100 ends the voice recognition mode (S700). That is, after performing the function corresponding to the control voice, even if there is no input of a user command to end the voice recognition mode, if the control voice is not input for a preset time, the sperm device 100 automatically enters the voice recognition mode. Terminate. Accordingly, the electronic device 100 may not perform its function in response to the input user voice until the input user voice is again determined to be a trigger voice after the voice recognition mode ends.

According to the voice recognition method described above, the user can easily control the functions of the electronic device without error by uttering a voice without any additional manipulation.

The voice recognition method of an electronic device according to the various embodiments described above may be coded into software and stored in a non-transitory readable medium. These non-transitory readable media can be mounted and used in various devices.

For example, when a user voice is input, determining whether the input user voice corresponds to a trigger voice; when the user voice is determined to be a trigger voice, converting the mode of the electronic device to a voice recognition mode, Analyzing a user's voice and storing the characteristics of the user's voice; When a control voice for controlling the electronic device is input, analyzing the control voice and comparing the characteristics of the analyzed control voice with the characteristics of the user's voice A program code for performing the step and performing the function corresponding to the control voice based on the comparison result may be stored and provided in a non-transitory readable medium. In addition, the power saving processing method described in the various embodiments described above may be coded into a program and stored in a non-transitory readable medium.

A non-transitory readable medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short period of time, such as registers, caches, and memories. Specifically, it can be a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, etc.

In addition, although preferred embodiments of the present invention have been shown and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the invention pertains without departing from the gist of the present invention as claimed in the claims. Of course, various modifications can be made by those of ordinary skill in the art, and these modifications should not be understood individually from the technical idea or perspective of the present invention.

100: Electronic device 110: Voice receiver
120: Voice signal analysis unit 130: Storage unit
140: Control unit 150: Video receiving unit
160: image processing unit 170: display unit
180: audio processing unit 190: audio output unit
200: communication unit 210: input unit

Claims (20)

In the display device,
video receiver;
display unit;
Voice input receiver;
Ministry of Communications; and
Controlling the display unit to output broadcast content received through the video receiver,
While the received broadcast content is being output on the display unit, a first voice input is received from an external device connected through the communication unit through the voice input receiver without receiving a signal corresponding to the voice input reception from the external device,
When the received first voice input corresponds to a preset trigger word, a voice recognition function corresponding to the received first voice input is performed, and a voice recognition function corresponding to the performance of the voice recognition function is performed together with the broadcast content being output. 1 Control the display unit to output UI,
If a second voice input corresponding to function control of the display device is received within a preset time after the voice recognition function is performed, control the function of the display device corresponding to the received second voice input,
If the second voice input corresponding to the function control of the display device is not received within a preset time after the voice recognition function is performed, the first voice input is received without a user command corresponding to termination of the performed voice recognition function. It includes a control unit that terminates the corresponding voice recognition function,
A display device wherein the preset trigger word can be changed according to user selection. According to paragraph 1,
The control unit,
A display device that changes the state of the display device to a voice recognition state capable of performing the voice recognition function when the received first voice input corresponds to a trigger word that is preset or selected by the user. According to paragraph 1,
The first UI corresponding to performing the voice recognition function is,
A display device comprising a UI indicating that the state of the display device is a voice recognition state in which the voice recognition function is performed and a state in which the second voice input can be received. According to paragraph 1,
The control unit,
A display device that controls the display unit to display, when a second voice input corresponding to function control of the display device is received, a second UI indicating that the received second voice input is being processed along with the broadcast content being output. . According to paragraph 4,
The first and second UI are each output to a partial area of the display unit. According to paragraph 1,
The first UI corresponding to performing the voice recognition function is,
A display device comprising a plurality of texts corresponding to a plurality of voice inputs that can be input to control functions of the display device in response to the performed voice recognition function. According to paragraph 1,
The control unit,
If a third voice input is not received within a preset time after the function of the display device corresponding to the received second voice input is controlled, the first voice is transmitted without a user command corresponding to termination of the performed voice recognition function. A display device that terminates the voice recognition function corresponding to input. In clause 7,
The control unit,
If the voice recognition function is terminated because the third voice input is not received within the preset time, the voice recognition function is terminated through the voice input receiver until the fourth voice input corresponding to the preset trigger word is received through the voice input receiver. A display device that does not perform a function corresponding to received voice input. According to paragraph 1,
The control unit,
A display device that identifies whether the received first voice input corresponds to the preset trigger word. According to clause 9,
The voice input receiver includes a microphone of the display device,
The control unit,
When a signal corresponding to the reception of a voice input through the microphone of the external device is received through the communication unit, it is not identified whether the first voice input received through the microphone of the display device corresponds to the preset trigger word. Display device. A method of controlling a display device including a voice input receiver, a communication unit, and a display unit,
outputting broadcast content to the display unit;
While the broadcast content is being output to the display unit, receiving a first voice input from an external device connected through the communication unit through the voice input receiver without receiving a signal corresponding to reception of voice input from the external device;
When the received first voice input corresponds to a preset trigger word, a voice recognition function corresponding to the received first voice input is performed, and a voice recognition function corresponding to the performance of the voice recognition function is performed together with the broadcast content being output. 1 Outputting UI to the display unit;
If a second voice input corresponding to function control of the display device is received within a preset time after the voice recognition function is performed, controlling a function of the display device corresponding to the received second voice input;
If the second voice input corresponding to the function control of the display device is not received within a preset time after the voice recognition function is performed, the first voice input is received without a user command corresponding to termination of the performed voice recognition function. Including; terminating the corresponding voice recognition function,
A control method in which the preset trigger word can be changed according to user selection. According to clause 11,
If the received first voice input corresponds to a preset or a trigger word selected by the user, changing the state of the display device to a voice recognition state capable of performing the voice recognition function; control further comprising method. According to clause 11,
The first UI corresponding to performing the voice recognition function is,
A control method comprising a UI indicating that the state of the display device is a voice recognition state in which the voice recognition function is performed and a state in which the second voice input can be received. According to clause 11,
When a second voice input corresponding to function control of the display device is received, outputting a second UI indicating that the received second voice input is being processed along with the broadcast content being output to the display unit; Including, control method. According to clause 14,
The first and second UI are each output to a partial area of the display unit. According to clause 11,
The first UI corresponding to performing the voice recognition function is,
A control method comprising a plurality of texts corresponding to a plurality of voice inputs that can be input to control the function of the display device in response to the performed voice recognition function. According to clause 11,
The ending step is,
If a third voice input is not received within a preset time after the function of the display device corresponding to the received second voice input is controlled, the first voice is transmitted without a user command corresponding to termination of the performed voice recognition function. A control method for terminating the voice recognition function corresponding to input. According to clause 17,
If the voice recognition function is terminated because the third voice input is not received within the preset time, the voice recognition function is terminated through the voice input receiver until the fourth voice input corresponding to the preset trigger word is received through the voice input receiver. A control method in which a function corresponding to a received voice input is not performed. According to clause 11,
Further comprising: identifying whether the received first voice input corresponds to the preset trigger word. According to clause 19,
The voice input receiver includes a microphone of the display device,
When a signal corresponding to the reception of a voice input through the microphone of the external device is received through the communication unit, it is not identified whether the first voice input received through the microphone of the display device corresponds to the preset trigger word. Control method.