KR20200095442A - Display apparatus, voice acquiring apparatus and voice recognition method thereof - Google Patents

Abstract

The present invention relates to a display device, a voice acquiring device and a voice recognition method thereof. The display device includes: a display unit displaying an image; a communication unit performing communication with a plurality of external devices; a voice recognition engine recognizing voice spoken by a user; and a control unit which receives a voice signal from a voice acquisition unit and controls the communication unit to receive a candidate command for recognizing the received voice signal from at least one of the plurality of external devices. Therefore, it is possible to increase utilization of various voice acquisition facilities and to provide link services using them, and by making it possible to dynamically register/delete candidate commands for speech recognition, it is possible to flexibly cope with problems such as delay in processing speed or decrease in recognition rate to increase the efficiency of the entire speech recognition system.

Description

Display device, voice acquisition device, and its voice recognition method {DISPLAY APPARATUS, VOICE ACQUIRING APPARATUS AND VOICE RECOGNITION METHOD THEREOF}

The present invention relates to a display device, a voice acquisition device, and a voice recognition method thereof, and more particularly, to a display device for recognizing a voice spoken by a user, a voice acquisition device, and a voice recognition method thereof.

The use of electronic devices having a voice recognition function that recognizes a voice spoken by a user is gradually increasing. Voice recognition is being actively used not only in PCs and mobile communication devices, but also in various electronic devices such as digital TVs, air conditioners, and home theaters.

In order to perform such a voice recognition function, a microphone for receiving the voice uttered by a user and a voice recognition engine for recognizing the input voice are provided in a main device such as a TV, and the voice recognition engine is a candidate pre-stored voice input from the microphone. Compared with the command, the spoken voice can be recognized according to the result.

However, in the case of a conventional electronic device having a voice recognition function, since a means for receiving a voice uttered by a user is fixed, it is difficult to utilize various input means capable of voice input such as a mobile phone. In addition, although the recognition rate increases as the number of candidate commands increases, as the number of candidate commands increases, the number of targets to be compared increases, resulting in a slower speech recognition processing speed and limited storage capacity of the main device. It has a difficult drawback.

A display apparatus according to an exemplary embodiment of the present invention includes a display unit that displays an image; A communication unit for performing communication with a plurality of external devices; The communication unit includes a voice recognition engine for recognizing a voice spoken by a user, receiving a voice signal from a voice acquisition unit, and receiving a candidate command for recognizing the received voice signal from at least one of the plurality of external devices It includes a control unit for controlling.

A plurality of voice acquisition units may be provided, and when a voice input is detected from at least one of the plurality of voice acquisition units, the control unit may receive a voice signal from the voice acquisition unit in which the voice input is sensed.

The voice acquisition unit includes at least one of a built-in microphone provided in the display device, a first external microphone provided in at least one of the plurality of external devices, and a second external microphone separated from the display device and the plurality of external devices. can do.

The external device may include at least one application, and the candidate command may be managed by the application.

The candidate command may be managed, and a built-in application provided in the display device may be further included.

A storage unit for storing the received candidate command may be further included, and the speech recognition engine may recognize a speech using the received candidate command.

When it is detected that the wakeup keyword for any one of the plurality of voice acquisition units is uttered, the control unit activates a voice acquisition unit corresponding to the detected wakeup keyword, and receives a voice signal from the activated voice acquisition unit. Can receive.

When a trigger signal according to an operation of a predetermined button provided in any one of the plurality of voice acquisition units is input, the control unit activates a voice acquisition unit corresponding to the input trigger signal, and a voice signal from the activated voice acquisition unit Can receive.

The controller may control the display to display a voice recognition result for the voice signal and a candidate command according to the voice recognition result.

The display unit may further display application information for managing the candidate command.

The voice recognition engine may recognize the voice by determining a command that matches or is similar to the received voice signal among the received candidate commands.

On the other hand, a voice acquisition device according to an embodiment of the present invention includes a communication unit for performing communication with a display device having a voice recognition function; A voice acquisition unit receiving a voice spoken by a user; A voice conversion unit converting the input voice into an electric voice signal; And a controller for controlling the communication unit to transmit the converted voice signal and a candidate command for recognizing the voice signal to the display device.

It further includes at least one application, and the candidate command may be managed by the application.

On the other hand, a voice recognition method of a display device according to an embodiment of the present invention includes the steps of receiving a voice signal from a voice acquisition unit; Receiving a candidate command for recognizing the received voice signal from at least one of a plurality of external devices; And recognizing the voice uttered by the user according to the received voice signal and the candidate command.

The method further includes detecting a voice input from at least one of the plurality of voice acquisition units, and the receiving of the voice signal may receive a voice signal from the voice acquisition unit in which the voice input is sensed.

The voice acquisition unit includes at least one of a built-in microphone provided in the display device, a first external microphone provided in at least one of the plurality of external devices, and a second external microphone separated from the display device and the plurality of external devices. can do.

The external device may include at least one application, and the candidate command may be managed by the application.

The candidate command may be managed, and a built-in application provided in the display device may be further included.

The step of storing the received candidate command may further include, and the step of recognizing the voice may recognize the voice using the received candidate command.

The detecting of the voice input includes: detecting that a wakeup keyword for any one of the plurality of voice acquisition units is uttered; It may include the step of activating a voice acquisition unit corresponding to the detected wakeup keyword.

The detecting of the voice input includes: detecting that a trigger signal is input according to an operation of a predetermined button provided in any one of the plurality of voice acquisition units; It may include the step of activating the voice acquisition unit corresponding to the input trigger signal.

The method may further include displaying a voice recognition result for the voice signal and a candidate command according to the voice recognition result.

The displaying may further display application information for managing the candidate command.

In the recognizing of the voice, the voice may be recognized by determining a command that matches or is similar to the received voice signal among the received candidate commands.

1 is an exemplary diagram of a speech recognition system according to an embodiment of the present invention,
2 is a block diagram showing the configuration of a voice recognition system according to an embodiment of the present invention,
3 is a diagram illustrating an example of performing voice recognition according to an embodiment of the present invention,
FIG. 4 is a diagram illustrating an example of a screen displayed as a result of voice recognition of FIG. 3;
5 is a diagram illustrating an example of performing voice recognition according to another embodiment of the present invention,
6 is a flow chart showing a voice recognition method of the voice recognition system according to an embodiment of the present invention,
7 is a flow chart showing in more detail the process of detecting the voice input of FIG. 6,
8 is a detailed flowchart illustrating a process of performing voice recognition of FIG. 6.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is an exemplary diagram of a speech recognition system according to an embodiment of the present invention.

As shown in Fig. 1, the voice recognition system according to the embodiment of the present invention includes a main device 100, a plurality of voice acquisition devices 201, ..., 202, and a plurality of external devices 301, 302, .. ., 303). The main device 100, a plurality of voice acquisition devices 201, 202, and a plurality of external devices 301, 302, 303 are connected to enable mutual communication.

The main device 100 is provided with a voice acquisition unit 140, such as a microphone into which a user uttered voice is input, and a voice recognition engine 181 for recognizing the input voice, and a voice acquisition device through the communication unit 160 ( 201, 202) and external devices (301, 302, 303) communicate. In addition, the main device 100 is provided with one or more built-in applications 171 and 172 (Native Application), and the main device 100 is driven to perform various functions (services). In the built-in applications 171 and 172 of this embodiment, a candidate command corresponding to a function to be performed, that is, a candidate command included in an executable service scenario, is stored in advance, and the candidate command stored in the built-in applications 171 and 172 is a voice recognition engine It is transmitted to 181, so that the voice recognition engine 181 can perform voice recognition.

The voice acquisition devices 201 and 202 include a voice acquisition unit such as a microphone to receive a voice spoken by a user, and a voice signal corresponding to the input voice is transmitted to the main device 100 for voice recognition.

The voice acquisition devices 201 and 202 receive the voice uttered by the user, convert it into an electrical voice signal, and transmit it to the main device 100. The voice acquisition devices 201 and 202 are external devices capable of wireless communication with the main device 100, and wireless communication includes wireless LAN, radio frequency (RF) communication, Bluetooth, Zigbee, It includes infrared (IR) communication.

At least one external application (Dev. Application) is provided in the external devices 301, 302, and 303, and functions (services) required by each of the external devices 301, 302, and 303 can be performed. In the external application of the present embodiment, candidate commands corresponding to functions performed by the corresponding external devices 301, 302, 303 are stored in advance, and candidate commands stored in the external application are transmitted to the speech recognition engine 181 during speech recognition. , Allows the voice recognition engine 181 to perform voice recognition.

Here, the candidate commands registered in advance in the built-in applications 171 and 172 and the external application may be commands related to a function/operation of the corresponding application. For example, when the main device 100 is a TV, candidate commands related to channel movement and volume control of the TV may be stored in any one of the built-in applications 171 and 172, and the external device 302 is an air conditioner. In this case, candidate commands related to temperature control (raise/lower) and wind intensity control (strong wind/weak wind/mild wind), etc. may be stored in an application included in the external device 302.

The present invention may be implemented such that an external device or a voice acquisition device includes both a voice acquisition unit and an external application, as in the external device 1 301 of FIG. 1. In this case, when a voice is input from the voice acquisition unit provided in the external device 1 301, a candidate command previously stored in the external application of the external device 1 301 is transmitted to the voice recognition engine 181 of the main device 100 , Voice recognition can be performed.

The voice recognition system of this embodiment includes at least one voice acquisition unit, and when a voice input is detected from the voice acquisition unit, the voice acquisition unit in which the voice input is sensed is activated to receive a voice stream. When a plurality of voice acquisition units are provided, a voice stream may be received by activating a voice acquisition unit in which a voice input is sensed among the plurality of voice acquisition units. Here, the plurality of voice acquisition units include a built-in microphone provided in the main device 100, a first external microphone provided in at least one of the plurality of external devices 301, 302, 303, the main device 100, and a plurality of external devices. A second external microphone provided in separate voice acquisition devices 201 and 202 separated from 301, 302, and 303 may be included.

When the main device 100 detects that a wakeup keyword for any one of the plurality of voice acquisition units is ignited, it activates a voice acquisition unit corresponding to the detected wakeup keyword, and from the activated voice acquisition unit Can receive audio signals. In addition, the main device 100 activates the voice acquisition unit corresponding to the input trigger signal when a trigger signal according to the operation (event occurrence) of a predetermined button provided in any one of the plurality of voice acquisition units is input. , It is possible to receive a voice signal from the activated voice acquisition unit.

The main device 100 of the present embodiment operates in a voice recognition mode, and when one of the voice acquisition units is activated by a wake-up keyboard or a trigger signal, the other voice acquisition unit is deactivated to prevent an error in voice recognition. have. The main device 100 can operate in a remote or near-field voice recognition mode accordingly. In addition, a UI indicating a voice acquisition unit connected to the display unit 130 to be described later is displayed to help the user's convenience.

In addition, the main device 100 may receive a candidate command for recognizing the received voice signal from at least one of the plurality of external devices 301, 302, and 303. The received candidate command can be transmitted to the voice recognition engine 181 for voice recognition.

The plurality of external devices 301, 302, 303 includes at least one application, and candidate commands may be managed by each corresponding application. In addition, the main device 100 further includes built-in applications 171 and 172, and the built-in applications 171 and 172 manage corresponding candidate commands. Candidate commands managed by the built-in applications 171 and 172 can be transferred to the voice recognition engine 181 for voice recognition.

The main device 100 of the present invention may be implemented as a display device such as a TV as shown in FIG. 2. FIG. 2 is a block diagram showing the configuration of a voice recognition system according to an embodiment of the present invention.

The display apparatus 100 processes an image signal provided from an external image supply source (not shown) according to a preset image processing process so that an image can be displayed.

In the system of the present embodiment, a description will be given of a case in which the display apparatus 100 is implemented as a TV or set top box that processes a broadcast image based on broadcast signals/broadcast information/broadcast data received from the transmission equipment of a broadcasting station. . However, since the idea of the present invention is not limited to the example implementation of the display apparatus 100, various types of implementation examples capable of processing an image may be applied to the display apparatus 100 in addition to a TV and a set-top box.

In addition, the display device 100 is not limited to the type of image that can be displayed to the broadcast image. For example, the display device 100 is a video based on signals/data received from various types of image sources (not shown), A still image, an application, an on-screen display (OSD), and a graphic user interface (GUI) for controlling various operations may be processed to display images.

According to an embodiment of the present invention, the display device 100 may be implemented as a smart TV. Smart TVs can receive and display broadcast signals in real time, and have a web browser function, allowing users to search and consume various contents through the Internet at the same time as displaying real-time broadcast signals, and to provide a convenient user environment for this purpose. to be. In addition, since the smart TV includes an open software platform, it can provide interactive services to users. Accordingly, the smart TV can provide a variety of contents, for example, an application that provides a predetermined service to a user through an open software platform. These applications are applications capable of providing various types of services, and include applications that provide services such as SNS, finance, news, weather, maps, music, movies, games, and electronic books.

A voice recognition engine 181 for recognizing a user's voice is provided in the display device 100 of the present embodiment. A command corresponding to the recognized voice, that is, a control command, is transmitted to a corresponding application to perform an operation according to the function. Here, when the application corresponding to the control command is any one of the built-in applications 171 and 172, the display apparatus 100 performs an operation according to the control command by the application. In addition, if the application corresponding to the control command is an external application, the control command is transmitted to the external devices 301, 302, 303 including the external application, and the external devices 301, 302, 303 You can perform the operation according to the control command.

Meanwhile, although FIG. 2 shows a case where the main device is implemented as a display device such as a TV, the present invention is not limited thereto, and the main device may be implemented as various electronic devices, for example, a PC.

In the embodiment illustrated in FIG. 2, a plurality of voice acquisition devices are provided, and for example, a mobile phone 200 and a remote controller 300 are used as an example. Here, the remote control 300 serves as both a voice acquisition device and an external device, and the mobile phone 200 may be a smartphone having a voice acquisition function.

The remote control 300 transmits a preset command (control command) to a corresponding device by a user's manipulation. The remote control according to the present embodiment may be previously set to transmit commands to the display apparatus 100 or an external device, and may be implemented as an integrated remote control that transmits commands to a plurality of devices in some cases. In addition, the remote control 300 may include a TV remote control and/or an air conditioner remote control.

On the other hand, the voice acquisition device of the present invention may be implemented with various devices capable of receiving a voice uttered by a user, such as a mobile phone 200 and a remote control 300, as well as a portable terminal device and a microphone transmitter.

In the embodiment illustrated in FIG. 2, a plurality of external devices are provided, and for example, a remote controller 300 and an air conditioner 400 are used as an example. As described above, the remote control 300 serves as both a voice acquisition device and an external device.

In the embodiment of FIG. 2, the external device is implemented with the remote control 300 and the air conditioner 400 as an example, but the external device of the present invention is not limited thereto, and various electronic devices capable of wireless communication, such as home It can be implemented as a theater, radio, VCR, DVD, washing machine, refrigerator, and robot cleaner. In addition, when a voice acquisition unit such as a microphone is provided in an external device, it can perform the role of a voice acquisition device together.

The external device of the present embodiment is provided with applications 372 and 472 for performing a function, and candidate commands are pre-stored and managed in each of the applications 372 and 472, and the candidate commands are the display apparatus 100 for voice recognition. Can be sent to.

The external devices, that is, the remote control 300 and the air conditioner 400 perform an operation corresponding to the control command received from the display apparatus 100 according to the voice recognition result.

Hereinafter, each configuration of the voice recognition system will be described in more detail with reference to FIG. 2.

As shown in FIG. 2, the display apparatus 100 includes an image receiving unit 110 receiving an image signal, an image processing unit 120 processing an image signal received from the image receiving unit 110, and an image processing unit 120. A display unit 130 that displays an image signal processed by the image as an image, a first voice acquisition unit 140 that receives a voice uttered by a user, and a first voice conversion unit that converts the input voice into an electrical voice signal ( 150), a first communication unit 160 for performing communication with an external device, a first storage unit 170 for storing various data, and a first control unit 180 for controlling the display apparatus 100.

The image receiving unit 110 receives an image signal and transmits it to the image processing unit 120, and may be implemented in various ways in accordance with a standard of the received image signal and an implementation form of the display apparatus 100. For example, the image receiving unit 110 wirelessly receives a radio frequency (RF) signal transmitted from a broadcasting station (not shown), or a composite video, component video, super video, SCART , HDMI (high definition multimedia interface) standard, etc. video signals can be received by wire. When the video signal is a broadcast signal, the video receiver 110 includes a tuner to tune the broadcast signal for each channel.

In addition, the image signal may be input from an external device, for example, the image signal may be input from an external device such as a PC, AV device, smart phone, smart pad, or the like. Also, the video signal may be derived from data received through a network such as the Internet. In this case, the display apparatus 100 may perform network communication through the first communication unit 160 or may further include a separate network communication unit. Further, the image signal may be derived from data stored in the nonvolatile first storage unit 170 such as a flash memory or a hard disk. The first storage unit 170 may be provided inside or outside the display apparatus 100, and when provided outside may further include a connection unit (not shown) to which the first storage unit 170 is connected.

The image processing unit 120 performs various preset image processing processes on an image signal. The image processing unit 120 outputs an image signal that has performed such a process to the display unit 130 so that an image is displayed on the display unit 130.

The type of image processing process performed by the image processing unit 120 is not limited, for example, decoding, de-interlacing, frame refresh rate conversion, and scaling corresponding to various image formats. (scaling), noise reduction for image quality improvement, detail enhancement, line scanning, etc. may be included. The image processing unit 120 may be implemented as a group of individual configurations capable of independently performing each of these processes, or may be implemented as a system-on-chip (SoC) in which several functions are integrated.

The display unit 130 displays an image based on an image signal processed by the image processing unit 120. The implementation method of the display unit 130 is not limited, for example, a liquid crystal, plasma, light-emitting diode, organic light-emitting diode, and surface conduction electron gun. -conduction electron-emitter), carbon nano-tubes, nano-crystals, and the like.

The display unit 130 may additionally include an additional component according to the implementation method. For example, when the display unit 130 is a liquid crystal type, the display unit 130 drives a liquid crystal display panel (not shown), a backlight unit (not shown) supplying light thereto, and a panel (not shown). It includes a panel driving substrate (not shown).

The display unit 130 of the present invention may display a speech recognition result as information on the recognized speech. Here, the speech recognition result can be displayed in various forms such as text, graphics, and icons, and the text includes letters and numbers. The display unit 130 according to the present exemplary embodiment may further display candidate commands and application information according to the voice recognition result. This will be described in more detail in FIG. 4 to be described later.

The user can check whether the speech is correctly recognized by the speech recognition result displayed on the display unit 130, and select a command corresponding to the speech uttered by the user from among the displayed candidate commands by manipulating the user input unit 390 provided on the remote control. Alternatively, you can select and check information related to the speech recognition result.

The first voice acquisition unit 140 receives a voice uttered by a user, and may be implemented as a microphone.

The first voice conversion unit 150 converts the voice input from the first voice acquisition unit 140 into an electric voice signal. The converted voice signal has a PCM (pulse code modulation) state or a compressed form of an audio waveform. Here, the first voice conversion unit 150 may be implemented as an A/D conversion unit that converts a user's input voice into digital.

On the other hand, when the first audio acquisition unit 140 is a digital microphone, since separate A/D conversion is not required, the first audio acquisition unit 140 may include the first audio conversion unit 150 .

The first communication unit 160 communicates with a voice acquisition device and an external device, that is, the mobile phone 200, the remote control 300, and the air conditioner 400 of FIG. 2. The first communication unit 160 of the present embodiment may perform wireless communication, and the wireless communication includes at least one of infrared communication, RF, ZigBee, and Bluetooth.

The first storage unit 170 stores unrestricted data according to the control of the first control unit 180. The first storage unit 170 is implemented as a nonvolatile storage medium such as a flash-memory and a hard-disc drive. The first storage unit 170 is accessed by the first control unit 180, and data read/write/edit/delete/update, etc. are performed by the first control unit 180.

The data stored in the first storage unit 170 includes, for example, an operating system for driving the display device 100, various applications, image data, and additional data that can be executed on the operating system.

In the first storage unit 170 of the present embodiment, various types of data for recognizing a voice spoken by a user may be stored. For example, the first storage unit 170 may store a command table 171 including candidate commands (hereinafter, also referred to as command candidate groups) as voice recognition target information corresponding to the received voice signal. In the command table 171, candidate commands may be managed for each application.

In the first storage unit 170 of the present embodiment, one or more applications for performing functions of the display apparatus 100, for example, applications 1 and 2 (172, 173) are further stored. Applications 1 and 2 (172, 173) are driven under the control of the first control unit 180 to be described later, and perform various functions of the display apparatus 100. In FIG. 2, a case in which two applications 172 and 173 are embedded in the display device 100 is illustrated as an example. However, functions performed by the display device 100 are various, and the display device 100 of the present invention includes 3 More than one application can be embedded.

Applications 1 and 2 (172, 173) manage candidate commands corresponding to functions to be performed, respectively. Candidate commands managed by applications 1 and 2 (172, 173) may be registered/deleted in the command table 171 as needed.

When the candidate commands of the first and/or second applications 172 and 173 are registered in the command table 171, the voice recognition engine 181 performs voice recognition using the candidate commands registered in the command table 171 Is done.

Candidate commands that can be registered/deleted in the command table 171 of this embodiment further include candidate commands managed by application 3 372 of the remote control 300 and applications managed by application 4 472 of the air conditioner 400 to be described later. Can include.

The first controller 180 performs a control operation on various components of the display apparatus 100. For example, the first control unit 180 performs an image processing process processed by the image processing unit 120 and a control operation corresponding to a command from the remote control 300 to control the entire operation of the display apparatus 100. Control.

The first control unit 180 may be implemented in a form in which software is combined with a CPU, for example.

The first control unit 180 includes a voice recognition engine 181 for recognizing a voice spoken by a user. The voice recognition function of the voice recognition engine 181 may be performed using a known voice recognition algorithm. For example, the voice recognition engine 181 extracts a voice feature vector of a voice signal, compares the extracted voice feature vector with candidate commands stored in the instruction table 171 of the first storage unit 170 to obtain a voice. I can recognize it. In addition, when there is no command matching the extracted speech feature vector among the candidate commands stored in the command table 171, speech recognition may be recognized by correcting the speech recognition result with a command having a high similarity. Here, when there are a plurality of candidate commands having high similarity, the first control unit 180 may display the plurality of candidate commands on the display unit 130 and select any one by the user.

The speech recognition engine 181 of the present embodiment is described as an example implemented by the embedded speech recognition engine 181 residing in the CPU, but the present invention is not limited thereto. For example, the voice recognition engine 181 may be implemented as a device built into the display device 100 separate from the CPU, that is, a separate chip such as a microcomputer.

Meanwhile, the present invention includes a case in which the voice recognition engine 181 is provided in a server physically separated from the display device 100 (hereinafter, also referred to as a cloud server (not shown)). The cloud server communicates with the display device 100 through a network such as the Internet. Here, the network may be a wired or wireless network. In this case, the voice recognition engine 181 may be implemented as an embedded voice recognition engine residing in the CPU of the cloud server, or a device built in the cloud server separate from the CPU, that is, a separate chip such as a microcomputer. .

The first control unit 180 may perform an operation corresponding to the recognition result of the speech recognition engine 181. For example, when the display device 100 is a TV, when a user is watching a movie or news, when the voice recognition engine 181 recognizes a volume up, a volume down, or a volume up or down, the first control unit 180 may adjust the volume (volume) of the movie or news to correspond to this.

When the recognition result of the voice recognition engine 181 and the recognized voice is a voice controlling an external device such as the remote control 300 and the air conditioner 400, the first control unit 180 sends a control command corresponding to the recognized voice. The first communication unit 160 may be controlled to transmit to a corresponding external device. For example, when the voice recognition engine 181 recognizes an increase in temperature, the first controller 180 recognizes this as a voice for the air conditioner, and transmits a command to increase the temperature of the air conditioner to the air conditioner 400. The first communication unit 160 can be controlled.

Hereinafter, a specific configuration of the mobile phone 200 will be described.

As shown in Fig. 2, the mobile phone 200 is a voice acquisition device, a second voice acquisition unit 240 receiving a voice uttered by a user, and a second voice conversion unit converting the input voice into an electrical voice signal. 250, a second communication unit 260 for performing communication with the outside, a second storage unit 270 for storing unrestricted data, and a second control unit 280 for controlling the mobile phone 200.

The second voice acquisition unit 240 receives a voice uttered by a user, and may be implemented as a microphone. The second voice conversion unit 250 converts the voice input from the second voice acquisition unit 240 into an electric voice signal. The converted voice signal has a PCM (pulse code modulation) state or a compressed form of an audio waveform. Here, the first voice conversion unit 250 may be implemented as an A/D conversion unit that converts a user's input voice into digital.

On the other hand, when the second audio acquisition unit 240 is a digital microphone, since separate A/D conversion is not required, the second audio acquisition unit 240 may include a second audio conversion unit 240. .

The second communication unit 260 communicates with the display apparatus 100. The second communication unit 260 of the present embodiment performs wired or wireless communication, and the wireless communication includes at least one of RF, Zigbee, and Bluetooth.

The second communication unit 260 of the present embodiment transmits the voice signal transmitted from the second voice conversion unit 250 to the display apparatus 100.

The second storage unit 270 stores unrestricted data according to the control of the second control unit 280. The second storage unit 270 is implemented as a nonvolatile storage medium such as a flash-memory. The second storage unit 270 is accessed by the second control unit 280, and data read/write/modify/delete/update data by the second control unit 280 is performed.

Data stored in the second storage unit 270 includes, for example, an operating system for driving the mobile phone 200, various applications, image data, and additional data that can be executed on the operating system.

The second control unit 280 performs a control operation for various components of the mobile phone 200. For example, the second control unit 280 may generate a command corresponding to a user's manipulation, perform an operation corresponding to the generated command, and display the result on the display unit (not shown).

The second control unit 280 may be implemented in a form in which software is combined with, for example, a micro controller unit (MCU).

The second control unit 280 of this embodiment controls the second voice conversion unit 250 to convert the voice uttered by the user through the second voice acquisition unit 240 to convert it into an electrical voice signal, and The second communication unit 260 is controlled to transmit the generated voice signal to the display device 100.

Hereinafter, a specific configuration of the remote control 300 will be described.

As shown in FIG. 2, the remote control 300 is a voice acquisition device and an external device at the same time, a user input unit 330 receiving a user's manipulation, and a third voice acquisition unit 340 receiving a voice uttered by the user. , A third voice conversion unit 350 for converting the input voice into an electric voice signal, a third communication unit 360 for performing communication with the outside, a third storage unit 370 for storing unrestricted data, and a remote control It includes a third control unit 280 for controlling (300).

The user input unit 330 transmits various preset control commands or unrestricted information to the third control unit 380 according to a user's manipulation and input. The user input unit 330 may be implemented as a button including a menu key or a number key installed outside the remote control 300. When the remote control 300 is a TV remote control, the user input unit 330 may further include a touch sensing unit receiving a user's touch input and/or a motion sensing unit sensing motion of the remote control 300.

The third voice acquisition unit 340 receives a voice uttered by a user, and may be implemented as a microphone.

The third voice conversion unit 350 converts the voice input from the third voice acquisition unit 340 into an electric voice signal. The converted voice signal has a PCM (pulse code modulation) state or a compressed form of an audio waveform. Here, the third voice conversion unit 350 may be implemented as an A/D conversion unit that converts a user's input voice into digital.

On the other hand, when the third audio acquisition unit 340 is a digital microphone, since separate A/D conversion is not required, the third audio acquisition unit 340 may include a third audio conversion unit 350. .

The third communication unit 360 communicates with the display apparatus 100. The third communication unit 360 of this embodiment performs wireless communication, and the wireless communication includes at least one of infrared communication, RF, Zigbee, and Bluetooth.

The third communication unit 360 of the present embodiment transmits the voice signal transmitted from the third voice conversion unit 350 to the display device 100, and by the application 3 372 in the third storage unit 370 to be described later. The managed candidate command is transmitted to the display apparatus 100.

The third storage unit 370 stores unrestricted data according to the control of the third control unit 380. The third storage unit 370 is implemented as a nonvolatile storage medium such as a flash-memory. The third storage unit 370 is accessed by the third control unit 380, and data read/write/modify/delete/update data by the third control unit 380 is performed.

Data stored in the third storage unit 370 includes, for example, an operating system for driving the remote control 300, various applications, image data, and additional data that can be executed on the operating system.

In the third storage unit 370 of the present embodiment, one or more applications for performing functions of the remote control 300, for example, application 3 372, are further stored. The application 3 372 is driven under the control of the third controller 380 to be described later, and performs various functions of the remote control 300. In the present invention, application 3 372 and application 4 472 to be described later are referred to as external applications in order to distinguish them from the built-in applications 172 and 173 of the display apparatus 100.

In FIG. 2, a case in which one application 372 is provided in the remote control 300 is illustrated as an example, but the present invention also includes a case in which two or more applications are provided in the remote control 300.

Application 3 (372) manages the candidate command corresponding to the function to be performed. Candidate commands managed by the application 3 372 may be registered/deleted in the command table 171 of the display apparatus 100 as needed.

The third control unit 380 performs a control operation for various components of the remote control 300. For example, the third control unit 260 may control the third communication unit 360 to generate a command corresponding to a user's manipulation of the user input unit 330 and transmit the generated command to the display device 100. I can.

The third control unit 380 may be implemented in a form in which software is combined with, for example, a micro controller unit (MCU).

The third control unit 380 of this embodiment controls the third voice conversion unit 350 to convert the voice uttered by the user through the third voice acquisition unit 340 to convert it into an electrical voice signal, and The third communication unit 360 is controlled to transmit the generated voice signal to the display device 100.

The third controller 380 may transmit a candidate command managed by the application 3 372 of the third storage unit 370 to the display apparatus 100 while performing communication with the display apparatus 100. The transmitted candidate command is registered in the command table 171 of the display apparatus 100 and is used for the voice recognition operation of the voice recognition engine 181.

In addition, when a control command according to voice recognition is received from the display apparatus 100, the third control unit 380 may receive it through the third communication unit 360 and perform an operation corresponding to the received control command. have.

Hereinafter, a specific configuration of the air conditioner 400 will be described.

As shown in FIG. 2, the air conditioner 400 is an external device, and includes a fourth communication unit 340 that communicates with the outside, a fourth storage unit 470 that stores unrestricted data, and an air conditioner 400. It includes a fourth control unit 480 to control.

The fourth communication unit 460 communicates with the display apparatus 100. The fourth communication unit 460 of the present embodiment performs wireless communication, and the wireless communication includes at least one of RF, Zigbee, and Bluetooth.

The fourth communication unit 460 according to the present embodiment transmits a candidate command managed by the application 4 472 in the fourth storage unit 370 to be described later to the display apparatus 100.

The fourth storage unit 470 stores unrestricted data according to the control of the fourth control unit 480. The fourth storage unit 470 is implemented as a nonvolatile storage medium such as a flash-memory. The fourth storage unit 470 is accessed by the fourth control unit 480, and data read/write/modify/delete/update data by the fourth control unit 480 is performed.

Data stored in the fourth storage unit 470 includes, for example, an operating system for driving the mobile phone 200, various applications and additional data that can be executed on the operating system.

In the fourth storage unit 470 of the present embodiment, one or more applications (external applications) for performing functions of the air conditioner 300, for example, application 4 472, are further stored. Application 4 (472) is driven under the control of the fourth controller 480 to be described later, and performs various functions of the air conditioner (400).

In FIG. 2, a case in which one application 472 is provided in the air conditioner 400 is illustrated as an example, but the present invention also includes a case in which two or more applications are provided in the air conditioner 400.

Application 4 (472) manages the candidate command corresponding to the function to be performed. Candidate commands managed by the application 4 472 may be registered/deleted in the command table 171 of the display apparatus 100 as needed.

The fourth control unit 460 performs a control operation on various components of the air conditioner 400. For example, the fourth controller 260 may receive a control command corresponding to a user's manipulation of the air conditioner remote control, and perform a control operation according to the received control command, for example, temperature control.

The fourth control unit 460 may be implemented in a form in which software is combined with, for example, a micro controller unit (MCU).

The fourth control unit 460 of the present embodiment may transmit a candidate command managed by the application 4 472 of the fourth storage unit 470 to the display apparatus 100 while performing communication with the display apparatus 100. . The transmitted candidate command is registered in the command table 171 of the display apparatus 100 and is used for the voice recognition operation of the voice recognition engine 181.

In addition, when a control command according to voice recognition is received from the display apparatus 100, the fourth control unit 480 may receive the control command through the fourth communication unit 460 and perform an operation corresponding to the received control command. have.

According to the embodiment of FIG. 2, the first control unit 180 of the display device 100 as the main device of the voice recognition system of the present invention receives input voice from at least one of the plurality of voice acquisition units 140, 240, and 340. When detected, the first communication unit 140 is controlled to receive a voice signal from the voice acquisition unit in which the voice input is sensed. In addition, the first control unit 180 transmits a candidate command for recognizing the received voice signal through the first communication unit 140 at least one of the external applications 372 and 472 of the plurality of external devices 300 and 400 or embedded. Candidate commands received from the applications 172 and 173 and received are registered in the command table 171 of the first storage unit 170. The voice recognition engine 181 performs voice recognition by comparing a voice signal with a candidate command registered in the command table 171.

In this way, as the main device according to the present embodiment, the display apparatus 100 detects voices input from various devices capable of receiving a user's utterance, so that the utilization of various voice acquisition devices can be improved. In addition, since candidate commands for voice recognition are transmitted from the running application and used, candidate commands for voice recognition can be dynamically registered/deleted, thereby preventing unnecessary infinite increase of candidate commands provided by the main device. I can.

Meanwhile, the display apparatus 100 according to the present invention receives voice recognition from the voice acquisition unit 140 provided in the display apparatus 100, and internal applications 171, 172, 173 and external applications 372, 472 By receiving a candidate command from at least one of the voice recognition engine 181 may be implemented to perform voice recognition.

Hereinafter, an embodiment of performing speech recognition in the speech recognition system of the present invention will be described in more detail with reference to FIGS. 3 and 4.

3 is a diagram illustrating an example of performing voice recognition according to an embodiment of the present invention, and FIG. 4 is a diagram illustrating an example of a screen displayed as a result of voice recognition of FIG. 3.

As illustrated in FIG. 3, the display apparatus 100 may register candidate commands stored in the command table 171 from one or more applications (including built-in applications and external applications).

Specifically, referring to FIG. 3, commands A and B are transferred from application 1 172 (embedded application) to the command table 171 (501), and the transferred commands A and B are stored in the command table 171 Becomes (502). The voice recognition engine 181 registers commands A and B stored in the command table 171 as candidate commands (504).

In addition, commands C and D are transferred from the application 3 372 (external application) to the command table 171 (505), and the transferred commands C and D are registered in the command table 171 (507). The voice recognition engine 181 registers commands C and D stored in the command table 171 as candidate commands (508).

Accordingly, in the voice recognition engine 181, A, B, C, and D transmitted from the application 1 172 and the application 3 372 are registered as candidate commands.

In this way, while A, B, C, and D are registered as candidate commands, it is possible to detect that A is inputted by the second voice acquisition unit 240 separated from the display apparatus 100. The detected voice A is converted into a voice signal by the second voice conversion unit 250 and transmitted to the voice recognition engine 181 through the second and first communication units 260 and 160 (509).

The voice recognition engine 181 compares the voice signal for voice A with the registered candidate commands A, B, C, and D, determines a match or similar command, and recognizes the voice A (510).

The first control unit 180 may transmit the recognition result to the display unit 130 (511), and the display unit 130 may display a voice recognition result screen as shown in FIG. 4.

As shown in FIG. 4, the display unit 130 includes a voice recognition result A (60) and a UI indicating candidate commands A, B, C, D (61, 62, 63, 64) according to the voice recognition result. Can be displayed. In addition, a UI indicating application information (application 1) 65 for managing the command A according to the voice recognition result may be further displayed on the display unit 130.

The user can check not only the voice recognition result but also the candidate command through the UI displayed on the screen as shown in FIG. 4, and when the voice recognition result does not match the speech intention, one of the candidate commands can be selected. In addition, it is possible to obtain device information related to the voice recognition result through application information.

The first control unit 180 transmits a control command according to the voice recognition result as shown in FIG. 4 to the application 1 172 (512). The application 1 172 performs a control operation according to the recognized voice A under the control of the first controller 180. For example, when the voice A is turned down, the volume of the display apparatus 100 is adjusted to be small.

As described in FIGS. 3 and 4, the display apparatus 100 of the present invention pre-registers commands (eg, A, B, C, D) of some applications as candidates according to a preset condition, and When a speech utterance is detected, the speech can be recognized using a candidate command registered in advance, the result is displayed, and a corresponding control operation can be executed.

In the embodiments of FIGS. 3 and 4, a case where the commands of the application 1 172 and the application 3 372 are registered as candidate commands and the user's voice is input through the second voice acquisition unit 240 has been described as an example. , In the present invention, it is possible to dynamically register/delete a candidate command by receiving commands from various built-in and external applications, and it goes without saying that all cases of receiving voices from various voice acquisition units are included.

Hereinafter, with reference to FIG. 5, another embodiment of performing voice recognition in the voice recognition system of the present invention will be described in more detail.

5 is a diagram illustrating an example of performing voice recognition according to another embodiment of the present invention.

As illustrated in FIG. 5, the third voice acquisition unit 340 separated from the display apparatus 100 may detect that E is input as a voice. The detected voice E is converted into a voice signal by the third voice conversion unit 350 and transmitted to the voice recognition engine 181 through the third and first communication units 360 and 160 (701).

The display apparatus 100 may register a candidate command stored in the command table 171 from the application 3 372 corresponding to the device in which the voice input is sensed. Specifically, referring to FIG. 5, instructions E and F are transferred from the application 3 372 to the instruction table 171 (702), and the transferred instructions E and F are stored in the instruction table 171 (703). . The voice recognition engine 181 registers the commands E and F stored in the command table 171 as candidate commands (705).

Accordingly, E and F transmitted from the application 3 372 are registered as candidate commands in the voice recognition engine 181.

In the state where E and F are registered as candidate commands, the voice recognition engine 181 compares the voice signal for the E voice with the registered candidate commands E and F and determines a match or similar command to recognize the E voice. (706).

The first control unit 180 may transmit the recognition result to the display unit 130 (707), and a voice recognition result screen may be displayed on the display unit 130.

The first control unit 180 transmits a control command according to the voice recognition result to the application 3 372 (708). The application 3 372 performs a control operation according to the recognized voice E under the control of the third controller 380. Here, when the control command according to the voice recognition result is a command for controlling the display apparatus 100, the control command may be transmitted to the application 1 172 or the application 2 173.

As described in FIG. 5, when a user's voice utterance is detected, the display apparatus 100 of the present invention registers an application command (eg, E, F) corresponding to the voice input device as a candidate command. , By using the registered candidate command, speech can be recognized, the result is displayed, and a corresponding control operation can be executed. Candidate commands can be registered/deleted dynamically.

In the embodiment of FIG. 5, a case where a user's voice is input through the third voice acquisition unit 340 and the command of the application 3 372 is registered as a candidate command is described as an example. It goes without saying that voice can be input, and it includes all cases of dynamically registering/deleting candidate commands by receiving commands from various built-in and external applications.

Hereinafter, a voice recognition method of the voice recognition system according to the present embodiment will be described with reference to the drawings.

6 is a flowchart illustrating a method of recognizing a voice in a voice recognition system according to an embodiment of the present invention.

As shown in FIG. 6, the voice recognition system of the present invention may detect a voice input from at least one of a plurality of voice acquisition units 140, 240, and 340 (S810). Here, the detected user voice is converted into an electric voice signal by the corresponding voice conversion unit 150, 250, and 350.

The first controller 180 receives the voice signal detected and converted in step S810 (S820). Here, when a voice input is detected by the external voice acquisition units 240 and 340, a voice signal may be received through the first communication unit 160.

A candidate command for voice recognition of the voice signal received in step S820 is registered in the voice recognition engine 181 (S830). Here, the registered candidate command may be previously stored in the command table 171 or may be received from the built-in or external applications 172, 173, 372, 472 and dynamically stored in the command table 171.

The voice recognition engine 181 recognizes the voice spoken by the user in step S810 by using the candidate command registered in step S830 (S840).

The first control unit 180 displays the voice recognition result of step S840 on the display unit 130. Here, the display unit 130 may display a voice recognition result for a voice signal, a candidate command according to the voice recognition result, application information, and the like.

The first control unit 180 generates a control command according to the result of voice recognition in step S840 and transmits the control command to an application capable of performing it (S860). Accordingly, an operation according to the generated control command may be performed.

7 is a detailed flowchart illustrating a process of detecting the voice input of FIG. 6.

As shown in FIG. 7, the display apparatus 100, which is a main device, may operate in a voice input mode in which user input by voice is possible (S811). The voice input mode in the present invention is operated to enable voice input from various voice acquisition units 140, 240, and 340.

As one of the methods of detecting the voice input, the first controller 180 may detect the utterance of the wakeup keyword from any one of the plurality of voice acquisition units 140, 240, and 340 (S812). Here, the wakeup keyword activates a voice input through a specific voice acquisition unit, and may be preset. For example, the first voice acquisition unit 140 of the display apparatus 100 may set a voice related to TV control, such as a channel and a volume, as a wakeup keyword, and the second voice acquisition unit 240 of the mobile phone 200 ) Can set voice related to calls, contacts, etc. as wakeup keywords.

On the other hand, as another method of detecting a voice input, when a trigger signal according to an operation of a predetermined button (voice input button) is input from any one of the plurality of voice acquisition units 140, 240, 340 , It is possible to detect a voice input from the corresponding voice acquisition unit (S813). For example, when a user operates a voice input button provided in a specific voice acquisition device, it is sensed that voice is input from a voice input unit provided in the device.

The first control unit 180 activates any one of the plurality of voice acquisition units 140, 240, and 340 corresponding to the voice input according to the detection results of steps S812 and S813 (S812). By activating any one of the voice acquisition units, it is possible to prevent unnecessary voices from being detected and causing confusion.

Then, a voice signal is received from the voice acquisition unit activated in step S820 to the voice recognition engine 181, so that voice recognition can be performed.

8 is a detailed flowchart illustrating a process of performing voice recognition of FIG. 6.

As shown in FIG. 8, as in step S830 of FIG. 6, the voice recognition engine 181 may receive and register a candidate command from one or more predetermined applications among a plurality of applications 172, 372, and 472.

The voice recognition engine 181 may determine whether the candidate command registered in step S830 matches/similar to the voice signal received in step S820 of FIG. 6 (S841).

As a result of the determination of step S840, if there is a match/similar candidate command, the voice recognition engine 181 determines the match/similar command to perform speech recognition, and the first control unit 180 displays the result to the display unit 130 Will be marked on.

As a result of the determination in step S840, if there is no match/similar candidate command, the voice recognition engine 181 may determine whether to receive and register a candidate command for an application different from the application in step S830 (S842). Here, the first control unit 180 may receive and register candidate commands of other applications according to a user's selection or pre-input settings, and sequentially receive and register candidate commands of a plurality of applications according to a preset order. Do. Further, in consideration of the capacity of the first storage unit 170 of the display apparatus 100, previously registered candidate commands may be selectively deleted.

If there is no match/similar candidate command among the candidate commands registered in step S842, steps S842 and 841 are sequentially repeated to perform speech recognition.

On the other hand, if it is determined not to receive and register candidate commands of other applications in step S842, the voice recognition engine 181 stops voice recognition, and the first control unit 180 causes a voice recognition failure as a result of the display unit 130 ) Can be displayed.

As described above, according to an exemplary embodiment of the present invention, since the main device senses voice input from various devices capable of receiving a user's utterance, it is possible to increase the utilization of various voice acquisition devices and provide a linked service using the same.

In addition, since candidate commands for voice recognition are received from a plurality of applications and used, candidate commands for voice recognition can be dynamically registered/deleted, thereby preventing unnecessary increase of candidate commands provided by the main device, It can flexibly cope with problems such as delay in processing speed or decrease in recognition rate, and can increase the efficiency of the entire speech recognition system.

In addition, it is possible to enhance user convenience by allowing a user to easily recognize not only voice recognition results, candidate commands, application information, but also information of various voice acquisition equipment and candidate command providing equipment used for voice recognition.

As described above, the present invention has been described in detail through preferred embodiments, but the present invention is not limited thereto and may be variously implemented within the scope of the claims.

100: main device, display device 110: image receiving unit
120: image processing unit 130: display unit
140: first voice acquisition unit 150: first voice conversion unit
160: first communication unit 170: first storage unit
171: instruction table 172, 173: application
180: first control unit 161: voice recognition engine
201, 202: voice acquisition device 200: mobile phone
240: second audio acquisition unit 250: second audio conversion unit
260: second communication unit 270: second storage unit
280: second control unit 301, 302, 303: external device
300: remote control 330: user input unit
340: third audio acquisition unit 350: second audio conversion unit
360: third communication unit 370: third storage unit
371: application 380: third control unit
400: air conditioner 460: fourth communication department
470: fourth storage unit 472: application
180: fourth control unit

Claims (20)

In the display device,
A display unit that displays an image;
A communication unit for performing communication with a plurality of external devices;
A storage unit for storing data;
Acquire instructions corresponding to at least one identified application,
Controlling the storage to store the acquired instructions,
In the voice recognition engine, among the commands stored in the storage unit, commands received from a running application are registered as candidate commands,
On the basis of receiving the wake-up keyword for any one of the plurality of voice acquisition units, activation of the reception of a voice signal from the voice acquisition unit receiving the wake-up keyword among the plurality of voice acquisition units,
Inactivating reception of the voice signal from the voice acquisition unit other than the voice acquisition unit receiving the wakeup keyword,
Identifying a command corresponding to the voice signal from among the candidate commands registered in the voice recognition engine, based on the voice signal received from the voice acquisition unit in which reception of the voice signal is activated,
Identify an application for executing the identified command corresponding to the voice signal,
And a control unit for controlling the identified application to execute the identified command,
The controller dynamically registers or deletes the candidate command from the voice recognition engine in response to the running application. The method of claim 1,
The voice acquisition unit includes at least one of a built-in microphone provided in the display device, a first external microphone provided in at least one of the plurality of external devices, and a second external microphone separated from the display device and the plurality of external devices. A display device, characterized in that. The method of claim 1,
Wherein the external device includes at least one application, and the candidate command is managed by the application. The method of claim 3,
And a built-in application provided in the display device and managing the candidate command. The method of claim 1,
The control unit,
And receiving the candidate command from an external device corresponding to the running application among the plurality of external devices. The method of claim 1,
The control unit,
When it is detected that the wakeup keyword for any one of the plurality of voice acquisition units is uttered, the voice acquisition unit corresponding to the detected wakeup keyword is identified. The method of claim 1,
The control unit,
When a trigger signal according to the operation of a predetermined button provided in any one of the plurality of voice acquisition units is input, a voice acquisition unit corresponding to the input trigger signal is activated, and the voice from the activated voice acquisition unit A display device, characterized in that receiving a signal. The method according to any one of claims 1 to 7,
And the control unit controls the display unit to display a speech recognition result for the speech signal and a candidate command according to the speech recognition result. The method of claim 8,
And the display unit further displays application information for managing the candidate command. The method according to any one of claims 1 to 7,
And the voice recognition engine identifies a command corresponding to the received voice signal by determining a command that matches or is similar to the received voice signal among commands registered as the candidate commands. The method of claim 1,
The control unit, among the commands registered as the candidate commands in the speech recognition engine, identifies whether there is a command that matches or is similar to the received voice signal,
If present, the speech recognition engine performs speech recognition by determining the matching or similar command,
If not present, the display apparatus characterized in that receiving and registering a command of an application different from the running application. In the voice recognition method of the display device,
Obtaining instructions corresponding to at least one identified application;
Storing the obtained instructions;
Registering commands received from a running application among the stored commands as candidate commands in a voice recognition engine;
Activating reception of a voice signal from a voice acquisition unit that has received the wakeup keyword from among the plurality of voice acquisition units based on receiving a wakeup keyword for any one of the plurality of voice acquisition units Wow;
Deactivating reception of the voice signal from the voice acquisition unit other than the voice acquisition unit receiving the wakeup keyword;
Identifying a command corresponding to the received voice signal from among the registered commands in the voice recognition engine based on the voice signal received from the voice acquisition unit in which reception of the voice signal is activated;
Identifying an application for executing the identified command corresponding to the received voice signal;
And controlling the identified application to execute the identified command,
The registering of the candidate command as the candidate command includes the step of dynamically registering or deleting the candidate command from the speech recognition engine in response to the running application. The method of claim 12,
The voice acquisition unit includes at least one of a built-in microphone provided in the display device, a first external microphone provided in at least one of a plurality of external devices, and a second external microphone separated from the display device and the plurality of external devices. Voice recognition method of a display device, characterized in that. The method of claim 12,
The voice recognition method of a display device, wherein the candidate command is managed by an application included in an external device. The method of claim 14,
And managing the candidate command, and further comprising a built-in application provided in the display device. The method of claim 12,
The step of registering as the candidate command,
Receiving the candidate command from an external device corresponding to the running application among a plurality of external devices. The method of claim 12,
The step of activating reception of a voice signal from a voice acquisition unit receiving the wake-up keyword among the plurality of voice acquisition units,
Detecting that a wake-up keyword for any one of the plurality of voice acquisition units is spoken;
And identifying a voice acquisition unit corresponding to the detected wakeup keyword. The method of claim 12,
The step of activating reception of a voice signal from a voice acquisition unit receiving the wake-up keyword among the plurality of voice acquisition units,
Sensing that a trigger signal is input according to an operation of a predetermined button provided in one of the plurality of voice acquisition units;
And activating a voice acquisition unit corresponding to the input trigger signal. The method according to any one of claims 12 to 18,
And displaying a voice recognition result for the voice signal and a candidate command according to the voice recognition result. The method according to any one of claims 11 to 17,
The step of identifying a command corresponding to the received voice signal,
And identifying a command corresponding to the received voice signal by determining a command that matches or is similar to the received voice signal among commands registered as the candidate commands.

Images