KR20190016814A - Display apparatus, Display system and Method for controlling display apparatus - Google Patents

Abstract

According to one embodiment of the present invention, a display system comprises: a display displaying an image; a microphone recognizing voice; and a control unit determining whether at least one predetermined activation condition is satisfied, controlling a predetermined voice recognition mode for outputting a predetermined question to a user to be activated when the activation condition is satisfied, and controlling a display apparatus based on voice information recognized by the microphone in the predetermined voice recognition mode. According to one embodiment of the present invention, a control method of the display apparatus comprises: a condition determination step of determining whether the predetermined activation condition is satisfied; an activation step of outputting the predetermined question to the user and activating the predetermined voice recognition mode when the activation condition is satisfied in the condition determination step; and a control step of controlling the display apparatus based on the voice information recognized in the activation step.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a display apparatus, a display system,

The present invention relates to a display device, a display system, and a control method of a display device using speech recognition.

The display device is a device having a function of displaying an image that the user can view. The user can view the broadcast through the display device. The display device displays the broadcast selected by the user among broadcast signals transmitted from the broadcast station on the display.

The display device includes various components including a display for outputting images and an audio output for outputting sound. The display device includes an input unit such as a button for inputting a user's instruction.

A remote control device is known which receives a user's instruction and remotely transmits a signal to a display device.

Further, there is known a technique in which a microphone for recognizing a user's voice command is provided, and the display device is controlled in accordance with the recognized voice command.

A first object of the present invention is to improve control convenience of a display device or a display system of a user.

If the user is provided with various types of voice instructions at any time without a predetermined voice recognition mode, the display device can be used even if the user does not intend (for example, when the user speaks via another person or a telephone) The display device may be unintentionally controlled. A second object of the present invention is to solve such a problem.

In order to solve the second problem, if the display device is controlled by recognizing the user's voice information only when there is an input of the user for starting the voice command, There is an inconvenience that the input of " A third object of the present invention is to solve such a disadvantage while solving the second problem.

A fourth object of the present invention is to lower the possibility of false recognition of a voice command and raise the accuracy of voice recognition.

A fifth object of the present invention is to provide a smart device that automatically determines when a user is likely to input an input.

A sixth object of the present invention is to minimize the product unit cost while achieving the above problems.

According to an aspect of the present invention, there is provided a display device including: a display for displaying an image; A microphone for recognizing voice; And to activate a predetermined voice recognition mode for outputting a predetermined question to the user if the activation condition is satisfied, and to control the microphone And a control unit for controlling the display device based on the voice information recognized by the user.

According to an aspect of the present invention, there is provided a display system including: a display for displaying an image; A microphone for recognizing voice; And to activate a predetermined voice recognition mode for outputting a predetermined question to the user if the activation condition is satisfied, and to control the microphone And a control unit for controlling the display device based on the voice information recognized by the user.

The activation condition may be pre-set regardless of the user's voice input request.

The control unit may control to activate a predetermined preparation mode for recognizing a voice command if there is an input of a user for starting a voice command. The speech recognition mode and the preparation mode may be different from each other.

The active condition may be preset to a condition independent of the user's input for starting a voice command.

The control unit may match the voice information recognized in the voice recognition mode with the answer information of the predetermined answer group and may control the display device based on the matched answer information.

The at least one predetermined activation condition may comprise a plurality of different activation conditions. The control unit may control to activate different predetermined voice recognition modes depending on which one of the plurality of activation conditions is satisfied.

The control unit may control to output different predetermined questions in the different predetermined speech recognition modes.

The control unit may match the recognized voice information with answer information among a plurality of different answer groups in the different predetermined voice recognition modes.

And a remote control device for remotely controlling the display device. The microphone may be disposed in the remote control device. The display and the control unit may be disposed in the display device.

According to another aspect of the present invention, there is provided a method of controlling a display device, the method comprising: determining a condition of a predetermined activation condition; An activation step of outputting a predetermined question to the user and activating a predetermined voice recognition mode when the activation condition is satisfied in the condition determination step; And a control step of controlling the display device based on the voice information recognized in the activation step.

Through the above-mentioned solution, convenience of voice instruction to the display device of the user can be improved.

By controlling whether or not the predetermined voice recognition mode is activated, it is possible to reduce the possibility of error that is controlled after the display device is misunderstood to recognize the voice even though the user does not intend to give an instruction to the display device.

By outputting the predetermined question in the predetermined speech recognition mode, the user's answer can be relatively restricted, and the accuracy of speech recognition can be improved by recognizing the user's speech information in a limited range.

The active condition is set in advance regardless of the user's voice input request or the user's input for starting the voice command so that the user does not need a separate preceding operation to start a voice command and saves the user's time .

In addition, if the user has a procedure for voice command, the user's agility is required, and the frequency with which the user uses the voice command function is relatively reduced. The display system first inquires the user so that the user manually answers the voice, This increases the frequency with which the user uses the voice command function, and gives the device a smart image.

By limiting the recognized voice information to the predetermined answer group, the probability that the voice information is correctly recognized as intended by the user can be increased.

By providing the plurality of activation conditions, different voice recognition modes can be activated according to various situations, and the accuracy of speech recognition in consideration of various situations can be enhanced.

By arranging the microphone in the remote control device and arranging the control device in the display device, it is possible to reduce the increase in the volume of the remote control device while recognizing the voice through the remote control device which is relatively close to the user have.

1 is a conceptual diagram showing a display system 1 and a user's voice S according to an embodiment of the present invention.
2 is a conceptual diagram showing a display system 1 and a user's voice S according to another embodiment of the present invention.
Figs. 3 and 4 are control block diagrams of the display device 100 and the remote control device 200 of Figs. 1 and 2. Fig. 3 is a diagram illustrating a control block diagram of the display apparatus 100, and FIG. 4 is a diagram illustrating a control block diagram of the remote control apparatus 200. Referring to FIG.
5A and 5B are flow charts showing a control method according to the first embodiment of the display apparatus 100. FIG. Fig. 5A shows a control method of the display device 100 of Fig. 1, and Fig. 5B shows a control method of the display device 100 of Fig.
6 is a flow chart showing a control method according to the second embodiment of the display apparatus 100. As shown in FIG.
7 is a flow chart showing a control method according to the third embodiment of the display device 100. As shown in FIG.
8 is a flow chart showing a control method according to the fourth embodiment of the display device 100. As shown in FIG.
Figures 9A-9H are drawings that are referenced to illustrate examples of predetermined activation conditions, a predetermined question, and a user's voice response. Figures 9A-9H illustrate respective exemplary situations.

The term "first, second, third, or the like" preceding the term of the components mentioned below is intended only to avoid confusion of the referred components, and it is to be understood that the order, It is irrelevant to the mainstream relationship. For example, an invention including only the second component without the first component is also feasible.

1 and 2, the display device 100 includes a display 180 for displaying an image. The display 180 may display an input image. The display 180 can display an image of a plurality of viewpoints to be described later according to an embodiment of the present invention. More specifically, the display 180 may display subpixels constituting a plurality of view-point images arranged in a predetermined pattern.

The display device 100 may include a display 180 and a lens unit 195 for 3D image display. The lens unit 195 may be spaced apart from the display 180 at regular intervals and arranged in the viewer direction.

The lens unit 195 may be configured to vary the traveling direction of the light according to an applied power source. For example, when a plurality of viewers watch 2D images, the first power is applied to the lens unit 195, and light can be emitted in the same direction as the light emitted from the display 180. [ Accordingly, the display apparatus 100 can provide a 2D image to a plurality of viewers.

On the other hand, when a plurality of viewers watch the 3D image, the second power is applied to the lens unit 195, and the light emitted from the display 180 is scattered, To provide a 3D image.

On the other hand, the lens unit 195 can be a lenticular system using a lenticular lens, a parallax system using a slit array, a system using a microlens array, or the like Do.

The display device 100 includes a signal receiving unit 110 that transmits and receives a signal R to and from the remote control device 200. [ The signal receiving unit 110 transmits and receives the signal R to and from the signal transmitting unit 210 of the remote control device 200. The signal receiving unit 110 may receive the signal R of the remote control device 200. [ The signal receiving unit 110 may transmit the signal R to the remote control device 200. [ The remote signal R may be, but is not necessarily limited to, an infrared signal.

Referring to Figs. 1 and 2, the remote control device 200 remotely controls the display device 100. Fig. The remote control apparatus 200 includes an input unit (not shown) such as a button for inputting an instruction by the user. The remote controller 200 includes a signal transmitter 210 that transmits and receives a signal R to and from the display device 100. The remote control apparatus 200 can transmit the control signal R to the display apparatus 100 through the signal transmitting unit 210 based on the input information of the input unit. The signal transmitting unit 210 may receive the signal R from the signal receiving unit 110 of the display device 100.

Referring to Figs. 1 and 2, the display system 1 includes at least a display device 100. Fig. The display system 1 may further include a remote control device 200. In addition, the display system 1 may include a separate server that performs a function of the control unit Co1 in addition to the display apparatus 100. [ That is, the display system 1 may refer only to the display device 100 and may refer to a system including the display device 100 and the remote control device 200, May refer to a system that includes a server.

The display system 1 includes a display 180 for displaying an image. The display system 1 includes a microphone M for recognizing a voice. The display system 1 includes a control unit for controlling the display device 100. [ The display 180 is disposed in the display device 100. The control unit for controlling the display device 100 may be disposed in the display device 100. [

The display device 100 may be a digital broadcasting receiver capable of receiving fixed or mobile digital broadcasting. The display device 100 may include a TV receiver, a monitor, a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (personal digital assistant), a portable multimedia player (PMP) .

In the display system 1 according to the embodiment referring to Fig. 1, the microphone M is disposed in the display device 100. Fig. The user's voice S can be sensed through the microphone Ml of the display device 100. [ The control unit can control the display device 100 based on the voice information recognized through the microphone Ml.

In the display system 1 according to another embodiment referring to Fig. 2, the microphone M is disposed in the remote control device 200. Fig. The user's voice S can be sensed through the microphone M2 of the remote control device 200. [ The control unit can control the display device 100 based on the voice information recognized through the microphone M2. The remote control device 200 transmits the voice information sensed by the microphone M2 to the display device 100 through the signal transmitter 210. [ The display apparatus 100 may perform a predetermined operation based on the audio information transmitted through the signal receiving unit 110. [

Although not shown, the display system 1 may include both a microphone M1 disposed on the display device 100 and a microphone M2 disposed on the remote control device 200. [

3, a display device 100 according to an exemplary embodiment of the present invention includes a signal receiving unit 110, a broadcast receiving unit 120, an external device interface unit 130, a storage unit 140, a camera 190, A control unit Co1, a display 180, an audio output unit 185, a power supply unit 192, a lens unit 195, and a microphone Ml.

The broadcast receiving unit 120 may include a tuner unit 121 and a demodulating unit 123. The broadcast receiving unit 120 may include a network interface unit 135. The broadcast receiving unit 120 may be configured to include the tuner unit 121 and the demodulating unit 123 so as not to include the network interface unit 135. Conversely, The tuner 121 and the demodulating unit 123 are not included.

The tuner unit 121 selects a channel selected by the user or an RF broadcast signal corresponding to all previously stored channels among RF (Radio Frequency) broadcast signals received through the antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner unit 121 can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner unit 121 can be directly input to the control unit Co1.

In addition, the tuner unit 121 can receive RF carrier signals of a single carrier according to an Advanced Television System Committee (ATSC) scheme or RF carriers of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

Meanwhile, the tuner unit 121 sequentially selects RF broadcast signals of all broadcast channels stored through the channel memory function among the RF broadcast signals received through the antenna in the present invention, and sequentially selects RF broadcast signals of the intermediate frequency signal, the baseband image, . ≪ / RTI >

On the other hand, the tuner section 121 can be provided with a plurality of tuners in order to receive broadcast signals of a plurality of channels. Alternatively, a single tuner that simultaneously receives broadcast signals of a plurality of channels is also possible.

The demodulator 123 receives the digital IF signal DIF converted by the tuner 121 and performs a demodulation operation.

The demodulation unit 123 may demodulate and decode the channel and output the stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed.

The stream signal output from the demodulation unit 123 may be input to the control unit Co1. The control unit Co1 performs demultiplexing, video / audio signal processing, and the like, and then outputs an image to the display 180 and outputs audio to the audio output unit 185. [

The external device interface unit 130 can transmit or receive data with the connected external device (not shown). To this end, the external device interface unit 130 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 130 can be connected to an external device such as a DVD (Digital Versatile Disk), a Blu ray, a game device, a camera, a camcorder, a computer , And may perform an input / output operation with an external device.

The A / V input / output unit can receive video and audio signals from an external device. Meanwhile, the wireless communication unit can perform short-range wireless communication with other electronic devices.

The network interface unit 135 provides an interface for connecting the display device 100 to a wired / wireless network including the Internet network. For example, the network interface unit 135 can receive, via the network, content or data provided by the Internet or a content provider or a network operator.

The storage unit 140 may store a program for each signal processing and control in the control unit Co1 or may store a signal-processed video, audio, or data signal.

In addition, the storage unit 140 may perform a function for temporarily storing video, audio, or data signals input to the external device interface unit 130. [ In addition, the storage unit 140 may store information on a predetermined broadcast channel through a channel memory function such as a channel map.

Although the storage unit 140 of FIG. 3 is separately provided from the control unit Co1, the scope of the present invention is not limited thereto. The storage unit 140 may be included in the control unit Co1.

The signal receiving unit 110 receives the signal R from the remote control device 200 and transmits it to the control unit Co1. The signal receiving unit 110 transmits the signal R from the control unit Co1 to the remote control device 200. [ The signal receiving unit 110 can transmit / receive a user input signal such as power on / off, channel selection, screen setting, etc. from the remote control device 200. The signal receiving unit 110 may transmit a signal to the remote control device 200 to activate a predetermined voice recognition mode to be described later. The signal receiving unit 110 may receive a signal for the voice information sensed by the remote control device 200. [

4 display device 100 may further include a local key (not shown) such as a power key, a channel key, a volume key, and a set value. The user input signal input from the local key is transmitted to the controller Co1.

The user input signal input from the sensor unit sensing the user's gesture may be transmitted to the control unit Co1. A signal from the control unit Co1 may be transmitted to the sensor unit.

The control unit Co1 demultiplexes the input stream or processes the demultiplexed signals through the tuner unit 121 or the demodulating unit 123 or the external device interface unit 130 so as to output the video or audio output Signals can be generated and output.

The video signal processed by the control unit Co1 is input to the display 180 and can be displayed as an image corresponding to the video signal. The image signal processed by the control unit Co1 may be input to the external output device through the external device interface unit 130. [

The audio signal processed by the control unit Co1 may be output to the audio output unit 185 as an audio signal. The voice signal processed by the control unit Co1 may be input to the external output device through the external device interface unit 130. [

Although not shown, the control unit Co1 may include a demultiplexing unit, an image processing unit, and the like.

The control unit Co1 can control the overall operation in the display device 100. [ For example, the control unit Co1 controls the tuner unit 121 to control the tuning of the RF broadcast corresponding to the channel selected by the user or the previously stored channel.

Also, the control unit Co1 can control the display device 100 according to a user command or an internal program input through the signal receiving unit 110. [

On the other hand, the control unit Co1 can control the display 180 to display an image. At this time, the image displayed on the display 180 may be a still image or a moving image, and may be a 3D image.

On the other hand, the control unit Co1 may generate a 3D object for a predetermined object among the images displayed on the display 180, and display the 3D object. For example, the object may be at least one of a connected web screen (newspaper, magazine, etc.), EPG (Electronic Program Guide), various menus, widgets, icons, still images, moving images, and text.

The control unit Co1 can recognize the position of the user based on the image photographed by the camera 190. [ For example, the distance (z-axis coordinate) between the user and the display device 100 can be grasped. In addition, the x-axis coordinate and the y-axis coordinate in the display 180 corresponding to the user position can be grasped.

The control unit Co1 can control the operation of the lens unit 195. [ For example, when the 2D image is displayed, the control unit Co1 controls the first power source to be applied to the lens unit 195, and when the 3D image is displayed, the second power source is applied to the lens unit 195 . Accordingly, in the 2D image display, light can be emitted in the same direction as the light emitted from the display 180 through the lens unit 195, and can be emitted through the lens unit 195, 180 may be scattered. .

Although not shown in the drawing, a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal may be further provided. The channel browsing processing unit receives a stream signal TS output from the demodulating unit 123 or a stream signal output from the external device interface unit 130 and extracts an image from an input stream signal to generate a thumbnail image . The generated thumbnail image may be stream decoded together with the decoded image and input to the control unit Co1. The controller Co1 may display a thumbnail list having a plurality of thumbnail images on the display 180 using the inputted thumbnail images.

At this time, the thumbnail list may be displayed in a simple view mode displayed on a partial area in a state where a predetermined image is displayed on the display 180, or in a full viewing mode displayed in most areas of the display 180. The thumbnail images in the thumbnail list can be sequentially updated.

The display 180 converts a video signal, a data signal, an OSD signal, a control signal processed by the control unit Co1 or a video signal, a data signal, and a control signal received from the external device interface unit 130, .

The display 180 may be a PDP, an LCD, an OLED, a flexible display, or the like, and may be a 3D display.

The display 180 may be configured as a touch screen and used as an input device in addition to the output device.

The power supply unit 192 supplies the overall power supply within the display apparatus 100. Thus, each module or unit in the display apparatus 100 can be operated.

The audio output unit 185 receives the signal processed by the control unit Co1 and outputs it as a voice.

The camera 190 photographs the user. The camera 190 may be implemented by a single camera, but is not limited thereto and may be implemented by a plurality of cameras. Meanwhile, the camera 190 may be embedded in the display device 100 above the display 180 or may be disposed separately. The image information photographed by the camera 190 may be input to the control unit Co1.

The control unit Co1 can sense the gesture of the user based on each of the images photographed from the camera 190 or the sensed signals from the sensor unit (not shown) or a combination thereof.

The remote control apparatus 200 transmits the user input information such as the recognized voice information to the signal receiving section 110. To this end, the remote control apparatus 200 can use Bluetooth, RF (radio frequency) communication, infrared (IR) communication, UWB (Ultra Wideband), ZigBee, or the like. Also, the remote control device 200 can receive the video, audio, or data signal output from the signal receiving unit 110 and display it on the remote control device 200 or output it by voice.

Meanwhile, the block diagram of the display device 100 shown in FIG. 3 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the display device 100 actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

Meanwhile, the display apparatus 100 is an example of a video signal processing apparatus that performs signal processing of video images or input video images stored in the apparatus. Another example of the video signal processing apparatus includes a display 180 shown in FIG. 3, A set-top box excluding the audio output unit 185, a DVD player, a Blu-ray player, a game device, a computer, and the like may be further exemplified.

The microphone (M1) senses the sound around the display device (100). The sound information detected by the microphone M1 is transmitted to the control unit Co1. The control unit Co1 can extract voice information from the sound information detected by the microphone M1. In a predetermined preparation mode or a predetermined voice recognition mode to be described later, the control unit Co1 can recognize voice information among the voice information detected by the microphone M1 according to a predetermined algorithm.

4, the remote control device 200 includes a signal transmission unit 210, a user input unit 230, a sensor unit (not shown), an output unit 250, a power supply unit 260, a storage unit 270, A microphone M2 and a control unit Co2.

The signal transmitting unit 210 transmits and receives signals to and from the signal receiving unit 110 of the display device 100.

The remote control apparatus 200 may include an RF module 212 capable of transmitting and receiving signals with the display apparatus 100 according to the RF communication standard. In addition, the remote control device 200 may include an IR module 213 capable of transmitting and receiving signals with the display device 100 according to the IR communication standard.

The remote control device 200 can receive a signal transmitted by the display device 100 through the RF module 212. [ The remote control device 200 can transmit a command regarding power on / off, channel change, volume change, and the like to the display device 100 through the IR module 213 as necessary. The remote control device 200 can transmit the voice information sensed through the microphone M2 to the display device 100. [

The user input unit 230 may include a keypad, a button, a touch pad, or a touch screen. The user can input a command related to the display device 100 to the remote control device 200 by operating the user input unit 230. [ When the user input unit 230 has a hard key button, the user can input a command related to the display device 100 to the remote control device 200 through the push operation of the hard key button. When the user input unit 230 has a touch screen, the user can touch a soft key of the touch screen to input a command related to the display device 100 to the remote control device 200. [ Also, the user input unit 230 may include various types of input means such as a scroll key, a jog key, and the like that the user can manipulate, and the present invention is not limited to the scope of the present invention.

The sensor unit of the remote control device 200 may include a gyro sensor (not shown) or an acceleration sensor (not shown). For example, the gyro sensor 441 may sense information on the motion of the remote control device 200. [

The output unit 250 may output an image or voice signal corresponding to an operation of the user input unit 230 or a signal transmitted from the display device 100. [ The user can recognize whether the user input unit 230 is operated or whether the display device 100 is controlled through the output unit 250.

For example, the output unit 250 may include an LED module 251 that is turned on when the user input unit 230 is operated or a signal is transmitted to and received from the display device 100 through the signal transmitting unit 210, a vibration module 253 An audio output module 255 for outputting sound, or a display module 257 for outputting an image.

The power supply unit 260 supplies power to the remote control device 200. The power supply unit 260 can reduce the power consumption by stopping the power supply when the remote controller 200 is not moving for a predetermined time. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for the control or operation of the remote control apparatus 200. [ If the remote control device 200 wirelessly transmits and receives a signal through the display device 100 and the RF module 212, the remote control device 200 and the display device 100 transmit and receive signals through a predetermined frequency band . The control unit Co2 of the remote control device 200 stores information on a frequency band or the like capable of wirelessly transmitting and receiving a signal with the display device 100 paired with the remote control device 200 in the storage unit 270, can do.

The control unit Co2 controls various matters related to the control of the remote control device 200. [ The control unit Co2 transmits a signal corresponding to the predetermined key operation of the user input unit 230 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit of the remote control device 200, To the display device 100 through the display device 100. [ The control unit Co2 can transmit a signal corresponding to the voice information sensed through the microphone M2 to the display device 100 through the signal transmission unit 210. [

The microphone M2 senses sounds around the display device 100. [ The sound information detected by the microphone M2 is transmitted to the control unit Co2. The control unit Co2 can extract voice information from the sound information detected by the microphone M2. In a predetermined preparation mode or a predetermined voice recognition mode to be described later, the control unit Co2 can recognize voice information among the voice information detected by the microphone M2 according to a predetermined algorithm. The sound information detected by the microphone M2 is transmitted to the display device 100 through the signal transmitting unit 210 and the control unit Co21 of the display device 100 detects the sound information from the microphone M2 according to a predetermined algorithm It is possible to recognize the voice information among the voice information.

3 and 4, the signal receiving unit 110 of the display device 100 can wirelessly transmit and receive signals to and from the remote control device 200. [

The signal receiving unit 110 can wirelessly transmit and receive signals to and from the remote control device 200 through the RF module 112. The RF module 112 of the display device 100 can transmit and receive the signals R to and from the RF module 212 of the remote control device 200. [

Also, the remote control device 200 can receive a signal transmitted through the IR module 113 according to the IR communication standard. The IR module 113 of the display device 100 can transmit and receive a signal R to and from the IR module 213 of the remote control device 200. [

The transmission signal of the remote control device 200 inputted to the display device 100 through the signal receiving unit 110 is transmitted to the control unit Co1 of the display device 100. [ The control unit Co1 can discriminate the voice information sensed by the remote control device 200 from the signal transmitted from the remote control device 200 and control the display device 100 in accordance therewith.

5A to 8, a control method of the display apparatus 100 according to the embodiments of the present invention will be described. The contents overlapping each other in the flowcharts are denoted by the same reference numerals, and redundant explanations are omitted.

The control method may be performed by the control unit Co1, the control unit Co2, or the control unit Co1 and the control unit Co2. The present invention may be a control method of the display apparatus 100 and may be a display system 1 or a display apparatus 100 including a control unit for performing the control method.

The present invention may be a computer program including each step of the control method, or may be a recording medium on which a program for implementing the control method by a computer is recorded. The 'recording medium' means a computer-readable recording medium. The recording medium includes all kinds of recording apparatuses in which data that can be read by a computer is stored. Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and a carrier wave such as transmission over the Internet . In addition, the computer-readable recording medium may be distributed over network-connected computer systems so that computer readable codes can be stored and executed in a distributed manner.

Flowcharts of Control Methods Combinations of the steps and flowchart illustrations in the figures may be performed by computer program instructions. The instructions may be embedded in a general purpose computer or a special purpose computer, and the instructions produce means for performing the functions described in the flowchart (s).

It is also possible that, in some embodiments, the functions mentioned in the steps occur out of order. For example, the two steps shown in succession may in fact be performed substantially concurrently, or the steps may sometimes be performed in reverse order according to the corresponding function.

5A and 5B, the controller determines whether at least one predetermined activation condition is satisfied. The control unit controls to activate a predetermined voice recognition mode when the activation condition is satisfied. The control unit controls the user to output a predetermined question in a predetermined voice recognition mode. The control unit controls the display device 100 based on the voice information recognized by the microphone M in the predetermined voice recognition mode.

5A and 5B, the control method according to the first embodiment of the display device 100 includes an inactivation step S100 of keeping the predetermined speech recognition mode in an inactive state (inactive state) do. The control method includes a condition determining step (S300) for determining whether at least one predetermined activation condition among the inactivation step (S100) is satisfied. The control method includes an activation step (S500) of controlling the user to activate a predetermined voice recognition mode when the activation condition is satisfied. The control method includes a controlling step (S900) of controlling the display apparatus 100 based on the voice information recognized by the microphone (M) in the predetermined voice recognition mode.

Specifically, after the activation step S500, a process of determining whether voice recognition is performed through the microphone M is performed (S600). If there is no voice detected through the microphone M within the predetermined period of time in the activation step S500, the inactivation step S100 proceeds again. If there is a voice detected through the microphone M within the predetermined time in the activation step S500, the control step S900 is performed.

If there is no voice detected in step S600, a step S700 of determining whether or not a predetermined time has passed is performed. In step S700, it is determined whether a predetermined time has elapsed since the start of the activation step S500. If it is determined in step S700 that the predetermined time has not passed, the process of determining whether voice recognition is continued continues in step S600. If it is determined in step S700 that the predetermined time has passed, the activating step S500 is terminated and the inactivation step S100 is started again. That is, if the voice for the control of the display device 100 is not recognized within the predetermined time in the predetermined voice recognition mode, the voice recognition mode is ended.

In the inactivation step S100, even if a sound is sensed, it may be set not to recognize the sensed sound as a specific instruction. The predetermined audio information to be recognized as a specific instruction is set so as not to be recognized as a predetermined instruction even if it is detected in the inactivation step S100. In the inactivation step S100, the detected voice information may be set not to be compared with a predetermined answer group to be described later.

Also, in the inactivation step S100, the preparation mode to be described later may be in an inactive state. In the inactivation step (S100), the detected sound may be set not to be recognized as a specific instruction unless there is a trigger input to be described later. Accordingly, even if the user does not intend to give an instruction to the display device, it is possible to reduce the possibility of occurrence of a controlled error after the display device is misunderstood to recognize the voice.

The condition determination step S300 may be performed during the inactivation step S100.

The at least one activation condition may comprise a plurality of activation conditions. If any one of the plurality of activation conditions is satisfied in the condition determination step (S300), the predetermined voice recognition mode may be activated.

The activation condition may include a condition that is not related to the input time point of the user. The input time point of the user means a point in time when a user inputs an input to the display device 100 or the remote control device 200 (for example, an act of pressing a key or uttering a specific word). The activity condition may be varied depending on the situation other than the user. For example, in the scenarios of FIGS. 8A to 8E and 8H, the active condition is satisfied regardless of the input time point of the user.

Of course, the activation condition may include a condition of satisfaction depending on the situation created by the input time of the user. For example, in the scenarios of FIGS. 8F and 8G, an active condition with an average viewing time per channel of 10 seconds or less per user input is satisfied.

If there is a user input for starting a voice command in the inactivation step S100, a predetermined preparation mode for recognizing a voice command may be activated. The condition for activating the ready mode is a condition in which there is a user's input for starting the voice command. For example, the user's input for starting the voice command can be performed by the user pressing a certain key or by the user uttering a specific word.

On the other hand, the activation condition is pre-set to a condition independent of the user's input for starting the voice command. The activation condition is different from the condition for starting the preparation mode. The preparation mode is a mode in which a user first inputs an input for starting the voice command on the user side in order to make a voice instruction, and the voice recognition mode first determines a point in time when the voice instruction is easy in the display system 1 It is a mode to induce voice instruction as a question to the user.

In the activating step (S500), the predetermined voice recognition mode is activated. In the predetermined voice recognition mode, the display system 1 outputs a predetermined question. The predetermined question may be output as a video or a sound. The predetermined question may be output via the display 180. The predetermined question may be output through the display module 257. [ The predetermined question may be output through the audio output unit 185. [ The predetermined question may be output through the sound output module 255. [

In the control step S900, the display device 100 is controlled according to the voice information recognized in the voice recognition mode. The display unit 180, the audio output unit 185, the power supply unit 192, and the display unit 180 in accordance with the voice information recognized in the voice recognition mode in step S900. And the lens unit 195, as shown in FIG.

In the control step S900, the remote control device 200 may be controlled according to the voice information recognized in the voice recognition mode. In the controlling step S900, it is possible to control at least one of the output unit 250 and the power supply unit 260 according to the voice information recognized in the voice recognition mode.

In one example referring to FIG. 5A, the speech recognition process (S600) may be performed in the display device 100. FIG. In step S600, voice information is sensed through the microphone M1 of the display device 100. [ The control unit Co1 controls the display device 100 based on the voice information sensed through the microphone M1.

In another example with reference to FIG. 5B, the voice recognition process (S600) may be performed in the remote control device 200. FIG. In step S600, voice information is sensed through the microphone M2 of the remote control device 200. [ The voice information sensed through the microphone (M2) is transmitted to the display device (100) through the signal transmitter (210). The control unit Co1 controls the display device 100 based on the voice information sensed through the microphone M2.

Referring to FIG. 6, the control method according to the second embodiment of the display apparatus 100 is as follows. The control unit matches the voice information recognized in the voice recognition mode with answer information of a predetermined answer group. The control unit controls the display device 100 based on the matched answer information.

The predetermined answer group is preset to correspond to the activated speech recognition mode. The predetermined answer group is predefined as a word group that is likely to be uttered by the user in the activated speech recognition mode.

For example, when the answer required by the user in the activated speech recognition mode is positive or negative, the predetermined answer group corresponding to the answer is' Yes, uh, yes, I will, okay, no, no, no, no (Yes, okay, yep, yeh, alright, sure, of course, right, agree, no, never, nay, etc.).

Even when the answer to the user in the activated speech recognition mode is not simple positive or negative, a predetermined answer group can be preset. In the example of FIG. 9G, in the predetermined speech recognition mode, it is possible to output 'I will search for a genre if I tell you the genre' as the predetermined question, and a predetermined answer group corresponding to 'melody, comedy, romantic, action, Western, gangster, nuwar, thriller, mystery, adventure, horror, war, detective, science fiction, fantasy, documentary, entertainment, music, show, drama, film, adult, no, no, do not, no (Melody, comedy, romantic, action, western, gangster, nuwar, thriller, mystery, adventure, horror, war, detective, science fiction, fantasy, documentary, music, show, drama, movie, adult, no , not, never, nay, etc.).

By limiting the recognized voice information to the predetermined answer group, the probability that the voice information is correctly recognized as intended by the user can be increased.

Referring to FIG. 6, in the control method, if voice information is recognized in step S600, it is determined whether there is answer information matching the recognized voice information among the predetermined answer groups (S800). If there is no answer information matching the recognized voice information in step S800, the voice recognition process (S600) continues. The speech recognition process (S600) may proceed for a predetermined time in the speech recognition mode as described above. If there is answer information matched with the voice information recognized in the process S800, the process of controlling the display device 100 based on the matched answer information is performed (S910).

Referring to FIG. 7, the control method according to the third embodiment of the display device 100 is as follows. The at least one predetermined activation condition may comprise a plurality of different activation conditions. When any one of the plurality of activation conditions is satisfied, the activation step (S500) proceeds.

The control unit may control to activate different predetermined voice recognition modes depending on which one of the plurality of activation conditions is satisfied. In different predetermined speech recognition modes, at least one of the predetermined question, the predetermined answer group and the predetermined time of the speech recognition mode may be different from each other.

The control unit may control to output different predetermined questions in the different predetermined speech recognition modes. The predetermined question to be output depends on which of the plurality of different activation conditions is satisfied.

The at least one activation condition may comprise different first and second activation conditions. When the first activation condition is satisfied, the first predetermined speech recognition mode is activated and the first predetermined question is output. When the second activation condition is satisfied, the second predetermined voice recognition mode is activated and the second predetermined question is output. The first predetermined question and the second predetermined question are different from each other. The at least one activation condition may further comprise a third activation condition different from the first and second activation conditions. If the third activation condition is satisfied, the third predetermined speech recognition mode is activated and the third predetermined question is output. The first and second predetermined questions and the third predetermined question are different.

The control unit compares the recognized voice information with different predetermined answer groups according to the voice recognition mode in the different predetermined voice recognition modes. In the different predetermined voice recognition modes, the recognized voice information is matched with the answer information among the different predetermined answer groups. Depending on which of the plurality of different activation conditions is satisfied, the predetermined answer group for comparing the recognized voice information is changed.

The at least one activation condition may comprise different first and second activation conditions. If the first activation condition is satisfied, the voice information recognized in the first predetermined voice recognition mode is matched with the answer information of the first predetermined answer group. If the second activation condition is satisfied, the voice information recognized in the second predetermined voice recognition mode is matched with the answer information of the second predetermined answer group. The first predetermined answer group and the second predetermined answer group are different from each other. The at least one activation condition may further comprise a third activation condition different from the first and second activation conditions. If the third activation condition is satisfied, the voice information recognized in the third predetermined voice recognition mode is matched with the answer information of the third predetermined answer group. The first and second activation conditions and the third activation conditions are different from each other.

The flowchart of FIG. 7 exemplarily shows a control method when the first through third activation conditions different from each other are set in advance.

First, the inactivation step (S110) in which the first to third predetermined speech recognition modes are maintained in a mode inactive state is performed. A condition determination step S310 is performed to determine whether one of the first activation condition, the second activation condition, and the third activation condition is satisfied during the inactivation step S110. For example, it is determined whether the first activation condition is satisfied (S310). If the first activation condition is not satisfied (S310), the process determines whether the second activation condition is satisfied S320). If the second activation condition is not satisfied in step S320, it is determined whether the third activation condition is satisfied (S330). If either the first activation condition, the second activation condition, or the third activation condition is not satisfied, the inactivation step (S110) is maintained.

If the first activation condition is satisfied in step S310, a first activation process (S510) is performed in which the first predetermined voice recognition mode is activated. The first predetermined question is output in the first predetermined speech recognition mode. After the first activation process (S510), the process of determining whether voice recognition is performed through the microphone (M6) (S610) is performed. Referring to step S710, if there is no voice detected through the microphone M within the first predetermined time in the first activation step S510, the inactivation step S110 is performed again. If voice information is recognized in step S610, a process of determining whether there is answer information matching with the recognized voice information in the first predetermined answer group is performed (S810). If there is no answer information matching the recognized voice information in step S810, the voice recognition process (S610) continues. The speech recognition process (S610) may proceed for a first predetermined time in the first predetermined speech recognition mode as described above. If there is answer information matched with the voice information recognized in step S810, the process of controlling the display device 100 based on the matched answer information is performed (S910).

If the second activation condition is satisfied in step S320, a second activation process in which the second predetermined voice recognition mode is activated is performed (S520). And a second predetermined question is output in the second predetermined voice recognition mode. After the second activation process (S520), the process of determining voice recognition through the microphone (M620) is performed. Referring to step S720, if there is no voice detected through the microphone M within the second predetermined time in the second activation step S520, the inactivation step S110 is performed again. If voice information is recognized in step S620, it is determined whether there is answer information matched with the recognized voice information in the second predetermined answer group (S820). If there is no answer information matching the recognized voice information in step S820, the voice recognition process (S620) continues. The speech recognition process (S620) may be performed for a second predetermined time in the second predetermined speech recognition mode as described above. If there is answer information matched with the recognized voice information in step S820, the process of controlling the display device 100 based on the matched answer information is performed (S910).

If the third activation condition is satisfied in step S330, a third activation process (S530) is performed in which the third predetermined voice recognition mode is activated. And the third predetermined question is output in the third predetermined speech recognition mode. After the third activation process (S530), the process of determining whether speech is recognized through the microphone (M630) is performed. If there is no sound detected through the microphone M within the third predetermined time in the third activation step S530, the activation step S110 is performed again. If the voice information is recognized in step S630, it is determined whether there is answer information matching the recognized voice information among the third predetermined answer groups (S830). If there is no answer information matching the recognized voice information in step S830, the voice recognition process (S630) continues. The voice recognition process (S630) may proceed for a third predetermined time in the third predetermined voice recognition mode as described above. If there is answer information matched with the recognized voice information in step S830, the process of controlling the display device 100 based on the matched answer information is performed (S910).

Referring to FIG. 8, the control method according to the fourth embodiment of the display device 100 is as follows. The control unit may control to activate a predetermined preparation mode for recognizing a voice command if there is a user's input (trigger input) for starting a voice command.

The speech recognition mode and the preparation mode are different from each other.

The predetermined answer group is previously set in the speech recognition mode, but the predetermined answer group may not be preset in the preparation mode. In the preparation mode, an answer group having a relatively larger range than the predetermined answer group of the voice recognition mode may be preset. This is because, in the preparation mode, there is a relatively wide variety of words that are likely to be used by the artist. In the voice recognition mode, the voice information is recognized within the limited answer range, thereby improving the accuracy of voice recognition.

A predetermined question is output in the speech recognition mode, but a predetermined question may not be output in the preparation mode. In the voice recognition mode, a question asking the user for an answer is output specifically, but in the preparation mode, only the notification of the preparation mode can be output. A question asking for a relatively limited range of answers is output in the speech recognition mode, but in the ready mode a comprehensive question (e.g., 'please indicate by voice') that all possible instructions are to be output It is possible.

The trigger input may be configured to be performed when a user touches a specific input or utteres a specific word. In the preparation mode, a technique of recognizing a voice by recognizing the position of a speaking person (user) and giving a weight to a sound generated at the corresponding position may be used. In the preparation mode, a technique of removing ambient noise in addition to the voice of the user can be used. Through the trigger input, it is possible to prevent the display device 100 from malfunctioning due to a voice uttered by the user in the inactivation step (SlOO), activate the preparation mode at a desired start time, To be precisely and efficiently controlled.

Referring to FIG. 8, first, the inactivation step (S150) of keeping the predetermined speech recognition mode and the preparation mode in an inactive state is performed. During the inactivation step S150, a process of determining whether the trigger is input or not is determined (S200, S300). In the above steps S200 and S300, if there is the trigger input, the preparation mode activation step S250 is performed. In the steps S200 and S300, if the activation condition is satisfied, the voice recognition mode activation step S500 proceeds. If the voice information is recognized in the preparation mode activation step S250, the display device 100 is controlled based on the recognized voice information. If voice information is recognized in the voice recognition mode activation step (S500), the display device 100 is controlled based on the recognized voice information.

The steps (S600, S700, S800, and S910) after the voice recognition mode activation step (S500) are as described above.

After the preparation mode activation step S250, the process of determining whether voice recognition is performed through the microphone M (S260) is performed. If there is no voice detected through the microphone M within the predetermined time in the preparation mode activation step S250, the inactivation step S150 is again performed. If there is a voice detected through the microphone M within a predetermined time in the preparation mode activation step S250, the control proceeds to step S290 of controlling the display device 100 based on the recognized voice information.

If there is no voice detected in step S260, a process of determining whether or not a predetermined time has passed is performed (S270). In step S270, it is determined whether a predetermined time has elapsed since the start of the preparation mode activation step S250. If it is determined in step S270 that the predetermined time has not elapsed, the process of determining whether speech recognition is continued continues in step S260. If it is determined in step S270 that the predetermined time has passed, the preparation mode activation step S250 is terminated and the inactivation step S150 is started again. That is, if the voice for the control of the display device 100 within the predetermined time in the predetermined preparation mode is not recognized, the preparation mode is ended.

9A to 9H, an exemplary situation of a predetermined active condition, a predetermined question, and a user's voice response will be described as follows.

In FIG. 9A, the active condition is 'a condition that is n minutes before sleeping reservation'. Here, the case where n is 10 is taken as an example. 10 minutes before the sleep reservation time in the state in which the voice recognition mode is inactivated, the activation condition is satisfied and the voice recognition mode is activated. In the voice recognition mode, a predetermined question (the power of the TV is turned off 10 minutes after sleeping reservation, please cancel to see TV continuously) is outputted. The user utters "Turn off the TV", and the display device 100 senses the user's voice information through the microphone M. The control unit matches the voice information of the user with the answer information of the predetermined answer group and immediately turns off the display device 100 based on the matched answer information.

In FIG. 9B, the active condition is 'a condition for detecting a network unconnected'. Here, the detection of network connection can be performed through the network interface unit 135. In a state in which the voice recognition mode is disabled, the display device 100 senses the absence of a network connection, the activation condition is satisfied, and the voice recognition mode is activated. In the voice recognition mode, a predetermined question (network is not connected, do you want to move to network connection) is output. The user speaks "yes", and the display device 100 senses the user's voice information through the microphone M. The control unit matches the voice information of the user with the answer information of the predetermined answer group, and causes the display unit 180 to display a setting screen related to the network connection based on the matched answer information.

In FIG. 9C, the active condition is a " starting condition of a frequently watched program ". A program frequently viewed by a predetermined criterion is set. For example, a frequently watched program can be set through whether it has been watched a predetermined number of times or more in the preset time, the accumulated number of watched times, whether or not it has been watched every regular program broadcast time, and the like. In a state where the voice recognition mode is disabled, the display device 100 detects that the program frequently viewed on another channel is started, the activation condition is satisfied, and the voice recognition mode is activated. In the speech recognition mode, a predetermined question (OOO, which was frequently viewed on another channel, has just started, do you want to switch channels) is output. The user speaks "Yes", and the display device 100 senses the user's voice information through the microphone M. The control unit controls the broadcast receiving unit 120 based on the matched answer information, matches the user's voice information with the answer information of the predetermined answer group, and displays the frequently viewed program on the display 180 do.

In FIG. 9D, the active condition is 'a program start condition frequently viewed while using the Internet'. In the state where the voice recognition mode is disabled, the display device 100 senses that the program that is frequently viewed is started while the Internet screen is being output, so that the activation condition is satisfied and the voice recognition mode is activated. In the voice recognition mode, a predetermined question (OOO, which you see every week, has started, please tell us if you want to switch channels or record). The user speaks "Record", and the display device 100 senses the user's voice information through the microphone M. The controller matches the voice information of the user with the answer information of the predetermined answer group, records the frequently viewed program on the basis of the matched answer information, and stores the program in the storage unit 140.

In FIG. 9E, the active condition is " a condition in which the user switches the channel ". Here, the active condition may be a condition that the user switches to another channel while watching a specific program for a predetermined time or longer. In a state in which the voice recognition mode is disabled, the display device 100 senses that the user has switched the channel, so that the activation condition is satisfied and the voice recognition mode is activated. In the voice recognition mode, a predetermined question (whether to add a broadcast currently being watched as a favorite channel) is output. The user speaks "Yes", and the display device 100 senses the user's voice information through the microphone M. The control unit matches the voice information of the user with the answer information of the predetermined answer group and sets the favorite program as a favorite on the basis of the matched answer information.

In FIG. 9F, the active condition is 'the condition that the average viewing time per user is within 10 seconds'. Here, the active condition may be a condition that a user has an average viewing time per channel within 10 seconds for a predetermined time. In the state where the voice recognition mode is disabled, the display device 100 detects that the average viewing time per channel is less than 10 seconds per user for a predetermined time period, the activation condition is satisfied, and the voice recognition mode is activated. In the voice recognition mode, a predetermined question (a favorite drama is currently on air, I would like to switch) is output. The user speaks "Yes", and the display device 100 senses the user's voice information through the microphone M. The control unit matches the voice information of the user with the answer information of the predetermined answer group and causes the display unit 180 to output the drama currently being broadcast based on the matched answer information.

In FIG. 9G, the active condition is 'a condition that the average viewing time per channel is within 10 seconds' by the user. Here, the active condition may be a condition that a user has an average viewing time per channel within 10 seconds for a predetermined time. In the state where the voice recognition mode is disabled, the display device 100 detects that the average viewing time per channel is less than 10 seconds per user for a predetermined time period, the activation condition is satisfied, and the voice recognition mode is activated. In the voice recognition mode, a predetermined question (search for a genre) is output. The user speaks "show an action movie", and the display device 100 senses the user's voice information through the microphone M. The controller matches the voice information of the user with the answer information of the predetermined answer group, and causes the display 180 to output the currently-displayed action movie list and corresponding channel information based on the matched answer information .

In FIG. 9H, the active condition is 'a condition in which 2D content is changed to 3D-capable content during viewing'. Here, 2D content refers to content that can be viewed only in 2D, and 3D capable content refers to content that can be viewed in 2D or 3D. In the state where the voice recognition mode is disabled, the display device 100 detects that the 2D content is changed to the 3D-enabled content during viewing, the activation condition is satisfied, and the voice recognition mode is activated. In the voice recognition mode, a predetermined question (content that can be 3D, view in 3D) is output. The user speaks "No, I would like to see in 2D", and the display device 100 senses the user's voice information through the microphone M. The control unit matches the voice information of the user with the answer information of the predetermined answer group, and controls to continuously output the 3D-capable content currently being broadcasted on the basis of the matched answer information. Although not shown, if the user speaks 'yes', the control unit controls the lens unit 195 to continuously output 3D-enabled contents currently being broadcasted on the basis of the detected voice information.

9A to 9H, items that can be selected in the voice recognition mode may be output together with the predetermined question. In the voice recognition mode, the selectable item may be output as an icon of an image, and the user may input the icon by selecting the icon using the key of the remote controller 200 instead of the voice command.

The display apparatus, the display system, and the display apparatus control method according to the present invention can be applied to a display apparatus, a display apparatus, and a display apparatus according to embodiments of the present invention. All or a part of the above-described elements may be selectively combined.

Display system (1) Display device (100)
The signal receiving unit 110, the remote control device 200,
Signal transmitting section 210: M, M1, M2: microphone
Co1, Co2: Control R: Signal
S: voice

Claims (10)

A display for displaying an image;
A microphone for recognizing voice; And
Wherein the controller is configured to determine whether at least one predetermined activation condition is satisfied and activate a predetermined voice recognition mode for outputting a predetermined question to the user when the activation condition is satisfied, And controlling the display device based on the voice information recognized by the display device. The method according to claim 1,
Wherein the activation condition is pre-set regardless of a user's voice input request. The method according to claim 1,
The control unit controls to activate a predetermined preparation mode for recognizing a voice command when there is an input from a user for starting a voice command,
Wherein the speech recognition mode and the preparation mode are different from each other. The method of claim 3,
Wherein the activation condition is pre-set to a condition independent of the user ' s input for starting a voice command. The method according to claim 1,
Wherein,
Wherein the voice information recognized in the voice recognition mode is matched with answer information of a predetermined answer group and the display device is controlled based on the matched answer information. The method according to claim 1,
Wherein the at least one predetermined activation condition comprises a plurality of different activation conditions,
Wherein,
And to activate different predetermined speech recognition modes depending on which of the plurality of activation conditions is satisfied. The method according to claim 6,
Wherein,
And to output different predetermined questions in the different predetermined speech recognition modes. The method according to claim 6,
Wherein,
Wherein the recognized voice information is matched with answer information among a plurality of different answer groups in the different predetermined voice recognition modes. The method according to claim 1,
Further comprising a remote control device for remotely controlling the display device,
Wherein the microphone is disposed in the remote control device,
Wherein the display and the control unit are disposed in the display device. A condition determining step of determining whether a predetermined activation condition is satisfied;
An activation step of outputting a predetermined question to the user and activating a predetermined voice recognition mode when the activation condition is satisfied in the condition determination step; And
And controlling the display device based on the voice information recognized in the activation step.

Images