KR102454761B1 - Method for operating an apparatus for displaying image - Google Patents

Abstract

The method of operating an image display device according to an embodiment of the present invention comprises the steps of receiving an audio signal including an audio signal and a sound signal of a speaker through a microphone (MIC), determining whether an external speaker is connected, and an external speaker When connected, analyzing the input signal of the external speaker, comparing the input signal of the external speaker with the audio signal, and correcting the sound quality distortion and transmission delay of the audio signal based on the corrected audio signal, and removing the acoustic signal of the speaker. Accordingly, it is possible to remove the sound of the sound bar and increase the accuracy of voice recognition, thereby improving user convenience.

Description

Method for operating an apparatus for displaying image}

The present invention relates to an image display apparatus and an operating method thereof, and more particularly, to an image display apparatus capable of providing a sound removing method for a sound bar and an efficient voice recognition method, and an operating method thereof.

An image display device is a device having a function of displaying an image that a user can watch. The user can watch the broadcast through the image display device. The image display device displays a broadcast selected by a user among broadcast signals transmitted from a broadcast station on a display. Currently, there is a trend of switching from analog broadcasting to digital broadcasting all over the world.

Digital broadcasting refers to broadcasting that transmits digital image and audio signals. Compared to analog broadcasting, digital broadcasting is strong against external noise, so data loss is small, it is advantageous for error correction, and provides a high resolution and clear screen. Also, unlike analog broadcasting, digital broadcasting can provide interactive services.

Meanwhile, the image display device may include an audio signal processing unit or may be used in connection with an audio processing device that processes and outputs an audio signal in order to output high-quality audio.

In addition, as the functions and services of image display devices are diversified, research on voice recognition technology capable of recognizing and manipulating a user's voice such as menu selection, text input, command input, and channel switching is increasing.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an image display device capable of performing sound cancellation on a sound bar and an operating method thereof.

Another object of the present invention is to provide an image display device capable of increasing the accuracy of voice recognition and an operating method thereof.

Another object of the present invention is to provide an image display device and an operating method thereof, which can be operated accurately and conveniently through voice recognition technology and can improve user convenience.

The method of operating an image display device according to an embodiment of the present invention comprises the steps of receiving an audio signal including an audio signal and a sound signal of a speaker through a microphone (MIC), determining whether an external speaker is connected, and an external speaker When connected, analyzing the input signal of the external speaker, comparing the input signal of the external speaker with the audio signal, and correcting the sound quality distortion and transmission delay of the audio signal based on the corrected audio signal, and removing the acoustic signal of the speaker.

According to the present invention, it is possible to perform sound cancellation for the sound bar, and it is possible to increase the accuracy of voice recognition.

According to the present invention, it is possible to operate accurately and conveniently through voice recognition technology, and to improve user convenience.

1 is a view showing an image display system according to an embodiment of the present invention.
2 is an internal block diagram of an image display device according to an embodiment of the present invention.
FIG. 3 is an example of an internal block diagram of the control unit of FIG. 2 .
FIG. 4 is a diagram illustrating a control method of the remote control device of FIG. 2 .
5 is a perspective view of a remote control device according to an embodiment of the present invention.
6 is an internal block diagram of a remote control device according to an embodiment of the present invention.
7 is a flowchart illustrating a method of operating an image display apparatus according to an embodiment of the present invention.
8A to 11 are diagrams referenced to explain a method of operating an image display apparatus according to an embodiment of the present invention.
12 is a flowchart illustrating a method of operating an image display device according to an embodiment of the present invention.
13 is an example of an internal block diagram of the control unit of FIG. 2 .
14 is a diagram referenced in the description of a voice recognition process according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffixes "module", "engine" and "part" for the components used in the following description are given simply in consideration of the ease of writing this specification, and do not give a particularly important meaning or role by themselves. . Accordingly, the terms “module”, “engine” and “unit” may be used interchangeably.

1 is a view showing an image display system according to an embodiment of the present invention.

1, an image display system 10 according to an embodiment of the present invention may include an image display device 100 and an external speaker, for example, a sound bar 400, and the image display device ( 100) and the sound bar 400 may be connected by wire or wirelessly.

In addition, the image display system 10 according to an embodiment of the present invention may be a home theater system including the image display device 100 and an external speaker, for example, the sound bar 400 and/or a plurality of speakers. have.

Meanwhile, the image display device 100 may be various electronic devices having a display means. For example, it may include a TV capable of displaying a broadcast, a monitor, a computer, a tablet PC, a mobile terminal, and the like.

The image display device 100 according to an embodiment of the present invention can receive a voice signal, and performs voice recognition for a voice signal received through an embedded voice recognition engine (not shown) provided therein. can be done

Meanwhile, the image display device 100 may include a voice database for storing data used for voice recognition in a storage unit inside the voice recognition engine or outside the voice recognition engine.

The voice database may store an acoustic model and a language model, and may include an acoustic model database and a language model database for storing the acoustic model and the language model, respectively.

In addition, the voice database may further include a pronunciation dictionary database for storing vocabulary and corresponding phonetic symbols. According to an embodiment, the speech recognition engine may further include a phonetic symbol generation module that generates phonetic symbols from received text data.

The voice recognition engine may process a received voice signal, compare it with data stored in the voice database, and output voice recognition result data. Meanwhile, the image display device 100 may perform various operations, such as menu selection, text input, command input, and channel switching, based on the output voice recognition result data.

2 is an internal block diagram of an image display device according to an embodiment of the present invention.

Referring to FIG. 2 , the image display device 100 according to an embodiment of the present invention includes a broadcast receiving unit 105 , an external device interface unit 130 , a network interface unit 135 , a storage unit 140 , and a user It may include an input interface unit 150 , a sensor unit (not shown), a control unit 170 , a display 180 , and an audio output unit 185 .

In addition, the image display device 100 according to an embodiment of the present invention may further include a built-in microphone (MIC, not shown).

The broadcast receiver 105 may include a tuner 110 and a demodulator 120 . Meanwhile, if necessary, the broadcast receiving unit 105 may be designed to include the tuner unit 110 and the demodulator 120 while not including the network interface unit 135, and vice versa. It is also possible to design such that the tuner unit 110 and the demodulator unit 120 are not included.

The tuner unit 110 selects an RF broadcast signal corresponding to a channel selected by a user or all pre-stored channels from among radio frequency (RF) broadcast signals received through an antenna. In addition, the selected RF broadcast signal is converted into an intermediate frequency signal or a baseband video or audio signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF), and if it is an analog broadcast signal, it is converted into an analog baseband image or audio signal (CVBS/SIF). That is, the tuner unit 110 may process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS/SIF) output from the tuner unit 110 may be directly input to the control unit 170 .

Also, the tuner unit 110 may receive a single-carrier RF broadcast signal according to an Advanced Television System Committee (ATSC) method or a multi-carrier RF broadcast signal according to a Digital Video Broadcasting (DVB) method.

Meanwhile, in the present invention, the tuner unit 110 sequentially selects RF broadcast signals of all broadcast channels stored through the channel storage function among the RF broadcast signals received through the antenna in the present invention, and converts them to an intermediate frequency signal or a baseband image or audio signal. can be converted to

Meanwhile, the tuner unit 110 may include a plurality of tuners in order to receive broadcast signals of a plurality of channels. Alternatively, a single tuner that simultaneously receives broadcast signals of a plurality of channels is also possible.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

The demodulator 120 may output a stream signal TS after demodulation and channel decoding are performed. In this case, the stream signal may be a signal obtained by multiplexing an image signal, an audio signal, or a data signal.

The stream signal output from the demodulator 120 may be input to the controller 170 . After performing demultiplexing, image/audio signal processing, and the like, the controller 170 outputs an image to the display 180 , and outputs an audio to the audio output unit 185 .

The external device interface unit 130 may transmit or receive data with the connected external device 190 . To this end, the external device interface unit 130 may include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 130 may be connected to an external device such as a DVD (Digital Versatile Disk), Blu-ray, game device, camera, camcorder, computer (laptop), set-top box, and the like by wire/wireless. , it is also possible to perform input/output operations with an external device.

The A/V input/output unit may receive video and audio signals from an external device. Meanwhile, the wireless communication unit may perform short-range wireless communication with other electronic devices.

The network interface unit 135 provides an interface for connecting the image display device 100 to a wired/wireless network including an Internet network. For example, the network interface unit 135 may receive content or other data from the Internet or a server provided by a content provider or network operator through a network.

The storage unit 140 may store a program for each signal processing and control in the control unit 170 , or may store a signal-processed image, audio, or data signal.

Also, the storage unit 140 may perform a function for temporarily storing an image, audio, or data signal input to the external device interface unit 130 . In addition, the recorded predetermined program can be stored and stored in the form of TS or transcoding into a predetermined format.

Meanwhile, the storage unit 140 may store and manage data used for voice recognition.

Although the embodiment in which the storage unit 140 of FIG. 2 is provided separately from the control unit 170 is illustrated, the scope of the present invention is not limited thereto. The storage unit 140 may be included in the control unit 170 .

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or transmits a signal from the control unit 170 to the user.

For example, transmit/receive user input signals such as power on/off, channel selection, and screen setting from the remote control device 200, or local keys such as power key, channel key, volume key, and setting value (not shown) transmits a user input signal input to the control unit 170, transmits a user input signal input from a sensor unit (not shown) for sensing a user's gesture to the control unit 170, or transmits a signal from the control unit 170 It can transmit to a sensor unit (not shown).

The control unit 170 demultiplexes an input stream through the tuner unit 110 or the demodulator 120 or the external device interface unit 130 or processes the demultiplexed signals to output video or audio. It can generate and output signals for

The image signal processed by the controller 170 may be input to the display 180 and displayed as an image corresponding to the image signal. Also, the image signal processed by the controller 170 may be input to an external output device through the external device interface unit 130 .

The audio signal processed by the controller 170 may be outputted to the audio output unit 185 . Also, the audio signal processed by the controller 170 may be input to an external output device, for example, the sound bar 400 through the external device interface unit 130 .

Although not shown in FIG. 2 , the controller 170 may include a demultiplexer, an image processor, and the like. This will be described later with reference to FIG. 3 .

In addition, the controller 170 may control overall operations in the image display apparatus 100 . For example, the controller 170 may control the tuner 110 to select a channel selected by the user or an RF broadcast corresponding to a pre-stored channel (tuning).

Also, the control unit 170 may control the image display apparatus 100 according to a user command input through the user input interface unit 150 or an internal program.

Meanwhile, the controller 170 may control the display 180 to display an image. In this case, the image displayed on the display 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

Meanwhile, the controller 170 may generate and display a 3D object for a predetermined 2D object among the images displayed on the display 180 . For example, the object may be at least one of an accessed web screen (newspaper, magazine, etc.), an electronic program guide (EPG), various menus, widgets, icons, still images, moving pictures, and text.

Such a 3D object may be processed to have a different depth from the image displayed on the display 180 . Preferably, the 3D object may be processed to look protruding compared to the image displayed on the display 180 .

Meanwhile, the controller 170 may recognize the location of the user based on the image captured by the photographing unit (not shown). For example, the distance (z-axis coordinate) between the user and the image display apparatus 100 may be determined. In addition, an x-axis coordinate and a y-axis coordinate in the display 180 corresponding to the user's location may be identified.

Meanwhile, although not shown in the drawings, a channel browsing processing unit for generating a thumbnail image corresponding to a channel signal or an external input signal may be further provided. The channel browsing processing unit receives the stream signal TS output from the demodulator 120 or the stream signal output from the external device interface unit 130, and extracts an image from the input stream signal to generate a thumbnail image. can The generated thumbnail image may be stream-decoded together with the decoded image and the like and input to the controller 170 . The controller 170 may display a thumbnail list including a plurality of thumbnail images on the display 180 by using the input thumbnail image.

In this case, the thumbnail list may be displayed in a simple view method displayed on a partial area while a predetermined image is displayed on the display 180 , or may be displayed in a full view method displayed on most areas of the display 180 . Thumbnail images in such a thumbnail list may be sequentially updated.

The display 180 converts an image signal, a data signal, an OSD signal, a control signal, or an image signal, a data signal, and a control signal received from the external device interface unit 130 processed by the controller 170 to generate a driving signal. create

The display 180 may be a PDP, LCD, OLED, flexible display, or the like, and may also be a three-dimensional display (3D display).

In order to view the 3D image, the display 180 may be divided into an additional display method and an independent display method.

In the independent display method, a 3D image can be implemented by the display 180 alone without a separate additional display, for example, glasses (glass), for example, a lenticular method, a parallax barrier, etc. Various methods may be applied.

On the other hand, the additional display method may implement a 3D image by using an additional display as a viewing device in addition to the display 180 . For example, various methods such as a head mounted display (HMD) type and glasses type may be applied.

Meanwhile, the glasses type may be further divided into a passive method such as a polarized glasses type and an active method such as a shutter glass type. Also, the head mounted display type can be divided into a passive method and an active method.

Meanwhile, the display 180 may be configured as a touch screen and used as an input device in addition to an output device.

The audio output unit 185 receives the audio-processed signal from the control unit 170 and outputs it as audio.

The photographing unit (not shown) photographs the user. The photographing unit (not shown) may be implemented with one camera, but is not limited thereto, and may be implemented with a plurality of cameras. Meanwhile, the photographing unit (not shown) may be embedded in the image display device 100 above the display 180 or disposed separately. Image information captured by the photographing unit (not shown) may be input to the control unit 170 .

The controller 170 may detect the user's gesture based on each or a combination of an image captured by a photographing unit (not shown) or a signal sensed from a sensor unit (not shown).

The remote control device 200 transmits a user input to the user input interface unit 150 . To this end, the remote control device 200 may use Bluetooth (Bluetooth), radio frequency (RF) communication, infrared (IR) communication, Ultra Wideband (UWB), ZigBee, or the like. In addition, the remote control device 200 may receive an image, audio, or data signal output from the user input interface unit 150 , and display it or output the audio signal from the remote control device 200 .

The remote control device 200 will be described later with reference to FIGS. 4 to 6 .

Meanwhile, the above-described image display apparatus 100 may be a digital broadcasting receiver capable of receiving fixed or mobile digital broadcasting.

Meanwhile, the block diagram of the image display device 100 shown in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the image display device 100 that are actually implemented. That is, two or more components may be combined into one component, or one component may be subdivided into two or more components as needed. In addition, the function performed in each block is for explaining the embodiment of the present invention, and the specific operation or device does not limit the scope of the present invention.

On the other hand, the image display apparatus 100 does not include the tuner unit 110 and the demodulator 120 shown in FIG. 2 , unlike the one shown in FIG. 2 , but a network interface unit 135 or an external device interface unit ( 130), the content may be received and it may be reproduced.

FIG. 3 is an example of an internal block diagram of the control unit of FIG. 2 .

Referring to the drawings, the controller 170 according to an embodiment of the present invention includes a demultiplexer 310 , an audio processor 315 , an image processor 320 , a processor 330 , and an OSD generator 340 . ), a mixer 345 , a frame rate converter 350 , and a formatter 360 . In addition, it may further include a data processing unit (not shown).

The demultiplexer 310 demultiplexes an input stream. For example, when MPEG-2 TS is input, it can be demultiplexed and separated into video, audio, and data signals, respectively. Here, the stream signal input to the demultiplexer 310 may be a stream signal output from the tuner unit 110 , the demodulator 120 , or the external device interface unit 130 .

On the other hand, the audio processing unit 315 in the control unit 170, the audio signal demultiplexed by the demultiplexer 310 or the audio signal directly input from the network interface unit 135 or the external device interface unit 130, etc., Audio signal processing may be performed. To this end, the audio processing unit 315 may include various decoders.

Also, the audio processing unit 315 may include a mixer for mixing audio signals decoded by various decoders, particularly audio signals of various channels. In addition, the audio signal mixed in the mixer may be transmitted to the audio output unit 185 .

In addition, the audio processing unit 315 may process a base, treble, volume control, etc., or may automatically perform sound field signal processing.

Also, the audio processing unit 315 may adjust at least one of a gain or a phase for each frequency band of an audio signal to be output.

Meanwhile, the processed audio signal may be sound output through the audio output unit 185 . The audio output unit 185 may include a digital-amplifier (D-Amp) and/or a speaker.

Alternatively, the processed audio signal may be input to an external output device, for example, the sound bar 400 through the external device interface unit 130 , and sound may be output from the sound bar 400 .

The image processing unit 320 may perform image processing of the demultiplexed image signal. To this end, the image processing unit 320 may include an image decoder 225 and a scaler 235 .

The video decoder 225 decodes the demultiplexed video signal, and the scaler 235 performs scaling to output the resolution of the decoded video signal on the display 180 .

The video decoder 225 may include decoders of various standards.

Meanwhile, the image signal decoded by the image processing unit 320 may be divided into a case in which there is only a 2D image signal, a case in which a 2D image signal and a 3D image signal are mixed, and a case in which there is only a 3D image signal.

For example, when an external video signal input from the external device 190 or a broadcast video signal of a broadcast signal received from the tuner unit 110 includes only a 2D video signal, when a 2D video signal and a 3D video signal are mixed , , and a case where only a 3D image signal is present. Accordingly, the signal is processed by the control unit 170 , particularly the image processing unit 320 , and the like, and a 2D image signal, a 2D image signal, and a 3D image signal mixed signal, respectively. , a 3D image signal may be output.

Meanwhile, the image signal decoded by the image processing unit 320 may be a 3D image signal of various formats. For example, it may be a 3D image signal including a color image and a depth image, or a 3D image signal including a multi-view image signal. The multi-view image signal may include, for example, a left-eye image signal and a right-eye image signal.

The processor 330 may control overall operations in the image display apparatus 100 or the controller 170 . For example, the processor 330 may control the tuner 110 to select a channel selected by the user or an RF broadcast corresponding to a pre-stored channel.

Also, the processor 330 may control the image display apparatus 100 according to a user command input through the user input interface unit 150 or an internal program.

In addition, the processor 330 may perform data transmission control with the network interface unit 135 or the external device interface unit 130 .

In addition, the processor 330 may control the overall voice recognition function, control to perform voice recognition based on a voice signal input, or control to use the server 400 connected through a network.

In addition, the processor 330 may control operations of the demultiplexer 310 , the audio processor 315 , the image processor 320 , and the OSD generator 340 in the controller 170 .

The OSD generator 340 generates an OSD signal according to a user input or by itself. For example, a signal for displaying various types of information as graphics or text on the screen of the display 180 may be generated based on a user input signal. The generated OSD signal may include various data such as a user interface screen of the image display device 100 , various menu screens, widgets, and icons. Also, the generated OSD signal may include a 2D object or a 3D object.

Also, the OSD generator 340 may generate a pointer that can be displayed on a display based on a pointing signal input from the remote control device 200 . In particular, such a pointer may be generated by a pointing signal processing unit, and the OSD generation unit 240 may include such a pointing signal processing unit (not shown). Of course, the pointing signal processing unit (not shown) may be provided separately instead of being provided in the OSD generating unit 240 .

The mixer 345 may mix the OSD signal generated by the OSD generator 340 and the decoded image signal image-processed by the image processor 320 . In this case, the OSD signal and the decoded image signal may include at least one of a 2D signal and a 3D signal, respectively. The mixed video signal is provided to the frame rate converter 350 .

A frame rate converter (FRC) 350 may convert a frame rate of an input image. On the other hand, the frame rate converter 350 may output as it is without a separate frame rate conversion.

The formatter 360 may arrange a left-eye image frame and a right-eye image frame of the frame rate-converted 3D image. In addition, a synchronization signal Vsync for opening the left eye glass and the right eye glass of the 3D viewing apparatus may be output.

Meanwhile, the formatter 360 may receive the signal mixed by the mixer 345 , that is, the OSD signal and the decoded image signal, and may separate the 2D image signal and the 3D image signal.

Meanwhile, in the present specification, a 3D image signal means including a 3D object, and examples of such objects include a picture in picture (PIP) image (still image or moving image), an EPG indicating broadcast program information, various menus, widgets, There may be icons, text, objects in the image, people, backgrounds, web screens (newspapers, magazines, etc.).

Meanwhile, the formatter 360 may change the format of the 3D image signal.

Meanwhile, the formatter 360 may convert a 2D video signal into a 3D video signal. For example, according to a 3D image generation algorithm, an edge or a selectable object is detected in a 2D image signal, and an object or a selectable object according to the detected edge is separated into a 3D image signal. can In this case, as described above, the generated 3D image signal may be separated into a left-eye image signal L and a right-eye image signal R and arranged.

On the other hand, although not shown in the drawing, it is also possible that a 3D processor (not shown) for processing a 3D effect signal is further disposed after the formatter 360 . Such a 3D processor (not shown) may process brightness, tint, and color adjustment of an image signal to improve a 3D effect. For example, signal processing that makes a near field clear and a far distance blurry may be performed. Meanwhile, the functions of the 3D processor may be merged into the formatter 360 or integrated into the image processing unit 320 .

A data processing unit (not shown) in the control unit 170 may perform data processing of the demultiplexed data signal. For example, when the demultiplexed data signal is an encoded data signal, it may be decoded. The encoded data signal may be EPG (Electronic Program Guide) information including broadcast information such as start time and end time of a broadcast program aired on each channel.

Meanwhile, in FIG. 3 , signals from the OSD generating unit 340 and the image processing unit 320 are mixed in the mixer 345 and then 3D processing is performed in the formatter 360, but is not limited thereto. It is also possible that is placed after the formatter. That is, the formatter 360 performs 3D processing on the output of the image processing unit 320 , and the OSD generation unit 340 performs 3D processing together with the OSD generation, and then mixes each processed 3D signal in the mixer 345 . It is also possible to

Meanwhile, a block diagram of the control unit 170 shown in FIG. 3 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specification of the controller 170 that is actually implemented.

In particular, the frame rate converter 350 and the formatter 360 are not provided in the controller 170 , but may be provided separately.

FIG. 4 is a diagram illustrating a control method of the remote control device of FIG. 2 .

As shown in (a) of FIG. 4 , it is exemplified that a pointer 205 corresponding to the remote control device 200 is displayed on the display 180 .

The user may move or rotate the remote control device 200 up and down, left and right (FIG. 5(b)), back and forth (FIG. 5(c)). The pointer 205 displayed on the display 180 of the image display device corresponds to the movement of the remote control device 200 . As shown in the drawings, the remote control device 200 moves and displays the corresponding pointer 205 according to movement in 3D space, so it may be called a space remote controller.

4B illustrates that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display 180 of the image display device also moves to the left correspondingly.

Information about the movement of the remote control device 200 sensed through the sensor of the remote control device 200 is transmitted to the image display device. The image display device may calculate the coordinates of the pointer 205 from information about the movement of the remote control device 200 . The image display device may display the pointer 205 to correspond to the calculated coordinates.

4C illustrates a case in which the user moves the remote control device 200 away from the display 180 while pressing a specific button in the remote control device 200 . Accordingly, the selected area in the display 180 corresponding to the pointer 205 may be zoomed in and displayed in an enlarged manner. Conversely, when the user moves the remote control device 200 closer to the display 180 , the selected area in the display 180 corresponding to the pointer 205 may be zoomed out and displayed. Meanwhile, when the remote control apparatus 200 moves away from the display 180 , the selection area is zoomed out, and when the remote control apparatus 200 approaches the display 180 , the selection area may be zoomed in.

On the other hand, while a specific button in the remote control device 200 is pressed, recognition of vertical and horizontal movements may be excluded. That is, when the remote control device 200 moves away from or close to the display 180 , up, down, left, and right movements are not recognized, but only forward and backward movements may be recognized. In a state where a specific button in the remote control device 200 is not pressed, only the pointer 205 moves according to the up, down, left, and right movement of the remote control device 200 .

Meanwhile, the moving speed or moving direction of the pointer 205 may correspond to the moving speed or moving direction of the remote control device 200 .

5 is a perspective view of a remote control apparatus according to an embodiment of the present invention, and FIG. 6 is an internal block diagram of the remote control apparatus.

Referring to FIG. 5 , the space remote control 201 according to an embodiment of the present invention may include various input keys or input buttons.

For example, the space remote control 201 may include an OK key 291 , a menu key 292 , a four direction key 293 , a channel control key 294 , and a volume control key 296 . have. In addition, a separate microphone (not shown) may be further included.

For example, the OK key 291 can be used to select a menu or item, the menu key 292 can be used to display a predetermined menu, and the four-way key 293 is used to move a pointer or an indicator. It can be used when moving up and down, left and right, the channel adjustment key 294 can be used to adjust the channel up and down, and the volume adjustment key 296 can be used when adjusting the volume up and down.

In addition, the space remote controller 201 may further include a back key 297 and a home key 298 . For example, the back key 297 can be used when moving to the previous screen, and the home key 298 can be used when moving to the home screen.

On the other hand, as shown in the figure, the confirmation key 291 may have a scroll function added thereto. To this end, the confirmation key 291 can be implemented in the form of a wheel key. That is, when the confirmation key 291 is pressed, it is used to select a corresponding menu or item, and when the confirmation key 291 is scrolled up and down, scrolling the display screen or switching a list page may be performed.

Specifically, when an image larger than the size of the display is displayed on the display unit 180 and the confirmation key 291 is scrolled to search for a corresponding image, an image area that is not currently displayed on the display is displayed on the display. As another example, when a list page is displayed on the display unit 180 , if the confirmation key 291 is scrolled, a previous page or a next page of the current page may be displayed.

Such a scroll function may be provided as a separate key other than the confirmation key 291 .

On the other hand, the four-way key 293, as shown in the figure, in a circular type, up, down, left, and right keys may be arranged in four directions, respectively. Meanwhile, a touch input to the four direction key 293 may also be possible. For example, when there is a touch operation from an up key to a down key in the four direction key 293, a set function may be input or performed according to the corresponding touch input.

Referring to FIG. 6 , the remote control device 200 includes a wireless communication unit 220 , a user input unit 230 , a sensor unit 240 , an output unit 250 , a power supply unit 260 , and a storage unit 270 . , a controller 280 , and an audio input unit 290 .

The wireless communication unit 220 may transmit/receive signals to and from the image display device 100 and, for example, the wireless communication unit 211 of the user input interface unit 150 .

Meanwhile, the coordinate value calculator 215 of the image display device 100 may calculate the coordinates of the pointer 205 from information about the movement of the remote control device 200 .

In this embodiment, the remote control device 200 may include an RF module 221 capable of transmitting and receiving a signal to and from the RF module 212 of the image display device 100 according to the RF communication standard. In addition, the remote control device 200 may include an IR module 223 capable of transmitting and receiving a signal to and from the IR module 213 of the image display device 100 according to the IR communication standard.

In addition, the remote control device 200 may further include an NFC module (not shown) for near field communication with an electronic device.

The remote control device 200 may transmit a signal containing information about the movement of the remote control device 200 to the image display device 100 through the RF module 221 .

Also, the remote control device 200 may receive a signal transmitted by the image display device 100 through the RF module 221 . In addition, the remote control device 200 may transmit commands related to power on/off, channel change, volume change, etc. to the image display device 100 through the IR module 223 as necessary.

Meanwhile, according to the present embodiment, the remote control device 200 may receive personal information through short-range magnetic field communication with a predetermined electronic device.

Meanwhile, the remote control device 200 may transmit received personal information to the image display device 100 . The communication method at this time may use an IR method or an RF method.

The user input unit 230 may include a keypad, a key (button), a touch pad, or a touch screen. The user may input a command related to the image display apparatus 100 to the remote control apparatus 200 by manipulating the user input unit 230 . When the user input unit 230 includes a hard key button, the user may input a command related to the image display device 100 to the remote control device 200 through a push operation of the hard key button. When the user input unit 230 includes a touch screen, the user may input a command related to the image display apparatus 100 to the remote control apparatus 200 by touching a soft key of the touch screen. In addition, the user input unit 230 may include various types of input means that the user can operate, such as a scroll key or a jog key, and this embodiment does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243 . The gyro sensor 241 may sense information about the movement of the remote control device 200 .

For example, the gyro sensor 241 may sense information about the operation of the remote control device 200 based on x, y, and z axes. The acceleration sensor 243 may sense information about the moving speed of the remote control device 200 . On the other hand, it may further include a distance measuring sensor, thereby, it is possible to sense the distance to the display 180. Alternatively, the amount of change in bearing can be detected by including a geomagnetic sensor that can detect the direction like a compass by grasping the flow of the magnetic field generated on the earth.

The output unit 250 may output an image or audio signal corresponding to an operation of the user input unit 230 or a signal transmitted from the image display apparatus 100 . Through the output unit 250 , the user may recognize whether the user input unit 230 is operated or whether the image display apparatus 100 is controlled.

For example, the output unit 250 includes an LED module 251 that is turned on when the user input unit 230 is manipulated or a signal is transmitted and received with the image display device 100 through the wireless communication unit 225, a vibration module that generates vibration ( 253), a sound output module 255 for outputting a sound, or a display module 257 for outputting an image may be provided.

The power supply unit 260 supplies power to the remote control device 200 . The power supply unit 260 may reduce power consumption by stopping the power supply when the remote control device 200 does not move for a predetermined time. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs and application data required for control or operation of the remote control device 200 . If the remote control device 200 wirelessly transmits and receives a signal through the image display device 100 and the RF module 221 , the remote control device 200 and the image display device 100 transmit the signal through a predetermined frequency band. send and receive The control unit 280 of the remote control device 200 stores information about a frequency band in which a signal can be wirelessly transmitted and received with the image display device 100 paired with the remote control device 200 in the storage unit 270 and can refer to

Also, the storage unit 270 may store IR format key codes for controlling other electronic devices as IR signals, and may store an IR format key database of a plurality of electronic devices.

The controller 280 controls all matters related to the control of the remote control device 200 . The control unit 280 transmits a signal corresponding to a predetermined key operation of the user input unit 230 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 240 to the image display device through the wireless communication unit 220 . (100) can be transmitted.

The audio input unit 290 is for an audio signal, and may include a microphone (MIC) or the like. The microphone may receive an external sound signal, for example, a user's voice signal, and process it as electrical voice data by a microphone.

Meanwhile, these audio signals and data may be transmitted to the image display device 100 through the wireless communication unit 220 .

7 is a flowchart illustrating a method of operating an image display apparatus according to an embodiment of the present invention, and FIGS. 8A to 11 are diagrams referenced to explain an operation method of an image display apparatus according to an embodiment of the present invention.

Referring to FIG. 7 , in the method of operating an image display apparatus according to an embodiment of the present invention, an audio signal including an audio signal and a sound signal of a speaker may be received through a microphone (S710).

The microphone (MIC) may receive an audio signal including a user's voice signal and a TV sound signal output through a built-in and/or external speaker and process it as electrical voice data.

Here, the microphone MIC may be a microphone provided in a remote control device or an image display device, or an external microphone connected through an interface unit.

The remote control apparatus 200 according to an embodiment of the present invention may include an audio input unit 290, and the audio input unit 290 is for an audio signal and may include a microphone (MIC). The microphone may receive an external sound signal, for example, a user's voice signal, and process it as electrical voice data by a microphone. Meanwhile, these audio signals and data may be transmitted to the image display device 100 through the wireless communication unit 220 .

Alternatively, the image display apparatus 100 according to an embodiment of the present invention may include a built-in microphone (MIC) to receive and process an audio signal.

Alternatively, the external microphone may be connected to the external device interface unit 130 or the network interface unit 135 to receive an audio signal processed by the external microphone.

Meanwhile, the microphone MIC may receive an analog audio signal and convert the received analog audio signal into a digital audio signal. Alternatively, the analog audio signal received by the microphone MIC may be converted into a digital audio signal through a separate analog-to-digital converter.

Meanwhile, the digital audio signal may be a multi-channel audio signal such as SPDIF, HDMI, MADI, or ADAT.

Meanwhile, the microphone (MIC) receives not only the user's voice but also the sound of the audio output through the built-in speaker or an external speaker connected to the image display device, and all of the received audio signals may be input for voice recognition.

Therefore, in order to perform accurate voice recognition, it is necessary to remove an acoustic signal generated from an audio device such as a speaker from an audio signal received from the microphone.

When the sound signal is removed, TV audio used as a reference signal and TV audio among audio from a microphone input terminal used for voice recognition are similar but not the same, so that the TV sound corresponding to noise may not be accurately removed.

For example, acoustic and/or audio signals may also be partially removed.

Also, audio from the microphone input terminal may vary depending on whether audio output is performed through a built-in speaker or an external speaker connected to the image display device.

Accordingly, there is a need to remove an acoustic signal in the most accurate and appropriate manner suitable for a situation, such as whether audio output is performed through a built-in speaker or an external speaker connected to an image display device.

According to the present invention, it is determined whether an external speaker is connected to the image display device (S720), and processing can be performed differently depending on whether an external speaker is connected. That is, a more effective sound cancellation method may be applied by selecting a reference signal to be used for appropriate sound cancellation according to whether an external speaker is connected.

Accordingly, it is possible to prevent a malfunction due to voice recognition and improve the voice recognition rate. In addition, since the sound output from the speaker is removed and only the user's voice is recognized, a malfunction of the image display apparatus can be prevented.

On the other hand, the external speaker may be a sound bar (Sound Bar, 400).

The sound bar 400 is an audio device separated from the image display device, and functions to process audio signals and output audio of the image display device, and may be used alone or as a speaker system in connection with one or more other speakers.

The sound bar 400 has a loud speaker configuration, and may be a loud speaker array in which a plurality of loudspeakers are linearly connected.

The sound bar 400 may reproduce a sound field by outputting an audio signal using a plurality of speakers. The sound bar 400 may perform panning, wave field synthesis, beam forming, and a focused source under an arrangement environment of a speaker system including the sound bar 400 alone or including the sound bar 400 . ), a multi-channel audio signal can be virtually reproduced using a 3D sound field processing technology such as a head related transfer function.

Referring to FIG. 7 , it is determined whether an external speaker is connected to the image display device according to an embodiment of the present invention ( S720 ), and when the external speaker is connected, an input signal of the external speaker may be analyzed. (S730)

Here, the input signal of the external speaker may be a digitized audio signal output by the image display device to the external speaker. In addition, the digitized audio signal may be an audio signal such as SPDIF, HDMI, MADI, ADAT, or the like.

The present invention captures the digitized signal before the output of the built-in speaker of the video display device or the connected external speaker, and uses it as a reference signal, which can be used to remove the speaker sound signal received from the microphone (MIC). have.

8A and 8B show an example of gain and frequency characteristics of TV speaker sound (-33 dB), respectively.

9A and 9B show an example of a gain and frequency characteristics of a sound bar sound (-29 dB), respectively.

8A, 8B, 9A and 9B are the sound before the digital amplifier (D-Amp) output, so the sound of the TV speaker and the gain and frequency characteristics are different. For example, referring to the drawings, the sound bar In the case of sound, it can be seen that the fluctuation range of high frequency is relatively large.

In addition, since the path through which the audio signal is transmitted to the built-in speaker goes through the digital amplifier (D-Amp), the signal can be captured before the digital amplifier (D-Amp) is output, but the path is transmitted to the sound bar 400 . is different from the existing TV sound capture path because it does not go through a digital amplifier (D-Amp).

In addition, since the transmission path of the audio signal is different, the signal captured by the microphone (MIC) and the capture signal of the sound bar may be significantly different from the captured signal of the TV.

In addition, since a delay may occur in TV sound input through the microphone MIC, it is necessary to remove the generated delay.

Accordingly, according to the present invention, input signal profiling can be performed separately depending on whether an external speaker is connected.

Comparing the input signal of the external speaker with the audio signal, correcting sound quality distortion and transmission delay of the audio signal (S740), and removing the sound signal of the speaker based on the corrected audio signal (S750)

10 is a diagram schematically illustrating a delay between a microphone signal and a sound bar capture signal.

FIG. 10 (a) shows a microphone capture signal, FIG. 10 (b) shows a TV capture signal, and FIG. 10 (c) shows a signal processed with a transmission delay.

Comparing FIG. 10(a) and FIG. 10(b), an interval (a1) in which one packet and system time are added for the microphone capture signal is equal to one packet and system time of the TV capture signal. It may be delayed by a transmission delay time (d) than the section (a2) in which the values are added, and a sample error between the TV capture signal and the microphone signal may occur.

Therefore, the signal (a3) processed by removing the transmission delay time (d) from the microphone capture signal can be used as an input for voice recognition.

According to an embodiment of the present invention, when sound is transmitted to an external speaker, a packet can be configured including system time information when TV sound is transmitted.

In addition, when TV sound is transmitted to an external speaker, a packet including system time information may be configured.

Accordingly, when the actual acoustic echo cancellation (AEC) is processed by comparing the audio signal (sound) input to the microphone and the captured sound, acoustic correction may be performed.

In addition, a header including a digital output gain of a digital audio signal and decoding information may be configured.

Accordingly, it is possible to improve voice recognition performance when using an external speaker (sound) device.

Meanwhile, in the correction step S740, a gain and frequency characteristics of an audio signal including an audio signal and a speaker sound signal through the microphone MIC may be corrected. When the sound bar 400 is connected to the image display device (TV), as described with reference to FIGS. 8A, 8B, 9A and 9B, the gain increases, and the fluctuation range of the high frequency is relatively large. , the control unit 170 and/or the audio processing unit 315 may reduce a gain of the audio signal and flatten the frequency characteristic.

The audio processing unit 315 may perform subband analysis and filtering on the input audio signal. That is, a sub-band analysis filter bank is provided to convert an audio signal whose sound phase localization is controlled into a frequency signal. The subbands of the filtered audio signal may be 32 subbands or 64 subbands or FFT subbands.

As described above, the phase adjustment or gain adjustment may be performed on the audio signal divided for each frequency band for each frequency band or for each frequency band group.

The audio processing unit 315 may perform at least one of phase adjustment and gain adjustment on the audio signal for each frequency band.

To this end, the audio processing unit 315 may adjust a gain for each frequency band separated for each band.

The gain adjustment method may be performed in various ways. For example, the gain may be independently adjusted in all frequency bands, the gain may be adjusted by dividing a band or a band only for a specific frequency range, or the gain may be adjusted for each group by grouping the specific frequency ranges into groups.

11 shows a comparison of the input signal of the external speaker with the audio signal to correct sound quality distortion and transmission delay of the audio signal (S740), and based on the corrected audio signal, the audio signal of the speaker The result of removing (S750) is shown.

That is, as a result of the sound processing according to the present invention, the sound output from the TV through the sound bar 400 and the voice are separated from the microphone signal, so that voice recognition can be performed with the user's voice signal processed as shown in FIG. 11, (S760) ) The image display device may perform a corresponding operation based on the determined voice recognition result data.

Meanwhile, the voice recognition step S760 includes extracting a feature vector based on the voice signal from which the sound signal of the speaker is removed, comparing the feature vector with the voice database, and data corresponding to the received voice signal. It may include a step of determining The voice recognition step S760 will be described later with reference to FIG. 14 .

Meanwhile, referring to FIG. 7 , when the external speaker is not connected (S720), the input signal of the built-in speaker of the image display device 100, for example, the digital amplifier (D-Amp) is analyzed (S770). ) The audio signal is compared with the input signal of the built-in speaker, and distortion of sound quality and transmission delay of the audio signal are corrected (S780).

Meanwhile, based on the corrected audio signal, the sound signal of the speaker may be removed (S750), and voice recognition may be performed based on the signal from which the sound signal of the speaker is removed (S760).

That is, according to the present invention, a reference signal to be used for sound cancellation is configured differently according to a speaker to output the TV-side sound, so that the audio signal can be corrected-sound-cancelled.

According to the present invention, voice recognition performance can be improved even when an external audio output device such as the sound bar 400 is connected.

In addition, conventionally, there is a limit to the reverberation performance when using a sound bar other than a TV speaker. However, according to the present invention, voice recognition can be used regardless of the acoustic characteristics and connection state of an external audio output device, and an image with a plurality of speakers connected There is an advantage that it can be used in a display device system.

In addition, voice recognition can be used with an external microphone (MIC) system such as a built-in microphone (MIC) and a USB microphone.

12 is a flowchart illustrating a method of operating an image display device according to an embodiment of the present invention.

12 , the image display device 100 according to the embodiment of the present invention may first capture a microphone signal. (S1210) In this case, the captured microphone signal is an audio signal and a speaker sound signal. may include

The image display apparatus 100 may determine whether an external speaker such as the sound bar 400 is connected. (S1220)

If an external speaker is not connected, the TV sound may be captured ( S1230 ). At this time, the captured TV sound may be a digitized audio signal captured from the input terminal of the digital amplifier (D-AMP).

The image display apparatus 100 may determine whether there is a delay by comparing the captured microphone signal and the captured TV sound (S1240).

If there is no delay, the speaker-side sound may be removed from the captured microphone signal by using the captured TV sound as a reference signal (S1250).

If there is a delay, the delayed time is analyzed (S1245), the analyzed time speech sample is converted to correct the transmission delay (S1247), and then refer to the corrected TV sound It is possible to remove the speaker-side sound from the captured microphone signal by using it as a signal. (S1250)

If an external speaker is connected, a profiling process may be performed on the input signal by capturing the sound of an external speaker such as a sound bar (S1235). It may be a digitized audio input signal captured in .

Meanwhile, a gain and frequency characteristics of an audio signal including an audio signal and a speaker sound signal may be corrected through the microphone MIC.

In particular, it is possible to convert a digital output gain and signal of an external speaker sound (S1237).

When the sound bar 400 is connected to the image display device (TV), as described with reference to FIGS. 8A, 8B, 9A and 9B, the gain increases, and the fluctuation range of the high frequency is relatively large. , the control unit 170 and/or the audio processing unit 315 may reduce a gain of the audio signal and flatten the frequency characteristic.

When output to an external speaker such as the sound bar 400, there is usually a delay, so the delayed time is analyzed (S1245), and the analyzed time voice sample is converted to reduce the transmission delay. After the correction (S1247), the speaker-side sound may be removed from the captured microphone signal by using the corrected sound bar sound as a reference signal (S1250).

FIG. 13 is an example of an internal block diagram of the control unit of FIG. 2 , and in particular, an embodiment of the audio processing unit 315 is shown.

Referring to FIG. 13 , the audio processing unit 315 may process an audio signal input from an audio input device.

The audio processing unit 315 may perform audio signal processing on the audio signal demultiplexed by the demultiplexer 310 or an audio signal directly input from the network interface unit 135 or the external device interface unit 130 . have. To this end, the audio processing unit 315 may include various decoders.

Also, the audio processing unit 315 may include a mixer for mixing audio signals decoded by various decoders, particularly audio signals of various channels.

Meanwhile, the audio processing unit 315 may include a sound engine 1310 that performs signal processing for sound to be output. According to an embodiment, the sound engine 1310 may include the decoder, mixer, or the like.

Also, the audio processing unit 315 may include a sound removing unit 1320 .

The sound removing unit 1320 may filter a predetermined component from an input audio signal, remove a predetermined sound signal, or adjust at least one of a gain or a phase of an audio signal to be output for each frequency band. have.

Meanwhile, the audio processing unit 315 may include an audio digital signal processor (DSP) 1330 that controls the overall operation of the audio processing unit 315 .

Meanwhile, the processed audio signal may be sound output to a built-in speaker through a digital-amplifier (D-Amp) 185 or may be sound output from an external sound output device, for example, the sound bar 400 .

Meanwhile, the image display device 100 may be connected to a sound output device such as the sound bar 400 by wire/wireless through the external device interface unit 130 and transmit digital signals such as SPDIF and HDMI.

According to an embodiment of the present invention, since the audio signal transmitted to the external speaker such as the sound bar 400 is different from the sound field effect in the image display system, a transmission path before and after the sound engine 1310 can be implemented.

That is, since the audio signal transmitted to the external speaker such as the sound bar 400 has a different sound field effect from that of the existing signal, the phase difference of the captured signal due to the directionality according to the position when configuring the multi-channel sound system can also be corrected.

In addition, as shown in FIG. 13, since the path for transmitting a signal to the sound bar 400 does not go through the D-Amp 185, unlike the conventional TV sound capture path that is captured from the D-Amp 185 input terminal, the sound bar ( 400) can be captured.

Meanwhile, the method of operating an image display device according to an embodiment of the present invention may further include filtering a noise component of the audio signal.

14 is a diagram referenced in the description of a voice recognition process according to an embodiment of the present invention.

Referring to FIG. 14 , preprocessing such as noise processing is first performed on a received voice signal 1410. In step 1420, the preprocessing process includes only the voice section from the input signal like end-point detection. It is possible to use a detection processing method, a method of extracting statistical features with a relatively simple calculation process from an input signal, and classifying a speech section and a silent section.

A generally used method is to obtain an energy value (or log energy value) in every section of the input signal and compare it with a threshold value predetermined by statistics to determine a speech section and a silence section.

Also, the preprocessing process may include a noise processing process of removing noise.

Meanwhile, the preprocessing process 1420 may further include necessary additional noise processing and signal processing.

Thereafter, a feature vector (parameter) effective for recognition is extracted from the input voice signal ( 1430 ).

Here, a method based on Linear Predictive Coefficients (LPC) and a method for extracting Mel Frequency Cepstral Coefficients (MFCC) may be used.

Thereafter, a voice signal and a pattern of the extracted feature parameter may be recognized ( 1440 ), and an acoustic model ( 1441 ) may be used for pattern recognition.

This is a method of modeling and comparing the signal characteristics of speech, and a direct comparison method of setting the recognition target as a feature vector model and comparing it with the feature vector of the input signal can be used. In the direct comparison method, units such as words and phonemes to be recognized are set as a feature vector model, and how similar the input speech is can be compared.

Alternatively, a statistical method for statistically processing and using a feature vector of a recognition target may be used. In this statistical method, the unit for recognition is composed of a state sequence, and the relationship between the state sequences can be used. The DTW (Dynamic Time Warping) method using a temporal arrangement relationship, probability value, mean, and variance are compared. and HMM (Hidden Markov Model) method.

In more detail, DTW (Dynamic Time Warping) is a method to obtain the distance between a reference voice signal and an input voice signal using dynamic programming.

HMM (Hidden Markov Model) is a method of expressing the change of a negative state from one state to the next as a transition probability. It is a method to adopt a probabilistic model with a high degree of similarity to the recognition result.

Thereafter, data corresponding to the received voice signal may be determined and a recognition result 1960 may be output.

Meanwhile, the data determination process may include an operation of the language processing 1450 using the language model 1451 .

A language model is generally to find the probability values for all possible word sequences, a grammar-based method that considers only the word sequences that are grammatically correct for a given situation among possible word combinations, and from a database of voices uttered in a given situation , a statistics-based method for statistically estimating probability values of possible word sequences may be used.

Speech recognition compares the input voice with data such as a stored acoustic model and a language model, and outputs the most similar data as the recognition result data.

For example, the embedded voice engine provided in the image display device 100 extracts features of a voice signal input through a microphone or a remote control device in a vector form, and the extracted feature vector and sound model, language model, and pronunciation A voice recognition result may be output using a voice database including phonetic information such as a dictionary.

The image display apparatus 100 obtains a recognition result by comparing the voice database with the feature vector. In more detail, a speech recognition result can be obtained by comparing the feature vector with an acoustic model that models and compares the signal characteristics of speech and a language model that models a linguistic order relationship such as words or syllables corresponding to the recognition vocabulary. have.

In the method of operating an image display device according to an embodiment of the present invention, the configuration and method of the embodiments described above are not limitedly applicable, but the embodiments are all of the embodiments so that various modifications can be made. Alternatively, some may be selectively combined and configured.

Meanwhile, the method of operating an image display apparatus of the present invention can be implemented as processor-readable codes on a processor-readable recording medium provided in the image display apparatus. The processor-readable recording medium includes all types of recording devices in which data readable by the processor is stored. Examples of the processor-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc., and also includes those implemented in the form of carrier waves such as transmission over the Internet . In addition, the processor-readable recording medium is distributed in a computer system connected to a network, so that the processor-readable code can be stored and executed in a distributed manner.

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention as claimed in the claims In addition, various modifications may be made by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

Broadcast receiver: 105
External device interface unit: 130
Storage: 140
User input interface: 150
Control: 170
Display: 180
Audio output: 185

Claims (10)

Operation of an image display device comprising: an audio processing unit for signal processing an audio signal; a digital amplifier for amplifying a signal output from the audio processing unit; and a speaker for outputting a first sound based on the amplified signal from the digital amplifier In the method,
receiving an audio signal through a microphone (MIC) and receiving an audio signal including an audio signal output from the digital amplifier to a speaker;
receiving a signal output from the audio processing unit and determining whether an external speaker outputting a second sound is connected;
analyzing an input signal of the external speaker when the external speaker is connected;
Comparing the input signal of the external speaker with the audio signal, correcting a sound quality distortion and transmission delay of the audio signal; and,
On the basis of the corrected audio signal, removing the sound signal of the speaker;
The input signal of the external speaker includes system time information,
comparing the audio signal with the input signal of the external speaker based on the system time information,
A signal is transmitted from the audio processing unit to the external speaker without passing through the digital amplifier, and the transmission delay of the audio signal is generated by the digital amplifier. According to claim 1,
The method of operating an image display device, characterized in that the external speaker is a sound bar (Sound Bar). According to claim 1,
extracting a feature vector based on the audio signal from which the sound signal of the speaker is removed; and,
and comparing the feature vector with a voice database to determine data corresponding to the received voice signal. 4. The method of claim 3,
The method of operating an image display device further comprising; performing a corresponding operation based on the determined data. According to claim 1,
The microphone (MIC) is a microphone provided in a remote control device or an image display device, or an external microphone connected through an interface unit. According to claim 1,
analyzing the input signal of the built-in speaker when the external speaker is not connected; and
Comparing the input signal of the built-in speaker with the audio signal, correcting distortion of sound quality and transmission delay of the audio signal; According to claim 1,
The method of operating an image display device further comprising; filtering a noise component of the audio signal. According to claim 1,
The method of operating an image display device, characterized in that the input signal of the external speaker is a digitized audio signal output by the image display device to the external speaker. According to claim 1,
The correcting step comprises correcting a gain and frequency characteristics. 10. The method of claim 9,
In the correcting step, the gain is reduced and the frequency characteristic is flattened and corrected.

Images