KR101938666B1 - Video processing apparatus and method thereof - Google Patents

Abstract

The method includes displaying a three-dimensional image including at least one object, arranging the object so as to be adjacent to the at least one object, determining a relative position of the object and the three- Dimensional image of the object and the object are overlapped, and changing the object when the at least a part of the object overlaps with the three-dimensional image of the object, And a video display device.

Description

TECHNICAL FIELD [0001] The present invention relates to a video display apparatus and a control method thereof.

The present invention relates to an image processing apparatus for outputting a three-dimensional image and a control method thereof.

Generally, the image processing apparatus that outputs three-dimensional stereoscopic images can sense the stereoscopic effect in the flat display hardware by using the binocular disparity which occurs when the human eye is about 6 mm away from the lateral direction It is the sum of the systems that make it possible.

In other words, the human eye sees a difference image even when looking at the same object because of the binocular parallax, and when these two images are transmitted to the brain through the retina, they are correctly fused to realize a stereoscopic effect. Dimensional stereoscopic image processing apparatus that displays two right and left images at the same time in a two-dimensional display device and produces a virtual stereoscopic effect through a design that sends them to each eye.

In recent years, in addition to a technique of inputting a signal to a display unit that outputs a two-dimensional image, a technique of interacting with a three-dimensional stereoscopic image output from a display unit that outputs a three- Research is underway.

However, since a plurality of three-dimensional stereoscopic images include a plurality of objects and at least one of the right-eye image and the left-eye image is obscured when an object approaching to interact with one object covers a part of the display, It does not display. Therefore, the quality of the stereoscopic image may be deteriorated.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to improve the quality of a stereoscopic image of a video display device.

According to another aspect of the present invention, there is provided a method of controlling an image display apparatus including displaying a three-dimensional image including at least one object, arranging an object adjacent to the at least one object, Dimensional image of the object and a three-dimensional image of the object according to a predetermined reference plane, determining whether the three-dimensional image of the object overlaps with the three-dimensional image of the object, And changing the object if at least a portion of the object overlaps.

According to an embodiment of the present invention, the control method further includes sensing a relative position of the object and a three-dimensional image of the object with reference to the reference plane.

As an example related to the present invention, when the object is closer to the reference plane than the 3D image of the object, the shape of the object is changed.

According to an embodiment of the present invention, the object includes first and second objects having different depths, a three-dimensional image of the first object is outputted closer to the reference surface than a three-dimensional image of the second object, The control method includes the step of the object being disposed adjacent to the three-dimensional image of the second object to input a signal to the second object.

According to another embodiment of the present invention, the control method further comprises the steps of transmitting information corresponding to the second object by the signal to a server via a wired communication network, and transmitting the information corresponding to the second object Dimensional stereoscopic image on the display unit.

According to an embodiment of the present invention, when the three-dimensional image of the object overlaps with at least a part of the object, the step of modifying the object may include a step of modifying the object, Increasing the transparency of one region of the stereoscopic image of the first object and increasing the transparency of the entire stereoscopic image of the first object when a signal is input to the second object.

As an example related to the present invention, when the three-dimensional image of the object and at least a part of the object overlap, the step of changing the object includes increasing the transparency of at least a part of the three-dimensional image of the object.

In one embodiment of the present invention, when the 3D image of the object overlaps with at least a part of the object, the step of modifying the object includes displaying an edge of the 3D image of the object.

As an example related to the present invention, the control method includes deleting a three-dimensional image of the object.

According to an embodiment of the present invention, when the 3D image of the object overlaps with at least a part of the object, the step of modifying the object includes a step of classifying the 3D image of the object, And increasing the transparency of the overlapping region.

According to an embodiment of the present invention, the control method includes a step of outputting a 3D image of the object by changing its position.

According to an embodiment of the present invention, when the 3D image of the object overlaps with at least a part of the object, the step of modifying the object may include changing an edge area of the 3D image of the object and at least a part of the edge area of the object And moving the object to move the object.

According to another aspect of the present invention, there is provided an image display apparatus including a display unit and a sensing unit. And a control unit. The display unit is configured to display a three-dimensional stereoscopic image including at least one object. The sensing unit senses a relative position with respect to the display unit of the object disposed adjacent to the display unit. The control unit compares the three-dimensional relative position of the object with the relative position of the object based on the display unit, and changes the shape of the object when at least a part of the object overlaps with the object.

According to an embodiment of the present invention, the controller senses a three-dimensional image of the object and a relative position of the object with reference to the display unit, and when the object is disposed closer to the display unit than the three- And controls the display unit to change the shape of the object.

As an example related to the present invention, the control unit controls the display unit to increase the transparency of at least a part of the three-dimensional image of the object.

According to an embodiment of the present invention, the control unit controls the display unit to distinguish a region overlapping the object of the three-dimensional image of the object with the remaining region, and to increase transparency of the overlapping region.

As an example related to the present invention, the control unit controls the display unit to display an edge of a three-dimensional image of the object.

According to an embodiment of the present invention, the control unit controls the display unit to change a three-dimensional image of the object so as to be spaced apart from the object.

According to an embodiment of the present invention, the control unit may include first and second objects having different depths, and the three-dimensional image of the first object may be displayed on the display unit Wherein at least a portion of the object passes through the second object, one end of the object is disposed in contact with the second object, and the control unit controls the display to change the shape of at least one area of the second object .

In one embodiment of the present invention, when the object is in contact with the object and a signal is input, the controller transmits information corresponding to the object to the server via a wireless or wired communication network, And controls the display unit to display the display unit.

In one embodiment of the present invention, the display unit displays the three-dimensional stereoscopic image between the display unit and the user.

In one embodiment of the present invention, the display unit displays the three-dimensional stereoscopic image in a direction opposite to a user, and is formed of a transparent material on both sides so that the user can recognize the object.

In the present invention, when an object and an object are superimposed, the shape of the damaged object is prevented from being displayed by changing the object, and the quality of the stereoscopic image can be improved because the object is more clearly recognized.

In addition, since more accurate information can be provided, the electrical interaction between the object and the object can be easily performed, thereby improving the convenience of the user.

1 is a block diagram illustrating a configuration of a mobile communication terminal to which an image processing apparatus according to embodiments of the present invention is applied.
BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an image display apparatus.
3 is a configuration diagram illustrating an image processing apparatus according to embodiments of the present invention.
4 is a flowchart showing a control method of the image processing apparatus of the present invention.
5 illustrates an object that is obscured by an object in accordance with an embodiment of the present invention.
6A and 6B are conceptual diagrams for explaining how the shape of an object is changed according to an embodiment;
FIG. 7A and FIG. 7B are conceptual diagrams for explaining how the shape of an object is changed according to another embodiment. FIG.
FIG. 8A and FIG. 8B are conceptual diagrams for explaining how the shape of an object is changed according to another embodiment. FIG.
9A and 9B are conceptual diagrams for explaining how an object moves according to another embodiment;
Figs. 10A to 10E are conceptual diagrams for explaining how two objects interact with each other. Fig.

It is noted that the technical terms used herein are used only to describe specific embodiments and are not intended to limit the invention. It is also to be understood that the technical terms used herein are to be interpreted in a sense generally understood by a person skilled in the art to which the present invention belongs, Should not be construed to mean, or be interpreted in an excessively reduced sense. Further, when a technical term used herein is an erroneous technical term that does not accurately express the spirit of the present invention, it should be understood that technical terms that can be understood by a person skilled in the art are replaced. In addition, the general terms used in the present invention should be interpreted according to a predefined or prior context, and should not be construed as being excessively reduced.

Also, the singular forms "as used herein include plural referents unless the context clearly dictates otherwise. In the present application, the term "comprising" or "comprising" or the like should not be construed as necessarily including the various elements or steps described in the specification, Or may be further comprised of additional components or steps.

Furthermore, terms including ordinals such as first, second, etc. used in this specification can be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or similar elements throughout the several views, and redundant description thereof will be omitted.

In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. It is to be noted that the accompanying drawings are only for the purpose of facilitating understanding of the present invention, and should not be construed as limiting the scope of the present invention with reference to the accompanying drawings.

1 is a block diagram illustrating a configuration of a mobile communication terminal 100 to which an image processing apparatus according to embodiments of the present invention is applied. The mobile communication terminal (mobile phone) 100 may be implemented in various forms. For example, the mobile communication terminal 100 includes a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), and a PMP (Portable Multimedia Player).

1, the mobile communication terminal 100 includes a wireless communication unit 110, an A / V (audio / video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150 A memory 160, an interface unit 170, a control unit 180, a power supply unit 190, and the like. All of the components of the mobile communication terminal 100 shown in FIG. 1 are not essential components, and the mobile communication terminal 100 may be implemented by more components than the components shown in FIG. 1, The mobile communication terminal 100 may be implemented by a component.

The wireless communication unit 110 may include at least one component for performing wireless communication between the mobile communication terminal 100 and the wireless communication system or wireless communication between the mobile communication terminal 100 and a network on which the mobile communication terminal 100 is located . For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114 and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may be a server for generating and transmitting broadcast signals and / or broadcast-related information, or a server for receiving previously generated broadcast signals and / or broadcast-related information and transmitting the broadcast signals and / or broadcast- related information to the mobile communication terminal 100 . The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, it may be received by the mobile communication module 112. The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data related to transmission and reception of a voice call signal, a video call signal, and / or a text / multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 can be embedded in the mobile communication terminal 100 or externally. Here, the wireless Internet technology includes a wireless LAN (WLAN), a Wi-Fi, a wireless broadband (Wibro), a WiMAX, a high speed downlink packet access (HSDPA) Can be used.

The short-range communication module 114 means a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, etc. may be used as the short distance communication technology.

The position information module 115 is a module for confirming or obtaining the position of the mobile terminal (capable of checking the position of the vehicle when the mobile terminal is mounted on the vehicle). One example is the GPS (Global Position System) module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information indicated by latitude and longitude. For example, the GPS module can accurately calculate the current position according to the triangle method by measuring the precise time and distance from three or more satellites and measuring three different distances. A method of obtaining distance and time information from three satellites and correcting the error by one satellite may be used. In particular, the GPS module can acquire latitude, longitude and altitude as well as three-dimensional velocity information and accurate time from the position information received from the satellite. A Wi-Fi Positioning System and / or a Hybrid Positioning System may be applied as the location information module 115.

The position information module 115 may further include a geomagnetic sensor and / or a gravity sensor for detecting a direction. For example, the position information module 115 detects directions (e.g., north, south, east, and west) of a mobile communication terminal for implementing navigation using augmented reality through the geomagnetic sensor (electronic compass). The position information module 115 detects in which direction gravity acts through the gravity sensor (G sensor). When the user holds the mobile communication terminal vertically, the position information module 115 displays a vertical screen, , The screen is automatically rotated 90 degrees to show a wide screen. Also, when the user watches the moving image, the position information module 115 rotates the screen according to the direction in which the user holds the mobile communication terminal through the gravity sensor (G sensor) so that the user can easily view the image.

The A / V input unit 120 is for inputting an audio signal or a video signal. The A / V input unit 120 includes a camera 121 and a microphone 122, . The camera 121 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be composed of two or more according to the configuration of the mobile terminal.

The microphone 122 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, and the like, and processes it as electrical voice data. In the call mode, the processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the mobile terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. Particularly, when the touch pad has a mutual layer structure with the display unit 151, it can be called a touch screen.

The sensing unit 140 senses the position of the mobile communication terminal 100 in the open / close state, the position of the mobile communication terminal 100, the presence of the user, the orientation of the mobile communication terminal 100, The mobile communication terminal 100 senses the current state of the mobile communication terminal 100 and generates a sensing signal for controlling the operation of the mobile communication terminal 100. For example, when the mobile communication terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. The sensing unit 140 senses whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like.

The interface unit 170 serves as an interface with all external devices connected to the mobile communication terminal 100. For example, the interface unit 170 may include a headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, An audio input / output (I / O) port, a video I / O (input / output) port, and an earphone port. Here, the identification module is a chip that stores various information for authenticating the usage right of the mobile communication terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM) ), A Universal Subscriber Identity Module (" USIM "), and the like. In addition, an apparatus (hereinafter, referred to as 'identification device') having the identification module may be manufactured in a smart card format. Accordingly, the identification module can be connected to the mobile communication terminal 100 through the port. The interface unit 170 receives data from an external device or receives power from the external device and transmits the received data to each component in the mobile communication terminal 100 or transmits data in the mobile communication terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 includes a display unit 151, an audio output module 152, an alarm unit 153, May be included.

The display unit (display unit) 151 displays information to be processed by the mobile communication terminal 100 and outputs the information. For example, when the mobile communication terminal 100 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile communication terminal 100 is in the video communication mode or the photographing mode, the displayed image or the UI or GUI is displayed.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display (3D display). There may be two or more display units 151 according to the embodiment of the mobile communication terminal 100. For example, the mobile communication terminal 100 may be provided with an external display unit (not shown) and an internal display unit (not shown) at the same time.

(Hereinafter, referred to as a 'touch screen') has a mutual layer structure with the display unit 151 and a sensor (hereinafter, referred to as 'touch sensor' It can also be used as an input device in addition to the device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch. If there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the control unit 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

In the present invention, the proximity-touch means that the pointer is not actually touched on the screen but approaches a predetermined distance from the screen.

The proximity sensor 141 may be disposed in an inner region of the mobile communication terminal 100 or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface or an object existing in the vicinity thereof without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 141 has a longer lifetime and higher utilization than the contact-type sensor.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually touching the pointer on the screen is called "Contact Touch ". A position where the pointer is proximally touched on the touch screen means a position where the pointer corresponds to the touch screen vertically when the pointer is touched.

Further, the proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, do. Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sensing unit 140 may include an acceleration sensor 142. The acceleration sensor 142 is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology. Since the acceleration sensor 142 measures the acceleration of a large value that is built in the airbag system of an automobile and used to detect a collision, the acceleration sensor 142 recognizes the minute motion of a human hand and calculates a minute value acceleration There are various kinds of things to measure. The acceleration sensor 142 is usually configured by mounting two or three axes in one package. In some cases, only one axis of the Z axis is required depending on the use environment. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, and a broadcast reception mode. The sound output module 152 outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile communication terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile communication terminal 100. Examples of events that occur in the mobile terminal include receiving a call signal, receiving a message, and inputting a key signal. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. When the call signal is received or the message is received, the alarm unit 153 can vibrate the mobile terminal through the vibration means to inform it. Alternatively, when the key signal is input, the alarm unit 153 may vibrate the mobile communication terminal 100 through the vibration means with the feedback of the key signal input. Through the above-described vibration, the user can recognize the occurrence of the event. Of course, a signal for notifying the occurrence of an event may also be output through the display unit 151 or the audio output module 152.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of air through the injection port or the suction port, a spit on the skin surface, contact with an electrode, And various effects of tactile effect such as effect of reproducing the cold sensation using the heat absorbing or heatable element can be generated.

The haptic module 154 can transmit a tactile effect through direct contact, and the tactile effect can be felt by a user through a muscular sense such as a finger or an arm. At least two haptic modules 154 may be provided according to the configuration of the telematics terminal. The haptic module 154 may be provided in a place where frequent contact with a user is frequent in the vehicle. For example, a steering wheel, a shift gear lever, a seat, and the like.

The memory 160 may store a program for processing and controlling the controller 180 and temporarily store the input / output data (e.g., map data, a phone book, a message, a still image, For example.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) A disk, and / or an optical disk. In addition, the mobile communication terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, the interface unit 170 may include a headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, An audio input / output (I / O) port, a video I / O (input / output) port, and an earphone port. Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM) A Universal Subscriber Identity Module (USIM), and the like. In addition, the device having the identification module (hereinafter, referred to as 'identification device') can be manufactured in a smart card format. Accordingly, the identification module can be connected to the mobile terminal 100 through the port. The interface unit 170 receives data from an external device or receives power from the external device and transmits the received data to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device.

When the mobile terminal 100 is connected to an external cradle, the interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100, or various commands A signal may be transmitted to the mobile terminal 100. The various command signals or the power source inputted from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile communication terminal 100. For example, the control unit 180 performs related control and processing for voice call, data communication, video call, and the like. In addition, the controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180.

The control unit 180 can perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 and supplies power required for operation of the respective components.

The functions of the components applied to the mobile communication terminal 100 may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof. According to a hardware implementation, an application specific integrated circuit (ASIC), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs) controllers may be implemented using at least one of micro-controllers, microprocessors, and electrical units for performing functions. In some cases, such embodiments may be implemented by the controller 180 In accordance with a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be stored in a software application written in a suitable programming language The software code may be stored in the memory 160, May also be performed by the < / RTI >

The voice recognition module 182 recognizes a voice uttered by a user and performs a corresponding function according to the recognized voice signal.

A navigation session 300 applied to the mobile communication terminal 100 displays a traveling route on the map data.

Details of the components of the image processing apparatus applied to the mobile communication terminal 100 according to the embodiments of the present invention will be described with reference to FIG. 3 to FIG.

Hereinafter, a configuration of an image display apparatus 200 to which an image processing apparatus according to embodiments of the present invention is applied will be described with reference to FIG.

2 is a block diagram showing the configuration of an image display apparatus 200 to which an image processing apparatus according to embodiments of the present invention is applied.

2, an image display apparatus 200 according to embodiments of the present invention includes a tuner 210, a demodulator 220, an external device interface 230, a network interface 235, A user input interface unit 250, a control unit 270, a display 280, an audio output unit 285, and a 3D viewing device 295, as shown in FIG.

The tuner 210 selects an RF broadcast signal corresponding to a channel selected by the user or all previously stored channels among RF (Radio Frequency) broadcast signals received through the antenna. The tuner 210 converts a selected RF broadcast signal into an intermediate frequency signal, a baseband image, or a voice signal. For example, the tuner 210 converts the selected RF broadcasting signal into a digital IF signal (DIF) if it is a digital broadcasting signal and converts it into an analog baseband image or a voice signal (CVBS / SIF) if it is an analog broadcasting signal. That is, the tuner 210 can process a digital broadcast signal or an analog broadcast signal.

The analog baseband video or audio signal (CVBS / SIF) output from the tuner 210 can be directly input to the controller 270.

Also, the tuner 210 can receive RF carrier signals of a single carrier according to an Advanced Television System Committee (ATSC) scheme or RF carriers of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

Meanwhile, the tuner 210 sequentially selects RF broadcast signals of all the broadcast channels stored through the channel memory function among the RF broadcast signals received through the antenna, and outputs the selected RF broadcast signals as an intermediate frequency signal, a baseband image, or a voice signal Can be converted.

The demodulator 220 receives the digital IF signal DIF converted by the tuner 210 and performs a demodulation operation. For example, when the digital IF signal output from the tuner 210 is of the ATSC scheme, the demodulator 220 performs 8-VSB (7-Vestigal Side Band) demodulation. Also, the demodulator 220 may perform channel decoding.

The demodulator 220 includes a Trellis decoder, a de-interleaver, and a Reed Solomon decoder. The demodulator 220 performs trellis decoding, deinterleaving, Remote decoding can be performed. For example, when the digital IF signal output from the tuner 210 is a DVB scheme, the demodulator 220 performs COFDMA (Coded Orthogonal Frequency Division Modulation) demodulation. Also, the demodulator 220 may perform channel decoding. For this, the demodulator 220 may include a convolution decoder, a deinterleaver, and a reed-solomon decoder to perform convolutional decoding, deinterleaving, and reed solomon decoding.

The demodulation unit 220 may perform demodulation and channel decoding and then output a stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 TS (Transport Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

The demodulation unit 220 may be separately provided according to the ATSC scheme and the DVB scheme. That is, it can be provided as an ATSC demodulation unit and a DVB demodulation unit.

The stream signal output from the demodulation unit 220 may be input to the controller 270. The controller 270 performs demultiplexing, video / audio signal processing, and the like, and then outputs an image to the display 280 and outputs audio to the audio output unit 285.

The external device interface unit 230 can transmit or receive data with the connected external device. To this end, the external device interface unit 230 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 230 is connected to an external device (not shown) such as a DVD (Digital Versatile Disk), a Blu ray, a game device, a camera, a camcorder, . The external device interface unit 230 transmits external video, audio, or data signals to the controller 270 of the video display device 200 through the connected external device. Also, the control unit 270 can output the processed video, audio, or data signal to the connected external device. To this end, the external device interface unit 230 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

A / V input / output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit can perform short-range wireless communication with other electronic devices. The video display device 200 may be a communication device such as a Bluetooth, a Radio Frequency Identification (RFID), an IrDA, an Ultra Wideband (UWB), a ZigBee, a Digital Living Network Alliance Depending on the standard, it can be networked with other electronic devices.

Also, the external device interface unit 230 may be connected to the various set-top boxes via at least one of the various terminals described above to perform input / output operations with the set-top box.

On the other hand, the external device interface unit 230 can transmit and receive data to and from the 3D viewing device 295.

The network interface unit 235 provides an interface for connecting the video display device 200 to a wired / wireless network including the Internet network. The network interface unit 235 may include an Ethernet terminal and the like for connection to a wired network and may be a WLAN (Wireless LAN) (Wi-Fi), a Wibro (Wireless) broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed Downlink Packet Access) communication standards.

The network interface unit 235 can receive, via the network, contents or data provided by the Internet or a content provider or a network operator. In other words, it is possible to receive contents such as movies, advertisements, games, VOD, broadcasting signals, and related information provided from the Internet and contents providers through a network. In addition, the update information and the update file of the firmware provided by the network operator can be received. It may also transmit data to the Internet or a content provider or network operator.

The network interface unit 235 is connected to, for example, an IP (Internet Protocol) TV, receives the processed video, audio, or data signals from the settop box for IPTV, And can transmit the signals processed by the controller 270 to the IPTV set-top box.

Meanwhile, the IPTV may include ADSL-TV, VDSL-TV, FTTH-TV and the like depending on the type of the transmission network. The IPTV may include a TV over DSL, a video over DSL, a TV over IP BTV), and the like. In addition, IPTV may also mean an Internet TV capable of accessing the Internet, or a full browsing TV.

The storage unit 240 may store a program for each signal processing and control in the control unit 270, and may store image-processed video, audio, or data signals.

In addition, the storage unit 240 may perform a function for temporarily storing video, audio, or data signals input to the external device interface unit 230. In addition, the storage unit 240 may store information on a predetermined broadcast channel through a channel memory function such as a channel map.

The storage unit 240 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) RAM, ROM (EEPROM, etc.), and the like. The video display device 200 can reproduce files (moving picture files, still picture files, music files, document files, etc.) stored in the storage unit 240 and provide them to the user.

2 illustrates an embodiment in which the storage unit 240 is provided separately from the control unit 270, the scope of the present invention is not limited thereto. The storage unit 240 may be included in the controller 270.

The user input interface unit 250 transmits a signal input by the user to the control unit 270 or a signal from the control unit 270 to the user. For example, the user input interface unit 250 may be configured to turn on / off the power, select the channel, and display the screen from the remote control device 260 according to various communication methods such as a radio frequency (RF) communication method and an infrared Or transmit a signal from the control unit 270 to the remote control device 260. The remote control device 260 may be a remote control device.

For example, the user input interface unit 250 may transmit a user input signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 270.

For example, the user input interface unit 250 may transmit a user input signal input from a sensing unit (not shown) that senses the gesture of the user to the control unit 270, To a sensing unit (not shown). Here, the sensing unit (not shown) may include a touch sensor, an audio sensor, a position sensor, an operation sensor, and the like.

The control unit 270 demultiplexes the input stream or processes the demultiplexed signals through the tuner 210 or the demodulation unit 220 or the external device interface unit 230 to generate a signal for video or audio output Can be generated and output.

The image signal processed by the controller 270 may be input to the display 280 and displayed as an image corresponding to the image signal. In addition, the video signal processed by the controller 270 may be input to the external output device through the external device interface 230.

The audio signal processed by the control unit 270 may be output to the audio output unit 285 by sound. The audio signal processed by the control unit 270 may be input to the external output device through the external device interface unit 230.

The control unit 270 may include a demultiplexing unit, an image processing unit, and the like. The control unit 270 can control the overall operation in the video display device 200. [ For example, the controller 270 controls the tuner 210 to control the tuner 210 to select an RF broadcast corresponding to a channel selected by the user or a previously stored channel.

In addition, the controller 270 can control the image display apparatus 200 according to a user command or an internal program input through the user input interface unit 250.

For example, the controller 270 controls the tuner 210 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface unit 250. Then, video, audio, or data signals of the selected channel are processed. The controller 270 allows the display 280 or the audio output unit 285 to output the video or audio signal processed by the user through the channel information or the like selected by the user.

For example, the control unit 270 may be connected to the external device interface unit 230 via the external device interface unit 230, for example, a camera or a camcorder, according to an external device video playback command received through the user input interface unit 250 So that the video signal or the audio signal of the display unit 280 or the audio output unit 285 can be outputted.

The control unit 270 can control the display 280 to display an image. For example, the broadcast image input through the tuner 210, the external input image input through the external device interface unit 230, the image input through the network interface unit 235, or the image stored in the storage unit 240 To be displayed on the display 280. At this time, the image displayed on the display 280 may be a still image or a moving image, and may be a 2D image or a 3D image.

The control unit 270 generates a 3D object for a predetermined object among the images displayed on the display 280, and displays the 3D object. For example, the object may be at least one of a connected web screen (newspaper, magazine, etc.), EPG (Electronic Program Guide), various menus, widgets, icons, still images, moving images, and text. Such a 3D object may be processed to have a different depth than the image displayed on the display 280. The control unit 270 can process the 3D object so that the 3D object is protruded compared to the image displayed on the display 280. [

The control unit 270 recognizes the position of the user based on the image photographed from the photographing unit (not shown). For example, the distance (z-axis coordinate) between the user and the image display apparatus 200 can be grasped. In addition, the x-axis coordinate and the y-axis coordinate in the display 280 corresponding to the user position can be grasped.

Although not shown in FIG. 2, it is also possible to provide a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal. The channel browsing processing unit receives a stream signal TS output from the demodulation unit 220 or a stream signal output from the external device interface unit 230 and extracts an image from an input stream signal to generate a thumbnail image . The generated thumbnail image may be encoded as it is or may be input to the controller 270. In addition, the generated thumbnail image may be encoded in a stream format and input to the controller 270.

The controller 270 may display a thumbnail list having a plurality of thumbnail images on the display 280 using the input thumbnail images. At this time, the thumbnail list may be displayed in a simple view mode displayed on a partial area in a state where a predetermined image is displayed on the display 280, or may be displayed in a full viewing mode displayed in most areas of the display 280. The thumbnail images in the thumbnail list can be sequentially updated.

The display 280 converts a video signal, a data signal, an OSD signal, a control signal processed by the control unit 270 or a video signal, a data signal, and a control signal received from the external device interface unit 230, .

The display 280 may be a PDP, an LCD, an OLED, a flexible display, or the like. In particular, a three-dimensional display (3D display) may be possible according to an embodiment of the present invention.

The display 280 for viewing three-dimensional images can be divided into an additional display method and a single display method. In the single display method, the display 280 alone can implement a 3D image without a separate additional display, for example, glass, and examples thereof include a lenticular method, a parallax barrier, and the like Various methods can be applied. The additional display method can implement a 3D image using an additional display in addition to the display 280. For example, various methods such as a head mount display (HMD) type and a glasses type can be applied.

The glasses type can be further divided into a passive type such as a polarizing glasses type and an active type such as a shutter glass type. On the other hand, head-mounted display type can be divided into a passive type and an active type.

A 3D viewing apparatus (glass for 3D) 295 for viewing a stereoscopic image can include a passive polarizing glass or an active shutter glass, and is described as a concept including the above-described head mount type.

Meanwhile, the display 280 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 285 receives a signal processed by the control unit 270, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs it as a voice. The voice output unit 185 may be implemented by various types of speakers.

Meanwhile, in order to detect the user's gesture, a sensing unit (not shown) having at least one of a touch sensor, a voice sensor, a position sensor, and an operation sensor may be further included in the image display device 200 . A signal sensed by a sensing unit (not shown) is transmitted to the controller 170 through the user input interface unit 150.

The control unit 270 can detect the gesture of the user by combining the images captured from the photographing unit (not shown) or the sensed signals from the sensing unit (not shown).

The remote control device 260 transmits the user input to the user input interface unit 250. To this end, the remote control device 260 can use Bluetooth, RF (radio frequency) communication, infrared (IR) communication, UWB (Ultra Wideband), ZigBee, or the like. Also, the remote control device 260 can receive the video, audio, or data signal output from the user input interface unit 250 and display it or output it by the remote control device 260.

The image display apparatus 200 described above can be applied to digital broadcasting of ATSC system (7-VSB system), digital broadcasting of DVB-T system (COFDM system), digital broadcasting of ISDB-T system (BST-OFDM system) And a digital broadcasting receiver capable of receiving at least one of the digital broadcasting signals. In addition, as a portable type, digital terrestrial DMB broadcasting, satellite DMB broadcasting, ATSC-M / H broadcasting, DVB-H broadcasting (COFDM broadcasting), MediaFoward Link Only And a digital broadcasting receiver capable of receiving at least one of digital broadcasting and the like. It may also be a digital broadcast receiver for cable, satellite communications, or IPTV.

The video display device described herein may include a TV receiver, a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) have.

The configuration of the image display apparatus 200 shown in FIG. 2 is a configuration diagram for embodiments of the present invention. Each component of the configuration diagram may be integrated, added, or omitted according to the specifications of the video display device 200 actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

The video signal decoded by the video display device 200 may be a 3D video signal of various formats. For example, a 3D image signal composed of a color image and a depth image, or a 3D image signal composed of a plurality of view-point image signals. The plurality of viewpoint image signals may include, for example, a left eye image signal and a right eye image signal. Here, the format of the 3D video signal is a side-by-side format in which the left-eye image signal L and the right-eye image signal R are arranged in left and right directions, a top- An interlaced format in which the left and right eye image signals and the right eye image signal are mixed line by line, a checker box for mixing the left eye image signal and the right eye image signal box by box, Format, and the like.

Hereinafter, an image processing apparatus and method according to embodiments of the present invention will be described with reference to Figs. 3 to 11. Fig. The image processing apparatus and method according to embodiments of the present invention are applied not only to mobile terminals such as the mobile communication terminal 100, the telematics terminal, and the navigation device, but also to a 3D television (3D TV) , A smart phone, a notebook computer, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a projector, a home theater and the like.

3, the image processing apparatus 400 according to the first embodiment of the present invention includes a display unit 401 for displaying an object, and a display unit 401 for displaying three-dimensional Determining an object corresponding to a position coinciding with the position of the space or the closest position as an active object, and selecting objects (or objects) having different depths while covering the active object, A detecting unit 402 for detecting the detected signal; And a controller 403 for changing the attribute of the detected object (s) and selecting the active object according to a user selection signal.

The control unit 403 may include a detection unit 402 for detecting objects that partially or wholly cover the active object (the object (s) having different depths while covering a part of the active object).

The object may be a stereoscopic image photographed through a stereo camera or a time-of-flight (TOF) camera, or an object received from a terminal or a server through a wired communication network or a wireless communication network. The three-dimensional objects included in the object may be a three-dimensional object having a depth displayed in a three-dimensional web browser (3D Web Browser). The image processing apparatus 400 according to the embodiment of the present invention can be applied to a 3D Web Browser graphics processing unit (GPU). Each of the three-dimensional objects includes left eye and right eye images.

According to the present invention, the object Hr entering the interior of the three-dimensional space in which the object is displayed can interact with the object electrically. Further, the image display device outputs a three-dimensional image corresponding to the object Hr.

Hereinafter, an image display apparatus for correcting an object hidden by an object interacting with the object and a method for controlling the same will be described in detail.

FIG. 4 is a flowchart illustrating a method of controlling an image processing apparatus according to an embodiment of the present invention. FIG. 5 is a view illustrating an object obscured by an object according to an exemplary embodiment of the present invention.

Referring to FIGS. 4 and 5, a three-dimensional image including an object is displayed. The image display apparatus 1000 includes a display unit 100. The display unit 100 displays a left eye image V and a right eye image V U). The user can recognize the object (I) which is a three-dimensional stereoscopic image by the left eye image (V) and the right eye image (U).

The three-dimensional stereoscopic image may include a plurality of objects. A plurality of objects can be displayed at different depths. That is, the plurality of objects may be output so as to overlap with each other.

Next, the object (O) is disposed so as to be adjacent to the object. The object O may be formed to be in electrical contact with the object. The control unit 403 may generate an electrical signal by contacting the object O with the object and the controller 403 may control the display unit to output another 3D stereoscopic image corresponding to the object when the object O touches the object The display unit 100 can be controlled.

For example, a three-dimensional web screen can be formed by electrical interaction between the object O and the three-dimensional stereoscopic image. The control unit 403 transmits the information corresponding to the object to the server via the wireless or wired communication network when a signal is input in response to the object in the sensing area and the object O is in contact with the object, So as to display an image.

In the drawing, the object O is shown as a human hand, but the present invention is not limited thereto. That is, it can be formed as a tool capable of generating an electrical signal by selecting an object included in a real human hand or a three-dimensional stereoscopic image, and the form is not limited thereto. It also corresponds to a wide range of objects O approaching the display unit 100 as well as a tool for generating the signals.

The sensing unit 402 of the stereoscopic display device senses the three-dimensional image I of the object and the position of the object O. For example, the sensing unit 402 may sense a relative position of the object O from the display unit 100 and a relative position between the user and the display unit 100 and the object.

Next, the sensing unit 402 determines whether the three-dimensional image I of the object and the object O overlap. As shown in FIG. 5, the object O may be disposed so as to be spaced apart from the user's eye around the three-dimensional image I of the object. Since the object O is disposed so as to overlap with the 3D image, the image output from the display unit 100 is masked by the object O to deform the shape of the 3D image I of the object .

The controller 402 controls the display unit 100 to output the three-dimensional image I of the object as it is, if it is determined that the three-dimensional image I of the object and the object O do not overlap with each other .

The control unit 402 controls the display unit 100 to change the object when it is determined that the object O and the three-dimensional image I of the object overlap each other.

Hereinafter, a method for changing the object will be specifically discussed.

6A and 6B are conceptual diagrams for explaining the change of the shape of an object according to an embodiment.

5, 6A and 6B, the display unit 100 of the image display apparatus 1000 outputs the right-eye image U and the left-eye image V to generate a three- I). The object (O) is arranged so that three-dimensional stereoscopic images of the object overlap.

The control unit 420 controls the display unit 100 to change the three-dimensional stereoscopic image of the object overlapping the object O. [ The control unit 420 controls the display unit 100 to output the corrected first corrected image I1 by controlling the transparency of at least one region of the three-dimensional image superimposed on the object O.

The entire transparency of the three-dimensional stereoscopic image superimposed on the object O can be adjusted. Alternatively, the overlapping region and the remaining region of the three-dimensional image overlapping with the object O can be distinguished from each other, and the transparency of the overlapping region can be controlled.

The control unit 403 controls the transparency of the three-dimensional image of the object to be high. When the transparency becomes about 100%, the three-dimensional stereoscopic image of the object is not seen. That is, the display unit 100 may be controlled to delete the object.

Therefore, the user can grasp the shape of the object O through the first corrected image I1. It is possible to recognize the first corrected image I1 and the object O at the same time or only the object O if the transparency of the first corrected image I1 is about 100%. The transparency can be controlled differently depending on the color of the size of the object (O) and the object.

That is, when the depth of the object O is deeper than the depth of the three-dimensional image of the object, that is, when the object O is disposed closer to the display unit 100 than the three- Dimensional stereoscopic image of the object becomes opaque or transparent.

Accordingly, it is possible to prevent confusion that may occur due to the simultaneous recognition of the three-dimensional stereoscopic image of the object damaged by the object O and the object O to the user. In addition, since the user can more clearly recognize the shape of the object O, it is easier to select another object that is output deeper than the object O. [

FIGS. 7A and 7B are conceptual diagrams for explaining how the shape of an object is changed according to another embodiment. This embodiment is substantially the same as the embodiment of Figs. 6A and 6B except for the way in which the shape of the object is changed. Therefore, the same configurations and features are replaced with the description of Figs. 6A and 6B.

5, 7A and 7B, when the object O and the three-dimensional stereoscopic image of the object are overlapped, the controller 402 changes the three-dimensional stereoscopic image to generate the second corrected image I2, The controller 100 controls the display unit 100 to output the image data.

Dimensional transparency of the three-dimensional image and forms a highlight on the edge of the three-dimensional image to form the second corrected image I2. The transparency can be adjusted by the color and size of the object O and the object.

The edge of the second corrected image I2 may be displayed as a line to confirm the position of the object to the user. The highlight can be variously implemented by changing colors of lines, dotted lines, and edge regions.

In the drawing, the transparency of the second corrected image I2 is about 100%, and the second corrected image I2 is displayed only at the edges. However, the present invention is not limited thereto.

According to the present embodiment, the user can recognize the object O more clearly. In addition, since the position of the object can be recognized, it is possible to prevent visual confusion and to prevent the user from forgetting existing information.

8A and 8B are conceptual diagrams for explaining the change of the shape of an object according to another embodiment. This embodiment is substantially the same as the embodiment of Figs. 6A and 6B except for the way in which the shape of the object is changed. Therefore, the same configurations and features are replaced with the description of Figs. 6A and 6B.

5, 8A and 8B, when the object O and the three-dimensional stereoscopic image of the object are overlapped, the controller 402 changes the three-dimensional stereoscopic image to generate the third corrected image I3, The controller 100 controls the display unit 100 to output the image data.

Dimensional transparency of the 3D stereoscopic image and forming a transparent portion I 'in one region of the 3D stereoscopic image to form the third corrected image I3.

The transparency of the transparent portion I 'may be about 100%. That is, the transparent portion I 'is substantially the same as the transparent portion I'. The transparent portion I 'is a part of the three-dimensional stereoscopic image and includes a region overlapping with the object O.

That is, since the area overlapping with the object O is not displayed, a damaged three-dimensional image is not output due to being covered by the object O, and a clearer image can be output.

In order to allow the user to recognize the position of the object, the transparency of the region other than the transparent portion (I ') of the third corrected image (I3) reaches 100% It is preferable to form it so as not to.

In addition, a highlight can be formed at the edge of the remaining area.

According to the present embodiment, it is possible to prevent visually confusion between the object O and the object by blocking the output of the overlapping area with the object O, and to suppress the output of the damaged image, thereby enhancing a clearer image. In addition, since the remaining area is recognized by the user, the information of the object can be continuously recognized and the depth of the object and the object O can be recognized, so that the information can be more accurately provided.

9A and 9B are conceptual diagrams for explaining how an object moves according to another embodiment. This embodiment is substantially the same as the embodiment of Figs. 6A and 6B except for how the position of the object is changed. Therefore, the same configurations and features are replaced with the description of Figs. 6A and 6B.

5, 9A and 9B, when the object O and the three-dimensional stereoscopic image of the object are superimposed on each other, the controller 402 controls the fourth correction image, in which the output position of the three- And controls the display unit 100 to output the image signal I4.

The fourth corrected image I4 moves to an area that is not overlapped with the object O. [ That is, the right eye image U and the left eye image V are moved in substantially the same room and output.

The fourth corrected image I4 may be displayed in an area adjacent to the object O. [ However, it is preferable that the depth of the fourth corrected image I4 is not shifted.

According to the present embodiment, the shape of the third stereoscopic image of the object is not deformed or damaged. Accordingly, the user can recognize the information of the third stereoscopic image as a whole, and can recognize the information of the object even when the object O accesses another object having a different depth from the object or selects another object have.

Therefore, since the shape of the object is not deformed and there is no image covering the object O, a clear three-dimensional stereoscopic image can be provided. In addition, since there are no objects to be covered, more accurate information can be provided.

The embodiments according to Figs. 6A to 9A may be respectively applied, or may be applied in duplicate. In addition, the object and the object O may be implemented in a plurality.

Hereinafter, a method of controlling the change of the three-dimensional stereoscopic image of two objects when two objects are displayed and an object O is displayed closer to the display unit 100 is described.

10A to 10E are conceptual diagrams for explaining how two objects and an object O interact with each other.

Referring to FIG. 10A, the 3D stereoscopic image includes a first object I and a second object I'2 having different depths. The second object I'2 is displayed closer to the display unit 100 than the first object I is. In addition, the first and second objects (I, I'2) are displayed such that one area is overlapped.

The object O approaches the display unit 100 and enters the first object I adjacent thereto.

Referring to FIGS. 10B and 10C, the object O is in contact with the first object I and proceeds through the first object I. In this case, one region of the object O may be in contact with the first object I and pass therethrough.

When the object O passes through the first object I, the first object I is changed and output to the first correction object I '. The first correction object I 'may be changed by the correction method described in FIGS. 6A to 9A. For example, the transparency and position of the first correction object I 'may be changed, the area overlapping with the object O may be deleted, or the edge area may be highlighted.

Referring to FIG. 10D, the object O moves closer to the display unit 100 and comes into contact with the second object I'2. The object O and the second object I'2 may be in contact with each other to generate an electrical signal.

The second object I'2 may change when it comes in contact with the object O and be output as the second correction object I''2. For example, it can be displayed so as to be distinguished from the second object I'2 using an increase in transparency, a change in color, a change in size, and the like. Accordingly, the user can recognize that the object O is in contact with the second object I'2 to generate an electrical signal. Also, before and after a signal is input to the second object I'2, the first object I 'is output in a semi-transparent state before being input, and is output in a completely transparent state after being input The display unit 100 can be controlled.

Referring to FIG. 10E, in response to a signal generated by the contact between the second object I'2 and the object O, the control unit transmits the second object I'2 corresponding to the second object I'2 through the wired and wireless communication, Dimensional stereoscopic image I'3.

Therefore, even if two or more objects are superposed and the object O passes through it, the object through which the object O passes is changed. Therefore, since the damaged object is not displayed, the quality of the three-dimensional image is improved and more accurate information can be provided to the user.

In addition, the video display device of the present invention not only displays a three-dimensional stereoscopic image between a user and a display. The present invention can also be applied to an image display apparatus having a head up display.

That is, when the user and the display unit 100 are adjacent to each other and a three-dimensional stereoscopic image is output in the direction opposite to the user, and the object O is disposed in the three- Can be applied.

However, the head-up display is formed of a transparent material on both sides so that the object O can be recognized.

That is, when the object O is disposed closer to the display unit 100 than the object, at least the left eye image V and the right eye image U of the display unit 100, Some are obscured. Accordingly, the controller 403 controls the display unit 100 to change the object.

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

Claims (21)

delete delete delete delete delete delete delete delete delete delete delete delete A display unit configured to display a three-dimensional stereoscopic image including at least one object;
A sensing unit for sensing a relative position of an object disposed adjacent to the display unit with respect to the display unit; And
And a control unit for controlling the display unit to change the shape of the object when at least a part of the object and the object are overlapped by comparing the three-dimensional relative position of the object with the relative position of the object based on the display unit,
The control unit
Detecting an overlap region in which the object overlaps with the three-dimensional image of the object,
The object is divided into the detected overlapping region overlapping the object and the remaining region not overlapping the object,
Wherein when the object is located closer to the display unit than the object, only the transparency of the detected overlapping region and the detected overlapping region is increased to control the display unit so that the detected overlapping region is not visible,
Wherein the transparency of the remaining region other than the detected overlapping region is kept the same as before the object is overlapped with the object. delete delete delete 14. The apparatus of claim 13,
And controls the display unit to display an edge of the three-dimensional image of the object so that the object and the object are visually distinguished when at least a part of the object and the object are overlapped. 14. The apparatus of claim 13,
Wherein the control unit controls the display unit to change the display position of the three-dimensional image of the object so as to be spaced apart from the object when at least a part of the object and the object are overlapped. 14. The apparatus of claim 13,
Wherein the object includes first and second objects having different depths, a three-dimensional image of the first object is output closer to the display unit than a three-dimensional image of the second object, Wherein the control unit controls the display unit to change the shape of at least one area of the second object when the first object passes through the first object and one end of the object is disposed in contact with the second object. 14. The image display apparatus of claim 13, wherein the display unit displays the three-dimensional stereoscopic image between the display unit and the user. 14. The video display device of claim 13, wherein the display unit displays the three-dimensional stereoscopic image in a direction opposite to a user, and is formed of a transparent material on both sides so that the user can recognize the object.

Images