KR20120111570A - Appartus for displaying stereoscopic image and calibration method thereof - Google Patents

Abstract

The present invention relates to a stereoscopic image display apparatus and a calibration method of a stereoscopic image display apparatus. More specifically, the present invention provides a stereoscopic image display apparatus and a stereoscopic image display apparatus for calibrating a relative position of a display and an optical filter with respect to the viewing position by using color differences of light incident to the left eye point and the right eye point of the viewing position. It relates to a calibration method. In accordance with an aspect of the present invention, a stereoscopic image display apparatus includes a display including a left eye pixel and a right eye pixel, an optical filter provided on the front of the display, and a left eye pixel and a right eye pixel to generate different colors. Also, while controlling the relative position between the pixels and the optical filter so that the output angle of the light output from the left eye pixel and the right eye pixel is controlled, the color difference between the light incident to the left eye point of the viewing position and the light incident to the right eye point is detected, and the color And a controller for calibrating a relative position with respect to the viewing position based on the difference.

Description

CALIBRATION METHOD AND CALIBRATION METHOD OF A Stereoscopic Image Display Apparatus {APPARTUS FOR DISPLAYING STEREOSCOPIC IMAGE AND CALIBRATION METHOD THEREOF}

The present invention relates to a stereoscopic image display apparatus and a calibration method of a stereoscopic image display apparatus. More specifically, the present invention provides a stereoscopic image display apparatus and a stereoscopic image display apparatus for calibrating a relative position of a display and an optical filter with respect to the viewing position by using color differences of light incident to the left eye point and the right eye point of the viewing position. It relates to a calibration method.

Recently, interest in stereoscopic images and stereoscopic image output devices is rapidly increasing, and various products are released in related industries. There are two methods of outputting such stereoscopic images: a glasses-free method and a glasses method.

In the autostereoscopic method, the left and right eye images are separated by using a parallax barrier or a lenticular lens for the light output from the display to create a binocular disparity, thereby making the user feel a three-dimensional effect.

However, in the present autostereoscopic method, since the left eye image and the right eye image are incident to different points to generate binocular disparity, the left eye image and the right eye image should be incident into the left eye and the right eye of the user who views them, respectively.

Therefore, in recent years, researches on techniques for correctly entering stereoscopic images according to viewing positions have been actively conducted.

One object of the present invention is to provide a stereoscopic image display device and a calibration method of a stereoscopic image display device for calibrating a relative position of a display and an optical filter with respect to a specific viewing position.

Another object of the present invention is to provide a stereoscopic image display device and a calibration method of a stereoscopic image display device, which are appropriately provided for stereoscopic images for various viewing positions.

The problem to be solved by the present invention is not limited to the above-described problem, another task that is not mentioned will be clearly understood by those skilled in the art from the following description.

In accordance with an aspect of the present invention, a stereoscopic image display apparatus includes a display including a left eye pixel and a right eye pixel, an optical filter provided on the front of the display, and a left eye pixel and a right eye pixel to generate different colors. Also, while controlling the relative position between the pixels and the optical filter so that the output angle of the light output from the left eye pixel and the right eye pixel is controlled, the color difference between the light incident to the left eye point of the viewing position and the light incident to the right eye point is detected, and the color And a controller for calibrating a relative position with respect to the viewing position based on the difference.

In accordance with another aspect of the present invention, a stereoscopic image display apparatus includes a display including a left eye pixel and a right eye pixel, an optical filter provided on the front of the display to generate binocular disparity, and a left eye pixel and a right eye pixel to output different colors. Also, while controlling the relative position between the pixels and the optical filter so that the output angle of the light output from the left eye pixel and the right eye pixel is controlled, the color difference between the light incident to the left eye point of the viewing position and the light incident to the right eye point is sensed. And a controller for calibrating a relative position with respect to the position to a relative position where the color difference is maximum.

In accordance with another aspect of the present invention, a stereoscopic image display apparatus includes a display including a left eye pixel and a right eye pixel, an optical filter provided at the front of the display, and a left eye pixel and a right eye pixel that generate binocular disparity and output different colors. Color of the light incident to the left eye point and the right eye point of the viewing position while controlling the relative position between the pixels and the optical filter by controlling the optical filter to control the output angle of the light output from the left eye pixel and the right eye pixel. And a controller for detecting a difference and calibrating a relative position with respect to the viewing position based on the color difference. Here, the optical filter is either a parallax barrier or a lenticular lens.

In accordance with another aspect of the present invention, a stereoscopic image display apparatus includes a display including a left eye pixel and a right eye pixel, an optical filter provided at the front of the display, and a left eye pixel and a right eye pixel that generate binocular disparity and output different colors. Control the position of the left and right eye pixels of the display to control the output angle of the light output from the left and right eye pixels, and control the relative position between the pixels and the optical filter, And a control unit for detecting a color difference of light incident to the right eye point and calibrating a relative position with respect to the viewing position based on the color difference.

In accordance with an aspect of the present invention, a stereoscopic image display apparatus includes a camera, a display including a left eye pixel and a right eye pixel, an optical filter provided on the front of the display, and an optical filter for generating binocular disparity, and outputting different colors to the left eye pixel and the right eye pixel. Control the relative position between the pixels and the optical filter so that the output angle of the light output from the left eye pixel and the right eye pixel is adjusted, and detect the color difference between the light incident to the left eye point of the viewing position and the light incident to the right eye point. And a controller configured to determine the viewing position based on the image photographed by the camera based on the color difference, and to calibrate the relative position with respect to the determined viewing position.

According to an aspect of the present invention, there is provided a calibration system for a stereoscopic image display apparatus including a first camera installed at a left eye point of a viewing position, a second camera installed at a right eye point of a viewing position, and a left eye pixel and a right eye pixel. The optical filter and binocular parallax provided on the front surface control the left eye pixel and the right eye pixel to output different colors, and adjust the relative position between the pixels and the optical filter so that the emission angle of the light output from the left eye pixel and the right eye pixel is adjusted. While controlling, it receives information about light incident to the left eye point from the first camera through the communication unit, and receives information about light incident to the right eye point from the second camera to receive color difference between the light incident to the left eye point and the right eye point. A control unit for acquiring the data and calibrating the relative position with respect to the viewing position based on the color difference. It comprises a three-dimensional display device.

In the calibration method of a stereoscopic image display apparatus according to an aspect of the present invention, the left eye pixel and the right eye pixel of the display output a different color, the optical filter disposed in front of the display is output from the left eye pixel and the right eye pixel Emitting light at different angles, controlling the relative position between the pixels and the optical filter to adjust the output angle of the light output from the left eye pixel and the right eye pixel, and controlling the relative position while being incident to the left eye point of the viewing position. Obtaining a color difference between the light and the light incident to the right eye point, and calibrating a relative position with respect to the viewing position based on the color difference.

According to another aspect of the present invention, there is provided a method of calibrating a stereoscopic image display device, the method including outputting different colors of a left eye pixel and a right eye pixel of a display, and an optical filter disposed in front of the display to output light from a left eye pixel and a right eye pixel. Emitting light at different angles, controlling the relative position between the pixels and the optical filter to adjust the output angle of the light output from the left eye pixel and the right eye pixel, and controlling the relative position, Obtaining a color difference between the light incident to the light and the right eye point, and calibrating a relative position with respect to the viewing position to a relative position where the color difference is maximum.

According to the calibration method of the stereoscopic image display device of the present invention, it is possible to calibrate the relative positions of the display and the optical filter with respect to a specific viewing position.

Further, according to the calibration method of the stereoscopic image display apparatus of the present invention, the stereoscopic image can be appropriately provided for various viewing positions.

Effects by the present invention is not limited to the above-described effects, other effects that are not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a view showing a stereoscopic image display device according to the present invention to provide a stereoscopic image.
2 is a view of providing a stereoscopic image according to the viewing position in the stereoscopic image display apparatus according to the present invention.
3 and 4 are perspective views of a stereoscopic image display device according to the present invention.
5 is a block diagram of a stereoscopic image display device according to the present invention.
6 is a schematic diagram of a calibration system for a stereoscopic image display device according to the present invention.
7 is a flowchart illustrating a calibration method of a stereoscopic image display device according to the present invention.
8 is a diagram of a left eye pixel and a right eye pixel of a display of a stereoscopic image display device according to the present invention.
9 is a view illustrating a left eye pixel and a right eye pixel outputting different colors in a calibration method of a stereoscopic image display device according to the present invention, and a left eye image and a right eye image accordingly.
10 is a diagram of a parallax barrier among optical filters of a stereoscopic image display device according to the present invention.
11 is a view of a lenticular lens of the optical filter of the stereoscopic image display apparatus according to the present invention.
12 is a view of the exit angle of the left eye image and the right eye image as the position of the parallax barrier of the stereoscopic image display device according to the present invention is changed.
13 is a diagram of control of a left eye pixel and a right eye pixel of a display of a stereoscopic image display device according to the present invention.
Fig. 14 is a diagram related to the control of the RGB pixel of the display of the stereoscopic image display apparatus according to the present invention.
FIG. 15 is a diagram illustrating that the stereoscopic image display apparatus obtains information regarding a viewing position as positions of a first camera and a second camera.
16 to 17 illustrate light incident to the left eye point and light incident to the right eye point according to the relative positions of the display and the optical filter of the stereoscopic image display device according to the present invention.
18 is a diagram illustrating color differences according to relative positions of a display and an optical filter of a stereoscopic image display device according to the present invention.
19 is a view related to matching the relative positions of the display and the optical filter with respect to the viewing position of the stereoscopic image display apparatus according to the present invention.
20 is a view of controlling the parallax barrier according to the viewing position of the stereoscopic imaging apparatus according to the present invention.

The terms used in the present specification are used to easily explain the present invention. Accordingly, the invention is not limited by the terms used herein.

As used herein, the term “connection” or “connection” does not necessarily mean a direct connection or a connection, but a concept including an indirect connection or connection through a medium. In addition, since "module" or "unit" is a term used for convenience of description, it does not have a meaning or function distinguished from each other by itself.

The present invention can be modified or modified without departing from the spirit and scope of the invention. At this time, modifications or variations that do not depart from the spirit and scope of the present invention will be apparent to those skilled in the art. Accordingly, the present invention includes modifications or variations without departing from the spirit and scope of the invention. In addition, this invention is not limited by the Example mentioned later.

Hereinafter, with reference to the accompanying drawings, the present invention will be described. Here, the drawings are intended to help understanding of the present invention, and the technical spirit of the present invention is not limited to the accompanying drawings. On the other hand, the same reference numerals are used for the same components in the drawings, and redundant description may be omitted.

Hereinafter, the stereoscopic image display apparatus 100 according to the present invention will be described with reference to FIGS. 1 and 2. 1 is a view showing a stereoscopic image display apparatus 100 according to the present invention to provide a stereoscopic image, Figure 2 is a stereoscopic image display apparatus 100 according to the present invention to provide a stereoscopic image according to the viewing position Related drawings.

The stereoscopic image display apparatus 100 may output a stereoscopic image. The stereoscopic image display apparatus 100 may display the left eye image and the right eye image, and separate the left eye image and the right eye image so as to be incident at different points. In this case, when the left eye image and the right eye image are respectively incident on the left eye and the right eye of the user, binocular disparity occurs and the user views a stereoscopic image in which a stereoscopic feeling is felt.

As such, there are two methods of outputting a stereoscopic image, a glasses method and a glasses-free method. Glasses are typically polarized light and shutter glass method, and glasses-free is typically used a parallax barrier and lenticular lenses.

As shown in FIG. 1, the stereoscopic imaging apparatus according to the present invention outputs a stereoscopic image in an autostereoscopic manner, in which case the left eye image IL and the right eye image IR are directed to specific points LE and RE. Since the incident, such a stereoscopic image device can provide a stereoscopic image only to a user at a predetermined viewing position.

The stereoscopic image apparatus tracks the position of the user, as shown in FIG. 2, such that the left eye image IL and the right eye image IR enter the left eye LE and the right eye RE of the user, respectively. It is possible to control the exit angle of the right eye image. As a result, the stereoscopic apparatus can allow the user to view the stereoscopic image at any position regardless of the viewing position of the user.

In such a stereoscopic image device, since the exit angles of the left eye image and the right eye image may be determined according to the relative positions between the display 120 and the optical filter 130, the stereoscopic image apparatus is a stereoscopic image according to various viewing positions. In order to provide a relative position between the display 120 and the optical filter 130 is controlled. More specifically, the angle at which each image is output may be determined according to a relative position or alignment state between the left eye pixel and the right eye pixel of the display 120 and the optical filter 130.

As such, in order for the stereoscopic apparatus to determine the viewing position of the user and output the left eye image and the right eye image at the exit angle corresponding to the viewing position, the relative position between the display 120 and the optical filter 130 with respect to the viewing position. You need to calibrate

Hereinafter, the stereoscopic image display apparatus 100 according to the present invention will be described with reference to FIGS. 3, 4, and 5. 3 and 4 are perspective views of the stereoscopic image display apparatus 100 according to the present invention, and FIG. 5 is a configuration diagram of the stereoscopic image display apparatus 100 according to the present invention.

The stereoscopic image display apparatus 100 according to the present invention may output a stereoscopic image in the autostereoscopic manner as described above, and control the emission angle of the stereoscopic image according to the viewing position of the user. As shown in FIGS. 3 and 4, the stereoscopic image display apparatus 100 may include a television, a digital television (DTV), an internet protocol television (IPTV), a mobile phone, a smart phone, personal digital assistants (PDAs), Portable multimedia player, laptop computer, tablet computer, computer monitor, navigation terminal and other stereoscopic images obvious to those of ordinary skill in the art. A display device may be included.

As shown in FIG. 5, the stereoscopic image display apparatus 100 includes a user input unit 110 receiving input from a user, a display 120 displaying a left eye image and a right eye image, and an optical filter for generating binocular disparity. 130, a camera 140 for taking an image, a communication unit 150 for communicating, a memory 160 for storing information, a controller 170 for controlling the overall operation of the stereoscopic image display apparatus 100 and a stereoscopic image It may include a power supply unit 180 for supplying power to the display device 100.

In the stereoscopic image display apparatus 100 according to the present invention, since the above-described components are not essential components, the stereoscopic image display apparatus 100 does not necessarily include all of the above-described components. In other words, the stereoscopic image display apparatus 100 according to the present invention may optionally include the above-described components.

Hereinafter, each component of the stereoscopic image display apparatus 100 will be described with reference to FIG. 5 again with respect to the user input unit 110, the display 120, the optical filter 130, the camera 140, the communication unit 150, and the memory ( 160, the controller 170 and the power supply unit 180 will be described in this order.

The user input unit 110 may receive an input from a user. The user may directly operate an operation of the 3D image display apparatus 100 through the user input unit 110.

The user input unit 110 may include a keypad, a dome switch, a jog wheel, a jog switch, a touch pad, and a touch pad. It may include at least one of other input devices that are obvious to those with knowledge.

The display 120 may display a left eye image and a right eye image. The display 120 may be implemented with a left eye pixel that outputs a left eye image and a right eye pixel that outputs a right eye image. In this case, the left eye pixel and the right eye pixel may be arranged in a vertical column, respectively.

The display 120 includes a liquid crystal display (LCD), a field emission display (FED), a plasma display panel (PDP), and an organic light emitting display (OLED). And other displays apparent to those of ordinary skill in the art.

The optical filter 130 may generate binocular parallax. The optical filter 130 may be disposed in front of the display 120 to allow an image or light output from the display 120 to be emitted at a specific angle.

The optical filter 130 may be implemented as a barrier or a lens. Here, the barrier may be a parallax barrier, and the lens may be a lenticular lens.

The parallax barrier is composed of a blocking portion that blocks light and an opening that transmits light, so that the light output from the left eye pixel and the right eye pixel is different from each other by transmitting a portion of the light output from the display 120 and blocking the portion. By exiting at the exit angle, binocular disparity can be generated.

In addition, the lenticular lens may generate binocular disparity by refracting the light output from the display 120 to emit light output from the left eye pixel and the right eye pixel at different emission angles.

The camera 140 may take an image. The camera 140 may acquire a still image or a moving image by shooting in accordance with an optical signal. Here, the optical signal may include not only visible light but also infrared rays and ultraviolet rays that are not visible to the naked eye.

The camera 140 may acquire an image by receiving light from the outside and acquiring contrast information, luminance information, color information, etc. according to the incident light. For example, the 2D camera 140 may acquire image information according to light received through an image sensor implemented as a charge coupled device (CCD) device or a complementary metal oxide semiconductor (COMS) device.

The communicator 150 may perform communication. The communication unit 150 may communicate with an external device to transmit and receive information.

The communication unit 150 may include at least one of a broadcast receiving module, a short range communication module, an internet module, and a wired communication module.

The broadcast receiving module may receive a broadcast signal from a broadcast server through various broadcast systems.

Here, the broadcasting system is a digital multimedia broadcasting terrestrial (DMBT), a digital multimedia broadcasting satellite (DMBS), a media forward link only (MediaFLO), a digital video broadcast handheld (DVBH), an integrated services digital broadcast terrestrial (ISDBT), and other present inventions. It may include at least one of a variety of broadcast systems that are obvious to those skilled in the art.

The short range communication module may perform short range wireless communication.

The short range communication module performs communication according to at least one of Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB) and ZigBee, and other short range communication standards. can do.

The short range communication module may communicate with various external devices in a short range. For example, the short range communication module may communicate with a remote controller or the like that remotely controls the 3D image display apparatus 100.

The internet module is a device for transmitting and receiving information by connecting to the Internet by wire or wirelessly. The internet module can transmit and receive various information by accessing the Internet. Such an internet module may be provided in a built-in form or an external form in the stereoscopic image display apparatus 100 or may be provided to be detachable.

The Internet module can access the Internet by wire or wirelessly, including local area network (LAN), wireless local area network (WLAN), wireless broadband (Wibro), world interoperability for microwave access (Wimax), high speed downlink packet access (HSDPA), and Communication may be performed according to at least one of various other communication standards.

The wired communication module may connect the stereoscopic image display device 100 and the external device 200 by wire.

The wired communication module may communicate with the external device 200 through various interfaces. Such an interface may include a universal serial bus (USB) port, an RS232 (RS-232) port, a headset, an external charger port, a memory card port, an audio input / output port, a video input / output port, an earphone jack, and the like. .

The memory 160 may store information.

The memory 160 may store information necessary for the operation of the stereoscopic image display apparatus 100 and information generated by the operation of the stereoscopic image display apparatus 100. Information required for the operation of the stereoscopic image display apparatus 100 may be, for example, an operating system (OS). The information generated by the operation of the stereoscopic image display apparatus 100 may be a left eye image or a right eye image.

The memory 160 may include various storage media. For example, the memory 160 may be a flash memory, a random access memory (RAM), a static random access memory (SRAM), a read only memory (ROM), or an EEPROM (EEPROM). Card type memory and the like such as electrically erasable programmable read only memory, hard disk, magnetic memory, magnetic disk, optical disc such as CD or Blu-ray, SD card The present invention may include at least one of other storage media that will be apparent to those skilled in the art.

The memory 160 may be provided in a form mounted inside the stereoscopic image display apparatus 100, a form located separately in the outside, or a detachable form. The external memory 160 may include not only an external hard disk but also a web storage that performs a storage function of the memory 160 on the Internet.

The controller 170 may control the overall operation of the stereoscopic image display apparatus 100 and other components of the stereoscopic image display apparatus 100. For example, the controller 170 may link various pieces of information and process the information so that the information can be used.

The controller 170 may be implemented as a computer or a similar device using software, hardware, or a combination thereof.

The controller 170 may be configured to include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and processors (processors). ), Controllers, micro-controllers, microprocessors, and at least one of an electrical device for performing a control function obvious to those skilled in the art. Can be.

The controller 170 may be implemented by software code or software application written in one or more programming languages. Such software may be stored in the memory 160 and executed by a hardware configuration of the controller 170. The software may be installed in the stereoscopic image display apparatus 100 by being transmitted from an external device, for example, a server, to the stereoscopic image display apparatus 100.

Details of the controller 170 will be described later in the description of the stereoscopic image output method according to the present invention.

The power supply unit 180 may supply power to the stereoscopic image display apparatus 100. The power supply unit 180 may supply power required for the operation of each component of the 3D image display device 100 by receiving external power or internal power under the control of the controller 170.

Hereinafter, a calibration system of the stereoscopic image display apparatus 100 according to the present invention will be described with reference to FIG. 6. 6 is a schematic diagram of a calibration system of the stereoscopic image display apparatus 100 according to the present invention.

As shown in FIG. 6, the calibration system of the stereoscopic image display apparatus 100 according to the present invention includes the stereoscopic image display apparatus 100, the first camera 210, the second camera 220, and the external device 300. It may be implemented including at least one of.

Here, the 3D image display device 100 displays a left eye image and a right eye image, controls an emission angle of the image, and the first camera 210 and the second camera 220 respectively, the left eye point and the right eye of the viewing position. Is installed at the point, detects the light incident from the stereoscopic image device, the external device receives the electrical signal generated in accordance with the light incident from the first camera 210 and the second camera 220 receives the first camera 210 ) And the color difference between the light incident on the second camera 220 may be calculated. In this case, the function performed by the external device may be performed by the controller 170 of the stereoscopic image display apparatus 100.

According to this configuration, the calibration system of the stereoscopic image display apparatus 100 sets the exit angles so that the left and right eye images emitted from the display 120 of the stereoscopic image apparatus are incident on the left and right eye points of the viewing position, respectively. By adjusting, the stereoscopic image display apparatus 100 may calibrate the exit angle according to the viewing position.

A detailed description of the calibration method of the stereoscopic image display device 100 will be described later.

The calibration method of the stereoscopic image display apparatus 100 according to the present invention will be described by using the calibration system and the stereoscopic image display apparatus 100 of the stereoscopic image display apparatus 100 according to the present invention.

Here, the calibration method of the stereoscopic image display apparatus 100 according to the present invention will be described using the calibration system and the stereoscopic image display apparatus 100 of the stereoscopic image display apparatus 100 according to the present invention for ease of explanation. Since it is only for the following, the calibration method of the stereoscopic image display apparatus 100 according to the present invention is not limited to the calibration system and the stereoscopic image display apparatus 100 of the stereoscopic image display apparatus 100 according to the present invention.

Accordingly, the calibration method of the stereoscopic image display apparatus 100 according to the present invention is another system that performs the same or similar functions in addition to the calibration system and the stereoscopic image display apparatus 100 of the stereoscopic image display apparatus 100 according to the present invention. Or other stereoscopic image display apparatuses.

Hereinafter, a calibration method of the stereoscopic image display apparatus 100 according to the present invention will be described with reference to FIG. 7. 7 is a flowchart illustrating a calibration method of the stereoscopic image display apparatus 100 according to the present invention.

In the calibration method of the stereoscopic image display apparatus 100 according to the present invention, as shown in FIG. 7, the step of outputting different colors to the left eye pixel and the right eye pixel (S110), the light output from the left eye pixel and the right eye pixel Controlling the relative position between the pixels and the optical filter 130 to adjust the exit angle (S120), obtaining information about the viewing position (S130), and the light incident to the left eye point of the viewing position. While detecting the incident light to obtain the color difference (S140) and calibrating the relative position between the pixels and the optical filter 130 for the viewing position based on the information and the color difference about the viewing position (S150) It may include at least one.

Hereinafter, each step of the calibration method of the stereoscopic image display apparatus 100 according to the present invention will be described.

The stereoscopic image display apparatus 100 may output different colors to the left eye pixel and the right eye pixel (S110). This step will be described with reference to FIGS. 8 and 9. 8 is a diagram of a left eye pixel and a right eye pixel of the display 120 of the stereoscopic image display apparatus 100 according to the present invention, and FIG. 9 is a left eye pixel in the calibration method of the stereoscopic image display apparatus 100 according to the present invention. And a right eye pixel outputting different colors, and a left eye image and a right eye image accordingly.

The left eye pixel and the right eye pixel of the display 120 may output different colors. Here, the left eye pixel PL and the right eye pixel PR may be alternately arranged on the display 120 as illustrated in FIG. 8. In the stereoscopic image display apparatus 100, the left eye pixel and the right eye pixel may output a left eye image and a right eye image, respectively, to provide a stereoscopic image to a user.

The control unit 170 controls the display 120 having the left eye pixel and the right eye pixel as described above. As shown in FIG. 9, the left eye pixel PL outputs the first color, and the right eye pixel PR is the first pixel. It can be controlled to output two colors. In this case, the left eye image may output the first color image IL, and the right eye image may output the second color image IR.

Here, it is preferable that the first color and the second color have different colors from each other, since the first color and the second color, as described later, are easier to calibrate using the color difference as the properties of the first color and the second color are different. .

Such a first color and a second color may be, for example, white and black, respectively. In another example, the first color may be blue, and the second color may be red. However, the pixels outputting black may be technically implemented as a pixel not outputting light. In the present specification, the pixels are output as black for convenience.

The stereoscopic image display apparatus 100 may control a relative position between the pixels and the optical filter 130 so that the emission angle of the light output from the left eye pixel and the right eye pixel is adjusted (S120).

The optical filter 130 may generate binocular disparity by allowing the light output from the left eye pixel of the display 120 and the light output from the right eye pixel to be output at different angles.

Here, the optical filter 130 is provided on the front of the display 120 serves to generate binocular disparity. The optical filter 130 may be, for example, a parallax barrier or a lenticular lens. Hereinafter, the parallax barrier and the lenticular lens will be described with reference to FIGS. 10 and 11. FIG. 10 is a diagram illustrating a parallax barrier among optical filters 130 of the stereoscopic image display apparatus 100 according to the present invention, and FIG. 11 is a diagram of the optical filter 130 of the stereoscopic image display apparatus 100 according to the present invention. It is a figure regarding a lenticular lens.

As shown in FIG. 10, the parallax barrier B may be disposed on the front of the display 120, and may include a blocking part BC and an opening BO formed in the longitudinal direction of the display 120. . Here, the blocking unit BC blocks the light output from the display 120, and the opening BO passes the light output from the display 120.

Due to the structure of the parallax barrier B, the light emitted from the left eye pixel PL and the right eye pixel PR of the display 120 passes through the parallax barrier B and is emitted in different directions. Accordingly, the left eye image IL and the right eye image IR are separated, and incident to different points LE and RE, thereby causing binocular disparity.

As shown in FIG. 11, the lenticular lens L is also disposed in front of the display 120 and refracts the light incident to the lenticular lens L. FIG. Therefore, when the light emitted from the left eye pixel PL and the right eye pixel PR of the display 120 passes through the lenticular lens L, the light is emitted in different directions, and accordingly, the left eye image IL and the right eye image ( IR) is separated and is incident to different points (LE, RE) to generate binocular disparity.

The controller 170 may control the relative position between the pixels including the left eye pixel and the right eye pixel of the display 120 and the optical filter 130 to adjust the emission angle of the light output by the display 120. The relative position between the pixels and the optical filter 130 may be performed by changing the position or arrangement of the optical filter 130 or by changing the position or arrangement of the left eye and right eye pixels of the display 120.

For example, the controller 170 may control the relative position between the pixels and the optical filter 130 by changing the positions of the openings and the blocking portions of the parallax barrier, which will be described with reference to FIG. 12. 12 is a view of the exit angle of the left eye image and the right eye image as the position of the parallax barrier of the stereoscopic image display apparatus 100 according to the present invention is changed.

The parallax barrier may be implemented as a liquid crystal shutter that blocks or transmits light according to an electrical signal, and the liquid crystal shutter may be implemented as two transparent substrates each having an electrode patterned thereon and a liquid crystal layer formed between the substrates. Here, the liquid crystal layer has a property of blocking light when voltage is applied by electrodes of the transparent substrate, and transmitting light when voltage is not applied. Accordingly, the liquid crystal layer that blocks light in the parallax barrier may operate as a blocking portion, and the liquid crystal layer through which light is transmitted may operate as an opening portion.

According to this principle, the controller 170 may control the position or arrangement of the opening and the blocking portion of the parallax barrier by controlling the electrical signal applied to the liquid crystal layer of the parallax barrier.

As such, when the controller 170 controls the parallax barrier B to move the blocking unit BC and the opening BO, as shown in FIG. 12, the emission angle of the light output to the left eye pixel PL is changed. The point LE at which the left eye image IL is incident changes. Similarly, the exit angle of light emitted from the right eye pixel is also changed so that the point where the right eye image is incident is also changed.

For another example, the controller 170 controls the electrical signal applied to the lenticular lens to change the structure, shape, arrangement, position, etc. of the lenticular lens, thereby controlling the relative position between the pixels and the optical filter 130 accordingly. can do. Similar to the parallax barrier, when the structure, shape, arrangement, position, etc. of the lenticular lens are changed, the emission angles of the light output from the left eye pixel and the right eye pixel are changed, and the point where the left and right eye images are incident. will be.

As another example, the controller 170 may control the relative position between the pixels and the optical filter 130 by changing the arrangement or the position of the left eye pixel and the right eye pixel of the display 120. It will be described with reference to FIG. FIG. 13 is a diagram illustrating control of a left eye pixel and a right eye pixel of the display 120 of the stereoscopic image display apparatus 100 according to the present invention, and FIG. 14 is a display 120 of the stereoscopic image display apparatus 100 according to the present invention. Is a diagram relating to the control of an RGB pixel.

The left eye pixel may be a pixel for outputting a left eye image, and the right eye pixel may mean a pixel for outputting a right eye image. As shown in FIG. 13, the control unit 170 may include a left eye pixel PL and a right eye pixel PR. You can swap the positions of. That is, the controller 170 outputs the left eye image to odd-pixel pixels, and controls the display 120 in which even-pixel pixels output the right eye image, and the right eye image to the odd-numbered pixels. The left eye image may be output as an even row of pixels. Accordingly, the position of the point where the left eye image is incident may be changed, and similarly, the position of the point at which the right eye image is incident may be changed.

Alternatively, the controller 170 may change at least one of red-green-blue (RGB) pixels from a left eye pixel to a right eye pixel or vice versa. Specifically, as shown in FIG. 14, the control unit 170 includes a left eye image of 2n + 1, a recording center G, and a blue pixel B of a left eye image, a 2n red pixel of Rn, The recording center (G) and the blue pixel (B) control the display 120 for outputting the right eye image, so that the left eye with 2n red pixels (R), 2n + 1 rows of recording (G) and blue pixels (B) The image may be output, and the right eye image may be output to the red pixel R in the 2n + 1 row, the recording pixel G in the 2n row, and the blue pixel B. Here, the heat is defined in units of blue green pixels, and each column includes blue green pixels.

As such, when the controller 170 changes the relative position between the optical filter 130 and the pixels by controlling the arrangement or position of the pixels of the display 120, the left eye image IL may be similar to the movement of the optical filter 130. ) And the exit angle of the right eye image IR may be changed to adjust the points LE and RE at which light is incident.

The stereoscopic image display apparatus 100 may obtain information about a viewing position (S130).

Here, the viewing position may mean a position for watching a stereoscopic image. More specifically, such a viewing position may mean a position of a left eye point and a right eye point of a user who views a stereoscopic image. Although the viewing position is precisely defined by the left eye point and the right eye point, in general, the distance between both eyes of a human is somewhat constant, about 65mm, and when the user's position is known from the display 120, Since the location of the left eye point and the right eye point can be known, viewing the viewing position as the user's position is not too much.

The controller 170 may obtain information about the viewing position using the image photographed by the camera 140.

In detail, when the camera 140 captures an image of the user, the controller 170 may analyze the photographed image to obtain information regarding the position of the user or the position of both eyes. The controller 170 may determine the location of the user by searching for a skin color area from the captured image and detecting a face area of the user. Furthermore, the controller 170 may determine the positions of both eyes by finding a black region again from the detected facial region. The controller 170 may determine the location of the user or the location of both eyes by using various head-tracking or eye-tracking techniques. In addition, the controller 170 may directly obtain a user's position using a 3D camera 140 such as a depth camera 140 such as a TOF camera 140. will be.

On the other hand, the viewing position in this step is not a position where the user actually watches a stereoscopic image, it may mean the position of the first camera 210 and the second camera 220 to replace both eyes.

To this end, if a face photograph of a person is placed and the left and right eyes are respectively drilled to install the first camera 210 and the second camera 220, the controller 170 determines the positions of both eyes as described above. By doing so, information about a viewing position which is a position of the first camera 210 and the second camera 220 may be obtained.

Alternatively, the controller 170 may recognize the first camera 210 and the second camera 220 from the image, determine the location thereof, and obtain information about the viewing location. The controller 170 may recognize the first camera 210 and the second camera 220 from the image and determine the position thereof. In this case, when the markers are installed in the first camera 210 and the second camera 220, respectively, the controller 170 recognizes the marker instead of directly recognizing the first camera 210 and the second camera 220 from the image. It is also possible to determine the viewing position which is the position of the first camera 210 and the second camera 220 by determining the position of the marker.

The stereoscopic image display apparatus 100 may detect a color difference between light incident to the left eye point of the viewing position and light incident to the right eye point (S140). This step will be described with reference to FIGS. 15 to 17 and 18. 15 to 17 are views of light incident to the left eye point and light incident to the right eye point according to the relative positions of the display 120 and the optical filter 130 of the stereoscopic image display apparatus 100 according to the present invention. 18 is a diagram illustrating color differences according to relative positions of the display 120 and the optical filter 130 of the stereoscopic image display apparatus 100 according to the present invention.

The light output from the display 120 is incident on the first camera 210 installed at the left eye point and the second camera 220 provided at the right eye point as described above. Therefore, the first camera 210 and the second camera 220 may receive the light incident to each point. When light is received by the first camera 210 and the second camera 220, the image sensor implemented by a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) of each camera 140 receives the received light. Accordingly generates an electrical signal.

Here, the color difference may occur due to color difference, contrast difference, saturation difference, luminance difference, or the like. For example, the left eye pixel outputs white, the right eye pixel outputs black, the light of the left eye pixel and the light of the right eye pixel are respectively incident at 5: 5 by the first camera 210, and the second camera 220 Also, when the light of the left eye pixel and the light of the right eye pixel are incident at 50%, the electric signal is generated according to the same luminance of the first camera 210 and the second camera 220, so that the value of the color difference becomes 0. On the contrary, when the light of the left eye pixel is incident to the first camera 210 and the light of the right eye pixel is incident to the second camera 220, the left eye pixel senses high luminance, and the second camera 220 is low. By detecting the luminance, the luminance difference will be big, so the value of the color difference will be large.

The communicator 150 may receive electrical signals generated from the first camera 210 and the second camera 220, respectively, and sense color differences between the light of the left eye point and the light of the right eye point.

Alternatively, when the first camera 210 and the second camera 220 respectively transmit an electrical signal to an external device, the external device calculates a color difference according to the electrical signal, and the control unit 170 communicates with the communication unit 150. By receiving a signal about the color difference from the external device through, it is possible to detect the color difference.

For example, when the display 120 outputs the first color to the left eye pixel and the second color to the right eye pixel, and the relative position between the display 120 and the optical filter 130 is as shown in FIG. 15. The light of the first color and the light of the second color are incident to the first camera 210, and the light of the first color and the light of the second color are also incident to the second camera 220. Thus, the controller 170 will detect a relatively small color difference.

For another example, if the left eye pixel and the right eye pixel also output the first color and the second color, respectively, and the relative position between the display 120 and the optical filter 130 is the same as that shown in FIG. The first color is incident on the camera 210 and the second color is incident on the second camera 220. Therefore, in this case, the control unit 170 will detect a relatively large color difference.

As another example, when the left eye pixel and the right eye pixel output the first color and the second color, respectively, and the relative position between the display 120 and the optical filter 130 is the same as that shown in FIG. The second color is incident on the first camera 210, and the first color is incident on the second camera 220. Even in this case, the controller 170 detects a relatively large color difference, but in the case of FIG. 17, the controller 170 will detect a color difference opposite to the color difference detected by the controller 170.

As described above, when the relative position between the display 120 and the optical filter 130 changes, the color difference of the light incident on each of the left eye point and the right eye point changes. That is, as shown in FIG. 18, when the controller 170 controls the relative positions of the display 120 and the optical filter 130, the light output from the left eye pixel and the right eye pixel of the display 120 is transmitted to the optical filter 130. The exit angle changes through), and thus the light incident on the left eye point and the right eye point changes so that the color difference between the light incident on the left eye point and the light incident on the right eye point changes.

The stereoscopic image display apparatus 100 may calibrate the relative position between the pixels for the viewing position and the optical filter 130 based on the information about the viewing position and the color difference (S150). This step will be described with reference to FIG. 19. FIG. 19 is a diagram illustrating the calibration of the position of the optical filter 130 by the stereoscopic image labeling device according to the color difference.

The controller 170 may calibrate the relative position between the pixels for the viewing position and the optical filter 130 based on the information about the viewing position and the color difference according to the relative positions of the pixels and the optical filter 130.

Specifically, the controller 170 detects the color difference of the viewing position while adjusting the relative position between the pixels and the optical filter 130, and when the color difference detected at the left eye point and the right eye point of the viewing position is the largest. The relative position between the pixels and the optical filter 130 may be matched with respect to the viewing position to perform calibration.

For example, as shown in FIG. 19, when the viewing position is the first viewing position, the control unit 170 moves the position of the parallax barrier to various points P1, P2, P3, and P4, respectively. The color difference between the light incident on the left eye point and the right eye point of the first viewing position is detected at the point. The controller 170 may calibrate the specific point P1 having the largest color difference among the various points to the position of the parallax barrier with respect to the first viewing position.

Accordingly, when the position of the parallax barrier with respect to the viewing position is matched, the left eye image output from the left eye pixel of the display 120 is incident to the left eye point of the viewing position, and the right eye image output from the right eye pixel is incident to the right eye image. Thus, the user in the viewing position can watch the stereoscopic image.

For another example, as shown again in FIG. 19, even when the viewing position is the second viewing position, the parallax relative to the second viewing position is similar to calibrating the position of the parallax barrier with respect to the first viewing position. The position P2 of the barrier can be calibrated. Accordingly, the user at the second viewing position will watch the stereoscopic image.

However, as shown in FIG. 19 again, when the position of the parallax barrier is the first point P1, light of the left eye pixel is incident to the left eye point of the first viewing position, and light of the right eye pixel is viewed first. The color difference is maximized when the light is incident on the right eye of the position, but on the contrary, even when the parallax barrier is located at the third point P3, the light of the right eye is incident on the left eye and the left eye is on the right eye. Of light may be incident so that the color difference is maximized. In this case, the absolute value of the color difference may be the same, but since the direction is different, the controller 170 may distinguish the two and determine either as the calibration position. That is, even if the absolute value of the voltage according to the color difference is the same, the controller 170 determines the first point among the first point and the second point as the calibration position according to whether the voltage is a positive value or a negative value. .

The stereoscopic image display device 100 uses the result of calibrating the relative positions of the pixels and the optical filter 130 with respect to the viewing position, so that the stereoscopic image is provided to the other viewing positions with respect to the pixels and the optical filter 130. You can control the position. This will be described with reference to FIG. 20. 20 is a view of controlling the parallax barrier according to the viewing position according to the stereoscopic image device according to the present invention.

As described above, when the pixels relative to the viewing position and the relative position of the optical filter 130 are calibrated, the 3D image display apparatus 100 uses the result of the calibration to determine the left eye point of the viewing position for the various viewing positions. The relative positions of the pixels and the optical filter 130 may be controlled to allow the left eye image and the right eye image to enter the right eye point, respectively.

For example, the controller 170 may determine the viewing position through the camera 140, move the parallax barrier according to the viewing position, and provide a stereoscopic image at the viewing position. Here, as shown in FIG. 20, when the viewing position moves by a specific distance (Duser), the controller 170 may move the position of the parallax barrier by a distance (Ddevice) proportional thereto. At this time, as described above, since the position of the parallax barrier is already calibrated with respect to the specific viewing position, the stereoscopic image can be provided even for the changed viewing position.

According to the calibration method of the stereoscopic image display device 100 of the present invention, it is possible to calibrate the relative position of the display 120 and the optical filter 130 for a particular viewing position.

Accordingly, the stereoscopic image display apparatus 100 may control the relative positions of the display 120 and the optical filter 130 to properly provide stereoscopic images for various viewing positions using the calibration result.

In the calibration method of the stereoscopic image display apparatus 100 according to the present invention described above, the step of configuring each embodiment is not essential, so each embodiment may optionally include the above-described steps. In addition, each step constituting each embodiment is not necessarily to be performed in the order described, the steps described later may be performed before the steps described first.

In addition, in the calibration method of the stereoscopic image display apparatus 100 according to the present invention, each embodiment may be used individually or in combination with each other. In addition, the steps configuring each embodiment may be used separately or in combination with the steps configuring another embodiment.

In addition, the calibration method of the stereoscopic image display apparatus 100 according to each embodiment of the present invention may be stored in a computer-readable recording medium in the form of a code or a program for performing the same.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. The present invention is not limited to the drawings. In addition, the embodiments described in this document can be applied to not only the present invention, but also all or some of the embodiments may be selectively combined so that various modifications can be made.

100: electronic device 110: user input unit 120: display
130: optical filter 140: camera 150: communication unit
160: memory 170: control unit 180: power supply unit

Claims (19)

A display including a left eye pixel and a right eye pixel;
An optical filter provided on the front of the display to generate binocular disparity; And
The left eye pixel and the right eye pixel are controlled to output different colors,
Detecting the color difference between the light incident to the left eye point of the viewing position and the light incident to the right eye point while controlling the relative position between the pixels and the optical filter so that the emission angle of the light output from the left eye pixel and the right eye pixel is adjusted And a controller configured to calibrate the relative position with respect to the viewing position based on the color difference.
Stereoscopic image display device.
The method of claim 1,
The controller is configured to calibrate a relative position with respect to the viewing position to a relative position where the color difference is maximum.
Stereoscopic image display device.
The method of claim 2,
The color difference is a luminance difference between light incident to the left eye point and light incident to the right eye point.
Stereoscopic image display device.
The method of claim 2,
The left eye pixel outputs white, and the right eye pixel outputs black.
Stereoscopic image display device.
The method of claim 1,
The control unit controls the relative position by adjusting the optical filter.
Stereoscopic image display device.
The method of claim 5,
The optical filter is any one of a parallax barrier or a lenticular lens.
Stereoscopic image display device.
The method according to claim 6,
The parallax barrier includes a blocking portion for blocking light and an opening for transmitting light,
The control unit controls the relative position by adjusting the positions of the blocking unit and the opening.
Stereoscopic image display device.
The method of claim 1,
The control unit controls the relative position by adjusting the positions of the left eye pixel and the right eye pixel of the display.
Stereoscopic image display device.
The method of claim 1,
Further comprising a camera,
The control unit determines the viewing position based on the image photographed by the camera,
Calibrating the relative position with respect to the determined viewing position
Stereoscopic image display device.
10. The method of claim 9,
After performing the calibration, the controller controls the relative position based on a result of the calibration when the viewing position is changed based on the image photographed by the camera, and performs a left eye to the left eye point of the changed viewing position. The light output from the pixel is incident, and the light output from the right eye pixel is incident to the right eye point.
Stereoscopic image display device.
The method of claim 1,
It further comprises a communication unit;
The control unit obtains information on light incident to the left eye point from the first camera installed at the left eye point through the communication unit, and information on light incident to the right eye point from the second camera installed at the right eye point. To obtain
Stereoscopic image display device.
A first camera installed at a left eye point of the viewing position;
A second camera installed at a right eye point of the viewing position; And
A display including a left eye pixel and a right eye pixel, an optical filter provided at the front of the display to generate binocular disparity, and the left eye pixel and the right eye pixel controlled to output different colors, and the left eye pixel and the right eye pixel Receiving information about the light incident to the left eye point from the first camera through the communication unit while controlling the relative position between the pixels and the optical filter so that the output angle of the output light is adjusted, and from the second camera A controller configured to receive information about light incident to the right eye point, obtain color differences between the light incident to the left eye point and the right eye point, and calibrate the relative position with respect to the viewing position based on the color difference; A stereoscopic image display device comprising;
Calibration system of stereoscopic image display device.
Outputting different colors between the left eye pixel and the right eye pixel of the display;
An optical filter disposed in front of the display emitting light output from the left eye pixel and the right eye pixel at different angles;
Controlling a relative position between the pixels and the optical filter to adjust an emission angle of light output from the left eye pixel and the right eye pixel;
Acquiring a color difference between light incident to the left eye point of the viewing position and light incident to the right eye point while controlling the relative position; And
And calibrating the relative position with respect to the viewing position based on the color difference.
Calibration method of 3D image display device.
The method of claim 13,
The step of calibrating,
Calibrating a relative position with respect to the viewing position to a relative position where the color difference is maximum
Calibration method of 3D image display device.
The method of claim 13,
The step of controlling the relative position,
Controlling the relative position by adjusting the optical filter
Calibration method of 3D image display device.
16. The method of claim 15,
The optical filter is any one of a parallax barrier or a lenticular lens.
Calibration method of 3D image display device.
17. The method of claim 16,
The parallax barrier includes a blocking portion for blocking light and an opening for transmitting light,
The step of controlling the relative position,
Control the relative position by adjusting the position of the blocking portion and the opening
Calibration method of 3D image display device.
The method of claim 13,
The step of controlling the relative position,
Controlling the relative position by adjusting the position of the left eye pixel and the right eye pixel of the display
Calibration method of 3D image display device.
The method of claim 13,
Photographing an image including a viewing position; And
Determining the viewing position based on the captured image;
The step of calibrating,
Calibrating a relative position relative to the determined viewing position
Calibration method of 3D image display device.

Images