KR102279816B1 - Autostereoscopic 3d display device - Google Patents

Abstract

The glasses-free stereoscopic image display device of the present invention is characterized in that the 3D image is viewed at any position by substituting view data of the image panel according to the position of the viewer. To this end, the type and number of images perceived by the left and right eyes according to the viewer's position, and the distribution on the image panel are generalized into equations and analyzed.
In this case, the present invention is characterized in that the ratio of the 3D area is increased by overlapping the viewing diamonds or the 2D area is reduced by inserting black data into the view of the 2D area. In addition, the present invention is characterized in that crosstalk that occurs due to overlapping views is eliminated through view data rendering.
As described above, the degree of viewing freedom is increased by the expansion of the 3D viewing area, and the gap glass can be removed, thereby providing the effect of reducing the cost.

Description

Glasses-free stereoscopic image display device {AUTOSTEREOSCOPIC 3D DISPLAY DEVICE}

The present invention relates to a stereoscopic image display device, and more particularly, to a glasses-free stereoscopic image display device in which no glasses are worn.

A 3D display can be simply defined as "the totality of a system that artificially reproduces a 3D screen".

Here, the system includes a software technology that can be viewed in 3D and hardware that actually implements the contents made by the software technology in 3D. The reason for including the software area is that, in the case of 3D display hardware, content composed of a separate software method is required for each three-dimensional implementation method.

In addition, a virtual 3D display (hereinafter referred to as a stereoscopic image display device) uses binocular disparity, which appears because our eyes are about 65 mm apart in the horizontal direction, among various factors that a person feels a three-dimensional effect in a flat display hardware. In other words, it is the totality of the system that allows you to feel a virtual three-dimensional effect. In other words, even if our eyes look at the same object due to binocular disparity, each of us sees slightly different images (to be more precise, each has a small amount of left and right spatial information), and when these two images are transmitted to the brain through the retina, the brain By precisely fusion with each other, we can feel a three-dimensional effect, and it is a three-dimensional image display device that creates a virtual three-dimensional effect through the design of simultaneously displaying two left and right images on a 2D display device and sending them to each eye. .

In order to display an image of two channels on a single screen in such a stereoscopic image display device, in most cases, one screen is outputted one by one while changing the lines in one of the horizontal or vertical directions on one screen. When images of two channels are simultaneously output from one display device, the right image enters the right eye and the left image enters only the left eye in the case of the glasses-free method due to the hardware structure. In addition, in the case of the method of wearing glasses, a method of covering the right image so that the left eye cannot see it and the left image so that the right eye cannot see it is used through special glasses suitable for each method.

As such, the most important factor for a person's sense of three-dimensionality and depth is binocular disparity due to the distance between the two eyes, but there is also a deep relationship to psychological and memory factors. It is usually divided into a volumetric type, a holographic type, and a stereoscopic type based on whether the 3D image information can be provided.

The volume expression method is a method to feel a sense of perspective in the depth direction by psychological factors and suction effects, and is a 3D computer graphic that displays perspective, overlap, shading, contrast, and movement by calculation, or viewing angle to an observer. It is being applied to so-called IMAX movies, which provide an optical illusion of being sucked into the space by providing this wide screen.

The three-dimensional expression method, which is known as the most complete stereoscopic image realization technology, can be represented by laser light reproduction holography or white light reproduction holography.

And, the three-dimensional expression method is a method to feel a three-dimensional effect using physiological factors of both eyes, and as described above, when a flat related image including parallax information is seen in the left and right eyes of a human that are located about 65 mm apart, the brain In the process of merging them, spatial information before and after the display surface is generated and the ability to feel a three-dimensional effect, that is, stereoography is used. Such a three-dimensional expression method is largely divided into a method of wearing glasses and a method of not wearing glasses.

Representative examples of a method for not wearing glasses include a lenticular lens method in which a lenticular lens plate in which cylindrical lenses are vertically arranged in front of an image panel and a parallax barrier method.

FIG. 1 is a diagram for explaining the concept of a general lenticular lens type stereoscopic image display device, and shows the relationship between the rear distance (S) of the lens and the viewing distance (v).

Referring to FIG. 1 , a general lenticular lens type stereoscopic image display device is positioned on the upper and lower substrates, a liquid crystal panel 10 filled with liquid crystals therebetween, and the rear surface of the liquid crystal panel 10 to irradiate light. a backlight unit (not shown) and a lenticular lens plate 20 positioned on the front surface of the liquid crystal panel 10 to implement a stereoscopic image.

The lenticular lens plate 20 is formed by forming a plurality of lenticular lenses whose upper surface is made of a convex lens-shaped material layer on a flat substrate.

The lenticular lens plate 20 serves to divide the left and right eye images, and at the optimal viewing distance v from the lenticular lens plate 20, the images corresponding to the left and right eyes in the left and right eyes, respectively, normally reach diamonds. A viewing diamond (mechanical region) (not shown) in the form of a viewing diamond is formed.

One width of the viewing diamond is formed by the size of the distance between the viewers' eyes, and this is to recognize a stereoscopic image by inputting images with parallax to the left and right eyes of the viewer.

At this time, view data of a corresponding sub-pixel of the liquid crystal panel 10, that is, an image is formed in each viewing diamond.

The view data refers to an image captured by a camera that is spaced apart by the standard of the distance between the eyes. Hereinafter, view data and view image will be used with the same meaning.

In such a general lenticular lens type stereoscopic image display device, the liquid crystal panel 10 and the lenticular lens plate 20 are supported by a mechanism (not shown), etc., and a predetermined distance between the liquid crystal panel 10 and the lenticular lens plate 20 is provided. (back distance; S) spaced apart.

At this time, in a stereoscopic image display device of a general lenticular lens type, a gap glass 26 is inserted to keep the rear distance S constant.

As described above, since the lenticular lens type stereoscopic image display device is implemented in a multi-view method formed according to an initially designed view map, the viewer enters the 3D image area when entering a predetermined view area. can watch

Referring to the Korean application 10-2012-0108794 previously filed by the present applicant, it is possible to control the extent of the extension and depth of the 3D viewing zone by replacing the view data appropriately according to the images perceived by the viewer's left and right eyes. can

However, in this case, the processing of the 2D area (ie, the 2D viewing area) generated as the viewer moves forward or backward at the optimal viewing distance of the stereoscopic image display device is not mentioned.

2A and 2B are diagrams illustrating an example in which a 2D region is generated.

At this time, FIGS. 2A and 2B show sub-pixels and views recognized by the viewer's left and right eyes when the viewer is positioned immediately behind the optimal viewing distance (first and second rear viewing areas) as an example.

In this case, FIG. 2A shows sub-pixels and views perceived by the viewer's left eye, and FIG. 2B shows sub-pixels and views perceived by the viewer's right eye as examples.

2A and 2B , when the viewer's left and right eyes are located in the first rear viewing area and the second rear viewing area, the viewer's left eye includes sub-pixels displaying the first view image 1 and the second Viewing the sub-pixels displaying the three-view image 3 together, the viewer's right eye sees the sub-pixels displaying the third-view image 3 .

That is, when the viewer's left and right eyes are located in the first rear viewing area and the second rear viewing area, the viewer feels the 2D area in a part of the image panel.

The present invention is to solve the above problem, and by replacing the view data of the image panel according to the position of the viewer, the 2D viewing area and the inverse stereoscopic viewing area are removed, so that the 3D image can be viewed from any position. The purpose is to provide a device.

In addition, other objects and features of the present invention will be described in the following description of the invention and claims.

In order to achieve the above object, the glasses-free stereoscopic image display device according to an embodiment of the present invention replaces the view data of the image panel according to the position of the viewer, and increases the ratio of the 3D area by overlapping the viewing diamonds. It is characterized by inserting black data into the view of the 2D area.

In addition, the glasses-free stereoscopic image display device according to an embodiment of the present invention is characterized in that crosstalk generated due to overlapping views is eliminated through view data rendering.

To this end, in the autostereoscopic 3D display device according to an embodiment of the present invention, the first view to the mth view are sequentially allocated to m (m is a natural number) sub-pixel image panel to display input data of multi-views. , disposed in front of the image panel, separating the optical axis of the input data to form a viewing diamond in which the first view image to the Kth view image (K is a natural number satisfying 1≤K≤m) is displayed at the optimal viewing distance A timing controller that calculates a view corresponding to a 3D filter and a viewer's position and a 2D region, and overlaps the viewing diamonds based on this, may be included.

In this case, if the viewer's position corresponds to N times the optimal viewing distance, the viewing diamond may be superimposed N or more times.

The timing controller may calculate the views and the number of views perceived by the viewer's left and right eyes according to the viewer's position.

In this case, the view data rendering area may be selected based on the calculated views and the number of views.

In this case, the view image may be replaced with one view image having a disparity for the viewer's left and right eyes, respectively, based on the selected view data rendering area.

In this case, for example, in the case of the left eye, any one view image among the plurality of recognized view images is replaced, and in the case of the right eye, another view image other than the view image replaced by the left eye among the plurality of view images recognized. can be replaced with

As described above, the glasses-free stereoscopic image display device according to an embodiment of the present invention provides the effect of increasing the viewing freedom by expanding the 3D viewing area, and enhancing the design freedom of the focal length and the rear distance.

In addition, it is possible to remove the gap glass provides an effect of reducing the cost.

1 is a view for explaining the concept of a stereoscopic image display device of a general lenticular lens type.
2A and 2B are views showing an example in which a 2D region is generated;
3 is a block diagram schematically showing the configuration of an autostereoscopic image display device according to an embodiment of the present invention.
4 is a perspective view schematically showing an autostereoscopic image display device according to an embodiment of the present invention;
5 is an exemplary view for explaining a viewing zone in the glasses-free stereoscopic image display device.
6 is a view showing a viewing diamond projected on the XZ-plane.
7A and 7B are views showing the viewing diamond coordinates as an example;
Fig. 8 is a view showing the viewing diamond coordinates in the XZ-plane as an example at a distance of twice the optimal viewing distance;
9 is a view showing, for example, the viewing diamond coordinates in the XZ-plane in the entire area including the optimal viewing distance.
FIG. 10 is a view showing, as an example, viewing diamond coordinates in the XZ-plane at a viewing distance k times the optimal viewing distance.
Fig. 11 shows by way of example a viewing diamond cell in the XZ-plane;
12 is a view showing, as an example, the coordinates of the viewing area including the position of both eyes in the XZ-plane at the position P1;
13A and 13B are views illustrating views perceived by left and right eyes of a viewer at a position P1 as an example;
Fig. 14 shows the 2D and 3D regions at the P1 position;
Fig. 15 is a view showing, as an example, the coordinates of the viewing area including the positions of both eyes in the XZ-plane at the position P2;
16A and 16B are views illustrating views perceived by the viewer's left and right eyes at a position P2 as an example;
Fig. 17 shows the 2D and 3D regions at the P2 position.
18 is a view showing, for example, the position of both eyes applied to the viewing diamond at the position P2.
19A and 19B are views illustrating views perceived from left and right eyes of a viewer at a position P3 as an example;
Fig. 20 is a diagram showing 2D and 3D regions at the P3 position;
21A and 21B are views illustrating views perceived from the left and right eyes of a viewer at a position Pj as an example;
22A and 22B are views illustrating views perceived by the viewer's left and right eyes at a position Pj that is twice or more of an optimal viewing distance.
23 is a view showing, as an example, the positions of both eyes applied to the viewing diamond at a viewing distance that is more than twice the optimal viewing distance.
24A and 24B are views illustrating a viewing area of a multi-view image according to a viewer's position as an example;
25 is a view showing, as an example, views recognized from the left and right eyes of a viewer at a position P1 in a two-layered structure;
26 is a view showing, as an example, views recognized by a viewer's left and right eyes at a position P2 in a two-layered structure;
Fig. 27 is a diagram showing 2D and 3D regions at a P2 position in a two-layered structure;
28 is a view illustrating an arrangement of a pixel array and a lenticular lens in which a view-map is written in the autostereoscopic image display device according to an embodiment of the present invention.
29A and 29B are views by way of example showing sub-pixels and views perceived in the left and right eyes at the P1 position;
Figures 30a and 30b are views by way of example showing sub-pixels and views perceived in the left eye at position P2;
31A and 31B show by way of example sub-pixels and views perceived in the right eye at position P2;
32A and 32B are diagrams showing sub-pixels and views recognized from the left eye at a P2 position as an example when view data rendering is applied;
33A and 33B are diagrams showing sub-pixels and views recognized by the right eye at the P2 position as an example in the case of applying view data rendering;
34 and 35 are diagrams showing examples of converting input data through view data rendering;
Fig. 36 is a diagram showing another example of transforming input data through view data rendering;
FIG. 37 is a view showing sub-pixels and views recognized in the left eye at a position P2 as an example in the case of applying the view data rendering shown in FIG. 36; FIG.
FIG. 38 is a view showing sub-pixels and views recognized by the right eye at the P2 position as an example in the case of applying the view data rendering shown in FIG. 36; FIG.

Hereinafter, with reference to the accompanying drawings, a preferred embodiment of the glasses-free stereoscopic image display device according to the present invention will be described in detail so that a person of ordinary skill in the art can easily implement it.

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in various different forms, and only these embodiments allow the disclosure of the present invention to be complete, and common knowledge in the art to which the present invention pertains It is provided to fully inform those who have the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout. The sizes and relative sizes of layers and regions in the drawings may be exaggerated for clarity of description.

Reference to an element or layer to another element or “on” or “on” includes not only directly on the other element or layer, but also with other layers or other elements interposed therebetween. do. On the other hand, reference to an element "directly on" or "directly on" indicates that there are no intervening elements or layers.

The spatially relative terms "below, beneath", "lower", "above", "upper", etc. are one element or component as shown in the drawings. and can be used to easily describe the correlation with other devices or components. Spatially relative terms should be understood as terms including different orientations of the device during use or operation in addition to the orientation shown in the drawings. For example, if an element shown in the figures is turned over, an element described as "beneath" or "beneath" another element may be placed "above" the other element. Accordingly, the exemplary term “below” may include both directions below and above.

The terminology used herein is for the purpose of describing the embodiments, and thus is not intended to limit the present invention. As used herein, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprise” and/or “comprising” refers to the presence of one or more other components, steps, operations and/or elements mentioned. or addition is not excluded.

3 is a block diagram schematically showing the configuration of an autostereoscopic image display device according to an embodiment of the present invention.

3, the glasses-free stereoscopic image display device according to the embodiment of the present invention is largely an image panel 110, image panel drivers 111 and 112, 3D filter 120, 3D filter driver (not shown), The timing controller 113 may be included.

A stereoscopic image display device according to an embodiment of the present invention includes a liquid crystal display (LCD), an organic light emitting diode display (OLED), a field emission display (FED), and a plasma. It may be implemented as a flat panel display device such as a plasma display panel (PDP) or an electroluminescent display (EL). Although the present invention exemplifies the case in which the image panel 110 is configured as a liquid crystal display in the following embodiment, the present invention is not limited thereto.

At this time, a plurality of sub-pixels displaying red, green, and blue are formed in the image panel 110 , and these sub-pixels work with the 3D filter 120 to display a stereoscopic image, a left eye image and a right eye image. A left-eye pixel and a right-eye pixel for displaying an image are separated.

For example, when the image panel 110 is configured as a liquid crystal display device, the present invention provides a liquid crystal mode, that is, a twisted nematic (TN) mode, an in-plane switching (IPS) mode, a fringe- It is applicable regardless of the field switching (Fringe Field Switching; FFS) mode and the vertical alignment (VA) mode.

At this time, although not shown, the image panel 110 may be largely composed of a color filter substrate, an array substrate, and a liquid crystal layer formed between the color filter substrate and the array substrate.

The color filter substrate is a color filter composed of a plurality of sub-color filters that implement red, green, and blue colors and a black matrix (BM) that separates the sub-color filters and blocks the light passing through the liquid crystal layer; And it may be formed of a transparent common electrode for applying a voltage to the liquid crystal layer.

The array substrate includes a plurality of gate lines (G1, G2, G3, ..., Gn), data lines (D1, D2, D3, ..., Dm), and gate lines arranged vertically and horizontally to define a plurality of pixel regions. It consists of a thin film transistor, which is a switching element, formed at the intersection of (G1, G2, G3,..., Gn) and the data lines D1, D2, D3,..., Dm, and a pixel electrode formed in the pixel area.

The thin film transistor is electrically connected to a gate electrode connected to the gate lines G1, G2, G3,..., Gn, a source electrode connected to the data lines D1, D2, D3,..., Dm, and a pixel electrode. It consists of a drain electrode. In addition, the thin film transistor includes a gate insulating film for insulation between the gate electrode and the source/drain electrodes, and an active layer that forms a conductive channel between the source electrode and the drain electrode by a gate voltage supplied to the gate electrode.

An upper polarizing plate is attached to the outer surface of the color filter substrate, and a lower polarizing plate is attached to the outer surface of the array substrate. The light transmission axis of the upper polarizing plate and the light transmission axis of the lower polarizing plate may be formed to be perpendicular to each other. In addition, an alignment layer for setting a pre-tilt angle of the liquid crystal layer is formed on the inner surfaces of the color filter substrate and the array substrate, while a cell gap of the image panel 110 is formed between the color filter substrate and the array substrate. A spacer for maintaining the cell gap) is formed.

The image panel 110 configured in this way displays an image under the control of the timing controller 113 .

The image panel 110 may display a 2D image in a 2D mode and a multi-view image in a 3D mode under the control of the timing controller 113 .

The view of the stereoscopic image may be generated by separating the cameras by the distance between both eyes of the viewer and photographing an image of the object. For example, when an object is photographed using nine cameras, the image panel 110 may display a stereoscopic image of nine views.

The image panel drivers 111 and 112 include the data driver 111 for supplying data voltages of 2D/3D images to the data lines D1, D2, D3, ..., Dm of the image panel 110 and the image panel. and a gate driver 112 for sequentially supplying scan pulses (or gate pulses) to the gate lines G1 , G2 , G3 , ..., Gn of 110 . The image panel drivers 111 and 112 spatially disperse and write the left-eye and right-eye image data input as data of the multi-view image data format in the sub-pixels of the image panel 110 in the 3D mode.

At this time, although not shown, the viewing distance detecting unit connected to the host system 115 detects the viewer's distance and the viewer's binocular position using a sensor, and converts the result into digital data to convert the result into digital data to the host system 115 or timing controller ( 113) is supplied. As the sensor, an ultraviolet sensor or a high-frequency sensor may be applied.

The viewing distance detecting unit may analyze the output of the two sensors by triangulation, calculate the distance between the image panel 110 and the viewer, and transmit the result to the host system 115 or the timing controller 113 . The viewing distance detector may detect the position of both eyes of the viewer by analyzing the sensor output through a known face recognition algorithm, and transmit the result to the host system 115 or the timing controller 113 .

The timing controller 113 receives timing signals such as a data enable signal DE and a dot clock CLK to control operation timings of the gate driver 111 and the data driver 112 . (GCS, DCS).

That is, the timing controller 113 drives the image panel 110 at a predetermined frame frequency based on the image data and timing signals input from the multi-view image converter 114 (or the host system 115), A gate driver control signal GCS and a data driver control signal DCS may be generated based on a predetermined frame frequency. The timing controller 113 supplies the gate driver control signal GCS to the gate driver 111 , and supplies image data R, G, and B and the data driver control signal DCS to the data driver 112 .

The gate driver control signal GCS for controlling the gate driver 111 includes a gate start pulse, a gate shift clock, and a gate output enable signal. The gate start pulse controls the timing of the first gate pulse. The gate shift clock is a clock signal for shifting the gate start pulse. The gate output enable signal controls the output timing of the gate driver 111 .

The data driver control signal DCS for controlling the data driver 112 includes a source start pulse, a source sampling clock, a source output enable signal, a polarity control signal, and the like. includes The source start pulse controls the data sampling start time of the data driver 112 . The source sampling clock is a clock signal that controls the sampling operation of the data driver 112 based on a rising or falling edge. If digital video data to be input to the data driver 112 is transmitted in the mini LVDS (Low Voltage Differential Signaling) interface standard, the source start pulse and the source sampling clock may be omitted. The polarity control signal inverts the polarity of the data voltage output from the data driver 112 in L (L is a natural number) horizontal period period. The source output enable signal controls the output timing of the data driver 112 .

The data driver 112 includes a plurality of source drive ICs. The source drive ICs convert the image data R, G, and B input from the timing controller 113 into positive/negative gamma compensation voltages to generate positive/negative analog data voltages. The positive/negative analog data voltages output from the source drive ICs are supplied to the data lines D1 , D2 , D3 , ..., Dm of the image panel 110 .

The gate driver 111 includes one or more gate drive ICs. The gate driver 111 includes a shift register, a level shifter for converting an output signal of the shift register to a swing width suitable for driving a TFT of a liquid crystal cell, an output buffer, and the like. The gate driver 111 sequentially supplies a gate pulse synchronized with the data voltage to the gate lines G1 , G2 , G3 , ..., Gn of the image panel 110 under the control of the timing controller 113 .

In particular, the timing controller 113 according to an embodiment of the present invention may perform a function of analyzing the type and number of images recognized by the left and right eyes and the distribution on the image panel 110 through calculation according to the viewer's position. there is. In this case, in order to reduce the 2D area, the ratio of the 3D area may be increased by overlapping the viewing diamonds, or black data may be inserted into the view of the 2D area. Alternatively, view data that is the same as or similar to view data adjacent to the view in the 2D area may be input.

If the viewing diamonds are overlapped, the viewing distance can be extended. For example, in order to extend the viewing distance N times, the viewing diamond may be configured to overlap N times or more.

In addition, as will be described later, the timing controller 113 according to an embodiment of the present invention may perform a function of calculating the views and the number of views recognized by the viewer's left and right eyes based on the equation devised by the present applicant. . Based on the calculated views and the number of views, the view data rendering area or sub-pixels or views may be selected and applied.

In addition, the timing controller 113 according to the embodiment of the present invention newly maps input data for each sub-pixel of the image panel 110 through a view data rendering process to eliminate crosstalk caused by overlapping views. function can be performed.

A multi-view image conversion unit 114 may be installed between the timing controller 113 and the host system 115 . The multi-view image converter 114 rearranges the left-eye and right-eye image data of the 3D image input from the host system 115 in the 3D mode into a multi-view image data format and transmits the rearranged data to the timing controller 113 .

That is, the multi-view image conversion unit 114 generates left-eye and right-eye image data from the 2D image data by executing a preset 2D-3D image conversion algorithm when 2D image data is input in the 3D mode, and converts the data into a multi-view image. It is rearranged in a data format and transmitted to the timing controller 113 .

The host system 115 may be implemented as any one of a television (television) system, a set-top box, a navigation system, a DVD player, a Blu-ray player, a personal computer, a home theater system, and a phone system. The host system 115 converts digital video data of the 2D/3D input image into a format suitable for the resolution of the image panel 110 using a scaler, and transmits a timing signal together with the data to the timing controller 113 . send.

The host system 115 supplies the 2D image to the timing controller 113 in the 2D mode, and supplies the 3D image or 2D image data to the multi-view image converter 114 in the 3D mode. The host system 115 transmits a mode signal to the timing controller 113 in response to user data input through a user interface (UI) (not shown) to change the motion mode of the autostereoscopic display device to the 2D mode and the 2D mode. You can switch in 3D mode. The user interface may be implemented as a keypad, a keyboard, a mouse, an on-screen display (OSD), a remote controller, a graphic user interface (GUI), a touch UI, and the like. The user can select 2D mode and 3D mode through the user interface, and can select 2D-3D image conversion in 3D mode.

That is, the host system 115 supplies image data and timing signals to the multi-view image converter 114 through an interface such as a low voltage differential signaling (LVDS) interface or a transition minimized differential signaling (TMDS) interface. The host system 115 supplies 3D image data including left-eye image data and right-eye image data to the multi-view image converter 114 . As described above, the timing signals include a vertical synchronization signal, a horizontal synchronization signal, a data enable signal, a dot clock, and the like.

The host system 115 receives the viewer detection information from the viewing distance sensor, and calculates the optimal number of views according to the viewer detection information. The host system 115 generates a view control signal according to the optimal number of views and supplies it to the multi-view image converter 114 . The host system 115 may receive the number of viewers of the viewer detection information as an input address and generate a view control signal using a lookup table that outputs the number of views stored in the input address.

Next, the 3D filter 120 is a medium that optically separates the path of the image, and includes a light transmission region for transmitting or blocking the left eye image and the right eye image output from the left eye pixel and the right eye pixel of the image panel 110 , and It functions to form a light blocking region.

The 3D filter 120 may be variously configured using known techniques such as the following lenticular lens or barrier. The lenticular lens and the barrier may be implemented as a switchable lens or a switchable barrier that is electrically controlled using a liquid crystal panel. For reference, the present applicant has proposed a switchable lens or a switchable barrier through US Application 13/077565, US Application 13/325272, Korean Application 10-2010-0030531, and the like.

The 3D filter driver may shift the switchable lens or the switchable barrier in synchronization with image data written in the pixel array of the image panel 110 in the 3D mode under the control of the timing controller 113 .

4 is a perspective view schematically showing a glasses-free stereoscopic image display device according to an embodiment of the present invention, illustrating a lenticular lens type stereoscopic image display device as an example.

Referring to FIG. 4 , the lenticular lens type stereoscopic image display device includes a plurality of lenticular lenses (w) having a predetermined width (w) on the front surface of the image panel 110 on which a plurality of sub-pixels (R, G, B) are disposed. A lenticular lens plate 120 that is a 3D filter including 125 is disposed.

The lenticular lens plate 120 is formed by forming a material layer having a convex lens shape on an upper surface of a flat substrate.

The lenticular lens plate 120 serves to divide the left and right eye images, and the optimal viewing distance (OVD) v from the lenticular lens plate 120 corresponds to the left and right eyes respectively for the left and right eyes. A viewing diamond (emphasis region) where images normally arrive is formed.

Accordingly, the video image transmitted through the video panel 110 passes through the lenticular lens plate 120 to allow different image groups to enter the left and right eyes of the final viewer, so that a three-dimensional stereoscopic image can be felt.

In this lenticular lens type stereoscopic image display device, the image panel 110 and the lenticular lens plate 120 are supported by a mechanism (not shown), etc., and the image panel 110 and the lenticular lens plate 120 are separated by a predetermined distance ( rear distance) are spaced apart.

Meanwhile, according to the embodiment of the present invention, the arrangement of the plurality of lenticular lenses 125 is inclined with a first angle θ with respect to the longitudinal direction (Y-axis direction) of the sub-pixels R, G, and B. The horizontal width w along the lateral direction (X-axis direction) of the sub-pixels R, G, and B of the lenticular lens 125 is an integer of the sub-pixels R, G, and B. Can be set to double.

That is, in the stereoscopic image display device according to the embodiment of the present invention, the lenticular lens 125 provided in the lenticular lens plate 120 is positioned at a first angle θ with respect to the longitudinal direction of the sub-pixels R, G, and B. ) can be tilted.

Accordingly, the number of views for viewing a 3D image can be adjusted by the inclined arrangement of the lenticular lens plate 120 with respect to the image panel 110 displaying the 2D image.

In the lenticular lens plate 120 , the first angle θ inclined with respect to the longitudinal direction of the sub-pixels R, G, B of the lenticular lens 125 is tan ^-1 ((M*Pa)/(N) *Pb)).

In this case, Pa is the pitch of the minor axes of the sub-pixels R, G, and B, Pb is the pitch of the major axes of the sub-pixels R, G, and B, M and N are each an arbitrary natural number, and the lenticular lens 125 is In the transverse direction of the sub-pixels (R, G, B) in the group when a plurality of sub-pixels (R, G, B) are grouped, and one group is passed through the vertices exactly diagonally. It is defined as the number of sub-pixels R, G, B and the number of sub-pixels R, G, B in the longitudinal direction of the sub-pixels R, G, B. In this case, in general, M and N generally satisfy the value of M/N ≤ 2.

At this time, the numbers assigned to the plurality of sub-pixels R, G, and B located in one group are three-dimensional in which the lenticular lens 125 of the lenticular lens plate 120 is tilted at a first angle θ. It becomes the number of views defined as the area where 3D image viewing of the image display device is possible, and the number assigned to each view becomes sub-pixels (R, G, B) displayed when 3D image is viewed in each view area.

As described above, the stereoscopic image display device according to an embodiment of the present invention having the lenticular lens plate 120 has an effect in terms of improving luminance, and further has an effect of improving a viewing angle for viewing a 3D image through an increase in the number of views.

The increase in the number of views is a structure in which the lenticular lens 125 provided on the lenticular lens plate 120 is arranged to have a predetermined angle with respect to the longitudinal direction of the sub-pixels R, G, and B, that is, slanted. ) structure is applied. By applying such a slanted structure, it is possible to prevent a decrease in resolution in one direction.

On the other hand, it is common for the viewer to view the stereoscopic image display device at a viewing distance other than the optimal viewing distance, that is, before or after the optimal viewing distance.

According to the study of the present applicant, it can be seen that the 2D recognition area (hereinafter referred to as the 2D area) increases and the 3D recognition area (hereinafter referred to as the 3D area) decreases as the distance from the image panel increases compared to the optimal viewing distance. In addition, since the coordinates of the viewing diamond and the perceived view change according to the size of the image panel, an optimal viewing distance control technology considering the size of the image panel is required.

Therefore, it is necessary to generalize the viewing diamond of the stereoscopic image display device into a formula, formulate the type of binocular perception image according to the viewer's position and the change of the overlapping image, and analyze the correlation between the change in the viewer's position and the optimal viewing distance control. there is.

First, the 3D viewing zone of the stereoscopic image display apparatus can be three-dimensionally expressed as shown in FIGS. 5 and 6 below.

5 is an exemplary view for explaining a viewing area in the glasses-free stereoscopic image display device.

And, FIG. 6 is a view showing a viewing diamond projected on the XZ-plane.

5 and 6 , at the optimal viewing distance v from the image panel 110 , a diamond-shaped viewing diamond (embryonic region) 130 is formed in which images corresponding to the left and right eyes respectively reach the left and right eyes. has been

The diamond in the viewing area may be divided into a front triangle zone 130a and a rear triangle zone 130b.

All the electric field processes described below may be performed on the assumption that the width of the viewing diamond 130 formed at the optimal viewing distance is equal to the binocular distance e, and the light travels straight.

The width and height of the image panel 110 may be determined by W and H, respectively.

At this time, the light passing through (0, 0, v) at _{(W/2, 0, 0) is represented by R 0} , and the light passing through (ne, 0, v) at (W/2, 0, 0) Light can be denoted by Rn. The light passing through (0, 0, v) at _{(-W/2, 0, 0) is denoted by L 0} , and the light passing through (ne, 0, v) at (-W/2, 0, 0) Light can be denoted by Ln.

As follows, the 3D viewing area (or viewing diamond) can be displayed by generalizing it to spatial coordinates, and using this, the size of the viewing area according to the display characteristics and the 3D area of the viewer can be calculated.

7A and 7B are diagrams showing the viewing diamond coordinates as an example.

Here, FIG. 7A shows the viewing diamond coordinates in the XZ-plane, while FIG. 7B shows the viewing diamond coordinates in the ZY-plane.

Referring to FIGS. 7A and 7B , the spatial coordinates of the vertices (n-1)e, ne, and fn of the front triangular zone 130a can be expressed by Equation 1 below.

[Equation 1]

In this case, the spatial coordinates (fnx, fny, fnz) of fn can be obtained by using the similarity ratio of the triangles as shown in the following equations.

[Equation 2]

therefore,

Likewise,

[Equation 3]

therefore,

[Equation 4]

therefore,

In addition, the spatial coordinates of the vertices (n-1)e, ne, and rn of the rear triangular zone 130b can also be expressed by Equation 5 below.

[Equation 5]

Here, he means the distance between both eyes of the viewer and the X-axis at the viewing distance in the XY-plane, that is, the height of the viewer's eyes. hp means the distance between the sub-pixel and the X-axis on the image panel 110 in the XY-plane, that is, the height of the sub-pixel.

Using this, a generalized expression of the 3D viewing diamond at a point twice the optimal viewing distance can be expressed in spatial coordinates, and the viewing diamond area at a point twice the optimal viewing distance can be calculated.

FIG. 8 is a diagram showing, for example, the viewing diamond coordinates in the XZ-plane at a distance twice the optimal viewing distance.

에서 (0, 0, v)를 지나는 광은

을 지나므로, 최적 시청거리의 2배 지점의 전방 삼각 존(130a')의 꼭지점

의 공간좌표를 다음의 수학식 6과 같이 표현할 수 있다.Referring to FIG. 8 , in the same manner as above

The light passing through (0, 0, v) at

As it passes through, the vertex of the front triangular zone 130a' at twice the optimal viewing distance

The spatial coordinates of can be expressed as in Equation 6 below.

[Equation 6]

의 공간좌표 역시 다음의 수학식 7과 같이 표현할 수 있다.
In addition, in the same manner, the vertex of the rear triangular zone 130b' at a point twice the optimal viewing distance

The spatial coordinates of can also be expressed as in Equation 7 below.

[Equation 7]

Next, by generalizing the equation of a straight line for light, the viewing diamond coordinates in the entire area including the optimal viewing distance can also be generalized.

In this case, the case of projection on the XZ-plane is exemplified to simplify the equation.

FIG. 9 is a view showing the viewing diamond coordinates in the XZ-plane as an example in the entire area including the optimal viewing distance.

Referring to FIG. 9 , the equation of the straight line for the light Rn is the following Equation (8).

[Equation 8]

In addition, the equation of the straight line with respect to the light Lm is the following Equation (9).

[Equation 9]

Here, n and m represent rational numbers.

If the above Equations 8 and 9 are simultaneously calculated, f(n, m), which is the coordinate where the light Rn and Lm meet, can be generalized as in Equation 10 below.

[Equation 10]

For reference, when f(n-1, n) in the XZ-plane, Equation 10 is the same as Equation 1. Also, when f(n, n-1) in the XZ-plane, Equation 10 is the same as Equation 5.

Based on the coordinates of the generalized viewing diamond of Equation 10, the coordinates of a point k times the optimal viewing distance can also be generalized as follows.

FIG. 10 is a view showing the viewing diamond coordinates in the XZ-plane as an example at a viewing distance k times the optimal viewing distance.

And, FIG. 11 is a view showing a viewing diamond cell in the XZ-plane as an example.

10 and 11 , in order to derive the coordinates of a point k times the optimal viewing distance, the case where the Z coordinate of Equation 10 is kv is calculated as in Equation 11 below.

[Equation 11]

Here, k represents a rational number greater than zero.

If Equation 11 is rearranged for m, Equation 12 is given below.

[Equation 12]

Accordingly, the coordinates of a point k times the optimal viewing distance can be generalized as in Equation 13 below.

[Equation 13]

For example, calculating the coordinates of a point twice the optimal viewing distance from Equation 13 is the following Equation 14, which is the same as the viewing diamond coordinates of Equations 6 and 7.

[Equation 14]

Next, the width of the viewing diamond in the entire area can be generalized using the plane coordinates of the viewing diamond.

은 피타고라스 정리에 의해 다음 수학식 15와 같이 일반화할 수 있다.The width of the viewing diamond with f(n, m) as the upper vertex

can be generalized as in Equation 15 below by the Pythagorean theorem.

[Equation 15]

Accordingly, by substituting the coordinates of Equation 10 into Equation 15, the width of the viewing diamond can be generalized as Equation 16 below.

[Equation 16]

For example, the coordinates of f(0, 1)f(0, 0), f(1, 0)f(1, 1) counterclockwise from the upper vertex f(n, m) located at the optimal viewing distance ( It can be seen from Equation (16) that the maximum width of the viewing diamond with n=0, m=1) is equal to the binocular spacing.

As described above, it can be seen through Equation 16 that when the distance between the eyes is fixed, the width of the viewing diamond is affected by the width W of the image panel 110 .

Next, using the previously calculated width of the viewing diamond, it is possible to formulate the width of the viewing diamond at a point k times the optimal viewing distance.

By substituting Equation 12 into Equation 16, the width of the viewing diamond at a point k times the optimal viewing distance can be calculated as in Equation 17 below.

[Equation 17]

Here, when the width W of the image panel 110 is sufficiently large compared to the distance e between the eyes, it can be expressed as in Equation 18 below.

[Equation 18]

For example, if the width W of the image panel 110 is twice the optimal viewing distance, which is sufficiently larger than the binocular distance e, the width of the viewing diamond is calculated as follows.

[Equation 19]

From Equation 18 above, it can be seen that when the width W of the image panel 110 is sufficiently larger than the binocular distance e, the width of the viewing diamond at a point k times the optimal viewing distance is close to ke.

Next, the view recognized by the viewer located at the optimal viewing distance (position P1) and the 2D and 3D regions are expressed in terms of the image panel as follows.

12 is a view showing, for example, the coordinates of the viewing area including the position of both eyes in the XZ-plane at the position P1.

And, FIGS. 13A and 13B are views showing views recognized by the viewer's left and right eyes at a position P1 as an example. In this case, FIG. 13A shows the view perceived by the viewer's left eye, and FIG. 13B shows the view perceived by the viewer's right eye.

14 is a diagram showing 2D and 3D regions at a location P1.

12, when the viewer's left eye (1) and right eye (2) are located at the center of the viewing diamond at the optimal viewing distance (point Ks = 1; P1 position), the left eye (1) and the right eye (2) It can be seen that the recognized image is an image divided into views as shown in FIGS. 13A and 13B .

That is, the viewer's left eye (1) perceives the image of the Kth view, while the viewer's right eye (2) perceives the image of the K+1th view. Here, K means the number of recognized views.

As such, since there is no overlapping portion of the images of the left eye 1 and the right eye 2 , the viewer perceives the image in 3D over the entire area of the image panel 110 as shown in FIG. 14 .

Next, the views and 2D and 3D areas perceived by the viewer out of the optimal viewing distance are as follows.

FIG. 15 is a view showing, for example, the coordinates of the viewing area including the positions of both eyes in the XZ-plane at the P2 position.

And, FIGS. 16A and 16B are views showing views recognized by the viewer's left and right eyes at the P2 position as an example. In this case, FIG. 16A shows the view perceived by the viewer's left eye, and FIG. 16B shows the view perceived by the viewer's right eye.

17 is a diagram illustrating 2D and 3D regions at a location P2.

Referring to FIG. 15 , for example, when the viewer's left eye 3 is located at the center of the viewing diamond at a point Ks=2 (just after the optimal viewing distance; P2 location), the left eye 3 and the right eye 4 ), it can be seen that two views are recognized together in a single eye as shown in FIGS. 16A and 16B .

That is, the viewer's left eye 3 recognizes the images of the K-1 th view and the K th view together, while the viewer's right eye 4 recognizes the images of the K th view and the K+1 th view together.

At this time, a region where the same view (ie, the K-th view) overlaps between the images recognized by the left eye 3 and the right eye 4 , that is, a 2D region, which can be expressed as shown in FIG. 17 .

As described above, a plurality of views information may be input to a viewer outside the optimal viewing distance, and in this case, when an image having a large disparity between views is input, the difference between images within the monocular may be recognized.

In this case, even when the viewer moves horizontally or the structure (eg, a stripe or slanted structure) of the image panel 110 is different, the 2D position and shape of the region may change, but the corresponding area is the same.

On the other hand, since the 2D area shown in FIGS. 16 and 17 is an area displaying the same view, even when view data is replaced, both the left eye 3 and the right eye 4 are converted, so the 2D area is still maintained. Therefore, a 2D region is essentially generated in the structure.

Accordingly, the area for each view and the 2D and 3D areas of the image recognized based on the position of both eyes of the viewer are generalized into equations, which will be described with reference to FIGS. 16A, 16B and the following FIG. 18 .

18 is a view showing the position of both eyes applied to the viewing diamond at the position P2 as an example.

In this case, the assumption that the viewer's left eye is located at the center of the viewing diamond is applied, and the minimum 2D area can be calculated when considering the like.

If both eyes 3 and 4 of the viewer are positioned on the viewing diamond at the point where Ks = 2 as shown in FIG. 18 , the image perceived by the left eye 3 has an equally wide W/Ks of each view.

Contrary to this, in the case of the right eye 4, the widths c and d of each view are proportional to the distance away from the center of the viewing diamond, so the width d of the K+1th view can be expressed as Equation 20 below. .

[Equation 20]

It can be seen from FIG. 16B that c+d=W. Accordingly, the width c of the K-th view may be expressed as in Equation 21 below.

[Equation 21]

From Equation 16 and FIG. 18, the width (2(a+b)) of the viewing diamond is expressed as Equation 22 below.

[Equation 22]

Here, Ks=n-m+1.

In addition, since 2a+b=e, if it is calculated in conjunction with Equation 22, a and b for the position of the right eye 4 can be obtained.

[Equation 23]

Using this, the area for each view and the 2D and 3D areas of the perceived image according to the position of both eyes of the viewer located at the point where Ks = 2 can be generalized into equations.

That is, by calculating the view overlap section of both eyes from FIGS. 16A and 16B and substituting it into Equation 23, the 2D region can be formulated as follows.

[Equation 24]

이다.At this time, Ks = 2,

am.

[Equation 25]

Here, the inequality sign in Equations 24 and 25 is a case in which the influence of and view data is also taken into consideration.

From Equation 24, it can be seen that a 2D area of at least 2eH is generated at a point where Ks=2.

Since the 2D area of the point Ks=2 was calculated previously, the 2D generation area can be generalized by calculating the point Ks=3 and the area thereafter. And, if this result is converted into coordinates, the 2D generation area of the image panel can be specified for each sub-pixel.

It is possible to calculate the size and location of the transformation region, and the amount of data processing and memory required at this time, when converting the 2D region to the stereoscopic region by the method proposed in the present invention.

19A and 19B are diagrams illustrating views recognized from the left and right eyes of a viewer at a position P3 as an example. In this case, FIG. 19A shows the view perceived by the viewer's left eye, and FIG. 19B shows the view perceived by the viewer's right eye.

And, FIG. 20 is a diagram showing 2D and 3D regions at a position P3.

Referring to FIGS. 19A and 19B , the area for each view and the 2D and 3D areas of the perceived image according to the position of both eyes of the viewer located at the point Ks=3 (just after the point Ks=2; the P3 location) can be generalized by equations. can

For example, when the viewer's left eye is located at the center of the viewing diamond at a point where Ks = 3, it can be seen that the image recognized by the left eye and the right eye is recognized by three views together with a single eye.

That is, the viewer's left eye perceives images of the K-1 th view, the K th view, and the K+1 th view together, while the viewer's right eye recognizes the images of the K th view, the K+1 th view, and the K + 2 th view. recognize together

In this case, a region in which the same view (ie, the K-th view and the K+1-th view) overlaps between the images recognized by the left eye and the right eye, that is, a 2D region, which may be expressed as shown in FIG. 20 .

Also, referring to FIG. 19A , in the image perceived by the viewer's left eye, each view has the same width of W/Ks.

In contrast, in the case of the right eye, referring to FIG. 19B , the width e of the K+2 th view may be expressed as Equation 26 below.

[Equation 26]

It can be seen from FIG. 19B that c+d+e=W. And, since c=d, the sum of the widths of the K-th view and the K+1-th view (2c=c+d) is expressed by Equation 27 below.

[Equation 27]

Using Equations 22, 23, and 27, the 2D and 3D regions in the case of Ks=3 are the following Equations 28 and 29.

[Equation 28]

이다.At this time, Ks = 3,

am.

[Equation 29]

Here, the inequality sign in Equations 28 and 29 is a case in which the influence of and view data is also taken into consideration.

From Equation 29, it can be seen that the 2D region at the point where Ks=3 occurs by at least 3eH regardless of image data and the number of views.

Next, based on the above results, the area for each view and the 2D and 3D areas of the perceived image according to the position of both eyes of the viewer from the optimal viewing distance to the point twice the optimal viewing distance are generalized into equations.

At this time, the point twice the optimal viewing distance is the maximum distance that both eyes can be located within the two viewing diamonds when the left eye is located in the center of the viewing diamond.

21A and 21B are diagrams illustrating views perceived from the left and right eyes of a viewer at a position Pj as an example. In this case, FIG. 21A shows the view perceived by the viewer's left eye, and FIG. 21B shows the view perceived by the viewer's right eye.

Referring to FIGS. 21A and 21B , for example, when the viewer's left eye is located at the center of the viewing diamond at the point where Ks = j (Pj position), the images perceived by the left and right eyes are j views together in a single eye. can be recognized.

That is, the viewer's left eye perceives the images of the Kj-1th view, the Kjth view, ...., the K-1th view, and the Kth view together, while the viewer's right eye perceives the Kjth view, K-j+ Images of the 1st view, ...., the Kth view, and the K+1th view are recognized together.

In this case, a region where the same view (ie, the K-j th view to the K th view) overlaps between the images recognized by the left eye and the right eye, that is, a 2D region occurs.

Referring again to FIG. 21A , in the image perceived by the viewer's left eye, each view has an equal width of W/Ks.

In contrast, in the case of the right eye, referring to FIG. 21B , the width d of the K+1th view is different from the widths of other views, and can be expressed as Equation 30 below.

[Equation 30]

It can be seen from FIG. 21b that (Ks-1)c+d=W. And, from Equation (30), the following can be found.

[Equation 31]

Using Equations 22, 23, and 31, the 2D and 3D regions in the case of Ks = j (that is, from the optimal viewing distance to a point twice the optimal viewing distance) are obtained by the following Equations 32 and 33 same as

[Equation 32]

[Equation 33]

Here, the inequality sign in Equations 32 and 33 is a case in which the influence of and view data is also taken into consideration.

From Equation 32, it can be seen that the 2D region from the optimal viewing distance to a point twice the optimal viewing distance occurs by at least eKsH regardless of image data and the number of views.

Next, the area for each view and the 2D and 3D areas of the perceived image according to the position of the viewer's binoculars located at a point at least twice the optimal viewing distance are generalized into equations.

In this case, a point at least twice the optimal viewing distance is a distance at which both eyes are located within one viewing diamond when the left eye is located in the center of the viewing diamond.

22A and 22B are diagrams illustrating views perceived by the viewer's left and right eyes at a position Pj that is twice the optimal viewing distance or more. In this case, FIG. 22A shows the view perceived by the viewer's left eye, and FIG. 22B shows the view perceived by the viewer's right eye.

And, FIG. 23 is a view showing, as an example, the positions of both eyes applied to the viewing diamond at a viewing distance that is more than twice the optimal viewing distance.

22A, 22B and 23 , for example, at a position twice or more of the optimal viewing distance, when the viewer's both eyes are located on the viewing diamond at the point where Ks = j, as shown in FIG. 22, the left and right eyes are recognized It can be seen that j views are recognized together in a single eye.

That is, the viewer's left eye perceives images of the Kj-1th view, the Kjth view, ...., the K-1th view, and the Kth view together, while the viewer's right eye recognizes the Kj-1th view, the Kjth view. Views, ...., images of the K-1 th view and the K th view are recognized together.

Referring again to FIG. 22A , in the image perceived by the viewer's left eye, each view has an equal width of W/Ks.

On the other hand, in the case of the right eye, referring to FIG. 22B , the width c of the K-j-1th view is different from the widths of other views, and can be expressed as Equation 34 below.

[Equation 34]

It can be seen from FIG. 22B that c+(Ks-1)d=W. And, from Equation 34, it can be seen that:

[Equation 35]

From Fig. 23, since a = e,

임을 알 수 있다.If calculated in conjunction with Equation 22,

it can be seen that

And, when this is used together with Equations 22 and 35, the 2D and 3D regions at a position more than twice the optimal viewing distance are expressed by Equations 36 and 37 below.

[Equation 36]

[Equation 37]

Here, the inequality sign in Equations 36 and 37 is a case in which the influence of and view data is also taken into consideration.

From Equations 32 and 37, it can be seen that the 2D area is generated by at least eKsH regardless of the viewer position.

Next, in consideration of the optimal viewing distance control, 2D and 3D regions of a point twice the optimal viewing distance and a point three times the optimal viewing distance are generalized into equations.

First, the coordinates of the point doubling the optimal viewing distance are from Equation 13,

이며,

is,

이다.at this time

am.

Accordingly, from Equations 32 and 33, the 2D and 3D regions at a position twice the optimal viewing distance can be generalized as shown in Equations 38 and 39 below.

[Equation 38]

[Equation 39]

In addition, the coordinates of a point that is three times the optimal viewing distance is from Equation 13,

이며,

is,

이다.at this time

am.

Accordingly, from Equations 36 and 37, the 2D and 3D regions at a position three times the optimal viewing distance can be generalized as shown in Equations 40 and 41 below.

[Equation 40]

[Equation 41]

According to these results, it can be seen that a 2D region is inevitably generated in the view independent structure.

Therefore, in the present invention, in the autostereoscopic 3D image display device for extending the viewing distance by N times, the overlapping view structure, that is, the viewing diamond is designed to overlap N times or more.

24A and 24B are views illustrating a viewing area of a multi-view image according to a viewer's position as an example, illustrating a double-overlapping structure of a viewing diamond as an example. In this case, FIG. 24B is an enlarged view of part A shown in FIG. 24A.

In this case, it is assumed that the position P1 corresponds to the optimal viewing distance at which the viewer can normally view the stereoscopic image. 24A and 24B show a state in which the viewing diamonds are overlapped only in some areas for convenience, but in reality, the viewing diamonds are overlapped over the entire area.

24A and 24B , the diamond-shaped region is a viewing zone and means the viewing diamond 130 .

For example, "K" is the viewing area in which the K-th view image (or the K-th view image) displayed on the image panel 110 is visible, and "K+1" is the K+1-th view displayed on the image panel 110 . This is the viewing area where the video is visible. "K+2" is a viewing area in which the K+2th view image displayed on the image panel 110 is viewed, and "K+3" is a viewing area in which the K+3th view image displayed on the image panel 110 is visible.

In this case, the region where the viewing diamond 130 overlaps according to the view overlapping structure is the region where the views overlap, and multiple view images are recognized.

When the viewer moves from the P1 position to the P2 position (behind the optimal viewing distance), it is almost similar to moving both eyes from the (1,2) position to the (3, 4) position.

Taking the double overlapping structure of the viewing diamond as an example, the sub-pixel area recognized by the viewer may be represented by the image panel 110 as follows.

Hereinafter, the viewing areas and the viewing diamond formed at the position P2 immediately after the optimum viewing distance will be described, but this is for convenience of explanation and is equally applicable to points twice the optimum viewing distance and other points.

25 is a diagram illustrating views recognized from the left and right eyes of a viewer at a position P1 in a two-layered structure as an example.

And, FIG. 26 is a diagram showing views recognized by the viewer's left and right eyes at the P2 position as an example in a two-layered structure.

27 is a diagram illustrating 2D and 3D regions at a position P2 in a two-layered structure.

Referring to FIG. 25, when the viewer's left eye (LE1) and right eye (RE1) are located at the center of the viewing diamond at the optimal viewing distance (point Ks = 1; P1 position) at position P1, left eye (LE1) and right eye ( It can be seen that the image recognized by RE1) is an image separated into each view.

However, in the case of the view-independent structure in the viewing diamond structure based on the binocular interval, only one view is recognized by a single eye at a point Ks=1, but in the view overlapping structure, as many views as the number of overlapping monocular views are recognized. And, one view is added one by one as you go back.

That is, the viewer's left eye LE1 recognizes the images of the K-th view and the K+1th view together, while the viewer's right eye RE1 recognizes the images of the K+2th view and the K+3rd view together. .

As such, since there is no overlapping portion of the images of the left eye LE1 and the right eye RE1, the viewer perceives the image as 3D over the entire area of the image panel.

Referring to FIG. 26 , for example, when the viewer's left eye LE2 is located at the center of the viewing diamond at a point Ks=2 (just after the optimal viewing distance; P2 location), the left eye LE2 and the right eye RE2 ), it can be seen that three views are recognized together in a single eye.

At this time, the viewer's left eye LE2 recognizes the images of the K-th view and the K-1th view from the left side of the image panel together, and recognizes the images of the K-th view and the K+1th view from the right side of the image panel together. .

On the other hand, the viewer's right eye (RE2) perceives the images of the K+2th view and the K+1th view from the left side of the image panel together, and the images of the K+2th view and the K+3th view from the right side of the image panel. recognize together

In this case, a region where the same view (ie, the K+1th view) overlaps between the images recognized by the left eye LE2 and the right eye RE2 , that is, a 2D region, which may be expressed as shown in FIG. 27 .

However, in this case, not all overlapping regions can be viewed as 2D regions, and since the 2D region and the 3D region are mixed, the 3D viewing region substantially increases compared to the view-independent structure. This is because, in an area where the same view overlaps between images recognized by the left eye LE2 and the right eye RE2, a part is implemented as a 3D area according to the overlapping views.

From the point of view of sub-pixels perceived by viewers, it is as follows.

28 is a view illustrating an arrangement of a pixel array and a lenticular lens in which a view-map is written in the autostereoscopic image display device according to an embodiment of the present invention as an example.

In this case, FIG. 28 shows a pixel array when 16 views are used as an example. However, the present invention is not limited to the above-described number of views.

R, G and B indicated at the top of FIG. 28 indicate the positions of the R, G and B sub-pixels.

Referring to FIG. 28 , when m (m is a natural number) view is used, the first view to the mth view may be sequentially allocated to the m sub-pixels in the image panel in units of m sub-pixels.

That is, the K-th view is allocated to the Kth sub-pixel (where K is a natural number satisfying 1≤K≤m) among the m sub-pixels of the image panel.

As an example, when 16 views are used, a first view (1 ^st view) is assigned to a first sub-pixel, a second view (2 ^nd view) is assigned to a second sub-pixel, and a third sub-pixel the third view is assigned the (3 ^rd view), the fourth sub-pixel is assigned a fourth view to (4 ^th view). And, a 5 ^th view is assigned to a 5 th sub-pixel, a 6 ^th view is assigned to a 6 th sub-pixel, and a 7 ^{th view is assigned to a 7 th sub-pixel.} view) is assigned, and the 8 ^th view is assigned to the 8 th sub-pixel. A ninth sub-is assigned a 10 second view (10 ^th view) to a pixel, an eleventh sub-11th view of the pixel (11 ^th view) 9 second view to a pixel (9 ^th view) is, the tenth sub-assigned the allocation is, 12 sub-assigned to the 12th view (view 12 ^th) in the pixel. 13th sub-is assigned a 14 second view (14 ^th view) to the pixel, the 15 sub-15th view of the pixel (15 ^th view) 13 second view to a pixel (13 ^th view) is, 14 sub-assigned is assigned, and the 16 ^th view is assigned to the 16 th sub-pixel.

To this end, the 3D filter may be implemented as a lenticular lens 125 having a slanted structure that is obliquely formed at a predetermined angle with respect to the sub-pixels. More specifically, the lenticular lens 125 of the slanted structure is obliquely formed by a predetermined angle with respect to the long axis sides of the sub-pixels.

Accordingly, the 3D filter divides each of the first to m-th view images (view images before transformation) displayed in the m sub-pixels into first to m-th views, respectively. Accordingly, the 3D filter outputs the K-th view image displayed in the K-th sub-pixel as the K-th view.

For reference, the view-map described in the present invention represents the data order and position of each view that is repeatedly mapped to sub-pixels of the image panel, and the viewing area includes a regular area, a reverse area, and a viewing area. There is an impossible area.

Here, the emmetropic region refers to an area in which a viewer can normally view a stereoscopic image, and refers to an area in which the right eye image is formed in the viewer's right eye and the left eye image is formed in the left eye.

In addition, since the image difference information is transmitted to the reverse region, the viewer can recognize the image three-dimensionally, but since the left eye image is formed in the right eye and the right eye image is formed in the left eye, the viewer can relieve eye fatigue more quickly. It is an area of feeling.

In addition, the viewing impossible area refers to an area in which viewing of a stereoscopic image itself is impossible.

That is, the view-map includes coordinate information (ie, the first view to the m-th view) for positions where the three regions are displayed.

However, since it is possible to determine an area excluding the normal area and the still area as the unviewable area, coordinate information on the viewable area may be omitted from the view-map.

29A and 29B are diagrams showing sub-pixels and views recognized by the left and right eyes at the P1 position by way of example.

In this case, FIG. 29A shows a sub-pixel and a view recognized by the left eye as an example, and FIG. 29B shows a sub-pixel and a view recognized by the right eye as an example.

Hereinafter, it is assumed that the corresponding view structure and mapping are repeatedly configured over the entire area.

In an ideal case where there is no 3D crosstalk between adjacent views, the viewer perceives two views in the two-layered structure of the viewing diamond on a monocular basis. Accordingly, sub-pixels recognized by the left eye and the right eye may be represented as shown in FIGS. 29A and 29B .

At this time, the autostereoscopic image display device according to the embodiment of the present invention uses the width of the viewing diamond as the distance between the binoculars, so if the left eye recognizes the first view, the right eye takes the second view if there is no overlap of the viewing diamonds. recognize

Therefore, in the case of two overlapping, as one more viewing diamond exists between the left and right eyes, as shown in FIGS. 29A and 29B, when the left eye recognizes the first view and the second view, the right eye is the third view and the fourth view. Recognize the second view.

That is, in the case of two overlapping, when the left eye sees the first-view image and the second-view image, the right eye sees the third-view image and the fourth-view image.

30A and 30B are diagrams illustrating sub-pixels and views perceived by the left eye at a position P2 by way of example.

31A and 31B are diagrams illustrating sub-pixels and views recognized by the right eye at a position P2 as an example.

In this case, FIGS. 30A and 31B show sub-pixels and views recognized by the left and right eyes in the 3D region as an example. And, FIGS. 30B and 31A show sub-pixels and views perceived by the left and right eyes in a 2D area (actually a 2D and 3D mixed area; see FIG. 27) as examples.

That is, FIG. 30A shows sub-pixels and views perceived by the left eye in the 3D area on the left side of the image panel, and FIG. 31B shows sub-pixels and views recognized by the right eye in the 3D area on the right side of the image panel. And, FIG. 30B shows the sub-pixel and view perceived by the left eye in the 2D area in the center of the image panel (actually, slightly right from the center), and FIG. 31A is the sub-pixel perceived by the right eye in the 2D area at the center of the image panel. - Display pixels and views.

However, this is described by taking the sub-pixel and the view recognized at the P2 position of the two-overlapping structure as an example, and the present invention is not limited thereto.

In the case of 2 overlapping, at the P2 position, there is one more viewing diamond between the left and right eyes, and as shown in FIGS. 30A and 30B and 31A and 31B, the left eye perceives the first view, the second view, and the 16th view. In this case, the right eye perceives the 2nd view, the 3rd view, and the 4th view.

That is, in the case of two overlapping, when the left eye sees the first-view image, the second-view image, and the 16th-view image at the P2 position, the right eye sees the second-view image, the third-view image, and the fourth-view image.

As described above, it can be seen from FIGS. 27, 30A, 30B, 31A, and 31B that a 2D area is partially generated in a partial area of the image panel in the sub-pixels recognized by the left and right eyes.

That is, as described above, in FIG. 27 , it can be seen that the K+1th view is simultaneously input to the left eye and the right eye in a partial region right of the center from the center of the image panel. In addition, it can be seen that the second views indicated by the dotted rectangles overlap with each other in FIGS. 30B and 31A .

At this time, FIGS. 30B and 31A show sub-pixels and views perceived by the left and right eyes in the 2D area of the center of the image panel (actually, slightly right from the center) as described above.

However, in this embodiment of the present invention, when the viewer's left eye recognizes the K-1th view, the Kth view, and the K+1th view, the viewer's right eye is the K+1th view, the K+2th view, and Since the K+3th view is recognized, the image perceived by the right eye compared to the left eye is a relatively right-view image. This is because the viewer can view the 3D image because it is determined that there is a disparity between the left eye and the right eye for recognizing multiple views due to the characteristics of the eye that integrates image information. Also, since the 3D viewing area is substantially increased compared to the view independent structure, it can be seen that the ratio of 2D perceived sub-pixels decreases as the overlapping number of viewing diamonds increases.

However, even in this case, crosstalk may occur because a plurality of views for each region are simultaneously recognized by a single eye. Therefore, in the embodiment of the present invention, view data rendering technology is applied as follows to convert view data of an image panel into one view data having a disparity for the left and right eyes according to the viewer position, respectively. It is characterized by substitution.

32A and 32B are diagrams showing sub-pixels and views recognized from the left eye at the P2 position as an example when view data rendering is applied.

And, FIGS. 33A and 33B are diagrams showing sub-pixels and views recognized by the right eye at the P2 position as an example when view data rendering is applied.

In this case, FIGS. 32A and 33B show sub-pixels and views recognized by the left and right eyes in the 3D region as an example. And, FIGS. 32B and 33A show sub-pixels and views recognized by the left and right eyes in the 2D region as an example.

34 and 35 are diagrams illustrating examples of converting input data through view data rendering.

At this time, 1, 2, 3, ... and 16 shown in FIG. 35 mean a first-view image, a second-view image, a third-view image, ..., and a sixteenth-view image, respectively.

32A, 32B, 33A, 33B, 34 and 35 , by applying the view data rendering technique according to the embodiment of the present invention, a plurality of views recognized for each area are different ( disparity), replacing each view with one view data. That is, for example, in the case of the left eye, any one view data among the data of a plurality of recognized views is substituted, and in the case of the right eye, the data of the other one excluding the view data substituted for the left eye among the data of a plurality of recognized views. It can be replaced with view data.

As an example the case of using the 16 views, 16th view of the left input data for and the first view (1 ^st view) (Fig. 34, the ^16-th view shown in FIG. 35) is in claim 16, the view image and the first view image converted into a first view image.

Then, the left and the second view of the right eye (2 ^nd view) and the third view of the right eye (3 ^rd view) and fourth views of input data (4 ^th view) and a second view image and the third-view image and the fourth The view image is converted into a second view image.

In this case, the first-view image and the second-view image as an example mean an image having a disparity between the binoculars, but a view image having a greater or lesser difference for depth control is also possible.

When the transformed view image is input, it is mapped as shown in FIGS. 32A and 32B and FIGS. 33A and 33B , and although not shown, an image of a surrounding view can also be appropriately transformed. Accordingly, crosstalk is reduced.

Meanwhile, in order to completely remove the 2D region recognizing the same view in the left eye and the right eye, only the view image of the sub-pixel corresponding to the 2D region may be removed. For example, when black data is inserted into a view of a sub-pixel corresponding to a 2D region, a portion where the perception sub-pixels of the left eye and the right eye overlap are removed.

36 is a diagram illustrating another example of converting input data through view data rendering.

In this case, Figure 36 is substantially the same as the FIG. 34 described above, except that insert the black data (the 2 ^nd view shown in Fig. 36), the second view corresponding to the 2D area.

And, FIG. 37 is a diagram illustrating sub-pixels and views recognized from the left eye at a position P2 as an example when the view data rendering shown in FIG. 36 is applied.

FIG. 38 is a diagram illustrating sub-pixels and views recognized by the right eye at the P2 position as an example when the view data rendering shown in FIG. 36 is applied.

36, 37 and 38 , one view having a disparity with respect to left and right eyes of data of a plurality of views recognized for each region by applying the view data rendering technique according to an embodiment of the present invention At the same time replacing each data with data, black data is inserted into the view corresponding to the 2D area.

That is, for example, in the case of the left eye, any one view data among the data of a plurality of recognized views is substituted, and in the case of the right eye, the data of the other one excluding the view data substituted for the left eye among the data of a plurality of recognized views. It can be replaced with view data. At the same time, black data is inserted into the view corresponding to the 2D area.

If the example using the 16 views, 16th view of the left eye (the ^16-th view shown in Fig. 36) and the first view, the input data of the (1 ^st view) of claim 16, the view image and the first view in a first view image converted to video.

Then, the input data of the right-eye view of the third (3 ^rd view) and the fourth view (view 4 ^th) is converted to the second view image in the third image view, and the fourth view image.

At the same time, the left, the input data of the second view of the right eye (2 ^nd view) corresponding to the 2D area is converted into black data.

In this case, the first-view image and the second-view image as an example mean an image having a disparity between the binoculars, but a view image having a greater or lesser difference for depth control is also possible.

When the transformed view image is input as shown in FIGS. 37 and 38 , the overlapping portions of sub-pixels recognized by the left and right eyes are completely removed as shown in FIGS. 37 and 38 .

However, in this case, luminance may be reduced, and accordingly, view data identical to or similar to that of an adjacent view may be input to the view of the 2D area instead of the black data.

In this case, the ratio of the 2D area can be reduced by increasing the number of overlapping views.

According to the present invention, the 3D viewing area is expanded to increase the viewing freedom and at the same time increase the design freedom of the focal length and the rear distance. In this case, it is possible to remove the gap glass (or gap film) used to adjust the viewing distance and the focal length, thereby providing an effect of reducing the cost.

In this way, after recognizing the viewer's location, the sub-pixel recognized by the viewer based on the viewer's location, the views corresponding to the sub-pixel, and several views based on the image panel are recognized by the viewer's left and right eyes. It can be calculated through the above-described equations and the like.

In addition, since the 2D generation area can be expressed as coordinates, based on this, whether or not to apply view data rendering and the view that needs to be applied can be selectively applied.

For reference, the eye tracking algorithm by the viewing distance sensor is as follows. The applicant of the present application has proposed an eye-tracking algorithm through Korean application 10-2013-0038815 and the like. However, the present invention is not limited thereto.

First, the number of users and the user's faces are detected from an input image captured by a camera. For example, the user's face is detected from the input image using a face detection method such as a Haar classifier.

Thereafter, eye center coordinates, ie, center coordinates between the left and right eyes, are detected from the detected user's face. For example, initial feature points such as the left eye and the right eye are selected using an eye model such as an Active Appearance Model (AAM), and then, eye center coordinates, which are final feature points, are detected through an EBGM model.

Then, the user's eye position information is calculated by applying the detected eye center coordinates to the distance model using the eyes. The user's eye position information is calculated as X, Y, and Z coordinate values based on the center point of the stereoscopic image display device.

As described above, the determination of the position of the viewing area in which the left and right eyes of the viewer are located is performed by comparing the position information (coordinate values) of the viewer's eyes detected by the viewing distance sensing unit and the position information (coordinate information) of the viewing area stored in the lookup table. method can be judged. When the viewing area in which both eyes of the viewer are located is determined in this way, the position of the right eye or left eye in the viewing areas in which both eyes of the viewer are located and the ratio of the left and right images shown in the viewing areas should be grasped. For a detailed description related thereto, reference may be made to the previously filed Korean application 10-2012-0108794, and may be generalized to equations such as the above-described equations.

Although many matters are specifically described in the above description, these should be construed as examples of preferred embodiments rather than limiting the scope of the invention. Therefore, the invention should not be defined by the described embodiments, but should be defined by the claims and equivalents to the claims.

110: image panel 120: lenticular lens plate
125: lenticular lens 130: viewing diamond

Claims (9)

an image panel in which first to m-th views are sequentially allocated to m (m is a natural number) sub-pixels to display input data of multi-views;
A viewing diamond disposed on the front side of the image panel and displaying a first view image to a Kth view image (K is a natural number satisfying 1≤K≤m) at an optimal viewing distance by separating the optical axis of the input data. 3D filter to form a diamond); and
a timing controller that calculates a view corresponding to a viewer's position and a 2D area, and overlaps the viewing diamonds based on this;
The 2D area is equal to or greater than eKsH (in this case, e means the distance between the eyes, and Ks and H are the order of the viewing diamonds and the height of the image panel formed in order from the optimal viewing distance, respectively). Glasses-free stereoscopic image display device. The autostereoscopic image display apparatus according to claim 1, wherein the viewing diamond is overlapped N times or more when the position of the viewer corresponds to N times the optimal viewing distance. The autostereoscopic image display apparatus according to claim 1, wherein the timing controller calculates the views and the number of views recognized by the viewer's left and right eyes according to the viewer's position. The autostereoscopic image display apparatus according to claim 3, wherein the view data rendering area is selected based on the calculated views and the number of views. The autostereoscopic stereoscopic image according to claim 4, wherein the view image is replaced with a single view image having a disparity for the left and right eyes of the viewer based on the selected view data rendering area. display device. The method according to claim 5, wherein in the case of the left eye, any one view image among a plurality of recognized view images is replaced, and in the case of the right eye, another view image is replaced with the view image replaced by the left eye among the plurality of view images recognized. A glasses-free stereoscopic image display device, characterized in that it is replaced with a view image of delete The autostereoscopic image display apparatus according to claim 1, wherein black data is inserted into a view of a sub-pixel corresponding to the 2D area. The autostereoscopic image display apparatus according to claim 8, wherein view data identical to or similar to a view adjacent to a view of a sub-pixel corresponding to the 2D region is input.

Images