KR20160079555A - Autostereoscopic 3d display device - Google Patents

Abstract

An autostereoscopic 3D display device according to the present invention enables a viewer to view a 3D image irrespective of a viewer position by transposing view data of an image panel according to the viewer position. In order to accomplish this, the autostereoscopic 3D display device according to the present invention mathematizes and analyzes the kinds and the number of images recognized by left and right eyes of a user as well as the distribution of the images on the image panel according to the viewer position. At this time, the autostereoscopic 3D display device according to the present invention increases a ratio of a 3D area by overlapping viewing diamonds or decreases a 2D area by inserting black data into a view of the 2D area. Also, the autostereoscopic 3D display device according to the present invention suppresses crosstalk resulting from a view overlapping through a view data rendering. As described above, according to the present invention, a degree of freedom in viewing can be increased by enlarging a 3D viewing area and costs can be reduced by removing a gap glass. The autostereoscopic 3D display device comprises: the image panel which displays input data of a multi-view, wherein first to m-th views are sequentially allocated in m (m is a natural number) sub pixels; a 3D filter which is arranged in front of the image panel and separates optical axes of the input data to generate a viewing diamond in which first to K^th (K is a natural number satisfying 1<=K<=m) view images are displayed at an optimum viewing distance; and a timing controller which calculates a position of the viewer and a view corresponding to the 2D area, and overlaps the viewing diamonds with one another based on the calculated position and view.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a three-

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a stereoscopic image display apparatus, and more particularly, to a non-eyeglass stereoscopic image display apparatus which does not wear glasses.

A simple definition of 3D display is "the total system that artificially reproduces the 3D screen".

Here, the system includes a software technique that can be viewed in 3D and a hardware that actually realizes the content created by the software technique in 3D. The reason for incorporating the software area is that the 3D display hardware requires separately configured contents in a separate software manner for each stereoscopic implementation method.

In addition, a virtual 3D display (hereinafter, referred to as a stereoscopic image display device) is a type of stereoscopic image display device that uses a binocular disparity, which is caused by a distance of about 65 mm It is the totality of the system that allows you to literally feel the stereoscopic effect. In other words, our eyes see a different image (a little bit of space between the left and the right, respectively) even if we look at the same things because of binocular parallax. When these two images are transmitted to the brain through the retina, Dimensional stereoscopic image display apparatus is a stereoscopic image display apparatus in which two left and right images are simultaneously displayed on a 2D display apparatus and sent to each eye by using a stereoscopic image display apparatus .

In order to display images of two channels in one screen in such a stereoscopic image display device, in most cases, one line is changed one line at a time horizontally or vertically in one screen and outputted one channel at a time. At the same time, when images of two channels are output from one display device, in the case of a non-eyeglass system due to the hardware structure, the right image enters the right eye as it is, and the left image enters only the left eye. In addition, in the case of wearing the glasses, the right image is visually obscured by the special glasses suitable for each method, and the left image is obscured by the right eye so that the right eye can not be seen.

As mentioned above, the binocular parallax due to the interval between the two eyes is the most important factor for the person to feel the three-dimensional feeling and the depth feeling, but there is also a deep relationship with the psychological and memory factors. Accordingly, Dimensional image information, a volumetric type, a holographic type, and a stereoscopic type based on whether the three-dimensional image information can be provided.

The volume expression method is a method for making the depth direction perceive by the psychological factors and the suction effect, and is a three-dimensional computer graphic which displays the perspective method, overlapping, shading, contrast, and movement by calculation, So-called IMAX films, which give rise to an optical illusion that it is sucked into the space by providing a large screen.

The three-dimensional representation known as the most complete stereoscopic imaging technique can be represented by laser light reproduction holography or white light reproduction holography.

As described above, when an association image of a plane including parallax information is displayed on the left and right sides of a human being present at a distance of about 65 mm as described above, the brain expresses three-dimensional images using the physiological factors of both eyes. And the ability to generate spatial information before and after the display surface in the process of fusing them to sense a stereoscopic effect, that is, stereography. Such a three-dimensional expression system is largely classified into a system in which glasses are worn and a system in which glasses are not worn.

Representative known methods of not wearing glasses include a lenticular lens method and a parallax barrier method in which a lenticular lens plate vertically arranging a cylindrical lens is installed in front of the image panel.

FIG. 1 is a view for explaining the concept of a general lenticular lens type stereoscopic image display apparatus, and shows a relationship between a rear distance S of a lens and a viewing distance v.

Referring to FIG. 1, a typical lenticular lens type stereoscopic image display device includes a liquid crystal panel 10 filled with liquid crystal between upper and lower substrates, a liquid crystal panel 10 disposed therebetween, And a lenticular lens plate 20 positioned on the front surface of the liquid crystal panel 10 for realizing a stereoscopic image.

The lenticular lens plate 20 is formed by forming, on a flat substrate, a plurality of lenticular lenses whose upper surfaces are formed of a material layer of a convex lens shape.

The lenticular lens plate 20 serves to divide the left and right eye images. The optimum viewing distance v from the lenticular lens plate 20 is a distance between the left and right eyes of the lenticular lens plate 20, A viewing diamond (regular area) (not shown) is formed.

One width of the viewing diamond is formed by the size of the viewer's eyes in both sides to input stereoscopic images in the left and right eyes of the viewer so that stereoscopic images can be recognized.

At this time, view data, that is, an image, of the corresponding sub-pixel of the liquid crystal panel 10 is formed in each of the viewing diamonds.

View data refers to images taken by cameras separated by a distance of the binocular interval. Hereinafter, the view data and the view image are used in the same meaning.

The liquid crystal panel 10 and the lenticular lens plate 20 are supported by an instrument (not shown) or the like so that the liquid crystal panel 10 and the lenticular lens plate 20 are spaced apart from each other by a predetermined distance (Back surface distance S).

At this time, in a typical lenticular lens type stereoscopic image display apparatus, a gap glass 26 is inserted to keep the rear distance S constant.

As described above, in the stereoscopic image display apparatus using the lenticular lens system, since the stereoscopic image display apparatus is implemented as a multi view system which is formed according to a view map designed in the beginning, when a viewer enters a predetermined view area, .

Reference is made to Korean Patent Application No. 10-2012-0108794 filed by the applicant of the present application to control the extent and depth of a 3D viewing zone by appropriately replacing view data according to an image recognized in the left and right eyes of a viewer .

In this case, however, the processing of the 2D area (i.e., the 2D viewing area) generated as the viewer moves forward or backward from the optimum viewing distance of the stereoscopic image display device is not mentioned.

2A and 2B are diagrams showing an example in which a 2D region is generated.

2A and 2B show examples of sub-pixels and views recognized in the left and right eyes of the viewer when the viewer is located immediately behind the optimal viewing distance (first and second rear viewing areas).

At this time, FIG. 2A shows sub-pixels and views recognized in the viewer's left eye, and FIG. 2B shows sub-pixels and views recognized in the viewer's right eye.

2A and 2B, when the left and right eyes of the viewer are located in the first and second rear view regions, the left eye of the viewer is divided into sub-pixels displaying the first view image 1 and sub- The sub-pixels displaying the 3-view image 3 together and the right-eye of the viewer see the sub-pixels displaying the 3rd view image 3.

That is, when the left and right eyes of the viewer are located in the first rearview area and the second rearview area, the viewer feels the 2D area in a part of the image panel.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a non-eyeglass stereoscopic image display device capable of eliminating a 2D viewing area and an inverse stereoscopic area by replacing view data of a video panel according to a viewer position, Device. &Lt; / RTI &gt;

Other objects and features of the present invention will be described in the following description of the invention and the claims.

In order to achieve the above object, according to one embodiment of the present invention, a non-eyeglass stereoscopic image display apparatus replaces view data of an image panel according to a viewer position, overlays a viewing diamond, Or insert black data into the view of the 2D area.

In addition, the non-eyeglass stereoscopic image display device according to an embodiment of the present invention is characterized by removing crosstalk caused by view overlapping through view data rendering.

For this purpose, in the non-eyeglass stereoscopic image display apparatus according to an embodiment of the present invention, a first view to an m-th view are sequentially allocated to m (m is a natural number) sub- A viewing diamond disposed on the front face of the image panel and separating the optical axis of the input data to form a viewing diamond in which the first view image to K (K is a natural number satisfying 1? K? M) A 3D controller, and a timing controller for calculating a position of a viewer and a view corresponding to the 2D area, and superimposing the viewing diamonds on the basis of the computed views.

At this time, if the position of the viewer corresponds to N times the optimal viewing distance, the viewing diamond can be superimposed N times or more.

The timing controller can calculate the number of views and views recognized by the viewer's left and right eyes according to the position of the viewer.

At this time, the view data rendering area can be selected based on the number of calculated views and views.

At this time, the view image can be replaced with one view image having a disparity with respect to the left and right eyes of the viewer based on the selected view data rendering region.

In this case, for example, one of the plurality of view images recognized in the case of the left eye is replaced with one of the plurality of view images. In the case of the right eye, among the plurality of view images recognized, . &Lt; / RTI &gt;

As described above, the non-eyeglass stereoscopic image display apparatus according to an embodiment of the present invention expands the 3D viewing area to increase the degree of viewing freedom, and enhances the degree of freedom in designing the focal distance and the back distance.

Further, the gap glass can be removed, thereby providing a cost-reducing effect.

1 is a view for explaining a concept of a stereoscopic image display apparatus using a general lenticular lens system.
2A and 2B show an example in which a 2D region is generated;
3 is a block diagram schematically showing the configuration of a spectacle-free three-dimensional image display apparatus according to an embodiment of the present invention.
4 is a perspective view schematically showing a non-eyeglass stereoscopic image display apparatus according to an embodiment of the present invention.
FIG. 5 is an exemplary view for explaining a viewing zone in a spectacle-free three-dimensional image display apparatus. FIG.
6 is a view showing a viewing diamond projected on an XZ-plane.
Figures 7A and 7B illustrate viewing diamond coordinates as examples.
8 is an illustration showing viewing diamond coordinates in the XZ-plane at a distance of twice the optimal viewing distance.
9 is a view showing, as an example, the viewing diamond coordinates in the XZ-plane in the entire region including the optimum viewing distance.
FIG. 10 illustrates viewing diamond coordinates in the XZ-plane at k viewing distances of the optimal viewing distance; FIG.
11 is a view showing a viewing diamond cell in an XZ-plane as an example;
12 illustrates an example of viewing area coordinates including a binocular position in the XZ-plane at the P1 position;
FIGS. 13A and 13B illustrate a view that is perceived in the left and right eyes of a viewer at a position P1; FIG.
14 is a view showing 2D and 3D regions at a P1 position;
15 illustrates an example of viewing area coordinates including a binocular position in the XZ-plane at the P2 position;
FIGS. 16A and 16B are views showing, for example, a view recognized in the left and right eyes of a viewer at a position P2; FIG.
17 is a view showing 2D and 3D regions at P2 position;
18 is a view showing an example of the position of the binocular applied to the viewing diamond at the P2 position;
Figs. 19A and 19B show examples of views recognized in the left and right eyes of a viewer at a position P3. Fig.
20 is a view showing 2D and 3D regions at a position P3;
Figs. 21A and 21B illustrate examples of views recognized in the left and right eyes of a viewer at a position Pj. Fig.
Figures 22A and 22B illustrate examples of views perceived in the left and right eyes of a viewer at Pj locations that are at least twice the optimal viewing distance.
Fig. 23 is a view showing an example of the position of both eyes applied to a viewing diamond at a viewing distance of more than twice the optimum viewing distance. Fig.
24A and 24B are views showing an example of a viewing area of a multi-view image according to the position of a viewer.
Fig. 25 is a view showing an example of a view recognized in the left and right eyes of a viewer at a position P1 in a two-layer structure; Fig.
Fig. 26 is a view showing an example of a view recognized in the left and right eyes of a viewer at a P2 position in a two-layer structure; Fig.
FIG. 27 is a view showing 2D and 3D regions at a P2 position in a two-layer structure; FIG.
28 is a view showing an example of a pixel array and a lenticular lens arrangement in which a view-map is written, in the non-eyeglass stereoscopic image display apparatus according to the embodiment of the present invention.
29A and 29B illustrate examples of sub-pixels and views perceived in the left and right eyes at the P1 position;
Figures 30A and 30B illustrate examples of sub-pixels and views perceived in the left eye at the P2 position.
Figures 31A and 31B illustrate examples of sub-pixels and views perceived in the right eye at the P2 position.
Figures 32A and 32B illustrate examples of sub-pixels and views perceived in the left eye at a position P2 when view data rendering is applied;
Figures 33A and 33B illustrate examples of sub-pixels and views perceived in the right eye at the P2 position in the case of applying view data rendering.
Figures 34 and 35 illustrate an example of transforming input data through view data rendering.
36 is a view showing another example of converting input data through view data rendering;
Fig. 37 is a view showing an example of a sub-pixel and a view recognized in the left eye at the P2 position in the case of applying the view data rendering shown in Fig. 36;
Fig. 38 is a view showing examples of sub-pixels and views recognized in the right eye at the P2 position in the case of applying the view data rendering shown in Fig. 36;

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the present embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. It should be understood, however, that the invention is not limited to the disclosed embodiments, but is capable of many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification. The dimensions and relative sizes of the layers and regions in the figures may be exaggerated for clarity of illustration.

It will be understood that when an element or layer is referred to as being another element or "on" or "on ", it includes both intervening layers or other elements in the middle, do. On the other hand, when a device is referred to as "directly on" or "directly above ", it does not intervene another device or layer in the middle.

The terms spatially relative, "below," "lower," "above," "upper," and the like, And may be used to easily describe the correlation with other elements or components. Spatially relative terms should be understood to include, in addition to the orientation shown in the drawings, terms that include different orientations of the device during use or operation. For example, when inverting an element shown in the figures, an element described as "below" or "beneath" of another element may be placed "above" another element. Thus, the exemplary term "below" can include both downward and upward directions.

The terminology used herein is for the purpose of describing embodiments only and is not intended to be limiting of the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. &Quot; comprise "and / or" comprising ", as used in the specification, means that the presence of stated elements, Or additions.

3 is a block diagram schematically illustrating the configuration of a non-eyeglass stereoscopic image display apparatus according to an embodiment of the present invention.

3 is a block diagram illustrating a stereoscopic image display apparatus according to an exemplary embodiment of the present invention. The stereoscopic image display apparatus includes an image panel 110, image panel drivers 111 and 112, a 3D filter 120, a 3D filter driver (not shown) A timing controller 113, and the like.

The stereoscopic image display device according to an exemplary embodiment of the present invention may be applied to a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a field emission display (FED) A flat panel display device such as a plasma display panel (PDP), an electroluminescent display (EL), or the like. In the following description, the present invention is applied to a case where the image panel 110 is constituted by a liquid crystal display device, but the present invention is not limited thereto.

At this time, a plurality of sub-pixels for displaying red, green and blue colors are formed on the image panel 110. These sub-pixels act on the 3D filter 120 to display a stereoscopic image, A left-eye pixel and a right-eye pixel that display an image are separated.

For example, when the image panel 110 is a liquid crystal display device, the present invention can be applied to a liquid crystal mode, i.e., a twisted nematic (TN) mode, an in-plane switching (IPS) mode, The present invention is applicable regardless of the Fringe Field Switching (FFS) mode and the Vertical Alignment (VA) mode.

Although not shown, the image panel 110 may include a color filter substrate, an array substrate, and a liquid crystal layer formed between the color filter substrate and the array substrate.

The color filter substrate includes a black matrix (BM) for separating a sub-color filter from a color filter composed of a plurality of sub-color filters for realizing colors of red, green and blue and blocking light transmitted through the liquid crystal layer, And a transparent common electrode for applying a voltage to the liquid crystal layer.

The array substrate includes a plurality of gate lines G1, G2, G3, ..., Gn and data lines D1, D2, D3, ..., Dm arranged vertically and horizontally to define a plurality of pixel regions, And a pixel electrode formed in a pixel region, which are switching elements formed in intersections of the data lines D1, D2, D3, ..., Dm and the data lines D1, D2, D3, ..., Dm.

The thin film transistor includes a source electrode connected to a gate electrode connected to the gate lines G1, G2, G3, ..., Gn, a source electrode connected to the data lines D1, D2, D3, ..., Dm, Drain electrodes. The thin film transistor includes a gate insulating film for insulation between the gate electrode and the source / drain electrode, and an active layer forming a conductive channel between the source electrode and the drain electrode by a gate voltage supplied to the gate electrode.

An upper polarizer is attached to the outer surface of the color filter substrate, and a lower polarizer is attached to the outer surface of the array substrate. The light transmission axis of the upper polarizer and the light transmission axis of the lower polarizer may be formed to be orthogonal to each other. An alignment film for setting a pre-tilt angle of the liquid crystal layer is formed on the inner surface of the color filter substrate and the array substrate. An alignment film for setting the pre-tilt angle of the liquid crystal layer is formed between the color filter substrate and the array substrate. a cell gap is formed.

The image panel 110 configured as described above displays an image under the control of the timing controller 113.

The image panel 110 may display a 2D image in a 2D mode and a multi-view image in a 3D mode under the control of the timing controller 113.

The view of the stereoscopic image can be generated by separating the cameras from each other by an interval of the viewer's eyes and taking an image of the object. For example, when capturing an object using nine cameras, the image panel 110 can display a three-dimensional image of nine views.

The image panel driving units 111 and 112 include a data driver 111 for supplying data voltages of the 2D / 3D image to the data lines D1, D2, D3, ..., Dm of the image panel 110, And a gate driver 112 for sequentially supplying scan pulses (or gate pulses) to the gate lines G1, G2, G3, ..., Gn of the scan driver 110. [ The image panel driving units 111 and 112 spatially distribute the left eye and right eye image data input as data of the multi view image data format in the 3D mode to the sub-pixels of the image panel 110 and write them.

In this case, although not shown, the viewing distance sensing unit connected to the host system 115 senses the distance of the viewer and the binocular position of the viewer using the sensor, converts the result into digital data, and transmits the digital data to the host system 115 or the timing controller 113). The sensor may be an ultraviolet sensor or a high frequency sensor.

The viewing distance sensing unit may analyze the two sensor outputs using a triangulation method to calculate the distance between the image panel 110 and the viewer and transmit the result to the host system 115 or the timing controller 113. The viewing distance sensing unit may analyze the sensor output through a known face recognition algorithm to sense the position of the viewer's binocular position and transmit the result to the host system 115 or the timing controller 113. [

The timing controller 113 receives timing signals such as a data enable signal DE and a dot clock signal CLK and generates control signals for controlling the operation timings of the gate driver 111 and the data driver 112 (GCS, DCS).

That is, the timing controller 113 drives the image panel 110 at a predetermined frame frequency based on the image data and the timing signals received from the multi-view image converter 114 (or the host system 115) The gate driving unit control signal GCS and the data driving unit control signal DCS can be generated based on a predetermined frame frequency. The timing controller 113 supplies a gate driving unit control signal GCS to the gate driving unit 111 and supplies the video data R, G and B and a data driving unit control signal DCS to the data driving unit 112.

The gate driving unit control signal GCS for controlling the gate driving unit 111 includes a gate start pulse, a gate shift clock and a gate output enable signal. The gate start pulse controls the timing of the first gate pulse. The gate shift clock is a clock signal for shifting the gate start pulse. The gate output enable signal controls the output timing of the gate driver 111.

The data driver control signal DCS for controlling the data driver 112 includes a source start pulse, a source sampling clock, a source output enable signal, a polarity control signal, . The source start pulse controls the data sampling start timing of the data driver 112. The source sampling clock is a clock signal for controlling the sampling operation of the data driver 112 based on the rising or falling edge. If the digital video data to be input to the data driver 112 is transmitted in mini LVDS (Low Voltage Differential Signaling) interface standard, the source start pulse and the source sampling clock may be omitted. The polarity control signal inverts the polarity of the data voltage output from the data driver 112 to L (L is a natural number) horizontal period period. The source output enable signal controls the output timing of the data driver 112.

The data driver 112 includes a plurality of source drive ICs. The source drive ICs convert the image data (R, G, B) input from the timing controller 113 into a positive / negative gamma compensation voltage to generate positive / negative analog data voltages. Positive / negative polarity analog data voltages output from the source drive ICs are supplied to the data lines D1, D2, D3, ..., Dm of the image panel 110.

The gate driver 111 includes one or more gate driver ICs. The gate driver 111 includes a shift register, a level shifter and an output buffer for converting an output signal of the shift register into a swing width suitable for TFT driving of the liquid crystal cell. The gate driver 111 sequentially supplies a gate pulse synchronized with the data voltage to the gate lines G1, G2, G3, ..., Gn of the image panel 110 under the control of the timing controller 113. [

In particular, the timing controller 113 according to the embodiment of the present invention can perform a function of analyzing the types and the number of images recognized by the left and right eyes and the distribution on the image panel 110 according to viewer positions have. At this time, in order to reduce the 2D area, the ratio of the 3D area can be increased by overlapping the viewing diamond, or the black data can be inserted into the view of the 2D area. Alternatively, view data that is the same as or similar to the view data adjacent to the view of the 2D area may be input.

If viewing diamonds overlap, viewing distance can be extended. For example, in order to expand the viewing distance N times, the viewing diamond may be configured to overlap N times or more.

As will be described later, the timing controller 113 according to the embodiment of the present invention can perform a function of calculating the number of views and views recognized by the left and right eyes of a viewer based on mathematical equations devised by the present applicant . Based on the number of views and views thus calculated, a view data rendering region, or a sub-pixel or a view, can be selected and applied.

In addition, the timing controller 113 according to the embodiment of the present invention newly maps the input data to the sub-pixels of the image panel 110 through the view data rendering process, thereby eliminating the crosstalk generated according to the view overlapping Can be performed.

A multi-view image converting unit 114 may be installed between the timing controller 113 and the host system 115. The multi-view image converting unit 114 rearranges the left-eye and right-eye image data of the 3D image input from the host system 115 in the 3D mode into the multi-view image data format and transmits the same to the timing controller 113.

That is, when the 2D image data is input in the 3D mode, the multi-view image conversion unit 114 executes a predetermined 2D-3D image conversion algorithm to generate left eye and right eye image data from 2D image data, Rearranged into the data format and transmitted to the timing controller 113. [

The host system 115 may be implemented in any one of a television system, a set top box, a navigation system, a DVD player, a Blu-ray player, a personal computer, a home theater system, and a phone system. The host system 115 converts the digital video data of the 2D / 3D input image into a format suited to the resolution of the image panel 110 using a scaler, and transmits a timing signal to the timing controller 113 send.

The host system 115 supplies the 2D image to the timing controller 113 in the 2D mode, and supplies the 3D image or the 2D image data to the multi-view image conversion unit 114 in the 3D mode. The host system 115 transmits a mode signal to the timing controller 113 in response to user data input through a user interface (UI) (not shown) to change the mode of the eyeglass stereoscopic display device to the 2D mode You can switch in 3D mode. The user interface may be implemented by a keypad, a keyboard, a mouse, an on-screen display (OSD), a remote controller, a graphical user interface (GUI) The user can select the 2D mode and the 3D mode through the user interface, and select the 2D-3D image conversion in the 3D mode.

That is, the host system 115 supplies image data, timing signals, and the like to the multi-view image conversion unit 114 through an interface such as a Low Voltage Differential Signaling (LVDS) interface and a TMDS (Transition Minimized Differential Signaling) interface. The host system 115 supplies the 3D image data including the left eye image data and the right eye image data to the multi-view image conversion unit 114. As described above, the timing signals include a vertical synchronization signal, a horizontal synchronization signal, a data enable signal (Data Enable), a dot clock, and the like.

The host system 115 receives the viewer detection information from the viewing distance detection unit, and calculates the number of optimal views according to the viewer detection information. The host system 115 generates a view control signal according to the number of optimal views and supplies the view control signal to the multi-view image conversion unit 114. [ The host system 115 may generate the view control signal using a lookup table that receives the number of viewers of the viewer detection information as an input address and outputs the number of views stored in the input address.

Next, the 3D filter 120 is a medium for optically separating the path of the image, and includes a light transmitting region for transmitting or blocking the left eye image and the right eye image output from the left eye pixel and the right eye pixel of the image panel 110, And functions to form a light shielding region.

This 3D filter 120 can be configured in a variety of ways using well known techniques such as the following lenticular lenses or barriers. The lenticular lens and the barrier may be implemented by a switchable lens or a switchable barrier which is electrically controlled using a liquid crystal panel. For reference, the present applicant has proposed a switchable lens or a switchable barrier through US Application No. 13/077565, US Application No. 13/325272, and Application No. 10-2010-0030531.

The 3D filter driver can shift the switchable lens or the switchable barrier in synchronization with the image data written in the pixel array of the image panel 110 in the 3D mode under the control of the timing controller 113. [

FIG. 4 is a perspective view schematically showing a non-eyeglass stereoscopic image display apparatus according to an embodiment of the present invention, and shows a stereoscopic image display apparatus using a lenticular lens system as an example.

4, a stereoscopic image display apparatus using a lenticular lens system includes a plurality of lenticular lenses (for example, a liquid crystal display panel) having a predetermined width w on the entire surface of a video panel 110 on which a plurality of sub- And a lenticular lens plate 120, which is a 3D filter including a plurality of lens units 125, is disposed.

The lenticular lens plate 120 is formed by forming a material layer having a convex lens shape on its upper surface on a flat substrate.

The lenticular lens plate 120 divides the left and right eye images. Optimal viewing distance (OVD) v from the lenticular lens plate 120 corresponds to left and right eyes, And a viewing diamond (regular region) in which the images normally reach is formed.

Therefore, the image image transmitted through the image panel 110 passes through the lenticular lens plate 120, and another group of images enters the left and right eyes of the final viewer, so that a three-dimensional stereoscopic image can be felt.

In the stereoscopic image display apparatus using the lenticular lens system, the image panel 110 and the lenticular lens plate 120 are supported by an instrument (not shown), so that the image panel 110 and the lenticular lens plate 120 are spaced apart from each other Back distance).

On the other hand, according to the embodiment of the present invention, the arrangement of the plurality of lenticular lenses 125 is inclined at a first angle? With respect to the longitudinal direction (Y-axis direction) of the sub-pixels R, And the horizontal width w along the lateral direction (X-axis direction) of the sub-pixels R, G and B of the lenticular lens 125 is set to be an integer number of sub-pixels R, G, It can be set to double.

That is, in the stereoscopic image display apparatus according to the embodiment of the present invention, the lenticular lens 125 provided in the lenticular lens plate 120 is arranged at a first angle? (?) With respect to the longitudinal direction of the sub-pixels R, G, ). &Lt; / RTI &gt;

Accordingly, the number of views for viewing a 3D image can be adjusted by inclining the lenticular lens plate 120 with respect to the image panel 110 displaying the 2D image.

The first angle? Inclined with respect to the longitudinal direction of the sub-pixels R, G and B of the lenticular lens 125 in the lenticular lens plate 120 is tan ^-1 ((M * Pa) / (N * Pb)).

Here, Pa is a short axis pitch of the sub-pixels R, G and B, Pb is a long axis pitch of the sub-pixels R, G and B, and M and N are arbitrary natural numbers, (R, G, B) in a group when a plurality of sub-pixels (R, G, B) are grouped and a group is exactly passed through a vertex in a diagonal direction G and B in the longitudinal direction of the sub-pixels R, G and B and the number of the sub-pixels R, G and B in the longitudinal direction. At this time, it is general that M and N generally satisfy a value of M / N? 2.

The number assigned to the plurality of sub-pixels R, G, and B located in one group is the number of the sub-pixels R, G, (R, G, B) that are displayed when a 3D image is viewed in each view region. The number of views is defined as an area capable of viewing a 3D image of the image display apparatus.

The stereoscopic image display device having the lenticular lens plate 120 according to the embodiment of the present invention is advantageous in terms of luminance improvement and further has an effect of improving the viewing angle for viewing 3D images by increasing the number of views.

The increase in the number of views is achieved by a structure in which the lenticular lenses 125 provided on the lenticular lens plate 120 are arranged to have a predetermined angle with respect to the longitudinal directions of the sub-pixels R, G, and B, ) Structure. Application of such a slanted structure can prevent resolution degradation in one direction.

On the other hand, the viewer generally watches the stereoscopic image display device before or after the viewing distance other than the optimum viewing distance, that is, the optimum viewing distance.

According to the study of the present applicant, it can be seen that as the distance from the optimal viewing distance increases, the 2D recognition area (hereinafter referred to as the 2D area) increases and the 3D recognition area (hereinafter referred to as the 3D area) decreases. In addition, since the coordinates of the viewing diamond and the recognized view change according to the size of the image panel, an optimum viewing distance control technique considering the size of the image panel is required.

Therefore, it is necessary to generalize the viewing diamond of the stereoscopic image display device by the equation, to formulate the type of binocular perception image and the change of the superimposed image according to the viewer position, and to analyze the correlation between the viewer position change and the optimum viewing distance control have.

First, a 3D viewing area of the stereoscopic image display apparatus can be expressed in three dimensions as shown in FIGS. 5 and 6.

5 is an exemplary diagram for explaining a viewing area in a spectacle-free three-dimensional image display apparatus.

6 is a view showing a viewing diamond projected on an XZ-plane.

Referring to FIGS. 5 and 6, the optimal viewing distance v from the image panel 110 is formed in a diamond-shaped viewing diamond 130 (normal region) in which images corresponding to the left and right eyes normally reach the left and right eyes, respectively .

The diamond in the viewing area can be divided into a front triangle zone 130a and a rear triangle zone 130b.

All of the following electric field processes can be performed on the assumption that the width of the viewing diamond 130 formed at the optimal viewing distance is equal to the binocular interval e and the light travels straight.

The width and height of the image panel 110 may be defined as W and H, respectively.

The light passing through (0, 0, v) from (W / 2, 0, 0) is denoted by R ₀ and passes through (ne, 0, v) from (W / The light can be represented by Rn. Light passing through (0, 0, v) from (-W / 2, 0, 0) is represented by L ₀ and passes through (ne, 0, v) The light can be represented by Ln.

The 3D viewing area (or viewing diamond) can be generalized as spatial coordinates and displayed, and the size of the viewing area and the 3D area of the viewer depending on the display characteristics can be calculated.

Figs. 7A and 7B are views showing viewing diamond coordinates as an example. Fig.

At this time, FIG. 7A shows the viewing diamond coordinates in the XZ-plane, while FIG. 7B shows the viewing diamond coordinates in the ZY-plane.

7A and 7B, the spatial coordinates of the vertexes (n-1) e, ne, and fn of the forward triangular zone 130a can be expressed by the following equation (1).

[Equation 1]

At this time, the spatial coordinates (fnx, fny, fnz) of fn can be obtained by using the resemblance ratios of the triangles as shown in the following equations.

&Quot; (2) &quot;

therefore,

Likewise,

&Quot; (3) &quot;

therefore,

&Quot; (4) &quot;

therefore,

The spatial coordinates of the vertexes (n-1) e, ne, rn of the rear triangular zone 130b can also be expressed by the following equation (5).

&Quot; (5) &quot;

Here, he means the distance between the viewer's binocular and X-axis, i.e., the viewer's eye height, in the XY-plane. hp means the distance between the sub-pixel and the X-axis on the image panel 110 in the XY-plane, i.e. the height of the sub-pixel.

By using this, it is possible to express the 3D viewing diamond which is twice the optimal viewing distance as a general coordinate in the space, and calculate the viewing diamond area which is twice the optimal viewing distance.

FIG. 8 is a diagram illustrating viewing diamond coordinates in the XZ-plane at a distance of twice the optimum viewing distance.

에서 (0, 0, v)를 지나는 광은

을 지나므로, 최적 시청거리의 2배 지점의 전방 삼각 존(130a')의 꼭지점

의 공간좌표를 다음의 수학식 6과 같이 표현할 수 있다.Referring to Figure 8, in the same manner as above

The light passing through (0, 0, v)

So that the vertexes of the front triangular zone 130a ', which is twice the optimal viewing distance,

Can be expressed as the following Equation (6).

&Quot; (6) &quot;

의 공간좌표 역시 다음의 수학식 7과 같이 표현할 수 있다.
Further, in the same manner, the vertexes of the rear triangular zone 130b 'at twice the optimum viewing distance

Can also be expressed by the following Equation (7).

&Quot; (7) &quot;

Next, by generalizing the linear equation for light, viewing diamond coordinates in the entire region including the optimum viewing distance can be generalized.

In this case, the projection is performed on the XZ plane in order to simplify the equation.

FIG. 9 is a view showing an example of a viewing diamond coordinate in the XZ-plane in the entire region including the optimum viewing distance.

Referring to FIG. 9, a straight line equation for the light Rn is represented by the following equation (8).

&Quot; (8) &quot;

The equation of the straight line for the light Lm is expressed by the following equation (9).

&Quot; (9) &quot;

Here, n and m represent rational numbers.

When the above equations (8) and (9) are calculated in tandem, it is possible to generalize the coordinate f (n, m) where the light Rn and Lm meet as shown in the following equation (10).

&Quot; (10) &quot;

For reference, Equation 10 is the same as Equation 1 when f (n-1, n) in the XZ-plane. Further, when f (n, n-1) in the XZ-plane, Equation (10) is the same as Equation (5).

Based on the coordinates of the generalized viewing diamond of Equation (10), the coordinates of the point k times the optimal viewing distance can be generalized as follows.

FIG. 10 is a diagram showing viewing diamond coordinates in the XZ-plane at viewing distance k times the optimum viewing distance.

11 is a view showing a viewing diamond cell in the XZ-plane as an example.

Referring to FIGS. 10 and 11, when the Z coordinate of Equation 10 is kv to derive the coordinates of the k-th point of the optimum viewing distance, the following equation (11) is obtained.

&Quot; (11) &quot;

Where k represents a rational number greater than zero.

Equation (11) can be summarized as m as shown in Equation (12).

&Quot; (12) &quot;

Therefore, the coordinates of the k-th point of the optimum viewing distance can be generalized as shown in the following equation (13).

&Quot; (13) &quot;

For example, from the equation (13), the coordinates of twice the optimum viewing distance are calculated as shown in the following equation (14), which is the same as the viewing diamond coordinates of the equations (6) and (7).

&Quot; (14) &quot;

Next, using the plane coordinates of the viewing diamond, the width of the viewing diamond in the entire area can be generalized.

은 피타고라스 정리에 의해 다음 수학식 15와 같이 일반화할 수 있다.The width of the viewing diamond whose upper vertex is f (n, m)

Can be generalized by the following Pythagorean theorem.

&Quot; (15) &quot;

Therefore, by substituting the coordinates of Equation (10) into Equation (15), the width of the viewing diamond can be generalized as Equation (16).

&Quot; (16) &quot;

For example, the coordinates of f (0,1) f (0,0), f (1,0) f (1,1) in the counterclockwise direction at the upper vertex f (n, m) the maximum width of the viewing diamond with n = 0, m = 1) is equal to the binocular interval from equation (16).

Thus, if the binocular interval is fixed through Equation (16), the width of the viewing diamond is influenced by the width W of the image panel 110.

Next, using the width of the viewing diamond calculated above, the width of the viewing diamond at the point k times the optimum viewing distance can be expressed.

By substituting the expression (12) into the expression (16), it is possible to calculate the width of the viewing diamond at the point at which the optimum viewing distance is multiplied by k times the following expression (17).

&Quot; (17) &quot;

Here, when the width W of the image panel 110 is sufficiently larger than the binocular interval e, the following expression (18) can be obtained.

&Quot; (18) &quot;

For example, the width of the viewing diamond at twice the optimum viewing distance where the width W of the image panel 110 is sufficiently larger than the binocular interval e is calculated as follows.

&Quot; (19) &quot;

If the width W of the image panel 110 is sufficiently larger than the binocular interval e from Equation 18, it can be seen that the width of the viewing diamond at k times the optimal viewing distance is close to ke.

Next, a viewing view and a 2D and 3D area located at the optimum viewing distance (P1 position) are expressed in terms of the image panel as follows.

12 is a view showing an example of the viewing area coordinates including the binocular position in the XZ-plane at the P1 position.

13A and 13B are views showing, for example, a view recognized in the left and right eyes of the viewer at the P1 position. 13A shows a view recognized in the left eye of the viewer, and FIG. 13B shows a view recognized in the viewer's right eye.

FIG. 14 is a view showing 2D and 3D regions at the P1 position. FIG.

12, when the left eye 1 and right eye 2 of the viewer are located at the center of the viewing diamond at the optimum viewing distance (point Ks = 1; position P1), the left eye 1 and the right eye 2 It can be seen that the image to be recognized is the image separated into the respective views as shown in FIGS. 13A and 13B.

That is, the viewer's left eye 1 recognizes the image of the K-th view, whereas the viewer's right eye 2 recognizes the image of the (K + 1) -th view. Here, K means the number of views to be recognized.

Since there is no overlapping portion of the images of the left eye 1 and the right eye 2, the viewer perceives the 3D image over the entire area of the image panel 110 as shown in Fig.

Next, the view and the 2D and 3D areas recognized by viewers outside the optimal viewing distance are as follows.

Fig. 15 is a view showing the viewing area coordinates including the binocular position in the XZ-plane at the P2 position as an example.

16A and 16B are views showing, for example, a view recognized in the left and right eyes of the viewer at the P2 position. Here, FIG. 16A shows a view recognized in the viewer's left eye, and FIG. 16B shows a viewer's view in the viewer's right eye.

17 is a view showing 2D and 3D regions at P2 position.

15, for example, when the left eye 3 of a viewer is located at the center of the viewing diamond at a point of Ks = 2 (immediately after the optimal viewing distance; P2 position), the left eye 3 and the right eye 4 ) Can recognize that two views are recognized together in a single view as shown in Figs. 16A and 16B.

That is, the left eye 3 of the viewer perceives the images of the K-1th view and the Kth view, while the viewer's right eye 4 recognizes the images of the Kth view and the K + 1th view together.

At this time, an area in which the same view (i.e., K-th view) overlaps between the images recognized in the left eye 3 and the right eye 4, i.e., a 2D area, is generated.

As described above, a viewer who is out of the optimal viewing distance can input a plurality of view information in a single view, and when an image with a large disparity is input, the difference between the monocular images can be recognized.

At this time, even if the viewer moves horizontally or the structure of the image panel 110 (for example, a stripe or a slant structure) is different, the 2D position and the shape of the area may be changed, but the corresponding areas are the same.

On the other hand, since the 2D area shown in FIGS. 16 and 17 is the area displaying the same view, the 2D area is still maintained because both the left eye 3 and the right eye 4 are converted even when the view data is replaced. Therefore, a 2D region is essential in the structure.

Accordingly, the view area and the 2D and 3D areas of the image, which are recognized based on the binocular position of the viewer, are generalized by the formulas and will be described with reference to FIGS. 16A and 16B and FIG.

18 is a view showing an example of the position of the binocular applied to the viewing diamond at the P2 position.

At this time, it is assumed that the viewer's left eye is located at the center of the viewing diamond.

When the viewer's binoculars 3 and 4 are positioned as shown in Fig. 18 on the viewing diamond at the point Ks = 2, the images perceived by the left eye 3 have a width of W / Ks uniformly in each view.

In contrast, in the case of the right eye 4, since the widths (c, d) of each view are proportional to the distance apart from the center of the viewing diamond, the width (d) of the K + 1th view can be expressed by the following equation .

&Quot; (20) &quot;

From FIG. 16B, it can be seen that c + d = W. Therefore, the width c of the Kth view can be expressed by the following equation (21).

&Quot; (21) &quot;

From equation (16) and (18), the width (2 (a + b)) of the viewing diamond is given by the following equation (22).

&Quot; (22) &quot;

Here, Ks = n-m + 1.

In addition, since 2a + b = e, it can be calculated in conjunction with equation (22) to obtain a and b for the position of the right eye 4.

&Quot; (23) &quot;

Using this, it is possible to generalize the view area and the 2D and 3D areas of the perceived image according to the binocular position of the viewer located at the point of Ks = 2.

16A and 16B, a 2D overlap region is calculated and substituted into Equation 23 to form a 2D region as follows.

&Quot; (24) &quot;

이다.At this time, Ks = 2,

to be.

&Quot; (25) &quot;

Equation (24) and Equation (25) are cases in which the influence by the view data is considered.

From the equation (24), it can be seen that a 2D area of at least 2eH occurs at a point of Ks = 2.

Since the 2D region of Ks = 2 is calculated in the foregoing, the 2D generation region can be generalized by calculating the region where Ks = 3 and the region thereafter. Then, by converting the result into coordinates, the 2D generation region of the image panel can be specified for each sub-pixel.

In converting the 2D region into the stereoscopic region by the method proposed by the present invention, the size and position of the transformation region, and the required data throughput and memory size can be calculated.

Figs. 19A and 19B are views showing, for example, a view recognized in the left and right eyes of a viewer at a position P3. At this time, FIG. 19A shows a view recognized in the left eye of the viewer, and FIG. 19B shows a view recognized in the viewer's right eye.

20 is a view showing 2D and 3D regions at a position P3.

Referring to FIGS. 19A and 19B, a view-specific region and 2D and 3D regions of a perceived image according to a viewer's binocular position located at a point Ks = 3 (immediately after a point Ks = 2; P3) .

For example, when the left eye of the viewer is located at the center of the viewing diamond at the point Ks = 3, the images perceived by the left eye and right eye can be recognized as three views in a single view.

That is, the left eye of the viewer perceives the images of the K-1th view, the Kth view and the K + 1th view, while the viewer's right eye recognizes the images of the Kth view, the K + 1th view, and the K + .

At this time, an area in which the same view (i.e., the K-th view and the (K + 1) -th view) overlap between the left eye and the right eye is generated, that is, a 2D area, which can be expressed as shown in FIG.

Also, referring to FIG. 19A, the image perceived in the viewer's left eye has a width of W / Ks uniformly in each view.

On the other hand, in the case of the right eye, referring to FIG. 19B, the width e of the (K + 2) -th view can be expressed by Equation 26 below.

&Quot; (26) &quot;

From FIG. 19B, it can be seen that c + d + e = W. Since c = d, the sum (2c = c + d) of the widths of the Kth view and the K + 1th view is expressed by the following equation (27).

&Quot; (27) &quot;

Using the equations (22), (23) and (27), the 2D and 3D regions when Ks = 3 are expressed by the following equations (28) and (29).

&Quot; (28) &quot;

이다.At this time, Ks = 3,

to be.

&Quot; (29) &quot;

Equation (28) and Equation (29) are cases in which the influence of the view data is taken into account.

From the equation (29), it can be seen that the 2D area at the point of Ks = 3 is generated by at least 3eH regardless of the number of the image data and the number of views.

Next, based on the above results, generalization of the view area and the 2D and 3D areas of the perceived image according to the viewer's binocular position from the optimum viewing distance to twice the optimum viewing distance is expressed by the formula.

At this time, the double point of the optimum viewing distance is the maximum distance that the binocular can be located within the two view diamonds when the left eye is located at the center of the view diamond.

Figs. 21A and 21B are views showing, for example, a view recognized in the left and right eyes of the viewer at the position Pj. At this time, FIG. 21A shows a view recognized in the left eye of the viewer, and FIG. 21B shows a view recognized in the viewer's right eye.

21A and 21B, for example, when the viewer's left eye is located at the center of the viewing diamond at a point (Pj position) where Ks = j, the images recognized by the left eye and right eye are It can be seen that it is perceived.

That is, the left eye of the viewer perceives images of the Kj-1th view, the Kjth view, ...., the K-1th view and the Kth view, while the viewer's right eye recognizes the Kjth view, Kj + The first view, ...., the Kth view, and the (K + 1) th view.

At this time, an area where a same view (that is, a K-th view from the K-j-th view) overlaps between the images recognized in the left eye and the right eye, i.e., a 2D area occurs.

Referring again to FIG. 21A, the image perceived in the left eye of the viewer has a width of W / Ks uniformly in each view.

21B, the width d of the (K + 1) -th view is different from the width of the other views and can be expressed by Equation (30).

&Quot; (30) &quot;

From FIG. 21B, it can be seen that (Ks-1) c + d = W. From the equation (30), the following can be found.

&Quot; (31) &quot;

Using the equations (22), (23) and (31), the 2D and 3D regions of Ks = j (i.e., from the optimum viewing distance to twice the optimal viewing distance) can be expressed by the following equations (32) and Respectively.

(32)

&Quot; (33) &quot;

Equation (32) and Equation (33) are cases in which the inequality is also taken into consideration by the influence of the view data.

From Equation (32), it can be seen that the 2D region from the optimum viewing distance to twice the optimum viewing distance is generated by the minimum eKsH regardless of the number of the image data and the number of views.

Next, the view area and the 2D and 3D areas of the perceived image according to the positions of the two eyes of the viewer located at a point twice or more than the optimum viewing distance are generalized by the formulas.

At this point, the point at least twice the optimal viewing distance is the distance that the binocular is located within one view diamond when the left eye is located at the center of the view diamond.

22A and 22B are views showing, for example, a view recognized in the left and right eyes of a viewer at a position Pj which is twice or more the optimum viewing distance. At this time, FIG. 22A shows a view recognized in the left eye of the viewer, and FIG. 22B shows a view recognized in the viewer's right eye.

FIG. 23 is a view showing an example of the position of both eyes applied to a viewing diamond at a viewing distance of more than twice the optimum viewing distance.

22A and 22B and FIG. 23, for example, when the viewer's binocular is positioned as shown in FIG. 22 in a viewing diamond at a point where Ks = j at a position twice or more than the optimum viewing distance, Can see that j views are recognized together in a single view.

That is, the viewer's left eye recognizes the images of the Kj-1th view, the Kjth view, ...., the K-1th view, and the Kth view, while the viewer's right eye recognizes the Kj- View, ...., image of the (K-1) th view and the image of the (K) th view are recognized together.

Referring again to FIG. 22A, the image perceived in the viewer's left eye has a width of W / Ks uniformly in each view.

22B, the width c of the (K-j-1) -th view is different from the width of the other views and can be expressed by the following equation (34).

&Quot; (34) &quot;

From FIG. 22B, it can be seen that c + (Ks-1) d = W. From the equation (34), the following can be found.

&Quot; (35) &quot;

23, since a = e,

임을 알 수 있다.Calculated in tandem with equation (22)

.

Using the equations (22) and (35), the 2D and 3D regions at positions twice or more than the optimal viewing distance are expressed by the following equations (36) and (37).

&Quot; (36) &quot;

&Quot; (37) &quot;

Equation (36) and Equation (37) are cases in which the influence of the view data is taken into account.

From Equation (32) and Equation (37), it can be seen that the 2D region is generated by the minimum eKsH regardless of the viewer position.

Next, considering the optimum viewing distance control, the 2D and 3D areas at the point where the optimum viewing distance is doubled and the optimal viewing distance is three times the generalized by the formula.

First, the coordinates of the point at which the optimum viewing distance is doubled can be calculated from Equation (13)

이며,

Lt;

이다.At this time

to be.

Hence, from the equations (32) and (33), the 2D and 3D regions at the position twice the optimal viewing distance can be generalized as the following equations (38) and (39).

&Quot; (38) &quot;

[Equation 39]

Further, the coordinates of the point at which the optimum viewing distance is tripled is obtained from the equation (13)

이며,

Lt;

이다.At this time

to be.

Therefore, from the equations (36) and (37), the 2D and 3D regions at the position three times the optimum viewing distance can be generalized as the following equations (40) and (41).

[Equation 40]

(41)

According to these results, it can be seen that a 2D region necessarily occurs in the view independent structure.

Therefore, in the present invention, in the non-eyeglass stereoscopic image display device for extending the viewing distance N times, the view overlapping structure, that is, the viewing diamond is designed to overlap N times or more.

24A and 24B are views showing an example of a viewing area of a multi-view image according to the position of a viewer, and show a double-superimposed structure of a viewing diamond as an example. 24B is an enlarged view of a portion A shown in FIG. 24A.

At this time, it is assumed that the P1 position corresponds to the optimum viewing distance at which the viewer can normally view the stereoscopic image. 24A and 24B show a state in which the viewing diamond is superimposed only in a partial area for convenience, but in reality, the viewing diamond is superimposed over the entire area.

Referring to FIGS. 24A and 24B, the diamond shape area refers to the viewing diamond 130 as a viewing zone.

For example, "K" is a viewing area in which the K-th view image (or the image of the K-th view) displayed on the image panel 110 is visible, It is the viewing area where the image is visible. "K + 2" is a viewing area in which a K + 2 view image displayed on the image panel 110 is visible, and "K + 3" is a viewing area in which a K + 3 view image displayed in the image panel 110 is visible.

At this time, an area where the viewing diamond 130 overlaps according to the view overlapping structure is an area where views overlap, and a plurality of view images are recognized.

When the viewer moves from the P1 position to the P2 position (behind the optimal viewing distance), the binocular is almost similar to moving from position (1, 2) to position (3, 4).

As an example of a double-superimposed structure of a viewing diamond, a sub-pixel area recognized by the viewer can be represented by the image panel 110 as follows.

Hereinafter, the viewing regions and the viewing diamond formed at the position P2 immediately after the optimum viewing distance will be described. However, this is for the convenience of explanation, and is equally applicable to a point twice the optimal viewing distance and other points.

Fig. 25 is a diagram showing a view recognized in the left and right eyes of the viewer at the position P1 in the two-layer structure.

26 is a diagram showing a view recognized in the left and right eyes of the viewer at the P2 position in the double superposed structure as an example.

FIG. 27 is a view showing 2D and 3D regions at a P2 position in a two-layer structure. FIG.

25, when the left eye LE1 and the right eye RE1 of the viewer are positioned at the center of the viewing diamond at the optimum viewing distance (point Ks = 1; position P1) at the position P1, the left eye LE1 and the right eye RE1) is an image separated by each view.

However, in the case of a view-independent structure in a viewing diamond structure based on a binocular interval, only one view is recognized in a single view at a point Ks = 1, but in the view overlapping structure, And one more view is added to the back.

That is, the left eye LE1 of the viewer perceives the images of the Kth view and the K + 1th view together, while the viewer's right eye RE1 recognizes the images of the K + 2th view and the K + 3th view together .

Since there is no part where the images of the left eye LE1 and the right eye RE1 overlap, the viewer perceives the 3D image over the entire area of the image panel.

26, for example, when the left eye LE2 of the viewer is located at the center of the viewing diamond at a position of Ks = 2 (immediately after the optimal viewing distance; P2 position), the left eye LE2 and the right eye RE2 ) Recognizes that three views are recognized together in a single view.

At this time, the left eye LE2 of the viewer recognizes the images of the Kth view and the K-1th view on the left side of the image panel, and recognizes the images of the Kth view and the (K + 1) th view on the right side of the image panel together .

On the other hand, the viewer's right eye RE2 recognizes the images of the (K + 2) -th view and the (K + 1) -th view from the left side of the image panel, .

At this time, a region in which the same view (i.e., the (K + 1) th view) is overlapped, that is, a 2D region, is generated between the images recognized by the left eye LE2 and the right eye RE2.

However, in this case, the overlapped area is not seen as a 2D area at all, and the 3D viewing area is substantially increased as compared with the view independent structure because it is mixed with the 2D area and the 3D area. This is because an area in which the same view overlaps between the images recognized by the left eye LE2 and the right eye RE2 is implemented as a 3D area according to view overlapping.

From the viewpoint of the sub-pixel perceived by the viewer, it is as follows.

FIG. 28 is a view showing an example of a pixel array and a lenticular lens arrangement in which a view-map is written in a spectacle-free three-dimensional image display apparatus according to an embodiment of the present invention.

At this time, FIG. 28 shows an example of a pixel array in which 16 views are used. However, the present invention is not limited to the above-described number of views.

R, G, and B shown at the top of FIG. 28 indicate the positions of the R, G, and B sub-pixels.

Referring to FIG. 28, when m (m is a natural number) view is used, the image panel may be allocated m first sub-pixels to m sub-pixels in units of m sub-pixels sequentially.

That is, the K-th view is assigned to the K-th sub-pixel among the m sub-pixels of the image panel (K is a natural number satisfying 1? K? M).

For example, if 16 views are used, a first view (1 ^st view) is assigned to the first sub-pixel, a second view (2 ^nd view) is assigned to the second sub- A third view (3 ^rd view) is allocated to the fourth sub-pixel, and a fourth view (4 ^th view) is allocated to the fourth sub-pixel. A fifth view (5 ^th view) is assigned to the fifth sub-pixel, a sixth view (6 ^th view) is assigned to the sixth sub-pixel, a seventh view (7 ^th view) view, and the eighth view (8 ^th view) is allocated to the eighth sub-pixel. A ninth sub-is assigned a 10 second view (10 ^th view) to a pixel, an eleventh sub-11th view of the pixel (11 ^th view) 9 second view to a pixel (9 ^th view) is, the tenth sub-assigned the allocation is, 12 sub-assigned to the 12th view (view 12 ^th) in the pixel. 13th sub-is assigned a 14 second view (14 ^th view) to the pixel, the 15 sub-15th view of the pixel (15 ^th view) 13 second view to a pixel (13 ^th view) is, 14 sub-assigned the allocation is, 16 sub-views assigned to the 16th to the pixel (16 ^th view).

For this purpose, the 3D filter may be implemented as a lenticular lens 125 of a slant structure formed obliquely at a predetermined angle with respect to the sub-pixels. More specifically, the lenticular lens 125 of the slanted structure is formed obliquely by a predetermined angle with respect to the long axis sides of the sub-pixels.

Accordingly, the 3D filter divides each of the first to m-th view images (before-converted view images) displayed on the m sub-pixels into the first view to the m-th view. Thus, the 3D filter outputs the Kth view image displayed on the Kth sub-pixel to the Kth view.

For reference, the view-map described in the present invention expresses data order and position of each view repeatedly mapped to sub-pixels of a video panel, and the viewing area includes a regular area, There is a non-existent area.

Here, the regular time region refers to an area in which a viewer can normally view a stereoscopic image, in which a right eye image is formed in the right eye of the viewer and a left eye image is formed in the left eye.

In addition, since the difference information of the image is transmitted to the region, the viewer can recognize the image in three dimensions. However, since the left eye image is formed in the right eye and the right eye image is formed in the left eye, It is an area to be felt.

In addition, the unviewable area refers to an area where viewing of stereoscopic images is impossible

That is, the view-map includes coordinate information (i.e., the first view to the m-th view) for the positions where the three regions are displayed.

However, since the regular time zone and the area other than the area can also be determined as the un-viewable area, the coordinate information for the un-viewable area may be omitted in the view-map.

Figs. 29A and 29B are views showing examples of sub-pixels and views recognized in the left eye and right eye at the P1 position. Fig.

At this time, FIG. 29A shows sub-pixels and views recognized in the left eye, and FIG. 29B shows sub-pixels and views recognized in the right eye as an example.

Hereinafter, it is assumed that the corresponding view structure and mapping are repeatedly formed over the entire area.

In an ideal case where there is no 3D crosstalk between neighboring views, there are two views per view of the viewers in the double-layered structure of the viewing diamond. Therefore, as shown in FIGS. 29A and 29B, sub-pixels recognized by the left eye and the right eye can be expressed.

In the non-eyeglass stereoscopic image display apparatus according to the embodiment of the present invention, the width of the viewing diamond is based on the binocular interval. If there is no overlap of the viewing diamonds, if the left eye recognizes the first view, I know.

29A and 29B, when the left eye recognizes the first view and the second view, the right eye has the third view and the fourth view as shown in FIG. 29A and FIG. 29B because there is one viewing diamond between the left eye and the right eye. Lt; / RTI &gt; view.

That is, when the left eye views the first view image and the second view image in the case of the double overlap, the right eye sees the third view image and the fourth view image.

Figs. 30A and 30B are views showing examples of sub-pixels and views recognized in the left eye at the P2 position. Fig.

Figs. 31A and 31B are views showing examples of sub-pixels and views recognized in the right eye at the P2 position.

Here, FIGS. 30A and 31B show examples of sub-pixels and views recognized in the left and right eyes in the 3D region. 30B and 31A show examples of sub-pixels and views recognized in the left and right eyes in the 2D area (actually, 2D, 3D mixed area; see FIG. 27).

That is, FIG. 30A shows sub-pixels and views perceived in the left eye in the 3D region on the left side of the image panel, and FIG. 31B shows sub-pixels and views perceived in the right eye in the 3D region on the right side of the image panel. FIG. 30B shows sub-pixels and views recognized in the left eye in the 2D region of the image panel center (actually, slightly right in the center), FIG. 31A shows the sub- - Show pixels and views.

However, this explains the sub-pixel and the view that are recognized at the P2 position of the double superposition structure, and the present invention is not limited thereto.

In the case of the two overlapping, there is one viewing diamond between the left eye and the right eye at the position P2, so that the left eye recognizes the first view, the second view, and the 16th view as shown in FIGS. 30A and 30B and FIGS. 31A and 31B The right eye recognizes the second view, the third view, and the fourth view.

That is, when the left eye views the first view image, the second view image, and the 16th view image at the P2 position in the case of the double overlap, the right eye sees the second view image, the third view image, and the fourth view image.

As can be seen from FIG. 27, FIG. 30A, FIG. 30B, FIG. 31A, and FIG. 31B, the sub-pixels recognized in the left eye and the right eye partially have 2D regions in some regions of the image panel.

That is, as shown in FIG. 27, it can be seen that the (K + 1) -th view is input to the left eye and the right eye simultaneously from a center portion to a center right portion of the image panel. 30B and 31A, it can be seen that the second views indicated by the rectangles of the dotted lines overlap.

Here, FIGS. 30B and 31A show sub-pixels and views recognized in the left and right eyes in the 2D region at the center of the image panel (actually, slightly right at the center) as described above.

However, in this embodiment of the present invention, when the viewer's left eye recognizes the K-1th view, the Kth view, and the K + 1th view, the viewer's right eye is a K + 1th view and a K + Since the K + 3th view is recognized, the image perceived by the right eye relative to the left eye is a relatively right view image. This is because the viewer recognizes that there is a disparity between the left eye and the right eye recognizing a plurality of views due to the characteristics of the eye that integrates the image information, so that the 3D image can be viewed. In addition, since the 3D viewing area is substantially increased as compared with the view independent structure, it can be seen that the ratio of 2D or sub-pixels decreases as the number of superimposed views is increased.

In this case, however, crosstalk may occur because a plurality of views are simultaneously recognized per area in a single view. Therefore, in the embodiment of the present invention, the view data rendering technique is applied as follows to convert the view data of the image panel into one view data having a disparity with respect to the left and right eyes according to the viewer position .

32A and 32B are views showing examples of sub-pixels and views recognized in the left eye at the position P2 when the view data rendering is applied.

33A and 33B are views showing examples of sub-pixels and views recognized in the right eye at the P2 position when the view data rendering is applied.

Here, FIGS. 32A and 33B show examples of sub-pixels and views recognized in the left and right eyes in the 3D region. 32B and 33A show examples of sub-pixels and views recognized in the left and right eyes in the 2D region.

34 and 35 are views showing an example of transforming input data through rendering of view data.

In this case, 1, 2, 3, ..., and 16 shown in FIG. 35 indicate the first view image, the second view image, the third view image, ..., and the 16th view image, respectively.

Referring to FIGS. 32A, 32B, 33A, 33B, 34, and 35, by applying the view data rendering technique according to the embodiment of the present invention, disparity), respectively. In other words, for example, one of view data of a plurality of views recognized in the case of the left eye is replaced with one of view data in the right eye, and the other one of the plurality of view data recognized in the right eye, Can be replaced with view data.

As an example the case of using the 16 views, 16th view of the left input data for and the first view (1 ^st view) (Fig. 34, the ^16-th view shown in FIG. 35) is in claim 16, the view image and the first view image And converted into a first view image.

Then, the left and the second view of the right eye (2 ^nd view) and the third view of the right eye (3 ^rd view) and fourth views of input data (4 ^th view) and a second view image and the third-view image and the fourth The second view image is converted from the view image.

In this case, the first and second view images are images having a disparity of binocular disparity, but a view image having a difference of more than or equal to the disparity is also possible for the depth control.

When the converted view image is input, it is mapped as shown in FIGS. 32A and 32B, FIGS. 33A and 33B, and the image of the neighboring view is not properly shown. As a result, the crosstalk is reduced.

On the other hand, it is possible to remove only the view image of the sub-pixel corresponding to the 2D region in order to completely remove the 2D region recognizing the same view in the left eye and the right eye. For example, inserting black data into a view of a sub-pixel corresponding to a 2D region eliminates the overlap of the left eye and the perceived sub-pixels of the right eye.

36 is a diagram showing another example of converting input data through view data rendering.

In this case, Figure 36 is substantially the same as the FIG. 34 described above, except that insert the black data (the 2 ^nd view shown in Fig. 36), the second view corresponding to the 2D area.

37 is a diagram showing examples of sub-pixels and views recognized in the left eye at the P2 position in the case of applying the view data rendering shown in Fig.

FIG. 38 is a view showing examples of sub-pixels and views recognized in the right eye at the P2 position in the case of applying the view data rendering shown in FIG.

Referring to FIGS. 36, 37, and 38, the view data rendering technology according to the embodiment of the present invention is applied to the data of a plurality of views per area, and a view having disparity with respect to the left and right Data, and black data is inserted into a view corresponding to the 2D area.

In other words, for example, one of view data of a plurality of views recognized in the case of the left eye is replaced with one of view data in the right eye, and the other one of the plurality of view data recognized in the right eye, Can be replaced with view data. At the same time, black data is inserted into the view corresponding to the 2D area.

If the example using the 16 views, 16th view of the left eye (the ^16-th view shown in Fig. 36) and the first view, the input data of the (1 ^st view) of claim 16, the view image and the first view in a first view image Image.

Then, the input data of the third view (3 ^rd view) and the fourth view (4 ^th view) of the right eye are converted into the second view image from the third view image and the fourth view image.

At the same time, the input data of the second view (2 ^nd view) of the left and right eyes corresponding to the 2D area is converted into black data.

In this case, the first and second view images are images having a disparity of binocular disparity, but a view image having a difference of more than or equal to the disparity is also possible for the depth control.

When the converted view image is input, overlapping portions of the sub-pixels recognized in the left eye and the right eye are mapped as shown in FIG. 37 and FIG.

However, in this case, the brightness may be reduced, so that the view data that is the same as or similar to the adjacent view instead of the black data may be input to the view of the 2D area.

At this time, the ratio of the 2D region can be reduced by increasing the number of view overlaps.

According to the present invention, the 3D viewing area is expanded to increase the degree of viewing freedom, and at the same time, the degree of freedom in designing the focal distance and the back distance can be increased. In this case, the gap glass (or the gap film) used for adjusting the viewing distance and the focal length can be removed, thereby providing a cost reduction effect.

After recognizing the position of the viewer, a sub-pixel recognized by the viewer based on the position of the viewer, a view corresponding to the sub-pixel, and several views based on the image panel are recognized in the left and right eyes of the viewer Can be calculated through the above-described equations or the like.

In addition, it is possible to express the 2D occurrence area by coordinates, and thus, it is possible to selectively apply the view that needs to apply view data rendering or apply it.

For reference, an eye tracking algorithm by the viewing distance detection unit is as follows. The applicant of the present application has proposed an eye-tracking algorithm through Korean Application No. 10-2013-0038815. However, the present invention is not limited thereto.

First, the number of users and the user's face are detected from the input image captured through the camera. For example, a user's face is detected from an input image using a face detection method such as Haar Classifier.

Then, the center coordinates of the eyes of the detected face of the user, that is, the center coordinates between the left eye and the right eye are detected. For example, eye feature models such as AAM (Active Appearance Model) are used to select initial feature points such as the left eye and right eye, and eye center coordinates, which are the final feature points, are detected through the EBGM model.

Then, the eye position information of the user is calculated by applying the detected eye center coordinates to the distance model using the eyes. The user's eye position information is calculated as X, Y, Z coordinate values based on the center point of the stereoscopic image display device.

The determination of the position of the viewing area where the left and right eyes of the viewer are located is performed by comparing the viewer's binocular positional information (coordinate value) sensed by the viewing distance sensing unit with the viewing area positional information (coordinate information) stored in the look- It can be judged by the method. When the viewing area where the viewer's binocular is located is determined, the ratio of the position of the right eye or the left eye and the ratio of the left and right images in the viewing areas within the viewing areas where the viewer's binocular is located should be grasped. A detailed description thereof can be found in Korean Patent Application No. 10-2012-0108794 filed in the same year, and can be generalized by a formula as shown in the above-mentioned mathematical formulas.

While a great many are described in the foregoing description, it should be construed as an example of preferred embodiments rather than limiting the scope of the invention. Therefore, the invention should not be construed as limited to the embodiments described, but should be determined by equivalents to the appended claims and the claims.

110: image panel 120: lenticular lens plate
125: Lenticular lens 130: Viewing diamond

Claims (9)

an image panel for displaying input data of a multi-view in which first to m-th views are sequentially assigned to m (m is a natural number) sub-pixels sequentially;
Wherein a viewing angle of the first view image to a K (K is a natural number satisfying 1 &lt; K &lt; m) is displayed on an optimal viewing distance by separating an optical axis of the input data, diamond); And
And a timing controller for calculating a position of the viewer and a view corresponding to the 2D region and superimposing the viewing diamond on the basis of the calculated view. The stereoscopic image display apparatus of claim 1, wherein when the position of the viewer corresponds to N times the optimal viewing distance, the viewing diamond is overlapped N times or more. The stereoscopic image display apparatus according to claim 1, wherein the timing controller calculates the number of views and views recognized by the viewer's left and right eyes according to the position of the viewer. The apparatus according to claim 3, wherein the view data rendering region is selected based on the number of the calculated views and views. The method of claim 4, wherein the view image is replaced with a view image having disparity with respect to left and right eyes of the viewer based on the selected view data rendering region, Display device. 6. The method according to claim 5, wherein one of the plurality of view images recognized in the case of the left eye is replaced with one of the plurality of view images, and the remaining one of the plurality of view images recognized in the right eye, Eye stereoscopic image display device. [2] The method of claim 1, wherein the 2D region is represented by eKsH (where e denotes a binocular interval, Ks and H denote the order of the viewing diamond formed in order from the optimum viewing distance, Eye stereoscopic image display device. The apparatus according to claim 7, wherein black data is inserted into a view of a sub-pixel corresponding to the 2D region. The apparatus according to claim 7, wherein view data identical or similar to a view adjacent to a view of a sub-pixel corresponding to the 2D region is input.

Images