TW202327348A - Stereoscopic display device and display method thereof - Google Patents

Abstract

A stereoscopic display device and a display method thereof. The stereoscopic display device includes a display panel, a lens array and a processing circuit. The lens array is arranged on a transmission path of the three-dimensional image displayed by the display panel. The processing circuit adjusts a liquid crystal rotation angle of the lens array according to an actual eye position. The processing circuit calculates a first vector according to an original point position and an after-rotation position of a liquid crystal of the lens array, calculates an second vector according to the original point position and a start position of the liquid crystal, calculates a liquid crystal angle of the adjusted lens array according to the first vector and the second vector, calculates a luminance compensation parameter according to the liquid crystal angle, and compensates a display brightness of the display panel according to the luminance compensation parameter.

Description

Stereoscopic display device and display method thereof

The present invention relates to a stereoscopic display device, and in particular to a stereoscopic display device capable of adjusting the liquid crystal rotation angle of a lens array and a display panel and a display method thereof.

Today's 3D display technology can be divided into glasses-type 3D display technology in which observers need to wear specially designed glasses, and naked-eye 3D display technology that can be directly viewed with naked eyes. The naked-eye stereoscopic display technology can be divided into stereoscopic display technologies such as parallax barriers, lenticular lens, and directional backlight. Wherein the lenticular lens stereoscopic imaging method is to arrange a series of straight cylindrical convex lens films in front of the display screen. Light rays can change direction as they pass through a lenticular lens. The left-eye image and the right-eye image are vertically staggered corresponding to the positions of the lenticular lens respectively. Through the lens refraction, the left and right eyes of the user respectively see the corresponding left-eye image frame and the right-eye image frame to generate parallax, thereby presenting a three-dimensional effect.

However, general lenticular lenses are arranged in a single direction and fixedly attached to the surface of the display screen, or liquid crystals are injected into the lenticular lenses to control the refraction angle of the lenses. But at most, it can only adjust the refraction in the horizontal direction according to the horizontal position of the user. When the display screen has a too large inclination angle for the user, or the vertical viewing angle of the display screen is too large due to the user's own height, sitting posture or other factors, the three-dimensional rendering effect of the displayed image may be greatly reduced. There is even a situation where the stereoscopic image has visual deviation or cannot form a three-dimensional effect. Therefore, it is necessary to adjust the rotation angle of the liquid crystal in the lenticular lens according to the actual position of the user's eyes, so as to change the refraction angle of the lens to maintain the three-dimensional image. However, the adjustment of the liquid crystal rotation angle may reduce the light transmittance of the liquid crystal, that is, the amount of light that can pass through the liquid crystal is reduced, resulting in problems such as brightness attenuation and uneven brightness of the display panel, thereby affecting user experience.

In view of this, the present invention proposes a stereoscopic display device and a display method thereof, which can dynamically adjust the liquid crystal rotation angle of the lens array according to the actual position of human eyes, and adjust the display brightness of the display panel according to the adjusted lens array.

In an embodiment of the present invention, the stereoscopic display device includes a display panel, a lens array and a processing circuit. The display panel is used for displaying three-dimensional images. The lens array is arranged on the transmission path of the three-dimensional image. The processing circuit is coupled to the lens array and the display panel. The processing circuit adjusts the liquid crystal rotation angle of the lens array according to the actual position of the human eye so that the viewing position of the three-dimensional image matches the actual position of the human eye. The processing circuit calculates the first vector according to the origin position of the lens array and the liquid crystal rotated position, calculates the second vector according to the origin position and the initial position of the liquid crystal, and calculates the adjusted liquid crystal angle of the lens array according to the first vector and the second vector , calculating the brightness compensation parameter according to the liquid crystal angle, and compensating the display brightness of the display panel according to the brightness compensation parameter.

In an embodiment of the present invention, the display method of the stereoscopic display device includes: displaying a three-dimensional image through the display panel of the stereoscopic display device; disposing the lens array of the stereoscopic display device on the transmission path of the three-dimensional image; The processing circuit of the device adjusts the liquid crystal rotation angle of the lens array according to the actual position of the human eye, so that the viewing position of the three-dimensional image matches the actual position of the human eye; the processing circuit calculates the first vector according to the origin position of the lens array and the rotated position of the liquid crystal ; Calculate the second vector according to the origin position and the initial position of the liquid crystal by the processing circuit; calculate the adjusted liquid crystal angle of the lens array according to the first vector and the second vector by the processing circuit; calculate the brightness according to the liquid crystal angle by the processing circuit compensation parameters; and adjust the display brightness of the display panel according to the brightness compensation parameters through the processing circuit.

Based on the above, the three-dimensional display device and the display method thereof described in the various embodiments of the present invention can display three-dimensional images through the display panel, and adjust the liquid crystal rotation angle of the lens array according to the actual position of the human eye through the processing circuit, so that the display panel displays The viewing position of the 3D image matches the actual position of the human eye. The processing circuit can calculate the adjusted liquid crystal angle of the lens array according to the origin position of the lens array, the initial position of the liquid crystal, and the rotated position of the liquid crystal, calculate the brightness compensation parameter according to the liquid crystal angle, and then adjust the display brightness of the display panel according to the brightness compensation parameter . In this way, the rendering effect and display brightness of the stereoscopic image of the stereoscopic display device can be maintained, thereby optimizing user experience.

In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail together with the accompanying drawings.

The term "coupled (or connected)" used throughout the specification of this case (including the scope of claims) may refer to any direct or indirect means of connection. For example, if it is described in the text that a first device is coupled (or connected) to a second device, it should be interpreted that the first device can be directly connected to the second device, or the first device can be connected to the second device through other devices or certain A connection means indirectly connected to the second device. The terms "first" and "second" mentioned in the entire description of this case (including the scope of the patent application) are used to name elements (elements), or to distinguish different embodiments or ranges, and are not used to limit the number of elements The upper or lower limit of , nor is it used to limit the order of the elements. In addition, wherever possible, elements/components/steps using the same reference numerals in the drawings and embodiments represent the same or similar parts. Elements/components/steps using the same symbols or using the same terms in different embodiments can refer to related descriptions.

FIG. 1 is a schematic diagram of a circuit block of a stereoscopic display device 100 according to an embodiment of the present invention. In the embodiment shown in FIG. 1 , the stereoscopic display device 100 includes a display panel 110 , a lens array 120 and a processing circuit 130 . The display panel 110 is used for displaying the 3D image I1. The lens array 120 can be configured on the transmission path of the 3D image I1. In some embodiments, the lens array 120 can be directly contacted or attached to the display panel 110 to simplify the manufacturing process or optimize the optical effect, which is not limited in this embodiment. In this embodiment, the processing circuit 130 is coupled to the lens array 120 and the display panel 110, and is used to adjust the liquid crystal rotation angle of the lens array 120 according to the actual position X _E of the human eye, and compensate the display panel 110 according to the adjusted lens array 120. display brightness.

According to the actual application, the type of the display panel 110 may be a liquid crystal display (Liquid Crystal Display, LCD), a light emitting diode (Light Emitting Diode, LED) display, a field emission display (Field Emission Display, FED), an organic light emitting diode (Organic Light Emitting Diode, OLED), active-matrix organic light-emitting diode (Active-Matrix Organic Light-Emitting Diode, AMOLED) display, flexible display (Flexible Display), transparent light-emitting diode display (Transparent Light Emitted Diode Display ) or other display units that provide display functions.

According to design requirements, related functions of the processing circuit 130 can be implemented as hardware by using hardware description languages (such as Verilog HDL or VHDL) or other suitable programming languages. For example, the relevant functions of the processing circuit 130 may be implemented in one or more microcontrollers, microprocessors, application-specific integrated circuits (Application-specific integrated circuit, ASIC), digital signal processors (digital signal processor, DSP), Field Programmable Gate Array (Field Programmable Gate Array, FPGA) and/or various logic blocks, modules and circuits in other processing units. In terms of software and/or firmware, related functions of the processing circuit 130 may be implemented as programming codes. For example, it can be realized by using general programming languages (programming languages, such as C, C++ or assembly language) or other suitable programming languages. The programming code can be recorded/stored in "non-transitory computer readable medium", such as including read only memory (Read Only Memory, ROM), tape (tape), disk (disk), card (card), semiconductor memory, programmable logic circuit and/or storage device. A central processing unit (Central Processing Unit, CPU), microcontroller or microprocessor can read and execute the programming code from the non-transitory computer-readable medium, so as to achieve related functions.

FIG. 2 is a schematic flowchart of a display method of a stereoscopic display device according to an embodiment of the invention. For the stereoscopic display device 100 shown in FIG. 1 or the stereoscopic display device 400 shown in FIGS. 4A and 4B , reference may be made to the relevant description of FIG. 2 . Please refer to Figure 1 and Figure 2 at the same time. In step S210, the display panel 110 may display the 3D image I1. In step S220, the lens array 120 may be configured on the transmission path of the 3D image I1. In step S230 , the processing circuit 130 can adjust the liquid crystal rotation angle of the lens array according to the actual position X _E of the human eye, so that the viewing position (ideal position) of the 3D image I1 coincides with the actual position X _E of the human eye. In step S240, the processing circuit 130 may calculate a brightness compensation parameter according to the adjusted lens array 120, and compensate the display brightness of the display panel 110 according to the brightness compensation parameter (step S250). The implementation details of step S230 will be described in detail in subsequent embodiments.

Regarding the implementation details of step S240 in FIG. 2 . For example, FIG. 3 is a schematic diagram of a liquid crystal rotation situation of a lens array 120 according to an embodiment of the present invention. In the embodiment shown in FIG. 3 , it is assumed that on the pq two-dimensional plane where the lens array 120 is located, any liquid crystal has an origin coordinate S ₀ ( ) and the starting coordinates of the liquid crystal ) two endpoints. For example, taking the liquid crystal array 120 with a resolution of 1920*1080 pixels (pixels) as an example, the distance between the horizontal pixels is _0.17925 millimeters (mm). The coordinates are set to (0, 0), then the initial coordinates of the liquid crystal The two-dimensional coordinates of can be expressed as (0.17925, 0). For another example, assuming that the two-dimensional coordinates of the origin coordinate S ₀ are (0.17925, 0.17925), the initial coordinates of the liquid crystal The two-dimensional coordinates of can be expressed as (0.3585, 0.17925), and the coordinates of other liquid crystals can be deduced by analogy.

In this embodiment, it is assumed that in the xyz three-dimensional space where the stereoscopic display device is located, the origin coordinate S ₀ corresponds to the origin position L ₀ and its three-dimensional coordinates can be expressed as ( ), the starting coordinates of the liquid crystal Corresponding to the liquid crystal starting position L _S and its three-dimensional coordinates can be expressed as ( ). Suppose further that when the processing circuit adjusts the lens array 120 according to the actual position of the human eye, the initial position of the liquid crystal is It will switch to the position after the LCD is rotated And its three-dimensional coordinates can be expressed as ( ). Then the origin position L ₀ of the liquid crystal, the initial position of the liquid crystal and the position of the LCD after rotation liquid crystal angle , and the liquid crystal angle The size of will affect the light transmittance of the liquid crystal. For example, in some embodiments, when the liquid crystal angle When the angle is 180 degrees (in a horizontal state), the liquid crystal can be in an off state, which has the minimum transmittance, for example, the display brightness of the corresponding pixel of the display panel can be the lowest (nearly black). Or, in some embodiments, when the liquid crystal angle When the angle is 90 degrees (in a vertical state), the liquid crystal can be in a fully open state, which has a maximum transmittance. For example, the display brightness of the corresponding pixel of the display panel can be the highest, which is not limited in this embodiment.

In detail, in some embodiments, the processing circuit can use the space transformation matrix corresponding to the lens array 120 to transform the origin coordinate S ₀ of the lens array 120 into the origin position L ₀ , and use the space transformation matrix to transform the liquid crystal The starting coordinate S _S is converted into the liquid crystal starting position L _S . The space transformation matrix may be one or more fixed matrices preset before the stereoscopic display device leaves the factory, or may be calculated from the actual position of human eyes, which will be described in more detail in subsequent embodiments. In some embodiments, the processing circuit can use the rotation matrix corresponding to the lens array 120 to set the initial position of the liquid crystal to Converted to LCD position after rotation . For example, in some embodiments, the liquid crystal starting position Position after rotation with LCD The relationship can be expressed as follows:

Wherein R _F represents the rotation matrix corresponding to the lens array 120 , the rotation matrix R _F can be calculated from the actual position of the human eye, and will be described in more detail in subsequent embodiments. Then at the origin position L ₀ , the initial position of the liquid crystal and the position of the LCD after rotation On the premise that all are known, the processing circuit can base on the origin position L ₀ of the lens array 120 and the initial position of the liquid crystal and the position of the LCD after rotation to calculate the liquid crystal angle . For example, in some embodiments, the processing circuit can calculate the first vector according to the origin position L ₀ of the lens array 120 and the rotated position _LF of the liquid crystal , and calculate the second vector according to the origin position L ₀ and the liquid crystal initial position L _S , and then according to the first vector with the second vector Calculation of LCD Angle . For example, in some embodiments, the first vector with the second vector and LCD angle The relationship can be expressed as follows: ) )

Therefore, in this embodiment, the processing circuit can calculate the liquid crystal angle through the above relational formulas (1)-(8). , according to the liquid crystal angle to calculate brightness compensation parameters (step S240). For example, in some embodiments, the processing circuitry can see through the liquid crystal angle Calculate the display brightness required to be compensated by the display panel corresponding to the lens array 120 with linear equations, curve equations, and (or) other mathematical relations, and then use a graphics processing unit (Graphics Processing Unit, GPU) or scaling integrated circuit ( Scaler IC) to adjust the image parameters input to the display panel. For example, when the processing circuit judges that the angle between the liquid crystals of the lens array 120 When the actual display brightness of the corresponding pixel on the display panel is reduced, the image brightness in the image parameters input to the display panel can be increased, so that the actual brightness displayed by the corresponding pixel on the display panel is consistent with the expected brightness (or the contrast is consistent ). For example, in some embodiments, the liquid crystal angle The relationship with brightness compensation parameters can be expressed as follows:

Wherein Pb represents the original display brightness (expected brightness) of the display panel, and Fb represents the compensated brightness actually received by the display panel (image brightness). In this embodiment, the brightness compensation parameters include a compensation coefficient Rb and a fine-tuning parameter Tb, wherein the compensation coefficient Rb and the fine-tuning parameter Tb can be determined according to empirical rules, or according to actual design/application, and this embodiment is not limited thereto. For example, the liquid crystal angle shown in Table 1 below with compensation ratio ( ) as an example, assume that in some embodiments, when the liquid crystal angle When it is 90 degrees (the light transmittance is the highest at this time), the image brightness can be set equal to the original display brightness. When the LCD angle When it is 135 degrees (at this time, the light penetration rate is medium), the image brightness can be set to 1.5 times the original display brightness. When the LCD angle When it is 180 degrees (the light penetration rate is the lowest at this time), the image brightness can be set to be twice the original display brightness. Then in some embodiments, the compensation coefficient Rb can be solved by linear simultaneous equations to be 0.0111, and the fine-tuning parameter Tb is 0, so that the compensation ratio ( ) and LCD angle A linear relationship was presented as expected in Table 1. In this way, the processing circuit can compensate the display brightness of the display panel according to the brightness compensation parameter through the graphics processor or the scaling integrated circuit (step S250), so as to solve the brightness attenuation that may occur when the lens array 120 has different liquid crystal rotation angles. or uneven brightness, etc., the actual brightness and contrast of the display panel can also be adjusted to improve the user's viewing quality. Table 1: Specific examples of liquid crystal angle and compensation ratio LCD Angle Original display brightness Pb Compensation ratio ( ) 90 100% x1 135 50% x1.5 180 <1% x2

For the implementation details of step 230 in FIG. 2 , the calculation method of the space transformation matrix and the rotation matrix R _F corresponding to the lens array 120 , please refer to the following embodiments. For example, FIG. 4A is a schematic circuit block diagram of a stereoscopic display device 400 according to another embodiment of the present invention. FIG. 4B is a schematic diagram illustrating a usage scenario of the stereoscopic display device 400 shown in FIG. 4A according to an embodiment of the present invention. Please refer to FIG. 4A and FIG. 4B at the same time. In the embodiment shown in FIG. 4A and FIG. 4B , the stereoscopic display device 400 includes a display panel 110 , a lens array 120 and a processing circuit 130 . The implementation manners of the display panel 110 , the lens array 120 and the processing circuit 130 can be analogized with reference to the related descriptions of the display panel 110 , the lens array 120 and the processing circuit 130 shown in FIG. 1 , so details are not repeated here. The difference from the embodiment shown in FIG. 1 is that the stereoscopic display device 400 shown in FIG. 4A and FIG. 4B further includes an image sensor 140 coupled to the processing circuit 130 for capturing the viewing field FD of the display panel 110. Take the sensing image I2.

In detail, in the embodiment shown in FIG. 4B , the viewing field FD includes the default viewing position X _F and the user's actual human eye position X _E , wherein the actual human eye position X _E may be the same as or different from the default viewing position X _F. It is worth mentioning that, in this embodiment, each lens in the lens array 120 is injected with liquid crystals, wherein the rotation angle of the liquid crystals can be controlled to change the focusing characteristics of the lenses, thereby changing the refraction angle of light passing through the lenses. In this embodiment, assuming that the liquid crystal rotation angle of the lens array 120 is a preset initial angle, the viewing position (ideal position) of the 3D image I1 displayed on the display panel 110 is the default viewing position X in the viewing field FD _F. According to actual design, in some embodiments, the default viewing position X _F may be located on the normal vector of the center of the display panel 110 , but it is not limited thereto in other embodiments.

Then, in the aforementioned step S230 shown in FIG. 2 , the sensing image I2 can be captured from the viewing field FD of the display panel 110 by the image sensor 140 shown in FIG. 4A , and the sensing image I2 can be sent to the processing circuit. 130. The processing circuit 130 can identify the sensing image I2 to obtain the coordinates of the user's eyes in the sensing image I2. And the default viewing position X _F in the viewing field FD as shown in FIG. 4B corresponds to the reference position in the sensing image I2 . Herein, the present embodiment assumes that the reference position in the sensing image I2 includes the central position of the sensing image I2. However, in other embodiments, the reference position may be other positions in the sensing image I2. In this way, according to the reference coordinates of the reference position in the sensing image I2 and the coordinates of the user's eyes in the sensing image I2, the processing circuit 130 can calculate the actual position X _E of the user's eyes in the viewing field FD .

For example, FIG. 5 is a schematic diagram illustrating a sensing situation of the stereoscopic display device 400 shown in FIG. 4B according to an embodiment of the present invention. In the embodiment shown in FIG. 5 , it is assumed that in the xyz three-dimensional space of the viewing field FD, with the image sensor 140 as a reference, the sensing direction of the image sensor 140 toward the user is defined as the z-axis, and x axis, y-axis and z-axis are perpendicular to each other. The xyz three-dimensional coordinates of the default viewing position X _F in the viewing field FD can be expressed as (x _F , y _F , z _F ), the xyz three-dimensional coordinates of the user's actual human eye position X _E in the viewing field FD Can be expressed as (x _E , y _E , z _E ).

In this embodiment, the sensing image I2 captured by the image sensor 140 for the viewing field FD may correspond to the virtual imaging plane VP where the focal length of the image sensor 140 is located. The image sensor 140 senses the actual position X _E of the human eye in the viewing field FD to obtain the sensed image I2 . The imaging plane VP (sensing image I2) is a uv two-dimensional plane formed by the u axis and the v axis. The human eye position C _G in the imaging plane VP (sensing image I2) corresponds to the human eye’s actual position X _E in the viewing field FD, while the reference position C _S in the imaging plane VP (sensing image I2) Corresponds to the default viewing position _XF in the viewing field FD. On the imaging plane VP, with the coordinates of the origin of the imaging plane C ₀ (0, 0) as the reference, the coordinates of the reference position C _S are the reference coordinates (u _S , v _S ), and the coordinates of the human eye position C _G are the human eye Coordinates (u _G , v _G ). In the embodiment shown in FIG. 5 , the x-axis of the viewing field FD is parallel to the u-axis of the imaging plane VP, and the y-axis of the viewing field FD is parallel to the v-axis of the imaging plane VP. In this way, when the default viewing position X _F in the viewing _{field FD is a preset default viewing position or a known position, the processing circuit 130 can sense the reference coordinates (u S ,} v _S ) and the human eye coordinates (u _G , v _G ) of the human eye position C _G to calculate the user's actual human eye position X _E in the viewing field FD.

For example, FIG. 6 is a schematic yz plane diagram illustrating the sensing situation shown in FIG. 5 according to an embodiment of the present invention. Please refer to Figure 5 and Figure 6 at the same time. In the embodiment shown in FIG. 6 , it is assumed that the z-axis coordinate (the depth information from the display panel ₁₁₀ to the human eye) of the user (that is, the actual position X _E of the human eye) in the viewing field FD is equal to the default viewing position X _F The z-axis coordinate (the depth information from the display panel 110 to the default viewing position X _F ) z _F . In the embodiment shown in FIG. 6 , taking the image sensor 140 as a reference, the yz two-dimensional coordinates of the default viewing position X _F can be expressed as (y _F , z _F ), and the yz two-dimensional coordinates of the actual human eye position X _E It can be expressed as (0, z _F ), and the relative distance between the default viewing position X _F and the actual position X _E of the human eye on the y-axis is y _F . In this way, in this embodiment, the relationship between the reference coordinates (u _S , v _S ) of the reference position _CS and the human eye coordinates (u _G , v _G ) of the human eye position C _G in the imaging plane VP can be Expressed as follows: → eyeball

Among them, d represents the relative distance (y-axis variable) between the reference position _CS and the human eye position C _G on the v-axis in the imaging plane VP. fv represents the imaging distance between the display panel 110 (image sensor 140 ) and the imaging plane VP corresponding to the sensed image I2, that is, the relative distance between the image sensor 140 and the position C _G of the human eye on the z-axis (z axis variable). ∆x represents the relative distance between the actual position of the human eye X _E and the default viewing position X _F on the x-axis (x-axis variable), and ∆Eyeball represents the actual position of the human eye X _E and the default viewing position X _F on the xy two-dimensional plane the actual variance of . In some embodiments, the processing circuit 130 can calculate by sensing the reference coordinates (u _S , v _S ) of the reference position _CS in the image I2 and the human eye coordinates (u _G , v _G ) of the human eye position C _G distance d. In some embodiments, the processing circuit 130 can calculate the imaging distance fv through the focal length of the image sensor 140 . According to practical applications, in some embodiments, the stereoscopic display device 400 can optionally include a depth sensor (not shown), and the depth sensor can sense the user (human) in the viewing field FD from the display panel 110 The depth information z _F of the actual eye position X _E ). Thus, in _some embodiments, the processing circuit 130 can use the depth information z _F and the reference coordinates (u _S , v _S ) of the reference position CS to calculate the View the default viewing position X _F corresponding to the reference position _CS in the viewing field FD.

It is worth mentioning that, in the embodiment shown in FIG. 4A and FIG. 4B , the processing circuit 130 can change the refraction direction of the light by adjusting the liquid crystal rotation angle of the lens array 120, so that the viewing position of the three-dimensional image I1 can be viewed from the default The position X _F is moved to the actual position X _E of the human eye (or, as close as possible to the actual position X _E of the human eye). Taking the situation shown in FIG. 5 as an example, the movement of the light (image) is only the movement of the three-dimensional image I1 on the uv (or xy) two-dimensional plane for the user's eyes, but for the lens array 120 and the image For the sensor 140, it is a stereo transformation in the xyz three-dimensional space. Therefore, in some embodiments, the processing circuit 130 may preset or calculate a space transformation matrix for transforming uv two-dimensional coordinates into xyz three-dimensional coordinates. The processing circuit 130 can use the space transformation matrix to convert the human eye coordinates (u _G , v _G ) _of the human eye position C _G in the sensed image I2 into the coordinates (x _E , y _E , z _E ), and then adjust the liquid crystal rotation angle of the lens array 120 according to the coordinates (x _E , y _E , z _E ) of the actual position X _E of the human eye. In some embodiments, the space transformation matrix can also be applied to the liquid crystal coordinate transformation on the lens array 120 at the same time, that is, the origin coordinate S ₀ in the embodiment shown in FIG. 3 is transformed into the origin position L ₀ , and (or) Convert the liquid crystal start coordinate S _S to the liquid crystal start position L _S .

For example, in some embodiments, the space transformation matrix may be prepared before the stereoscopic display device (such as the stereoscopic display device 100 shown in FIG. 1, the stereoscopic display device 400 shown in FIG. 4A or 4B) leaves the factory. One or more fixed matrices preset. Or in some embodiments, the processing circuit 130 can also use the reference coordinates (u _S , v _S ) of the reference position _CS in the sensing image I2 and the default viewing position corresponding to the reference position _CS in the viewing field FD. The coordinates (x _F , y _F , z _F ) of the position X _F are used to dynamically calculate the space transformation matrix. For example, in some embodiments, the relationship between the reference position _CS and the default viewing position _XF can be expressed as follows:

Wherein, K _F represents the space transformation matrix between the reference position C _S on the two-dimensional plane and the default viewing position X _F in the three-dimensional space. In some embodiments, the reference position C _S may be a 2x1 matrix, the space transformation matrix K _F may be a 2x3 matrix, and the default viewing position X _F may be a 3x1 matrix. In some embodiments, the default viewing position X _F is an irreversible non-square matrix, so the processing circuit 130 can solve the space transformation matrix K _F through the least square method of the above relational expressions (13)-(16). Similarly, in some embodiments, the relationship between the position C _G of the human eye and the actual position X _E of the human eye can also be expressed as follows:

Among them, K _E represents the space transformation matrix between the position C _G of the human eye on the two-dimensional plane and the actual position X _E of the human eye in the three-dimensional space. In some embodiments, the position C _G of the human eye may be a 2x1 matrix, the space transformation matrix K _E may be a 2x3 matrix, and the actual coordinate X _E of the human eye may be a 3x1 matrix. In some embodiments, the space transformation matrix K _E can be equal to the space transformation matrix K _F . In this way, the processing circuit 130 can use the space transformation matrix K _F calculated by the above formula (16) to transform the human eye through the formula (17). The human eye coordinates (u _G , v _G ) of the position C _G are transformed into the coordinates (x _E , y _E , z _E ) of the actual position X _E of the human eye.

Furthermore, for the lens array 120 and the image sensor 140 , the movement of the viewing position of the 3D image I1 can be regarded as the coordinate transformation of the default viewing position X _F in the 3D space. Therefore, in some embodiments, the relationship between the default viewing position _XF and the actual human eye position _XE can be expressed as follows:

Where t represents a compensation vector between the lenses in the lens array 120 . R _F represents the rotation matrix of the default viewing position X _F when performing coordinate transformation in three-dimensional space. In some embodiments, the actual human eye position X _E may be a 3x1 matrix, the rotation matrix R _F may be a 3x3 matrix, the default viewing position X _F may be a 3x1 matrix, and the compensation vector t may be a 3x1 matrix. In this way, when the compensation vector t approaches 0, the processing circuit 130 can substitute the default viewing position X _F in the viewing field FD and the actual human eye position X _E calculated by the above formula (17) into the above formula (18 ) to calculate the rotation matrix R _F . Then, the processing circuit 130 can calculate the liquid crystal rotation angle of the lens array 120 according to the rotation matrix R _F . In some embodiments, the rotation matrix R _F can also be applied to the liquid crystal coordinate conversion on the lens array 120 at the same time, that is, the initial position L _S of the liquid crystal in the embodiment shown in FIG. 3 is converted to the rotated position L of the liquid crystal _F.

In other embodiments, the above formula (17) and formula (18) can also be combined into the following relational formula:

In some embodiments, assuming that the compensation vector t is close to 0, and the space transformation matrix K _E is equal to the space transformation matrix K _F , the above formula (19) can be expressed as . In other words, the processing circuit 130 can also be based on the human eye position C _G in the sensed image I2 sensed by the image sensor 140, the default viewing position X _F preset or calculated by the above formula (10), and the above formula ( 16) The calculated space transformation matrix K _F is used to calculate the rotation matrix R _F . In this way, as long as the image sensor 140 captures the position C _G of the human eye, the processing circuit 130 can directly calculate the rotation matrix R _F through the above formulas (19) and (20), and obtain the rotation matrix R F according to the rotation matrix R _F The liquid crystal rotation angle that the lens array 120 needs to rotate.

In detail, the coordinate transformation of a three-dimensional coordinate point (such as the default viewing position X _F ) in the xyz three-dimensional space can be decomposed into three-dimensional coordinate points that rotate the x-axis, y-axis, and z-axis respectively, and the rotation matrix R _F can be Expressed as follows:

Among them, R _x , R _y and R _z respectively represent the rotation matrix when the three-dimensional coordinate point rotates the x-axis, y-axis and z-axis independently, and the rotation angles are θ _x , θ _y and θ _z respectively. In other words, when the three-dimensional coordinate point rotates the x-axis alone, its coordinate transformation only affects the yz two-dimensional plane, that is, it can be regarded as the yz two-dimensional plane where the three-dimensional coordinate point is located rotates the x-axis. In the case that the three-dimensional coordinate point rotates the y-axis alone, its coordinate transformation only affects the xz two-dimensional plane, that is, it can be regarded as the xz two-dimensional plane where the three-dimensional coordinate point is located rotates the y-axis. In the case that the three-dimensional coordinate point rotates the z-axis alone, its coordinate transformation only affects the xy two-dimensional plane, that is, it can be regarded as the xy two-dimensional plane where the three-dimensional coordinate point is located rotates the z-axis.

Therefore, taking the embodiment of FIG. 5 as an example, in the xyz three-dimensional space, for the lens array 120 (or the image sensor 140), the viewing position of the three-dimensional image I1 is shifted from the default viewing position X _F to the actual position X of the human eye. The movement of _E can be regarded as rotating the z-axis on the xy two-dimensional plane where the default viewing position X _F is located. Then the rotation matrix R _F in the above formula (18)~(20) can be represented by the rotation matrix R _Z (θ _z ) in the above formula (24). In this way, after the processing circuit 130 calculates the rotation matrix R _F , it can calculate the rotation angle θ _z when the default viewing position X _F rotates the z-axis according to the rotation matrix R _Z (θ _z ). Furthermore, the processing circuit 130 adjusts the liquid crystal rotation angle in the lens array 120 to change the refraction direction of passing light, so that the viewing position of the 3D image I1 coincides with the actual position X _E of the human eye, so as to maintain the rendering effect of the 3D image.

FIG. 7 is a schematic diagram illustrating a partial optical path of the stereoscopic display device 100 shown in FIG. 1 or the stereoscopic display device 400 shown in FIGS. 4A and 4B according to an embodiment of the present invention. In the embodiment shown in FIG. 7 , the display panel 110 can present at least two sub-images for forming a three-dimensional image at the same time, and the lens array 120 can include a plurality of lenses arranged in order to respectively correspond to the plurality of sub-images, so that the multiple The sub-images are projected to the user's eyes respectively. The number, shape and arrangement of the lenses in the lens array 120 can be adjusted according to actual needs, and this embodiment is not limited thereto. For example, in this embodiment, the 3D image displayed on the display panel 110 may include a left parallax image IM1 and a right parallax image IM2, and the lens array 120 may include a lens array 122 respectively corresponding to the user's left eye X _EyeL and right eye X _EyeR and the lens array 121 to transmit the left parallax image IM1 and the right parallax image IM2 to the user's left eye X _EyeL and right eye X _EyeR respectively, so as to present a stereoscopic effect through the parallax. Corresponding to the user's actual human eye position X _E (left eye X _EyeL and right eye X _EyeR ), the liquid crystal rotation angles of the lens arrays 121 and 122 must be calculated separately.

In detail, in this embodiment, the image sensor 140 can sense the user's left eye X _EyeL and (or) the right eye X _EyeR to generate a sensing image, and the imaging plane VP corresponding to the sensing image can be It includes left eye coordinates _{Eye L} and (or) right eye coordinates Eye _R corresponding to the user's left eye X _EyeL and (or) right eye X _EyeR . Then in some embodiments, assuming that the actual position of the right eye X _EyeR is used as a reference, the above formula (18) can be rewritten as follows:

In this embodiment, the compensation vector t may be related to the horizontal resolution of the display panel 110 . For example, taking the display panel 110 with a resolution of 1920*1080 pixels as an example, the compensation vector t can be 0.17925 millimeters between horizontal pixels, then in the xyz three-dimensional space, the compensation vector t can be expressed as a 3x1 matrix . R _EL and R _ER respectively represent the rotation matrices of the lens arrays 121 and 122 . In this embodiment, it is assumed that the lens array 121 and the lens array 122 are arranged in sequence along the x-axis horizontal direction, and the direction in which the display panel 110 displays images through the lens array 120 is the z-axis. The processing circuit 130 can calculate the rotation matrices corresponding to the lens arrays 121 and 122 based on the actual position X _E of the human eye (left eye X _EyeL or right eye X _EyeR ) and the compensation vector t through the above formulas (25) and (26). R _EL and R _ER . The processing circuit 130 can then calculate the rotation angle θ z in the rotation matrices R _EL and R _ER according to the rotation matrix R _Z (θ _z ) that independently rotates the z-axis in the _above formula (24), and then adjust the lens array 121 respectively The liquid crystal rotation angle of and the liquid crystal rotation angle of the lens array 122 .

FIG. 8 is a schematic diagram of a hardware architecture of a stereoscopic display device 800 according to another embodiment of the present invention. In the embodiment shown in FIG. 8 , a stereoscopic display device 800 includes a display panel 110 , a lens array 120 and a processing circuit 130 . In some embodiments, the stereoscopic display device 800 may further include an image sensor 140 . The implementation of the display panel 110, the lens array 120, and the image sensor 140 can be analogized with reference to the related descriptions of the display panel 110, the lens array 120, and the image sensor 140 shown in FIG. 4A and FIG. In some embodiments, the processing circuit 130 may include a memory 131 , a processor 132 , an analog-to-digital conversion circuit 133 , a timing controller 134 and (or) a scaling circuit 135 . The implementation of the processor 132 can be analogized with reference to the related description of the processing circuit 130 shown in FIG. 4A and FIG. 4B . In some embodiments, the stereoscopic display device 800 may further include a backlight module 150 . The implementations of the memory 131, the analog-to-digital conversion circuit 133, the timing controller 134, the scaling circuit 135 and the backlight module 150 can be constructed through an image display device well known to those skilled in the art, and this embodiment does not provide limit.

FIG. 9 is a partial structural diagram of a stereoscopic display device according to an embodiment of the invention. The display panel 110 and (or) the lens array 120 shown in FIG. 9 can be used as an implementation example of the display panel 110 and (or) the lens array 120 in the stereoscopic display device 100 shown in FIG. An implementation example of the display panel 110 and (or) the lens array 120 in the display device 400 may be used as an implementation example of the display panel 110 and (or) the lens array 120 in the stereoscopic display device 800 shown in FIG. 8 . In the embodiment shown in FIG. 9 , the display panel 110 may include a switching liquid crystal layer (SLC), a polarized coating (PC) and a plurality of display pixels (display pixels) DP, which are sequentially overlapped. The lens array 120 may include a glass substrate (glass substrate) GS1 , a liquid crystal layer (liquid crystal layer) LC, and a glass substrate GS2 that are sequentially stacked. The liquid crystal rotation angle of the liquid crystal layer LC in the lens array 120 can be adjusted to change the light transmission direction of the image displayed by the display pixels DP. The implementation of each element can be constructed through a stereoscopic display device known to those skilled in the art, and this embodiment is not limited thereto.

To sum up, the stereoscopic display devices 100, 400, 800 and their display methods described in the various embodiments of the present invention can display a three-dimensional image I1 through the display panel 110, and adjust it according to the actual position X _E of the human eye through the processing circuit 130. The liquid crystals of the lens array 120 are rotated so that the viewing position FD of the 3D image I1 displayed on the display panel 110 coincides with the actual position X _E of the human eye. In addition, the adjusted liquid crystal angle of the lens array 120 can also be calculated by the processing circuit 130 according to the origin position L ₀ of the lens array 120, the initial position L _S of the liquid crystal, and the rotated position L _F of the liquid crystal. , according to the liquid crystal angle The brightness compensation parameter is calculated, and then the display brightness of the display panel 110 is adjusted according to the brightness compensation parameter. In this way, the rendering effect and display brightness of the stereoscopic images of the stereoscopic display devices 100 , 400 , 800 can be maintained, thereby optimizing user experience.

Although the present invention has been disclosed above with the embodiments, it is not intended to limit the present invention. Anyone with ordinary knowledge in the technical field may make some changes and modifications without departing from the spirit and scope of the present invention. The scope of protection of the present invention should be defined by the scope of the appended patent application.

100, 400, 800: stereoscopic display device 110: display panel 120, 121, 122: lens array 130: processing circuit 131: memory 132: processor 133: analog-to-digital conversion circuit 134: timing controller 135: scaling circuit 140: Image sensor 150: backlight module , : vector C ₀ : origin coordinates of imaging plane C _G : human eye position C _S : reference position d: distance DP: display pixel Eye _L : left eye coordinate Eye _R : right eye coordinate FD: viewing field fv: imaging distance GS1 , GS2: glass substrate I1: three-dimensional image I2: sensing image IM1: left parallax image IM2: right parallax image LC: liquid crystal layer L ₀ : origin position L _F : liquid crystal rotated position L _S : liquid crystal initial position p ₀ , p _S , q ₀ , q _S , u _G , u _S , v _G , v _S , x _E , x _F , x _L0 , x _LF , x _LS , y _E , y _F , y _L0 , y _LF , y _LS , z _E , z _F , z _L0 , z _LF , z _LS : Coordinate PC: Polarizing coating S ₀ : Origin coordinate S _S : Liquid crystal start coordinates S210~S250: Step SLC: Switch liquid crystal layer t: Compensation vector u , v, x, y, z: coordinate axis VC: voltage VP: imaging plane X _E : actual position of human eye X _EyeL : left eye X _EyeR : right eye X _F : default viewing position : LCD Angle

FIG. 1 is a schematic diagram of a circuit block of a stereoscopic display device according to an embodiment of the present invention. FIG. 2 is a flowchart of a display method of a stereoscopic display device according to an embodiment of the invention. FIG. 3 is a schematic diagram of a liquid crystal rotation situation of a lens array according to an embodiment of the present invention. FIG. 4A is a schematic circuit block diagram of a stereoscopic display device according to another embodiment of the present invention. FIG. 4B is a schematic diagram illustrating a usage scenario of the stereoscopic display device shown in FIG. 4A according to an embodiment of the present invention. FIG. 5 is a schematic diagram illustrating a sensing situation of the stereoscopic display device shown in FIG. 4B according to an embodiment of the present invention. FIG. 6 is a schematic y-z plane diagram illustrating the sensing situation shown in FIG. 5 according to an embodiment of the present invention. FIG. 7 is a schematic diagram illustrating a partial optical path of the stereoscopic display device shown in FIG. 1 or the stereoscopic display device shown in FIGS. 4A and 4B according to an embodiment of the present invention. FIG. 8 is a schematic diagram of a hardware architecture of a stereoscopic display device according to another embodiment of the present invention. FIG. 9 is a partial structural diagram of a stereoscopic display device according to an embodiment of the invention.

100: Stereoscopic display device

110: display panel

120: lens array

130: processing circuit

I1: 3D image

X _E : the actual position of the human eye

Claims (11)

A stereoscopic display device, comprising: A display panel for displaying a three-dimensional image; a lens array disposed on a transmission path of the 3D image; and a processing circuit, coupled to the lens array and the display panel, wherein the processing circuit adjusts a liquid crystal rotation angle of the lens array according to an actual position of a human eye so that a viewing position of the three-dimensional image coincides with the actual position of the human eye, and The processing circuit calculates a first vector according to an origin position of the lens array and a liquid crystal rotated position, calculates a second vector according to the origin position and a liquid crystal initial position, and calculates a second vector according to the first vector and the second A liquid crystal angle of the adjusted lens array is vector calculated, a brightness compensation parameter is calculated according to the liquid crystal angle, and a display brightness of the display panel is compensated according to the brightness compensation parameter. The stereoscopic display device according to claim 1, wherein the processing circuit uses a rotation matrix corresponding to the lens array to convert the initial position of the liquid crystal into the rotated position of the liquid crystal. The stereoscopic display device according to claim 1, wherein the processing circuit uses a space transformation matrix corresponding to the lens array to transform an origin coordinate of the lens array into the origin position, and uses the space transformation matrix to convert a The liquid crystal start coordinates are converted to the liquid crystal start position. The stereoscopic display device as described in claim 1, further comprising: an image sensor, coupled to the processing circuit, the image sensor is used to capture a sensing image of a viewing field of the display panel, The processing circuit calculates the actual position of the human eye of the user in the viewing field according to a reference coordinate of a reference position in the sensing image and a human eye coordinate of a user in the sensing image. The stereoscopic display device as claimed in claim 4, wherein the processing circuit calculates a space transformation matrix according to the reference coordinates and a default viewing position corresponding to the reference coordinates in the viewing field. The stereoscopic display device as claimed in claim 4, wherein the processing circuit uses a space transformation matrix to convert the coordinates of the human eyes into the actual positions of the human eyes. The stereoscopic display device as described in claim 4, wherein the processing circuit calculates a rotation matrix according to a default viewing position corresponding to the reference coordinate in the viewing field and the actual position of the human eye, and calculates the rotation matrix according to the rotation matrix LCD rotation angle. The stereoscopic display device as described in claim 4, further comprising: a depth sensor for sensing a depth information from the display panel to the user in the viewing field, wherein the processing circuit uses the depth information and the reference coordinates to calculate the viewing field A default viewing position corresponding to the reference coordinate. The stereoscopic display device as described in Claim 1, wherein the lens array includes a first lens array and a second lens array respectively corresponding to a left eye and a right eye of the user, and the processing circuit is based on the actual The position and a compensation vector adjust the liquid crystal rotation angle of the first lens array and the liquid crystal rotation angle of the second lens array, wherein the compensation vector is related to a horizontal resolution of the display panel. A display method for a stereoscopic display device, comprising: displaying a three-dimensional image through a display panel of the stereoscopic display device; disposing a lens array of the stereoscopic display device on a transmission path of the three-dimensional image; adjusting a liquid crystal rotation angle of the lens array according to the actual position of the human eye by a processing circuit of the stereoscopic display device, so that a viewing position of the three-dimensional image coincides with the actual position of the human eye; calculating a first vector according to an origin position of the lens array and a liquid crystal rotated position by the processing circuit; calculating a second vector according to the origin position and a liquid crystal initial position by the processing circuit; calculating an adjusted liquid crystal angle of the lens array according to the first vector and the second vector by the processing circuit; calculating a brightness compensation parameter according to the liquid crystal angle by the processing circuit; and A display brightness of the display panel is adjusted by the processing circuit according to the brightness compensation parameter. The display method as described in claim 10, wherein the lens array includes a first lens array and a second lens array respectively corresponding to a left eye and a right eye of the user, and the display method further includes: The liquid crystal rotation angle of the first lens array and the liquid crystal rotation angle of the second lens array are adjusted by the processing circuit according to the actual position of the human eye and a compensation vector, wherein the compensation vector is related to a level of the display panel resolution.

Images