CN115695764A

CN115695764A - Display apparatus and method, computer-readable storage medium, and computer device

Info

Publication number: CN115695764A
Application number: CN202110823314.1A
Authority: CN
Inventors: 洪涛
Original assignee: BOE Technology Group Co Ltd
Current assignee: BOE Technology Group Co Ltd
Priority date: 2021-07-21
Filing date: 2021-07-21
Publication date: 2023-02-03

Abstract

The invention discloses a display device and a method, a computer readable storage medium and computer equipment, wherein the display device of one embodiment comprises: the image collector outputs the user position to the control unit according to the user image collected in real time; the variable-focus lens array is arranged on the light emitting side of the second display panel, is far away from a user relative to the first display panel, and the focal length of each lens is variable; a control unit configured to acquire display parameters according to a user position, the display parameters including: the focal length parameters are output to the variable focal length lens array to control the focal length of each lens, and the image parameters are output to the image rendering unit and used for enabling the first display panel to display the first display image and enabling the second display panel to display the second display image, so that the display device presents a three-dimensional image. According to the display device provided by the embodiment of the invention, the first display panel, the variable focus lens array and the second display panel are arranged, so that the depth of field range and the viewing angle of three-dimensional image display are increased.

Description

Display apparatus and method, computer-readable storage medium, and computer device

Technical Field

The present invention relates to the field of display technologies, and in particular, to a display device and method, a computer-readable storage medium, and a computer apparatus.

Background

The depth fusion 3D display is to laminate two or more display elements, as shown in fig. 1, display images 1 and 2 on the display elements 1 and 2, respectively, the display images 1 and 2 are foreground and background images displayed with different brightness, a depth effect is exhibited due to the difference of the depth of the entity, and the display images on the two display elements are depth fused by human eyes to form a depth fusion display image.

Because the depth fusion type does not simulate the parallax of two eyes to generate three-dimensional effect, but the picture really has the difference between the foreground and the background, the focus of the sight lines of the two eyes of a viewer can naturally fall on the picture position and feel the depth of field, and the eyes are not easy to feel fatigue when the viewer watches the picture. However, since the angle shift when the foreground and background are overlapped cannot be too large, the viewing angle suitable for viewing the depth fusion 3D display is limited, and as shown in fig. 1, the observer 1 can observe the correct depth fusion display image, but the observer 2 cannot simultaneously observe the correct depth fusion display image at a position away from the observer 1. Meanwhile, a depth fusion display image formed by depth fusion 3D display is positioned between the No. 1 display element and the No. 2 display element, the depth range of the depth fusion display image is determined by the distance between the first display element and the second display element, and therefore the depth range of the depth fusion 3D display image is limited.

Disclosure of Invention

In order to solve at least one of the above problems, a first embodiment of the present invention provides a display device including an image collector, a control unit, an image rendering unit, and a first display panel, a variable focus lens array, and a second display panel which are stacked, in which:

the image collector is used for collecting user images of users watching the display device in real time and outputting the user positions to the control unit according to the user images;

the variable focus lens array is arranged on the light emitting side of the second display panel and is far away from a user relative to the first display panel, the variable focus lens array comprises a plurality of lenses, and the focal length of each lens is variable;

a control unit configured to acquire display parameters according to a user position, the display parameters including:

the focal length parameters output to the array of variable focusing lenses to control the focal length of each lens,

and the image parameters are output to the image rendering unit and used for controlling the image rendering unit to respectively output the first display parameters to the first display panel to display the first display image and output the second display parameters to the second display panel to display the second display image, so that the display device presents a three-dimensional image.

In some alternative embodiments, the focal length of each lens of the variable focus lens array satisfies:

the system comprises a variable-focus lens array, a first display panel, a second display panel, a plurality of lenses, a plurality of lens groups and a plurality of optical elements, wherein theta is an included angle between a central connecting line of human eyes and the first display panel and an image central connecting line of the human eyes and the second display panel, L is a distance between the human eyes and the first display panel, g is a distance between the variable-focus lens array and the second display panel, f is a focal length of each lens of the variable-focus lens array, d1 is a distance between the first display panel and the second display panel, and e is a interpupillary distance of the human eyes;

the first display image is a foreground image of the three-dimensional image;

the second display image is a background image of the three-dimensional image.

In some alternative embodiments, the variable focus lens array is:

the variable-focus cylindrical lens array comprises a variable-focus cylindrical lens array, wherein each lens is a variable-focus cylindrical lens;

or alternatively

An array of variable focus microlenses, each lens being a variable focus microlens.

In some alternative embodiments, the display parameters further include a display range obtained by the control unit according to the distance of the variable focus lens array from the second display panel,

a control unit configured to determine whether the user position is within a display range, and if so, control:

the focal length of each lens of the variable-focus lens array is the distance between the variable-focus lens array and the second display panel;

the first display image is a transparent image;

the second display image is a two-dimensional image of the three-dimensional image.

In some alternative embodiments, the display range may satisfy:

f＝g

and, a _y ≤e，(M-1)b _y ≥e，c _y ≤e

Wherein f is a focal length of each lens of the variable-focus lens array, g is a distance from the variable-focus lens to the second display panel, lb is a distance from an optimal viewing position to the display device, e is a interpupillary distance of human eyes, t is a distance from the optimal viewing position to the display device, and _y is the length of the sub-pixels of the second display panel in the transverse direction, M is the number of sub-pixels covered by each lens, a _y Viewing zone width, L, for optimal viewing distance Lb ₁ Distance between the closest viewing position and the best viewing position, L ₂ Is the distance between the farthest viewing position and the best viewing position, w _y Is the length of the second display panel in the lateral direction, b _y Distance of two adjacent viewing zones for closest viewing position, c _y The distance of two adjacent viewing zones being the farthest viewing distance.

In some alternative embodiments, the array of variable focus lenses is an array of variable focus cylindrical lenses, each lens being a variable focus cylindrical lens.

In some alternative embodiments, the second display panel includes pixels arranged in an array, each pixel including a plurality of sub-pixels;

each lens of the variable focus lens array covers at least two sub-pixels of the second display panel.

A second aspect of the present invention provides a display method using the display device described above, comprising:

the control unit controls the image collector to collect user images of users watching the display device in real time and outputs the user positions to the control unit according to the user images;

the control unit acquires display parameters according to the position of a user, wherein the display parameters comprise a focal length parameter and an image parameter;

the control unit controls the focal length of each lens of the variable-focus lens array according to the focal length parameters;

the control unit controls the image rendering unit to output a first display parameter to the first display panel to display a first display image and output a second display parameter to the second display panel to display a second display image according to the image parameter, so that the display device presents a three-dimensional image.

In some of the alternative embodiments, the first and second,

the control unit controlling the focal length of each lens of the variable focus lens array according to the focal length parameter further comprises:

the focal length of each lens of the variable focus lens array satisfies:

wherein θ is an included angle between a connecting line of centers of the human eyes and the first display panel and a connecting line of image centers of the human eyes and the second display panel, L is a distance between the human eyes and the first display panel, g is a distance between the variable-focus lens array and the second display panel, f is a focal length of each lens of the variable-focus lens array, d1 is a distance between the first display panel and the second display panel, and e is a interpupillary distance of the human eyes;

the control unit controls the image rendering unit to output a first display parameter to the first display panel to display a first display image and output a second display parameter to the second display panel to display a second display image according to the image parameter, so that the display device presents a three-dimensional image further comprises: and controlling the first display image to be a foreground image of the three-dimensional image, and controlling the second display image to be a background image of the three-dimensional image.

In some optional embodiments, the display parameters further include a display range obtained by the control unit according to a distance between the variable focus lens array and the second display panel, and the display method further includes: the control unit judges whether the user position is in the display range, if so:

the control unit controlling the focal length of each lens of the variable focus lens array according to the focal length parameter further comprises: controlling the focal length of each lens of the variable-focus lens array to be the distance between the variable-focus lens array and the second display panel;

the control unit controls the image rendering unit to output a first display parameter to the first display panel to display a first display image and output a second display parameter to the second display panel to display a second display image according to the image parameter, so that the display device presents a three-dimensional image further comprises: and controlling the first display image to be a transparent image and controlling the second display image to be a two-dimensional image of a three-dimensional image.

A third aspect of the invention provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs a method as described above.

A fourth aspect of the invention provides a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the method as described above when executing the program.

The invention has the following beneficial effects:

aiming at the existing problems, the invention sets a display device and method, a computer readable storage medium and computer equipment, the first display panel, the variable-focus lens array and the second display panel are arranged in a laminated manner, the focal length of each lens in the variable-focus lens array is controlled according to the position of a user, and the display device presents three-dimensional images by respectively displaying images on the first display panel and the display panel, so that depth fusion 3D display with variable depth of field is realized, and the depth of field range is effectively increased; and the variable-focus lens array can form viewpoints in multiple directions, so that the visual angle can be enlarged, the advantage that visual fatigue is not easy to generate due to depth fusion is achieved, the advantages of large visual angle and large depth of field are achieved, and the application prospect is wide.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 shows an imaging principle diagram of a depth-fused 3D display according to the prior art.

Fig. 2 illustrates a schematic structural diagram of a display device according to an embodiment of the present invention.

Fig. 3 illustrates a schematic diagram of conditions required for 3D display of a display device according to an embodiment of the present invention.

Fig. 4 illustrates a schematic diagram of a display mode of a display apparatus according to another embodiment of the present invention.

Fig. 5 illustrates a view zone diagram of the display apparatus of the embodiment shown in fig. 4 in a multi-view 3D display mode.

Fig. 6 illustrates a schematic flowchart of a display method of a display apparatus according to an embodiment of the present invention.

Fig. 7 is a schematic structural diagram of a computer device according to another embodiment of the present invention.

Detailed Description

In order to more clearly illustrate the invention, the invention is further described below with reference to preferred embodiments and the accompanying drawings. Similar components in the figures are denoted by the same reference numerals. It is to be understood by persons skilled in the art that the following detailed description is illustrative and not restrictive, and is not to be taken as limiting the scope of the invention.

It is noted that, in the description of the present application, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising one of 8230; \8230;" 8230; "does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.

In order to solve at least one of the above problems, an embodiment of the present invention provides a display device including an image collector, a control unit, an image rendering unit, and a first display panel, a variable focus lens array, and a second display panel which are stacked, wherein:

the variable-focus lens array is arranged on the light emitting side of the second display panel and is far away from a user relative to the first display panel, the variable-focus lens array comprises a plurality of lenses, and the focal length of each lens is variable;

the focal length parameters output to the variable focal length lens array to control the focal length of each lens,

and the image parameters output to the image rendering unit are used for controlling the image rendering unit to respectively output the first display parameters to the first display panel to display the first display image and output the second display parameters to the second display panel to display the second display image, so that the display device presents a three-dimensional image.

In the embodiment, the display device presents a three-dimensional image by controlling the focal length of each lens in the variable-focus lens array according to the user position through the first display panel, the variable-focus lens array and the second display panel which are arranged in a stacked manner, and respectively displaying images on the first display panel and the second display panel, so that depth fusion 3D display with variable depth of field is realized, and the depth of field range is effectively increased; and the variable-focus lens array can form viewpoints in multiple directions, so that the visual angle can be enlarged, the advantage that visual fatigue is not easy to generate due to depth fusion is achieved, the advantages of large visual angle and large depth of field are achieved, and the application prospect is wide.

In a specific example, as shown in fig. 2, the display device includes an image collector 101, a control unit 103, an image rendering unit 105, and a first display panel 107-1, a variable focus lens array 109, and a second display panel 107-2 which are stacked.

The variable focus lens array 109 is disposed between the first display device 107-1 and the second display device 107-2, the variable focus lens array 109 is disposed on the light exit side of the second display panel 107-2, the first display panel 107-1 is close to a user viewing the display device with respect to the variable focus lens array 109, and correspondingly, the second display panel 107-2 is far from the user viewing the display device with respect to the variable focus lens array 109, in other words, the variable focus lens array 109 is far from the user with respect to the first display panel 107-1. In an embodiment of the invention, the variable focus lens array 109 comprises a plurality of lenses, each lens having a variable focal length.

The image collector 101 may be a depth camera, and may be disposed at the first display panel 107-1. The image collector 101 is configured to collect a user image of a user viewing the display device in real time and output a user position to the control unit 103 according to the user image. The user position may comprise, for example, the distance of the user from the first display panel 107-1 of the display device.

The control unit 103 is configured to acquire display parameters according to the user position received from the image acquirer 101. The display parameters include: the focal length parameter output to the variable focusing lens array 109 to control the focal length of each lens, and the image parameter output to the image rendering unit 105.

The focal length parameter may be focal lengths of lenses which are stored in the display device in advance and correspond to specific values of the user positions one by one, or may be focal lengths of lenses which are stored in the display device in advance and correspond to a distance range where the user position is located, the distance range may be reasonably selected according to actual tolerance errors during design, and the focal length parameter may be stored in a storage of the display device in a manner of a search table together with the corresponding user position.

The image parameters output to the image rendering unit 105 are used to control the image rendering unit 105 to output the first display parameters to the first display panel 107-1 to display the first display image and output the second display parameters to the second display panel 107-2 to display the second display image, respectively, so that the display device presents a three-dimensional image.

Through the arrangement, two display elements for image display, namely the first display panel and the second display panel, are arranged in the display device, the variable focal length lens array with the variable focal length is arranged between the two display elements, the image collector is arranged to obtain the position of a user watching the display device, the control unit is enabled to obtain the focal length parameters of the corresponding variable focal length lens array based on the position of the user and output the focal length parameters to the image rendering unit to control the display parameters displayed by the display elements, the focal length of each lens can be controlled according to the position of the user, and the images of the second display panel are not limited on the second display panel by utilizing the matching of the variable focal length lens array and the second display panel, so that the depth of field of 3D depth fusion 3D display can be adjusted, and the depth of field range can be increased. In addition, by utilizing the matching of the variable focus lens array, the visual angle can be increased by combining the visual point increasing effect of realizing multi-visual point display.

The following describes in detail the implementation principle of the specific depth of field increase and the visual angle increase of the above functions with reference to the drawings.

On the one hand, with reference to fig. 2, the specific position of the image a formed by the second display panel 107-2 in the display device according to the embodiment of the present invention is not only related to the distance between the variable focal length lens array 109 and the second display panel 107-2, but also related to the focal length of each lens in the variable focal length lens array 109. Therefore, in the embodiment of the present invention, the image distance of the second display panel 107-2 is the distance d from the variable focus lens array 109 to the image a formed by the second display panel 107-2, and satisfies:

where g is the distance from the variable focus lens array 109 to the second display panel 107-2 and f is the focal length of each lens of the variable focus lens array. It should be noted that, in this embodiment, the distance between the variable focus lens array 109 and the image a or the second display panel 107-2 is the distance between the optical center of the lens in the array and the image a or the second display panel 107-2.

In the embodiment of the invention, when the first display panel 107-1 displays the foreground image of the 3D image and the second display panel 107-2 displays the foreground image of the 3D image, that is, the first display panel 107-1 and the second display panel 107-2 both display normal two-dimensional images, the first display panel 107-1, the second display panel 107-2 and the variable-focus lens array 109 are used for depth fusion 3D display, and the depth-of-field range D of the display is ₂ Satisfies the following conditions:

d ₂ ＝d-g+d ₁ (2)

among them, referring to the expression (2), since the variable focus lens array 109 is introduced, the depth of field range d is larger than or equal to 0 since d-g is larger than or equal to 0, as compared with the case where only two display elements are present ₂ Is inevitably increased, the depth of field range d ₂ Can be optimizedThe image distance d of the second display panel 107-2 is increased by one.

Referring to fig. 3, in order to realize a depth fusion 3D display such that the human eye can perform proper fusion through the image displayed by the first display panel 107-1 and the image displayed by the second display panel 107-2 to generate a fusion 3D image between the image of the first display panel 107-1 (i.e., the image imaged on the first display panel 107-1) and the image a displayed by the second display panel 107-2, an angle θ between a line connecting the human eye and the center of the first display panel 107-1 and a line connecting the human eye and the center of the image a of the second display panel 107-2 needs to be less than or equal to 2 angular minutes, wherein 1 angular minute is 1/60 degrees, the resolution of the retina of the human eye is less than or equal to 2 angular minutes, and the angle θ satisfies:

wherein, L is the distance between the human eyes and the first display panel 107-1, and e is the interpupillary distance of the human eyes.

Substituting expressions (1) and (2) into expression (3), the focal length f of the variable focus lens array 109 needs to satisfy:

from the above analysis, in the embodiment of the present invention, the depth of field d is within the range ₂ Limited by the focal length f of each lens of the variable focus lens array 109, the depth of field range d2 can be adjusted by simply adjusting the value of the focal length f.

Specifically, a lookup table that can achieve depth-fusion 3D display including a correspondence relationship that satisfies an angle θ of 2 or less angular divisions, a focal length f of each lens of the variable focus lens array 109, and a distance L of the human eye from the first display panel 107-1 may be stored in advance in the display device in accordance with expression (4).

In this embodiment, the different included angles θ respectively correspond to a set of distance L and focal length f, and according to the lookup table, at least one included angle θ and a corresponding focal length f that satisfy the condition can be obtained according to the distance L from the human eye to the first display panel 107-1. In the present embodiment, the focal length f corresponding to the maximum included angle θ is selected in consideration of the fact that the larger the included angle θ is, the larger the achievable depth of field is.

It should be noted that, in the present application, how to select the included angle θ and the corresponding focal length f is not specifically limited, and it should be understood by those skilled in the art that, when the included angle θ is less than or equal to 2 angular minutes, the focal length f is obtained according to the lookup table under the condition that the distance L from the human eye to the first display panel 107-1 is determined, and then the depth fusion 3D display may be implemented.

Correspondingly, the control unit 103 outputs the image parameters corresponding to the depth fusion 3D display to the image rendering unit 105, and causes the image rendering unit 105 to output the first image parameters to the first display panel 107-1 to form a first display image and output the second image parameters to the second display panel 107-2 to form a second display image, where the first display image is a foreground image of the three-dimensional image presented during the depth fusion 3D display, and the second display image is a background image of the three-dimensional image.

It will be understood by those skilled in the art that the type of variable focus lens array is not necessarily limited thereto, and the variable focus lens array may be a variable focus microlens array in which each lens is a variable focus microlens, or a variable focus cylindrical lens array in which each lens in the array is a variable focus cylindrical lens.

In particular, the lens in the variable focus lens array may be one of a liquid crystal lens, a birefringent lens, a PB lens and a super surface lens.

The liquid crystal lens is a novel micro-lens which is manufactured by utilizing an electro-optic effect to change the spatial distribution of the refractive index of the lens and a microelectronic technology process, and the focal length of the liquid crystal lens is changed by changing the spatial distribution of the refractive index of the lens; the birefringent microlens can change the focal length of the compound lens by changing the polarization state of incident light through the compound lens in which a plurality of birefringent lenses are superposed and utilizing the equivalent refractive index change of the material of the birefringent microlens. The PB lens changes the focal length of the PB lens through changing loaded voltage or changes the focal length of the PB lens through changing the polarization state of incident light, in practical application, a plurality of PB lenses are superposed to form a PB compound lens, each PB lens forms different focal lengths according to the loaded voltage or the polarization state of the incident light, and the plurality of PB lenses are cooperatively adjusted to realize the variable focal length of the compound PB lens; the super-surface lens changes the focal length of incident light by changing the polarization state of the incident light, in practical application, a plurality of super-surface lenses are superposed to form a composite super-surface lens, each super-surface lens forms different focal lengths according to the polarization state of the incident light, and the plurality of super-surface lenses are cooperatively adjusted to realize the variable focal length of the composite super-surface lens.

Specifically, the variable focus microlens may be a two-dimensional array lens, each lens unit of the variable focus microlens may be two-dimensionally arranged, and parallax in a horizontal direction and a vertical direction may be provided, that is, parallax may be formed in both the vertical direction and the horizontal direction, but there is a problem that 3D resolution is easily reduced. The variable-focus cylindrical lens is a one-dimensional lens, and the lenses of the variable-focus cylindrical lens are arranged in the one-dimensional direction, only parallax in the horizontal direction is provided, and 3D display requirements can be met, so that a cylindrical lens array can be selected.

In view of that a 3D display can be formed by one-dimensional parallax, a lenticular lens array is preferably used.

On the other hand, for the function of increasing the visual angle, as shown in fig. 2, since the variable focus lens array is introduced in the depth fusion 3D display, under the dimming action of the lens, a plurality of visual regions are included, each lens corresponds to a plurality of sub-pixels of the second display panel, and the plurality of visual regions are formed by the lens. As shown in the figure, each lens corresponds to 4 sub-pixels of the second display panel, and 4 viewing zones are formed by the lenses, so that depth fusion 3D display can be achieved within a plurality of viewing zones formed by the first display panel 107-1, the second display panel 107-2 and the zoom lens array, and a user watching the display device can observe a depth fusion 3D display effect in a plurality of directions, thereby overcoming the defect of narrow viewing angle of the conventional depth fusion 3D display.

In some optional embodiments, in order to improve the viewing angle characteristics of the depth-blending 3D display, the second display panel includes pixels arranged in an array, each pixel includes a plurality of sub-pixels, and each lens of the variable focal length lens array covers at least two sub-pixels of the second display panel.

In this embodiment, at least two viewpoints are formed by covering at least two sub-pixels of the second display panel with each lens, so that the viewing angle characteristics of the depth fusion display are improved, in other words, the viewing angle characteristics of the depth fusion display can be effectively improved by multiple viewpoints.

In some alternative embodiments, the display parameters acquired by the control unit 105 further include a display range acquired by the control unit 105 according to the distance of the variable focus lens array 109 from the second display panel. In the embodiment of the present invention, the display range is a visible range in which multi-viewpoint 3D display can be realized, and the display range is denoted by reference numeral W1 in fig. 4.

In this embodiment, the control unit 103 is configured to determine whether the user position is located in the display range W1, and if so, control: the focal length f of each lens of the variable focal length lens array 109 is the distance between the variable focal length lens array and the second display panel 107-2, that is, the second display panel 107-2 is located on the focal plane of the variable focal length lens array 109; the first display image is a transparent image; the second display image is a two-dimensional image of the three-dimensional image.

It should be noted that, in this embodiment, the first image displayed on the first display panel is controlled to be a transparent image, so as to make the first display panel in a transparent state, so that the first display panel does not participate in the display. For example, when the first display panel is a liquid crystal display panel, the liquid crystal is made to be in a transparent state without applying refraction and reflection to light by adjusting the voltage applied to the liquid crystal display panel. Of course, the present application is not intended to be limited thereto, and other ways of making the first display panel assume the transparent state are also possible.

The variable focal length lens array 109 is a variable focal length cylindrical lens array, that is, each lens is a variable focal length cylindrical lens, the second display panel 107-2 is arranged on a focal plane of the variable focal length lens array 109, so that light emitted by the second display panel is converted into collimated light after passing through each lens, and a two-dimensional image displayed by the second display panel is presented as a three-dimensional image through the microlens array in combination with the transparent first display panel, thereby providing a multi-view 3D display mode with a better display effect in the display range W1 for a user viewing the display device.

Specifically, referring to fig. 5, in the multi-view 3D display mode, since the first display panel 107-1 displays a transparent image, the first display panel 107-1 is equivalent to having no influence on the multi-view 3D display, which is not shown in fig. 5. The display range W1 includes a best viewing position D1, a first viewing position D2, and a second viewing position D3, in which diamond-shaped areas surrounded by solid bold black lines in the drawing are each viewing zones 1 to 7.

When the left eye and the right eye of the human eye are respectively positioned in each visual area, the left eye and the right eye respectively observe images with different parallaxes due to the fact that the parallaxes of the images in different visual areas are different, and three-dimensional vision is formed. In the figure, lb is the optimum viewing distance at the optimum viewing position D1, L1 is the distance from the closest viewing position D2 to the optimum viewing position D1, L2 is the distance from the farthest viewing position D3 to the optimum viewing position D1, and w _y Which is the length of the second display panel 107-2 in the lateral direction, i.e., the display size of the second display panel in the lateral direction, in the multi-view 3D display mode, the second display panel is disposed on the focal plane of each cylindrical lens in the variable focal lens array, i.e., the focal length of each cylindrical lens in the variable focal lens array is the distance between the second display panel and the variable focal lens array, i.e., f = g.

In the display range W1, the maximum distance a between two adjacent visual zones in FIG. 5 _y The requirements are as follows:

wherein t is _y Is the dimension of the sub-pixel in the lateral direction.

The optimal viewing distance Lb satisfies:

wherein e is the interpupillary distance of the human eye, and M is the number of sub-pixels covered by each lens.

L ₁ And L ₂ The requirements are as follows:

in actual design, lb, L are determined once the positions of the variable focus lens array 109 and the second display panel 107-2 are determined ₁ And L ₂ Is determined.

Optionally, the control unit 103 determines according to the user position, and if the distance between the user and the second display panel 107-2 is greater than or equal to Lb-L ₁ And Lb + L or less ₂ The control unit 103 determines that the user position is within the display range W1, i.e., the sum of the distance L from the user to the first display panel 107-1 and the distance d1 from the user to the first display panel 107-1 and the second display panel 107-2, L + d1 being equal to or greater than Lb-L ₁ And Lb + L2 or less, the user position is within the display range W1, the control unit 103 outputs the focal length parameter of the variable focal lens array 109 to the image rendering unit 105 to set the focal length of each lens to be the distance g between the variable focal lens array 109 and the second display panel 107-2, and controls the image parameter output to the image rendering unit 105, where the image parameter is used to control the image rendering unit 105 to output the first display parameter to the first display panel 107-1 to display a transparent image and output the second display parameter to the second display panel 107-2 to display a two-dimensional image, respectively.

Further specifically, the display range W1 should also satisfy:

and is，a _y ≤e，(M-1)b _y ≥e，c _y ≤e

Wherein M is the number of sub-pixels covered by each lens, and M is 2,b or more for forming a parallax image to satisfy 3D display _y Distance of two adjacent viewing zones for closest viewing position, c _y The distance of two adjacent viewing zones being the furthest viewing position. When the above conditions are satisfied, it is ensured that the two eyes of the user are in different viewing zones within the display range W1, thereby realizing multi-viewpoint 3D display of the display device.

It can be further understood that, in this embodiment, the control unit 103 determines that the distance from the user to the second display panel 107-2 is less than Lb-L ₁ Or greater than Lb + L ₂ Then, it is determined that the user position is located in another display range W2, i.e., the sum of the distance L from the user to the first display panel 107-1 and the distance d1 from the user to the first display panel 107-1 and the second display panel 107-2, L + d1 being less than Lb-L ₁ Or greater than Lb + L2, the user position is in another display range W2. The control unit 103 presents a three-dimensional image in the depth-fusion 3D display mode in the above embodiment by controlling the display images of the first display panel 107-1 and the second display panel 107-2 and the focal lengths of the respective variable focus lenses of the variable focus lens array 109.

With the above arrangement, the display device can automatically switch the 3D display mode according to the position of the user viewing the display device by configuring the control manner of the control unit 103, thereby providing a composite 3D display device capable of having two display modes.

In correspondence with the display device, as shown in fig. 6, an embodiment of the present invention also provides a display method using the display device described in the above embodiment, including:

s1, a control unit controls an image collector to collect user images of a user watching a display device in real time and outputs the user position to the control unit according to the user images;

s2, the control unit acquires display parameters according to the position of a user, wherein the display parameters comprise a focal length parameter and an image parameter;

s3, the control unit controls the focal length of each lens of the variable-focus lens array according to the focal length parameters;

and S4, the control unit controls the image rendering unit to output the first display parameters to the first display panel to display the first display image and output the second display parameters to the second display panel to display the second display image according to the image parameters, so that the display device presents a three-dimensional image.

In the embodiment, the first display panel, the variable focal lens array and the second display panel are arranged in a stacked manner, the focal length of each lens in the variable focal lens array is controlled according to the position of a user, and the display device presents a three-dimensional image by respectively displaying images on the first display panel and the display panel, so that depth fusion 3D display with variable depth of field is realized, and the depth range is effectively increased; and the variable-focus lens array can form viewpoints in multiple directions, so that the visual angle can be enlarged, the advantage that visual fatigue is not easy to generate due to local depth fusion is achieved, and the advantages of large visual angle and deep depth are achieved, and the application prospect is wide.

Optionally, the controlling unit controlling the focal length of each lens of the variable focus lens array according to the focal length parameter further includes:

the focal length of each lens of the variable focus lens array satisfies:

wherein θ is an included angle between a connection line between the human eye and the center of the first display panel and a connection line between the human eye and the image center of the second display panel, L is a distance between the human eye and the first display panel, g is a distance between the variable-focus lens and the second display panel, f is a focal length of each lens of the variable-focus lens array, d1 is a distance between the first display panel and the second display panel, and e is a pupil distance of the human eye;

the control unit controls the image rendering unit to output a first display parameter to the first display panel to display a first display image and a second display parameter to the second display panel to display a second display image according to the image parameter, respectively, so that the display device presents a three-dimensional image further comprises: and controlling the first display image to be a foreground image of the three-dimensional image, and controlling the second display image to be a background image of the three-dimensional image.

In this embodiment, depth fusion 3D display is implemented by controlling display images of the first display panel and the second display panel and controlling the focal lengths of the variable focusing lenses of the variable focusing lens array according to the user position. Since the display method provided in the embodiments of the present application corresponds to the display devices provided in the above-mentioned several embodiments, the foregoing embodiments are also applicable to the display method using the display device provided in the present embodiment, and detailed description is omitted in the present embodiment.

Optionally, the display parameters further include a display range obtained by the control unit according to a distance between the variable focus lens array and the second display panel, and the display method further includes: the control unit judges whether the user position is in the display range, if so:

Here, it should also be noted that, in this embodiment, the first image displayed on the first display panel is controlled to be a transparent image, so as to make the first display panel in a transparent state, so that the first display panel does not participate in the display. For example, when the first display panel is a liquid crystal display panel, the liquid crystal is in a transparent state by adjusting the voltage applied to the liquid crystal display panel so that the liquid crystal does not refract or reflect light. Of course, the present application is not intended to be limited thereto, and other ways of making the first display panel assume the transparent state are possible.

In the present embodiment, when the user position is within the display range, multi-view 3D display is achieved by controlling the display images of the first display panel and the second display panel and controlling the focal lengths of the variable focusing lenses of the variable focusing lens array. Since the display method provided in the embodiments of the present application corresponds to the display devices provided in the above-mentioned several embodiments, the foregoing embodiments are also applicable to the display method using the display device provided in the present embodiment, and detailed description is omitted in the present embodiment.

Another embodiment of the present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements:

In practice, the computer-readable storage medium may take any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present embodiment, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

As shown in fig. 7, another embodiment of the present invention provides a schematic structural diagram of a computer device. The computer device 12 shown in fig. 7 is only an example and should not impose any limitation on the scope of use or functionality of embodiments of the invention.

As shown in FIG. 7, computer device 12 is in the form of a general purpose computing device. The components of computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.

Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, industry Standard Architecture (ISA) bus, micro-channel architecture (MAC) bus, enhanced ISA bus, video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

Computer device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer device 12 and includes both volatile and nonvolatile media, removable and non-removable media.

The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 30 and/or cache memory 32. The computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 7, and commonly referred to as a "hard drive"). Although not shown in FIG. 7, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.

A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of embodiments of the invention as described.

Computer device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with computer device 12, and/or with any devices (e.g., network card, modem, etc.) that enable computer device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, computer device 12 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet) via network adapter 20. As shown in FIG. 7, the network adapter 20 communicates with the other modules of the computer device 12 via the bus 18. It should be appreciated that although not shown in FIG. 7, other hardware and/or software modules may be used in conjunction with computer device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.

The processor unit 16 executes various functional applications and data processing by executing programs stored in the system memory 28, for example, to implement a display method using a display device provided by an embodiment of the present invention.

It should be understood that the above-mentioned embodiments of the present invention are only examples for clearly illustrating the present invention, and are not intended to limit the embodiments of the present invention, and it will be obvious to those skilled in the art that other variations or modifications may be made on the basis of the above description, and all embodiments may not be exhaustive, and all obvious variations or modifications may be included within the scope of the present invention.

Claims

1. A display device is characterized by comprising an image collector, a control unit, an image rendering unit, a first display panel, a variable focus lens array and a second display panel which are arranged in a stacked mode, wherein:

the image collector is used for collecting user images of users watching the display device in real time and outputting user positions to the control unit according to the user images;

the variable-focus lens array is arranged on the light emitting side of the second display panel and is far away from the user relative to the first display panel, the variable-focus lens array comprises a plurality of lenses, and the focal length of each lens is variable;

the control unit is configured to acquire display parameters according to the user position, wherein the display parameters comprise:

focal length parameters output to the array of variable focal length lenses to control the focal length of each lens,

and the image parameters output to the image rendering unit are used for controlling the image rendering unit to respectively output first display parameters to the first display panel to display a first display image and output second display parameters to the second display panel to display a second display image, so that the display device presents a three-dimensional image.

2. The display device according to claim 1,

the focal length of each lens of the variable focus lens array satisfies:

theta is less than or equal to 2 degrees

the first display image is a foreground image of the three-dimensional image;

the second display image is a background image of the three-dimensional image.

3. A display device as claimed in claim 2, wherein the array of variable focus lenses is:

the variable-focus cylindrical lens array comprises a variable-focus cylindrical lens array, a variable-focus cylindrical lens array and a variable-focus cylindrical lens array, wherein each lens is a variable-focus cylindrical lens;

or

4. The display device according to claim 1, wherein the display parameters further include a display range acquired by the control unit according to a distance of the variable focal lens array from the second display panel,

the control unit is configured to judge whether the user position is within the display range, and if so, control:

the first display image is a transparent image;

5. The display device according to claim 4, wherein the display range is required to satisfy:

f＝g

and, a _y ≤e，(M-1)b _y ≥e，c _y ≤e

Wherein f is a focal length of each lens of the variable-focus lens array, g is a distance from the variable-focus lens to the second display panel, lb is a distance from an optimal viewing position to the display device, e is a interpupillary distance of human eyes, t is a distance from the optimal viewing position to the display device, and _y is the length of the sub-pixel of the second display panel along the transverse direction, M is the number of sub-pixels covered by each lens, a _y Viewing zone width, L, for optimal viewing distance Lb ₁ Distance between the closest viewing position and the best viewing position, L ₂ Is the distance between the farthest viewing position and the best viewing position, w _y Is the length of the second display panel in the transverse direction, b _y Distance of two adjacent viewing zones for closest viewing position, c _y The distance of two adjacent viewing zones being the farthest viewing positions.

6. The display device of claim 5, wherein the array of variable focus lenses is an array of variable focus cylindrical lenses, each lens being a variable focus cylindrical lens.

7. The display device according to any one of claims 1 to 6, wherein the second display panel comprises pixels arranged in an array, each pixel comprising a plurality of sub-pixels;

8. A display method using the display device according to any one of claims 1 to 7, comprising:

the control unit controls the image collector to collect user images of users watching the display device in real time and outputs user positions to the control unit according to the user images;

the control unit acquires display parameters according to the user position, wherein the display parameters comprise focal length parameters and image parameters;

9. The display method according to claim 8,

the focal length of each lens of the variable focus lens array satisfies:

theta is less than or equal to 2 degrees

Wherein theta is an included angle between a connecting line of the human eye and the center of the first display panel and a connecting line of the human eye and the image center of the second display panel, L is a distance between the human eye and the first display panel, g is the distance from the variable-focus lens to the second display panel, f is the focal length of each lens of the variable-focus lens array, d1 is the distance between the first display panel and the second display panel, and e is the interpupillary distance of human eyes;

10. The display method according to claim 8, wherein the display parameters further include a display range acquired by the control unit according to a distance of the variable focal lens array from the second display panel, the display method further comprising: the control unit judges whether the user position is in the display range, if so:

the controlling unit controlling the focal length of each lens of the variable focus lens array according to the focal length parameter further includes: controlling the focal length of each lens of the variable-focus lens array to be the distance between the variable-focus lens array and the second display panel;

the control unit controls the image rendering unit to output a first display parameter to the first display panel to display a first display image and a second display parameter to the second display panel to display a second display image according to the image parameter, respectively, so that the display device presents a three-dimensional image further comprises: and controlling the first display image to be a transparent image, and controlling the second display image to be a two-dimensional image of the three-dimensional image.

11. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 8-10.

12. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 8-10 when executing the program.