CN116540418A

CN116540418A - Image generation device, display equipment and image generation method

Info

Publication number: CN116540418A
Application number: CN202210094890.1A
Authority: CN
Inventors: 常天海; 董天浩; 秦振韬
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2022-01-26
Filing date: 2022-01-26
Publication date: 2023-08-04
Also published as: CN115576116B; WO2023143505A1; CN115576116A

Abstract

The embodiment of the application discloses an image generation device, display equipment and an image generation method, which can be applied to the fields of optical table displays, HUDs, projectors, displays and the like, and are used for smoothly changing the 3D imaging position according to the human eye position and improving the imaging consistency. The image generating device provided by the embodiment of the application comprises: the first light source and the second light source are respectively used for emitting a beam of illumination light beam; a lens for converging the two illumination light beams respectively; an image modulator for modulating the two illumination light beams; wherein, the two modulated illumination light beams are respectively converged to different positions; and the driving device is used for moving the first light source and the second light source, and the illumination light beams emitted by the moved first light source and the moved second light source are converged to the binocular vision point of the first observer after movement.

Description

Image generation device, display equipment and image generation method

Technical Field

The embodiment of the application relates to the field of image generation, in particular to an image generation device, a display device and an image generation method.

Background

In three-dimensional (3D) display technology, images of left and right viewing angles are respectively projected into corresponding human eyes, so that images of two viewing angles are processed in the brain of a person to obtain a 3D image. In one implementation, the light sources at two positions are respectively used as the light sources of the left eye and the right eye, and the light beams emitted by the two light sources are respectively converged to the left eye and the right eye of an observer through the lens. And in the optical path where the light beam is projected to both eyes of the observer, the light beam is modulated by the image modulator so that the imaging light is incident to both eyes of the observer.

However, if the observer moves, the modulated light beam is converged to a position other than the eyes of the observer, and the observer cannot receive images corresponding to the eyes.

In one solution, a plurality of light sources are provided, and when an observer moves, two light sources corresponding to the positions of the eyes after the movement are determined, the two light sources corresponding to the positions of the eyes are extinguished, and the two light sources corresponding to the positions of the eyes are lit. The extinction and the brightening of the light source can cause abrupt change of brightness of light received by human eyes, and display effect is affected.

Disclosure of Invention

The embodiment of the application provides an image generation device, a display device and an image generation method. The device, the equipment and the method are used for smoothly changing the 3D imaging position according to the eye position, so that the imaging consistency is improved.

In a first aspect, an embodiment of the present application provides an image generating apparatus. The image generation device includes: the image modulator comprises a first light source, a second light source, a lens, an image modulator and a driving device. The first light source and the second light source are respectively used for emitting an illumination beam. The lens is used for converging the two illumination light beams respectively. The image modulator is used for modulating the two illumination light beams, and the two modulated illumination light beams are respectively converged to different positions. The driving device is used for moving the first light source and the second light source, and illumination light beams emitted by the moved first light source and the moved second light source are respectively converged to the left eye of the first observer and the right eye of the first observer.

In the embodiment of the present application, a position to which imaging light (modulated illumination light beam) is condensed is referred to as a 3D imaging position. According to the embodiment of the application, the first light source and the second light source can be smoothly moved through the driving device, so that the 3D imaging position moves along with the positions of the eyes of an observer. Compared with the jump of the 3D imaging position in the method of starting the new position light source by extinguishing the original position light source, the image generating device provided by the embodiment of the application can realize the smooth movement of the position of the 3D imaging, and the brightness of the 3D imaging is constant, does not suddenly change and has high imaging consistency. In the present embodiment, imaging consistency refers to consistency between the 3D imaging position and the actual human eye position.

In an alternative implementation, the driving means is for moving the first light source and the second light source along a predetermined trajectory. Since the predetermined trajectory is one continuous trajectory, the first light source and the second light source can be moved to arbitrary positions on the predetermined trajectory. That is, for any two eye positions of the first observer, the corresponding light source positions can be found on the predetermined track, and then the first light source and the second light source are moved to the light source positions by the driving device, so that the imaging effect is good in the final presentation compared with the opening and closing of the light source at the fixed position.

In an alternative embodiment, the drive means may be an electric motor.

In an alternative implementation, the image generation device further comprises a track. A predetermined trajectory is on the track. The first light source and the second light source move along a predetermined trajectory on the track. According to the embodiment of the application, the moving route of the first light source and the second light source is limited through the track, so that the first light source and the second light source can only move in a one-dimensional space, a two-dimensional space or a space with higher dimension of a preset track on the track.

If the predetermined track is a track in a one-dimensional space, the motor control difficulty is reduced by limiting the movement direction (compared with the movement in a space with two dimensions or higher, the one-dimensional control difficulty is low), the driving device does not need to have multi-dimensional control capability, and the structure of the driving device and the control dimension quantity requirement of the driving device are simplified.

If the predetermined trajectory is a trajectory in a two-dimensional space or a higher-dimensional space, the light source position may be moved in more dimensions matching the movement of the binocular position compared to a trajectory in a lower-dimensional (e.g., one-dimensional) space. For example, if the trajectory is a trajectory in the x-axis of a one-dimensional space, matching of the 3D imaging position with the position of both eyes can be achieved by moving the light source on a predetermined trajectory when both eyes are moved in a direction parallel or close to the x-axis direction. But in other dimensions (e.g. in the y-axis or z-axis direction perpendicular to the one-dimensional trajectory direction) the light source cannot be moved along the predetermined trajectory, matching of the 3D imaging position with the binocular position is not possible in these dimensions. If the predetermined trajectory is a two-dimensional trajectory (e.g., a plane in which the x-axis and the y-axis lie), matching of the 3D imaging position to the binocular position can be done in two dimensions. The higher dimension and so on, are not described in detail herein.

In an alternative implementation, the polarization directions of the illumination light beams emitted by the first light source and the second light source are perpendicular to each other. The image generating apparatus further includes: polarization converter and analyzer. Wherein the polarization converter is configured to rotate the polarization directions of the illumination light beams emitted from the first light source and the second light source by 90 ° when the data loaded on the image modulator corresponds to the first viewing angle. Wherein the first viewing angle corresponds to the first light source. The polarization analyzer is used for transmitting the light beam emitted by the polarization converter, and the target polarization direction is the polarization direction of the illumination light beam emitted by the second light source.

Since the positions of the eyes of a person are different, the two-dimensional images received by the left and right eyes are different for the same three-dimensional screen. That is, for the same three-dimensional picture, the left and right eyes stand at different viewing angles to receive a two-dimensional picture. Therefore, in the image acquisition process of the three-dimensional picture, two-dimensional images of the left and right eye viewing angles are required to be acquired by the acquisition devices corresponding to the left and right eyes, respectively. In the process of collecting the three-dimensional picture, the visual angle of the two-dimensional image received by the image collecting device corresponding to the left eye can be called as a left eye visual angle, and the visual angle of the two-dimensional image received by the image collecting device corresponding to the right eye can be called as a right eye visual angle.

According to the embodiment of the application, through the combination of the polarization converter and the polarization analyzer, the periodic transmission of the image corresponding to the left eye visual angle and the image corresponding to the right eye visual angle is realized. Therefore, the first light source and the second light source do not need to be periodically turned off and on in cooperation with the switching period of the image corresponding to the left eye visual angle and the image corresponding to the right eye visual angle, so that the imaging brightness is constant and does not change suddenly, and the display effect is improved. And the problems of human eyes, picture flickering, crosstalk and the like caused by the bright-up time delay and the dark-out time delay of the light source, which are caused by wrong imaging, can be avoided (see the description of fig. 5 in particular), the display effect is improved, and the service life of the device is prolonged.

In an alternative implementation, the polarization converter includes a liquid crystal layer, and energizing the liquid crystal layer rotates the polarization direction of the light beam incident on the liquid crystal layer by 90 °, and not energizing the liquid crystal layer, the polarization direction of the light beam incident on the liquid crystal layer is unchanged. According to the embodiment of the application, whether the polarization direction of the light beam rotates or not is controlled by the liquid crystal layer, and because the liquid crystal layer is electrified to be a control means with extremely low time delay, the control time delay can be effectively reduced, so that the time point of image switching is more matched with the switching time point of loaded image data.

In an alternative implementation, the polarization converter is configured to rotate the polarization direction of the illumination beams emitted by the first and second light sources. The image modulator is used for modulating the illumination beam emitted by the polarization converter. The analyzer is used for analyzing the polarization of the light beam exiting the polarization converter.

In an alternative implementation, the illumination beam passes through the lens before passing through the image modulator. In the embodiment of the application, the direction of the illumination light beam is changed by the lens and then the illumination light beam is modulated by the image modulator, so that the imaging obtained by the modulation of the image modulator is free from distortion or low in distortion degree, and the imaging quality of 3D imaging is ensured.

In an alternative implementation, the image generation device further comprises a computing unit. The computing unit is used for determining target positions of the first light source and the second light source according to the two eye positions of the first observer. The driving device is used for moving the first light source and the second light source to the target position. In the embodiment of the application, the target position of the light source is the position of the light source obtained by reversely converging the light beams received by the eyes of the first observer along the lens.

Specifically, the computing unit may query a comparison table of the 3D imaging positions and the light source positions according to the two eye positions, thereby determining a left light source position corresponding to the left eye position and a right light source position corresponding to the right eye position. Optionally, if the position of the left eye is located between two calibration 3D imaging positions in the lookup table, the computing unit may determine a light source position corresponding to the position of the left eye between two calibration light source positions corresponding to the two 3D imaging positions. The right eye position is similar and will not be described in detail here. Therefore, by the calculation unit, the light source positions (i.e. the target positions) corresponding to infinite actual binocular positions can be determined according to the correspondence between the finite calibration 3D imaging positions and the calibration light source positions.

In an alternative implementation, the image generation device further comprises a position sensor. The position sensor is used for determining the positions of the first light source and the second light source. The computing unit is used for determining the moving distance and/or the moving speed of the first light source and the second light source according to the positions of the first light source and the second light source and the target position. The driving device is used for moving the first light source and the second light source to the target position according to the moving distance and/or the moving speed. According to the embodiment of the application, the actual positions of the first light source and the second light source are determined through the position sensor, so that feedback control of the driving device is realized, the capacity of inhibiting influence of internal and external disturbance on the controlled quantity (namely the positions of the first light source and the second light source) is restrained, and the control precision is high.

In an alternative implementation, the image generating device further comprises a detecting device. The detection means are for determining the positions of both eyes of the first observer. According to the embodiment of the application, the real-time position information of the two eyes can be acquired through the detection device, and then the position of the light source is adjusted in real time, so that the position of the light source is adjusted in real time according to the positions of the two eyes, and the imaging consistency is further improved.

In an alternative implementation, the image generating device further comprises a third light source and a fourth light source. The third light source and the fourth light source are used for emitting two illumination light beams. The driving device is also used for moving the third light source and the fourth light source, and the illumination light beams emitted by the moved third light source and the moved fourth light source are respectively converged to the left eye of the second observer and the right eye of the second observer. The embodiment of the application projects imaging light to both eyes of the second observer through the third light source and the fourth light source, thereby providing 3D imaging for two observers (the first observer and the second observer).

In an alternative implementation, the lens comprises a spherical lens, an aspherical lens, or a fresnel lens.

In an alternative implementation, the image modulator includes any one of a liquid crystal display (liquid crystal display, LCD), a liquid crystal on silicon (liquid crystal on silicon, LCOS) chip, a digital micromirror device (digital micromirror device, DMD), and a microelectromechanical system (micro electro mechanical systems, MEMS).

In an alternative implementation, the first light source and the second light source are light bars.

In a second aspect, embodiments of the present application provide a display device. The display device comprises a main processor and the image generation means of the first aspect. The main processor is used for sending data to the image modulator. The image modulator modulates the illumination beam according to the data.

In a third aspect, embodiments of the present application provide an image generating method. The method comprises the following steps: and acquiring one illumination beam through the first light source and the second light source respectively to obtain two beams. The two illumination light beams are respectively converged. The two illumination light beams are respectively modulated, and the modulated two illumination light beams are respectively converged to different positions. And moving the first light source and the second light source, wherein the illumination light beams emitted by the moved first light source and the moved second light source are respectively converged to the left eye of the first observer and the right eye of the first observer.

In an alternative implementation, the act of moving the first light source and the second light source may specifically include: the first light source and the second light source are moved along a predetermined trajectory.

In an alternative implementation, the first light source and the second light source move along a predetermined trajectory on the track.

In an alternative implementation, the polarization directions of the illumination light beams emitted by the first light source and the second light source are perpendicular to each other. The method further comprises the steps of: when the data loaded on the image modulator corresponds to the first viewing angle, the polarization directions of the illumination light beams emitted from the first light source and the second light source are rotated by 90 ° by the polarization converter. Wherein the first viewing angle corresponds to the first light source. And transmitting a light beam with a target polarization direction in the light beams emitted by the polarization converter, wherein the target polarization direction is the polarization direction of the illumination light beam emitted by the second light source.

In an alternative implementation, the target positions of the first light source and the second light source may also be determined based on the binocular positions of the first observer. The act of moving the first light source and the second light source may specifically include: the first light source and the second light source are moved to a target position.

In an alternative implementation, the positions of the first and second light sources may also be determined. And determining the moving distance and/or the moving speed of the first light source and the second light source according to the positions of the first light source and the second light source and the target position. The act of moving the first light source and the second light source to the target position may specifically include: and moving the first light source and the second light source to the target position according to the moving distance and/or the moving speed.

In an alternative implementation, two illumination beams may also be acquired by a third light source and a fourth light source. And moving the third light source and the fourth light source, wherein the illumination light beams emitted by the moved third light source and the moved fourth light source are respectively converged to the left eye of the second observer and the right eye of the second observer.

The advantages of the second and third aspects are seen in the first aspect and are not described here in detail.

Drawings

Fig. 1 is a schematic diagram of an image generating apparatus;

FIG. 2 is a schematic diagram of an image generating apparatus with multiple groups of light sources;

fig. 3a is a schematic structural diagram of an image generating device according to an embodiment of the present application;

FIG. 3b is a schematic diagram of an image generation apparatus including a reflective image modulator according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of an image generating apparatus including a track according to an embodiment of the present application;

FIG. 5 is a schematic diagram of an image generation apparatus including a polarization converter and an analyzer according to an embodiment of the present application;

FIG. 6 is a schematic view of the beneficial effects of the structure of FIG. 5;

fig. 7 is a schematic structural diagram of an image generating device including a position sensor according to an embodiment of the present application;

Fig. 8 is a schematic diagram of a feedback control system of an image generating apparatus according to an embodiment of the present application;

FIG. 9 is a schematic diagram of a feedforward feedback control system of an image generating apparatus according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of a display device according to an embodiment of the present application;

fig. 11 is a schematic product form of a display device according to an embodiment of the present application

Fig. 12 is a schematic view of a table display of a display device according to an embodiment of the present application;

fig. 13 is a flowchart of an image generating method according to an embodiment of the present application.

Detailed Description

First, some terms appearing in the embodiments of the present application are explained:

naked eye 3D technology: the separation of the left and right eye images is realized by the image generating device, and a 3D display technology for separating the left and right eye images by wearing a wearing device by a viewer is not needed.

3D imaging position: and the modulated imaging light is converged to a position, and the imaging light corresponding to the left eye visual angle and the imaging light corresponding to the right eye visual angle are converged to different 3D imaging positions.

Left eye viewing angle: since the positions of the eyes of a person are different, the two-dimensional images received by the left and right eyes are different for the same three-dimensional screen. That is, for the same three-dimensional picture, the left and right eyes stand at different viewing angles to receive a two-dimensional picture. Therefore, in the process of image acquisition of a three-dimensional picture (that is, acquisition of a data source projected by the image generating apparatus in the embodiment of the present application), two-dimensional images of left and right eye viewing angles need to be acquired respectively by using acquisition devices corresponding to the left and right eyes. The left eye visual angle is the visual angle of the two-dimensional image received by the image acquisition device corresponding to the left eye in the acquisition process of the three-dimensional picture.

Right eye viewing angle: the right eye visual angle is the visual angle of the two-dimensional image received by the image acquisition device corresponding to the right eye in the acquisition process of the three-dimensional picture.

Imaging consistency: consistency between the 3D imaging position and the actual human eye position. The smaller the distance between the 3D imaging position and the actual eye position, the higher the imaging consistency.

Data loaded on the image modulator: in the embodiment of the application, the digital signals corresponding to the 3D image are represented, including the digital signals corresponding to the left eye viewing angle and the digital signals corresponding to the right eye viewing angle. The imaging light corresponding to the left eye visual angle can be obtained by modulating the illumination light beam according to the digital signal corresponding to the left eye visual angle, and the imaging light corresponding to the right eye visual angle can be obtained by modulating the illumination light beam according to the digital signal corresponding to the right eye visual angle.

With the development of 3D display technology, the application scenes of 3D display are also increasing. For example, in the scenes of offices, education, medical treatment, entertainment, games, advertisement delivery, architectural decoration, event retransmission, exhibition of artwork, college and the like, exhibition of performances such as operas, concerts and the like, 3D images can be projected by a 3D display technology, so that the projected images are more stereoscopic and vivid.

In the 3D display technology, imaging light of different viewing angles is projected to the left and right eyes, respectively, thereby obtaining a stereoscopic 3D image in the human brain. The 3D display technology can project imaging light of the left and right eyes to the corresponding human eyes, respectively, through various means. In the naked eye 3D technology, imaging light is divided into left and right eye imaging light, imaging light of a left eye viewing angle is projected to a left eye, and imaging light of a right eye viewing angle is projected to a right eye. The naked eye 3D technology can realize separation of left and right eye imaging light without wearing equipment by a viewer, and is a technology with high usability (usability) for the viewer.

As shown in fig. 1, in an naked eye 3D technology, illumination light beams emitted by two light sources are respectively converged to left and right eyes through lenses, and corresponding illumination light beams are respectively modulated by an image modulator through data corresponding to the left and right eyes, so that imaging light corresponding to the left and right eyes is respectively projected to corresponding human eyes.

When the position of the human eye changes, the convergence position of the light beam emitted by the light source is unchanged, so that the human eye cannot receive imaging light obtained based on the light source. In order to solve the problem that the human eye cannot receive the imaging light after the movement of the human eye, a structure as shown in fig. 2 is presented. This structure is configured by providing a plurality of sets of light sources, and one set of light sources at the initial light source positions (e.g., position 2 and position 3 in the figure) of the human eye is passed as the light sources of the left and right eyes. As the human eye moves, new light source positions (e.g., positions 5 and 6 in the figure) corresponding to the new positions of the human eye are determined. And turning off the light source at the initial light source position, starting the light source at the new light source position, and realizing the switching of the imaging position.

However, such a structure of switching the imaging position by turning off the home position light source and turning on the new position light source may cause abrupt brightness changes of the imaging light due to the turning off and on of the light source, thereby affecting the viewing experience of the viewer. And, because the light source position jumps and leads to 3D imaging position jump, lead to the distance between 3D imaging position and the actual human eye position great to lead to imaging uniformity poor.

In order to solve the above-described drawbacks, an embodiment of the present application provides an image generating apparatus. As shown in fig. 3a, the image generating apparatus 300 provided in the embodiment of the present application includes a first light source 310, a second light source 320, a lens 330, an image modulator 340, and a driving apparatus 350. Wherein the first light source 310 and the second light source 320 are respectively configured to provide an illumination beam. The lens 330 is used for converging the two illumination beams, and the two illumination beams passing through the lens 330 are respectively converged to different viewpoints. The image modulator 340 is configured to modulate the two light beams, and the modulated two illumination light beams are converged to different positions. The driving device 350 is used to move the first light source 310 and the second light source 320. The illumination light beams emitted from the moved first light source 310 and the moved second light source 320 are respectively converged to the left eye of the first observer and the right eye of the first observer.

In the embodiment of the present application, the first light source 310 may be a left light source, and the second light source 320 may be a right light source; the first light source 310 may be a right light source and the second light source 320 may be a left light source, which is not limited in this application. The illumination light beams emitted by the left light source are converged to the left eye of the observer through the lens 330, and the illumination light beams emitted by the right light source are converged to the right eye of the observer through the lens 330.

In the image generating apparatus 300 provided in the embodiment of the present application, the first light source 310 and the second light source 320 are moved by the driving apparatus 350, so that the convergence position (i.e., the 3D imaging position) of the illumination light beams of the first light source 310 and the second light source 320 is changed, so that the 3D imaging position follows the human eye position. According to the embodiment of the application, the 3D imaging position is changed by moving the light source, the position of the light source does not jump in the moving process of the light source, so that the 3D imaging position does not jump, the brightness is constant and does not jump, and the viewing experience of a viewer is improved. In addition, in the embodiment of the application, the 3D imaging position is gradually close to the eye point, and the distance between the 3D imaging position and the actual binocular position is smaller, so that the imaging consistency can be improved through the image generating device provided by the embodiment of the application.

In addition, the image generating device provided by the embodiment of the application can realize the matching of a plurality of positions of a pair of eyes through a pair of light sources, a plurality of pairs of light sources are not required to be arranged for a pair of eyes, the number of the light sources is reduced, and therefore the equipment cost is reduced.

It should be noted that, in the embodiment of the present application, the illumination beam may pass through the lens 330 and then the image modulator 340 as shown in fig. 3a, or may pass through the image modulator 340 and then the lens 330, which is not limited in this application.

The lens 330 may be a spherical lens, an aspherical lens, or a fresnel lens. The first light source 310 and the second light source 320 may be light bars. Alternatively, the light bar may be composed of one or more rows of beads, and the moving directions of the first and second light sources 310 and 320 may be perpendicular to the extending direction of each row of beads.

The image modulator 340 may be a transmissive image modulator, for modulating an incident illumination beam and transmitting the modulated imaging light. By way of example, image modulator 340 may be a liquid crystal display (liquid crystal display, LCD) or other transmissive image modulator, as not limited in this application.

Alternatively, the image modulator 340 may be a reflective image modulator. The structure of the image generation device comprising the reflective image modulator is shown in fig. 3 b. In this configuration, the image modulator 340 is configured to modulate an incident illumination beam and reflect the modulated imaging light. In this configuration, the image modulator 340 may be a liquid crystal on silicon (Liquid crystal on silicon, LCOS), a digital micromirror device (Digital Micromirror Device, DMD), a microelectromechanical system (Micro-electromechanical systems, MEMS), or the like, which is not limited in this application. A diffusion screen is also included between the image modulator 340 and the lens 330, or after the lens 330. The diffusion screen is used for carrying out diffuse reflection on the imaging light, so that the imaging light is softer.

It is noted that a diffusion screen may also be included in the construction of the image generating device comprising the transmissive image modulator, for example in the construction shown in fig. 3a, 4, 5 and 7. The diffusion screen may be located at any position after the image modulator 340, which is not limited in this application.

In the image generating apparatus 300 shown in fig. 3a and 3b, the driving apparatus 350 may move the first light source 310 and the second light source 320 on a predetermined trajectory. Since the trajectory is a line or a plane where a plurality of points are connected, the first light source 310 and the second light source 320 can be moved to any point on the trajectory along a predetermined trajectory. That is, for any binocular position, the corresponding light source position can be found on the predetermined track, and then the driving device 350 moves the first light source 310 and the second light source 320 to the light source position, so that the 3D imaging position where the light sources converge falls on the actual binocular position, and the finally presented imaging effect is good. Alternatively, as shown in fig. 4, the driving device 350 may include a motor 351.

Optionally, as shown in fig. 4, the image generating apparatus 300 provided in the embodiment of the present application may further include a track 360, where the predetermined track is on the track 360. The driving means 350 may include a motor 351. The motor 351 is used to move the first light source 310 and the second light source 320 along a predetermined trajectory on the rail 360.

Alternatively, the track 360 may be a one-dimensional track, i.e., the first light source 310 and the second light source 320 can only move forward or backward along a predetermined trajectory on the track. Alternatively, the motor 351 may move the first and second light sources 310 and 320 through gears, belts, chains, pulleys, pneumatic gears, hydraulic gears, and the like.

Since the one-dimensional track limits movement of the light sources in other dimensions, movement of the first light source 310 and the second light source 320 over the track 360 is smoother, thereby enabling smooth movement of the imaging position. Moreover, the motor only needs to control the light source to move in one dimension, so that the assembly structure among the motor, the transmission device and the track is simple, and the whole image generating device is simple in structure.

In order to present a stereoscopic 3D image in the human brain, the left and right eyes need to alternately receive images of corresponding viewing angles. The image modulator 340 thus periodically switches the loaded image data during the modulation of the illumination beam. For example, as shown in fig. 5, the odd frames (first, third, … …) load data for the left eye viewing angle, and the even frames (second, fourth, … …) load data for the right eye viewing angle. In order to project the imaging light of the data into the corresponding human eyes, the left and right light sources also need to be switched between the two light sources according to the switching period of the image modulator 340 loading the data. That is, when the image modulator 340 loads data of the left eye viewing angle, the left light source is turned on and the right light source is turned off; when the image modulator 340 loads data of the right eye viewing angle, the right light source is turned on and the left light source is turned off. The illumination light beams emitted by the left light source are converged by the lens and then projected to the left eye of the observer, and the illumination light beams emitted by the right light source are converged by the lens and then projected to the right eye of the observer.

Due to factors such as circuit design and luminous principle inside the light source, a certain time delay exists between the power-on of the light source and the actual lighting time of the light source. Due to glow and other reasons, a certain time delay exists between the power failure of the light source and the actual extinction of the light source. The time delay between the actual turning on and the actual turning off of the light source is caused by the light source itself and cannot be eliminated. The time delay causes problems such as flicker and crosstalk, and the display effect is poor.

In order to solve the problem of poor display effect, the embodiment of the application also provides an image generating device structure, which realizes the periodic transmission of left and right light source beams through a polarization converter and an analyzer, and the left and right light sources do not need to be periodically turned on and off, so that the display problem caused by the delay of the turning on and off is avoided.

As shown in fig. 5, in this structure, the image generating apparatus 300 includes a first light source 310, a second light source 320, a lens 330, an image modulator 340, a driving apparatus 350, a polarization converter 370, and an analyzer 380. The first light source 310, the second light source 320, the lens 330, the image modulator 340 and the driving device 350 are shown in the embodiment of fig. 3a, and are not described herein.

Wherein the polarization directions of the illumination light beams emitted from the first light source 310 and the second light source 320 are perpendicular to each other. When the data loaded on the image modulator 340 corresponds to the first viewing angle, the polarization converter 370 rotates the polarization directions of the illumination light beams emitted from the first and second light sources 310 and 320 by 90 °. Wherein the first viewing angle corresponds to the first light source 310. The first light source 310 may be one of a left light source and a right light source. That is, if the first light source 310 is a left light source, the first viewing angle is a left eye viewing angle, and if the first light source 310 is a right light source, the first viewing angle is a right eye viewing angle.

Wherein the analyzer 380 is configured to transmit a light beam of a target polarization direction. Wherein the target polarization direction is the polarization direction of the illumination beam emitted in the second light source 320.

For example, if the polarization state of the left light source is S, the polarization state of the right light source is P, and the polarization state of the transmitted beam is S by the analyzer 380. Then as shown in table 1, when the image modulator 340 is loaded with data for the right eye viewing angle (i.e., the odd frame, the first frame is taken as an example in table 1), the polarization converter 370 is put in an on state. The polarization converter 370 in the on state rotates the polarization directions of the illumination light beams emitted from the left and right light sources by 90 °, thereby converting the illumination light beam emitted from the left light source into P-polarized light and the illumination light beam emitted from the right light source into S-polarized light. Since the analyzer 380 can only transmit S polarized light, the illumination beam from the right light source is transmitted, and the image light from the right eye viewing angle is converged to the right eye through the convergence of the lens 330 and the modulation of the image modulator 340; while the left light source emits an illumination beam that is blocked by the analyzer 380 and the left eye cannot receive the imaging light.

When the image modulator 340 is loaded with data for the left eye viewing angle (i.e., even frames, the second frame is exemplified in table 1), the polarization converter 370 is put in the off state. The polarization converter 370 is in an off state, directly transmitting the S light emitted from the left light source and the P light emitted from the right light source. Since the analyzer 380 can only transmit S polarized light, the illumination beam from the left light source is transmitted, and the resulting imaging light from the left eye viewing angle is converged to the left eye through the convergence of the lens 330 and the modulation of the image modulator 340; while the illumination beam from the right light source is blocked by the analyzer 380 and the right eye is unable to receive the imaging light.

Table 1 an example of correspondence between polarization states of respective members and light beams in an image generating apparatus

Alternatively, the data of the left eye view angle may be loaded by the odd frame, and the data of the right eye view angle may be loaded by the even frame: changing the polarization state of the light source (left P and right S), changing the on-off period of the polarization converter (odd frame and even frame and on), or changing the polarization state of the polarization analyzer to P, and executing one or three of the above 3 points can also realize the correspondence of the viewing angle of the loaded data and the light source of the transmitted light beam (i.e. transmitting the illumination light beam of the left light source when loading the left eye viewing angle data, and transmitting the illumination light beam of the right light source when loading the right eye viewing angle data).

It should be noted that the order of any one of the polarization converter 370 and the analyzer 380 and the image modulator 340 is not limited in the embodiments of the present application. The illumination beam described in this embodiment may be either a pre-modulated illumination beam or a modulated illumination beam (imaging light), which is not limited in this application.

Wherein the polarization converter 370 may be a liquid crystal layer. When the liquid crystal layer is energized, the liquid crystals in the liquid crystal layer are arranged in a predetermined pattern, rotating the polarization direction of the passing light beam by 90 °. The liquid crystal layer may transmit a light beam when the liquid crystal layer is not energized.

In fig. 6, in a configuration in which the left and right light sources are periodically turned on and off, light gray indicates that the left light source is turned on and dark gray indicates that the right light source is turned on. Crosstalk occurs due to the delay in the light source turning on, and flicker occurs at a high frame rate due to the delay in the light source turning off. In the structure including the polarization converter 370 and the analyzer 380 shown in fig. 5, light gray represents a light beam transmitting the left light source, and dark gray represents a light beam transmitting the right light source. Since the change of the liquid crystal arrangement state from the energization of the liquid crystal layer to the liquid crystal layer is completed at high speed, there is no significant time delay. Therefore, with the configuration of the image generating apparatus shown in fig. 5, the problem of poor display effects such as flickering and crosstalk caused by the periodic turning on and off of the light source does not occur. Thereby improving the display effect of the image generating device.

And compared with the control of the periodical on and off of the left and right light sources, the control of the on and off of the liquid crystal layer is simpler. In this structure, the control system of the on-off period is disposed between the still image modulator 340 and the polarization converter 370, and the control system is simple in structure without considering the movement of the structure, compared with being disposed between the image modulator 340 and the movable first and second light sources 310 and 320, thereby simplifying the overall device structure. In addition, the polarization converter 370 is turned on and off to realize the periodic switching of the imaging light corresponding to the visual angle, and the light source is not required to be turned on and off periodically, so that the service life of the light source can be prolonged, and the service life of the whole image generating device is prolonged.

It is noted that table 1 is only one example of the correspondence relationship. In order to realize that the illumination beam of the left light source is transmitted when the left-eye viewing angle data is loaded, the illumination beam of the right light source is transmitted when the right-eye viewing angle data is loaded, the polarization states of the components in the image generating apparatus 300 and the loading period of the data may be set as shown in any one of the rows in table 2.

Table 2 correspondence between polarization states of respective members and light beams in image generating apparatus

In the configuration shown in fig. 5, the positional relationship among the lens 330, the image modulator 340, the polarization converter 370, and the polarization analyzer 380 is not limited except that the polarization converter 370 needs to be on the optical path before the polarization analyzer 380 (i.e., the light beam must pass through the polarization converter 370 before it enters the polarization analyzer 380). That is, after the illumination beam exits from the first light source and the second light source, the sequence of passing through the lens 330, the image modulator 340, the polarization converter 370 and the analyzer 380 is limited to passing through the polarization converter 370 and then passing through the analyzer 380, and the other is not limited.

If the polarization converter 370 and the analyzer 380 are not included in the image generating device 300, the first light source 310 and the second light source 320 are periodically switched in synchronization with the switching period of the viewing angle of the image data loaded by the image modulator 340.

In the image generating apparatus provided in the embodiment of the present application, the control of the driving apparatus 350 may be implemented by the control system, so that the control of the positions of the first light source 310 and the second light source 320 is implemented. In order to achieve the above control, a calculation unit for determining target positions of the first light source and the second light source from left and right eye positions of the observer is provided in the image generating apparatus 300. So that the driving means 350 moves the first light source 310 and the second light source 320 to the target position.

Alternatively, as shown in fig. 8, a comparison table between the calibration 3D imaging position and the calibration light source position may be included in the calculation unit. When the viewer's binocular position is at the nominal 3D imaging position (e.g., at point (O1, O2)), the corresponding nominal light source positions (e.g., points (T1, T2)) are determined to be the target positions of the first and second light sources. When the viewer's binocular position is between the two nominal 3D imaging positions, the target position may be determined between the corresponding two nominal light source positions. The determined target position is the light source position obtained by converging light beams received by two eyes after the observer moves along the reverse direction of the lens.

Alternatively, in order to achieve accurate control of the first light source position and the second light source position, a position sensor 390 may be provided in the image generating device 300, the position sensor 390 being used to determine the positions of the first light source 310 and the second light source 320, the specific structure being as shown in fig. 7.

The position sensor 390 may be a resistive displacement sensor, a distance sensor, etc., which is not limited in this application. The position sensor 390 may be moved synchronously with the first light source and the second light source, or may be in a fixed position, which is not limited in this application. For example, the position sensor 390 may move in synchronization with the first and second light sources 310 and 320, and the positions of the first and second light sources 310 and 320 are determined by the distance from the calibration point. Alternatively, the position sensor 390 is fixed in position, and the positions of the first light source 310 and the second light source 320 are determined by the distance from the calibration points on the first light source 310 and the second light source 320. The present application is not limited in this regard.

Alternatively, based on the image generating apparatus structure shown in fig. 7, the driving apparatus 350 may be feedback-controlled or feedforward-feedback-controlled.

Next, a case of feedback control will be described. As shown in fig. 8, the target position of the light source is determined by the calculation unit, and the actual position of the light source is determined by the position sensor 390. And subtracting the actual position from the target position of the light source to obtain the moving distance of the light source. The driving device 350 moves the light source position according to the moving distance so that the light source is moved to the target position, and thus the focusing position (3D imaging position) of the light beam emitted from the light source falls on both eyes of the observer after the movement.

The feedback control system shown in fig. 8 can suppress the influence of the internal and external disturbance on the controlled quantity (i.e., the light source position), and has high control accuracy. The imaging position can be accurately moved to the target position without other interference, so that the imaging consistency is improved.

Next, a case of feedforward feedback control will be described. If the binocular viewpoint is in a continuously moving state, there must be a lag in the light source position movement compared to the actual binocular position movement by a simple feedback control system. This lag can be minimized by the feedforward compensation value. As shown in fig. 9, in the process of calculating the moving distance by the calculation unit, the difference between the target position and the actual position of the light source is added to the feedforward compensation value based on the feedback control system shown in fig. 8, to obtain the moving distance. Wherein the feedforward compensation value may be a distance and/or a velocity. The feedforward compensation value reduces the system lag, so that the moving distance and the moving speed of the light source position can keep up with the movement of the binocular vision point, thereby improving the imaging consistency.

In the control system shown in fig. 8 and 9, the positions of both eyes of the observer can be acquired by the detection means. That is, the image generating apparatus 300 may further include a detecting means for determining the positions of both eyes of the observer.

Alternatively, the light source in fig. 8 and 9 may be a left light source or a right light source. Namely, the positions of the left light source and the right light source are respectively controlled, and the feedback control system is divided into a feedback control system of the left light source and a feedback control system of the right light source. The position sensor 390 may be provided for the left and right light sources, respectively, as shown, or may be provided with one position sensor to determine the positions of the two light sources as a whole. If the position sensors 390 are respectively provided for the left light source and the right light source, the distance between the left light source and the right light source can be changed according to the interpupillary distance of different observers, so that the suitability of the image generating device for different users is improved.

Alternatively, the target positions of the light sources in fig. 8 and 9 may be determined based on actual binocular positions or predicted binocular positions. The calculation unit can predict the target positions of the binocular movement according to the movement rule of the binocular positions, so that the hysteresis of the movement of the 3D imaging positions corresponding to the light sources compared with the movement of the binocular positions is reduced.

In the embodiment of the present application, the calculating unit may be a part of the control circuit of the driving device 350, or may be a separate control unit, which is not limited in this application.

Fig. 4, 5 and 7 are the structures of the track 360, the polarization converter 370 and the analyzer 380, and the position sensor 390, which are respectively superimposed based on fig. 3 a. The track 360, polarization converter 370 and analyzer 380, and position sensor 390 may also be superimposed on the structure shown in fig. 3b, which is not limited in this application. Alternatively, any of the track 360, the polarization converter 370 and the analyzer 380, the position sensor 390, the computing unit, the detecting device may be superimposed on each other, and present in the same image generating apparatus, which is not limited in this application.

The image generating apparatus shown in fig. 3a to 9 can move the light source positions based on the binocular positions of one observer or a plurality of observers, respectively. When moving based on the binocular positions of a plurality of observers, there are a plurality of pairs of light sources matching the number of observers, which is not limited by the embodiment of the present application.

As shown in fig. 10, the embodiment of the application further provides a display device. The display device 1000 includes a main processor 1100 and an image generating apparatus 1200. Wherein the image generation apparatus 1200 is the image generation apparatus 300 shown in fig. 3a to 9. The main processor 1100 is used to transmit data to an image modulator in the image generating apparatus 1200. The image modulator modulates the illumination beam according to the data.

The display device 1000 has a variety of product forms. As shown in fig. 11, the display device 1000 may include a 3D display, a 3D projector, a 3D wearable device, or the like. The 3D display may be a display screen of a mobile device such as a computer display, a mobile phone, a notebook computer, a personal digital assistant (personal digital assistant, PDA), a game machine, or the like. The 3D projector may be applied to front projection scenes and rear projection scenes, which is not limited in this application. For example, the display device 1000 may be a car light, a desktop display device, a Head Up Display (HUD) device, or the like. The 3D wearable device may be augmented reality (augmented reality, AR)/Virtual Reality (VR) glasses, AR/VR helmets, smartwatches, etc., which are not limited in this application. The display device 1000 provided in the embodiment of the present application may be applied to vehicles such as a car and a ship, which is not limited in this application.

As shown in fig. 12, when the display device 1000 is a desktop display device, the image generating apparatus 1200 on the display device 1000 outputs imaging light. The imaging light is reflected by the glass screen and the free-form surface reflecting mirror, is projected onto the human eye through the glass screen, and is imaged on the human eye.

Fig. 13 is a flowchart of an image projection method according to an embodiment of the present application. The method may be applied to any of the aforementioned image generating apparatuses. As shown in fig. 13, the method includes:

s1, acquiring a beam of illumination light beams through a first light source and a second light source respectively.

S2, respectively converging the two illumination light beams.

S3, respectively modulating the two illumination light beams, wherein the two modulated illumination light beams are respectively converged to different positions.

S4, moving the first light source and the second light source, and converging illumination light beams emitted by the moved first light source and the moved second light source to the left eye of the first observer and the right eye of the first observer respectively.

In an alternative implementation, the first light source and the second light source are moved along a predetermined trajectory.

In an alternative implementation, the polarization directions of the illumination light beams emitted by the first light source and the second light source are perpendicular to each other. When the data loaded on the image modulator corresponds to the first viewing angle, the polarization directions of the illumination light beams emitted from the first light source and the second light source are rotated by 90 ° by the polarization converter. Wherein the first viewing angle corresponds to the first light source. And transmitting a light beam with a target polarization direction in the light beams emitted by the polarization converter, wherein the target polarization direction is the polarization direction of the illumination light beam emitted by the second light source.

In an alternative implementation, the target positions of the first and second light sources are determined based on the binocular positions of the first observer. The first light source and the second light source are moved to a target position.

In an alternative implementation, the locations of the first light source and the second light source are determined. And determining the moving distance and/or the moving speed of the first light source and the second light source according to the positions of the first light source and the second light source and the target position. And moving the first light source and the second light source to the target position according to the moving distance and/or the moving speed.

In an alternative implementation, a beam of illumination light is acquired by a third light source and a fourth light source, respectively; and moving the third light source and the fourth light source, wherein the illumination light beams emitted by the moved third light source and the moved fourth light source are respectively converged to the left eye of the second observer and the right eye of the second observer.

The image generating device, the display device and the image generating method provided by the embodiment of the application can be applied to scenes such as office, education, medical treatment, entertainment, games, advertisement delivery, architectural decoration, event retransmission, exhibition of artware, collection and the like, and exhibition of performances such as operas, concerts and the like. For example, in offices, education, etc., it may be applied to devices such as computer displays, conference projectors, conference flat panel displays, etc. In medical scenes, the method can be applied to a medical display, a surgical microscope and the like to enrich display content (3D imaging can display objects or depth distances among the objects), so that object information acquired by medical staff is upgraded from 2 dimensions to 3 dimensions, and the accuracy of remote medical diagnosis, medical examination and the like is improved. In scenes such as entertainment, event rebroadcasting, performance showing and the like, 3D images can be displayed on the screens of game machines, mobile phones, flat-panel devices and the like, or the 3D images are displayed through game projectors, so that the image display is more stereoscopic and vivid, and the presence of a user is improved.

The data loaded on the image modulator may be a digital signal corresponding to a pre-prepared 3D image, or may be a digital signal corresponding to a real-time generated 3D image. For example, in a game relay scene, images of a left eye view angle and a right eye view angle can be acquired respectively by two cameras at a game scene, and the real-time acquired images of two eyes are converted into digital signals and loaded on an image modulator in real time, so that the scene real-time relay is realized. Alternatively, the data may also be image data of a free view angle. That is, the viewing angle may be changed to enhance interactivity.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, which are not repeated herein.

In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

Claims

1. An image generating apparatus, comprising:

the first light source and the second light source are respectively used for emitting a beam of illumination light beam;

a lens for converging the two illumination light beams respectively;

the image modulator is used for modulating the two illumination light beams, wherein the two modulated illumination light beams are respectively converged to different positions;

and the driving device is used for moving the first light source and the second light source, wherein the illumination light beams emitted by the moved first light source and the moved second light source are respectively converged to the left eye of the first observer and the right eye of the first observer.

2. The image generation apparatus according to claim 1, wherein the driving means is configured to move the first light source and the second light source along a predetermined trajectory.

3. The image generation apparatus of claim 2, further comprising a track, wherein the first light source and the second light source move along the predetermined trajectory on the track.

4. An image generation apparatus according to any one of claims 1 to 3, wherein the polarization directions of the illumination light beams emitted from the first light source and the second light source are perpendicular to each other;

The image generating apparatus further includes:

a polarization converter for rotating the polarization directions of illumination light beams emitted from the first light source and the second light source by 90 ° when data loaded on the image modulator corresponds to a first viewing angle, wherein the first viewing angle corresponds to the first light source;

and the polarization analyzer is used for transmitting the light beam with the target polarization direction in the light beam emitted by the polarization converter, wherein the target polarization direction is the polarization direction of the illumination light beam emitted by the second light source.

5. The image generation device of claim 4, wherein the polarization converter is configured to rotate a polarization direction of illumination light beams emitted from the first light source and the second light source;

the image modulator is used for modulating the illumination light beam emitted by the polarization converter.

6. The image generation apparatus of any one of claims 1 to 5, wherein the illumination beam passes through the lens before passing through the image modulator.

7. The image generation apparatus according to any one of claims 1 to 6, further comprising:

a calculation unit configured to determine target positions of the first light source and the second light source according to the binocular positions of the first observer;

The driving device is used for moving the first light source and the second light source to the target position.

8. The image generation apparatus according to claim 7, further comprising:

a position sensor for determining the positions of the first light source and the second light source;

the computing unit is used for determining the moving distance and/or the moving speed of the first light source and the second light source according to the positions of the first light source and the second light source and the target position;

the driving device is used for moving the first light source and the second light source to the target position according to the moving distance and/or the moving speed.

9. The image generation apparatus according to any one of claims 1 to 8, further comprising:

and detection means for determining the positions of both eyes of the first observer.

10. The image generation apparatus according to any one of claims 1 to 9, further comprising:

the third light source and the fourth light source are respectively used for emitting a beam of illumination light beams;

the driving device is further used for moving the third light source and the fourth light source, wherein the moved illumination light beams emitted by the third light source and the moved illumination light beams emitted by the fourth light source are respectively converged to the left eye of the second observer and the right eye of the second observer.

11. The image generation apparatus according to any one of claims 1 to 10, wherein the lens includes any one of a spherical lens, an aspherical lens, and a fresnel lens.

12. The image generation device according to any one of claims 1 to 11, wherein the first light source and the second light source are light bars.

13. The image generation apparatus according to any one of claims 1 to 12, wherein the image modulator includes: any one of a liquid crystal display LCD, liquid crystal on silicon LCOS, digital micromirror device DMD, and microelectromechanical system MEMS.

14. A display device comprising a main processor and the image generating apparatus of any one of claims 1 to 13;

the main processor is configured to send data to the image modulator.

15. An image generation method, comprising:

acquiring a beam of illumination light beam through a first light source and a second light source respectively;

respectively converging two illumination beams;

respectively modulating the two illumination light beams, wherein the two modulated illumination light beams are respectively converged to different positions;

and moving the first light source and the second light source, wherein the illumination light beams emitted by the first light source after movement and the second light source after movement are respectively converged to the left eye of the first observer and the right eye of the first observer.

16. The method of claim 15, wherein said moving said first light source and said second light source comprises:

the first light source and the second light source are moved along a predetermined trajectory.

17. The method of claim 16, wherein the moving the first light source and the second light source along a predetermined trajectory comprises:

the first light source and the second light source are moved along the predetermined trajectory on a track.

18. The method according to any one of claims 15 to 17, wherein the polarization directions of the illumination light beams emitted by the first light source and the second light source are perpendicular to each other;

the method further comprises the steps of: rotating, by a polarization converter, a polarization direction of illumination light beams emitted by the first light source and the second light source by 90 ° when data loaded onto an image modulator corresponds to a first viewing angle, wherein the first viewing angle corresponds to the first light source;

transmitting a light beam with a target polarization direction in the light beams emitted by the polarization converter, wherein the target polarization direction is the polarization direction of the illumination light beam emitted by the second light source.

19. The method according to any one of claims 15 to 18, further comprising:

Determining target positions of the first light source and the second light source according to the binocular positions of the first observer;

said moving said first light source and said second light source, comprising:

and moving the first light source and the second light source to the target position.

20. The method as recited in claim 19, further comprising:

determining the positions of the first light source and the second light source;

determining a moving distance and/or a moving speed of the first light source and the second light source according to the positions of the first light source and the second light source and the target position;

the moving the first light source and the second light source to the target location includes:

and moving the first light source and the second light source to the target position according to the moving distance and/or the moving speed.

21. The method according to any one of claims 15 to 20, further comprising:

acquiring a beam of illumination light beam through a third light source and a fourth light source respectively;

and moving the third light source and the fourth light source, wherein the moved illumination light beams emitted by the third light source and the moved illumination light beams emitted by the fourth light source are respectively converged to the left eye of the second observer and the right eye of the second observer.