CN116243491A - Vehicle-mounted holographic imaging device and display system - Google Patents

Vehicle-mounted holographic imaging device and display system Download PDF

Info

Publication number
CN116243491A
CN116243491A CN202310331067.2A CN202310331067A CN116243491A CN 116243491 A CN116243491 A CN 116243491A CN 202310331067 A CN202310331067 A CN 202310331067A CN 116243491 A CN116243491 A CN 116243491A
Authority
CN
China
Prior art keywords
imaging
image
imaging plane
vehicle
projection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310331067.2A
Other languages
Chinese (zh)
Inventor
王梓
庞煜剑
苏雨萌
吕国强
冯奇斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hefei University of Technology
Original Assignee
Hefei University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hefei University of Technology filed Critical Hefei University of Technology
Priority to CN202310331067.2A priority Critical patent/CN116243491A/en
Publication of CN116243491A publication Critical patent/CN116243491A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B27/0103Head-up displays characterised by optical features comprising holographic elements
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00Projectors or projection-type viewers; Accessories therefor
    • G03B21/14Details
    • G03B21/28Reflectors in projection beam
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B27/0103Head-up displays characterised by optical features comprising holographic elements
    • G02B2027/0109Head-up displays characterised by optical features comprising holographic elements comprising details concerning the making of holograms
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00Road transport of goods or passengers
    • Y02T10/10Internal combustion engine [ICE] based vehicles
    • Y02T10/40Engine management systems

Abstract

The invention provides a vehicle-mounted holographic imaging device and a display system, wherein the imaging device comprises: the projection imaging assembly is used for generating real image light rays; the scattering array component is arranged at the transmitting end of the projection imaging component and comprises a plurality of imaging plane units, and the imaging plane units are sequentially arranged along the propagation path of the real image light rays and are used for scattering imaging the real image light rays so as to generate a plurality of real image projections; the first reflection element is arranged on the extension line of the projection imaging assembly and the scattering array assembly and is used for reflecting a plurality of real image projections; the second reflecting element is arranged on one side of the concave opening of the first reflecting element and is used for projecting and reflecting a plurality of real images to the eye box area so as to generate a plurality of virtual images; wherein the virtual image generated by each imaging plane unit is located at a different depth of field. The invention can display the identification images with different depth of field in the whole field of view, thereby improving the display effect of the vehicle-mounted head-up display.

Description

Vehicle-mounted holographic imaging device and display system
Technical Field
The invention relates to the technical field of display, in particular to a vehicle-mounted holographic imaging device and a display system.
Background
Head Up Display (HUD), also known as head up display, is widely used in the automotive field. The head up display can project important information of the automobile driving process onto a front windshield or a screen, such as automobile speed, oil quantity, navigation, automobile distance reminding and the like. In the existing head-up display technology, only two virtual image planes with different depths are usually provided, and eyes of a driver focus different real depths when facing different road conditions. Because the virtual image plane distance is generally inconsistent with the external environment object distance, the driver can see the virtual image and road condition clearly by zooming back and forth in the HUD observation process, and the driving safety problem is easy to generate.
In addition, in the existing head-up display technology, virtual image identification display areas with different depths of field are fixed. In an actual driving situation, because the areas where objects with different depths are located can change at any time, the marks with different depths of field are limited to a fixed area and cannot be displayed in the full view angle of the HUD. Therefore, there is a need for improvement.
Disclosure of Invention
In view of the above-mentioned drawbacks of the prior art, an object of the present invention is to provide a vehicle-mounted holographic imaging device and a display system, which are used for solving the problems of fixed field display range and small depth of field coverage of head-up display in the prior art.
To achieve the above and other related objects, the present invention provides an in-vehicle hologram imaging apparatus comprising:
the projection imaging assembly is used for generating real image light rays;
the scattering array component is arranged at the transmitting end of the projection imaging component and comprises a plurality of imaging plane units, and the imaging plane units are sequentially arranged along the propagation paths of the real image light rays and are used for scattering imaging the real image light rays so as to generate a plurality of real image projections;
the first reflection element is arranged on the extension line of the projection imaging assembly and the scattering array assembly and is used for reflecting a plurality of real image projections; and
the second reflecting element is arranged on one side of the concave opening of the first reflecting element and is used for projecting and reflecting a plurality of real images to the eye box area so as to generate a plurality of virtual images;
wherein the virtual image generated by each imaging plane unit is located at a different depth of field.
In an embodiment of the invention, the scattering array assembly further comprises:
and the activation circuit unit is electrically connected with each imaging plane unit and is used for adjusting the scattering diffusion angle of each imaging plane unit.
In an embodiment of the present invention, each of the imaging plane units is divided into a plurality of blocks, and the activation circuit unit independently adjusts a diffusion angle of each of the blocks to control a transparency of each of the blocks.
In an embodiment of the present invention, the projection imaging assembly includes a light source, a collimating lens, a speckle attenuator, and a spatial light modulator, wherein the light source is configured to generate a laser beam, and the collimating lens, the speckle attenuator, and the spatial light modulator are sequentially arranged along a propagation direction of the laser beam.
In an embodiment of the present invention, a positional relationship between the imaging plane unit and the corresponding virtual image projection satisfies the following formula:
Figure BDA0004154987050000021
wherein f represents the focal length of the first reflecting element, u represents the distance between the imaging plane unit and the first reflecting element, and v represents the depth of field of the plane on which the virtual image is projected.
In an embodiment of the present invention, the depth of field of the plane in which the two adjacent virtual images are projected satisfies the following formula:
Figure BDA0004154987050000022
wherein v is n-1 Representing depth of field, v, of plane in which the n-1 th virtual image is projected n Represents depth of field of the plane in which the nth virtual image is projected, sigma represents allowable diffuse spot diameter, F represents aperture value of human eye, F p Representing the focal length value of the human eye.
In an embodiment of the invention, the first reflective element is a reflective concave mirror or a holographic optical element lens.
The invention also provides a vehicle-mounted holographic display system, which comprises:
the camera module is used for collecting a forward-looking image of the vehicle;
the control module is electrically connected with the camera module and used for identifying a preset key object in the front-view image so as to generate an identification image;
the control module controls the projection imaging assembly to generate real image light rays of the identification image;
the scattering array component is arranged at the transmitting end of the projection imaging component and comprises a plurality of imaging plane units, the imaging plane units are sequentially arranged along the propagation path of the real image light, and the control module controls the scattering array component to perform scattering imaging on the real image light so as to generate a plurality of real image projections;
the first reflection element is arranged on an extension line from the projection imaging component to the scattering array component and is used for reflecting the real image projection; and
the second reflecting element is arranged in the opening direction of the concave surface of the first reflecting element and is used for reflecting the real image projection to the eye box area so as to generate a plurality of virtual image projections;
wherein the virtual image generated by each imaging plane unit is located at a different depth of field.
In an embodiment of the present invention, the control module is configured to scale the front view image into an intermediate image, and divide the intermediate image into a plurality of blocks according to a division manner of the imaging plane unit;
the control module identifies the intermediate image to generate the identification image of the key object, and acquires edge coordinate information (x, y) and distance information z of the key object;
the control module generates coordinates of the block occupied by the identification image according to the edge coordinate information (x, y) and the distance information z
Figure BDA0004154987050000031
Wherein d represents the longitudinal side length of the imaging plane unit, e represents the transverse side length of the imaging plane unit, and u represents the position data of the imaging plane unit occupied by the block.
In one embodiment of the invention, the control module includes:
the content identification unit is used for identifying the key object in the front-view image and acquiring edge coordinate information and distance information of the key object;
the identification generating unit is used for generating an identification image of the key object and calculating and generating identification image information of the identification image according to the edge coordinate information and the distance information; and
and the display control unit is used for controlling the projection imaging assembly and the scattering array assembly to generate a plurality of real image projections according to the identification image information.
As described above, the vehicle-mounted holographic imaging device and the display system of the invention have the following beneficial effects: the invention can display the identification images with different depth of field in the full field of view, effectively improve the display effect of the vehicle-mounted head-up display, enhance the virtual-real fusion degree and improve the driving safety.
Drawings
Fig. 1 shows a schematic structural diagram of a vehicle-mounted holographic imaging device provided by the invention.
Fig. 2 is a schematic view showing a first active mode of an imaging plane according to an embodiment of the invention.
Fig. 3 is a circuit diagram of a first active mode of an imaging plane according to an embodiment of the invention.
Fig. 4 is a schematic view showing a second active mode of the imaging plane according to an embodiment of the invention.
FIG. 5 is a circuit diagram illustrating a second active mode of an imaging plane according to an embodiment of the invention
Fig. 6 is a schematic perspective view of a scattering array assembly according to an embodiment of the invention.
Fig. 7 is a schematic structural diagram of an in-vehicle holographic display system according to the present invention.
Fig. 8 is a schematic diagram showing front view image information according to an embodiment of the invention.
Fig. 9 is a schematic diagram showing the identification of image information according to an embodiment of the invention.
Fig. 10 is a schematic diagram showing front view image information according to still another embodiment of the present invention.
FIG. 11 is a schematic diagram showing a display of identified image information according to still another embodiment of the present invention
Description of element reference numerals
10. A projection imaging assembly; 11. a light source; 12. a collimating lens; 13. a speckle attenuator; 14; a spatial light modulator;
20. a scattering array assembly; 21. a first imaging plane unit; 22. a second imaging plane unit; 23. a third imaging plane unit;
30. a first reflective element;
40. a second reflective element;
50. virtual images; 51. a first virtual image; 52. a second virtual image; 53. a third virtual image;
60. an eye box area;
70. a camera module;
80. a control module; 81. a content identification unit; 82. an identification generation unit; 83. a display control unit;
91. vehicle profile identification; 92. and (5) navigation identification.
Detailed Description
Other advantages and effects of the present invention will become apparent to those skilled in the art from the following disclosure, which describes the embodiments of the present invention with reference to specific examples. The invention may be practiced or carried out in other embodiments that depart from the specific details, and the details of the present description may be modified or varied from the spirit and scope of the present invention. It should be noted that the following embodiments and features in the embodiments may be combined with each other without conflict. It is also to be understood that the terminology used in the examples of the invention is for the purpose of describing particular embodiments only, and is not intended to limit the scope of the invention. The test methods in the following examples, in which specific conditions are not noted, are generally conducted under conventional conditions or under conditions recommended by the respective manufacturers.
Please refer to fig. 1 to 11. It should be understood that the structures, proportions, sizes, etc. shown in the drawings are for illustration purposes only and should not be construed as limiting the invention to the extent that it can be practiced, since modifications, changes in the proportions, or otherwise, used in the practice of the invention, are not intended to be critical to the essential characteristics of the invention, but are intended to fall within the spirit and scope of the invention. Also, the terms such as "upper," "lower," "left," "right," "middle," and "a" and the like recited in the present specification are merely for descriptive purposes and are not intended to limit the scope of the invention, but are intended to provide relative positional changes or modifications without materially altering the technical context in which the invention may be practiced.
The invention provides a vehicle-mounted holographic imaging device and a display system, and relates to the technical field of display. The invention can collect external image information and generate corresponding marks at corresponding distances according to the external image information. The invention reconstructs images in a multi-depth virtual image plane, namely the virtual image generated by the vehicle-mounted holographic display system can be controlled to be generated in the depth of field covered by the distance plane of the real scene, so as to ensure that human eyes can fully fuse the virtual image with the real scene. Among them, the in-vehicle holographic display system may be provided in an instrument desk of a vehicle, and a holographic reproduction image generated by the in-vehicle holographic display system may be reflected to human eyes through a windshield or a screen and form a virtual image. It should be noted that the "vehicle" here refers to a vehicle provided with an in-vehicle hologram display system, the hologram reproduction image is a three-dimensional stereoscopic image of an object obtained by reproducing the object by using a hologram technique, and the three-dimensional stereoscopic image can be seen at an eye box region 60 of the in-vehicle hologram display system; and in other areas, the three-dimensional stereo image can not be seen or seen is blurred. Thus, when the driver's eyes are located in the eyebox area 60, the image information generated by the in-vehicle holographic display system may enter the eyes, i.e., the driver may observe the holographic reconstructed image generated by the in-vehicle holographic display system.
Referring to fig. 1, in one embodiment of the present invention, an in-vehicle holographic imaging apparatus may include a projection imaging assembly 10, a scattering array assembly 20, a first reflective element 30, and a second reflective element 40. The projection imaging assembly 10 is operable to generate a laser beam for illumination and to generate real image light. The scattering array component 20 may be disposed at an emitting end of the projection imaging component 10, and may be used to perform scattering imaging on real image light to generate a plurality of real image projections. The scattering array assembly 20 may include a plurality of imaging plane units sequentially arranged along a propagation path of real image light, performing scattering imaging on the real image light to generate a plurality of real image projections; the first reflective element 30 may be disposed on an extension of the projection imaging assembly 10 to the scattering array assembly 20, and the first reflective element 30 may be configured to reflect a plurality of real image projections. The second reflecting element 40 may be disposed in the concave opening direction of the first reflecting element 30, and is configured to reflect the plurality of real images to the eye-box area 60 to generate a plurality of virtual images.
Referring to FIG. 1, in one embodiment of the present invention, a projection imaging assembly 10 may include a light source 11, a collimating lens 12, a speckle attenuator 13, and a spatial light modulator 14. Among them, the light source 11 may be used to generate a laser beam, and the collimator lens 12, the speckle attenuator 13, and the spatial light modulator 14 may be arranged in order along the propagation path of the laser beam. The light source 11 may be a red, green, and blue three-color laser light source or a three-color LED (light-emitting diode) light source, and the light source 11 is required to have coherence or partial coherence. Thus, a laser beam can be generated by the light source 11. A collimator lens 12 may be located on one side of the light source 11, which may be used to collimate the divergent light beam generated by the light source 11 to form a parallel collimated light beam. The speckle attenuator 13 may be located between the collimator lens 12 and the spatial light modulator 14, and the laser beam may enter the speckle attenuator 13 along a propagation path to make noise reduction, and then be incident into the spatial light modulator 14. After the laser beam enters the speckle attenuator 13, the speckle attenuator 13 can allow for dynamic diffusion of the laser beam to eliminate local interference in the laser system and greatly reduce speckle noise. It is noted that the spatial light modulator 14 is a device for modulating the amplitude or phase or complex amplitude of a light beam to generate a holographic image at an arbitrary depth in space. The laser beam generated by the light source 11 is collimated by the collimator lens 12 and noise-reduced by the speckle attenuator 13, and then irradiated onto the spatial light modulator 14, thereby forming a real image beam. In the present embodiment, the spatial light modulator 14 may include one of a digital micromirror device, a liquid crystal display, an amplitude type liquid crystal on silicon, and a phase type liquid crystal on silicon, or a combination of the devices thereof, but the present invention is not limited thereto, and the present invention may allow determination according to practical situations. Thus, the position of the virtual image generated by the in-vehicle holographic imaging device can be adjusted by the spatial light modulator 14, realizing a holographically enhanced display.
Referring to FIG. 1, in one embodiment of the present invention, a scattering array assembly 20 may include a plurality of imaging plane elements and an activation circuit. The imaging plane units may be sequentially arranged along a propagation path of the real image light. The activation circuit may be electrically connected to each imaging plane unit, which may be used to adjust the scattering diffusion angle of each imaging plane unit, i.e. to adjust the transparency of the imaging plane unit. Therefore, the imaging plane units can be used for receiving real image light to perform scattering imaging, and the virtual image corresponding to each imaging plane unit is located at different depth of field.
Referring to fig. 2 to 3, in an embodiment of the present invention, fig. 2 is a schematic diagram showing a first active mode of the scattering array assembly 20, and fig. 3 (a), (b), and (c) are schematic diagrams showing activation circuits of the first imaging plane unit 21, the second imaging plane unit 22, and the third imaging plane unit 23 in the current first active mode sequentially. When the block is in an opaque state, the activating circuit displays 0, namely the block is in a power-off state; when the block is in the transparent state, the activation circuit is shown as 1, i.e., the block is in the power-on state.
Referring to fig. 4 to 5, in an embodiment of the present invention, fig. 4 is a schematic diagram showing a second active mode of the scattering array assembly 20, and fig. 5 (a), (b), and (c) are schematic diagrams showing activation circuits of the first imaging plane unit 21, the second imaging plane unit 22, and the third imaging plane unit 23 in the current second active mode sequentially.
Referring to fig. 2 to 5, in an embodiment of the present invention, each imaging plane unit may be divided into a plurality of blocks according to a predetermined block manner. For example, the imaging plane unit may be divided into 3*3 blocks, and 3 of the imaging plane units form the scattering array assembly 20, so that a three-dimensional holographic display of 3×3 arrays may be realized. Each imaging plane unit is connected with an activation circuit, so that the size of a diffusion angle of each block can be controlled, and each block is controlled to be in a transparent or opaque state.
Referring to fig. 2 to 5, in one embodiment of the present invention, the scattering array component 20 may include a first imaging plane unit 21, a second imaging plane unit 22, a third imaging plane unit 23, and an activation circuit. The first imaging plane unit 21, the second imaging plane unit 22, and the third imaging plane unit 23 may be sequentially arranged along the real image light propagation path, and may be connected to the activation circuits, respectively.
In this embodiment, the real image light generated by the projection imaging assembly 10 is allowed to enter the scattering array assembly 20. When the real image light enters the scattering array assembly 20, the scattering array assembly 20 can perform scattering imaging on the real image light. Specifically, the real image light generated by the projection imaging assembly 10 may be allowed to enter the scattering array assembly 20. Therefore, after the laser beam enters the scattering array assembly 20, the scattering array assembly 20 can control the diffusion angles of the corresponding blocks in the first imaging plane unit 21, the second imaging plane unit 22 and the third imaging plane unit 23 respectively through the activation circuit, so that a certain block of a certain imaging plane unit is in an opaque state, and the block can perform scattering imaging on the real image light. Therefore, the real image light generated by the projection imaging assembly 10 can be scattered and imaged at any area of any imaging plane unit, and the imaged real image projection is reflected by the first reflective element 30 and the second reflective element 40, so that projection imaging at different positions at different depths can be realized.
Referring to fig. 1, in one embodiment of the present invention, the first reflective element 30 may be an imaging lens, specifically, a reflective concave mirror or a holographic optical element lens, but is not limited thereto. The first reflective element 30 may receive the real image projections generated by the scattering array assembly 20 and reflect them; thereby reflecting the real image projection to the second reflective element 40. The real image projection is then reflected by the second reflective element 40 to the box region 60. When the driver's eyes are located at the eyebox area 60, the virtual image projection 50 is clearly viewable, and the virtual image projection 50 is located outside the second reflective element 40, i.e., outside the vehicle windshield. The virtual image projection 50 is an enlarged and upright virtual image. The virtual images formed by the different imaging plane elements of the scattering array assembly 20 may be located at virtual image planes of different depths of field. In this embodiment, the generated virtual image projection 50 may include a first virtual image 51, a second virtual image 52, and a third virtual image 53 corresponding to the first imaging plane unit 21, the second imaging plane unit 22, and the third imaging plane unit 23. Meanwhile, the virtual image projection 50 can be integrated with the real scene in front of the vehicle in a virtual-real manner, and because a plurality of virtual images are positioned at different depth of field, the virtual image projection 50 can be integrated with the real scenes at different distances, so that the observation difficulty of a driver is reduced, and the driving safety is improved.
Referring to fig. 1, in an embodiment of the present invention, the first imaging plane unit 21, the second imaging plane unit 22 and the third imaging plane unit 23 form a first virtual image 51, a second virtual image 52 and a third virtual image 53. Wherein the method comprises the steps ofDepth of field of the first virtual image 51, the second virtual image 52, and the third virtual image 53 may be v 1 、v 2 、v 3 . The distances from the first imaging plane unit 21, the second imaging plane unit 22 and the third imaging plane unit 23 to the first reflecting element 30 are u 1 、u 2 、u 3 . From Gaussian imaging formulas
Figure BDA0004154987050000091
Wherein f is the focal length of the first reflecting element 30, and the value thereof can be correspondingly adjusted by changing different imaging concave mirrors according to actual needs.
Referring to fig. 1, in one embodiment of the present invention, the focal length f of the first reflective element 30, the distances u from the first imaging plane unit 21, the second imaging plane unit 22, and the third imaging plane unit 23 to the first reflective element 30 are known 1 、u 2 、u 3 . According to the Gaussian imaging formula, the distances v of the first virtual image 51, the second virtual image 52 and the third virtual image 53 from the eye box region 60 can be obtained 1 、v 2 、v 3 I.e. the depth of field of the plane in which the 3 virtual images lie. From this, the depth of field range of the plane in which each virtual image is located can be calculated, and the depth of field range of the plane can satisfy the following formula:
Figure BDA0004154987050000101
Figure BDA0004154987050000102
wherein DeltaS 1 Representing the depth of field, ΔS, of the plane in which the virtual image lies 2 Represents the back depth of field of the plane in which the virtual image is located, v represents the depth of field of the plane in which the virtual image is located, sigma represents the allowable speckle diameter, F represents the aperture value of the human eye, F p Representing the focal length value of the human eye. It is thus obtained that the human eye plane is taken as the origin to move forward of the vehicleThe external direction of the windshield is a positive direction, and the depth of field range of the plane where the virtual image is located can satisfy the following conditions:
the depth of field of the plane in which the first virtual image 51 lies is in the range of
Figure BDA0004154987050000103
The second virtual image 52 has a depth of field in the plane of
Figure BDA0004154987050000104
The depth of field of the plane in which the third virtual image 53 lies is in the range of
Figure BDA0004154987050000105
The depth of field of the plane of the n-1 virtual image is in the range of
Figure BDA0004154987050000106
The depth of field of the plane where the nth virtual image is located is in the range of
Figure BDA0004154987050000107
In order to make the depth of field of the plane of each virtual image in the virtual image projection 50 continuous, the present invention requires that the rear depth of field of the plane of the n-1 th virtual image is equal to the front depth of field of the plane of the n-th virtual image, i.e. the depth of field of the planes of the two adjacent virtual images satisfies the following formula:
Figure BDA0004154987050000108
referring to fig. 6, in one embodiment of the present invention, the scattering array element 20 may be further configured as a 4 x 4 array, a 5 x 5 array, however, the present invention is not limited thereto, and may be extended to an array of imaging plane cells of m×n×l. The extended scattering array elements 20 may be arranged in accordance with the principles described above. In the imaging plane area of the virtual image projection 50, the depth of field of the adjacent two planes is continuous in the plane where the L virtual images are located, namely the n-1 th virtual image imaging is satisfiedThe back depth of field of the planar element is equal to the front depth of field of the nth virtual image imaging planar element. According to the depth v of the plane in which the L virtual images lie 1 、v 2 …v L The distance u from the first reflective element 30 corresponding to the L imaging plane units in the corresponding relay imaging region can be obtained by Gaussian imaging formula 1 、u 2 …u L
Referring to fig. 7, in an embodiment of the present invention, the present invention further provides an in-vehicle holographic display system, which may include a projection imaging assembly 10, a scattering array assembly 20, a first reflective element 30, a second reflective element 40, a camera module 70, and a control module 80. Wherein the camera module 70 may be used to capture front view image information of the vehicle. The control module 80 may be electrically connected to the camera module 70, and may be used to identify a preset key object in the front view image information to generate the identification image information. The projection imaging assembly 10 may be electrically connected to the control module 80, and the control module 80 may control the projection imaging assembly 10 to generate real image light. The scattering array assembly 20 may be disposed at an emitting end of the real image light, and the scattering array assembly 20 may be electrically connected to the control module 80. Control module 80 may control scatter array assembly 20 to scatter image real image light to produce a plurality of real image projections. The first reflective element 30 may be disposed on an extension of the projection imaging assembly 10 to the scattering array assembly 20. The first reflective element may be used to reflect the real image projection. The second reflecting element 40 may be disposed in the concave opening direction of the first reflecting element 30, and may be used to reflect the real image projection to the eye box area 60, so as to generate a plurality of virtual images.
In one embodiment of the present invention, the specific structures of the projection imaging assembly 10, the scattering array assembly 20, the first reflective element 30 and the second reflective element 40 may refer to the specific embodiments described above, and the application of the respective parts to the present vehicle-mounted holographic display system also has the technical effects described above.
Referring to fig. 7, in an embodiment of the present invention, the camera module 70 may be disposed at an upper portion of a front windshield or a front grille of a vehicle, and the collected image in front of the vehicle includes various static elements or dynamic elements of a front road, and the system may identify and mark preset key objects.
Referring to fig. 8 and 9, in one embodiment of the present invention, the control module 20 performs an identification and marking process on the acquired front view image, and the generated identification image information may include the type, position and imaging depth of the identification image. Specifically, first, the key objects in the front view image, such as the vehicle and the lane lines in fig. 9, may be identified according to the preset key objects; then, identification images of the identified key objects, for example, a vehicle profile identification 91 and a navigation identification 92 in fig. 9, are generated; and generating a location and an imaging depth identifying the image. The identification image is located at the corresponding position of the identified key object, that is, each area divided by the imaging plane unit according to the above-mentioned partitioning manner, for example, the vehicle contour identifier 91 may be located in the same area of the identified vehicle, and the navigation identifier 92 may be located in the area of the identified lane line corresponding to the direction. The imaging depth of the identification image is then related to the depth of field of the eye box region 60 according to the corresponding key object.
Referring to fig. 7, in one embodiment of the present invention, the control module 80 may include a content recognition unit 81, an identification generation unit 82, and a display control unit 83. Wherein the content recognition unit 81 may be configured to recognize a key object in the front view image information and acquire edge coordinate information and distance information of the key object. The identification generation unit 82 may be configured to generate an identification image of the key object, and calculate identification image information for generating the identification image based on the edge coordinate information and the distance information. The display control unit 83 is operable to control the projection imaging assembly and the scattering array assembly to generate a plurality of real image projections based on the identification image information.
Referring to fig. 8 to 11, in one embodiment of the present invention, first, the content recognition unit 81 may perform an equal-scale scaling process on the front image to scale the front image to the same size as the imaging plane unit in the scattering array assembly 20; the system may then divide the forward-looking image according to the blocking manner of the imaging plane unit. In this embodiment, the system sets the partitioning method to be 3*3 equal-partition. But is not limited toHere, the imaging plane unit may be divided into 4*4 blocks, 5*5 blocks, and m×n blocks. Then, the content recognition unit 81 detects front view image information of the front of the vehicle acquired by the image capturing module 10, locates the edge of the area where the key object to be identified is detected, and records its coordinates as (x, y, z). In the scattering array assembly 20, the imaging plane unit can be set to have a side length d in the x-direction and a side length e in the y-direction, thereby obtaining
Figure BDA0004154987050000121
Namely, the block position where the identification key object is located. Meanwhile, the content recognition unit 81 detects the key object distance and calculates the distance to the plane in which the eye-box area 60 is located. The edge coordinate information (x, y) and the distance information z of the key object can be obtained in the above manner.
In one embodiment of the present invention, the identification generation unit 82 generates a corresponding identification image according to the identified key object. The coordinates of the region edge points identifying the key object can then be determined
Figure BDA0004154987050000131
Rounding up, recorded as->
Figure BDA0004154987050000132
So that the block coordinates of the edge of this identification image in the scattering array assembly 20 are obtained. Meanwhile, the position data u of the imaging plane unit can be obtained by comparing the depth of field range of the plane where the virtual image is located. Firstly, performing distance sensing on a key object to be identified to obtain the actual distance from the key object to the eye box area 60 in the real world, and recording the actual distance as z; and then, judging which plane depth of field the real object is located in according to the plane depth of field range of the virtual image corresponding to different imaging plane units in the scattering array component 20. Position data of the imaging plane unit identifying the imaging of the key object, i.e. the distance between the imaging plane unit and the first reflective element 300, can thereby be obtained. For example, the depth of field of an external critical object to be identified
Figure BDA0004154987050000133
Figure BDA0004154987050000134
Then z=v 1 And by the gaussian imaging formula: />
Figure BDA0004154987050000135
The value of u in the identification coordinates may be determined in such a way that identification image information is generated.
In one embodiment of the present invention, the display control unit 83 may control the projection imaging assembly and the scattering array assembly in a plurality of imaging plane units according to the processing result of the front view image acquired by the image capturing module 70
Figure BDA0004154987050000136
The corresponding blocks are activated to realize projection imaging at different positions at different depths, and a plurality of virtual images are generated.
It should be noted that in the above steps, after the system collects the front view image and measures the distance, the front view image is compared with the dividing mode of the scattering array component 20 set by the system to determine the positions of the blocks in the imaging plane unit where the different identification images are located and the number of the occupied blocks, if the identification images corresponding to the key objects with different distances occupy the same block, the processing can be performed according to the following rule:
if two identification images occupy the same block, but are not overlapped with each other, and the distance between the two identification images in the real world object is within the depth of field of one of the virtual image planes set by the system, the two identification images are divided into the objects in the same plane, and the two identification images can share the same block.
If two identification images occupy the same block, but are not overlapped with each other, and the distance in the real world object is not outside the depth of field of one of the virtual image planes set by the system, the two identification images are divided into different plane objects, and at the moment, the identification images are prioritized according to the identification content, the display distance and the identification size. The priorities include and are not only: content of identification > display distance > identification size. The user can set the priority order according to different conditions, and when the priorities are the same, the user can compare the priorities. The block is occupied by the identification image with higher priority, and other identification images with lower priority positioned in the block are subjected to equal ratio shrinkage until the identification with higher priority is displayed. In addition, when the priorities are the same, the lower priority comparison is performed.
In summary, the invention provides a vehicle-mounted holographic imaging device and a display system, which can be applied to the technical field of display. The invention can record and realize the reconstructed complete light field information and reconstruct the image at any depth. The invention realizes the imaging of different areas and different depths of holographic imaging through the imaging plane units distributed in the three-dimensional array. Meanwhile, for the distance measurement of actual objects with different required marks, the depth of field range of the virtual image plane where the mark image is located can be compared, and the corresponding imaging plane unit where the mark image is located is selected, so that the virtual image mark image and the actual image are fused more harmoniously. The invention can also realize expansion of the depth of field range of the virtual image by increasing the number of imaging plane units of the scattering array component so as to improve the fusion degree of virtual image identification and reality, thereby improving driving safety. Therefore, the invention effectively overcomes various defects in the prior art and has high industrial utilization value.
The above embodiments are merely illustrative of the principles of the present invention and its effectiveness, and are not intended to limit the invention. Modifications and variations may be made to the above-described embodiments by those skilled in the art without departing from the spirit and scope of the invention. Accordingly, it is intended that all equivalent modifications and variations of the invention be covered by the claims, which are within the ordinary skill of the art, be within the spirit and scope of the present disclosure.

Claims (10)

1. An in-vehicle holographic imaging apparatus, comprising:
the projection imaging assembly is used for generating real image light rays;
the scattering array component is arranged at the transmitting end of the projection imaging component and comprises a plurality of imaging plane units, and the imaging plane units are sequentially arranged along the propagation paths of the real image light rays and are used for scattering imaging the real image light rays so as to generate a plurality of real image projections;
the first reflection element is arranged on the extension line of the projection imaging assembly and the scattering array assembly and is used for reflecting a plurality of real image projections; and
the second reflecting element is arranged on one side of the concave opening of the first reflecting element and is used for projecting and reflecting a plurality of real images to the eye box area so as to generate a plurality of virtual images;
wherein the virtual image generated by each imaging plane unit is located at a different depth of field.
2. The in-vehicle holographic imaging device of claim 1, in which the scatter array assembly further comprises:
and the activation circuit unit is electrically connected with each imaging plane unit and is used for adjusting the scattering diffusion angle of each imaging plane unit.
3. The in-vehicle holographic imaging apparatus of claim 2, wherein each of said imaging plane units is divided into a plurality of tiles, and said activation circuit unit independently adjusts a scattering diffusion angle of each of said tiles to control a transparency of each of said tiles.
4. The vehicle-mounted holographic imaging arrangement of claim 1, wherein the projection imaging assembly comprises a light source, a collimating lens, a speckle attenuator, and a spatial light modulator, wherein the light source is configured to produce a laser beam, and wherein the collimating lens, the speckle attenuator, and the spatial light modulator are sequentially arranged along a propagation direction of the laser beam.
5. The in-vehicle holographic imaging device of claim 1, in which the positional relationship between the imaging plane unit and the corresponding virtual image projection satisfies the following formula:
Figure FDA0004154987030000021
wherein f represents the focal length of the first reflecting element, u represents the distance between the imaging plane unit and the first reflecting element, and v represents the depth of field of the plane on which the virtual image is projected.
6. The in-vehicle holographic imaging device of claim 5, in which the depth of field of the plane in which adjacent two of the virtual images are projected satisfies the following equation:
Figure FDA0004154987030000022
wherein v is n-1 Representing depth of field, v, of plane in which the n-1 th virtual image is projected n Represents depth of field of the plane in which the nth virtual image is projected, sigma represents allowable diffuse spot diameter, F represents aperture value of human eye, F p Representing the focal length value of the human eye.
7. The in-vehicle holographic imaging device of claim 1, in which the first reflective element is a reflective concave mirror or a holographic optical element lens.
8. An in-vehicle holographic display system, comprising:
the camera module is used for collecting a forward-looking image of the vehicle;
the control module is electrically connected with the camera module and used for identifying a preset key object in the front-view image so as to generate an identification image;
the control module controls the projection imaging assembly to generate real image light rays of the identification image;
the scattering array component is arranged at the transmitting end of the projection imaging component and comprises a plurality of imaging plane units, the imaging plane units are sequentially arranged along the propagation path of the real image light, and the control module controls the scattering array component to perform scattering imaging on the real image light so as to generate a plurality of real image projections;
the first reflection element is arranged on an extension line from the projection imaging component to the scattering array component and is used for reflecting the real image projection; and
the second reflecting element is arranged in the opening direction of the concave surface of the first reflecting element and is used for reflecting the real image projection to the eye box area so as to generate a plurality of virtual image projections;
wherein the virtual image generated by each imaging plane unit is located at a different depth of field.
9. The vehicle mounted holographic display system of claim 8, in which the control module is configured to scale the front view image into an intermediate image and divide the intermediate image into a plurality of tiles uniformly in accordance with the division of the imaging plane units;
the control module identifies the intermediate image to generate the identification image of the key object, and acquires edge coordinate information (x, y) and distance information z of the key object;
the control module generates coordinates of the block occupied by the identification image according to the edge coordinate information (x, y) and the distance information z
Figure FDA0004154987030000031
Wherein d represents the longitudinal side length of the imaging plane unit, e represents the transverse side length of the imaging plane unit, and u represents the position data of the imaging plane unit occupied by the block.
10. The in-vehicle holographic display system of claim 8, in which the control module comprises:
the content identification unit is used for identifying the key object in the front-view image and acquiring edge coordinate information and distance information of the key object;
the identification generating unit is used for generating an identification image of the key object and calculating and generating identification image information of the identification image according to the edge coordinate information and the distance information; and
and the display control unit is used for controlling the projection imaging assembly and the scattering array assembly to generate a plurality of real image projections according to the identification image information.
CN202310331067.2A 2023-03-30 2023-03-30 Vehicle-mounted holographic imaging device and display system Pending CN116243491A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310331067.2A CN116243491A (en) 2023-03-30 2023-03-30 Vehicle-mounted holographic imaging device and display system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310331067.2A CN116243491A (en) 2023-03-30 2023-03-30 Vehicle-mounted holographic imaging device and display system

Publications (1)

Publication Number Publication Date
CN116243491A true CN116243491A (en) 2023-06-09

Family

ID=86629663

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310331067.2A Pending CN116243491A (en) 2023-03-30 2023-03-30 Vehicle-mounted holographic imaging device and display system

Country Status (1)

Country Link
CN (1) CN116243491A (en)

Similar Documents

Publication Publication Date Title
CN109309828B (en) Image processing method and image processing apparatus
WO2022052112A1 (en) Head-up display device, head-up display method, and vehicle
US20080192312A1 (en) Holographic information display
JPH07270711A (en) Information display device
JP2018205446A (en) Display system, electronic mirror system and mobile body equipped with the same
KR102509086B1 (en) Holographic head up display device
US20220013046A1 (en) Virtual image display system, image display method, head-up display, and moving vehicle
KR102305917B1 (en) Multiple viewing angle monitor system using magnified diffraction reflection
JP2023525844A (en) Multifocal plane image generation device, head-up display device, related methods and devices
JP7350777B2 (en) heads up display
CN116243491A (en) Vehicle-mounted holographic imaging device and display system
JP7000167B2 (en) Image display device
JP6726883B2 (en) Display system, moving body, and control method for display system
CN112824968A (en) Projection apparatus and method
JPH0618810A (en) Display device
RU2371745C2 (en) Method of displaying information on vehicle windscreen
JPH10149085A (en) Holographic display device
JP7178637B2 (en) Virtual image display system, head-up display, and moving object
JP7178638B2 (en) Electronic mirror system and moving object
CN115576111B (en) AR display device
CN114815241B (en) Head-up display system and method and vehicle-mounted system
JP7475107B2 (en) ELECTRONIC MIRROR SYSTEM, IMAGE DISPLAY METHOD, AND MOBILE BODY
CN214751108U (en) Vehicle-mounted imaging device based on MEMS array
CN112764219B (en) Head-up display system and application thereof
JP5333779B2 (en) Head-up display device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination