WO2024257771A1 - 空中像表示装置 - Google Patents
空中像表示装置 Download PDFInfo
- Publication number
- WO2024257771A1 WO2024257771A1 PCT/JP2024/021244 JP2024021244W WO2024257771A1 WO 2024257771 A1 WO2024257771 A1 WO 2024257771A1 JP 2024021244 W JP2024021244 W JP 2024021244W WO 2024257771 A1 WO2024257771 A1 WO 2024257771A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- aerial image
- concave mirror
- optical axis
- display device
- imaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/50—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a three-dimensional [3D] volume, e.g. voxels
- G02B30/56—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a three-dimensional [3D] volume, e.g. voxels by projecting aerial or floating images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
Definitions
- This disclosure relates to an aerial image display device.
- Patent Document 1 An aerial image display device as described in Patent Document 1 is known.
- the aerial image display device of the present disclosure is an aerial image display device including a display unit and an optical system that forms an image light emitted from the display unit into a real aerial image,
- the ratio of the half width to the quarter width of the peak value is 0.5 or more.
- 1 is a cross-sectional view showing a configuration of an aerial image display device according to an embodiment of the present disclosure.
- 11 is a cross-sectional view showing a configuration of an aerial image display device according to another embodiment of the present disclosure.
- 1 is a graph showing an example of a modulation transfer function.
- 13 is a graph showing the relationship between the MTF area S1 of an aerial image formed by an optical system and the sharpness of the luminance distribution waveform of the aerial image (width ratio W/Q: (half width)/(quarter width)) when the F-number of the imaging device is 3.
- FIG. 13 is a graph showing the relationship between the MTF area S1 of an aerial image formed by an optical system and the sharpness of the luminance distribution waveform of the aerial image (width ratio W/Q: (half width)/(quarter width)) when the F-number of the imaging device is 8.
- 2 is a diagram showing an example of an aerial image visually recognized by a user of the aerial image display device of FIG. 1 .
- 4A and 4B are diagrams for explaining the definition of the curvature of a first concave mirror.
- 1 is a perspective view showing a measurement system for calculating a modulation transfer function of an aerial image formed by an aerial image display device.
- FIG. FIG. 13 is a diagram showing an example of a test pattern for calculating a modulation transfer function.
- FIG. 2 is a diagram showing a captured image of a test pattern captured by an imaging device.
- 4 is a partial enlarged view showing an image of a test pattern captured by an imaging device.
- FIG. 11 is a graph showing a luminance distribution waveform calculated from the captured image of FIG. 10 .
- FIG. 13 is a diagram showing another example of the test pattern for calculating the modulation transfer function.
- 4 is a partial enlarged view showing an image of a test pattern captured by an imaging device.
- FIG. 11A and 11B are side views illustrating a defocus operation for the imaging apparatus.
- 1 is a partial enlarged view showing an example of a captured image of a test pattern captured by an imaging device
- 1 is a partial enlarged view showing an example of a captured image of a test pattern captured by an imaging device;
- FIG. 2 is a diagram showing an example of a captured image of a test pattern captured by an imaging device.
- 1 is a graph showing the focal position of each imaging region.
- FIG. 20 is a diagram for explaining the optical axis shift corresponding to the graph in FIG. 18 .
- 1 is a graph showing the focal position of each imaging region.
- FIG. 21 is a diagram for explaining the optical axis deviation corresponding to the graph in FIG. 20 .
- 1A and 1B are diagrams illustrating a rotation operation for the imaging device.
- Conventional aerial image display devices are configured to focus the image light emitted from the display panel as a real aerial image using optical components such as polarizing filters and beam splitters. Conventional aerial image display devices can sometimes result in reduced resolution and brightness of the aerial image.
- the drawings referred to below are schematic. The dimensional ratios and the like in the drawings do not necessarily correspond to the actual ones.
- a Cartesian coordinate system XYZ is defined in some of the drawings.
- the X-axis direction is also referred to as the first direction or height direction.
- the Y-axis direction is also referred to as the second direction or width direction (horizontal direction, lateral direction).
- the Z-axis direction is also referred to as the third direction or depth direction.
- FIGS. 1 to 22 are diagrams or graphs illustrating an aerial image display device according to one embodiment of the present disclosure.
- the second band-shaped image black image
- FIGS. 8 to 10, 12, 13, and 15 to 17 the second band-shaped image (black image) is shown at a higher brightness than its actual brightness to facilitate illustration.
- the aerial image display device 2 includes a display unit 3 and an optical system 5.
- the display unit 3 includes a display panel 4.
- the display panel 4 has a display surface 4a, and displays an image that is formed as an aerial image R on the display surface 4a. That is, the display panel 4 emits image light Lp that is formed as an aerial image R from the display surface 4a.
- the display panel 4 may be a transmissive display panel or a self-luminous display panel. If the display panel 4 is a transmissive display panel, the display unit 3 may include an illuminator such as a backlight. If the display panel 4 is a self-luminous display panel, the display unit 3 does not need to include an illuminator.
- the transmissive display panel may include a liquid crystal panel.
- the transmissive display panel may have a known liquid crystal panel configuration.
- various liquid crystal panels such as IPS (In-Plane Switching) type, FFS (Fringe Field Switching) type, VA (Vertical Alignment) type, ECB (Electrically Controlled Birefringence) type, etc. may be used.
- the transmissive display panel includes MEMS (Micro Electro Mechanical Systems) shutter type display panels.
- the self-luminous display panel may include a plurality of self-luminous elements.
- various self-luminous elements such as LEDs (Light Emitting Diodes), organic EL (Electro Luminescence), inorganic EL, etc. may be used.
- the optical system 5 focuses the image light Lp emitted from the display unit 3 into a real aerial image R.
- the optical system 5 may be composed of a reflective member such as a concave mirror or a convex mirror. As shown in FIG. 1, the optical system 5 may be composed of a first concave mirror 5a, a convex mirror 5b, and a second concave mirror 5c.
- the first concave mirror 5a is configured to reflect the image light Lp emitted from the display unit 3 in a direction different from the direction toward the display unit 3.
- the first concave mirror 5a may be a free-form concave mirror.
- the first concave mirror 5a is not limited to being a free-form concave mirror, and may be a spherical concave mirror or an aspherical concave mirror.
- the convex mirror 5b is configured to reflect the image light Lp reflected by the first concave mirror 5a in a direction different from the direction toward the first concave mirror 5a.
- the convex mirror 5b may be a free-form convex mirror.
- the convex mirror 5b is not limited to being a free-form convex mirror, and may be a spherical convex mirror or an aspherical convex mirror.
- the second concave mirror 5c is configured to reflect the image light Lp reflected by the convex mirror 5b in a direction different from the direction toward the convex mirror 5b, forming an aerial image R.
- the second concave mirror 5c may be a free-form concave mirror.
- the second concave mirror 5c is not limited to being a free-form concave mirror, and may be a spherical concave mirror or an aspherical concave mirror.
- the aerial image display device 2 may be configured such that the first concave mirror 5a and the second concave mirror 5c face each other in a tilted state, the display panel 4 is located between the first concave mirror 5a and the second concave mirror 5c, and the tilt of the display surface 4a of the display panel 4 with respect to the reflecting surface (also called the first reflecting surface) 5ar of the first concave mirror 5a is smaller than the tilt of the display surface 4a of the display panel 4 with respect to the reflecting surface (also called the second reflecting surface) 5cr of the second concave mirror 5c.
- the aerial image display device 2 Since the first concave mirror 5a and the second concave mirror 5c face each other in a tilted state, and the display panel 4 is located between the first concave mirror 5a and the second concave mirror 5c, the aerial image display device 2 is made smaller. In particular, the vertical dimension of the aerial image display device 2 (X-axis direction in FIG. 1) is reduced.
- the display surface 4a of the display panel 4 and the first reflecting surface 5ar of the first concave mirror 5a become nearly parallel.
- the angle of incidence of the light beam of the image light Lp emitted from the display surface 4a with respect to the first reflecting surface 5ar becomes smaller, and the distortion of the aerial image R can be reduced and the brightness of the aerial image R can be increased.
- the inclination of the display surface 4a of the display panel 4 with respect to the first reflecting surface 5ar of the first concave mirror 5a may be defined as an inclination angle between the display surface 4a (or a virtual surface 4ai including the display surface 4a in space) and a tangent plane (or a virtual surface 5ai including the tangent plane in space) that is in contact with the apex 5ap of the curvature of the first reflecting surface 5ar.
- the inclination of the display surface 4a of the display panel 4 with respect to the second reflecting surface 5cr of the second concave mirror 5c may be defined as the inclination angle between the display surface 4a (or a virtual surface 4ai in space that includes the display surface 4a) and a tangent plane (or a virtual surface 5ci in space that includes the tangent plane) that is tangent to the apex 5cp of the curvature of the second reflecting surface 5cr.
- the convex mirror 5b may be located between the first concave mirror 5a and the second concave mirror 5c.
- the optical system 5 of the aerial image display device 2 is made smaller.
- the vertical dimension of the optical system 5 is made smaller.
- the convex mirror 5b may be closer to the first concave mirror 5a and the second concave mirror 5c than the display panel 4.
- the optical system 5 of the aerial image display device 2 is made even smaller.
- the horizontal dimension of the optical system 5 (Z-axis direction in FIG. 1) is made smaller.
- the aerial image display device 2 is not limited to the configuration shown in FIG. 1.
- the optical system 5 may be composed of a first concave mirror 5d and a second concave mirror 5e, as shown in FIG. 2.
- the first concave mirror 5d is configured to reflect the image light Lp emitted from the display unit 3 in a direction different from the direction toward the display unit 3.
- the first concave mirror 5d may be a free-form concave mirror.
- the first concave mirror 5d is not limited to being a free-form concave mirror, and may be a spherical concave mirror or an aspherical concave mirror.
- the second concave mirror 5e is configured to reflect the image light Lp reflected by the first concave mirror 5d in a direction different from the direction toward the first concave mirror 5d, and form an aerial image R.
- the second concave mirror 5e may be a free-form concave mirror.
- the second concave mirror 5e is not limited to being a free-form concave mirror, and may be a spherical concave mirror or an aspherical concave mirror.
- the aerial image display device 2 may be configured such that the curvature of the first concave mirror 5d is greater than the curvature of the second concave mirror 5e, the first concave mirror 5d and the second concave mirror 5e face each other in a tilted state, and the display panel 4 is located between the first concave mirror 5d and the second concave mirror 5e. Since the curvature of the first concave mirror 5d is greater than the curvature of the second concave mirror 5e, the display panel 4 can be positioned closer to the first concave mirror 5d. As a result, the aerial image display device 2 is made smaller. In particular, the horizontal dimension of the aerial image display device 2 is reduced. Since the display panel 4 is located between the first concave mirror 5d and the second concave mirror 5e, the aerial image display device 2 is made even smaller. In particular, the vertical dimension of the aerial image display device 2 is reduced.
- the free-form surface that defines the reflecting surface of the free-form concave mirror and the reflecting surface of the free-form convex mirror may be an XY polynomial surface (also called an SPS XYP surface) defined by the following formulas (1) and (2).
- the XY polynomial surface is expanded into a polynomial of up to the 10th order that is added to the reference conic surface. Therefore, in formulas (1) and (2), the sum of m and n is 10 or less.
- z is the sag of the surface parallel to the z axis (optical axis)
- c is the vertex curvature
- k is the conic constant
- Cj is the coefficient of the monomial xmyn .
- the aerial image display device 2 may include a housing 6, as shown in Figures 1 and 2.
- Components 2a of the aerial image display device 2, such as the display unit 3 and the optical system 5, may be located within the housing 6.
- the components 2a may include a circuit board, wiring, cables, heat dissipation components such as a heat sink, a holding member for holding the optical system 5, an adjustment member for adjusting the position of the optical system 5, etc.
- the housing 6 may be made of, for example, a resin material, a metal material, a ceramic material, etc.
- At least a portion of the housing 6 that faces the user of the aerial image display device 2 is configured as an image light emitting section 6a.
- Image light Lp that is focused as an aerial image R is emitted from inside the housing 6 to outside the housing 6 via the image light emitting section 6a.
- the image light emitting section 6a may be configured to include, for example, a light-shielding film or light-shielding glass. In this case, when using the aerial image display device 2, it becomes difficult for the user 20 to see the components 2a located inside the housing 6, and the visibility of the aerial image R can be improved.
- the resolution of the aerial image R formed by the aerial image display device 2 can be represented by the luminance distribution waveform of the aerial image R.
- the imaging device 7 which is assumed to be the eye 20e of the user 20, can capture an aerial image R as shown in FIG. 9. Then, from a part of the captured image (see FIG. 10), a luminance distribution waveform as shown in FIG. 11 can be calculated. Note that FIG. 8 shows a test pattern 9 without blurring (resolution degradation).
- the luminance distribution waveform is approximately Gaussian in shape, and has a half-width W where the luminance is approximately 50% of the peak value H, and a quarter-width (hereinafter also referred to as half-width or quarter-width) Q where the luminance is approximately 25% of the peak value H.
- the resolution of the aerial image R is inferior to that of the test pattern 9 represented by a rectangular function due to the degradation of resolution caused by the optical system 5, but the closer the ratio (width ratio) W/Q of the half-width W to the half-width Q is to 1, the more the spread of the luminance distribution waveform can be suppressed and the more the degradation of the resolution of the aerial image R can be reduced.
- the aerial image display device 2 is configured so that the width ratio W/Q is 0.68 or more, and therefore the degradation of the resolution can be suppressed.
- the resolution of the aerial image R can also be expressed by the modulation transfer function (MTF).
- the modulation transfer function is a performance index for evaluating the resolution of the optical system 5, and can be used as a resolution index for comparing the high and low resolution of the aerial image R.
- the modulation transfer function may be normalized so that the maximum value is 1. In this case, it can be said that the closer the value of the modulation transfer function is to 1, the higher the resolution of the optical system 5 (i.e., the resolution of the aerial image R).
- the value of the modulation transfer function itself may be used as the performance index of the optical system 5, but the resolution of the optical system 5 (i.e., the resolution of the aerial image R) can be evaluated with high accuracy by using the area obtained by integrating the modulation transfer function on the spatial frequency axis as the performance index of the optical system 5.
- the resolution of the optical system 5 is also degraded by manufacturing tolerances and positioning errors of the reflective members that make up the optical system 5.
- the aerial image R formed by the optical system 5 is an aerial image with degraded resolution compared to an ideal aerial image formed by an ideal optical system.
- An ideal optical system has the same configuration as the optical system 5, but has diffraction-limited resolution.
- An ideal optical system is an optical system in which degradation of resolution is limited only to the degradation that inevitably occurs due to the diffraction of light.
- An ideal aerial image formed by an ideal optical system is an aerial image in which degradation of resolution is theoretically minimized.
- FIG. 3 is a graph showing an example of a modulation transfer function.
- the modulation transfer function K1 of the aerial image R formed by the optical system 5 (hereinafter also referred to as the first modulation transfer function) is shown by a dashed line
- the modulation transfer function K2 of the ideal aerial image formed by the ideal optical system (hereinafter also referred to as the second modulation transfer function) is shown by a solid line.
- the first modulation transfer function K1 is smaller than the second modulation transfer function K2.
- the area S1 obtained by integrating the first modulation transfer function K1 on the spatial frequency axis (hereinafter also referred to as the MTF area) is smaller than the area S2 obtained by integrating the second modulation transfer function K2 on the spatial frequency axis, and the area ratio S1/S2 is smaller than 1. It can be said that the closer the area ratio S1/S2 is to 1, the higher the resolution of the aerial image R actually formed by the aerial image display device 2. For example, when the area ratio S1/S2 is 0.85 or more, it can be said that the degradation of the resolution of the aerial image R formed by the optical system 5 is reduced compared to the ideal aerial image formed by the ideal optical system.
- the second modulation transfer function K2 of the ideal aerial image formed by the ideal optical system may be calculated by simulation. Alternatively, the second modulation transfer function may be calculated based on image data obtained by the imaging device 7 capturing a simulated image that imitates the ideal aerial image.
- the aerial image display device 2 can suppress the spread of the luminance distribution waveform because the width ratio W/Q of the half-width W to the half-width Q is 0.68 or more. That is, the aerial image display device 2 can reduce the degradation of the resolution of the aerial image R.
- Figures 4A and 4B are graphs showing the relationship between the width ratio W/Q and the area ratio S1/S2.
- the numbers on the lower horizontal axis indicate the values of the area ratio S1/S2, and the values of the area S2 are 14.9 and 7.25, respectively.
- the aperture value of the imaging device 7 was set to 3
- the aperture value of the imaging device 7 was set to 8.
- FIG. 4B is a graph showing the relationship between the MTF area S1 of the aerial image R formed by the optical system 5 and the width ratio W/Q representing the sharpness of the luminance distribution waveform of the aerial image R when the F-number of the imaging device 7 is 8.
- the numerical value on the upper horizontal axis indicates the value of the MTF area S1.
- the luminance distribution waveform is also called the line spread function (LSF) shown in FIG. 11.
- W is the half-width of the LSF shown in FIG. 11
- Q is the 1 ⁇ 4 width of the LSF shown in FIG. 11.
- the width ratio W/Q is (half-width)/(1 ⁇ 4 width), which is the ratio of the half-width W to the 1 ⁇ 4 width Q of the line spread function as shown in FIG. 11.
- the contrast of the aerial image R is likely to be low because the area of the light receiving part (lens aperture) of the imaging device 7 is small. That is, the sharpness of the luminance distribution waveform decreases, and the value of the MTF area S1 of the aerial image R tends to become smaller overall.
- Figure 4A is a graph showing the relationship between the MTF area S1 of the aerial image R formed by the optical system 5 and the width ratio W/Q, which represents the sharpness of the luminance distribution waveform of the aerial image R, when the F-number (aperture value) of the imaging device 7 is 3.
- the numerical value on the upper horizontal axis indicates the value of the MTF area S1.
- the F-number of the imaging device 7 is 3
- the area of the light receiving part (lens aperture) of the imaging device 7 is large, so that the contrast of the aerial image R tends to be high. That is, the sharpness (W/Q) of the luminance distribution waveform increases, and the value of the MTF area S1 of the aerial image R tends to increase overall.
- S1 may be approximately 12.7 (S1/S2 is approximately 0.85) or more, in which case W/Q will be approximately 0.68 or more.
- the sharpness (W/Q) of the luminance distribution waveform drops sharply from about 0.68.
- the sharpness (W/Q) of the luminance distribution waveform is in the highest region of about 0.68 or more, and the sharpness (W/Q) of the luminance distribution waveform asymptotically approaches the sharpness (W/Q) of an ideal aerial image of about 0.7.
- S1 when S1 is about 6 or more, the sharpness (W/Q) of the luminance distribution waveform is an almost constant value that is close to the sharpness (W/Q) of an ideal aerial image. Therefore, S1 may be about 6 (S1/S2 is about 0.83) or more, in which case W/Q is about 0.68 or more.
- S1/S2 may be approximately 0.85 or more, that is, the width ratio W/Q of the sharpness of the luminance distribution waveform may be approximately 0.68 or more. Note that since the width ratio W/Q is less than 1, it may be approximately 0.68 or more and less than 1.
- the aerial image display device 2 can reduce the distortion of the aerial image R formed by the optical system 5 to 5% or less.
- FIG. 5 shows a simulation result of the aerial image R viewed by the user 20 of the aerial image display device 2 of FIG. 1.
- the aerial image R is shown as an aerial image with a lattice pattern, and coordinate axes indicating the direction and amount of distortion are shown.
- the solid line shows the aerial image R viewed by the user 20, and the dashed line shows a virtual aerial image IR without distortion.
- the distortion of the aerial image R can include distortion in the planar direction (direction parallel to the paper surface) and distortion in the depth direction (direction perpendicular to the paper surface), but FIG. 5 shows only distortion in the planar direction. Note that in FIG. 5, unlike FIGS. 1 and 2, the X-axis direction is the horizontal direction and the Y-axis direction is the height direction.
- distortion of the aerial image R is likely to occur on the outer periphery of the aerial image R, and distortion is particularly likely to be large at the four corners of the aerial image R (lower right corner LR, upper right corner UR, lower left corner LL, and upper left corner UL).
- Table 1 shows the distortion from the aerial image IR at the corners LR, UR, LL, and UL.
- the aerial image display device 2 can suppress distortion at the corners LR, UR, LL, and UL to within ⁇ 5%.
- the + (plus) direction of the X direction is the right direction in FIG. 5, and the - (minus) direction of the X direction is the left direction in FIG. 5.
- the + (plus) direction of the Y direction is the upward direction in FIG. 5, and the - (minus) direction of the Y direction is the downward direction in FIG. 5.
- the distortion of the aerial image R in each of the X and Y directions is a positive value when it is distorted outward from the aerial image IR, and a negative value when it is distorted inward from the aerial image IR.
- the outward direction in the X direction (rightward: expanding direction) is the + (plus) direction
- the inward direction in the X direction (leftward: shrinking direction) is the - (minus) direction
- the outward direction in the Y direction (downward: expanding direction) is the + (plus) direction
- the inward direction in the Y direction (upward: shrinking direction) is the - (minus) direction.
- the upper right corner UR, the lower left corner LL, and the upper left corner UL The same applies to the following tables showing distortion of the aerial image R.
- the distortion at the corners LR, UR, LL, and UL is calculated as follows.
- the distortion in the X direction at the corners LR, UR, LL, and UL is defined as the length of deviation in the X direction relative to the length LX of the top side (the bottom side is the same length as the top side) of the rectangular aerial image IR. Because the length of the bottom side of the aerial image IR is the same as the length LX of the top side, the length LX of the top side is used as the reference.
- the distortion in the X direction at the corner UR is defined as the length of deviation ⁇ XUR in the X direction from the upper right corner CUR of the aerial image IR relative to the length LX of the top side.
- the distortion in the X direction at the corner UR is defined as ( ⁇ XUR/LX) x 100 (%). Because the corner UR is distorted inward of the aerial image IR in the X direction, the value is - (negative). The distortion in the X direction at the corners LR, LL, and UL is defined similarly. If the aerial image IR has a shape other than rectangular, the reference length in the X direction may be the average length or the maximum length.
- the distortion in the Y direction of the corners LR, UR, LL, and UL is specified by the deviation length in the Y direction relative to the length LY of the right side (the left side is the same length as the right side) of the rectangular aerial image IR. Since the length of the left side of the aerial image IR is the same as the length LY of the right side, the length LY of the right side is used as the reference.
- the distortion in the Y direction of the corner UR is specified by the deviation length ⁇ YUR in the Y direction from the upper right corner CUR of the aerial image IR relative to the length LY of the right side. In other words, the distortion in the Y direction of the corner UR is specified by ( ⁇ YUR/LY) ⁇ 100(%).
- the corner UR is distorted inward of the aerial image IR in the Y direction, it has a negative (negative) value.
- the distortion in the Y direction of the corners LR, LL, and UL is specified in the same way. If the aerial image IR is a shape other than rectangular, the reference length in the Y direction may be the average length or the maximum length.
- the curvature Sa of the first concave mirror 5a may be about 0.35 to 0.45
- the curvature Sb of the convex mirror 5b may be about 0.15 to 0.25
- the curvature Sc of the second concave mirror 5c may be about 0.25 to 0.35.
- the area ratio S1/S2 can be 0.85 or more while suppressing the distortion of the aerial image R to 5% or less.
- the curvature Sd of the first concave mirror 5d may be about 0.2 to 0.3
- the curvature Se of the second concave mirror 5e may be about 0.05 to 0.15.
- the area ratio S1/S2 can be 0.85 or more while suppressing the distortion of the aerial image R to 5% or less.
- the curvatures Sa, Sb, Sc, Sd, and Se are not limited to the above ranges because they can change depending on the size, shape, and angle of view (spread of light) of the display panel 4.
- the curvature Sa of the first concave mirror 5a is defined by DMAX/H, where the length of a line segment LS that passes through the center of the reflecting surface 5aa of the first concave mirror 5a and connects both ends of the reflecting surface 5aa is 2 x H, and the maximum length (also called maximum depth ) of the direction along the optical axis OA between a point on the reflecting surface 5aa and the line segment LS is DMAX.
- the maximum value of DMAX /H when the position of the cross section is changed may be taken as the curvature Sa.
- the curvatures Sb, Sc, Sd, and Se are also defined in the same way as the curvature Sa.
- the aerial image display device 2 can make the brightness of the aerial image R formed by the optical system 5 800 cd/ m2 or more.
- the aerial image display device 2 has a high utilization rate of the image light Lp because the optical system 5 is composed only of reflective members and does not include optical members that transmit a portion of the incident light, such as a polarizing filter or a beam splitter. Therefore, the aerial image display device 2 can form a high-brightness aerial image R while suppressing an increase in power consumption.
- the brightness of the aerial image R may be measured by a commercially available luminance meter.
- the brightness of the aerial image R may be measured by a luminance meter arranged at the position of the imaging device 7 (see FIG. 7).
- the luminance distribution waveform of the aerial image R can be calculated using the measurement system 1.
- the measurement system 1 includes an imaging device 7, a control unit 8, and an acquisition unit 14.
- the imaging device 7 is assumed to be the eye 20e of the user 20 (see Figures 1 and 2), and captures the aerial image R formed by the aerial image display device 2.
- the imaging device 7 is located away from the aerial image display device 2 in the design optical axis direction Dad of the aerial image display device 2.
- the imaging device 7 captures the aerial image R formed by the aerial image display device 2 in the design optical axis direction Dad of the aerial image display device 2.
- the design optical axis direction Dad refers to the design optical axis direction of the aerial image R formed by the aerial image display device 2.
- the design optical axis direction Dad may be, for example, a direction perpendicular to the width direction of the housing 6, or a direction perpendicular to the emission surface of the image light emission unit 6a.
- the aerial image display device 2 is disposed so that the design optical axis direction Dad coincides with the depth direction.
- the imaging direction 7d of the imaging device 7 is not limited to the design optical axis direction.
- the control unit 8 may control the first rotation device 12 to rotate the imaging device 7 around a predetermined rotation axis. That is, the control unit 8 may control the imaging device 7 to capture the aerial image R in a direction different from the design optical axis direction (depth direction).
- the imaging device 7 includes an imaging element.
- the imaging element may be, for example, a CCD (Charge Coupled Device) imaging element or a CMOS (Complementary Metal Oxide Semiconductor) imaging element.
- the imaging device 7 may be a camera (for example, a CCD camera) including multiple imaging elements and optical elements such as an objective lens.
- the imaging device 7 may be capable of changing the aperture value (also called the F-number).
- the imaging device 7 may be capable of changing the aperture value within a range of 2 to 22.
- the control unit 8 may function as a control unit of the measurement system 1.
- the control unit 8 may be connected to each component of the measurement system 1 and control each component.
- the control unit 8 may also function as a control unit of the aerial image display device 2 when calculating the modulation transfer function of the aerial image R.
- the control unit 8 may control, for example, the aerial image R formed by the aerial image display device 2.
- the control unit 8 may include one or more processors.
- the processor may include at least one of a general-purpose processor configured to load a specific program and execute a specific function, and a dedicated processor specialized for a specific process.
- the dedicated processor may include an ASIC (Application Specific Integrated Circuit).
- the processor may include a PLD (Programmable Logic Device).
- the PLD may include an FPGA (Field-Programmable Gate Array).
- the control unit 8 may include at least one of a SoC (System-on-a-Chip) and a SiP (System In a Package) configured to cooperate with one or more processors.
- the acquisition unit 14 may store image data of the captured image generated by the imaging device 7.
- the control unit 8 may acquire image data of the captured image via the acquisition unit 14.
- the imaging device 7 may automatically output image data of the captured image to the acquisition unit 14.
- the acquisition unit 14 may be a temporary storage device such as a buffer memory.
- the method of transmitting and receiving signals between the control unit 8 and the imaging device 7, the method of transmitting and receiving signals between the acquisition unit 14 and the imaging device 7, and the method of transmitting and receiving signals between the acquisition unit 14 and the control unit 8 may use at least one of a wired communication method, a wireless communication method, an infrared communication method, etc.
- the control unit 8 controls the aerial image display device 2 to form a test pattern (hereinafter, simply referred to as an aerial image) 9 in the air as shown in Figs. 7 and 8.
- Fig. 8 shows a test pattern 9 without blurring (resolution degradation).
- the test pattern 9 may be a repeated pattern of a first band-shaped image 9a and a second band-shaped image 9b.
- the first band-shaped image 9a and the second band-shaped image 9b may be elongated images in the vertical direction (X-axis direction).
- the test pattern 9 may include at least three first band-shaped images 9a.
- first band-shaped image 9a is a white image and the second band-shaped image 9b is a black image, but this is not limited to this.
- the first band-shaped image 9a and the second band-shaped image 9b may differ in at least one of the luminance and the color.
- the imaging device 7 may be tilted by about 3° to 5° around a rotation axis parallel to the depth direction (Z-axis direction) in the height direction of the imaging device 7 (e.g., a direction perpendicular to the top surface of the imaging device 7).
- the number of samples taken when calculating the luminance distribution waveform of the test pattern 9 can be increased, making it possible to calculate the luminance distribution waveform of the test pattern 9 with high accuracy.
- Figure 9 shows an example of an overall image of an aerial image R (test pattern 9) captured by the imaging device 7.
- the control unit 8 controls the imaging device 7 to capture at least one imaging portion in the test pattern 9.
- the at least one imaging portion may be, for example, at least one of the multiple imaging portions F1 to F7 shown in Figure 9.
- the at least one imaging portion may be multiple imaging portions F3 to F5, or multiple imaging portions F1 to F7.
- the imaging device 7 captures imaging portions F1 to F7 in the test pattern 9. Note that "to” means “up to,” and the same applies below.
- the imaging portion F4 may be located near the center of the imaging plane Rp (X-axis direction and Y-axis direction) of the aerial image R.
- the imaging portions F3 to F5 may be aligned in a predetermined direction in the imaging plane Rp of the aerial image 9.
- the predetermined direction may be, but is not limited to, the Y-axis direction (width direction).
- the predetermined direction may be the X-axis direction (up-down direction, height direction) or a direction inclined from the X-axis direction and Y-axis direction (diagonal direction).
- the imaging portions F1, F2, F6, and F7 may be located at the four corners of the test pattern 9, respectively, as shown in FIG. 9. In the following, unless otherwise specified, a case will be described in which the imaging portions F3 to F5 are aligned in the Y-axis direction (width direction) in the imaging plane of the aerial image 9.
- the imaging device 7 captures a plurality of imaging portions F1 to F7 of the test pattern 9 and outputs image data of a plurality of captured images P1 to P7.
- the plurality of captured images P1 to P7 are images of a plurality of imaging portions F1 to F7, respectively.
- the test pattern 9 may be configured such that each of the plurality of captured images P1 to P7 includes at least one image of the first strip-shaped image 9a (white image portion in FIG. 8).
- the test pattern 9 may be configured such that each of the plurality of captured images P1 to P7 includes an image of one first strip-shaped image 9a, as shown in FIG. 10.
- FIG. 10 shows the captured image P3, but the same is true for the captured images P1, P2, P4 to P7.
- the distance between the imaging device 7 and the test pattern 9 in the depth direction may be set to a predetermined imaging distance (also referred to as the initial setting distance).
- the initial setting distance may be, for example, 300 mm to 700 mm, or 500 mm.
- the distance between the imaging device 7 and the aerial image 9 may be the distance between the imaging device 7 and the vicinity of the center of the aerial image 9 (for example, the imaging part F4).
- the focal length of the imaging device 7 is fixed to a predetermined focal length.
- the predetermined focal length may be the same as the initial setting distance. In the following, unless otherwise specified, the distance between the imaging device 7 and the aerial image 9 is set to the initial setting distance.
- control unit 8 may control the moving device 11 to change the distance between the imaging device 7 and the aerial image 9 from the initial setting distance. That is, the control unit 8 may perform a defocus operation to make the distance between the imaging device 7 and the aerial image 9 and the focal length of the imaging device 7 different.
- the control unit 8 may control the imaging device 7 to set the aperture value to a value greater than 3, or may control the imaging device 7 to set the aperture value to a value equal to or less than 3.
- the aperture value of the imaging device 7 By setting the aperture value of the imaging device 7 to a relatively large value (e.g., 8), the resolution when the eye 20e of the user 20 visually recognizes the test pattern 9 can be evaluated.
- the aperture value of the imaging device 7 By setting the aperture value of the imaging device 7 to a relatively small value (e.g., 3), the depth of field (also called the focal depth of field) of the imaging device 7 can be made shallow (shortened). That is, the range in which the subject is in focus in the depth direction can be made small (narrowed).
- the position of the subject i.e., the multiple imaging parts F3, F4, F5 in the depth direction can be accurately measured, and the modulation transfer function can be accurately calculated.
- the control unit 8 acquires image data of the multiple captured images P1 to P7 from the imaging device 7 via the acquisition unit 14.
- the control unit 8 scans the luminance values of the pixels arranged in the width direction (left and right direction in FIG. 10) for the multiple captured images P1 to P7, performs binning processing, and calculates the luminance distribution waveforms LSF1 to LSF7 as shown in FIG. 11.
- the luminance distribution waveforms LSF1 to LSF7 refer to the luminance distribution waveforms calculated from the image data of the captured images P1 to P7.
- the luminance distribution waveforms LSF1 to LSF7 are pulse-shaped waveforms that represent the change in luminance depending on the position in the Y-axis direction. The horizontal axis in FIG.
- FIG. 11 represents the change in position in the Y-axis direction.
- FIG. 11 shows the maximum value (peak value) of the luminance distribution waveform at the position of the 30th pixel among multiple pixels (for example, 60 pixels) in the Y-axis direction.
- the luminance distribution waveform is also called a line spread function (LSF).
- the line spread functions LSF1 to LSF7 may have a substantially Gaussian shape as shown in FIG. 11.
- the control unit 8 can calculate the peak value H, half width W, quarter width Q, and width ratio W/Q of each line spread function LSF1 to LSF7 based on each line spread function LSF1 to LSF7.
- the peak value H is the maximum value of the line spread function.
- the half width W is the width of the line spread function having a brightness of approximately 50% of the peak value H, and is expressed in units of the number of pixels.
- the half width Q is the width of the line spread function having a brightness of approximately 25% of the peak value H, and is expressed in units of the number of pixels.
- the control unit 8 may take the average value of the width ratios W/Q of the line spread functions LSF1 to LSF7 as the width ratio W/Q of the luminance distribution waveform of the aerial image R. In this case, the average resolution level over the entire aerial image R can be evaluated.
- the control unit 8 may take the weighted average of the width ratios W/Q of the line spread functions LSF1 to LSF7 as the width ratio W/Q of the luminance distribution waveform of the aerial image R. In this case, the resolution level near the center of the aerial image R can be evaluated by increasing the weighting of the width ratios W/Q of the line spread functions LSF3 to LSF5.
- the resolution level at the corners of the aerial image R can be evaluated by increasing the weighting of the width ratios W/Q of the line spread functions LSF1, LSF2, LSF6, and LSF7.
- the control unit 8 may take the minimum value of the width ratios W/Q of the line spread functions LSF1 to LSF7 as the width ratio W/Q of the luminance distribution waveform of the aerial image R. In this case, the resolution level over the entire aerial image R can be evaluated.
- a misalignment (hereinafter also referred to as optical axis misalignment) may occur between the optical axis direction Da of the aerial image R formed by the aerial image display device 2 and the design optical axis direction Dad.
- optical axis misalignment a misalignment
- a bias occurs in the display quality such as brightness and resolution within the imaging plane Rp of the aerial image R, and the line spread functions LSF1 to LSF7 may not be calculated accurately.
- the measurement system 1 may be configured to measure the optical axis misalignment of the aerial image display device 2.
- the measurement system 1 may be configured to calibrate the optical axis misalignment of the aerial image display device 2.
- the following describes the measurement system 1 that measures the optical axis deviation of the aerial image display device 2.
- the measurement system 1 may include a moving device 11 that moves the imaging device 7 along the depth direction (Z direction).
- the moving device 11 is configured to be able to move the imaging device 7 in a predetermined distance ⁇ Z unit.
- the predetermined distance ⁇ Z may be, for example, about 1 mm to 5 mm, or about 1 mm to 2 mm.
- the moving device 11 includes, for example, a rail 11r, a holding member (also called a support member) 11h, and a moving table (also called a slider) 11t on whose upper surface the holding member 11h is installed.
- the rail 11r is located on the upper surface 10a of the device table 10 and extends along the depth direction.
- the holding member 11h supports and holds the imaging device 7. With the holding member 11h holding the imaging device 7, the moving table 11t can move along the depth direction on the rail 11r.
- the movement of the moving table 11t along the depth direction may be controlled by the control unit 8.
- the measurement system 1 may include a first rotation device 12 that rotates the imaging device 7 around a first rotation axis RA1.
- the first rotation axis RA1 may be parallel to a direction (e.g., X-axis direction) perpendicular to a predetermined direction (e.g., Y-axis direction) in which the imaging portions F3, F4, and F5 are arranged in the imaging plane Rp.
- the first rotation axis RA1 may be a rotation axis passing through the imaging device 7.
- the first rotation device 12 is configured to rotate the imaging device 7 in units of a predetermined angle ⁇ .
- the predetermined angle ⁇ may be, for example, about 0.1° to 2.0°, or about 0.5° to 1°.
- the first rotation device 12 may be provided in the moving device 11.
- the first rotation device 12 may be installed between the moving table 11t and the holding member 11h.
- the first rotation device 12 may rotate the holding member 11h of the moving device 11 and the imaging device 7 held by the holding member about the first rotation axis RA1.
- the first rotation device 12 may rotate only the imaging device 7 about the first rotation axis RA1 without rotating the holding member 11h of the moving device 11.
- the rotation of the imaging device 7 about the first rotation axis RA1 is controlled by the control unit 8.
- the first rotation device 12 may be a manual rotation device equipped with a stepping motor device, a linear motor device, an ultrasonic motor device, a manually rotated knob, a rotation adjustment device such as a screw, or the like.
- the aerial image display device 2 may include a second rotation device 13 located within the housing 6 for rotating the entire component 2a around the second rotation axis RA2.
- the second rotation axis RA2 may be parallel to a direction (e.g., the X-axis direction) perpendicular to a predetermined direction in which the imaging portions F3, F4, and F5 are aligned within the imaging plane Rp.
- the second rotation device 13 may rotate only the entire component 2a around the second rotation axis RA2 without rotating the housing 6.
- the rotation of the aerial image display device 2 or the entire component 2a around the second rotation axis RA2 is controlled by the control unit 8.
- the imaging direction 7d of the imaging device 7 may be the optical axis direction (also called the central axis direction) of the objective lens of the camera, or may be a direction perpendicular to the imaging surface of a CCD imaging element or the like.
- the imaging direction 7d of the imaging device 7 may be assumed to be the line of sight of the eye 20e of the user 20 facing the aerial image display device 2.
- the aerial image display device 2 faces the imaging device 7. Then, if the actual optical axis direction Da of the aerial image 9 does not coincide with the imaging direction 7d of the imaging device 7 (if the actual optical axis direction Da is misaligned with the imaging direction 7d), the amount of misalignment between the optical axis direction Da and the imaging direction 7d can be measured by a method (defocus method) of translating the imaging device 7 forward and backward in the depth direction, which will be described later, and the optical axis direction Da can be measured. In addition, by rotating the imaging device 7 around the first rotation axis RA1 to align the imaging direction 7d with the optical axis direction Da, the optical axis direction Da can be measured and the aerial image display device 2 can be accurately faced toward the imaging device 7.
- a method defocus method
- the positional deviation between the actual optical axis direction Da and the imaging direction 7d may exist only in the height direction (X-axis direction), only in the width direction (Y-axis direction), or in both the height direction (X-axis direction) and the width direction (Y-axis direction). In each case, the positional deviation can be measured and adjustments can be made to eliminate the positional deviation.
- the aerial image display device 2 When measuring whether the actual optical axis direction Da of the aerial image 9 coincides with the design optical axis direction Dad (see Figures 1 and 2) of the aerial image display device 2, the aerial image display device 2 is accurately positioned at a predetermined position directly facing the imaging device 7.
- the aerial image display device 2 may be positioned so that the image light emission section 6a of the aerial image display device 2 is perpendicular to the imaging direction 7d of the imaging device 7.
- the imaging direction 7d is a predetermined imaging direction 7da (imaging direction 7da that coincides with the design optical axis direction Dad).
- the amount of misalignment between the optical axis direction Da and the imaging direction 7da is not measured, and if there is an optical axis misalignment between the actual optical axis direction Da and the design optical axis direction Dad, the amount of misalignment between the optical axis direction Da and the imaging direction 7da is measured by a method (defocus method) of moving the imaging device 7 back and forth in the depth direction in parallel, which will be described later.
- the optical axis direction Da and the design optical axis direction Dad may be aligned by adjusting the arrangement of the components 2a of the aerial image display device 2, replacing the components 2a, etc.
- the optical axis misalignment between the actual optical axis direction Da and the design optical axis direction Dad may exist only in the height direction (X-axis direction), only in the width direction (Y-axis direction), or in both the height direction (X-axis direction) and the width direction (Y-axis direction).
- the position misalignment can be measured and adjustments can be made to eliminate the position misalignment.
- the measurement system 1 which measures the agreement or mismatch between the actual optical axis direction Da of the aerial image 9 and the design optical axis direction Dad in a plane perpendicular to the height direction (X-axis direction) based on the image data of the captured images P3 to P5, but is not limited to this.
- the control unit 8 acquires image data of the multiple captured images P3 to P5 from the imaging device 7.
- the control unit 8 calculates luminance distribution waveforms LSF3 to LSF5 as shown in FIG. 11 based on the image data of the multiple captured images P3 to P5.
- the control unit 8 calculates the characteristic values V3, V4, and V5 of the line spread functions LSF3 to LSF5.
- the characteristic values V1 to V7 refer to the characteristic values of the line spread functions LSF1 to LSF7, respectively.
- the characteristic value may be the peak value H of the line spread function, the half-width W of the line spread function, or the width ratio W/Q of the half-width W to the half-width Q of the line spread function (see FIG. 11).
- the larger the peak value H of the line spread function LSF4 is in the case of FIG. 11, the closer it is to 1), the closer it can be determined that the distance between the imaging part F4 and the imaging device 7 is to the focal length of the imaging device 7.
- the larger the peak value H of the line spread function LSF4 is, the higher the resolution (contrast value) of the aerial image R can be determined.
- the half-width W is the width of the line spread function having a brightness of approximately 50% of the peak value H, and is expressed in units of the number of pixels.
- the smaller the half-width W of the line spread function LSF4 the higher the resolution (contrast value) of the aerial image R can be determined.
- the quarter-value width Q is the width of the line spread function having a brightness of approximately 25% of the peak value H, and is expressed in units of the number of pixels.
- the larger the width ratio W/Q the higher the resolution (contrast value) of the aerial image R can be determined.
- the characteristic value may be a combination value obtained from the peak value H and the half-width W.
- the combination value may be a value obtained by dividing the peak value H by the half-width W, or may be some other value.
- the characteristic value is a combination value obtained by dividing the peak value H by the half-width W, it can be determined that the distance between the imaging portion F4 and the imaging device 7 is closer to the focal length of the imaging device 7 as the combination value of the line spread function LSF4 is larger.
- the resolution (contrast value) of the aerial image R is higher as the combination value of the line spread function LSF4 is larger.
- the control unit 8 may calculate multiple differences between the multiple characteristic values V3 to V5 (i.e., V3-V4, V3-V5, and V4-V5), and if all of the absolute values of the multiple differences are equal to or less than the threshold value T1, may determine that the actual optical axis direction Da of the aerial image 9 coincides with the depth direction (i.e., the design optical axis direction Dad). If at least one of the absolute values of the multiple differences exceeds the threshold value T1, the control unit 8 may determine that the optical axis direction Da of the aerial image 9 does not coincide with the depth direction.
- the threshold value T1 may be set appropriately based on the required specifications of the aerial image display device 2.
- the control unit 8 may determine that the optical axis direction of the aerial image 9 coincides with the depth direction when the absolute value of the difference between the characteristic values V3 to V5 is equal to or less than a threshold value T1.
- the control unit 8 may determine that the optical axis direction Da of the aerial image 9 coincides with the depth direction when all of the characteristic values V3 to V5 are equal to or greater than the threshold value T2.
- the control unit 8 may determine that the optical axis direction Da of the aerial image 9 does not coincide with the depth direction when at least one of the characteristic values V3 to V5 is less than the threshold value T2.
- the threshold value T2 may be set appropriately based on the required specifications of the aerial image display device 2.
- the control unit 8 may determine that the optical axis direction Da of the aerial image R coincides with the depth direction when all of the characteristic values V3 to V5 are equal to or less than the threshold value T3.
- the control unit 8 may determine that the optical axis direction Da of the aerial image 9 does not coincide with the depth direction when at least one of the characteristic values V3 to V5 exceeds the threshold value T3.
- the threshold value T3 may be set appropriately based on the required specifications of the aerial image display device 2, etc.
- the measurement system 1 can systematically measure whether the actual optical axis direction Da of the aerial image 9 coincides with the design optical axis direction Dad based on the characteristic values V3 to V5 of the line spread functions LSF3 to LSF5. Therefore, the measurement system 1 makes it possible to calibrate the optical axis direction Da of the aerial image R formed by the aerial image display device 2. That is, in order to match the actual optical axis direction Da with the design optical axis direction Dad, measures such as adjusting the arrangement of at least some of the components 2a of the aerial image display device 2 or replacing at least some of the components 2a can be adopted.
- the measurement system 1 can determine whether the actual optical axis direction Da of the aerial image 9 coincides with the imaging direction 7d and whether the actual optical axis direction Da of the aerial image 9 coincides with the design optical axis direction Dad based on the area of the modulation transfer function (see FIG. 3).
- the operation of the measurement system 1 that determines whether the actual optical axis direction Da of the aerial image 9 coincides with the design optical axis direction Dad based on the area of the modulation transfer function will be described.
- the optical axis direction measurement method based on the area of the modulation transfer function (hereinafter also referred to as the MTF area) is also referred to as the MTF area method.
- the control unit 8 calculates modulation transfer functions MTF3 to MTF5 such as the first modulation transfer function K1 shown in Fig. 3 by Fourier transforming each of the line spread functions LSF3 to LSF5 as shown in the following formula (3).
- the Fourier transform is an operation for converting, for example, a function represented by a pulse-like waveform into a curve represented by continuous values in the frequency domain (a continuous curve represented by a sine waveform curve, a cosine waveform curve, or a composite curve of these).
- LSF(x) collectively represents the line spread functions LSF3 to LSF5 as a function of position x in the captured images P3 to P5.
- MTF( ⁇ ) collectively represents the modulation transfer functions MTF3 to MTF5 as a function of spatial frequency ⁇ .
- C is a constant for normalizing MTF(0) to "1".
- the MTF( ⁇ ) can be said to be an index representing the resolution based on the contrast of the captured images P3 to P5.
- the upper and lower limits of the integral interval in formula (3) may be replaced with finite values, in which case the processing load on the control unit 8 can be reduced.
- a method such as discrete Fourier transform or fast Fourier transform may be used.
- the control unit 8 measures areas A3 to A5 obtained by integrating the modulation transfer functions MTF3 to MTF5 on the spatial frequency axis, respectively, as expressed by the following formula (4).
- the integral interval in formula (4) may be replaced with a finite interval (for example, a range of 0/mm to 18/mm), in which case the processing load on the control unit 8 can be reduced.
- A collectively represents the areas A3 to A5.
- modulation transfer functions MTF3 to MTF5 do not have to be calculated using equation (3).
- the modulation transfer functions MTF3 to MTF5 may be calculated directly from the image data of the captured images P1 to P7 using the chart method.
- the control unit 8 controls the aerial image display device 2 to form a test pattern (hereinafter, also simply referred to as an aerial image) 9' as shown in Figure 12.
- Figure 12 shows an ideal aerial image 9' without blurring (resolution degradation) and optical axis misalignment.
- the aerial image 9' is configured so that each of the imaging portions F3 to F5 includes multiple square wave charts 9c, 9d, 9e, and 9f with different spatial frequencies (pitch of the white image portion). Therefore, each of the captured images P3 to P5 includes images of multiple square wave charts 9c to 9f with different spatial frequencies ⁇ , as shown in Figure 13.
- the control unit 8 controls the imaging device 7 to capture the aerial image 9', generate captured images P3 to P5 by capturing the imaging portions F3 to F5, and output image data of the captured images P3 to P5.
- the imaging device 7 does not need to be inclined with respect to the upper surface 10a of the device stand 10 when capturing the aerial image 9'.
- control unit 8 normalizes the contrast ratio c ⁇ of each spatial frequency ⁇ with the contrast ratio c ⁇ of the lowest spatial frequency ⁇ to calculate the square wave response function (Square Wave Response Function: SWRF).
- SWRF Square Wave Response Function
- the control unit 8 converts the square wave response function into a sine wave response function and calculates the modulation transfer functions MTF3 to MTF5.
- Coltman's formula may be used. The Coltman's formula may use up to the fourth term or up to the twelfth term.
- the control unit 8 may calculate multiple differences between the multiple MTF areas A3 to A5 (i.e., A3-A4, A3-A5, and A4-A5), and if all of the absolute values of the multiple differences are equal to or less than the threshold value T4, may determine that the actual optical axis direction Da of the aerial image 9 coincides with the depth direction (design optical axis direction Dad). If at least one of the absolute values of the multiple differences exceeds the threshold value T4, the control unit 8 may determine that the optical axis direction of the aerial image 9 does not coincide with the depth direction.
- the threshold value T4 may be set appropriately based on the required specifications of the aerial image display device 2.
- the control unit 8 may determine that the actual optical axis direction Da of the aerial image 9 coincides with the depth direction when all of the MTF areas A3 to A5 are equal to or greater than the threshold value T5.
- the control unit 8 may determine that the actual optical axis direction Da of the aerial image 9 does not coincide with the depth direction when at least one of the MTF areas A3 to A5 is less than the threshold value T5.
- the threshold value T5 may be set appropriately based on the required specifications of the aerial image display device 2.
- the measurement system 1 can systematically measure whether the actual optical axis direction Da of the aerial image 9 coincides with the design optical axis direction Dad based on the MTF areas A3 to A5. Because the area of the modulation transfer function MTF is not easily affected by external light, etc., it is possible to accurately measure whether the actual optical axis direction Da of the aerial image 9 coincides with the design optical axis direction Dad by using the MTF areas A3 to A5. Therefore, the measurement system 1 makes it possible to accurately calibrate the actual optical axis direction Da of the aerial image R formed by the aerial image display device 2.
- the control unit 8 determines that the actual optical axis direction Da of the aerial image 9 does not match the design optical axis direction (depth direction) Dad, it may measure the optical axis shift of the actual optical axis direction Da of the aerial image 9 from the design optical axis direction Dad.
- the control unit 8 may measure the optical axis shift of the actual optical axis direction Da of the aerial image 9 from the design optical axis direction Dad without determining whether the actual optical axis direction Da of the aerial image 9 matches the design optical axis direction Dad.
- the control unit 8 controls the moving device 11 to move the imaging device 7 along the imaging direction (Z-axis direction) 7d as shown in FIG. 14, and position the imaging device 7 at multiple positions with different coordinates (Z coordinates) in the imaging direction 7d.
- Z0 is the initial coordinate of the imaging device 7 in the imaging direction 7d, and is the Z coordinate of the imaging device 7 when the distance between the imaging device 7 and the aerial image 9 becomes the initial setting distance.
- ⁇ Z may be, for example, about 0.1 mm to 5 mm, or about 0.2 mm to 2 mm.
- j is an integer in the range of -m1 ⁇ j ⁇ m2 (m1 and m2 are natural numbers).
- m1 and m2 may be, for example, natural numbers from 1 to 20, but are not limited to natural numbers from 1 to 20.
- the control unit 8 controls the imaging device 7 to capture an aerial image 9 in the imaging direction 7d from each position represented by Z coordinate Zj (-m1 ⁇ j ⁇ m2).
- FIG. 15 shows an example of an aerial image 9 captured by the imaging device 7 located at a position where the Z coordinate is Z0
- FIG. 16 shows an example of an aerial image 9 captured by the imaging device 7 located at a position where the Z coordinate is Zja (ja is a positive integer)
- FIG. 17 shows an example of an aerial image 9 captured by the imaging device 7 located at a position where the Z coordinate is Zjb (jb is a negative integer). Since the focal length of the imaging device 7 is fixed to the initial setting distance, it can be seen that the blur of the imaging parts F3, F4, and F5 changes as the imaging device 7 moves.
- the imaging device 7 outputs image data of (m1+m2+1) captured images P3 to P5 for each of the imaging parts F3 to F5 to the control unit 8.
- the control unit 8 acquires image data of (m1+m2+1) captured images P3-P5 from the imaging device 7 for each of the imaging regions F3-F5.
- the control unit 8 may acquire image data from the imaging device 7 via the acquisition unit 14.
- the control unit 8 calculates (m1+m2+1) line spread functions LSF3, LSF4, and LSF5 for each of the imaging portions F3 to F5 based on the image data of (m1+m2+1) captured images P3 to P5, and calculates (m1+m2+1) characteristic values V3 to V5.
- the characteristic values V3 to V5 are the peak value H, width ratio W/Q, or combination value obtained by dividing the peak value H by the half-width W of the line spread functions LSF3 to LSF5.
- the control unit 8 calculates the maximum value VMAX of the (m1+m2+1) characteristic values V3 to V5 for each of the imaging portions F3 to F5, and calculates the Z coordinate (hereinafter also referred to as the focusing position) of the imaging device 7 when the characteristic values V3 to V5 become the maximum value VMAX .
- FIG. 18 is a graph showing the focusing positions FP3 to FP5 of the imaging parts F3 to F5.
- the focusing positions FP1 to FP7 respectively refer to the focusing positions when the characteristic values V1 to V7 are the maximum value VMAX .
- FIG. 18 also shows the focusing positions FP1, FP2, FP6, and FP7 of the imaging parts F1, F2, F6, and F7.
- the focusing positions FP1, FP2, FP6, and FP7 can be calculated in the same manner as the focusing positions FP3 to FP5.
- the focusing positions FP3 to FP5 of the imaging parts F3 to F5 are shown with the focusing position FP4 of the imaging part F4 as the reference position (0 mm).
- FIG. 18 shows the focusing positions FP3 to FP5 of the imaging parts F3 to F5 when the optical axis deviation occurs.
- the sign of the focal position FP3 (+1.0 mm) of the imaging portion F3 is different from the sign of the focal position FP5 (-0.8 mm) of the imaging portion F5.
- the control unit 8 determines that the optical axis of the aerial image 9 is deviated from the depth direction by an angle ⁇ that satisfies the following formula (5).
- is the absolute value of the in-focus position FP3
- is the absolute value of the in-focus position FP5 (see FIG. 18).
- L is the design length of the aerial image 9 in the width direction (Y-axis direction).
- control unit 8 determines that the optical axis direction Da of the aerial image 9 is deviated from the design optical axis direction (depth direction) Dad by an angle ⁇ , it controls the second rotation device 13 (see Figures 1 and 2), which rotates the entire component 2a of the aerial image display device 2, to rotate the aerial image display device 2 by an angle ⁇ around the second rotation axis RA2.
- This makes it possible to calibrate the optical axis deviation of the aerial image R formed by the aerial image display device 2.
- the control unit 8 controls the second rotation device 13 to rotate the aerial image display device 2 by an angle ⁇ clockwise or counterclockwise when viewed from above the device stand 10.
- the control unit 8 may determine the direction in which to rotate the aerial image display device 2 based on the signs of the focus positions FP3 and FP5 so that the optical axis direction Da of the aerial image 9 is parallel to (i.e., coincides with) the design optical axis direction Dad.
- the second rotation device 13 may be a manual rotation device equipped with a stepping motor device, a linear motor device, an ultrasonic motor device, a manually rotated knob, a rotation adjustment device such as a screw, etc.
- Figure 20 shows focus positions FP3 to FP5 of imaging portions F3 to F5 when no optical axis misalignment occurs.
- Figure 20 also shows focus positions FP1, FP2, FP6, and FP7 of imaging portions F1, F2, F6, and F7.
- Focus positions FP1, FP2, FP6, and FP7 can be calculated in the same way as focus positions FP3 to FP5.
- the sign of focus position FP3 (-0.6 mm) of imaging portion F3 and the sign of focus position FP5 (-0.6 mm) of imaging portion F5 are the same, which indicates that no optical axis misalignment occurs (or the optical axis misalignment is reduced) as shown in Figure 21.
- the control unit 8 determines that the actual optical axis direction Da of the aerial image 9 does not deviate from the designed optical axis direction (depth direction) Dad, and does not need to rotate the component 2a of the aerial image display device 2.
- the above-described operation of the measurement system 1 is an operation in the case where the peak value H or a combination value obtained by dividing the peak value H by the half-width W is used as the characteristic values V3 to V5 of the line spread functions LSF3 to LSF5.
- the control unit 8 calculates the minimum value V MIN of the (m1+m2+1) characteristic values V3 to V5 for each of the imaging portions F3 to F5, and sets the Z coordinate of the imaging device 7 when the characteristic values V3 to V5 become the minimum value V MIN as the focusing positions FP3 to FP5.
- the minimum value V MIN may be the same as the threshold value T1.
- the measurement system 1 can systematically measure the optical axis deviation between the actual optical axis direction Da of the aerial image 9 and the design optical axis direction Dad based on the characteristic values V3 to V5 of the line spread functions LSF3 to LSF5. Therefore, the measurement system 1 makes it possible to calibrate the optical axis direction Da of the aerial image R formed by the aerial image display device 2.
- optical axis shift shift between the optical axis direction Da and the design optical axis direction Dad
- the control unit 8 calculates (m1+m2+1) modulation transfer functions MTF3-MTF5 for each of the imaging portions F3-F5 based on the image data of the (m1+m2+1) captured images P3-P5, and calculates (m1+m2+1) MTF areas S3-S5.
- the control unit 8 measures the maximum value A MAX of the (m1+m2+1) MTF areas A3-A5 for each of the imaging portions F3-F5, and calculates the Z coordinate (focus position FP3-FP5) of the imaging device 7 where the MTF areas A3-A5 are maximum value A MAX .
- the control unit 8 can measure the optical axis shift (tilt angle ⁇ ) of the aerial image 9 based on the focusing positions FP3 to FP5 at which the MTF areas A3 to A5 reach their maximum value A MAX , and calibrate the optical axis shift of the aerial image R formed by the aerial image display device 2.
- the operation of the measurement system 1 that measures the optical axis shift of the aerial image 9 based on the MTF areas A3 to A5 and calibrates the optical axis shift of the aerial image is similar to the operation of the measurement system 1 that measures the optical axis shift of the aerial image 9 based on the characteristic values V3 to V5 and calibrates the optical axis shift of the aerial image, and therefore a detailed description thereof will be omitted.
- the control unit 8 may calculate (m1+m2+1) line spread functions LSF3-LSF5 for each imaging portion F3-F5 based on the image data of the (m1+m2+1) captured images P3-P5, and calculate (m1+m2+1) modulation transfer functions MTF3-MTF5 by Fourier transforming the (m1+m2+1) line spread functions LSF3-LSF5.
- the control unit 8 may calculate (m1+m2+1) modulation transfer functions MTF3-MTF5 for each imaging portion F3-F5 based on the image data of the (m1+m2+1) captured images P3-P5 using the chart method.
- the measurement system 1 performs a defocus operation on the imaging device 7, and can systematically measure the optical axis deviation between the optical axis direction of the aerial image 9 and the design optical axis direction based on the change in the MTF areas A3 to A5 accompanying the movement of the imaging device 7.
- the defocus operation is an operation that changes the degree of focus (degree of focus, degree of blur of the captured image) of each imaging part of the aerial image 9 by moving the imaging device 7 back and forth in the imaging direction 7d, as shown in FIG. 14. Since the area of the modulation transfer function MTF is not easily affected by external light, etc., it is possible to accurately measure whether the actual optical axis direction Da of the aerial image 9 coincides with the design optical axis direction Dad by using the MTF areas S3 to S5. Therefore, the measurement system 1 makes it possible to accurately calibrate the actual optical axis direction Da of the aerial image R formed by the aerial image display device 2.
- the control unit 8 controls the first rotation device 12 to rotate the imaging device 7 around the first rotation axis RA1 as shown in FIG. 22, and capture the aerial image 9 in a plurality of imaging directions 7d that have different angles with the depth direction (Z-axis direction).
- the plurality of imaging directions 7d are directions that form an angle collectively represented by ⁇ k with the depth direction (design optical axis direction Dad). ⁇ k is also referred to as the imaging angle.
- ⁇ may be, for example, about 0.1° to 2°, or about 0.5° to 1°.
- k is an integer in the range of -n1 ⁇ k ⁇ n2 (n1, n2 are natural numbers).
- n1 and n2 may be, for example, a natural number between 1 and 20, but is not limited to a natural number between 1 and 20.
- Fig. 22 shows a case where the rotation angle of the imaging device 7 is ⁇ ka (ka is a positive integer) and a case where the rotation angle of the imaging device 7 is ⁇ kb (kb is a negative integer).
- the control unit 8 controls the imaging device 7 to capture an aerial image 9 in each direction represented by an imaging angle ⁇ k (-n1 ⁇ k ⁇ n2).
- the imaging device 7 outputs image data of (n1+n2+1) captured images P3-P5 for each imaging portion F3-F5 to the control unit 8.
- the control unit 8 acquires image data of (n1+n2+1) captured images P3-P5 from the imaging device 7 for each imaging portion F3-F5.
- the control unit 8 may acquire image data from the imaging device 7 via the acquisition unit 14.
- the control unit 8 calculates (n1+n2+1) line spread functions LSF3 to LSF5 based on the image data of the (n1+n2+1) captured images P3 to P5, and calculates (n1+n2+1) characteristic values V3 to V5.
- the characteristic values V3 to V5 may be the peak value H or the half width W of the line spread functions LSF3 to LSF5.
- the characteristic values V3 to V5 may be a combination value obtained by dividing the peak value H by the half width W.
- the control unit 8 calculates multiple differences between the multiple characteristic values V3 to V5 (i.e., V3-V4, V3-V5, and V4-V5) for each imaging angle ⁇ k, and if the absolute value of the multiple differences at a certain imaging angle ⁇ 1 is equal to or less than a threshold value T6, it may determine that the actual optical axis direction Da of the aerial image 9 is inclined by the inclination angle ⁇ 1 with respect to the depth direction (design optical axis direction Dad).
- the threshold value T6 may be set appropriately based on the required specifications of the aerial image display device 2.
- the control unit 8 may determine that the actual optical axis direction Da of the aerial image is inclined by the inclination angle ⁇ 2 with respect to the design optical axis direction Dad when all of the characteristic values V3 to V5 are equal to or greater than the threshold value T7 at a certain imaging angle ⁇ 2.
- the threshold value T7 may be set appropriately based on the required specifications of the aerial image display device 2.
- the control unit 8 may determine that the actual optical axis direction Da of the aerial image is inclined by the inclination angle ⁇ 3 with respect to the design optical axis direction Dad when all of the characteristic values V3 to V5 are equal to or smaller than the threshold value T8 at a certain imaging angle ⁇ 3.
- the threshold value T8 may be set appropriately based on the required specifications of the aerial image display device 2.
- control unit 8 determines that the actual optical axis direction Da of the aerial image 9 is deviated from the design optical axis direction (depth direction) Dad by the inclination angles ⁇ 1, ⁇ 2, and ⁇ 3, the control unit 8 controls the second rotation device 13 to rotate the aerial image display device 2 by a rotation angle equal to the inclination angles ⁇ 1, ⁇ 2, and ⁇ 3 around the second rotation axis RA2.
- This makes it possible to calibrate the optical axis shift of the aerial image R formed by the aerial image display device 2.
- the control unit 8 controls the second rotation device 13 to rotate the aerial image display device 2 clockwise or counterclockwise by a rotation angle equal to the inclination angles ⁇ 1, ⁇ 2, and ⁇ 3 when viewed from above the device stand 10.
- the control unit 8 may determine the direction in which to rotate the aerial image display device 2 so that the optical axis shift of the aerial image 9 is eliminated.
- the measurement system 1 can systematically measure the optical axis deviation between the actual optical axis direction Da of the aerial image 9 and the design optical axis direction Dad based on the changes in the characteristic values V3 to V5 that accompany the rotation of the imaging device 7. Therefore, the measurement system 1 makes it possible to calibrate the optical axis direction Da of the aerial image R formed by the aerial image display device 2.
- the control unit 8 calculates (n1+n2+1) modulation transfer functions MTF for each of the imaging portions F3 to F5 based on the image data of the (n1+n2+1) captured images P3 to P5, and measures (n1+n2+1) MTF areas S3 to S5.
- the control unit 8 calculates multiple differences between multiple MTF areas A3 to A5 (i.e., A3-A4, A3-A5, and A4-A5) for each imaging angle ⁇ k, and if the absolute value of the multiple differences at a certain imaging angle ⁇ 4 is less than or equal to a threshold value T9, it may determine that the actual optical axis direction Da of the aerial image 9 is inclined by an inclination angle ⁇ 4 with respect to the depth direction (design optical axis direction Dad).
- the threshold value T9 may be set appropriately based on the required specifications of the aerial image display device 2.
- the control unit 8 may determine that the actual optical axis direction Da of the aerial image is inclined by the inclination angle ⁇ 5 with respect to the design optical axis direction Dad when all of the MTF areas A3 to A5 are equal to or greater than the threshold value T10 at a certain imaging angle ⁇ 5.
- the threshold value T10 may be set appropriately based on the required specifications of the aerial image display device 2.
- the control unit 8 may calculate (n1+n2+1) line spread functions LSF3-LSF5 for each imaging region F3-F5 based on the image data of the (n1+n2+1) captured images P3-P5, and calculate (n1+n2+1) modulation transfer functions MTF3-MTF5 by Fourier transforming the (n1+n2+1) line spread functions LSF3-LSF5.
- the control unit 8 may calculate (n1+n2+1) modulation transfer functions MTF3-MTF5 for each imaging region F3-F5 based on the image data of the (n1+n2+1) captured images P3-P5 using the chart method.
- the measurement system 1 can systematically measure the optical axis misalignment between the actual optical axis direction Da of the aerial image 9 and the design optical axis direction Dad based on the MTF areas A3 to A5. Because the area of the modulation transfer function MTF is not easily affected by external light, etc., it is possible to accurately measure whether the actual optical axis direction Da of the aerial image 9 matches the design optical axis direction Dad by using the MTF areas A3 to A5. Therefore, the measurement system 1 makes it possible to accurately calibrate the optical axis direction Da of the aerial image R formed by the aerial image display device 2.
- the above describes the operation of the measurement system 1, which measures the optical axis shift around the height direction (X-axis direction) perpendicular to the width direction (Y-axis direction) based on multiple captured images P3 to P5 captured from multiple imaging sites F3 to F5 aligned in the width direction (Y-axis direction) in the imaging plane Rp of the aerial image 9, and calibrates the optical axis shift, but is not limited to this.
- the measurement system 1 can also measure the optical axis shift around the width direction (Y-axis direction) perpendicular to the height direction (X-axis direction) based on multiple captured images (e.g., multiple captured images P1, P3, P6 or multiple captured images P2, P5, P7) captured from multiple imaging sites (e.g., multiple imaging sites F1, F3, F6 or multiple imaging sites F2, F5, F7) aligned in the height direction (X-axis direction) in the imaging plane Rp of the aerial image 9, and calibrate the optical axis shift.
- multiple captured images e.g., multiple captured images P1, P3, P6 or multiple captured images P2, P5, P7
- multiple imaging sites e.g., multiple imaging sites F1, F3, F6 or multiple imaging sites F2, F5, F7 aligned in the height direction (X-axis direction) in the imaging plane Rp of the aerial image 9, and calibrate the optical axis shift.
- the measurement system 1 can measure the optical axis shift in the height direction (X-axis direction) and the optical axis shift in the width direction (Y-axis direction) based on a plurality of captured images of a plurality of captured portions F1 to F7 in the imaging plane Rp of the aerial image 9, and can also calibrate these optical axis shifts.
- the line spread functions LSF1, LSF2, LSF6, and LSF7 can be calculated in the same manner as the line spread functions LSF3 to LSF5.
- the characteristic values V1, V2, V6, and V7 can be calculated in the same manner as the characteristic values V3, V4, and V5.
- the modulation transfer functions MTF1, MTF2, MTF6, and MTF7 can be calculated in the same manner as the modulation transfer functions MTF3, MTF4, and MTF5.
- the MTF areas A1, A2, A6, and A7 can be measured in the same manner as the MTF areas A3 to A5.
- the optical axis shift is measured using the measurement system 1, and if an optical axis shift is present, the optical axis shift is calibrated, allowing the line spread functions LSF1 to LSF7 of the aerial image R to be calculated with high accuracy. As a result, degradation of the resolution of the aerial image display device 2 can be suppressed.
- the aerial image display device disclosed herein can suppress a decrease in the resolution of the aerial image. Furthermore, the aerial image display device disclosed herein can reduce distortion of the aerial image and suppress a decrease in the brightness of the aerial image.
- This disclosure can be implemented in the following configurations (1) to (8).
- An aerial image display device including a display unit and an optical system that forms an image light emitted from the display unit into a real aerial image, An aerial image display device, wherein the ratio of the half width to the quarter width of the peak value in the luminance distribution waveform of the aerial image is 0.5 or more.
- An aerial image display device according to the above configuration (1) or (2), in which the distortion of the aerial image is 5% or less.
- An aerial image display device in which the distortion of the aerial image is defined by the distortion of a corner when the corner of the aerial image located at the end of an ideal rectangular aerial image is used as a reference and the deviation length from the edge, expressed as a percentage, of the corner is defined as the distortion of the corner.
- An aerial image display device in which the distortion of the aerial image is a distortion of the four corners.
- An aerial image display device according to any one of the above configurations (1) to (6), in which the luminance of the aerial image is 800 cd/m2 or more.
- the optical system comprises: a first concave mirror that reflects the image light emitted from the display unit in a direction different from a direction toward the display unit; a convex mirror that reflects the image light reflected by the first concave mirror in a direction different from a direction toward the first concave mirror; a second concave mirror that reflects the image light reflected by the convex mirror in a direction different from the direction toward the convex mirror, and forms a real aerial image;
- the aerial image display device according to any one of the above configurations (1) to (7), comprising:
- the first concave mirror and the second concave mirror are free-form concave mirrors,
- the first concave mirror and the second concave mirror face each other in a tilted state
- the optical system comprises: a first concave mirror that reflects the image light emitted from the display unit in a direction different from a direction toward the display unit; a second concave mirror that reflects the image light reflected by the first concave mirror in a direction different from the direction toward the first concave mirror, and forms a real aerial image;
- the aerial image display device according to any one of the above configurations (1) to (7), comprising:
- the curvature of the first concave mirror is greater than the curvature of the second concave mirror, the first concave mirror and the second concave mirror face each other in a tilted state,
- the aerial image display device according to the above configuration (11) or (12), wherein the display unit is located between the first concave mirror and the second concave mirror.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
Abstract
Description
前記空中像の輝度分布波形における、ピーク値の4分の1値幅に対する半値幅の比が、0.5以上である。
次に、空中像表示装置2が結像するテストパターン9の実際の光軸方向Daを測定する測定システム1の動作について説明する。
先ず、線広がり関数の特性値に基づいて、空中像9の実際の光軸方向Daが設計光軸方向Dadに一致するか否かを判定する測定システム1の動作について説明する。線広がり関数の特性値に基づく光軸方向の測定方法をLSF法ともいう。制御部8は、上述のように、撮像装置7から、複数の撮像画像P3~P5の画像データを取得する。制御部8は、複数の撮像画像P3~P5の画像データに基づいて、図11に示すような輝度分布波形LSF3~LSF5を算出する。
測定システム1は、変調伝達関数の面積(図3参照)に基づいて、空中像9の実際の光軸方向Daが撮像方向7dに一致するか否か、また空中像9の実際の光軸方向Daが設計光軸方向Dadに一致するか否かを判定することができる。以下、変調伝達関数の面積に基づいて、空中像9の実際の光軸方向Daが設計光軸方向Dadに一致するか否かを判定する測定システム1の動作について説明する。変調伝達関数の面積(以下、MTF面積ともいう)に基づく光軸方向の測定方法をMTF面積法ともいう。
先ず、撮像装置7を撮像方向7dに沿って移動させることによって、光軸ずれを測定する測定システム1の動作について説明する。制御部8は、移動装置11が、図14に示すように、撮像装置7を撮像方向(Z軸方向)7dに沿って移動させ、撮像方向7dにおける座標(Z座標)が互いに異なる複数の位置に位置付けるよう制御する。複数の位置のZ座標は、総括的にZjで表され、Zjは、Zj=Z0+j×ΔZで表される。Z0は、撮像方向7dにおける撮像装置7の初期座標であり、撮像装置7と空中像9との距離が初期設定距離となるときの撮像装置7のZ座標である。ΔZは、例えば、0.1mm~5mm程度であってよいし、0.2mm~2mm程度であってよい。jは、-m1≦j≦m2(m1,m2は自然数)の範囲の整数である。m1,m2は、例えば1~20の自然数であってよいが、1~20の自然数に限定されない。
先ず、線広がり関数の特性値に基づいて、空中像9の光軸ずれを測定する場合について説明する。制御部8は、各撮像部位F3~F5について、(m1+m2+1)枚の撮像画像P3~P5の画像データに基づいて、(m1+m2+1)個の線広がり関数LSF3,LSF4,LSF5を算出し、(m1+m2+1)個の特性値V3~V5を算出する。以下では、特性値V3~V5が、線広がり関数LSF3~LSF5のピーク値H、幅比W/Q、またはピーク値Hを半値幅Wで除算した組み合わせ値であるとする。制御部8は、各撮像部位F3~F5について、(m1+m2+1)個の特性値V3~V5のうちの最大値VMAXを算出するとともに、特性値V3~V5が最大値VMAXとなるときの撮像装置7のZ座標(以下、合焦位置ともいう)を算出する。
次に、変調伝達関数MTFの面積に基づいて、空中像9の光軸ずれ(光軸方向Daと設計光軸方向Dadとのずれ)を測定する場合について説明する。制御部8は、各撮像部位F3~F5について、(m1+m2+1)枚の撮像画像P3~P5の画像データに基づいて、(m1+m2+1)個の変調伝達関数MTF3~MTF5を算出し、(m1+m2+1)個のMTF面積S3~S5を算出する。制御部8は、各撮像部位F3~F5について、(m1+m2+1)個のMTF面積A3~A5のうちの最大値AMAXを測定するとともに、MTF面積A3~A5が最大値AMAXとなる撮像装置7のZ座標(合焦位置FP3~FP5)を算出する。
次に、撮像装置7を第1回転軸RA1まわりに回転させることによって、光軸ずれ(光軸方向Daと設計光軸方向Dadとのずれ)を測定する測定システム1の動作について説明する。制御部8は、第1回転装置12が、図22に示すように、撮像装置7を第1回転軸RA1まわりに回転させ、空中像9を奥行方向(Z軸方向)との間の角度が互いに異なる複数の撮像方向7dにおいて撮像するよう制御する。複数の撮像方向7dは、奥行方向(設計光軸方向Dad)との間に総括的にΘkで表される角度を成す方向である。Θkは、撮像角度とも称される。Θkは、Θk=k×ΔΘで表される。ΔΘは、例えば、0.1°~2°程度であってよいし、0.5°~1°程度であってよい。kは、-n1≦k≦n2(n1,n2は自然数)の範囲の整数である。n1,n2は、例えば1以上20以下の自然数であってよいが、1以上20以下の自然数に限定されない。図22は、撮像装置7の回転角度がΘka(kaは正の整数)である場合と、撮像装置7の回転角度がΘkb(kbは負の整数)である場合とを示している。
先ず、線広がり関数の特性値に基づいて、空中像9の光軸ずれを測定する場合について説明する。制御部8は、各撮像部位F3~F5について、(n1+n2+1)枚の撮像画像P3~P5の画像データに基づいて、(n1+n2+1)個の線広がり関数LSF3~LSF5を算出し、(n1+n2+1)個の特性値V3~V5を算出する。特性値V3~V5は、線広がり関数LSF3~LSF5のピーク値Hであってよいし、半値幅Wであってよい。特性値V3~V5は、ピーク値Hを半値幅Wで除算した組み合わせ値であってもよい。
次に、変調伝達関数MTFの面積に基づいて、空中像9の光軸ずれを測定する場合について説明する。制御部8は、各撮像部位F3~F5について、(n1+n2+1)枚の撮像画像P3~P5の画像データに基づき、(n1+n2+1)個の変調伝達関数MTFを算出し、(n1+n2+1)個のMTF面積S3~S5を測定する。
閾値T9は、空中像表示装置2の要求仕様に基づいて、適宜設定されてよい。
前記空中像の輝度分布波形における、ピーク値の4分の1値幅に対する半値幅の比が、0.5以上である、空中像表示装置。
前記表示部から射出された画像光を、前記表示部に向かう方向とは異なる方向に反射する第1凹面鏡と、
前記第1凹面鏡によって反射された前記画像光を、前記第1凹面鏡に向かう方向とは異なる方向に反射する凸面鏡と、
前記凸面鏡によって反射された前記画像光を、前記凸面鏡に向かう方向とは異なる方向に反射し、実像の空中像として結像する第2凹面鏡と、
を備える、上記構成(1)~(7)のいずれかに記載の空中像表示装置。
前記凸面鏡は、自由曲面凸面鏡である、上記構成(8)に記載の空中像表示装置。
前記表示部は、前記第1凹面鏡と前記第2凹面鏡との間に位置し、前記表示部の表示面の前記前記第1凹面鏡の反射面に対する傾斜が、前記表示部の表示面の前記第2凹面鏡の反射面に対する傾斜よりも小さい、上記構成(8)または(9)に記載の空中像表示装置。
前記表示部から射出された画像光を、前記表示部に向かう方向とは異なる方向に反射する第1凹面鏡と、
前記第1凹面鏡によって反射された前記画像光を、前記第1凹面鏡に向かう方向とは異なる方向に反射し、実像の空中像として結像する第2凹面鏡と、
を備える、上記構成(1)~(7)のいずれかに記載の空中像表示装置。
前記第1凹面鏡と前記第2凹面鏡とが互いに傾斜した状態で対向し、
前記表示部は、前記第1凹面鏡と前記第2凹面鏡との間に位置している、上記構成(11)または(12)に記載の空中像表示装置。
2 空中像表示装置
2a 構成部材
3 表示部
4 表示パネル
4a 表示面
4ai 仮想面
5 光学系
5a 第1凹面鏡
5aa 反射面
5ai 仮想面
5ap 頂点
5ar 反射面(第1反射面)
5b 凸面鏡
5c 第2凹面鏡
5ci 仮想面
5cp 頂点
5cr 反射面(第2反射面)
5d 第1凹面鏡
5e 第2凹面鏡
6 筐体
6a 画像光射出部
7 撮像装置
7d 撮像方向
7da 撮像方向
8 制御部
9,9’ テストパターン(空中像)
9a 第1帯状画像
9b 第2帯状画像
9c 矩形波チャート
10 装置台
10a 上面
11 移動装置
11h 保持部材
11r レール
11t 移動台
12 第1回転装置
13 第2回転装置
14 取得部
20 利用者
20e 眼
Da 空中像の光軸方向
Dad 設計光軸方向
Lp 画像光
F1~F7 撮像部位
P1~P7 撮像画像
R 空中像
Rp 結像面
Claims (13)
- 表示部と、前記表示部から射出された画像光を実像の空中像として結像させる光学系と、を備えた空中像表示装置であって、
前記空中像の輝度分布波形における、ピーク値の4分の1値幅に対する半値幅の比が、0.5以上である、空中像表示装置。 - 前記空中像の輝度分布波形における、ピーク値の4分の1値幅に対する半値幅の比が、0.68以上である、請求項1に記載の空中像表示装置。
- 前記空中像の歪みが5%以下である、請求項1または2に記載の空中像表示装置。
- 前記空中像の歪みは、理想的な矩形状である理想空中像の辺を基準とし、前記辺の端に位置する前記空中像の角部について前記辺からのずれ長さを%で表した値を、前記角部の歪としたときに、前記角部の歪によって定義される、請求項3に記載の空中像表示装置。
- 前記空中像の歪みは、四隅の前記角部の歪である、請求項4に記載の空中像表示装置。
- 前記空中像の歪みは、四隅の前記角部の歪が最も大きい、請求項4または5に記載の空中像表示装置。
- 前記空中像の輝度が800cd/m2以上である、請求項1~6のいずれか1項に記載の空中像表示装置。
- 前記光学系は、
前記表示部から射出された画像光を、前記表示部に向かう方向とは異なる方向に反射する第1凹面鏡と、
前記第1凹面鏡によって反射された前記画像光を、前記第1凹面鏡に向かう方向とは異なる方向に反射する凸面鏡と、
前記凸面鏡によって反射された前記画像光を、前記凸面鏡に向かう方向とは異なる方向に反射し、実像の空中像として結像する第2凹面鏡と、を備える、請求項1~7のいずれか1項に記載の空中像表示装置。 - 前記第1凹面鏡および前記第2凹面鏡は、自由曲面凹面鏡であり、
前記凸面鏡は、自由曲面凸面鏡である、請求項8に記載の空中像表示装置。 - 前記第1凹面鏡と前記第2凹面鏡とが互いに傾斜した状態で対向し、
前記表示部は、前記第1凹面鏡と前記第2凹面鏡との間に位置し、前記表示部の表示面の前記前記第1凹面鏡の反射面に対する傾斜が、前記表示部の表示面の前記第2凹面鏡の反射面に対する傾斜よりも小さい、請求項8または9に記載の空中像表示装置。 - 前記光学系は、
前記表示部から射出された画像光を、前記表示部に向かう方向とは異なる方向に反射する第1凹面鏡と、
前記第1凹面鏡によって反射された前記画像光を、前記第1凹面鏡に向かう方向とは異なる方向に反射し、実像の空中像として結像する第2凹面鏡と、を備える、請求項1~7のいずれか1項に記載の空中像表示装置。 - 前記第1凹面鏡および前記第2凹面鏡は、自由曲面凹面鏡である、請求項11に記載の空中像表示装置。
- 前記第1凹面鏡の湾曲度が前記第2凹面鏡の湾曲度よりも大きく、
前記第1凹面鏡と前記第2凹面鏡とが互いに傾斜した状態で対向し、
前記表示部は、前記第1凹面鏡と前記第2凹面鏡との間に位置している、請求項11または12に記載の空中像表示装置。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP24823386.8A EP4730021A1 (en) | 2023-06-15 | 2024-06-11 | Aerial image display device |
| JP2025527946A JPWO2024257771A1 (ja) | 2023-06-15 | 2024-06-11 |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2023098830 | 2023-06-15 | ||
| JP2023-098830 | 2023-06-15 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024257771A1 true WO2024257771A1 (ja) | 2024-12-19 |
Family
ID=93851972
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2024/021244 Ceased WO2024257771A1 (ja) | 2023-06-15 | 2024-06-11 | 空中像表示装置 |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP4730021A1 (ja) |
| JP (1) | JPWO2024257771A1 (ja) |
| WO (1) | WO2024257771A1 (ja) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000066131A (ja) * | 1998-08-19 | 2000-03-03 | Harness Syst Tech Res Ltd | 表示装置 |
| JP2011253128A (ja) | 2010-06-03 | 2011-12-15 | Nippon Seiki Co Ltd | 結像装置 |
| JP2020144281A (ja) * | 2019-03-07 | 2020-09-10 | オムロン株式会社 | 評価方法 |
| JP2020177221A (ja) * | 2019-04-22 | 2020-10-29 | 久保田 洋治 | 遠視点空中像投射装置 |
| JP2022140896A (ja) * | 2021-03-15 | 2022-09-29 | オムロン株式会社 | 導光板デバイス |
| WO2023022024A1 (ja) * | 2021-08-20 | 2023-02-23 | 京セラ株式会社 | 空中像表示装置 |
-
2024
- 2024-06-11 WO PCT/JP2024/021244 patent/WO2024257771A1/ja not_active Ceased
- 2024-06-11 JP JP2025527946A patent/JPWO2024257771A1/ja active Pending
- 2024-06-11 EP EP24823386.8A patent/EP4730021A1/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000066131A (ja) * | 1998-08-19 | 2000-03-03 | Harness Syst Tech Res Ltd | 表示装置 |
| JP2011253128A (ja) | 2010-06-03 | 2011-12-15 | Nippon Seiki Co Ltd | 結像装置 |
| JP2020144281A (ja) * | 2019-03-07 | 2020-09-10 | オムロン株式会社 | 評価方法 |
| JP2020177221A (ja) * | 2019-04-22 | 2020-10-29 | 久保田 洋治 | 遠視点空中像投射装置 |
| JP2022140896A (ja) * | 2021-03-15 | 2022-09-29 | オムロン株式会社 | 導光板デバイス |
| WO2023022024A1 (ja) * | 2021-08-20 | 2023-02-23 | 京セラ株式会社 | 空中像表示装置 |
Also Published As
| Publication number | Publication date |
|---|---|
| JPWO2024257771A1 (ja) | 2024-12-19 |
| EP4730021A1 (en) | 2026-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP3631182B2 (ja) | 画像投射装置 | |
| US5798864A (en) | Projection type image display apparatus | |
| US20090002574A1 (en) | Method and a system for optical design and an imaging device using an optical element with optical aberrations | |
| JP4423380B2 (ja) | 結像光学系および距離測定装置 | |
| JP7431389B1 (ja) | 空中像表示装置 | |
| EP2300864A1 (en) | Optical scan unit, image projector including the same, vehicle head-up display device, and mobile phone | |
| TWI497116B (zh) | 立體影像顯示裝置及立體影像顯示方法 | |
| US8870390B2 (en) | Low Z-height projection system for projecting structured light for 3D imaging | |
| US8208190B2 (en) | Optical imaging system | |
| US7834990B2 (en) | Evaluation method for evaluating optical characteristics of optical system, evaluation method for evaluating projector, evaluation device for evaluating optical characteristics, and screen | |
| WO2024257771A1 (ja) | 空中像表示装置 | |
| WO2024257770A1 (ja) | 空中像表示装置 | |
| WO2025070291A1 (ja) | 解像度測定装置 | |
| WO2025070290A1 (ja) | 空中像表示装置 | |
| CN209642791U (zh) | 一种拍摄装置以及检测设备 | |
| WO2024162079A1 (ja) | 測定システム、合否判定システム、および測定装置 | |
| WO2024162078A1 (ja) | 光軸方向測定システム、光軸方向測定方法、プログラム、光軸方向測定装置、および合否判定システム | |
| WO2024162077A1 (ja) | 解像度測定装置、光軸方向測定システム、光軸方向測定方法、プログラム、光軸方向測定装置、および合否判定システム | |
| Blankenbach et al. | 42.1: Comparison of Key Optical Measurements of Curved to Flat CD TVs and Their Impact on Image Quality | |
| US7102826B2 (en) | Telecentric singlet having a small height requirement | |
| JP4029154B2 (ja) | プロジェクタ | |
| JP6326814B2 (ja) | 投射光学系 | |
| JP2015096887A (ja) | 投射光学系および画像表示装置 | |
| KR101882977B1 (ko) | 360도 이미지를 형성할 수 있는 렌즈 모듈 및 360도 이미지 형성 어플리케이션 | |
| TWI872568B (zh) | 解像力檢測裝置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 24823386 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2025527946 Country of ref document: JP Kind code of ref document: A |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2025527946 Country of ref document: JP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2024823386 Country of ref document: EP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2024823386 Country of ref document: EP Effective date: 20260115 |
|
| ENP | Entry into the national phase |
Ref document number: 2024823386 Country of ref document: EP Effective date: 20260115 |
|
| ENP | Entry into the national phase |
Ref document number: 2024823386 Country of ref document: EP Effective date: 20260115 |
|
| ENP | Entry into the national phase |
Ref document number: 2024823386 Country of ref document: EP Effective date: 20260115 |
|
| WWP | Wipo information: published in national office |
Ref document number: 2024823386 Country of ref document: EP |