WO2023047897A1 - ヘッドアップディスプレイ装置 - Google Patents
ヘッドアップディスプレイ装置 Download PDFInfo
- Publication number
- WO2023047897A1 WO2023047897A1 PCT/JP2022/032529 JP2022032529W WO2023047897A1 WO 2023047897 A1 WO2023047897 A1 WO 2023047897A1 JP 2022032529 W JP2022032529 W JP 2022032529W WO 2023047897 A1 WO2023047897 A1 WO 2023047897A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- light
- emitting element
- vehicle
- imaging
- display
- Prior art date
Links
- 238000003384 imaging method Methods 0.000 claims abstract description 234
- 230000003287 optical effect Effects 0.000 claims abstract description 45
- 230000001678 irradiating effect Effects 0.000 claims description 6
- 238000001579 optical reflectometry Methods 0.000 claims description 3
- 238000001514 detection method Methods 0.000 abstract description 10
- 238000010586 diagram Methods 0.000 description 26
- 230000000694 effects Effects 0.000 description 12
- 230000008859 change Effects 0.000 description 10
- 230000008901 benefit Effects 0.000 description 8
- 230000006866 deterioration Effects 0.000 description 7
- 238000009434 installation Methods 0.000 description 6
- 230000002411 adverse Effects 0.000 description 5
- 230000001419 dependent effect Effects 0.000 description 5
- 230000004907 flux Effects 0.000 description 5
- 239000000463 material Substances 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000001154 acute effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 2
- 230000000052 comparative effect Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000002441 reversible effect Effects 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 230000001629 suppression Effects 0.000 description 2
- 238000010521 absorption reaction Methods 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000011109 contamination Methods 0.000 description 1
- 238000002310 reflectometry Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/23—Head-up displays [HUD]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/23—Head-up displays [HUD]
- B60K35/235—Head-up displays [HUD] with means for detecting the driver's gaze direction or eye points
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/149—Instrument input by detecting viewing direction not otherwise provided for
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/20—Optical features of instruments
- B60K2360/21—Optical features of instruments using cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/40—Hardware adaptations for dashboards or instruments
- B60K2360/48—Sensors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/741—Instruments adapted for user detection
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K37/00—Dashboards
- B60K37/20—Dashboard panels
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Y—INDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY
- B60Y2400/00—Special features of vehicle units
- B60Y2400/30—Sensors
- B60Y2400/301—Sensors for position or displacement
- B60Y2400/3015—Optical cameras
Definitions
- the present invention relates to, for example, a head-up display (HUD) device mounted on a vehicle such as an automobile.
- HUD head-up display
- Patent Document 1 describes detecting a driver's viewpoint using an infrared camera and attaching the infrared camera to a steering column (steering wheel shaft) (Patent Document 1 [ 0018], Fig. 4).
- the camera When the camera is mounted on the steering column, the camera rotates as the steering wheel rotates, causing distortion in the captured image. are provided.
- the camera and the viewpoint detection unit can be incorporated into the HUD device, and the viewpoint detection unit and the HUD control unit can be connected with, for example, a short wiring in the HUD device, reducing signal delay and communication noise. contamination can be suppressed.
- the inventor further considered providing an infrared camera (hereinafter sometimes simply referred to as a camera) outside the path of the display light that displays the image.
- a camera an infrared camera
- it is possible to freely determine the arrangement of the camera independently of the optical system for display light, thereby improving the degree of freedom in design.
- one optical element (reflecting mirror, etc.) does not need to correspond to both visible light and infrared light, and the configuration (structure) of the optical element (optical system) can be simplified. is also advantageous.
- the light-emitting element for example, an LED that emits infrared rays
- the camera for example, a solid-state imaging device such as a CCD
- the direction of the imaging light emitted by the light emitting element is also set appropriately.
- the imaging light is emitted toward the windshield (reflective translucent member) through the translucent cover provided in the opening of the housing of the HUD device.
- the translucent cover provided in the opening of the housing of the HUD device.
- outside light enters through the translucent cover from the upper side of the vehicle in the height direction.
- an LED that emits infrared rays or a camera (for example, a solid-state imaging device such as a CCD) may be visible. Therefore, it is preferable to consider countermeasures for suppressing external light and countermeasures for suppressing discomfort due to human visual observation (in other words, deterioration of marketability of the HUD device).
- part of the imaging light emitted from the light-emitting element (LED, etc.) is reflected by the light-transmitting cover, and the reflected light (stray light) enters the camera (solid-state imaging element, etc.). It may be an error. Therefore, it is preferable to consider measures against this stray light as well.
- One of the objects of the present invention is to reduce the distortion of the captured image in a head-up display device having a function of displaying an image (virtual image) and a function of imaging the parts (eyes, etc.) of the occupant, and detecting the parts. It is to improve accuracy.
- the head-up display device comprises: Displaying a virtual image to an occupant of the vehicle by irradiating display light of an image on a reflective translucent member provided in the vehicle and having both light reflectivity and transparency, irradiating a part of the occupant with imaging light, and capturing an image of the part by receiving reflected light from the part via the reflective translucent member;
- a head-up display device disposed between the occupant and the translucent reflecting member in a plan view viewed from above in the height direction of the vehicle, the head-up display device comprising: a housing; a translucent cover provided on the housing; a display unit provided in the housing for displaying the image; an optical system that is provided in the housing and includes an optical element that irradiates the display light toward the reflecting light-transmitting member via the light-transmitting cover; a light-emitting element that is provided outside the path of the display light of the image in the housing and that emits the imaging light; and an imaging element that receives the reflected light arriving via the reflective translucent member
- an imaging unit having has In a plan view seen from above in the height direction of the vehicle,
- the housing is arranged between the seated position of the passenger and the reflective translucent member,
- the region of the translucent cover provided on the housing is a display light passing area through which the display light passes; an imaging device region corresponding to the imaging device located below the translucent cover,
- the imaging device area is provided on the end side of the vehicle in the width direction of the vehicle, which is opposite to the center side, with respect to the display light passing area as viewed from the occupant.
- the HUD device can be arranged, for example, in front of the occupant (imaging target) and in front of the windshield (near the windshield, etc.).
- the HUD device emits display light for displaying an image and imaging light for imaging the parts of the occupant.
- the imaging light emitted from the light-emitting element passes through the windshield (reflecting light-transmitting member) and irradiates the occupant.
- the light is received by (imaging element) and imaged.
- a quadrangle looks like a quadrangle, but when viewed from an angle, it looks like a parallelogram or a trapezoid, and the image is distorted.
- the occupant (for example, the driver) is positioned on the left end side in the width direction of the vehicle in a left-hand drive vehicle, and is positioned on the right end side in a right-hand drive vehicle.
- the change in the curved surface shape of the windshield is generally sharp at the ends of the vehicle (in other words, the curvature is large and the radius of curvature is small), and is gentle at the center side (in other words, the curvature is small and the radius of curvature is small). large).
- the light is reflected at a portion where the curved surface shape changes abruptly on the end side of the vehicle, it is possible to reflect the light at a more acute angle with respect to the width direction of the vehicle.
- This acute-angle reflection is possible makes it easy to use the display light to irradiate the front of the passenger (driver) while approaching it, and furthermore, the reflected light of the imaging light from the passenger (driver) can be more easily reflected. It can be easily used to reflect light at a position close to the front and return it to a camera (imaging device) positioned close to the light emitting device. Imaging at a position close to the front reduces the distortion of the captured image.
- the imaging device is arranged at a position where the optical axis of the imaging device is less twisted with respect to the translucent reflecting member, the distortion of the captured image can be reduced, and the detection accuracy of the position of the user's eyes can be improved. can be improved.
- the optical path length of the return optical path of the reflected light of the imaging light can be shortened. This point is useful, for example, in suppressing expansion of distortion caused by reflection of imaging light on the windshield. In this respect as well, it is possible to reduce the distortion of the captured image.
- the reflected light can be received at a position closer to the front in the width direction of the vehicle (in other words, the imaging device can be arranged closer to the front).
- the imaging device can be arranged closer to the front.
- the area in which the image sensor is arranged is wider in the width direction of the vehicle than the display light passing area through which the display light (a wider luminous flux) passes. It is provided on the edge side (opposite side to the central side), and a layout configuration is adopted that makes it easy to use the portion on the edge side of the windshield (reflecting light-transmitting member) where there is a large change in the curved surface.
- the size of the housing of the HUD device can be reduced.
- the display light is visible light
- the imaging light is infrared light, having a filter portion provided under the translucent cover that transmits infrared light and blocks visible light;
- a filter part area corresponding to the filter part is provided in the area of the light-transmitting cover,
- the imaging element region may be provided within the filter portion region.
- a filter portion that transmits infrared light and blocks visible light is provided under the translucent cover.
- this filter portion for example, a multilayer long-pass filter made of a material that absorbs visible light and transmits infrared light (specifically, an IR filter or the like attached to the back surface of the translucent cover) can be used. .
- the imaging device is placed at a position corresponding to this filter section.
- a layout configuration is adopted in which the imaging element area is provided within the filter portion area corresponding to the filter portion.
- the human line of sight from above is also blocked by the filter section. Therefore, it is possible to suppress the occurrence of discomfort due to human visual observation (in other words, deterioration of the marketability of the HUD device).
- a point of intersection between the optical axis of the imaging element and the translucent reflective member is located above a point of reflection of the principal ray of the display light on the translucent reflective member.
- the principal ray of the imaging light is reflected by the windshield (reflecting translucent member) above the position at which the principal ray of the image display light is reflected.
- the "principal ray of imaging light” is, in other words, a central ray (referred to as a principal ray) that travels along the optical axis of the imaging device. Therefore, "the reflection position of the principal ray of the imaging light on the windshield” can be rephrased as "the position of the intersection of the optical axis of the imaging device and the windshield”.
- the human face (especially the eyes) is located above the instrument panel and steering wheel. Therefore, according to the height of the face, eyes, etc., the position of intersection of the optical axis of the imaging light and the windshield is set to a position higher than the position of the reflection area of the display light of the image, and the position of the human part (for example, the face) (eyes, etc.) can be imaged at an angle closer to the front. As a result, the distortion of the captured image can be suppressed, and the detection accuracy of the positions of the face and eyes can be maintained at a high level.
- the area of the light-transmitting cover provided on the housing includes a light-emitting element area corresponding to the light-emitting element positioned below the light-transmitting cover;
- the light emitting element region may be provided on an end portion side of the vehicle in the width direction of the vehicle, which is opposite to the center side, with respect to the display light passing region, when viewed from the occupant.
- the fourth aspect illustrates a preferred example of the layout configuration of the light emitting element regions.
- the light emitting element region is provided on the vehicle end side (the side opposite to the center side) with respect to the display light passing region.
- the "light-emitting element area” is arranged on the same side as the "imaging element area” shown in the first aspect (on the edge side of the vehicle with respect to the display light passing area).
- Adopting this layout configuration has the effect that, for example, the light-emitting element and the imaging element that are arranged close to each other can be handled as one imaging unit. Specifically, by housing the light-emitting element and the imaging element in a common package to form a unit, handling becomes easier than when each element is handled individually.
- the light-emitting element and the imaging element are installed separately, it is possible that there may be a concern about variations in the relative positions of the elements.
- the relative positional error of each element is determined by the layout accuracy of each element in the manufacturing process of the unit and is not affected by the positional deviation during mounting.
- the area of the light-transmitting cover provided on the housing includes a light-emitting element area corresponding to the light-emitting element positioned below the light-transmitting cover;
- the light emitting element area may be provided on the center side of the vehicle in the width direction of the vehicle with respect to the display light passing area as viewed from the passenger.
- the fifth aspect exemplifies another preferred example of the layout configuration of the light emitting element region.
- the light emitting element area is provided on the vehicle center side with respect to the display light passing area.
- the "light-emitting element area” is arranged on the opposite side (the center side of the vehicle) of the “imaging element area” with respect to the display light passing area. Since the display light passing area exists between the light emitting element area and the imaging element area, the distance between the areas can be increased accordingly.
- the layout configuration of this aspect is useful as a countermeasure against stray light.
- the layout configuration of this embodiment is also useful in realizing a layout of elements with a higher degree of freedom according to the situation.
- the area of the light-transmitting cover provided on the housing includes a light-emitting element area corresponding to the light-emitting element positioned below the light-transmitting cover; Having first and second light emitting elements as the light emitting elements,
- the light emitting element region has a first light emitting element region corresponding to the first light emitting element and a second light emitting element region,
- the first light emitting element region is provided on the center side of the vehicle in the width direction of the vehicle with respect to the display light passing region as viewed from the passenger
- the second light-emitting element region may be provided on an end portion side of the vehicle in the width direction of the vehicle, which is opposite to the center side, with respect to the display light passing region, as viewed from the passenger. good.
- the first and second light emitting elements are used.
- the first light emitting element is provided on the center side of the vehicle with respect to the display light passing area.
- the second light emitting element is provided on the edge side of the vehicle with respect to the display light passing area.
- the display light passing region exists between the first and second light emitting elements, so that the distance between them is wide and the installation positions of the elements are considerably different. Therefore, for example, an optical path (first optical path) when imaging light emitted by the first light emitting element is reflected by the windshield and applied to a part of a person (first optical path), and an imaging light emitted by the second light emitting element passes through the windshield. It is possible to make the light path different from the light path (second light path) when the light is reflected by the shield and illuminates the part of the person.
- the surface of the sunglasses worn by the driver causes unusual reflection (diffuse reflection, etc.) of the imaging light
- the unusual reflected light is reflected by the windshield and returned to the image sensor.
- the distortion of the image may increase.
- the optical path In other words, it is possible to subtly change the angle of incidence), or to change the cross-sectional shape of the beam of light that irradiates the part of the person, or to expand the area. This may reduce the stray light described above.
- the incident angle of the returning stray light to the image sensor changes and becomes difficult to detect.
- the S/N may be improved by increasing normal (regular) return light.
- the configuration of this aspect can be a countermeasure against stray light when a person (driver) wears sunglasses or the like.
- this aspect is also useful in terms of increasing the amount of imaging light returning to the imaging element and improving the detection sensitivity.
- the area of the light-transmitting cover provided on the housing includes a light-emitting element area corresponding to the light-emitting element positioned below the light-transmitting cover; Having first and second light emitting elements as the light emitting elements,
- the light emitting element region has a first light emitting element region corresponding to the first light emitting element and a second light emitting element region,
- the first light emitting element region is provided on the center side of the vehicle in the width direction of the vehicle with respect to the display light passing region as viewed from the passenger,
- the second light emitting element region is viewed from the occupant, the center side of the vehicle in the width direction of the vehicle with respect to the display light passage area, and, It may be provided at a position farther from the display light passing region than the first light emitting element region.
- first and second light emitting elements are provided, and each light emitting element is switched and used, or two light emitting elements are used in combination. , measures against stray light, or increase the amount of imaging light returning to the imaging element.
- the first and second light emitting elements are provided on opposite sides of the display light passing region, whereas in this aspect, the first and second light emitting elements are both provided on the central side (same side). Also, the second light emitting element is provided at a position farther from the display light passing region than the first light emitting element. The interval between the first and second light emitting elements can also be finely adjusted as appropriate.
- FIG. 1A is a diagram showing an example of the configuration of the HUD device, and FIG. , and a second region (filter region) in which infrared light is transmitted and visible light is not transmitted.
- FIG. 2A is a diagram showing an example layout of an imaging unit including a light emitting element and an imaging element
- FIG. 2B is a diagram showing another example layout of the imaging unit.
- FIG. 3A is a diagram showing an example of the arrangement of the HUD device in a left-hand drive vehicle, an example of optical paths of visible light (display light) and infrared light (imaging light), etc.
- FIG. It is a figure which shows the example of arrangement
- FIG. 4A is a diagram showing an example of the arrangement of the HUD device in a right-hand drive vehicle, an example of optical paths of visible light (display light) and infrared light (imaging light), etc.
- FIG. It is a figure which shows the example of arrangement
- FIG. 5 is a diagram for explaining the advantages of arranging the imaging device (imaging device region) on the end side of the vehicle with respect to the display light passing region.
- FIG. 6 is a diagram showing a preferred example of optical paths (routes) of display light and imaging light.
- FIGS. 7A and 7B are diagrams for explaining the effect of blocking external light and line of sight by the filter section.
- FIGS. 9A to 9C show a light-emitting element (light-emitting element area) and an image pickup element (image pickup element area) in consideration of stray light generated in the light-transmitting cover (or the filter section provided under the light-transmitting cover).
- FIGS. 9A to 9C show a light-emitting element (light-emitting element area) and an image sensor (image sensor area) in consideration of stray light generated in the light-transmitting cover (or the filter section provided under the light-transmitting cover).
- FIG. 9A to 9C show a light-emitting element (light-emitting element area) and an image sensor (image sensor area) in consideration of stray light generated in the light-transmitting cover (or the filter section provided under the light-transmitting cover).
- FIG. 9A to 9C show a light-emitting element (light-emitting element area) and an image sensor (image sensor area) in consideration of stray light generated in the light-transmitting
- FIG. 10A shows an example in which the light emitting element (light emitting element area) is arranged on the right side of the display light passing area as seen from the driver, and the image pickup element (image pickup element area) is arranged on the left side as seen from the driver.
- FIG. 10B is a diagram showing the stray light suppression effect.
- FIG. 11 is a diagram showing an example of a layout configuration using first and second light emitting elements.
- FIG. 12 is a diagram showing another example of layout configuration using the first and second light emitting elements.
- FIG. 1A is a diagram showing an example of the configuration of the HUD device, and FIG. , and a second region (filter portion region that transmits infrared light) that transmits infrared light and does not transmit visible light.
- a head-up display (HUD) device 100 displays an image on a windshield 2 provided in a vehicle 1 and serving as a reflective translucent member having both light reflectivity and transmissivity. It has a function of displaying a virtual image V on a virtual image display surface PS for an occupant (here, the driver) 5 of the vehicle 1 by irradiating the light L1.
- HUD head-up display
- the HUD device 100 irradiates the part (the face, the eyes, etc., here referred to as the eyes (viewpoint) 7) of the occupant (driver) 5 with the imaging light L2 via the windshield 2, and It also has a function of capturing an image of a part by receiving reflected light L3 from the part via the windshield 2 .
- the position of the eye (viewpoint) is detected based on the captured image. Based on the detected viewpoint position, for example, viewpoint position tracking lighting, viewpoint position tracking warping, etc. may be performed.
- the HUD device 100 in a plan view seen from the upper side in the height direction (Y direction) of the vehicle 1, has an occupant (driver) 5 (or the steering wheel 8) and the windshield 2 as a reflective translucent member, positioned forward (and downward) as viewed from the driver 5. As shown in FIG.
- the HUD device 100 is housed in the instrument panel 4 near the windshield 2 .
- the HUD device 100 includes a housing 116, a translucent cover 112 provided on the housing, and a display unit 102 (such as a liquid crystal display device) provided in the housing for displaying an image. ), and an optical element (curved mirror 108 ) (including the plane mirror 106), and a light emitting element (not shown in FIG. 1, FIG. 2 etc.) and an imaging element (not shown in FIG. 1, reference numeral 115 in FIG. 2 etc.) that receives the reflected light L3 of the imaging light arriving via the windshield 2 (imaging unit ) 110 and .
- the light emitting element 113 emits imaging light toward the windshield 2 through the translucent cover 112 in the example of FIG. 1(A).
- the configuration is not limited to this, and the light emitting element 113 may be configured to directly irradiate the passenger (driver or the like) with the imaging light without passing through the windshield 2 .
- the display light L1 is visible light
- the imaging light L2 (and the reflected light L3 of the imaging light that is reflected by the human body and returns to the imaging unit 110) is infrared light (including near-infrared light).
- infrared light including near-infrared light
- the HUD device 100 also has a filter section 114 provided on the lower side of the translucent cover 112 that transmits infrared light and blocks visible light.
- This filter section 114 has a function of preventing external light from entering the imaging section 110 or preventing a person from viewing the imaging section 110 through the translucent cover 112 .
- a multilayer long-pass filter made of a material that absorbs visible light and transmits infrared light (specifically, an IR filter or the like attached to the back surface of the translucent cover 112) is used. be able to.
- the region of the light-transmitting cover 112 includes a display light passing region (sometimes referred to as a first region) Z1 through which display light (visible light) passes, and infrared light. It can be distinguished from a filter portion region (region corresponding to the filter portion 114; sometimes referred to as a second region) Z2 that transmits and blocks visible light.
- a display light passing region sometimes referred to as a first region
- Z1 display light (visible light) passes, and infrared light. It can be distinguished from a filter portion region (region corresponding to the filter portion 114; sometimes referred to as a second region) Z2 that transmits and blocks visible light.
- first region Z1 can also be referred to as a "display light (visible light) transmission region”.
- the second region Z2 can also be called an "infrared light transmission region.”
- the regions Z1 and Z2 are drawn along the longitudinal direction of the vehicle 1 for the sake of convenience, but they are actually arranged along the width direction (horizontal direction) of the vehicle 1. (this point will be discussed later).
- FIG. 2A is a diagram showing an example layout of an imaging unit including a light emitting element and an imaging element
- FIG. 2B is a diagram showing another example layout of the imaging unit.
- parts common to those in FIG. 1 are denoted by the same reference numerals (the same applies to other drawings).
- FIGS. 2(A) and (B) show an example of arrangement in a left-hand drive vehicle (see FIG. 3(A)).
- the HUD device 100 provides a space between an occupant (driver) 5 (or a steering wheel 8) and a windshield 2 as a reflective translucent member. It is arranged at a front (and lower) position as viewed from 5 .
- the translucent cover 112 provided on the housing 116 is exposed to the windshield 2 side.
- Display light L1 and imaging light L2 are emitted through the translucent cover 112, and reflected light L3 of the imaging light L2 from human parts returns.
- Light is received by an element (camera in a broad sense) 115 .
- a region (light-transmitting cover region Z0) where the light-transmitting cover 112 exists is a rectangular region in a plan view viewed from above in the height direction (Y direction) of the vehicle 1, and is indicated by a thick solid line in the drawing. ing.
- a device region (broadly speaking, a camera region) Zr is provided.
- the light emitting element 113 and the imaging element 115 are components of the imaging unit (imaging unit) 110 .
- the imaging unit (imaging section) 110 is arranged below the filter section 114 .
- a layout configuration is employed in which an imaging unit area (imaging section area) is arranged in a filter section area Z2 corresponding to the filter section 114 .
- Reference numeral 106 denotes a plane mirror that is a component of the optical system of the HUD device 100.
- the imaging element region Zr is opposite to the central side of the vehicle in the width direction of the vehicle 1 with respect to the display light passing region Z1 when viewed from the passenger (driver) 5.
- side in other words, the left side as seen from the driver 5).
- the light emitting element 113 and the imaging element 115 are arranged along the longitudinal direction of the vehicle.
- the light emitting element 113 is arranged in the rear
- the imaging element 115 is arranged in the front. Adopting this arrangement has the advantage of suppressing adverse effects of stray light caused by reflection of infrared light on the translucent cover 112 (this point will be described later).
- the light emitting element 113 and the imaging element 115 are arranged along the width direction (horizontal direction) of the vehicle.
- the light emitting element 113 is arranged on the right side as seen from the driver 5, and the imaging element 115 is arranged on the left side. Adopting this arrangement has the advantage of suppressing adverse effects of stray light caused by reflection of infrared light on the translucent cover 112 (this point will be described later).
- FIG. 3A is a diagram showing an example of the arrangement of the HUD device in a left-hand drive vehicle, an example of optical paths of visible light (display light) and infrared light (imaging light), etc.
- FIG. It is a figure which shows the example of arrangement
- FIG. 3 the arrangement shown in FIG. 2(A) is adopted. Further, as shown in FIG. 3A, the vehicle 1 is a left-hand drive vehicle, and the driver 5 is positioned on the left end (second end) side of the vehicle 1 .
- Reference numeral 91 denotes a right side mirror, and reference numeral 93 denotes a left side mirror.
- a portion P1 surrounded by a dashed circle on the windshield 2 indicates a reflection position in the width direction of the vehicle of display light (visible light) L1 for displaying an image.
- a point P2 is a reflection position in the width direction of the vehicle of the emitted light L2 of the imaging light (infrared light) and the reflected light (or the feedback light returning toward the imaging device 115) L3 from the part of the person. show.
- the point P1 is located on the center side (closer to the center) in the width direction of the vehicle, and the point P2 is located on the end side (closer to the end).
- the change (degree of bending) of the curved surface of the windshield 2 at the point P1 is gradual, while the change of the curved surface of the windshield 2 at the point P2 is quite steep.
- This steep curved surface it is possible to reflect the imaging light (infrared light) L2 and L3 at an acute angle and to image the driver 5 from a position as close to the front as possible. It also has the effect of suppressing the transformation (details of this point will be described later).
- an imaging unit (imaging section) 110 includes a light-emitting element 113 and an imaging element 115 . Note that the filter portion region Z2 is omitted in FIG. 3B.
- FIG. 3B in a plan view seen from the upper side in the height direction of the vehicle 1, a light emitting element region Ze is provided corresponding to the light emitting element 113, and an image pickup element region Zr is provided corresponding to the image pickup element 115. is provided.
- the imaging device area Zr is located on the left side of the display light passing area Z1 as seen from the driver 5, in other words, on the end side in the width direction (horizontal direction) of the vehicle 1.
- FIG. 4A is a diagram showing an example of the arrangement of the HUD device in a right-hand drive vehicle, an example of optical paths of visible light (display light) and infrared light (imaging light), etc.
- FIG. It is a figure which shows the example of arrangement
- parts common to those in FIG. 3 are given the same reference numerals.
- the vehicle 1 is a right-hand drive vehicle, and the driver 5 is positioned on the right end (first end) side of the vehicle 1 .
- the HUD device is also provided on the right end side in the width direction of the vehicle 1 .
- FIG. 5 is a diagram for explaining the advantages of arranging the imaging device (imaging device region) on the end side of the vehicle with respect to the display light passing region. 5 assumes the left-hand drive vehicle shown in FIG.
- the imaging light infrared light
- FIG. is drawing.
- the imaging light (infrared light) L2 emitted from the light emitting element 113 is irradiated to the driver 5 via the windshield (translucent reflecting member) 2 (see FIG. 3A), and the reflected light L3 is incident on the windshield 2, reflected, and received and imaged by a camera (image pickup device) 115 arranged at a predetermined position.
- a quadrangle looks like a quadrangle, but when viewed from an angle, it looks like a parallelogram or a trapezoid, and the image is distorted. Therefore, it is preferable to take an image from a position as close to the front as possible.
- the dashed straight line G1 indicates the sagittal plane of the driver 5
- the direction along the sagittal plane G1 is the front direction
- the intersection of the sagittal plane G1 and the windshield 2 is It can be called the front position.
- An image pickup unit (image pickup unit) 110 having a light emitting element 113 and an image pickup element 115 does not overlap the display light passage area Z1 so as not to hinder the progress of the display light L2 (L3). It is arranged in the vicinity of the light passing area Z1.
- the imaging element can be arranged either on the left side or the right side of the display light passing area Z1.
- the imaging element arranged on the left side is denoted by reference numeral 115
- the imaging element arranged on the right side is denoted by reference numeral 115' to distinguish between them.
- those related to the image pickup element 115' are distinguished by attaching "'".
- the reflected light L3 is reflected obliquely forward left as viewed from the driver 5 at an angle ⁇ 1, and the reflected light L3′ is reflected obliquely forward right viewed from the driver 5 at an angle ⁇ 1. Both reflection angles are ⁇ 1.
- the angle of incidence (and angle of reflection) of principal ray L3 is ⁇ 2
- the angle of incidence (and angle of reflection) of principal ray L3' is ⁇ 3, where ⁇ 2 ⁇ 3.
- the driver 5 is positioned on the left end side in the width direction of the vehicle 1 in a left-hand drive vehicle. Moreover, as is clear from FIG. 5, the change in the curved surface shape of the windshield 2 is abrupt at the end of the vehicle 1 (in other words, when the shape of the windshield 2 is a partial arc, the curvature of the arc is is large and the radius of curvature is small), and is gentle on the central side (in other words, the curvature of the partial arc is small and the radius of curvature is large).
- the light is reflected at a point (point P2 in FIG. 5) where the curved surface shape changes abruptly on the end portion side of the vehicle 1, the light is formed at a sharper angle (angle ⁇ 2 ) can be reflected.
- angle ⁇ 2 the angle
- the fact that this acute-angle reflection is possible makes it easy to use the display light L2 for irradiating it closer to the front of the driver 5, and also makes the reflected light L3 of the imaging light from the driver 5 more frontal. It can be easily used for reflecting light at a near position (a position near the sagittal plane G1) and returning it to an imaging device (camera) 115 positioned near the light emitting device 113 . Imaging at a position close to the front reduces the distortion of the captured image.
- the imaging element 115 is arranged at a position where the twist of the optical axis of the imaging element is small with respect to the windshield (reflecting translucent member) 2, the distortion of the captured image can be reduced.
- the eye position detection accuracy can be improved.
- the optical path length of the return optical path of the reflected light of the imaging light (principal ray L3 in FIG. 5) can be shortened. This point is useful, for example, in suppressing expansion of distortion caused by reflection of imaging light on the windshield 2 . In this respect as well, it is possible to reduce the distortion of the captured image.
- the reflected light is received at a position closer to the front in the width direction of the vehicle (in other words, the imaging element is placed closer to the front position (the intersection of the sagittal plane G1 and the windshield 2). can do.
- the size of the housing 116 expands in the lateral direction (the width direction of the vehicle), and the HUD device 100 inevitably increases in size. Therefore, a configuration that efficiently utilizes acute-angle reflection can be expected to have the effect of suppressing an increase in housing size.
- the imaging element (camera) 115 is arranged at a position close to the display light passing area Z1, which contributes to miniaturization of the housing 116 of the HUD device 100.
- the angle of incidence (and angle of reflection) ⁇ 3 is quite large. This substantially means that the parts of the driver 5 are taken from a position that is far from the front and from a fairly oblique angle, and the distortion of the captured image becomes large.
- the optical path length of the reflected light L3' is longer than that of the reflected light L3, which may increase the error.
- the imaging element 115' in order to receive the reflected light L3', the imaging element 115' must be placed at a position away from the display light passing area Z1. Therefore, the housing 116 is increased in size, which goes against the demand for miniaturization of the HUD device 100 .
- the image sensor region Ze (see FIG. 3B) in which the image sensor 115 is arranged is larger than the display light passing region Z1 through which the display light (luminous flux) L1 passes.
- the image sensor region Ze (see FIG. 3B) in which the image sensor 115 is arranged is larger than the display light passing region Z1 through which the display light (luminous flux) L1 passes.
- adopting a layout configuration that makes it easy to use the portion on the end side of the windshield (reflecting translucent member) 2 where there is a large change in the curved surface. are doing.
- the size of the housing of the HUD device can be reduced.
- FIG. 6 is a diagram showing a preferred example of optical paths (routes) of display light and imaging light.
- the same reference numerals are given to the parts that are common to the previous figures. Description of each part shown in FIG. 6 is omitted. Note that FIG. 6 assumes a left-hand drive vehicle shown in FIG. 6A (this also applies to subsequent figures).
- the principal ray R2 of the imaging light L2 (in this case, irradiation light emitted from the light emitting element 113 toward the windshield 2) ) 2 (position in the height direction of the vehicle) 2 is set above the position (position in the height direction) YA where the principal ray R1 of the display light L1 of the image is reflected.
- the "principal ray of imaging light” is, in other words, the central ray (this is called the principal ray) that travels along the "optical axis" of the image sensor. Taking this into account, "principal ray R2 of imaging light L2" can be rephrased as “optical axis R2 of imaging device 115".
- the reflection position YB of the principal ray R2 of the imaging light L2 on the windshield 2 can be rephrased as "the position YB of the intersection of the optical axis R2 of the imaging device 115 and the windshield 2".
- the intersection position YB between the optical axis R2 of the imaging light L2 and the windshield 2 is set at a position higher than the reflection position YA of the display light L1 of the image on the windshield 2 in accordance with the height of the face, eyes, etc.
- a human part for example, face, eyes, etc.
- the distortion of the captured image can be suppressed, and the detection accuracy of the face and eye positions can be maintained at a high level.
- the situation in which the imaging light L2 is blocked by the instrument panel 4 or the steering wheel 8 and the body part of the person cannot be imaged can be reliably avoided. Therefore, it is possible to suppress deterioration in the reliability of the imaging function provided in the HUD device 100 .
- FIGS. 7A and 7B are diagrams for explaining the effect of blocking external light and line of sight by the filter section.
- FIG. 7(A) is a reproduction of FIG. 2(A) shown above.
- FIG. 7B is a cross-sectional view taken along line AA in FIG. 7A.
- the lower side of the translucent cover 112 fixed to the housing 116 transmits infrared light and visible light.
- a filter section (sometimes simply referred to as a filter) 114 that blocks (including absorption) is provided.
- a multilayer long-pass filter made of a material that absorbs visible light and transmits infrared light (specifically, an IR filter or the like attached to the back surface of the translucent cover) can be used. can.
- a filter portion region Z2 corresponding to the filter portion 114 is provided in a region where the light-transmitting cover 2 exists (light-transmitting cover region) when viewed from above in the height direction of the vehicle (for example, FIG. 3 ( A)).
- An imaging element area Zr corresponding to the imaging element 115 is provided in this filter area Z2.
- the imaging element 115 is arranged at a position corresponding to this filter section 114 .
- the filter unit 114 is provided above (above) the image sensor 115 in the housing 116 of the HUD device 100 so as to cover the image sensor 115 .
- ⁇ indicates the range (angular range) in which the imaging light (infrared light) is emitted, and ⁇ indicates the reflected light of the imaging light (infrared light) at the part of the person. It shows the range (angle range) in which (return light) is incident.
- the filter section 114 exists above the imaging element 115 . Therefore, as shown in FIG. 7(B), external light incident on the translucent cover 112 from above (for example, external light arriving via the windshield 2: (indicated by dashed arrows) are blocked by the filter section 114 . Therefore, it is possible to suppress deterioration in imaging accuracy due to external light.
- FIGS. 8A to 8C show a light-emitting element (light-emitting element area) and an image pickup element (image pickup element area) in consideration of stray light generated in the light-transmitting cover (or the filter section provided under the light-transmitting cover). ) is a diagram for explaining an example of a preferred arrangement.
- FIG. 8(A) is a reproduction of Fig. 2(A) shown earlier.
- FIG. 8B is a cross-sectional view along line AA in FIG. 8A
- FIG. 8C is a comparative example (an example in which a layout in which a light-emitting element and an imaging element are arranged in reverse). It is a cross-sectional view showing the.
- the imaging unit 110 is positioned on the left side of the display light passage area Z1 as seen from the driver 5 (on the end side of the vehicle 1) in plan view from above. are doing.
- the imaging element (camera) 115 not only the imaging element (camera) 115 but also the light emitting element (such as a solid-state imaging element such as a CCD) 113 is located on the left side of the display light passage area Z1 as viewed from the driver 5 (on the end side of the vehicle 1). ).
- the light emitting element such as a solid-state imaging element such as a CCD
- the light emitting element area Ze is provided on the end side of the vehicle 1 (the side opposite to the center side) with respect to the display light passing area z1.
- the “light-emitting element region Ze” is arranged on the same side as the “imaging element region Zr” (on the vehicle end side with respect to the display light passing region z1).
- Employing this layout configuration has the effect that, for example, the light emitting element 113 and the imaging element 115 that are arranged close to each other can be handled as one imaging unit 110 . Specifically, by housing the light-emitting element 113 and the imaging element 115 in a common package to form a unit, handling becomes easier than when each element is handled individually.
- the relative positional error of each element is determined by the layout accuracy of each element in the manufacturing process of the unit and is not affected by the positional deviation during mounting.
- the imaging element 115 and the light emitting element 113 are arranged close to each other along the longitudinal direction of the vehicle 1 .
- the imaging element 115 is arranged on the side (front side) near the windshield 2, and the light emitting element 113 is arranged on the side (rear side) near the steering wheel 8 (or the driver 5).
- the shape of the translucent cover 112 has an arcuate curved surface shape (partial arcuate shape) convex downward in a cross section along the longitudinal direction of the vehicle.
- This partial circular arc shape is inclined so that the height position of the end on the rear side is higher than the height position of the end on the front side.
- both the light emitting element 113 and the imaging element 115 are installed tilted to the rear side (to the right in the paper surface of FIG. 8B) with respect to the height direction (Y direction) of the vehicle, and the light emitting element 113 , the imaging light is emitted to the upper rear side (diagonally upper right in the paper surface of FIG. 8B).
- ⁇ indicates the range (angular range) in which the imaging light (infrared light) is emitted, and ⁇ indicates the reflected light of the imaging light (infrared light) at the part of the person. It shows the range (angle range) in which (return light) is incident.
- stray lights N1 and N2 are generated.
- the problem here is the stray light N2.
- the stray light N2 is generated by reflection of the light at the position closest to the imaging element in the luminous flux of the imaging light.
- the stray light N2 travels out of the light receiving range ⁇ of the image sensor 115, so the influence on the light reception (imaging) of the image sensor 115 can be sufficiently suppressed.
- the stray light N4 may return directly to the imaging element 115. Therefore, the S/N of imaging may decrease.
- the configuration of FIG. 8A has a layout configuration that takes measures against stray light caused by part of the imaging light being reflected by the translucent cover.
- FIGS. 9A to 9C show a light-emitting element (light-emitting element area) and an image sensor (image sensor area) in consideration of stray light generated in the light-transmitting cover (or the filter section provided under the light-transmitting cover). ) is a diagram for explaining another example of a preferred arrangement.
- FIG. 9(A) is a reproduction of Fig. 2(B) shown earlier.
- FIG. 9B is a cross-sectional view along line BB in FIG. 9A
- FIG. 9C is a comparative example (an example in which a layout in which a light-emitting element and an imaging element are arranged in reverse). It is a cross-sectional view showing the.
- the light emitting element (light source section) 113 and the imaging element (camera) 115 are arranged close to each other along the width direction (horizontal direction) of the vehicle. This point is different from FIG. 8(A).
- the imaging unit 110 is positioned on the left side of the display light passage area Z1 as viewed from the driver 5 (on the end side of the vehicle 1) in plan view from above. are doing. As described above with reference to FIG. 8A, there is an advantage that it can be handled on a unit-by-unit basis.
- stray lights N5 and N6 are generated.
- the problem here is the stray light N6.
- the stray light N6 is out of the light incident range of the imaging device 115 . Therefore, deterioration of imaging accuracy due to stray light N6 is sufficiently suppressed.
- FIG. 9A is a layout configuration that takes countermeasures against stray light caused by part of the imaging light reflected by the light-transmitting cover, as in the case of FIG. 8A. be.
- FIG. 10A shows an example in which the light emitting element (light emitting element area) is arranged on the right side of the display light passing area as seen from the driver, and the image pickup element (image pickup element area) is arranged on the left side as seen from the driver.
- FIG. 10B is a diagram showing the stray light suppression effect.
- the region of the light-transmitting cover 112 provided in the housing 116 is the light-emitting element 113 located below the light-transmitting cover 112. includes a light emitting element region Ze corresponding to .
- This light emitting element area Ze is located on the center side of the vehicle in the width direction of the vehicle (in other words, on the side where the imaging element 115 is provided) with respect to the display light passing area Z1 when viewed from the driver (in a broad sense, the passenger). (on the side opposite to the end side of the vehicle).
- a display light passing area Z1 exists between the light emitting element 113 and the imaging element 115, and the distance between the elements is widened accordingly.
- FIG. 10(B) is a cross-sectional view along line CC of FIG. 10(A). As shown in FIG. 10B, in a three-dimensional space, a path (three-dimensional space corresponding to the luminous flux) Ea through which display light (visible light) passes is sandwiched between the light emitting element 113 and the imaging element 115. , layout configuration is adopted.
- the layout (planar layout) viewed from above is such that the display light (visible light) passing area Z1 is sandwiched between the light emitting element area Ze and the imaging element area Zr.
- the light emitting element area Ze is arranged on the opposite side of the image sensor area Zr (the center side of the vehicle) with respect to the display light passing area Z1. Since the display light passing area Z1 exists between the light emitting element area Ze and the imaging element area Zr, the distance between the areas can be widened accordingly.
- the layout configuration in FIG. 10 is useful as a measure against stray light.
- the layout configuration of FIG. 10B is also useful in realizing a layout of elements with a higher degree of freedom depending on the situation.
- FIG. 11 is a diagram showing an example of a layout configuration using first and second light emitting elements.
- the region of the light-transmitting cover 112 provided on the housing 116 includes a light emitting element area Ze corresponding to the light emitting element 113 positioned below the translucent cover 112 .
- the HUD device 100 of FIG. 11 has a first light emitting element 113a and a second light emitting element 113b as light emitting elements.
- the light-emitting element region Ze has a layout configuration having a first light-emitting element region Zea corresponding to the first light-emitting element 113a and a second light-emitting element region Zeb corresponding to the second light-emitting element 113b. .
- the filter portion (and the filter portion region) is also divided into the first filter portion 114a (first filter portion region Z2a) and the second filter portion 114b (second filter portion region Z2b). be done.
- the first light emitting element area Zea is provided on the center side of the vehicle in the width direction of the vehicle (right side: upper side in FIG. 11) with respect to the display light passage area Z1 when viewed from the driver 5 .
- the second light emitting element region Zeb When viewed from the driver 5, the second light emitting element region Zeb is located on the end side (left side: in FIG. on the lower side of the paper).
- the first and second light-emitting elements 113a and 113b can be selectively switched for use, or the light-emitting elements 113a and 113b can simultaneously emit light for use.
- the first light emitting element 113a (and the first light emitting element area Zea) is provided on the center side of the vehicle (on the right side as viewed from the driver 5) with respect to the display light passage area Z1.
- the second light emitting element 113b (and the second light emitting element region Zeb) is provided on the vehicle end side (on the left side as seen from the driver) with respect to the display light passing region Z1.
- the first and second light emitting elements 113a and 113b have the display light passing region Z1 between them, so that the distance between the elements is large and the installation positions of the elements are considerably different.
- the imaging light emitted by the light emitting element 113b is reflected by the windshield 2, and the optical path (second optical path) when the parts (face, eyes, etc.) of the person 5 are irradiated can be made different. .
- the two light emitting elements (imaging light sources) 113a and 113b are appropriately switched and used, or the two light emitting elements (imaging light sources) 113a and 113b are used in combination. This increases the possibility of suppressing adverse effects due to stray light that tends to occur when the (driver) 5 wears sunglasses.
- the surface of the sunglasses worn by the driver 5 causes an unusual reflection (diffuse reflection, etc.) of the imaging light, and the unusual reflected light is reflected by the windshield 2 and returned to the imaging device.
- the unusual reflected light since it does not pass through a normal optical path, it may cause an increase in image distortion.
- the optical path In other words, it is possible to subtly change the angle of incidence), or to change the cross-sectional shape of the beam of light that irradiates the part of the person, or to expand the area. This may reduce the stray light described above.
- the incident angle of the returning stray light to the image sensor changes and becomes difficult to detect.
- the S/N may be improved by increasing normal (regular) return light.
- FIG. 11 can serve as a countermeasure against stray light when a person (driver) wears sunglasses or the like.
- FIG. 11 The configuration of FIG. 11 is also useful in that it increases the amount of imaging light that returns to the imaging element and improves detection sensitivity.
- FIG. 12 is a diagram showing another example of layout configuration using the first and second light emitting elements.
- a region Z0 of the light-transmitting cover 112 provided on the housing 116 (a rectangular region indicated by a thick solid line in the figure: transparent
- the light cover area) includes a light emitting element area Ze corresponding to the light emitting element 113 positioned below the translucent cover 112 .
- the HUD device 100 of FIG. 12 has a first light emitting element 113a and a second light emitting element 113b as light emitting elements.
- the first and second light emitting elements 113 a and 113 b are provided as constituent elements of the light emitting element unit 117 .
- the light-emitting element region Ze has a layout configuration having a first light-emitting element region Zea corresponding to the first light-emitting element 113a and a second light-emitting element region Zeb corresponding to the second light-emitting element 113b. .
- the filter portion (and the filter portion region) is also divided into the first filter portion 114a (first filter portion region Z2a) and the second filter portion 114b (second filter portion region Z2b). be done.
- the first and second light emitting elements 113a and 113b are located on the central side of the vehicle when viewed from the driver (passenger) 5 with the display light passing area Z1 as a reference. (Upper side of the paper surface of FIG. 12), they are arranged close to each other along the width direction (horizontal direction) of the vehicle.
- the second light emitting element region Zeb corresponding to the second light emitting element 113a is provided at a position farther from the display light passing region Z1 than the first light emitting element region Zea.
- the distance (distance in the width direction of the vehicle) from the display light passing area Z1 for the first light emitting element area Zea is "D1”
- the distance for the second light emitting element area Zeb is "D2 , and D2>D1 is set.
- first and second light emitting elements (imaging light sources) 113a and 113b are provided, and each light emitting element is switched for use, or two light emitting elements are used. By using them together, it is possible to take countermeasures against stray light, or to increase the amount of imaging light returning to the imaging device. For example, since the first and second light emitting elements 113a and 113b are arranged close to each other, there is an advantage that using them together can effectively increase the amount of light emitted in the same direction.
- distortion of a captured image in a head-up display device having a function of displaying an image (virtual image) and a function of capturing an image of a passenger's body part (eyes, etc.) can be reduced.
- vehicle can be broadly interpreted as a vehicle.
- terms related to navigation should be interpreted in a broad sense, taking into consideration the viewpoint of broad-sense navigation information that is useful for driving a vehicle, for example.
- HUD devices and display devices also include those used as simulators (for example, aircraft simulators, simulators as game devices, etc.).
- curved surface Mirror concave mirror, etc.
- HUD device 110 Imaging unit (imaging unit) 112 Translucent cover 113 Light-emitting element (infrared light-emitting diode, etc.) 114 Filter unit (filter that passes infrared light and blocks visible light), 115: imaging device (solid-state imaging device such as CCD, broadly speaking: camera), 116: housing, L1: image display light (visible light), L2 ... imaging light (infrared light: irradiation light irradiated to the human part), L3 ... reflected light reflected by the human part, Z0 ... translucent cover Areas Z1: display light passing area Z2: filter portion area Ze: light emitting element area Zr: imaging element area
Landscapes
- Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Instrument Panels (AREA)
Abstract
Description
(1)カメラの設置位置によって、人の部位(例えば目(視点))の位置の検出精度が異なる。
撮像光(赤外光等)は、ウインドシールド(広義には、光の反射性/透過性を併せ持つ反射透光部材)を経由してカメラに戻るため、ウインドシールドにて、どのような角度に撮像光が反射されるのか、を事前に検討して、適切なカメラの設置位置を決める必要がある。
但し、ウインドシールド(反射透光部材)の曲面形状は一律ではなく、例えば、車両の中央側では、曲面の変化が緩やかで、端部(左端部及び右端部)では曲面の変化が急峻となる傾向がある。どの領域を撮像光の反射に用いるかによって、撮像画像の歪みの程度に差が生じる。
上記(1)で述べたように、撮像画像の歪みが低減されるようにカメラを配置する必要があるが、そのカメラの位置が、画像を表示する表示光用の光学系から離れた位置であるときは、筐体は大きくならざるを得ない。この場合は、HUD装置の小型化の要請に反することとなる。よって、HUD装置の小型化の要請も考慮して、発光素子やカメラの配置が決定されるのが好ましい。
よって、外光を抑制する対策、及び、人の目視による不快感の発生(言い換えれば、HUD装置の商品性の低下)を抑制する対策についても考慮されるのが好ましい。
車両に設けられた、光の反射性と透過性を併せ持つ反射透光部材に画像の表示光を照射して、前記車両の乗員に対して虚像を表示し、
撮像光を前記乗員の部位に照射し、前記部位からの反射光を、前記反射透光部材を経由して受光することで前記部位を撮像し、
かつ、前記車両の高さ方向における上側から見た平面視において、前記乗員と前記反射透光部材との間に配置されるヘッドアップディスプレイ装置であって、筐体と、
前記筐体に設けられる透光カバーと、
前記筐体内に設けられ、前記画像を表示する表示部と、
前記筐体内に設けられ、前記透光カバーを経由して前記反射透光部材に向けて前記表示光を照射する光学素子を含む光学系と、
前記筐体内の、前記画像の表示光の経路外に設けられると共に、前記撮像光を出射する発光素子と、前記反射透光部材を経由して到来する前記反射光を受光する撮像素子と、を有する撮像部と、
を有し、
前記車両の高さ方向における上側から見た平面視において、
前記筐体は、前記乗員の着座位置と前記反射透光部材との間に配置され、
前記筐体に設けられる前記透光カバーの領域は、
前記表示光が通過する表示光通過領域と、
前記透光カバーの下側に位置する前記撮像素子に対応する撮像素子領域と、を含み、
前記撮像素子領域は、前記乗員から見て、前記表示光通過領域に対して、前記車両の幅方向における前記車両の、中央側とは反対側である端部側に設けられている。
前記表示光は可視光であり、前記撮像光は赤外光であり、
前記透光カバーの下側に設けられる、赤外光を透過し、可視光を遮断するフィルター部を有し、
前記車両の高さ方向における上側から見た平面視において、
前記透光カバーの領域内において、前記フィルター部に対応するフィルター部領域が設けられ、
前記フィルター部領域内に、前記撮像素子領域が設けられていてもよい。
前記撮像素子の光軸と前記反射透光部材との交点は、前記表示光の主光線の、前記反射透光部材における反射点よりも上方に位置する。
前記車両の高さ方向における上側から見た平面視において、
前記筐体に設けられる前記透光カバーの領域は、前記透光カバーの下側に位置する前記発光素子に対応する発光素子領域、を含み、
前記発光素子領域は、前記乗員から見て、前記表示光通過領域に対して、前記車両の幅方向における前記車両の、中央側とは反対側である端部側に設けられていてもよい。
前記車両の高さ方向における上側から見た平面視において、
前記筐体に設けられる前記透光カバーの領域は、前記透光カバーの下側に位置する前記発光素子に対応する発光素子領域、を含み、
前記発光素子領域は、前記乗員から見て、前記表示光通過領域に対して、前記車両の幅方向における前記車両の中央側に設けられていてもよい。
前記車両の高さ方向における上側から見た平面視において、
前記筐体に設けられる前記透光カバーの領域は、前記透光カバーの下側に位置する前記発光素子に対応する発光素子領域、を含み、
前記発光素子として、第1、第2の発光素子を有し、
前記発光素子領域は、前記第1の発光素子に対応する第1の発光素子領域と、第2の発光素子領域を有し、
前記第1の発光素子領域は、前記乗員から見て、前記表示光通過領域に対して、前記車両の幅方向における前記車両の中央側に設けられており、
前記第2の発光素子領域は、前記乗員から見て、前記表示光通過領域に対して、前記車両の幅方向における前記車両の、中央側とは反対側である端部側に設けられてもよい。
前記車両の高さ方向における上側から見た平面視において、
前記筐体に設けられる前記透光カバーの領域は、前記透光カバーの下側に位置する前記発光素子に対応する発光素子領域、を含み、
前記発光素子として、第1、第2の発光素子を有し、
前記発光素子領域は、前記第1の発光素子に対応する第1の発光素子領域と、第2の発光素子領域を有し、
前記第1の発光素子領域は、前記乗員から見て、前記表示光通過領域に対して、前記車両の幅方向における前記車両の中央側に設けられており、
前記第2の発光素子領域は、
前記乗員から見て、前記表示光通過領域に対して、前記車両の幅方向における前記車両の、中央側であって、
かつ、
第1の発光素子領域よりも、表示光通過領域からの距離が遠い位置に設けられていてもよい。
図1(A)は、HUD装置の構成の一例を示す図、図1(B)は、透光カバー領域が、可視光である表示光が通過する第1の領域(表示光通過領域)と、赤外光である赤外光が透過し、可視光が不透過である第2の領域(赤外光を透過するフィルター部領域)とに、区別し得ることを示す図である。
次に、図10を参照する。図10(A)は、発光素子(発光素子領域)を、運転者から見て表示光通過領域の右側に配置し、撮像素子(撮像素子領域)を、運転者から見て左側に配置した例を示す図、図10(B)は、迷光抑制効果を示す図である。
次に、図11を参照する。図11は、第1、第2の発光素子を使用したレイアウト構成の一例を示す図である。
次に、図12を参照する。図12は、第1、第2の発光素子を使用したレイアウト構成の他の例を示す図である。
Claims (7)
- 車両に設けられた、光の反射性と透過性を併せ持つ反射透光部材に画像の表示光を照射して、前記車両の乗員に対して虚像を表示し、
撮像光を前記乗員の部位に照射し、前記部位からの反射光を、前記反射透光部材を経由して受光することで前記部位を撮像し、
かつ、前記車両の高さ方向における上側から見た平面視において、前記乗員と前記反射透光部材との間に配置されるヘッドアップディスプレイ装置であって、
筐体と、
前記筐体に設けられる透光カバーと、
前記筐体内に設けられ、前記画像を表示する表示部と、
前記筐体内に設けられ、前記透光カバーを経由して前記反射透光部材に向けて前記表示光を照射する光学素子を含む光学系と、
前記筐体内の、前記画像の表示光の経路外に設けられると共に、前記撮像光を出射する発光素子と、前記反射透光部材を経由して到来する前記反射光を受光する撮像素子と、を有する撮像部と、
を有し、
前記車両の高さ方向における上側から見た平面視において、
前記筐体は、前記乗員の着座位置と前記反射透光部材との間に配置され、
前記筐体に設けられる前記透光カバーの領域は、
前記表示光が通過する表示光通過領域と、
前記透光カバーの下側に位置する前記撮像素子に対応する撮像素子領域と、を含み、
前記撮像素子領域は、前記乗員から見て、前記表示光通過領域に対して、前記車両の幅方向における前記車両の、中央側とは反対側である端部側に設けられている、
ヘッドアップディスプレイ装置。 - 前記表示光は可視光であり、前記撮像光は赤外光であり、
前記透光カバーの下側に設けられる、赤外光を透過し、可視光を遮断するフィルター部を有し、
前記車両の高さ方向における上側から見た平面視において、
前記透光カバーの領域内において、前記フィルター部に対応するフィルター部領域が設けられ、
前記フィルター部領域内において、前記撮像素子領域が設けられている、
請求項1に記載のヘッドアップディスプレイ装置。 - 前記撮像素子の光軸と前記反射透光部材との交点は、前記表示光の主光線の、前記反射透光部材における反射点よりも上方に位置する、
請求項1に記載のヘッドアップディスプレイ装置。 - 前記車両の高さ方向における上側から見た平面視において、
前記筐体に設けられる前記透光カバーの領域は、前記透光カバーの下側に位置する前記発光素子に対応する発光素子領域、を含み、
前記発光素子領域は、前記乗員から見て、前記表示光通過領域に対して、前記車両の幅方向における前記車両の、中央側とは反対側である端部側に設けられている、
請求項1に記載のヘッドアップディスプレイ装置。 - 前記車両の高さ方向における上側から見た平面視において、
前記筐体に設けられる前記透光カバーの領域は、前記透光カバーの下側に位置する前記発光素子に対応する発光素子領域、を含み、
前記発光素子領域は、前記乗員から見て、前記表示光通過領域に対して、前記車両の幅方向における前記車両の中央側に設けられている、
請求項1に記載のヘッドアップディスプレイ装置。 - 前記車両の高さ方向における上側から見た平面視において、
前記筐体に設けられる前記透光カバーの領域は、前記透光カバーの下側に位置する前記発光素子に対応する発光素子領域、を含み、
前記発光素子として、第1、第2の発光素子を有し、
前記発光素子領域は、前記第1の発光素子に対応する第1の発光素子領域と、第2の発光素子領域を有し、
前記第1の発光素子領域は、前記乗員から見て、前記表示光通過領域に対して、前記車両の幅方向における前記車両の中央側に設けられており、
前記第2の発光素子領域は、前記乗員から見て、前記表示光通過領域に対して、前記車両の幅方向における前記車両の、中央側とは反対側である端部側に設けられている、
請求項1に記載のヘッドアップディスプレイ装置。 - 前記車両の高さ方向における上側から見た平面視において、
前記筐体に設けられる前記透光カバーの領域は、前記透光カバーの下側に位置する前記発光素子に対応する発光素子領域、を含み、
前記発光素子として、第1、第2の発光素子を有し、
前記発光素子領域は、前記第1の発光素子に対応する第1の発光素子領域と、第2の発光素子領域を有し、
前記第1の発光素子領域は、前記乗員から見て、前記表示光通過領域に対して、前記車両の幅方向における前記車両の中央側に設けられており、
前記第2の発光素子領域は、
前記乗員から見て、前記表示光通過領域に対して、前記車両の幅方向における前記車両の、中央側であって、
かつ、
前記車両の幅方向における前記表示光通過領域からの距離が、前記第1の発光素子領域の前記表示光通過領域からの距離よりも大きくなるように、前記表示光通過領域から、より遠い位置に設けられている、
請求項1に記載のヘッドアップディスプレイ装置。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE112022004477.2T DE112022004477T5 (de) | 2021-09-21 | 2022-08-30 | Head-up-Display-Vorrichtung |
CN202280062612.6A CN117980801A (zh) | 2021-09-21 | 2022-08-30 | 平视显示装置 |
JP2023549437A JPWO2023047897A1 (ja) | 2021-09-21 | 2022-08-30 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2021-153000 | 2021-09-21 | ||
JP2021153000 | 2021-09-21 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023047897A1 true WO2023047897A1 (ja) | 2023-03-30 |
Family
ID=85720513
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2022/032529 WO2023047897A1 (ja) | 2021-09-21 | 2022-08-30 | ヘッドアップディスプレイ装置 |
Country Status (4)
Country | Link |
---|---|
JP (1) | JPWO2023047897A1 (ja) |
CN (1) | CN117980801A (ja) |
DE (1) | DE112022004477T5 (ja) |
WO (1) | WO2023047897A1 (ja) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011152883A (ja) * | 2010-01-28 | 2011-08-11 | Toyota Motor Corp | 撮像装置 |
WO2017033566A1 (ja) * | 2015-08-26 | 2017-03-02 | 富士フイルム株式会社 | 投写型表示装置、投写表示方法、及び投写表示プログラム |
JP2017134226A (ja) * | 2016-01-27 | 2017-08-03 | 京セラ株式会社 | 表示装置および車両 |
WO2019238854A1 (en) * | 2018-06-15 | 2019-12-19 | Continental Automotive Gmbh | Head-up-display |
JP2022056520A (ja) * | 2020-09-30 | 2022-04-11 | 日本精機株式会社 | 車両用表示装置 |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2019026198A (ja) | 2017-08-03 | 2019-02-21 | マクセル株式会社 | ヘッドアップディスプレイ装置とそのためのドライバ視点検出方法 |
-
2022
- 2022-08-30 WO PCT/JP2022/032529 patent/WO2023047897A1/ja active Application Filing
- 2022-08-30 DE DE112022004477.2T patent/DE112022004477T5/de active Pending
- 2022-08-30 CN CN202280062612.6A patent/CN117980801A/zh active Pending
- 2022-08-30 JP JP2023549437A patent/JPWO2023047897A1/ja active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011152883A (ja) * | 2010-01-28 | 2011-08-11 | Toyota Motor Corp | 撮像装置 |
WO2017033566A1 (ja) * | 2015-08-26 | 2017-03-02 | 富士フイルム株式会社 | 投写型表示装置、投写表示方法、及び投写表示プログラム |
JP2017134226A (ja) * | 2016-01-27 | 2017-08-03 | 京セラ株式会社 | 表示装置および車両 |
WO2019238854A1 (en) * | 2018-06-15 | 2019-12-19 | Continental Automotive Gmbh | Head-up-display |
JP2022056520A (ja) * | 2020-09-30 | 2022-04-11 | 日本精機株式会社 | 車両用表示装置 |
Also Published As
Publication number | Publication date |
---|---|
CN117980801A (zh) | 2024-05-03 |
JPWO2023047897A1 (ja) | 2023-03-30 |
DE112022004477T5 (de) | 2024-07-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4414612B2 (ja) | 車両用表示装置 | |
JP5698578B2 (ja) | 頭部装着型表示装置 | |
JP4325724B2 (ja) | ヘッドアップディスプレイ装置 | |
TWI479177B (zh) | 反射型光電感測器 | |
US20180252917A1 (en) | Display Image Projection Apparatus and Display Image Projection System | |
JP7377609B2 (ja) | ヘッドアップディスプレイ装置 | |
JP6115585B2 (ja) | ヘッドマウントディスプレイ及び画像表示装置 | |
CN113741031B (zh) | 车载显示装置 | |
JP2004226469A (ja) | 車両用ヘッドアップディスプレイ装置 | |
WO2016190134A1 (ja) | ヘッドアップディスプレイ装置 | |
JP7492670B2 (ja) | 車両用表示装置 | |
JP2020197672A (ja) | 画像表示装置 | |
JP6334273B2 (ja) | 車両用投影表示装置 | |
WO2023047897A1 (ja) | ヘッドアップディスプレイ装置 | |
US10246010B2 (en) | Ultrasonic sensor and obstacle detection apparatus | |
JP7417937B2 (ja) | 表示装置 | |
JP6549817B2 (ja) | コンバイナ | |
WO2022085621A1 (ja) | ヘッドアップディスプレイ装置 | |
JP6646614B2 (ja) | 車両用表示装置 | |
JPWO2019239465A1 (ja) | 画像表示装置 | |
WO2023112908A1 (ja) | 表示装置 | |
WO2020066193A1 (ja) | 光学装置及び表示装置 | |
CN112748572A (zh) | 虚像显示装置及导光部件 | |
JP7147373B2 (ja) | 車両用表示装置 | |
WO2024053543A1 (ja) | 画像投影装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22872653 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2023549437 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202280062612.6 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 18694025 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 112022004477 Country of ref document: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22872653 Country of ref document: EP Kind code of ref document: A1 |