US11673470B2 - CAB comprising an holographic human-machine interface and motor vehicle - Google Patents

CAB comprising an holographic human-machine interface and motor vehicle Download PDF

Info

Publication number
US11673470B2
US11673470B2 US17/722,314 US202217722314A US11673470B2 US 11673470 B2 US11673470 B2 US 11673470B2 US 202217722314 A US202217722314 A US 202217722314A US 11673470 B2 US11673470 B2 US 11673470B2
Authority
US
United States
Prior art keywords
cab
occupant
holographic image
windshield
machine interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US17/722,314
Other versions
US20220332192A1 (en
Inventor
Arnaud JAFFUEL
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Faurecia Interieur Industrie SAS
Original Assignee
Faurecia Interieur Industrie SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Faurecia Interieur Industrie SAS filed Critical Faurecia Interieur Industrie SAS
Publication of US20220332192A1 publication Critical patent/US20220332192A1/en
Assigned to FAURECIA INTERIEUR INDUSTRIE reassignment FAURECIA INTERIEUR INDUSTRIE ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: JAFFUEL, Arnaud
Application granted granted Critical
Publication of US11673470B2 publication Critical patent/US11673470B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B60K37/02—
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/50—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels
    • G02B30/56—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels by projecting aerial or floating images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B27/0103—Head-up displays characterised by optical features comprising holographic elements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/02—Details of features involved during the holographic process; Replication of holograms without interference recording
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22—Processes or apparatus for obtaining an optical image from holograms
    • G03H1/2294—Addressing the hologram to an active spatial light modulator
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/143—Touch sensitive instrument input devices
    • B60K2360/1434—Touch panels
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/146—Instrument input by gesture
    • B60K2360/1464—3D-gesture
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/21—Optical features of instruments using cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/29—Holographic features
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/33—Illumination features
    • B60K2360/334—Projection means
    • B60K2370/1464—
    • B60K2370/1529—
    • B60K2370/29—
    • B60K2370/334—
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/23—Head-up displays [HUD]
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/223—Posture, e.g. hand, foot, or seat position, turned or inclined
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/227—Position in the vehicle
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22—Processes or apparatus for obtaining an optical image from holograms
    • G03H1/2202—Reconstruction geometries or arrangements
    • G03H1/2205—Reconstruction geometries or arrangements using downstream optical component
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005—Adaptation of holography to specific applications
    • G03H2001/0061—Adaptation of holography to specific applications in haptic applications when the observer interacts with the holobject
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22—Processes or apparatus for obtaining an optical image from holograms
    • G03H1/2249—Holobject properties
    • G03H2001/2284—Superimposing the holobject with other visual information
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2226/00—Electro-optic or electronic components relating to digital holography
    • G03H2226/05—Means for tracking the observer

Definitions

  • This disclosure relates to a cab comprising an holographic human-machine interface.
  • this disclosure relates to a holographic human-machine interface capable of controlling comfort equipment of a motor vehicle, and a motor vehicle equipped with that interface.
  • head-up displays make it possible to display images on a semi-transparent mirror using a projector. These images are superimposed on the landscape and allow the pilot to monitor his environment and the data provided by these images at the same time. Head-up displays have also been developed for the automotive field. Information pertaining to safety can thus be projected onto a semi-transparent blade or onto the vehicle's windshield. These head-up displays project, for example, the safety distance. However, head-up displays can only project images to the outside the vehicle. In addition, these displays do not allow to control on-board comfort equipment. Lastly, these displays are expensive because they require the implementation of a retractable semi-transparent blade or the manufacture of a specific windshield including a non-parallel geometry of the external main faces to avoid the presence of a double image.
  • the present invention relates to a cab comprising an holographic human-machine interface to generate at least one holographic image in order to control at least one comfort equipment installed in the cab, the cab having a windshield, at least one comfort equipment and at least one seat configured for an occupant, the human-machine interface comprising:
  • the human-machine interface comprises a recognition device connected to said at least one comfort equipment, said recognition device being adapted to recognize at least one position of a finger and/or one gesture of the hand of said occupant on said at least one holographic image, and to control said at one least comfort equipment according to said at least one position and/or one recognized gesture.
  • the at least one holographic image is visualized at a distance of more than 20 centimeters, and preferably less than 50 centimeters of said windshield.
  • the visualized holographic image is at a distance less than the length of an arm so that the seat occupant can easily touch the image to control the comfort equipment.
  • the reflector consists of a reflection area of the windshield of the motor vehicle, said windshield has a first external main face and a second external main face opposed and parallel to the first external main face.
  • this device works with any type of windshield. It is not necessary to manufacture a particular windshield with a wedge angle to avoid duplication of images. It works regardless of the curvature of the windshield or the inclination thereof. This device can be simply and economically added to any already existing vehicle. It is also very economical for new vehicles because it does not require manufacturing a special windshield.
  • the reflector comprises a semi-transparent blade positioned in the interior compartment at the level of the windshield.
  • the human-machine interface comprises an optical system capable of enlarging said at least one holographic image.
  • the human-machine interface comprises an orientatable reflective system comprising a mirror and a mirror orientation system mobile along two perpendicular axes, wherein the orientation system is connected to the computer and receives mirror inclination controls according to the position of the pupils located from the images captured by the at least one camera.
  • the cab comprises a dashboard, the at least one camera being fixed on the dashboard at the level of the seat.
  • At least one comfort equipment is equipment among a heating and/or air conditioning device, an infotainment device and a central control device.
  • the human-machine interface further comprises a haptic device capable of giving a tactile feeling and a kinesthetic perception when the occupant touches the visualized holographic image.
  • the invention also relates to a motor vehicle having a windshield, at least one comfort equipment and at least one seat, characterized in that it comprises a human-machine interface as described above.
  • FIG. 1 is a schematic view of a holographic human-machine interface according to the present disclosure
  • FIG. 2 is a schematic view of the image generation unit
  • FIG. 3 is a representation of a cab in which a holographic image is visible.
  • the cab may be a cab 4 of a vehicle, e.g., a motor vehicle, an aircraft, a train or a boat.
  • vehicle equipped with the cab 4 delimits an inner compartment.
  • the cab includes a human-machine interface 2 , a windshield 6 , at least one seat 14 arranged facing the windshield, a dashboard, an inner rear-view mirror and embedded comfort equipment 8 , 10 , 12 .
  • the windshield 6 comprises a first external main face 16 and a second external main face 18 opposed and parallel to the first external face 16 .
  • the seat 14 is a seat located at the front of the vehicle.
  • the seat 14 can be the driver seat or the passenger seat.
  • FIG. 1 represents only one seat.
  • Comfort equipment 8 , 10 , 12 may, for example, include a heating and/or air conditioning device 8 , an infotainment device 10 , a central control device 12 .
  • the human-machine interface 2 comprises at least one camera 20 , a computer 22 connected to the camera and an image generation unit 24 .
  • the camera 20 is capable of capturing images representing at least the pupils of a person 26 sitting in seat 14 . This person is referred to as the occupant in the rest of the description.
  • the camera 20 can be fixed to the dashboard at the level of the seat occupant. Alternatively, the camera 20 can also be fixed to the ceiling of the cab. In particular, the camera can be located in a central position, for example next to the inner rear-view mirror or on a central console. Alternatively, the human-machine interface 2 can have multiple cameras.
  • the computer 22 is a central processing unit, such as a processor or microprocessor.
  • the computer 22 can be a programmable device that uses software, a specific integrated circuit (ASIC) or part of the control unit of a motor (ECU).
  • the computer 22 comprises a memory and a code executable to implement a localization method of the position of the seat occupant's gaze from the captured images as well as a method for generating at least one two-dimensional digital holographic image.
  • the localization method implements the gaze tracking technique to generate digital holographic images with variable focal points depending on the localized position of the occupant's gaze. Accommodation and vergence problems for the occupant 26 are thus avoided.
  • the holographic image is a binocular image in color and in two dimensions.
  • the image generation unit 24 comprises a spatial light modulator (SLM) 28 connected to the computer 22 to receive the digital holographic images generated by it, a source 30 capable of generating coherent light, a magnifying optical system 32 and a tilting reflective system 34 .
  • SLM spatial light modulator
  • An example of an image generation unit 24 is shown in FIG. 2 .
  • the image generation unit 24 includes two SLM modulators 28 and two sets of light-emitting diodes 30 to generate a right and left binocular image.
  • the SLM modulators 28 are for example of the crystal liquid on silicon type.
  • Each set of light-emitting diodes 30 includes a red light-emitting diode, a green light-emitting diode, and a blue light-emitting diode.
  • Each set 30 is arranged in the vicinity of an SLM modulator and illuminates it so that the SLM modulator 28 emits radiation around an optical axis crossed by the magnifying optical system 32 and the tilting reflective system 34 .
  • the magnifying optical system 32 comprises a set of lenses that merging the binocular images generated by the modulators.
  • the magnifying optical system 32 is also configured to enlarge the holographic images generated in the visualizing window 33 .
  • the orientatable reflective system 34 comprises a reflective mirror mounted on a mobile or tiltable mirror orientation system along two perpendicular axes.
  • the orientation system makes it possible to move the holographic images in the visualizing window according to two perpendicular directions represented by the X and Y axes in FIG. 1 .
  • the orientatable reflective system 34 is connected to the computer 22 which transmits thereto mirror inclination controls according to the position of the pupils located by the implementation of the localization method from the images captured by the camera 20 .
  • the sources 30 are laser sources.
  • the human machine interface 2 according to the present disclosure also includes a reflector 36 and a recognition device 38 .
  • the reflector 36 receives radiation emitted by the spatial light modulator, magnified by the optical system 32 and reflected by the orientatable reflective system 34 , and reflects it back into the visualization window located in the interior compartment between windshield 6 and seat 14 .
  • This radiation generates the visualization of at least one holographic image by the seat occupant.
  • This holographic image is positioned between the windshield and the seat, especially between the windshield, and the occupant sitting on the seat.
  • the holographic image is visualized at a distance of more than 20 centimeters, and preferably less than 50 centimeters from the windshield. In other words, the holographic image is visualized at a distance of more than 60 centimeters, and preferably less than 80 centimeters from the seat.
  • the reflector 36 is constituted by a reflection area belonging to the windshield 6 .
  • the windshield is a conventional windshield that does not have a non-parallel geometry of the external main faces.
  • the reflector 36 consists of a semi-transparent blade positioned in the cab at the level of the windshield and substantially parallel thereto. This semi-transparent blade can be retractable into the dashboard or fixed.
  • the recognition device 38 is able to recognize the position of a limb of the occupant with respect to the visualized holographic image.
  • the limb is for example the hand or a particular finger thereof.
  • the recognition device 38 includes one or several camera(s) capturing images of the occupant and optionally one or several motion sensors.
  • the recognition device 38 includes a processor, a memory and a code which is executable to implement a recognition method of the position of the occupant limb with respect to the visualized image. To this end, the recognition device 38 is connected to the computer 22 which transmits data thereto that allow it to know the position at which the user will visualize a holographic image.
  • the recognition device 38 is connected to the comfort equipments 8 , 10 , 12 . It is capable of controlling this equipment according to the positions of the occupant's limb and the controls it represents for the occupant.
  • the human machine interface 2 further comprises a haptic device 40 capable of giving a tactile feeling and a kinesthetic perception when the occupant touches the visualized holographic image.
  • This haptic device is, for example, a surface that generates ultrasonic signals capable of giving an resistance impression specific to the touch of a real surface in the air.
  • the haptic device 40 is connected to the recognition device 38 .
  • FIG. 3 shows an example of a human-machine interface 2 according to the present disclosure.
  • This human-machine interface 2 includes the holographic image.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Optics & Photonics (AREA)
  • Instrument Panels (AREA)
  • User Interface Of Digital Computer (AREA)
  • Holo Graphy (AREA)

Abstract

A cab having a human-machine interface to generate a holographic image in order to control comfort equipment installed in the cab. The human-machine interface includes: a camera capable of capturing images representing a gaze of an occupant, one image generation unit having (a) a computer capable of calculating the position of the location of the occupant's gaze from the captured images, the computer being adapted to generate the digital holographic image according to the position of the occupant's gaze, (b) a spatial light modulator receiving the generated digital holographic image, and (c) a light source illuminating the spatial light modulator. The human-machine interface also includes a reflector reflecting the light beams emitted by the spatial light modulator into a visualizing window to form a holographic image positioned between the windscreen and the seat.

Description

TECHNICAL FIELD
This disclosure relates to a cab comprising an holographic human-machine interface. In particular, this disclosure relates to a holographic human-machine interface capable of controlling comfort equipment of a motor vehicle, and a motor vehicle equipped with that interface.
BACKGROUND
In the field of military aviation, head-up displays make it possible to display images on a semi-transparent mirror using a projector. These images are superimposed on the landscape and allow the pilot to monitor his environment and the data provided by these images at the same time. Head-up displays have also been developed for the automotive field. Information pertaining to safety can thus be projected onto a semi-transparent blade or onto the vehicle's windshield. These head-up displays project, for example, the safety distance. However, head-up displays can only project images to the outside the vehicle. In addition, these displays do not allow to control on-board comfort equipment. Lastly, these displays are expensive because they require the implementation of a retractable semi-transparent blade or the manufacture of a specific windshield including a non-parallel geometry of the external main faces to avoid the presence of a double image.
SUMMARY
It would be advantageous to develop a holographic human-machine interface that makes it possible to control embedded comfort equipment and that is inexpensive.
The present invention relates to a cab comprising an holographic human-machine interface to generate at least one holographic image in order to control at least one comfort equipment installed in the cab, the cab having a windshield, at least one comfort equipment and at least one seat configured for an occupant, the human-machine interface comprising:
    • at least one camera capable of capturing images representing at least one gaze of the occupant,
    • an image generation unit comprising:
      • (a) a computer connected to the camera, the computer being capable of calculating the position of the location of the occupant's gaze from the captured images, the computer being adapted to generate said at least one digital holographic image to control said comfort equipment according to the position of the occupant's gaze,
      • (b) a spatial light modulator connected to the computer to receive said at least one generated digital holographic image, (c) a coherent light source capable of illuminating the spatial light modulator, the spatial light modulator emitting light beams,
    • a reflector adapted to reflect the light beams emitted by the spatial light modulator into a visualizing window in order to form said at least one holographic image positioned between the windshield and the seat as a control interface.
The features set out in the following paragraphs may, optionally, be implemented. They can be implemented independently of each other or in combination with each other.
According to one embodiment, the human-machine interface comprises a recognition device connected to said at least one comfort equipment, said recognition device being adapted to recognize at least one position of a finger and/or one gesture of the hand of said occupant on said at least one holographic image, and to control said at one least comfort equipment according to said at least one position and/or one recognized gesture.
According to one embodiment, the at least one holographic image is visualized at a distance of more than 20 centimeters, and preferably less than 50 centimeters of said windshield. Advantageously, the visualized holographic image is at a distance less than the length of an arm so that the seat occupant can easily touch the image to control the comfort equipment.
According to one embodiment, the reflector consists of a reflection area of the windshield of the motor vehicle, said windshield has a first external main face and a second external main face opposed and parallel to the first external main face. Advantageously, this device works with any type of windshield. It is not necessary to manufacture a particular windshield with a wedge angle to avoid duplication of images. It works regardless of the curvature of the windshield or the inclination thereof. This device can be simply and economically added to any already existing vehicle. It is also very economical for new vehicles because it does not require manufacturing a special windshield.
According to one embodiment, the reflector comprises a semi-transparent blade positioned in the interior compartment at the level of the windshield.
According to one embodiment, the human-machine interface comprises an optical system capable of enlarging said at least one holographic image.
According to one embodiment, the human-machine interface comprises an orientatable reflective system comprising a mirror and a mirror orientation system mobile along two perpendicular axes, wherein the orientation system is connected to the computer and receives mirror inclination controls according to the position of the pupils located from the images captured by the at least one camera.
According to one embodiment, the cab comprises a dashboard, the at least one camera being fixed on the dashboard at the level of the seat.
According to one embodiment, at least one comfort equipment is equipment among a heating and/or air conditioning device, an infotainment device and a central control device.
According to one embodiment, the human-machine interface further comprises a haptic device capable of giving a tactile feeling and a kinesthetic perception when the occupant touches the visualized holographic image.
The invention also relates to a motor vehicle having a windshield, at least one comfort equipment and at least one seat, characterized in that it comprises a human-machine interface as described above.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a schematic view of a holographic human-machine interface according to the present disclosure
FIG. 2 is a schematic view of the image generation unit; and
FIG. 3 is a representation of a cab in which a holographic image is visible.
 DETAILED DESCRIPTION
With reference to FIG. 1 , the cab according to the present disclosure may be a cab 4 of a vehicle, e.g., a motor vehicle, an aircraft, a train or a boat. Conventionally, the vehicle equipped with the cab 4 delimits an inner compartment. The cab includes a human-machine interface 2, a windshield 6, at least one seat 14 arranged facing the windshield, a dashboard, an inner rear-view mirror and embedded comfort equipment 8, 10, 12.
In the embodiment shown in FIG. 1 , the windshield 6 comprises a first external main face 16 and a second external main face 18 opposed and parallel to the first external face 16.
The seat 14 is a seat located at the front of the vehicle. The seat 14 can be the driver seat or the passenger seat. For the sake of simplification, FIG. 1 represents only one seat. Comfort equipment 8, 10, 12 may, for example, include a heating and/or air conditioning device 8, an infotainment device 10, a central control device 12.
The human-machine interface 2 according to the present disclosure comprises at least one camera 20, a computer 22 connected to the camera and an image generation unit 24. The camera 20 is capable of capturing images representing at least the pupils of a person 26 sitting in seat 14. This person is referred to as the occupant in the rest of the description. The camera 20 can be fixed to the dashboard at the level of the seat occupant. Alternatively, the camera 20 can also be fixed to the ceiling of the cab. In particular, the camera can be located in a central position, for example next to the inner rear-view mirror or on a central console. Alternatively, the human-machine interface 2 can have multiple cameras. The computer 22 is a central processing unit, such as a processor or microprocessor. The computer 22 can be a programmable device that uses software, a specific integrated circuit (ASIC) or part of the control unit of a motor (ECU). The computer 22 comprises a memory and a code executable to implement a localization method of the position of the seat occupant's gaze from the captured images as well as a method for generating at least one two-dimensional digital holographic image. Advantageously, the localization method implements the gaze tracking technique to generate digital holographic images with variable focal points depending on the localized position of the occupant's gaze. Accommodation and vergence problems for the occupant 26 are thus avoided.
Advantageously, the holographic image is a binocular image in color and in two dimensions. The image generation unit 24 comprises a spatial light modulator (SLM) 28 connected to the computer 22 to receive the digital holographic images generated by it, a source 30 capable of generating coherent light, a magnifying optical system 32 and a tilting reflective system 34. An example of an image generation unit 24 is shown in FIG. 2 . In this non-limiting example, the image generation unit 24 includes two SLM modulators 28 and two sets of light-emitting diodes 30 to generate a right and left binocular image.
The SLM modulators 28 are for example of the crystal liquid on silicon type. Each set of light-emitting diodes 30 includes a red light-emitting diode, a green light-emitting diode, and a blue light-emitting diode. Each set 30 is arranged in the vicinity of an SLM modulator and illuminates it so that the SLM modulator 28 emits radiation around an optical axis crossed by the magnifying optical system 32 and the tilting reflective system 34. The magnifying optical system 32 comprises a set of lenses that merging the binocular images generated by the modulators. The magnifying optical system 32 is also configured to enlarge the holographic images generated in the visualizing window 33. The orientatable reflective system 34 comprises a reflective mirror mounted on a mobile or tiltable mirror orientation system along two perpendicular axes. The orientation system makes it possible to move the holographic images in the visualizing window according to two perpendicular directions represented by the X and Y axes in FIG. 1 . The orientatable reflective system 34 is connected to the computer 22 which transmits thereto mirror inclination controls according to the position of the pupils located by the implementation of the localization method from the images captured by the camera 20. Alternatively, the sources 30 are laser sources. The human machine interface 2 according to the present disclosure also includes a reflector 36 and a recognition device 38.
The reflector 36 receives radiation emitted by the spatial light modulator, magnified by the optical system 32 and reflected by the orientatable reflective system 34, and reflects it back into the visualization window located in the interior compartment between windshield 6 and seat 14. This radiation generates the visualization of at least one holographic image by the seat occupant. This holographic image is positioned between the windshield and the seat, especially between the windshield, and the occupant sitting on the seat.
Advantageously, the holographic image is visualized at a distance of more than 20 centimeters, and preferably less than 50 centimeters from the windshield. In other words, the holographic image is visualized at a distance of more than 60 centimeters, and preferably less than 80 centimeters from the seat.
Advantageously, this positioning of or holographic images (s) allows the occupant to touch the holographic image without the need to advance his chest towards the dashboard. According to the embodiment illustrated in FIG. 1 , the reflector 36 is constituted by a reflection area belonging to the windshield 6. Advantageously, the windshield is a conventional windshield that does not have a non-parallel geometry of the external main faces.
According to a non-shown alternative, the reflector 36 consists of a semi-transparent blade positioned in the cab at the level of the windshield and substantially parallel thereto. This semi-transparent blade can be retractable into the dashboard or fixed.
The recognition device 38 is able to recognize the position of a limb of the occupant with respect to the visualized holographic image. The limb is for example the hand or a particular finger thereof. The recognition device 38 includes one or several camera(s) capturing images of the occupant and optionally one or several motion sensors. The recognition device 38 includes a processor, a memory and a code which is executable to implement a recognition method of the position of the occupant limb with respect to the visualized image. To this end, the recognition device 38 is connected to the computer 22 which transmits data thereto that allow it to know the position at which the user will visualize a holographic image.
The recognition device 38 is connected to the comfort equipments 8, 10, 12. It is capable of controlling this equipment according to the positions of the occupant's limb and the controls it represents for the occupant.
Advantageously, the human machine interface 2 further comprises a haptic device 40 capable of giving a tactile feeling and a kinesthetic perception when the occupant touches the visualized holographic image. This haptic device is, for example, a surface that generates ultrasonic signals capable of giving an resistance impression specific to the touch of a real surface in the air. The haptic device 40 is connected to the recognition device 38.
FIG. 3 shows an example of a human-machine interface 2 according to the present disclosure. This human-machine interface 2 includes the holographic image.

Claims (10)

The invention claimed is:
1. Cab comprising a holographic human-machine interface to generate at least one holographic image in order to control at least one comfort equipment installed in the cab, the cab having a windshield, the at least one comfort equipment, and at least one seat configured for an occupant, the human-machine interface comprising:
at least one camera capable of capturing images representing at least one gaze of said occupant,
one image generation unit comprising:
(a) a computer connected to the at least one camera, the computer being capable of calculating the position of the location of the occupant's gaze from the captured images, the computer being adapted to generate said at least one digital holographic image with variable focal points to control said comfort equipment according to the position of the occupant's gaze,
(b) a spatial light modulator connected to the computer to receive said at least one generated digital holographic image,
(c) a coherent light source capable of illuminating the spatial light modulator, the spatial light modulator emitting light beams,
a reflector adapted to reflect the beams of light emitted by the spatial light modulator in a visualizing window in order to form at least one holographic image positioned between the windshield and the seat as a control interface, and
an orientatable reflective system comprising a mirror and a mirror orientation system mobile along two perpendicular axes, wherein the orientation system is connected to the computer and receives mirror inclination controls according to the position of the occupant's pupils located from the images captured by the at least one camera.
2. Cab according to claim 1, comprising a recognition device connected to said at least one comfort equipment, said recognition device being adapted to recognize at least one position of a finger and/or one gesture of the hand of said occupant on said at least one holographic image, and to control said at least one comfort equipment according to said at least one position and/or one recognized gesture.
3. Cab according to claim 1, wherein said at least one holographic image is visualized at a distance of more than 20 centimeters, and preferably less than 50 centimeters of said windshield.
4. Cab according to claim 1, wherein the reflector consists of a reflection area of the windshield of the motor vehicle, said windshield has a first external main face and
a second external main face opposed and parallel to the first external main face.
5. Cab according to claim 1, wherein the reflector comprises a semi-transparent blade positioned in the interior compartment at the level of the windshield.
6. Cab according to claim 1, which comprises an optical system capable of enlarging said at least one holographic image.
7. Cab according to claim 1, comprising a dashboard, the at least one camera being fixed on the dashboard at the level of the seat.
8. Cab according to claim 7, wherein the at least one comfort equipment is equipment among a heating and/or air conditioning device, an infotainment device and a central control device.
9. Cab according to claim 1, which further comprises a haptic device capable of giving a tactile feeling and a kinesthetic perception when the occupant touches the visualized holographic image.
10. Motor vehicle having a windshield, at least one comfort equipment and at least one seat, wherein the motor vehicle comprises a cab according to claim 1.
US17/722,314 2021-04-16 2022-04-16 CAB comprising an holographic human-machine interface and motor vehicle Active US11673470B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR2103998A FR3122000B1 (en) 2021-04-16 2021-04-16 Holographic human-machine interface and associated vehicle
FRFR2103998 2021-04-16

Publications (2)

Publication Number Publication Date
US20220332192A1 US20220332192A1 (en) 2022-10-20
US11673470B2 true US11673470B2 (en) 2023-06-13

Family

ID=76807738

Family Applications (1)

Application Number Title Priority Date Filing Date
US17/722,314 Active US11673470B2 (en) 2021-04-16 2022-04-16 CAB comprising an holographic human-machine interface and motor vehicle

Country Status (2)

Country Link
US (1) US11673470B2 (en)
FR (1) FR3122000B1 (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE202014003241U1 (en) 2014-04-15 2015-07-20 GM Global Technology Operations LLC (n. d. Ges. d. Staates Delaware) Holographic display device, vehicle with holographic display device and computer program product
FR3047933A1 (en) 2016-02-24 2017-08-25 Valeo Vision DEVICE FOR INTERACTIVE PRESENTATION OF INFORMATION IN A MOTOR VEHICLE HABITACLE
DE102016208096A1 (en) 2016-05-11 2017-11-16 Bayerische Motoren Werke Aktiengesellschaft Arrangement, means of transport and method for supporting a user of a means of transportation
US20190278091A1 (en) * 2010-10-04 2019-09-12 Gerard Dirk Smits System and method for 3-d projection and enhancements for interactivity
US20200057546A1 (en) * 2016-11-03 2020-02-20 Visteon Global Technologies, Inc. User interface and methods for inputting and outputting information in a vehicle
US20210070176A1 (en) * 2018-05-04 2021-03-11 Harman International Industries, Incorporated Enhanced augmented reality experience on heads up display
US20220317463A1 (en) * 2019-11-15 2022-10-06 Cy Vision Inc. Augmented reality head-up display with steerable eyebox
US20220326760A1 (en) * 2019-09-03 2022-10-13 Light Field Lab, Inc. Light field display for mobile devices
US11474360B2 (en) * 2014-04-25 2022-10-18 Mentor Acquisition One, Llc Speaker assembly for headworn computer

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190278091A1 (en) * 2010-10-04 2019-09-12 Gerard Dirk Smits System and method for 3-d projection and enhancements for interactivity
DE202014003241U1 (en) 2014-04-15 2015-07-20 GM Global Technology Operations LLC (n. d. Ges. d. Staates Delaware) Holographic display device, vehicle with holographic display device and computer program product
US11474360B2 (en) * 2014-04-25 2022-10-18 Mentor Acquisition One, Llc Speaker assembly for headworn computer
FR3047933A1 (en) 2016-02-24 2017-08-25 Valeo Vision DEVICE FOR INTERACTIVE PRESENTATION OF INFORMATION IN A MOTOR VEHICLE HABITACLE
DE102016208096A1 (en) 2016-05-11 2017-11-16 Bayerische Motoren Werke Aktiengesellschaft Arrangement, means of transport and method for supporting a user of a means of transportation
US20200057546A1 (en) * 2016-11-03 2020-02-20 Visteon Global Technologies, Inc. User interface and methods for inputting and outputting information in a vehicle
US20210070176A1 (en) * 2018-05-04 2021-03-11 Harman International Industries, Incorporated Enhanced augmented reality experience on heads up display
US20220326760A1 (en) * 2019-09-03 2022-10-13 Light Field Lab, Inc. Light field display for mobile devices
US20220317463A1 (en) * 2019-11-15 2022-10-06 Cy Vision Inc. Augmented reality head-up display with steerable eyebox

Also Published As

Publication number Publication date
FR3122000B1 (en) 2023-12-08
FR3122000A1 (en) 2022-10-21
US20220332192A1 (en) 2022-10-20

Similar Documents

Publication Publication Date Title
US10302940B2 (en) Head-up display
CN112904558B (en) Head-up display calibration
US10629106B2 (en) Projection display device, projection display method, and projection display program
JP6201690B2 (en) Vehicle information projection system
JP5155915B2 (en) In-vehicle display system, display method, and vehicle
WO2017033566A1 (en) Projection-type display device, projection display method, and projection display program
US20200057546A1 (en) User interface and methods for inputting and outputting information in a vehicle
JP6741029B2 (en) Information display device
AU2015260356A1 (en) Display device and vehicle
US10645308B2 (en) Projection display device, projection display method, and projection display program
US20170068093A1 (en) System having an adjustment device and method for automatically adjusting/switching the adjustment device for a head-up display device
JP7240208B2 (en) VEHICLE DISPLAY DEVICE, VEHICLE DISPLAY METHOD, AND COMPUTER PROGRAM
US20210109355A1 (en) Head-up display calibration
JP7346859B2 (en) Control device, display device, moving object, control method, and program
JP2019189139A (en) Head-up display device
WO2021111765A1 (en) Vehicle driving system
KR20170008430A (en) Head up display
US11673470B2 (en) CAB comprising an holographic human-machine interface and motor vehicle
JP2019032363A (en) Head-up display device and control unit
JP2021154988A (en) On-vehicle display device, method of controlling on-vehicle display device, and computer program
US11790615B2 (en) Marking objects for a vehicle using a virtual element
WO2017145565A1 (en) Projection-type display device, projection display method, and projection display program
CN114114685A (en) Head-up display and control method thereof
CN111163967B (en) Vehicle operating system with three-dimensional display
JP2019078794A (en) Display device for vehicle

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: EX PARTE QUAYLE ACTION MAILED

AS Assignment

Owner name: FAURECIA INTERIEUR INDUSTRIE, FRANCE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:JAFFUEL, ARNAUD;REEL/FRAME:062229/0139

Effective date: 20220531

STCF Information on status: patent grant

Free format text: PATENTED CASE