WO2018035974A1 - 一种抬头显示装置 - Google Patents

一种抬头显示装置 Download PDF

Info

Publication number
WO2018035974A1
WO2018035974A1 PCT/CN2016/104740 CN2016104740W WO2018035974A1 WO 2018035974 A1 WO2018035974 A1 WO 2018035974A1 CN 2016104740 W CN2016104740 W CN 2016104740W WO 2018035974 A1 WO2018035974 A1 WO 2018035974A1
Authority
WO
WIPO (PCT)
Prior art keywords
display device
host
image
driver
head
Prior art date
Application number
PCT/CN2016/104740
Other languages
English (en)
French (fr)
Inventor
王艳龙
苗顺平
王建辉
闵剑锋
Original Assignee
北京乐驾科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京乐驾科技有限公司 filed Critical 北京乐驾科技有限公司
Priority to EP16913994.6A priority Critical patent/EP3505989A4/en
Priority to US16/327,595 priority patent/US11079594B2/en
Publication of WO2018035974A1 publication Critical patent/WO2018035974A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
    • B60R16/0373—Voice control
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0149—Head-up displays characterised by mechanical features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/213—Virtual instruments
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/013—Head-up displays characterised by optical features comprising a combiner of particular shape, e.g. curvature
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0149—Head-up displays characterised by mechanical features
    • G02B2027/0154—Head-up displays characterised by mechanical features with movable elements
    • G02B2027/0159—Head-up displays characterised by mechanical features with movable elements with mechanical means other than scaning means for positioning the whole image
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0149—Head-up displays characterised by mechanical features
    • G02B2027/0161—Head-up displays characterised by mechanical features characterised by the relative positioning of the constitutive elements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0149—Head-up displays characterised by mechanical features
    • G02B2027/0169—Supporting or connecting means other than the external walls

Definitions

  • the present invention relates to a vehicle-mounted smart device, and more particularly to a head-up display device.
  • Head Up Display is a flight aid instrument commonly used on aircraft. Looking up means that the pilot can see the important information he needs without looking down.
  • the head-up display HUD also has the following defects:
  • the projection based on the LED principle projector is generally used, and the image is displayed on the imaging film, and the driver can see the relevant information of the vehicle through the imaging film.
  • the use of a projector is limited by the imaging distance, which affects the overall appearance of the HUD device.
  • the information displayed by the HUD head may be unclear, especially in the case of strong light in front, and there may be ghosting of the image, which affects the driver's driving.
  • the imaging distance of HUD is not far enough in the car.
  • the focal length can't match the driving scene, and it can't solve the problem of far and near fusion of road and instrument panel.
  • the technical problem to be solved by the present invention is to provide an intelligent in-vehicle device that supports full-range voice interaction and has a good display effect.
  • the present invention provides a head-up display device comprising:
  • the host computer is configured to send the image signal to the display device; the host computer is connected to the OBD interface in the vehicle or the USB interface of the vehicle charger to obtain driving information of the vehicle, and correspondingly display in the display device.
  • the display device provided on the host side is for displaying the image signal, and the display device provided on the host side is capable of displaying an image signal.
  • a curved semi-transparent reflective screen disposed relative to a position of the display device for receiving an image displayed by the display device, and displaying an image on the other side through the translucent reflective screen on the host side;
  • the semi-transparent reflective screen is also used to display the image after it has been ghosted.
  • the display image can be directly presented in the display device.
  • the display device is a flexible display screen for correcting image distortion in the display device by adjusting the shape of the flexible display screen and changing an image projected onto the curved surface translucent reflective screen.
  • the flexible display using PHOLED phosphorescent OLED technology has low power consumption and direct visible flexible panel, which can effectively overcome distortion image distortion.
  • the display device is a laser projector for transmitting the image through a laser beam; and an MLA microlens array disposed between the curved semi-transparent reflective screen and the laser projector is used for modulating the image.
  • the light sources in the display device are gathered by the MLA. Modulating the diffuse reflection effect of the laser beam through the curved surface of the curved surface to prevent damage to the human eye and reducing visual fatigue, and reasonably controlling the scattering angle of the light to ensure brightness.
  • the display device is a TFT, LCD, OLED or AMOLED display One or more of them.
  • Alternative forms of various display devices are provided in the present invention.
  • the host and the display device are integrated, and the main body and the display device are integrally formed, which facilitates factory manufacture.
  • the curved translucent reflective screen is movable as a foldable mechanism.
  • the foldable mechanism is a damped rotating shaft or an electric memory adjusting rotating shaft based on user information.
  • the translucent reflection screen is subjected to the following processing to perform image de-ghosting:
  • Translucent reflective screen molding concave surface of semi-transparent reflective screen and double-sided surface hardening of convex surface
  • An AF anti-fingerprint film is further added to the concave surface and/or the convex surface;
  • the main body is provided with a base, and a rotating card table is mounted on the base, the rotating card table is used for engaging on a slide rail on the base, and the angle of the main body is adjusted An image in a semi-transparent reflective screen.
  • the display device further includes a heat dissipation air duct system built in the host to guide the display device and the hot air generated in the microprocessor in the host to perform convection.
  • the heat dissipation air duct system includes a heat pipe, a heat sink and a fan.
  • the heat pipe is connected to the heat sink for transmitting the received heat to the heat sink;
  • the heat sink is configured to dissipate heat from the display device and the microprocessor
  • the fan is configured to cool the heat sink.
  • the display device further includes a shield cover and a thermal conductive silicon wafer, and the shield cover passes through the guide
  • the thermal silicon wafer is connected to the display device and the microprocessor, and the shield is connected to the heat dissipation air duct system.
  • the technical problem to be solved by the present invention is to provide an intelligent in-vehicle device that monitors and pre-intelligently monitors the driver in real time during driving.
  • the invention also provides a head up display device comprising:
  • a host for transmitting an image signal to the display device
  • the display device disposed on one side of the host for displaying the image signal
  • a curved semi-transparent reflective screen disposed relative to a position of the display device for receiving an image displayed by the display device, and displaying an image on the other side through the semi-transparent reflective screen on a host side;
  • a driver detecting device installed in the host for determining facial state information of the driver according to the face information; the state information includes at least distraction, fatigue, and emotional state information of the road anger;
  • the driver detection device installed in the host monitors the driving environment of the driver and the vehicle through the front/rear camera in the main machine, and captures the driver's facial state information through the front camera to the driver.
  • the analysis of emotions strengthens the analysis and early warning of the three emotions of distraction, fatigue and road anger, which effectively ensures the safety of driving.
  • the driver detecting device includes a camera and a night vision compensation light unit
  • the camera is configured to adopt the driver's overall state information of the face, the three-dimensional posture information of the head, and the opening/closing information of the eyes and the mouth;
  • the night vision fill light unit is configured to perform light compensation when the in-vehicle/out-of-vehicle illumination intensity is lower than a threshold.
  • the design of the night vision compensation light unit fully considers the problem of insufficient light inside and outside the vehicle when driving at night.
  • the host further includes a direction sensor, an acceleration sensor, a GPS, a temperature sensor, and a geomagnetic sensor, wherein the temperature sensor is configured to sense a temperature in the vehicle and to dissipate heat, and the geomagnetic sensor is configured to detect a direction, where the direction is The sensor is used to determine the direction in which the vehicle advances or retreats, and the vehicle travel distance is used.
  • the acceleration sensor is used for braking and starting detection of the vehicle
  • the GPS is used to locate the vehicle and map access. Multi-purpose sensor access allows the host to obtain rich vehicle travel information and optimize the relevant information output.
  • the technical problem to be solved by the present invention is to provide an intelligent head-up display device capable of performing intelligent voice interaction, thereby realizing full-range voice control.
  • the invention also discloses a head up display device, comprising:
  • a host for transmitting image signals to the display device, and sound collection and input processing
  • the display device disposed on one side of the host for displaying the image signal
  • a curved semi-transparent reflective screen disposed relative to a position of the display device for receiving an image displayed by the display device, and displaying an image on the other side through the semi-transparent reflective screen on a host side;
  • the voice interaction unit pre-placed in the host is configured to perform a query in the database according to the information input by the user voice, and if there are multiple matching query results, the driver is prompted to make a selection.
  • the driver can perform various functions in the vehicle, such as: wake-up of the machine, navigation, and music playing; at the same time, when the smart device such as the host and the driver's mobile phone is connected through Bluetooth, The host implements making a call, sending a text message, sending a WeChat, and the like.
  • the voice interaction unit can support voice interaction in the navigation process to achieve speech intelligence interruption, voice Echo cancellation and so on.
  • the voice interaction unit is further configured to
  • the voice interaction unit is further configured to:
  • the driver's voice input is detected by VAD detection;
  • the voice interaction unit further includes an echo cancellation device, where the echo cancellation device includes a first input and a second input;
  • the first input is used to collect an external sound input
  • the second input is used to connect the output of the speaker of the host to the input of the microphone
  • the time points of the first input and the second input are synchronized, and the echo is respectively cancelled according to the AEC algorithm.
  • the display device further includes a multi-channel sound output unit,
  • the technical problem to be solved by the present invention is to provide an intelligent voice interaction and driving A real-time monitoring and early warning, and a good-looking head-up display device.
  • the invention also provides a head up display device comprising:
  • a host for transmitting an image signal to the display device
  • a display device disposed on one side of the host for displaying the image signal
  • a curved semi-transparent reflective screen disposed relative to a position of the display device for receiving an image displayed by the display device, and displaying an image on the other side through the translucent reflective screen on the host side;
  • the semi-transparent reflective screen is also used to display the image after being ghosted;
  • the voice interaction unit pre-placed in the host is configured to perform an inquiry in the database according to the information input by the user voice, and if there are multiple matching query results, the driver is prompted to make a selection;
  • a driver detecting device installed in the host for determining a driver's face state information according to the face information, and performing driver fatigue monitoring and early warning according to the face state information and the real-time vehicle traveling speed.
  • the display device further includes a remote control device for waking up, starting, and relating to the host within a set range,
  • the warning in the driver detecting device includes: an image information prompt, a sound reminder, a light reminder, and one or more ways of stimulating the driver by using the scent.
  • the voice interaction unit is further configured to receive an external instruction to implement activation, where the activation manner includes: a custom voice wakeup, a voice wake phrase, a physical button, and a gesture action.
  • the voice interaction unit is further configured to receive all information input of the user at a time, and the information input includes at least: voice activation, entering a location navigation/result query, setting a destination/result, and setting a path plan.
  • the manner in which the driver detects the warning in the device is dynamically adjusted in accordance with the speed.
  • the warning mode is: sending a message to the preset contact to inform the current driver of the status.
  • the display device and the curved semi-transparent reflective screen both adopt an electric rotation adjustment angle; and adjust the distance that the driver sees the virtual image by adjusting the relative distance between the display device and the curved semi-transparent reflective screen.
  • the imaging device screen is designed to be parallel to the outer cut surface of the center point of the reflective screen, and the deformation of the upper and lower sides of the image due to the different reflection distances can be reduced.
  • the display device and the host are disposed on the rearview mirror, and the curved semi-transparent reflective screen is disposed on the instrument panel, and displays the image after one reflection.
  • the display device acquires an image to be displayed from an external device by way of wireless or wired connection.
  • the present invention also provides a split type head-up display device, comprising:
  • a host for transmitting an image signal to the display device
  • a display device disposed on one side of the host for displaying the image signal
  • a total reflection screen for reflecting the display image of the display device and forming a virtual image by secondary reflection of the windshield
  • the display device and the host are disposed on the rear view mirror, and the total reflection screen is disposed on the instrument panel, and after two shots, the image is displayed through the front windshield;
  • the voice interaction unit pre-placed in the host is configured to perform an inquiry in the database according to the information input by the user voice, and if there are multiple matching query results, the driver is prompted to make a selection;
  • a driver detecting device installed in the host for determining a driver's facial state information according to the face information, and performing driver fatigue monitoring and early warning according to the facial state information and the real-time vehicle traveling speed.
  • the curved semi-transparent reflective screen disposed relative to the position of the display device is configured to receive the display by the display device Image, and display the image on the other side through the semi-transparent reflective screen on the host side; completely changing the presentation mode of the HUD, overcoming the deficiencies of the existing LED projection principle, and effectively eliminating the ghosting of the image And light refraction, reflection.
  • the main body is provided with a base, a rotating card table is mounted on the base, and the rotating card table is used for engaging on a sliding rail on the base.
  • the flexible and open design is beneficial to the host host to adjust. Angle and direction.
  • a driver detecting device installed in the host for determining a driver's facial state information according to the face information; the state information includes at least distraction, fatigue, and emotional state information of the road anger.
  • the driver's detection device analyzes the driver's emotions and strengthens the analysis and early warning of the three emotions of distraction, fatigue and road anger, which effectively ensures driving safety.
  • the driver detection device is more targeted and real-time.
  • the voice interaction unit preset in the host is used to perform an inquiry in the database according to the information input by the user voice, and if there are multiple matching query results, the driver is prompted to make a selection. Based on the multi-functional voice interaction unit, the driver can realize the navigation of the destination location, query the network information, and play music, make calls, send WeChat, fully consider the driving The trouble of manual operation and the existing safety hazards during the driving process realize the control of the whole voice.
  • the display device Due to the host, the display device, the curved semi-transparent reflective screen, the voice interaction unit and the driver detection device in the head-up display device, the optimized display of the vehicle driving information of the vehicle-mounted HUD, the intelligent voice interaction control, and the driver's driving state are realized.
  • the real-time monitoring overcomes the existing HUD: reflective projection imaging requires large spatial distance, image has ghosting, HUD does not have operational functions and other operational defects.
  • FIG. 1 is a schematic view showing the external structure of a head-up display device of the present invention.
  • FIG. 2(a) is a schematic block diagram of a head-up display device of the present invention.
  • Fig. 2(b) is a schematic view showing the principle of the head-up display device of the present invention.
  • Figure 3 is a schematic illustration of a preferred manner of the head-up display device of Figure 1 (with a base added).
  • Figure 4 is a schematic view of the preferred embodiment of the base of Figure 3.
  • Fig. 5(a) is a schematic view showing the imaging mode of the flat display device in the prior art.
  • Fig. 5(b) is a schematic view showing the imaging mode of the flexible display screen of the present invention.
  • FIG. 6 is a schematic view showing an embodiment of the display device of FIG. 1 as a laser projector.
  • Figure 7 is a schematic view showing the structure of a head-up display device in the present invention.
  • Figure 8 is a schematic illustration of another preferred embodiment of the head-up display device of Figure 7.
  • Figure 9 is a schematic view showing the structure of another head-up display device in the present invention.
  • Figure 10 is a schematic view showing the structure of a preferred head-up display device in the present invention.
  • Figure 11 is a schematic illustration of the further optimized external device of Figure 10.
  • Figure 12 is a schematic view of the split mounting structure of Figure 10.
  • Figure 13 is a schematic view showing the structure of a split type head-up display device in the present invention.
  • FIG. 14 is a schematic structural view of a split type head-up display device of another preferred mode of FIG.
  • FIG. 1 is a schematic view showing the external structure effect of the head-up display device of the present invention.
  • 2(a) is a schematic block diagram of a head-up display device of the present invention.
  • a head-up display device in the embodiment includes: a host 1 for transmitting an image signal to the display device; and a USB interface (USB interface and a cigarette lighter port) through the OBD interface of the host or the vehicle or the car charger Connected to obtain driving information of the vehicle and correspondingly display in the display device.
  • the display device 2 provided on the host side is for displaying the image signal, and the display device provided on the host side is capable of displaying an image signal.
  • a curved semi-transparent reflective screen 3 disposed relative to a position of the display device for receiving an image displayed by the display device, and displaying an image on the other side through the translucent reflective screen on a host side;
  • the translucent reflective screen is also used to display images after de-duplicating the images.
  • the display image can be directly presented in the display device.
  • the inherent design of the prior art based on the LED principle projector used in the display mode and the imaging on the wind shield or the projection screen is changed.
  • FIG. 2(b) is a schematic diagram of the principle of the head-up display device of the present invention, wherein A represents the position of the driver's human eye, and B represents the position of the virtual image that is zoomed in and out.
  • the display device 2 disposed on one side of the host is configured to display the image signal; and the display device disposed on the host side can It is sufficient to display the image signal.
  • a curved semi-transparent reflective screen 3 disposed relative to the position of the display device 2 for receiving an image displayed by the display device, and displaying an image on the other side through the translucent reflective screen on the host side,
  • the image of the existing LED projection principle is overcome.
  • the imaging is based on the principle of reflective imaging of a concave mirror. After the display device 2 is projected onto the curved semi-transparent reflective screen 3, the virtual image is enlarged on the other side through the semi-transparent reflective screen.
  • the side disposed on the host refers to the end of the host.
  • disposed on the host side refers to an integrated raised structure that is formed with the end of the host.
  • the position relative to the display device refers to the other end corresponding to the end of the host, preferably in a positional relationship with the position in which the display device 2 is located.
  • the effective effect in the present embodiment includes at least: a simple semi-transparent reflective screen 3 provided by the display device 2 disposed on one side of the host and the position of the display device.
  • the imaging principle realizes the display of image information during the running of the vehicle, overcomes the deficiencies of the existing methods of projection imaging, and satisfies the placement of different consoles and effective imaging under different driving scenarios.
  • the semi-transparent reflective screen is also used to display images after de-ghosting, effectively solving the defects commonly existing in most in-vehicle devices.
  • the display device 2 is a flexible display screen for performing image distortion in the display device by adjusting the shape of the flexible display screen and changing an image projected onto the curved semi-transparent reflective screen. Correction.
  • the flexible display using PHOLED phosphorescent OLED technology has low power consumption and direct visible flexible panel, which can effectively overcome distortion image distortion. Since the image information may be output when the display device 2 outputs image information, by using the display device as preferred
  • the flexible display screen is calibrated to effectively change the image projected onto the curved surface of the curved surface to overcome image distortion.
  • the reason for image distortion is that the spherical translucent reflective screen cooperates with a conventional flat display screen, as shown in FIG. 5( a ), with TFT as a column, the distance between each pixel of the image and the surface of the spherical surface is different, resulting in a virtual image path length. Different, causing image distortion.
  • the flexible display screen is used, and the flexible display screen can be bent to ensure that the optical path of each pixel point to the spherical translucent reflective screen is uniform, thereby solving the problem of image distortion.
  • the display device is a laser projector for transmitting the image through a laser beam; and is disposed between the curved semi-transparent reflective screen and the laser projector.
  • An MLA microlens array for modulating the display of the laser beam on a curved translucent reflective screen.
  • the light sources in the display device are gathered by the MLA.
  • the display device is a laser projector for transmitting the image through a laser beam to modulate the diffuse reflection effect of the laser beam through a curved semi-transparent reflective screen to prevent damage to the human eye and reduce visual fatigue. And reasonable control of the scattering angle of the light to ensure brightness.
  • the display device is one or more of a TFT, LCD, OLED, or AMOLED display, and alternative forms of display devices are provided in this embodiment.
  • TFT Thin Film Transistor
  • the TFT type display screen is generally used for mainstream display devices on various types of notebook computers and desktop computers, and the TFT type display has the advantages of high responsivity, high brightness, high contrast, and the like, so that the head up display device is optimized at the output end.
  • the main unit 1 and the display device 2 are integrated, and the main unit and the display device are integrally formed to facilitate manufacturing.
  • the curved semi-transparent reflective screen 3 is movable as a foldable mechanism, and the foldable mechanism is a damped rotating shaft or an electric memory adjusting rotating shaft based on user information.
  • the foldable mechanism is a damping shaft
  • the curved semi-transparent reflective screen 3 can be closed by its own gravity.
  • the folding mechanism is an electric memory adjusting the rotating shaft based on user information
  • the automatic lifting of the folding mechanism can be controlled by the advanced motor, and the memory function of different drivers can be performed based on the user information.
  • the driver A is accustomed to adjust the curved semi-transparent reflective screen 3 and the display device 2 to be 30° parallel with respect to the main body; and the driver B is accustomed to adjust the curved semi-transparent reflective screen 3 and the display device 2 due to the height.
  • the information can be memorized by the host and adjusted according to different drivers identified by the camera.
  • the translucent reflective screen is subjected to the following processing to perform image de-ghosting:
  • the concave surface of the translucent reflective screen and the double-sided surface of the convex surface are hardened; the surface hardening can improve the hardness of the surface of the Combiner translucent reflective screen, increase the scratch resistance of the product; and increase the adhesion of the subsequent coating;
  • a semi-lens mask is disposed on the concave surface; the semi-lens mask functions as an image to be reflected; an AR anti-reflection film is disposed on the convex surface; the anti-reflection film functions to increase the concave transmittance, thereby avoiding ghosting, and Since the antireflection film has different colors, a colorless antireflection film may be preferably used; an AF anti-fingerprint film is further added on the concave surface and/or the convex surface; and the anti-fingerprint film functions to reduce soiling;
  • the circumferential CNC cutting of the translucent reflective screen is carried out.
  • the circumferential CNC cutting is mainly to avoid the image deformation problem caused by the unevenness at the edge after the Combiner injection.
  • FIG. 3 is a schematic view of a preferred embodiment of the head-up display device of FIG. 1 (with a base added), and
  • FIG. 4 is a schematic view of a preferred embodiment of the base of FIG.
  • a head-up display device includes: a host 1 for transmitting an image signal to a display device; and obtaining driving information of the vehicle through a host interface with an OBD interface of the vehicle or a USB interface of the vehicle charger, And correspondingly displayed in the display device.
  • the display device 2 provided on the host side is for displaying the image signal, and the display device provided on the host side is capable of displaying an image signal.
  • a curved semi-transparent reflective screen 3 disposed relative to a position of the display device for receiving an image displayed by the display device and displaying the image inside a curved surface of the translucent reflective screen; The translucent reflective screen is also used to display the image after it has been ghosted.
  • the main body is provided with a base 4 for being placed on the bridge to prevent the main body from sliding or shifting position during driving.
  • a rotating card table 5 is mounted on the base 4, and the rotating card table is configured to engage 5 on the slide rail 6 on the base, and adjust the semi-transparent reflective screen on the curved surface by the placement angle of the main body.
  • the image in . By designing the rotating card table 5 and the slide rail 6, it is convenient to adjust the angle and direction of the main machine. When the host slides through the rotating card table 5 in the slide rail 6, the image in the curved semi-transparent reflective screen can be adjusted by the angle of the placement.
  • the rotary chuck 5 is slidable on the slide rail 6 by two fixed rivets.
  • the slide rail 6 may be provided with a plurality of rails to ensure stability during sliding.
  • the slide rail 6 is a convex spherical design structure, which plays an effective buffering role while saving space.
  • the rotating card table 5 cooperates with the grooves at the bottom of the main body 1 to fit each other.
  • the base 4 supports left and right rotation on the rotating deck 5.
  • Figure 7 is the hair A schematic structural view of a head-up display device in the present invention.
  • a head-up display device in the embodiment, comprising: a host 1 for transmitting an image signal to a display device; and the display device 2 disposed on a side of the host 1 for displaying the image signal; a curved semi-transparent reflective screen 3 disposed relative to the position of the display device 2 for receiving an image displayed by the display device 2 and displaying the image on the inner side of the curved surface of the translucent reflective screen 3; a driver detecting device 12 installed in the host for determining facial state information of the driver according to the face information; the state information includes at least distraction, fatigue, and emotional state information of road anger; The driver's fatigue monitoring and warning are performed on the facial status information, real-time environmental information, and real-time vehicle travel speed.
  • the driver detecting device installed in the host computer can monitor the driving environment of the driver and the vehicle through the front/rear camera in the host, and capture the driver's facial state information through the front camera.
  • the analysis of the driver's emotions strengthens the analysis and early warning of the three emotions of distraction, fatigue and road anger, which effectively ensures the safety of driving.
  • Distracted driving refers to a phenomenon in which attention is directed to activities that are not related to normal driving, resulting in a decline in driving operation capability. Distracted driving is usually caused by the driver's distraction or distraction. The lack of concentration is a common and important cause of traffic accidents. This incentive is particularly significant in rear-end collisions. If the camera detects the driver's line of sight deviation or inattention, and confirms the confidence level of the information in the host.
  • ISO International Organization for Standardization
  • the distracting driving means that the driver's line of sight in the vehicle is not directly in front of the set time, including but not limited to the behavior: it may be playing the mobile phone, controlling the operation, and turning the head.
  • the beneficial effect of the embodiment is that, for the hidden danger of distracting driving, the three-dimensional orientation of the face is used to determine whether the driver's line of sight is directly in front of the driver, to detect whether the driver is in front of the driver. Distraction.
  • Fatigue driving refers to the driver's dysfunction of physiology and mental function after continuous driving for a long time, and the phenomenon of driving skills declines objectively.
  • the incentives for fatigue driving for example, the interior environment: poor air quality, poor ventilation; excessive or too low temperature; severe noise and vibration; improper seat adjustment; and tension with the same car.
  • Outside the car environment driving in the afternoon, evening, early morning, late night; poor road conditions; good road conditions, single situation; wind, sand, rain, snow and snow driving.
  • Operating conditions long time, long distance driving; speed is too fast or too slow; too restrictive time to reach the destination.
  • Causes of road anger driving including but not limited to: abuse of high beam; cut-in, plug; rear high frequency horn; battery car motorway does not go;
  • an angry mood is detected by the camera.
  • the road anger driving detection feature also includes: frequent rapid acceleration / rapid deceleration.
  • the camera detects that the driver's state is fatigue driving, the driver's fatigue is monitored and alerted according to the judgment condition.
  • the fatigue driving detection feature includes, but is not limited to, an eye opening degree.
  • the ratio of the eye opening degree being less than a certain set value exceeds the set threshold. And/or, continuous eye closure exceeds a set threshold.
  • the facial status information includes, but is not limited to, locating a plurality of key points within the face area, primarily including points of facial features and facial contours.
  • real-time environmental information includes, but is not limited to, real-time Internet traffic information, real-time weather, real-time interior and exterior temperature, interior and exterior brightness, and the like.
  • the real-time vehicle travel speed includes, but is not limited to, the relative speed of the vehicle.
  • the driver detecting device 12 installed in the host is further configured to perform head posture estimation, specifically, using position information of a face key point and a 3-dimensional coordinate position of an average face learned offline.
  • the 3D-2D point pair and the mature Perspective-n-Point method in the field of camera calibration are used to estimate the 3-dimensional pose information of the head.
  • the monitoring methods include, but are not limited to, lane line monitoring, driving distance monitoring, pedestrian distance monitoring, roadway edge monitoring, vehicle vanishing point monitoring, and vehicle position monitoring.
  • the warning mode includes, but is not limited to, a machine sound warning, a sensor vibration warning, and a mobile phone vibration warning after being connected to the mobile phone.
  • the warning mode can be dynamically adjusted, for example, it can be reminded according to the speed and the speed exceeds the set value.
  • the set alert mode is to send a message to a pre-set contact to inform the current driver of the status.
  • the alert mode includes, but is not limited to, a warning mode for voice machine chat to alleviate fatigue.
  • the voice machine chat can adopt a manner of playing soothing music, can guide the driver to chat by means of topic chat, and can relieve fatigue by means of telling a joke.
  • the warning mode includes, but is not limited to, an image prompt, a sound reminder, a light reminder, and the scent is used to stimulate the driver.
  • the head-up display device in the present embodiment includes at least the following technical effects: the driver detecting device 12 of the head-up display device in the present embodiment according to the face state information, the real-time environment information, and the real-time vehicle traveling speed. It can analyze, monitor and pass the driver's distraction, fatigue and emotional state of road anger. Now effective warning. Compared with the prior art, the head-up display device in the embodiment strengthens the analysis and early warning processing of the three emotions of distraction, fatigue and road anger in the analysis of the driver's emotion, thereby effectively ensuring driving safety.
  • the driver detecting device includes a camera 13 and a night vision compensation light unit 14;
  • the camera 13 is configured to adopt information about the overall state of the driver's face, three-dimensional posture information of the head, and opening/closing of the eyes and the mouth;
  • the night vision fill light unit 14 is configured to perform light compensation when the in-vehicle/out-of-vehicle illumination intensity is lower than a threshold.
  • the design of the night vision compensation light unit fully considers the problem of insufficient light inside and outside the vehicle when driving at night.
  • the overall state information of the face collected by the camera 13 includes, but is not limited to, classifying the face region by the CNN method, and generally determining the current face state of the driver.
  • the three-dimensional posture information of the head collected by the camera 13 includes, but is not limited to, using the position information of the face key point and the 3-dimensional coordinate position of the average face learned offline, and utilizing these 3D- 2D point pairs and the mature Perspective-n-Point method in the field of camera calibration estimate the 3-dimensional pose information of the head.
  • the human eye and mouth state classification collected by the camera 13 includes, but is not limited to, an output of a face key point location, and the result includes contour information of two eyes and a mouth.
  • the contour information accurately identifies the open/closed state of both eyes and mouth.
  • the driver detecting device is further configured to collect state data of the driver, Synchronization with data collected by the driving recorder, historical usage data of the driver, and networking information related to the current driving; and establishing an early warning model in the cloud based on the data in the driver detecting device, correlating the data with the accident, and predicting the risk Confidence and early warning.
  • the host is coupled to an in-vehicle CAN bus or OBD for reading travel data for the vehicle.
  • the learning model is established, and the data and the accident are associated by using a classifier such as SVM.
  • Figure 8 is a schematic illustration of another preferred embodiment of the head-up display device of Figure 7.
  • the host 1 further includes a direction sensor 16, an acceleration sensor 15, a GPS 19, a temperature sensor 18, and a geomagnetic sensor 17, wherein the temperature sensor 18 senses the temperature inside the vehicle and performs heat dissipation.
  • the geomagnetic sensor 17 is used to detect the direction
  • the direction sensor 16 is used to determine the direction of the vehicle forward or backward, and the driving distance of the vehicle is tested.
  • the acceleration sensor 15 is used for braking and starting detection of the vehicle
  • the GPS 19 is used for positioning.
  • Vehicle location and map access provide car-level GPS antenna, precise navigation and positioning.
  • the host is equipped with an ARM 4 core CPU processor, 1G RAM memory, and an Android system based on the in-vehicle scene depth customization, and can be updated periodically with the cloud.
  • FIG. 9 is a schematic structural view of another head-up display device in the present invention.
  • a head-up display device includes: a host 1 for transmitting an image signal to a display device, and sound collection and input processing; and the display device 2 disposed on one side of the host for The image signal is displayed; the curved semi-transparent reflective screen 3 is disposed relative to the position of the display device for receiving an image displayed by the display device, and the image is inside the curved surface of the translucent reflective screen Displaying; a voice interaction unit preset in the host 20, for querying in the database according to the information input by the user voice, if there are multiple matching query results, the driver is reminded to make a selection.
  • the voice interaction unit is further configured to receive an external activation to implement the activation function, including: a voice wake activation that can be customized, a voice wake activation phrase, a physical button activation, and a gesture action activation.
  • the voice interaction unit is further configured to receive all information input by the user once, and complete the input once. All information inputs include, but are not limited to, voice activation, entering navigation functions, setting destinations, and setting path planning strategies.
  • the voice interaction unit in this embodiment can process the user's needs at one time, including activation, query, navigation, and path finding, and realize one-time analysis of various instructions to obtain a result. For example, "radish, I want to navigate to the south gate of Tsinghua University and find me the fastest route.”
  • the voice interaction unit is further configured to parse the natural voice information of different expressions of the same meaning of the user according to the semantics, and execute a corresponding query: query according to the input query result, if If you search for a unique location, use this result; if you search for multiple possible query results, you need to ask again, and further confirm according to multiple natural voice input. If you accurately query the unique result, use the query result, otherwise Continue to ask or remind you to repeat.
  • the voice interaction unit is further configured to: collect voice input of the driver while the host outputs the sound;
  • the driver's voice input is detected by VAD detection;
  • the voice interaction unit further includes an echo cancellation device, where the echo cancellation device includes a first input and a second input;
  • the first input is used to collect an external sound input
  • the second input is used to connect the output of the speaker of the host to the input of the microphone
  • the time points of the first input and the second input are synchronized, and the AEC algorithm is preferably used to cancel the echo respectively.
  • the apparatus further includes a multi-channel sound output unit for outputting different types of operational sounds to different acoustic devices such that the driver simultaneously hears the sound output of the different operations.
  • the apparatus further includes a speaker for outputting the voice information to the outside.
  • the head-up display device in this embodiment includes at least the following technical effects: a voice interaction unit built in the host and a microphone outside the host can implement voice operations in multiple modes, such as multiple rounds of voice interactive query and destination location. Clustering, echo cancellation, dual channel sound output, voice intelligent interruption, etc.
  • the voice interaction unit in the host can also be used for the driver to navigate, make calls, send WeChat, and position the location through voice. Compared with the in-vehicle head-up display device in the prior art that cannot perform voice interaction and voice function operation, there is a significant improvement.
  • Figure 10 is a schematic view showing the structure of a preferred head-up display device in the present invention.
  • a host 1 for transmitting an image signal to a display device; a display device 2 disposed on a host side for displaying the image signal; and a curved surface set with respect to a position of the display device a semi-transparent reflective screen 3 for receiving an image displayed by the display device and displaying the image inside a curved surface of the translucent reflective screen; and the translucent reflective screen is further configured to Displaying after the ghosting;
  • the voice interaction unit 20 preset in the host is configured to perform an inquiry in the database according to the information input by the user voice, and if there are multiple matching query results, the driver is prompted to make a selection;
  • the driver detecting device 12 installed in the host is configured to determine the driver's facial state information according to the face information, and perform driver fatigue monitoring and early warning according to the facial state information and the real-time vehicle traveling speed.
  • the display device 2 is a flexible display screen for performing image distortion in the display device by adjusting the shape of the flexible display screen and changing an image projected onto the curved semi-transparent reflective screen. Correction.
  • the display device is a laser projector for transmitting the image through a laser beam; and the MLA microlens array disposed between the curved semi-transparent reflective screen and the laser projector is used To modulate the display of the laser beam on a semi-transparent reflective screen.
  • both the display device and the reflective screen may employ an electric rotation adjustment angle.
  • the relative distance between the display device and the reflective screen can be adjusted.
  • the distance of the virtual image seen by the driver can be adjusted, and the distance between the display device and the reflective screen can be increased, and the image that the user can see is farther than the prior art.
  • a camera mounted in the interior rear view mirror position transmits video data to the host via a wired connection and performs video display on the host.
  • the processing chip in the host can use the image processing algorithm to analyze the video, realize lane departure detection, front vehicle collision warning, pedestrian detection and the like.
  • the display device is one or more of a TFT, LCD, OLED, or AMOLED display, and alternative forms of display devices are provided in this embodiment.
  • TFT Thin Film Transistor
  • the main body is provided with a base 4 for being placed on the bridge to prevent the main body from sliding or shifting position during driving.
  • a rotating card table 5 is mounted on the base 4, and the rotating card table is configured to engage 5 on the slide rail 6 on the base, and adjust the semi-transparent reflective screen on the curved surface by the placement angle of the main body. The image in .
  • the driver detecting device 12 installed in the host is further configured to perform head posture estimation, specifically, using position information of a face key point and a 3-dimensional coordinate position of an average face learned offline.
  • the 3D-2D point pair and the mature Perspective-n-Point method in the field of camera calibration are used to estimate the 3-dimensional pose information of the head.
  • the monitoring methods include, but are not limited to, lane line monitoring, driving distance monitoring, pedestrian distance monitoring, roadway edge monitoring, vehicle vanishing point monitoring, and vehicle position monitoring.
  • the warning mode includes, but is not limited to, a machine sound warning, a sensor vibration warning, and a mobile phone vibration warning after being connected to the mobile phone.
  • the alert mode includes, but is not limited to, a warning mode for voice machine chat to alleviate fatigue.
  • the voice machine chat can adopt a manner of playing soothing music, can guide the driver to chat by means of topic chat, and can relieve fatigue by means of telling a joke.
  • the driver detecting device includes a camera 13 and a night vision compensation light unit 14;
  • the camera 13 is configured to adopt information about the overall state of the driver's face, three-dimensional posture information of the head, and opening/closing of the eyes and the mouth;
  • the night vision fill light unit 14 is used for illumination inside and outside the vehicle.
  • the intensity is lower than the threshold, light compensation is performed.
  • the design of the night vision compensation light unit fully considers the problem of insufficient light inside and outside the vehicle when driving at night.
  • the head-up display device in the embodiment includes at least the following technical effects: by using a simple imaging principle, the display of image information during the running of the vehicle is realized, which overcomes the deficiencies of the existing methods of projection imaging, and satisfies The placement of different consoles and effective imaging in different driving scenarios.
  • the driver's detection device installed in the main machine can monitor the driving environment of the driver and the vehicle through the front/rear camera in the main machine, and capture the driver's facial state information through the front camera.
  • the analysis of the driver's emotions strengthens the analysis and early warning of the three emotions of distraction, fatigue and road anger, effectively ensuring driving safety and has outstanding substantive features; through the built-in voice interaction unit and the outside of the host
  • the microphone can realize voice operations in various ways, such as multiple rounds of voice interactive query, clustering of destination locations, echo cancellation, dual channel sound output, and voice intelligent interruption.
  • the voice interaction unit in the host can also be used for the driver to navigate, make calls, send WeChat, and position the location through voice. Compared with the in-vehicle head-up display device in the prior art that cannot perform voice interaction and voice function operation, there is a significant improvement.
  • Figure 11 is a schematic illustration of the further optimized external device of Figure 10.
  • the head-up display device further includes a remote control device for waking up, starting, and relating to the host within a set range, and adjusting the display device and the curved semi-transparent reflection The angle of imaging of the screen.
  • the external device of the head-up display device may be the smart mobile terminal 40, and the connection manner of the head-up display device with the external device includes, but is not limited to, wi-fi, Bluetooth, NFC, and the like.
  • the manner in which the heads up display device accesses the network includes, but is not limited to, wireless AP, GPRS, 3G/4G, and the like.
  • Figure 12 is a schematic view of the split mounting structure of Figure 10.
  • a head-up display device in this embodiment may also be configured as a split type, and specifically includes the following structure:
  • a host 1 for transmitting an image signal to a display device
  • a display device 2 disposed on one side of the host for displaying the image signal
  • a curved semi-transparent reflective screen 3 disposed relative to a position of the display device for receiving an image displayed by the display device, and displaying an image on the other side through the translucent reflective screen on a host side;
  • the translucent reflective screen is further configured to display the image after being ghosted;
  • the voice interaction unit pre-placed in the host is configured to perform an inquiry in the database according to the information input by the user voice, and if there are multiple matching query results, the driver is prompted to make a selection;
  • a driver detecting device installed in the host for determining a driver's facial state information according to the face information, and performing driver fatigue monitoring and early warning according to the facial state information and the real-time vehicle traveling speed;
  • the display device 2 and the main body 1 are disposed on a rear view mirror, and the curved semi-transparent reflective screen 3 is disposed on the instrument panel, and displays an image after one reflection.
  • a voice interaction unit and driver detection device are integrated in the host.
  • the display device 2 acquires an image to be displayed from an external device by way of wireless or wired connection.
  • the external device includes, but is not limited to, a mobile phone or other intelligent terminal that can be accessed infinitely.
  • FIG. 13 is a schematic view showing the structure of a split type head-up display device in the present invention.
  • FIG. 14 is a schematic structural view of a split type head-up display device of another preferred mode of FIG.
  • a split type head-up display device includes:
  • a host 1 for transmitting an image signal to a display device
  • a display device 2 disposed on one side of the host for displaying the image signal
  • a total reflection screen for reflecting the display image of the display device and forming a virtual image by secondary reflection of the windshield; the user can see the virtual image of the second reflection through the windshield;
  • a visor on one side of the total reflection screen for blocking reflected light; thus, the sunlight emission is blocked, so that it is not reflected in the human eye;
  • the display device and the host are disposed on the rear view mirror, and the total reflection screen is disposed on the instrument panel, and after two shots, the image is displayed through the front windshield;
  • the voice interaction unit pre-placed in the host is configured to perform an inquiry in the database according to the information input by the user voice, and if there are multiple matching query results, the driver is prompted to make a selection;
  • a driver detecting device installed in the host for determining a driver's face state information according to the face information, and performing driver fatigue monitoring and early warning according to the face state information and the real-time vehicle traveling speed.
  • the display device 2 acquires an image to be displayed from an external device by way of wireless or wired connection.
  • the external device includes, but is not limited to, a mobile phone or other intelligent terminal that can be accessed infinitely.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Instrument Panels (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

公开了一种抬头显示装置，所述抬头显示装置包括：主机（1），用以将图像信号发送至显示装置（2）；设置于主机（1）一侧的显示装置（2），用以将所述图像信号进行显示；相对于所述显示装置（2）的位置设置的曲面半透明反射屏（3），用以接收所述显示装置（2）所显示的图像，并且在主机（1）一侧透过所述半透明反射屏（3）在另一侧显示图像；以及所述半透明反射屏（3）还用以将图像去重影后进行显示；预置于所述主机（1）中的语音交互单元（20）以及安装于所述主机（1）中的驾驶员检测装置（12）。所述抬头显示装置支持全程语音交互、驾驶员实时监测与提前预警且显示效果良好。

Description

一种抬头显示装置 技术领域
本发明涉及车载智能装置，特别涉及一种抬头显示装置。
背景技术
抬头显示器HUD(Head Up Display)，是普遍运用在航空器上的飞行辅助仪器。抬头的意思是指飞行员不需要低头就能够看到他需要的重要资讯。
目前，抬头显示器HUD还存在如下的缺陷：
1.大部分只能显示车速、油量等信息，完全不具备操作功能。
2.在实现原理上的不足，一般都是通过将车辆相关信息投射在玻璃、镀膜镜片(析光镜)，然后平衡反射进驾驶员的眼睛。
3.在显示方式上一般采用基于LED原理投影仪进行投影，并将图像显示在成像膜上，驾驶员透过成像膜可以看到车辆的相关信息。另外，采用投影仪会受到成像距离的限制，从而影响HUD装置的整体外观。
4.HUD抬头显示的信息可能会不清晰，尤其是在在前方有强光照射的情况下，另外还有可能出现图像的重影，影响驾驶员的驾驶。
5.HUD的成像距离放置在车内来说不够远，焦距未能与驾驶场景中契合匹配，无法解决路面、仪表台的远近融合问题。
发明内容
本发明要解决的技术问题是，提供一种支持全程语音交互、显示效果良好的智能车载装置。
解决上述技术问题，本发明提供了一种抬头显示装置，包括：
主机，用以将图像信号发送至显示装置；通过主机与车内的OBD接口或者车载充电器的USB接口连接，获得车辆的驾驶信息，并对应地在显示装置中进行显示。
设置于主机一侧的所述显示装置，用以将所述图像信号进行显示；设置在主机一侧的显示装置，能够对图像信号进行显示。
相对于所述显示装置的位置设置的曲面半透明反射屏，用以接收所述显示装置所显示的图像，并且在主机一侧透过所述半透明反射屏在另一侧显示图像；以及所述半透明反射屏还用以，将图像去重影后进行显示。通过所述曲面半透明反射屏，类似“镜面”反射，能够直接呈现在显示装置中的显示图像。改变了现有技术在显示方式上一般所采用的基于LED原理投影仪进行投影，并在挡风或者投影屏上进行成像的固有设计。
更进一步，所述显示装置为柔性显示屏，用以通过调整所述柔性显示屏的形状，改变投射到所述曲面半透明反射屏上的图像，对显示装置中的图像畸变进行校正。使用了PHOLED磷光性OLED技术的柔性显示屏，具有低功耗，直接可视柔性面板，可有效克服distortion图像畸变。
更进一步，所述显示装置为激光投影器，用以将所述图像通过激光光束进行透射；且在所述曲面半透明反射屏与激光投影器之间设置的MLA微透镜阵列，用以调制所述激光光束在曲面半透明反射屏的显示。通过MLA将显示装置中光源进行聚集。调制所述激光光束经所述曲面半透明反射屏的漫反射效果，防止损伤人眼及减轻视疲劳，并合理控制光线的散射角度，保证亮度。
更进一步，所述显示装置为TFT、LCD、OLED或者AMOLED显示器 中的一种或者多种。在本发明中提供了多种显示装置的替换形式。
更进一步，所述主机与显示装置为一体化结构，主机与显示装置一体成型，利于出厂制造。
更进一步，所述曲面半透明反射屏活动为可折叠机构，
所述可折叠机构为阻尼转轴或者基于用户信息的电动记忆调节转轴。
更进一步，对所述半透明反射屏进行如下处理后进行图像去重影：
半透明反射屏成型，半透明反射屏的凹面以及凸面双面表面硬化；
对所述凹面，设置半透镜面膜；
对所述凸面，设置AR增透膜；
在所述凹面和/或凸面还增设有AF防指纹膜；
最后进行半透明反射屏的周圈CNC切割。
更进一步，所述主机设置有底座，在底座上安装有一旋转卡台，所述旋转卡台用以卡合在所述底座上的滑轨上，以及通过所述主机的摆放角度调整在所述曲面半透明反射屏中的图像。通过设计旋转卡台和滑轨，能够方便主机的调节角度和方向。
更进一步，显示装置还包括所述主机内置的散热风道系统，用以引导所述显示装置以及主机中的微处理器中产生的热风进行对流，
所述散热风道系统包括，热管、散热片以及风扇，
所述热管与散热片连接，用以传递接收到的热量至散热片；
所述散热片，用以对所述显示装置、微处理器中的热量进行散热；
所述风扇用以对所述散热片进行降温。
更进一步，显示装置还包括屏蔽罩、导热硅片，所述屏蔽罩通过所述导 热硅片与显示装置、微处理器连接，所述屏蔽罩与散热风道系统连接。
本发明还要解决的技术问题是，提供一种在驾驶过程中，对驾驶员实时监测和预智能警的智能车载装置。
本发明还提供了一种抬头显示装置，包括：
主机，用以将图像信号发送至显示装置；
设置于主机一侧的所述显示装置，用以将所述图像信号进行显示；
相对于所述显示装置的位置设置的曲面半透明反射屏，用以接收所述显示装置所显示的图像，并且在主机一侧透过所述半透明反射屏在另一侧显示图像；
安装于所述主机中的驾驶员检测装置，用以根据人脸信息判断驾驶员的脸部状态信息；所述状态信息至少包括，分心、疲劳以及路怒的情绪状态信息；
以及根据所述脸部状态信息、实时环境信息以及实时车辆行驶速度，进行驾驶员疲劳监测和预警。
安装于主机中的驾驶员检测装置，通过主机中的前置/后置摄像头，对驾驶员和车辆的行驶环境进行监测，并通过前置摄像头捕捉到驾驶员的脸部状态信息，对驾驶员的情绪进行分析中强化了对分心、疲劳以及路怒的三种情绪的分析和预警处理，有效保证了行车安全。
更进一步，所述驾驶员检测装置包括，摄像头和夜视补偿光单元；
所述摄像头，用以采用驾驶员的人脸整体状态信息、头部三维姿态信息、眼睛和嘴巴的张开/闭合的信息；
所述夜视补光单元，用以在车内/车外光照强度低于阈值时，进行光补偿。 夜视补偿光单元的设计，充分考虑到了夜晚行车时，车内/车外光线不足的问题。
更进一步，所述主机还包括，方向传感器、加速度传感器、GPS、温度传感器以及地磁传感器，所述温度传感器用以感应车内的温度并进行散热，所述地磁传感器用以检测方向，所述方向传感器用以判断车辆前进或倒退的方向以及测试汽车行驶距离，所述加速度传感器用以车辆的制动、启动检测，所述GPS用以定位车辆位置以及地图接入。多用途的感应器接入，能够让主机获得丰富的车辆行驶信息，并进行相关的信息输出优化处理。
本发明还要解决的技术问题是，提供一种能够进行智能语音交互，从而实现全程语音控制的智能抬头显示装置。
本发明还公开了一种抬头显示装置，包括：
主机，用以将图像信号发送至显示装置，以及声音采集和输入处理；
设置于主机一侧的所述显示装置，用以将所述图像信号进行显示；
相对于所述显示装置的位置设置的曲面半透明反射屏，用以接收所述显示装置所显示的图像，并且在主机一侧透过所述半透明反射屏在另一侧显示图像；
预置于所述主机中的语音交互单元，用以根据用户语音输入的信息，在数据库中进行查询，若有多条符合的查询结果，则提醒驾驶员进行选择。通过语音交互单元，能够让驾驶员在车内实现多种功能的操作，比如：机器的唤醒、行车导航、播放音乐；同时，当主机与驾驶员的手机等智能设备通过蓝牙连接后，能够通过主机实现拨打电话、发送短信、发送微信等。同时，语音交互单元能够支持导航过程中的语音交互，以实现说话智能打断、语音 的回声消除等。
更进一步，所述语音交互单元还用以，
对用户的同样意思的不同表述方式的自然语音信息，根据语义进行解析，并执行对应的查询：
根据输入查询结果进行查询，若精准查询到唯一位置，则使用此结果；
若搜索出来多个可能的查询结果，则需要再次询问，并根据多次自然语音输入进一步确认，若精准查询到唯一结果，则使用该查询结果，否则继续询问或者提醒重说。
更进一步，所述语音交互单元还用以：
在所述主机输出声音的同时，采集驾驶员的语音输入；
通过VAD检测，检测到驾驶员的语音输入；
并且，在检测得到驾驶员的语音输入的同时，终止主机中的语音播放。
更进一步，所述语音交互单元还包括回声消除装置，所述回声消除装置包括第一路输入和第二路输入；
所述第一路输入，用以采集外部声音输入；
所述第二路输入，用以将主机的扬声器的输出与麦克风的输入连接；
对上述第一路输入、第二路输入的时间点进行同步，并根据AEC算法分别消除回声。
更进一步，显示装置还包括多通道声音输出单元，
用以将不同类型的操作声音输出到不同的音响设备，使得驾驶员同时听到不同操作的声音输出结果。
本发明还要解决的技术问题是，提供一种能够进行智能语音交互、驾驶 员实时监测与提前预警、呈现效果良好的能抬头显示装置。
本发明还提供了一种抬头显示装置，包括：
主机，用以将图像信号发送至显示装置；
设置于主机一侧的显示装置，用以将所述图像信号进行显示；
相对于所述显示装置的位置设置的曲面半透明反射屏，用以接收所述显示装置所显示的图像，并且在主机一侧透过所述半透明反射屏在另一侧显示图像；以及所述半透明反射屏还用以，将图像去重影后进行显示；
预置于所述主机中的语音交互单元，用以根据用户语音输入的信息，在数据库中进行查询，若有多条符合的查询结果，则提醒驾驶员进行选择；
以及，安装于所述主机中的驾驶员检测装置，用以根据人脸信息判断驾驶员的脸部状态信息，根据所述脸部状态信息和实时车辆行驶速度，进行驾驶员疲劳监测和预警。
更进一步，显示装置还包括遥控装置，所述遥控装置用以在设定范围内唤醒、启动以及关系所述主机，
以及，调节所述显示装置与所述曲面半透明反射屏的成像角度。
更进一步，所述驾驶员检测装置中的预警包括：图像信息提示，声音提醒，灯光提醒，采用气味刺激驾驶员的一种或者多种方式。
更进一步，所述语音交互单元还用以接收外部指令实现激活，所述激活方式包括：自定义语音唤醒，语音唤醒短语，物理按钮，手势动作。
更进一步，所述语音交互单元还用以一次接收用户所有信息输入，所述信息输入至少包括：语音激活、进入位置导航/结果查询、设定目的地/结果，设置路径规划。
更进一步，所述驾驶员检测装置中的预警的方式根据速度进行动态调整。
更进一步，预警方式为：向预先设定的联系人发送一条信息，告知当前驾驶员的状态。
更进一步，所述显示装置和曲面半透明反射屏均采用电动转动调整角度；通过调节所述显示装置和所述曲面半透明反射屏之间的相对距离，调整驾驶员看到虚像的距离。优选地，成像装置屏幕设计成和反射屏幕的中心点的外切面平行，可以减少图像上下由于反射距离不一样导致的形变。
更进一步，所述显示装置、主机设置于后视镜，所述曲面半透明反射屏设置于仪表台，经过一次反射后显示图像。
更进一步，所述显示装置通过无线或者有线连接的方式，从外部设备中获取需要显示的图像。
更进一步，本发明还提供了一种分体式抬头显示装置，包括：
主机，用以将图像信号发送至显示装置；
设置于主机一侧的显示装置，用以将所述图像信号进行显示；
全反射屏，用以将显示装置的显示图像进行一次反射，并通过风挡二次反射形成虚像；
位于所述全反射屏一侧的遮光板，用以挡住反射光线；
所述显示装置、主机设置于后视镜，所述全反射屏设置于仪表台，经过两次发射后透过前挡风玻璃显示图像；
预置于所述主机中的语音交互单元，用以根据用户语音输入的信息，在数据库中进行查询，若有多条符合的查询结果，则提醒驾驶员进行选择；
以及，安装于所述主机中的驾驶员检测装置，用以根据人脸信息判断驾驶员的脸部状态信息，根据所述脸部状态信息和实时车辆行驶速度，进行驾驶员疲劳监测和预警
本发明的有益效果：
1)由于采用了设置于主机一侧的所述显示装置，用以将所述图像信号进行显示，相对于所述显示装置的位置设置的曲面半透明反射屏用以接收所述显示装置所显示的图像，并且在主机一侧透过所述半透明反射屏在另一侧显示图像；彻底改变了HUD的呈现方式，克服了现有LED投影原理成像的不足，同时有效消除了图像的重影和光线折射、反射。
2)由于所述主机设置有底座，在底座上安装有一旋转卡台，所述旋转卡台用以卡合在所述底座上的滑轨上，该灵活、开放性的设计有利于主机主机调节角度和方向。
3)由于安装于所述主机中的驾驶员检测装置，用以根据人脸信息判断驾驶员的脸部状态信息；所述状态信息至少包括，分心、疲劳以及路怒的情绪状态信息。通过驾驶员检测装置对驾驶员的情绪进行分析中强化了对分心、疲劳以及路怒的三种情绪的分析和预警处理，有效保证了行车安全。与现有的常见的ADAS高级驾驶辅助系统中的辅助驾驶不同，所述的驾驶员检测装置更有针对性和实时性。
4)由于预置于所述主机中的语音交互单元，用以根据用户语音输入的信息，在数据库中进行查询，若有多条符合的查询结果，则提醒驾驶员进行选择。基于多功能的语音交互单元，可以让驾驶员实现目的地位置查询导航、联网查询网络信息，以及播放音乐、拨打电话、发送微信，充分考虑到了驾 驶过程中手动操作的麻烦与存在的安全隐患，实现全程语音的控制。
5)由于在抬头显示装置中的主机、显示装置、曲面半透明反射屏、语音交互单元以及驾驶员检测装置，实现了车载HUD的车辆驾驶信息的优化显示、智能语音交互控制以及驾驶员驾驶状态的实时监测，克服了现有HUD所存在的：反射投影成像需要较大的空间距离、图像具有重影、HUD不具备操作功能等操作缺陷。
附图说明
图1是本发明抬头显示装置的外部结构效果示意图。
图2(a)是本发明抬头显示装置的原理框图架示意图。
图2(b)是本发明抬头显示装置的原理示意图。
图3是图1中的抬头显示装置的优选方式示意图(增加了底座)。
图4是图3中的底座优选方式示意图。
图5(a)是现有技术中平面显示装置成像方式示意图。
图5(b)是本发明中柔性显示屏成像方式示意图。
图6是图1中的显示装置为激光投影器时实施方式示意图。
图7是本发明中的一种抬头显示装置的结构示意图。
图8是图7中的抬头显示装置另一优选实施例中的示意图。
图9是本发明中的另一种抬头显示装置的结构示意图。
图10是本发明中的一种优选抬头显示装置的结构示意图。
图11是图10中的进一步优化外接装置的示意图。
图12是图10中的分体式安装结构示意图。
图13是本发明中的分体式抬头显示装置的结构示意图。
图14是图13另一种优选方式的分体式抬头显示装置的结构示意图。
具体实施方式
为使本发明的目的、技术方案和优点更加清楚明白，以下结合具体实施例，并参照附图，对本发明进一步详细说明。
如图1所示是本发明抬头显示装置的外部结构效果示意图。图2(a)是本发明抬头显示装置的原理框图架示意图。
本实施例中的一种抬头显示装置，包括：主机1，用以将图像信号发送至显示装置；通过主机与车内的OBD接口或者车载充电器的USB接口(USB接口与点烟口插接)连接，获得车辆的驾驶信息，并对应地在显示装置中进行显示。设置于主机一侧的所述显示装置2，用以将所述图像信号进行显示；设置在主机一侧的显示装置，能够对图像信号进行显示。相对于所述显示装置的位置设置的曲面半透明反射屏3，用以接收所述显示装置所显示的图像，并且在主机一侧透过所述半透明反射屏在另一侧显示图像；以及所述半透明反射屏还用以，将图像去重影后进行显示。通过所述曲面半透明反射屏，类似“镜面”反射，能够直接呈现在显示装置中的显示图像。改变了现有技术在显示方式上一般所采用的基于LED原理投影仪进行投影，并在挡风或者投影屏上进行成像的固有设计。
请参考图2(b)是本发明抬头显示装置的原理示意图，其中，A表示驾驶员人眼所在位置，B表示放大拉远的虚像所在位置。设置于主机一侧的所述显示装置2，用以将所述图像信号进行显示；设置在主机一侧的显示装置，能 够对图像信号进行显示。相对于所述显示装置2的位置设置的曲面半透明反射屏3，用以接收所述显示装置所显示的图像，并且在主机一侧透过所述半透明反射屏在另一侧显示图像，以使得在A位置能够看到B位置处放大拉远的虚像，克服了现有LED投影原理成像的不足。其中成像基于凹面镜的反射成像原理，显示装置2投射到所述曲面半透明反射屏3上后，透过所述半透明反射屏在另一侧成放大拉远的虚像。
在一些实施例中，设置于主机一侧是指主机的末端。
在一些实施例中，设置于主机一侧是指与主机末端成型的一体化凸起结构。
在一些实施例中，相对于所述显示装置的位置是指与主机末端所相对应的另一端，优选地，与显示装置2所在的位置关系为平行。
基于上述区别技术特征，在本实施例中的有效效果至少包括：通过设置于主机一侧的所述显示装置2以及相对于所述显示装置的位置设置的曲面半透明反射屏3，采用简单的成像原理实现了对于车辆行驶过程中的图像信息的显示，克服了现有的投影成像的方式的不足，满足不同操作台的摆放和不同行车场景下的有效成像。由于，所述半透明反射屏还用以，将图像去重影后进行显示，有效解决了现有大多车载设备中普遍存在的缺陷。
在一些实施例中，所述显示装置2为柔性显示屏，用以通过调整所述柔性显示屏的形状，改变投射到所述曲面半透明反射屏上的图像，对显示装置中的图像畸变进行校正。使用了PHOLED磷光性OLED技术的柔性显示屏，具有低功耗，直接可视柔性面板，可有效克服distortion图像畸变。由于在显示装置2输出图像信息时，可能会存在图像畸变，通过将显示装置优选为 柔性显示屏进行校正，可以有效改变投射到所述曲面半透明反射屏上的图像，克服图像畸变。
具体地，图像畸变的原因是球面的半透明反射屏配合传统的平面显示屏，如图5(a)所示，以TFT为列，图像的各个像素与球面的表面距离不同，导致虚像光程不同，造成图像畸变。如图5(b)所示在本实施例中解决采用柔性显示屏，可以将柔性显示屏弯折，保证每个像素点到球面半透明反射屏的光程一致，从而解决图像畸变的问题。
如图6所示，在一些实施例中，所述显示装置为激光投影器，用以将所述图像通过激光光束进行透射；且在所述曲面半透明反射屏与激光投影器之间设置的MLA微透镜阵列，用以调制所述激光光束在曲面半透明反射屏的显示。通过MLA将显示装置中光源进行聚集。具体地，所述显示装置为激光投影器，用以将所述图像通过激光光束进行透射，用以调制所述激光光束经曲面半透明反射屏的漫反射效果，防止损伤人眼及减轻视疲劳，并合理控制光线的散射角度，保证亮度。
在一些实施例中，所述显示装置为TFT、LCD、OLED或者AMOLED显示器中的一种或者多种，在本实施例中提供了多种显示装置的替换形式。其中TFT(Thin Film Transistor)是指薄膜晶体管。TFT式显示屏一般用于各类笔记本电脑和台式机上的主流显示设备，利用TFT式显示器具有高响应度、高亮度、高对比度等优点，使得抬头显示装置在输出端进行最优化处理。
作为本实施例中的优选，所述主机1与显示装置2为一体化结构，主机与显示装置一体成型，利于出厂制造。
作为本实施例中的优选，所述曲面半透明反射屏3活动为可折叠机构，所述可折叠机构为阻尼转轴或者基于用户信息的电动记忆调节转轴。所述可折叠机构为阻尼转轴时，可通过自身重力使得曲面半透明反射屏3闭合。所述可折叠机构为基于用户信息的电动记忆调节转轴时，可通过进步电机操控可折叠机构的自动升降，同时可以基于用户信息进行不同驾驶者的记忆功能。比如，驾驶员A，习惯将曲面半透明反射屏3与显示装置2调整为相对于主机呈30°平行；而驾驶员B，由于身高的原因习惯将曲面半透明反射屏3与显示装置2调整为相对于主机呈45°平行，该些信息可以通过主机进行记忆，并根据摄像头识别的不同驾驶员，进行不同的调整。
在一些实施例中，对所述半透明反射屏进行如下处理后进行图像去重影：
半透明反射屏成型，半透明反射屏的凹面以及凸面双面表面硬化；表面硬化能提高Combiner半透明反射屏表面的硬度，增加产品的耐刮滑；同时增加后续镀膜的附着力；
对所述凹面，设置半透镜面膜；半透镜面膜起到反射图像的效果；对所述凸面，设置AR增透膜；增透膜起到增加凹面透光率的作用，避免重影发生，另外由于增透膜有不同的颜色，因此可优选用无色的增透膜；在所述凹面和/或凸面还增设有AF防指纹膜；防指纹膜起到减缓脏污的作用；
最后进行半透明反射屏的周圈CNC切割，周圈CNC切割主要是为了避免Combiner注塑后，边缘处不平导致的图像变形问题。
如图3所示是图1中的抬头显示装置的优选方式示意图(增加了底座)，图4是图3中的底座优选方式示意图。
在本实施例中的一种抬头显示装置，包括：主机1，用以将图像信号发送至显示装置；通过主机与车内的OBD接口或者车载充电器的USB接口连接，获得车辆的驾驶信息，并对应地在显示装置中进行显示。设置于主机一侧的所述显示装置2，用以将所述图像信号进行显示；设置在主机一侧的显示装置，能够对图像信号进行显示。相对于所述显示装置的位置设置的曲面半透明反射屏3，用以接收所述显示装置所显示的图像，并且将所述图像在所述半透明反射屏的曲面内侧进行显示；以及所述半透明反射屏还用以，将图像去重影后进行显示。作为本实施例中的优选，所述主机设置有底座4，用以放置在驾驶台上，防止主机在驾驶过程中滑动或者偏移位置。在底座4上安装有一旋转卡台5，所述旋转卡台用以卡合5在所述底座上的滑轨6上，以及通过所述主机的摆放角度调整在所述曲面半透明反射屏中的图像。通过设计旋转卡台5和滑轨6，能够方便主机的调节角度和方向。当所述主机通过所述旋转卡台5在所述滑轨6中滑动时，可以通过摆放的角度调整在所述曲面半透明反射屏中的图像。
在一些实施例中，通过两个固定的铆接使得所述旋转卡台5能够在所述滑轨6上进行滑动。
在一些实施例中，所述滑轨6可设置有多条轨道，保证滑动时候的稳定性。
在一些实施例中，所述滑轨6为凸球面设计结构，在节约空间的同时，起到有效的缓冲作用。
在一些实施例中，旋转卡台5与主机1底部的凹槽相互配合，相互契合。
在一些实施例中，底座4支持在旋转卡台5上进行左右旋转。图7是本发 明中的一种抬头显示装置的结构示意图。
在本实施例中的一种抬头显示装置，包括：主机1，用以将图像信号发送至显示装置；设置于主机1一侧的所述显示装置2，用以将所述图像信号进行显示；相对于所述显示装置2的位置设置的曲面半透明反射屏3，用以接收所述显示装置2所显示的图像，并且将所述图像在所述半透明反射屏3的曲面内侧进行显示；安装于所述主机中的驾驶员检测装置12，用以根据人脸信息判断驾驶员的脸部状态信息；所述状态信息至少包括，分心、疲劳以及路怒的情绪状态信息；以及根据所述脸部状态信息、实时环境信息以及实时车辆行驶速度，进行驾驶员疲劳监测和预警。
所述安装于主机中的驾驶员检测装置，可以通过主机中的前置/后置摄像头，对驾驶员和车辆的行驶环境进行监测，并通过前置摄像头捕捉到驾驶员的脸部状态信息，对驾驶员的情绪进行分析中强化了对分心、疲劳以及路怒的三种情绪的分析和预警处理，有效保证了行车安全。
分心驾驶，根据国际标准化组织(ISO)的定义，分心驾驶是指驾驶时注意力指向与正常驾驶不相关的活动，从而导致驾驶操作能力下降的一种现象。分心驾驶通常是因驾驶人视线偏离或分心产生的注意力不集中是引发交通事故的常见且重要的原因，这一诱因在追尾碰撞事故中表现得尤为显著。若摄像头检测到驾驶员视线偏离或者注意力不集中，并在主机中确认该些信息的置信程度。
在本实施例中，所述分心驾驶定是指，车内的驾驶员视线不在正前方超过设定的时间，包括但不限于的行为：可能是在玩手机，操作中控，扭头说话。
在一些实施例中，通过图像分析驾驶员面部的三维朝向，可以判断驾驶员视线是否在正前方。与现有技术相比，本实施例的有益效果在于，针对分心驾驶这一大影响行车安全的隐患，采用面部三维朝向，判断出驾驶员的视线是否位于正前方，用以检测驾驶员是否分心。
疲劳驾驶，是指驾驶人在长时间连续行车后，产生生理机能和心理机能的失调，而在客观上出现驾驶技能下降的现象。考虑到疲劳驾驶的诱因，比如，车内环境：空气质量差，通风不良；温度过高或过低；噪声和振动严重；座椅调整不当；与同车人关系紧张等。车外环境：在午后、傍晚、凌晨、深夜时段行车；路面状况差；道路条件好，情况单一；风沙、雨、雾、雪天气行车等。运行条件：长时间、长距离行车；车速过快或过慢；过于限制到达目的地的时间。
引起路怒驾驶的原因，包括但不限于：滥用远光灯；插队、加塞；后车高频率按喇叭；电瓶车机动车道挡道不走；
在一些实施例中，通过摄像头检测到愤怒的情绪。比如，路怒驾驶检测特征还包括：频繁的急加速/急减速。
若摄像头检测到驾驶员的状态属于疲劳驾驶，则根据判断条件对驾驶员疲劳进行监测和预警。
作为本实施例中的优选，疲劳驾驶检测特征包括但不限于：眼睛开合度。眼睛睁开度小于某个设定值的比例超过设定阈值。和/或，连续眼睛闭合超过设定阈值。
在一些实施例中，脸部状态信息包括但不限于，定位人脸区域内的多个关键点，主要包括五官和人脸轮廓的点。
在一些实施例中，实时环境信息包括但不限于，实时互联网路况信息、实时天气、实时车内外温度、车内外亮度等。
在一些实施例中，实时车辆行驶速度包括但不限于，车辆的相对速度。
在一些实施例中，安装于所述主机中的驾驶员检测装置12还用以进行头部姿态估计，具体地，利用人脸关键点的位置信息和离线学习的平均人脸的3维坐标位置，利用这些3D-2D点对和相机标定领域成熟的Perspective-n-Point方法估计头部的3维姿态信息。
在一些实施例中，所述监测方式包括但不限于，车道线监测、行车距离监测、行人距离监测、马路道沿监测、车辆灭点监测、车辆位置监测。
在一些实施例中，所述预警方式包括但不限于，机器声音预警、传感器振动预警、与手机连接后手机振动预警。预警方式是可以动态调整的，比如可以根据速度，速度超过设定值才提醒。
在一些实施例中，设定的预警方式为：向预先设定的联系人发送一条信息，告知当前驾驶员的状态。在一些实施例中，所述预警方式包括但不限于，语音机器聊天缓解疲劳的预警方式。所述语音机器聊天可以采用播放舒缓音乐的方式、可以采用话题聊天的方式引导驾驶员进行聊天、可以采用讲笑话的方式缓解疲劳等方式。
在一些实施例中，所述预警方式包括但不限于：图像提示，声音提醒，灯光提醒，采用气味刺激驾驶员。基于上述技术特征，本实施例中的抬头显示装置至少包括如下的技术效果：根据所述脸部状态信息、实时环境信息以及实时车辆行驶速度，本实施例中抬头显示装置的驾驶员检测装置12，可以对驾驶员的分心、疲劳以及路怒的情绪状态进行分析、监测并通过主机实 现有效的预警。相比于现有技术，本实施例中的抬头显示装置，对驾驶员的情绪进行分析中强化了对分心、疲劳以及路怒的三种情绪的分析和预警处理，有效保证了行车安全。
作为本实施例中的优选，所述驾驶员检测装置包括，摄像头13和夜视补偿光单元14；
所述摄像头13，用以采用驾驶员的人脸整体状态信息、头部三维姿态信息、眼睛和嘴巴的张开/闭合的信息；
作为本实施例中的优选，所述夜视补光单元14，用以在车内/车外光照强度低于阈值时，进行光补偿。夜视补偿光单元的设计，充分考虑到了夜晚行车时，车内/车外光线不足的问题。
作为本实施例中的优选，所述摄像头13采集到的人脸整体状态信息包括但不限于，通过CNN的方法对人脸区域进行分类，总体判断目前驾驶员的脸部状态。
作为本实施例中的优选，所述摄像头13采集到的头部三维姿态信息包括但不限于，利用人脸关键点的位置信息和离线学习的平均人脸的3维坐标位置，利用这些3D-2D点对和相机标定领域成熟的Perspective-n-Point方法估计头部的3维姿态信息。
作为本实施例中的优选，所述摄像头13采集到的人眼和嘴巴状态分类包括但不限于，人脸关键点定位的输出，其结果中包含了两只眼睛和嘴巴的轮廓信息，通过这些轮廓信息可以精确的识别两只眼睛和嘴巴的张开/闭合状态。
在一些实施例中，所述驾驶员检测装置还用以，采集驾驶员的状态数据、 与行车记录仪采集的数据同步、驾驶员的历史使用数据、当前驾驶相关的联网信息；以及根据驾驶员检测装置中的数据，在云端计算建立预警模型，对数据和事故建立关联，预测发生危险置信度，并提前预警。
在一些实施例中，所述主机与车内CAN总线或者OBD连接，用以读取车辆的行驶数据。
在一些实施例中，在云端计算建立预警模型时，通过建立学习模型，并采用SVM等分类器对数据和事故建立关联。
如图8是图7中的抬头显示装置另一优选实施例中的示意图。
作为本实施例中的优选，所述主机1还包括，方向传感器16、加速度传感器15、GPS19、温度传感器18以及地磁传感器17，所述温度传感器18用以感应车内的温度并进行散热，所述地磁传感器17用以检测方向，所述方向传感器16用以判断车辆前进或倒退的方向以及测试汽车行驶距离，所述加速度传感器15用以车辆的制动、启动检测，所述GPS19用以定位车辆位置以及地图接入，提供车规级GPS天线，精准导航定位。对应地，在主机上设置有，ARM 4核CPU处理器，1G RAM内存，预置基于车载场景深度定制的安卓系统，同时可以定期与云端进行同步进行更新。
如图9所示是本发明中的另一种抬头显示装置的结构示意图。
在本实施例中的一种抬头显示装置，包括：主机1，用以将图像信号发送至显示装置，以及声音采集和输入处理；设置于主机一侧的所述显示装置2，用以将所述图像信号进行显示；相对于所述显示装置的位置设置的曲面半透明反射屏3，用以接收所述显示装置所显示的图像，并且将所述图像在所述半透明反射屏的曲面内侧进行显示；预置于所述主机中的语音交互单元 20，用以根据用户语音输入的信息，在数据库中进行查询，若有多条符合的查询结果，则提醒驾驶员进行选择。
作为本实施例中的优选，所述语音交互单元还用以接收外部的激活，以实现激活功能包括：可以自定义的语音唤醒激活，语音唤醒激活的短语，物理按钮激活，手势动作激活。作为本实施例中的优选，所述语音交互单元还用以接收用户一次所有信息输入，一次完成输入。所述所有信息输入包括但不限于：语音激活，进入导航功能，设定目的地，设定路径规划策略。与现有技术相比，本实施例中的语音交互单元能够一次性处理用户的需求，包括了激活、查询、导航、寻路，实现多种指令的一次性分析得出结果。比如“萝卜，我要导航去清华大学南门，给我找一条最快的路线”
作为本实施例中的优选，所述语音交互单元还用以，对用户的同样意思的不同表述方式的自然语音信息，根据语义进行解析，并执行对应的查询：根据输入查询结果进行查询，若精准查询到唯一位置，则使用此结果；若搜索出来多个可能的查询结果，则需要再次询问，并根据多次自然语音输入进一步确认，若精准查询到唯一结果，则使用该查询结果，否则继续询问或者提醒重说。
作为本实施例中的优选，所述语音交互单元还用以：在所述主机输出声音的同时，采集驾驶员的语音输入；
通过VAD检测，检测到驾驶员的语音输入；
并且，在检测得到驾驶员的语音输入的同时，终止主机中的语音播放。
传统的语音交互时人和机器依次说话，在机器说话的时候人不能打断机器，需要等待机器说完话。本实施例中的打断方法，在机器说话的时候，人 可以打断(bargin)，机器听到人开始说话之后，就停止机器合成音输出，处理人的语音输入。
作为本实施例中的优选，所述语音交互单元还包括回声消除装置，所述回声消除装置包括第一路输入和第二路输入；
所述第一路输入，用以采集外部声音输入；
所述第二路输入，用以将主机的扬声器的输出与麦克风的输入连接；
对上述第一路输入、第二路输入的时间点进行同步，并优选AEC算法分别消除回声。
作为本实施例中的优选，装置还包括多通道声音输出单元，用以将不同类型的操作声音输出到不同的音响设备，使得驾驶员同时听到不同操作的声音输出结果。
作为本实施例中的优选，装置还包括扬声器，用以向外输出语音信息。
基于上述特征，本实施例中的抬头显示装置至少包括如下技术效果：通过主机内置的语音交互单元和主机外侧的麦克风，可以实现多种方式的语音操作，比如多轮语音交互查询、目的地位置的聚类、回声消除、双通道声音输出、语音智能打断等。采用主机中的语音交互单元，还可以让驾驶者通过语音进行导航、拨打电话、发微信、发出位置定位等。相比于现有技术中无法进行语音交互、语音功能操作的车载抬头显示装置而言，具有显著进步。
图10是本发明中的一种优选抬头显示装置的结构示意图。
本实施例中的一种抬头显示装置，包括：
主机1，用以将图像信号发送至显示装置；设置于主机一侧的显示装置2，用以将所述图像信号进行显示；相对于所述显示装置的位置设置的曲面 半透明反射屏3，用以接收所述显示装置所显示的图像，并且将所述图像在所述半透明反射屏的曲面内侧进行显示；以及所述半透明反射屏还用以，将图像去重影后进行显示；预置于所述主机中的语音交互单元20，用以根据用户语音输入的信息，在数据库中进行查询，若有多条符合的查询结果，则提醒驾驶员进行选择；以及，安装于所述主机中的驾驶员检测装置12，用以根据人脸信息判断驾驶员的脸部状态信息，根据所述脸部状态信息和实时车辆行驶速度，进行驾驶员疲劳监测和预警。
在一些实施例中，所述显示装置2为柔性显示屏，用以通过调整所述柔性显示屏的形状，改变投射到所述曲面半透明反射屏上的图像，对显示装置中的图像畸变进行校正。
在一些实施例中，所述显示装置为激光投影器，用以将所述图像通过激光光束进行透射；且在所述曲面半透明反射屏与激光投影器之间设置的MLA微透镜阵列，用以调制所述激光光束在曲面半透明反射屏的显示。
在一些实施例中，所述显示装置和反射屏幕都可采用电动转动调整角度。具体地，可以调节显示装置和反射屏幕之间的相对距离。从而能够调整驾驶员看到的虚像的距离，增加显示装置和反射屏幕之间的距离，相比于现有技术，能够让用户看到的图像在更远处。在一些实施例中，安装于车内后视镜位置的摄像头，通过有线连接将视频数据传输给所述主机，并在所述主机上进行视频显示。主机中的处理芯片可以使用图像处理算法分析视频，实现车道偏离检测，前车碰撞预警，行人检测等。
在一些实施例中，所述显示装置为TFT、LCD、OLED或者AMOLED显示器中的一种或者多种，在本实施例中提供了多种显示装置的替换形式。 其中TFT(Thin Film Transistor)是指薄膜晶体管。
作为本实施例中的优选，所述主机设置有底座4，用以放置在驾驶台上，防止主机在驾驶过程中滑动或者偏移位置。在底座4上安装有一旋转卡台5，所述旋转卡台用以卡合5在所述底座上的滑轨6上，以及通过所述主机的摆放角度调整在所述曲面半透明反射屏中的图像。
在一些实施例中，安装于所述主机中的驾驶员检测装置12还用以进行头部姿态估计，具体地，利用人脸关键点的位置信息和离线学习的平均人脸的3维坐标位置，利用这些3D-2D点对和相机标定领域成熟的Perspective-n-Point方法估计头部的3维姿态信息。
在一些实施例中，所述监测方式包括但不限于，车道线监测、行车距离监测、行人距离监测、马路道沿监测、车辆灭点监测、车辆位置监测。
在一些实施例中，所述预警方式包括但不限于，机器声音预警、传感器振动预警、与手机连接后手机振动预警。
在一些实施例中，所述预警方式包括但不限于，语音机器聊天缓解疲劳的预警方式。所述语音机器聊天可以采用播放舒缓音乐的方式、可以采用话题聊天的方式引导驾驶员进行聊天、可以采用讲笑话的方式缓解疲劳等方式。
作为本实施例中的优选，所述驾驶员检测装置包括，摄像头13和夜视补偿光单元14；
所述摄像头13，用以采用驾驶员的人脸整体状态信息、头部三维姿态信息、眼睛和嘴巴的张开/闭合的信息；
作为本实施例中的优选，所述夜视补光单元14，用以在车内/车外光照 强度低于阈值时，进行光补偿。夜视补偿光单元的设计，充分考虑到了夜晚行车时，车内/车外光线不足的问题。
基于上述特征，本实施例中的抬头显示装置至少包括如下技术效果：通过采用简单的成像原理实现了对于车辆行驶过程中的图像信息的显示，克服了现有的投影成像的方式的不足，满足不同操作台的摆放和不同行车场景下的有效成像。通过安装于主机中的驾驶员检测装置，可以通过主机中的前置/后置摄像头，对驾驶员和车辆的行驶环境进行监测，并通过前置摄像头捕捉到驾驶员的脸部状态信息，对驾驶员的情绪进行分析中强化了对分心、疲劳以及路怒的三种情绪的分析和预警处理，有效保证了行车安全，具有突出的实质性特征；通过主机内置的语音交互单元和主机外侧的麦克风，可以实现多种方式的语音操作，比如多轮语音交互查询、目的地位置的聚类、回声消除、双通道声音输出、语音智能打断等。采用主机中的语音交互单元，还可以让驾驶者通过语音进行导航、拨打电话、发微信、发出位置定位等。相比于现有技术中无法进行语音交互、语音功能操作的车载抬头显示装置而言，具有显著进步。
图11是图10中的进一步优化外接装置的示意图。
作为本实施例中的优选，抬头显示装置还包括遥控装置，所述遥控装置用以在设定范围内唤醒、启动以及关系所述主机，以及，调节所述显示装置与所述曲面半透明反射屏的成像角度。作为本实施例中的优选，抬头显示装置的外接设备可以是智能移动终端40，所述抬头显示装置的与外接设备的连接方式包括但不限于：wi-fi、蓝牙、NFC等。所述抬头显示装置接入网络的方式包括但不限于，无线AP、GPRS、3G/4G等。
图12是图10中的分体式安装结构示意图。
作为本实施例中的优选，本实施例中一种抬头显示装置还可以进行分体式构造，具体包括如下结构：
主机1，用以将图像信号发送至显示装置；
设置于主机一侧的显示装置2，用以将所述图像信号进行显示；
相对于所述显示装置的位置设置的曲面半透明反射屏3，用以接收所述显示装置所显示的图像，并且在主机一侧透过所述半透明反射屏在另一侧显示图像；以及所述半透明反射屏还用以，将图像去重影后进行显示；
预置于所述主机中的语音交互单元，用以根据用户语音输入的信息，在数据库中进行查询，若有多条符合的查询结果，则提醒驾驶员进行选择；
以及，安装于所述主机中的驾驶员检测装置，用以根据人脸信息判断驾驶员的脸部状态信息，根据所述脸部状态信息和实时车辆行驶速度，进行驾驶员疲劳监测和预警；
作为本实施例中的优选，所述显示装置2、主机1设置于后视镜，所述曲面半透明反射屏3设置于仪表台，经过一次反射后显示图像。主机中集成了语音交互单元和驾驶员检测装置。
作为本实施例中的优选，所述显示装置2通过无线或者有线连接的方式，从外部设备中获取需要显示的图像。所述外部设备包括但不限于：手机或者其它可无限接入的智能终端。
图13是本发明中的分体式抬头显示装置的结构示意图。图14是图13另一种优选方式的分体式抬头显示装置的结构示意图。
在本实施例中的一种分体式抬头显示装置，包括：
主机1，用以将图像信号发送至显示装置；
设置于主机一侧的显示装置2，用以将所述图像信号进行显示；
全反射屏，用以将显示装置的显示图像进行一次反射，并通过风挡二次反射形成虚像；用户可以通过风挡看到二次反射的虚像；
位于所述全反射屏一侧的遮光板，用以挡住反射光线；这样阳光发射被遮挡，从而反射不到人眼睛中；
所述显示装置、主机设置于后视镜，所述全反射屏设置于仪表台，经过两次发射后透过前挡风玻璃显示图像；
预置于所述主机中的语音交互单元，用以根据用户语音输入的信息，在数据库中进行查询，若有多条符合的查询结果，则提醒驾驶员进行选择；
以及，安装于所述主机中的驾驶员检测装置，用以根据人脸信息判断驾驶员的脸部状态信息，根据所述脸部状态信息和实时车辆行驶速度，进行驾驶员疲劳监测和预警。
作为本实施例中的优选，所述显示装置2通过无线或者有线连接的方式，从外部设备中获取需要显示的图像。所述外部设备包括但不限于：手机或者其它可无限接入的智能终端。

Claims (16)

  1. 一种抬头显示装置，其特征在于包括：
    主机，用以将图像信号发送至显示装置；
    设置于主机一侧的所述显示装置，用以将所述图像信号进行显示；
    相对于所述显示装置的位置设置的曲面半透明反射屏，用以接收所述显示装置所显示的图像，并且在主机一侧透过所述半透明反射屏在另一侧显示图像；
    以及所述半透明反射屏还用以，将图像去重影后进行显示。
  2. 根据权利要求1所述的抬头显示装置，其特征在于，所述显示装置为柔性显示屏，用以通过调整所述柔性显示屏的形状，改变投射到所述曲面半透明反射屏上的图像，对显示装置中的图像畸变进行校正。
  3. 根据权利要求1所述的抬头显示装置，其特征在于，对所述半透明反射屏进行如下处理后进行图像去重影：
    半透明反射屏成型，半透明反射屏的凹面以及凸面双面表面硬化；
    对所述凹面，设置半透镜面膜；
    对所述凸面，设置AR增透膜；
    在所述凹面和/或凸面还增设有AF防指纹膜；
    最后进行半透明反射屏的周圈CNC切割。
  4. 根据权利要求1-3任一项所述的抬头显示装置，其特征在于，所述主机设置有底座，在底座上安装有一旋转卡台，所述旋转卡台用以卡合在所述底座上的滑轨上，以及通过所述主机的摆放角度调整在所述曲面半透明反射屏中的图像位置。
  5. 一种抬头显示装置，其特征在于包括：
    主机，用以将图像信号发送至显示装置；
    设置于主机一侧的所述显示装置，用以将所述图像信号进行显示；
    相对于所述显示装置的位置设置的曲面半透明反射屏，用以接收所述显示装置所显示的图像，并且在主机一侧透过所述半透明反射屏在另一侧显示 图像；
    安装于所述主机中的驾驶员检测装置，用以根据人脸信息判断驾驶员的脸部状态信息；所述状态信息至少包括，分心、疲劳以及路怒的情绪状态信息；
    以及根据所述脸部状态信息、实时环境信息以及实时车辆行驶速度，进行驾驶员疲劳监测和预警。
  6. 一种抬头显示装置，其特征在于包括：
    主机，用以将图像信号发送至显示装置，以及声音采集和输入处理；
    设置于主机一侧的所述显示装置，用以将所述图像信号进行显示；
    相对于所述显示装置的位置设置的曲面半透明反射屏，用以接收所述显示装置所显示的图像，并且在主机一侧透过所述半透明反射屏在另一侧显示图像；
    预置于所述主机中的语音交互单元，用以根据用户语音输入的信息，在数据库中进行查询，若有多条符合的查询结果，则提醒驾驶员进行选择，
    所述语音交互单元还用以，
    对用户的同样意思的不同表述方式的自然语音信息，根据语义进行解析，并执行对应的查询：
    根据输入查询结果进行查询，若精准查询到唯一位置，则使用此结果；
    若搜索出来多个可能的查询结果，则需要再次询问，并根据多次自然语音输入进一步确认，若精准查询到唯一结果，则使用该查询结果，否则继续询问或者提醒重说。
  7. 根据权利要求6所述的抬头显示装置，其特征在于，所述语音交互单元还用以：
    在所述主机输出声音的同时，采集驾驶员的语音输入；
    通过VAD检测，检测到驾驶员的语音输入；
    并且，在检测得到驾驶员的语音输入的同时，终止主机中的语音播放。
  8. 根据权利要求6所述的抬头显示装置，其特征在于，所述语音交互单元还包括回声消除装置，所述回声消除装置包括第一路输入和第二路输入；
    所述第一路输入，用以采集外部声音输入；
    所述第二路输入，用以将主机的扬声器的输出与麦克风的输入连接；
    对上述第一路输入、第二路输入的时间点进行同步，并根据AEC算法分别消除回声。
  9. 根据权利要求6所述的抬头显示装置，其特征在于，还包括多通道声音输出单元，
    用以将不同类型的操作声音输出到不同的音响设备，使得驾驶员同时听到不同操作的声音输出结果。
  10. 一种抬头显示装置，其特征在于包括：
    主机，用以将图像信号发送至显示装置；
    设置于主机一侧的显示装置，用以将所述图像信号进行显示；
    相对于所述显示装置的位置设置的曲面半透明反射屏，用以接收所述显示装置所显示的图像，并且在主机一侧透过所述半透明反射屏在另一侧显示图像；以及所述半透明反射屏还用以，将图像去重影后进行显示；
    预置于所述主机中的语音交互单元，用以根据用户语音输入的信息，在数据库中进行查询，若有多条符合的查询结果，则提醒驾驶员进行选择；
    以及，安装于所述主机中的驾驶员检测装置，用以根据人脸信息判断驾驶员的脸部状态信息，根据所述脸部状态信息和实时车辆行驶速度，进行驾驶员疲劳监测和预警。
  11. 根据权利要求10所述的抬头显示装置，其特征在于，还包括遥控装置，所述遥控装置用以在设定范围内唤醒、启动以及关系所述主机，
    以及，调节所述显示装置与所述曲面半透明反射屏的成像角度，所述显 示装置和曲面半透明反射屏均采用电动转动调整角度；通过调节所述显示装置和所述曲面半透明反射屏之间的相对距离，调整驾驶员看到虚像的距离。
  12. 根据权利要求10所述的抬头显示装置，其特征在于，所述驾驶员检测装置中的预警包括：图像信息提示，声音提醒，与驾驶员聊天，灯光提醒，采用气味刺激驾驶员的一种或者多种方式，
    所述驾驶员检测装置中的预警的方式根据速度进行动态调整，
    预警方式为：向预先设定的联系人发送一条信息，告知当前驾驶员的状态。
  13. 根据权利要求10所述的抬头显示装置，其特征在于，所述语音交互单元还用以接收外部指令实现激活，所述激活方式包括：自定义语音唤醒，语音唤醒短语，物理按钮，手势动作；
    以及所述语音交互单元还用以一次接收用户所有信息输入，所述信息输入至少包括：语音激活、进入位置导航/结果查询、设定目的地/结果，设置路径规划。
  14. 根据权利要求10所述的抬头显示装置，其特征在于，所述显示装置、主机设置于后视镜，所述曲面半透明反射屏设置于仪表台，经过一次反射后显示图像。
  15. 根据权利要求10或14所述的抬头显示装置，其特征在于，所述显示装置通过无线或者有线连接的方式，从外部设备中获取需要显示的图像。
  16. 一种分体式抬头显示装置，其特征在于包括：
    主机，用以将图像信号发送至显示装置；
    设置于主机一侧的显示装置，用以将所述图像信号进行显示；
    全反射屏，用以将显示装置的显示图像进行一次反射，并通过风挡二次反射形成虚像；
    位于所述全反射屏一侧的遮光板，用以挡住反射光线；
    所述显示装置、主机设置于后视镜，所述全反射屏设置于仪表台，经过两次发射后透过前挡风玻璃显示图像；
    预置于所述主机中的语音交互单元，用以根据用户语音输入的信息，在数据库中进行查询，若有多条符合的查询结果，则提醒驾驶员进行选择；
    以及，安装于所述主机中的驾驶员检测装置，用以根据人脸信息判断驾驶员的脸部状态信息，根据所述脸部状态信息和实时车辆行驶速度，进行驾驶员疲劳监测和预警。
PCT/CN2016/104740 2016-08-23 2016-11-04 一种抬头显示装置 WO2018035974A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP16913994.6A EP3505989A4 (en) 2016-08-23 2016-11-04 HEAD-UP DISPLAY DEVICE
US16/327,595 US11079594B2 (en) 2016-08-23 2016-11-04 Head-up display device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610712737.5 2016-08-23
CN201610712737.5A CN106226905B (zh) 2016-08-23 2016-08-23 一种抬头显示装置

Publications (1)

Publication Number Publication Date
WO2018035974A1 true WO2018035974A1 (zh) 2018-03-01

Family

ID=57553849

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/104740 WO2018035974A1 (zh) 2016-08-23 2016-11-04 一种抬头显示装置

Country Status (4)

Country Link
US (1) US11079594B2 (zh)
EP (1) EP3505989A4 (zh)
CN (1) CN106226905B (zh)
WO (1) WO2018035974A1 (zh)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107310476A (zh) * 2017-06-09 2017-11-03 武汉理工大学 基于车载hud的眼动辅助语音交互方法及系统
US11315415B2 (en) * 2017-09-03 2022-04-26 Innovart Design Inc. Information sharing system and information sharing method for vehicle
CN107393435A (zh) * 2017-09-15 2017-11-24 北京威视安业科技有限公司 虚像显示系统及飞行模拟器
CN108171673B (zh) 2018-01-12 2024-01-23 京东方科技集团股份有限公司 图像处理方法、装置、车载抬头显示系统及车辆
CN108345112A (zh) * 2018-03-01 2018-07-31 苏州途驰安电子科技有限公司 一种车载抬头显示器
CN108417021B (zh) * 2018-03-07 2021-08-17 京东方科技集团股份有限公司 车用信息共享系统及方法
CN108621947B (zh) * 2018-05-04 2020-11-03 福建省汽车工业集团云度新能源汽车股份有限公司 一种自适应调节的车载抬头显示系统
CN108766427B (zh) * 2018-05-31 2020-10-16 北京小米移动软件有限公司 语音控制方法及装置
CN109889805A (zh) * 2019-02-19 2019-06-14 上海理工大学 一种具有眼球追踪功能的夜视抬头显示设备
KR102703277B1 (ko) * 2019-06-19 2024-09-04 현대자동차주식회사 수직방향 접이식 카메라 모니터링 시스템
CN110435665B (zh) * 2019-08-14 2024-07-02 东风汽车有限公司 一种驾驶员检测装置及汽车
CN112904996B (zh) * 2019-12-04 2023-05-12 上海交通大学 车载抬头显示设备画面补偿方法及装置、存储介质和终端
CN111524528B (zh) * 2020-05-28 2022-10-21 Oppo广东移动通信有限公司 防录音检测的语音唤醒方法及装置
CN111679431A (zh) * 2020-05-28 2020-09-18 广东好翼未来科技有限公司 一种基于汽车遮阳板的抬头显示系统
JP7534181B2 (ja) * 2020-10-13 2024-08-14 株式会社Subaru 車両の表示装置
CN112918394A (zh) * 2021-02-02 2021-06-08 梦幻世界科技(珠海)有限公司 一种新型汽车抬头显示hud装置
CN113038430A (zh) * 2021-03-17 2021-06-25 江西昌河汽车有限责任公司 一种车载语音通讯系统及其控制方法
CN113002461A (zh) * 2021-03-26 2021-06-22 芜湖汽车前瞻技术研究院有限公司 Ar-hud系统的虚像位置调整方法、装置及存储介质
CN114637115B (zh) * 2022-03-14 2022-12-09 深圳市深光粟科技有限公司 一种基于人工智能的混合现实医学诊疗装置及其方法
CN114446193B (zh) * 2022-03-23 2023-05-26 北京龙翼风科技有限公司 一种模拟器led型沉浸式显示装置
CN115689920B (zh) * 2022-10-26 2023-08-11 北京灵犀微光科技有限公司 Hud成像的辅助矫正方法、装置及矫正系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203305897U (zh) * 2013-05-04 2013-11-27 周鑫森 透视型彩色平视显示器
US20160025973A1 (en) * 2014-07-22 2016-01-28 Navdy, Inc. Compact Heads-Up Display System
CN105527710A (zh) * 2016-01-08 2016-04-27 北京乐驾科技有限公司 一种智能抬头显示系统
CN105842850A (zh) * 2016-03-22 2016-08-10 福耀集团（上海）汽车玻璃有限公司 带反射膜层的hud玻璃制品

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4780906A (en) * 1984-02-17 1988-10-25 Texas Instruments Incorporated Speaker-independent word recognition method and system based upon zero-crossing rate and energy measurement of analog speech signal
US5037182A (en) * 1990-09-12 1991-08-06 Delco Electronics Corporation Rearview mirror head-up display
JPH11326823A (ja) * 1998-05-18 1999-11-26 Sony Corp 虚像観察光学系
US7526103B2 (en) * 2004-04-15 2009-04-28 Donnelly Corporation Imaging system for vehicle
US20060036430A1 (en) * 2004-08-12 2006-02-16 Junling Hu System and method for domain-based natural language consultation
CN100462047C (zh) * 2007-03-21 2009-02-18 汤一平 基于全方位计算机视觉的安全驾驶辅助装置
US9560448B2 (en) * 2007-05-04 2017-01-31 Bose Corporation System and method for directionally radiating sound
EP2058800B1 (en) * 2007-10-24 2010-09-01 Harman Becker Automotive Systems GmbH Method and system for recognizing speech for searching a database
KR101179436B1 (ko) * 2009-09-18 2012-09-04 주식회사 토비스 곡면 형태의 디스플레이 패널 제조 방법
US9008302B2 (en) * 2010-10-08 2015-04-14 Optical Fusion, Inc. Audio acoustic echo cancellation for video conferencing
US8724225B2 (en) * 2011-01-26 2014-05-13 Korea Institute Of Construction Technology Optical system for use in a vehicle head-up display
DE102011101912B3 (de) * 2011-05-13 2012-06-21 Bury Sp.Z.O.O Haltevorrichtung zum Befestigen eines elektronischen Gerätes in einem Innenraum eines Kraftfahrzeuges
WO2014121261A1 (en) * 2013-02-04 2014-08-07 Newport Corporation Method and apparatus for laser cutting transparent and semitransparent substrates
CN203544376U (zh) * 2013-06-24 2014-04-16 惠州市华阳多媒体电子有限公司 一种分离式抬头显示器
WO2015186488A1 (ja) * 2014-06-03 2015-12-10 矢崎総業株式会社 車両用投影表示装置
CN204037446U (zh) * 2014-07-25 2014-12-24 大连引航光电信息技术有限公司 一种平视显示装置
CN104216119A (zh) * 2014-08-20 2014-12-17 财团法人车辆研究测试中心 抬头显示装置
US11223381B2 (en) * 2015-02-12 2022-01-11 Seeing Machines Limited Phone docking station mounted on a vehicle for enhanced driving safety
CN205263405U (zh) * 2015-06-29 2016-05-25 深圳前海智云谷科技有限公司 Hud成像屏及车载hud智能终端
CN104950447A (zh) * 2015-07-13 2015-09-30 京东方科技集团股份有限公司 一种平视显示装置和交通工具
CN204989625U (zh) * 2015-07-17 2016-01-20 樊强 一种具有放大图像功能的抬头显示器
CN105654753A (zh) * 2016-01-08 2016-06-08 北京乐驾科技有限公司 一种智能车载安全驾驶辅助方法及系统
CN105740767A (zh) * 2016-01-22 2016-07-06 江苏大学 一种基于脸部特征的驾驶员路怒症实时识别和预警方法
US20170236330A1 (en) * 2016-02-15 2017-08-17 Julie Maria Seif Novel dual hmd and vr device with novel control methods and software

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203305897U (zh) * 2013-05-04 2013-11-27 周鑫森 透视型彩色平视显示器
US20160025973A1 (en) * 2014-07-22 2016-01-28 Navdy, Inc. Compact Heads-Up Display System
CN105527710A (zh) * 2016-01-08 2016-04-27 北京乐驾科技有限公司 一种智能抬头显示系统
CN105842850A (zh) * 2016-03-22 2016-08-10 福耀集团（上海）汽车玻璃有限公司 带反射膜层的hud玻璃制品

Also Published As

Publication number Publication date
EP3505989A4 (en) 2020-07-29
CN106226905A (zh) 2016-12-14
CN106226905B (zh) 2019-08-23
US20190227310A1 (en) 2019-07-25
US11079594B2 (en) 2021-08-03
EP3505989A1 (en) 2019-07-03

Similar Documents

Publication Publication Date Title
WO2018035974A1 (zh) 一种抬头显示装置
CN105527710B (zh) 一种智能抬头显示系统
US20160196098A1 (en) Method and system for controlling a human-machine interface having at least two displays
WO2018192259A1 (zh) 一种分体式安装的抬头显示装置及其实现方法
US9255813B2 (en) User controlled real object disappearance in a mixed reality display
CN205720871U (zh) 一种智能抬头显示系统
US20130050258A1 (en) Portals: Registered Objects As Virtualized, Personalized Displays
CN106043150A (zh) 一种带语音识别功能的车载投影系统
CN110471532B (zh) 整合眼球追踪与手势操控之车载装置
CN104875680A (zh) 一种结合语音和视频识别的hud显示装置
CN209381917U (zh) 一种抬头显示器及汽车
CN205871923U (zh) 一种带语音识别功能的车载投影系统
CN109087485A (zh) 驾驶提醒方法、装置、智能眼镜及存储介质
CN109507799A (zh) 车载hud显示方法和系统
JP6620977B2 (ja) 表示制御装置、投影装置、および表示制御プログラム
CN105759426A (zh) 智能汽车抬头显示装置
CN115185080A (zh) 一种车用可穿戴ar抬头显示系统
CN204821323U (zh) 车载电子设备
CN207601426U (zh) 一种双屏抬头显示装置
JP6287422B2 (ja) ヘッドアップディスプレイ装置
KR101859043B1 (ko) 이동단말기, 차량과 이동 단말기의 연동 시스템
KR20160075203A (ko) 이동 단말기 및 이의 제어 방법
CN205750122U (zh) 智能汽车抬头显示装置
WO2022116688A1 (zh) 一种图像投射方法和系统
CN209063897U (zh) 崁入式抬头显示设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16913994

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2016913994

Country of ref document: EP

Effective date: 20190325