CN104875680A - HUD (head up display) device combining voice and video recognition - Google Patents

HUD (head up display) device combining voice and video recognition Download PDF

Info

Publication number
CN104875680A
CN104875680A CN201510297407.XA CN201510297407A CN104875680A CN 104875680 A CN104875680 A CN 104875680A CN 201510297407 A CN201510297407 A CN 201510297407A CN 104875680 A CN104875680 A CN 104875680A
Authority
CN
China
Prior art keywords
module
voice
hud
chaufeur
read out
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510297407.XA
Other languages
Chinese (zh)
Other versions
CN104875680B (en
Inventor
何杰
莫冰
韩宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Halation Network Technology Co Ltd Of Shenzhen
Original Assignee
Halation Network Technology Co Ltd Of Shenzhen
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Halation Network Technology Co Ltd Of Shenzhen filed Critical Halation Network Technology Co Ltd Of Shenzhen
Priority to CN201510297407.XA priority Critical patent/CN104875680B/en
Publication of CN104875680A publication Critical patent/CN104875680A/en
Application granted granted Critical
Publication of CN104875680B publication Critical patent/CN104875680B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used

Abstract

The invention provides an HUD (head up display) device combining voice and video recognition. The HUD device combining voice and video recognition comprises an HUD module, a camera-shooting module, a voice module and a circuit module. The circuit module integrates a GPU (graphics processing unit), an ARM (advanced RISC machine) processor, an acceleration sensor, a GPS (global positioning system) sensor, WIFI (wireless fidelity) and a Bluetooth module, wherein the GPU acquires image signals transmitted by the camera-shooting module to match the image signals with preset image signals, or the ARM processor acquires voice signals transmitted by the voice module to match the voice signals with preset voice signals so as to obtain a matched action command; the ARM processor receives the action command, executes relative in-vehicle actions automatically and outputs the actions to the HUD module to display finally. The HUD device combining voice and video recognition has the advantages that HUD display content is enriched greatly by the aid of voice and data such as acceleration sensor data; a driver can always concentrate on the roadways by watching the HUD display content and can obtain vehicle and peripheral information safely and timely, and accordingly, man-machine interaction, rapidity and convenience are achieved.

Description

A kind of HUD read out instrument in conjunction with voice and video identification
Technical field
The invention belongs to vehicle-mounted HUD technique of display field, particularly relate to a kind of HUD read out instrument in conjunction with voice and video identification.
Background technology
HUD (Heads Up Display) new line numerical monitor, be head-up display system again, it can important information, as rotating speed, navigation, time, the small screen utilizing the principle of optical specular reflection to project automotive windshield or to erect allows people feel, and image is in the distance in several meters, headstock front, chaufeur need not be bowed, just can see important information clearly.Also have and add lens on the basis of original Windshield imaging, the content of display is amplified to farther place, chaufeur can not regulate the focal length of sight line in the process of moving, parallelly while seeing surface conditions clearly forward sees the vehicle condition information that HUD shows.
Existing HUD display system only cannot can show limited content in conjunction with actual environment, and the content that chaufeur can not show with HUD is in the process of moving carried out effectively mutual and controlled.Respond HUD displaying contents as needed chaufeur and sight line must leave front, manually contact associative operation interface, makes chaufeur apply this system and is subject to limitation, is difficult to ensure driving safety.
Summary of the invention
In order to overcome the problem of the deficiencies in the prior art, HUD display system only cannot can show limited content in conjunction with actual environment, the content that chaufeur can not show with HUD is in the process of moving carried out effectively mutual and is controlled, respond HUD displaying contents as needed chaufeur and sight line must leave front, manual contact associative operation interface, make chaufeur apply this system and be subject to limitation, be difficult to ensure driving safety, the invention provides a kind of HUD read out instrument in conjunction with voice and video, in order to solve technical matters of the prior art.
The technical scheme that the present invention provides for achieving the above object is: a kind of HUD read out instrument in conjunction with voice and video identification, having the HUD module for being projected by information of vehicles on vehicle front windshield, also comprising:
Photographing module, for taking the image of vehicle and driver status, and is converted into picture signal by image;
Voice for recording the voice of chaufeur input, and are converted into voice signal by voice module;
Circuit module, the integrated GPU of described circuit module, arm processor, acceleration pick-up, GPS sensor, wireless WIFI and bluetooth module, the picture signal that wherein GPU acquisition photographing module transmits is mated with prearranged image signal, the voice signal that arm processor identification microphone gathers the transmission of sample sound acquisition voice module mates with default voice signal, obtains the action command matched; The gesture that chaufeur is taked by arm processor, the action of eyes, or the voice of typing carry out identification and obtain action command and automatically perform this action, the relevant data of mobile phone are obtained by WIF or bluetooth, other sensor states of combined circuit module, as GPS sensor, acceleration pick-up, forms the interface of final display, is projected in HUD module be shown to chaufeur by projection module.
Further, chaufeur carries out interaction by this HUD read out instrument and automobile, takes gesture motion to be one of identifiable design action of this HUD read out instrument internal preset, analyzes for circuit module to gesture motion; The voice gathered are the voice signals comprising voice activation word, and sound identification module carries out Eigenvalues analysis to voice.This HUD read out instrument finally obtains the action command matched in conjunction with the result of gesture and voice.
Further, described photographing module is by CSI interface, or MIPI video interface, or bnc interface, or USB interface, or wireless module and circuit module are electrically connected, and this photographing module comprises: colour imagery shot and infrared camera.Colour imagery shot is arranged on Windshield dead ahead, for taking the ambient condition of vehicle periphery; Infrared camera takes the profile of chaufeur gesture and the eyes frequency of wink for analyzing tired driver state in the face of chaufeur is arranged.
Further, colour imagery shot shooting surrounding environment state include but not limited to, front truck crossroads traffic light situation, leading vehicle distance, pedestrian's situation, the every data arm processor collected according to the set and display of different scene at HUD display module.
Further, all sides of described infrared camera have LED infrared light supply, LED infrared light supply initiatively sends infrared ray, utilize CCD or CMOS in infrared eye can experience the spectral characteristics of the infrared light that surrounding scenes and Ambient are returned, coordinate infrared lamp to realize night vision monitoring as " light source ".Infrared camera gathers the contour image of gesture and the motion image of eyes is RAW optical signalling, and RAW optical signalling is converted to after digital signal through A/D converter, and GPU digital signal being sent to circuit module carries out Modulation recognition and instruction identification.One infrared perspective layer is also set below LED infrared light supply, for intercepting visible ray and eliminating visible ray to the interference of video identification.This infrared absorption filter photosphere can be made up of saturating infrared polycarbonate, also can be made up of saturating infrared acrylic, also can be made up of the saturating infrared fileter of plastics.
Further, the digital signal that GPU acquisition photographing module transmits carries out Modulation recognition and instruction identification comprises: the gesture or the eye image that extract infrared shooting carry out background separation, for eliminating the impact of background on graphics filter; Image after background separation and pre-set image are contrasted and classifies; Sorted picture is carried out instruction identification according to the path of motion of gesture or eyes, determines the action command that path of motion represents.
Further, HUD module comprises optics display structure, projection module, wherein optics display structure comprises and just throws imaging film and optical lens, and projection module is the LCD screen based on the micro-throwing module with DLP technology or the micro-throwing module based on laser projection or high brightness; Imaging is projected the just throwing imaging film of relative projection module by projection module, this is just throwing imaging film is exactly use chip typography in the convex configuration more than more than 10 ten thousand of printed thereon close to Nano grade on the surface of film, being coated with nano level light sensitive layer by vacuum magnetron sputtering coating film technique again, ensureing have good diffuse effect to possess again high optical gain to projecting to imaging film.Just throwing imaging film again by imaging line reflection on the optical lens aligning the HUD module of throwing imaging film mutually, through this optical lens, chaufeur can see before windshield that projection module sends the final imaging of light.
Further, described optical lens two sides has identical curvature, thickness is consistent, and the reflectivity of intrados plated film is higher than the reflectivity of extrados plated film, as: the reflectivity of intrados is 30%, the reflectivity 1% of extrados, ensures that chaufeur is looked out for the car the outer normal images having 70% light transmittance, and the picture that just saturating imaging film becomes can have the light reflection of 30% to driver's eyes on intrados, possesses the effect zooming into the virtual image.
Further, HUD module be suspended on position of driver sun shield below or console dead ahead.
Further, automobile or terminal can by the displaying contents of controlled in wireless HUD.User carries out communication by car networking with the HUD module of automobile by the button on automobile or terminal, can adjust the content shown by HUD.
The invention has the beneficial effects as follows: the technique of display comparing current vehicle-mounted HUD, the present invention has the following advantages:
1, the content of HUD display by the data extreme enrichment of voice and acceleration pick-up etc.
2, chaufeur is watched by HUD the content sight line represented and is not left road surface, can obtain vehicle and peripheral information in time safely, human-computer interaction, convenient rapidly.
3, chaufeur by and vehicle-mounted HUD system carry out information interaction, networking share traffic information, improve traffic running efficiency.
Accompanying drawing explanation
Fig. 1 is the module structure drafting of a kind of HUD read out instrument in conjunction with voice and video identification provided by the invention;
The mounting means figure of a kind of HUD read out instrument in conjunction with voice and video identification that Fig. 2 provides for the embodiment of the present invention one;
A kind of hardware structure diagram of HUD read out instrument in conjunction with voice and video identification of Fig. 3 for providing for the embodiment of the present invention one;
Identifier declaration in figure: 1, HUD module, 2, photographing module, 3, voice module, 4, circuit module, 5, shield glass, 6, colour imagery shot shooting angle, 7, sun shield, 8, infrared camera shooting angle, 9, optical lens, 10, colour imagery shot, 11, infrared camera, 12, infrared perspective layer, 13, projection module, 14, just throw imaging film.
Detailed description of the invention
Below with reference to accompanying drawing 1 to accompanying drawing 3, the present invention is described further, but should not limit the scope of the invention with this.
With reference to accompanying drawing 1, the invention provides a kind of HUD read out instrument in conjunction with voice and video identification, there is the HUD module 1 for being projected by information of vehicles on vehicle front windshield, it is characterized in that, also comprise:
Photographing module 2, for taking the image of vehicle and driver status, and is converted into picture signal by image;
Voice for recording the voice of chaufeur, and are converted into voice signal by voice module 3;
Circuit module 4, the integrated GPU of described circuit module 4, arm processor, acceleration pick-up, GPS sensor, wireless WIFI and bluetooth module, the picture signal that wherein GPU acquisition photographing module 2 transmits is mated with prearranged image signal, the voice signal that arm processor identification microphone gathers the transmission of sample sound acquisition voice module 3 mates with default voice signal, obtains the action command matched; The gesture that chaufeur is taked by arm processor, the action of eyes, or the voice of typing carry out identification and obtain action command and automatically perform this action, the relevant data of mobile phone are obtained by WIF or bluetooth, other sensor states of combined circuit module 4, as GPS sensor, acceleration pick-up, forms the interface of final display, is projected in HUD module 1 be shown to chaufeur by projection module.
Embodiment one
With reference to accompanying drawing 2 and accompanying drawing 3, a kind of HUD read out instrument in conjunction with voice and video identification provided by the invention, mounting means in a kind of car of this HUD read out instrument:
Projection module 13 in HUD module 1 and just throwing imaging film 14 and be suspended on below the sun shield 7 of vehicle, optical lens 9 is suspended on rear side of projection module 13, colour imagery shot 10 is arranged on the angle 6 in Windshield 5 dead ahead, for taking the ambient condition of vehicle periphery, infrared camera 11 is arranged on the angle 8 in the face of chaufeur, the action that gesture and eyes for monitoring chaufeur are blinked.All sides of infrared camera 11 have LED infrared light supply, arrange one and be made up of thoroughly infrared makrolon material below LED infrared light supply.Infrared perspective layer 12, for intercepting visible ray and eliminating visible ray to the interference of video recognition algorithms, voice module is arranged on photographing module inside, exports for monitoring chaufeur the voice containing keyword.
Embodiment two
A kind of HUD read out instrument in conjunction with voice and video identification provided by the invention, the working process of this HUD read out instrument:
Start this HUD read out instrument, the situation of the colour imagery shot shooting road in photographing module, the gesture of infrared camera shooting chaufeur and eye motion, the GPU in circuit module processes the picture signal that photographing module sends in real time; The voice of chaufeur monitored by microphone simultaneously, the voice signal that the arm processor real-time matching voice module in circuit module sends; Acceleration pick-up and GPS sensor real-time collecting vehicle condition and position data; This HUD read out instrument connects mobile phone by wireless wifi or blue teeth wireless.Above-mentioned all data are finally calculated by the arm processor being all sent to circuit module, and the status data obtained is sent to the amplification that HUD module generation is projected through optical lens and is shown to outside Windshield.Status data obtained above comprises but is not limited to, front vehicles distance, orbit displacement, traffic signal state, driver fatigue state.The content that chaufeur can be shown by gesture or voice command control HUD, includes but not limited to, music information, the social network informations such as micro-letter, answers the information of calling, navigation information.
Embodiment three
Chaufeur starts the vehicle being loaded with apparatus of the present invention and travels on road, runs into when cross roads is red light and stops.Chaufeur is side on the steering wheel, in the acquisition range below infrared camera, according to the prompting of HUD display interface, lifts forefinger and horizontally slips.All behaviors of the infrared camera continuous record chaufeur of this HUD read out instrument, action command corresponding to this action is mated by GPU and arm processor, know that chaufeur wants to open micro-letter of mobile phone terminal, this device by bluetooth command to the mobile phone be attached thereto.After micro-letter opened by the mobile phone that micro-letter is housed, also push micro-letter message to HUD module by bluetooth, by projection module, micro-letter information is projected to Windshield after HUD module obtaining information and show outward.Simultaneously, traffic signal outside the monitoring vehicle window that the colour imagery shot of this HUD read out instrument continues, the red light calculating crossing when arm processor changes green light into, HUD modules exhibit content be namely transformed into token passing, the content of micro-letter is closed, and reminding user continues to drive.
The good effect of the present application: the content of HUD display by the data extreme enrichment of voice and acceleration pick-up etc.; Chaufeur is watched by HUD the content sight line represented and is not left road surface, can obtain vehicle and peripheral information in time safely, human-computer interaction, convenient rapidly; Chaufeur is by carrying out information interaction with vehicle-mounted HUD system, and traffic information is shared in networking, improves traffic running efficiency.
The announcement of book and instruction according to the above description, those skilled in the art in the invention can also change above-mentioned embodiment and revise.Therefore, the present invention is not limited to detailed description of the invention disclosed and described above, also should fall in the protection domain of claim of the present invention modifications and changes more of the present invention.In addition, although employ some specific terms in this specification sheets, these terms just for convenience of description, do not form any restriction to the present invention.

Claims (9)

1., in conjunction with a HUD read out instrument for voice and video identification, there is the HUD module (1) for being projected by information of vehicles on vehicle front windshield, it is characterized in that, also comprise:
Photographing module (2), for taking the image of vehicle and driver status, and is converted into picture signal by image;
Voice for recording the voice of chaufeur, and are converted into voice signal by voice module (3);
Circuit module (4), described circuit module (4) integrated GPU, arm processor, acceleration pick-up, GPS sensor, wireless WIFI and bluetooth module, the picture signal that wherein GPU acquisition photographing module (2) transmits is mated with prearranged image signal, the voice signal that arm processor identification microphone collection sample sound acquisition voice module (3) transmits mates with default voice signal, obtains the action command matched; The gesture that chaufeur is taked by arm processor, the action of eyes, or the voice of typing carry out identification and obtain action command and automatically perform this action, the relevant data of mobile phone are obtained by WIF or bluetooth, other sensor states of combined circuit module (4), as GPS sensor, acceleration pick-up, forms the interface of final display, is projected in HUD module (1) be shown to chaufeur by projection module.
2. a kind of HUD read out instrument in conjunction with voice and video identification as claimed in claim 1, it is characterized in that, described photographing module (2) is by CSI interface, or MIPI interface, or bnc interface, or USB interface, or wireless module and circuit module (4) are electrically connected; This photographing module (2) comprises the colour imagery shot of the ambient condition for taking vehicle periphery being arranged on Windshield dead ahead and is arranged on the infrared camera of the state of blinking for the gesture and eyes of taking chaufeur in the face of the direction of chaufeur.
3. a kind of HUD read out instrument in conjunction with voice and video identification as claimed in claim 2, it is characterized in that, the state of colour imagery shot shooting surrounding environment comprises front truck crossroads traffic light situation, leading vehicle distance, pedestrian's situation, every data that colour imagery shot collects according to the setting of different scene by arm processor are presented at HUD module (1).
4. a kind of HUD read out instrument in conjunction with voice and video identification as claimed in claim 2, it is characterized in that, all sides of described infrared camera have LED infrared light supply; One infrared perspective layer is also set below LED infrared light supply, for intercepting visible ray and eliminating visible ray to the interference of video identification.
5. a kind of HUD read out instrument in conjunction with voice and video identification as claimed in claim 4, it is characterized in that, described infrared perspective layer is made up of saturating infrared polycarbonate, or is made up of saturating infrared acrylic, or is made up of the saturating infrared fileter of plastics.
6. a kind of HUD read out instrument in conjunction with voice and video identification as claimed in claim 1, it is characterized in that, described voice module (3) is a microphone, and this microphone is electrically connected circuit module, for recording chaufeur voice; Described microphone is built in circuit module (4).
7. a kind of HUD read out instrument in conjunction with voice and video identification as claimed in claim 1, it is characterized in that, described HUD module (1) comprises optics display structure, projection module, wherein optics display structure comprises and just throws imaging film and optical lens, and projection module is the liquid crystal display based on the micro-throwing module with DLP technology or the micro-throwing module based on laser projection or high brightness; Imaging is projected the just throwing imaging film of relative projection module by projection module, just throwing imaging film again by imaging line reflection to align mutually throw imaging film optical lens on, chaufeur through the shield glass posting optical lens see projection final imaging.
8. a kind of HUD read out instrument in conjunction with voice and video identification as claimed in claim 7, it is characterized in that, described optical lens two sides has identical curvature, and the reflectivity of intrados plated film is higher than extrados.
9. a kind of HUD read out instrument in conjunction with voice and video identification as claimed in claim 1, is characterized in that, below the sun shield that described HUD module (1) is suspended on position of driver or console dead ahead.
CN201510297407.XA 2015-06-03 2015-06-03 A kind of HUD display devices of combination voice and video identification Expired - Fee Related CN104875680B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510297407.XA CN104875680B (en) 2015-06-03 2015-06-03 A kind of HUD display devices of combination voice and video identification

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510297407.XA CN104875680B (en) 2015-06-03 2015-06-03 A kind of HUD display devices of combination voice and video identification

Publications (2)

Publication Number Publication Date
CN104875680A true CN104875680A (en) 2015-09-02
CN104875680B CN104875680B (en) 2018-03-16

Family

ID=53943446

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510297407.XA Expired - Fee Related CN104875680B (en) 2015-06-03 2015-06-03 A kind of HUD display devices of combination voice and video identification

Country Status (1)

Country Link
CN (1) CN104875680B (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105516289A (en) * 2015-12-02 2016-04-20 广东小天才科技有限公司 Method and system for assisting voice interaction based on position and action
CN105677206A (en) * 2016-01-08 2016-06-15 北京乐驾科技有限公司 System and method for controlling head-up display based on vision
CN106043150A (en) * 2016-08-04 2016-10-26 歌尔科技有限公司 Vehicle-mounted projection system with speech recognition function
CN106354259A (en) * 2016-08-30 2017-01-25 同济大学 Automobile HUD gesture-interaction-eye-movement-assisting system and device based on Soli and Tobii
CN107719122A (en) * 2017-09-14 2018-02-23 中国第汽车股份有限公司 A kind of new line actuation means and method applied to automobile
CN108417021A (en) * 2018-03-07 2018-08-17 京东方科技集团股份有限公司 Automobile-used information sharing system and method
CN108790822A (en) * 2018-06-14 2018-11-13 苏州途驰安电子科技有限公司 Vehicle speed data acquisition methods based on listening mode and device
CN109240635A (en) * 2018-10-12 2019-01-18 宁波吉利汽车研究开发有限公司 A kind of vehicle window display device and method
CN109963144A (en) * 2019-03-28 2019-07-02 重庆长安汽车股份有限公司 A kind of vehicle-mounted identifying system based on AR-HUD
CN110520915A (en) * 2017-04-24 2019-11-29 三菱电机株式会社 Notify control device and notification control method
CN110554766A (en) * 2018-05-31 2019-12-10 柯刚铠 Interaction method and vehicle-mounted interaction device
CN110858467A (en) * 2018-08-23 2020-03-03 比亚迪股份有限公司 Display screen control system and vehicle
CN112241663A (en) * 2019-07-18 2021-01-19 上汽通用汽车有限公司 Device and system for allocating a plurality of vehicle-mounted resources
CN112947761A (en) * 2021-03-26 2021-06-11 芜湖汽车前瞻技术研究院有限公司 Virtual image position adjusting method, device and storage medium of AR-HUD system
CN113147596A (en) * 2021-04-13 2021-07-23 一汽奔腾轿车有限公司 AR technology-based head-mounted vehicle-mounted information display system and method
CN113335183A (en) * 2021-07-05 2021-09-03 兴科迪科技(泰州)有限公司 Streaming media rearview mirror capable of adjusting camera shooting view field by means of voice recognition
CN113752959A (en) * 2021-10-18 2021-12-07 浙江中导北斗导航科技有限公司 Driver driving behavior self-improvement auxiliary equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005070255A (en) * 2003-08-22 2005-03-17 Denso Corp Virtual image display device
CN101866051A (en) * 2009-04-02 2010-10-20 通用汽车环球科技运作公司 Infotainment on the full-windscreen head-up display shows
CN202541258U (en) * 2012-01-20 2012-11-21 法国圣戈班玻璃厂 Head-up display windshield as well as system and vehicle with same
CN102910130A (en) * 2012-10-24 2013-02-06 浙江工业大学 Actually-enhanced driver-assisted early warning system
WO2014174677A1 (en) * 2013-04-26 2014-10-30 三菱電機株式会社 In-vehicle device, information distribution server, and facility information display method
WO2014203534A1 (en) * 2013-06-20 2014-12-24 株式会社デンソー Head-up display device, and illuminating device employed in head-up display device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005070255A (en) * 2003-08-22 2005-03-17 Denso Corp Virtual image display device
CN101866051A (en) * 2009-04-02 2010-10-20 通用汽车环球科技运作公司 Infotainment on the full-windscreen head-up display shows
CN202541258U (en) * 2012-01-20 2012-11-21 法国圣戈班玻璃厂 Head-up display windshield as well as system and vehicle with same
CN102910130A (en) * 2012-10-24 2013-02-06 浙江工业大学 Actually-enhanced driver-assisted early warning system
WO2014174677A1 (en) * 2013-04-26 2014-10-30 三菱電機株式会社 In-vehicle device, information distribution server, and facility information display method
WO2014203534A1 (en) * 2013-06-20 2014-12-24 株式会社デンソー Head-up display device, and illuminating device employed in head-up display device

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105516289A (en) * 2015-12-02 2016-04-20 广东小天才科技有限公司 Method and system for assisting voice interaction based on position and action
CN105677206A (en) * 2016-01-08 2016-06-15 北京乐驾科技有限公司 System and method for controlling head-up display based on vision
CN106043150A (en) * 2016-08-04 2016-10-26 歌尔科技有限公司 Vehicle-mounted projection system with speech recognition function
CN106043150B (en) * 2016-08-04 2018-02-09 歌尔科技有限公司 A kind of vehicle-mounted optical projection system with speech identifying function
CN106354259A (en) * 2016-08-30 2017-01-25 同济大学 Automobile HUD gesture-interaction-eye-movement-assisting system and device based on Soli and Tobii
CN110520915A (en) * 2017-04-24 2019-11-29 三菱电机株式会社 Notify control device and notification control method
CN110520915B (en) * 2017-04-24 2022-03-01 三菱电机株式会社 Notification control device and notification control method
CN107719122A (en) * 2017-09-14 2018-02-23 中国第汽车股份有限公司 A kind of new line actuation means and method applied to automobile
CN108417021A (en) * 2018-03-07 2018-08-17 京东方科技集团股份有限公司 Automobile-used information sharing system and method
CN108417021B (en) * 2018-03-07 2021-08-17 京东方科技集团股份有限公司 Vehicle information sharing system and method
CN110554766A (en) * 2018-05-31 2019-12-10 柯刚铠 Interaction method and vehicle-mounted interaction device
CN108790822B (en) * 2018-06-14 2021-05-25 苏州途驰安电子科技有限公司 Vehicle speed data acquisition method and device based on monitoring mode
CN108790822A (en) * 2018-06-14 2018-11-13 苏州途驰安电子科技有限公司 Vehicle speed data acquisition methods based on listening mode and device
CN110858467A (en) * 2018-08-23 2020-03-03 比亚迪股份有限公司 Display screen control system and vehicle
CN109240635A (en) * 2018-10-12 2019-01-18 宁波吉利汽车研究开发有限公司 A kind of vehicle window display device and method
CN109963144B (en) * 2019-03-28 2021-06-04 重庆长安汽车股份有限公司 AR-HUD-based vehicle-mounted identification system
CN109963144A (en) * 2019-03-28 2019-07-02 重庆长安汽车股份有限公司 A kind of vehicle-mounted identifying system based on AR-HUD
CN112241663A (en) * 2019-07-18 2021-01-19 上汽通用汽车有限公司 Device and system for allocating a plurality of vehicle-mounted resources
CN112947761A (en) * 2021-03-26 2021-06-11 芜湖汽车前瞻技术研究院有限公司 Virtual image position adjusting method, device and storage medium of AR-HUD system
CN112947761B (en) * 2021-03-26 2023-07-28 芜湖汽车前瞻技术研究院有限公司 Virtual image position adjustment method, device and storage medium of AR-HUD system
CN113147596A (en) * 2021-04-13 2021-07-23 一汽奔腾轿车有限公司 AR technology-based head-mounted vehicle-mounted information display system and method
CN113335183A (en) * 2021-07-05 2021-09-03 兴科迪科技(泰州)有限公司 Streaming media rearview mirror capable of adjusting camera shooting view field by means of voice recognition
CN113752959A (en) * 2021-10-18 2021-12-07 浙江中导北斗导航科技有限公司 Driver driving behavior self-improvement auxiliary equipment

Also Published As

Publication number Publication date
CN104875680B (en) 2018-03-16

Similar Documents

Publication Publication Date Title
CN104875680A (en) HUD (head up display) device combining voice and video recognition
US20210357670A1 (en) Driver Attention Detection Method
US10279741B2 (en) Display control apparatus, method, recording medium, and vehicle
CN206031079U (en) On -vehicle head -up display AR of augmented reality HUD
WO2018167966A1 (en) Ar display device and ar display method
CN104076514B (en) A kind of automobile information display method and device
CN105527710A (en) Intelligent head-up display system
CN104866106A (en) HUD and infrared identification-combined man-machine interactive method and system
US10445594B2 (en) Onboard display system
CN205720871U (en) A kind of intelligence head-up-display system
CN106338828A (en) Vehicle-mounted augmented reality system, method and equipment
TW202325049A (en) Vehicle and mobile device interface for vehicle occupant assistance
CN108099790A (en) Driving assistance system based on augmented reality head-up display Yu multi-screen interactive voice
KR101976106B1 (en) Integrated head-up display device for vehicles for providing information
JPWO2017056889A1 (en) Optical communication connector, optical communication cable and electronic device
CN107315256A (en) A kind of bore hole AR HUD implementation method
TW202323931A (en) Vehicle and mobile device interface for vehicle occupant assistance
JP2022169621A (en) Reproduction device, reproduction method, program for the same, recording apparatus, and control method of recording apparatus
CN106143308A (en) Lane Departure Warning System based on intelligent back vision mirror
KR20140145332A (en) HMD system of vehicle and method for operating of the said system
CN110825216A (en) Method and system for man-machine interaction of driver during driving
CN107472140B (en) Eye-control vehicle-mounted HUD system
CN111679431A (en) Head-up display system based on automobile sun shield
CN208847962U (en) A kind of train head-up-display system
US10317631B2 (en) Optical communication connector to restrain direct emission of collimated light

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
DD01 Delivery of document by public notice
DD01 Delivery of document by public notice

Addressee: SHENZHEN GUANGYUN NETWORK TECHNOLOGY Co.,Ltd.

Document name: Notification of Termination of Patent Right

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180316

Termination date: 20190603