CN105527710A - Intelligent head-up display system - Google Patents

Intelligent head-up display system Download PDF

Info

Publication number
CN105527710A
CN105527710A CN201610012601.3A CN201610012601A CN105527710A CN 105527710 A CN105527710 A CN 105527710A CN 201610012601 A CN201610012601 A CN 201610012601A CN 105527710 A CN105527710 A CN 105527710A
Authority
CN
China
Prior art keywords
order
module
voice
intelligent
identification
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610012601.3A
Other languages
Chinese (zh)
Other versions
CN105527710B (en
Inventor
王艳龙
马斌斌
苗顺平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Lejia Technology Co Ltd
Original Assignee
Beijing Lejia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Lejia Technology Co Ltd filed Critical Beijing Lejia Technology Co Ltd
Priority to CN201610012601.3A priority Critical patent/CN105527710B/en
Publication of CN105527710A publication Critical patent/CN105527710A/en
Application granted granted Critical
Publication of CN105527710B publication Critical patent/CN105527710B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Traffic Control Systems (AREA)
  • Navigation (AREA)

Abstract

The invention discloses an intelligent head-up display system, which comprises a display assembly, an image acquisition assembly, a natural voice interaction assembly, a sensor assembly and a processor assembly. The display assembly is connected with the image acquisition assembly; the sensor assembly is connected with the processor assembly; and the image acquisition assembly is connected with the processor assembly. Compared with a convention head-up display system, the intelligent head-up display system can support more interaction control and can realize voice scheme interaction adoption, and meanwhile, can install various third-party applications to expand and enrich functions; furthermore, the intelligent head-up display system, carried with various sensors, can connect external equipment; and besides, the intelligent head-up display system has a camera module, which faces to the inner portion of a vehicle, so that the behavior and state of a driver can be identified, and safe driving reminding function and interaction control function can be realized.

Description

A kind of intelligent head-up-display system
Technical field
The present invention relates to head-up-display system, particularly intelligent head-up-display system.
Background technology
HUD HUD (HeadUpDisplay) is the flight supplementary instrument generally used on aircraft.The meaning come back refers to that pilot does not need to bow the important information just can seeing that he needs.Because the convenience of HUD and can improve flight safety, airliner also follows up installation one after another.HUD is the principle utilizing optical reflection, important flight relevent information is incident upon above a sheet glass.This what passenger cabin front end, sheet glass position, highly roughly becomes level with the eyes of pilot, and the word of projection and image adjustment, on the distance of focal length infinity, time pilot sees toward front through HUD, can not hamper the running of eyes, maintain and show clearly.
The basic framework of HUD comprises two parts: data processing unit and image display.Data processing unit is by the Hou of the data conformity process of system each on aircraft, and according to the symbol that the patten transformation selected becomes to preset, figure or the kenel with word or numeral export.Signal process and image output are divided into two devices by some product, but are all similar working method haply.Image display is just mounted in passenger cabin front, between pilot and canopy spatially.Image display receives the information from data processing device, is incident upon above glass.Display device and with control panel, can reconcile or change the image of output.
The improvement of HUD in image display of a new generation comprises employing full figure photography (Holographic) display mode, expand the scope of show image, especially the field-of-view angle in increase level, reduce the thickness of support to the restriction in the what visual field and impact, the display strengthened under different luminosity and external environment adjusts, the sharpness of strengthening image, what export with other optical images coordinates, for example the aircraft forward image that infrared image video camera produces directly can be projected on HUD, show with other data fusion, coordinate the use of night vision goggles and adopt chromatic image display data.Improvement on data processing unit comprises the speed and efficiency that improve process, and HUD is by image projection in the stationary installation in passenger cabin front, and when pilot's rotation head time, these images will his field range away from keyboard.The HUD of a new generation is more suitable for being used on automobile widely.
In the intrinsic notion of people, what driving should be focused on is safety naturally, but popularizing along with smart mobile phone, cellphone subscribers do not rely on the facility of mobile phone belt all the time with quick.The real-time communication of phone, note, micro-letter, multimedia use, digital map navigation instrument etc. these, but in " race of bowing " increasing today, mobile phone belt but have impact on the security of driving to our facility greatly.The traffic hazard of various ways is all because car owner causes owing to using mobile phone in driving procedure.Automobile vendors come to realise the importance of middle control screen, add vehicle as maximum terminal device, more allow this block " screen " on car become place contested by all strategists.But the existence of vehicle-mounted middle control screen really to allow driving variable obtain safer, but in real experiences, still have the every drawback on vehicle-mounted middle control screen and inconvenient part, still can allow driver distraction.
At present, also there is following defect in HUD HUD:
1. major part can only show the information such as the speed of a motor vehicle, oil mass, does not possess operating function completely.
2. in use, need commonly use mobile phone, then by the information projection on mobile phone on new line display screen.
Summary of the invention
The technical problem to be solved in the present invention is, provide support more interactive controlling, can realize the intellective scheme adopting voice, gesture alternately.There is provided and can install all kinds of third-party application, function is enriched in expansion, can realize connecting external unit.The driving behavior and state that can identify are provided, safe driving prompt facility and function of interaction control can be realized.
Solve the problems of the technologies described above, the invention provides a kind of intelligent head-up-display system, comprise, display module, image collection assembly, natural-sounding interactive component, sensor module and processor module, described display module comprises, projection module, imaging device and reflection unit, described projection module, in order to emission of light; Described imaging device, in order to receive the emission of light of described emitter, and by picture being carried out imaging after two secondary reflections, and is transmitted into emitter; Described reflection unit, in order to amplify rear reimaging by described picture imaging; The feature of display module, amplification imaging; Become the virtual image in front, the virtual image and road overlap, and reduce user's focal length and switch.In another implementation of display module of the present invention, be screen (lcd screen) and a reflection unit of a direct imaging, there is no projection module.
Described image collection assembly comprises, first camera head, second camera head, driver status monitoring system, driving environment monitoring system, described first camera head, in order to obtain driver drives vehicle status information, described second camera head, in order to obtain the status information of vehicle periphery, described driver status monitoring system, carries out driver status monitoring in order to the information obtained according to the first camera head; Described driving environment monitoring system, carries out driving environment monitoring in order to the vehicle periphery state obtained according to the second camera head; Described natural-sounding interactive component comprises, microphone and speech processing module, described microphone is in order to transmit the natural-sounding information of driver to described speech processing module, described speech processing module is in order to carry out the identification of natural-sounding information, synthesis and logical sessions, and the waking up of natural-sounding information; Described sensor module, comprises, illumination induction installation, for obtaining the illumination value in driving environment; Described processor module, comprises, treating apparatus, for according to acquisition driver drives vehicle status information, forms view data, if described view data does not meet predetermined images of gestures standard, does not then store described view data; If meet, then export gesture instruction after described view data being stored, and for according to described illumination value, judge whether that opening compensating light shines; If so, then open compensating light irradiate and again obtain the view data in driving environment; Described display module is connected with described image collection assembly, and described sensor module is connected with described processor module, and described image collection assembly is connected with described processor module.Processor module, for interactive voice, image recognition etc. have effect.Further, processor module, also has networking component, can connect WIFI network, cellular mobile network.
In intelligent head-up-display system of the present invention, also comprise map access module, in order to generate traffic navigation instruction alternately according to voice messaging, the navigation way of reference position and destination is set up according to described traffic navigation instruction, adopt the mode of simplifying to show described navigation way, described navigation way comprises running line inquiry and traffic route planning; When travelling up to destination from described reference position, auto zoom mode is adopted to show apart from the distance of described destination; According to described traffic navigation instruction, the mode of navigation circuit according to circuit classification is shown.Particularly, based on the intelligent operating system of installing, can develop and install various application software, navigation is one of them application software just.
In intelligent head-up-display system of the present invention, also comprise the intelligent sex of view-based access control model and voice, Emotion identification detection system, carry out the Emotion identification of occupant according to facial image, and carry out the sex identification of occupant according to face; Carry out the Emotion identification of occupant according to the voice of people, and carry out the sex identification of occupant according to voice; In order to the result of described sex identification is carried out mating and is sent to individualized intelligent voice interactive system, and in order to the result of described Emotion identification is carried out merging and is sent to individualized intelligent voice interactive system; Interactive voice is carried out according to the matching result received and fusion results.
Described sensor module also comprises, collecting unit, in order to illumination brightness in inspection vehicle, and user preference unit, in order to arrange user preference, self-regulation unit, carries out self-regulation in order to collect light intensity signal according to above-mentioned illumination brightness; Self-regulation is carried out in order to arrange brightness preference according to above-mentioned user preference; Display unit, for showing self-regulation brightness.
Described sensor module also comprises, gesture monitoring identification module, in order to carry out gestures detection to driver, trigger action information is gone out according to described gesture identification, audio monitoring identification module, in order to carry out speech message monitoring to driver, identify according to described speech message and wake voice messaging up, button monitoring modular, in order to monitor the button of association, if monitor button trigger message, then mate, wake module, in order to described trigger action information or wake voice messaging up and mate, if information matches success arbitrarily, then wake up.
Described sensor module also comprises, sound identification module, in order to receive the voice signal that user sends; Enquiry module, in order to obtain the POI address of user's input according to described voice signal; Display translation module, in order to retrieve according to described POI address, obtains result for retrieval; Voice interaction module, in order to be fed back by described result for retrieval, waits for user's voice signal next time; According to described voice signal next time, in the result of described feedback, regioselective goes out order ground, completes navigation.
Described processor module also comprises, wake command process module, navigation instruction processing module up, telephone order processing module, musical instruction processing module, micro-letter command process module, navigation instruction processing module, comprise with phonetic order select your destination appointment, judge whether to hide block up route instructions, navigation come sourse instruction, driving road-condition instruction, cyberdog instruction; Wake command process module up, in order to wake the HUD of dormancy up; Telephone order, can send telephone order and carry out Voice command and answer, dial number, when called party's number of depositing is more than one time, and can voice selecting; Musical instruction, according to voice operating, can play the music of SD card, or broadcast station content; Whether micro-letter instruction, can log in micro-letter by barcode scanning in advance, have voice message and report when receiving micro-letter, is converted to and is asked word during reply by phonetic entry, identification.
In intelligent head-up-display system of the present invention, also comprise the external equipment by wireless connections or wired connection, described external equipment comprises intelligent mobile terminal, drive recorder, automobile OBD equipment.Intelligent mobile terminal keeps being connected with intelligent head-up-display system by mode that is wireless or bluetooth.Described automobile equipment OBD, can the operation conditions of monitoring engine and the duty of exhaust gas aftertreatment system at any time, once find that there is the situation that may cause and discharge and exceed standard, can send warning at once.When system malfunctions, trouble light (MIL) or check engine (CheckEngine) emergency warning lamp bright, simultaneously OBD system can by failure message stored in storer, can read relevant information by the diagnostic instrments of standard and diagnose interface with the form of diagnostic trouble code.According to the prompting of diagnostic trouble code, maintenance personal can determine character and the position of fault quickly and accurately.
Described sensor module, also comprise, direction sensor, acceleration transducer, GPS, temperature sensor and geomagnetic sensor, described temperature sensor is in order to the temperature responded in car and dispel the heat, described geomagnetic sensor is with for inspection vehicle and vehicle cab recognition, described direction sensor is in order to judge vehicle and advance or the direction of falling back and testing automobile operating range, described acceleration transducer is in order to the braking of vehicle, start detection, and described GPS is in order to positioned vehicle position and map access.
Described reflection unit comprises radiation shield, and described radiation shield is the optical lens that two sides has identical curvature, and the reflectivity of intrados plated film is higher than the reflectivity of extrados plated film; Described imaging device comprises: the first transmitting mirror, the second catoptron and imaging film, described first mirror tilt is arranged on the exit of described light, described second catoptron and described first transmitting mirror are spliced, be obliquely installed equally, described imaging film splices along the edge of side and described second catoptron.
Beneficial effect of the present invention:
1) because described natural-sounding interactive component comprises, microphone and speech processing module, described microphone is in order to transmit the natural-sounding information of driver to described speech processing module, described speech processing module is in order to carry out the identification of natural-sounding information, synthesis and logical sessions, and the waking up of natural-sounding information.Make intelligent head-up-display system can realize taking turns voice interactive function more, thus use voice mode to complete all inputs completely.
2) because described display module comprises, projection module, imaging device and reflection unit, described projection module, in order to emission of light; Described imaging device, in order to receive the emission of light of described emitter, and by picture being carried out imaging after two secondary reflections, and is transmitted into emitter; Described reflection unit, in order to rear reimaging is amplified in described picture imaging, imaging is presented at vehicle front certain distance, makes intelligent head-up-display system can realize the display of multiple on-vehicle information.
3) because described image collection assembly comprises, first camera head, second camera head, driver status monitoring system, driving environment monitoring system, described first camera head, in order to obtain driver drives vehicle status information, described second camera head, in order to obtain the status information of vehicle periphery, described driver status monitoring system, carries out driver status monitoring in order to the information obtained according to the first camera head; Described driving environment monitoring system, carries out driving environment monitoring in order to the vehicle periphery state obtained according to the second camera head.Make intelligent head-up-display system can identify driving behavior and state, safe driving prompt facility and function of interaction control can be realized.Concrete function comprises: fatigue detecting, and deviation is pointed out, front truck collision detection etc.
4) because described processor module comprises, processor, storer, internal memory, for running intelligent operating system, intelligent operating system being run and has types of functionality program.Such as: treating apparatus, for according to acquisition driver drives vehicle status information, form view data, if described view data does not meet predetermined images of gestures standard, then described view data is not stored; If meet, then export gesture instruction after described view data being stored, and for according to described illumination value, judge whether that opening compensating light shines; If so, then open compensating light irradiate and again obtain the view data in driving environment.Make intelligent head-up-display system have automatic brightness control function, can realize simultaneously daytime, night free adjustment.
5) because described display module can comprise, the upside of described base is provided with LCD display device, in order to show the frame of vehicle, and frame is projected to described catoptron, described catoptron is inclined to set in the horizontal direction relative to described LCD display device, reflect after receiving described frame, the left side of described base is provided with radiation shield, in order to amplify and to show frame.By above-mentioned structure, light path can be carried out side instead, effectively can shorten the length of product, meanwhile, the working depth of HUD entirety can be effectively reduced, to make the adaptive more vehicle of product energy.
6) based on front-facing camera retrieval actual scene traffic events and the traffic signals of HUD, and be presented on navigation interface, realize scene and navigation display combination in the present invention.
Accompanying drawing explanation
Fig. 1 is the intelligent head-up-display system structural representation in one embodiment of the invention.
Fig. 2 is the structural representation of the display module in Fig. 1.
Fig. 3 is the structural representation of image collection assembly in Fig. 1.
Fig. 4 is the structural representation of sensor module in Fig. 1.
Fig. 5 is the structural representation of processor module in Fig. 1.
Fig. 6 is the structural representation of natural-sounding interactive component in Fig. 1.
Embodiment
For making the object, technical solutions and advantages of the present invention clearly understand, below in conjunction with specific embodiment, and with reference to accompanying drawing, the present invention is described in more detail.
Please refer to Fig. 1, is the intelligent head-up-display system structural representation in one embodiment of the invention.
Intelligent head-up-display system in the present embodiment, comprise, display module 101, image collection assembly 102, natural-sounding interactive component 105, sensor module 103 and processor module 104, described display module 101 is connected with described image collection assembly 102, in order to the image information in image collection assembly to be shown.Described sensor module 103 is connected with described processor module 104, and the Signal transmissions in order to be detected by sensor module enters in processor module 104 and processes.Described image collection assembly 102 is connected with described processor module 104, enters in processor module 104 process in order to the image information collected to be converted to picture signal transmission.Particularly, display module 101, driver need not bow, and just can see running information, as the speed of a motor vehicle, navigation etc. all can be presented in the pocket of front windshield.Avoid disperseing the notice to road ahead.Described display module 101 can carry out amplification imaging, forms the virtual image in front, and the virtual image on radiation shield and carriage way are overlapped, and the focal length reducing user's vision switches.Particularly, described image collection assembly 102, collects the image of the face of driver, gesture, iris, and those image informations is compared in relevant database, and then carries out follow-up identification.Particularly, described natural-sounding interactive component 105, can identify the voice messaging of driver, and it is mutual that the recognition result obtained carries out many wheel natural-soundings, obtains corresponding moving operation instruction.Particularly, described sensor module 103, can carry multiple sensor, such as: the sensors such as direction, acceleration, GPS, microphone.Particularly, processor module 104, comprises, processor, storer and internal memory, by may be used for running intelligent operating system after coupling api interface, intelligent operating system can run types of functionality program.Preferred as in the present embodiment, the complete machine of intelligent head-up-display system has a cooling system, and whole cooling system is by fan, and heat radiator, air channel forms.
Intelligent head-up-display system in the present embodiment, also comprise map access module, in order to generate traffic navigation instruction alternately according to voice messaging, the navigation way of reference position and destination is set up according to described traffic navigation instruction, adopt the mode of simplifying to show described navigation way, described navigation way comprises running line inquiry and traffic route planning; When travelling up to destination from described reference position, auto zoom mode is adopted to show apart from the distance of described destination; According to described traffic navigation instruction, the mode of navigation circuit according to circuit classification is shown.Particularly, described Map Simplification mode is: the reference position in described navigation way and destination are carried out location, position, owing to being not air line distance between reference position and destination, needing the geographical environment walking around buildings or corresponding position, position is located.Obtain gps coordinate according to location, described position, directly can acquire gps coordinate information on map, such as, map indicate Wangfujing Applied in Business Pedestrian Street, then resolving the gps coordinate information obtained is: north latitude 39.9, east longitude 116.4.Obtain position coordinates point by above-mentioned gps coordinate, draw on described traffic navigation map according to described position coordinates point and generate travel, the navigation way that instruction human pilot travels.Adopt Google Maps API, high moral map API, MapBoxAPI or adopt CloudmadeAPI.User selectively can show the object on map according to distance.Google and most maps provide commercial city automatically to provide this function, such as contiguous street and highway.Described drafting generates vehicle line, for preset or human pilot self-defined.Be preset as fixing factory-said value, driver is self-defined adds the determination of human pilot to position coordinate points.
Particularly, by the step that auto zoom mode carries out showing be in the present embodiment: when from reference position in the driving process of destination, according to travel speed, automatically navigation way engineer's scale in the described traffic navigation map of adjustment.Consider that, when larger change occurs the speed of automobile, user may need different map denotation to experience.Such as when the speed of a motor vehicle is slower, user needs the engineer's scale of map to amplify, to facilitate the road conditions and point of interest (PointofInterest, POI) information of seeing oneself side, parking stall clearly; When the speed of a motor vehicle is very fast, user needs the scale compression of map, to see information more of overall importance.Meanwhile, when through complex crossing time, user needs to amplify current engineer's scale more clearly to show current crossing situation; And having crossed complex crossing, user needs the scale compression of map, to see information more of overall importance.By automatically adjusting navigation way engineer's scale in described traffic navigation map, can solve the above problems.Described travel speed, 2 longitudes and latitudes obtained by navigation software draw the distance of point-to-point transmission, then using this distance divided by the result that obtains of times through these 2 costs as the vehicle present speed obtained.Thus need not be connected with the control system of vehicle itself and can obtain vehicle present speed from navigation software itself, obtain more convenient, and change on hardware is less.Such as, first obtain current vehicle position, then judge that whether vehicle is close to complex crossing according to current vehicle position; If so, then with the first displaying ratio chi display current map; If not, then need to obtain vehicle present speed.Further, search the engineer's scale of corresponding present speed as the second displaying ratio chi, and then with described second displaying ratio chi display current map.Pass through aforesaid operations, when vehicle is close to complex crossing (or assembling ground close to speed limit mark, camera mark, traffic lights information mark etc.), namely adjustment current map shows with the first displaying ratio chi automatically, and when not having close to complex crossing, then automatically adjust current map and show with the second displaying ratio chi that vehicle present speed is corresponding.In varied situations, auto zoom display scale of navigation map can be reached, facilitate user to watch, and without the need to user's repeatable operation.And according to the distance of the next navigation hint point in front, navigation way engineer's scale in the described traffic navigation map of adjustment automatically; By the above-mentioned speed proportional chi table of comparisons (namely preset table) carry out searching obtain corresponding present speed engineer's scale as the second displaying ratio chi, also can be searched by the mapping relations of other speed and engineer's scale.Further, the described speed proportional chi table of comparisons also can obtain for arranging according to user, thus user can be facilitated to be arranged under the different speed of a motor vehicle according to oneself demand with the second displaying ratio chi display map.Above-mentioned complex crossing is for determining to draw according to filling information; Described filling information is the information of each point between starting point and destination in navigation path planning; Or described complex crossing by prompting or the crossing of pointing out and guiding of turning right of turning left, can cannot carry out judgement and determine according to this for working direction.In the described engineer's scale point of interest POI classification table of comparisons, larger proportion chi correspondence comprises more multi-class point of interest.Such as, minimum engineer's scale can show the point of interest of 30 classifications, and maximum engineer's scale can show the point of interest of 80 classifications.Preferred as in the present embodiment, the current map of described display comprises interest point information.Described point of interest classification is searched according to described first displaying ratio chi or described second displaying ratio chi and is obtained.When described current map is with the first displaying ratio chi display time, described point of interest classification is searched according to described first displaying ratio chi and is obtained; When described current map is with the second displaying ratio chi display time, described point of interest classification is searched according to described second displaying ratio chi and is obtained.Described next navigation hint select be turn round mark, speed limit mark, camera mark, traffic lights information flag, neighbouring lodging mark, neighbouring diet mark, neighbouring refuel mark, neighbouring shopping mark in one or more.
Intelligent head-up-display system in the present embodiment, also comprises the intelligent sex of view-based access control model and voice, Emotion identification detection system, carries out the Emotion identification of occupant according to facial image, and carries out the sex identification of occupant according to face; Carry out the Emotion identification of occupant according to the voice of people, and carry out the sex identification of occupant according to voice; In order to the result of described sex identification is carried out mating and is sent to individualized intelligent voice interactive system, and in order to the result of described Emotion identification is carried out merging and is sent to individualized intelligent voice interactive system; Interactive voice is carried out according to the matching result received and fusion results.
Everyone expression decomposition can be many Facial action units (ActionUnits) according to " face action organization system " (FACS) by the described mood based on image and sex identification, employing computing machine carrys out automatic analysis, identifies that facial expression is a very complicated problem simultaneously, and its key is to set up rational human emotion's model and is connected by the variation characteristic of it and face features and expression.Generally speaking, in order to accurately identify mood, mood can be fallen into 5 types: bored, joyful, surprised, to baffle or indignation, sad or painful.In certain embodiments, described voice-based mood and gender identification module 101, such as need to consider the attention level to face, if the information obtaining face changes in faces is imperfect, then compensation way can be adopted to carry out expression and compensate.Again such as, face familiarity, one is the characteristic amplitude extracted, and two is the human face three-dimensional models set up.Again such as, need to consider the impact of the extraneous factors such as illumination on image.In certain embodiments, when carrying out sex identification, two kinds of gender identification method: EigenFace and FisherFace provided in the contrib of OpenCV can be adopted.In addition, voice-based mood and sex identification, in order to carry out the Emotion identification of occupant according to the voice of people, and carry out the sex identification of occupant according to voice; Result input Fusion Module 103; The described voice according to people carry out the Emotion identification of occupant, comprising: " key acoustical features " in voice, then these critical sound features are contrasted with the categorizing system of setting, thus judge the mood of speaker.The Emotion identification undertaken by voice can be divided into 5 kinds of basic emotions altogether: happy, sad, gentle, frightened and angry.
Carry out fusion to result to comprise, in order to the result of described sex identification is carried out mating and is sent to individualized intelligent voice interactive system, and in order to the result of described Emotion identification is carried out merging and is sent to individualized intelligent voice interactive system; Individualized intelligent interactive voice is carried out after fusion; When merging by merging through the mood of speech recognition and sex and by the mood of Expression Recognition and sex result, individualized intelligent voice interactive system can be sent to after the fusion results obtained and carry out next step interactive voice, so promote the precision of sex/Emotion identification.Such as, detecting the result obtained in voice-based mood and sex identification is, sex: man, mood: happy, detecting the result obtained in based on the mood of image and sex identification is, sex: man, mood: joyful, then think that sex conforms to the identification of mood, namely fusion results conforms to, and can carry out individualized intelligent interactive voice.Such as, in voice-based mood and sex identification, detect the result obtained is, sex: man, mood: gentle, and detect the result obtained in based on the mood of image and sex identification and be, sex: female, mood: gentle, then fusion results does not conform to, and does not carry out interactive voice.When carrying out individualized intelligent interactive voice, carry out interactive voice according to the matching result received and fusion results, the result after merging is mated with the interactive voice information in the result of described individualized intelligent interactive voice.If be unhealthy emotion state to the result of determination of current emotional states, then to start in individualized intelligent interactive voice such as, music unit, play according to the music track preset in individualized music storehouse, by music, the unhealthy emotion state of driver is adjusted to optimum emotional state, indirectly impel driver to adopt the driving behavior of trend safety, thus realize the function of initiatively assisting driving safety.As preferred in the present embodiment, such as, intelligent sound interactive unit can also be adopted, according to the mood talk linguistic context of setting, carry out mood by adopting personalized speech service and dredge, the unhealthy emotion state of driver is adjusted to optimum emotional state.
Preferred as in the present embodiment, can adopt the preposition camera in car-mounted terminal, in order to retrieve actual scene traffic events and traffic signals, and is presented at and navigation interface realizes scene and navigation display combines.Particularly, in certain embodiments, current residing track is identified according to gathering, lane position is matched in navigation map, and navigation instruction, provide user and remind more accurately, such as, navigation instruction front needs to roll away from from right-side outlet, if Current vehicle track on the right detected, then does not need to point out doubling to the right.If detect that Current vehicle is in left-hand lane, then doubling should be reminded to operate.If detect that vehicle is in track, the leftmost side, just doubling should be reminded when distance crossing is far away.By front-facing camera, can detect upcoming traffic event and traffic signals in real time, intelligent reminding driver carries out and road, turning etc.In certain embodiments, when vehicle drives to a traffic light intersection, the state according to traffic lights obtained by camera collection, is reminded driver to wait for or travels.When lights state changes, driver is reminded to perform specific operation.Can effectively overcome during current visible navigation realizes by above-mentioned mode, not consider lights state, the prompting hearing " please keep straight on " when red light may be run into, cause navigation can not the defect that combines of actual situation.
Fig. 2 is the structural representation of the display module in Fig. 1.
In the present embodiment, display module comprises, projection module 1011, imaging device 1012 and reflection unit 1013, and described projection module 1011, in order to emission of light; Described imaging device 1012, in order to receive the emission of light of described projection module 1011, and by picture being carried out imaging after two secondary reflections, and is transmitted into projection module 1011; Described reflection unit 1013, in order to amplify rear reimaging by described picture imaging.Due in imaging device 1012, by picture being carried out imaging after two secondary reflections, and being transmitted into projection module 1011, effectively can shortening the length of product, meanwhile, the working depth of HUD entirety can be effectively reduced, to make the adaptive more vehicle of product energy.Imaging in described emitter and the back of the body permeable membrane of micro optical-mechanical in reflection unit is realized by secondary reflection.Particularly, in the present embodiment, described reflection unit 1013 can comprise radiation shield, and wherein said radiation shield is the optical lens that two sides has identical curvature, and the reflectivity of intrados plated film is higher than the reflectivity of extrados plated film.Preferred as in the present embodiment, the reflectivity of the intrados of described radiation shield is 30%, the reflectivity 1% of extrados, ensure that driver looks out for the car the outer normal images having 70% transmittance, simultaneously, described intrados has the light reflection of 30% to driver's eyes, described picture imaging can be zoomed into the virtual image.Preferred as in the present embodiment, described imaging device 1012 comprises: the first transmitting mirror, the second catoptron and imaging film, described first mirror tilt is arranged on the exit of described light source, and described second catoptron and described first transmitting mirror are spliced, and are obliquely installed equally.Because described imaging device 1012 comprises: the first transmitting mirror, the second catoptron and imaging film, wherein imaging film adopts special stack-design, taken into account like this daytime and evening without the requirement of brightness demand, user can be avoided to see the background color of imaging film simultaneously.Described imaging film splices along the edge of side and described second catoptron, wherein, state imaging film to comprise: gum plate, optical reflecting lens, optical clear offset plate, diffusion barrier, after described optical reflecting lens and optical clear offset plate are fitted, press fixing by gum plate and diffusion barrier, described optical reflecting mirror is glass sheet or PET reflecting piece in order to regulate height, described optical reflecting lens is provided with reflection plated film on the direction towards described diffusion barrier, or described diffusion barrier is back projection imaging film.In certain embodiments, described projection module 1011 is micro projector, miniature video camera instrument.
Fig. 3 is the structural representation of image collection assembly in Fig. 1.
Described image collection assembly comprises, first camera head 1021, second camera head 1022, driver status monitoring system 1023, driving environment monitoring system 1024, described first camera head 1021, in order to obtain driver drives vehicle status information, described second camera head 1022, in order to obtain the status information of vehicle periphery, described driver status monitoring system 1023, carries out driver status monitoring in order to the information obtained according to the first camera head 1022; Described driving environment monitoring system 1023, carries out driving environment monitoring in order to the vehicle periphery state obtained according to the second camera head 1022.
Particularly, first camera head 1021 in the present embodiment, in order to obtain driver drives vehicle status information, second camera head 1022, in order to obtain the status information of vehicle periphery, driver status monitoring system 1024: can gesture recognition module be comprised, driver identity identification module, fatigue driving detection module, carries out driver status monitoring in order to the information obtained according to the first camera head; Described gesture recognition module is in order to identify the gesture of driver, and the gesture of driver includes but not limited to: the five fingers palm (opening), forefinger, clench fist, the gesture stationary state such as scissors hand, the five fingers palm (closing up), " OK " gesture.By described gesture, free incoming call answering or refusal incoming call can be realized, play or switch Music Radio, reply or check Wei Xindeng chat software.Described driver identity identification module, in order to identify the identity information of driver, comprising of identity information: whether driver is car owner oneself, the sex of driver, the driving habits (height, distance etc. at seat) of driver.Described fatigue driving detection module, whether carrying out fatigue driving for detecting driver, first can carry out driver identity certification, according to the video image of driver at present period, by recognition of face, just carry out certification at the driver identity of steering vehicle to current; Synchronously carry out driving time to add up, according to the identity authentication result of driver, obtain the driving time record of driver; Also comprise, emotional state extracts, and according to the video image of driver at present period, extracts the emotional state of driver at present period; Also comprise, limbs state is extracted, and according to the video image of driver at present period, extracts the limbs state of driver at present period; Also comprise, traffic information is collected, and according to the video image that scene camera is taken at present period, obtains the environmental information of driver vehicle-surroundings; Finally carry out the extraction of vehicle performance state, the driving condition of combining road condition information and vehicle, extract driver in the manipulation state of present period to vehicle; To sum up, the timestamp of driving time as driver's emotional state, limbs state and vehicle performance state is added up using present period, upgrade the data of following the tracks of drivers working states change, analyze the state change of driver in more new data, judge whether current time driver is in fatigue driving.By recognition of face, tracking driver's facial expression and limb action are passed in time, present and change from normal condition to fatigue state, such as closed-eye time is elongated, the frequency of bowing increase etc.; Follow the tracks of driver vehicle to manipulate state and whether decline in time, such as rotating of steering wheel variance becomes large etc., detects driver whether be in fatigue driving state with this.
Particularly, driving environment monitoring system 1023 in the present embodiment: can comprise detect Current vehicle whether run-off-road module, detect lines front side whether have the running distance of pedestrian's module, front truck whether to there is collision distance inner module, carry out driving environment monitoring in order to the vehicle periphery state obtained according to the second camera head; Whether described detection Current vehicle whether run-off-road module, deviate from track in order to the vehicle detected in driving process, can detect according to BLIS blind area monitoring system, and have doubling attention gatter to remind driver by the pillar that is arranged on rearview mirror.Whether described detect lines front side has pedestrian's module 106, in order to carry out pedestrian's Distance Judgment according to collision distance, if be greater than collision distance, does not then carry out early warning, if be less than collision distance, then needs to carry out early warning.Whether the running distance of described front truck exists collision distance inner module, in order to carry out leading vehicle distance calculating according to collision distance, and carries out early warning, by the information of camera collection front truck, and can coordinate with alternate manner.
Further, according to mood and sex-screening result, individualized content recommendation can be carried out in the present embodiment.Described individualized content is recommended based on multi-channel feedback, is not limited to voice.
Such as, recognition result " man's bicycle master, tired ", then can regulate by carrying out vibration with Intelligent worn device or the device be arranged in car on seat, alleviating the physiological fatigue state of driver.Or recognition result " woman's bicycle master, tired ", then can, by being arranged on the flavor-generating device in car, provide the fragrance of multiple fragrance to alleviate driver's mood.
Fig. 4 is the structural representation of sensor module in intelligent head-up-display system in Fig. 1.
Sensor module 103 in the present embodiment comprises: illumination induction installation 1031, for obtaining the illumination value in driving environment; Wherein also comprise, collecting unit 1032, in order to illumination brightness in inspection vehicle, user preference unit 1033, in order to arrange user preference, self-regulation unit 1034, carries out self-regulation in order to collect light intensity signal according to above-mentioned illumination brightness and carries out self-regulation in order to arrange brightness preference according to above-mentioned user preference; Display unit 1035, for showing self-regulation brightness.
Those skilled in the art can understand, described illumination induction installation 1031, for obtaining the illumination value in driving environment; Those skilled in the art can understand, illumination induction installation 1031 can adopt illumination inductor, or light activated element.
Described sensor module 103 also comprises, gesture monitoring identification module 1036, in order to carry out gestures detection to driver, trigger action information is gone out according to described gesture identification, audio monitoring identification module 1037, in order to carry out speech message monitoring to driver, identify according to described speech message and wake voice messaging up, button monitoring modular 1038, in order to monitor the button of association, if monitor button trigger message, then mate, wake module 1039, in order to described trigger action information or wake voice messaging up and mate, if information matches success arbitrarily, then wake up.
Described sensor module 103 also comprises, sound identification module 10311, in order to receive the voice signal that user sends; Enquiry module 10312, in order to obtain the POI address of user's input according to described voice signal; Display translation module 10313, in order to retrieve according to described POI address, obtains result for retrieval; Voice interaction module 10314, in order to be fed back by described result for retrieval, waits for user's voice signal next time; According to described voice signal next time, in the result of described feedback, regioselective goes out order ground, completes navigation.Described sensor module 103, also comprise, direction sensor 10315, acceleration transducer 10316, GPS10319, temperature sensor 10317 and geomagnetic sensor 10318, described temperature sensor 10317 is in order to the temperature responded in car and dispel the heat, described geomagnetic sensor 10318 in order to detection side to, described direction sensor 10315 is in order to judge vehicle and advance or the direction of falling back and testing automobile operating range, described acceleration transducer 10316 is in order to the braking of vehicle, start detection, and described GPS10319 is in order to positioned vehicle position and map access.
Fig. 5 is the structural representation of processor module in Fig. 1.
Processor module in intelligent head-up-display system in the present embodiment comprises, treating apparatus 1041, for according to acquisition driver drives vehicle status information, forms view data, if described view data does not meet predetermined images of gestures standard, then described view data is not stored; If meet, then export gesture instruction after described view data being stored, and for according to described illumination value, judge whether that opening compensating light shines; If so, then open compensating light irradiate and again obtain the view data in driving environment.Described treating apparatus 1041 can provide processing power at a high speed, can adopt ARM4 core processor unit, supports microSD memory card maximum support 32GB simultaneously.HUD805, in order to provide the carrier of said apparatus.
In the present embodiment, particularly, the stationary state of gesture identifies based on two-dimentional hand-type; The identification of two dimension hand-type, based on two-dimentional aspect, needs not contain the two-dimensional signal of depth information as inputting in processing procedure.Just as the photograph of gained of taking pictures at ordinary times just contains two-dimensional signal, only need the two dimensional image using single camera to capture as input, then analyzed by the two dimensional image of computer vision technique to input, obtaining information, thus realize gesture identification.Those skilled in the art can understand, computer vision (ComputerVision, CV) in, the treatment technology of visual information depends on image processing method, and it comprises the contents such as image enhaucament, data encoding and transmission, level and smooth, edge sharpening, segmentation, feature extraction, image recognition and understanding.After these process, the quality of output image obtains the improvement of certain degree, has both improved the visual effect of image, and has been convenient to again computing machine and analyzes image, process and identify.Such as, obtain two-dimentional hand-type image by image acquisition, image enhaucament can be carried out to two-dimentional hand-type image, such as, can enhance picture contrast by histogram transformation, realize single channel image and strengthen, gradation of image threshold value is stretched to 0-255.And then carry out data encoding and transmission, this step is to compress image, and image smoothing fundamental purpose is denoising, and removing may factors such as () vehicle jolts, turn, dark causes because environmental factor image fault.Complete edge sharpening can adopt " image sharpening method based on rim detection ". Zeng Jialiang. method.After completing above-mentioned operation, feature extraction can be carried out again, the linear transformation carried out based on karhunen-Le Wei expansion can be adopted.Or employing nonlinear mapping technique, such as multidimensional scaling method and parameter mapping method.Finally can complete the identification of image.Further, after obtaining the two-dimensional signal on described two-dimentional hand-type, input obtains the first image; Can obtain two-dimensional signal after obtaining above-mentioned two-dimentional hand-type, the first image obtained is the image after image procossing, then carries out match cognization with the gesture preset; The gesture preset includes the images of gestures of all single, double hands, i.e. right-hand man or single hand.If find the second image with the first described images match, trigger action instruction; The second described image is the images of gestures prestored, if match cognization success, can trigger corresponding instruction, such as static gesture " 1 ", may correspond to instruction and plays music, then control HUD according to the result of coupling, carry out broadcasting music.Such as static gesture " fist ", corresponding can open navigation feature, then control HUD according to the result of coupling, after completing and waking up, starts to navigate.Particularly, when illumination in car is not enough, HUD can open compensating light photograph automatically, and points out driver again to carry out hand-type operation, or when driver does not also make the operation of instruction hand-type, opens compensating light photograph in advance, avoid secondary operation.The light path mode of above-mentioned adjustment can adopt " the intelligent dimming algorithm research of physically based deformation illumination variation reaction ". Chen Zhongyin. light modulation algorithm.
Described processor module 104 also comprises, wake command process module 1042, navigation instruction processing module 1043 up, telephone order processing module 1044, musical instruction processing module 1045, micro-letter command process module 1046, the function of processor module 104 is as follows: with phonetic order select your destination instruction, judge whether to hide block up route instructions, navigation come sourse instruction, driving road-condition instruction, cyberdog instruction; Wake command process module 1042 up, in order to wake the HUD of dormancy up; Telephone order, can send telephone order and carry out Voice command and answer, dial number, when called party's number of depositing is more than one time, and can voice selecting; Musical instruction, according to voice operating, can play the music of SD card, or broadcast station content; Whether micro-letter instruction, can log in micro-letter by barcode scanning in advance, have voice message and report when receiving micro-letter, converts word to during reply by phonetic entry, identification.Above-mentioned instruction all belongs to the operational order based on HUD: those skilled in the art can understand, includes but not limited to, the direct navigation of destination with the phonetic order appointment that selects your destination, or based on the address inquiring method of POI.Described navigation carrys out sourse instruction and includes but not limited to, selects the map supply business of the access of map, such as can select Gao De, or Baidu's map accesses.Navigation instruction processing module 1043 includes but not limited in order to process described driving road-condition instruction, the road conditions whether blocked up, the traffic signals of whether have red light, taking pictures, and whether curb parking, front whether can have pedestrian etc.Described cyberdog instruction, includes but not limited to the anti-velocity radar of full range, GPS cyberdog, GPS radar electric dog.Effect is the existence reminding car owner's electronic eyes or velocity radar in advance, can prevent because hypervelocity or in violation of rules and regulations imposed a fine and deduct points, and what allow driver have a defence enjoys Driving.Wake instruction up, in order to wake the HUD of dormancy up; Those skilled in the art can understand, gesture can be waken up instruction associate in advance with described, like this after making gesture, just can realize waking up HUD.Telephone order processing module 1044, in order to perform telephone order, can send telephone order and carry out Voice command and answer, dial number, when called party's number of depositing is more than one time, and can voice selecting; Such as after mobile phone is connected with HUD bluetooth, during external incoming call, can directly by the stationary state of gesture, such as " palm ", the also motion state of gestures available, such as " clench fist and slide to the right ", refuses or accept this logical incoming call.Musical instruction processing module 1045, in order to perform musical instruction, according to voice operating, can play the music of SD card, or broadcast station content; When such as using broadcast station content, can directly by the stationary state of gesture, such as " scissors hand ", the also motion state of gestures available, such as " clench fist and slide left ", switch music, increase sound etc.Whether micro-letter command process module 1046, in order to process micro-letter instruction, can log in micro-letter by barcode scanning in advance, have voice message and report when receiving micro-letter, is converted to and is asked word during reply by phonetic entry, identification.Can directly by the motion state of gesture, such as " slide to the right forefinger " sends micro-letter information.
Fig. 6 is the structural representation of natural-sounding interactive component in Fig. 1.
Natural-sounding interactive component 105 in intelligent head-up-display system in the present embodiment comprises, microphone 1051 and speech processing module 1052, described microphone 1051 is in order to transmit the natural-sounding information of driver to described speech processing module 1052, described speech processing module 1052 is in order to carry out the identification of natural-sounding information, synthesis and logical sessions, and the waking up of natural-sounding information.
Particularly, carry out the identification of natural-sounding information, synthesis comprises: voice interaction module, in order to be fed back by described result for retrieval, wait for user's voice signal next time; According to described voice signal next time, in the result of described feedback, regioselective goes out order ground, completes navigation.Voice signal next time, or voice signal first, can preset according to customizable personalized answer method.Before the use, the rules of competence and the content of auto answer are set, possible rule comprises: provide the contacts list that auto answer is served, and is the time period that each contact person provides auto answer to serve, the auto answer service range that each contact person can receive.Then authenticating caller identity, if determine that it has permission by automatic answering system obtaining information, then carries out subsequent step; Caller identities comprises: personal information, the data etc. pre-set.The specific implementation that data store can be divided into and being stored in local data base or server-side database.The speech data that further receiving caller's sends, uses automatic speech recognition module to carry out speech recognition; The conversation content of management and caller and dialog process.It, according to the data content that problem and the owner of caller's inquiry are arranged, automatic analysis goes out response content.This module can realize beyond the clouds, mobile terminal and high in the clouds mutual; Also can independently realize on mobile terminals.Further according to voice identification result, semantic analysis is used to analyze caller's intention; Further according to analyzing the caller's intention drawn, use rule and the content of the auto answer pre-set, or access third party's data and program, use semantic analysis to determine the content of text of replying, or perform corresponding operation to mobile terminal data; Finally, use phoneme synthesizing method, convert response content of text to speech data and send to caller.
Particularly, the logical sessions of described natural-sounding information in the present embodiment, can operate in accordance with the following steps:
1) receiving the voice signal that user sends, when receiving the voice signal of user, needing to carry out pre-service to device;
Pretreated step mainly comprises: waken up by the HUD be under dormant state, and the mode waken up includes but not limited to, manually wakes up, Voice command wakes up and adopt telepilot to wake up.The principle waken up includes but not limited to, the waking up of broadcast singal, the waking up of speech chip.HUD upon awakening can in order to receive the voice signal of user, and wherein those skilled in the art can understand, voice signal can include but not limited to, disyllabic word converges, such as " start, start " or with user-defined multisyllable vocabulary, such as " radish starts ".But according to monosyllabic vocabulary, such as " ", " ", " U.S. " etc., easily cause the inaccurate of speech recognition, or cause operand excessive to processing unit, thus HUD is caused to react slower.Specifically can use " Design and implementation based on the instruction interactive system of speech recognition and text segmentation methods " Zhang Wenjie. Zhang Honggang, realizes.
2) the POI address of user's input is obtained according to described voice signal; Voice signal is resolved, in order to obtain the POI address needed;
POI is the abbreviation of " PointOfInterest ", and each POI comprises cubic surface information, and title, classification, latitude, longitude, neighbouring business information, can be referred to as " navigation map information ".Near described, business information comprises: food and drink, hotel, amusement, bus station, subway station, refuelling station, parking lot, sight spot, bank, pharmacy's information.Intelligent extraction can obtain target keyword according to voice signal, described target keyword includes but not limited to, place word, modal particle, annexation word etc.Also need when carrying out target keyword and extracting to arrange " time parameter ", " person (name) parameter "." time parameter " etc." time parameter ", " person (name) parameter ", " weather parameters ", " time parameter " can be, " morning, noon, afternoon ", " person (name) parameter " can be Mr. Wang, Miss Wang, king two, Wang Yi, or associate with the contact person in driver's mobile phone and contact method, include but not limited to phoneme, syllable, word or sentence etc.
3) retrieve according to described POI address, obtain result for retrieval; Selectively POI address is called,
Such as, voice are " Wangfujing ", then POI address is then title; Such as voice are " shopping mall, market " again, then POI address is then classification.Voice are " north latitude 39.9, east longitude 116.4 " for another example, then POI address is then latitude, longitude, and voice are " going to neighbouring KFC " for another example, then POI address is then neighbouring business information.
4) described result for retrieval is fed back, wait for user's voice signal next time; The result for retrieval of described feedback may comprise multiple result for retrieval, need wait for user next time voice signal carry out selection again;
Such as, the voice signal of the first round is " the KFC dining room that meet with Miss Wang in the morning ", and the result obtained is the result for retrieval of feedback, may comprise:
" Zhong Guan-cun KFC dining room "
" Hai Dianhuang village KFC dining room "
" KFC of People's University dining room "
Wait for user's voice signal next time, user can to carry out after cross-searching feedback result again to the information in Query Result and schedule table by Selection radio such as " checking schedule table ", such as record in schedule table and meet in Zhong Guan-cun with Miss Wang, then Query Result can be fed back to user.
5) according to described voice signal next time, in the result of described feedback, regioselective goes out destination, completes navigation.Voice signal is in order to determine last destination next time, includes but not limited in upper once voice signal: the END instruction of the direct end dialog of instruction, again carries out the selection instruction selected.
Particularly, described waking up of natural-sounding information comprises the steps:
Speech message monitoring is carried out to driver, identify according to described speech message and wake voice messaging up, can operate according to following mode: set up voice activation storehouse by self-defined message, described self-defined message comprises, monosyllable or polysyllabic word, if listen to the self-defined message of coupling, and meet setting wake voice messaging condition up, then directly carry out waking rear wait up.Further, preferred as in the present embodiment, is transferred to the voice activation storehouse in automatic speech recognition system, in order to production language text (i.e. the corresponding character translation of voice) by phonetic entry when not proposing to inquire to user.Obtaining phonetic entry can according to the pick-up unit of vehicle interior, such as, with the radio reception microphone of signal processing apparatus being connected in downstream, receives the phonetic entry of user.After being the first numerical information by speech conversion driver sent, first numerical information is sent in the storage element being previously stored with voice document data base, by the voice document data base arranged in server, the voice obtained are identified, voice document data base is arranged on special in, so the memory capacity of voice document data base is no longer by the restriction of vehicle-mounted storer, and the memory capacity of storage element can be expanded, and avoid in vehicle-mounted storer because the navigation map storing multi-medium data and onboard navigation system causes to taking of memory storage space the defect that the storage space of storaged voice document data base is not enough further, making in voice document data base can the voice data of driver of the different accent of storage as much as possible, so add the identification possibility different accent driver being sent to voice, improve the practicality of vehicle-mounted voice identification interactive system.Be configured with ARM4 core CPU in HUD, internal memory 1GRAM, the processing speed to the identification of above-mentioned voice data can be ensured.In addition, the 8GROM of HUD configuration, and can support MicroSD (TF) memory card, maximum support 32,64,128G, the storage of voice document data base is given security.Preferred as in the present embodiment, natural-sounding interactive component 105 also comprises, noise reduction module 1053.Particularly, described noise reduction module 1053 comprises dual microphone noise reduction, Lou Shi high s/n ratio silicon wheat, by being integrated in microphone by ADC (analog to digital converter), enabling microphone self provide numeral to export, disturbing with noise decrease.
Those of ordinary skill in the field are to be understood that: more than; describedly be only specific embodiments of the invention, be not limited to the present invention, within the spirit and principles in the present invention all; any amendment of making, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (10)

1. an intelligent head-up-display system, is characterized in that, comprises, display module, image collection assembly, natural-sounding interactive component, sensor module and processor module,
Described display module comprises, projection module, imaging device and reflection unit, and described projection module, in order to emission of light; Described imaging device, in order to receive the emission of light of described projection module, and by picture being carried out imaging after two secondary reflections, and is transmitted into projection module; Described reflection unit, in order to amplify rear reimaging by described picture imaging;
Described image collection assembly comprises, first camera head, second camera head, driver status monitoring system, driving environment monitoring system, described first camera head, in order to obtain driver drives vehicle status information, described second camera head, in order to obtain the status information of vehicle periphery, described driver status monitoring system, carries out driver status monitoring in order to the information obtained according to the first camera head; Described driving environment monitoring system, carries out driving environment monitoring in order to the vehicle periphery state obtained according to the second camera head;
Described natural-sounding interactive component comprises, microphone and speech processing module, described microphone is in order to transmit the natural-sounding information of driver to described speech processing module, described speech processing module is in order to carry out the identification of natural-sounding information, synthesis and logical sessions, and the waking up of natural-sounding information;
Described sensor module, comprises, illumination induction installation, for obtaining the illumination value in driving environment;
Described processor module, comprises, treating apparatus, for according to acquisition driver drives vehicle status information, forms view data, if described view data does not meet predetermined images of gestures standard, does not then store described view data; If meet, then export gesture instruction after described view data being stored, and for according to described illumination value, judge whether that opening compensating light shines; If so, then open compensating light irradiate and again obtain the view data in driving environment;
Described display module is connected with described image collection assembly, and described sensor module is connected with described processor module, and described image collection assembly is connected with described processor module.
2. intelligent head-up-display system according to claim 1, it is characterized in that, also comprise map access module, in order to generate traffic navigation instruction alternately according to voice messaging, the navigation way of reference position and destination is set up according to described traffic navigation instruction, adopt the mode of simplifying to show described navigation way, described navigation way comprises running line inquiry and traffic route planning; When travelling up to destination from described reference position, auto zoom mode is adopted to show; According to described traffic navigation instruction, the mode of navigation circuit according to circuit classification is shown.
3. intelligent head-up-display system according to claim 1, it is characterized in that, also comprise the intelligent sex of view-based access control model and voice, Emotion identification detection system, individualized intelligent voice interactive system, carry out the Emotion identification of occupant according to facial image, and carry out the sex identification of occupant according to face; Carry out the Emotion identification of occupant according to the voice of people, and carry out the sex identification of occupant according to voice; In order to the result of described sex identification is carried out mating and is sent to individualized intelligent voice interactive system, and in order to the result of described Emotion identification is carried out merging and is sent to individualized intelligent voice interactive system; Interactive voice is carried out according to the matching result received and fusion results.
4. intelligent head-up-display system according to claim 1, it is characterized in that, described sensor module also comprises, collecting unit, in order to illumination brightness in inspection vehicle, user preference unit, in order to arrange user preference, self-regulation unit, carries out self-regulation in order to collect light intensity signal according to above-mentioned illumination brightness and carries out self-regulation in order to arrange brightness preference according to above-mentioned user preference; Display unit, for showing self-regulation brightness.
5. intelligent head-up-display system according to claim 1, it is characterized in that, described sensor module also comprises, gesture monitoring identification module, in order to carry out gestures detection to driver, trigger action information is gone out according to described gesture identification, audio monitoring identification module, in order to carry out speech message monitoring to driver, identify according to described speech message and wake voice messaging up, button monitoring modular, in order to monitor the button of association, if monitor button trigger message, then mate, wake module, in order to described trigger action information or wake voice messaging up and mate, if information matches success arbitrarily, then wake up.
6. intelligent head-up-display system according to claim 1, is characterized in that, described sensor module also comprises, sound identification module, in order to receive the voice signal that user sends; Enquiry module, in order to obtain the POI address of user's input according to described voice signal; Display translation module, in order to retrieve according to described POI address, obtains result for retrieval; Voice interaction module, in order to be fed back by described result for retrieval, waits for user's voice signal next time; According to described voice signal next time, in the result of described feedback, regioselective goes out order ground, completes navigation.
7. intelligent head-up-display system according to claim 1, it is characterized in that, described processor module also comprises, wake command process module, navigation instruction processing module up, telephone order processing module, musical instruction processing module, micro-letter command process module, comprise with phonetic order select your destination instruction, judge whether to hide block up route instructions, navigation come sourse instruction, driving road-condition instruction, cyberdog instruction; Wake command process module up, in order to wake the HUD of dormancy up; Telephone order, can send telephone order and carry out Voice command and answer, dial number, when called party's number of depositing is more than one time, and can voice selecting; Musical instruction, according to voice operating, can play the music of SD card, or broadcast station content; Whether micro-letter instruction, can log in micro-letter by barcode scanning in advance, have voice message and report when receiving micro-letter, converts word to during reply by phonetic entry, identification.
8. intelligent head-up-display system system according to claim 1, is characterized in that, also comprise the external equipment by wireless connections or wired connection, described external equipment comprises intelligent mobile terminal, drive recorder, automobile OBD equipment.
9. intelligent head-up-display system according to claim 1, it is characterized in that, described sensor module, also comprise, direction sensor, acceleration transducer, GPS, temperature sensor and geomagnetic sensor, described temperature sensor is in order to the temperature responded in car and dispel the heat, described geomagnetic sensor in order to detection side to, described direction sensor is in order to judge vehicle and advance or the direction of falling back and testing automobile operating range, described acceleration transducer is in order to the braking of vehicle, start detection, and described GPS is in order to positioned vehicle position and map access.
10. intelligent head-up-display system according to claim 1, it is characterized in that, described display module comprises base, radiation shield, LCD display device and catoptron, the upside of described base is provided with LCD display device, in order to show the frame of vehicle, and frame is projected to described catoptron, described catoptron is inclined to set in the horizontal direction relative to described LCD display device, reflect after receiving described frame, the left side of described base is provided with radiation shield, in order to amplify and to show frame.
CN201610012601.3A 2016-01-08 2016-01-08 A kind of intelligence head-up-display system Active CN105527710B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610012601.3A CN105527710B (en) 2016-01-08 2016-01-08 A kind of intelligence head-up-display system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610012601.3A CN105527710B (en) 2016-01-08 2016-01-08 A kind of intelligence head-up-display system

Publications (2)

Publication Number Publication Date
CN105527710A true CN105527710A (en) 2016-04-27
CN105527710B CN105527710B (en) 2018-11-20

Family

ID=55770035

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610012601.3A Active CN105527710B (en) 2016-01-08 2016-01-08 A kind of intelligence head-up-display system

Country Status (1)

Country Link
CN (1) CN105527710B (en)

Cited By (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106226905A (en) * 2016-08-23 2016-12-14 北京乐驾科技有限公司 A kind of head-up display device
CN106335454A (en) * 2016-09-29 2017-01-18 北京汽车股份有限公司 Vehicle and setting method of vehicle driving habit of driver
CN106347221A (en) * 2016-09-30 2017-01-25 广东威创视讯科技股份有限公司 Vehicle-mounted head-up display device
CN106707512A (en) * 2016-12-26 2017-05-24 北京悉见科技有限公司 Intelligent AR (Augmented Reality) system with low power consumption and intelligent AR glasses
CN106767887A (en) * 2017-02-13 2017-05-31 上海荧瑞光电科技有限公司 A kind of HUD onboard navigation systems
CN106740473A (en) * 2016-12-13 2017-05-31 中国航空工业集团公司洛阳电光设备研究所 A kind of vehicle-mounted small-sized HUD head-up-display systems
CN106950696A (en) * 2017-04-21 2017-07-14 苏州车萝卜汽车电子科技有限公司 The head-up display device and its implementation of a kind of split type installation
CN107719306A (en) * 2017-09-30 2018-02-23 深圳市创康安科技有限公司 A kind of intelligent vehicle-mounted system
CN107885810A (en) * 2017-01-24 2018-04-06 问众智能信息科技（北京）有限公司 The method and apparatus that result for vehicle intelligent equipment interactive voice is shown
CN108116309A (en) * 2016-11-07 2018-06-05 法乐第(北京)网络科技有限公司 Interior reading lamp method of adjustment, device, system and electronic equipment
CN108171673A (en) * 2018-01-12 2018-06-15 京东方科技集团股份有限公司 Image processing method, device, vehicle-mounted head-up-display system and vehicle
CN108181992A (en) * 2018-01-22 2018-06-19 北京百度网讯科技有限公司 Voice awakening method, device, equipment and computer-readable medium based on gesture
CN108229345A (en) * 2017-12-15 2018-06-29 吉利汽车研究院（宁波）有限公司 A kind of driver's detecting system
CN108279500A (en) * 2018-02-02 2018-07-13 深圳市恒晨电器有限公司 Embedded head up display based on laser light source
CN108334871A (en) * 2018-03-26 2018-07-27 深圳市布谷鸟科技有限公司 The exchange method and system of head-up display device based on intelligent cockpit platform
CN108459520A (en) * 2018-02-02 2018-08-28 斑马网络技术有限公司 Automatic displaying method and its system for vehicle
CN108594698A (en) * 2018-03-14 2018-09-28 深圳市火乐科技发展有限公司 A kind of method for controlling projection and device of adaptation different platform projecting apparatus
CN108759854A (en) * 2018-04-28 2018-11-06 苏州车萝卜汽车电子科技有限公司 Method for processing navigation information and device, virtual reality head-up display device
CN109050396A (en) * 2018-07-16 2018-12-21 浙江合众新能源汽车有限公司 A kind of vehicle intelligent robot
CN109598948A (en) * 2019-01-16 2019-04-09 谢宝建 A kind of new vehicle automatic segmentation speed limit solution
CN109633911A (en) * 2019-01-18 2019-04-16 黄山徽岭电子科技有限公司 A kind of Teaching Experience device and its experiencing system based on VR technology
CN110194108A (en) * 2019-05-29 2019-09-03 中国第一汽车股份有限公司 Display color regulation method, head-up-display system and the vehicle of head-up-display system
CN110213730A (en) * 2019-05-22 2019-09-06 未来（北京）黑科技有限公司 Call establishment of connection method and device, storage medium, electronic device
CN110620840A (en) * 2018-06-20 2019-12-27 阿里巴巴集团控股有限公司 Call processing method, device, terminal equipment and storage medium
WO2020019231A1 (en) * 2018-07-26 2020-01-30 Bayerische Motoren Werke Aktiengesellschaft Apparatus and method for use with vehicle
CN111124198A (en) * 2018-11-01 2020-05-08 广州汽车集团股份有限公司 Animation playing and interaction method, device, system and computer equipment
CN111591223A (en) * 2020-04-26 2020-08-28 中国第一汽车股份有限公司 Height adjusting method and system for head-up display image and vehicle
CN111696548A (en) * 2020-05-13 2020-09-22 深圳追一科技有限公司 Method and device for displaying driving prompt information, electronic equipment and storage medium
CN111696561A (en) * 2020-05-27 2020-09-22 一汽奔腾轿车有限公司 Voice interaction system and method based on auditory, visual and olfactory feedback
CN112861677A (en) * 2021-01-28 2021-05-28 上海商汤临港智能科技有限公司 Method and device for detecting actions of rail transit driver, equipment, medium and tool
EP3726395A4 (en) * 2017-12-15 2021-07-21 NIO (Anhui) Holding Co., Ltd. Vehicle-mounted music matching method and apparatus, and vehicle-mounted intelligent controller
CN114454814A (en) * 2022-01-26 2022-05-10 深圳时空科技集团有限公司 Human-computer interaction method and device for augmented reality
US11698535B2 (en) 2020-08-14 2023-07-11 Hes Ip Holdings, Llc Systems and methods for superimposing virtual image on real-time image
US11774759B2 (en) 2020-09-03 2023-10-03 Hes Ip Holdings, Llc Systems and methods for improving binocular vision
CN116923425A (en) * 2023-08-01 2023-10-24 深圳市哲思特科技有限公司 New energy automobile intelligent cabin with intelligent sensing system and control method thereof
US11953689B2 (en) 2020-09-30 2024-04-09 Hes Ip Holdings, Llc Virtual image display system for virtual reality and augmented reality devices

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102707801A (en) * 2012-05-07 2012-10-03 广东好帮手电子科技股份有限公司 Vehicle-mounted recognition control system and control method thereof
CN102910130A (en) * 2012-10-24 2013-02-06 浙江工业大学 Actually-enhanced driver-assisted early warning system
US20130141250A1 (en) * 2011-12-02 2013-06-06 GM Global Technology Operations LLC Driving maneuver assist on full windshield head-up display
CN203544376U (en) * 2013-06-24 2014-04-16 惠州市华阳多媒体电子有限公司 Split head-up display
CN104348851A (en) * 2013-07-25 2015-02-11 惠州市华阳多媒体电子有限公司 Interconnection system of head up display and mobile terminal
CN104567897A (en) * 2013-10-16 2015-04-29 大陆汽车投资（上海）有限公司 Road condition forecast combined path planning method and navigation device
CN104865703A (en) * 2014-02-25 2015-08-26 崔海龙 High Brightness Head-up Display Device
CN205720871U (en) * 2016-01-08 2016-11-23 北京乐驾科技有限公司 A kind of intelligence head-up-display system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130141250A1 (en) * 2011-12-02 2013-06-06 GM Global Technology Operations LLC Driving maneuver assist on full windshield head-up display
CN102707801A (en) * 2012-05-07 2012-10-03 广东好帮手电子科技股份有限公司 Vehicle-mounted recognition control system and control method thereof
CN102910130A (en) * 2012-10-24 2013-02-06 浙江工业大学 Actually-enhanced driver-assisted early warning system
CN203544376U (en) * 2013-06-24 2014-04-16 惠州市华阳多媒体电子有限公司 Split head-up display
CN104348851A (en) * 2013-07-25 2015-02-11 惠州市华阳多媒体电子有限公司 Interconnection system of head up display and mobile terminal
CN104567897A (en) * 2013-10-16 2015-04-29 大陆汽车投资（上海）有限公司 Road condition forecast combined path planning method and navigation device
CN104865703A (en) * 2014-02-25 2015-08-26 崔海龙 High Brightness Head-up Display Device
CN205720871U (en) * 2016-01-08 2016-11-23 北京乐驾科技有限公司 A kind of intelligence head-up-display system

Cited By (53)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018035974A1 (en) * 2016-08-23 2018-03-01 北京乐驾科技有限公司 Head-up display device
US11079594B2 (en) 2016-08-23 2021-08-03 Beijing Ileja Tech. Co. Ltd. Head-up display device
CN106226905A (en) * 2016-08-23 2016-12-14 北京乐驾科技有限公司 A kind of head-up display device
CN106335454A (en) * 2016-09-29 2017-01-18 北京汽车股份有限公司 Vehicle and setting method of vehicle driving habit of driver
CN106347221A (en) * 2016-09-30 2017-01-25 广东威创视讯科技股份有限公司 Vehicle-mounted head-up display device
CN106347221B (en) * 2016-09-30 2019-04-16 广东威创视讯科技股份有限公司 Vehicle-mounted head-up display device
CN108116309A (en) * 2016-11-07 2018-06-05 法乐第(北京)网络科技有限公司 Interior reading lamp method of adjustment, device, system and electronic equipment
CN106740473A (en) * 2016-12-13 2017-05-31 中国航空工业集团公司洛阳电光设备研究所 A kind of vehicle-mounted small-sized HUD head-up-display systems
CN106707512A (en) * 2016-12-26 2017-05-24 北京悉见科技有限公司 Intelligent AR (Augmented Reality) system with low power consumption and intelligent AR glasses
CN106707512B (en) * 2016-12-26 2023-10-27 中科海微(北京)科技有限公司 Low-power consumption intelligent AR system and intelligent AR glasses
CN107885810A (en) * 2017-01-24 2018-04-06 问众智能信息科技（北京）有限公司 The method and apparatus that result for vehicle intelligent equipment interactive voice is shown
CN106767887A (en) * 2017-02-13 2017-05-31 上海荧瑞光电科技有限公司 A kind of HUD onboard navigation systems
WO2018192259A1 (en) * 2017-04-21 2018-10-25 苏州车萝卜汽车电子科技有限公司 Split-mounted head-up display apparatus and implementation method therefor
CN106950696A (en) * 2017-04-21 2017-07-14 苏州车萝卜汽车电子科技有限公司 The head-up display device and its implementation of a kind of split type installation
CN107719306A (en) * 2017-09-30 2018-02-23 深圳市创康安科技有限公司 A kind of intelligent vehicle-mounted system
EP3726395A4 (en) * 2017-12-15 2021-07-21 NIO (Anhui) Holding Co., Ltd. Vehicle-mounted music matching method and apparatus, and vehicle-mounted intelligent controller
CN108229345A (en) * 2017-12-15 2018-06-29 吉利汽车研究院（宁波）有限公司 A kind of driver's detecting system
CN108171673B (en) * 2018-01-12 2024-01-23 京东方科技集团股份有限公司 Image processing method and device, vehicle-mounted head-up display system and vehicle
US11120531B2 (en) 2018-01-12 2021-09-14 Boe Technology Group Co., Ltd. Method and device for image processing, vehicle head-up display system and vehicle
CN108171673A (en) * 2018-01-12 2018-06-15 京东方科技集团股份有限公司 Image processing method, device, vehicle-mounted head-up-display system and vehicle
CN108181992A (en) * 2018-01-22 2018-06-19 北京百度网讯科技有限公司 Voice awakening method, device, equipment and computer-readable medium based on gesture
US10783364B2 (en) 2018-01-22 2020-09-22 Beijing Baidu Netcom Science And Technology Co., Ltd. Method, apparatus and device for waking up voice interaction function based on gesture, and computer readable medium
CN108459520B (en) * 2018-02-02 2022-02-15 斑马网络技术有限公司 Automatic display method for vehicle and system thereof
CN108279500A (en) * 2018-02-02 2018-07-13 深圳市恒晨电器有限公司 Embedded head up display based on laser light source
CN108459520A (en) * 2018-02-02 2018-08-28 斑马网络技术有限公司 Automatic displaying method and its system for vehicle
CN108594698A (en) * 2018-03-14 2018-09-28 深圳市火乐科技发展有限公司 A kind of method for controlling projection and device of adaptation different platform projecting apparatus
CN108594698B (en) * 2018-03-14 2021-08-31 深圳市火乐科技发展有限公司 Projection control method and device adaptive to projectors of different platforms
CN108334871A (en) * 2018-03-26 2018-07-27 深圳市布谷鸟科技有限公司 The exchange method and system of head-up display device based on intelligent cockpit platform
CN108759854A (en) * 2018-04-28 2018-11-06 苏州车萝卜汽车电子科技有限公司 Method for processing navigation information and device, virtual reality head-up display device
CN110620840A (en) * 2018-06-20 2019-12-27 阿里巴巴集团控股有限公司 Call processing method, device, terminal equipment and storage medium
CN109050396A (en) * 2018-07-16 2018-12-21 浙江合众新能源汽车有限公司 A kind of vehicle intelligent robot
WO2020019231A1 (en) * 2018-07-26 2020-01-30 Bayerische Motoren Werke Aktiengesellschaft Apparatus and method for use with vehicle
CN112513708A (en) * 2018-07-26 2021-03-16 宝马股份公司 Apparatus and method for use with a vehicle
US11858526B2 (en) 2018-07-26 2024-01-02 Bayerische Motoren Werke Aktiengesellschaft Apparatus and method for use with vehicle
CN112513708B (en) * 2018-07-26 2023-02-21 宝马股份公司 Apparatus and method for use with a vehicle
CN111124198A (en) * 2018-11-01 2020-05-08 广州汽车集团股份有限公司 Animation playing and interaction method, device, system and computer equipment
CN109598948A (en) * 2019-01-16 2019-04-09 谢宝建 A kind of new vehicle automatic segmentation speed limit solution
CN109633911B (en) * 2019-01-18 2020-10-30 黄山徽岭电子科技有限公司 Teaching experience device based on VR technique and experience system thereof
CN109633911A (en) * 2019-01-18 2019-04-16 黄山徽岭电子科技有限公司 A kind of Teaching Experience device and its experiencing system based on VR technology
CN110213730A (en) * 2019-05-22 2019-09-06 未来（北京）黑科技有限公司 Call establishment of connection method and device, storage medium, electronic device
CN110194108A (en) * 2019-05-29 2019-09-03 中国第一汽车股份有限公司 Display color regulation method, head-up-display system and the vehicle of head-up-display system
CN111591223A (en) * 2020-04-26 2020-08-28 中国第一汽车股份有限公司 Height adjusting method and system for head-up display image and vehicle
CN111696548A (en) * 2020-05-13 2020-09-22 深圳追一科技有限公司 Method and device for displaying driving prompt information, electronic equipment and storage medium
CN111696561A (en) * 2020-05-27 2020-09-22 一汽奔腾轿车有限公司 Voice interaction system and method based on auditory, visual and olfactory feedback
US11698535B2 (en) 2020-08-14 2023-07-11 Hes Ip Holdings, Llc Systems and methods for superimposing virtual image on real-time image
US11822089B2 (en) 2020-08-14 2023-11-21 Hes Ip Holdings, Llc Head wearable virtual image module for superimposing virtual image on real-time image
US11774759B2 (en) 2020-09-03 2023-10-03 Hes Ip Holdings, Llc Systems and methods for improving binocular vision
US11953689B2 (en) 2020-09-30 2024-04-09 Hes Ip Holdings, Llc Virtual image display system for virtual reality and augmented reality devices
CN112861677A (en) * 2021-01-28 2021-05-28 上海商汤临港智能科技有限公司 Method and device for detecting actions of rail transit driver, equipment, medium and tool
CN114454814B (en) * 2022-01-26 2023-08-11 深圳时空数字科技有限公司 Human-computer interaction method and device for augmented reality
CN114454814A (en) * 2022-01-26 2022-05-10 深圳时空科技集团有限公司 Human-computer interaction method and device for augmented reality
CN116923425A (en) * 2023-08-01 2023-10-24 深圳市哲思特科技有限公司 New energy automobile intelligent cabin with intelligent sensing system and control method thereof
CN116923425B (en) * 2023-08-01 2024-06-04 深圳市哲思特科技有限公司 New energy automobile intelligent cabin with intelligent sensing system and control method thereof

Also Published As

Publication number Publication date
CN105527710B (en) 2018-11-20

Similar Documents

Publication Publication Date Title
CN105527710A (en) Intelligent head-up display system
CN205720871U (en) A kind of intelligence head-up-display system
CN109416733B (en) Portable personalization
US11335210B2 (en) Apparatus and method for analyzing images
US10149132B2 (en) Pedestrial crash prevention system and operation method thereof
US10462568B2 (en) Terminal and vehicle control method of mobile terminal using machine learning
CN106226905B (en) A kind of head-up display device
US10875525B2 (en) Ability enhancement
CN105509761B (en) A kind of more wheel interactive voice navigation methods and systems
CN105501121A (en) Intelligent awakening method and system
KR20190030731A (en) Command processing using multimode signal analysis
CN113302664A (en) Multimodal user interface for a vehicle
CN105700682A (en) Intelligent gender and emotion recognition detection system and method based on vision and voice
KR20140007282A (en) Speech recognition apparatus and method thereof
KR20170014586A (en) Mobile terminal and method for controlling the same
KR20160094096A (en) Vehicle, Vehicle operating method and wearable device operating method
CN104875680A (en) HUD (head up display) device combining voice and video recognition
CN112269939B (en) Automatic driving scene searching method, device, terminal, server and medium
KR20140118221A (en) User recognition apparatus and method thereof
KR101859043B1 (en) Mobile terminal, vehicle and mobile terminal link system
EP4328765A1 (en) Method and apparatus for recommending vehicle driving strategy
CN112506353A (en) Vehicle interaction system, method, storage medium and vehicle
WO2023236691A1 (en) Control method based on vehicle external audio system, vehicle intelligent marketing method, electronic apparatus, and storage medium
US20220198518A1 (en) Systems And Methods For Displaying Targeted Advertisements On A Vehicle
WO2024046353A2 (en) Presentation control method, device for in-vehicle glass of vehicle, and vehicle

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 102208 Beijing city Changping District Huilongguan Longyu street 1 hospital floor A loe Center No. 1 floor 5 Room 518

Applicant after: BEIJING LEJIA TECHNOLOGY CO., LTD.

Address before: 100193 Beijing City, northeast of Haidian District, South Road, No. 29, building 3, room 3, room 3558

Applicant before: BEIJING LEJIA TECHNOLOGY CO., LTD.

GR01 Patent grant
GR01 Patent grant