CN107458381A - A kind of motor vehicle driving approval apparatus based on artificial intelligence - Google Patents

A kind of motor vehicle driving approval apparatus based on artificial intelligence Download PDF

Info

Publication number
CN107458381A
CN107458381A CN201710601191.0A CN201710601191A CN107458381A CN 107458381 A CN107458381 A CN 107458381A CN 201710601191 A CN201710601191 A CN 201710601191A CN 107458381 A CN107458381 A CN 107458381A
Authority
CN
China
Prior art keywords
driver
microprocessor
motor vehicle
voice
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710601191.0A
Other languages
Chinese (zh)
Inventor
张开生
赵小芬
薛杨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shaanxi University of Science and Technology
Original Assignee
Shaanxi University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shaanxi University of Science and Technology filed Critical Shaanxi University of Science and Technology
Priority to CN201710601191.0A priority Critical patent/CN107458381A/en
Publication of CN107458381A publication Critical patent/CN107458381A/en
Pending legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818Inactivity or incapacity of driver
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0872Driver physiology
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0881Seat occupation; Driver or passenger presence

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Mathematical Physics (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Traffic Control Systems (AREA)

Abstract

A kind of motor vehicle driving approval apparatus based on artificial intelligence, including pressure sensor, microphone, camera, Intelligent voice dialog system, band touch function liquid crystal display and microprocessor, Intelligent voice dialog system calls pre-stored sound bite to play out, driver is gathered using microphone and interacts answer content with what the sound bite was carried out, and driver can also be selected to be answered the question on band touch function liquid crystal display;Using the facial expression of camera collection driver, answer content and facial expression based on driver, judge whether the mood of driver is stablized;It is if unstable, microprocessor exports refusal ignition signal to ignition controller, current automobile can not normal ignition, the present invention sets human facial expression recognition system in motor vehicle, it can judge whether driver permits to drive according to the expression of driver, avoid the generation of the dangerous accident caused by driver's abnormal feeling.

Description

A kind of motor vehicle driving approval apparatus based on artificial intelligence
Technical field
The invention belongs to motor vehicle driving management and control technical field, more particularly to a kind of motor vehicle driving based on artificial intelligence Approval apparatus.
Background technology
With the development of science and technology motor vehicle industry is quickly grown, increasing people has the private car of oneself, passes It is made up of inside the automobile driving cabin of system steering wheel, seat, automobile instrument panel etc., still, a series of potential safety hazard is also deposited , such as, driver drives to be extremely unsafe in the state of emotional instability, but in current vehicle, not Such a system being present so that human pilot can not drive in the state of emotional instability, and it is clear that driver's feelings It is especially unsafe to be driven in the case that thread is unstable.
The content of the invention
The shortcomings that in order to overcome above-mentioned prior art, it is an object of the invention to provide a kind of based on the motor-driven of artificial intelligence Car drives approval apparatus, and the mood of driver can be judged according to the language and expression of driver, and unhappy in driver When refusal igniting, so as to prevent due to unexpected traffic accident caused by driver's emotional instability.
To achieve these goals, the technical solution adopted by the present invention is:
A kind of motor vehicle driving approval apparatus based on artificial intelligence, including:
Pressure sensor 1, is laid under seat, perceives seating pressure;
Microphone 2, gather the voice messaging of driver;
Camera 3, gather the facial expression information of driver;
Intelligent voice dialog system 7, with driver's two-way call, guiding driver provides voice output;
Microprocessor 5, it is connected, connects with the pressure sensor 1, microphone 2, camera 3 and Intelligent voice dialog system 7 The pressure signal for receiving pressure sensor 1 judges whether driver's seat has driver, if any then startup camera 3 and intelligent sound pair Telephone system 7, Intelligent voice dialog system 7 call pre-stored sound bite to play out, using microphone 2 gather driver with The interaction that the sound bite is carried out replies content, and the facial expression of driver, answering based on driver are gathered using camera 3 Multiple content and facial expression, judge whether the mood of driver is stablized;
Ignition controller 9, it is connected with the microprocessor 5, when the microprocessor 5 judges the mood of driver for shakiness Regularly, refusal ignition signal is exported to ignition controller 9, current automobile can not normal ignition.
The answer content and facial expression based on driver, judge that the method whether mood of driver is stablized includes Audio recognition method and human facial expression recognition method, wherein:
Audio recognition method step is:
In the firm operating motor vehicles of driver, " voice answer study " pattern is first passed through, allows motor vehicle driving licensing system It is familiar with the pronunciation of driver, and is remembered;
After microphone 2 collects voice signal, voice signal is converted into electric signal and inputted to microprocessor 5, is carried out pre- Processing;
There is speech model that the characteristic voice based on people is established in microprocessor 5 and based on speech model to input The sound template needed for the speech recognition that required feature is established is analyzed and extracted to voice signal;During identification, by sound template Compared with the feature of the voice signal of input, according to certain search and matching strategy, find out it is a series of it is optimal with it is defeated Enter the template of voice match, then according to the definition of this template, result is identified by tabling look-up;
Human facial expression recognition method and step is:
Promising Expression Recognition algorithm provides material and the expression storehouse of foundation is provided for algorithm performance test in microprocessor 5, During identification, identification face is caught using camera 3, then microprocessor 5 is analyzed the pixel for forming face-image, first By the shading value of each pixel compared with consecutive points, region of the shading value to surrounding in radiomutation is searched, sketches the contours area The position of each pixel in domain, Expression Recognition result is obtained according to expression storehouse.
In the audio recognition method, pretreatment is the pre-filtering processing that voice signal is carried out before sampling, it is therefore an objective to Suppress interference components in each frequency of signal.
In the human facial expression recognition method, specific algorithm is:The first step, color space is carried out to the head portrait collected and turned Change, row pixel and row pixel are set;Second step:Compareed with the expression storehouse of system, calculate average and covariance;3rd step:Meter Calculate barycenter and deflection angle;4th step:Find out the border of image-region;5th step:Seek origin coordinates;6th step:Carry out mould Plate matches, and produces the gray level image of a covering face.
Also include photosensitive sensor 4, illumination condition information in collecting vehicle, if in-car illumination condition is less than setting value, open Motor-car intraoral illumination lamp 6, room light lamp 6 set two side positions in the car.
Also include camera position adjuster 8, orientation regulation, the branch of camera 3 are carried out according to the facial positions of driver Frame is provided with the shaft coupling for the evolution that can carry out 360 degrees omnidirection, and microprocessor 5 is examined according to the structure distribution feature of face Face is surveyed, then extracts these features into corresponding rule to judge that whether face location is in suitable in the image detected Position, if face location is not on centre, output signal control shaft coupling can carry out position adjustments up and down, directly The centre of camera 3 is in face position.
Present invention additionally comprises band touch function liquid crystal display 19, it is connected with the microprocessor 5, when the microprocessor When device 5 is putd question to, driver can select to answer the question on band touch function liquid crystal display 19, with abandon driver directly with System is answered.
Compared with prior art, the present invention sets human facial expression recognition system in motor vehicle, can be according to the table of driver Feelings judge whether driver permits to drive, and avoid the generation of the dangerous accident caused by driver's abnormal feeling.
Brief description of the drawings
Fig. 1 is hardware frame figure of the present invention.
Fig. 2 is schematic structural view of the invention.
Fig. 3 is flow chart of the present invention.
Fig. 4 is on-board engine firing circuit figure of the present invention.
Embodiment
Describe embodiments of the present invention in detail with reference to the accompanying drawings and examples.
As shown in figure 1, a kind of motor vehicle driving approval apparatus based on artificial intelligence, including:
Pressure sensor 1, perceive the pressure on seat;
Microphone 2, gather the voice messaging of driver;
Camera 3, gather the facial expression information of driver;
Photosensitive sensor 4, sense in-car light, if bright good, in-car two-side lighting lamp is not turned on, if in-car light It is dark, then automatically turn on illuminating lamp 6.
Intelligent voice dialog system 7, with driver's two-way call, guiding driver provides voice output;
The information of all inputs passes through microprocessor 5, is processed, handles.Controlled and shone according to the data of photosensitive sensor 4 The automatic opening of bright lamp 6 and angle adjustment;
According to the positional information of driver's face, the shooting orientation of the regulation camera 3 of camera position adjuster 8 is utilized.
Judge the timing of driver's emotional lability in microprocessor 5, motor vehicle refusal igniting is controlled using ignition controller 9.
Its device is specific as shown in Fig. 2 in-car mainly include left front illuminating lamp 10, right front lamp 11, and camera 3 is left Rearview mirror 13, right rear view mirror 14, steering wheel 15, pilot set 16, the passenger side seat 17 and car door 18.
Pressure sensor 1 is arranged under pilot set 16, and sensed pressure judges whether there is driving on pilot set 16 Member, if any then automatically turning on Intelligent voice dialog system 7.
Photosensitive sensor 4 perceives in-car light intensity, and illuminating lamp 6 is made up of left front illuminating lamp 10 and right front lamp 11, Left front illuminating lamp 10 and right front lamp 11 are positioned on the upper left side and upper right side of driver's cabin, bad at night or in-car light In the case of automatically turn on, camera 3 is preferably gathered image information.
Microphone 2 is located on steering wheel 15, convenient preferably to collect voice messaging.
Camera 3 is arranged on the front position of operating seat, convenient preferably to gather head image information, delivers to microprocessor Device 5 carries out human facial expression recognition and data analysis.
Reference picture 3, according to the present invention, after driver gets on the bus, pressure sensor 1 perceives the pressure on seat, automatically Open Intelligent voice dialog system 7.Automatically turn on the meeting of Intelligent voice dialog system 7 shuffle and go out the joke first to prestore, or It is to broadcast first sad story.Or based on the question content to prestore, engaged in the dialogue at random with human pilot, in dialogue Rong Li, happy thing, sad thing can be related to as the case may be.Such as following scene:
Scene one:Intelligent voice dialog system 7:" your good owner, it is very happy to meet again!Why may I ask your mood of today Sample" if driver replies the in high mood of today, possible Intelligent voice dialog system 7 can ask:" owner runs into today What happy thing, could share with me, it is a robot that not see me ".Next may say:" owner, You want to go to where" and then may ask that " you intend go there what does”
Scene two:Intelligent voice dialog system 7:" Hello, hello by owner, and I has learned to tell funny stories recently, owner I say Listened to you ".Then can ask:" owner, you think that I say how”.Next may ask:" owner, you are disagreeable People whom isMe is stealthily told, I can never tell others ".It may finally allow driver to imitate most to beg for Some features of the people detested.
Before dialogue, " voice answers study " pattern can be first passed through, allows motor vehicle driving licensing system to be familiar with driver's Pronunciation, and remembered, just then engaging in the dialogue, this is to learn the voice of different drivers custom.
In whole process, camera 3 can gather all facial expression informations, and this information is delivered into microprocessor 5 is carried out Human facial expression recognition, analysis, processing.Thus judge whether the driver can now drive, when driver speaks, voice meeting Being identified at once, voice will be immediately encoded, and turn into the digital document of a compression, wherein all useful information are included, All will be by Intelligent Recognition.
In dialog procedure, the facial expression of driver will carry out head portrait acquisition by camera 3, then pass through detection Module is detected to the image of input, and the possible orientation of face is scanned in the picture, identify, positioned.Pass through inspection Survey module and obtain the face-image without background, and have indignation using this as research object, the basic mood of people, detest, probably Fear, it is happy, it is sad and surprised.And the human facial expression recognition system in microprocessor 5, it is to resolve into the facial expression of driver Multiple Facial action units, these independent facial units can not represent any emotion, but utilize combinations thereof special Sign can carry out the identification of some facial expressions.
For example, if driver has only affected greater zygomatic muscle when laughing at, then, now driver is exactly certainly phoney, Because a sincere smile is in addition to greater zygomatic muscle, also orbicular muscle of eye can also be affected.Other expressions are in this approach It can judge.When the expression for identifying driver is sad, angry or abnormal exciting.Voice system will be reported: " sorry, you do not allow now to drive " and close automobile engine now.
The method of speech recognition is after microphone collects acoustic information, first by voice signal be converted to electric signal be added in it is micro- The input of processor, by pretreatment, pretreatment is the pre-filtering processing that voice signal is carried out before sampling, suppresses signal Interference components in each frequency;Speech model is established further according to the characteristic voice of people, the voice signal of input is analyzed, and takes out Required feature is taken, establishes the template needed for speech recognition on this basis.System will be according to speech recognition in identification process Model, by the sound template deposited in system compared with the feature of the voice signal inputted, according to certain search and Matching strategy, find out a series of optimal templates with inputting voice match.Then according to the definition of this template, by tabling look-up just The recognition result of system can be provided.
Following processing method is employed in system:
(1) Extended Precision is carried out in the higher place of required precision, the intermediate variable of calculating is used into 32b, or even 48b To represent.So, it can greatly improve operational precision in the case where instruction strip number increase is few.(2) pseudo- floating point is used To represent floating number, i.e., represent floating number with the method for mantissa+index.This method for representing data has sufficiently large data Scope, the requirement of data precision can be met.
Human facial expression recognition technical basis expression storehouse, expression storehouse not only can provide material for Expression Recognition algorithm, and Foundation can be provided for the performance test of various algorithms.The method of human facial expression recognition is to catch identification people first with camera Face, then system to form face-image pixel analyze.It is compared the shading value of each pixel with consecutive points Compared with region of the lookup shading value to surrounding in radiomutation.In the feature of brow ridge, eyes or other projections.System will be sketched the contours Go out the position of each this pixel.Specific algorithm is:It is empty that the head portrait that the first step collects to shooting figure first carries out color Between conversion, row pixel and row pixel are set.Second step:Compareed with the expression storehouse of system, calculate average and covariance.3rd Step:Calculate barycenter and deflection angle.4th step:Find out the border of image-region.5th step:Seek origin coordinates.6th step:Enter The matching of row template, produce the gray level image of a covering face.
In the entire system, intelligent voice system, human facial expression recognition system and automobile engine triplicity are got up, In order to accurately collect the facial information of people, the special front that camera 3 is arranged on to driver.In order to facilitate night Image information can be preferably collected, one illuminating lamp is installed respectively on the upper left side of automobile cab and upper right side, illuminated Used in the case that situation is bad.
Fig. 4 is on-board engine firing circuit figure of the present invention, crystal oscillator X1, ceramic disc capacitor C1, ceramic disc capacitor C2 groups Into clock oscillation circuit, clock signal is provided for LPC2103.Electrochemical capacitor C4 and resistance R1 composition LPC2103 electrification reset electricity Road.On-board engine firing circuit is installed on motor vehicle.By RL1, triode, resistance and structure crystal diode etc. is waited to form, When relay in coil without it is electric when, the contact of off-state is that normally opened contact, the contact of closure state are normally-closed contacts, When the information judged via human facial expression recognition system be this driver fail by test, when disapproving operating motor vehicles, Microprocessor control relay makes its contact be disconnection form, and engine can not be activated, conversely, when human pilot has passed through survey During examination, when allowable drivers drive, microprocessor control relay contact is closed form, is now lighted a fire, and starts function to be opened It is dynamic.

Claims (7)

  1. A kind of 1. motor vehicle driving approval apparatus based on artificial intelligence, it is characterised in that including:
    Pressure sensor (1), is laid under seat, perceives seating pressure;
    Microphone (2), gather the voice messaging of driver;
    Camera (3), gather the facial expression information of driver;
    Intelligent voice dialog system (7), with driver's two-way call, guiding driver provides voice output;
    Microprocessor (5), with the pressure sensor (1), microphone (2), camera (3) and Intelligent voice dialog system (7) Connection, receive pressure sensor (1) pressure signal judge whether driver's seat has driver, if any, then startup camera (3) and Intelligent voice dialog system (7), Intelligent voice dialog system (7) call pre-stored sound bite to play out, utilize Mike Wind (2) gathers driver and interacts answer content with what the sound bite was carried out, utilizes camera (3) to gather the face of driver Expression, answer content and facial expression based on driver, judges whether the mood of driver is stablized;
    Ignition controller (9), it is connected with the microprocessor (5), when the microprocessor (5) judges the mood of driver for not When stable, refusal ignition signal is exported to ignition controller (9), current automobile can not normal ignition.
  2. 2. the motor vehicle driving approval apparatus based on artificial intelligence according to claim 1, it is characterised in that described to be based on driving The answer content and facial expression for the person of sailing, judge that the method whether mood of driver is stablized includes audio recognition method and face Expression recognition method, wherein:
    Audio recognition method step is:
    In the firm operating motor vehicles of driver, " voice answers study " pattern is first passed through, allows motor vehicle driving licensing system to be familiar with The pronunciation of driver, and remembered;
    After microphone (2) collects voice signal, voice signal is converted into electric signal and inputted to microprocessor (5), is carried out pre- Processing;
    There are the speech model that the characteristic voice based on people is established and the language based on speech model to input in microprocessor (5) The sound template needed for the speech recognition that required feature is established is analyzed and extracted to sound signal;During identification, by sound template with The feature of the voice signal of input is compared, and according to certain search and matching strategy, is found out a series of optimal with input The template of voice match, then according to the definition of this template, result is identified by tabling look-up;
    Human facial expression recognition method and step is:
    Promising Expression Recognition algorithm provides material and the expression storehouse of foundation is provided for algorithm performance test in microprocessor (5), knows When other, identification face is caught using camera (3), then microprocessor (5) is analyzed the pixel for forming face-image, first First by the shading value of each pixel compared with consecutive points, region of the shading value to surrounding in radiomutation is searched, is sketched the contours The position of each pixel in region, Expression Recognition result is obtained according to expression storehouse.
  3. 3. the motor vehicle driving approval apparatus based on artificial intelligence according to claim 2, it is characterised in that the voice is known In other method, pretreatment is the pre-filtering processing that voice signal is carried out before sampling, it is therefore an objective to suppresses to do in each frequency of signal Disturb component.
  4. 4. the motor vehicle driving approval apparatus based on artificial intelligence according to claim 2, it is characterised in that the facial table In feelings recognition methods, specific algorithm is:The first step, color space conversion is carried out to the head portrait collected, row pixel and row are set Pixel;Second step:Compareed with the expression storehouse of system, calculate average and covariance;3rd step:Calculate barycenter and deflection angle Degree;4th step:Find out the border of image-region;5th step:Seek origin coordinates;6th step:Template matches are carried out, one is produced and covers The gray level image of lid face.
  5. 5. the motor vehicle driving approval apparatus based on artificial intelligence according to claim 1, it is characterised in that also including photosensitive Sensor (4), illumination condition information in collecting vehicle, if in-car illumination condition is less than setting value, start room light lamp (6), Room light lamp (6) sets two side positions in the car.
  6. 6. the motor vehicle driving approval apparatus based on artificial intelligence according to claim 1, it is characterised in that also include shooting Head position control (8), orientation regulation is carried out according to the facial positions of driver, the support of camera (3) is provided with and can carried out The shaft coupling of the evolution of 360 degrees omnidirection, microprocessor (5) is according to the structure distribution feature detection face of face, then These features are extracted into corresponding rule to judge whether face location is in suitable position in the image detected, if face Position is not on centre, then output signal control shaft coupling can carry out position adjustments up and down, until face position Put the centre in camera (3).
  7. 7. the motor vehicle driving approval apparatus based on artificial intelligence according to claim 1, it is characterised in that also include band and touch Function liquid crystal display (19) is touched, is connected with the microprocessor (5), when the microprocessor (5) is putd question to, driver can To select to answer the question on band touch function liquid crystal display (19), directly answered with abandoning driver with system.
CN201710601191.0A 2017-07-21 2017-07-21 A kind of motor vehicle driving approval apparatus based on artificial intelligence Pending CN107458381A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710601191.0A CN107458381A (en) 2017-07-21 2017-07-21 A kind of motor vehicle driving approval apparatus based on artificial intelligence

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710601191.0A CN107458381A (en) 2017-07-21 2017-07-21 A kind of motor vehicle driving approval apparatus based on artificial intelligence

Publications (1)

Publication Number Publication Date
CN107458381A true CN107458381A (en) 2017-12-12

Family

ID=60546345

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710601191.0A Pending CN107458381A (en) 2017-07-21 2017-07-21 A kind of motor vehicle driving approval apparatus based on artificial intelligence

Country Status (1)

Country Link
CN (1) CN107458381A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108638980A (en) * 2018-05-23 2018-10-12 上海闻泰电子科技有限公司 Vehicle startup system, method and automobile
CN110091874A (en) * 2019-05-07 2019-08-06 绍兴天宏激光科技有限公司 A kind of safety driving system and recognition methods based on Expression Recognition
CN110626261A (en) * 2018-06-25 2019-12-31 郑州宇通客车股份有限公司 Vehicle power-on method and system and vehicle
CN110837819A (en) * 2019-11-21 2020-02-25 北京健康有益科技有限公司 Fatigue degree detecting system based on artificial intelligence
CN112991718A (en) * 2019-12-13 2021-06-18 丰田自动车株式会社 Driver assistance device, non-transitory storage medium storing driver assistance program, and driver assistance system
US11151900B2 (en) 2018-10-22 2021-10-19 RaceVoice LLC Method and apparatus for generating voice guidance in a race vehicle

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1122687A2 (en) * 2000-01-25 2001-08-08 Nec Corporation Emotion expressing device
CN103593054A (en) * 2013-11-25 2014-02-19 北京光年无限科技有限公司 Question-answering system combining emotion recognition and output
CN105599607A (en) * 2016-02-05 2016-05-25 长安大学 Device and method for starting vehicle based on driver state
CN105700682A (en) * 2016-01-08 2016-06-22 北京乐驾科技有限公司 Intelligent gender and emotion recognition detection system and method based on vision and voice
CN105760852A (en) * 2016-03-14 2016-07-13 江苏大学 Driver emotion real time identification method fusing facial expressions and voices
CN106469297A (en) * 2016-08-31 2017-03-01 北京小米移动软件有限公司 Emotion identification method, device and terminal unit
CN206124986U (en) * 2016-10-12 2017-04-26 德尔福电子(苏州)有限公司 Automobile staring device based on face identification and discernment of vocal print cloud
CN106650633A (en) * 2016-11-29 2017-05-10 上海智臻智能网络科技股份有限公司 Driver emotion recognition method and device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1122687A2 (en) * 2000-01-25 2001-08-08 Nec Corporation Emotion expressing device
CN103593054A (en) * 2013-11-25 2014-02-19 北京光年无限科技有限公司 Question-answering system combining emotion recognition and output
CN105700682A (en) * 2016-01-08 2016-06-22 北京乐驾科技有限公司 Intelligent gender and emotion recognition detection system and method based on vision and voice
CN105599607A (en) * 2016-02-05 2016-05-25 长安大学 Device and method for starting vehicle based on driver state
CN105760852A (en) * 2016-03-14 2016-07-13 江苏大学 Driver emotion real time identification method fusing facial expressions and voices
CN106469297A (en) * 2016-08-31 2017-03-01 北京小米移动软件有限公司 Emotion identification method, device and terminal unit
CN206124986U (en) * 2016-10-12 2017-04-26 德尔福电子(苏州)有限公司 Automobile staring device based on face identification and discernment of vocal print cloud
CN106650633A (en) * 2016-11-29 2017-05-10 上海智臻智能网络科技股份有限公司 Driver emotion recognition method and device

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108638980A (en) * 2018-05-23 2018-10-12 上海闻泰电子科技有限公司 Vehicle startup system, method and automobile
CN110626261A (en) * 2018-06-25 2019-12-31 郑州宇通客车股份有限公司 Vehicle power-on method and system and vehicle
US11151900B2 (en) 2018-10-22 2021-10-19 RaceVoice LLC Method and apparatus for generating voice guidance in a race vehicle
CN110091874A (en) * 2019-05-07 2019-08-06 绍兴天宏激光科技有限公司 A kind of safety driving system and recognition methods based on Expression Recognition
CN110837819A (en) * 2019-11-21 2020-02-25 北京健康有益科技有限公司 Fatigue degree detecting system based on artificial intelligence
CN112991718A (en) * 2019-12-13 2021-06-18 丰田自动车株式会社 Driver assistance device, non-transitory storage medium storing driver assistance program, and driver assistance system

Similar Documents

Publication Publication Date Title
CN107458381A (en) A kind of motor vehicle driving approval apparatus based on artificial intelligence
CN109941231B (en) Vehicle-mounted terminal equipment, vehicle-mounted interaction system and interaction method
CN114445888A (en) Vehicle-mounted interaction system based on emotion perception and voice interaction
CN111341349B (en) Emotion estimation device, emotion estimation method, and storage medium
JP6964044B2 (en) Learning device, learning method, program, trained model and lip reading device
CN102324035A (en) Method and system of applying lip posture assisted speech recognition technique to vehicle navigation
CN109606386A (en) Cockpit in intelligent vehicle
EP4163913A1 (en) In-vehicle voice instruction control method, and related device
DE102005041261A1 (en) User greeting system for a motor vehicle
CN115205729A (en) Behavior recognition method and system based on multi-mode feature fusion
CN113459943A (en) Vehicle control method, device, equipment and storage medium
CN115195637A (en) Intelligent cabin system based on multimode interaction and virtual reality technology
CN114043939B (en) Vehicle-mounted central control system using holographic projection technology and control method
CN111797755A (en) Automobile passenger emotion recognition method and electronic equipment
CN207059776U (en) A kind of motor vehicle driving approval apparatus
CN113128295A (en) Method and device for identifying dangerous driving state of vehicle driver
CN114286479A (en) Scene-based in-vehicle light control method and system and readable storage medium
CN115205917A (en) Man-machine interaction method and electronic equipment
CN113715728A (en) Control system and system of reading lamp in vehicle and vehicle
CN112319483A (en) Driving state improving device and driving state improving method
CN116567895A (en) Vehicle-mounted atmosphere lamp control method and device, electronic equipment and vehicle
CN111605479A (en) Emotion-sensing and self-adjusting interior atmosphere lamp system and control method
WO2023231211A1 (en) Voice recognition method and apparatus, electronic device, storage medium, and product
CN112418162B (en) Method, device, storage medium and apparatus for controlling vehicle
CN115402333A (en) In-vehicle interaction control system and method based on driver emotion and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20171212