CN107776579A - A kind of direct feeling driver status alarm set - Google Patents

A kind of direct feeling driver status alarm set Download PDF

Info

Publication number
CN107776579A
CN107776579A CN201710825212.7A CN201710825212A CN107776579A CN 107776579 A CN107776579 A CN 107776579A CN 201710825212 A CN201710825212 A CN 201710825212A CN 107776579 A CN107776579 A CN 107776579A
Authority
CN
China
Prior art keywords
module
driver
driver status
alarm
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710825212.7A
Other languages
Chinese (zh)
Inventor
张惠
丁志鹏
张宇航
邱少波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
FAW Group Corp
Original Assignee
FAW Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by FAW Group Corp filed Critical FAW Group Corp
Priority to CN201710825212.7A priority Critical patent/CN107776579A/en
Publication of CN107776579A publication Critical patent/CN107776579A/en
Pending legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/06Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818Inactivity or incapacity of driver
    • B60W2040/0827Inactivity or incapacity of driver due to sleepiness
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143Alarm means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146Display means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/22Psychological state; Stress level or workload
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/26Incapacity

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Auxiliary Drives, Propulsion Controls, And Safety Devices (AREA)
  • Emergency Alarm Devices (AREA)

Abstract

The invention discloses a kind of direct feeling driver status alarm set, is made up of camera module, on-vehicle information module, driver status judge module, driver status warning module, new line display module and the part of sound alarm module six;Camera module is gathered with exporting driver's face video data and sending to driver status judge module, on-vehicle information module is by vehicle-mounted CAN bus transfer vehicle information data and sends to driver status judge module, driver status judge module integrates driver's face video data and information of vehicles, determine the state grade of driver, and state grade is sent to driver status warning module, alarm mode is determined according to the state grade that driver status judge module is sent, and transmit a signal to new line display module and sound alarm module, new line display module and sound alarm module provide to come back according to the alarm mode of determination shows that alarm or new line display combine audible alarm.

Description

A kind of direct feeling driver status alarm set
Technical field
The present invention relates to a kind of direct feeling driver status alarm set, belongs to automotive safety and comfortable, electronical display skill Art field.
Background technology
Growing day by day with car ownership, traffic accident is continuously increased, and the quality of driver status is to influence to hand over Interpreter thus a major reason, if driver fatigue occurs, diverted attention and the abnormal condition such as changeable in mood, easily during driving Trigger traffic accident and cause economic loss, or even threat to life.In addition, with the demand more and more higher of people, to safety Increasingly pay attention to, directly can effectively carry out driver status if a kind of and show and the apparatus and method of prompting, will be very big Driving safety is improved in degree and lifts the quality of the life of people.
At present, in the market has some driver status monitoring systems, but generally directed to be driver fatigue state, and adopt With than more conventional alerting pattern, such as Volvo, benz, it can show alert icon in instrument when driver fatigue or pass through Sound carries out early warning.But the mode of alert icon is shown in the instrument viewing, it is necessary to which driver bows, now pilot's line of vision meeting Vehicle front road conditions are left, potential safety hazard be present;And early warning is carried out by sound, people can be allowed to feel very unexpected, and much drive Accessory system (ADAS) is sailed by the way of voice reminder, too many voice reminder easily causes driver to obscure.
The content of the invention
The present invention proposes a kind of direct feeling driver status alarm set, can carry out driver status and show and prompting, For fatigue, divert attention is applicable with the driver status type such as changeable in mood, is combined with new line Display Technique, and description is driven The information of member's state is shown in driver and need not bowed in front of the driving that can see in real time, quick, directly perceived, effectively, more Driving safety is improved well, avoids accident.
The present invention is achieved by the following scheme:
A kind of direct feeling driver status alarm set, judged by camera module, on-vehicle information module, driver status Module, driver status warning module, new line display module and the part of sound alarm module six composition;Camera module gather with Export driver's face video data and send to driver status judge module, on-vehicle information module and pass through vehicle-mounted CAN bus Transmit vehicle information data and send to driver status judge module, driver status judge module synthesis driver's face and regard Frequency evidence and information of vehicles, determine the state grade of driver, and state grade is sent to driver status warning module, root The state grade sent according to driver status judge module determines alarm mode, and transmits a signal to new line display module harmony Sound alarm module, new line display module and sound alarm module provide to come back according to the alarm mode of determination shows alarm or new line Display combines audible alarm.
A kind of described direct feeling driver status alarm set, driver status judge module progress image preprocessing, Face recognition, eye recognition, head pose angular estimation and condition adjudgement and output procedure:The camera module is gathered Video data is examined after the pretreatment such as noise reduction by ADABOOST cascade classifiers, ASM active shape models, Harris angle points Survey, Sobel rim detections, fitting of a polynomial algorithm carry out face and eye recognition, and driver is estimated using geometrical face model Attitude angle, and judge driver's operation behavior with reference to the information of vehicles that the on-vehicle information module provides, obtained according to analysis Driver status threshold value, judge the fatigue of driver, divert attention or the state grade of anxious state of mind.
A kind of described direct feeling driver status alarm set, the state grade of driver status judge module judge knot Fruit is divided into " good ", " bad " and " very bad " three major types according to degree of danger, while between " good " and " bad " Two state grades are segmented out, two state grades are also segmented out between " bad " and " very bad ", totally seven states etc. Level.
A kind of described direct feeling driver status alarm set, the new line that new line display module provides show alarm bag Include:When driver status changes, new line display module shows that column is sought ways to return sb.'s kindness police in front of the driving of vehicle driver.
Described a kind of direct feeling driver status alarm set, before block diagram alarm is included in the driving of vehicle driver Three energy posts of square real-time display, the color of three energy posts are each with the change of state using green, orange, red three kinds Energy post can gradually change color, for representing different state grades, when energy post is all red and maintains scheduled duration, Audible alarm module starts audible alarm and combined with new line display alarm.
Advantage of the invention is that:1. for fatigue, divert attention is applicable with the driver status type such as changeable in mood;2. pass through The color change of three column icons (hereinafter referred to as " energy post "), describes the change of driver status, according further to driving Member's state adds sound early warning to the influence degree of safe driving, direct feeling display interface intuitive display, readily understood, improves Driver comfort;3. being combined with new line Display Technique, the information for describing driver status is included in driver in real time Need not be bowed the driving front that can be seen.Therefore, the present invention reminds quick, directly perceived, effective, preferably improves driving peace Entirely, accident is avoided, there is good economic benefit and social benefit.
Brief description of the drawings
Fig. 1 driver status reminds overall flow (framework) figure
Fig. 2 is used for the block diagram alarm energy post display schematic diagram for describing driver status
Fig. 3 driver status transition logic figures
Embodiment
Embodiments of the present invention are illustrated below in conjunction with the accompanying drawings.
As shown in figure 1, a kind of direct feeling driver status alarm set, mainly by camera module 11, on-vehicle information mould Block 12, driver status judge module 13, driver status warning module 14, new line display module 15 and sound alarm module 16 Six parts form.Camera module 11 gathers passes through vehicle-mounted CAN with output driver's face video data, on-vehicle information module 12 Bus transfer vehicle information data (such as speed information, steering wheel angle information), the synthesis of driver status judge module 13 are driven The person of sailing determines the state grade of driver with information of vehicles, and state grade is divided into seven grades, and driver status warning module 14 determines The alarm mode of corresponding driver status grade, and by correlation signal transmission to new line display module 15 and sound alarm module 16, carry out display and the audible alarm of block diagram.
The camera module 11 is made up of a camera and infrared light compensating lamp, and it is used to gather driver's upper half in real time Body and facial video data, the driver being filmed is real-time transmitted to driver status including facial video above the waist and judged Module 13.
The on-vehicle information module 12 obtains information of vehicles (such as:Speed, steering wheel angle etc.), and information is sent in real time To driver status judge module 13.
Driver status judge module 13 judges the current driving condition of driver, and will determine that result passes to driver's shape State warning module 14.Driver status judge module 13 carries out image preprocessing, face recognition, eye recognition, head pose angle The process such as estimation and condition adjudgement and output, by the video data of camera module collection after the pretreatment such as noise reduction, pass through ADABOOST cascade classifiers, ASM active shape models, Harris Corner Detections, Sobel rim detections, fitting of a polynomial phase Close algorithm and carry out face and eye recognition, estimate driver gestures angle using the methods of geometrical face model, and combine vehicle-mounted letter The information of vehicles that breath module provides judges whether driver has and plays the associative operation behaviors such as steering wheel, is finally obtained according to behavioural analysis The driver status threshold value arrived, the fatigue of comprehensive descision driver, divert attention or the state grade of anxious state of mind.
The state grade judged result of driver status judge module 13 is divided into three major types according to degree of danger, and they are Well, it is bad and very bad, at the same it is good with it is bad between again segment out two state grades, it is bad with it is very bad Between also segment out two state grades, so come to seven state grades.By taking driver fatigue state type as an example, if Driver regains consciousness, then is " good " state;When feature of the driver with slight fatigue, but driving is not brought very big Influence, then well to arrive two grades of bad;Start to change normally on vehicle when the fatigue of driver starts to be reacted to When driving behavior, then be " bad " state;When the fatigue state of driver is increasingly severe, then it is presented as bad to very not Two grades between good;When the fatigue state of driver continues deterioration and reached almost to lose normal driving ability, then for " very It is bad " state.
The state grade that the driver status warning module 14 is sent according to driver status judge module determines needs The alarm mode taken, and signal is passed into new line display module and sound alarm module.
New line display module 15 and sound alarm module 16 provide new line according to the alarm mode of determination and show alarm or lift Head display combines audible alarm.The present invention mainly uses two kinds of alarm modes of vision and the sense of hearing.Wherein, in visual aspects, when driving During the person's of sailing state change, new line display module shows that column is sought ways to return sb.'s kindness police in front of the driving of vehicle driver, block diagram alarm bag Three energy posts of the real-time display in front of the driving of vehicle driver are included, the color of three energy posts uses green, orange, red three Kind, seven kinds of different state grades are represented respectively, and these three colors have good warning function, meet standard requirement;In addition, Present invention adds sound early warning, when energy post be all it is red and through driver status after a while without improvement in the case of, Audible alarm module can start audible alarm.
Fig. 2 is block diagram alarm energy post display schematic diagram, is named as " energy post ".According to driver from well to very Seven grades of bad state, devise seven width figures altogether.Every width figure is made up of three energy posts, with each energy of the change of state Amount post can gradually change color, and energy post figure can be in complete green, Fig. 2 (a);Complete orange Fig. 2 (d);And between complete red Fig. 2 (g) constantly Switch, energy post display representative " good " state in Fig. 2 (a), energy post display representative " bad " state, Fig. 2 (g) in Fig. 2 (d) The display of middle energy post represents " very bad " state, Fig. 2 (b) energy posts into Fig. 2 (f) show represent respectively from " good " to " bad " arrives the state of " very bad " change, example:Energy post color is green, green, yellow in Fig. 2 (b), and energy post in Fig. 2 (c) Color is green, yellow, yellow, illustrates that " bad " state that Fig. 2 (c) is represented is more serious than " bad " state that Fig. 2 (b) is represented.
Driver status transition logic figure is illustrated in figure 3, describes the process of driver status transformation.Come back and show mould The judged result that the energy post shown in block can provide according to driver status judge module dynamically changes color, if necessary sound Sound alarm module can also start.By taking driver fatigue state type as an example, when driver status judge module judges driver's shape State grade is " good ", then three energy posts are all green;When driver status judge module judges driver status for " no It is good " and continue 5 seconds, 1 energy post begins to change into crocus, if driver status continues to remain " bad " and continues 5 Second, second energy post is changed into crocus, if the state duration of " bad " reaches 15 seconds, three energy posts are changed into Crocus, afterwards, when driver status is judged as " good " and continues 5 seconds, 1 energy post becomes green again again, works as driving Member's state continues to preserve " good " when reaching 5 seconds, and second energy post also becomes green again, and this " good " state continues 5 seconds again, and three Root energy post is all changed into green again.
When three energy posts are all crocus, driver status judge module gives " bad " state and holding 5 again Second, an energy post can be changed into red, if driver status continues as " bad " and continues 5 seconds, second energy post can become Red, by that analogy, if the state duration of " bad " reaches 15 seconds, three energy posts are changed into red, driver's shape State enters " very bad " state;When driver status enter " very bad " state, i.e.,:Energy post is three red columns, and And continue driver status in 3 seconds and do not improve also, then three energy posts start to flash, and driver does not react still after flicker 3 seconds, Then sound early warning is sent while energy post flashes.

Claims (5)

1. a kind of direct feeling driver status alarm set, it is characterised in that by camera module, on-vehicle information module, drive Member's condition judgment module, driver status warning module, new line display module and the part of sound alarm module six composition;Camera Module gathers passes through car with output driver's face video data and transmission to driver status judge module, on-vehicle information module Carry CAN transmission vehicle information data and send to driver status judge module, driver status judge module synthesis and drive The person's of sailing face video data and information of vehicles, the state grade of driver is determined, and state grade is sent to driver status Warning module, alarm mode is determined according to the state grade that driver status judge module is sent, and transmit a signal to new line Display module and sound alarm module, new line display module and sound alarm module provide to come back according to the alarm mode of determination to be shown Warn report or come back display combine audible alarm.
A kind of 2. direct feeling driver status alarm set as claimed in claim 1, it is characterised in that the driver status Judge module carries out image preprocessing, face recognition, eye recognition, head pose angular estimation and condition adjudgement and exported Journey:By the video data that the camera module gathers after the pretreatment such as noise reduction, pass through ADABOOST cascade classifiers, ASM Active shape model, Harris Corner Detections, Sobel rim detections, fitting of a polynomial algorithm carry out face and eye recognition, profit Driver gestures angle is estimated with geometrical face model, and judges driver with reference to the information of vehicles that the on-vehicle information module provides Operation behavior, obtained driver status threshold value, judge the fatigue of driver, divert attention or the state grade of anxious state of mind.
A kind of 3. direct feeling driver status alarm set as claimed in claim 1, it is characterised in that the driver status The state grade judged result of judge module is divided into " good ", " bad " and " very bad " three major types according to degree of danger, Two state grades are segmented out between " good " and " bad " simultaneously, two are also segmented out between " bad " and " very bad " Individual state grade, totally seven state grades.
4. a kind of direct feeling driver status alarm set as claimed in claim 1, it is characterised in that described come back shows mould The new line that block provides shows that alarm includes:When driver status changes, new line display module is before the driving of vehicle driver Side shows that column is sought ways to return sb.'s kindness police.
A kind of 5. direct feeling driver status alarm set as claimed in claim 4, it is characterised in that the block diagram alarm It is included in three energy posts of real-time display in front of the driving of vehicle driver, the color of three energy posts is using green, orange, red Three kinds, as each energy post of the change of state can gradually change color, for representing different state grades, when energy post is complete For red and scheduled duration is maintained, audible alarm module starts audible alarm and combined with new line display alarm.
CN201710825212.7A 2017-09-14 2017-09-14 A kind of direct feeling driver status alarm set Pending CN107776579A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710825212.7A CN107776579A (en) 2017-09-14 2017-09-14 A kind of direct feeling driver status alarm set

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710825212.7A CN107776579A (en) 2017-09-14 2017-09-14 A kind of direct feeling driver status alarm set

Publications (1)

Publication Number Publication Date
CN107776579A true CN107776579A (en) 2018-03-09

Family

ID=61437973

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710825212.7A Pending CN107776579A (en) 2017-09-14 2017-09-14 A kind of direct feeling driver status alarm set

Country Status (1)

Country Link
CN (1) CN107776579A (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108423004A (en) * 2018-05-16 2018-08-21 浙江吉利控股集团有限公司 A kind of binocular identification driver status detecting system and method
CN108764169A (en) * 2018-05-31 2018-11-06 厦门大学 A kind of driver's Emotion identification based on machine learning and display device and method
CN109407845A (en) * 2018-10-30 2019-03-01 盯盯拍(深圳)云技术有限公司 Screen exchange method and screen interactive device
CN110525456A (en) * 2019-08-07 2019-12-03 北京全路通信信号研究设计院集团有限公司 A kind of train safe driving monitoring system and method
CN110544368A (en) * 2018-05-31 2019-12-06 深圳疆程技术有限公司 fatigue driving augmented reality early warning device and early warning method
CN110908576A (en) * 2018-09-18 2020-03-24 阿里巴巴集团控股有限公司 Vehicle system/vehicle application display method and device and electronic equipment
CN111222444A (en) * 2019-12-31 2020-06-02 的卢技术有限公司 Augmented reality head-up display method and system considering emotion of driver
CN111508046A (en) * 2020-03-13 2020-08-07 重庆利龙科技产业(集团)有限公司 Vehicle alarm icon drawing method and system based on OpenG L and storage medium
CN112613181A (en) * 2020-12-28 2021-04-06 浙江天行健智能科技有限公司 Driving state modeling method based on simulated driver and ANN algorithm
WO2021147590A1 (en) * 2020-01-22 2021-07-29 同济大学 Safety assistance function-oriented vehicle-mounted head-up display system
CN113954860A (en) * 2020-07-01 2022-01-21 丰田自动车株式会社 Display and sound output control system
WO2022048139A1 (en) * 2020-09-02 2022-03-10 上海本安仪表系统有限公司 Vehicle-mounted human-computer interface having face and emotion recognition functions

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102741088A (en) * 2011-01-06 2012-10-17 福特全球技术公司 Information display system and method
CN103400471A (en) * 2013-08-12 2013-11-20 电子科技大学 Detecting system and detecting method for fatigue driving of driver
CN103479367A (en) * 2013-09-09 2014-01-01 广东工业大学 Driver fatigue detection method based on facial action unit recognition
CN105654753A (en) * 2016-01-08 2016-06-08 北京乐驾科技有限公司 Intelligent vehicle-mounted safe driving assistance method and system
CN106353886A (en) * 2016-10-12 2017-01-25 惠州市华阳多媒体电子有限公司 Intelligent head up display of automobile
CN106408878A (en) * 2016-12-16 2017-02-15 苏州清研微视电子科技有限公司 Vehicle anticollision pre-warning system considering driver fatigue state and response capability
CN106541915A (en) * 2016-11-28 2017-03-29 墨宝股份有限公司 A kind of electric automobile safety pre-warning system and its method for early warning

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102741088A (en) * 2011-01-06 2012-10-17 福特全球技术公司 Information display system and method
CN103400471A (en) * 2013-08-12 2013-11-20 电子科技大学 Detecting system and detecting method for fatigue driving of driver
CN103479367A (en) * 2013-09-09 2014-01-01 广东工业大学 Driver fatigue detection method based on facial action unit recognition
CN105654753A (en) * 2016-01-08 2016-06-08 北京乐驾科技有限公司 Intelligent vehicle-mounted safe driving assistance method and system
CN106353886A (en) * 2016-10-12 2017-01-25 惠州市华阳多媒体电子有限公司 Intelligent head up display of automobile
CN106541915A (en) * 2016-11-28 2017-03-29 墨宝股份有限公司 A kind of electric automobile safety pre-warning system and its method for early warning
CN106408878A (en) * 2016-12-16 2017-02-15 苏州清研微视电子科技有限公司 Vehicle anticollision pre-warning system considering driver fatigue state and response capability

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108423004A (en) * 2018-05-16 2018-08-21 浙江吉利控股集团有限公司 A kind of binocular identification driver status detecting system and method
CN108764169A (en) * 2018-05-31 2018-11-06 厦门大学 A kind of driver's Emotion identification based on machine learning and display device and method
CN110544368B (en) * 2018-05-31 2021-08-03 合肥疆程技术有限公司 Fatigue driving augmented reality early warning device and early warning method
CN110544368A (en) * 2018-05-31 2019-12-06 深圳疆程技术有限公司 fatigue driving augmented reality early warning device and early warning method
CN110908576A (en) * 2018-09-18 2020-03-24 阿里巴巴集团控股有限公司 Vehicle system/vehicle application display method and device and electronic equipment
CN109407845A (en) * 2018-10-30 2019-03-01 盯盯拍(深圳)云技术有限公司 Screen exchange method and screen interactive device
WO2021023198A1 (en) * 2019-08-07 2021-02-11 北京全路通信信号研究设计院集团有限公司 Train safety driving monitoring system and method
CN110525456A (en) * 2019-08-07 2019-12-03 北京全路通信信号研究设计院集团有限公司 A kind of train safe driving monitoring system and method
CN111222444A (en) * 2019-12-31 2020-06-02 的卢技术有限公司 Augmented reality head-up display method and system considering emotion of driver
WO2021147590A1 (en) * 2020-01-22 2021-07-29 同济大学 Safety assistance function-oriented vehicle-mounted head-up display system
CN111508046A (en) * 2020-03-13 2020-08-07 重庆利龙科技产业(集团)有限公司 Vehicle alarm icon drawing method and system based on OpenG L and storage medium
CN111508046B (en) * 2020-03-13 2023-08-22 重庆利龙中宝智能技术有限公司 Vehicle alarm icon drawing method, system and storage medium based on OpenGL
CN113954860A (en) * 2020-07-01 2022-01-21 丰田自动车株式会社 Display and sound output control system
WO2022048139A1 (en) * 2020-09-02 2022-03-10 上海本安仪表系统有限公司 Vehicle-mounted human-computer interface having face and emotion recognition functions
CN112613181A (en) * 2020-12-28 2021-04-06 浙江天行健智能科技有限公司 Driving state modeling method based on simulated driver and ANN algorithm
CN112613181B (en) * 2020-12-28 2023-05-23 浙江天行健智能科技有限公司 Driving state modeling method based on simulated driver and ANN algorithm

Similar Documents

Publication Publication Date Title
CN107776579A (en) A kind of direct feeling driver status alarm set
CN108791299B (en) Driving fatigue detection and early warning system and method based on vision
CN104599443B (en) A kind of driving behavior early warning car-mounted terminal and its method for early warning based on information fusion
CN106709420A (en) Method for monitoring driving behaviors of driver of commercial vehicle
CN104408879B (en) Method, device and system for processing fatigue driving early warning
CN105678961B (en) The automobile safety alarm system and alarming method for power of a kind of anti-fatigue-driving
CN108819945A (en) A kind of automatic driving vehicle adapter tube suggestion device and method
CN109035718A (en) The dangerous driving behavior grading forewarning system method of multifactor fusion
CN110532976A (en) Method for detecting fatigue driving and system based on machine learning and multiple features fusion
CN108154101A (en) The fatigue driving detecting system and method for a kind of multi-parameter fusion
CN106585624A (en) Driver state monitoring method and device
CN107585026A (en) A kind of anti-fatigue-driving system
CN102930693A (en) Early warning system and method for safe driving
CN105389948A (en) System and method for preventing fatigue driving of driver
CN105956548A (en) Driver fatigue state detection method and device
CN106467057B (en) The method, apparatus and system of lane departure warning
CN101722852A (en) Driving safety monitoring apparatus and method
CN106157537A (en) Anti-fatigue-driving system
CN110194107A (en) A kind of vehicle intelligent back-sight visual system of integrative display and warning function
CN105931430A (en) Alarm sensitivity detection method and apparatus for driver state early warning system
CN109367540A (en) A kind of driver's response identifying system based on Risk-warning
CN108573210A (en) A kind of alarming method for fatigue drive and device
CN110533883A (en) A kind of fatigue drive prompting system and method
CN106564429A (en) Fatigue driving determination device and method
CN111583609A (en) Differential setting method for early warning strategy

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180309

RJ01 Rejection of invention patent application after publication