CN111613329A - Driver state monitoring system - Google Patents

Driver state monitoring system Download PDF

Info

Publication number
CN111613329A
CN111613329A CN202010377906.0A CN202010377906A CN111613329A CN 111613329 A CN111613329 A CN 111613329A CN 202010377906 A CN202010377906 A CN 202010377906A CN 111613329 A CN111613329 A CN 111613329A
Authority
CN
China
Prior art keywords
data
driver
psychological
physiological
computing unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010377906.0A
Other languages
Chinese (zh)
Inventor
王明亮
崔海洋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chery Automobile Co Ltd
Original Assignee
Chery Automobile Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chery Automobile Co Ltd filed Critical Chery Automobile Co Ltd
Priority to CN202010377906.0A priority Critical patent/CN111613329A/en
Publication of CN111613329A publication Critical patent/CN111613329A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • A61B5/0015—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
    • A61B5/0022—Monitoring a patient using a global network, e.g. telephone networks, internet
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/021—Measuring pressure in heart or blood vessels
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/63—Querying
    • G06F16/635—Filtering based on additional data, e.g. user or group profiles
    • G06F16/637—Administration of user profiles, e.g. generation, initialization, adaptation or distribution
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00—Registering or indicating the working of vehicles
    • G07C5/008—Registering or indicating the working of vehicles communicating information to a remotely located station
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00—Registering or indicating the working of vehicles
    • G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
    • G07C5/0808—Diagnosing performance data
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H15/00—ICT specially adapted for medical reports, e.g. generation or transmission thereof
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00—Evaluating a particular growth phase or type of persons or animals
    • A61B2503/20—Workers
    • A61B2503/22—Motor vehicles operators, e.g. drivers, pilots, captains
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/15—Biometric patterns based on physiological signals, e.g. heartbeat, blood flow

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Cardiology (AREA)
  • Physiology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Primary Health Care (AREA)
  • Multimedia (AREA)
  • Epidemiology (AREA)
  • Psychiatry (AREA)
  • Hospice & Palliative Care (AREA)
  • Social Psychology (AREA)
  • Psychology (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Educational Technology (AREA)
  • Developmental Disabilities (AREA)
  • Pulmonology (AREA)
  • Child & Adolescent Psychology (AREA)
  • General Business, Economics & Management (AREA)
  • Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Vascular Medicine (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention discloses a driver state monitoring system which comprises a vehicle-mounted face recognition camera for collecting face information of a driver, wherein the output end of the vehicle-mounted face recognition camera is connected with a computing unit, and the computing unit is used for recognizing and analyzing physiological and psychological state data of the driver according to the face information and carrying out display and health reminding through a human-computer interaction system. The invention has the advantages that: physiological and psychological data of a human body can be recognized through the vehicle-mounted face camera, health monitoring and reminding can be given after analysis, and data support can be provided for remote medical treatment, remote monitoring and the like; and human-computer interaction experience can be improved, and an auxiliary interaction function is given on the basis of recognizing and analyzing the emotion of the driver.

Description

Driver state monitoring system
Technical Field
The invention relates to the field of intelligent vehicle-mounted recognition monitoring, in particular to a driver state monitoring system based on a face recognition camera.
Background
The face recognition technology is carried on the automobile more and more, but most of the face recognition technology is focused on identity judgment, fatigue monitoring, simple expression recognition and the like, and the physiological and psychological states of a user cannot be monitored. Traditional physiological and psychological state detection, such as blood pressure, heart rate, emotional state and the like, require professional instruments, and the mode cannot be applied to the vehicle-mounted condition within a short time.
With the development and maturity of the blood spectrum optical imaging technology, the technology gradually becomes a hot point of research of enterprises and schools and also provides a foundation for vehicle-mounted application.
The development of the automobile is developed towards the direction of intelligent assistance, for example, some vehicle-mounted intelligent voice assistants and the like are used for vehicle assistance, along with the development of automobile intelligence, the state of a driver is monitored to provide intelligent and humanized services, and the intelligent and humanized services are of great importance for improving the human-computer interaction experience and services of the automobile. The whole vehicle experience is improved by combining the blood spectrum optical imaging technology and the vehicle-mounted intelligent technology, and the intelligent interactive experience can be effectively improved.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a driver state monitoring system which is used for acquiring psychological and physiological data of a driver by a camera and providing data support for the interconnection and health reminding of the whole vehicle.
In order to achieve the purpose, the invention adopts the technical scheme that: the utility model provides a driver state monitoring system, is including being used for gathering the on-vehicle face identification camera of driver face information, the computing unit is connected to the output of on-vehicle face identification camera, the computing unit is used for showing and health warning through man-machine interaction system according to the physiology and the psychological state data that face information discernment analyzed out the driver.
The computing unit analyzes the physiological and psychological data including heart rate, blood pressure, respiration, heart pressure, psychological pressure and/or emotional state through the face image information.
And the computing unit controls the multimedia host to operate according to the analyzed physiological and psychological data.
The multimedia host drives the music playing module to play corresponding different types of music according to the physiological and psychological data.
And the computing unit uploads the physiological and psychological data to the cloud server through the network.
The cloud server is used for storing the uploaded data and/or analyzing the uploaded data to give a health analysis report.
The computing unit uploads the detected physiological and psychological data to the TSP platform through the Internet of vehicles, and the TSP platform acquires the driving data of the user through the Internet of vehicles and analyzes the driving behavior of the user by combining the driving data.
The computing unit acquires a computing unit of the vehicle-mounted multimedia host; the camera adopts a vehicle-mounted face recognition camera.
The invention has the advantages that: physiological and psychological data of a human body can be recognized through the vehicle-mounted face camera, health monitoring and reminding can be given after analysis, and data support can be provided for remote medical treatment, remote monitoring and the like; moreover, the human-computer interaction experience can be improved, and an auxiliary interaction function is given on the basis of identifying and analyzing the emotion of the driver, such as music matched with the emotion is automatically played, so that the intelligent degree of the human-computer interaction of the whole vehicle and the user experience are improved; physiological and psychological data obtained through face analysis can be used as basic support data of big data analysis, so that a basis is provided for auxiliary analysis of the driving behavior of a driver, and driving behavior dependent data are supplemented; providing data support for the vehicle-mounted intelligent assistant; the camera is adopted to analyze the facial information to obtain physiological and psychological data, so that the non-contact and non-inductive monitoring of the physiological and psychological states of the driver is realized; the data acquisition monitoring analysis is realized on the basis of the existing vehicle-mounted face recognition camera and the vehicle-mounted multimedia host without increasing new hardware cost, so that the cost is saved, and the practicability is strong.
Drawings
The contents of the expressions in the various figures of the present specification and the labels in the figures are briefly described as follows:
FIG. 1 is a schematic diagram of a blood spectral imaging technology for realizing data acquisition by a camera according to the present invention;
FIG. 2 is a diagram of the hardware configuration of the present invention.
Detailed Description
The following description of preferred embodiments of the invention will be made in further detail with reference to the accompanying drawings.
As shown in fig. 1, in order to take a face image by using a face recognition camera, a blood spectrum optical imaging technology is adopted, blood flow information of a human face is extracted by capturing hemoglobin distribution change under the skin of the human face through a common optical camera, and then physiological and psychological states of a human are recognized, measured and predicted by combining psychology, neuroscience, machine learning and image analysis technologies. For example, blood pressure, heart rate, emotional state and the like, the system can realize the non-inductive monitoring of the physiological and psychological states of the driver based on the face recognition camera arranged on the automobile and by combining the blood spectrum optical imaging technology. One or all of three aspects may be implemented for detection:
1. the data are provided for the cloud diagnosis platform and the networked cloud diagnosis system, so that remote diagnosis and treatment of doctors and data monitoring of personal doctors at any time can be realized, and a remote medical function is realized;
2. according to the analyzed driving state emotion data of the driver, the relaxed music playing is provided to improve the experience comfort of the driver; giving a health prompt according to human physiological data such as heart rate, blood pressure and the like;
3. the data is used as basic analysis data of the vehicle-mounted intelligent assistant to help the vehicle-mounted intelligent assistant to monitor, learn and know the driving data of the driver, so that the analysis of the driving data is convenient to give out in time, the subjective wrong driving behavior of the driver is reminded in time, such as the overspeed behavior of an excited state is analyzed, an intelligent reminding warning can be given out in time according to the psychological feeling state analyzed at the moment and the overspeed data or an instruction is directly sent to a vehicle controller of a user by the intelligent assistant, and the vehicle speed is limited to a safety value.
As shown in fig. 2, the hardware structure of the driver status monitoring system according to the present application is schematically illustrated, and the hardware structure of the present application may adopt a vehicle-mounted hardware structure or a newly added hardware structure, and combines with vehicle-mounted software to implement analysis of facial data and intelligent and humanized human-computer auxiliary operations such as health reminding, automatic music playing, data uploading and the like according to an analysis result, so as to improve human-computer interaction experience of the whole vehicle. The vehicle-mounted face recognition camera is used for collecting face information of a driver, the output end of the vehicle-mounted face recognition camera is connected with the computing unit, and the computing unit is used for identifying and analyzing physiological and psychological state data of the driver according to the face information and displaying and reminding health through the human-computer interaction system. The computing unit can be realized by adopting a data processing unit in the vehicle-mounted multimedia host, meanwhile, the controller of the multimedia host realizes the detection of the physiological and psychological states of the human body through a blood spectrum imaging technology, and then the display and health reminding of the monitoring information are realized according to the monitoring result. The health reminding calls a display screen or a voice system of the multimedia host to display or carry out voice reminding.
The computing unit analyzes the physiological and psychological data including heart rate, blood pressure, respiration, heart pressure, psychological pressure and/or emotional state through the face image information. The detection of heart rate, blood pressure, respiration, heart pressure, psychological pressure and/or emotional state and the like is realized by integrating the blood spectrum imaging technology into an algorithm, and when abnormal phenomena occur in physiological data (such as heart rate, blood pressure, respiratory frequency and the like), health display and reminding can be given through a human-computer interaction interface, a display screen and a voice system of a multimedia host.
Aiming at psychological data, such as psychological stress data or emotion data of the current driver, which are analyzed, the computing unit can control the multimedia host after analyzing the data, and relieve the psychology and emotion of the driver in an active intervention mode; for example, when the analysis shows that the driver is under high psychological stress or low mood at the moment, the relaxing music is correspondingly turned on to perform the decompression operation. These can be integrated in the intelligent assistant in the multimedia host, and the artificial intelligent assistant is integrated in the host, and the work of the multimedia host is controlled by acquiring the data of the computing unit, and various operation information is intelligently provided. The multimedia host drives the music playing module to play corresponding different types of music according to the physiological and psychological data. If the music is in a more happy and excited state, the multimedia host controls the music to give out happy music.
In order to further realize cloud storage, the computing unit uploads the physiological and psychological data to a cloud server through a network. The computing unit is that a controller in the multimedia host is connected with a cloud server through the Internet of vehicles, and the cloud server is used for storing the uploaded data and/or analyzing the uploaded data to give a health analysis report.
Meanwhile, the computing unit uploads the detected physiological and psychological data to the TSP platform through the Internet of vehicles, and the TSP platform enables a user to acquire the monitoring data on the TSP through a mobile phone and an app, so that the user can check the data conveniently. And furthermore, the TSP platform is combined with the driving data acquired through the internet of vehicles, the driving behavior of the user is analyzed in combination with the driving data, early warning information is given, for example, the TSP platform is combined with the driving data to analyze the overspeed behavior at the moment, and is combined with psychological data to judge whether the overspeed behavior is subjective at the moment, if the overspeed behavior is subjective, an instruction is issued to the whole vehicle controller, the speed limit of the vehicle is realized through the whole vehicle controller, and the speed is limited to be a safe value, so that the active safety intervention of the vehicle is realized intelligently and reliably. When the vehicle is overspeed and in abnormal emotional states such as excessive emotions and low emotions, the abnormal emotional states are analyzed and sent to the VCU of the vehicle control unit through the TSP, the TBOX and the CAN bus, and then the vehicle speed is limited.
Driver's physiology and psychological state monitoring system based on-vehicle face identification camera can realize the monitoring to driver's physiology and psychological state under the condition that whole factory does not increase any extra hardware input, and the monitoring result passes through on-vehicle multimedia system and car networking system, carries out user's show and health warning, and supplementary on-vehicle intelligent assistant understands driver's state better, richens the data of driving behavior analysis.
The system designs a vehicle-mounted face recognition camera and a multimedia computing unit, so that the physiological and psychological states of a driver can be monitored without sense. The analysis data can be displayed and reminded on the vehicle-mounted multimedia interface, the vehicle-mounted intelligent assistant is assisted to better understand the state of the driver, the data of driving behavior analysis are enriched, and the driving behavior analysis is more accurate. The method comprises the following specific steps:
(1) the vehicle-mounted face recognition camera is connected to a vehicle-mounted multimedia host through a wire harness, and a computing unit in the host integrates a human body physiological and psychological state detection algorithm based on a blood spectrum imaging technology.
(2) The calculating unit acquires the facial image information of the driver in real time through the face camera and inputs the captured image into a detection algorithm.
(3) The detection algorithm measures the physiological and psychological states of the driver including heart rate, blood pressure, respiration, heart pressure, Heart Rate Variability (HRV), respiration rate, psychological pressure, emotional state and the like in real time through calculation and analysis, and outputs the physiological and psychological states to the multimedia host.
(4) The multimedia host displays the analysis result to the user through the interactive interface, and actively reminds the user to pay attention to health and provides reasonable suggestions if the analysis result of the user is abnormal.
(5) When the psychological stress of the user is detected to be large or the emotion is low, the intelligent assistant carried by the multimedia host can actively push some relaxing music, help the user to relieve the stress and relieve the emotion. Conversely, when it is detected that the user is happy, the intelligent assistant may also actively push some happy music.
(6) The multimedia host transmits the detection result to the background in real time through the Internet of vehicles, the background integrates the driving data of the user, such as overspeed, emergency brake, emergency acceleration and deceleration and the like, and then the driving data is analyzed by combining big data to judge whether the user is overspeed with subjective consciousness or not, so that the driving behavior is analyzed more accurately.
It is clear that the specific implementation of the invention is not restricted to the above-described embodiments, but that various insubstantial modifications of the inventive process concept and technical solutions are within the scope of protection of the invention.

Claims (7)

1. The utility model provides a driver state monitoring system, is including being used for gathering the on-vehicle face identification camera of driver face information, its characterized in that: the output end of the vehicle-mounted face recognition camera is connected with a computing unit, and the computing unit is used for recognizing and analyzing physiological and psychological state data of a driver according to face information and displaying and reminding health through a human-computer interaction system.
2. A driver condition monitoring system as claimed in claim 1, wherein: the computing unit analyzes the physiological and psychological data including heart rate, blood pressure, respiration, heart pressure, psychological pressure and/or emotional state through the face image information.
3. A driver condition monitoring system as defined in claim 1 or 2, wherein: and the computing unit controls the multimedia host to operate according to the analyzed physiological and psychological data.
4. A driver condition monitoring system as defined in claim 3, wherein: the multimedia host drives the music playing module to play corresponding different types of music according to the physiological and psychological data.
5. A driver condition monitoring system as claimed in claim 1, wherein: and the computing unit uploads the physiological and psychological data to the cloud server through the network.
6. A driver condition monitoring system as defined in claim 5, wherein: the cloud server is used for storing the uploaded data and/or analyzing the uploaded data to give a health analysis report.
7. A driver condition monitoring system as defined in any one of claims 1-6, wherein: the computing unit uploads the detected physiological and psychological data to the TSP platform through the Internet of vehicles, and the TSP platform acquires the driving data of the user through the Internet of vehicles and analyzes the driving behavior of the user by combining the driving data.
CN202010377906.0A 2020-05-07 2020-05-07 Driver state monitoring system Pending CN111613329A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010377906.0A CN111613329A (en) 2020-05-07 2020-05-07 Driver state monitoring system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010377906.0A CN111613329A (en) 2020-05-07 2020-05-07 Driver state monitoring system

Publications (1)

Publication Number Publication Date
CN111613329A true CN111613329A (en) 2020-09-01

Family

ID=72199571

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010377906.0A Pending CN111613329A (en) 2020-05-07 2020-05-07 Driver state monitoring system

Country Status (1)

Country Link
CN (1) CN111613329A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112257588A (en) * 2020-10-22 2021-01-22 浙江合众新能源汽车有限公司 Method for automatically identifying expression of driver
CN113555117A (en) * 2021-07-19 2021-10-26 江苏金海星导航科技有限公司 Driver health management system based on wearable device
CN114067236A (en) * 2021-10-28 2022-02-18 中国电子科技集团公司电子科学研究院 Target person information detection device, detection method and storage medium
CN115317304A (en) * 2022-07-28 2022-11-11 瑞多（上海）智能科技有限公司 Intelligent massage method and system based on physiological characteristic detection

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108528371A (en) * 2018-03-07 2018-09-14 北汽福田汽车股份有限公司 Control method, system and the vehicle of vehicle
CN109949923A (en) * 2019-03-14 2019-06-28 康飞 A kind of vehicle-mounted health system
CN110001652A (en) * 2019-03-26 2019-07-12 深圳市科思创动科技有限公司 Monitoring method, device and the terminal device of driver status
CN110491515A (en) * 2019-09-25 2019-11-22 江苏启润科技有限公司 Driving managing and control system and method based on vehicle-mounted human multi-parameter monitoring terminal
WO2020003788A1 (en) * 2018-06-25 2020-01-02 パナソニックＩｐマネジメント株式会社 Driving assist device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108528371A (en) * 2018-03-07 2018-09-14 北汽福田汽车股份有限公司 Control method, system and the vehicle of vehicle
WO2020003788A1 (en) * 2018-06-25 2020-01-02 パナソニックＩｐマネジメント株式会社 Driving assist device
CN109949923A (en) * 2019-03-14 2019-06-28 康飞 A kind of vehicle-mounted health system
CN110001652A (en) * 2019-03-26 2019-07-12 深圳市科思创动科技有限公司 Monitoring method, device and the terminal device of driver status
CN110491515A (en) * 2019-09-25 2019-11-22 江苏启润科技有限公司 Driving managing and control system and method based on vehicle-mounted human multi-parameter monitoring terminal

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112257588A (en) * 2020-10-22 2021-01-22 浙江合众新能源汽车有限公司 Method for automatically identifying expression of driver
CN113555117A (en) * 2021-07-19 2021-10-26 江苏金海星导航科技有限公司 Driver health management system based on wearable device
CN113555117B (en) * 2021-07-19 2022-04-01 江苏金海星导航科技有限公司 Driver health management system based on wearable device
CN114067236A (en) * 2021-10-28 2022-02-18 中国电子科技集团公司电子科学研究院 Target person information detection device, detection method and storage medium
CN115317304A (en) * 2022-07-28 2022-11-11 瑞多（上海）智能科技有限公司 Intelligent massage method and system based on physiological characteristic detection

Similar Documents

Publication Publication Date Title
CN111613329A (en) Driver state monitoring system
Healey et al. Detecting stress during real-world driving tasks using physiological sensors
Begum Intelligent driver monitoring systems based on physiological sensor signals: A review
CN110001652B (en) Driver state monitoring method and device and terminal equipment
US9408570B2 (en) Physiological feature extraction and fusion to assist in the diagnosis of post-traumatic stress disorder
EP2515760B1 (en) Affective well-being supervision system and method
Riener et al. Heart on the road: HRV analysis for monitoring a driver's affective state
CN107117174B (en) A kind of driver's mood monitoring active safety guide device circuit system and its control method
CN107252313A (en) The monitoring method and system of a kind of safe driving, automobile, readable storage medium storing program for executing
KR101854812B1 (en) Psychiatric symptoms rating scale system using multiple contents and bio-signal analysis
CN111231970A (en) Health regulation method and device, computer equipment and storage medium
Zhang Stress recognition from heterogeneous data
CN115064246A (en) Depression evaluation system and equipment based on multi-mode information fusion
CN111452747A (en) Vehicle-mounted health monitoring method and monitoring system
KR20200071647A (en) Biofeedback method based on virtual/augmented reality contents and bio-signal for diagnosis and healing of mental illness
CN113040773A (en) Data acquisition and processing method
CN111222464B (en) Emotion analysis method and system
CN116807476A (en) Multi-mode psychological health assessment system and method based on interface type emotion interaction
CN104490374A (en) Judgment system and method for heart status of driver
CN212353957U (en) Health regulating system
CN115868989A (en) Key post fatigue prediction method based on multi-mode full-time emotion recognition
CN116168371A (en) 5G remote driving-oriented safety work load estimation system and estimation method
CN114566275A (en) Pre-hospital emergency auxiliary system based on mixed reality
Firdaus et al. An Embedded Computer Vision Method to Extract Percentage of Eye Close for Detecting Drowsiness of a Safety Driving System
KR20220047187A (en) Server and method for cognitive function testing using feature combination

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination