WO2023236434A1 - 一种基于驾驶人情绪干预的安全驾驶预警系统 - Google Patents

一种基于驾驶人情绪干预的安全驾驶预警系统 Download PDF

Info

Publication number
WO2023236434A1
WO2023236434A1 PCT/CN2022/129873 CN2022129873W WO2023236434A1 WO 2023236434 A1 WO2023236434 A1 WO 2023236434A1 CN 2022129873 W CN2022129873 W CN 2022129873W WO 2023236434 A1 WO2023236434 A1 WO 2023236434A1
Authority
WO
WIPO (PCT)
Prior art keywords
driver
unit
vehicle
emotion
real
Prior art date
Application number
PCT/CN2022/129873
Other languages
English (en)
French (fr)
Inventor
刘彩霞
Original Assignee
公安部第三研究所
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 公安部第三研究所 filed Critical 公安部第三研究所
Publication of WO2023236434A1 publication Critical patent/WO2023236434A1/zh

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
    • B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
    • B60K28/06—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K31/00—Vehicle fittings, acting on a single sub-unit only, for automatically controlling vehicle speed, i.e. preventing speed from exceeding an arbitrarily established velocity or maintaining speed at a particular velocity, as selected by the vehicle operator
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60T—VEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL; ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
    • B60T7/00—Brake-action initiating means
    • B60T7/12—Brake-action initiating means for automatic initiation; for initiation not subject to will of driver or passenger
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G06V40/176—Dynamic expression
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/10—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using wireless transmission systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143—Alarm means

Definitions

  • the invention relates to automobile driving safety monitoring technology, specifically to all operational vehicles such as highway passenger transport, tourist passenger transport, hazardous chemical transport vehicles, freight vehicles, school buses, buses, taxis, online car-hailing or rental cars on various platforms, Driving safety monitoring of non-commercial transport vehicles and private vehicles.
  • the purpose of the present invention is to provide a safe driving warning system based on driver's emotional intervention, which uses driver's emotion analysis technology to monitor the driver's emotional state in real time and realizes linkage with the vehicle control system, thereby Provide effective early warning and active intervention for potential accident risks that may be caused by abnormal drivers' emotions, prevent drivers from driving vehicles in abnormal emotional states that hinder safe driving, and ensure that drivers can drive vehicles safely in normal emotional states, and Ensure that when the driver has abnormal emotions, the vehicle will carry out active intelligent safety prevention and control to improve the safety of vehicle operation.
  • the present invention provides a safe driving warning system based on driver emotional intervention, including:
  • Driver's emotion real-time recognition unit which is used to obtain the current driver's facial expression dynamics, and perform intelligent emotion analysis based on the obtained facial expression dynamics or transmit the obtained facial expression dynamics to the vehicle-mounted gateway
  • the unit performs intelligent emotion analysis;
  • the real-time driver emotion recognition unit can directly associate with the vehicle control unit through the vehicle gateway unit based on the real-time emotion recognition results to control the vehicle operating status;
  • Vehicle-mounted gateway unit the vehicle-mounted gateway unit is respectively associated with the driver's emotion real-time recognition unit, the vehicle control unit, the alarm prompt unit and the remote management unit; the vehicle-mounted gateway unit can also cooperate with the driver's emotion real-time recognition unit to perform emotion recognition;
  • Vehicle control unit the vehicle control unit is linked to the vehicle's starting system, speed control system and braking system, and is associated with the vehicle gateway unit and the driver's emotion real-time recognition unit.
  • the vehicle control unit sends signals based on the driver's emotion real-time recognition unit. or the driver’s real-time emotional state analysis results sent by the vehicle gateway unit to control the vehicle driving state;
  • Alarm prompt unit the alarm prompt unit is connected and cooperated with the driver's emotion real-time recognition unit and the vehicle gateway unit respectively;
  • Remote management unit which completes driver emotion recognition through the vehicle control unit and the driver emotion real-time recognition unit, and can give corresponding vehicle management and driver management control instructions and feed them back to the vehicle gateway unit.
  • driver's emotion real-time recognition unit of the driver's emotion real-time recognition unit includes a facial high-speed camera module and an emotion intelligent analysis and recognition module;
  • the facial high-speed camera module is used to collect the current driver's facial expression dynamics, and may include a facial high-speed camera acquisition device and a light fill device;
  • the emotional intelligent analysis and recognition module is used to intelligently analyze and recognize the dynamic facial expressions collected by the facial high-speed camera device, and determine the real-time emotional state of the current driver.
  • driver's emotion real-time recognition unit is directly associated with the vehicle control unit or indirectly associated with the vehicle control unit and/or the remote management unit through a vehicle-mounted gateway.
  • vehicle gateway unit includes a network communication module and/or a data storage module and/or an edge computing module;
  • the network communication module is used for data interaction between the driver's emotion real-time recognition unit and the alarm prompt unit, vehicle control unit and remote management unit;
  • the data storage module is used to store interaction data between the driver's emotion real-time recognition unit, the alarm prompt unit, the vehicle control unit and the remote management unit;
  • the edge computing module is used to perform intelligent analysis and identification of emotions based on the data interacted between the driver's emotion real-time recognition unit, the alarm prompt unit, the vehicle control unit and the remote management unit.
  • the network communication module of the vehicle gateway unit includes a 5G communication device, a CAN bus communication device, a TCP/IP communication device, a Bluetooth communication device, and other wireless communication (WIFI, UWB, Zigbee, etc.) devices.
  • the data storage module of the vehicle-mounted gateway unit includes a built-in data storage device and an external data storage device.
  • the edge computing module of the vehicle gateway unit includes an AI smart chip containing edge computing functions and a terminal SDK containing edge computing.
  • vehicle-mounted gateway unit is directly associated with the driver's emotion real-time recognition unit, vehicle control unit, alarm prompt unit and remote management unit.
  • the alarm prompt unit includes a vehicle local alarm prompt subunit and a remote monitoring client software alarm prompt subunit.
  • the alarm prompt unit is directly associated with the driver's emotion real-time recognition unit and the vehicle gateway unit.
  • the vehicle control unit includes an anti-lock braking module and/or a speed limit management module and/or an intelligent brake management module and/or an electronically controlled brake assist module;
  • the anti-lock braking module is used to prevent the vehicle from losing control of the direction of travel or slipping during emergency braking when receiving abnormal driver status monitoring results;
  • the speed limit management module is used to control the maximum driving speed of the vehicle when receiving abnormal driver status monitoring results
  • the intelligent braking management module is used to activate the intelligent braking device to reduce the real-time driving speed of the vehicle when receiving abnormal driver status monitoring results;
  • the electronically controlled brake assist module is used to quickly activate all braking force when emergency braking is required when receiving abnormal monitoring results of the driver's status.
  • the vehicle control unit is directly associated with the driver's emotion real-time recognition unit and the vehicle gateway unit.
  • the vehicle control unit receives abnormal results from the driver's real-time emotion recognition, the vehicle control unit controls the vehicle's speed limit, deceleration or emergency braking.
  • the safe driving warning system also includes a remote management unit.
  • the remote management unit cooperates with the driver's emotion real-time recognition unit to complete the driver's emotion recognition through the vehicle control unit, and can give corresponding vehicle management and driver management control instructions. , feedback to the vehicle gateway unit.
  • the remote management unit includes government industry management client software, enterprise operation management client software, driver and passenger service client software, and a communication center.
  • the government industry management client of the remote management unit includes public security industry management client software, transportation industry management client software, emergency industry management client software, and other industry management client software (such as Insurance industry management client software), etc.
  • the enterprise operation management client of the remote management unit includes shipping unit management client software, carrier unit management client software, and receiving unit management client software depending on the user.
  • driver and passenger service management client of the remote management unit includes driver service client software and escort (safety officer) service client software depending on the user.
  • the communication center of the remote management unit includes a cloud platform, a local server and a personal mobile intelligent terminal.
  • the remote management unit receives the driver's real-time emotion recognition results sent by the vehicle-mounted gateway unit and provides vehicle management and driver management control instructions, or receives the driver's facial expression dynamic collection information sent by the vehicle-mounted gateway unit, and performs the driver's facial expression dynamic collection.
  • Real-time emotions are recognized, and vehicle management and driver management control instructions are given based on the emotion recognition results, which are fed back to the vehicle gateway unit and fed back to the alarm prompt unit or vehicle control unit through the vehicle gateway.
  • the safe driving early warning system based on driver's emotional intervention provided by the present invention can conduct real-time monitoring and early warning of the driver's emotional state during driving, and automatically control the vehicle's safety in a proactive driving assistance safety prevention and control manner based on the monitoring results.
  • the driving status can provide safety warnings to drivers, thereby ensuring the operational safety of automobile transportation from the driver's perspective.
  • the safe driving warning system based on driver's emotional intervention can conduct real-time monitoring of the driver's facial dynamic expression or facial vibration amplitude while driving the vehicle, comprehensively analyze the driver's real-time emotional state, and based on Emotional state analysis, recognition and judgment results automatically control the vehicle to automatically limit speed, decelerate or emergency brake and simultaneously issue voice prompts or sound and light alarms, providing effective early warning and active intervention to prevent potential accident risks that may be caused by driver factors.
  • the driver drives the vehicle in an abnormal emotional state that hinders safe driving, ensure that the driver can drive the vehicle safely in a normal emotional state and mental state, and ensure that the vehicle carries out active intelligent safety prevention and control when the driver has abnormal emotions to improve vehicle operation. security.
  • Figure 1 is a schematic diagram of the composition principle and usage flow of a safe driving warning system based on driver's emotional intervention provided by an example of the present invention
  • Figure 2 is a schematic diagram of the composition principle and usage flow of the driver's emotion real-time emotion recognition unit in an example of the present invention
  • FIG. 3 is a schematic diagram of the composition principle of the vehicle-mounted gateway unit and its network communication module in an example of the present invention
  • Figure 4 is a schematic diagram of the composition principle and usage flow of the alarm prompt unit in an example of the present invention.
  • Figure 5 is a schematic diagram of the composition principle and usage flow of the vehicle control unit in an example of the present invention.
  • Figure 6 is a schematic diagram of the composition principle and usage flow of the remote management unit in an example of the present invention.
  • Figure 7 is a schematic diagram of the composition principle of the government industry management client of the remote management unit in the example of the present invention.
  • Figure 8 is a schematic diagram of the composition principle of the enterprise operation management client of the remote management unit in the example of the present invention.
  • Figure 9 is a schematic diagram of the composition principle of the driver and passenger service client of the remote management unit in the example of the present invention.
  • Figure 10 is a schematic diagram showing the composition principle of the communication center of the remote management unit in the example of the present invention.
  • This invention innovatively starts from the perspective of driver management, monitors the real-time emotional state of the driver during driving, and controls the driving state of the vehicle in real-time based on the monitoring results and/or forms a safety warning for the driver, thereby monitoring the driver's real-time emotional state. It can realize intelligent early warning for safety hazards that may be caused by driver factors, and can also control the driving status of the vehicle in a linkage manner, thereby eliminating safety hazards caused by driver factors and ensuring the safety of corresponding vehicle transportation from the perspective of driver management.
  • the present invention provides a safe driving warning system based on driver's emotional intervention.
  • the safe driving warning system can monitor the driver's facial dynamic expression or facial vibration amplitude in real time while driving the vehicle, and comprehensively analyze the driver's behavior.
  • Real-time emotional state based on the emotional state analysis and identification results, it automatically controls the vehicle's automatic speed limit, deceleration or emergency braking and simultaneously issues voice prompts or audible and visual alarms to effectively control potential accident risks caused by abnormal emotional factors of the driver.
  • Early warning and active intervention prevent drivers from driving vehicles in abnormal emotional states that hinder safe driving, ensure that drivers can drive vehicles safely in normal emotional and mental states, and ensure that vehicles carry out active intelligent safety prevention when drivers have abnormal emotions.
  • Figure 1 is a schematic diagram of the overall composition and principle of a safe driving warning system based on driver's emotional intervention according to the present invention.
  • this driving safety management system is mainly composed of a real-time driver emotion recognition unit 200, a vehicle-mounted gateway unit 300, an alarm prompt unit 400, a vehicle control unit 500 and a remote management unit 600 that cooperate with each other.
  • the driver's emotion real-time recognition unit 200 in this system is installed in the cab of the vehicle 100 to be monitored, is associated with the vehicle's on-board gateway unit 300, alarm prompt unit 400, and vehicle control unit 500, and is connected to the remote management unit through the on-board gateway unit 300. 600 associations.
  • the driver's emotion real-time recognition unit 200 can monitor the driver's emotional state in real time, which can be transmitted to the remote management unit 600 through the unit itself, through the edge computing module of the vehicle gateway unit 300 or through the network communication module of the vehicle gateway unit 300 Perform emotion recognition and judgment.
  • the driver's emotion real-time recognition unit 200 can obtain management instructions based on the relevant emotion recognition results from the remote management unit based on the real-time emotion recognition results or through the vehicle-mounted gateway unit, and directly associate with the vehicle control unit 500 or associate with vehicle control through the vehicle-mounted gateway unit 300
  • Unit 500 controls the working status of the vehicle's anti-lock braking (ABS) module, speed limit management module, intelligent brake management module or electronically controlled brake assist (EBA) module to perform speed limit, speed control or deceleration operations.
  • ABS anti-lock braking
  • EBA electronically controlled brake assist
  • the vehicles 100 to be monitored here can be "two passenger, one dangerous, one cargo and one school” vehicles, taxis, online car-hailing and rental cars on various platforms, and all operational vehicles and non-commercial transportation vehicles. It can also be a general private vehicle if necessary.
  • the driver's emotion real-time recognition unit 200 provided in this example can effectively obtain the current driver's facial expression dynamics, and transmit the obtained facial expression dynamics to its own intelligent emotion analysis function module (such as the driver's emotion real-time recognition unit 200 itself
  • intelligent emotion analysis function module such as the driver's emotion real-time recognition unit 200 itself
  • the intelligent emotion analysis function module of the vehicle gateway unit such as the edge computing module built in the vehicle gateway unit
  • the intelligent emotion analysis function module transmitted to the remote management unit through the vehicle gateway unit can effectively obtain the current driver's facial expression dynamics, and transmit the obtained facial expression dynamics to its own intelligent emotion analysis function module (such as the driver's emotion real-time recognition unit 200 itself
  • the intelligent emotion analysis function module of the vehicle gateway unit such as the edge computing module built in the vehicle gateway unit
  • the driver's emotion real-time recognition unit 200 may be configured with a corresponding intelligent emotion analysis function module as needed.
  • the intelligent emotion analysis function module is used to receive the current driver's facial expression obtained by the driver's emotion real-time recognition unit 210
  • Dynamic data the dynamic data here can be videos, pictures, etc., and intelligent emotion analysis is performed based on this data, and corresponding real-time emotion analysis results are formed.
  • the intelligent emotion analysis function module when implemented, it can be implemented by the edge computing module built by the driver's emotion real-time identification unit 200 itself.
  • the specific composition technology can be determined according to actual needs. For example, it can be based on real-time identification of the driver's emotion.
  • Unit 200 hardware comes with edge computing functions to achieve.
  • the driver's emotion real-time recognition unit 200 configured in this way can collect the current driver's facial expression dynamics and/or perform intelligent analysis and recognition on the collected facial expression dynamics to determine the current driver's real-time emotional state.
  • the driver's emotion real-time recognition unit 200 When the driver's emotion real-time recognition unit 200 performs intelligent analysis and recognition, it can directly perform intelligent analysis and recognition by building a corresponding edge computing module (ie, an intelligent emotion analysis function module) in the driver's emotion real-time recognition unit 200 .
  • a corresponding edge computing module ie, an intelligent emotion analysis function module
  • the present driver's emotion real-time recognition unit 200 can also complete intelligent analysis and recognition of driver's emotions by cooperating with the vehicle-mounted gateway unit 300 .
  • the driver's emotion real-time recognition unit 200 transmits the obtained dynamic facial expression data of the current driver to the vehicle-mounted gateway unit 300, and the vehicle-mounted gateway unit 300
  • the edge computing module running in the system performs intelligent analysis and identification to determine the current driver's real-time emotional state.
  • the driver's emotion real-time recognition unit 200 can also cooperate with the remote management unit 600 through the vehicle gateway unit 300 to complete the intelligent analysis and recognition of the driver's emotions.
  • the real-time driver emotion recognition unit 200 transmits the acquired dynamic facial expression data of the current driver to the vehicle-mounted gateway unit 300, and then the vehicle-mounted gateway unit 300 transmits it to the remote management unit 600.
  • the remote management unit 600 This data is intelligently analyzed and identified to determine the current driver's real-time emotional state.
  • the monitored data can be processed through the edge computing module of the driver's emotion real-time recognition unit 200, or through the edge computing module of the vehicle-mounted gateway unit 300 or through the vehicle-mounted gateway unit 300.
  • the network communication module of the gateway unit 300 transmits the information to the remote management unit 600 for emotion recognition and determination.
  • the driver's emotion real-time recognition unit 200 simultaneously relies on the real-time emotion recognition results; or obtains management instructions generated based on the relevant emotion recognition results from the remote management unit 600 through the vehicle-mounted gateway unit 300, and directly associates with the vehicle control unit 500 or associates with the vehicle-mounted gateway unit 300
  • the vehicle control unit 500 can thereby control the working status of the vehicle's anti-lock braking (ABS) module, speed limit management module, intelligent brake management module or electronically controlled brake assist (EBA) module to perform speed limit, deceleration or emergency braking. Manual operation to control the running status of the vehicle.
  • ABS anti-lock braking
  • EBA electronically controlled brake assist
  • the vehicle-mounted gateway unit 300 in this system is installed in the cab of the vehicle 100 to be monitored, and is associated with the vehicle's real-time driver emotion recognition unit 200, alarm prompt unit 400, vehicle control unit 500 and remote management unit 600 .
  • the vehicle-mounted gateway unit 300 here at least has a network communication function and/or a data storage function and/or an edge computing function and establishes a communication channel with the remote management unit 600 to identify the data information generated by the driver's emotion real-time recognition unit 200 , analyze or transmit relevant information to the remote management unit for identification and analysis, and send the management data information returned by the remote management unit to the vehicle control unit and alarm prompt unit.
  • FIG. 3 shows a structural principle of the vehicle-mounted gateway unit 300 and a schematic diagram of its network communication module in the safe driving warning system based on driver's emotional intervention given in this example.
  • the vehicle-mounted gateway unit 300 is composed of a network communication module 310 and/or a data storage module 320 and/or an edge computing module 330 that are combined with each other or composed independently.
  • the network communication module 310 is a basic component, that is, a necessary component of the vehicle gateway unit 300.
  • the vehicle gateway unit 300 configured in this way uses the network communication module 310 to perform data interaction between the real-time driver emotion recognition unit 200 and the alarm prompt unit 400, the vehicle control unit 500 and the remote management unit 600.
  • the vehicle-mounted gateway unit 300 can forward the current driver's facial expression dynamic information or real-time emotion analysis and recognition results uploaded by the driver's emotion real-time recognition unit 200 to the remote management unit 600 using the network communication module 310 .
  • the vehicle-mounted gateway unit 300 can also send corresponding instructions to the vehicle control unit 500 and the alarm prompt unit 400 based on the received real-time emotion analysis and recognition results of the driver; or based on the information obtained by the edge computing module 330 of the vehicle-mounted gateway unit 300
  • the real-time emotion analysis and recognition results send corresponding instructions to the vehicle control unit 500 and the alarm prompt unit 400; or forward the received management instructions of the remote management unit 600 to the driver emotion real-time recognition unit 200 or the alarm prompt unit 400 or the vehicle control unit 500.
  • the vehicle-mounted gateway unit 300 can use the data storage module 320 to store the current driver's facial expression dynamic information uploaded by the driver's emotion real-time recognition unit 200.
  • the vehicle-mounted gateway unit 300 can use the edge computing module 330 to perform emotional intelligence analysis, identification, analysis and determination on the current driver's facial expression dynamic information uploaded by the driver's emotion real-time recognition unit 200.
  • the alarm prompt unit 400 in this system is installed in the cab of the vehicle 100 to be monitored.
  • the monitoring client software of the vehicle exterior and remote management unit 600, and the driver's emotion real-time recognition unit 200 in the vehicle, the vehicle-mounted The gateway unit 300 and the remote management unit 600 are associated.
  • the alarm prompt unit 400 here includes a local sound and light alarm or voice prompt device and a remote monitoring client alarm display setting.
  • the local sound and light alarm or voice prompt device in the alarm prompt unit 400 is set in the cab and vehicle of automobile transportation. Externally, it is respectively connected to the driver's emotion real-time recognition unit 200 and the vehicle-mounted gateway unit 300; the local alarm prompt unit thus configured can issue a voice based on the driver's real-time emotional state sent by the driver's emotion real-time recognition unit 200 or the vehicle-mounted gateway unit 300. Prompt or sound and light alarm.
  • the remote monitoring client alarm display in the alarm prompt unit 400 is set in the government industry management client software, enterprise operation management client software, and driver and passenger service client software of the remote management unit, and is connected to the vehicle gateway unit 300; set in this way
  • the monitoring client of the alarm prompt unit issues a voice or text prompt based on the driver identity verification result or driver status monitoring and determination result sent by the vehicle gateway unit 300 .
  • Figure 4 shows a schematic diagram of the composition principle and usage flow of the alarm prompt unit 400 in the safe driving warning system given in this example.
  • the alarm prompt unit 400 given in this example consists of an indoor sound and light alarm module 410, an indoor voice prompt module 420, an outdoor sound and light alarm module 430, an outdoor voice prompt module 440 and other vehicle local alarm prompts.
  • the sub-units and the remote monitoring client software alarm prompt sub-units such as the government industry management client software 610, the enterprise operation management client software 620, and the driver and passenger service client software 630 cooperate with each other.
  • the audible and visual alarm module 410 in the cab in the alarm prompt unit 400 configured in this way is used to issue an audible and visual alarm when the driver's emotion recognition result is abnormal.
  • the light emitted by the audible and visual alarm of the optical alarm module is generally red by default.
  • the in-cab voice prompt module 420 is used to prompt the driver to adjust his mood or park nearby when the driver's emotion recognition result is abnormal.
  • the in-cab voice prompt module 420 here can be set up independently with the in-cab audible and visual alarm module or combined into a voice audible and visual alarm.
  • the audible and visual alarm module 430 outside the cab is used to issue an audible and visual alarm to the crowd outside the vehicle if the driver's emotion recognition result is seriously abnormal.
  • the light emitted by the sound and light alarm of the sound and light alarm module here is generally red by default, and the volume of the alarm sound is enough to alert passers-by in a noisy road environment.
  • the voice prompt module 440 outside the cab is used to issue voice prompts to people outside the vehicle when the driver's emotion recognition results are seriously abnormal.
  • the volume of the voice prompts generated by the voice prompt module 440 outside the cab and the volume of the alarm sound are enough to arouse high alertness of passers-by in a noisy road environment, and the voice broadcast content of the voice warning content is clear enough to be clearly understood by the listener.
  • the government industry management client software 610 is used to receive alarm information forwarded by the vehicle gateway through the communication center when the driver's emotion recognition result is abnormal. As an example, when the government industry management client software receives information such as serious abnormalities in driver emotion recognition results, it defaults to initiating the emergency management process according to the emergency plan.
  • the enterprise operation management client software 620 is used to receive alarm information forwarded by the vehicle gateway through the communication center when the driver's emotion recognition result is abnormal.
  • the enterprise operation management client software 620 receives information such as a serious abnormality in the driver's emotion recognition result, it defaults to initiating the emergency management process according to the emergency plan and simultaneously sends an emergency alarm message to the government industry management client.
  • the driver and passenger service client 630 is used to receive the alarm information forwarded by the vehicle-mounted gateway through the communication center when the driver's emotion recognition result is abnormal, and while issuing the alarm information, it also prompts the driver to adjust his mood or park nearby, etc. according to the driver and passenger service client.
  • Voice prompts for content are set based on different end user roles. As an example, the driver and passenger service client here issues a voice prompt while issuing an alarm message. The content of the voice prompt differs depending on the user role of the driver and passenger service client.
  • the driver service client's voice prompts the driver to adjust his or her mood or prompts the driver to concentrate or park nearby;
  • the escort service client of a hazardous chemical transport vehicle prompts the escort to supervise the driver to adjust his or her mood or prompts the driver to concentrate or park nearby. Park nearby and wait.
  • the vehicle control unit 500 in this system is placed in the cab of the vehicle 100 to be monitored, and is associated with the real-time driver emotion recognition unit 200, the vehicle gateway unit 300 and the remote management unit 600 in the vehicle.
  • the vehicle control unit 500 is installed in the car cab or the car engine compartment, links the vehicle's starting system, speed control system and braking system, and is associated with the vehicle-mounted gateway unit 300 and the driver's emotion real-time recognition unit 200, and through the vehicle-mounted gateway unit 300 is associated with the alarm prompt unit 400, the remote management unit 600 and/or the driver's emotion real-time recognition unit 200.
  • the vehicle control unit 500 can control whether the vehicle speeds up, slows down or brakes urgently based on the driver's real-time emotional state analysis results sent by the driver's emotion real-time recognition unit 200 or the vehicle gateway unit 300 .
  • Figure 5 shows a schematic diagram of the composition principle and usage flow of the vehicle control unit 500 used in the safe driving warning system provided in this example.
  • the vehicle control unit 500 is composed of an anti-lock braking (ABS) module 510 and/or a speed limit management module 520 and/or an intelligent brake management module 530 and/or an electronically controlled brake assist (
  • ABS anti-lock braking
  • the EBA modules 540 are combined with each other or formed independently.
  • the vehicle control unit 500 configured in this way can use the anti-lock braking (ABS) module 510 to receive the information sent by the driver's emotion real-time recognition unit 200 , or the driver's emotion real-time recognition unit 200 passes the vehicle gateway unit 300
  • ABS anti-lock braking
  • the driver's real-time emotional abnormality recognition results forwarded or forwarded by the enterprise operation management client software 610 through the communication center 640 and the vehicle gateway unit 300 can prevent possible loss of vehicle driving direction or sideslip during emergency braking.
  • the vehicle control unit 500 may use the speed limit management module 520 to receive what is sent by the driver's emotion real-time recognition unit 200 , or forwarded by the driver's emotion real-time recognition unit 200 through the vehicle gateway unit 300 , or by the enterprise operation management client software 610 through the communication center 640 and the driver's real-time emotional abnormality identification results forwarded by the vehicle-mounted gateway unit 300 and control the maximum driving speed of the vehicle.
  • the vehicle control unit 500 may use the intelligent brake management module 530 to receive what is sent by the driver's emotion real-time recognition unit 200, or forwarded by the driver's emotion real-time recognition unit 200 through the vehicle gateway unit 300, or by the enterprise operation management client software 610 through the communication center. 640 and the vehicle-mounted gateway unit 300 forward the driver's real-time emotion abnormal recognition results and activate the intelligent braking device to reduce the real-time driving speed of the vehicle.
  • the vehicle control unit 500 may use the electronically controlled brake assist (EBA) module 540 to receive what is sent by the driver's emotion real-time recognition unit 200 or forwarded by the driver's emotion real-time recognition unit 200 through the vehicle gateway unit 300 or the enterprise operation management client software 610 forwards the driver's real-time emotional abnormality recognition results through the communication center 640 and the vehicle gateway unit 300 and quickly activates all the braking force when emergency braking is required to prevent the driver's slow reaction in abnormal conditions, resulting in traffic accidents caused by excessive vehicle braking distances.
  • EBA electronically controlled brake assist
  • the vehicle control unit 500 When deploying the application, the vehicle control unit 500 is preferably directly associated with the real-time driver emotion recognition unit 200 and the vehicle-mounted gateway unit 300. In this way, when the vehicle control unit 500 receives the driver's emotional state detection abnormal result, the vehicle control unit controls the vehicle speed limit, Slowing down or emergency braking; thus achieving different types of precise control of vehicles in different situations and effectively ensuring vehicle driving safety.
  • the remote management unit 600 in this system is set up on the cloud platform and/or local storage server of the automobile transportation-related government industry authority and/or the personal handheld smart terminal of the relevant manager, the transportation enterprise to which the automobile belongs, and the transportation company.
  • the cloud platform and/or local storage server of the relevant parties and/or the personal handheld smart terminals of relevant managers and the personal handheld smart terminals of drivers and passengers are associated with the vehicle-mounted gateway unit 300 and communicate with the driver of the vehicle through the vehicle-mounted gateway unit 300
  • the emotion real-time recognition unit 200, the alarm prompt unit 400 and the vehicle control unit 500 are associated.
  • the remote management unit 600 receives the driver's real-time emotions sent by the vehicle gateway unit 300 to identify, analyze, and determine, and gives vehicle management and driver management control instructions based on the emotion recognition results and feedbacks them to the vehicle.
  • the gateway unit 300 feeds back to the alarm prompt unit 400 or the vehicle control unit 500 through the vehicle gateway to send out audible and visual alarms, voice prompts or control the vehicle ACC to open or close or control vehicle speed limit, deceleration or emergency braking.
  • FIG. 6 a schematic diagram of the composition principle and usage flow of the remote management unit 600 used in the safe driving warning system in this example is shown.
  • the remote management unit 600 consists of government industry management client software 610, enterprise operation management client software 620, driver and passenger service client software 630 and communication center 640 (such as a cloud platform or local servers and/or personal mobile smart terminals) that cooperate with each other.
  • government industry management client software 610 enterprise operation management client software 620
  • driver and passenger service client software 630 and communication center 640 (such as a cloud platform or local servers and/or personal mobile smart terminals) that cooperate with each other.
  • the remote management unit 600 configured in this way can use the government industry management client software 610 to receive and display the driver's emotional state forwarded by the real-time recognition unit 200 of the driver's emotion through the vehicle gateway unit 300 and through the communication center 640.
  • relevant management instructions are issued and the driver is managed based on the received driver's emotional state monitoring results; when the driver's emotional state monitoring results are received showing serious abnormalities, the emergency management process is initiated and relevant emergency disposal instructions are issued.
  • the remote management unit 600 can use the enterprise operation management client software 620 to receive and display the driver's emotional state monitoring results sent by the driver's emotion real-time identification unit 200 or forwarded by the driver's emotion real-time identification unit 200 through the vehicle gateway unit 300 and through the communication center 640 , issue relevant management instructions and manage drivers based on the received driver's emotional state monitoring results; when receiving the driver's emotional state monitoring results showing serious abnormalities, initiate the emergency management process and issue an emergency alarm to the government industry management client and issue relevant emergency response instructions.
  • the remote management unit 600 can use the driver and passenger service client software 630 to receive and display the driver's emotional state monitoring sent by the real-time driver's emotion recognition unit 200 or forwarded by the driver's emotion real-time recognition unit 200 through the vehicle gateway unit 300 and through the communication center 640 As a result, relevant alarm prompts are issued based on the received driver's emotional state monitoring results.
  • the remote management unit 600 can use the communication center 640 to communicate with the vehicle-mounted gateway unit 300 to receive and store the current driver's facial expression dynamic information collected by the driver's emotion real-time recognition unit 200 forwarded by the vehicle-mounted gateway unit 300 Or driver status monitoring results.
  • the emotional intelligence analysis and recognition component is set in the remote management unit 600, the emotional intelligence analysis and recognition can be performed through the cloud platform of the communication center 640 or the local server.
  • the communication center 640 here also serves as the computer system environment for the government industry management client software 610, the enterprise operation management client software 620, and the driver and passenger service client software 630, supports related software applications, and forwards the government industry to the vehicle gateway unit 300. Management instructions or response instructions of the management client software 610, the enterprise operation management client software 620, and the driver and passenger service client software 630.
  • the remote management unit 600 When the safe driving warning system based on driver's emotional intervention given in this example is used for operating vehicles, the remote management unit 600 generally needs to have a government industry management client 610, an enterprise operation management client 620, and a driver and passenger service client. 630 and communication center 640; when the safe driving warning system based on driver's emotional intervention given in this example is used for non-commercial transportation vehicles, the remote management unit 600 does not need to have the government industry management client 610; when the safe driving warning system based on driver's emotion intervention given in this example is used When the driver's emotion intervention safe driving warning system is used in private vehicles, the remote management unit 600 may not have the government industry management client 610 and the enterprise operation management client 620, and the driver and passenger service client 630 may also only retain the driver service client. Terminal 631, the communication center 640 may also retain only the driver service client 643.
  • the present invention further clearly provides the specific devices that may be involved in the corresponding functional units and modules in the safe driving warning system based on driver's emotional intervention.
  • FIG. 2 shows a structural principle and a schematic diagram of the usage flow of the real-time driver emotion recognition unit 200 used in the safe driving warning system given in this example.
  • the real-time driver emotion recognition unit 200 mainly includes a facial high-speed camera module 210 and an emotion intelligent analysis and recognition module 220.
  • the facial high-speed camera module 210 here is used to collect the facial expression dynamics of the current driver.
  • the facial high-speed camera module 210 includes, but is not limited to, an external high-speed video capture camera, an embedded high-speed video capture camera, and a light fill device.
  • the types of facial high-speed camera collection devices include but are not limited to visible light high-speed video collection cameras, near-infrared high-speed video collection cameras, special high-speed cameras for collecting three-dimensional facial expression dynamics, or three-dimensional high-speed facial expression dynamics collectors; specifically based on the vehicle's
  • the installation conditions and management requirements of the carrier are determined and are not limited here.
  • the emotion intelligent analysis and recognition module 220 here is used to intelligently analyze and recognize the facial expression dynamics collected by the facial high-speed camera module 210, and determine the real-time emotional state of the current driver.
  • the device form of the emotional intelligence analysis and recognition module includes but is not limited to the emotion intelligence analysis and recognition component (module) built into the driver's emotion real-time recognition unit, the emotion intelligence analysis and recognition component (module) in the vehicle gateway unit, and the emotion intelligence analysis and recognition component (module) in the remote management unit.
  • Intelligent analysis and identification components modulees.
  • the types of the intelligent emotion analysis and recognition device include but are not limited to facial expression analysis or micro-expression analysis, and facial micro-vibration analysis based on different technical principles. The details are determined based on the installation conditions of the vehicle and the management requirements of the carrier, and are not limited here.
  • the driver emotion real-time recognition unit 200 constructed accordingly can be directly associated with the vehicle control unit 500 or indirectly associated with the vehicle control unit 500 and/or the remote management unit 600 through the vehicle gateway unit 300 .
  • the vehicle control unit 500 controls the vehicle speed limit, deceleration or emergency braking, and the alarm prompt unit issues a danger warning Status or dangerous behavior alarm prompts, analysis identification or judgment results, and vehicle control unit actions are uploaded to the remote management unit 600 through the vehicle gateway unit 300 .
  • the vehicle gateway unit 300 sends an instruction to the vehicle control unit 500, and the vehicle control unit 500
  • the vehicle speed limit, deceleration or emergency braking is controlled, and the alarm prompt unit issues an alarm prompt for a dangerous state or dangerous behavior.
  • the analysis, identification or judgment results and the action of the vehicle control unit 500 are uploaded to the remote management unit 600 through the vehicle gateway unit 300.
  • the driver's emotion real-time recognition unit 200 When the driver's emotion real-time recognition unit 200 is indirectly associated with the vehicle control unit 500 through the vehicle gateway unit 300, but the emotion intelligent analysis and recognition component based on video analysis is in the remote management unit 600, the facial high-speed camera in the driver's emotion real-time recognition unit 200 The dynamic information on the current driver's facial expression collected by the module is uploaded to the remote management unit 600 through the vehicle gateway unit 300.
  • the remote management unit 600 performs intelligent analysis, identification or determination and sends the analysis, identification or determination results back to the vehicle gateway unit 300.
  • the vehicle gateway unit 300 sends instructions to the vehicle control unit 500; the vehicle control unit 500 controls the vehicle speed limit, deceleration or emergency braking, and the alarm prompt unit 400 issues an alarm prompt for a dangerous state or dangerous behavior; the action status of the vehicle control unit 500 is uploaded to the remote through the vehicle gateway management unit.
  • FIG. 3 shows a structural principle of the vehicle-mounted gateway unit 300 and a schematic diagram of its network communication module in the safe driving warning system based on driver's emotional intervention given in this example.
  • the network communication module 310 in the vehicle gateway unit 300 provided in this example consists of a 5G communication device 311, a CAN bus communication device 312, a TCP/IP communication device 313, a Bluetooth communication device 314, and other wireless communication devices. Communication (WIFI, UWB, Zigbee, etc.) devices 315 and so on are combined.
  • the network communication module 310 can use the 5G communication device 311 to communicate between the vehicle gateway unit 300 and the remote management unit 600;
  • the network communication module 310 can use the CAN bus communication device 312 to implement wired communication using the CAN bus between the vehicle gateway unit 300 and the real-time driver emotion recognition unit 200, the alarm prompt unit 400 and the vehicle control unit 500.
  • the network communication module 310 can use the TCP/IP communication device 313 to implement TCP/IP wired communication between the vehicle gateway unit 300 and the real-time driver emotion recognition unit 200, the alarm prompt unit 400, the vehicle control unit 500 and the remote management unit 600. or wireless communications.
  • the network communication module 310 can use the Bluetooth communication device 314 to implement wireless communication based on the Bluetooth protocol between the vehicle gateway unit 300 and the real-time driver emotion recognition unit 200 and the alarm prompt unit 400 .
  • the network communication module 310 can use other wireless communication (WIFI, UWB, Zigbee, etc.) devices 314 to implement communication between the vehicle gateway unit 300 and the driver's emotion real-time recognition unit 200 and the alarm prompt unit 400 based on corresponding protocols such as WIFI, UWB, Zigbee, etc. Wireless communication.
  • WIFI wireless communication
  • UWB Universal Mobile Broadband
  • Zigbee Zigbee
  • the network communication module 310 in this example has at least three communication devices: a 5G communication device 311, a CAN bus communication device 312, and a TCP/IP communication device 313.
  • the configuration of other wireless communication devices depends on the camera installed on the vehicle. The specific communication method is determined and is not limited here.
  • the data storage module 320 in the vehicle-mounted gateway unit 300 provided in this example includes a built-in data storage device and an external data storage device.
  • the built-in data storage device is used to store the current driver's facial expression dynamic information uploaded by the driver's emotion real-time recognition unit.
  • the built-in data storage device specifically includes but is not limited to built-in static random access memory SRAM, built-in dynamic random access memory DRAM, built-in hard disk, and built-in read-only memory ROM.
  • External data storage devices here include but are not limited to external mobile hard drives, USB flash drives, TF memory cards, SD memory cards, rewritable CD-RW, DVD-RAM discs, non-rewritable CD-ROMs, and DVD-ROM discs. .
  • the edge computing module 330 in the vehicle gateway unit 300 provided in this example includes an AI smart chip containing edge computing functions and a terminal SDK containing edge computing.
  • the circuit board AI smart chip with edge computing function and the terminal SDK with edge computing here are used to conduct emotional intelligent analysis, identification, analysis and judgment on the current driver's facial expression dynamic information uploaded by the driver's emotion real-time recognition unit.
  • the vehicle-mounted gateway unit 300 composed of the network communication module 310, the data storage module 320, and the edge computing module 330 can be directly associated with the real-time driver emotion recognition unit 200, the vehicle control unit 500, the alarm prompt unit 400 and Remote management unit 500.
  • the vehicle-mounted gateway unit 300 When the vehicle-mounted gateway unit 300 receives the driver's real-time emotional abnormality result, the vehicle-mounted gateway unit 300 sends instructions to the vehicle control unit 500 to control the vehicle speed limit, deceleration or emergency braking, and issues a dangerous state or dangerous behavior alarm to the alarm prompt unit 400
  • the voice prompt reminds the driver to eliminate abnormal emotions or prompts the driver to stop and rest nearby, and forwards the driver status monitoring results and vehicle control unit action information to the remote management unit 600.
  • the vehicle-mounted gateway unit 300 forwards the current driver's facial expression dynamic information collected by the facial high-speed camera device to the remote management unit 600; at the same time, it receives the intelligent information from the remote management unit 600. After analysis and identification or determination, the identification or determination results will be analyzed and instructions will be sent to the vehicle control unit 500 and/or the alarm prompt unit 400, and then the action status of the vehicle control unit will be uploaded to the remote management unit 600.
  • the alarm prompt unit 400 in this example can be directly associated with the driver's emotion real-time recognition unit 200 and the vehicle gateway unit 300 when deployed.
  • the alarm prompt unit 400 issues an audible and visual alarm. It also provides voice prompts to the driver to adjust their mood, concentrate or park nearby;
  • the alarm prompt unit 400 emits a sound inside and outside the vehicle.
  • the light alarm and the voice inside and outside the vehicle prompt the driver to adjust his mood, concentrate or stop nearby, and remind passers-by to be alert to vehicle anomalies, avoid them in time, or call the police immediately;
  • the alarm prompt unit 400 issues an alarm prompt or a voice prompt;
  • the alarm prompt unit 400 issues an emergency alarm and a voice prompt and By default, the emergency management process is started according to the emergency plan.
  • FIG. 7 it is a schematic diagram showing a structural principle of the government industry management client 610 of the remote management unit in the safe driving warning system given in this example.
  • the government industry management client 610 of the remote management unit 600 provided in this example includes public security industry management client software 611, transportation industry management client software 612, and emergency industry management client according to different competent industry departments.
  • the public security industry management client software 611 in the government industry management client 610 is used to alarm drivers with abnormal emotions.
  • the driver's abnormal emotion alarm can receive and display the driver's abnormal emotion alarm information.
  • When receiving a high-risk alarm it can send a warning to the enterprise operation management client and the driver and passenger service client in the form of text, image, voice, file, etc. information and send out linkage management information according to emergency plan settings.
  • the transportation industry management client software 612 in the government industry management client 610 is used to alert drivers to abnormal emotions.
  • the driver's abnormal emotion alarm can receive and display the driver's abnormal emotion alarm information.
  • When receiving a high-risk alarm it can send a warning to the enterprise operation management client and the driver and passenger service client in the form of text, image, voice, file, etc. information and send out linkage management information according to emergency plan settings.
  • the emergency industry management client software 613 in the government industry management client 610 is used to alert drivers to abnormal emotions.
  • the driver's abnormal emotion alarm can receive and display the driver's abnormal emotion alarm information.
  • When receiving a high-risk alarm it can send a warning to the enterprise operation management client and the driver and passenger service client in the form of text, image, voice, file, etc. information and send out linkage management information according to emergency plan settings.
  • driver's abnormal emotion alarm record query supports querying the driver's abnormal emotion alarm record information of a certain car through the driver's name, vehicle license plate number, and specified time range.
  • Figure 8 shows a schematic diagram of the composition principle of the enterprise operation management client 620 of the remote management unit in the safe driving warning system given in this example.
  • the enterprise operation management client 620 of the remote management unit 600 includes shipper management client software 621, carrier management client software 622, and receiving unit management client depending on the user.
  • Software 623 the enterprise operation management client 620 of the remote management unit 600 provided in this example includes shipper management client software 621, carrier management client software 622, and receiving unit management client depending on the user.
  • Software 623 the enterprise operation management client 620 of the remote management unit 600 provided in this example includes shipper management client software 621, carrier management client software 622, and receiving unit management client depending on the user.
  • the shipping unit management client software 621 in the enterprise operation management client 620 is used to query the driver's abnormal emotion alarm record.
  • the driver's abnormal emotion alarm record query supports querying the driver's abnormal emotion alarm record information of a certain car through the driver's name, vehicle license plate number, and a specified time range.
  • the carrier management client software 622 in the enterprise operation management client 620 is used to alert drivers to abnormal emotions.
  • the driver's abnormal emotion alarm here can receive and display the driver's abnormal emotion alarm information.
  • a warning message is sent to the driver and passenger service client in the form of text, image, voice, file, etc.
  • a warning message will be sent to the driver and passenger service client in the form of text, image, voice, file, etc., and a linked alarm message will be sent to the government industry management client immediately according to the emergency plan settings.
  • the receiving unit management client software 623 in the enterprise operation management client 620 is used to query the driver's abnormal emotion alarm record.
  • the driver's abnormal emotion alarm record query supports querying the driver's abnormal emotion alarm record information of a certain car through the driver's name, vehicle license plate number, and a specified time range.
  • the enterprise operation management client 620 of the remote management unit 600 When the safe driving warning system based on driver's emotional intervention given in this example is used for cargo transportation operating vehicles, the enterprise operation management client 620 of the remote management unit 600 usually has both the shipper management client software 621 and the carrier management client software 621 . Client software 622, receiving unit management client software 623; when the safe driving warning system based on driver emotion intervention given in this example is used for passenger operating vehicles, non-operating official vehicles and non-commercial transportation vehicles, The enterprise operation management client 620 of the remote management unit 600 may only retain the carrier management client software 622; when the safe driving warning system based on driver emotion intervention given in this example is used for private vehicles, the remote management unit 600 may not have Enterprise operation management client 620.
  • Figure 9 shows a schematic diagram of the composition principle of the driver and passenger service client 630 of the remote management unit of the safe driving warning system given in this example.
  • the driver and passenger service client 630 of the remote management unit 600 provided in this example includes driver service client software 631 and escort service client software 632 depending on the user.
  • the driver service client software 631 in the driver and passenger service client 630 is used to alert the driver of abnormal emotions.
  • the driver's abnormal emotion alarm here can receive and display the driver's abnormal emotion alarm information.
  • a warning message When a medium-risk level or low-risk level alarm is received, a warning message will be issued by voice or a specific preset sound. In high-risk alarm situations, warning messages are issued in the form of high-level alarm content-set voices or specific high-level alarm preset sounds.
  • the escort service client software 632 in the driver and passenger service client 630 is used to alert the driver of abnormal emotions.
  • the driver's abnormal emotion alarm here can receive and display the driver's abnormal emotion alarm information.
  • a warning message When a medium-risk level or low-risk level alarm is received, a warning message will be issued by voice or a specific preset sound.
  • warning messages When the government industry management client and the carrier management client issue high-risk alarms, warning messages will be issued in the form of voices set by the high-level alarm content or preset sounds for specific high-level alarms, and continuous voice prompts will be given to escort personnel for supervision.
  • Drivers can correct abnormal behaviors or choose opportunities to stop and take a rest, and support feedback on corrective situations and corrective measures within the specified time through text, images, voice, files, etc.
  • the escort (safety officer) service client in the driver and passenger service client 630 of the remote management unit 600 The software 632 is usually the escort service client software; when the safe driving warning system based on driver emotional intervention given in this example is used for passenger operating vehicles or school buses, the driver and passenger service client 630 of the remote management unit 600
  • the escort (safety officer) service client software 632 is usually the safety officer service client software; when the safe driving warning system based on driver's emotional intervention given in this example is used, it does not require the deployment of escort personnel, safety personnel or co-pilots.
  • the driver and passenger service client 630 of the remote management unit 600 may not have the escort (safety officer) service client software.
  • FIG. 10 shows a schematic structural diagram of the communication center 640 in the remote management unit in the safe driving warning system based on driver emotion intervention given in this example.
  • the communication center 640 of the remote management unit 600 provided in this example includes a cloud platform 641, a local server 642 and a personal mobile intelligent terminal 643.
  • a cloud platform combined with a personal mobile smart terminal is preferably used as a communication center application.
  • the details can be determined based on the actual communication conditions of different users and are not limited here.
  • the cloud platform 641 in this communication center 640 is used for storage of data information uploaded by the real-time driver emotion recognition unit 200, intelligent analysis, identification and determination of data information uploaded by the real-time driver emotion recognition unit 200, and government industry management client software 610/enterprise operations.
  • the cloud platform 641 communicates with the vehicle-mounted gateway unit 300, receives and stores the current driver's facial expression dynamic information collected by the facial high-speed camera module 211 in the driver's emotion real-time recognition unit 200 and forwarded by the vehicle-mounted gateway unit 300. Or driver emotion recognition results.
  • the emotion intelligence analysis and identification component When the emotion intelligence analysis and identification component is set on the cloud platform 641, the emotion intelligence analysis and identification is performed through the cloud platform 641, and the government industry management client software 610, enterprise operation management client software 620, and driver and passenger services are forwarded to the vehicle gateway unit 300. Management instructions or response instructions of the client software 630.
  • This cloud platform 641 supports B/S monitoring client applications.
  • the B/S monitoring client is developed based on the latest version of China's high-security operating system and China's high-security Xinchuang version browser.
  • the local server 642 in the communication center 640 is used for separate storage of data information uploaded by the real-time driver emotion recognition unit 200, intelligent analysis, identification and determination of data information uploaded by the real-time driver emotion recognition unit 200, and government industry management client software 610/enterprise operations.
  • Management client software 620/driver and passenger service client software 630 are data sources for data reception and invocation respectively, supporting government industry management client software 610/enterprise operation management client software 620/driver and passenger service client software 630 applications
  • the computer hardware platform environment, government industry management client software 610/enterprise operation management client software 620/driver and passenger service client software 630 communicate and interact with the vehicle gateway unit 300.
  • the local server 642 communicates with the vehicle-mounted gateway unit 300, receives and stores the current driver's facial expression dynamic information collected by the facial high-speed camera module 211 of the driver's emotion real-time recognition unit 200 and forwarded by the vehicle-mounted gateway unit 300. Or driver emotion recognition results.
  • the emotional intelligence analysis and recognition component When the emotional intelligence analysis and recognition component is set on the local server 642, the emotional intelligence analysis and recognition is performed through the local server 642, and the government industry management client software 610, the enterprise operation management client software 620, and the driver and passenger are respectively forwarded to the vehicle gateway unit 300. Management instructions or response instructions of the service client software 630.
  • the local server 642 supports the C/S monitoring client application.
  • the C/S monitoring client is developed based on various latest versions of high-security operating systems based on the Linux kernel;
  • the personal handheld smart terminal 643 in this communication center 640 is used as an online query tool and temporary storage space for the data information uploaded by the real-time driver emotion recognition unit 200, and supports the government industry management mobile client APP software 610/enterprise operation management mobile client APP Software 620/Driver and Passenger Service Mobile Client APP Software 630 Application Computer Hardware Environment, Government Industry Management Mobile Client APP Software 610/Enterprise Operation Management Mobile Client APP Software 620/Driver and Passenger Service Mobile Client APP Software 630 and Communication interaction between the cloud platform 641 or the local server 642 and the vehicle-mounted gateway unit 300.
  • the personal handheld intelligent terminal 643 communicates with the vehicle-mounted gateway unit 300 through the cloud platform 641 or the local server 642, and receives the driver's abnormal emotions forwarded by the driver's emotion real-time identification unit 200 through the vehicle-mounted gateway unit 300 and forwarded by the cloud platform 641 or the local server 642. alarm information, and forward the management instructions or response instructions of the government industry management mobile client APP software 610/enterprise operation management mobile client APP software 620/driver and passenger service mobile client APP software 630 to the vehicle gateway unit 300.
  • the personal handheld smart terminal 643 supports mobile monitoring client APP applications.
  • the mobile monitoring client APP is developed based on operating systems based on Linux kernel such as HarmonyOS microkernel or Android.
  • the remote management unit 600 composed of government industry management client software 610, enterprise operation management client software 620, driver and passenger service client software 630 and communication center 640 is set on the cloud platform and/or of the automobile transportation-related government industry authorities.
  • the local storage server and/or the personal handheld smart terminals of relevant managers the cloud platform and/or the local storage server and/or the personal handheld smart terminals of relevant managers, the cloud platform of the transportation company and transportation related parties to which the car belongs, and the personal handheld smart terminals of relevant managers, and the personal data of drivers and passengers.
  • Handheld smart terminal connected to the vehicle gateway unit.
  • the remote management unit 600 receives the driver's emotion recognition results sent by the vehicle-mounted gateway unit 300 to give vehicle management and driver management control instructions, or receives the dynamic collection information of the driver's facial expressions sent by the vehicle-mounted gateway unit 300, and performs the driver's facial expression dynamic collection.
  • Real-time emotions are recognized and analyzed, and vehicle management and driver management control instructions are given according to the emotion recognition results, which are fed back to the vehicle-mounted gateway unit 300, and fed back to the alarm prompt unit 400 or vehicle control unit 500 through the vehicle-mounted gateway unit 300 to emit sound and light.
  • the resulting safe driving warning system based on driver's emotional intervention is based on the driver's real-time emotion recognition unit to collect the driver's real-time facial expression dynamic information and identify the edge of the driver's real-time facial expression through the emotional intelligence analysis module of the driver's real-time emotion recognition unit or the vehicle gateway unit.
  • the emotional intelligence analysis and recognition module of the computing module or remote management unit performs facial micro-expression analysis and/or face micro-vibration analysis.
  • the analysis results link the vehicle control unit and alarm prompt unit to perform automatic speed control, braking and other operations, and perform operations such as automatic speed control and braking. It controls the driving status of the vehicle while issuing voice prompts or sound and light alarms to prevent drivers from driving in abnormal emotional states that are not suitable for driving. When the driver has abnormal emotions, it reduces driving risks through active intelligent safety prevention and control to ensure the driving of the car. security.
  • the safe driving warning system based on driver's emotional intervention when applied to general private vehicles, it does not need to include a remote management unit.
  • the above-mentioned method of the present invention can be deployed on physical media, such as hard drives, optical disks, or any electronic devices (such as smart phones, computers, etc.) through program codes.
  • the storage medium read), when the machine loads the program code and executes it (such as a smart phone loads and executes it), the machine becomes a device for executing the present invention.
  • the above-mentioned method and device of the present invention can also be transmitted in the form of program code through some transmission media, such as cables, optical fibers, or any transmission type.
  • a machine such as a smart phone
  • the machine becomes the device for carrying out the invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Combustion & Propulsion (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Chemical & Material Sciences (AREA)
  • Emergency Management (AREA)
  • Mathematical Physics (AREA)
  • Business, Economics & Management (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Traffic Control Systems (AREA)

Abstract

一种基于驾驶人情绪干预的安全驾驶预警系统，该系统通过驾驶人情绪实时识别单元（200）获取当前驾驶人的面部表情动态，并基于获取到的面部表情动态进行智能情绪分析，同时依据实时情绪识别结果来控制车辆运行状态。该系统通过对驾驶人驾驶过程中的情绪进行实时监测，并根据监测结果联动控制车辆（100）的行驶状态和/或对驾驶人形成安全警告，从而实现从驾驶人角度保障各类车辆的交通安全。

Description

一种基于驾驶人情绪干预的安全驾驶预警系统 技术领域
本发明涉及汽车行车安全监控技术，具体涉及公路客运、旅游客运、危化品运输车、货运车辆、校车、公交车、出租车、各类平台的网约车或租用车等全部营运性质车辆、非营业性运输车辆及私家车辆的行车安全监控。
背景技术
随着社会经济的快速发展，我国的公路总里程数快速增加，上路行驶的各类车辆也日益增多。伴随交通事业发展和汽车保有量的增加，我国道路交通事故数量也在不断攀升。近年来,我国每年平均有近10万人因交通事故丧生,每天都有近300人被车祸夺去生命,交通死亡事故率约占全球的15％,成为交通事故多发国家。过去三年中，全国年均发生交通事故约24万起，死亡人数年均约6万人，每年造成直接财产损失为14亿元。
在造成交通事故的人、车、道路环境三要素中,人的因素占比55％以上，其中，因驾驶人情绪异常，甚至因处于愤怒情绪而开斗气车、赌气车导致的交通事故占比近30％。
研究表明，汽车驾驶人的情绪对安全行车的影响很大。驾驶人在满意、愉快、高兴、欢喜时，反应灵敏度提高，行车精力充沛、精神集中，观察分析情况灵敏果断，操作迅速、敏捷、及时，驾驶的差错少，对行车安全是一种保证。反之，驾驶员存在厌恶、愤怒、恐惧或悲哀等不良情绪时，感受能力降低，精力分散、无精打采、反应迟钝、操作迟缓，时有失误，对行车安全是一种潜在威胁。严重的甚至会因坏情绪引发“路怒症”冲动之下主观造成事故。
因此，如何通过有效的技术手段对潜在的可能由于驾驶人情绪异常导致的事故风险进行有效监控和主动干预，切实提高全部营运性质车辆、非营业性运输车辆及私家车辆等全部行驶车辆的行车安全性，尤其是一旦发生事故，后果会更为严重的“两客一危”类车辆及货运车辆、校车的行车安全性是本领域亟需解决的问题。
发明内容
针对现有技术手段无法实现针对驾驶人情绪不稳定情况的来对车辆进行安全管控的问 题，需要一种能够针对车辆驾驶人情绪状态进行有效监测，并基于监测结果来对驾驶人进行情绪干预、对车辆的行驶状态进行安全管控的方案。
为此，本发明的目的在于提供一种基于驾驶人情绪干预的安全驾驶预警系统，其采用驾驶人情绪分析技术来对驾驶人的情绪状态进行实时监测，并与车辆控制系统实现联动，由此对潜在的可能由于驾驶人情绪异常因素引发的事故风险进行有效的预警和主动干预，防范驾驶人在妨害安全驾驶的异常情绪状态下驾驶车辆，保障驾驶人在正常情绪状态下安全驾驶车辆，并确保当驾驶人出现异常情绪时车辆进行主动智能安全防控，以提高车辆运行的安全性。
为了达到上述目的，本发明提供的基于驾驶人情绪干预的安全驾驶预警系统，包括：
驾驶人情绪实时识别单元，所述驾驶人情绪实时识别单元用于获取当前驾驶人的面部表情动态，并基于获取到的面部表情动态进行智能情绪分析或将获取到的面部表情动态传至车载网关单元进行智能情绪分析；所述驾驶人情绪实时识别单元能够依据实时情绪识别结果直接关联车辆控制单元通过车载网关单元关联车辆控制单元，控制车辆运行状态；
车载网关单元，所述车载网关单元分别与驾驶人情绪实时识别单元、车辆控制单元、报警提示单元和远程管理单元关联；所述车载网关单元还能够配合驾驶人情绪实时识别单元进行情绪识别；
车辆控制单元，所述车辆控制单元联动车辆的启动系统、控速系统和制动系统，并与车载网关单元、驾驶人情绪实时识别单元关联，所述车辆控制单元依据驾驶人情绪实时识别单元发送的或车载网关单元发送的驾驶人实时情绪状态分析结果控制车辆行驶状态；
报警提示单元，所述报警提示单元分别与驾驶人情绪实时识别单元、车载网关单元连接配合；
远程管理单元，所述远程管理单元通过车辆控制单元配合驾驶人情绪实时识别单元完成驾驶人情绪识别，能够给出对应的车辆管理及驾驶人管理控制指令，反馈给车载网关单元。
进一步地，所述驾驶人情绪实时识别单元的驾驶人情绪实时识别单元包括面部高速摄像模块和情绪智能分析识别模块；
所述面部高速摄像模块用于采集当前驾驶人的面部表情动态，可包括面部高速摄像采集装置和补光装置；
所述情绪智能分析识别模块用于对面部高速摄像装置采集到的面部表情动态进行智能分析识别，判定当前驾驶人实时情绪状态。
进一步地，所述驾驶人情绪实时识别单元直接关联车辆控制单元或通过车载网关间接关联车辆控制单元和/或远程管理单元。
进一步地，所述车载网关单元包括网络通讯模块和/或数据存储模块和/或边缘计算模块；
所述网络通讯模块用于驾驶人情绪实时识别单元与报警提示单元、车辆控制单元及远程管理单元之间的数据交互；
所述数据存储模块用于存储驾驶人情绪实时识别单元与报警提示单元、车辆控制单元及远程管理单元之间交互的数据；
所述边缘计算模块用于基于驾驶人情绪实时识别单元与报警提示单元、车辆控制单元及远程管理单元之间交互的数据进行情绪智能分析识别。
进一步地，所述车载网关单元的网络通讯模块包括5G通信装置、CAN总线通信装置、TCP/IP通信装置、蓝牙(Bluetooth)通信装置、其他无线通信(WIFI、UWB、Zigbee等)装置。
进一步地，所述车载网关单元的数据存储模块包括内置式数据存储装置和外置式数据存储装置。
进一步地，所述车载网关单元的边缘计算模块包括含边缘计算功能的AI智能芯片、含边缘计算的终端SDK。
进一步地，所述车载网关单元直接关联驾驶人情绪实时识别单元、车辆控制单元、报警提示单元和远程管理单元。
进一步地，所述报警提示单元包括车辆本地报警提示子单元及远程监控客户端软件报警提示子单元。
进一步地，所述报警提示单元直接关联驾驶人情绪实时识别单元、车载网关单元。
进一步地，所述车辆控制单元包括防抱死模块和/或限速管理模块和/或智能制动管理模块和/或电子控制制动辅助模块；
所述防抱死模块用于在收到的驾驶人状态异常监测结果时防止紧急刹车时可能出现的车辆行驶方向失控或侧滑现象；
所述限速管理模块用于在收到驾驶人状态异常监测结果时控制车辆最高行驶速度；
所述智能制动管理模块用于在收到的驾驶人状态异常监测结果时启动智能刹车装置降低车辆实时行驶速度；
所述电子控制制动辅助模块用于在收到的驾驶人状态异常监测结果时需紧急制动时快 速启动全部制动力。
进一步地，所述车辆控制单元直接关联驾驶人情绪实时识别单元和车载网关单元。当车辆控制单元收到驾驶人实时情绪识别异常结果时，车辆控制单元控制车辆限速、降速或紧急制动。
进一步地，所述安全驾驶预警系统还包括远程管理单元，所述远程管理单元通过车辆控制单元配合驾驶人情绪实时识别单元完成驾驶人情绪识别，能够给出对应的车辆管理及驾驶人管理控制指令，反馈给车载网关单元。
进一步地，所述远程管理单元包括政府行业管理客户端软件、企业运营管理客户端软件、驾乘人员服务客户端软件和通信中心。
进一步地，所述远程管理单元的政府行业管理客户端依据主管行业部门的不同包括公安行业管理客户端软件、交通行业管理客户端软件、应急行业管理客户端软件、其他行业管理客户端软件(如保险行业管理客户端软件)等。
进一步地，所述远程管理单元的企业运营管理客户端依据使用方的不同包括托运单位管理客户端软件、承运单位管理客户端软件、收货单位管理客户端软件。
进一步地，所述远程管理单元的驾乘人员服务管理客户端依据使用方的不同包括驾驶人服务客户端软件、押运人(安全员)服务客户端软件。
进一步地，所述远程管理单元的通信中心包括云平台、本地服务器和个人移动智能终端。
进一步地，所述远程管理单元接收车载网关单元发送的驾驶人实时情绪识别结果给出车辆管理及驾驶人管理控制指令，或接收车载网关单元发送的驾驶人面部表情动态采集信息，对驾驶人的实时情绪进行识别，并根据情绪识别结果给出车辆管理及驾驶人管理控制指令，反馈给车载网关单元，并通过车载网关反馈给报警提示单元或车辆控制单元。
本发明提供的基于驾驶人情绪干预的安全驾驶预警系统，能够对驾驶人在驾驶过程中的情绪状态进行实时监测与预警，并根据监测结果以主动驾驶辅助安全防控的方式自动联动控制车辆的行驶状态并对驾驶人形成安全警告，从而能够实现从驾驶人角度保障汽车运输的运行安全。
具体的，本发明提供的基于驾驶人情绪干预的安全驾驶预警系统，可对驾驶人在驾驶车辆过程中的面部动态表情或面部振动幅度情况进行实时监测，综合分析驾驶人的实时情绪状态，依据情绪状态的分析识别判定结果自动控制车辆自动限速、减速或紧急制动并同 时发出语音提示或声光报警，对潜在的可能由于驾驶人因素引发的事故风险进行有效的预警和主动干预，防范驾驶人在妨害安全驾驶的异常情绪状态下驾驶车辆，保障驾驶人在正常情绪状态、精神状态下安全驾驶车辆，并确保当驾驶人出现异常情绪时车辆进行主动智能安全防控，以提高车辆运行的安全性。
附图说明
以下结合附图和具体实施方式来进一步说明本发明。
图1为本发明实例提供的基于驾驶人情绪干预的安全驾驶预警系统的构成原理及使用流程示意图；
图2为本发明实例中驾驶人情绪实时情绪识别单元的构成原理及使用流程示意图；
图3为本发明实例中车载网关单元构成原理及其网络通讯模块示意图；
图4为本发明实例中报警提示单元构成原理及使用流程示意图；
图5为本发明实例中车辆控制单元构成原理及使用流程示意图；
图6为本发明实例中远程管理单元构成原理及使用流程示意图；
图7为本发明实例中远程管理单元的政府行业管理客户端构成原理示意图；
图8为本发明实例中远程管理单元的企业运营管理客户端构成原理示意图；
图9为本发明实例中远程管理单元的驾乘人员服务客户端构成原理示意图；
图10为本发明实例中远程管理单元的通信中心构成原理示意图。
具体实施方式
为了使本发明实现的技术手段、创作特征、达成目的与功效易于明白了解，下面结合具体图示，进一步阐述本发明。
本发明创新的从驾驶人管理角度切入，对驾驶人驾驶过程中的实时情绪状态进行实时监测，并根据监测结果实时联动控制车辆的行驶状态和/或对驾驶人形成安全警告，由此来对因驾驶人因素可能导致的安全隐患实现智能预警，同时能够联动控制车辆的行驶状态，从而实现消除因驾驶人因素导致的安全隐患，从驾驶人管理角度保障相应车辆运输安全。
据此，本发明提供一种基于驾驶人情绪干预的安全驾驶预警系统，该安全驾驶预警系统能够对驾驶人在驾驶车辆过程中的面部动态表情或面部振动幅度进行实时监测，综合分析驾驶人的实时情绪状态，依据情绪状态分析识别判定结果自动控制车辆自动限速、减速 或紧急制动并同时发出语音提示或声光报警，对潜在的可能由于驾驶人情绪异常因素引发的事故风险进行有效的预警和主动干预，防范驾驶人在妨害安全驾驶的异常情绪状态下驾驶车辆，保障驾驶人在正常情绪状态、精神状态下安全驾驶车辆，并确保当驾驶人出现异常情绪时车辆进行主动智能安全防控，防范如公路客运、旅游客运、危化品运输车、货运车辆、校车、公交车、出租车、各类平台的网约车或租用车等全部营运性质车辆、非营业性运输车辆及私家车辆等相应车辆发生交通安全事故。
参见图1，其所示为本发明给出的一种基于驾驶人情绪干预的安全驾驶预警系统的整体构成原理示意图。
基于图1所示，本行车安全管理系统主要由驾驶人情绪实时识别单元200、车载网关单元300、报警提示单元400、车辆控制单元500以及远程管理单元600相互配合构成。
本系统中的驾驶人情绪实时识别单元200设置在待监测车辆100的驾驶室内，与车辆的车载网关单元300、报警提示单元400、车辆控制单元500关联，并通过车载网关单元300与远程管理单元600关联。
本驾驶人情绪实时识别单元200能够实时监控驾驶人的情绪状态，可通过本单元自身，也可通过车载网关单元300的边缘计算模块或通过车载网关单元300的网络通讯模块传输至远程管理单元600进行情绪识别判定。
同时本驾驶人情绪实时识别单元200能够依据实时情绪识别结果或通过车载网关单元从远程管理单元获取依据相关情绪识别结果产生的管理指令，直接关联车辆控制单元500或通过车载网关单元300关联车辆控制单元500，控制车辆的防抱死(ABS)模块、限速管理模块、智能制动管理模块或电子控制制动辅助(EBA)模块的工作状态进行限速、控速或减速操作。
作为举例，这里针对的待监测车辆100可以为“两客一危一货一校”车辆、出租车及各类平台的网约车、租用车等全部营运性质车辆、非营业运输车辆。根据需要也可以为一般的私家车辆。
本实例给出的驾驶人情绪实时识别单元200能够有效获取当前驾驶人的面部表情动态，并将获取到的面部表情动态传至自身的智能情绪分析功能模块(如驾驶人情绪实时识别单元200自身构建的边缘计算模块)或车载网关单元智能情绪分析功能模块(如车载网关单元中构建的边缘计算模块)或通过车载网关单元传至远程管理单元的智能情绪分析功能模块。
作为举例，本驾驶人情绪实时识别单元200中根据需要具体可设置相应的智能情绪分析功能模块，该智能情绪分析功能模块用于接收驾驶人情绪实时识别单元210所获取到当前驾驶人的面部表情动态数据，这里的动态数据可以为视频、图片等等，并依据该数据进行智能情绪分析，并形成对应的实时情绪分析结果。
进一步的，该智能情绪分析功能模块在实现时，可由驾驶人情绪实时识别单元200自身构建的边缘计算模块来实现，具体的构成技术，可根据实际需求而定，如可基于驾驶人情绪实时识别单元200硬件自带的边缘计算功能来实现，。
如此设置的驾驶人情绪实时识别单元200能够采集当前驾驶人的面部表情动态和/或对采集到的面部表情动态进行智能分析识别，判定当前驾驶人实时情绪状态。
本驾驶人情绪实时识别单元200在进行智能分析识别时，可直接通过在驾驶人情绪实时识别单元200内构建相应的边缘计算模块(即智能情绪分析功能模块)来进行智能分析识别。
作为替代方案，本驾驶人情绪实时识别单元200还可通过与车载网关单元300配合来完成驾驶人情绪智能分析识别。本替代方案中，通过在车载网关单元300中运行相应的边缘计算模块，驾驶人情绪实时识别单元200将所获取到当前驾驶人的面部表情动态数据传输至车载网关单元300，由车载网关单元300中运行的边缘计算模块据此进行智能分析识别，判定当前驾驶人实时情绪状态。
作为另一替代方案，本驾驶人情绪实时识别单元200还可通过车载网关单元300与远程管理单元600配合来完成驾驶人情绪智能分析识别。本替代方案中，驾驶人情绪实时识别单元200将所获取到当前驾驶人的面部表情动态数据传输至车载网关单元300，再由车载网关单元300传输至远程管理单元600，由远程管理单元600据此数据进行智能分析识别，判定当前驾驶人实时情绪状态。
这样本驾驶人情绪实时识别单元200在运行时，针对所监测到的数据，可通过驾驶人情绪实时识别单元200自带的边缘计算模块，也可通过车载网关单元300的边缘计算模块或通过车载网关单元300的网络通讯模块传输至远程管理单元600进行情绪识别判定。
本驾驶人情绪实时识别单元200同时依据实时情绪识别结果；或通过车载网关单元300从远程管理单元600获取依据相关情绪识别结果产生的管理指令，直接关联车辆控制单元500或通过车载网关单元300关联车辆控制单元500，由此实现控制车辆的防抱死(ABS)模块、限速管理模块、智能制动管理模块或电子控制制动辅助(EBA)模块的工作状态进 行限速、减速或紧急制动操作，实现对车辆运行状态的管控。
基于图1所示，本系统中的车载网关单元300设置在待监测车辆100的驾驶室内，与车辆的驾驶人情绪实时识别单元200、报警提示单元400、车辆控制单元500及远程管理单元600关联。
这里的车载网关单元300至少具备网络通讯功能和/或数据存储功能和/或边缘计算功能并与远程管理单元600之间建立通信通道，以对驾驶人情绪实时识别单元200产生的数据信息进行识别、分析或将相关信息传输至远程管理单元进行识别、分析，并将远程管理单元返回的管理数据信息发送至车辆控制单元和报警提示单元.
参见图3，其所示为本实例给出的基于驾驶人情绪干预的安全驾驶预警系统中车载网关单元300的一种构成原理及其网络通讯模块示意图。
基于图3所示，本实例给出的车载网关单元300由网络通讯模块310和/或数据存储模块320和/或边缘计算模块330互相组合构成或独立构成。其中，网络通讯模块310为基本组成部分，即为车载网关单元300的必要组成部分。
基于图1和图3所示，如此设置的车载网关单元300使用网络通讯模块310进行驾驶人情绪实时识别单元200与报警提示单元400、车辆控制单元500及远程管理单元600之间的数据交互。
本车载网关单元300使用网络通讯模块310可将驾驶人情绪实时识别单元200上传的当前驾驶人面部表情动态信息或实时情绪分析识别结果转发至远程管理单元600。
与之配合的，本车载网关单元300还可依据接收到的驾驶人实时情绪分析识别结果向车辆控制单元500和报警提示单元400发送相应指令；或依据车载网关单元300的边缘计算模块330得到的实时情绪分析识别结果向车辆控制单元500和报警提示单元400发送相应指令；或将接收的远程管理单元600的管理指令向驾驶人情绪实时识别单元200或报警提示单元400或车辆控制单元500进行转发。
本车载网关单元300可使用数据存储模块320存储驾驶人情绪实时识别单元200上传的当前驾驶人面部表情动态信息。
本车载网关单元300可使用边缘计算模块330对驾驶人情绪实时识别单元200上传的当前驾驶人面部表情动态信息进行情绪智能分析识别分析判定。
基于图1所示，本系统中的报警提示单元400设置在待监测车辆100的驾驶室内，车辆外部及远程管理单元600的监控客户端软件，与车辆中的驾驶人情绪实时识别单元200、 车载网关单元300及远程管理单元600关联。
这里的报警提示单元400包括本地声光报警器或语音提示装置以及远程监控客户端报警显示设置，其中报警提示单元400中的本地声光报警器或语音提示装置设置在汽车运输的驾驶室内及车辆外部，分别与驾驶人情绪实时识别单元200、车载网关单元300连接；如此设置的本地报警提示单元能够依据驾驶人情绪实时识别单元200发送的或车载网关单元300发送的驾驶人实时情绪状态发出语音提示或声光报警。
本报警提示单元400中的远程监控客户端报警显示设置在远程管理单元的政府行业管理客户端软件、企业运营管理客户端软件、驾乘人员服务客户端软件，与车载网关单元300连接；如此设置的报警提示单元的监控客户端依据车载网关单元300发送的驾驶人身份核验结果或驾驶人状态监测判定结果发出语音或文字提示。
图4所示为本实例给出的安全驾驶预警系统中报警提示单元400构成原理及使用流程示意图。
基于图4所示，本实例给出的报警提示单元400由驾驶室内声光报警模块410、驾驶室内语音提示模块420、驾驶室外声光报警模块430、驾驶室外语音提示模块440等车辆本地报警提示子单元及政府行业管理客户端软件610、企业运营管理客户端软件620、驾乘人员服务客户端软件630等远程监控客户端软件报警提示子单元相互配合构成。
基于图1和图4所示，如此设置的报警提示单元400中的驾驶室内声光报警模块410用于驾驶人情绪识别结果异常时发出声光报警。作为举例，光报警模块的声光报警器发出的光一般默认红色。
驾驶室内语音提示模块420用于驾驶人情绪识别结果异常时提示驾驶人调整情绪或就近停车。作为举例，这里的驾驶室内语音提示模块420可以与驾驶室内声光报警模块独立设置或合并为语音声光报警器。
驾驶室外声光报警模块430用于驾驶人情绪识别结果严重异常发出对车辆外人群的声光报警。作为举例，这里的声光报警模块的声光报警器发出的光一般默认红色，报警声音的音量足以在路面嘈杂环境中引起路人警觉。
驾驶室外语音提示模块440用于驾驶人情绪识别结果严重异常时对车辆外人群发出语音提示。作为举例，这里驾驶室外语音提示模块440产生的语音提示的音量，报警声音的音量足以在路面嘈杂环境中引起路人高度警觉，语音警示内容的语音播报清晰度足以被听者明确理解。
政府行业管理客户端软件610用于驾驶人情绪识别结果异常时接收车载网关通过通信中心转发的报警信息。作为举例，政府行业管理客户端软件接收到驾驶人情绪识别结果严重异常等信息时默认按应急预案启动应急管理流程。
企业运营管理客户端软件620用于驾驶人情绪识别结果异常时接收车载网关通过通信中心转发的报警信息。作为举例，企业运营管理客户端软件620接收到驾驶人情绪识别结果严重异常等信息时默认按应急预案启动应急管理流程并向政府行业管理客户端同步发出紧急报警信息。
驾乘人员服务客户端630用于驾驶人情绪识别结果异常时接收车载网关通过通信中心转发的报警信息，并在发出报警信息的同时发出提示驾驶人调整情绪或就近停车等依据驾乘人员服务客户端用户角色不同而设定好内容的语音提示。作为举例，这里的驾乘人员服务客户端在发出报警信息的同时发出语音提示，语音提示依据驾乘人员服务客户端用户角色不同内容有所差异。如驾驶人员服务客户端语音提示驾驶人调整情绪或提示驾驶人集中精神或就近停车；危险化学品运输车辆的押运人员服务客户端语音提示押运人员监督驾驶人调整情绪或提示监督驾驶人集中精神或就近停车等。
基于图1所示，本系统中的车辆控制单元500设置在待监测车辆100的驾驶室内，与车辆中的驾驶人情绪实时识别单元200、车载网关单元300及远程管理单元600关联。
本车辆控制单元500设置在汽车驾驶室或汽车发动机舱，联动车辆的启动系统、控速系统和制动系统，并与车载网关单元300、驾驶人情绪实时识别单元200关联，并通过车载网关单元300与报警提示单元400、远程管理单元600和/或驾驶人情绪实时识别单元200关联。
本车辆控制单元500能够依据驾驶人情绪实时识别单元200发送的或车载网关单元300发送的驾驶人实时情绪状态分析结果来控制车辆是否限速、降速或紧急制动。
图5所示为本实例给出的用于安全驾驶预警系统的车辆控制单元500的一种构成原理及使用流程示意图。
基于图5所示，本实例给出的车辆控制单元500由防抱死(ABS)模块510和/或限速管理模块520和/或智能制动管理模块530和/或电子控制制动辅助(EBA)模块540互相组合构成或独立构成。
基于图1和图5所示，如此设置的车辆控制单元500可使用防抱死(ABS)模块510接收驾驶人情绪实时识别单元200发送的、或驾驶人情绪实时识别单元200通过车载网关 单元300转发的、或企业运营管理客户端软件610通过通信中心640及车载网关单元300转发的驾驶人实时情绪异常识别结果并防止紧急刹车时可能出现的车辆行驶方向失控或侧滑现象。
车辆控制单元500可使用限速管理模块520接收驾驶人情绪实时识别单元200发送的、或驾驶人情绪实时识别单元200通过车载网关单元300转发的、或企业运营管理客户端软件610通过通信中心640及车载网关单元300转发的驾驶人实时情绪异常识别结果并控制车辆最高行驶速度。
车辆控制单元500可使用智能制动管理模块530接收驾驶人情绪实时识别单元200发送的、或驾驶人情绪实时识别单元200通过车载网关单元300转发的、或企业运营管理客户端软件610通过通信中心640及车载网关单元300转发的驾驶人实时情绪异常识别结果并启动智能刹车装置降低车辆实时行驶速度。
车辆控制单元500可使用电子控制制动辅助(EBA)模块540接收驾驶人情绪实时识别单元200发送的、或驾驶人情绪实时识别单元200通过车载网关单元300转发的、或企业运营管理客户端软件610通过通信中心640及车载网关单元300转发的驾驶人实时情绪异常识别结果并在需紧急制动时快速启动全部制动力，防范驾驶人异常状态下反应迟钝导致车辆制动距离过长发生交通事故。
本车辆控制单元500在部署应用时优选直接关联驾驶人情绪实时识别单元200和车载网关单元300，这样当车辆控制单元500收到驾驶人情绪状态检测异常结果时，车辆控制单元控制车辆限速、降速或紧急制动；从而实现不同情况对车辆进行不同类别的精确管控，有效保证车辆行驶安全。
基于图1所示，本系统中的远程管理单元600设置在汽车运输相关政府行业主管部门的云平台和/或本地存储服务器和/或相关管理人员的个人手持智能终端、汽车所属运输企业及运输相关方的云平台和/或本地存储服务器和/或相关管理人员的个人手持智能终端、驾乘人员的个人手持智能终端，与车载网关单元300关联，并通过车载网关单元300与车辆的驾驶人情绪实时识别单元200、报警提示单元400及车辆控制单元500关联。
本远程管理单元600在运行时，接收车载网关单元300发送的对驾驶人的实时情绪进行识别、分析、判定，并根据情绪识别结果判定结果给出车辆管理及驾驶人管理控制指令，反馈给车载网关单元300，并通过车载网关反馈给报警提示单元400或车辆控制单元500，发出声光报警、语音提示或控制车辆ACC开启、关闭或控制车辆限速、降速或紧急制动。
参见图6，其所示为本实例给出的安全驾驶预警系统中采用到的远程管理单元600的一种构成原理及使用流程示意图。
基于图6所示，本实例给出的远程管理单元600由政府行业管理客户端软件610、企业运营管理客户端软件620、驾乘人员服务客户端软件630和通信中心640(如云平台或本地服务器和/或个人移动智能终端)相互配合构成。
基于图1和图7所示，如此设置的远程管理单元600可使用政府行业管理客户端软件610接收显示驾驶人情绪实时识别单元200通过车载网关单元300并通过通信中心640转发的驾驶人情绪状态监测结果，依据收到的驾驶人情绪状态监测结果发出相关管理指令及对驾驶人进行管理；当收到驾驶人情绪状态监测结果显示严重异常时，启动应急管理流程，发布相关应急处置指令。
远程管理单元600可使用企业运营管理客户端软件620接收显示驾驶人情绪实时识别单元200发送的或驾驶人情绪实时识别单元200通过车载网关单元300并通过通信中心640转发的驾驶人情绪状态监测结果，依据收到的驾驶人情绪状态监测结果发出相关管理指令及对驾驶人进行管理；当收到驾驶人情绪状态监测结果显示严重异常时，启动应急管理流程，向政府行业管理客户端发出紧急报警并发布相关应急处置指令。
远程管理单元600可使用驾乘人员服务客户端软件630接收显示驾驶人情绪实时识别单元200发送的或驾驶人情绪实时识别单元200通过车载网关单元300并通过通信中心640转发的驾驶人情绪状态监测结果，依据收到的驾驶人情绪状态监测结果发出相关报警提示。
远程管理单元600可使用通信中心640和车载网关单元300进行通信，接收并存储驾驶人情绪实时识别单元200通过车载网关单元300转发的驾驶人情绪实时识别单元200采集的当前驾驶人面部表情动态信息或驾驶人状态监测结果。当情绪智能分析识别组件设置在远程管理单元600时，则可通过通信中心640的云平台或本地服务器进行情绪智能分析识别。
这里的通信中心640同时作为政府行业管理客户端软件610、企业运营管理客户端软件620、驾乘人员服务客户端软件630的计算机系统环境，支撑相关软件应用，并向车载网关单元300转发政府行业管理客户端软件610、企业运营管理客户端软件620、驾乘人员服务客户端软件630的管理指令或应答指令。
当本实例给出的基于驾驶人情绪干预的安全驾驶预警系统用于营运车辆时，远程管理单元600一般需同时具备政府行业管理客户端610、企业运营管理客户端620、驾乘人员服 务客户端630和通信中心640；当本实例给出的基于驾驶人情绪干预的安全驾驶预警系统用于非营业运输车辆时，远程管理单元600可不具备政府行业管理客户端610；当本实例给出的基于驾驶人情绪干预的安全驾驶预警系统用于私家车辆时，远程管理单元600可不具备政府行业管理客户端610、企业运营管理客户端620，驾乘人员服务客户端630也可仅保留驾驶人员服务客户端631，通信中心640也可仅保留驾驶人员服务客户端643。
在此基础上，本发明进一步明确给出了基于驾驶人情绪干预的安全驾驶预警系统中相应功能单元及模块可能涉及的具体装置。
参见图2，其所示为本实例给出的用于本安全驾驶预警系统的驾驶人情绪实时识别单元200的一种构成原理以及使用流程示意图。
基于图2所示，本实例给出的驾驶人情绪实时识别单元200中主要包括面部高速摄像模块210和情绪智能分析识别模块220。
这里的面部高速摄像模块210用于采集当前驾驶人的面部表情动态。该面部高速摄像模块210包括但不限于外置的高速视频采集摄像头、嵌入式高速视频采集摄像头及补光装置。该面部高速摄像采集装置类型包括但不限于可见光高速视频采集摄像头、近红外高速视频采集摄像头、用于采集三维人脸表情动态的专用高速摄像头或三维高速人脸表情动态采集仪；具体依据车辆的安装条件及承运单位管理要求确定，此处不加以限定。
这里的情绪智能分析识别模块220用于对面部高速摄像模块210采集到的面部表情动态进行智能分析识别，判定当前驾驶人实时情绪状态。该情绪智能分析识别模块的装置形态包括但不限于驾驶人情绪实时识别单元内置的情绪智能分析识别组件(模块)、车载网关单元中的情绪智能分析识别组件(模块)、远程管理单元中的情绪智能分析识别组件(模块)。再者，该情绪智能分析识别装置类型依据技术原理不同包括但不限于面部表情分析或微表情分析、面部微振动分析。具体依据车辆的安装条件及承运单位管理要求确定，此处不加以限定。
据此构成的驾驶人情绪实时识别单元200在进行部署时，可直接关联车辆控制单元500或通过车载网关单元300间接关联车辆控制单元500和/或远程管理单元600。
当驾驶人情绪实时识别单元200直接关联车辆控制单元500时，驾驶人实时情绪识别结果达到或超出危险阈值时，车辆控制单元500控制车辆限速、降速或紧急制动，报警提示单元发出危险状态或危险行为报警提示，分析识别或判定结果及车辆控制单元动作情况通过车载网关单元300上传至远程管理单元600。
当驾驶人情绪实时识别单元200通过车载网关单元300间接关联车辆控制单元500时，驾驶人实时情绪识别结果达到或超出危险阈值后，车载网关单元300向车辆控制单元500发送指令，车辆控制单元500控制车辆限速、降速或紧急制动，报警提示单元发出危险状态或危险行为报警提示，分析识别或判定结果及车辆控制单元500动作情况通过车载网关单元300上传至远程管理单元600。
当驾驶人情绪实时识别单元200通过车载网关单元300间接关联车辆控制单元500，但基于视频分析的情绪智能分析识别组件在远程管理单元600中时，驾驶人情绪实时识别单元200中的面部高速摄像模块采集的当前驾驶人面部表情动态信息通过车载网关单元300上传至远程管理单元600，远程管理单元600进行智能分析识别或判定后将分析识别或判定结果回传给车载网关单元300，车载网关单元300向车辆控制单元500送指令；车辆控制单元500控制车辆限速、降速或紧急制动，报警提示单元400发出危险状态或危险行为报警提示；车辆控制单元500动作情况通过车载网关上传至远程管理单元。
参见图3，其所示为本实例给出的基于驾驶人情绪干预的安全驾驶预警系统中车载网关单元300的一种构成原理及其网络通讯模块示意图。
基于图3所示，本实例给出的车载网关单元300中的网络通讯模块310由5G通信装置311、CAN总线通信装置312、TCP/IP通信装置313、蓝牙(Bluetooth)通信装置314、其他无线通信(WIFI、UWB、Zigbee等)装置315等组合而成。
其中，网络通讯模块310可使用5G通信装置311进行车载网关单元300与远程管理单元600之间的通信；
网络通讯模块310可使用CAN总线通信装置312实现在车载网关单元300与驾驶人情绪实时识别单元200、报警提示单元400及车辆控制单元500之间采用CAN总线方式的有线通信。
网络通讯模块310可使用TCP/IP通信装置313实现车载网关单元300与驾驶人情绪实时识别单元200、报警提示单元400、车辆控制单元500及远程管理单元600之间的TCP/IP方式的有线通信或无线通信。
网络通讯模块310可使用蓝牙(Bluetooth)通信装置314实现车载网关单元300与驾驶人情绪实时识别单元200、报警提示单元400之间的基于蓝牙(Bluetooth)协议的无线通信。
网络通讯模块310可使用其他无线通信(WIFI、UWB、Zigbee等)装置314实现车载 网关单元300与驾驶人情绪实时识别单元200、报警提示单元400之间的基于WIFI、UWB、Zigbee等对应协议的无线通信。
作为优选方案，本实例中的网络通讯模块310至少具备5G通信装置311、CAN总线通信装置312和TCP/IP通信装置313等三种通信装置，其他无线通信装置的配备依据车辆安装的摄像头采用的具体通信方式确定，此处不加以限定。
基于图3所示，本实例给出的车载网关单元300中的数据存储模块320包括内置式数据存储装置和外置式数据存储装置。
其中，内置式数据存储装置用于存储驾驶人情绪实时识别单元上传的当前驾驶人面部表情动态信息。该内置式数据存储装置具体包括但不限于内置静态随机存储器SRAM、内置动态随机存储器DRAM、内置硬盘、内置只读存储器ROM。
这里的外置式数据存储装置包括但不限于外接移动硬盘、USB闪存盘、TF存储卡、SD存储卡、可擦写CD-RW、DVD-RAM光盘、不可擦写CD-ROM、DVD-ROM光盘。
基于图3所示，本实例给出的车载网关单元300中的边缘计算模块330包括含边缘计算功能的AI智能芯片、含边缘计算的终端SDK。
这里的含边缘计算功能的电路板AI智能芯片、含边缘计算的终端SDK用于对驾驶人情绪实时识别单元上传的当前驾驶人面部表情动态信息进行情绪智能分析识别分析判定。
据此网络通讯模块310、数据存储模块320、边缘计算模块330配合构成的车载网关单元300在进行具体部署时，可直接关联驾驶人情绪实时识别单元200、车辆控制单元500、报警提示单元400和远程管理单元500。
当车载网关单元300收到驾驶人实时情绪异常结果时，车载网关单元300向车辆控制单元500发送指令控制车辆限速、降速或紧急制动，向报警提示单元400发出危险状态或危险行为报警并语音提示提醒驾驶人消除异常情绪或提示驾驶人就近停车休息，并向远程管理单元600转发驾驶员状态监测结果及车辆控制单元动作信。
当基于视频分析的情绪智能分析识别组件在远程管理单元600中时，车载网关单元300向远程管理单元600转发面部高速摄像装置采集的当前驾驶人面部表情动态信息；同时接收远程管理单元600进行智能分析识别或判定后将分析识别或判定结果并向车辆控制单元500和/或报警提示单元400发送指令，然后将车辆控制单元动作情况上传至远程管理单元600。
进一步结合图4所示，本实例中的报警提示单元400在具体部署时，可直接关联驾驶 人情绪实时识别单元200、车载网关单元300。
当车辆本地报警提示子单元收到驾驶人情绪实时识别单元200发出的或驾驶人情绪实时识别单元200通过车载网关单元300发出的驾驶人情绪识别结果异常结果时，报警提示单元400发出声光报警并语音提示驾驶人调整情绪、集中精神或就近停车；
当车辆本地报警提示子单元收到驾驶人情绪实时识别单元200发出的或驾驶人情绪实时识别单元200通过车载网关单元300发出的驾驶人情绪识别结果严重异常时，报警提示单元400发出车辆内外声光报警及车辆内外语音提示驾驶人调整情绪、集中精神或就近停车，提示路人警惕车辆异常、及时躲避或立即报警；
当远程监控客户端软件报警提示子单元收到驾驶人情绪实时识别单元200通过车载网关单元300并通过通信中心发出的驾驶人情绪识别结果异常时，报警提示单元400发出报警提示或发出语音提示；
当远程监控客户端软件报警提示子单元收到驾驶人情绪实时识别单元200通过车载网关单元300并通过通信中心发出的驾驶人情绪识别结果严重异常时，报警提示单元400发出紧急报警及语音提示并默认按应急预案启动应急管理流程。
进一步参见图7，其所示为本实例给出的安全驾驶预警系统中的远程管理单元的政府行业管理客户端610的一种构成原理示意图。
基于图7所示，本实例给出的远程管理单元600的政府行业管理客户端610依据主管行业部门的不同包括公安行业管理客户端软件611、交通行业管理客户端软件612、应急行业管理客户端软件613和其他行业管理客户端软件(如保险行业管理客户端软件)614等。
政府行业管理客户端610中的公安行业管理客户端软件611用于驾驶人异常情绪报警。驾驶人异常情绪报警能接收并显示驾驶人异常情绪报警信息，当接收到高风险警情时能以文字、图像、语音、文件等方式向企业运营管理客户端及驾乘人员服务客户端发出警示信息并按应急预案设定发出联动管理信息。
政府行业管理客户端610中的交通行业管理客户端软件612用于驾驶人异常情绪报警。驾驶人异常情绪报警能接收并显示驾驶人异常情绪报警信息，当接收到高风险警情时能以文字、图像、语音、文件等方式向企业运营管理客户端及驾乘人员服务客户端发出警示信息并按应急预案设定发出联动管理信息。
政府行业管理客户端610中的应急行业管理客户端软件613用于驾驶人异常情绪报警。驾驶人异常情绪报警能接收并显示驾驶人异常情绪报警信息，当接收到高风险警情时能以 文字、图像、语音、文件等方式向企业运营管理客户端及驾乘人员服务客户端发出警示信息并按应急预案设定发出联动管理信息。
政府行业管理客户端610中的其他行业管理客户端软件(如保险行业管理客户端软件)614用于驾驶人异常情绪报警记录查询。驾驶人异常情绪报警记录查询支持通过驾驶人姓名、车辆车牌号码、指定时间范围查询某辆汽车的驾驶人异常情绪报警记录信息。
其中其他行业管理客户端软件还支持依据相应行业管理需求进行功能定制或在用户权限范围内自主选择开通或关闭相关监控客户端功能，此处不加以限定。
图8所示为本实例给出的安全驾驶预警系统中的远程管理单元的企业运营管理客户端620构成原理示意图。
基于图8所示，本实例给出的远程管理单元600的企业运营管理客户端620依据使用方的不同包括托运单位管理客户端软件621、承运单位管理客户端软件622、收货单位管理客户端软件623。
企业运营管理客户端620中的托运单位管理客户端软件621用于驾驶人异常情绪报警记录查询。作为举例，驾驶人异常情绪报警记录查询支持通过驾驶人姓名、车辆车牌号码、指定时间范围查询某辆汽车的驾驶人异常情绪报警记录信息。
企业运营管理客户端620中的承运单位管理客户端软件622用于驾驶人异常情绪报警。
作为举例，这里的驾驶人异常情绪报警能接收并显示驾驶人异常情绪报警信息，当接收到警情时以文字、图像、语音、文件等方式向驾乘人员服务客户端发出警示信息，当接收到高风险警情时，以文字、图像、语音、文件等方式向驾乘人员服务客户端发出警示信息并立即按应急预案设定同步向政府行业管理客户端发出联动报警信息。
企业运营管理客户端620中的收货单位管理管理客户端软件623用于驾驶人异常情绪报警记录查询。作为举例，驾驶人异常情绪报警记录查询支持通过驾驶人姓名、车辆车牌号码、指定时间范围查询某辆汽车的驾驶人异常情绪报警记录信息。
当本实例给出的基于驾驶人情绪干预的安全驾驶预警系统用于货物运输类营运车辆时，远程管理单元600的企业运营管理客户端620通常同时具备托运单位管理客户端软件621、承运单位管理客户端软件622、收货单位管理客户端软件623；当本实例给出的基于驾驶人情绪干预的安全驾驶预警系统用于客运类营运车辆、非营运公务用车及非营业性运输车辆时，远程管理单元600的企业运营管理客户端620可仅保留承运单位管理客户端软件622；当本实例给出的基于驾驶人情绪干预的安全驾驶预警系统用于私家车辆时，远程管理单元 600可不具备企业运营管理客户端620。
图9所示为本实例给出的安全驾驶预警系统的远程管理单元的驾乘人员服务客户端630的一种构成原理示意图。
基于图9示，本实例给出的远程管理单元600的驾乘人员服务客户端630依据使用方的不同包括驾驶人服务客户端软件631、押运人服务客户端软件632。
驾乘人员服务客户端630中的驾驶人服务客户端软件631用于驾驶人异常情绪报警。
作为举例，这里的驾驶人异常情绪报警能接收并显示驾驶人员异常情绪报警信息，当接收到中风险等级或低风险等级警情时以语音或特定预设声音等方式发出警示信息，当接收到高风险警情时，以高等级警情内容设定语音或特定高等级警情预设声音等方式发出警示信息。
驾乘人员服务客户端630中的押运人服务客户端软件632用于驾驶人异常情绪报警。
作为举例，这里的驾驶人异常情绪报警能接收并显示驾驶人员异常情绪报警信息，当接收到中风险等级或低风险等级警情时以语音或特定预设声音等方式发出警示信息，当接收到政府行业管理客户端和承运单位管理客户端下发的高风险警情时，以高等级警情内容设定语音或特定高等级警情预设声音等方式发出警示信息，持续语音提示押运人员监督驾驶人员纠正异常行为或择机停车休息，并支持在规定时间内以文字、图像、语音、文件等方式反馈纠正情况及纠正措施。
当本实例给出的基于驾驶人情绪干预的安全驾驶预警系统用于危险品货物运输类营运车辆时，远程管理单元600的驾乘人员服务客户端630中的押运人(安全员)服务客户端软件632通常为押运人服务客户端软件；当本实例给出的基于驾驶人情绪干预的安全驾驶预警系统用于客运类营运车辆或校车时，远程管理单元600的驾乘人员服务客户端630中的押运人(安全员)服务客户端软件632通常为安全员服务客户端软件；当本实例给出的基于驾驶人情绪干预的安全驾驶预警系统用于不要求配备押运人员、安全人员或副驾驶的客货运输车辆或私家车辆时，远程管理单元600的驾乘人员服务客户端630可不具备押运人(安全员)服务客户端软件。
进一步参阅图10，其所示为本实例给出的基于驾驶人情绪干预的安全驾驶预警系统中的远程管理单元中的通信中心640的一种构成示意图。
基于图10所示，本实例给出的远程管理单元600的通信中心640包括云平台641、本地服务器642和个人移动智能终端643。
本实例优选采用云平台组合个人移动智能终端的通信中心应用方式，具体可依据不同用户的实际通信条件确定，此处不加以限定。
本通信中心640中的云平台641用于驾驶人情绪实时识别单元200上传数据信息的存储、驾驶人情绪实时识别单元200上传数据信息的智能分析识别判定、政府行业管理客户端软件610/企业运营管理客户端软件620/驾乘人员服务客户端软件630的数据接收及调用的共享数据资源池、支撑政府行业管理客户端软件610/企业运营管理客户端软件620/驾乘人员服务客户端软件630应用的计算机硬件平台环境、政府行业管理客户端软件610/企业运营管理客户端软件620/驾乘人员服务客户端软件630与车载网关单元300之间的通信交互。
云平台641和车载网关单元300进行通信，接收并存储驾驶人情绪实时识别单元200通过车载网关单元300转发的驾驶人情绪实时识别单元200中面部高速摄像模块211采集的当前驾驶人面部表情动态信息或驾驶人情绪识别结果。
当情绪智能分析识别组件设置在云平台641时，通过云平台641进行情绪智能分析识别，并向车载网关单元300转发政府行业管理客户端软件610、企业运营管理客户端软件620、驾乘人员服务客户端软件630的管理指令或应答指令。
本云平台641支持B/S监控客户端应用，B/S监控客户端基于中国最新版本高安全操作系统及中国高安全信创版浏览器开发。
通信中心640中的本地服务器642用于驾驶人情绪实时识别单元200上传数据信息的分别存储、驾驶人情绪实时识别单元200上传数据信息的智能分析识别判定、政府行业管理客户端软件610/企业运营管理客户端软件620/驾乘人员服务客户端软件630分别进行数据接收及调用的数据源、支撑政府行业管理客户端软件610/企业运营管理客户端软件620/驾乘人员服务客户端软件630应用的计算机硬件平台环境、政府行业管理客户端软件610/企业运营管理客户端软件620/驾乘人员服务客户端软件630与车载网关单元300的通信交互。
本地服务器642和车载网关单元300进行通信，接收并存储驾驶人情绪实时识别单元200通过车载网关单元300转发的驾驶人情绪实时识别单元200中面部高速摄像模块211采集的当前驾驶人面部表情动态信息或驾驶人情绪识别结果。
当情绪智能分析识别组件设置在本地服务器642时，通过本地服务器642进行情绪智能分析识别，并向车载网关单元300分别转发政府行业管理客户端软件610、企业运营管理 客户端软件620、驾乘人员服务客户端软件630的管理指令或应答指令。
本地服务器642支持C/S监控客户端应用，C/S监控客户端基于Linux内核的各类最新版本高安全操作系统开发；
本通信中心640中的个人手持智能终端643用于驾驶人情绪实时识别单元200上传数据信息的在线查询工具和临时存储空间、支撑政府行业管理移动客户端APP软件610/企业运营管理移动客户端APP软件620/驾乘人员服务移动客户端APP软件630应用的计算机硬件环境、政府行业管理移动客户端APP软件610/企业运营管理移动客户端APP软件620/驾乘人员服务移动客户端APP软件630与云平台641或本地服务器642及车载网关单元300的通信交互。
个人手持智能终端643通过云平台641或本地服务器642和车载网关单元300进行通信，接收驾驶人情绪实时识别单元200通过车载网关单元300转发并通过云平台641或本地服务器642转发的驾驶人异常情绪报警信息，并向车载网关单元300转发政府行业管理移动客户端APP软件610/企业运营管理移动客户端APP软件620/驾乘人员服务移动客户端APP软件630的管理指令或应答指令。
该个人手持智能终端643支持移动监控客户端APP应用，移动监控客户端APP基于HarmonyOS微内核或安卓(Android)等基于Linux内核的操作系统开发。
据此政府行业管理客户端软件610、企业运营管理客户端软件620、驾乘人员服务客户端软件630和通信中心640构成的远程管理单元600设置在汽车运输相关政府行业主管部门的云平台和/或本地存储服务器和/或相关管理人员的个人手持智能终端、汽车所属运输企业及运输相关方的云平台和/或本地存储服务器和/或相关管理人员的个人手持智能终端、驾乘人员的个人手持智能终端，与车载网关单元连接。
如此，本远程管理单元600接收车载网关单元300发送的驾驶人情绪识别结果给出车辆管理及驾驶人管理控制指令，或接收车载网关单元300发送的驾驶人面部表情动态采集信息，对驾驶人的实时情绪进行识别分析，并根据情绪识别结果给出车辆管理及驾驶人管理控制指令，反馈给车载网关单元300，并通过车载网关单元300反馈给报警提示单元400或车辆控制单元500，发出声光报警、语音提示或控制车辆限速、降速或紧急制动。
由此形成的基于驾驶人情绪干预的安全驾驶预警系统，基于驾驶人情绪实时识别单元采集驾驶人实时面部表情动态信息并通过驾驶人实时情绪识别单元的情绪智能分析识别模块或车载网关单元的边缘计算模块或远程管理单元的情绪智能分析识别模块进行基于面部 微表情分析和/或面对微振动分析，分析结果联动车辆控制单元及报警提示单元，进行自动控速、制动等操作，并在控制车辆行驶状态的同时发出语音提示或声光报警，防范驾驶人在不适合驾驶的异常情绪状态下驾驶车辆，并在驾驶人出现异常情绪时通过主动智能安全防控降低行车风险，保证汽车行驶的安全性。
另外，基于驾驶人情绪干预的安全驾驶预警系统在应用到一般私家车辆上时，也可不包含其中的远程管理单元。
最后需要说明的上述本发明的方法，或特定系统单元、或其部份单元，可以透过程序代码布设于实体媒体，如硬盘、光盘片、或是任何电子装置(如智能型手机、计算机可读取的储存媒体)，当机器加载程序代码且执行(如智能型手机加载且执行)，机器成为用以实行本发明的装置。上述本发明的方法与装置亦可以程序代码型态透过一些传送媒体，如电缆、光纤、或是任何传输型态进行传送，当程序代码被机器(如智能型手机)接收、加载且执行，机器成为用以实行本发明的装置。
以上显示和描述了本发明的基本原理、主要特征和本发明的优点。本行业的技术人员应该了解，本发明不受上述实施例的限制，上述实施例和说明书中描述的只是说明本发明的原理，在不脱离本发明精神和范围的前提下，本发明还会有各种变化和改进，这些变化和改进都落入要求保护的本发明范围内。本发明要求保护范围由所附的权利要求书及其等效物界定。

Claims (10)

  1. 一种基于驾驶人情绪干预的安全驾驶预警系统，其特征在于，包括：
    驾驶人情绪实时识别单元，所述驾驶人情绪实时识别单元用于获取当前驾驶人的面部表情动态，并基于获取到的面部表情动态进行智能情绪分析或将获取到的面部表情动态传至车载网关单元进行智能情绪分析；所述驾驶人情绪实时识别单元能够依据实时情绪识别结果直接关联车辆控制单元通过车载网关单元关联车辆控制单元，控制车辆运行状态；
    车载网关单元，所述车载网关单元分别与驾驶人情绪实时识别单元、车辆控制单元、报警提示单元和远程管理单元关联；所述车载网关单元还能够配合驾驶人情绪实时识别单元进行情绪识别；
    车辆控制单元，所述车辆控制单元联动车辆的控速系统和制动系统，并与车载网关单元、驾驶人情绪实时识别单元关联，所述车辆控制单元依据驾驶人情绪实时识别单元发送的或车载网关单元发送的驾驶人实时情绪状态分析结果控制车辆行驶状态；
    报警提示单元，所述报警提示单元分别与驾驶人情绪实时识别单元、车载网关单元连接配合；
    远程管理单元，所述远程管理单元通过车辆控制单元配合驾驶人情绪实时识别单元完成驾驶人情绪识别，能够给出对应的车辆管理及驾驶人管理控制指令，反馈给车载网关单元。
  2. 根据权利要求1所述的安全驾驶预警系统，其特征在于：所述驾驶人情绪实时识别单元的驾驶人情绪实时识别单元包括面部高速摄像模块和情绪智能分析识别模块；
    所述面部高速摄像模块用于采集当前驾驶人的面部表情动态；
    所述情绪智能分析识别模块用于对面部高速摄像装置采集到的面部表情动态进行智能分析识别，判定当前驾驶人实时情绪状态。
  3. 根据权利要求1所述的安全驾驶预警系统，其特征在于：所述驾驶人情绪实时识别单元直接关联车辆控制单元或通过车载网关间接关联车辆控制单元和/或远程管理单元。
  4. 根据权利要求1所述的安全驾驶预警系统，其特征在于：所述车载网关单元包括网络通讯模块和/或数据存储模块和/或边缘计算模块；
    所述网络通讯模块包括5G通信装置、CAN总线通信装置、TCP/IP通信装置、蓝牙通信装置、其他无线通信装置中的一种或多种，用于驾驶人情绪实时识别单元与报警提示单元、车辆控制单元及远程管理单元之间的数据交互；
    所述数据存储模块包括内置式数据存储装置和外置式数据存储装置，用于存储驾驶人情 绪实时识别单元与报警提示单元、车辆控制单元及远程管理单元之间交互的数据；
    所述边缘计算模块包括含边缘计算功能的AI智能芯片、含边缘计算的终端SDK，用于基于驾驶人情绪实时识别单元与报警提示单元、车辆控制单元及远程管理单元之间交互的数据进行情绪智能分析识别。
  5. 根据权利要求1所述的安全驾驶预警系统，其特征在于：所述报警提示单元包括车辆本地报警提示子单元及远程监控客户端软件报警提示子单元。
  6. 根据权利要求1所述的安全驾驶预警系统，其特征在于：所述车辆控制单元包括防抱死模块和/或限速管理模块和/或智能制动管理模块和/或电子控制制动辅助模块；
    所述防抱死模块用于在收到的驾驶人状态异常监测结果时防止紧急刹车时可能出现的车辆行驶方向失控或侧滑现象；
    所述限速管理模块用于在收到驾驶人状态异常监测结果时控制车辆最高行驶速度；
    所述智能制动管理模块用于在收到的驾驶人状态异常监测结果时启动智能刹车装置降低车辆实时行驶速度；
    所述电子控制制动辅助模块用于在收到的驾驶人状态异常监测结果时需紧急制动时快速启动全部制动力。
  7. 根据权利要求1或6所述的安全驾驶预警系统，其特征在于：所述车辆控制单元直接关联驾驶人情绪实时识别单元和车载网关单元；当车辆控制单元收到驾驶人情绪识别异常结果时，车辆控制单元控制车辆限速、降速或紧急制动。
  8. 根据权利要求1所述的安全驾驶预警系统，其特征在于：所述安全驾驶预警系统还包括远程管理单元，所述远程管理单元通过车辆控制单元配合驾驶人情绪实时识别单元完成驾驶人情绪识别，能够给出对应的车辆管理及驾驶人管理控制指令，反馈给车载网关单元。
  9. 根据权利要求8所述的安全驾驶预警系统，其特征在于：所述远程管理单元包括政府行业管理客户端、企业运营管理客户端、驾乘人员服务客户端和通信中心；
    所述远程管理单元的政府行业管理客户端依据主管行业部门的不同包括公安行业管理客户端软件、交通行业管理客户端软件、应急行业管理客户端软件、其他行业管理客户端软件；
    所述远程管理单元的企业运营管理客户端依据使用方的不同包括托运单位管理客户端软件、承运单位管理客户端软件、收货单位管理客户端软件；
    所述远程管理单元的驾乘人员服务管理客户端依据使用方的不同包括驾驶人服务客户端软件、押运人服务客户端软件；
    所述远程管理单元的通信中心包括云平台、本地服务器和个人移动智能终端。
  10. 根据权利要求8或9所述的安全驾驶预警系统，其特征在于：所述远程管理单元接收车载网关单元发送的驾驶人实时情绪识别结果给出车辆管理及驾驶人管理控制指令，或接收车载网关单元发送的驾驶人实时面部表情采集信息，对驾驶人的实时情绪进行识别，并根据情绪识别结果给出车辆管理及驾驶人管理控制指令，反馈给车载网关单元，并通过车载网关反馈给报警提示单元或车辆控制单元。
PCT/CN2022/129873 2022-06-07 2022-11-04 一种基于驾驶人情绪干预的安全驾驶预警系统 WO2023236434A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210642173.8 2022-06-07
CN202210642173.8A CN115056786A (zh) 2022-06-07 2022-06-07 一种基于驾驶人情绪干预的安全驾驶预警系统

Publications (1)

Publication Number Publication Date
WO2023236434A1 true WO2023236434A1 (zh) 2023-12-14

Family

ID=83200410

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/129873 WO2023236434A1 (zh) 2022-06-07 2022-11-04 一种基于驾驶人情绪干预的安全驾驶预警系统

Country Status (2)

Country Link
CN (1) CN115056786A (zh)
WO (1) WO2023236434A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115056786A (zh) * 2022-06-07 2022-09-16 公安部第三研究所 一种基于驾驶人情绪干预的安全驾驶预警系统
CN114802266B (zh) * 2022-06-07 2023-10-27 公安部第三研究所 一种基于驾驶人情绪和疲劳度分析的行车安全管理系统
CN114834474B (zh) * 2022-06-07 2023-10-27 公安部第三研究所 一种基于驾驶人实时状态监测的主动安全辅助驾驶系统
CN117022294B (zh) * 2023-08-17 2024-05-14 山东理工大学 一种危险驾驶行为识别及预警方法与系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130054090A1 (en) * 2011-08-29 2013-02-28 Electronics And Telecommunications Research Institute Emotion-based vehicle service system, emotion cognition processing apparatus, safe driving service apparatus, and emotion-based safe driving service method
CN109572705A (zh) * 2018-12-11 2019-04-05 武汉格罗夫氢能汽车有限公司 一种驾驶员情绪管理方法、设备及存储设备
CN110154757A (zh) * 2019-05-30 2019-08-23 电子科技大学 公交车多方位安全驾驶保障方法
CN114049677A (zh) * 2021-12-06 2022-02-15 中南大学 基于驾驶员情绪指数的车辆adas控制方法及系统
CN114802266A (zh) * 2022-06-07 2022-07-29 公安部第三研究所 一种基于驾驶人情绪和疲劳度分析的行车安全管理系统
CN115056786A (zh) * 2022-06-07 2022-09-16 公安部第三研究所 一种基于驾驶人情绪干预的安全驾驶预警系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130054090A1 (en) * 2011-08-29 2013-02-28 Electronics And Telecommunications Research Institute Emotion-based vehicle service system, emotion cognition processing apparatus, safe driving service apparatus, and emotion-based safe driving service method
CN109572705A (zh) * 2018-12-11 2019-04-05 武汉格罗夫氢能汽车有限公司 一种驾驶员情绪管理方法、设备及存储设备
CN110154757A (zh) * 2019-05-30 2019-08-23 电子科技大学 公交车多方位安全驾驶保障方法
CN114049677A (zh) * 2021-12-06 2022-02-15 中南大学 基于驾驶员情绪指数的车辆adas控制方法及系统
CN114802266A (zh) * 2022-06-07 2022-07-29 公安部第三研究所 一种基于驾驶人情绪和疲劳度分析的行车安全管理系统
CN115056786A (zh) * 2022-06-07 2022-09-16 公安部第三研究所 一种基于驾驶人情绪干预的安全驾驶预警系统

Also Published As

Publication number Publication date
CN115056786A (zh) 2022-09-16

Similar Documents

Publication Publication Date Title
WO2023236434A1 (zh) 一种基于驾驶人情绪干预的安全驾驶预警系统
WO2023236433A1 (zh) 一种基于驾驶人情绪和疲劳度分析的行车安全管理系统
US11756414B2 (en) Systems and methods for intra-vehicle pedestrian and infrastructure communication
WO2023236432A1 (zh) 一种基于驾驶人实时状态监测的主动安全辅助驾驶系统
US20220262239A1 (en) Determining causation of traffic events and encouraging good driving behavior
JP7263233B2 (ja) 車両衝突を検出するための方法、システム及びプログラム
JP7236454B2 (ja) 無人運転車両を制御するための方法及び装置
US10229461B2 (en) Continuous identity monitoring for classifying driving data for driving performance analysis
CN111210620B (zh) 一种驾驶员画像的生成方法、装置、设备及存储介质
JP2002042288A (ja) 運行状態記録装置及びそれを利用した運行管理システム
WO2023236431A1 (zh) 一种基于驾驶人全息管理的汽车运输安全监控系统
CN104637326A (zh) 基于云端服务的车辆驾驶安全系统
JP3656401B2 (ja) ドライバーへの警報システム
CN114639231A (zh) 公路交通处理方法、装置及系统
US20200094820A1 (en) Automatically assessing and reducing vehicular incident risk
WO2023236439A1 (zh) 一种基于物联网的车辆自身安全监测系统
CN111917873A (zh) 一种事故处理系统、方法、装置、终端及存储介质
US20210174684A1 (en) Transport dangerous driving reporting
WO2023236437A1 (zh) 一种基于座椅承压分析的驾驶人疲劳状态监测系统
WO2023236429A1 (zh) 一种车载易燃易爆物品防燃爆安全管理系统
US20240062652A1 (en) Traffic light indication system with suppressed notification for a vehicle
CN115240174A (zh) 一种驾驶员操作行为识别方法、装置及车辆监控系统
CN115086294A (zh) 一种基于云平台的危险品汽车运输安全监控客户端
CN116432911A (zh) 数据处理方法、装置及存储介质
CN111225033A (zh) 一种车辆的管理方法、装置、设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22945563

Country of ref document: EP

Kind code of ref document: A1