WO2021179889A1 - 驾驶辅助方法和驾驶辅助装置 - Google Patents

驾驶辅助方法和驾驶辅助装置 Download PDF

Info

Publication number
WO2021179889A1
WO2021179889A1 PCT/CN2021/077092 CN2021077092W WO2021179889A1 WO 2021179889 A1 WO2021179889 A1 WO 2021179889A1 CN 2021077092 W CN2021077092 W CN 2021077092W WO 2021179889 A1 WO2021179889 A1 WO 2021179889A1
Authority
WO
WIPO (PCT)
Prior art keywords
driver
terminal
driving assistance
abnormal state
abnormal
Prior art date
Application number
PCT/CN2021/077092
Other languages
English (en)
French (fr)
Inventor
高磊
马莎
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP21768730.0A priority Critical patent/EP4101718A4/en
Publication of WO2021179889A1 publication Critical patent/WO2021179889A1/zh
Priority to US17/940,815 priority patent/US20230042206A1/en

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/06Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/168Evaluating attention deficit, hyperactivity
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6893Cars
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/746Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K28/00Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
    • B60K28/02Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
    • B60K28/06Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
    • B60K28/066Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver actuating a signalling device
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W40/09Driving style or behaviour
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/087Interaction between the driver and the control system where the control system corrects or modifies a request from the driver
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00Drive control systems specially adapted for autonomous road vehicles
    • B60W60/005Handover processes
    • B60W60/0051Handover processes from occupants to vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00Drive control systems specially adapted for autonomous road vehicles
    • B60W60/005Handover processes
    • B60W60/0059Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174Facial expression recognition
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00Evaluating a particular growth phase or type of persons or animals
    • A61B2503/20Workers
    • A61B2503/22Motor vehicles operators, e.g. drivers, pilots, captains
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818Inactivity or incapacity of driver
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818Inactivity or incapacity of driver
    • B60W2040/0827Inactivity or incapacity of driver due to sleepiness
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818Inactivity or incapacity of driver
    • B60W2040/0836Inactivity or incapacity of driver due to alcohol
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818Inactivity or incapacity of driver
    • B60W2040/0845Inactivity or incapacity of driver due to drugs
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0872Driver physiology
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W2050/0062Adapting control system settings
    • B60W2050/0075Automatic parameter input, automatic initialising or calibrating means
    • B60W2050/0083Setting, resetting, calibration
    • B60W2050/0088Adaptive recalibration
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143Alarm means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403Image sensing, e.g. optical camera
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/10Accelerator pedal position
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/12Brake pedal position
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/18Steering angle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/221Physiology, e.g. weight, heartbeat, health or special needs
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/229Attention level, e.g. attentive to driving, reading or sleeping
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/24Drug level, e.g. alcohol

Definitions

  • This application relates to the field of automatic driving, and more specifically, to a driving assistance method and a driving assistance device.
  • the status of the driver is highly related to the safety of driving or operating mobile devices (such as vehicles, etc.).
  • driving or operating mobile devices such as vehicles, etc.
  • an abnormal driving state such as drunk driving, fatigued driving, distracted by other things (such as calling, picking up things, etc.)
  • the inability to focus on driving will greatly increase the possibility of traffic accidents and cause traffic An important cause of the accident.
  • a driver monitoring system (DMS) is installed on the vehicle to realize the monitoring and early warning of the driver, so as to improve driving safety and reduce the accident rate.
  • DMS driver monitoring system
  • the DMS can give feedback to the driver such as warnings based on the detected state of the driver.
  • DMS may give offensive or unnecessary warnings. It severely affected the actual role of DMS, resulting in low efficiency of DMS and ineffective in reducing the incidence of traffic accidents.
  • the present application provides a driving assistance method and a driving assistance device, which can avoid unnecessary or offensive alarms, improve the efficiency and accuracy of the DMS, and further reduce the incidence of traffic accidents.
  • a driving assistance method may be a driving assistance device, a driving assistance module (unit), or a driving assistance system integrated on a first terminal, or it may also be a first terminal.
  • the chip or integrated circuit on the terminal for example, the chip may be a chip in a sensor, a fusion module, or an in-vehicle processor.
  • a fusion module can be understood as a module or unit composed of multiple modules or units, or a fusion module can also be understood as a module that obtains and integrates information from multiple other modules, and outputs the fused information.
  • the execution subject of the driving assistance method may also be the first terminal, and the above-mentioned chip or integrated circuit is integrated on the first terminal.
  • the first terminal may be a mobile device, which may include vehicles, airplanes, unmanned aerial vehicles, ships, cranes, tower cranes, and other devices that can move spatial positions or change spatial shapes through human operations.
  • the method includes: determining that the driver is in an abnormal state; determining that the driver's first operation of the first terminal is an abnormal operation; executing a first process, the first process including outputting instruction information and/or control information, the instruction information or The control information is used to indicate a second operation on the first terminal, or the first processing includes controlling the first terminal to perform the second operation.
  • the driving assistance method provided by the first aspect does not immediately trigger an alert to the driver or other responses to the driver when it is detected that the state of the driver driving the first terminal is an abnormal state, but further determines the driver’s
  • the driver responds to or makes adjustments to the misoperation of the mobile device, that is, executes the first processing. Therefore, unnecessary or offensive warnings can be avoided, the efficiency and accuracy of feedback or response to the driver can be improved, and the incidence of traffic accidents can be further reduced.
  • the specific method for determining that the driver's first operation on the first terminal is an abnormal operation may be the same or different, and for different abnormal states, the first operation performed
  • the processing can be the same or different, and this application does not restrict it.
  • the determining that the driver's first operation of the first terminal is an abnormal operation includes: determining that the first operation satisfies at least one of the following conditions:
  • the rate of change in the operation of the first terminal is greater than or equal to the first threshold
  • the operation amplitude for the first terminal is greater than or equal to the second threshold
  • the operation indicated by the operation decision from the first auxiliary system is inconsistent with the operation of the driver on the first terminal;
  • the operation indicated by the operation information from the second auxiliary system is inconsistent with the operation of the driver on the first terminal. Further, the first auxiliary system is different from the second auxiliary system.
  • the operation indicated by the operation decision or the operation indicated by the operation information is inconsistent with the operation of the driver on the mobile device includes: the operation type is different or the operation type is the same but the operation intensity (amplitude) difference (or the absolute value of the difference) Value) is greater than a certain threshold.
  • the operation type may include, for example, at least one of an acceleration device operation type, a deceleration device operation type, a direction changing device operation type, a height changing device operation type, and the like.
  • the first operation includes an operation of controlling the first terminal to change a motion state.
  • the operation of controlling the first terminal to change the motion state is considered, and low-risk or risk-free operations that do not change the motion state of the first terminal are ignored, so as to improve the efficiency and accuracy of feedback or response to the driver.
  • the first operation includes: operation of an acceleration device of the first terminal, operation of a braking device of the first terminal, or a steering device of the first terminal At least one of the operations.
  • the device for controlling the mobile device to change the motion state may include an acceleration device (for example, an accelerator pedal), a deceleration device (for example, a brake pedal), a steering device (for example, a steering wheel), and a motion height control device ( For example, the pull rod on the plane) and so on.
  • an acceleration device for example, an accelerator pedal
  • a deceleration device for example, a brake pedal
  • a steering device for example, a steering wheel
  • a motion height control device For example, the pull rod on the plane
  • the first auxiliary system or the second auxiliary system includes: an automatic driving AD system, an advanced driver assistance system ADAS, or a driving assistance system including at least one driving assistance function at least one;
  • the driving assistance function includes: determining that the first terminal satisfies a preset condition, and determining a function of changing the motion state of the first terminal when the preset condition is met; and/or determining that the first terminal satisfies the preset condition, And the function of controlling the first terminal to change the motion state when the preset condition is met.
  • the driving assistance function may include: AEB, LKA, LCA, ACC, and so on.
  • the operation indicated by the operation decision from the first auxiliary system or the operation indicated by the operation information from the second auxiliary system includes:
  • One or more of the operation of the acceleration device of the first terminal, the operation of the braking device of the first terminal, and the operation of the steering device of the first terminal are provided.
  • the second operation includes: issuing a warning to the driver, not responding to the first operation of the driver, reducing the degree of operation of the first operation, or increasing the first operation. At least one of the difficulty of the operation.
  • issuing a warning to the driver may include any one or a combination of visual, auditory, and tactile sensations.
  • the abnormal state includes: at least one of the driver's physiological abnormal state, mental abnormal state, attention abnormal state, or abnormal state that affects the operation of the first terminal one.
  • the abnormal state can be: the driver is in one of the abnormal driving states such as drunk driving, drug driving, fatigue driving, or handling other things (such as making a phone call, picking up things, smoking, etc.). kind or multiple.
  • This abnormal state directly affects the driver's judgment or control of the normal operation of the first terminal, and affects the driver's ability to control the first terminal.
  • a driving assistance method may be a driving assistance device, a driving assistance module (unit), or a driving assistance system integrated on a first terminal, or it may also be the first terminal.
  • the chip or integrated circuit on the terminal for example, the chip may be a chip in a sensor, a fusion module, or an in-vehicle processor.
  • a fusion module can be understood as a module or unit composed of multiple modules or units, or a fusion module can also be understood as a module that obtains and integrates information from multiple other modules, and outputs the fused information.
  • the execution subject of the driving assistance method may also be the first terminal, and the above-mentioned chip or integrated circuit is integrated on the first terminal.
  • the first terminal may be a mobile device, which may include vehicles, airplanes, unmanned aerial vehicles, ships, cranes, tower cranes, and other devices that can move spatial positions or change spatial shapes through human operations.
  • the method includes: determining that the driver is in an abnormal state; performing a second process, the second process including: adjusting or updating an alarm triggering condition, and/or adjusting or updating an alarm level, wherein the alarm triggering condition is used to trigger the The driver warns.
  • the driving assistance method provided by the second aspect does not immediately trigger an alert to the driver when it detects that the driver's mobile device is in an abnormal state, but adjusts or updates the alert triggering conditions, and/or adjusts or updates the alert Grade etc. After the mobile device satisfies the adjusted or updated warning trigger conditions, it can alert the driver, thereby avoiding unnecessary or offensive warnings, improving the accuracy and efficiency of warning to the driver, and improving the performance of DMS. Efficiency and accuracy reduce the incidence of traffic accidents.
  • the abnormal state can be: the driver is in one of the abnormal driving states such as drunk driving, drug driving, fatigue driving, or handling other things (such as making a phone call, picking up things, smoking, etc.). kind or multiple.
  • This abnormal state directly affects the driver's judgment or control of the normal operation of the first terminal, and affects the driver's ability to control the first terminal.
  • the second processing performed for different abnormal states may be the same or different, which is not limited in the present application.
  • the second process corresponding to the detection of mild fatigue or smoking is to increase the alarm level; or the second process corresponding to the detection of mild fatigue is to adjust the alarm trigger condition and increase the alarm level, and the second process corresponding to smoking is detected
  • the processing is to increase the alarm level, etc.
  • the adjustment or update of the alarm trigger condition includes:
  • the adjustment or update of the alarm level includes:
  • the warning level is adjusted or updated to be higher than the warning level when the driver is in a normal state; where the normal state is a state in which the driver normally operates the first terminal.
  • the warning time is adjusted or updated to be earlier than the warning time when the driver is in the normal state
  • the warning distance is adjusted or updated to be greater than the warning distance when the driver is in the normal state
  • the warning level is adjusted or updated. Adjusting or updating to a warning level higher than when the driver is in a normal state can avoid unnecessary or offensive warnings, improve the accuracy and efficiency of warning to the driver, but still ensure the timeliness and effectiveness of the warning sex.
  • the abnormal state includes: at least one of the driver's physiological abnormal state, mental abnormal state, attention abnormal state, or abnormal state that affects the operation of the first terminal one.
  • the method when the driver is in the abnormal state, the method further includes: determining that the driver's first operation of the first terminal is an abnormal operation; executing the first processing, The first processing includes outputting instruction information and/or control information, the instruction information or the control information is used to indicate a second operation on the first terminal, or the first processing includes controlling the first terminal to perform the second operation .
  • the warning to the driver when it is detected that the state of the driver driving the mobile device is an abnormal state, the warning to the driver is not immediately triggered, but the warning trigger condition and/or the warning level are adjusted or updated.
  • the specific method for determining that the driver's first operation on the first terminal is an abnormal operation may be the same or different, and for different abnormal states, the first operation performed
  • the processing can be the same or different, and this application does not restrict it.
  • the determining that the driver's first operation of the first terminal is an abnormal operation includes: determining that the first operation satisfies at least one of the following conditions:
  • the rate of change in the operation of the first terminal is greater than or equal to the first threshold
  • the operation amplitude for the first terminal is greater than or equal to the second threshold
  • the operation indicated by the operation decision from the first auxiliary system is inconsistent with the operation of the driver on the first terminal;
  • the operation indicated by the operation information from the second auxiliary system is inconsistent with the operation of the driver on the first terminal.
  • the first operation includes an operation of controlling the first terminal to change a motion state.
  • the second operation includes: issuing a warning to the driver, not responding to the first operation of the driver, reducing the degree of operation of the first operation, or increasing the first operation. At least one of the difficulty of the operation.
  • the warning to the driver may include any one or a combination of visual, auditory, and tactile sensations.
  • a driving assistance device in a third aspect, includes a unit for executing the steps in the above first aspect or any possible implementation of the first aspect.
  • a driving assistance device in a fourth aspect, includes a unit for executing each step in the above second aspect or any possible implementation of the second aspect.
  • a driving assistance device in a fifth aspect, includes at least one processor and a memory, and the at least one processor is configured to execute the above first aspect or any possible implementation of the first aspect.
  • a driving assistance device which includes at least one processor and a memory, and the at least one processor is configured to execute the above second aspect or any possible implementation of the second aspect.
  • a driving assistance device which includes at least one processor and an interface circuit, and the at least one processor is configured to execute the above first aspect or the method in any possible implementation of the first aspect.
  • a driving assistance device which includes at least one processor and an interface circuit, and the at least one processor is configured to execute the above second aspect or any possible implementation method of the second aspect.
  • a mobile device comprising: the driving assistance device provided in the third aspect, the fifth aspect, or the seventh aspect, and/or the fourth aspect, the sixth aspect, or the eighth aspect Provided driving assistance devices.
  • mobile devices may include vehicles, airplanes, unmanned aerial vehicles, ships, cranes, tower cranes, and other devices that can move spatial positions or change spatial shapes through human operations.
  • a computer program product includes a computer program.
  • the computer program product includes a computer program.
  • the computer program is executed by a processor, it is used to execute the method in the first aspect or any possible implementation of the first aspect, Or execute the method in the second aspect or any possible implementation of the second aspect.
  • a computer-readable storage medium stores a computer program, and when the computer program is executed, it is used to execute the first aspect or any possible implementation manner of the first aspect Or execute the method in the second aspect or any possible implementation of the second aspect.
  • a chip or integrated circuit includes a processor for calling and running a computer program from a memory, so that a device installed with the chip or integrated circuit executes the first aspect or The method in any possible implementation manner of the first aspect, or the second aspect or the method in any possible implementation manner of the second aspect is executed.
  • the chip may be a chip in a sensor, a fusion module, or an in-vehicle processor.
  • the driving assistance method and driving assistance device provided by the embodiments of the present application do not immediately trigger an alert to the driver when it is detected that the state of the driver driving the mobile device is an abnormal state, and it is further determined that the driver's operation on the mobile device is In the case of misoperation or abnormal operation, feedback is generated to the driver's operation of the mobile device, for example, an alarm is generated to the driver. Thereby, unnecessary or offensive alarms can be avoided, the efficiency and accuracy of DMS can be improved, and the incidence of traffic accidents can be further reduced.
  • Fig. 1 is a schematic diagram of the detection of the driver when the driver is driving the vehicle by the DMS system.
  • Fig. 2 is a schematic flowchart of an example of a driving assistance method provided by an embodiment of the present application.
  • FIG. 3 is a schematic flowchart of another example of driving assistance provided by an embodiment of the present application.
  • FIG. 4 is a schematic flowchart of another example of a driving assistance method provided by an embodiment of the present application.
  • Fig. 5 is a schematic block diagram of a driving assistance device provided by an embodiment of the present application.
  • Fig. 6 is a schematic block diagram of another example of a driving assistance device provided by an embodiment of the present application.
  • Fig. 7 is a schematic block diagram of another example of a driving assistance device provided by an embodiment of the present application.
  • FIG. 8 is a schematic block diagram of another example of a driving assistance device provided by an embodiment of the present application.
  • FIG. 9 is a schematic block diagram of another example of a driving assistance device provided by an embodiment of the present application.
  • FIG. 10 is a schematic block diagram of another example of a driving assistance device provided by an embodiment of the present application.
  • FIG. 11 is a schematic block diagram of another example of a driving assistance device provided by an embodiment of the present application.
  • FIG. 12 is a schematic block diagram of another example of a driving assistance device provided by an embodiment of the present application.
  • FIG. 13 is a schematic block diagram of another example of a driving assistance device provided by an embodiment of the present application.
  • first and second are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined with “first” and “second” may explicitly or implicitly include one or more of these features. In the description of the present embodiment, unless otherwise specified, “plurality” means two or more.
  • various aspects or features of the present application can be implemented as methods, devices, or products using standard programming and/or engineering techniques.
  • article of manufacture used in this application encompasses a computer program accessible from any computer-readable device, carrier, or medium.
  • computer-readable media may include, but are not limited to: magnetic storage devices (for example, hard disks, floppy disks, or tapes, etc.), optical disks (for example, compact discs (CD), digital versatile discs (DVD)) Etc.), smart cards and flash memory devices (for example, erasable programmable read-only memory (EPROM), cards, sticks or key drives, etc.).
  • various storage media described herein may represent one or more devices and/or other machine-readable media for storing information.
  • machine-readable medium may include, but is not limited to, wireless channels and various other media capable of storing, containing, and/or carrying instructions and/or data.
  • the status of the driver is highly related to the safety of driving a mobile device (such as a car, etc.).
  • a mobile device such as a car, etc.
  • an abnormal driving state such as drunk driving, fatigued driving, distracted by other things (such as calling, picking up things, etc.)
  • the inability to focus on driving will greatly increase the possibility of traffic accidents and cause traffic An important cause of the accident.
  • a driver monitoring system is installed on the vehicle.
  • the DMS includes sensors and analysis modules that detect the driver's state.
  • the analysis module judges the driver's status based on the sensor data.
  • the sensor can detect the driver’s facial expressions based on the camera, and the analysis module can perceive the driver’s status based on the image detection of the camera data and/or the micro-Doppler analysis of the radar data to realize the monitoring of the driver.
  • Early warning to improve driving safety, reduce the accident rate, and ensure the safety of the driver’s life and property.
  • the DMS system shown in Figure 1 shows a schematic diagram of the driver's detection of the driver's vehicle. By detecting the driver's facial expression and other data based on the camera, the driver's state is sensed based on the facial expression analysis and other technical means, so as to realize the driver's status. Monitoring and alarms.
  • the DMS can give feedback to the driver such as warnings based on the detected state of the driver. For example: when the DMS detects that the driver is sleepy, it will give an alarm to alert the driver; when it detects that the driver is smoking or making a phone call, it will trigger an alarm.
  • DMS may give offensive or unnecessary warnings.
  • the current DMS system still has a certain misrecognition rate, and warnings caused by misrecognition will be offensive.
  • the driver's wrong driving behavior when awake is often deliberate, such as smoking, making a phone call, and so on.
  • the DMS system detects this type of driver's abnormal state and the warning will be offensive.
  • the driver actively shuts down the DMS system
  • the current DMS may generate unnecessary or offensive warnings, which seriously affects the actual function of the DMS, leads to the low efficiency of the DMS, increases the incidence of traffic accidents, and seriously threatens the life and property safety of drivers.
  • the present application provides a driving assistance method that does not immediately trigger an alert to the driver when it is detected that the driver is driving the mobile device in an abnormal state, and further determines that the driver's operation on the mobile device is wrong.
  • feedback is generated to the driver's operation of the mobile device, for example, an alarm is generated to the driver.
  • mobile devices may include vehicles, airplanes, unmanned aerial vehicles, ships, cranes, tower cranes, and other devices that can move spatial positions or change spatial shapes through human operations. This application does not limit the specific form of the mobile device.
  • FIG. 2 is a schematic flowchart of the driving assistance method 200 according to an embodiment of the present application.
  • the execution subject of the driving assistance method provided in the present application may be a driving assistance device, a driving assistance module (unit) or a driving assistance system integrated on the first terminal.
  • the execution body of the driving assistance method provided in the present application may also be a chip or an integrated circuit on the first terminal.
  • the chip may be a chip in a sensor, a fusion module, or a vehicle-mounted processor.
  • the fusion module may include the above-mentioned driving assistance module (unit), or the fusion module may also be understood as a module that obtains information from multiple other modules and performs fusion, and outputs the fusion information.
  • the execution subject of the driving assistance method provided in the present application may also be the first terminal, and the above-mentioned chip or integrated circuit is integrated on the first terminal.
  • the driving assistance device or driving assistance system may include a DMS.
  • the driving assistance device or driving assistance system may also include: advanced driver assistance system (ADAS), autonomous driving (AD) system, or driving assistance including at least one driving assistance function At least one in the system.
  • ADAS advanced driver assistance system
  • AD autonomous driving
  • the execution body of the execution method may also be a chip, a chip system, or a processor applied to the driving assistance device or driving assistance system.
  • the first terminal may be the above-mentioned various types of mobile devices.
  • mobile devices for example, cars, drones, ships, etc.
  • the method 200 shown in FIG. 2 may include S210 to S230. Each step in the method 200 will be described in detail below with reference to FIG. 2.
  • S210 Determine that the driver is in an abnormal state.
  • S220 Determine that the driver's first operation on the first terminal is an abnormal operation.
  • S230 Perform first processing, where the first processing includes outputting instruction information and/or control information, where the instruction information or the control information is used to indicate a second operation on the first terminal, or the first processing includes controlling the The first terminal performs the second operation.
  • the driver detection system (for example, DMS, etc.) in the first terminal can detect the status of the driver when operating the first terminal in real time.
  • the first terminal operated by the driver may be, for example, the driver is driving a vehicle, the driver is driving an airplane, the driver is driving a ship, or the driver is driving a crane or a tower crane.
  • the specific form of the driver operating the first terminal is not limited. In the case of real-time detection of the state of the driver operating the first terminal, it will be determined whether the driver is in an abnormal state when operating the first terminal.
  • the abnormal state includes: the driver's physiological abnormal state (for example, physical discomfort), mental abnormal state (for example, nervousness), abnormal attention state (for example, inattention), Or at least one of abnormal states that affect the operation of the first terminal (for example, answering a phone call, smoking, etc.).
  • the abnormal state can be understood as a state that affects the driver's normal operation of the first terminal.
  • the abnormal state may include: the driver is in one or more of the abnormal driving states such as drunk driving, drug driving, fatigue driving, or handling other things (such as making a phone call, picking up things, smoking, etc.). This abnormal state directly affects the driver's judgment or control of the normal operation of the first terminal, and affects the driver's ability to control the first terminal.
  • the analysis module in DMS judges the driver's status based on sensor data.
  • the sensor can detect the driver's facial expression and other data based on the camera, and the analysis module can perceive the driver's state based on the image detection of the camera data and/or the micro-Doppler analysis of the radar data and other technical means to realize the state monitoring of the driver. Determine whether the driver is in an abnormal state when operating the first terminal.
  • the abnormal operation may be: the driver suddenly depresses the accelerator to a large extent, suddenly taps the steering wheel at a large angle, or suddenly depresses the brake pedal to a large extent, and so on.
  • an abnormal operation can be understood as an operation that the driver has rarely or never occurred before.
  • the specific form of the abnormal operation is not limited.
  • the driving assistance device or the driving assistance system will execute the first process.
  • the first processing includes outputting instruction information and/or control information, the instruction information or the control information is used to indicate a second operation on the first terminal, or the first processing includes controlling the first terminal to perform the second operation .
  • the first processing includes a response or adjustment to the first operation. Since the first operation is a misoperation, it is necessary to intervene or respond to the driver's first operation to avoid serious traffic accidents that may be caused by the first operation.
  • the driving assistance device or the driving assistance system outputs instruction information and/or control information, and the instruction information or the control information is used to indicate the second operation of the first terminal.
  • the second operation may include: instructing a horn on the car to warn the driver.
  • the driving assistance device or driving assistance system controls the first terminal to perform the second operation.
  • it refers to controlling other devices (such as mechanical devices, etc.) on the car to reduce the driver's misoperation or eliminate the driver's misoperation. Thereby ensuring the safety of the driver and avoiding traffic accidents.
  • the driving assistance method provided by the present application does not immediately trigger an alert to the driver or other responses to the driver when it is detected that the state of the first terminal being driven by the driver is an abnormal state. Only when the operation of a terminal is a misoperation, the driver responds to or makes adjustments to the misoperation of the mobile device, that is, the first processing is executed. Therefore, unnecessary or offensive warnings can be avoided, the efficiency and accuracy of feedback or response to the driver can be improved, and the incidence of traffic accidents can be further reduced.
  • the first terminal when the driver's first operation on the first terminal is not an abnormal operation, or when the driver operates the first terminal and is not in an abnormal state, the first terminal may not be executed.
  • One treatment when the driver's first operation on the first terminal is not an abnormal operation, or when the driver operates the first terminal and is not in an abnormal state, the first terminal may not be executed.
  • the specific method for determining that the driver's first operation on the first terminal is an abnormal operation may be the same or different.
  • the first processing performed may be the same or different, which is not limited in this application.
  • S220 when determining whether the driver's first operation on the first terminal is an abnormal operation, if the driver's operation on the first terminal satisfies any one of the following conditions or If there are multiple, it can be determined that the driver's operation on the first terminal is an abnormal operation.
  • the following conditions include:
  • the rate of change of the driver's operation on the first terminal is greater than or equal to the first threshold
  • the driver's operating range for the first terminal is greater than or equal to the second threshold
  • the operation indicated by the operation decision from the first auxiliary system is inconsistent with the operation of the driver on the first terminal;
  • the operation indicated by the operation information from the second auxiliary system is inconsistent with the operation of the driver on the first terminal.
  • the first terminal is a mobile device as an example for description.
  • the driver's operation (or the first operation) on the mobile device can be understood as an operation of controlling the mobile device to change the motion state.
  • the driver's operation of the mobile device can be understood as the driver's operation of the device that controls the mobile device to change the motion state.
  • the driver's operation of the acceleration device such as the accelerator pedal
  • the driver's operation of the deceleration device such as the brake pedal
  • the driver's operation of the steering device such as the steering wheel of the mobile device Operation etc.
  • the change of the motion state of the mobile device may include: the change of the motion speed, the change of the motion direction, the change of the motion height, and so on.
  • the change of the motion state of the mobile device may include: a change in the lateral motion state, a change in the longitudinal motion state, and a change in the motion state in a direction parallel to the direction of gravity. This application is not restricted here.
  • the device for controlling the mobile device to change the motion state may include an acceleration device (such as an accelerator pedal), a deceleration device (such as a brake pedal), a steering device (such as a steering wheel), and a device for controlling movement height (such as a pull on an airplane). High pole) and so on.
  • an acceleration device such as an accelerator pedal
  • a deceleration device such as a brake pedal
  • a steering device such as a steering wheel
  • a device for controlling movement height such as a pull on an airplane. High pole
  • the driver's operating range on the mobile device can be understood as the driver's operating amount or change on the mobile device.
  • the operation amplitude may also be the absolute value of the operation variation.
  • the operating range can be the amount of change in the angle of the accelerator pedal when the accelerator is stepped on or released, where the change in angle can be defined as a negative or positive value.
  • the operating range may be the distance that the accelerator pedal is lowered or raised, and so on.
  • the distance or angle of the accelerator pedal when the accelerator pedal is depressed can be defined as a negative value, and the distance or angle of the accelerator pedal rising when the accelerator pedal is released as a positive value, or the accelerator pedal can also be defined as a positive value.
  • the lowering distance or angle of the accelerator pedal is defined as a positive value, and the rising distance or angle of the accelerator pedal when the accelerator pedal is released is defined as a negative value.
  • the operating range can be understood as the degree of the steering wheel.
  • the rate of change of the driver's operation of the mobile device can be obtained by reciprocating the operation amplitude against time.
  • the operating range of the driver on the mobile device may be the operating variation on the mobile device. Since the operating variation can be defined as a positive value or a negative value, it can also be defined as a negative value.
  • the rate of change of the driver's operation of the mobile device can be negative or positive.
  • the corresponding operation change rate may be a positive value
  • the driver's operation of the mobile device is to release the accelerator
  • the corresponding operation change rate may be a negative value.
  • the corresponding operation change rate may be positive
  • the first threshold may be a positive value or a negative value.
  • the second threshold value may also be a positive value or a negative value.
  • the first threshold and the second threshold may be predefined. If the operating change rate of a certain operation of the mobile device by the driver is greater than or equal to the first threshold, or the operating amplitude is greater than or equal to the second threshold. It can be determined that this operation is the first operation, that is, an abnormal operation.
  • the mobile device may include one or more operation assistance systems.
  • the operation assistance system may also be referred to as an assistance system.
  • the operation assistance system may be: a system that automatically determines whether the mobile device can, should, or cannot perform some or some control to change the motion state; or automatically determines that the mobile device should perform some or some change in the motion state , And automatically control the mobile equipment to change the system or device of the motion state.
  • the operation assistance system of the mobile device includes at least one of an AD system, an ADAS, or a driving assistance system including at least one driving assistance function.
  • the execution subject of the driving assistance method provided in this application may be the mobile operation assistance system.
  • the driving assistance function includes: determining that the mobile device satisfies a preset condition, and automatically determining that the mobile device meets the preset condition a function of changing the motion state; and/or automatically determining that the mobile device satisfies the preset condition Set conditions, and automatically control the function of the mobile device to change the motion state when the mobile device meets the preset condition.
  • the driving assistance function may be: can automatically determine that the mobile device should perform a certain longitudinal (a certain degree of acceleration, a certain degree of deceleration) and/or a lateral (a certain degree of steering) movement Function.
  • the driving assistance function may also perform a function of controlling the mobile device's longitudinal and/or lateral motion.
  • the automatic judgment function can be realized by judging whether the current mobile device meets a certain preset condition, and determining whether a certain vertical and/or horizontal control should be performed on the mobile device according to the judgment result.
  • the preset condition may be: whether the distance from the vehicle in front is greater than a certain threshold, the distance or angle of the vehicle deviating from the normal lane, and so on.
  • driving assistance functions may include: automatic emergency braking (AEB), lane keep assist (LKA), lane change assist (LCA), adaptive cruise control (adaptive cruise control, etc.) ACC) etc.
  • AEB automatic emergency braking
  • LKA lane keep assist
  • LCA lane change assist
  • adaptive cruise control adaptive cruise control, etc.
  • ACC adaptive cruise control
  • the operation of the operation assistance system of the mobile equipment on the mobile equipment includes: the operation assistance system of the mobile equipment operates the acceleration device (such as the accelerator pedal) of the mobile equipment, and the operation assistance system of the mobile equipment operates the mobile equipment.
  • the system that can automatically determine whether the mobile device can, should, or cannot perform some or some control to change the motion state is called the first auxiliary system.
  • the output of the first auxiliary system is an operation decision, which is used to instruct other devices on the mobile device to perform operations.
  • the first auxiliary system itself does not perform the operation indicated by the operation decision.
  • the system or device that can automatically determine that the mobile device should perform some or some changes in the motion state and automatically control the mobile device to change the motion state becomes the second auxiliary system.
  • the second auxiliary system can not only output operating information, but also The operation indicated by the information can be operated.
  • the execution subject of the driving assistance method provided in this application may be the first assistance system, or the second assistance system, or may also be other assistance systems on the mobile device.
  • the first auxiliary system, the second auxiliary system and the other auxiliary systems may be the same or different.
  • the driver's operation on the first terminal is the first operation, that is, the abnormal operation.
  • the operation indicated by the operation decision or the operation indicated by the operation information is inconsistent with the operation of the driver on the mobile device includes: the operation type is different or the operation type is the same but the operation intensity (amplitude) difference (or the absolute value of the difference) Value) is greater than a certain threshold.
  • the operation type may include, for example, at least one of an acceleration device operation type, a deceleration device operation type, a direction changing device operation type, or a height changing device operation type, and the like.
  • the different operation types may include: the operation indicated by the operation decision of the operation assistance system of the mobile device is to operate the acceleration device of the mobile device, or the operation indicated by the operation information is the operation of the acceleration device of the mobile device, while driving Operators perform operations on non-acceleration devices (such as braking devices, steering devices, height control devices, etc.) of mobile equipment.
  • the operation judgment indicated by the operation decision of the operation assistance system of the mobile device should operate the brake device of the mobile device, or the operation indicated by the operation information is the operation of the brake device of the mobile device, and the driver What is performed is the operation of the non-braking device (for example, acceleration device, steering device, height control device, etc.) of the mobile device.
  • the operation of the acceleration device, and the driver is also the operation of the acceleration device of the mobile device, but the difference between the two operation ranges (or the absolute value of the difference) is greater than or equal to the preset threshold.
  • the operation assistance system of the mobile device judges that the angle or distance at which the accelerator pedal of the mobile device should be (or executed) depressed is D1, and the angle or distance at which the driver depresses the accelerator pedal is D2. If D1-D2 ⁇ T, where T is a preset threshold, it is determined that the operation assistance system of the mobile device determines or operates on the mobile device inconsistent with the driver's operation on the mobile device.
  • the operation assistance system of the mobile device judges or operates on the mobile device inconsistent with the driver's operation on the mobile device. For example, the operation assistance system judges that the accelerator pedal should be raised by D1, but the driver has stepped on D2 deeply. In this case, D2 is a negative value and D1 is a positive value. Alternatively, if D2 is a positive value and D1 is a negative value, whether
  • the first processing when the state of the driver driving the mobile device is an abnormal state, and in the case of determining that the driver's operation on the mobile device is a misoperation, the first processing may be performed .
  • the first processing includes outputting instruction information and/or control information, and the instruction information or control information is used to indicate a second operation for the mobile device, or the first processing includes controlling the mobile device.
  • the device performs a second operation, and the second operation includes:
  • the instruction information and/or control information may instruct other devices on the mobile device to alert the driver.
  • the warning to the driver may include: any one or a combination of visual, auditory, and tactile sensations, etc.
  • the specific warning method is not limited in the embodiment of the present application.
  • Not responding to the driver's first operation can be understood as eliminating the driver's misoperation, that is, not responding to the driver's first operation of the mobile device. For example, when the driver depresses the accelerator pedal deeply, the vehicle does not accelerate. For another example, when the driver turns the direction, the direction of the vehicle does not change, and so on. Especially when the AD/ADAS function is working, the driver's current operation is judged to be a misoperation rather than the driver's intention to take over the operation of the vehicle, so the active AD/ADAS function will not be interrupted. Optionally, it can also prompt the driver to re-operate after returning to the normal driving state.
  • Reducing the degree of operation of the first operation can be understood as reducing the effect of the first operation on the mobile device, or reducing the efficiency of the first operation. For example, if the first operation is to depress the accelerator pedal deeply, reducing the degree of operation of the first operation can be understood as the mobile device only provides slow acceleration even if the driver depresses the accelerator pedal deeply. For another example, if the first operation is to slam the steering wheel, reducing the degree of operation of the first operation can be understood as when the driver slams the direction, the direction of the vehicle still changes slowly, etc.
  • Increasing the difficulty of the first operation can be understood as increasing the effort required by the driver to operate the mobile device. For example, suppose that the first operation is to slam the accelerator pedal, and the driver needs 5 N to slam the accelerator pedal in a normal state. When the driver is in an abnormal state, it takes 10 N to step on the accelerator pedal to achieve the same effect as using 5 N to slam the accelerator pedal in a normal state. That is, increase the force required for the driver to step on the accelerator pedal. Or, compared to when the driver is in a normal state, at the same angle of the direction change, the force required for steering when the driver is in an abnormal state (required force) is greater than the force required when the driver is in a normal state ( Required strength).
  • the second operation may also include other types or methods of operation, or other responses or adjustments to the first operation, as long as the operation can remind the driver that he is currently out of trouble. Safe operation status and reduce the occurrence of safety accidents.
  • the embodiments of the application are not limited here.
  • the present application also provides a driving assistance method.
  • a driving assistance method When it is detected that the state of the driver driving the mobile device is an abnormal state, it does not immediately trigger an alert to the driver, but adjusts or updates the alert triggering condition, and/or, adjusts or Update the alarm level. Only after the adjusted or updated trigger conditions are met, the driver is alerted, or the driver is alerted with the adjusted or updated warning level, which can avoid unnecessary or offensive warnings and improve the Carry out the accuracy and efficiency of warning, improve the efficiency and accuracy of DMS, and reduce the incidence of traffic accidents.
  • FIG. 3 is a schematic flowchart of a driving assistance method 300 according to an embodiment of the present application.
  • the execution subject of the driving assistance method may be a driving assistance device or a driving assistance system integrated on the first terminal.
  • the driving assistance device or driving assistance system may include a DMS.
  • the driving assistance device or driving assistance system may further include at least one of an ADAS, an AD system, or a driving assistance system including at least one driving assistance function.
  • the execution body of the execution method may also be a chip, a chip system, or a processor applied to the driving assistance device or driving assistance system.
  • the chip may be a chip in a sensor, a fusion module, or an in-vehicle processor.
  • a fusion module can be understood as a module or unit composed of multiple modules or units, or a fusion module can also be understood as a module that obtains information from multiple other modules and performs fusion, and outputs the fused information.
  • the method 300 shown in FIG. 3 may include S310 to S320.
  • the steps in the method 200 will be described in detail below in conjunction with FIG. 3.
  • S310 Determine that the driver is in an abnormal state.
  • the second process includes: adjusting or updating an alarm triggering condition, and/or adjusting or updating an alarm level, where the alarm triggering condition is used to trigger an alarm for the driver.
  • the abnormal state includes: at least one of the driver's physiological abnormal state, mental abnormal state, abnormal attention state, or abnormal state that affects the operation of the first terminal.
  • the abnormal state may include: the driver is in one or more of the abnormal driving states such as drunk driving, drug driving, fatigue driving, or handling other things (such as making a phone call, picking up things, smoking, etc.).
  • This abnormal state directly affects the driver's judgment or control of the normal operation of the first terminal, and affects the driver's ability to control the first terminal.
  • step S310 reference may be made to the above description of S210, and for the sake of brevity, it will not be repeated here.
  • the first terminal may be the above-mentioned various types of mobile devices.
  • mobile devices for example, cars, drones, ships, etc.
  • the second process in a case where it is determined that the driver is operating the mobile device in an abnormal state, the second processing includes: adjusting or updating an alarm trigger condition, and/or adjusting or updating an alarm level.
  • the alarm trigger condition is used to trigger an alarm to the driver.
  • the alarm is used to remind or warn the driver that the mobile device is currently in a certain dangerous state, or if a certain operation is currently performed or not performed, the mobile device is in a certain dangerous state, etc.
  • the operation assistance system on the mobile device can adjust or update the alarm trigger condition or alarm level of the early warning function.
  • the operation assistance system of the mobile device reference may be made to the description of the operation assistance system in the method 200. For brevity, details are not repeated here.
  • it may be AD/ADAS, etc., adjusting or updating the alarm trigger condition and/or adjusting the alarm level.
  • the driving assistance method provided by the present application does not immediately trigger an alert to the driver when it detects that the driver is driving the mobile device in an abnormal state, but adjusts or updates the alert triggering conditions, and/or adjusts or updates the alert level Wait. After the mobile device satisfies the adjusted or updated warning trigger conditions, it can alert the driver, thereby avoiding unnecessary or offensive warnings, improving the accuracy and efficiency of warning to the driver, and improving the performance of DMS. Efficiency and accuracy reduce the incidence of traffic accidents.
  • the second processing performed for different abnormal states may be the same or different, which is not limited in the present application.
  • the second process corresponding to the detection of mild fatigue or smoking is to increase the alarm level; or the second process corresponding to the detection of mild fatigue is to adjust the alarm trigger condition and increase the alarm level, and the second process corresponding to smoking is detected
  • the processing is to increase the alarm level, etc.
  • the adjustment or update of the alarm triggering conditions includes: adjusting or updating the alarm time to be earlier than the alarm time when the driver is in a normal state, or adjusting the alarm distance or Update to at least one of the warning distances greater than when the driver is in a normal state.
  • the adjustment or update of the alarm level includes:
  • the normal state is a state in which the driver normally operates the first terminal.
  • the alarm can be triggered by the time standard or the alarm can be triggered by the distance standard.
  • the warning time can be adjusted to be earlier than the warning time when the driver is in the second state. Or, in other words, the warning time is updated from the warning time corresponding to the driver in the normal state (referred to as the first warning time) to the warning time corresponding to the driver in the abnormal state (referred to as the second warning time). That is, the first warning time and the second warning time can be pre-configured, and the corresponding warning time can be updated or switched according to different driver states.
  • the first warning time can be adjusted to the second warning time online, that is, only one warning time can be configured, and the warning time can be adjusted online according to different driver states.
  • only one set of warning distance parameters can be configured in advance, and the warning distance parameters can be adjusted online according to different driver states.
  • multiple sets of warning distance parameters can be pre-configured, and corresponding warning distance parameters can be updated or switched according to different driver states.
  • the normal state is a state in which the driver normally operates the first terminal.
  • the second state will not affect the driver's normal operation or control of the mobile device.
  • the warning time of the warning function such as AD/ADAS can be adjusted or updated to be earlier than the warning time when the driver is in the normal state.
  • the first terminal device is a car and a specific example will be used for description.
  • the driver when the driver is in a normal state, it starts when it is detected that the distance to the vehicle in front is less than or equal to S meters, and after T seconds, it starts to warn the driver that it is too close to the car and needs to brake. And if the driver is in an abnormal state, and from detecting that the distance from the vehicle in front is less than or equal to S meters, the driver will be immediately warned that the vehicle is too close and needs to be braked. That is, adjust or update the warning time of automatic braking earlier than the warning time of automatic braking when the driver is in a normal state.
  • the driver when the driver is in a normal state, starting from detecting that the vehicle has deviated from the current lane, after M seconds, the driver will be warned of the lane departure of the vehicle, and lane keeping is required. If the driver is in an abnormal state, he will immediately start to warn the driver of the vehicle's lane departure when it detects that the vehicle has deviated from the current lane, and lane keeping is required. That is, adjust or update the lane departure warning time earlier than the lane departure warning time when the driver is in a normal state.
  • T2 is less than T1, that is, the warning time of adjusting or updating the fatigue driving is earlier than the warning time of the fatigue driving when the driver is in a normal state.
  • the driver is in a different state and can correspond to different warning distances.
  • the warning distance of AD/ADAS and other warning functions can be adjusted to be greater than the warning distance of the driver in a normal state.
  • the first terminal device is a car and a specific example will be used for description.
  • the driver when the driver is in a normal state and the distance to the vehicle in front is less than S meters, the driver will start to warn the driver to follow the car too close and need to brake.
  • the distance to the vehicle in front is less than P meters. Started to warn the driver that he was too close to the car and needed to brake.
  • P is greater than S, that is, the distance for adjusting or updating the automatic braking warning is greater than the automatic braking warning distance when the driver is in a normal state.
  • L2 is greater than L1. That is, adjust or update the warning distance of the body obstacle to be greater than the warning distance of the body obstacle when the driver is in a normal state.
  • adjusting or updating the alarm level to be higher than the alarm level when the driver is in a normal state can be understood to mean that the driver’s alarm level in the abnormal state is higher than the first alarm level when the same alarm trigger condition is met.
  • the warning level when the driver is in a normal state can be understood to mean that the driver’s alarm level in the abnormal state is higher than the first alarm level when the same alarm trigger condition is met.
  • only one warning level can be configured in advance, and the warning level can be adjusted online according to different driver states.
  • multiple warning levels can be pre-configured, and corresponding warning levels can be updated or switched according to different driver states.
  • the warning level is level 1
  • the warning level is level 2
  • Level 2 is higher than the alarm level 1. The higher the level, the greater the intensity of the alarm.
  • the warning level is level 2.
  • the warning level is level 3, of which the warning level is level 3. Level 2 higher than the alarm level.
  • the alarm may include: visual, auditory, tactile and any combination of these methods and other alarm methods, and the specific alarm method is not limited in the embodiment of the present application.
  • FIG. 4 is a schematic flowchart of a driving assistance method in some embodiments of the present application.
  • the method 300 also includes: S330 and S340.
  • S330 Determine that the driver's first operation of the first terminal is an abnormal operation
  • S340 Perform first processing, where the first processing includes outputting instruction information and/or control information, where the instruction information or the control information is used to indicate a second operation on the first terminal, or the first processing includes controlling the The first terminal performs the second operation.
  • the alarm trigger condition can be adjusted or updated, and/or the alarm level can be adjusted or updated.
  • it is determined whether the driver's operation on the first terminal is an abnormal operation that is, it is determined whether the driver's operation on the first terminal is an incorrect operation.
  • a first process is executed, and the first process includes outputting instruction information and/or control information, the instruction information or the control The information is used to indicate the second operation on the first terminal, or the first processing includes controlling the first terminal to perform the second operation.
  • the second operation includes: issuing a warning to the driver, not responding to the first operation of the driver, reducing the degree of operation of the first operation, or increasing the first operation At least one of the difficulty levels.
  • the driving assistance method provided by the present application does not immediately trigger an alarm to the driver when detecting that the state of the driver driving the mobile device is an abnormal state, but adjusts or updates the alarm trigger condition and/or adjusts the alarm level. Furthermore, only when it is determined that the driver's operation of the first terminal is a misoperation, a response or adjustment is generated to the driver's operation of the mobile device, that is, the first processing is executed. Therefore, unnecessary or offensive warnings can be avoided, the efficiency and accuracy of feedback or response to the driver can be improved, and the incidence of traffic accidents can be further reduced.
  • determining that the driver's first operation on the first terminal is an abnormal operation includes: determining that the first operation satisfies at least one of the following conditions:
  • the rate of change in the operation of the first terminal is greater than or equal to the first threshold
  • the operation amplitude for the first terminal is greater than or equal to the second threshold
  • the operation indicated by the operation decision from the first auxiliary system is inconsistent with the operation of the driver on the first terminal;
  • the operation indicated by the operation information from the second auxiliary system is inconsistent with the operation of the driver on the first terminal.
  • the first operation includes an operation of controlling the first terminal to change the motion state.
  • the first operation includes:
  • the first auxiliary system or the second auxiliary system includes at least one of an AD system, an ADAS, or a driving assistance system including at least one driving assistance function.
  • the driving assistance function includes: determining that the first terminal meets a preset condition, and determining a function of changing the motion state of the first terminal when the preset condition is satisfied; and/or, determining that the first terminal meets the preset condition, and When the preset condition is met, the function of controlling the first terminal to change the motion state.
  • the operation indicated by the operation decision from the first auxiliary system or the operation indicated by the operation information from the second auxiliary system includes:
  • One or more of the operation of the acceleration device of the first terminal, the operation of the braking device of the first terminal, and the operation of the steering device of the first terminal are provided.
  • pre-set and pre-defined can be achieved by pre-saving corresponding codes, tables, or other methods that can be used to indicate related information in devices (for example, including terminals and network devices). To achieve, this application does not limit its specific implementation.
  • FIG. 5 shows a schematic block diagram of a driving assistance device 400 according to an embodiment of the present application.
  • the driving assistance device 400 may correspond to the first terminal described in the above method 200 or method 300, or may be a chip applied to the first terminal device. , Components, integrated circuits, sensors, fusion modules, in-vehicle processors, etc. In addition, each module or unit in the driving assistance device 400 is respectively used to execute each action or processing procedure performed in the above-mentioned method 200 or method 300.
  • the driving assistance device 400 includes a processing module (unit) 410.
  • the driving assistance device may also include a transceiving module (unit) 420.
  • the transceiving module 420 is configured to execute under the driving of the processing module 410. Specific signal transmission and reception.
  • the processing module 410 is used to:
  • the first process includes outputting instruction information and/or control information, the instruction information or the control information is used to indicate a second operation on the first terminal, or the first process includes controlling the first terminal The terminal performs the second operation.
  • the driving assistance device does not immediately trigger an alert to the driver or other responses to the driver when it detects that the state of the driver driving the first terminal is an abnormal state, but further determines the driver’s response to the first terminal. Only when the operation of a terminal is a misoperation, the driver responds to or makes adjustments to the misoperation of the mobile device, that is, the first processing is executed. Therefore, unnecessary or offensive warnings can be avoided, the efficiency and accuracy of feedback or response to the driver can be improved, and the incidence of traffic accidents can be further reduced.
  • the processing module 410 is further configured to:
  • the first operation satisfies at least one of the following conditions, it is determined that the first operation is an abnormal operation:
  • the determining that the driver's first operation on the first terminal is an abnormal operation includes: determining that the first operation satisfies at least one of the following conditions:
  • the rate of change in the operation of the first terminal is greater than or equal to the first threshold
  • the operation amplitude for the first terminal is greater than or equal to the second threshold
  • the operation indicated by the operation decision from the first auxiliary system is inconsistent with the operation of the driver on the first terminal;
  • the operation indicated by the operation information from the second auxiliary system is inconsistent with the operation of the driver on the first terminal.
  • the first operation includes an operation of controlling the first terminal to change a motion state.
  • the first operation includes:
  • the first auxiliary system or the second auxiliary system includes: an automatic driving AD system, an advanced driver assistance system ADAS, or a driving assistance system including at least one driving assistance function At least one of
  • the driving assistance function includes: determining that the first terminal satisfies a preset condition, and determining a function of changing the motion state of the first terminal when the preset condition is met; and/or determining that the first terminal satisfies the preset condition, And the function of controlling the first terminal to change the motion state when the preset condition is met
  • the operation indicated by the operation decision from the first auxiliary system or the operation indicated by the operation information from the second auxiliary system includes:
  • One or more of the operation of the acceleration device of the first terminal, the operation of the braking device of the first terminal, and the operation of the steering device of the first terminal are provided.
  • the second operation includes:
  • the abnormal state includes: the driver's physiological abnormal state, mental abnormal state, attention abnormal state, or any abnormal state that affects the operation of the first terminal at least one.
  • processing module 410 is used to:
  • a second process is performed, and the second process includes: adjusting or updating an alarm triggering condition, and/or adjusting or updating an alarm level, where the alarm triggering condition is used to trigger an alarm for the driver.
  • the driving assistance device does not immediately trigger an alert to the driver when it detects that the driver is driving the mobile device in an abnormal state, but adjusts or updates the alert triggering conditions, and/or adjusts or updates the alert level Wait. After the mobile device satisfies the adjusted or updated warning trigger conditions, it can alert the driver, thereby avoiding unnecessary or offensive warnings, improving the accuracy and efficiency of warning to the driver, and improving the performance of DMS. Efficiency and accuracy reduce the incidence of traffic accidents.
  • the processing module 410 is further configured to:
  • the normal state is a state in which the driver normally operates the first terminal.
  • the abnormal state includes: the driver's physiological abnormal state, mental abnormal state, attention abnormal state, or any abnormal state that affects the operation of the first terminal at least one.
  • the processing module 410 when the driver is in the abnormal state, is further configured to:
  • the first process includes outputting instruction information and/or control information, the instruction information or the control information is used to indicate a second operation on the first terminal, or the first process includes controlling the first terminal The terminal performs the second operation.
  • the processing module 410 is further configured to:
  • the first operation satisfies at least one of the following conditions, it is determined that the first operation is an abnormal operation:
  • the rate of change in the operation of the first terminal is greater than or equal to the first threshold
  • the operation amplitude for the first terminal is greater than or equal to the second threshold
  • the operation indicated by the operation decision from the first auxiliary system is inconsistent with the operation of the driver on the first terminal;
  • the operation indicated by the operation information from the second auxiliary system is inconsistent with the operation of the driver on the first terminal.
  • the first operation includes an operation of controlling the first terminal to change a motion state.
  • the second operation includes:
  • the transceiver module 420 may include a receiving module (unit) and a sending module (unit), configured to perform the steps of receiving information and sending information in each of the foregoing method 200 and method 300.
  • the driving assistance device 400 may also be the storage module (unit).
  • the transceiver module 420 may be a transceiver, an input/output interface, or an interface circuit.
  • the storage module is used to store instructions executed by the transceiver module unit 420 and the processing module 410.
  • the transceiving module 420, the processing module 510, and the storage module are coupled to each other.
  • the storage module stores instructions, the processing module 410 is used to execute the instructions stored in the storage module, and the transceiving module 420 is used to perform specific signal transceiving under the driving of the processing module 410.
  • the transceiver module 420 may be a transceiver, an input/output interface, or an interface circuit.
  • the storage module may be a memory.
  • the processing module 410 may be implemented by a processor.
  • the driving assistance device 500 may include a processor 610, a memory 620, and a transceiver 630.
  • the driving assistance device 400 shown in FIG. 5 or the driving assistance device 500 shown in FIG. 6 can implement the foregoing method 200 and method 300 embodiments and the steps performed in the embodiments shown in FIGS. 2 to 4. For similar descriptions, reference can be made to the descriptions in the aforementioned corresponding methods. To avoid repetition, I won’t repeat them here.
  • the driving assistance device 400 shown in FIG. 5 or the driving assistance device 500 shown in FIG. 6 may be a driving assistance device, a driving assistance module (unit), or a driving assistance system integrated on the first terminal, or, It may be a chip or an integrated circuit on the first terminal.
  • the chip may be a chip in a sensor, a fusion module, or a vehicle-mounted processor.
  • the fusion module may include the processing module and the transceiver module shown in FIG. 5, or may also be a first terminal on which the aforementioned chip or integrated circuit, etc. are integrated.
  • the embodiments of the application are not limited here.
  • FIG. 7 shows a schematic block diagram of another example of a driving assistance device 600 provided by an embodiment of the present application.
  • the driving assistance device 400 may correspond to the first terminal described in the above method 200, or may be a chip applied to the first terminal device. , Chips in components, integrated circuits, sensors, fusion modules, on-board processors, etc.
  • each module or unit in the driving assistance device 600 is respectively used to execute each action or processing procedure executed by the method 200 described above.
  • the driving assistance device 600 includes a driver detection module 610 and a misoperation judgment module 620.
  • the driver detection module 610 is used to detect the state of the driver
  • the misoperation judgment module 620 is used to determine whether the driver's operation of the first terminal is an abnormal operation
  • the misoperation judgment module 620 is further configured to: in the case where it is determined that the driver is in an abnormal state, and the first operation of the first terminal by the driver is determined to be an abnormal operation, execute a first process, and the first process includes Outputting instruction information and/or control information, where the instruction information or the control information is used to indicate a second operation on the first terminal, or the first processing includes controlling the first terminal to perform the second operation.
  • the driving assistance device does not immediately trigger an alert to the driver or other responses to the driver when it detects that the state of the driver driving the first terminal is an abnormal state, but further determines the driver’s response to the first terminal.
  • the driver responds to or makes adjustments to the misoperation of the mobile device, that is, the first processing is executed. Therefore, unnecessary or offensive warnings can be avoided, the efficiency and accuracy of feedback or response to the driver can be improved, and the incidence of traffic accidents can be further reduced.
  • the misoperation judgment module 620 is further configured to determine that the first operation is an abnormal operation when the first operation satisfies at least one of the following conditions:
  • the rate of change in the operation of the first terminal is greater than or equal to the first threshold
  • the operation amplitude for the first terminal is greater than or equal to the second threshold
  • the operation indicated by the operation decision from the first auxiliary system is inconsistent with the operation of the driver on the first terminal;
  • the operation indicated by the operation information from the second auxiliary system is inconsistent with the operation of the driver on the first terminal.
  • the first operation includes an operation of controlling the first terminal to change a motion state.
  • the first auxiliary system or the second auxiliary system includes: an automatic driving AD system, an advanced driver assistance system ADAS, or a driving assistance system including at least one driving assistance function At least one of
  • the driving assistance function includes: determining that the first terminal satisfies a preset condition, and determining a function of changing the motion state of the first terminal when the preset condition is met; and/or determining that the first terminal satisfies the preset condition, And the function of controlling the first terminal to change the motion state when the preset condition is met.
  • the operation indicated by the operation decision from the first auxiliary system or the operation indicated by the operation information from the second auxiliary system includes: One or more of the operation of the acceleration device of a terminal, the operation of the braking device of the first terminal, and the operation of the steering device of the first terminal.
  • the driving assistance device 600 further includes: a first assistance system 630 and/or a second assistance system 640, the first assistance system 630 or the The second auxiliary 640 system includes the misoperation judgment module 620, and the driver detection module 610 includes a first interface,
  • the driver detection module 610 is further configured to send the driver's state information to the first auxiliary system 630 or the second auxiliary system 640 through the first interface.
  • the driving assistance device 600 further includes: a first assistance system 630 and/or a second assistance system 640, and the driver detection module 610 includes the Misoperation judgment module 620,
  • the first auxiliary system 630 includes a second interface, and the first auxiliary system 630 is used to: send the operation decision of the first auxiliary system 630 to the driver detection module 610 through the second interface; and/or
  • the second auxiliary system 640 includes a third interface, and the second auxiliary system is used to send the operation information of the second auxiliary system 640 to the driver detection module 610 through the third interface.
  • the driving assistance device 600 further includes: a first assistance system 630 and/or a second assistance system 640,
  • the driver detection module 610 includes a fourth interface, and the driver detection module 610 is further configured to: send the status information of the driver to the misoperation judgment module 620 through the fourth interface;
  • the first auxiliary system 630 includes a fifth interface, and the first auxiliary system 630 is configured to: send the operation decision of the first auxiliary system 630 to the misoperation judgment module 620 through the fifth interface, and/or the first auxiliary system 630
  • the second auxiliary system 640 includes a sixth interface, and the second auxiliary system 640 is configured to send the operation information of the second auxiliary system 640 to the misoperation judgment module 620 through the sixth interface.
  • FIG. 11 shows a schematic block diagram of another example of a driving assistance device 700 provided by an embodiment of the present application.
  • the driving assistance device 700 may correspond to the first terminal described in the above method 300, or may be a chip applied to the first terminal device. , Components, integrated circuits, sensors, fusion modules, or chips in on-board processors, etc.
  • each module or unit in the driving assistance device 700 is respectively used to execute each action or processing procedure executed by the method 300 described above.
  • the driving assistance device 700 includes a driver detection module 710 and an alarm adjustment module 720.
  • the driver detection module 710 is used to detect the state of the driver
  • the alarm adjustment module 720 is configured to perform a second process when it is determined that the driver is in an abnormal state.
  • the second process includes: adjusting or updating an alarm trigger condition, and/or adjusting or updating an alarm level, where the alarm The trigger condition is used to trigger an alert to the driver.
  • the driving assistance device does not immediately trigger an alert to the driver when it detects that the driver is driving the mobile device in an abnormal state, but adjusts or updates the alert triggering conditions, and/or adjusts or updates the alert level Wait. After the mobile device satisfies the adjusted or updated warning trigger conditions, it can alert the driver, thereby avoiding unnecessary or offensive warnings, improving the accuracy and efficiency of warning to the driver, and improving the performance of DMS. Efficiency and accuracy reduce the incidence of traffic accidents.
  • the alarm adjustment module 720 is further configured to:
  • the normal state is a state in which the driver normally operates the first terminal.
  • the abnormal state includes: the driver's physiological abnormal state, mental abnormal state, attention abnormal state, or any abnormal state that affects the operation of the first terminal at least one.
  • the driving assistance device 700 further includes: a misoperation judgment module 730,
  • the misoperation judgment module 730 is used to determine whether the driver's operation of the first terminal is an abnormal operation
  • a first process is performed, and the first process includes outputting instruction information and/or control information,
  • the instruction information or the control information is used to indicate a second operation on the first terminal, or the first processing includes controlling the first terminal to perform the second operation.
  • the misoperation judgment module 730 is further configured to determine that the first operation is an abnormal operation when the first operation satisfies at least one of the following conditions:
  • the rate of change in the operation of the first terminal is greater than or equal to the first threshold
  • the operation amplitude for the first terminal is greater than or equal to the second threshold
  • the operation indicated by the operation decision from the first auxiliary system is inconsistent with the operation of the driver on the first terminal;
  • the operation indicated by the operation information from the second auxiliary system is inconsistent with the operation of the driver on the first terminal.
  • the first operation includes an operation of controlling the first terminal to change a motion state.
  • a warning is issued to the driver, the driver does not respond to the first operation of the driver, the degree of operation of the first operation is reduced, or the difficulty of the first operation is increased. at least one.
  • the driver detection module 710 includes a seventh interface, and the driver detection module 710 is further configured to pass the driver's status information through the The seventh interface is sent to the alarm adjustment module 720.
  • the processor may be a central processing unit (central processing unit, CPU), and the processor may also be other general-purpose processors, digital signal processors (digital signal processors, DSP), and dedicated integration Circuit (application specific integrated circuit, ASIC), ready-made programmable gate array (field programmable gate array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc.
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • the memory in the embodiments of the present application may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory.
  • the non-volatile memory can be read-only memory (ROM), programmable read-only memory (programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), and electrically available Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory.
  • the volatile memory may be random access memory (RAM), which is used as an external cache.
  • RAM random access memory
  • static random access memory static random access memory
  • DRAM dynamic random access memory
  • DRAM synchronous dynamic random access memory
  • Access memory synchronous DRAM, SDRAM
  • double data rate synchronous dynamic random access memory double data rate SDRAM, DDR SDRAM
  • enhanced synchronous dynamic random access memory enhanced SDRAM, ESDRAM
  • synchronous connection dynamic random access memory Take memory (synchlink DRAM, SLDRAM) and direct memory bus random access memory (direct rambus RAM, DR RAM).
  • the above-mentioned embodiments may be implemented in whole or in part by software, hardware, firmware or any other combination.
  • the above-mentioned embodiments may be implemented in the form of a computer program product in whole or in part.
  • the computer program product includes one or more computer instructions or computer programs.
  • the computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.
  • the computer instruction may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.
  • the computer instruction may be transmitted from a website, computer, server, or data center through a cable (For example, infrared, wireless, microwave, etc.) to transmit to another website, computer, server or data center.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that includes one or more sets of available media.
  • the usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium.
  • the semiconductor medium may be a solid state drive.
  • the embodiment of the present application also provides a computer-readable medium for storing computer program code, and the computer program includes instructions for executing the driving assistance method in the above-mentioned method 200 or method 300 in the embodiment of the present application.
  • the readable medium may be a read-only memory (ROM) or a random access memory (RAM), which is not limited in the embodiment of the present application.
  • the present application also provides a computer program product.
  • the computer program product includes instructions. When the instructions are executed, the driving assistance device executes operations corresponding to the above-mentioned method 200 or method 300, respectively.
  • An embodiment of the present application also provides a system chip, which includes a processing unit and a communication unit.
  • the processing unit may be, for example, a processor, and the communication unit may be, for example, an input/output interface, a pin, or a circuit.
  • the processing unit can execute computer instructions so that the chip in the communication device executes any of the driving assistance methods provided in the foregoing embodiments of the present application.
  • any driving assistance device provided in the foregoing embodiments of the present application may include the system chip.
  • the computer instructions are stored in a storage unit.
  • the storage unit is a storage unit in the chip, such as a register, a cache, etc.
  • the storage unit can also be a storage unit in the terminal located outside the chip, such as a ROM or other storage units that can store static information and instructions.
  • static storage devices RAM, etc.
  • the processor mentioned in any of the above can be a CPU, a microprocessor, an ASIC, or one or more integrated circuits used to control the execution of the program of the above driving assistance method.
  • the processing unit and the storage unit can be decoupled, respectively set on different physical devices, and connected in a wired or wireless manner to realize the respective functions of the processing unit and the storage unit, so as to support the system chip to implement the above-mentioned embodiments Various functions in.
  • the processing unit and the memory may also be coupled to the same device.
  • the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory.
  • the non-volatile memory can be read-only memory (ROM), programmable read-only memory (programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), and electrically available Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory.
  • the volatile memory may be random access memory (RAM), which is used as an external cache.
  • RAM random access memory
  • static random access memory static random access memory
  • DRAM dynamic random access memory
  • DRAM synchronous dynamic random access memory
  • Access memory synchronous DRAM, SDRAM
  • double data rate synchronous dynamic random access memory double data rate SDRAM, DDR SDRAM
  • enhanced synchronous dynamic random access memory enhanced SDRAM, ESDRAM
  • synchronous connection dynamic random access memory Take memory (synchlink DRAM, SLDRAM) and direct memory bus random access memory (direct rambus RAM, DR RAM).
  • the disclosed system, device, and method can be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the unit is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of the present application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM), and random access.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Automation & Control Theory (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Surgery (AREA)
  • General Physics & Mathematics (AREA)
  • Developmental Disabilities (AREA)
  • Mathematical Physics (AREA)
  • Emergency Management (AREA)
  • Business, Economics & Management (AREA)
  • Child & Adolescent Psychology (AREA)
  • Multimedia (AREA)
  • Educational Technology (AREA)
  • Hospice & Palliative Care (AREA)
  • Psychiatry (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • Theoretical Computer Science (AREA)
  • Physiology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Combustion & Propulsion (AREA)
  • Chemical & Material Sciences (AREA)
  • Traffic Control Systems (AREA)

Abstract

一种驾驶辅助方法和驾驶辅助装置,可以应用在自动驾驶或者智能驾驶领域。驾驶辅助方法包括:确定驾驶员为异常状态;确定驾驶员对第一终端的第一操作为异常操作;执行第一处理,第一处理包括输出指示信息和/或控制信息,指示信息或者控制信息用于指示对第一终端的第二操作,或者,第一处理包括控制第一终端执行第二操作。第一终端可以包括车辆、飞机、无人机、轮船、天车、塔吊等可以通过人的操作移动空间位置或改变空间形状的移动设备。提供的驾驶辅助方法,可以避免产生不必要或者令人反感的告警,提高驾驶员监测系统DMS的效率和准确性,进一步的降低交通事故的发生率。

Description

驾驶辅助方法和驾驶辅助装置
本申请要求于2020年3月10日提交中国专利局、申请号为202010161761.0、发明名称为“驾驶辅助方法和驾驶辅助装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及自动驾驶领域,更为具体的,涉及一种驾驶辅助方法和驾驶辅助装置。
背景技术
驾驶员的状态与驾驶或者操作移动设备(例如车辆等)的安全性高度相关。驾驶员处于酒驾、疲劳驾驶、处理其它事情(如打电话、捡东西等)分神等异常驾驶状态时,无法把注意力集中在驾驶上,会大幅增加交通事故发生的可能性,是导致交通事故的一个重要原因。
为了减少此类事故的发生,目前,在车辆上设置有驾驶员监测系统(driver monitoring system,DMS),实现对驾驶员的监测、预警,来提高行车安全性,降低事故发生率。
DMS根据检测出的驾驶员状态,可以向驾驶员给出告警等反馈。
但是,DMS可能会给出引人反感的或者不必要的告警。严重的影响了DMS的实际作用,导致DMS效率低下,不能有效的降低交通事故的发生率。
发明内容
本申请提供一种驾驶辅助方法和驾驶辅助装置,可以避免产生不必要或者令人反感的告警,提高DMS的效率和准确性,进一步的降低交通事故的发生率。
第一方面,提供了一种驾驶辅助方法,该驾驶辅助方法的执行主体可以是集成在第一终端上的驾驶辅助装置、驾驶辅助模块(单元)或者驾驶辅助系统,或者,还可以是第一终端上的芯片或者集成电路,例如,该芯片可以是传感器、融合模块或者车载处理器等中的芯片。融合模块可以理解为多个模块或者单元组成的一个模块或者单元,或者,融合模块还可以理解为从多个其它模块获取信息并进行融合,并输出融合信息的模块。或者,该驾驶辅助方法的执行主体还可以是第一终端,该第一终端上集成有上述的芯片或者集成电路。其中,第一终端可以为移动设备,移动设备可以包括车辆、飞机、无人机、轮船、天车、塔吊等可以通过人的操作移动空间位置或改变空间形状的设备。该方法包括:确定驾驶员为异常状态;确定该驾驶员对第一终端的第一操作为异常操作;执行第一处理,该第一处理包括输出指示信息和/或控制信息,该指示信息或者该控制信息用于指示对该第一终端的第二操作,或者,该第一处理包括控制该第一终端执行第二操作。
第一方面提供的驾驶辅助方法,在检测到驾驶员驾驶第一终端的状态为异常状态时,并不立即触发向驾驶员告警或者向驾驶员进行其他响应,而是进一步的在确定驾驶员对于第一终端的操作为误操作的情况下,才对驾驶员对移动移动设备的误操作产生响应或者进 行调整,即执行第一处理。从而可以避免产生不必要或者令人反感的告警,提高向驾驶员进行反馈或者响应的效率和准确性,进一步的降低交通事故的发生率。
应理解,在本申请实施例中,对于不同的异常状态,确定该驾驶员对第一终端的第一操作为异常操作的具体方式可以相同或不同,并且,对于不同异常状态,执行的第一处理可以相同或不同,本申请对此不做限制。
在第一方面一种可能的实现方式中,该确定该驾驶员对第一终端的第一操作为异常操作,包括:确定该第一操作满足以下条件中的至少一个:
对该第一终端的操作变化速率大于或者等于第一阈值;
对该第一终端的操作幅度大于或者等于第二阈值;
来自于第一辅助系统的操作决策所指示的操作与该驾驶员对该第一终端的操作不一致;或者
来自于第二辅助系统的操作信息所指示的操作与该驾驶员对该第一终端的操作不一致。进一步,所述第一辅助系统不同于所述第二辅助系统。
其中,操作决策所指示的操作或者操作信息所指示的操作与该驾驶员对该移动设备的操作不一致包括:操作类型不同或者操作类型相同但是操作的强度(幅度)差值(或者差值的绝对值)大于某个阈值。操作类型例如可以包括:加速装置操作类型、减速装置操作类型、方向改变装置操作类型、高度改变装置操作类型等中的至少一个。
在该实现方式中,通过上述的条件确定第一操作是否为误操作,判定的结果比较准确,并且,比较简单,容易实现。
在第一方面一种可能的实现方式中,该第一操作包括控制该第一终端改变运动状态的操作。在该实现方式中,仅考虑控制该第一终端改变运动状态的操作,忽略不改变第一终端运动状态的低风险或无风险的操作,提高向驾驶员进行反馈或者响应的效率和准确性。
在第一方面一种可能的实现方式中,该第一操作包括:对该第一终端的加速装置的操作、对该第一终端的制动装置的操作、或者对该第一终端的转向装置的操作中的至少一个。
在第一方面一种可能的实现方式中,控制移动设备改变运动状态的装置可以包括加速装置(例如加速踏板)、减速装置(例如刹车踏板)、转向装置(例如方向盘)、控制运动高度装置(例如飞机上的拉高杆)等。
在第一方面一种可能的实现方式中,该第一辅助系统或者该第二辅助系统包括:自动驾驶AD系统、先进驾驶员辅助系统ADAS、或者包括至少一个驾驶辅助功能的驾驶辅助系统中的至少一个;
其中,该驾驶辅助功能包括:确定该第一终端满足预设条件,以及在满足预设条件时确定改变该第一终端运动状态的功能;和/或,确定该第一终端满足预设条件,以及在满足预设条件时控制该第一终端改变运动状态的功能。
在第一方面一种可能的实现方式中,驾驶辅助功能可以包括:AEB、LKA、LCA、ACC等。
在第一方面一种可能的实现方式中,来自于该第一辅助系统的操作决策所指示的操作,或者,来自于该第二辅助系统的操作信息所指示的操作,包括:
对该第一终端的加速装置的操作、对该第一终端的制动装置的操作、对该第一终端的转向装置的操作中的一个或者多个。
在第一方面一种可能的实现方式中,该第二操作包括:向该驾驶员发出告警、不响应该驾驶员的该第一操作、减轻该第一操作的操作程度、或者提高该第一操作的难度中的至少一个。例如,向该驾驶员发出告警可以包括:视觉、听觉、触觉中的任意一种或者多种的组合等告警方式。
在第一方面一种可能的实现方式中,该异常状态包括:该驾驶员的生理异常状态、精神异常状态、注意力异常状态、或者对该第一终端的操作造成影响的异常状态中的至少一个。
在第一方面一种可能的实现方式中,异常状态可以为:驾驶员处于酒驾、毒驾、疲劳驾驶、或者处理其它事情(如打电话、捡东西、吸烟等)等异常驾驶状态中的一种或者多种。该异常状态直接会影响驾驶员对第一终端的正常的操作的判断或者控制,会影响驾驶员对该第一终端的控制能力。
第二方面,提供了一种驾驶辅助方法,该驾驶辅助方法的执行主体可以是集成在第一终端上的驾驶辅助装置、驾驶辅助模块(单元)或者驾驶辅助系统,或者,还可以是第一终端上的芯片或者集成电路,例如,该芯片可以是传感器、融合模块或者车载处理器等中的芯片。融合模块可以理解为多个模块或者单元组成的一个模块或者单元,或者,融合模块还可以理解为从多个其它模块获取信息并进行融合,并输出融合信息的模块。或者,该驾驶辅助方法的执行主体还可以是第一终端,该第一终端上集成有上述的芯片或者集成电路。其中,第一终端可以为移动设备,移动设备可以包括车辆、飞机、无人机、轮船、天车、塔吊等可以通过人的操作移动空间位置或改变空间形状的设备。该方法包括:确定驾驶员为异常状态;执行第二处理,该第二处理包括:调整或者更新告警触发条件,和/或,调整或者更新告警等级,其中,该告警触发条件用于触发对该驾驶员告警。
第二方面提供的驾驶辅助方法,在检测到驾驶员驾驶移动设备的状态为异常状态时,并不立即触发向驾驶员告警,而是调整或者更新告警触发条件,和/或,调整或者更新告警等级等。在该移动设备满足调整或者更新后的告警触发条件后,才向驾驶员进行告警,从而可以避免产生不必要或者令人反感的告警,提高向驾驶员进行告警的准确性和效率,提高DMS的效率和准确性,降低交通事故的发生率。
在第二方面一种可能的实现方式中,异常状态可以为:驾驶员处于酒驾、毒驾、疲劳驾驶、或者处理其它事情(如打电话、捡东西、吸烟等)等异常驾驶状态中的一种或者多种。该异常状态直接会影响驾驶员对第一终端的正常的操作的判断或者控制,会影响驾驶员对该第一终端的控制能力。
应理解,在本申请实施例中,对于不同的异常状态执行的第二处理可以相同或不同,本申请不做限制。例如:检测出轻度疲劳或吸烟对应的第二处理都是提高告警等级;或者,检测出轻度疲劳对应的第二处理为调整告警触发条件并且提高告警等级,而检测出吸烟对应的第二处理为提高告警等级等。
在第二方面一种可能的实现方式中,该调整或者更新告警触发条件,包括:
将告警时间调整或更新至早于该驾驶员处于正常状态时的告警时间、或将告警距离调整或更新至大于该驾驶员处于正常状态时的告警距离中的至少一个;和/或,
该调整或者更新告警等级,包括:
将告警等级调整或更新至高于该驾驶员处于正常状态时的告警等级;其中,该正常状 态为该驾驶员对该第一终端正常操作的状态。
在该实现方式中,通过将告警时间调整或更新至早于该驾驶员处于正常状态时的告警时间、将告警距离调整或更新至大于该驾驶员处于正常状态时的告警距离、或者将告警等级调整或更新至高于该驾驶员处于正常状态时的告警等级,可以避免产生不必要或者令人反感的告警,提高向驾驶员进行告警的准确性和效率,但仍然可以保证告警的及时性和有效性。
在第二方面一种可能的实现方式中,该异常状态包括:该驾驶员的生理异常状态、精神异常状态、注意力异常状态、或者对该第一终端的操作造成影响的异常状态中的至少一个。
在第二方面一种可能的实现方式中,在该驾驶员处于该异常状态的情况下,该方法还包括:确定该驾驶员对第一终端的第一操作为异常操作;执行第一处理,该第一处理包括输出指示信息和/或控制信息,该指示信息或者该控制信息用于指示对该第一终端的第二操作,或者,该第一处理包括控制该第一终端执行第二操作。在该实现方式中,在检测到驾驶员驾驶移动设备的状态为异常状态时,并不立即触发向驾驶员告警,而是调整或者更新告警触发条件和/或调整告警等级。并且,进一步的在确定驾驶员对于第一终端的操作为误操作的情况下,才对驾驶员对移动移动设备的操作产生响应或者调整,即执行第一处理。从而可以避免产生不必要或者令人反感的告警,提高向驾驶员进行反馈或者响应的效率和准确性,进一步的降低交通事故的发生率。
应理解,在本申请实施例中,对于不同的异常状态,确定该驾驶员对第一终端的第一操作为异常操作的具体方式可以相同或不同,并且,对于不同异常状态,执行的第一处理可以相同或不同,本申请对此不做限制。
在第二方面一种可能的实现方式中,该确定该驾驶员对第一终端的第一操作为异常操作,包括:确定该第一操作满足以下条件中的至少一个:
对该第一终端的操作变化速率大于或者等于第一阈值;
对该第一终端的操作幅度大于或者等于第二阈值;
来自于第一辅助系统的操作决策所指示的操作与该驾驶员对该第一终端的操作不一致;或者
来自于第二辅助系统的操作信息所指示的操作与该驾驶员对该第一终端的操作不一致。
在第二方面一种可能的实现方式中,该第一操作包括控制该第一终端改变运动状态的操作。
在第二方面一种可能的实现方式中,该第二操作包括:向该驾驶员发出告警、不响应该驾驶员的该第一操作、减轻该第一操作的操作程度、或者提高该第一操作的难度中的至少一个。向该驾驶员发出告警可以包括:视觉、听觉、触觉中的任意一种或者多种的组合等告警方式。
第三方面,提供了一种驾驶辅助装置,该驾驶辅助装置包括用于执行以上第一方面或第一方面的任意可能的实现方式中的各个步骤的单元。
第四方面,提供了一种驾驶辅助装置,该驾驶辅助装置包括用于执行以上第二方面或第二方面的任意可能的实现方式中的各个步骤的单元。
第五方面,提供了一种驾驶辅助装置,该装置包括至少一个处理器和存储器,该至少一个处理器用于执行以上第一方面或第一方面的任意可能的实现方式中的方法。
第六方面,提供了一种驾驶辅助装置,该装置包括至少一个处理器和存储器,该至少一个处理器用于执行以上第二方面或第二方面的任意可能的实现方式中的方法。
第七方面,提供了一种驾驶辅助装置,该装置包括至少一个处理器和接口电路,该至少一个处理器用于执行以上第一方面或第一方面的任意可能的实现方式中的方法。
第八方面,提供了一种驾驶辅助装置,该装置包括至少一个处理器和接口电路,该至少一个处理器用于执行以上第二方面或第二方面的任意可能的实现方式中的方法。
第九方面,提供了一种移动设备,该移动设备包括:上述第三方面、第五方面或者第七方面提供的驾驶辅助装置,和/或,上述第四方面、第六方面或者第八方面提供的驾驶辅助装置。可选的,移动设备可以包括车辆、飞机、无人机、轮船、天车、塔吊等可以通过人的操作移动空间位置或改变空间形状的设备。
第十方面,提供了一种计算机程序产品,该计算机程序产品包括计算机程序,该计算机程序在被处理器执行时,用于执行第一方面或第一方面的任意可能的实现方式中的方法,或者执行第二方面或第二方面的任意可能的实现方式中的方法。
第十一方面,提供一种计算机可读存储介质,该计算机可读存储介质中存储有计算机程序,当该计算机程序被执行时,用于执行第一方面或第一方面的任意可能的实现方式中的方法,或者执行第二方面或第二方面的任意可能的实现方式中的方法。
第十二方面,提供了一种芯片或者集成电路,该芯片或者集成电路包括:处理器,用于从存储器中调用并运行计算机程序,使得安装有该芯片或者集成电路的设备执行第一方面或第一方面的任意可能的实现方式中的方法,或者执行第二方面或第二方面的任意可能的实现方式中的方法。可选的,该芯片可以为传感器、融合模块或者车载处理器等中的芯片等。
本申请实施例提供的驾驶辅助方法和驾驶辅助装置,在检测到驾驶员驾驶移动设备的状态为异常状态时,并不立即触发向驾驶员告警,进一步的在确定驾驶员对于移动设备的操作为误操作或者异常操作的情况下,才对驾驶员对移动设备的操作产生反馈,例如向驾驶员产生告警等。从而可以避免产生不必要或者令人反感的告警,提高DMS的效率和准确性,进一步的降低交通事故的发生率。
附图说明
图1是是DMS系统对驾驶员驾驶车辆时的检测的示意图。
图2是本申请实施例提供的一例驾驶辅助方法的示意性流程图。
图3是本申请实施例提供的另一例驾驶辅助的示意性流程图。
图4是本申请实施例提供的又一例驾驶辅助方法的示意性流程图。
图5是本申请实施例提供的驾驶辅助装置的示意性框图。
图6是本申请实施例提供的另一例驾驶辅助装置的示意性框图。
图7是本申请实施例提供的又一例驾驶辅助装置的示意性框图。
图8是本申请实施例提供的又一例驾驶辅助装置的示意性框图。
图9是本申请实施例提供的又一例驾驶辅助装置的示意性框图。
图10是本申请实施例提供的又一例驾驶辅助装置的示意性框图。
图11是本申请实施例提供的又一例驾驶辅助装置的示意性框图。
图12是本申请实施例提供的又一例驾驶辅助装置的示意性框图。
图13是本申请实施例提供的又一例驾驶辅助装置的示意性框图。
具体实施方式
下面将结合附图,对本申请中的技术方案进行描述。
在本申请实施例的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;本文中的“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,在本申请实施例的描述中,“多个”是指两个或多于两个。
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。
另外,本申请的各个方面或特征可以实现成方法、装置或使用标准编程和/或工程技术的制品。本申请中使用的术语“制品”涵盖可从任何计算机可读器件、载体或介质访问的计算机程序。例如,计算机可读介质可以包括,但不限于:磁存储器件(例如,硬盘、软盘或磁带等),光盘(例如,压缩盘(compact disc,CD)、数字通用盘(digital versatile disc,DVD)等),智能卡和闪存器件(例如,可擦写可编程只读存储器(erasable programmable read-only memory,EPROM)、卡、棒或钥匙驱动器等)。另外,本文描述的各种存储介质可代表用于存储信息的一个或多个设备和/或其它机器可读介质。术语“机器可读介质”可包括但不限于,无线信道和能够存储、包含和/或承载指令和/或数据的各种其它介质。
驾驶员的状态与驾驶移动设备(例如汽车等)的安全性高度相关。驾驶员处于酒驾、疲劳驾驶、处理其它事情(如打电话、捡东西等)分神等异常驾驶状态时,无法把注意力集中在驾驶上,会大幅增加交通事故发生的可能性,是导致交通事故的一个重要原因。
为了减少此类事故的发生,目前,在车辆上设置有驾驶员监测系统(driver monitoring system,DMS),DMS包含检测驾驶员状态的传感器和分析模块。分析模块基于传感器的数据判断驾驶员状态。例如,传感器可以基于对摄像头检测驾驶员的面部表情等数据,分析模块基于对摄像头数据的图像检测和/或雷达数据的微多普勒分析等技术手段感知驾驶员状态,实现对驾驶员的监测、预警,来提高行车安全性,降低事故发生率,确保驾驶员生命安全与财产安全。例如,图1所示的DMS系统对驾驶员驾驶车辆时的检测的示意图,通过基于对摄像头检测驾驶员的面部表情等数据,基于对面部表情分析等技术手段感知驾驶员状态,实现对驾驶员的监测以及告警等。
当前,国内外市场对DMS的需求已经非常明确,相关标准的制定也已经纳入了多个标准组织的未来标准规划路线图。
DMS根据检测出的驾驶员状态,可以向驾驶员给出告警等反馈。例如:当DMS检测到驾驶员犯困时给出告警,引起驾驶员警觉;当检测到驾驶员处于抽烟状态或打电话的状态,会触发告警。
但是,DMS可能会给出引人反感的或者不必要的告警。
例如,由于人行为的复杂性和当前传感器性能以及检测算法性能有限,当前DMS系统仍然有一定的误识别率,由误识别导致的告警会引人反感。
又例如,驾驶员在清醒情况下的错误驾驶行为往往是故意的,例如抽烟、打电话等。DMS系统检测到这类驾驶员异常状态而告警会引人反感。
无论哪种引人反感的告警发生,都很可能导致如下两种情况:
驾驶员主动关闭DMS系统;
驾驶员的主观注意力刻意忽略、屏蔽DMS系统的所有告警甚至车的所有告警,从而导致DMS的实际作用显著降低。
因此,目前DMS的可能产生不必要或者令人反感的告警,严重的影响了DMS的实际作用,导致DMS效率低下,提高了交通事故的发生率、严重威胁驾驶员生命和财产安全。
有鉴于此,本申请提供一种驾驶辅助方法,在检测到驾驶员驾驶移动设备的状态为异常状态时,并不立即触发向驾驶员告警,进一步的在确定驾驶员对于移动设备的操作为误操作或者异常操作的情况下,才对驾驶员对移动设备的操作产生反馈,例如向驾驶员产生告警等。从而可以避免产生不必要或者令人反感的告警,提高DMS的效率和准确性,进一步的降低交通事故的发生率。
本申请提供的基于驾驶辅助方法,可以应用在驾驶员对于移动设备的驾驶或者操作的场景中。在本申请实施例中,移动设备可以包括车辆、飞机、无人机、轮船、天车、塔吊等可以通过人的操作移动空间位置或改变空间形状的设备。本申请对于移动设备的具体形态不作限制。
下面结合图2详细说明本申请提供的驾驶辅助方法,图2是本申请一个实施例的驾驶辅助方法200的示意性流程图。
应理解,本申请提供的驾驶辅助方法的执行主体可以是集成在第一终端上的驾驶辅助装置、驾驶辅助模块(单元)或者驾驶辅助系统。或者,本申请提供的驾驶辅助方法的执行主体还可以是第一终端上的芯片或者集成电路,例如,该芯片可以是传感器、融合模块或者车载处理器等中的芯片。融合模块可以包括上述的驾驶辅助模块(单元),或者,融合模块还可以理解为从多个其它模块获取信息并进行融合,并输出融合信息的模块。或者,本申请提供的驾驶辅助方法的执行主体还可以是第一终端,该第一终端上集成有上述的芯片或者集成电路。
可选的,该驾驶辅助装置或者驾驶辅助系统可以包括DMS。可选的,该驾驶辅助装置或者驾驶辅助系统还可以包括:先进驾驶员辅助系统(advanced driver assistant system,ADAS)、自动驾驶(autonomous driving,AD)系统、或者包括至少一个驾驶辅助功能的驾驶辅助系统中的至少一个。本申请在此不作限制。作为示例而非限定,执行方法的执行主体也可以是应用于该驾驶辅助装置或者驾驶辅助系统的芯片、芯片系统、或处理器等。
在本申请实施例中,第一终端可以为上述各种类型的移动设备。例如汽车、无人机、轮船等。
如图2所示,图2中示出的方法200可以包括S210至S230。下面结合图2详细说明方法200中的各个步骤。
S210,确定驾驶员处于异常状态。
S220,确定该驾驶员对第一终端的第一操作为异常操作。
S230,执行第一处理,该第一处理包括输出指示信息和/或控制信息,该指示信息或者该控制信息用于指示对该第一终端的第二操作,或者,该第一处理包括控制该第一终端执行第二操作。
具体而言,在S210中。第一终端中的驾驶员检测系统(例如DMS等)可以实时的检测驾驶员在操作第一终端时的状态。驾驶员操作第一终端例如可以为:驾驶员在驾驶车辆、驾驶员在驾驶飞机、驾驶员在驾驶轮船、或者驾驶员在驾驶吊车或者塔吊等。本申请实施例中对于驾驶员在操作第一终端的具体形式不作限制。在实时检测驾驶员操作第一终端的状态情况下,会确定驾驶员操作第一终端时是否处于异常状态。
可选的,在本申请实施例中,该异常状态包括:该驾驶员的生理异常状态(例如身体不适)、精神异常状态(例如紧张不安)、注意力异常状态(例如注意力不集中)、或者对该第一终端的操作造成影响的异常状态(例如接听电话、吸烟等)中的至少一个。也就是说,异常状态可以理解为影响该驾驶员对该第一终端正常操作的状态。例如,异常状态可以包括:驾驶员处于酒驾、毒驾、疲劳驾驶、或者处理其它事情(如打电话、捡东西、吸烟等)等异常驾驶状态中的一种或者多种。该异常状态直接会影响驾驶员对第一终端的正常的操作的判断或者控制,会影响驾驶员对该第一终端的控制能力。
例如,DMS中的分析模块基于传感器的数据判断驾驶员状态。传感器可以基于对摄像头检测驾驶员的面部表情等数据,分析模块基于对摄像头数据的图像检测和/或雷达数据的微多普勒分析等技术手段感知驾驶员状态,实现对驾驶员的状态监测。确定驾驶员操作第一终端时是否处于异常状态。
在S220中,会确定驾驶员对该第一终端的操作是否为异常操作,即确定驾驶员对该第一终端的操作是否为误操作。例如,异常操作可以为:驾驶员对油门突然踩深较大的幅度、对方向盘突然打了很大的角度、或者对刹车踏板突然踩深较大的幅度等。换句话说,异常操作可以理解为驾驶员之前很少出现过或者没有出现过的操作。在申请实施例中,对于异常操作的具体形式不作限制。
在S230中,在确定驾驶员操作第一终端时处于异常状态,并且,确定驾驶员对该第一终端的操作为异常操作的情况下,该驾驶辅助装置或者驾驶辅助系统会执行第一处理。该第一处理包括输出指示信息和/或控制信息,该指示信息或者该控制信息用于指示对该第一终端的第二操作,或者,该第一处理包括控制该第一终端执行第二操作。换句话说,该第一处理包括对该第一操作的响应或者调整。由于第一操作为误操作,因此,需要对于驾驶员的第一操作进行干预或者响应,以避免第一操作可能产生的严重交通事故。例如,该驾驶辅助装置或者驾驶辅助系统输出指示信息和/或控制信息,该指示信息或者该控制信息用于指示对该第一终端的第二操作。例如,第二操作可以包括:指示车上的喇叭等向驾驶员进行告警等。或者,该驾驶辅助装置或者驾驶辅助系统控制该第一终端执行第二操作。例如,指控制车上的其他装置(例如机械装置等)降低驾驶员的误操作幅度、或者消除驾驶员的误操作等。从而保证驾驶员的安全,避免出现交通事故。
本申请提供的驾驶辅助方法,在检测到驾驶员驾驶第一终端的状态为异常状态时,并不立即触发向驾驶员告警或者向驾驶员进行其他响应,而是进一步的在确定驾驶员对于第 一终端的操作为误操作的情况下,才对驾驶员对移动移动设备的误操作产生响应或者进行调整,即执行第一处理。从而可以避免产生不必要或者令人反感的告警,提高向驾驶员进行反馈或者响应的效率和准确性,进一步的降低交通事故的发生率。
可选的,在本申请实施例中,在该驾驶员对该第一终端的第一操作不是异常操作,或者,在该驾驶员操作该第一终端不处于异常状态时,均可以不执行第一处理。
应理解,在本申请实施例中,对于不同的异常状态,确定该驾驶员对第一终端的第一操作为异常操作的具体方式可以相同或不同。并且,对于不同异常状态,执行的第一处理可以相同或不同,本申请对此不做限制。
在本申请一些可能的实现方式中,在S220中,在确定该驾驶员对第一终端的第一操是否为异常操作时,如果驾驶员对第一终端的操作满足如下条件中的任意一个或者多个,则可以确定驾驶员对第一终端的操作为异常操作。如下条件包括:
驾驶员对该第一终端的操作变化速率大于或者等于第一阈值;
驾驶员对该第一终端的操作幅度大于或者等于第二阈值;
来自于第一辅助系统的操作决策所指示的操作与该驾驶员对该第一终端的操作不一致;或者
来自于第二辅助系统的操作信息所指示的操作与该驾驶员对该第一终端的操作不一致。
具体而言,第一终端上的各种传感器等可以检测该驾驶员对第一终端的操作。下文的描述中,以第一终端为移动设备为例进行说明。
本申请实施例中,驾驶员对移动设备的操作(或者为第一操作)可以理解为控制该移动设备改变运动状态的操作。换句话说,驾驶员对该移动设备的操作可以理解为驾驶员对控制移动设备改变运动状态的装置的操作。例如,驾驶员对该移动设备的加速装置(例如加速踏板)的操作、驾驶员对该移动设备的减速装置(例如刹车踏板)的操作、驾驶员对该移动设备的转向装置(例如方向盘)的操作等。其中,移动设备运动状态的改变可以包括:运动速度的改变、运动方向的改变、运动高度的改变等。或者,从另外一个角度去理解,移动设备的运动状态的改变可以包括:横向运动状态的改变、纵向运动状态的改变、在与重力方向平行的方向上的运动状态的改变等。本申请在此不作限制。
在本申请实施例中,控制移动设备改变运动状态的装置可以包括加速装置(例如加速踏板)、减速装置(例如刹车踏板)、转向装置(例如方向盘)、控制运动高度装置(例如飞机上的拉高杆)等。本申请实施例中对于控制该移动设备改变运动状态的装置的类型以及具体形式不作限制。
驾驶员对该移动设备的操作幅度可以理解为该驾驶员对该移动设备的操作量或者变化量。可选的,在本申请实施例中,操作幅度也可以为操作变化量的绝对值。例如,对于踩油门或者松油门而言,操作幅度可以为踩加速踏板或者松加速踏板时加速踏板角度的变化量,其中,角度的变化量可以定义为负值或者正值。或者,操作幅度可以为加速踏板下降或者升高的距离等。可选的,例如,可以将踩加速踏板时加速踏板下降的距离或者角度定义为负值,将松加速踏板时加速踏板上升的距离或者角度定义为正值,或者,也可以将踩加速踏板时加速踏板下降的距离或者角度定义为正值,将松加速踏板时加速踏板上升的距离或者角度定义为负值。又例如,对于操作为打反向盘而言,操作幅度可以理解为打方 向盘时的度数等。
驾驶员对移动设备的操作变化速率可以由操作幅度对时间求倒数得到。应理解,在本申请实施例中,驾驶员对该移动设备的操作幅度可为对移动设备的操作变化量,由于操作变化量可以定义为正值,也可以定义为负值,因此。驾驶员对移动设备的操作变化速率可以为负值,也可以为正值。例如,驾驶员对移动设备的操作为踩油门时,其对应的操作变化速率可以为正值,驾驶员对移动设备的操作为松油门时,其对应的操作变化速率可以为负值。又例如,驾驶员对移动设备的操作为踩刹车时,其对应的操作变化速率可以正值,驾驶员对移动设备的操作为松刹车时,其对应的操作变化速率可以为负值。
因此,在本申请实施例中,第一阈值可以为正值,或者也可以为负值。第二阈值也可以为正值,或者也可以为负值。可选的,第一阈值和第二阈值可以为预定义的。如果驾驶员对移动设备的某一个操作的操作变化速率大于或者等于第一阈值,或者,操作幅度大于或者等于第二阈值。则可以确定该操作为第一操作,即为异常操作。
在本申请实施例中,移动设备上可以包括一种或者多种操作辅助系统,在本申请中,操作辅助系统也可以称为辅助系统。例如,操作辅助系统可以为:自动判断该移动设备可以、应该、或不可以执行某种或某些改变运动状态的控制的系统;或者为自动判断移动设备应该执行某种或某些改变运动状态,并自动控制移动设备改变运动状态的系统或装置。可选的,在本申请实施例中,移动设备的操作辅助系统包括:AD系统、ADAS、或者包括至少一个驾驶辅助功能的驾驶辅助系统中的至少一个。可选的,本申请提供的驾驶辅助方法的执行主体可以为该移动上的操作辅助系统。
其中,该驾驶辅助功能包括:确定该移动设备满足预设条件,并且,在该移动设备满足预设条件下自动判断该移动设备改变运动状态的功能;和/或,自动确定该移动设备满足预设条件,并且,在该移动设备满足预设条件下自动控制该移动设备改变运动状态的功能。
例如,在本申请实施例中,驾驶辅助功能可以为:能自动判断移动设备应该做某种纵向(特定程度的加速、特定程度的减速)和/或横向(特定程度、方向的转向)运动的功能。或者,该驾驶辅助功能还可以执行对移动设备做某种纵向和/或横向运动控制的功能。其中,自动判断功能的实现方式可以为通过判断当前移动设备是否满足某种预设条件,根据判断结果确定是否应该对移动设备做某种纵向和/或横向控制的功能。例如,该预设条件可以为:与前车的距离是否大于某个阈值,车辆偏离正常车道的距离或者角度等。
例如,驾驶辅助功能可以包括:自动紧急制动(automatic emergency braking,AEB)、车道保持(lane keep assist,LKA)、并线辅助(lane change assist,LCA)、自适应巡航控制(adaptive cruise control,ACC)等。本申请实施例中对于驾驶辅助功的具体形式不作限制。
在本申请实施例中,移动设备的操作辅助系统对移动设备的操作,包括:移动设备的操作辅助系统对该移动设备的加速装置(例如加速踏板)的操作、移动设备的操作辅助系统对该移动设备的制动装置(例如刹车踏板)的操作、移动设备的操作辅助系统对该移动设备的转向装置(例如方向盘)的操作、或者移动设备的操作辅助系统对该移动设备的控制运动高度装置(例如拉高杆)等中的至少一个。
为了区分,在移动设备的操作辅助系统中,将能自动判断该移动设备可以、应该、或 不可以执行某种或某些改变运动状态的控制的系统称为第一辅助系统。换句话说,第一辅助系统输出的为操作决策,该操作决策用于指示移动设备上的其他装置执行操作。第一辅助系统自身并不执操作决策指示的操作。将能自动判断移动设备应该执行某种或某些改变运动状态,并自动控制移动设备改变运动状态的系统或装置成为第二辅助系统,换句话说,第二辅助系统不仅可以输出操作信息,还可以操作信息指示的操作。
应理解,本申请提供的驾驶辅助方法的执行主体可以为第一辅助系统,或者为第二辅助系统,或者,还可以其该移动设备上的其他辅助系统。可选的,第一辅助系统、第二辅助以及该其他辅助系统可以相同,也可以不同。
当第一辅助系统的操作决策所指示的操作与该驾驶员对该第一终端的操作不一致的情况下,和/或,当第二辅助系统的操作信息所指示的操作与该驾驶员对该第一终端的操作不一致的情况下,则驾驶员对该第一终端的操作为第一操作,即为异常操作。
其中,操作决策所指示的操作或者操作信息所指示的操作与该驾驶员对该移动设备的操作不一致包括:操作类型不同或者操作类型相同但是操作的强度(幅度)差值(或者差值的绝对值)大于某个阈值。操作类型例如可以包括:加速装置操作类型、减速装置操作类型、方向改变装置操作类型或者高度改变装置操作类型等中的至少一个。
例如,操作类型不同可以包括:移动设备的操作辅助系统的操作决策所指示的操作为对移动设备的加速装置进行操作,或者操作信息所指示的操作为对移动设备的加速装置的操作,而驾驶员进行的为对移动设备的非加速装置(例如制动装置、转向装置、高度控制装置等)的操作。又例如,移动设备的操作辅助系统的操作决策所指示的操作判断应该对移动设备的制动装置进行操作,或者,操作信息所指示的操作为对移动设备的制动装置的操作,而驾驶员进行的为对该移动设备的非制动装置(例如加速装置、转向装置、高度控制装置等)的操作等。
例如,操作类型相同但是操作的幅度差值(或者差值的绝对值)大于某个阈值可以包括:移动设备的操作辅助系统判断应该对移动设备的加速装置进行操作,或者执行对该移动设备的加速装置的操作,而驾驶员进行的也为对该移动设备的加速装置的操作,但是两者的操作幅度的差值(或者差值的绝对值)大于或者等于预设的阈值。
以加速装置为加速踏板为例,移动设备的操作辅助系统判断应该(或者执行)对移动设备的加速踏板踩下的角度或者距离为D1,驾驶员对加速踏板踩下的角度或者距离为D2,如果D1-D2≥T,其中,T为预设的阈值,则确定移动设备的操作辅助系统对该移动设备判断或操作与该驾驶员对该移动设备的操作不一致。
或者,如果满足|D1-D2|≥S,S为预设的阈值,则也可以确定移动设备的操作辅助系统对该移动设备判断或操作与该驾驶员对该移动设备的操作不一致。例如,操作辅助系统为判断加速踏板应该抬起D1,而驾驶员却踩深了D2,在这种情况下,D2为负值,D1为正值。或者,D2为正值,D1为负值,就可以利用是否满足|D1-D2|≥S确定操作辅助系统对该移动设备判断或操作与该驾驶员对该移动设备的操作是否一致。
可选的,在本申请一些可能的实现方式中,当驾驶员驾驶移动设备的状态为异常状态时,并且,在确定驾驶员对于移动设备的操作为误操作的情况下,可以执行第一处理。在本申请实施例中,该第一处理包括输出指示信息和/或控制信息,该指示信息或者控制信息用于指示用于该移动设备的第二操作,或者,该第一处理包括控制该移动设备执行第二 操作,该第二操作包括:
向该驾驶员发出告警、不响应该驾驶员的该第一操作、减轻该第一操作的操作程度、或者提高该第一操作的难度中的至少一个。
例如,指示信息和/或控制信息可以指示移动设备上的其他装置向驾驶员进行告警。其中,向该驾驶员发出告警可以包括:视觉、听觉、触觉中的任意一种或者多种的组合等告警方式,本申请实施例中对于具体的告警方式不作限制。
不响应该驾驶员的该第一操作可以理解为消除驾驶员的误操作,即对于驾驶员对移动设备的第一操作不作任何响应。例如,驾驶员踩深加速踏板时,车辆并不进行加速。又例如,驾驶员打方向时,车辆行驶的方向并不发生变化等。尤其是在AD/ADAS功能正在作用时,驾驶员的本次操作被判定为误操作而不是驾驶员意图接管车辆的操作,则不打断正在作用的AD/ADAS功能。可选的,还可以提示驾驶员回到正常驾驶状态后重新操作。
减轻该第一操作的操作程度可以理解为降低第一操作对移动设备的作用效果,或者降低第一操作的效率。例如,第一操作为深踩加速踏板,则减轻该第一操作的操作程度可以理解为即使驾驶员深踩加速踏板移动设备仍仅提供缓慢的加速。又例如,如果第一操作为猛打方向盘,则减轻该第一操作的操作程度可以理解为驾驶员猛打方向时,车辆行驶的方向仍然变化缓慢等。
提高该第一操作的难度,可以理解为增大该驾驶员对该移动设备的操作所需力度。例如,假设第一操作为猛踩加速踏板,驾驶员在正常状态下需要5牛的力去猛踩加速踏板。在驾驶员处于异常状态时,需要10牛的力去踩加速踏板才能达到和正常状态下利用5牛的力去猛踩加速踏板一样的效果。即增加驾驶员踩加速踏板时所需的力度。或者,相比于驾驶员处于正常状态时,在方向转变相同的角度下,驾驶员处于异常状态时打方向时所需的力度(所需力量)大于驾驶员处于正常状态时的所需力度(所需力量)。
应理解,在本申请实施例中,第二操作还可以包括:其他类型或者方式的操作,或者,对该第一操作进行的其他响应或者调整等,只要该操作可以提醒驾驶员目前出于非安全操作状态、降低安全事故的发生即可。本申请实施例在此不作限制。
本申请还提供了一种驾驶辅助方法,在检测到驾驶员驾驶移动设备的状态为异常状态时,并不立即触发向驾驶员告警,而是调整或者更新告警触发条件,和/或,调整或者更新告警等级。在满足调整或者更新后的触发条件后,才向驾驶员进行告警,或者,以调整或者更新后的告警等级向驾驶员告警,从而可以避免产生不必要或者令人反感的告警,提高向驾驶员进行告警的准确性和效率,提高DMS的效率和准确性,降低交通事故的发生率。
下面结合图3详细说明本申请提供的驾驶辅助方法,图3是本申请一个实施例驾驶辅助方法300的示意性流程图。
应理解,在本申请实施例中,该驾驶辅助方法的执行主体可以是集成在第一终端上的驾驶辅助装置或者驾驶辅助系统。可选的,该驾驶辅助装置或者驾驶辅助系统可以包括DMS。可选的,该驾驶辅助装置或者驾驶辅助系统还可以包括:ADAS、AD系统、或者包括至少一个驾驶辅助功能的驾驶辅助系统中的至少一个。本申请在此不作限制。作为示例而非限定,执行方法的执行主体也可以是应用于该驾驶辅助装置或者驾驶辅助系统的芯片、芯片系统、或处理器等。例如,该芯片可以是传感器、融合模块或者车载处理器等中的芯片。融合模块可以理解为多个模块或者单元组成的一个模块或者单元,或者,融合模 块还可以理解为从多个其它模块获取信息并进行融合,并输出融合信息的模块。
如图3所示,图3中示出的方法300可以包括S310至S320。下面结合图3详细说明方法200中的各个步骤。
S310,确定驾驶员为异常状态。
S320,执行第二处理,该第二处理包括:调整或者更新告警触发条件,和/或,调整或者更新告警等级,其中,该告警触发条件用于触发对该驾驶员告警。
具体的,异常状态包括:该驾驶员的生理异常状态、精神异常状态、注意力异常状态、或者对该第一终端的操作造成影响的异常状态中的至少一个。例如,异常状态可以包括:驾驶员处于酒驾、毒驾、疲劳驾驶、或者处理其它事情(如打电话、捡东西、吸烟等)等异常驾驶状态中的一种或者多种。该异常状态直接会影响驾驶员对第一终端的正常的操作的判断或者控制,会影响驾驶员对该第一终端的控制能力。对于步骤S310的具体过程可以参考上述对于S210描述,为了简洁,这里不再赘述。
在本申请实施例中,第一终端可以为上述各种类型的移动设备。例如汽车、无人机、轮船等。
在S320中,在确定了驾驶员操作移动设备处于异常状态的情况下,可以执行第二处理。其中,第二处理包括:调整或者更新告警触发条件,和/或,调整或者更新告警等级。该告警触发条件用于触发对该驾驶员告警。在本申请实施例中,告警用于提示或警告驾驶员,当前移动设备处于某种危险状态,或者,当前如果执行或不执行某种操作会导致移动设备处于某种危险状态等。例如,移动设备上的操作辅助系统可以调整或者更新预警类功能的告警触发条件或者告警等级等。对于移动设备的操作辅助系统具体描述可以参考方法200中对于操作辅助系统的描述,为了简洁,这里不在赘述。
例如,在本申请实施例中,可以是AD/ADAS等调整或者更新告警触发条件和/或调整告警等级等。
本申请提供的驾驶辅助方法,在检测到驾驶员驾驶移动设备的状态为异常状态时,并不立即触发向驾驶员告警,而是调整或者更新告警触发条件,和/或,调整或者更新告警等级等。在该移动设备满足调整或者更新后的告警触发条件后,才向驾驶员进行告警,从而可以避免产生不必要或者令人反感的告警,提高向驾驶员进行告警的准确性和效率,提高DMS的效率和准确性,降低交通事故的发生率。
应理解,在本申请实施例中,对于不同的异常状态执行的第二处理可以相同或不同,本申请不做限制。例如:检测出轻度疲劳或吸烟对应的第二处理都是提高告警等级;或者,检测出轻度疲劳对应的第二处理为调整告警触发条件并且提高告警等级,而检测出吸烟对应的第二处理为提高告警等级等。
可选的,在本申请一些可能的实现方式中,该调整或者更新告警触发条件,包括:将告警时间调整或更新至早于该驾驶员处于正常状态时的告警时间、或将告警距离调整或更新至大于该驾驶员处于正常状态时的告警距离中的至少一个。
该调整或者更新告警等级,包括:
将告警等级调整或更新至高于该驾驶员处于正常状态时的告警等级;
其中,该正常状态为该驾驶员对该第一终端正常操作的状态。
具体而言,对于告警触发条件而言,可以是利用时间标准触发告警或者利用距离标准 触发告警。对于时间标准而言,在本申请实施例中,可以将告警时间调整至早于该驾驶员处于第二状态时的告警时间。或者,换句话说,将告警时间从驾驶员处于正常状态对应的告警时间(称为第一告警时间)更新至驾驶员处于异常状态对应的告警时间(称为第二告警时间)。即第一告警时间和第二告警时间可以为预先配置好的,根据不同的驾驶员状态可以进行对应的告警时间的更新或者切换。或者,当确定驾驶员为异常状态时,可以在线将第一告警时间调整为第二告警时间,也就是说,可以只配置一个告警时间,根据不同的驾驶员状态进行告警时间的在线调整。类似的,对于告警距离,也可以预先只配置一套告警距离参数,根据不同的驾驶员状态进行告警距离参数的在线调整。或者,可以预先配置多套告警距离参数,根据不同的驾驶员状态可以进行对应的告警距离参数的更新或者切换。
其中,该正常状态为该驾驶员对该第一终端正常操作的状态。换句话说,第二状态不会影响驾驶员对操作移动的设备的正常操作或者控制等。
在本申请实施例中,在确定驾驶员处于异常状态时,可以调整或者更新AD/ADAS等告警类功能告警时间为早于驾驶员处于正常状态的告警时间。下面将以第一终端设备为汽车、并结合具体的例子进行说明。
例如,当驾驶员处于正常状态时,从检测到与前车的距离小于或者等于S米时开始,经过T秒后开始向驾驶员告警跟车太近,需要刹车。而如果驾驶员处于异常状态,并且从检测到与前车的距离小于或者等于S米时,就立即向驾驶员告警跟车太近,需要刹车。即调整或者更新自动刹车的告警时间早于驾驶员处于正常状态时的自动刹车的告警时间。
又例如,当驾驶员处于正常状态时,从检测到车辆偏离目前行驶的车道开始,经过M秒开始向驾驶员告警车辆车道偏离,需要车道保持。而如果驾驶员处于异常状态,在检测到车辆偏离目前行驶的车道开始,就立即开始向驾驶员告警车辆车道偏离,需要车道保持。即调整或者更新车道偏离的告警时间早于驾驶员处于正常状态时的车道偏离的告警时间。
又例如,当驾驶员处于正常状态时,连续驾驶车辆的时间长度大于T1时间长度开始就向驾驶员告警疲劳驾驶,需要休息。而如果驾驶员处于异常状态,连续驾驶车辆的时间长度大于T2时间长度开始就向驾驶员告警疲劳驾驶,需要休息。其中,T2小于T1,即调整或者更新疲劳驾驶的告警时间早于驾驶员处于正常状态时的疲劳驾驶的告警时间。
对于距离标准而言,驾驶员处于不同的状态,可以对应不同的告警距离。可选的,在本申请实施例中,可以调整AD/ADAS等告警类功能告警距离大于驾驶员处于正常状态的告警距离。下面将以第一终端设备为汽车、并结合具体的例子进行说明。
例如,当驾驶员处于正常状态时,与前车的距离小于S米时就开始向驾驶员告警跟车太近,需要刹车,当驾驶员处于异常状态时,与前车的距离小于P米就开始向驾驶员告警跟车太近,需要刹车。P大于S,即调整或者更新自动刹车告警的距离大于驾驶员处于正常状态时的自动刹车告警距离。
又例如,当驾驶员处于正常状态时,检测到车辆距离四周的障碍物的距离小于或者等于L1时,向驾驶员告警,需要注意周围环境。而如果驾驶员处于异常状态,检测到车辆距离四周的障碍物的距离小于或者等于L2时,向驾驶员告警,需要注意周围环境。L2大于L1。即调整或者更新车身障碍物的告警距离大于驾驶员处于正常状态时的车身障碍物的告警距离。
在本申请实施例中,将告警等级调整或者更新至高于该驾驶员处于正常状态时的告警等级,可以理解为在满足的相同告警触发条件下,驾驶员在异常状态先的告警等级高于该驾驶员处于正常状态时的告警等级。
可选的,可以预先只配置一个告警等级,根据不同的驾驶员状态进行告警等级的在线调整。或者,也可以预配置多个告警等级,根据不同的驾驶员状态可以进行对应的告警等级的更新或者切换。
例如,在驾驶员处于正常状态的情况下,与前车的距离为10至20米之间,告警等级为1级,与前车的距离小于10后,告警等级为2级,其中,告警等级2级高于告警等级1级。级数越高,告警力度越大。在驾驶员处于异常状态的情况下,与前车的距离为10至20米之间,告警等级为2级,与前车的距离小于10后,告警等级为3级,其中,告警等级3级高于告警等级2级。
应理解,上述仅仅以移动设备车辆为例进行说明,在本申请实施例中,对于不同的移动设备,调整告警时间、调整告警等级以及调整告警等级还可以存在其它不同的具体实现方式,本申请实施例中对于调整告警时间、调整告警等级以及调整告警等级的具体形式不作任何限制。
还应理解,在本申请实施例中,告警可以包括:视觉、听觉、触觉以及这些方式中的任意几种的组合等告警方式,本申请实施例中对于具体的告警方式不作限制。
在本申请一些可能的实现方式中,如图4所示的,图4是本申请一些实施例中的驾驶辅助方法的示意性流程图,在图3所示的方法步骤的基础上,该方法300还包括:S330和S340。
S330,确定该驾驶员对第一终端的第一操作为异常操作;
S340,执行第一处理,该第一处理包括输出指示信息和/或控制信息,该指示信息或者该控制信息用于指示对该第一终端的第二操作,或者,该第一处理包括控制该第一终端执行第二操作。
图4所示的步骤S310、S320可以参考上述对S310、S320的相关描述,为了简洁,这里不再赘述。
在检测到驾驶员驾驶移动设备的状态为异常状态时,可以调整或者更新告警触发条件,和/或,调整或者更新告警等级。并且,在S330中,会确定驾驶员对该第一终端的操作是否为异常操作,即确定驾驶员对该第一终端的操作是否为误操作。在S340中,在确定了确定驾驶员对该第一终端的操作为异常操作的情况下,会执行第一处理,该第一处理包括输出指示信息和/或控制信息,该指示信息或者该控制信息用于指示对该第一终端的第二操作,或者,该第一处理包括控制该第一终端执行第二操作。
可选的,在本申请实施例中,该第二操作包括:向该驾驶员发出告警、不响应该驾驶员的该第一操作、减轻该第一操作的操作程度、或者提高该第一操作的难度中的至少一个。从而保证驾驶员的安全,避免出现交通事故。
对于S330以及S340的具体描述,可以参考方法200中对于S220和S330的描述,为了简洁,这里不再赘述。
本申请提供的驾驶辅助方法,在检测到驾驶员驾驶移动设备的状态为异常状态时,并不立即触发向驾驶员告警,而是调整或者更新告警触发条件和/或调整告警等级。并且, 进一步的在确定驾驶员对于第一终端的操作为误操作的情况下,才对驾驶员对移动移动设备的操作产生响应或者调整,即执行第一处理。从而可以避免产生不必要或者令人反感的告警,提高向驾驶员进行反馈或者响应的效率和准确性,进一步的降低交通事故的发生率。
可选的,在本申请一些可能的实现方式中,在S330中,确定该驾驶员对第一终端的第一操作为异常操作,包括:确定该第一操作满足以下条件中的至少一个:
对该第一终端的操作变化速率大于或者等于第一阈值;
对该第一终端的操作幅度大于或者等于第二阈值;
来自于第一辅助系统的操作决策所指示的操作与该驾驶员对该第一终端的操作不一致;或者
来自于第二辅助系统的操作信息所指示的操作与该驾驶员对该第一终端的操作不一致。
可选的,在本申请一些可能的实现方式中,该第一操作包括控制该第一终端改变运动状态的操作。
可选的,在本申请一些可能的实现方式中,该第一操作包括:
对该第一终端的加速装置的操作、对该第一终端的制动装置的操作、或者对该第一终端的转向装置的操作中的至少一个。
可选的,在本申请一些可能的实现方式中,该第一辅助系统或者该第二辅助系统包括:AD系统、ADAS、或者包括至少一个驾驶辅助功能的驾驶辅助系统中的至少一个。
该驾驶辅助功能包括:确定该第一终端满足预设条件,以及在满足预设条件时确定改变该第一终端运动状态的功能;和/或,确定该第一终端满足预设条件,以及在满足预设条件时控制该第一终端改变运动状态的功能。
可选的,在本申请一些可能的实现方式中,来自于该第一辅助系统的操作决策所指示的操作,或者,来自于该第二辅助系统的操作信息所指示的操作,包括:
对该第一终端的加速装置的操作、对该第一终端的制动装置的操作、对该第一终端的转向装置的操作中的一个或者多个。
应理解,上述各个可能的实现方式的具体描述可以参考方法200中相关的实施例中的描述,为了简洁,这里不再赘述。
还应理解,上述只是为了帮助本领域技术人员更好地理解本申请实施例,而非要限制本申请实施例的范围。本领域技术人员根据所给出的上述示例,显然可以进行各种等价的修改或变化,例如,上述方法200和方法300的各个实施例中某些步骤可以是不必须的,或者可以新加入某些步骤等。或者上述任意两种或者任意多种实施例的组合。这样的修改、变化或者组合后的方案也落入本申请实施例的范围内。
还应理解,上文对本申请实施例的描述着重于强调各个实施例之间的不同之处,未提到的相同或相似之处可以互相参考,为了简洁,这里不再赘述。
还应理解,上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。
还应理解,本申请实施例中,“预先设定”、“预先定义”可以通过在设备(例如,包括终端和网络设备)中预先保存相应的代码、表格或其他可用于指示相关信息的方式来实现,本申请对于其具体的实现方式不做限定。
还应理解,本申请实施例中的方式、情况、类别以及实施例的划分仅是为了描述的方便,不应构成特别的限定,各种方式、类别、情况以及实施例中的特征在不矛盾的情况下可以相结合。
还应理解,在本申请的各个实施例中,如果没有特殊说明以及逻辑冲突,不同的实施例之间的术语和/或描述具有一致性、且可以相互引用,不同的实施例中的技术特征根据其内在的逻辑关系可以组合形成新的实施例。
以上结合图1至图4对本申请实施例的驾驶辅助方法做了详细说明。以下,结合图5至图13对本申请实施例驾驶辅助装置进行详细说明。
图5示出了本申请实施例的驾驶辅助装置400的示意性框图,该驾驶辅助装置400可以对应上述方法200或者方法300描述的第一终端,也可以是应用于第一终端设备上的芯片、组件、集成电路、传感器、融合模块、车载处理器等中的芯片等。并且,该驾驶辅助装置400中各模块或单元分别用于执行上述方法200或者方法300中所执行的各动作或处理过程。
如图5所示,该驾驶辅助装置400包括处理模块(单元)410,可选的,该驾驶辅助装置还可以包括收发模块(单元)420,收发模块420用于在处理模块410的驱动下执行具体的信号收发。
在一种可能的实现方式中,处理模块410用于:
确定驾驶员为异常状态;
确定该驾驶员对第一终端的第一操作为异常操作;
执行第一处理,该第一处理包括输出指示信息和/或控制信息,该指示信息或者该控制信息用于指示对该第一终端的第二操作,或者,该第一处理包括控制该第一终端执行第二操作。
本申请提供的驾驶辅助装置,在检测到驾驶员驾驶第一终端的状态为异常状态时,并不立即触发向驾驶员告警或者向驾驶员进行其他响应,而是进一步的在确定驾驶员对于第一终端的操作为误操作的情况下,才对驾驶员对移动移动设备的误操作产生响应或者进行调整,即执行第一处理。从而可以避免产生不必要或者令人反感的告警,提高向驾驶员进行反馈或者响应的效率和准确性,进一步的降低交通事故的发生率。
可选的,在本申请的一些实施例中,该处理模块410还用于:
在该第一操作满足以下条件中的至少一个的情况下,确定该第一操作为异常操作:
该确定该驾驶员对第一终端的第一操作为异常操作,包括:确定该第一操作满足以下条件中的至少一个:
对该第一终端的操作变化速率大于或者等于第一阈值;
对该第一终端的操作幅度大于或者等于第二阈值;
来自于第一辅助系统的操作决策所指示的操作与该驾驶员对该第一终端的操作不一致;或者
来自于第二辅助系统的操作信息所指示的操作与该驾驶员对该第一终端的操作不一致。
可选的,在本申请的一些实施例中,该第一操作包括控制该第一终端改变运动状态的操作。
可选的,在本申请的一些实施例中,其特征在于,该第一操作包括:
对该第一终端的加速装置的操作、对该第一终端的制动装置的操作、或者对该第一终端的转向装置的操作中的至少一个。
可选的,在本申请的一些实施例中,该第一辅助系统或者该第二辅助系统包括:自动驾驶AD系统、先进驾驶员辅助系统ADAS、或者包括至少一个驾驶辅助功能的驾驶辅助系统中的至少一个;
其中,该驾驶辅助功能包括:确定该第一终端满足预设条件,以及在满足预设条件时确定改变该第一终端运动状态的功能;和/或,确定该第一终端满足预设条件,以及在满足预设条件时控制该第一终端改变运动状态的功能
可选的,在本申请的一些实施例中,来自于该第一辅助系统的操作决策所指示的操作,或者,来自于该第二辅助系统的操作信息所指示的操作,包括:
对该第一终端的加速装置的操作、对该第一终端的制动装置的操作、对该第一终端的转向装置的操作中的一个或者多个。
可选的,在本申请的一些实施例中,该第二操作包括:
向该驾驶员发出告警、不响应该驾驶员的该第一操作、减轻该第一操作的操作程度、或者提高该第一操作的难度中的至少一个。
可选的,在本申请的一些实施例中,该异常状态包括:该驾驶员的生理异常状态、精神异常状态、注意力异常状态、或者对该第一终端的操作造成影响的异常状态中的至少一个。
在另一种可能的实现方式中,处理模块410用于:
确定驾驶员为异常状态;
执行第二处理,该第二处理包括:调整或者更新告警触发条件,和/或,调整或者更新告警等级,其中,该告警触发条件用于触发对该驾驶员告警。
本申请提供的驾驶辅助装置,在检测到驾驶员驾驶移动设备的状态为异常状态时,并不立即触发向驾驶员告警,而是调整或者更新告警触发条件,和/或,调整或者更新告警等级等。在该移动设备满足调整或者更新后的告警触发条件后,才向驾驶员进行告警,从而可以避免产生不必要或者令人反感的告警,提高向驾驶员进行告警的准确性和效率,提高DMS的效率和准确性,降低交通事故的发生率。
可选的,在本申请的一些实施例中,该处理模块410还用于:
将告警时间调整或更新至早于该驾驶员处于正常状态时的告警时间、将告警距离调整或更新至大于该驾驶员处于正常状态时的告警距离、或者将告警等级调整或更新至高于该驾驶员处于正常状态时的告警等级;
其中,该正常状态为该驾驶员对该第一终端正常操作的状态。
可选的,在本申请的一些实施例中,该异常状态包括:该驾驶员的生理异常状态、精神异常状态、注意力异常状态、或者对该第一终端的操作造成影响的异常状态中的至少一个。
可选的,在本申请的一些实施例中,在该驾驶员处于该异常状态的情况下,该处理模块410还用于:
确定该驾驶员对第一终端的第一操作为异常操作;
执行第一处理,该第一处理包括输出指示信息和/或控制信息,该指示信息或者该控制信息用于指示对该第一终端的第二操作,或者,该第一处理包括控制该第一终端执行第二操作。
可选的,在本申请的一些实施例中,该处理模块410还用于:
在该第一操作满足以下条件中的至少一个的情况下,确定该第一操作为异常操作:
对该第一终端的操作变化速率大于或者等于第一阈值;
对该第一终端的操作幅度大于或者等于第二阈值;
来自于第一辅助系统的操作决策所指示的操作与该驾驶员对该第一终端的操作不一致;或者
来自于第二辅助系统的操作信息所指示的操作与该驾驶员对该第一终端的操作不一致。
可选的,在本申请的一些实施例中,该第一操作包括控制该第一终端改变运动状态的操作。
可选的,在本申请的一些实施例中,该第二操作包括:
向该驾驶员发出告警、不响应该驾驶员的该第一操作、减轻该第一操作的操作程度、或者提高该第一操作的难度中的至少一个。
应理解,驾驶辅助装置400中各模块(单元)执行上述相应步骤的具体过程请参照前文中结合方法200、和方法300以及图2至图4中相关实施例中的描述,为了简洁,这里不加赘述。
可选的,收发模块420可以包括接收模块(单元)和发送模块(单元),用于执行前述方法200和方法300中的各个实施例接收信息和发送信息的步骤。
进一步的,该驾驶辅助装置400还可以该存储模块(单元)。收发模块420可以是收发器、输入/输出接口或接口电路。存储模块用于存储收发模块单元420和处理模块410执行的指令。收发模块420、处理模块510和存储模块相互耦合,存储模块存储指令,处理模块410用于执行存储模块存储的指令,收发模块420用于在处理模块410的驱动下执行具体的信号收发。
应理解,收发模块420可以是收发器、输入/输出接口或接口电路。存储模块可以是存储器。处理模块410可由处理器实现。如图6所示,驾驶辅助装置500可以包括处理器610、存储器620和收发器630。
图5所示的驾驶辅助装置400或图6所示的驾驶辅助装置500能够实现前述方法200、方法300中的实施例以及图2至图4所示的实施例中执行的步骤。类似的描述可以参考前述对应的方法中的描述。为避免重复,这里不再赘述。
还应理解,图5所示的驾驶辅助装置400或图6所示的驾驶辅助装置500可以为集成在第一终端上的驾驶辅助装置、驾驶辅助模块(单元)或者驾驶辅助系统,或者,还可以为第一终端上的芯片或者集成电路,例如,该芯片可以是传感器、融合模块或者车载处理器等中的芯片。融合模块可以包括图5所示的处理模块和收发模块等,或者,还可以是第一终端,该第一终端上集成有上述的芯片或者集成电路等。本申请实施例在此不做限制。
图7示出了本申请实施例提供的另一例驾驶辅助装置600的示意性框图,该驾驶辅助装置400可以对应上述方法200描述的第一终端,也可以是应用于第一终端设备上的芯片、 组件、集成电路、传感器、融合模块、车载处理器等中的芯片等。并且,该驾驶辅助装置600中各模块或单元分别用于执行上述方法200所执行的各动作或处理过程。
如图7所示,该驾驶辅助装置600包括驾驶员检测模块610和误操作判断模块620。
驾驶员检测模块610,用于检测驾驶员的状态;
误操作判断模块620,用于确定该驾驶员对第一终端的操作是否为异常操作;
该误操作判断模块620还用于:在确定驾驶员为异常状态,并且,确定该驾驶员对该第一终端的第一操作为异常操作的情况下,执行第一处理,该第一处理包括输出指示信息和/或控制信息,该指示信息或者该控制信息用于指示对该第一终端的第二操作,或者,该第一处理包括控制该第一终端执行第二操作。
本申请提供的驾驶辅助装置,在检测到驾驶员驾驶第一终端的状态为异常状态时,并不立即触发向驾驶员告警或者向驾驶员进行其他响应,而是进一步的在确定驾驶员对于第一终端的操作为误操作的情况下,才对驾驶员对移动移动设备的误操作产生响应或者进行调整,即执行第一处理。从而可以避免产生不必要或者令人反感的告警,提高向驾驶员进行反馈或者响应的效率和准确性,进一步的降低交通事故的发生率。
可选的,在本申请的一些实施例中,该误操作判断模块620还用于:在该第一操作满足以下条件中的至少一个的情况下,确定该第一操作为异常操作:
对该第一终端的操作变化速率大于或者等于第一阈值;
对该第一终端的操作幅度大于或者等于第二阈值;
来自于第一辅助系统的操作决策所指示的操作与该驾驶员对该第一终端的操作不一致;或者
来自于第二辅助系统的操作信息所指示的操作与该驾驶员对该第一终端的操作不一致。
可选的,在本申请的一些实施例中,该第一操作包括控制该第一终端改变运动状态的操作。
可选的,在本申请的一些实施例中,该第一辅助系统或者该第二辅助系统包括:自动驾驶AD系统、先进驾驶员辅助系统ADAS、或者包括至少一个驾驶辅助功能的驾驶辅助系统中的至少一个;
其中,该驾驶辅助功能包括:确定该第一终端满足预设条件,以及在满足预设条件时确定改变该第一终端运动状态的功能;和/或,确定该第一终端满足预设条件,以及在满足预设条件时控制该第一终端改变运动状态的功能。
可选的,在本申请的一些实施例中,来自于该第一辅助系统的操作决策所指示的操作,或者,来自于该第二辅助系统的操作信息所指示的操作,包括:对该第一终端的加速装置的操作、对该第一终端的制动装置的操作、对该第一终端的转向装置的操作中的一个或者多个。
可选的,在本申请的一些实施例中,如图8所示的,该驾驶辅助装置600还包括:第一辅助系统630和/或第二辅助系统640,该第一辅助系统630或该第二辅助640系统包括该误操作判断模块620,该驾驶员检测模块610包括第一接口,
该驾驶员检测模块610还用于:将该驾驶员的状态信息通过该第一接口发送给该第一辅助系统630或该第二辅助系统640。
可选的,在本申请的一些实施例中,如图9所示的,该驾驶辅助装置600还包括:第一辅助系统630和/或第二辅助系统640,该驾驶员检测模块610包括该误操作判断模块620,
该第一辅助系统630包括第二接口,该第一辅助系统630用于:将该第一辅助系统630的操作决策通过该第二接口发送给该驾驶员检测模块610;和/或
该第二辅助系统640包括第三接口,该第二辅助系统用于:将该第二辅助系统640的操作信息通过该第三接口发送给该驾驶员检测模块610。
可选的,在本申请的一些实施例中,如图10所示的,其特征在于,该驾驶辅助装置600还包括:第一辅助系统630和/或第二辅助系统640,
该驾驶员检测模块610包括第四接口,该驾驶员检测模块610还用于:将该驾驶员的状态信息通过该第四接口发送给该误操作判断模块620;
该第一辅助系统630包括第五接口,该第一辅助系统630用于:将该第一辅助系统630的操作决策通过该第五接口发送给该误操作判断模块620,和/或,该第二辅助系统640包括第六接口,该第二辅助系统640用于:将该第二辅助系统640的操作信息通过该第六接口发送给该误操作判断模块620。
应理解,驾驶辅助装置600中各模块(单元)执行上述相应步骤的具体过程请参照前文中结合方法200中相关实施例中的描述,为了简洁,这里不加赘述。
图11示出了本申请实施例提供的另一例驾驶辅助装置700的示意性框图,该驾驶辅助装置700可以对应上述方法300描述的第一终端,也可以是应用于第一终端设备上的芯片、组件、集成电路、传感器、融合模块或者车载处理器等中的芯片等。并且,该驾驶辅助装置700中各模块或单元分别用于执行上述方法300所执行的各动作或处理过程。
如图11所示,该驾驶辅助装置700包括驾驶员检测模块710和告警调整模块720。
驾驶员检测模块710,用于检测驾驶员的状态;
告警调整模块720,用于在确定驾驶员为异常状态的情况下,执行第二处理,该第二处理包括:调整或者更新告警触发条件,和/或,调整或者更新告警等级,其中,该告警触发条件用于触发对该驾驶员告警。
本申请提供的驾驶辅助装置,在检测到驾驶员驾驶移动设备的状态为异常状态时,并不立即触发向驾驶员告警,而是调整或者更新告警触发条件,和/或,调整或者更新告警等级等。在该移动设备满足调整或者更新后的告警触发条件后,才向驾驶员进行告警,从而可以避免产生不必要或者令人反感的告警,提高向驾驶员进行告警的准确性和效率,提高DMS的效率和准确性,降低交通事故的发生率。
可选的,在本申请的一些实施例中,该告警调整模块720还用于:
将告警时间调整或更新至早于该驾驶员处于正常状态时的告警时间;和/或,
或将告警距离调整或更新至大于该驾驶员处于正常状态时的告警距离;和/或,
将告警等级调整或更新至高于该驾驶员处于正常状态时的告警等级;
其中,该正常状态为该驾驶员对该第一终端正常操作的状态。
可选的,在本申请的一些实施例中,该异常状态包括:该驾驶员的生理异常状态、精神异常状态、注意力异常状态、或者对该第一终端的操作造成影响的异常状态中的至少一个。
可选的,在本申请的一些实施例中,如图12所示的,该驾驶辅助装置700还包括:误操作判断模730,
该误操作判断模块730用于:确定该驾驶员对第一终端的操作是否为异常操作;
在确定该驾驶员为异常状态,并且,确定该驾驶员对该第一终端的第一操作为异常操作的情况下,执行第一处理,该第一处理包括输出指示信息和/或控制信息,该指示信息或者该控制信息用于指示对该第一终端的第二操作,或者,该第一处理包括控制该第一终端执行第二操作。
可选的,在本申请的一些实施例中,
该误操作判断模块730还用于:在该第一操作满足以下条件中的至少一个的情况下,确定该第一操作为异常操作:
对该第一终端的操作变化速率大于或者等于第一阈值;
对该第一终端的操作幅度大于或者等于第二阈值;
来自于第一辅助系统的操作决策所指示的操作与该驾驶员对该第一终端的操作不一致;或者
来自于第二辅助系统的操作信息所指示的操作与该驾驶员对该第一终端的操作不一致。
可选的,在本申请的一些实施例中,该第一操作包括控制该第一终端改变运动状态的操作。
可选的,在本申请的一些实施例中,向该驾驶员发出告警、不响应该驾驶员的该第一操作、减轻该第一操作的操作程度、或者提高该第一操作的难度中的至少一个。
可选的,在本申请的一些实施例中,如图13所示的,该驾驶员检测模710包括第七接口,该驾驶员检测模块710,还用于将该驾驶员的状态信息通过该第七接口发送给该告警调整模块720。
应理解,驾驶辅助装置700中各模块(单元)执行上述相应步骤的具体过程请参照前文中结合方法300中相关实施例中的描述,为了简洁,这里不加赘述。
应理解,本申请实施例中,该处理器可以为中央处理单元(central processing unit,CPU),该处理器还可以是其他通用处理器、数字信号处理器(digital signal processor,DSP)、专用集成电路(application specific integrated circuit,ASIC)、现成可编程门阵列(field programmable gate array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
还应理解,本申请实施例中的存储器可以是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(read-only memory,ROM)、可编程只读存储器(programmable ROM,PROM)、可擦除可编程只读存储器(erasable PROM,EPROM)、电可擦除可编程只读存储器(electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(random access memory,RAM),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的随机存取存储器(random access memory,RAM)可用,例如静态随机存取存储器(static RAM,SRAM)、动态随机存取存储器(DRAM)、同步动态随机存取存储器(synchronous DRAM,SDRAM)、 双倍数据速率同步动态随机存取存储器(double data rate SDRAM,DDR SDRAM)、增强型同步动态随机存取存储器(enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(synchlink DRAM,SLDRAM)和直接内存总线随机存取存储器(direct rambus RAM,DR RAM)。
上述实施例,可以全部或部分地通过软件、硬件、固件或其他任意组合来实现。当使用软件实现时,上述实施例可以全部或部分地以计算机程序产品的形式实现。该计算机程序产品包括一个或多个计算机指令或计算机程序。在计算机上加载或执行该计算机指令或计算机程序时,全部或部分地产生按照本申请实施例的流程或功能。该计算机可以为通用计算机、专用计算机、计算机网络、或者其他可编程装置。该计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,该计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。该计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集合的服务器、数据中心等数据存储设备。该可用介质可以是磁性介质(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质。半导体介质可以是固态硬盘。
本申请实施例还提供了一种计算机可读介质,用于存储计算机程序代码,该计算机程序包括用于执行上述方法200或者方法300中本申请实施例的驾驶辅助方法的指令。该可读介质可以是只读存储器(read-only memory,ROM)或随机存取存储器(random access memory,RAM),本申请实施例对此不做限制。
本申请还提供了一种计算机程序产品,该计算机程序产品包括指令,当该指令被执行时,以该驾驶辅助装置分别执行对应于上述方法200或者方法300中的操作。
本申请实施例还提供了一种系统芯片,该系统芯片包括:处理单元和通信单元,该处理单元,例如可以是处理器,该通信单元例如可以是输入/输出接口、管脚或电路等。该处理单元可执行计算机指令,以使该通信装置内的芯片执行上述本申请实施例提供的任一种驾驶辅助方法。
可选地,上述本申请实施例中提供的任意一种驾驶辅助装置可以包括该系统芯片。
可选地,该计算机指令被存储在存储单元中。
可选地,该存储单元为该芯片内的存储单元,如寄存器、缓存等,该存储单元还可以是该终端内的位于该芯片外部的存储单元,如ROM或可存储静态信息和指令的其他类型的静态存储设备,RAM等。其中,上述任一处提到的处理器,可以是一个CPU,微处理器,ASIC,或一个或多个用于控制上述的驾驶辅助方法的程序执行的集成电路。该处理单元和该存储单元可以解耦,分别设置在不同的物理设备上,通过有线或者无线的方式连接来实现该处理单元和该存储单元的各自的功能,以支持该系统芯片实现上述实施例中的各种功能。或者,该处理单元和该存储器也可以耦合在同一个设备上。
可以理解,本申请实施例中的存储器可以是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(read-only memory,ROM)、可编程只读存储器(programmable ROM,PROM)、可擦除可编程只读存储器(erasable PROM,EPROM)、电可擦除可编程只读存储器(electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(random access memory,RAM), 其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的随机存取存储器(random access memory,RAM)可用,例如静态随机存取存储器(static RAM,SRAM)、动态随机存取存储器(DRAM)、同步动态随机存取存储器(synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(double data rate SDRAM,DDR SDRAM)、增强型同步动态随机存取存储器(enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(synchlink DRAM,SLDRAM)和直接内存总线随机存取存储器(direct rambus RAM,DR RAM)。
在本申请中可能出现的对各种消息/信息/设备/网元/系统/装置/动作/操作/流程/概念等各类客体进行了赋名,可以理解的是,这些具体的名称并不构成对相关客体的限定,所赋名称可随着场景,语境或者使用习惯等因素而变更,对本申请中技术术语的技术含义的理解,应主要从其在技术方案中所体现/执行的功能和技术效果来确定。
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,该单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(read-only memory,ROM)、随机存取。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。

Claims (33)

  1. 一种驾驶辅助方法,其特征在于,包括:
    确定驾驶员为异常状态;
    确定所述驾驶员对第一终端的第一操作为异常操作;
    执行第一处理,所述第一处理包括输出指示信息和/或控制信息,所述指示信息或者所述控制信息用于指示对所述第一终端的第二操作,或者,所述第一处理包括控制所述第一终端执行第二操作。
  2. 根据权利要求1所述的驾驶辅助方法,其特征在于,所述确定所述驾驶员对第一终端的第一操作为异常操作,包括:确定所述第一操作满足以下条件中的至少一个:
    对所述第一终端的操作变化速率大于或者等于第一阈值;
    对所述第一终端的操作幅度大于或者等于第二阈值;
    来自于第一辅助系统的操作决策所指示的操作与所述驾驶员对所述第一终端的操作不一致;或者
    来自于第二辅助系统的操作信息所指示的操作与所述驾驶员对所述第一终端的操作不一致。
  3. 根据权利要求1或2所述的驾驶辅助方法,其特征在于,
    所述第一操作包括控制所述第一终端改变运动状态的操作。
  4. 根据权利要求1至3中任一项所述的驾驶辅助方法,其特征在于,所述第一操作包括:
    对所述第一终端的加速装置的操作、对所述第一终端的制动装置的操作、或者对所述第一终端的转向装置的操作中的至少一个。
  5. 根据权利要求2所述的驾驶辅助方法,其特征在于,
    所述第一辅助系统或者所述第二辅助系统包括:自动驾驶AD系统、先进驾驶员辅助系统ADAS、或者包括至少一个驾驶辅助功能的驾驶辅助系统中的至少一个;
    其中,所述驾驶辅助功能包括:确定所述第一终端满足预设条件,以及在满足预设条件时确定改变所述第一终端运动状态的功能;和/或,确定所述第一终端满足预设条件,以及在满足预设条件时控制所述第一终端改变运动状态的功能。
  6. 根据权利要求2所述的驾驶辅助方法,其特征在于,
    来自于所述第一辅助系统的操作决策所指示的操作,或者,来自于所述第二辅助系统的操作信息所指示的操作,包括:
    对所述第一终端的加速装置的操作、对所述第一终端的制动装置的操作、对所述第一终端的转向装置的操作中的一个或者多个。
  7. 根据权利要求1至6中任一项所述的驾驶辅助方法,其特征在于,所述第二操作包括:
    向所述驾驶员发出告警、不响应所述驾驶员的所述第一操作、减轻所述第一操作的操作程度、或者提高所述第一操作的难度中的至少一个。
  8. 根据权利要求1至7中任一项所述的驾驶辅助方法,其特征在于,
    所述异常状态包括:所述驾驶员的生理异常状态、精神异常状态、注意力异常状态、或者对所述第一终端的操作造成影响的异常状态中的至少一个。
  9. 一种驾驶辅助方法,其特征在于,包括:
    确定驾驶员为异常状态;
    执行第二处理,所述第二处理包括:调整或者更新告警触发条件,和/或,调整或者更新告警等级,其中,所述告警触发条件用于触发对所述驾驶员告警。
  10. 根据权利要求9所述的驾驶辅助方法,其特征在于,
    所述调整或者更新告警触发条件,包括:
    将告警时间调整或更新至早于所述驾驶员处于正常状态时的告警时间、或将告警距离调整或更新至大于所述驾驶员处于正常状态时的告警距离中的至少一个;和/或,
    所述调整或者更新告警等级,包括:
    将告警等级调整或更新至高于所述驾驶员处于正常状态时的告警等级;
    其中,所述正常状态为所述驾驶员对所述第一终端正常操作的状态。
  11. 根据权利要求9或10所述的驾驶辅助方法,其特征在于,
    所述异常状态包括:所述驾驶员的生理异常状态、精神异常状态、注意力异常状态、或者对所述第一终端的操作造成影响的异常状态中的至少一个。
  12. 根据权利要求9至11中任一项所述的驾驶辅助方法,其特征在于,在所述驾驶员处于所述异常状态的情况下,所述方法还包括:
    确定所述驾驶员对第一终端的第一操作为异常操作;
    执行第一处理,所述第一处理包括输出指示信息和/或控制信息,所述指示信息或者所述控制信息用于指示对所述第一终端的第二操作,或者,所述第一处理包括控制所述第一终端执行第二操作。
  13. 根据权利要求12所述的驾驶辅助方法,其特征在于,所述确定所述驾驶员对第一终端的第一操作为异常操作,包括:确定所述第一操作满足以下条件中的至少一个:
    对所述第一终端的操作变化速率大于或者等于第一阈值;
    对所述第一终端的操作幅度大于或者等于第二阈值;
    来自于第一辅助系统的操作决策所指示的操作与所述驾驶员对所述第一终端的操作不一致;或者
    来自于第二辅助系统的操作信息所指示的操作与所述驾驶员对所述第一终端的操作不一致。
  14. 根据权利要求13所述的驾驶辅助方法,其特征在于,
    所述第一操作包括控制所述第一终端改变运动状态的操作。
  15. 根据权利要求12至14中任一项所述的驾驶辅助方法,其特征在于,所述第二操作包括:
    向所述驾驶员发出告警、不响应所述驾驶员的所述第一操作、减轻所述第一操作的操作程度、或者提高所述第一操作的难度中的至少一个。
  16. 一种驾驶辅助装置,其特征在于,包括:处理模块,所述处理模块用于:
    确定驾驶员为异常状态;
    确定所述驾驶员对第一终端的第一操作为异常操作;
    执行第一处理,所述第一处理包括输出指示信息和/或控制信息,所述指示信息或者所述控制信息用于指示对所述第一终端的第二操作,或者,所述第一处理包括控制所述第一终端执行第二操作。
  17. 根据权利要求16所述的驾驶辅助装置,其特征在于,所述处理模块还用于:
    在所述第一操作满足以下条件中的至少一个的情况下,确定所述第一操作为异常操作:
    所述确定所述驾驶员对第一终端的第一操作为异常操作,包括:确定所述第一操作满足以下条件中的至少一个:
    对所述第一终端的操作变化速率大于或者等于第一阈值;
    对所述第一终端的操作幅度大于或者等于第二阈值;
    来自于第一辅助系统的操作决策所指示的操作与所述驾驶员对所述第一终端的操作不一致;或者
    来自于第二辅助系统的操作信息所指示的操作与所述驾驶员对所述第一终端的操作不一致。
  18. 根据权利要求16或17所述的驾驶辅助装置,其特征在于,
    所述第一操作包括控制所述第一终端改变运动状态的操作。
  19. 根据权利要求16至18中任一项所述的驾驶辅助装置,其特征在于,所述第一操作包括:
    对所述第一终端的加速装置的操作、对所述第一终端的制动装置的操作、或者对所述第一终端的转向装置的操作中的至少一个。
  20. 根据权利要求17所述的驾驶辅助装置,其特征在于,
    所述第一辅助系统或者所述第二辅助系统包括:自动驾驶AD系统、先进驾驶员辅助系统ADAS、或者包括至少一个驾驶辅助功能的驾驶辅助系统中的至少一个;
    其中,所述驾驶辅助功能包括:确定所述第一终端满足预设条件,以及在满足预设条件时确定改变所述第一终端运动状态的功能;和/或,确定所述第一终端满足预设条件,以及在满足预设条件时控制所述第一终端改变运动状态的功能。
  21. 根据权利要求17所述的驾驶辅助装置,其特征在于,
    来自于所述第一辅助系统的操作决策所指示的操作,或者,来自于所述第二辅助系统的操作信息所指示的操作,包括:
    对所述第一终端的加速装置的操作、对所述第一终端的制动装置的操作、对所述第一终端的转向装置的操作中的一个或者多个。
  22. 根据权利要求16至21中任一项所述的驾驶辅助装置,其特征在于,所述第二操作包括:
    向所述驾驶员发出告警、不响应所述驾驶员的所述第一操作、减轻所述第一操作的操作程度、或者提高所述第一操作的难度中的至少一个。
  23. 根据权利要求16至22中任一项所述的驾驶辅助装置,其特征在于,
    所述异常状态包括:所述驾驶员的生理异常状态、精神异常状态、注意力异常状态、或者对所述第一终端的操作造成影响的异常状态中的至少一个。
  24. 一种驾驶辅助装置,其特征在于,包括:处理模块,所述处理模块用于:
    确定驾驶员为异常状态;
    执行第二处理,所述第二处理包括:调整或者更新告警触发条件,和/或,调整或者更新告警等级,其中,所述告警触发条件用于触发对所述驾驶员告警。
  25. 根据权利要求24所述的驾驶辅助装置法,其特征在于,所述处理模块还用于:
    将告警时间调整或更新至早于所述驾驶员处于正常状态时的告警时间、将告警距离调整或更新至大于所述驾驶员处于正常状态时的告警距离、或者将告警等级调整或更新至高于所述驾驶员处于正常状态时的告警等级;
    其中,所述正常状态为所述驾驶员对所述第一终端正常操作的状态。
  26. 根据权利要求24或25所述的驾驶辅助装置,其特征在于,
    所述异常状态包括:所述驾驶员的生理异常状态、精神异常状态、注意力异常状态、或者对所述第一终端的操作造成影响的异常状态中的至少一个。
  27. 根据权利要求24至26中任一项所述的驾驶辅助装置,其特征在于,在所述驾驶员处于所述异常状态的情况下,所述处理模块还用于:
    确定所述驾驶员对第一终端的第一操作为异常操作;
    执行第一处理,所述第一处理包括输出指示信息和/或控制信息,所述指示信息或者所述控制信息用于指示对所述第一终端的第二操作,或者,所述第一处理包括控制所述第一终端执行第二操作。
  28. 根据权利要求27所述的驾驶辅助装置,其特征在于,所述处理模块还用于:
    在所述第一操作满足以下条件中的至少一个的情况下,确定所述第一操作为异常操作:
    对所述第一终端的操作变化速率大于或者等于第一阈值;
    对所述第一终端的操作幅度大于或者等于第二阈值;
    来自于第一辅助系统的操作决策所指示的操作与所述驾驶员对所述第一终端的操作不一致;或者
    来自于第二辅助系统的操作信息所指示的操作与所述驾驶员对所述第一终端的操作不一致。
  29. 根据权利要求28所述的驾驶辅助装置,其特征在于,
    所述第一操作包括控制所述第一终端改变运动状态的操作。
  30. 根据权利要求27至29中任一项所述的驾驶辅助装置,其特征在于,所述第二操作包括:
    向所述驾驶员发出告警、不响应所述驾驶员的所述第一操作、减轻所述第一操作的操作程度、或者提高所述第一操作的难度中的至少一个。
  31. 一种驾驶辅助装置,其特征在于,所述驾驶辅助装置包括至少一个处理器,所述至少一个处理器与至少一个存储器耦合:
    所述至少一个处理器,用于执行所述至少一个存储器中存储的计算机程序或指令,以使得所述装置执行如权利要求1至8中任一项所述的驾驶辅助装置方法,或者9至15中任一项所述的驾驶辅助装置方法。
  32. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质中存储有计算机程序或指令,当计算机读取并执行所述计算机程序或指令时,使得计算机执行如权利要 求1至8中任一项所述的驾驶辅助装置方法,或者9至15中任一项所述的驾驶辅助装置方法。
  33. 一种芯片,其特征在于,包括:处理器,用于从存储器中调用并运行计算机程序,使得安装有所述芯片的通信设备执行如权利要求1至8中任一项所述的驾驶辅助装置方法,或者9至15中任一项所述的驾驶辅助装置方法。
PCT/CN2021/077092 2020-03-10 2021-02-20 驾驶辅助方法和驾驶辅助装置 WO2021179889A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP21768730.0A EP4101718A4 (en) 2020-03-10 2021-02-20 DRIVING ASSISTANCE METHOD AND DRIVING ASSISTANCE APPARATUS
US17/940,815 US20230042206A1 (en) 2020-03-10 2022-09-08 Driver assistance method and driver assistance apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010161761.0 2020-03-10
CN202010161761.0A CN113370990A (zh) 2020-03-10 2020-03-10 驾驶辅助方法和驾驶辅助装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/940,815 Continuation US20230042206A1 (en) 2020-03-10 2022-09-08 Driver assistance method and driver assistance apparatus

Publications (1)

Publication Number Publication Date
WO2021179889A1 true WO2021179889A1 (zh) 2021-09-16

Family

ID=77568771

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/077092 WO2021179889A1 (zh) 2020-03-10 2021-02-20 驾驶辅助方法和驾驶辅助装置

Country Status (4)

Country Link
US (1) US20230042206A1 (zh)
EP (1) EP4101718A4 (zh)
CN (1) CN113370990A (zh)
WO (1) WO2021179889A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11858532B2 (en) * 2020-06-04 2024-01-02 Qualcomm Incorporated Gesture-based control for semi-autonomous vehicle

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114802369B (zh) * 2022-05-06 2023-06-16 郑州铁路职业技术学院 一种列车辅助驾驶方法、系统、电子设备和存储介质

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105818817A (zh) * 2015-01-22 2016-08-03 株式会社万都 用于控制车辆的设备和方法
CN107685735A (zh) * 2016-08-04 2018-02-13 丰田自动车株式会社 车辆控制装置
CN108154101A (zh) * 2017-12-21 2018-06-12 江苏东洲物联科技有限公司 一种多参数融合的疲劳驾驶检测系统及方法
EP3456599A1 (en) * 2017-09-18 2019-03-20 The Hi-Tech Robotic Systemz Ltd Monitoring drivers and external environment for vehicles
CN109584507A (zh) * 2018-11-12 2019-04-05 深圳佑驾创新科技有限公司 驾驶行为监测方法、装置、系统、交通工具和存储介质
CN109774470A (zh) * 2017-11-15 2019-05-21 欧姆龙株式会社 旁视判定装置、旁视判定方法及存储介质
CN110371133A (zh) * 2019-06-28 2019-10-25 神龙汽车有限公司 汽车驾驶员疲劳检测系统和方法
CN110393540A (zh) * 2019-07-22 2019-11-01 浙江鸿泉电子科技有限公司 基于司机情绪稳定的提示安全驾驶的方法及装置、系统

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2500690B (en) * 2012-03-30 2015-07-29 Jaguar Land Rover Ltd Driver assistance system
US9493118B1 (en) * 2015-06-24 2016-11-15 Delphi Technologies, Inc. Cognitive driver assist with variable warning for automated vehicles
JP6455456B2 (ja) * 2016-02-16 2019-01-23 トヨタ自動車株式会社 車両制御装置
JP2018020682A (ja) * 2016-08-04 2018-02-08 トヨタ自動車株式会社 車両制御装置
US10467488B2 (en) * 2016-11-21 2019-11-05 TeleLingo Method to analyze attention margin and to prevent inattentive and unsafe driving
JP6597690B2 (ja) * 2017-03-24 2019-10-30 株式会社デンソー 運転支援装置
CN109747656A (zh) * 2017-11-02 2019-05-14 罗曦明 人工智能车辆辅助驾驶方法、装置、设备及存储介质
JP7031469B2 (ja) * 2018-04-20 2022-03-08 マツダ株式会社 ドライバ状態判定装置及び運転支援装置
CN109901574B (zh) * 2019-01-28 2021-08-13 华为技术有限公司 自动驾驶方法及装置

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105818817A (zh) * 2015-01-22 2016-08-03 株式会社万都 用于控制车辆的设备和方法
CN107685735A (zh) * 2016-08-04 2018-02-13 丰田自动车株式会社 车辆控制装置
EP3456599A1 (en) * 2017-09-18 2019-03-20 The Hi-Tech Robotic Systemz Ltd Monitoring drivers and external environment for vehicles
CN109774470A (zh) * 2017-11-15 2019-05-21 欧姆龙株式会社 旁视判定装置、旁视判定方法及存储介质
CN108154101A (zh) * 2017-12-21 2018-06-12 江苏东洲物联科技有限公司 一种多参数融合的疲劳驾驶检测系统及方法
CN109584507A (zh) * 2018-11-12 2019-04-05 深圳佑驾创新科技有限公司 驾驶行为监测方法、装置、系统、交通工具和存储介质
CN110371133A (zh) * 2019-06-28 2019-10-25 神龙汽车有限公司 汽车驾驶员疲劳检测系统和方法
CN110393540A (zh) * 2019-07-22 2019-11-01 浙江鸿泉电子科技有限公司 基于司机情绪稳定的提示安全驾驶的方法及装置、系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4101718A4

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11858532B2 (en) * 2020-06-04 2024-01-02 Qualcomm Incorporated Gesture-based control for semi-autonomous vehicle

Also Published As

Publication number Publication date
US20230042206A1 (en) 2023-02-09
EP4101718A4 (en) 2023-08-02
CN113370990A (zh) 2021-09-10
EP4101718A1 (en) 2022-12-14

Similar Documents

Publication Publication Date Title
US11670175B2 (en) Vehicle operation assistance
US20190004513A1 (en) Driving assistance control apparatus
JP6213282B2 (ja) 運転支援装置
KR102485348B1 (ko) 차량 주행보조기능의 자동제어 장치 및 방법
US10843685B2 (en) Method and system for preventing a following vehicle from driving up on a vehicle driving directly in front and use of the system
WO2021179889A1 (zh) 驾驶辅助方法和驾驶辅助装置
US20150191176A1 (en) Drive assist device
US11351992B2 (en) Method and system for assisting drivers to drive with precaution
EP2767450A1 (en) Lane departure warning system and a method for a lane departure warning system
JP2010039919A (ja) 注意喚起装置
JP2016181032A (ja) 自動走行制御装置及び自動走行制御システム
KR20190105152A (ko) 자율 주행 제어 장치 및 그의 전방차량 출발 알림 방법
KR20150051548A (ko) 운전자의 성향을 반영하는 운전보조시스템 및 그 제어방법
JP2015032291A (ja) 自動走行支援装置
US20190221117A1 (en) Agent cooperation system, agent cooperation method, and non-transitory storage medium
CN111942395A (zh) 车辆以及用于控制车辆的方法
US11912267B2 (en) Collision avoidance system for vehicle interactions
CN116867697A (zh) 辅助驾驶系统对交通事件的物理反馈确认
WO2022258150A1 (en) Computer-implemented method of assisting a driver, computer program product, driving assistance system, and vehicle
JP2018151941A (ja) 作動状態通知システム、車両、作動状態通知方法、及び作動状態通知プログラム
WO2023001068A1 (zh) 一种车辆驾驶方法及装置
US20240101125A1 (en) Information processing device, vehicle, and information processing system
US20240025432A1 (en) Driver assistance system for vehicle
CN116160953A (zh) 车辆的鸣笛控制方法
JP2022047738A (ja) 車両制御装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21768730

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021768730

Country of ref document: EP

Effective date: 20220906

NENP Non-entry into the national phase

Ref country code: DE