CN112957045A - Vehicle driver fatigue monitoring and remote intervention system and method based on 5G - Google Patents
Vehicle driver fatigue monitoring and remote intervention system and method based on 5G Download PDFInfo
- Publication number
- CN112957045A CN112957045A CN202110156436.XA CN202110156436A CN112957045A CN 112957045 A CN112957045 A CN 112957045A CN 202110156436 A CN202110156436 A CN 202110156436A CN 112957045 A CN112957045 A CN 112957045A
- Authority
- CN
- China
- Prior art keywords
- steering wheel
- vehicle
- standard deviation
- microcomputer controller
- lane
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 18
- 238000012544 monitoring process Methods 0.000 title claims abstract description 13
- 238000004088 simulation Methods 0.000 claims description 17
- 238000005070 sampling Methods 0.000 claims description 16
- 230000005540 biological transmission Effects 0.000 claims description 9
- 238000012795 verification Methods 0.000 claims description 4
- 230000000007 visual effect Effects 0.000 claims description 4
- 230000003213 activating effect Effects 0.000 claims description 2
- 206010039203 Road traffic accident Diseases 0.000 abstract description 6
- 238000005516 engineering process Methods 0.000 abstract description 5
- 230000006870 function Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 206010013954 Dysphoria Diseases 0.000 description 1
- 241001282135 Poromitra oscitans Species 0.000 description 1
- 206010048232 Yawning Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000013256 coordination polymer Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000035479 physiological effects, processes and functions Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000036632 reaction speed Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 208000024891 symptom Diseases 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
- A61B5/6893—Cars
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
- B60W2040/0827—Inactivity or incapacity of driver due to sleepiness
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/143—Alarm means
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Veterinary Medicine (AREA)
- Animal Behavior & Ethology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Automation & Control Theory (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Educational Technology (AREA)
- Psychiatry (AREA)
- Psychology (AREA)
- Social Psychology (AREA)
- Hospice & Palliative Care (AREA)
- Human Computer Interaction (AREA)
- Developmental Disabilities (AREA)
- Child & Adolescent Psychology (AREA)
- Mathematical Physics (AREA)
- Physiology (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a vehicle driver fatigue monitoring and remote intervention system and method based on 5G technology, wherein a monocular camera and a steering wheel rotation angle sensor are used for collecting driving condition data of an electric vehicle, a microcomputer controller is used for calculating a lane deviation standard deviation and a steering wheel rotation rate, and a driving fatigue alarm is sent to a driver when the lane deviation standard deviation is larger than or equal to a lane deviation standard deviation threshold value or the steering wheel rotation rate is larger than or equal to a steering wheel rotation rate threshold value; the automobile microcomputer controller counts down the preset time, calculates the lane departure standard deviation and the steering wheel turning rate in the preset time after the countdown is finished, uploads fatigue alarm information to the cloud server through the 5G CPE when the lane departure standard deviation or the steering wheel turning rate is larger than or equal to the corresponding threshold value, controls the vehicle to be in a wire control state, and sends the takeover information to the simulated cockpit for takeover. The invention improves the driving safety and can greatly reduce traffic accidents caused by fatigue.
Description
Technical Field
The invention belongs to the technical field of vehicle driver fatigue monitoring and remote intervention, and particularly relates to a vehicle driver fatigue monitoring and remote intervention system and method based on a 5G technology.
Background
Automobile safety is becoming an issue that people must consider more and more, and fatigue driving has become one of the important causes of traffic safety accidents. Due to driving fatigue, the attention of a driver cannot be concentrated, the reaction speed is reduced, the vehicle handling performance is reduced, and the possibility of traffic accidents is seriously increased. Therefore, the research on the identification and intervention of fatigue driving has important significance for preventing traffic accidents and improving road safety.
The driving fatigue is a phenomenon of physical function degradation caused by continuous driving, and means that the perception ability, the judgment thinking ability and the physical coordination ability of a driver are damaged, thereby causing traffic accidents. Driving fatigue is directly manifested in the driver's physiology and the driving state of the vehicle: under the condition of physiological change, the symptoms are mainly such as delayed hand-foot reaction, eye turbidity, emotional dysphoria and the like, even yawning and eye closing are continuously performed, and the head is lowered when the fatigue is serious; in the vehicle running state, the main power is that the driving frequency of the vehicle is reduced and is different from the current running track. There are studies showing that: under the light fatigue state, the driving ability of the driver can be recovered through proper voice memory or music playing; however, if the driver is in a moderate or even severe fatigue state, the driver should actively intervene and control according to the actual situation to avoid accidents. Therefore, a corresponding safety auxiliary driving system is developed aiming at the driving fatigue, and the real-time identification and active intervention of the state of the driver are realized, so that the safety auxiliary driving system has important practical application value.
The existing active intervention system still depends on a vehicle driver to drive after intervention, however, the driver is still in a fatigue driving state after the system sends out an alarm to remind, and a higher driving risk still exists at the moment.
Disclosure of Invention
Aiming at the defects or improvement requirements of the prior art, the invention provides a vehicle driver fatigue monitoring and remote intervention system and method based on 5G, which fully utilize system equipment such as an automobile microcomputer controller, a monocular camera, a steering wheel corner sensor, a vehicle-mounted display, 5G CPE, a cloud server, a simulation cockpit, a remote visual transmission system and the like, realize the identification of the fatigue state in the driving process, and have the remote operation control capability after fatigue occurs.
To achieve the above object, according to one aspect of the present invention, there is provided a 5G-based vehicle driver fatigue monitoring and remote intervention system, comprising: the system comprises an automobile microcomputer controller, a monocular camera, a steering wheel corner sensor, a vehicle-mounted display, a 5G CPE, a cloud server, a simulation cockpit and a remote visual transmission system;
the automobile microcomputer controller is respectively connected with the steering wheel angle sensor, the vehicle-mounted display, the monocular camera and the cloud server;
the monocular camera is used for collecting lane deviation of a vehicle and sending the lane deviation to the automobile microcomputer controller;
the steering wheel corner sensor is used for collecting the steering wheel corner of the vehicle and sending the steering wheel corner to the automobile microcomputer controller;
the vehicle microcomputer controller is arranged on a vehicle and used for calculating a lane departure standard deviation according to the lane departure amount, calculating a steering wheel turning rate according to the steering wheel turning angle, judging whether the lane departure standard deviation and the steering wheel turning rate meet preset conditions or not, sending fatigue alarm information to a driver through the vehicle-mounted display when the preset conditions are met, counting down the preset time, calculating the lane departure standard deviation and the steering wheel turning rate in the preset time, uploading the fatigue alarm information to the cloud server through the 5G CPE when the lane departure standard deviation and the steering wheel turning rate in the preset time meet the preset drive-by-wire conditions, activating a remote driving function, starting the vehicle function, and transmitting the real vehicle driving view to the simulated driving cabin through the remote vision transmission system, and the cloud server issues takeover information to the simulation cockpit, and the simulation cockpit takes over.
In some alternative embodiments, the preset conditions are:
the lane departure standard deviation is greater than or equal to a lane departure standard deviation threshold, or the steering wheel turning rate is greater than or equal to a steering wheel turning rate threshold.
In some alternative embodiments, the composition is prepared by
Calculating a standard deviation of lane departure SDLP, wherein diRepresenting the value of the position of the lane within the sampling period, davgRepresents the mean of the lane positions within the sampling period, and n represents the number of lane position samples within the analysis sampling period.
In some alternative embodiments, the number of revolutions of the steering wheel over a preset number of degrees within a sample period is recorded as the steering wheel revolution rate.
According to another aspect of the invention, a 5G-based vehicle driver fatigue monitoring and remote intervention method is provided, comprising:
the method comprises the steps that real-time data of vehicle driving conditions collected by a steering wheel angle sensor and a monocular camera are obtained by a vehicle microcomputer controller;
calculating an operation capacity parameter by the automobile microcomputer controller by utilizing the real-time data of the vehicle running condition;
when the automobile microcomputer controller determines that the operation capability parameter does not meet the preset condition, recording the verification request event;
when the automobile microcomputer controller determines that the operation capacity parameter meets the preset condition, the automobile microcomputer controller sends fatigue alarm information to a driver through a vehicle-mounted display;
the automobile microcomputer controller counts down the preset time;
calculating the operation capacity parameter in the preset time by the automobile microcomputer controller by using the real-time data of the vehicle driving condition in the preset time;
when the automobile microcomputer controller determines that the operation capability parameter in the preset time does not meet the preset condition, recording the verification request event;
when the automobile microcomputer controller determines that the operation capability parameter in the preset time meets the preset condition, the automobile microcomputer controller uploads fatigue alarm information to a cloud server through 5G CPE, and simultaneously activates a remote driving function and starts a vehicle line control function;
the cloud server issues takeover information to the simulation cockpit;
and the remote vision transmission system transmits the driving vision of the real vehicle to the simulated cockpit so as to take over by the simulated cockpit.
In some optional embodiments, the real-time data of the driving condition of the vehicle comprises lane departure amount and steering wheel rotation angle.
In some alternative embodiments, the performance parameters include a standard deviation of lane departure and a rate of steering wheel turn.
In some alternative embodiments, the composition is prepared by
Calculating a standard deviation of lane departure SDLP, wherein diRepresenting the value of the position of the lane within the sampling period, davgRepresents the mean of the lane positions within the sampling period, and n represents the number of lane position samples within the analysis sampling period.
In some alternative embodiments, the number of revolutions of the steering wheel over a preset number of degrees within a sample period is recorded as the steering wheel revolution rate.
In some alternative embodiments, the preset conditions are:
the lane departure standard deviation is greater than or equal to a lane departure standard deviation threshold, or the steering wheel turning rate is greater than or equal to a steering wheel turning rate threshold.
In some optional embodiments, the by-wire state is a state of steering-by-wire, throttle, brake, light, handbrake, and gear.
In general, compared with the prior art, the above technical solution contemplated by the present invention can achieve the following beneficial effects:
the invention provides a vehicle driver fatigue monitoring and remote intervention system and method based on 5G technology, which comprises the steps of calculating an operation capability parameter of a driver by acquiring driving condition data of an automobile, and sending fatigue alarm information to the driver when the operation capability parameter meets a preset condition; after the operation capacity parameter of the driver within a plurality of minutes is calculated again after the operation is carried out for a plurality of minutes, and when the operation capacity parameter meets the preset condition, the control right of the vehicle is transferred to the simulation cockpit for remote driving by a security officer by utilizing the characteristic of small 5G delay. The driving condition data of the vehicle can be detected to find out the fatigue of the driver in time, and the fatigue alarm is carried out, so that the driving safety can be improved. Traffic accidents caused by fatigue can be greatly reduced by remote driving intervention based on 5G.
Drawings
FIG. 1 is a schematic diagram of a system architecture according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of a method according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. In addition, the technical features involved in the embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.
Fig. 1 is a schematic structural diagram of a vehicle driver fatigue monitoring and remote intervention system based on 5G technology according to an embodiment of the present invention, including: the system comprises an automobile microcomputer controller, a monocular camera, a steering wheel corner sensor, a vehicle-mounted display, a 5G CPE, a cloud server, a simulation cockpit and a remote visual transmission system;
wherein, the automobile microcomputer controller can be CP 80617; the monocular camera can be MV-CE013-50 GM/GC; the steering wheel angle sensor can be an MLX 90363; the vehicle-mounted display can be SPD-043-AIO; the 5G CPE can be H122-373.
Preferably, the vehicle-mounted display is installed in the middle of a center console of the vehicle to provide information to the driver and is expressed in the form of voice, text image.
As shown in fig. 2, the monocular camera is used for collecting the lane departure amount of the vehicle and sending the lane departure amount to the automobile microcomputer controller;
preferably, a monocular camera is mounted on the front windshield for acquiring the lane departure amount.
The steering wheel corner sensor is used for acquiring the steering wheel corner of the vehicle and sending the steering wheel corner of the vehicle to the automobile microcomputer controller;
preferably, a steering wheel angle sensor is mounted on the steering wheel lever for acquiring the steering wheel angle.
The automobile microcomputer controller is used for calculating a lane departure standard deviation according to the lane departure amount of the vehicle, calculating a steering wheel turning rate according to the steering wheel turning angle of the vehicle, and giving out a driving fatigue alarm to a driver through characters and/or voice of a vehicle-mounted display when the lane departure standard deviation is larger than or equal to a lane departure standard deviation threshold value or the steering wheel turning rate is larger than or equal to a steering wheel turning rate threshold value; when the lane departure standard deviation is smaller than the lane departure standard deviation threshold value and the steering wheel turning rate is smaller than the steering wheel turning rate threshold value, recording the current lane departure standard deviation and the current steering wheel turning rate;
wherein, by
Calculating a standard deviation of lane departure SDLP, wherein diRepresenting the value of the position of the lane within the sampling period, davgRepresents the mean of the lane positions within the sampling period, and n represents the number of lane position samples within the analysis sampling period.
In some alternative embodiments, the number of revolutions of the steering wheel over a preset number of degrees within a sample period is recorded as the steering wheel revolution rate.
The preset degree can be determined according to actual needs, and is preferably 6 ° in the embodiment of the present invention.
The lane departure standard deviation threshold and the steering wheel turning rate threshold can be determined according to actual needs, and the embodiment of the invention is not limited uniquely.
After sending a driving fatigue alarm to a driver, the automobile microcomputer controller counts down the preset time, calculates the lane departure standard deviation and the steering wheel turning rate within the preset time after the countdown is finished, and uploads fatigue alarm information to a cloud server through 5G CPE when the lane departure standard deviation is greater than or equal to a lane departure standard deviation threshold value or the steering wheel turning rate is greater than or equal to a steering wheel turning rate threshold value, and controls the vehicle to be in a wire control state; when the lane departure standard deviation is smaller than a lane departure standard deviation threshold value and the steering wheel turning rate is smaller than a steering wheel turning rate threshold value, recording the lane departure standard deviation and the steering wheel turning rate within the preset time;
the preset time can be determined according to actual needs, and is preferably 3min in the embodiment of the invention.
The cloud server is used for distributing the simulation cockpit through the 5G CPE after receiving fatigue alarm information sent by the automobile microcomputer controller, transmitting a real automobile driving view to the simulation cockpit through the remote vision transmission system, remotely taking over driving by a security guard, and operating remote parts in the simulation cockpit: and the steering, the accelerator and the brake remotely take over and drive the actual road vehicle.
Illustratively, in the embodiment of the present invention, the driving condition data includes a lane departure amount and a steering wheel angle.
The drivability parameters include a standard deviation of lane departure and a rate of steering wheel turn.
The operational capability parameter meeting the preset condition may be that the standard deviation of lane departure is greater than or equal to a threshold standard deviation of lane departure, and the rate of turning of the steering wheel is greater than or equal to a threshold rate of turning of the steering wheel.
When the lane departure standard deviation is larger than or equal to the lane departure standard deviation threshold value or the steering wheel turning rate is larger than or equal to the steering wheel turning rate threshold value, namely any one of the two conditions is met, the data to be verified can be judged to meet the preset condition.
Wherein, vehicle-mounted display generates alarm information and can be: the vehicle-mounted display fatigue driving prompt and warning is generated by the vehicle microcomputer controller and is sent to the vehicle-mounted display, and a user is in a fatigue driving state at present and is required to pay attention to driving.
The vehicle driver fatigue monitoring and remote intervention system based on the 5G technology provided by the embodiment of the invention comprises: the system comprises an automobile microcomputer controller, a monocular camera, a steering wheel corner sensor, a vehicle-mounted display, 5G CPE, a cloud server and a simulation cockpit; the monocular camera and the steering wheel corner sensor are used for acquiring the driving working condition data of the electric automobile and sending the data to the automobile microcomputer controller; the automobile microcomputer controller is used for calculating a lane departure standard deviation and a steering wheel turning rate and sending out a driving fatigue alarm to a driver when the lane departure standard deviation is larger than or equal to a lane departure standard deviation threshold value or the steering wheel turning rate is larger than or equal to a steering wheel turning rate threshold value; the automobile microcomputer controller is also used for counting down the preset time, calculating a lane departure standard deviation and a steering wheel turning rate within the preset time after the counting down is finished, uploading fatigue alarm information to the cloud server through the 5G CPE when the lane departure standard deviation is larger than or equal to a lane departure standard deviation threshold value or the steering wheel turning rate is larger than or equal to a steering wheel turning rate threshold value, and controlling the automobile to be in a wire control state; the cloud server is used for receiving the fatigue alarm information and issuing the takeover information to the simulation cockpit; the simulation cockpit is used for remote driving of a security officer. The fatigue of the driver can be found in time by detecting the driving condition data of the vehicle, and the fatigue alarm is carried out, so that the driving safety is improved. In addition, traffic accidents caused by fatigue can be greatly reduced by remote driving intervention based on 5G.
Although the present invention makes use of the terms of car microcontroller, monocular camera, steering wheel angle sensor, on-board display, cloud server, simulated cockpit, etc., it does not exclude the possibility of using other terms. These terms are used merely to more conveniently describe the nature of the invention and they are to be construed as any additional limitation which is not in accordance with the spirit of the invention.
It should be noted that, according to the implementation requirement, each step/component described in the present application can be divided into more steps/components, and two or more steps/components or partial operations of the steps/components can be combined into new steps/components to achieve the purpose of the present invention.
It will be understood by those skilled in the art that the foregoing is only a preferred embodiment of the present invention, and is not intended to limit the invention, and that any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (10)
1. A5G-based vehicle driver fatigue monitoring and remote intervention system, comprising: the system comprises an automobile microcomputer controller, a monocular camera, a steering wheel corner sensor, a vehicle-mounted display, a 5G CPE, a cloud server, a simulation cockpit and a remote visual transmission system;
the automobile microcomputer controller is respectively connected with the steering wheel angle sensor, the vehicle-mounted display, the monocular camera and the cloud server;
the monocular camera is used for collecting lane deviation of a vehicle and sending the lane deviation to the automobile microcomputer controller;
the steering wheel corner sensor is used for collecting the steering wheel corner of the vehicle and sending the steering wheel corner to the automobile microcomputer controller;
the vehicle microcomputer controller is arranged on a vehicle and used for calculating a lane departure standard deviation according to the lane departure amount, calculating a steering wheel turning rate according to the steering wheel turning angle, judging whether the lane departure standard deviation and the steering wheel turning rate meet preset conditions or not, sending fatigue alarm information to a driver through the vehicle-mounted display when the preset conditions are met, counting down the preset time, calculating the lane departure standard deviation and the steering wheel turning rate in the preset time, uploading the fatigue alarm information to the cloud server through the 5G CPE when the lane departure standard deviation and the steering wheel turning rate in the preset time meet the preset drive-by-wire conditions, activating a remote driving function, starting the vehicle function, and transmitting the real vehicle driving view to the simulated driving cabin through the remote vision transmission system, and the cloud server issues takeover information to the simulation cockpit, and the simulation cockpit takes over.
2. The system according to claim 1, wherein the preset condition is:
the lane departure standard deviation is greater than or equal to a lane departure standard deviation threshold, or the steering wheel turning rate is greater than or equal to a steering wheel turning rate threshold.
3. A system according to claim 1 or 2, characterised by being formed by
Calculating lane departure signAlignment difference SDLP wherein diRepresenting the value of the position of the lane within the sampling period, davgRepresents the mean of the lane positions within the sampling period, and n represents the number of lane position samples within the analysis sampling period.
4. The system of claim 3, wherein the number of revolutions of the steering wheel over a predetermined number of degrees in a recorded sample period is the steering wheel revolution rate.
5. A vehicle driver fatigue monitoring and remote intervention method based on 5G is characterized by comprising the following steps:
the method comprises the steps that real-time data of vehicle driving conditions collected by a steering wheel angle sensor and a monocular camera are obtained by a vehicle microcomputer controller;
calculating an operation capacity parameter by the automobile microcomputer controller by utilizing the real-time data of the vehicle running condition;
when the automobile microcomputer controller determines that the operation capability parameter does not meet the preset condition, recording the verification request event;
when the automobile microcomputer controller determines that the operation capacity parameter meets the preset condition, the automobile microcomputer controller sends fatigue alarm information to a driver through a vehicle-mounted display;
the automobile microcomputer controller counts down the preset time;
calculating the operation capacity parameter in the preset time by the automobile microcomputer controller by using the real-time data of the vehicle driving condition in the preset time;
when the automobile microcomputer controller determines that the operation capability parameter in the preset time does not meet the preset condition, recording the verification request event;
when the automobile microcomputer controller determines that the operation capability parameter in the preset time meets the preset condition, the automobile microcomputer controller uploads fatigue alarm information to a cloud server through 5G CPE, and simultaneously activates a remote driving function and starts a vehicle line control function;
the cloud server issues takeover information to the simulation cockpit;
and the remote vision transmission system transmits the driving vision of the real vehicle to the simulated cockpit so as to take over by the simulated cockpit.
6. The method of claim 5, wherein the real-time data of vehicle driving conditions includes lane departure and steering wheel angle.
7. The method of claim 6, wherein the performance parameters include a standard deviation of lane departure and a rate of steering wheel turn.
8. The method of claim 7, wherein the method is performed by
Calculating a standard deviation of lane departure SDLP, wherein diRepresenting the value of the position of the lane within the sampling period, davgRepresents the mean of the lane positions within the sampling period, and n represents the number of lane position samples within the analysis sampling period.
9. The method of claim 7, wherein the number of revolutions of the steering wheel over a predetermined number of degrees within a recorded sampling period is the rate of revolution of the steering wheel.
10. The method according to claim 7, wherein the preset condition is:
the lane departure standard deviation is greater than or equal to a lane departure standard deviation threshold, or the steering wheel turning rate is greater than or equal to a steering wheel turning rate threshold.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110156436.XA CN112957045A (en) | 2021-02-04 | 2021-02-04 | Vehicle driver fatigue monitoring and remote intervention system and method based on 5G |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110156436.XA CN112957045A (en) | 2021-02-04 | 2021-02-04 | Vehicle driver fatigue monitoring and remote intervention system and method based on 5G |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112957045A true CN112957045A (en) | 2021-06-15 |
Family
ID=76274003
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110156436.XA Pending CN112957045A (en) | 2021-02-04 | 2021-02-04 | Vehicle driver fatigue monitoring and remote intervention system and method based on 5G |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112957045A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113682316A (en) * | 2021-08-24 | 2021-11-23 | 武汉理工大学 | Method for monitoring deviation state data in vehicle driving behaviors |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109002817A (en) * | 2018-08-31 | 2018-12-14 | 武汉理工大学 | Adapter tube performance monitoring early warning system based on automatic driving vehicle driving fatigue temporal behavior |
| CN112270808A (en) * | 2020-10-23 | 2021-01-26 | 湖南行必达网联科技有限公司 | Fatigue driving prevention method and device and vehicle |
| CN112286166A (en) * | 2020-10-12 | 2021-01-29 | 上海交通大学 | Vehicle remote driving control system and method based on 5G network |
-
2021
- 2021-02-04 CN CN202110156436.XA patent/CN112957045A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109002817A (en) * | 2018-08-31 | 2018-12-14 | 武汉理工大学 | Adapter tube performance monitoring early warning system based on automatic driving vehicle driving fatigue temporal behavior |
| CN112286166A (en) * | 2020-10-12 | 2021-01-29 | 上海交通大学 | Vehicle remote driving control system and method based on 5G network |
| CN112270808A (en) * | 2020-10-23 | 2021-01-26 | 湖南行必达网联科技有限公司 | Fatigue driving prevention method and device and vehicle |
Non-Patent Citations (1)
| Title |
|---|
| ZHANG HUI, ET AL: "Sensitivity of Lane Position and Steering Angle Measurements to Driver Fatigue", TRANSPORTATION RESEARCH RECORD JOURNAL OF THE TRANSPORTATION RESEARCH BOARD, vol. 2585, no. 1, pages 1 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113682316A (en) * | 2021-08-24 | 2021-11-23 | 武汉理工大学 | Method for monitoring deviation state data in vehicle driving behaviors |
| CN113682316B (en) * | 2021-08-24 | 2024-01-02 | 武汉理工大学 | Method for monitoring deviation data in driving behavior of vehicle |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019144511A1 (en) | Intelligent transportation safety pre-warning method, cloud server, vehicle-mounted terminal and system | |
| CN105599773B (en) | A kind of driver status suggestion device and its method based on moving attitude of vehicle | |
| CN107139919B (en) | Self-protection method for vehicle anti-rear collision early warning | |
| EP2678206B1 (en) | System and method for in-vehicle operator training | |
| CN110083109B (en) | Unmanned vehicle remote control system and method thereof | |
| EP2763879B1 (en) | Method for activating a driver assistance system | |
| CN107618512A (en) | Driving behavior safe evaluation method based on people's car environment multi-data source | |
| WO2022057728A1 (en) | Automated driving method, ads and automated driving vehicle | |
| WO2022183808A1 (en) | Chassis-by-wire cyber physical system in intelligent traffic environment, and control method | |
| CN103065501A (en) | Automobile lane changing early-warning method and lane changing early-warning system | |
| CN110588656A (en) | Self-adaptive kinetic energy recovery method and system based on road and road condition information | |
| CN103010213A (en) | Control method and control system for vehicle cruise | |
| CN114030475A (en) | Vehicle driving assisting method and device, vehicle and storage medium | |
| CN109927720A (en) | A kind of dynamic brake auxiliary control method, apparatus and system | |
| CN112957045A (en) | Vehicle driver fatigue monitoring and remote intervention system and method based on 5G | |
| CN112874515A (en) | System and method for carrying out safety reminding on driving assistance system by using driving posture | |
| CN110021192A (en) | Deviation alarm method, intelligent alarm device and vehicle | |
| CN107719368A (en) | A kind of Lane Departure Warning System and its control method | |
| CN106494409A (en) | Based on AR augmented realities and the drive assist system of the wagon control of big data | |
| DE102021207546A1 (en) | Method and device for controlling autonomous driving | |
| CN111243291B (en) | Method for early warning vehicles behind traffic abnormal points on sharp-curved highway sections | |
| CN111959508A (en) | Driving assistance system based on artificial intelligence | |
| CN207416817U (en) | Driver's defense driving efficiency judgement system and vehicle | |
| CN115782782A (en) | Mirror image digital twinning device and method for intelligent networking automobile dynamic behavior | |
| CN115649145A (en) | Intelligent automobile steering and braking self-adaptive coordination control system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210615 |
|
| RJ01 | Rejection of invention patent application after publication |