CN111619580A - Driving takeover reminding device and method based on video identification and steering wheel sensor - Google Patents
Driving takeover reminding device and method based on video identification and steering wheel sensor Download PDFInfo
- Publication number
- CN111619580A CN111619580A CN202010307857.3A CN202010307857A CN111619580A CN 111619580 A CN111619580 A CN 111619580A CN 202010307857 A CN202010307857 A CN 202010307857A CN 111619580 A CN111619580 A CN 111619580A
- Authority
- CN
- China
- Prior art keywords
- driver
- steering wheel
- driving
- time
- processing unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 238000012545 processing Methods 0.000 claims abstract description 29
- 230000002159 abnormal effect Effects 0.000 claims abstract description 17
- 230000001815 facial effect Effects 0.000 claims abstract description 8
- 238000004590 computer program Methods 0.000 claims description 4
- 206010039203 Road traffic accident Diseases 0.000 abstract description 6
- 238000005516 engineering process Methods 0.000 description 7
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 239000012141 concentrate Substances 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000036626 alertness Effects 0.000 description 1
- 210000001217 buttock Anatomy 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/0098—Details of control systems ensuring comfort, safety or stability not otherwise provided for
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W50/16—Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/001—Planning or execution of driving tasks
- B60W60/0015—Planning or execution of driving tasks specially adapted for safety
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/001—Planning or execution of driving tasks
- B60W60/0025—Planning or execution of driving tasks specially adapted for specific operations
- B60W60/00259—Surveillance operations
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/007—Emergency override
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/26—Incapacity
Abstract
The invention provides a driving takeover reminding device and method based on video identification and a steering wheel sensor. The device of the invention comprises: the device comprises a touch sensor, an infrared camera, a vibration reminding device, a first processing unit and a second processing unit. The infrared camera acquires a facial image of the driver in real time, and the first processing unit analyzes the image acquired by the infrared camera and judges whether the driver is in a fatigue state. The touch sensor detects the time that the hands of the driver are separated from the steering wheel, and the second processing unit judges whether the driver is in an abnormal driving state or not according to the detected time that the hands of the driver are separated from the steering wheel. And when the driver is in a fatigue state and/or the time of the driver in an abnormal driving state exceeds a set safe time threshold, triggering a vibration reminding device and sending a driving takeover request. The traffic accident caused by the distracted driver or the dozing is avoided, the safety of the driver is improved, and the probability of the traffic accident is reduced.
Description
Technical Field
The invention relates to the technical field of auxiliary driving reminding devices, in particular to a driving takeover reminding device and method based on video identification and a steering wheel sensor.
Background
With the intelligent development of the automobile industry, currently, most automobiles are equipped with auxiliary driving technologies, such as an ACC (adaptive cruise control) technology, a lane keeping technology and the like, the driving pressure of a driver is greatly relieved due to the adoption of the technologies, the driving fatigue is effectively relieved, and the driver can drive the automobile more easily. However, due to the appearance of the technologies, the driving alertness of the driver is greatly reduced, when the driver trusts the auxiliary driving technology too much, the driver can relax completely when driving the automobile, the driving state of the automobile is not concerned, the attention is transferred to other things, and therefore traffic accidents are caused, the safe driving of the automobile on the road is influenced, and great potential safety hazards are caused.
Disclosure of Invention
In light of the above-mentioned technical problems, a driving takeover reminding device and method based on video recognition and a steering wheel sensor are provided. The invention mainly utilizes the video recognition and the steering wheel sensor to trigger the vibration device to remind a driver to take over a running vehicle, thereby avoiding traffic accidents caused by vague or dozing drivers. The device improves the driving safety of the driver and reduces the occurrence probability of traffic accidents.
The technical means adopted by the invention are as follows:
the utility model provides a reminding device is taken over in driving based on video identification and steering wheel inductor, driving take over reminding device and automobile power supply system be connected, include:
the touch sensor is arranged on the automobile steering wheel and used for detecting the time when the hands of a driver are separated from the steering wheel;
the infrared camera is used for acquiring a facial image of a driver in real time;
the vibration reminding device is arranged at the bottom of the driver seat and on the backrest and is used for reminding a driver to take over a running vehicle;
the first processing unit is used for analyzing a face image of the driver and judging whether the driver is in a fatigue state or not according to the face image;
and the second processing unit is used for judging whether the driver is in an abnormal driving state or not according to the detected time that the two hands of the driver are separated from the steering wheel.
Furthermore, the first processing unit is connected with the infrared camera and the vibration reminding device;
when the first processing unit detects that the eyes of a driver are closed or the eyes are not in the driving direction of the automobile, the infrared camera collects images, and the first processing unit triggers the switches of the vibration reminding devices arranged at the bottom of the driver seat and on the backrest.
Further, the second processing unit is connected with the touch sensor and the vibration reminding device;
and when the second processing unit detects that the time for separating the two hands of the driver from the steering wheel exceeds a set threshold value, the second processing unit triggers switches of the vibration reminding devices arranged at the bottom and the backrest of the driver seat.
The invention also provides a driving takeover reminding method based on video identification and a steering wheel sensor, which comprises the following steps:
acquiring a face image of a driver in real time, and judging whether the driver is in a fatigue state according to the face image;
detecting the time that the hands of the driver are separated from the steering wheel, and judging whether the driver is in an abnormal driving state or not according to the time that the hands are separated from the steering wheel;
setting a safety time threshold;
when the driver is in a fatigue state and/or the time of the driver in an abnormal driving state exceeds a set safe time threshold, triggering a vibration reminding device and sending a driving takeover request;
and controlling the vehicle to stop if the driver does not manage the driving after the safe time according to the driving taking-over request.
Further, the step of acquiring a face image of the driver in real time and judging whether the driver is in a fatigue state according to the face image comprises the following steps:
acquiring infrared images of eyes of a driver continuously through an infrared camera;
and when the eyes of the driver in the collected infrared image are closed or the eyes do not watch the driving direction of the automobile, judging that the driver is in a fatigue state.
Further, the step of detecting the time that the hands of the driver are disengaged from the steering wheel and judging whether the driver is in an abnormal driving state according to the time that the hands are disengaged from the steering wheel comprises:
detecting the time when the hands of a driver are separated from a steering wheel through a touch sensor arranged on the automobile steering wheel;
and when the time for separating the hands of the driver from the steering wheel exceeds a set safe time threshold value, judging that the driver is in an abnormal driving state.
Further, the method also comprises the step of closing the vibration reminding device when the driver is in a normal driving state.
Further, the invention also provides a storage medium, which comprises a stored program, wherein when the program runs, the steps of the driving takeover reminding method are executed.
Furthermore, the invention also provides an electronic device, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the steps of the driving takeover reminding method through the computer program.
Compared with the prior art, the invention has the following advantages:
the driving takeover reminding device provided by the invention can be used for judging whether the driver is in the fatigue state or not according to the facial image by acquiring the facial image of the driver in real time, acquiring the facial image of the driver and judging whether the driver is in the fatigue state or not according to the facial image. When the driver is in a fatigue state and/or the time of the driver in an abnormal driving state exceeds a set safe time threshold, triggering a vibration reminding device and sending a driving takeover request; the attention of a driver is ensured to be concentrated when the driver drives the automobile, the driver can pay attention to the road conditions in real time, traffic accidents are avoided, and the method has positive significance for unmanned automobiles.
For the reasons, the invention can be widely popularized in the fields of auxiliary driving reminding devices and the like.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a flow chart of the method of the present invention.
Detailed Description
It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict. The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings.
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of exemplary embodiments according to the invention. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, and it should be understood that when the terms "comprises" and/or "comprising" are used in this specification, they specify the presence of stated features, steps, operations, devices, components, and/or combinations thereof, unless the context clearly indicates otherwise.
The relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise. Meanwhile, it should be understood that the sizes of the respective portions shown in the drawings are not drawn in an actual proportional relationship for the convenience of description. Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate. Any specific values in all examples shown and discussed herein are to be construed as exemplary only and not as limiting. Thus, other examples of the exemplary embodiments may have different values. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
In the description of the present invention, it is to be understood that the orientation or positional relationship indicated by the directional terms such as "front, rear, upper, lower, left, right", "lateral, vertical, horizontal" and "top, bottom", etc., are generally based on the orientation or positional relationship shown in the drawings, and are used for convenience of description and simplicity of description only, and in the absence of any contrary indication, these directional terms are not intended to indicate and imply that the device or element so referred to must have a particular orientation or be constructed and operated in a particular orientation, and therefore should not be considered as limiting the scope of the present invention: the terms "inner and outer" refer to the inner and outer relative to the profile of the respective component itself.
Spatially relative terms, such as "above … …," "above … …," "above … …," "above," and the like, may be used herein for ease of description to describe one device or feature's spatial relationship to another device or feature as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if a device in the figures is turned over, devices described as "above" or "on" other devices or configurations would then be oriented "below" or "under" the other devices or configurations. Thus, the exemplary term "above … …" can include both an orientation of "above … …" and "below … …". The device may be otherwise variously oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly.
It should be noted that the terms "first", "second", and the like are used to define the components, and are only used for convenience of distinguishing the corresponding components, and the terms have no special meanings unless otherwise stated, and therefore, the scope of the present invention should not be construed as being limited.
The invention provides a driving takeover reminding device based on video identification and a steering wheel sensor, which comprises:
the touch sensor is arranged on the automobile steering wheel and used for detecting the time when the hands of a driver are separated from the steering wheel;
the infrared camera is used for acquiring a facial image of a driver in real time; the infrared image collected by the infrared camera can ensure that the eye image of the driver can be still stably obtained under the condition of strong light or dark light.
The vibration reminding device is arranged at the bottom of the driver seat and the backrest (because the cushion is always in contact with the buttocks of the driver in the driving process and is not easy to generate relative displacement, and the contact surface has proper and stable pressure, the vibration device is arranged at the cushion part, so that the vibration reminding device is the first choice; in a preferred embodiment, the vibration alert device employs a vibration mode with an amplitude of 2.2m/s2 and a frequency of 205 Hz.
The first processing unit is used for analyzing a face image of the driver and judging whether the driver is in a fatigue state or not according to the face image;
and the second processing unit is used for judging whether the driver is in an abnormal driving state or not according to the detected time that the two hands of the driver are separated from the steering wheel.
Further, the first processing unit is connected with the infrared camera and the vibration reminding device; when the first processing unit detects that the eyes of a driver are closed or the eyes are not watching the driving direction of the automobile in the image collected by the infrared camera, the first processing unit triggers the switches of the vibration reminding devices arranged at the bottom and the backrest of the driver seat. The vibration of the seat cushion part and the back part is generated to remind a driver to concentrate on driving.
Further, the second processing unit is connected with the touch sensor and the vibration reminding device; and when the second processing unit detects that the time for separating the two hands of the driver from the steering wheel exceeds a set threshold value, the second processing unit triggers switches of the vibration reminding devices arranged at the bottom and the backrest of the driver seat. The vibration of the seat cushion part and the back part is generated to remind a driver to concentrate on driving.
As shown in fig. 1, the present invention provides a driving takeover reminding method based on video identification and a steering wheel sensor, wherein a driving takeover reminding device is connected with an automobile power system, and when an automobile is started, a reminding device system is started, and the method comprises:
acquiring a face image of a driver in real time, and judging whether the driver is in a fatigue state according to the face image; the preferred embodiment of the present invention specifically includes:
acquiring infrared images of eyes of a driver continuously through an infrared camera;
and when the eyes of the driver in the collected infrared image are closed or the eyes do not watch the driving direction of the automobile, judging that the driver is in a fatigue state.
Detecting the time that the hands of the driver are separated from the steering wheel, and judging whether the driver is in an abnormal driving state or not according to the time that the hands are separated from the steering wheel; the preferred embodiment of the present invention specifically includes:
detecting the time when the hands of a driver are separated from a steering wheel through a touch sensor arranged on the automobile steering wheel;
and when the time for separating the hands of the driver from the steering wheel exceeds a set safe time threshold value, judging that the driver is in an abnormal driving state.
Setting a safety time threshold;
when the driver is in a fatigue state and/or the time of the driver in an abnormal driving state exceeds a set safe time threshold, triggering a vibration reminding device and sending a driving takeover request;
and controlling the vehicle to stop if the driver does not manage the driving after the safe time according to the driving taking-over request.
Further, when the driver is in a normal driving state, the vibration reminding device is turned off, the vibration on the driver seat is stopped, and the driver enters the normal driving state.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (9)
1. The utility model provides a reminding device is taken over in driving based on video identification and steering wheel inductor which characterized in that, driving take over reminding device and automobile power supply system be connected, include:
the touch sensor is arranged on the automobile steering wheel and used for detecting the time when the hands of a driver are separated from the steering wheel;
the infrared camera is used for acquiring a facial image of a driver in real time;
the vibration reminding device is arranged at the bottom of the driver seat and on the backrest and is used for reminding a driver to take over a running vehicle;
the first processing unit is used for analyzing a face image of the driver and judging whether the driver is in a fatigue state or not according to the face image;
and the second processing unit is used for judging whether the driver is in an abnormal driving state or not according to the detected time that the two hands of the driver are separated from the steering wheel.
2. The driving takeover reminding device of claim 1, wherein the first processing unit is connected with an infrared camera and a vibration reminding device;
when the first processing unit detects that the eyes of a driver are closed or the eyes are not in the driving direction of the automobile, the infrared camera collects images, and the first processing unit triggers the switches of the vibration reminding devices arranged at the bottom of the driver seat and on the backrest.
3. The driving takeover reminding device of claim 1, wherein the second processing unit is connected with a touch sensor and a vibration reminding device;
and when the second processing unit detects that the time for separating the two hands of the driver from the steering wheel exceeds a set threshold value, the second processing unit triggers switches of the vibration reminding devices arranged at the bottom and the backrest of the driver seat.
4. A driving takeover reminding method based on video identification and a steering wheel sensor is characterized by comprising the following steps:
acquiring a face image of a driver in real time, and judging whether the driver is in a fatigue state according to the face image;
detecting the time that the hands of the driver are separated from the steering wheel, and judging whether the driver is in an abnormal driving state or not according to the time that the hands are separated from the steering wheel;
setting a safety time threshold;
when the driver is in a fatigue state and/or the time of the driver in an abnormal driving state exceeds a set safe time threshold, triggering a vibration reminding device and sending a driving takeover request;
and controlling the vehicle to stop if the driver does not manage the driving after the safe time according to the driving taking-over request.
5. The driving takeover reminding method based on the video recognition and the steering wheel sensor as claimed in claim 4, wherein the step of acquiring the face image of the driver in real time and judging whether the driver is in a fatigue state according to the face image comprises the steps of:
acquiring infrared images of eyes of a driver continuously through an infrared camera;
and when the eyes of the driver in the collected infrared image are closed or the eyes do not watch the driving direction of the automobile, judging that the driver is in a fatigue state.
6. The driving takeover reminding method based on the video recognition and the steering wheel sensor as claimed in claim 4, wherein the step of detecting the time that the hands of the driver are disengaged from the steering wheel and judging whether the driver is in an abnormal driving state or not according to the time that the hands are disengaged from the steering wheel comprises the steps of:
detecting the time when the hands of a driver are separated from a steering wheel through a touch sensor arranged on the automobile steering wheel;
and when the time for separating the hands of the driver from the steering wheel exceeds a set safe time threshold value, judging that the driver is in an abnormal driving state.
7. The video recognition and steering wheel sensor based driving takeover reminding method as claimed in claim 4, further comprising the step of turning off the vibration reminding device when the driver is in a normal driving state.
8. A storage medium comprising a stored program, wherein the program when executed performs the method of any one of claims 4 to 7.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor executes the computer program to perform the method of any one of claims 4 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010307857.3A CN111619580A (en) | 2020-04-17 | 2020-04-17 | Driving takeover reminding device and method based on video identification and steering wheel sensor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010307857.3A CN111619580A (en) | 2020-04-17 | 2020-04-17 | Driving takeover reminding device and method based on video identification and steering wheel sensor |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111619580A true CN111619580A (en) | 2020-09-04 |
Family
ID=72255914
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010307857.3A Pending CN111619580A (en) | 2020-04-17 | 2020-04-17 | Driving takeover reminding device and method based on video identification and steering wheel sensor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111619580A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113085898A (en) * | 2021-04-27 | 2021-07-09 | 宝能(广州)汽车研究院有限公司 | Method for activating application program and automatic driving vehicle |
| CN113734178A (en) * | 2021-09-08 | 2021-12-03 | 一汽奔腾轿车有限公司 | System and method with safe driving assistance function |
| CN114132330A (en) * | 2021-12-17 | 2022-03-04 | 奇瑞新能源汽车股份有限公司 | Method and device for reminding driver of abnormal driving state |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160338632A1 (en) * | 2014-11-24 | 2016-11-24 | Boe Technology Group Co., Ltd. | Vehicle steering wheel |
| CN107585026A (en) * | 2017-07-18 | 2018-01-16 | 成都华科威电子科技有限公司 | A kind of anti-fatigue-driving system |
| CN107657236A (en) * | 2017-09-29 | 2018-02-02 | 厦门知晓物联技术服务有限公司 | Vehicle security drive method for early warning and vehicle-mounted early warning system |
| CN110303884A (en) * | 2019-07-10 | 2019-10-08 | 初速度（苏州）科技有限公司 | A kind of anti-fatigue-driving method, system and device |
| CN110949396A (en) * | 2019-11-21 | 2020-04-03 | 西安芯海微电子科技有限公司 | Method, system, steering wheel, device, equipment and medium for monitoring fatigue driving |
-
2020
- 2020-04-17 CN CN202010307857.3A patent/CN111619580A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160338632A1 (en) * | 2014-11-24 | 2016-11-24 | Boe Technology Group Co., Ltd. | Vehicle steering wheel |
| CN107585026A (en) * | 2017-07-18 | 2018-01-16 | 成都华科威电子科技有限公司 | A kind of anti-fatigue-driving system |
| CN107657236A (en) * | 2017-09-29 | 2018-02-02 | 厦门知晓物联技术服务有限公司 | Vehicle security drive method for early warning and vehicle-mounted early warning system |
| CN110303884A (en) * | 2019-07-10 | 2019-10-08 | 初速度（苏州）科技有限公司 | A kind of anti-fatigue-driving method, system and device |
| CN110949396A (en) * | 2019-11-21 | 2020-04-03 | 西安芯海微电子科技有限公司 | Method, system, steering wheel, device, equipment and medium for monitoring fatigue driving |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113085898A (en) * | 2021-04-27 | 2021-07-09 | 宝能(广州)汽车研究院有限公司 | Method for activating application program and automatic driving vehicle |
| CN113734178A (en) * | 2021-09-08 | 2021-12-03 | 一汽奔腾轿车有限公司 | System and method with safe driving assistance function |
| CN114132330A (en) * | 2021-12-17 | 2022-03-04 | 奇瑞新能源汽车股份有限公司 | Method and device for reminding driver of abnormal driving state |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108205731B (en) | Situation assessment vehicle system | |
| CN111619580A (en) | Driving takeover reminding device and method based on video identification and steering wheel sensor | |
| US8179243B2 (en) | Lane departure warning method and system thereof | |
| US10485468B2 (en) | System and method for assessing arousal level of driver of vehicle that can select manual driving mode or automated driving mode | |
| US20190135291A1 (en) | System and method for controlling vehicle based on condition of driver | |
| JP6369487B2 (en) | Display device | |
| EP3845431A2 (en) | Driver-monitoring system | |
| EP3060434B1 (en) | Responding to in-vehicle environmental conditions | |
| CN112041910A (en) | Information processing apparatus, mobile device, method, and program | |
| CN1802273A (en) | Method and arrangement for controlling vehicular subsystems based on interpreted driver activity | |
| US20100219947A1 (en) | Vehicle-installed display system and control method thereof | |
| CN107284449A (en) | A kind of traffic safety method for early warning and system, automobile, readable storage medium storing program for executing | |
| KR20120119537A (en) | System and method for intelligent monitoring using proximity sensor and in vehicle camera | |
| KR101500016B1 (en) | Lane Departure Warning System | |
| CN104376685A (en) | Fatigue driving preventing vehicle control method | |
| CN110558998A (en) | Automobile fatigue driving detection control method based on ADAS system | |
| CN212541557U (en) | Fatigue-prevention auxiliary device based on automobile data recorder | |
| CN106710145A (en) | Guided driver tiredness prevention method | |
| Ahir et al. | Driver inattention monitoring system: A review | |
| CN111951532A (en) | Fatigue-prevention auxiliary device based on automobile data recorder | |
| EP2343207B1 (en) | Assistance system against sleepiness | |
| Nair et al. | Smart System for Drowsiness and Accident Detection | |
| Bhargava et al. | Drowsiness detection while driving using eye tracking | |
| CN214012153U (en) | Driving management and control system | |
| KR20230074642A (en) | Driver's emergency awareness system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200904 |
|
| RJ01 | Rejection of invention patent application after publication |