CN112164228A - Helmet-free behavior detection method for driving electric vehicle, electronic device and storage medium - Google Patents
Helmet-free behavior detection method for driving electric vehicle, electronic device and storage medium Download PDFInfo
- Publication number
- CN112164228A CN112164228A CN202010966585.8A CN202010966585A CN112164228A CN 112164228 A CN112164228 A CN 112164228A CN 202010966585 A CN202010966585 A CN 202010966585A CN 112164228 A CN112164228 A CN 112164228A
- Authority
- CN
- China
- Prior art keywords
- electric vehicle
- helmet
- wearing
- motor vehicle
- partial image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/017—Detecting movement of traffic to be counted or controlled identifying vehicles
- G08G1/0175—Detecting movement of traffic to be counted or controlled identifying vehicles by photographing vehicles, e.g. when violating traffic rules
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V10/267—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion by performing operations on regions, e.g. growing, shrinking or watersheds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
- G06V20/54—Surveillance or monitoring of activities, e.g. for recognising suspicious objects of traffic, e.g. cars on the road, trains or boats
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/015—Detecting movement of traffic to be counted or controlled with provision for distinguishing between two or more types of vehicles, e.g. between motor-cars and cycles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/07—Target detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/08—Detecting or categorising vehicles
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Emergency Alarm Devices (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention provides a method for detecting the behavior of driving an electric vehicle without wearing a helmet, which comprises the following steps: detecting a non-motor vehicle, namely detecting the non-motor vehicle on the video frame to obtain a non-motor vehicle target area in the image; electric vehicle judgment, namely cutting a non-motor vehicle target area to obtain a first partial image and a second partial image, and classifying the first partial image; and detecting the behavior of wearing the helmet, classifying the second partial image, and if the classification result of the first partial image is that the electric vehicle is used and the classification result of the second partial image is that the helmet is not worn, performing early warning and reminding. The present invention relates to an electronic device and a storage medium for executing a helmet-free behavior detection method for driving an electric vehicle. The invention can be used for an actual road, can accurately distinguish the electric vehicle from the bicycle, realizes the judgment of the wearing of the helmet of a driver, carries out early warning and reminding, and improves the safety of driving the electric vehicle.
Description
Technical Field
The invention relates to the technical field of security monitoring, in particular to a method for detecting the behavior of driving an electric vehicle without wearing a helmet, electronic equipment and a storage medium.
Background
The electric vehicle becomes a vehicle selected by more and more people for daily travel. When the electric bicycle is ridden without a helmet, the electric bicycle is very dangerous, and the head is very seriously injured under the condition of no protection once an accident occurs. Therefore, the helmet can well protect the head and reduce the injury when being worn. But only have the technique that detects to the electric motor car in the existing market, still lack the detection to the action of driver's driving electric motor car not wearing the helmet, and the application scene is mostly prevent that the storage battery car from getting into the elevator, and the application scene is comparatively simple, lacks the detection realization of drive test scene.
Disclosure of Invention
In order to overcome the defects of the prior art, the invention aims to provide a method for detecting the behavior of driving an electric vehicle without wearing a helmet, which can be used for an actual road, can accurately distinguish the electric vehicle from a bicycle and realize the judgment of the wearing of the helmet of a driver.
The invention provides a method for detecting the behavior of driving an electric vehicle without wearing a helmet, which comprises the following steps:
detecting a non-motor vehicle, namely detecting the non-motor vehicle on the video frame to obtain a non-motor vehicle target area in the image;
electric vehicle judgment, namely cutting the non-motor vehicle target area to obtain a first partial image and a second partial image, and classifying the first partial image;
and detecting the helmet wearing behavior, classifying the second partial image, and if the classification result of the first partial image is that the electric vehicle is used and the classification result of the second partial image is that the helmet is not worn, performing early warning and reminding.
Further, in the non-motor vehicle detection step, the video frame is a video frame collected by a camera, the camera is installed above a road, the direction of an optical axis is parallel to the road, and a picture is the back of the electric vehicle.
Further, in the non-motor vehicle detection step, a resnet-yolo target detection neural network is adopted for non-motor vehicle detection.
Further, in the electric vehicle judging step, the non-motor vehicle target area is cut in the longitudinal direction to obtain an upper half portion and a lower half portion, and the images of the lower half portion are classified.
Further, in the electric vehicle judging step, the non-motor vehicle target area is cut by 1/2 of the image height.
Further, in the helmet wearing behavior detection step, the upper half portion image is classified, and if the classification result of the lower half portion image is that the electric vehicle is used and the classification result of the upper half portion image is that the helmet is not worn, early warning reminding is performed.
Further, in the electric vehicle judging step, a resnet-18 neural network is used for classifying the lower half portion image.
Further, in the helmet wearing behavior detection step, the upper half portion image is classified by using a googlenet network.
An electronic device, comprising: a processor;
a memory; and a program, wherein the program is stored in the memory and configured to be executed by the processor, the program comprising instructions for executing a method of detecting a helmet-free behavior of a driving electric vehicle.
A computer-readable storage medium having stored thereon a computer program for executing by a processor a method of detecting a helmet-free behavior of driving an electric vehicle.
Compared with the prior art, the invention has the beneficial effects that:
the invention provides a method for detecting the behavior of driving an electric vehicle without wearing a helmet, which comprises the following steps: detecting a non-motor vehicle, namely detecting the non-motor vehicle on the video frame to obtain a non-motor vehicle target area in the image; electric vehicle judgment, namely cutting a non-motor vehicle target area to obtain a first partial image and a second partial image, and classifying the first partial image; and detecting the behavior of wearing the helmet, classifying the second partial image, and if the classification result of the first partial image is that the electric vehicle is used and the classification result of the second partial image is that the helmet is not worn, performing early warning and reminding. The present invention relates to an electronic device and a storage medium for executing a helmet-free behavior detection method for driving an electric vehicle. The invention can be used for an actual road, can accurately distinguish the electric vehicle from the bicycle, realizes the judgment of the wearing of the helmet of a driver, carries out early warning and reminding, and improves the safety of driving the electric vehicle.
The foregoing description is only an overview of the technical solutions of the present invention, and in order to make the technical solutions of the present invention more clearly understood and to implement them in accordance with the contents of the description, the following detailed description is given with reference to the preferred embodiments of the present invention and the accompanying drawings. The detailed description of the present invention is given in detail by the following examples and the accompanying drawings.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a flow chart of a method for detecting a behavior of driving an electric vehicle without wearing a helmet according to the present invention.
Detailed Description
The present invention will be further described with reference to the accompanying drawings and the detailed description, and it should be noted that any combination of the embodiments or technical features described below can be used to form a new embodiment without conflict.
The method for detecting the behavior of driving the electric vehicle without wearing the helmet, as shown in fig. 1, comprises the following steps:
the camera installation for monitor driving the camera that the electric motor car did not wear the helmet and install in the road top, the optical axis direction is parallel with the road, and the electric motor car back is looked at to the picture.
Detecting the non-motor vehicle, namely acquiring a video frame from the camera, and detecting the non-motor vehicle on the video frame to obtain a non-motor vehicle target area in the image; in this embodiment, a resnet-yolo target detection neural network is used for non-motor vehicle detection, the image is scaled to a size required by network input, for example, 300 × 300, the pixel value is divided by 255 after scaling to perform normalization, the neural network is operated to perform inference, and a network inference result is obtained. The reason why only non-motor vehicle detection is carried out in the step is that in a large image, the characteristics of the bicycle and the electric vehicle are very similar and cannot be distinguished.
And electric vehicle judgment, namely cutting the non-motor vehicle target area to obtain a first partial image and a second partial image, and classifying the first partial image.
The difference between the electric vehicle and the bicycle is that the tail of the electric vehicle is bound to have a recorded registration license plate, so the difference is obvious in the image. Specifically, a non-motor vehicle target area is cut by 1/2 of the height of an image, the lower half part of the image is classified by adopting a resnet-18 neural network, the image is zoomed to the size required by network input, such as 112 × 112, the pixel value is divided by 255 after the image is zoomed to be normalized, the neural network is operated to carry out reasoning, a network reasoning result is obtained, and whether the electric vehicle is the electric vehicle or not is judged.
And detecting the behavior of wearing the helmet, classifying the second partial image, and if the classification result of the first partial image is that the electric vehicle is used and the classification result of the second partial image is that the helmet is not worn, performing early warning and reminding. Specifically, the upper half part of the image is classified by adopting a googlenet network, and whether the helmet is worn or not is judged. And if the classification result of the lower half part of the image is the electric vehicle and the classification result of the upper half part of the image is that the helmet is not worn, early warning reminding is carried out.
It should be understood that the step of determining the electric vehicle and the step of detecting the action of wearing the helmet both use CNN neural networks, and other neural networks may be used instead.
An electronic device, comprising: a processor;
a memory; and a program, wherein the program is stored in the memory and configured to be executed by the processor, the program comprising instructions for executing a method of detecting a helmet-not-worn behavior of a driving electric vehicle.
A computer-readable storage medium having stored thereon a computer program for executing by a processor a method of detecting a helmet-free behavior of driving an electric vehicle.
The invention provides a method for detecting the behavior of driving an electric vehicle without wearing a helmet, which comprises the following steps: detecting a non-motor vehicle, namely detecting the non-motor vehicle on the video frame to obtain a non-motor vehicle target area in the image; electric vehicle judgment, namely cutting a non-motor vehicle target area to obtain a first partial image and a second partial image, and classifying the first partial image; and detecting the behavior of wearing the helmet, classifying the second partial image, and if the classification result of the first partial image is that the electric vehicle is used and the classification result of the second partial image is that the helmet is not worn, performing early warning and reminding. The present invention relates to an electronic device and a storage medium for executing a helmet-free behavior detection method for driving an electric vehicle. The invention can be used for an actual road, can accurately distinguish the electric vehicle from the bicycle, realizes the judgment of the wearing of the helmet of a driver, carries out early warning and reminding, and improves the safety of driving the electric vehicle.
The foregoing is merely a preferred embodiment of the invention and is not intended to limit the invention in any manner; those skilled in the art can readily practice the invention as shown and described in the drawings and detailed description herein; however, those skilled in the art should appreciate that they can readily use the disclosed conception and specific embodiments as a basis for designing or modifying other structures for carrying out the same purposes of the present invention without departing from the scope of the invention as defined by the appended claims; meanwhile, any changes, modifications, and evolutions of the equivalent changes of the above embodiments according to the actual techniques of the present invention are still within the protection scope of the technical solution of the present invention.
Claims (10)
1. The method for detecting the behavior of driving the electric vehicle without wearing the helmet is characterized by comprising the following steps of:
detecting a non-motor vehicle, namely detecting the non-motor vehicle on the video frame to obtain a non-motor vehicle target area in the image;
electric vehicle judgment, namely cutting the non-motor vehicle target area to obtain a first partial image and a second partial image, and classifying the first partial image;
and detecting the helmet wearing behavior, classifying the second partial image, and if the classification result of the first partial image is that the electric vehicle is used and the classification result of the second partial image is that the helmet is not worn, performing early warning and reminding.
2. The behavior detection method of driving an electric vehicle without wearing a helmet according to claim 1, characterized in that: in the non-motor vehicle detection step, the video frame is a video frame collected by a camera, the camera is arranged above a road, the direction of an optical axis is parallel to the road, and a picture is the back of the electric vehicle.
3. The method according to claim 1, wherein in the step of detecting the non-motor vehicle, a resnet-yolo target detection neural network is used for detecting the non-motor vehicle.
4. The behavior detection method of driving an electric vehicle without wearing a helmet according to claim 1, characterized in that: in the electric vehicle judging step, the non-motor vehicle target area is cut in the longitudinal direction to obtain an upper half part and a lower half part, and the lower half part image is classified.
5. The behavior detection method of driving an electric vehicle without wearing a helmet according to claim 4, characterized in that: and in the electric vehicle judging step, the non-motor vehicle target area is cut by 1/2 of the image height.
6. The behavior detection method of driving an electric vehicle without wearing a helmet according to claim 4, characterized in that: in the helmet wearing behavior detection step, the upper half part images are classified, and if the classification result of the lower half part images is that the electric vehicle is used and the classification result of the upper half part images is that the helmet is not worn, early warning reminding is performed.
7. The behavior detection method of driving an electric vehicle without wearing a helmet according to claim 4, characterized in that: and in the electric vehicle judging step, classifying the lower half part of image by adopting a resnet-18 neural network.
8. The behavior detection method of driving an electric vehicle without wearing a helmet according to claim 6, characterized in that: in the helmet wearing behavior detection step, a googlenet network is adopted to classify the upper half part image.
9. An electronic device, characterized by comprising: a processor;
a memory; and a program, wherein the program is stored in the memory and configured to be executed by the processor, the program comprising instructions for carrying out the method of any one of claims 1-8.
10. A computer-readable storage medium having stored thereon a computer program, characterized in that: the computer program is executed by a processor for performing the method according to any of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010966585.8A CN112164228A (en) | 2020-09-15 | 2020-09-15 | Helmet-free behavior detection method for driving electric vehicle, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010966585.8A CN112164228A (en) | 2020-09-15 | 2020-09-15 | Helmet-free behavior detection method for driving electric vehicle, electronic device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112164228A true CN112164228A (en) | 2021-01-01 |
Family
ID=73857528
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010966585.8A Pending CN112164228A (en) | 2020-09-15 | 2020-09-15 | Helmet-free behavior detection method for driving electric vehicle, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112164228A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112926540A (en) * | 2021-04-08 | 2021-06-08 | 天津天地伟业智能安全防范科技有限公司 | Method and device for detecting helmet wearing of two-wheeled vehicle and electronic equipment |
| CN113160575A (en) * | 2021-03-15 | 2021-07-23 | 超级视线科技有限公司 | Traffic violation detection method and system for non-motor vehicles and drivers |
| CN113946214A (en) * | 2021-10-18 | 2022-01-18 | 深圳爱玛智行科技有限公司 | Wearing reminding system and method of intelligent helmet |
| CN115861907A (en) * | 2023-03-02 | 2023-03-28 | 山东华夏高科信息股份有限公司 | Helmet detection method and system |
| CN116957889A (en) * | 2023-09-21 | 2023-10-27 | 深圳市智慧城市通信有限公司 | Multi-source heterogeneous electric bicycle data fusion management system and method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110866479A (en) * | 2019-11-07 | 2020-03-06 | 北京文安智能技术股份有限公司 | Method, device and system for detecting that motorcycle driver does not wear helmet |
| CN111066024A (en) * | 2017-09-22 | 2020-04-24 | 大陆-特韦斯贸易合伙股份公司及两合公司 | Method and device for recognizing lane, driver assistance system and vehicle |
| CN111144273A (en) * | 2019-12-24 | 2020-05-12 | 苏州奥易克斯汽车电子有限公司 | Non-motor vehicle detection method |
| CN111310653A (en) * | 2020-02-13 | 2020-06-19 | 上海眼控科技股份有限公司 | Detection method and device for wearing helmet, computer equipment and storage medium |
-
2020
- 2020-09-15 CN CN202010966585.8A patent/CN112164228A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111066024A (en) * | 2017-09-22 | 2020-04-24 | 大陆-特韦斯贸易合伙股份公司及两合公司 | Method and device for recognizing lane, driver assistance system and vehicle |
| CN110866479A (en) * | 2019-11-07 | 2020-03-06 | 北京文安智能技术股份有限公司 | Method, device and system for detecting that motorcycle driver does not wear helmet |
| CN111144273A (en) * | 2019-12-24 | 2020-05-12 | 苏州奥易克斯汽车电子有限公司 | Non-motor vehicle detection method |
| CN111310653A (en) * | 2020-02-13 | 2020-06-19 | 上海眼控科技股份有限公司 | Detection method and device for wearing helmet, computer equipment and storage medium |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113160575A (en) * | 2021-03-15 | 2021-07-23 | 超级视线科技有限公司 | Traffic violation detection method and system for non-motor vehicles and drivers |
| CN112926540A (en) * | 2021-04-08 | 2021-06-08 | 天津天地伟业智能安全防范科技有限公司 | Method and device for detecting helmet wearing of two-wheeled vehicle and electronic equipment |
| CN113946214A (en) * | 2021-10-18 | 2022-01-18 | 深圳爱玛智行科技有限公司 | Wearing reminding system and method of intelligent helmet |
| CN115861907A (en) * | 2023-03-02 | 2023-03-28 | 山东华夏高科信息股份有限公司 | Helmet detection method and system |
| CN116957889A (en) * | 2023-09-21 | 2023-10-27 | 深圳市智慧城市通信有限公司 | Multi-source heterogeneous electric bicycle data fusion management system and method |
| CN116957889B (en) * | 2023-09-21 | 2024-02-27 | 深圳市智慧城市通信有限公司 | Multi-source heterogeneous electric bicycle data fusion management system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112164228A (en) | Helmet-free behavior detection method for driving electric vehicle, electronic device and storage medium | |
| CN112389448B (en) | Abnormal driving behavior identification method based on vehicle state and driver state | |
| CN110532976B (en) | Fatigue driving detection method and system based on machine learning and multi-feature fusion | |
| CN108399743B (en) | Highway vehicle abnormal behavior detection method based on GPS data | |
| CN105719482A (en) | Dynamic vehicle information collecting device | |
| CN112319491B (en) | Safe driving early warning method and system | |
| CN106585624A (en) | Driver state monitoring method and device | |
| KR20200095383A (en) | Method and device for alerting abnormal driver situation detected by using humans' status recognition via v2v connection | |
| CN101722852A (en) | Driving safety monitoring apparatus and method | |
| SG188578A1 (en) | Vehicle behavior analysis device, vehicle behavior analysis program and drive recorder | |
| CN106530829A (en) | Driver state broadcasting method and device | |
| CN103871200A (en) | Safety warning system and method used for automobile driving | |
| CN109146914B (en) | Drunk driving behavior early warning method for expressway based on video analysis | |
| CN111497799A (en) | Vehicle braking method and device, vehicle and storage medium | |
| CN106600748A (en) | Illegal driving recording method and illegal driving recording apparatus | |
| CN112105537A (en) | Driving risk calculation device and method | |
| US20200094820A1 (en) | Automatically assessing and reducing vehicular incident risk | |
| CN108230717B (en) | Intelligent traffic management system | |
| CN112277940B (en) | Driver state control system based on image information | |
| Ward | The culture of traffic safety in rural America | |
| US20200098206A1 (en) | Automatic real-time detection of vehicular incidents | |
| Singh et al. | Your smartphone can watch the road and you: mobile assistant for inattentive drivers | |
| Gupta et al. | Road accident prevention system using driver’s drowsiness detection by combining eye closure and yawning | |
| JP2005075253A (en) | Accident situation record reporting device | |
| CN112966543B (en) | Vehicle scratch recording method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210101 |
|
| RJ01 | Rejection of invention patent application after publication |