CN111178171A - Pedestrian detection spike system based on monocular camera - Google Patents
Pedestrian detection spike system based on monocular camera Download PDFInfo
- Publication number
- CN111178171A CN111178171A CN201911284167.4A CN201911284167A CN111178171A CN 111178171 A CN111178171 A CN 111178171A CN 201911284167 A CN201911284167 A CN 201911284167A CN 111178171 A CN111178171 A CN 111178171A
- Authority
- CN
- China
- Prior art keywords
- spike
- detection
- monocular camera
- pedestrian
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 46
- 238000012545 processing Methods 0.000 claims abstract description 17
- 238000004891 communication Methods 0.000 claims abstract description 12
- 230000006855 networking Effects 0.000 claims abstract description 7
- GELKBWJHTRAYNV-UHFFFAOYSA-K lithium iron phosphate Chemical compound [Li+].[Fe+2].[O-]P([O-])([O-])=O GELKBWJHTRAYNV-UHFFFAOYSA-K 0.000 claims description 5
- 229910021421 monocrystalline silicon Inorganic materials 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 3
- 238000010191 image analysis Methods 0.000 claims description 3
- 239000000463 material Substances 0.000 claims description 3
- 230000000007 visual effect Effects 0.000 claims description 3
- 238000012423 maintenance Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 229910021420 polycrystalline silicon Inorganic materials 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000000034 method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- HBBGRARXTFLTSG-UHFFFAOYSA-N Lithium ion Chemical group [Li+] HBBGRARXTFLTSG-UHFFFAOYSA-N 0.000 description 1
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000004146 energy storage Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 229910001416 lithium ion Inorganic materials 0.000 description 1
- 230000003446 memory effect Effects 0.000 description 1
- 230000004297 night vision Effects 0.000 description 1
- 239000007774 positive electrode material Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- E—FIXED CONSTRUCTIONS
- E01—CONSTRUCTION OF ROADS, RAILWAYS, OR BRIDGES
- E01F—ADDITIONAL WORK, SUCH AS EQUIPPING ROADS OR THE CONSTRUCTION OF PLATFORMS, HELICOPTER LANDING STAGES, SIGNS, SNOW FENCES, OR THE LIKE
- E01F9/00—Arrangement of road signs or traffic signals; Arrangements for enforcing caution
- E01F9/50—Road surface markings; Kerbs or road edgings, specially adapted for alerting road users
- E01F9/553—Low discrete bodies, e.g. marking blocks, studs or flexible vehicle-striking members
- E01F9/559—Low discrete bodies, e.g. marking blocks, studs or flexible vehicle-striking members illuminated
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
- G06V20/54—Surveillance or monitoring of activities, e.g. for recognising suspicious objects of traffic, e.g. cars on the road, trains or boats
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/08—Detecting or categorising vehicles
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Architecture (AREA)
- Civil Engineering (AREA)
- Structural Engineering (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention relates to a pedestrian detection spike system based on a monocular camera, and belongs to the field of pedestrian detection. The system comprises a spike shell, an LED light source module, a solar power supply module, a zigbee communication module, a monocular camera and an MCU processing module; the spike shell takes every 50 spike nodes as a detection group and is arranged on two sides of a road crossed by pedestrians, the spike shell adopts a solar power supply module, and energy is stored through sunlight and road light charging; and each group of spike shells are communicated in real time by adopting zigbee networking, and light signals are synchronously controlled. The invention provides a solar energy LED detection lamp, which can reduce the cost and the equipment maintenance. When the pedestrian is detected, the pedestrian and the automobile can be warned simultaneously through the flashing light, and the collision is effectively avoided.
Description
Technical Field
The invention belongs to the field of pedestrian detection, and relates to a pedestrian detection spike system based on a monocular camera.
Background
Current pedestrian collision avoidance mainly employs automotive self-induction systems, such as: the method is characterized in that the track of the automobile and the pedestrian is predicted to carry out early warning, people are located by collecting images in front of the automobile to carry out prediction, and a distance measuring radar, a physical anti-collision device and the like are installed in front of the automobile.
However, the anti-collision device in the existing scheme has a complex structure, only equipment of the automobile participates in detection and early warning activities in the execution process, the information source is single, once the equipment fails to be detected in a short period of failure, the early warning task cannot be completed, and meanwhile, the single equipment also has blind spot risks.
Secondly, because the feedback information in front of the automobile mainly comprises a large number of dynamic images of pedestrians and a large number of calculations are carried out on the automobile and the pedestrians, the processing speed is low; and the physical equipment needs to be maintained regularly, and the maintenance requirement is higher and the cost is high.
In addition, the automobile self-induction device can effectively prevent collision on the social level only by equipping each automobile, and the universality is low. In addition, different automobile installation devices have difference, and the operability is lower.
Therefore, the invention provides a novel and effective pedestrian detection spike system which can avoid blind spots and failure risks, remind a driver of paying attention to pedestrians ahead in time at lower cost and guarantee driving safety.
Disclosure of Invention
In view of this, the present invention provides a pedestrian detection spike system based on a monocular camera, which solves the problem of collision avoidance of pedestrians in automobiles, reminds a driver to pay attention to pedestrians ahead, and ensures driving safety.
In order to achieve the purpose, the invention provides the following technical scheme:
the pedestrian detection spike system based on the monocular camera comprises a spike shell, an LED light source module, a solar power supply module, a zigbee communication module, the monocular camera and an MCU processing module;
the spike shell takes every 50 spike nodes as a detection group and is arranged on two sides of a road crossed by pedestrians, the spike shell adopts a solar power supply module, and energy is stored through sunlight and road light charging;
each group of spike shells are communicated in real time by adopting zigbee networking, and light signals are synchronously controlled;
the monocular camera transmits image signals of a road to the MCU processing module, the MCU processing module judges whether pedestrians are around or in the road through image analysis, transmits corresponding lamp hole signals to the whole detection group through zigbee, and sends out corresponding lamp hole signals; if one or more spikes in the detection group detect the existence of a pedestrian, the spike shell in the detection group flashes red light; otherwise, no light is emitted.
Optionally, the distance between the spike shells is 5m, the covering angle of the monocular camera is 90 degrees, and the visual radius is 8 m.
Optionally, the rechargeable battery in the solar power supply module is a lithium iron phosphate battery, and the rated capacity is 5000 mA; the material is a monocrystalline silicon electric plate.
Optionally, the LED light source module adopts 3 LED lamp tubes, and a yellow reflector is covered beside the LED lamp tubes.
Optionally, the MCU processing module performs detection and identification every 2s, the zigbee communication module performs communication every 2s, and each spike node broadcasts its own detection result in sequence at a speed of 2ms and receives the transmission information of the remaining 49 spike nodes; if the spike nodes and the rest 49 spike nodes do not detect pedestrians, the detection is continued, otherwise, the LED light source is controlled to flicker red light signals until all the nodes do not detect pedestrians in the subsequent detection.
The invention has the beneficial effects that:
1. simple structure, convenient installation, no need of cable, solar energy power supply
2. Through the design of the multi-channel nail node, the sidelines on two sides of the road can be completely covered without dead angles. When the pedestrian approaches or crosses the boundary line of the highway, the pedestrian can give an alarm in time to remind a driver of safe driving.
3. And zigbee networking is adopted, so that the communication is efficient and the power consumption is low.
4. The traffic accidents caused by the fact that the pedestrians cross the road and the drivers do not observe timely can be effectively reduced.
Additional advantages, objects, and features of the invention will be set forth in part in the description which follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or may be learned from practice of the invention. The objectives and other advantages of the invention may be realized and attained by the means of the instrumentalities and combinations particularly pointed out hereinafter.
Drawings
For the purposes of promoting a better understanding of the objects, aspects and advantages of the invention, reference will now be made to the following detailed description taken in conjunction with the accompanying drawings in which:
FIG. 1 is a block diagram of the present system;
FIG. 2 is a working diagram of spike node placement on a highway;
FIG. 3 is a diagram illustrating pedestrian detection effects;
FIG. 4 is an illustration of a spike housing;
FIG. 5 is a second illustration of the spike housing;
fig. 6 is a system work flow diagram.
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention in a schematic way, and the features in the following embodiments and examples may be combined with each other without conflict.
Wherein the showings are for the purpose of illustrating the invention only and not for the purpose of limiting the same, and in which there is shown by way of illustration only and not in the drawings in which there is no intention to limit the invention thereto; to better illustrate the embodiments of the present invention, some parts of the drawings may be omitted, enlarged or reduced, and do not represent the size of an actual product; it will be understood by those skilled in the art that certain well-known structures in the drawings and descriptions thereof may be omitted.
The same or similar reference numerals in the drawings of the embodiments of the present invention correspond to the same or similar components; in the description of the present invention, it should be understood that if there is an orientation or positional relationship indicated by terms such as "upper", "lower", "left", "right", "front", "rear", etc., based on the orientation or positional relationship shown in the drawings, it is only for convenience of description and simplification of description, but it is not an indication or suggestion that the referred device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and therefore, the terms describing the positional relationship in the drawings are only used for illustrative purposes, and are not to be construed as limiting the present invention, and the specific meaning of the terms may be understood by those skilled in the art according to specific situations.
The invention provides a novel pedestrian detection spike system, which mainly comprises the following components: the device comprises a spike shell, an LED light source module, a solar power supply module, a zigbee communication module, a monocular camera and an MCU processing module.
Every 50 spike nodes are used as a detection group in the system, the spike nodes are arranged on two sides of a road which is easy to cross pedestrians, a spike body adopts a solar power supply module, and the spike body can be charged and stored with energy through sunlight and road light and also can work at night. And each group of spikes is communicated in real time by a zigbee networking, so that light signals can be synchronously controlled. The monocular camera transmits image signals of the road to the MCU processing module, the MCU processing module judges whether pedestrians are around or in the road through image analysis, transmits corresponding lamp hole signals to the whole detection group through the zigbee, and sends out the corresponding lamp hole signals. If one or more spikes in the detection group detect the existence of the pedestrian, the spikes in the group flash red light synchronously. Otherwise, no light is emitted.
The structural block diagram of the system is shown in FIG. 1.
The operation of the spike system is schematically shown in fig. 2-3.
The distance between nodes of the single-side road is 5m, the covering angle of the camera is 90 degrees, the visible radius is 8m, a detection system formed by the spikes can completely cover the boundary of the road, and when pedestrians approach or cross the boundary of the road, light signals can be triggered.
FIG. 4 is an illustration of a spike housing; FIG. 5 is a second illustration of the spike housing;
1. zigbee communication module description
By using the Zigbee low-power module, the Zigbee low-power module is particularly suitable for systems with ultra-low power consumption requirements. The short transition time between the operating modes further ensures low energy consumption.
The module is controlled by the MCU, networking can be formed at 50 nodes, and when a lamp hole signal needs to be sent, the MCU sends a control command to other nodes in the group through the module.
2. Description of Power supply Module
The solar panel material selected by the invention is a monocrystalline silicon electric plate, and the color is black. Monocrystalline silicon not only has strong absorption power in a strong light environment, but also can be absorbed in a weak light environment, weak light (such as rainy days) is much stronger than the charging effect of polycrystalline silicon, and the cost of monocrystalline silicon is higher than that of polycrystalline silicon and is higher than that of polycrystalline silicon.
The rechargeable battery selected by the invention is a lithium iron phosphate battery, and the rated capacity can reach 5000 mA. The lithium iron phosphate battery is a lithium ion battery using lithium iron phosphate as a positive electrode material, has a series of unique advantages of high working voltage, high energy density, long cycle life, small self-discharge rate, no memory effect, environmental friendliness and the like, supports stepless expansion, and is suitable for large-scale electric energy storage.
3. LED light source module
The spike light source adopts 3 red LED fluorescent tubes, and the fluorescent tube is covered with yellow reflector panel next door. At night, if the spike node does not send out a light signal, the spike reflects yellow light under the irradiation of the street lamp and the vehicle lamp, and sends out a red light flashing signal when the light signal is sent out.
4. Description of MCU processing Module
The module adopts a low-power processing chip, and can quickly analyze images and identify pedestrians. The module is responsible for timing, image processing and signal control and is the main control part of the node.
5. Monocular camera
The monocular camera disclosed by the invention has infrared night vision capability and can sense clear image signals at night. The monocular camera is responsible for monitoring road conditions in real time and transmitting image signals to the MCU processing module for pedestrian identification. The shortest monitoring radius of the monocular camera is 8m, and the visual angle is not less than 90 degrees.
Because each node in the system takes on the role of pedestrian detection, all the nodes need to be synchronously calibrated when the system works. The system carries out detection identification and communication once every 2s, each node broadcasts the detection result of the node in turn at a very fast speed (2ms), and receives the transmission information of the other 49 nodes. If the node and the rest 49 nodes do not detect the pedestrians, the detection is continued, otherwise, the LED light source is controlled to flicker the red light signal until all the nodes do not detect the pedestrians in the subsequent detection.
The system work flow diagram is shown in fig. 6.
According to the invention, the automobile is not subjected to anti-collision design, the detection equipment is arranged in the spike for linkage detection, once one spike is detected, the road section is subjected to flashing warning, so that the risk caused by equipment failure can be effectively avoided, and meanwhile, the blind spot risk can be effectively avoided due to more spikes.
In addition, the invention provides the solar energy to supply energy to the LED detection lamp, so that the cost can be reduced, and the equipment maintenance can be reduced. When the pedestrian is detected, the pedestrian and the automobile can be warned simultaneously through the flashing light, and the collision is effectively avoided. And zigbee networking is adopted, so that the communication is efficient, and the power consumption is low.
Finally, the above embodiments are only intended to illustrate the technical solutions of the present invention and not to limit the present invention, and although the present invention has been described in detail with reference to the preferred embodiments, it will be understood by those skilled in the art that modifications or equivalent substitutions may be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions, and all of them should be covered by the claims of the present invention.
Claims (5)
1. Pedestrian detects spike system based on monocular camera, its characterized in that: the device comprises a spike shell, an LED light source module, a solar power supply module, a zigbee communication module, a monocular camera and an MCU processing module;
the spike shell takes every 50 spike nodes as a detection group and is arranged on two sides of a road crossed by pedestrians, the spike shell adopts a solar power supply module, and energy is stored through sunlight and road light charging;
each group of spike shells are communicated in real time by adopting zigbee networking, and light signals are synchronously controlled;
the monocular camera transmits image signals of a road to the MCU processing module, the MCU processing module judges whether pedestrians are around or in the road through image analysis, transmits corresponding lamp hole signals to the whole detection group through zigbee, and sends out corresponding lamp hole signals; if one or more spikes in the detection group detect the existence of a pedestrian, the spike shell in the detection group flashes red light; otherwise, no light is emitted.
2. The monocular camera-based pedestrian detection spike system of claim 1, wherein: the spike shell interval is 5m, the monocular camera cover angle is 90 degrees, and the visual radius is 8 m.
3. The monocular camera-based pedestrian detection spike system of claim 1, wherein: the rechargeable battery in the solar power supply module is a lithium iron phosphate battery with the rated capacity of 5000 mA; the material is a monocrystalline silicon electric plate.
4. The monocular camera-based pedestrian detection spike system of claim 1, wherein: the LED light source module adopts 3 LED lamp tubes, and a yellow reflecting plate covers beside the LED lamp tubes.
5. The monocular camera-based pedestrian detection spike system of claim 1, wherein: the MCU processing module carries out detection and identification once every 2s, the zigbee communication module carries out communication once every 2s, and each spike node broadcasts the detection result of the spike node in sequence at the speed of 2ms and receives the transmission information of the other 49 spike nodes; if the spike nodes and the rest 49 spike nodes do not detect pedestrians, the detection is continued, otherwise, the LED light source is controlled to flicker red light signals until all the nodes do not detect pedestrians in the subsequent detection.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911284167.4A CN111178171A (en) | 2019-12-13 | 2019-12-13 | Pedestrian detection spike system based on monocular camera |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911284167.4A CN111178171A (en) | 2019-12-13 | 2019-12-13 | Pedestrian detection spike system based on monocular camera |
Publications (1)
Publication Number | Publication Date |
---|---|
CN111178171A true CN111178171A (en) | 2020-05-19 |
Family
ID=70651974
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911284167.4A Pending CN111178171A (en) | 2019-12-13 | 2019-12-13 | Pedestrian detection spike system based on monocular camera |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111178171A (en) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN201627149U (en) * | 2009-06-10 | 2010-11-10 | 浙江正泰汽车零部件有限公司 | Solar synchronous controllable spike based on Zigbee technology |
US20150302736A1 (en) * | 2014-04-18 | 2015-10-22 | Gentex Corporation | Trainable transceiver and camera systems and methods |
CN206768643U (en) * | 2017-04-18 | 2017-12-19 | 昆山市工研院智能制造技术有限公司 | Solar wireless intelligent spike holder |
CN109785220A (en) * | 2018-12-30 | 2019-05-21 | 武汉极目智能技术有限公司 | Monocular cam image multichannel collecting device and method based on FPGA |
CN110428630A (en) * | 2019-09-10 | 2019-11-08 | 西安电子科技大学 | A kind of road pedestrian detection system and its network-building method |
-
2019
- 2019-12-13 CN CN201911284167.4A patent/CN111178171A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN201627149U (en) * | 2009-06-10 | 2010-11-10 | 浙江正泰汽车零部件有限公司 | Solar synchronous controllable spike based on Zigbee technology |
US20150302736A1 (en) * | 2014-04-18 | 2015-10-22 | Gentex Corporation | Trainable transceiver and camera systems and methods |
CN206768643U (en) * | 2017-04-18 | 2017-12-19 | 昆山市工研院智能制造技术有限公司 | Solar wireless intelligent spike holder |
CN109785220A (en) * | 2018-12-30 | 2019-05-21 | 武汉极目智能技术有限公司 | Monocular cam image multichannel collecting device and method based on FPGA |
CN110428630A (en) * | 2019-09-10 | 2019-11-08 | 西安电子科技大学 | A kind of road pedestrian detection system and its network-building method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11350508B2 (en) | Low-altitude, low-power installable smart streetlight system | |
US10176713B2 (en) | Emergency alert and warning apparatus | |
CN100481151C (en) | Express highway intelligent safety monitoring pre-warning system and monitoring method thereof | |
CN104361768A (en) | Intelligent L-shaped bend traffic warning device | |
US10403142B1 (en) | Adaptive stop sign and intersection traffic control system | |
CN206805801U (en) | Hazardous vehicles cross the street caution system | |
CN206975839U (en) | A kind of road meeting prior-warning device based on millimetre-wave radar | |
CN205365392U (en) | Far and near lamp auto -change over device of car | |
CN111785009A (en) | Pedestrian crossing active early warning method and system based on video detection | |
CN209343515U (en) | A kind of pedestrian's street crossing intelligence care device | |
CN103415122B (en) | A kind of intelligent power saving LED traffic lights treatment system | |
CN111479353A (en) | L ED street lamp energy-saving lighting system and method | |
CN104805780A (en) | Solar energy geomagnetic induction road sign and vehicle dynamic trail display system and method | |
CN111178171A (en) | Pedestrian detection spike system based on monocular camera | |
CN213092518U (en) | Pedestrian crossing active early warning system based on video detection | |
CN214409628U (en) | Intelligent delineator | |
CN212847147U (en) | Pedestrian perception road side system with cooperative warning signals | |
CN114582136A (en) | Bridge deck lane guiding device and lane level inducing method for foggy days | |
CN210777149U (en) | Highway bend safety traffic warning light | |
CN111335206A (en) | Road construction or accident safety warning cursor device | |
CN106016162A (en) | Intelligent car light system | |
CN107567143B (en) | A kind of guardrail anticollision device, collision-prevention device for having both hypervelocity and warning and illuminating | |
CN210865106U (en) | Novel traffic induction lamp device | |
CN219676717U (en) | Intersection vision blind area coming car warning device and system | |
CN113823107B (en) | Traffic warning instrument for curved road corner |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200519 |
|
RJ01 | Rejection of invention patent application after publication |