CN111178171A - Pedestrian detection spike system based on monocular camera - Google Patents

Pedestrian detection spike system based on monocular camera Download PDF

Info

Publication number
CN111178171A
CN111178171A CN201911284167.4A CN201911284167A CN111178171A CN 111178171 A CN111178171 A CN 111178171A CN 201911284167 A CN201911284167 A CN 201911284167A CN 111178171 A CN111178171 A CN 111178171A
Authority
CN
China
Prior art keywords
spike
detection
monocular camera
pedestrian
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911284167.4A
Other languages
Chinese (zh)
Inventor
蒋思怡
匡思敏
张清悦
陈家杨
龙泳舟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing University
Original Assignee
Chongqing University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing University filed Critical Chongqing University
Priority to CN201911284167.4A priority Critical patent/CN111178171A/en
Publication of CN111178171A publication Critical patent/CN111178171A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • EFIXED CONSTRUCTIONS
    • E01CONSTRUCTION OF ROADS, RAILWAYS, OR BRIDGES
    • E01FADDITIONAL WORK, SUCH AS EQUIPPING ROADS OR THE CONSTRUCTION OF PLATFORMS, HELICOPTER LANDING STAGES, SIGNS, SNOW FENCES, OR THE LIKE
    • E01F9/00Arrangement of road signs or traffic signals; Arrangements for enforcing caution
    • E01F9/50Road surface markings; Kerbs or road edgings, specially adapted for alerting road users
    • E01F9/553Low discrete bodies, e.g. marking blocks, studs or flexible vehicle-striking members
    • E01F9/559Low discrete bodies, e.g. marking blocks, studs or flexible vehicle-striking members illuminated
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G06V20/54Surveillance or monitoring of activities, e.g. for recognising suspicious objects of traffic, e.g. cars on the road, trains or boats
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/08Detecting or categorising vehicles

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Architecture (AREA)
  • Civil Engineering (AREA)
  • Structural Engineering (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention relates to a pedestrian detection spike system based on a monocular camera, and belongs to the field of pedestrian detection. The system comprises a spike shell, an LED light source module, a solar power supply module, a zigbee communication module, a monocular camera and an MCU processing module; the spike shell takes every 50 spike nodes as a detection group and is arranged on two sides of a road crossed by pedestrians, the spike shell adopts a solar power supply module, and energy is stored through sunlight and road light charging; and each group of spike shells are communicated in real time by adopting zigbee networking, and light signals are synchronously controlled. The invention provides a solar energy LED detection lamp, which can reduce the cost and the equipment maintenance. When the pedestrian is detected, the pedestrian and the automobile can be warned simultaneously through the flashing light, and the collision is effectively avoided.

Description

Pedestrian detection spike system based on monocular camera
Technical Field
The invention belongs to the field of pedestrian detection, and relates to a pedestrian detection spike system based on a monocular camera.
Background
Current pedestrian collision avoidance mainly employs automotive self-induction systems, such as: the method is characterized in that the track of the automobile and the pedestrian is predicted to carry out early warning, people are located by collecting images in front of the automobile to carry out prediction, and a distance measuring radar, a physical anti-collision device and the like are installed in front of the automobile.
However, the anti-collision device in the existing scheme has a complex structure, only equipment of the automobile participates in detection and early warning activities in the execution process, the information source is single, once the equipment fails to be detected in a short period of failure, the early warning task cannot be completed, and meanwhile, the single equipment also has blind spot risks.
Secondly, because the feedback information in front of the automobile mainly comprises a large number of dynamic images of pedestrians and a large number of calculations are carried out on the automobile and the pedestrians, the processing speed is low; and the physical equipment needs to be maintained regularly, and the maintenance requirement is higher and the cost is high.
In addition, the automobile self-induction device can effectively prevent collision on the social level only by equipping each automobile, and the universality is low. In addition, different automobile installation devices have difference, and the operability is lower.
Therefore, the invention provides a novel and effective pedestrian detection spike system which can avoid blind spots and failure risks, remind a driver of paying attention to pedestrians ahead in time at lower cost and guarantee driving safety.
Disclosure of Invention
In view of this, the present invention provides a pedestrian detection spike system based on a monocular camera, which solves the problem of collision avoidance of pedestrians in automobiles, reminds a driver to pay attention to pedestrians ahead, and ensures driving safety.
In order to achieve the purpose, the invention provides the following technical scheme:
the pedestrian detection spike system based on the monocular camera comprises a spike shell, an LED light source module, a solar power supply module, a zigbee communication module, the monocular camera and an MCU processing module;
the spike shell takes every 50 spike nodes as a detection group and is arranged on two sides of a road crossed by pedestrians, the spike shell adopts a solar power supply module, and energy is stored through sunlight and road light charging;
each group of spike shells are communicated in real time by adopting zigbee networking, and light signals are synchronously controlled;
the monocular camera transmits image signals of a road to the MCU processing module, the MCU processing module judges whether pedestrians are around or in the road through image analysis, transmits corresponding lamp hole signals to the whole detection group through zigbee, and sends out corresponding lamp hole signals; if one or more spikes in the detection group detect the existence of a pedestrian, the spike shell in the detection group flashes red light; otherwise, no light is emitted.
Optionally, the distance between the spike shells is 5m, the covering angle of the monocular camera is 90 degrees, and the visual radius is 8 m.
Optionally, the rechargeable battery in the solar power supply module is a lithium iron phosphate battery, and the rated capacity is 5000 mA; the material is a monocrystalline silicon electric plate.
Optionally, the LED light source module adopts 3 LED lamp tubes, and a yellow reflector is covered beside the LED lamp tubes.
Optionally, the MCU processing module performs detection and identification every 2s, the zigbee communication module performs communication every 2s, and each spike node broadcasts its own detection result in sequence at a speed of 2ms and receives the transmission information of the remaining 49 spike nodes; if the spike nodes and the rest 49 spike nodes do not detect pedestrians, the detection is continued, otherwise, the LED light source is controlled to flicker red light signals until all the nodes do not detect pedestrians in the subsequent detection.
The invention has the beneficial effects that:
1. simple structure, convenient installation, no need of cable, solar energy power supply
2. Through the design of the multi-channel nail node, the sidelines on two sides of the road can be completely covered without dead angles. When the pedestrian approaches or crosses the boundary line of the highway, the pedestrian can give an alarm in time to remind a driver of safe driving.
3. And zigbee networking is adopted, so that the communication is efficient and the power consumption is low.
4. The traffic accidents caused by the fact that the pedestrians cross the road and the drivers do not observe timely can be effectively reduced.
Additional advantages, objects, and features of the invention will be set forth in part in the description which follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or may be learned from practice of the invention. The objectives and other advantages of the invention may be realized and attained by the means of the instrumentalities and combinations particularly pointed out hereinafter.
Drawings
For the purposes of promoting a better understanding of the objects, aspects and advantages of the invention, reference will now be made to the following detailed description taken in conjunction with the accompanying drawings in which:
FIG. 1 is a block diagram of the present system;
FIG. 2 is a working diagram of spike node placement on a highway;
FIG. 3 is a diagram illustrating pedestrian detection effects;
FIG. 4 is an illustration of a spike housing;
FIG. 5 is a second illustration of the spike housing;
fig. 6 is a system work flow diagram.
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention in a schematic way, and the features in the following embodiments and examples may be combined with each other without conflict.
Wherein the showings are for the purpose of illustrating the invention only and not for the purpose of limiting the same, and in which there is shown by way of illustration only and not in the drawings in which there is no intention to limit the invention thereto; to better illustrate the embodiments of the present invention, some parts of the drawings may be omitted, enlarged or reduced, and do not represent the size of an actual product; it will be understood by those skilled in the art that certain well-known structures in the drawings and descriptions thereof may be omitted.
The same or similar reference numerals in the drawings of the embodiments of the present invention correspond to the same or similar components; in the description of the present invention, it should be understood that if there is an orientation or positional relationship indicated by terms such as "upper", "lower", "left", "right", "front", "rear", etc., based on the orientation or positional relationship shown in the drawings, it is only for convenience of description and simplification of description, but it is not an indication or suggestion that the referred device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and therefore, the terms describing the positional relationship in the drawings are only used for illustrative purposes, and are not to be construed as limiting the present invention, and the specific meaning of the terms may be understood by those skilled in the art according to specific situations.
The invention provides a novel pedestrian detection spike system, which mainly comprises the following components: the device comprises a spike shell, an LED light source module, a solar power supply module, a zigbee communication module, a monocular camera and an MCU processing module.
Every 50 spike nodes are used as a detection group in the system, the spike nodes are arranged on two sides of a road which is easy to cross pedestrians, a spike body adopts a solar power supply module, and the spike body can be charged and stored with energy through sunlight and road light and also can work at night. And each group of spikes is communicated in real time by a zigbee networking, so that light signals can be synchronously controlled. The monocular camera transmits image signals of the road to the MCU processing module, the MCU processing module judges whether pedestrians are around or in the road through image analysis, transmits corresponding lamp hole signals to the whole detection group through the zigbee, and sends out the corresponding lamp hole signals. If one or more spikes in the detection group detect the existence of the pedestrian, the spikes in the group flash red light synchronously. Otherwise, no light is emitted.
The structural block diagram of the system is shown in FIG. 1.
The operation of the spike system is schematically shown in fig. 2-3.
The distance between nodes of the single-side road is 5m, the covering angle of the camera is 90 degrees, the visible radius is 8m, a detection system formed by the spikes can completely cover the boundary of the road, and when pedestrians approach or cross the boundary of the road, light signals can be triggered.
FIG. 4 is an illustration of a spike housing; FIG. 5 is a second illustration of the spike housing;
1. zigbee communication module description
By using the Zigbee low-power module, the Zigbee low-power module is particularly suitable for systems with ultra-low power consumption requirements. The short transition time between the operating modes further ensures low energy consumption.
The module is controlled by the MCU, networking can be formed at 50 nodes, and when a lamp hole signal needs to be sent, the MCU sends a control command to other nodes in the group through the module.
2. Description of Power supply Module
The solar panel material selected by the invention is a monocrystalline silicon electric plate, and the color is black. Monocrystalline silicon not only has strong absorption power in a strong light environment, but also can be absorbed in a weak light environment, weak light (such as rainy days) is much stronger than the charging effect of polycrystalline silicon, and the cost of monocrystalline silicon is higher than that of polycrystalline silicon and is higher than that of polycrystalline silicon.
The rechargeable battery selected by the invention is a lithium iron phosphate battery, and the rated capacity can reach 5000 mA. The lithium iron phosphate battery is a lithium ion battery using lithium iron phosphate as a positive electrode material, has a series of unique advantages of high working voltage, high energy density, long cycle life, small self-discharge rate, no memory effect, environmental friendliness and the like, supports stepless expansion, and is suitable for large-scale electric energy storage.
3. LED light source module
The spike light source adopts 3 red LED fluorescent tubes, and the fluorescent tube is covered with yellow reflector panel next door. At night, if the spike node does not send out a light signal, the spike reflects yellow light under the irradiation of the street lamp and the vehicle lamp, and sends out a red light flashing signal when the light signal is sent out.
4. Description of MCU processing Module
The module adopts a low-power processing chip, and can quickly analyze images and identify pedestrians. The module is responsible for timing, image processing and signal control and is the main control part of the node.
5. Monocular camera
The monocular camera disclosed by the invention has infrared night vision capability and can sense clear image signals at night. The monocular camera is responsible for monitoring road conditions in real time and transmitting image signals to the MCU processing module for pedestrian identification. The shortest monitoring radius of the monocular camera is 8m, and the visual angle is not less than 90 degrees.
Because each node in the system takes on the role of pedestrian detection, all the nodes need to be synchronously calibrated when the system works. The system carries out detection identification and communication once every 2s, each node broadcasts the detection result of the node in turn at a very fast speed (2ms), and receives the transmission information of the other 49 nodes. If the node and the rest 49 nodes do not detect the pedestrians, the detection is continued, otherwise, the LED light source is controlled to flicker the red light signal until all the nodes do not detect the pedestrians in the subsequent detection.
The system work flow diagram is shown in fig. 6.
According to the invention, the automobile is not subjected to anti-collision design, the detection equipment is arranged in the spike for linkage detection, once one spike is detected, the road section is subjected to flashing warning, so that the risk caused by equipment failure can be effectively avoided, and meanwhile, the blind spot risk can be effectively avoided due to more spikes.
In addition, the invention provides the solar energy to supply energy to the LED detection lamp, so that the cost can be reduced, and the equipment maintenance can be reduced. When the pedestrian is detected, the pedestrian and the automobile can be warned simultaneously through the flashing light, and the collision is effectively avoided. And zigbee networking is adopted, so that the communication is efficient, and the power consumption is low.
Finally, the above embodiments are only intended to illustrate the technical solutions of the present invention and not to limit the present invention, and although the present invention has been described in detail with reference to the preferred embodiments, it will be understood by those skilled in the art that modifications or equivalent substitutions may be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions, and all of them should be covered by the claims of the present invention.

Claims (5)

1. Pedestrian detects spike system based on monocular camera, its characterized in that: the device comprises a spike shell, an LED light source module, a solar power supply module, a zigbee communication module, a monocular camera and an MCU processing module;
the spike shell takes every 50 spike nodes as a detection group and is arranged on two sides of a road crossed by pedestrians, the spike shell adopts a solar power supply module, and energy is stored through sunlight and road light charging;
each group of spike shells are communicated in real time by adopting zigbee networking, and light signals are synchronously controlled;
the monocular camera transmits image signals of a road to the MCU processing module, the MCU processing module judges whether pedestrians are around or in the road through image analysis, transmits corresponding lamp hole signals to the whole detection group through zigbee, and sends out corresponding lamp hole signals; if one or more spikes in the detection group detect the existence of a pedestrian, the spike shell in the detection group flashes red light; otherwise, no light is emitted.
2. The monocular camera-based pedestrian detection spike system of claim 1, wherein: the spike shell interval is 5m, the monocular camera cover angle is 90 degrees, and the visual radius is 8 m.
3. The monocular camera-based pedestrian detection spike system of claim 1, wherein: the rechargeable battery in the solar power supply module is a lithium iron phosphate battery with the rated capacity of 5000 mA; the material is a monocrystalline silicon electric plate.
4. The monocular camera-based pedestrian detection spike system of claim 1, wherein: the LED light source module adopts 3 LED lamp tubes, and a yellow reflecting plate covers beside the LED lamp tubes.
5. The monocular camera-based pedestrian detection spike system of claim 1, wherein: the MCU processing module carries out detection and identification once every 2s, the zigbee communication module carries out communication once every 2s, and each spike node broadcasts the detection result of the spike node in sequence at the speed of 2ms and receives the transmission information of the other 49 spike nodes; if the spike nodes and the rest 49 spike nodes do not detect pedestrians, the detection is continued, otherwise, the LED light source is controlled to flicker red light signals until all the nodes do not detect pedestrians in the subsequent detection.
CN201911284167.4A 2019-12-13 2019-12-13 Pedestrian detection spike system based on monocular camera Pending CN111178171A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911284167.4A CN111178171A (en) 2019-12-13 2019-12-13 Pedestrian detection spike system based on monocular camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911284167.4A CN111178171A (en) 2019-12-13 2019-12-13 Pedestrian detection spike system based on monocular camera

Publications (1)

Publication Number Publication Date
CN111178171A true CN111178171A (en) 2020-05-19

Family

ID=70651974

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911284167.4A Pending CN111178171A (en) 2019-12-13 2019-12-13 Pedestrian detection spike system based on monocular camera

Country Status (1)

Country Link
CN (1) CN111178171A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201627149U (en) * 2009-06-10 2010-11-10 浙江正泰汽车零部件有限公司 Solar synchronous controllable spike based on Zigbee technology
US20150302736A1 (en) * 2014-04-18 2015-10-22 Gentex Corporation Trainable transceiver and camera systems and methods
CN206768643U (en) * 2017-04-18 2017-12-19 昆山市工研院智能制造技术有限公司 Solar wireless intelligent spike holder
CN109785220A (en) * 2018-12-30 2019-05-21 武汉极目智能技术有限公司 Monocular cam image multichannel collecting device and method based on FPGA
CN110428630A (en) * 2019-09-10 2019-11-08 西安电子科技大学 A kind of road pedestrian detection system and its network-building method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201627149U (en) * 2009-06-10 2010-11-10 浙江正泰汽车零部件有限公司 Solar synchronous controllable spike based on Zigbee technology
US20150302736A1 (en) * 2014-04-18 2015-10-22 Gentex Corporation Trainable transceiver and camera systems and methods
CN206768643U (en) * 2017-04-18 2017-12-19 昆山市工研院智能制造技术有限公司 Solar wireless intelligent spike holder
CN109785220A (en) * 2018-12-30 2019-05-21 武汉极目智能技术有限公司 Monocular cam image multichannel collecting device and method based on FPGA
CN110428630A (en) * 2019-09-10 2019-11-08 西安电子科技大学 A kind of road pedestrian detection system and its network-building method

Similar Documents

Publication Publication Date Title
US11350508B2 (en) Low-altitude, low-power installable smart streetlight system
US10176713B2 (en) Emergency alert and warning apparatus
CN100481151C (en) Express highway intelligent safety monitoring pre-warning system and monitoring method thereof
CN104361768A (en) Intelligent L-shaped bend traffic warning device
US10403142B1 (en) Adaptive stop sign and intersection traffic control system
CN206805801U (en) Hazardous vehicles cross the street caution system
CN206975839U (en) A kind of road meeting prior-warning device based on millimetre-wave radar
CN205365392U (en) Far and near lamp auto -change over device of car
CN111785009A (en) Pedestrian crossing active early warning method and system based on video detection
CN209343515U (en) A kind of pedestrian's street crossing intelligence care device
CN103415122B (en) A kind of intelligent power saving LED traffic lights treatment system
CN111479353A (en) L ED street lamp energy-saving lighting system and method
CN104805780A (en) Solar energy geomagnetic induction road sign and vehicle dynamic trail display system and method
CN111178171A (en) Pedestrian detection spike system based on monocular camera
CN213092518U (en) Pedestrian crossing active early warning system based on video detection
CN214409628U (en) Intelligent delineator
CN212847147U (en) Pedestrian perception road side system with cooperative warning signals
CN114582136A (en) Bridge deck lane guiding device and lane level inducing method for foggy days
CN210777149U (en) Highway bend safety traffic warning light
CN111335206A (en) Road construction or accident safety warning cursor device
CN106016162A (en) Intelligent car light system
CN107567143B (en) A kind of guardrail anticollision device, collision-prevention device for having both hypervelocity and warning and illuminating
CN210865106U (en) Novel traffic induction lamp device
CN219676717U (en) Intersection vision blind area coming car warning device and system
CN113823107B (en) Traffic warning instrument for curved road corner

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200519

RJ01 Rejection of invention patent application after publication