CN113516691A - High-altitude parabolic detection system based on machine vision - Google Patents

High-altitude parabolic detection system based on machine vision Download PDF

Info

Publication number
CN113516691A
CN113516691A CN202110514025.3A CN202110514025A CN113516691A CN 113516691 A CN113516691 A CN 113516691A CN 202110514025 A CN202110514025 A CN 202110514025A CN 113516691 A CN113516691 A CN 113516691A
Authority
CN
China
Prior art keywords
parabolic
floor
altitude
module
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110514025.3A
Other languages
Chinese (zh)
Inventor
王志华
苏崧
阮颖慧
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing University of Science and Technology
Original Assignee
Nanjing University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing University of Science and Technology filed Critical Nanjing University of Science and Technology
Priority to CN202110514025.3A priority Critical patent/CN113516691A/en
Publication of CN113516691A publication Critical patent/CN113516691A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/292Multi-camera tracking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/194Segmentation; Edge detection involving foreground-background segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/215Motion-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/246Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/248Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving reference images or patches
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30232Surveillance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30241Trajectory

Abstract

The invention discloses a high-altitude parabolic detection system based on machine vision, which comprises a plurality of modules, such as a front-end monitoring real-time video image information acquisition module, an information transmission and exchange module, an image real-time analysis and processing algorithm module, a monitoring display module and the like. In the scheme, different high-definition cameras are alternatively used to cover different floors, the local area network is accessed to the convergence switch, and the video stream is identified and analyzed by using AI algorithms such as video image technology, machine vision, deep learning and the like, so that the identification and monitoring of the high-altitude parabolic object are realized. The safety protection of the high-altitude parabolic phenomenon of the community buildings is realized, the defect that the high-altitude parabolic phenomenon cannot be subjected to security management in the existing management is overcome, the personal safety of community residents is guaranteed, the community sanitary environment is protected, and the working pressure of sanitation workers is reduced.

Description

High-altitude parabolic detection system based on machine vision
Technical Field
The invention relates to the technical field of artificial intelligence and intelligent security, in particular to a high-altitude parabolic detection system based on machine vision.
Background
With the acceleration of the urbanization process, the high-rise building is pulled up, and the high-altitude throwing problem caused by the high-rise building is very severe. The high-altitude parabolic behavior attracts much attention all the time, and as urban civilization behavior, the social hazards (potential safety hazards, property loss, environment damage and the like) brought by the high-altitude parabolic behavior are huge. Because the implementation places of the high-altitude parabolic unlawful behaviors are mostly high-altitude floors, the dropping speed of the parabolic is extremely high, the parabolic time is extremely short, and the parabolic people are good at hiding the parabolic behaviors, so that related departments are difficult to realize effective evidence collection and accurate responsibility determination. Thus, the high altitude parabola is referred to as "pain hanging over the city".
In order to effectively prevent and punish the behavior of the high-altitude parabolic things according to law, the government and related departments in China pay attention to the fact that the opinion on the law-based proper examination of the high-altitude parabolic things and falling things is issued, and the law violation behavior of the high-altitude parabolic things is clearly specified in the national code of people's republic of China. In particular, the first thousand, two hundred and fifty-four rules of the national law prohibit the throwing of articles from buildings. If the high-altitude parabolic behavior causes damage to others, the parabolic person takes full charge of responsibility; the person who is responsible cannot be clearly determined, and the possibly harmed building users share responsibility; if the related security measures in the cell are not done, the property should take responsibility by law. Although various large enterprises and research institutes respond to government calls and actively research and design various high-altitude parabolic prevention solutions by applying modern advanced information technology, a plurality of defects still exist. Therefore, it is extremely important to construct a system for detecting high-altitude parabolic behavior.
Disclosure of Invention
Aiming at the problems, the invention designs a high-altitude parabolic detection system based on machine vision so as to solve the problem of security management of the existing high-altitude parabolic phenomenon.
The purpose of the invention can be realized by the following technical scheme:
a high altitude parabolic detection system based on machine vision is characterized in that: the system comprises a video image data acquisition module, a parabolic behavior detection module, a moving target tracking module, a parabolic behavior judgment module and a result display module.
The video image data acquisition module comprises a plurality of high-definition cameras, each high-definition camera corresponds to different floors, and each high-definition camera is installed on a support on the ground and used for shooting images of each building close to the window side according to a preset time interval and sending the shot images of the building window side to the parabolic behavior detection module;
the parabolic behavior detection module comprises motion track prediction, tracking model updating, motion track matching and the like, continuously receives the image of the building window side sent by the image data acquisition module, performs filtering processing on the received image of the building window side to obtain a filtered building image, and performs mining analysis on video stream by designing a deep learning algorithm to realize automatic detection and identification of high-altitude parabolic behavior;
the moving target tracking module draws a motion track of a suspected high-altitude parabolic object through a machine vision correlation algorithm and sends the motion track to the parabolic behavior judgment module;
the parabolic behavior judgment module is used for further analyzing whether the moving object in the graph is interference of other objects in the air or not and judging whether high-altitude parabolic behavior exists in the graph or not;
and the result display module is used for displaying the final judgment result on the terminal and reminding monitoring personnel to timely arrive at the place of affairs for processing.
The invention discloses a high-altitude parabolic detection method based on deep learning, which comprises the following steps:
high-altitude parabolic and other dangerous behaviors are detected, identified and stored in summary videos for viewing and evidence collection by using traditional image processing and combining with deep learning technology. As shown in figure 2, the multi-camera combination is arranged at a distance of 20-40m from the floor, and the coverage monitoring of high, medium and low floors is realized by adjusting the pitch angle and the focal length.
W1: initializing a Gaussian mixture model for background modeling by using the first 10 to 100 frames of the monitoring video image;
w2: predicting whether each pixel belongs to the foreground or the background by using a Gaussian mixture model for the subsequent video frame image to obtain a potential moving target in the foreground, and updating the Gaussian mixture model;
w3: according to the intersection ratio IoU between the areas of the moving object detection frames between the adjacent frames, a target tracking algorithm based on data association is used for obtaining the moving track of the moving object;
w4: calculating the movement speed of the target track and the descending distance of the target, finding out a moving target with an obvious descending trend, and judging whether the moving target is a high-altitude parabola or not;
w5: calculating the center coordinate of the first frame of the high-altitude parabolic target track sequence and the instantaneous speed of the last frame of object in the field of view, and reversely deducing the floor range where the parabola occurs;
the front end high-definition camera of the image acquisition module acquires a floor image and carries out preprocessing operations such as image denoising and image enhancement according to the imaging quality of the floor image. The moving object detection module carries out motion estimation on the preprocessed image by using a Gaussian mixture model background modeling method, and the new frame-by-frame image is compared with the background model by the gray value of each pixel to judge whether the new frame-by-frame image belongs to the foreground or the background. And performing morphological opening operation on the foreground area, filtering small background noises, and finding a potential moving target area. Considering that the high-altitude parabolic motion trajectory is regular, the multi-target tracking module tracks the moving target through a target tracking algorithm based on data association, calculates IoU similarity matrixes of detection frames among different frames, and obtains an optimal matching result to obtain the motion trajectories of different targets. The object throwing judging and identifying module distinguishes whether the tracked object is an object throwing at high altitude or normal daily activity environment interference by judging whether the target track has an obvious descending trend or not and filters the influence of some false alarms; carrying out image recognition on the target determined to be a high-altitude parabola by using a deep learning method, and determining the type and the danger degree of the parabola; and finally backtracking the range of the abandoned floor through the tracked track coordinate information. And the alarm and display module transmits the detected high-altitude parabolic video abstract and the timestamp information to a central server through a network for displaying and alarming, and stores corresponding video information.
The standard building windowsill side image is a building windowsill side static image without a high-altitude parabola.
The detection system can also confirm the owner information of the parabolic room, and the specific process comprises the following steps:
s1: screening the parabolic floor sub-images from a plurality of floor sub-images according to the identified parabolic floor;
s2: amplifying the obtained parabolic floor sub-images, and obtaining the numbers of the parabolic rooms according to the distribution sequence of the numbers of the rooms of the floors:
s3: and extracting owner information of each house number of each floor of the building to obtain owner information of the parabolic house number, wherein the owner information comprises an owner name and an owner contact way.
In the face of the high-altitude parabolic emergency protection mode, the specific process is as follows:
r1: according to the received critical floor number and parabolic floor number, starting upwards sequentially from the first floor on the critical floor to the floors between the critical floor and the parabolic floor to extend the protective net outwards, and receiving possible subsequent falling objects in an emergency;
r2: when the protective net on a certain floor receives a falling object, the sub-controllers on the floor send a receiving completion signal to the master controller, and send the floor number of the falling object to the master controller;
r3: when receiving a receiving completion signal sent by the sub-controllers and receiving a floor number of a falling object, the main controller sends a protection stopping instruction to the sub-controllers of floors except the floor receiving the falling object;
r4: and (4) corresponding to the protection stopping instructions which are sent by the master controller and received by the sub-controllers of all floors except the floor which receives the falling object, and stopping and starting the protective net.
The master controller acquires owner information of the parabolic house number, receives the high-altitude parabolic image, sends the high-altitude parabolic image to a mobile phone terminal of the owner of the parabolic house number, and reminds the owner of the parabolic house number not to throw objects high-altitude.
The invention has the beneficial effects that:
(1) according to the invention, the image acquisition module is used for acquiring and processing the images of all buildings close to the window side, parabolic floor locking and parabolic protection mode analysis are carried out on the identified high-altitude parabolic images of the buildings, and the protection execution terminal is controlled by the master controller to execute the protection instruction according to the parabolic protection mode analyzed, so that the high-altitude parabolic phenomenon of the buildings of the community can be effectively monitored and protected, the defect that the high-altitude parabolic phenomenon of the buildings cannot be subjected to security protection management is overcome, the personal safety of the community is ensured, the sanitary environment of the community is protected, and the working pressure of sanitation workers is reduced.
(2) According to the invention, whether people appear on all floors downwards of the parabolic floor or not is checked through the identified high-altitude parabolic image of the building, and the characteristic of strong operability of parabolic protection is analyzed according to the checking result, so that personal injury of residents at the lower windowsill caused by falling objects is avoided to the maximum extent in the emergency protection mode, and the personal safety of the residents is greatly protected.
Drawings
FIG. 1 is a block diagram of the system of the present invention;
FIG. 2 is a schematic diagram of a high altitude parabolic detection and identification system provided by the present invention;
FIG. 3 is an algorithm flow of a high-altitude parabolic detection and identification method based on machine vision provided by the invention
Detailed description of the invention
The technical solution in the implementation of the present invention will be clearly and completely described below with reference to the accompanying drawings in the present specification. The invention provides a high-altitude parabolic detection system based on machine vision, which acquires a floor image through a front-end high-definition camera of an image acquisition module and performs preprocessing operations such as image denoising and image enhancement according to the imaging quality of the floor image. The moving object detection module carries out motion estimation on the preprocessed image by using a Gaussian mixture model background modeling method, and the new frame-by-frame image is compared with the background model by the gray value of each pixel to judge whether the new frame-by-frame image belongs to the foreground or the background. And performing morphological opening operation on the foreground area, filtering small background noises, and finding a potential moving target area. Considering that the high-altitude parabolic motion trajectory is regular, the multi-target tracking module tracks the moving target through a target tracking algorithm based on data association, calculates IoU similarity matrixes of detection frames among different frames, and obtains an optimal matching result to obtain the motion trajectories of different targets. The object throwing judging and identifying module distinguishes whether the tracked object is an object throwing at high altitude or normal daily activity environment interference by judging whether the target track has an obvious descending trend or not and filters the influence of some false alarms; carrying out image recognition on the target determined to be a high-altitude parabola by using a deep learning method, and determining the type and the danger degree of the parabola; and finally backtracking the range of the abandoned floor through the tracked track coordinate information. And the alarm and display module transmits the detected high-altitude parabolic video abstract and the timestamp information to a central server through a network for displaying and alarming, and stores corresponding video information.
The image data acquisition module comprises a plurality of high-definition cameras, each high-definition camera corresponds to different floors, and each high-definition camera is installed on a support on the ground and used for shooting images of each building close to the window side according to a preset time interval and sending the shot images of the building window side to the parabolic behavior detection module;
the smaller the preset shooting time interval is, the higher the frequency of the camera for collecting images is, the more the high-altitude parabolic phenomenon can be monitored in time, the high-altitude parabolic protection can be carried out in time, and the harm of falling objects to people is reduced.
The moving target tracking module draws a motion track of a suspected high-altitude parabolic object through a machine vision correlation algorithm and sends the motion track to the parabolic behavior judgment module;
the detection system can also confirm the owner information of the parabolic room, and the specific process comprises the following steps:
s1: screening the parabolic floor sub-images from a plurality of floor sub-images according to the identified parabolic floor;
s2: amplifying the obtained parabolic floor sub-images, and obtaining the numbers of the parabolic rooms according to the distribution sequence of the numbers of the rooms of the floors:
s3: and extracting owner information of each house number of each floor of the building to obtain owner information of the parabolic house number, wherein the owner information comprises an owner name and an owner contact way.
In the face of the high-altitude parabolic emergency protection mode, the specific process is as follows:
r1: according to the received critical floor number and parabolic floor number, starting upwards sequentially from the first floor on the critical floor to the floors between the critical floor and the parabolic floor to extend the protective net outwards, and receiving possible subsequent falling objects in an emergency;
r2: when the protective net on a certain floor receives a falling object, the sub-controllers on the floor send a receiving completion signal to the master controller, and send the floor number of the falling object to the master controller;
r3: when receiving a receiving completion signal sent by the sub-controllers and receiving a floor number of a falling object, the main controller sends a protection stopping instruction to the sub-controllers of floors except the floor receiving the falling object;
r4: and (4) corresponding to the protection stopping instructions which are sent by the master controller and received by the sub-controllers of all floors except the floor which receives the falling object, and stopping and starting the protective net.
The main controller is respectively connected with the target tracking module and the protection mode analysis module, receives the high-altitude parabolic floor number sent by the target tracking module and receives the parabolic protection mode sent by the protection mode analysis module, if the received parabolic protection mode is the normal parabolic protection mode, an instruction is sent to the sub-controller of the corresponding floor, and the sub-controller starts the protection execution terminal to perform normal parabolic protection; if the received parabolic protection mode is the emergency parabolic protection mode, sending an instruction to the sub-controllers of the corresponding floors, starting the protection execution terminal by the sub-controllers to perform emergency parabolic protection, enabling the sub-controllers to correspond to the floors of the building one by one, connecting the sub-controllers with the protection mechanisms of the floors, receiving the control instruction of the master controller, and feeding back a receiving completion signal to the master controller.
The master controller acquires owner information of the parabolic house number, receives the high-altitude parabolic image, sends the high-altitude parabolic image to a mobile phone terminal of the owner of the parabolic house number, and reminds the owner of the parabolic house number not to throw objects high-altitude.
The method collects and identifies the images of the sides of the buildings close to the windowsill, carries out parabolic floor locking and parabolic protection mode analysis on the identified high-altitude parabolic images of the buildings, and executes the protection instruction by the protection execution terminal according to the parabolic protection mode analyzed, thereby realizing the safety protection of the high-altitude parabolic phenomenon of the buildings of the community, overcoming the defect that the high-altitude parabolic phenomenon cannot be subjected to security management, ensuring the personal safety of residents of the community, protecting the sanitary environment of the community and reducing the working pressure of sanitation workers.

Claims (5)

1. A high altitude parabolic detection system based on machine vision is characterized in that: the system comprises a video image data acquisition module, a parabolic behavior detection module, a moving target tracking module, a parabolic behavior judgment module and a result display module.
The video image data acquisition module comprises a plurality of high-definition cameras, each high-definition camera corresponds to different floors, and each high-definition camera is installed on a support on the ground and used for shooting images of each building close to the window side according to a preset time interval and sending the shot images of the building window side to the parabolic behavior detection module;
the parabolic behavior detection module comprises motion track prediction, tracking model updating, motion track matching and the like, continuously receives the image of the building window side sent by the image data acquisition module, performs filtering processing on the received image of the building window side to obtain a filtered building image, and performs mining analysis on video stream by designing a deep learning algorithm to realize automatic detection and identification of high-altitude parabolic behavior;
the moving target tracking module draws a motion track of a suspected high-altitude parabolic object through a machine vision correlation algorithm and sends the motion track to the parabolic behavior judgment module;
the parabolic behavior judgment module is used for further analyzing whether the moving object in the graph is interference of other objects in the air or not and judging whether high-altitude parabolic behavior exists in the graph or not;
and the result display module is used for displaying the final judgment result on the terminal and reminding monitoring personnel to timely arrive at the place of affairs for processing.
2. The machine vision-based high altitude parabolic detection system according to claim 1, characterized in that: the standard building windowsill side image is a building windowsill side static image without a high-altitude parabola.
3. The machine vision-based high altitude parabolic detection system according to claim 1, characterized in that: the detection system can also confirm the owner information of the parabolic room, and the specific process comprises the following steps:
s1: screening the parabolic floor sub-images from a plurality of floor sub-images according to the identified parabolic floor;
s2: amplifying the obtained parabolic floor sub-images, and obtaining the numbers of the parabolic rooms according to the distribution sequence of the numbers of the rooms of the floors:
s3: and extracting owner information of each house number of each floor of the building to obtain owner information of the parabolic house number, wherein the owner information comprises an owner name and an owner contact way.
4. The machine vision-based high altitude parabolic detection system according to claim 1, characterized in that: the emergency protection mode facing high-altitude parabolas is also provided, and the specific process is as follows:
r1: according to the received critical floor number and parabolic floor number, starting upwards sequentially from the first floor on the critical floor to the floors between the critical floor and the parabolic floor to extend the protective net outwards, and receiving possible subsequent falling objects in an emergency;
r2: when the protective net on a certain floor receives a falling object, the sub-controllers on the floor send a receiving completion signal to the master controller, and send the floor number of the falling object to the master controller;
r3: when receiving a receiving completion signal sent by the sub-controllers and receiving a floor number of a falling object, the main controller sends a protection stopping instruction to the sub-controllers of floors except the floor receiving the falling object;
r4: and (4) corresponding to the protection stopping instructions which are sent by the master controller and received by the sub-controllers of all floors except the floor which receives the falling object, and stopping and starting the protective net.
5. The machine vision-based high altitude parabolic detection system according to claim 1, characterized in that: the master controller acquires owner information of the parabolic house number, receives the high-altitude parabolic image, sends the high-altitude parabolic image to a mobile phone terminal of the owner of the parabolic house number, and reminds the owner of the parabolic house number not to throw objects high-altitude.
CN202110514025.3A 2021-05-11 2021-05-11 High-altitude parabolic detection system based on machine vision Pending CN113516691A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110514025.3A CN113516691A (en) 2021-05-11 2021-05-11 High-altitude parabolic detection system based on machine vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110514025.3A CN113516691A (en) 2021-05-11 2021-05-11 High-altitude parabolic detection system based on machine vision

Publications (1)

Publication Number Publication Date
CN113516691A true CN113516691A (en) 2021-10-19

Family

ID=78064338

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110514025.3A Pending CN113516691A (en) 2021-05-11 2021-05-11 High-altitude parabolic detection system based on machine vision

Country Status (1)

Country Link
CN (1) CN113516691A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114424911A (en) * 2022-01-23 2022-05-03 深圳市银星智能科技股份有限公司 Cleaning method and mobile equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114424911A (en) * 2022-01-23 2022-05-03 深圳市银星智能科技股份有限公司 Cleaning method and mobile equipment
CN114424911B (en) * 2022-01-23 2024-01-30 深圳银星智能集团股份有限公司 Cleaning method and mobile device

Similar Documents

Publication Publication Date Title
CN110428522B (en) Intelligent security system of wisdom new town
CN112257557B (en) High-altitude parabolic detection and identification method and system based on machine vision
CN103839373B (en) A kind of unexpected abnormality event Intelligent Recognition alarm device and warning system
CN107911653B (en) Intelligent video monitoring module, system, method and storage medium for residence
CN101465033B (en) Automatic tracking recognition system and method
CN102968802A (en) Moving target analyzing and tracking method and system based on video monitoring
CN201278180Y (en) Automatic tracking recognition system
CN108319926A (en) A kind of the safety cap wearing detecting system and detection method of building-site
CN107133564B (en) Tooling cap detection method
CN108802758B (en) Intelligent security monitoring device, method and system based on laser radar
CN106241533A (en) Elevator occupant's comprehensive safety intelligent control method based on machine vision
CN111488799B (en) Falling object identification method and system based on image identification
CN109867186B (en) Elevator trapping detection method and system based on intelligent video analysis technology
CN109286788A (en) A kind of safety defense monitoring system based on cloud computing
CN209543514U (en) Monitoring and alarm system based on recognition of face
CN111540152A (en) Intelligent security early warning system
CN112396658A (en) Indoor personnel positioning method and positioning system based on video
CN113012374A (en) Intelligent park security system and control method thereof
CN112084963B (en) Monitoring early warning method, system and storage medium
CN109583339A (en) A kind of ATM video brainpower watch and control method based on image procossing
CN112800975A (en) Behavior identification method in security check channel based on image processing
CN113516691A (en) High-altitude parabolic detection system based on machine vision
CN105095891A (en) Human face capturing method, device and system
CN101814134A (en) Intelligent flame detection method based on computer vision monitoring technology
CN116993265A (en) Intelligent warehouse safety management system based on Internet of things

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
DD01 Delivery of document by public notice

Addressee: Su Song

Document name: Notice before the deadline for substantive examination of an invention patent application expires