Warehouse video monitoring system based on edge calculation
Technical Field
The invention relates to the technical field of intelligent video monitoring, in particular to a warehouse video monitoring system based on edge calculation.
Background
The video monitoring system is mainly used for video processing, target query, personnel tracking and the like, and gradually becomes an important guarantee for urban public safety. The video resolution ratio acquired by a front-end camera of the traditional video monitoring system is high, the video data volume is large, and the load of the computing and transmission bandwidth of the traditional cloud mode video monitoring system is heavy; the video processing capacity of the existing intelligent monitoring system is insufficient; the existing camera has the problems of large target information detection omission, low detection efficiency and the like due to the defects of computing capacity, time delay, bandwidth and the like of uploading data.
For the above-mentioned problems of unreliable moving target detection rate and time and space consumption for processing data amount, and incapability of guaranteeing real-time performance, there are two algorithms at present:
⑴ the weighted behavior recognition algorithm reduces the calculated amount of video analysis processing and solves the problem of high energy consumption, but the method only reduces the calculated amount of the behavior analysis stage and does not process redundant video frames.
⑵, the dynamic task scheduling algorithm migrates part of the calculation task to the cloud end to complete the calculation task, but under the scene of large traffic of people such as a station and an airport, the data volume is increased rapidly in a short time, and the target recognition rate is reduced to some extent.
Although the method improves the current situation that the cloud platform monitoring system has higher requirements on bandwidth and computing resources, the problems that video frames are not filtered and redundant edge data are transmitted are not fundamentally solved, so that the total computation amount is not reduced and the storage space is in short supply no matter how the computing tasks are migrated.
Disclosure of Invention
The invention discloses a warehouse video monitoring system based on edge calculation, which is characterized in that an analysis processing task is transferred to an edge node module, on the premise of ensuring the reliability of data, a large amount of real-time edge data generated by a monitoring acquisition terminal module in a short time are preprocessed, the video analysis speed is improved, the processing and transmission time delay is reduced, and the real-time performance of a monitoring video stream is ensured. Meanwhile, the moving target is detected by using an improved algorithm of fusing a two-frame difference method and a projection method, and the moving target is stored only when a moving object is detected in a monitored picture, so that the credibility of evidence information is enhanced, the storage space utilization rate of video data is improved, and a large amount of storage space is saved.
In order to achieve the purpose, the invention adopts the technical scheme that:
an edge computing based warehouse video surveillance system, comprising: the monitoring acquisition terminal module, the edge node module, the peripheral network transmission module and the terminal control end display module are connected in sequence; wherein:
the monitoring acquisition terminal module comprises a camera and a video converter, wherein the video converter converts an analog video signal acquired by the camera into a digital signal and transmits the digital signal to the edge node module;
the edge node module comprises a DSP unit and a data storage unit, the DSP unit is used for screening digital signals obtained by conversion of a video converter in the monitoring acquisition terminal module, compressing cached videos after the digital signals are processed, caching the videos into the data storage unit to form video streams, and sending the video streams to a terminal control end display module through the peripheral network transmission module;
the peripheral network transmission module is used for sending the cached video stream to the terminal control end display module in time;
and the terminal control end display module is used for receiving the video stream sent by the peripheral network transmission module, displaying the video and reminding a supervisor in front of the terminal control end.
Preferably, the digital signal is in a data format processable by the DSP.
Preferably, the screening process is to screen video frames according to an algorithm to select an effective video, judge whether the multi-angle projection of the current video frame is changed or not compared with the multi-angle projection of the previous frame according to an improved algorithm combining a two-frame difference method and a projection method, store the changed video frames to generate a buffer video frame sequence, and not store the unchanged video frames.
Preferably, the system further comprises a power supply module, wherein the power supply module is connected with other modules and supplies power to each module.
Compared with the prior art, the invention has the beneficial effects that:
1. according to the invention, by migrating the analysis processing task to the edge node module, on the premise of ensuring the reliability of data, a large amount of real-time edge data generated by the monitoring acquisition terminal module in a short time are preprocessed, so that the video analysis speed is improved, the processing and transmission delay is reduced, and the real-time performance of the monitoring video stream is ensured;
2. the invention uses the algorithm fused by the improved two-frame difference method and the projection method to detect the moving target, is more reliable than the artificial detection, and only stores when a moving object is detected in the monitoring picture, thereby not only reducing the storage of invalid videos, but also storing the evidence video data of the warehouse site, enhancing the credibility of the evidence information, improving the storage space utilization rate of the video data and saving a large amount of storage space.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic view of the structure of the present invention;
FIG. 2 is a schematic diagram of an edge node module preprocessing process according to the present invention;
FIG. 3 is a detailed flow chart of the present invention.
Detailed Description
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings.
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Example 1
As shown in fig. 1, a warehouse video monitoring system based on edge calculation includes: the monitoring acquisition terminal module 1, the edge node module 2, the peripheral network transmission module 3 and the terminal control end display module 4 are connected in sequence; wherein:
the monitoring acquisition terminal module 1 comprises a camera 11 and a video converter 12, wherein the video converter 12 converts an analog video signal acquired by the camera 11 into a digital signal and transmits the digital signal to the edge node module 2;
the edge node module 2 comprises a DSP unit 21 and a data storage unit 22, wherein the DSP unit 21 performs a screening process on the digital signal converted by the video converter 12 in the monitoring acquisition terminal module 1, compresses the cached video after the processing, caches the compressed video in the data storage unit 22 to form a video stream, and transmits the video stream to the terminal control end display module 4 through the peripheral network transmission module 3;
the peripheral network transmission module 3 is used for sending the cached video stream to the terminal control end display module 4 in time;
and the terminal control end display module 4 is used for receiving the video stream sent by the peripheral network transmission module 3, displaying the video and reminding a supervisor in front of the terminal control end.
The digital signal is in a data format which can be processed by the DSP.
The system also comprises a power supply module 5, wherein the power supply module 5 is connected with other modules and supplies power to each module.
Example 2
As shown in fig. 2, the pretreatment process of the edge node module 2 is described in detail based on embodiment 1:
after receiving the digital signal, the DSP unit 21 of the edge node module 2 screens the video frames according to the algorithm to select an effective video, and according to the algorithm that combines the improved two-frame difference method and the projection method, determines whether the multi-angle projection of the current video frame is changed or not compared with the multi-angle projection of the previous frame, stores the changed video frame, generates a sequence of buffered video frames, and the unchanged video frame is not stored, and after the processing is completed, compresses the buffered video, buffers the compressed video in the data storage unit 22, and sends the compressed video to the terminal control end display module 4 through the peripheral network transmission module 3.
The working process of the system is as follows:
the camera 11 is used as the input end of the system;
firstly, when the system acquires an effective video, the video converter 12 converts an analog video signal acquired by the camera 11 into a digital signal;
then, the video enters a DSP unit 21 for processing, an algorithm processed in the DSP unit 21 is cached in a data storage unit 22, whether the warehouse video is stored or not is judged according to an improved algorithm of combining a two-frame difference method and a projection method, namely whether the multi-angle projection of the current video frame is changed or not compared with the multi-angle projection of the previous frame is judged, the gray level projections of the two are subjected to difference processing, and if the difference is 0, the video is not stored; if not 0, it is buffered in the data storage unit 22. The video data are adjusted in real time in the preprocessing process, so that the storage of invalid videos is reduced, the storage space is reduced, the evidence video data of a warehouse site can be stored, and the credibility of evidence information is enhanced;
and finally, sending the cached video stream to a terminal control end display module 4 through a peripheral network transmission module 3.
By migrating the analysis processing task to the edge node module 2, on the premise of ensuring the reliability of data, a large amount of real-time edge data generated by the monitoring acquisition terminal module 1 in a short time are preprocessed, so that the video analysis speed is improved, the processing and transmission delay is reduced, and the real-time performance of monitoring video stream is ensured.
Compared with a cloud computing model, the video transmission and processing overhead is reduced. The influence of transmission and processing time delay is considered, the system firstly screens out effective video frames to upload, and the space occupied by the processed video is greatly reduced through a compression coding technology, so that the real-time performance and the resource utilization rate of the video stream are improved.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement, component separation or combination and the like made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.