CN110913181A - Warehouse video monitoring system based on edge calculation - Google Patents
Warehouse video monitoring system based on edge calculation Download PDFInfo
- Publication number
- CN110913181A CN110913181A CN201911243267.2A CN201911243267A CN110913181A CN 110913181 A CN110913181 A CN 110913181A CN 201911243267 A CN201911243267 A CN 201911243267A CN 110913181 A CN110913181 A CN 110913181A
- Authority
- CN
- China
- Prior art keywords
- video
- module
- edge
- control end
- monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 34
- 238000004364 calculation method Methods 0.000 title claims abstract description 9
- 238000000034 method Methods 0.000 claims abstract description 25
- 230000005540 biological transmission Effects 0.000 claims abstract description 22
- 230000002093 peripheral effect Effects 0.000 claims abstract description 15
- 238000013500 data storage Methods 0.000 claims description 9
- 238000012216 screening Methods 0.000 claims description 5
- 238000006243 chemical reaction Methods 0.000 claims description 2
- 238000012545 processing Methods 0.000 abstract description 18
- 238000004458 analytical method Methods 0.000 abstract description 10
- 238000001514 detection method Methods 0.000 description 4
- 239000000872 buffer Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/188—Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/91—Television signal processing therefor
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention discloses a warehouse video monitoring system based on edge calculation, which comprises: the monitoring acquisition terminal module, the edge node module, the peripheral network transmission module and the terminal control end display module are connected in sequence; the power supply module is used for supplying power to each module. According to the invention, by migrating the analysis processing task to the edge node module, on the premise of ensuring the data reliability, the method and the system preprocess a large amount of real-time edge data generated by the monitoring acquisition terminal module in a short time, thereby improving the video analysis speed, reducing the processing and transmission time delay and ensuring the real-time performance of the monitoring video stream. Meanwhile, an improved algorithm combining a two-frame difference method and a projection method is used for detecting the moving target, and only when a moving object is detected in a monitored picture, the moving object is stored, so that the credibility of evidence information is enhanced, the storage space utilization rate of video data is improved, and a large amount of storage space is saved.
Description
Technical Field
The invention relates to the technical field of intelligent video monitoring, in particular to a warehouse video monitoring system based on edge calculation.
Background
The video monitoring system is mainly used for video processing, target query, personnel tracking and the like, and gradually becomes an important guarantee for urban public safety. The video resolution ratio acquired by a front-end camera of the traditional video monitoring system is high, the video data volume is large, and the load of the computing and transmission bandwidth of the traditional cloud mode video monitoring system is heavy; the video processing capacity of the existing intelligent monitoring system is insufficient; the existing camera has the problems of large target information detection omission, low detection efficiency and the like due to the defects of computing capacity, time delay, bandwidth and the like of uploading data.
For the above-mentioned problems of unreliable moving target detection rate and time and space consumption for processing data amount, and incapability of guaranteeing real-time performance, there are two algorithms at present:
⑴ the weighted behavior recognition algorithm reduces the calculated amount of video analysis processing and solves the problem of high energy consumption, but the method only reduces the calculated amount of the behavior analysis stage and does not process redundant video frames.
⑵, the dynamic task scheduling algorithm migrates part of the calculation task to the cloud end to complete the calculation task, but under the scene of large traffic of people such as a station and an airport, the data volume is increased rapidly in a short time, and the target recognition rate is reduced to some extent.
Although the method improves the current situation that the cloud platform monitoring system has higher requirements on bandwidth and computing resources, the problems that video frames are not filtered and redundant edge data are transmitted are not fundamentally solved, so that the total computation amount is not reduced and the storage space is in short supply no matter how the computing tasks are migrated.
Disclosure of Invention
The invention discloses a warehouse video monitoring system based on edge calculation, which is characterized in that an analysis processing task is transferred to an edge node module, on the premise of ensuring the reliability of data, a large amount of real-time edge data generated by a monitoring acquisition terminal module in a short time are preprocessed, the video analysis speed is improved, the processing and transmission time delay is reduced, and the real-time performance of a monitoring video stream is ensured. Meanwhile, the moving target is detected by using an improved algorithm of fusing a two-frame difference method and a projection method, and the moving target is stored only when a moving object is detected in a monitored picture, so that the credibility of evidence information is enhanced, the storage space utilization rate of video data is improved, and a large amount of storage space is saved.
In order to achieve the purpose, the invention adopts the technical scheme that:
an edge computing based warehouse video surveillance system, comprising: the monitoring acquisition terminal module, the edge node module, the peripheral network transmission module and the terminal control end display module are connected in sequence; wherein:
the monitoring acquisition terminal module comprises a camera and a video converter, wherein the video converter converts an analog video signal acquired by the camera into a digital signal and transmits the digital signal to the edge node module;
the edge node module comprises a DSP unit and a data storage unit, the DSP unit is used for screening digital signals obtained by conversion of a video converter in the monitoring acquisition terminal module, compressing cached videos after the digital signals are processed, caching the videos into the data storage unit to form video streams, and sending the video streams to a terminal control end display module through the peripheral network transmission module;
the peripheral network transmission module is used for sending the cached video stream to the terminal control end display module in time;
and the terminal control end display module is used for receiving the video stream sent by the peripheral network transmission module, displaying the video and reminding a supervisor in front of the terminal control end.
Preferably, the digital signal is in a data format processable by the DSP.
Preferably, the screening process is to screen video frames according to an algorithm to select an effective video, judge whether the multi-angle projection of the current video frame is changed or not compared with the multi-angle projection of the previous frame according to an improved algorithm combining a two-frame difference method and a projection method, store the changed video frames to generate a buffer video frame sequence, and not store the unchanged video frames.
Preferably, the system further comprises a power supply module, wherein the power supply module is connected with other modules and supplies power to each module.
Compared with the prior art, the invention has the beneficial effects that:
1. according to the invention, by migrating the analysis processing task to the edge node module, on the premise of ensuring the reliability of data, a large amount of real-time edge data generated by the monitoring acquisition terminal module in a short time are preprocessed, so that the video analysis speed is improved, the processing and transmission delay is reduced, and the real-time performance of the monitoring video stream is ensured;
2. the invention uses the algorithm fused by the improved two-frame difference method and the projection method to detect the moving target, is more reliable than the artificial detection, and only stores when a moving object is detected in the monitoring picture, thereby not only reducing the storage of invalid videos, but also storing the evidence video data of the warehouse site, enhancing the credibility of the evidence information, improving the storage space utilization rate of the video data and saving a large amount of storage space.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic view of the structure of the present invention;
FIG. 2 is a schematic diagram of an edge node module preprocessing process according to the present invention;
FIG. 3 is a detailed flow chart of the present invention.
Detailed Description
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings.
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Example 1
As shown in fig. 1, a warehouse video monitoring system based on edge calculation includes: the monitoring acquisition terminal module 1, the edge node module 2, the peripheral network transmission module 3 and the terminal control end display module 4 are connected in sequence; wherein:
the monitoring acquisition terminal module 1 comprises a camera 11 and a video converter 12, wherein the video converter 12 converts an analog video signal acquired by the camera 11 into a digital signal and transmits the digital signal to the edge node module 2;
the edge node module 2 comprises a DSP unit 21 and a data storage unit 22, wherein the DSP unit 21 performs a screening process on the digital signal converted by the video converter 12 in the monitoring acquisition terminal module 1, compresses the cached video after the processing, caches the compressed video in the data storage unit 22 to form a video stream, and transmits the video stream to the terminal control end display module 4 through the peripheral network transmission module 3;
the peripheral network transmission module 3 is used for sending the cached video stream to the terminal control end display module 4 in time;
and the terminal control end display module 4 is used for receiving the video stream sent by the peripheral network transmission module 3, displaying the video and reminding a supervisor in front of the terminal control end.
The digital signal is in a data format which can be processed by the DSP.
The system also comprises a power supply module 5, wherein the power supply module 5 is connected with other modules and supplies power to each module.
Example 2
As shown in fig. 2, the pretreatment process of the edge node module 2 is described in detail based on embodiment 1:
after receiving the digital signal, the DSP unit 21 of the edge node module 2 screens the video frames according to the algorithm to select an effective video, and according to the algorithm that combines the improved two-frame difference method and the projection method, determines whether the multi-angle projection of the current video frame is changed or not compared with the multi-angle projection of the previous frame, stores the changed video frame, generates a sequence of buffered video frames, and the unchanged video frame is not stored, and after the processing is completed, compresses the buffered video, buffers the compressed video in the data storage unit 22, and sends the compressed video to the terminal control end display module 4 through the peripheral network transmission module 3.
The working process of the system is as follows:
the camera 11 is used as the input end of the system;
firstly, when the system acquires an effective video, the video converter 12 converts an analog video signal acquired by the camera 11 into a digital signal;
then, the video enters a DSP unit 21 for processing, an algorithm processed in the DSP unit 21 is cached in a data storage unit 22, whether the warehouse video is stored or not is judged according to an improved algorithm of combining a two-frame difference method and a projection method, namely whether the multi-angle projection of the current video frame is changed or not compared with the multi-angle projection of the previous frame is judged, the gray level projections of the two are subjected to difference processing, and if the difference is 0, the video is not stored; if not 0, it is buffered in the data storage unit 22. The video data are adjusted in real time in the preprocessing process, so that the storage of invalid videos is reduced, the storage space is reduced, the evidence video data of a warehouse site can be stored, and the credibility of evidence information is enhanced;
and finally, sending the cached video stream to a terminal control end display module 4 through a peripheral network transmission module 3.
By migrating the analysis processing task to the edge node module 2, on the premise of ensuring the reliability of data, a large amount of real-time edge data generated by the monitoring acquisition terminal module 1 in a short time are preprocessed, so that the video analysis speed is improved, the processing and transmission delay is reduced, and the real-time performance of monitoring video stream is ensured.
Compared with a cloud computing model, the video transmission and processing overhead is reduced. The influence of transmission and processing time delay is considered, the system firstly screens out effective video frames to upload, and the space occupied by the processed video is greatly reduced through a compression coding technology, so that the real-time performance and the resource utilization rate of the video stream are improved.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement, component separation or combination and the like made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims (4)
1. A warehouse video surveillance system based on edge computing, comprising: the monitoring acquisition terminal module, the edge node module, the peripheral network transmission module and the terminal control end display module are connected in sequence; wherein:
the monitoring acquisition terminal module comprises a camera and a video converter, wherein the video converter converts an analog video signal acquired by the camera into a digital signal and transmits the digital signal to the edge node module;
the edge node module comprises a DSP unit and a data storage unit, the DSP unit is used for screening digital signals obtained by conversion of a video converter in the monitoring acquisition terminal module, compressing cached videos after the digital signals are processed, caching the videos into the data storage unit to form video streams, and sending the video streams to a terminal control end display module through the peripheral network transmission module;
the peripheral network transmission module is used for sending the cached video stream to the terminal control end display module in time;
and the terminal control end display module is used for receiving the video stream sent by the peripheral network transmission module, displaying the video and reminding a supervisor in front of the terminal control end.
2. The edge computing-based warehouse video monitoring system of claim 1, wherein the digital signals are in a data format that is processable by a DSP.
3. The edge-computing-based warehouse video monitoring system of claim 1, wherein the screening process screens video frames according to an algorithm to select valid videos, judges whether the multi-angle projection of a previous frame is changed or not in comparison with the multi-angle projection of a current video frame according to an improved algorithm combining a two-frame difference method and a projection method, stores the changed video frames to generate a sequence of cached video frames, and does not store the unchanged video frames.
4. The video monitoring system for the warehouse based on the edge calculation as claimed in any one of claims 1 to 4, wherein the system further comprises a power module, and the power module is connected with other modules to supply power to each module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911243267.2A CN110913181A (en) | 2019-12-06 | 2019-12-06 | Warehouse video monitoring system based on edge calculation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911243267.2A CN110913181A (en) | 2019-12-06 | 2019-12-06 | Warehouse video monitoring system based on edge calculation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110913181A true CN110913181A (en) | 2020-03-24 |
Family
ID=69822978
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911243267.2A Pending CN110913181A (en) | 2019-12-06 | 2019-12-06 | Warehouse video monitoring system based on edge calculation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110913181A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111614936A (en) * | 2020-05-09 | 2020-09-01 | 安徽三音电子科技有限公司 | Video monitoring system for cloud computing data center |
| CN111866450A (en) * | 2020-06-18 | 2020-10-30 | 昇辉控股有限公司 | Intelligent video monitoring device based on cloud edge cooperation |
| CN112040189A (en) * | 2020-09-01 | 2020-12-04 | 浙江大华技术股份有限公司 | Monitoring method and system of front-end equipment and storage medium |
| CN112738458A (en) * | 2020-12-21 | 2021-04-30 | 山东产研信息与人工智能融合研究院有限公司 | Cotton bale quantity detection device and method based on video identification |
| CN113055654A (en) * | 2021-03-26 | 2021-06-29 | 太原师范学院 | Method for lossy compression of video stream in edge device |
| CN113542714A (en) * | 2021-07-02 | 2021-10-22 | 恒大新能源汽车投资控股集团有限公司 | Remote interactive communication system and device |
| WO2021218384A1 (en) * | 2020-04-29 | 2021-11-04 | 华为技术有限公司 | Algorithm update method, system and device |
| CN113747222A (en) * | 2021-09-07 | 2021-12-03 | 湖南五凌电力科技有限公司 | Picture synchronous transmission method and system based on edge calculation |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102625082A (en) * | 2012-02-29 | 2012-08-01 | 中山大学 | Video monitoring system |
| WO2017118640A1 (en) * | 2016-01-08 | 2017-07-13 | Siemens Aktiengesellschaft | Field data transmission apparatus, method and system |
| CN107093186A (en) * | 2017-03-10 | 2017-08-25 | 北京环境特性研究所 | The strenuous exercise's detection method matched based on edge projection |
| CN109118510A (en) * | 2018-08-10 | 2019-01-01 | 平安科技（深圳）有限公司 | A kind of monitor video processing method, device and computer-readable medium |
| CN109194926A (en) * | 2018-10-19 | 2019-01-11 | 济南浪潮高新科技投资发展有限公司 | A kind of city security system and its detection method based on edge calculations |
| CN110381298A (en) * | 2019-08-16 | 2019-10-25 | 深圳江行联加智能科技有限公司 | A kind of method, apparatus and system of tunnel video monitoring |
| CN110428522A (en) * | 2019-07-24 | 2019-11-08 | 青岛联合创智科技有限公司 | A kind of intelligent safety and defence system of wisdom new city |
| CN210839843U (en) * | 2019-12-06 | 2020-06-23 | 太原师范学院 | Warehouse video monitoring system based on edge calculation |
-
2019
- 2019-12-06 CN CN201911243267.2A patent/CN110913181A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102625082A (en) * | 2012-02-29 | 2012-08-01 | 中山大学 | Video monitoring system |
| WO2017118640A1 (en) * | 2016-01-08 | 2017-07-13 | Siemens Aktiengesellschaft | Field data transmission apparatus, method and system |
| CN107093186A (en) * | 2017-03-10 | 2017-08-25 | 北京环境特性研究所 | The strenuous exercise's detection method matched based on edge projection |
| CN109118510A (en) * | 2018-08-10 | 2019-01-01 | 平安科技（深圳）有限公司 | A kind of monitor video processing method, device and computer-readable medium |
| CN109194926A (en) * | 2018-10-19 | 2019-01-11 | 济南浪潮高新科技投资发展有限公司 | A kind of city security system and its detection method based on edge calculations |
| CN110428522A (en) * | 2019-07-24 | 2019-11-08 | 青岛联合创智科技有限公司 | A kind of intelligent safety and defence system of wisdom new city |
| CN110381298A (en) * | 2019-08-16 | 2019-10-25 | 深圳江行联加智能科技有限公司 | A kind of method, apparatus and system of tunnel video monitoring |
| CN210839843U (en) * | 2019-12-06 | 2020-06-23 | 太原师范学院 | Warehouse video monitoring system based on edge calculation |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021218384A1 (en) * | 2020-04-29 | 2021-11-04 | 华为技术有限公司 | Algorithm update method, system and device |
| CN111614936A (en) * | 2020-05-09 | 2020-09-01 | 安徽三音电子科技有限公司 | Video monitoring system for cloud computing data center |
| CN111866450A (en) * | 2020-06-18 | 2020-10-30 | 昇辉控股有限公司 | Intelligent video monitoring device based on cloud edge cooperation |
| CN112040189A (en) * | 2020-09-01 | 2020-12-04 | 浙江大华技术股份有限公司 | Monitoring method and system of front-end equipment and storage medium |
| CN112738458A (en) * | 2020-12-21 | 2021-04-30 | 山东产研信息与人工智能融合研究院有限公司 | Cotton bale quantity detection device and method based on video identification |
| CN113055654A (en) * | 2021-03-26 | 2021-06-29 | 太原师范学院 | Method for lossy compression of video stream in edge device |
| CN113542714A (en) * | 2021-07-02 | 2021-10-22 | 恒大新能源汽车投资控股集团有限公司 | Remote interactive communication system and device |
| CN113747222A (en) * | 2021-09-07 | 2021-12-03 | 湖南五凌电力科技有限公司 | Picture synchronous transmission method and system based on edge calculation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110913181A (en) | Warehouse video monitoring system based on edge calculation | |
| CN105791431B (en) | A kind of distribution on line formula monitor video processing method for scheduling task and device | |
| Wang et al. | Enabling edge-cloud video analytics for robotics applications | |
| CN111047818A (en) | Forest fire early warning system based on video image | |
| CN110390246A (en) | A kind of video analysis method in side cloud environment | |
| CN103297754A (en) | Monitoring video self-adaption interesting area coding system | |
| CN102355572A (en) | Large high-definition video monitoring system based on cloud computing | |
| CN112309068B (en) | Forest fire early warning method based on deep learning | |
| CN210839843U (en) | Warehouse video monitoring system based on edge calculation | |
| CN111510774A (en) | Intelligent terminal image compression algorithm combining edge calculation and deep learning | |
| KR101365237B1 (en) | Surveilance camera system supporting adaptive multi resolution | |
| CN103634552A (en) | Monitoring video storage method, system and central management server | |
| CN104853060A (en) | High-definition video preprocessing method and system | |
| CN102523432A (en) | Intelligent vehicle-mounted monitoring system based on third generation (3G) | |
| CN114679607A (en) | Video frame rate control method and device, electronic equipment and storage medium | |
| CN103533358A (en) | Self adaption image collection transmission and display device | |
| CN110087041A (en) | Video data processing and transmission method and system based on the base station 5G | |
| CN115695720A (en) | Intelligent monitoring method and device for smart city road and electronic equipment | |
| CN113642403A (en) | Crowd abnormal intelligent safety detection system based on edge calculation | |
| CN102104721A (en) | Double-mode intelligent vision sensing system architecture | |
| CN102355575A (en) | Distributed video monitoring device with pre-warning function | |
| CN201238358Y (en) | Full-view intelligent video monitoring hardware platform | |
| Hou et al. | Real-time surveillance video salient object detection using collaborative cloud-edge deep reinforcement learning | |
| CN209895464U (en) | Transformer substation abnormity monitoring and alarming system | |
| CN110807444A (en) | Pedestrian abnormal behavior detection system and method based on DSP edge calculation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |