CN113794855A - Transmission control system and method for video data of video monitoring system - Google Patents
Transmission control system and method for video data of video monitoring system Download PDFInfo
- Publication number
- CN113794855A CN113794855A CN202110851590.9A CN202110851590A CN113794855A CN 113794855 A CN113794855 A CN 113794855A CN 202110851590 A CN202110851590 A CN 202110851590A CN 113794855 A CN113794855 A CN 113794855A
- Authority
- CN
- China
- Prior art keywords
- video
- module
- background
- monitoring
- sending
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 127
- 230000005540 biological transmission Effects 0.000 title claims abstract description 109
- 238000000034 method Methods 0.000 title claims abstract description 25
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 33
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 33
- 238000012545 processing Methods 0.000 claims abstract description 31
- 238000001514 detection method Methods 0.000 claims description 52
- 230000003044 adaptive effect Effects 0.000 claims description 8
- 239000000284 extract Substances 0.000 claims description 7
- 230000033001 locomotion Effects 0.000 claims description 6
- 238000003062 neural network model Methods 0.000 claims description 3
- 230000002194 synthesizing effect Effects 0.000 claims description 3
- 230000008859 change Effects 0.000 description 9
- 238000007906 compression Methods 0.000 description 7
- 230000006835 compression Effects 0.000 description 7
- 238000007726 management method Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000013144 data compression Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W28/00—Network traffic management; Network resource management
- H04W28/02—Traffic management, e.g. flow control or congestion control
- H04W28/0231—Traffic management, e.g. flow control or congestion control based on communication conditions
- H04W28/0236—Traffic management, e.g. flow control or congestion control based on communication conditions radio quality, e.g. interference, losses or delay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W28/00—Network traffic management; Network resource management
- H04W28/02—Traffic management, e.g. flow control or congestion control
- H04W28/0273—Traffic management, e.g. flow control or congestion control adapting protocols for flow control or congestion control to wireless environment, e.g. adapting transmission control protocol [TCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W28/00—Network traffic management; Network resource management
- H04W28/02—Traffic management, e.g. flow control or congestion control
- H04W28/06—Optimizing the usage of the radio link, e.g. header compression, information sizing, discarding information
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention relates to the technical field of data transmission of monitoring systems, in particular to a transmission control system and method for video data of a video monitoring system. The system comprises a monitoring camera, a background library, a background identification module, an image processing module, an image library, an image synthesis module and an inquiry output module; the monitoring camera, the background library connection, the background recognition module, the image processing module and the video coding unit are sequentially connected; the image library is connected with the video decoding unit and the video synthesis module; the image synthesis module is respectively connected with the background library, the background identification module and the query output module; the invention separates the background image and the active video part of the monitoring system in advance, identifies the background image in advance, and only transmits the active video part during transmission, thereby greatly reducing the quantity of video data to be transmitted, reducing the possibility of channel blockage, and improving the reliability and the safety of the transmission of the monitoring video.
Description
Technical Field
The invention relates to the technical field of data transmission of monitoring systems, in particular to a transmission control system and method for video data of a video monitoring system.
Background
With the continuous innovation of network information technology and the continuous breakthrough of hardware manufacturing technology, video monitoring systems developed based on security monitoring technology are also continuously upgraded, and the development from closed-circuit systems mainly based on analog equipment, i.e. analog video monitoring systems, to full-digital monitoring and remote network video monitoring systems is advanced. The video monitoring system generally selects the H.264 standard as a video format for transmission, and the video stream compressed according to the standard has a higher compression ratio, and can automatically adjust the coding rate along with the change of the channel condition, so the video monitoring system is very suitable for Intene remote transmission. The most important link for realizing remote monitoring is to ensure the safe, complete and timely transmission of the monitoring video code stream, but the dynamic change of the network transmission environment easily causes congestion, so that the code stream frame loss delay is caused, and the video quality and complete transmission are seriously affected, so that how to solve the core problem that the realization of high-quality transmission of the monitoring video becomes the design of a remote monitoring system under the frequent change of a channel. The real-time transmission of video code streams is the primary problem which puzzles the normal work of a remote monitoring system, if a special network is adopted, the code streams can be transmitted with high quality and high efficiency, but the cost is very expensive, and if a public network is adopted to transmit real-time videos, the transmission problem under low bandwidth needs to be solved. The existing video transmission methods mainly include the following 3 methods:
1) using TCP protocol
The TCP protocol provides reliable and controllable connection for the transmission process, and ensures that transmission data can be completely and nondefectively received through three times of information/handshake between a sender and a receiver, but the biggest defect of adopting the TCP protocol is that a control mechanism and a connection method thereof are too complex, and precious system resources are occupied, so that delay is possibly caused.
2) Using UDP protocol
The UDP protocol is different in that it provides a connectionless transmission, and has high transmission efficiency because there is no judgment of any connection state, and the UDP packet has strong network penetration capability, and can be used for network communication in a situation where the network environment is relatively complex, but it cannot detect whether a packet loss occurs during transmission because it does not provide the judgment of the connection state, and cannot provide transmission integrity and security control because it cannot obtain information feedback sent back by a receiving party.
3) Encapsulating data packets
The method is characterized in that a packaged data packet is a transmission mode with high efficiency, a system can adjust the volume of the data packet according to the change of a transmission environment, and the transmission throughput is flexibly controlled, but the method needs to be provided with an efficient and perfect error detection scheme, in order to ensure the integrity of data transmission, a receiving party needs to carry out the work of error rearrangement, packet loss judgment and the like on the received data packet, and if the efficiency of error detection work is low, time delay can occur.
In summary, in view of the uncertainty of the network environment, if there is no pre-determination on the channel communication quality, it is difficult to implement real-time transmission of the code stream only by using a single transmission method, and the video quality cannot be guaranteed. Chinese patent: the adaptive transmission method and system (CN101222296B) in uplink cellular video communication disclose a video adaptive transmission system, but it is not applicable to video transmission of a monitoring system, and the video transmission of the monitoring system is large and large, and if video data is lost, the security and later forensics of the system are affected.
Disclosure of Invention
In order to solve the above problems, the present invention provides a transmission control system and method for video data of a video monitoring system, which is used for improving the transmission quality of video, and the specific technical scheme is as follows:
a transmission control system of video data of a video monitoring system comprises a sending end transmission control unit, a receiving end transmission control unit, a video coding unit and a video decoding unit; the transmitting end transmission control unit is connected with the video coding unit; the receiving end transmission control unit is connected with the video decoding unit; the transmission control unit of the sending end also comprises a sending cache module, a sending rate control module, a code rate control module, a bandwidth detection module and a wireless transceiving module,
the receiving end transmission control unit comprises a wireless or wired transceiving module, a receiving cache module and a channel detection module;
the system also comprises a monitoring camera, a background library, a background recognition module, an image processing module, an image library, an image synthesis module and an inquiry output module; the monitoring camera, the background library connection, the background recognition module, the image processing module and the video coding unit are sequentially connected; the image library is connected with the video decoding unit and the video synthesis module; the image synthesis module is respectively connected with the background library, the background identification module and the query output module;
the monitoring camera is used for acquiring background images and monitoring videos of all monitoring areas, storing the acquired background images into a background library in advance and inputting the acquired monitoring videos into a background identification module;
the background recognition module is used for extracting a background image in a monitoring video transmitted by the monitoring camera, matching the extracted background image part with background images of all monitoring areas pre-stored in a background library, and inputting a recognition result to the video synthesis module and the image processing module;
the image processing module is used for extracting a movable video part in the monitoring video according to the identification result of the background identification module and inputting the extracted video part into the video coding unit for coding;
the video coding unit is used for coding the active video part extracted by the image processing module and inputting the coded video stream to the sending cache module;
the sending and caching module is used for receiving and caching the bit stream of the active video part sent by the video coding unit;
the bandwidth detection module is used for receiving packet loss rate feedback information from a receiving end through the wireless transceiving module, counting according to the information to obtain the current available channel bandwidth, further setting a sending rate and an information source target code rate, inputting the set sending rate to the sending rate control module, and inputting the set information source target code rate to the code rate control module;
the sending rate control module is used for sending the bit stream in the sending cache module into the wireless transceiving module according to the channel bandwidth detected by the bandwidth detection module and the sending rate given by the bandwidth detection module, sending the bit stream out through the wireless transceiving module and transmitting the bit stream to a receiving end through a transmission network;
the code rate control module is used for calculating a target coding rate of the video coding unit according to an information source target code rate given by the bandwidth detection module through management aiming at the sending cache module, and transmitting the target coding rate to the video coding unit, and the video coding unit carries out coding according to the video coding rate to obtain a coding rate adaptive to the channel bandwidth;
the wireless or wired transceiving module is used for receiving the bit stream transmitted by the wireless transceiving module, sending the bit stream to the receiving cache module and then sending the bit stream to the video decoding unit;
the channel detection module analyzes the bit stream in the receiving cache module, counts packet loss conditions according to the continuity of the serial numbers of packet headers, generates a feedback real-time transmission control protocol packet according to a real-time transmission control protocol, transmits the feedback real-time transmission control protocol packet to the wireless or wired transceiving module, and transmits the feedback real-time transmission control protocol packet to the broadband detection module through the wireless or wired transceiving module and the transmission network;
the video decoding unit is used for decoding the moving part video cached in the receiving caching module and storing the moving part video in an image library;
the video synthesis module is used for matching the decoded moving part video stored in the image library according to the recognition result of the background recognition module, synthesizing the monitoring video of the corresponding monitoring area, and outputting the monitoring video of the corresponding area meeting the query condition through the query output module.
Preferably, the query output module is configured to input a query condition, and the video synthesis module synthesizes the monitoring videos meeting the query condition according to the query condition input by the query output module, and feeds the monitoring videos back to the user in a descending order according to the similarity.
Preferably, the method for extracting the moving video by the image processing module is as follows: three motion parameters are adopted for simultaneous detection, which are respectively as follows: (1) average value of absolute difference of corresponding pixels of the previous and the next frame images;
(2) average value of absolute difference value of corresponding pixels of the front and rear frame images in vertical direction;
(3) the average value of the absolute difference value of the corresponding pixels in the horizontal direction of the previous and next frame images.
Preferably, the video monitoring system further comprises a video database, wherein the video database is connected with the image synthesis module and used for storing the synthesized monitoring video, and the storage structure is divided into two parts, namely, a pointer of the recorded conventional data and video image data, and multimedia data of the video image, frames are constructed by using a double-linked list, the frame index and the frame video data are records which can be lengthened, and each record is stored by using a single-linked list.
Preferably, the background recognition module recognizes the background image by using a neural network model.
Preferably, the background recognition module obtains a recognition result by calculating the similarity between the extracted background image and each background image pre-stored in the background library, and if the calculated similarity is the maximum, the extracted background image and the corresponding background image in the background library with the calculated maximum similarity are matched background images.
Preferably, the similarity between the extracted background image and each background image pre-stored in the background library is judged by using the euclidean distance.
Preferably, if the packet loss rate fed back by the receiving party and received by the bandwidth detection module exceeds a set threshold, the monitoring video is encapsulated into a custom RTP data packet, and the data is sent to the receiving party;
and if the packet loss rate does not exceed the set threshold, adaptively adjusting the coding rate.
Preferably, the synthesized surveillance video is compressed by the video synthesis module and then stored in the video database.
A transmission control method of video data of a video monitoring system comprises the following steps:
(1) the monitoring camera collects background images and monitoring videos of all monitoring areas, stores the collected background images in a background library in advance and inputs the collected monitoring videos into a background identification module;
(2) the background recognition module extracts a background image in a monitoring video transmitted by the monitoring camera, matches the extracted background image part with background images of all monitoring areas stored in a background library in advance, and inputs a recognition result to the video synthesis module and the image processing module;
(3) the image processing module extracts a movable video part in the monitoring video according to the identification result of the background identification module and inputs the extracted video part into the video coding unit for coding;
(4) the video coding unit codes the active video part extracted by the image processing module and inputs the coded video stream to the sending cache module;
(5) the sending and caching module receives and caches the bit stream of the active video part sent by the video coding unit;
(6) the bandwidth detection module receives packet loss rate feedback information from a receiving end through the wireless transceiving module, obtains the current available channel bandwidth according to the information statistics, further sets a sending rate and an information source target code rate, inputs the set sending rate to the sending rate control module, and inputs the set information source target code rate to the code rate control module;
(7) the sending rate control module sends the bit stream in the sending cache module into the wireless transceiving module according to the sending rate given by the bandwidth detection module according to the channel bandwidth detected by the bandwidth detection module, sends the bit stream out through the wireless transceiving module, and transmits the bit stream to a receiving end through a transmission network;
(8) the code rate control module calculates a target coding code rate of the video coding unit according to an information source target code rate given by the bandwidth detection module through management aiming at the sending cache module, and transmits the target coding code rate to the video coding unit, and the video coding unit performs coding according to the video coding code rate to obtain a coding code rate adaptive to the channel bandwidth;
(9) the wireless or wired transceiving module receives the bit stream transmitted by the wireless transceiving module, sends the bit stream to the receiving cache module and then sends the bit stream to the video decoding unit;
(10) the channel detection module analyzes the bit stream in the receiving cache module, counts packet loss conditions according to the continuity of the serial numbers of the packet headers, generates a feedback real-time transmission control protocol packet according to a real-time transmission control protocol, transmits the feedback real-time transmission control protocol packet to the wireless or wired transceiving module, and transmits the feedback real-time transmission control protocol packet to the broadband detection module through the wireless or wired transceiving module and the transmission network;
(11) the video decoding unit decodes the video of the active part cached in the receiving caching module and stores the decoded video in an image library;
(12) the video synthesis module matches the decoded moving part video stored in the image library according to the recognition result of the background recognition module, synthesizes the monitoring video of the corresponding monitoring area, and outputs the monitoring video of the corresponding area meeting the query condition through the query output module.
The invention has the beneficial effects that: in the work, the video image of the monitoring system is found to have the characteristics that 1) the video image of the monitoring system has small change and great frame correlation, and the whole video image can be divided into two areas. Background area the camera of the monitoring system is typically mounted in a fixed location where the accident is likely to occur. Moving object region the proportion of moving parts is small, and sometimes there is little or no change over a long period of time. 2) And the video and audio synchronization problem is not considered.
Compared with the prior art, the method separates the background image and the active video part of the monitoring system in advance, identifies the background image in advance, transmits only the active video part during transmission, greatly reduces the quantity of video data to be transmitted, reduces the possibility of channel blockage, improves the reliability and safety of monitoring video transmission, and is provided with the self-adaptive code rate transmission system to form a closed-loop feedback control system, further improves the reliability and safety of monitoring video transmission, and greatly reduces the possibility of loss of monitoring video data packets. Therefore, unattended operation of the transformer substation is achieved, and powerful technical support is provided for promoting the development of the management of the power grid to the direction of automation, integration, centralization and intellectualization step by step.
The method is characterized in that monitoring video information is stored in a database, the problem of data compression must be solved firstly, the key to be solved by a video monitoring system is the collection, storage and transmission of huge data volume, therefore, if data compression is not carried out, the existing network cannot process video data at all, at present, a plurality of coding schemes designed for different transmission code rate applications exist, but the prior art does not fully utilize the characteristics of industrial video images, and simultaneously does not consider the visual characteristics of monitored scenes, so the compression ratio is not high, and the method is also one of the reasons for the difficulty in improving the compression capability of a compression coding method. Therefore, the video coding unit of the invention adopts compression coding, and the synthesized monitoring video is compressed and stored in the video database, thereby reducing the network resource and storage space occupied by the video data and improving the convenience.
The invention records the video image through the video communication interface, extracts the moving part, namely the part different from the background library, by the image processing module, stores the compressed moving part into the moving video library or the image library, thereby reducing the data volume and improving the compression ratio.
Drawings
FIG. 1 is a schematic diagram of the system of the present invention.
Detailed Description
For a better understanding of the present invention, reference is made to the following detailed description taken in conjunction with the accompanying drawings in which:
as shown in fig. 1, a transmission control system for video data of a video monitoring system includes a transmitting end transmission control unit, a receiving end transmission control unit, a video encoding unit, and a video decoding unit; the transmitting end transmission control unit is connected with the video coding unit; the receiving end transmission control unit is connected with the video decoding unit; the transmitting end transmission control unit also comprises a transmitting cache module, a transmitting rate control module, a code rate control module, a bandwidth detection module and a wireless transceiving module, and the receiving end transmission control unit comprises a wireless or wired transceiving module, a receiving cache module and a channel detection module;
the system also comprises a monitoring camera, a background library, a background recognition module, an image processing module, an image library, an image synthesis module and an inquiry output module; the monitoring camera, the background library connection, the background recognition module, the image processing module and the video coding unit are sequentially connected; the image library is connected with the video decoding unit and the video synthesis module; the image synthesis module is respectively connected with the background library, the background identification module and the query output module;
the monitoring camera is used for acquiring background images and monitoring videos of all monitoring areas, storing the acquired background images into a background library in advance and inputting the acquired monitoring videos into a background identification module;
the background recognition module is used for extracting a background image in a monitoring video transmitted by the monitoring camera, matching the extracted background image part with background images of all monitoring areas pre-stored in a background library, and inputting a recognition result to the video synthesis module and the image processing module;
the image processing module is used for extracting a movable video part in the monitoring video according to the identification result of the background identification module and inputting the extracted video part into the video coding unit for coding;
the video coding unit is used for coding the active video part extracted by the image processing module and inputting the coded video stream to the sending cache module;
the sending and caching module is used for receiving and caching the bit stream of the active video part sent by the video coding unit;
the bandwidth detection module is used for receiving packet loss rate feedback information from a receiving end through the wireless transceiving module, counting according to the information to obtain the current available channel bandwidth, further setting a sending rate and an information source target code rate, inputting the set sending rate to the sending rate control module, and inputting the set information source target code rate to the code rate control module;
the sending rate control module is used for sending the bit stream in the sending cache module into the wireless transceiving module according to the channel bandwidth detected by the bandwidth detection module and the sending rate given by the bandwidth detection module, sending the bit stream out through the wireless transceiving module and transmitting the bit stream to a receiving end through a transmission network;
the code rate control module is used for calculating a target coding rate of the video coding unit according to an information source target code rate given by the bandwidth detection module through management aiming at the sending cache module, and transmitting the target coding rate to the video coding unit, and the video coding unit carries out coding according to the video coding rate to obtain a coding rate adaptive to the channel bandwidth;
the wireless or wired transceiving module is used for receiving the bit stream transmitted by the wireless transceiving module, sending the bit stream to the receiving cache module and then sending the bit stream to the video decoding unit;
the channel detection module analyzes the bit stream in the receiving cache module, counts packet loss conditions according to the continuity of the serial numbers of packet headers, generates a feedback real-time transmission control protocol packet according to a real-time transmission control protocol, transmits the feedback real-time transmission control protocol packet to the wireless or wired transceiving module, and transmits the feedback real-time transmission control protocol packet to the broadband detection module through the wireless or wired transceiving module and the transmission network;
the video decoding unit is used for decoding the moving part video cached in the receiving caching module and storing the moving part video in an image library;
the video synthesis module is used for matching the decoded moving part video stored in the image library according to the recognition result of the background recognition module, synthesizing the monitoring video of the corresponding monitoring area, and outputting the monitoring video of the corresponding area meeting the query condition through the query output module.
The query output module is used for inputting query conditions, and the video synthesis module synthesizes the monitoring videos meeting the query conditions according to the query conditions input by the query output module and feeds the monitoring videos back to the user in a descending order according to the similarity.
The method for extracting the active video by the image processing module comprises the following steps: three motion parameters are adopted for simultaneous detection, which are respectively as follows:
(1) average value of absolute difference of corresponding pixels of the previous and the next frame images;
(2) average value of absolute difference value of corresponding pixels of the front and rear frame images in vertical direction;
when a moving object appears, a peak value area appears in the vertical direction of the average value in the vertical direction at the position of the object, when the object moves along the vertical direction, the peak value area moves and changes along with the object, when the scene has light change conditions such as lightning or lighting, a larger average value appears, but the change of the peak value area is not obvious, and the situation that the object moves in the vertical direction can be detected.
(3) The average value of the absolute difference value of the corresponding pixels in the horizontal direction of the previous and next frame images.
The average value in the horizontal direction reflects the change of the gray value of the front and back frame images in the horizontal direction, and experiments show that the average value in the horizontal direction is very small and usually does not exceed 3 when no moving object exists, but if the moving object exists, a peak area appears, and the peak area continuously changes along with the movement of the object. After a moving object appears, the average value in the horizontal direction moves along with the peak value interval when the object moves in the horizontal direction, and when light changes such as lightning or lighting occur in a scene, a larger average value appears, but the peak value interval is not obvious, so that the approximate situation of the moving object can be detected by detecting the peak value.
Through the analysis of motion parameters, if a moving object appears, a pixel has a larger value, a peak value interval can appear on the horizontal or vertical direction, the interval changes along with the motion of the object, and at the moment, if conditions such as lightning or turning on light appear in a scene, the peak value interval can not appear, so that the three parameters are used for detection at the same time, and the interference caused by the non-moving object can be avoided.
The video data base is connected with the image synthesis module and used for storing the synthesized monitoring video, and the storage structure is divided into two parts, namely, a pointer of recorded conventional data and video image data, and multimedia data of the video image, frames are constructed by using a double linked list, a frame index and the frame video data are records which can be lengthened, and each record is stored by using a single linked list. The conventional data volume is small, the fixed-length technology can be used for processing, the storage is carried out according to three-level storage units of fields, blocks and records with fixed lengths, the data storage is convenient, but the video data volume is large, and the data volume after the compression is uneven, so the three-level storage units of fields, blocks and records with fixed lengths cannot be used for organizing and storing, and the storage structure is relatively complex. Therefore, the frame of the invention is constructed by using the double linked list, the frame index and the frame video data are one variable-length record, each record is stored by using one single linked list, the structure is simple and easy to realize, and the operability is strong.
In a preferred embodiment, the background recognition module recognizes the background image using a neural network model.
As a preferred embodiment, the background recognition module obtains the recognition result by calculating the similarity between the extracted background image and each of the background images pre-stored in the background library, and if the calculated similarity is the maximum, the extracted background image and the corresponding background image in the background library, which is calculated to obtain the maximum similarity, are the matched background images.
As a preferred embodiment, the euclidean distance is used to judge the similarity between the extracted background image and each of the background images prestored in the background library.
As a preferred embodiment, if the bandwidth detection module receives that the packet loss rate fed back by the receiver exceeds the set threshold, the bandwidth detection module encapsulates the monitoring video into a custom RTP data packet and sends the data to the receiver;
and if the packet loss rate does not exceed the set threshold, adaptively adjusting the coding rate.
In a preferred embodiment, the synthesized surveillance video is compressed by the video synthesis module and then stored in the video database.
A transmission control method of video data of a video monitoring system comprises the following steps:
(1) the monitoring camera collects background images and monitoring videos of all monitoring areas, stores the collected background images in a background library in advance and inputs the collected monitoring videos into a background identification module;
(2) the background recognition module extracts a background image in a monitoring video transmitted by the monitoring camera, matches the extracted background image part with background images of all monitoring areas stored in a background library in advance, and inputs a recognition result to the video synthesis module and the image processing module;
(3) the image processing module extracts a movable video part in the monitoring video according to the identification result of the background identification module and inputs the extracted video part into the video coding unit for coding;
(4) the video coding unit codes the active video part extracted by the image processing module and inputs the coded video stream to the sending cache module;
(5) the sending and caching module receives and caches the bit stream of the active video part sent by the video coding unit;
(6) the bandwidth detection module receives packet loss rate feedback information from a receiving end through the wireless transceiving module, obtains the current available channel bandwidth according to the information statistics, further sets a sending rate and an information source target code rate, inputs the set sending rate to the sending rate control module, and inputs the set information source target code rate to the code rate control module;
(7) the sending rate control module sends the bit stream in the sending cache module into the wireless transceiving module according to the sending rate given by the bandwidth detection module according to the channel bandwidth detected by the bandwidth detection module, sends the bit stream out through the wireless transceiving module, and transmits the bit stream to a receiving end through a transmission network;
(8) the code rate control module calculates a target coding code rate of the video coding unit according to an information source target code rate given by the bandwidth detection module through management aiming at the sending cache module, and transmits the target coding code rate to the video coding unit, and the video coding unit performs coding according to the video coding code rate to obtain a coding code rate adaptive to the channel bandwidth;
(9) the wireless or wired transceiving module receives the bit stream transmitted by the wireless transceiving module, sends the bit stream to the receiving cache module and then sends the bit stream to the video decoding unit;
(10) the channel detection module analyzes the bit stream in the receiving cache module, counts packet loss conditions according to the continuity of the serial numbers of the packet headers, generates a feedback real-time transmission control protocol packet according to a real-time transmission control protocol, transmits the feedback real-time transmission control protocol packet to the wireless or wired transceiving module, and transmits the feedback real-time transmission control protocol packet to the broadband detection module through the wireless or wired transceiving module and the transmission network;
(11) the video decoding unit decodes the video of the active part cached in the receiving caching module and stores the decoded video in an image library;
(12) the video synthesis module matches the decoded moving part video stored in the image library according to the recognition result of the background recognition module, synthesizes the monitoring video of the corresponding monitoring area, and outputs the monitoring video of the corresponding area meeting the query condition through the query output module.
The present invention is not limited to the above-described embodiments, which are merely preferred embodiments of the present invention, and the present invention is not limited thereto, and any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A transmission control system of video data of a video monitoring system comprises a sending end transmission control unit, a receiving end transmission control unit, a video coding unit and a video decoding unit; the transmitting end transmission control unit is connected with the video coding unit; the receiving end transmission control unit is connected with the video decoding unit; the transmission control unit of the sending end also comprises a sending cache module, a sending rate control module, a code rate control module, a bandwidth detection module and a wireless transceiving module,
the receiving end transmission control unit comprises a wireless or wired transceiving module, a receiving cache module and a channel detection module;
the method is characterized in that: the system also comprises a monitoring camera, a background library, a background recognition module, an image processing module, an image library, an image synthesis module and an inquiry output module; the monitoring camera, the background library connection, the background recognition module, the image processing module and the video coding unit are sequentially connected; the image library is connected with the video decoding unit and the video synthesis module; the image synthesis module is respectively connected with the background library, the background identification module and the query output module;
the monitoring camera is used for acquiring background images and monitoring videos of all monitoring areas, storing the acquired background images into a background library in advance and inputting the acquired monitoring videos into a background identification module;
the background recognition module is used for extracting a background image in a monitoring video transmitted by the monitoring camera, matching the extracted background image part with background images of all monitoring areas pre-stored in a background library, and inputting a recognition result to the video synthesis module and the image processing module;
the image processing module is used for extracting a movable video part in the monitoring video according to the identification result of the background identification module and inputting the extracted video part into the video coding unit for coding;
the video coding unit is used for coding the active video part extracted by the image processing module and inputting the coded video stream to the sending cache module;
the sending and caching module is used for receiving and caching the bit stream of the active video part sent by the video coding unit;
the bandwidth detection module is used for receiving packet loss rate feedback information from a receiving end through the wireless transceiving module, counting according to the information to obtain the current available channel bandwidth, further setting a sending rate and an information source target code rate, inputting the set sending rate to the sending rate control module, and inputting the set information source target code rate to the code rate control module;
the sending rate control module is used for sending the bit stream in the sending cache module into the wireless transceiving module according to the channel bandwidth detected by the bandwidth detection module and the sending rate given by the bandwidth detection module, sending the bit stream out through the wireless transceiving module and transmitting the bit stream to a receiving end through a transmission network;
the code rate control module is used for calculating a target coding rate of the video coding unit according to an information source target code rate given by the bandwidth detection module through management aiming at the sending cache module, and transmitting the target coding rate to the video coding unit, and the video coding unit carries out coding according to the video coding rate to obtain a coding rate adaptive to the channel bandwidth;
the wireless or wired transceiving module is used for receiving the bit stream transmitted by the wireless transceiving module, sending the bit stream to the receiving cache module and then sending the bit stream to the video decoding unit;
the channel detection module analyzes the bit stream in the receiving cache module, counts packet loss conditions according to the continuity of the serial numbers of packet headers, generates a feedback real-time transmission control protocol packet according to a real-time transmission control protocol, transmits the feedback real-time transmission control protocol packet to the wireless or wired transceiving module, and transmits the feedback real-time transmission control protocol packet to the broadband detection module through the wireless or wired transceiving module and the transmission network;
the video decoding unit is used for decoding the moving part video cached in the receiving caching module and storing the moving part video in an image library;
the video synthesis module is used for matching the decoded moving part video stored in the image library according to the recognition result of the background recognition module, synthesizing the monitoring video of the corresponding monitoring area, and outputting the monitoring video of the corresponding area meeting the query condition through the query output module.
2. The transmission control system of video data of a video surveillance system according to claim 1, characterized in that: the query output module is used for inputting query conditions, and the video synthesis module synthesizes the monitoring videos meeting the query conditions according to the query conditions input by the query output module and feeds the monitoring videos back to the user in a descending order according to the similarity.
3. The transmission control system of video data of a video surveillance system according to claim 1, characterized in that: the method for extracting the active video by the image processing module comprises the following steps: three motion parameters are adopted for simultaneous detection, which are respectively as follows:
(1) average value of absolute difference of corresponding pixels of the previous and the next frame images;
(2) average value of absolute difference value of corresponding pixels of the front and rear frame images in vertical direction;
(3) the average value of the absolute difference value of the corresponding pixels in the horizontal direction of the previous and next frame images.
4. The transmission control system of video data of a video surveillance system according to claim 1, characterized in that: the video database is connected with the image synthesis module and used for storing the synthesized monitoring video, and the storage structure is divided into two parts, namely, the pointer of the recorded conventional data and video image data, and the multimedia data of the video image, frames are constructed by using a double linked list, the frame index and the frame video data are records which can be changed in length, and each record is stored by using a single linked list.
5. The transmission control system of video data of a video surveillance system according to claim 1, characterized in that: the background recognition module recognizes the background image by adopting a neural network model.
6. The transmission control system of video data of a video surveillance system according to claim 1, characterized in that: the background recognition module calculates the similarity between the extracted background image and each background image pre-stored in the background library to obtain a recognition result, if the calculated similarity is maximum, the extracted background image and the corresponding background image in the background library with the maximum similarity are matched background images.
7. The transmission control system of video data of a video surveillance system according to claim 6, characterized in that: and judging the similarity between the extracted background image and each background image prestored in the background library by adopting the Euclidean distance.
8. The transmission control system of video data of a video surveillance system according to claim 1, characterized in that: if the packet loss rate fed back by the receiving party and received by the bandwidth detection module exceeds a set threshold, encapsulating the monitoring video into a custom RTP data packet and sending the data to the receiving party;
and if the packet loss rate does not exceed the set threshold, adaptively adjusting the coding rate.
9. The transmission control system of video data of a video surveillance system according to claim 4, characterized in that: the synthesized monitoring video is compressed by the video synthesis module and then stored in the video database.
10. A transmission control method of video data of a video monitoring system is characterized in that: the method comprises the following steps:
(1) the monitoring camera collects background images and monitoring videos of all monitoring areas, stores the collected background images in a background library in advance and inputs the collected monitoring videos into a background identification module;
(2) the background recognition module extracts a background image in a monitoring video transmitted by the monitoring camera, matches the extracted background image part with background images of all monitoring areas stored in a background library in advance, and inputs a recognition result to the video synthesis module and the image processing module;
(3) the image processing module extracts a movable video part in the monitoring video according to the identification result of the background identification module and inputs the extracted video part into the video coding unit for coding;
(4) the video coding unit codes the active video part extracted by the image processing module and inputs the coded video stream to the sending cache module;
(5) the sending and caching module receives and caches the bit stream of the active video part sent by the video coding unit;
(6) the bandwidth detection module receives packet loss rate feedback information from a receiving end through the wireless transceiving module, obtains the current available channel bandwidth according to the information statistics, further sets a sending rate and an information source target code rate, inputs the set sending rate to the sending rate control module, and inputs the set information source target code rate to the code rate control module;
(7) the sending rate control module sends the bit stream in the sending cache module into the wireless transceiving module according to the sending rate given by the bandwidth detection module according to the channel bandwidth detected by the bandwidth detection module, sends the bit stream out through the wireless transceiving module, and transmits the bit stream to a receiving end through a transmission network;
(8) the code rate control module calculates a target coding code rate of the video coding unit according to an information source target code rate given by the bandwidth detection module through management aiming at the sending cache module, and transmits the target coding code rate to the video coding unit, and the video coding unit performs coding according to the video coding code rate to obtain a coding code rate adaptive to the channel bandwidth;
(9) the wireless or wired transceiving module receives the bit stream transmitted by the wireless transceiving module, sends the bit stream to the receiving cache module and then sends the bit stream to the video decoding unit;
(10) the channel detection module analyzes the bit stream in the receiving cache module, counts packet loss conditions according to the continuity of the serial numbers of the packet headers, generates a feedback real-time transmission control protocol packet according to a real-time transmission control protocol, transmits the feedback real-time transmission control protocol packet to the wireless or wired transceiving module, and transmits the feedback real-time transmission control protocol packet to the broadband detection module through the wireless or wired transceiving module and the transmission network;
(11) the video decoding unit decodes the video of the active part cached in the receiving caching module and stores the decoded video in an image library;
(12) the video synthesis module matches the decoded moving part video stored in the image library according to the recognition result of the background recognition module, synthesizes the monitoring video of the corresponding monitoring area, and outputs the monitoring video of the corresponding area meeting the query condition through the query output module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110851590.9A CN113794855A (en) | 2021-07-27 | 2021-07-27 | Transmission control system and method for video data of video monitoring system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110851590.9A CN113794855A (en) | 2021-07-27 | 2021-07-27 | Transmission control system and method for video data of video monitoring system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113794855A true CN113794855A (en) | 2021-12-14 |
Family
ID=78877004
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110851590.9A Pending CN113794855A (en) | 2021-07-27 | 2021-07-27 | Transmission control system and method for video data of video monitoring system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113794855A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114726891A (en) * | 2022-03-28 | 2022-07-08 | 慧之安信息技术股份有限公司 | Video transmission reporting method based on Internet of things |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101222296A (en) * | 2008-01-31 | 2008-07-16 | 上海交通大学 | Self-adapting transmission method and system in ascending honeycomb video communication |
| CN103220530A (en) * | 2013-04-22 | 2013-07-24 | 郑永春 | System and method for processing high-definition picture for intelligent monitoring |
| CN107333026A (en) * | 2017-06-26 | 2017-11-07 | 电子科技大学 | A kind of monitor video image transmitting being directed under fixed scene and storage method |
| CN112489072A (en) * | 2020-11-11 | 2021-03-12 | 广西大学 | Vehicle-mounted video perception information transmission load optimization method and device |
-
2021
- 2021-07-27 CN CN202110851590.9A patent/CN113794855A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101222296A (en) * | 2008-01-31 | 2008-07-16 | 上海交通大学 | Self-adapting transmission method and system in ascending honeycomb video communication |
| CN103220530A (en) * | 2013-04-22 | 2013-07-24 | 郑永春 | System and method for processing high-definition picture for intelligent monitoring |
| CN107333026A (en) * | 2017-06-26 | 2017-11-07 | 电子科技大学 | A kind of monitor video image transmitting being directed under fixed scene and storage method |
| CN112489072A (en) * | 2020-11-11 | 2021-03-12 | 广西大学 | Vehicle-mounted video perception information transmission load optimization method and device |
Non-Patent Citations (3)
| Title |
|---|
| 杨丹;姚伟新;周鸣争;: "AVS-M帧间预测模式快速选择算法的研究", 计算机工程与科学, vol. 33, no. 08, 15 August 2011 (2011-08-15), pages 158 - 163 * |
| 蔡茂国, 杨淑雯: "利用图像系统捕捉运动物体的一种实现方法", 计算机应用, vol. 20, no. 06, 28 June 2000 (2000-06-28), pages 32 - 34 * |
| 蔡茂国, 杨淑雯: "远程多场景运动物体捕捉系统的实现", 计算机应用研究, no. 04, 28 April 2000 (2000-04-28), pages 94 - 95 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114726891A (en) * | 2022-03-28 | 2022-07-08 | 慧之安信息技术股份有限公司 | Video transmission reporting method based on Internet of things |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101488967B (en) | Video transmission method, embedded monitoring terminal and monitoring platform server | |
| CN102547243B (en) | Audio and video remote monitoring method and system based on 3G (the 3rd generation telecommunication) network | |
| CN104683762B (en) | A kind of wireless adaptive transmission method of UAV Video and wireless transmitting system occupying ratio based on buffering | |
| CN103647954A (en) | Mobile video monitoring system based on 3G channel and intelligent terminal | |
| CN110519635B (en) | Audio and video media stream converging method and system of wireless cluster system | |
| CN104519325A (en) | Wireless video monitoring system self-adaptive guaranteeing method based on 4G network | |
| CN102377730A (en) | Audio/video signal processing method and mobile terminal | |
| CN100455020C (en) | Screen coding method under low code rate | |
| CN113794855A (en) | Transmission control system and method for video data of video monitoring system | |
| Chu et al. | The design and implementation of video surveillance system based on H. 264, SIP, RTP/RTCP and RTSP | |
| CN1968406A (en) | Wireless real-time video monitoring system and method | |
| CN110099250B (en) | Monitoring video quality judgment method and play control device | |
| EP2963929B1 (en) | A method for configuration of video stream output from a digital video camera | |
| CN114339445A (en) | Real-time video stream self-adaptive coordination system and method | |
| CN101437157B (en) | Multipath CDMA video transmission system for monitoring railway field video | |
| KR101494537B1 (en) | Method and apparatus for dertermining monitoring channel in visual surveillance system | |
| CN105828082B (en) | Video image Fast Compression system and method | |
| CN111866509A (en) | Method for realizing real-time video data transmission based on forward error correction and receiving feedback | |
| CN103428493A (en) | Light wireless transmission system for high-definition videos | |
| CN103269448A (en) | Method for achieving synchronization of audio and video on the basis of RTP/RTCP feedback early-warning algorithm | |
| CN218888597U (en) | Remote video monitoring compression transmission system based on 4G network | |
| CN112449138A (en) | Low-delay video transmission system and method | |
| RU46397U1 (en) | INFORMATION TRANSMISSION SYSTEM | |
| CN105306970A (en) | Method and device for controlling stream media live broadcast transmitting speed | |
| CN201001170Y (en) | Network video monitor terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |