Disclosure of Invention
In view of the above-mentioned shortcomings in the prior art, an object of the present invention is to provide a video streaming control method for a monitoring system and a monitoring system, so as to solve one or more problems in the prior art.
In order to achieve the purpose, the technical scheme of the invention is as follows:
a video stream transmission control method for a monitoring system comprises
Collecting video stream data and environment information data in a monitoring area, and transmitting the environment information data to a monitoring terminal;
analyzing the video stream data and the environmental information data to detect whether the state of a monitoring area is abnormal or not;
when the monitoring area is abnormal, intercepting the video stream segment corresponding to the abnormal moment and generating notification information, transmitting the notification information to the monitoring terminal, and determining whether to check the video stream segment by a worker.
Further, after receiving the notification information, if a worker sends a viewing command, the worker transmits the video stream clip to a monitoring terminal for viewing; and if the viewing command is not sent, storing the video stream segment in a front-end camera.
Further, after the video stream segment is intercepted, the video stream data in the period of normal state of the monitoring area is deleted.
Further, when the video stream segment is saved, the video stream segment is saved in different paths according to different abnormal states.
Further, the time range of the video stream segment is 30s before and after the abnormal time.
Further, the allowable storage amount of the video stream segments is determined according to the memory size of the front-end camera, and when the number of the video stream segments reaches the allowable storage amount, at least one earliest video stream segment is deleted.
Further, during the normal state of the monitoring area, images of the monitoring area are captured regularly and transmitted to the monitoring terminal.
The utility model provides a monitoring system, includes front end camera and monitor terminal, the front end camera with be equipped with communication transmission network between the monitor terminal, the front end camera includes camera lens module, perception module, analysis and control module, storage module and communication module, wherein:
the camera module is used for collecting video stream data in the monitoring area;
the sensing module is used for acquiring environmental information data in the monitoring area;
an analysis and control module for analyzing the video stream data and the environmental information data to detect whether the state of the monitored area is abnormal, intercepting the video stream segment corresponding to the abnormal time and sending notification information to the monitoring terminal when the monitored area is abnormal, and
executing a command sent by the monitoring terminal;
the storage module is used for storing the video stream fragments;
and the communication module is used for communicating the front-end camera with the monitoring terminal.
Further, during the normal state of the monitoring area, the lens module periodically captures images of the monitoring area and transmits the images to the monitoring terminal through the communication module.
Further, the front-end camera further comprises a pan-tilt module, the lens module is arranged on the pan-tilt module, and the analysis and control module is further configured to:
analyzing the image to obtain the offset of the lens module; and
and controlling the operation of the holder module according to the offset so as to adjust the position and the direction of the lens module.
Compared with the prior art, the invention has the following beneficial technical effects:
when the monitoring area is normal, only the environment information data is transmitted to the monitoring terminal, so that a large amount of network bandwidth can be saved. And when the monitored area is abnormal, intercepting the video stream segment and transmitting notification information to the monitoring terminal. When the staff decides to look over the video stream fragment, transmit corresponding video stream fragment to monitor terminal again, will divide into the data of monitoring terminal transmission and count alert stream and video stream in this scheme, wherein the alert stream of number includes: the environmental information data is transmitted when the state is normal, and the notification information is transmitted when the state is abnormal and used for alarming; the video stream refers to a video stream segment corresponding to the abnormal state. When a worker determines to check video stream data, the corresponding video stream fragments are transmitted to the monitoring terminal, and compared with a transmission mode of a main code stream and a sub code stream (the sub code stream video obtained by transcoding needs to be continuously transmitted or a large amount of network bandwidth can be occupied), the scheme can obviously reduce the requirement on the network bandwidth, is particularly suitable for the monitoring terminal for controlling a plurality of front-end cameras, and can ensure smoothness when transmitting high-definition video stream fragments because the video stream data collected by the plurality of front-end cameras does not need to be transmitted simultaneously, and the high-definition video stream fragments can be convenient for the worker to know detailed problems.
And (II) after the video stream fragments are intercepted, deleting the video stream data in the normal state period of the monitoring area, so that the memory of the front-end camera can be saved. In the transmission mode of the main code stream and the sub code stream, the front-end camera is responsible for storing the main code stream video, needs to occupy a large amount of storage space, and is inconvenient for workers to query. In the scheme, the video stream data in the normal state period is deleted, the effect of filtering and optimizing the video stream data is achieved, effective video stream fragments are stored, the requirement on the storage space of the front-end camera can be reduced, and meanwhile, the video stream fragments corresponding to the abnormal state moments are convenient to inquire by workers.
And (III) storing the video stream segments in different paths according to different abnormal states, so that a worker can conveniently check the video stream segments and analyze the frequency of the different abnormal states.
And fourthly, regularly capturing the image of the monitored area during the normal state of the monitored area, and transmitting the image to the monitoring terminal, so that the working personnel can know the field condition of the monitored area conveniently.
And fifthly, obtaining the offset of the lens module by analyzing the image, controlling the operation of the holder module according to the offset, adjusting the position and the direction of the lens module, and ensuring that the lens module is always aligned with the monitored object.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more clearly understood, the following describes a video streaming control method and a monitoring system for a monitoring system in detail with reference to the accompanying drawings and the following detailed description. The advantages and features of the present invention will become more apparent from the following description. It is to be noted that the drawings are in a very simplified form and are all used in a non-precise scale for the purpose of facilitating and distinctly aiding in the description of the embodiments of the present invention. To make the objects, features and advantages of the present invention comprehensible, reference is made to the accompanying drawings. It should be understood that the structures, ratios, sizes, and the like shown in the drawings and described in the specification are only used for matching with the disclosure of the specification, so as to be understood and read by those skilled in the art, and are not used to limit the implementation conditions of the present invention, so that the present invention has no technical significance, and any structural modification, ratio relationship change or size adjustment should still fall within the scope of the present invention without affecting the efficacy and the achievable purpose of the present invention.
Examples
Referring to fig. 1 and fig. 2, the present application provides a video stream transmission control method for a monitoring system, which includes:
s1, collecting video stream data and environment information data in the monitoring area, and transmitting the environment information data to the monitoring terminal 1;
s2, analyzing the video stream data and the environment information data to detect whether the state of the monitoring area is abnormal;
and S3, when the monitoring area is abnormal, intercepting the video stream segment corresponding to the abnormal time, generating notification information, transmitting the notification information to the monitoring terminal 1, and determining whether to check the video stream segment by a worker.
In this embodiment, the monitoring area refers to a shooting range of the front-end camera 3 after being aligned with a shooting object, the acquired video stream data is a video shot by the front-end camera 3, and the environment information data includes environment information such as temperature, humidity, longitude and latitude, azimuth information, pressure, and flow. The front-end camera 3 transmits the environmental information data to the monitoring terminal 1 through the communication transmission network 2 so that the working personnel can know the environmental information data in the monitoring range conveniently. It should be understood that in the present solution, it is not necessary to collect the environmental information data, and it is also possible to analyze only the video stream data to know whether the state of the monitoring area is abnormal.
In the process of analyzing video stream data and environmental information data, analysis needs to be performed according to a use scene, for example, in an industrial production process, a temperature change of equipment and a shape change of a component need to be monitored, an image of a standard temperature range and a normal shape of the component can be preset, comparison analysis can be performed on collected temperature data and video stream data, and if the collected temperature data is within the range of the standard temperature or the shape of the component in the video stream data is matched with the normal shape, the state of a monitored area is normal; if the collected temperature data exceeds the range of the standard temperature or the shape of the member in the video stream data is deformed relative to the normal shape, the abnormal state of the monitoring area is indicated. In a similar way, whether people or objects break into the monitoring area or not can be detected when the security protection field and the body temperature are detected, and whether the body temperature of pedestrians in the monitoring area is normal or not can be monitored. In addition, people and vehicles intruding into the monitoring area can be identified, such as recording personnel information and license plate numbers of the vehicles, and the system can be customized according to monitoring requirements in practical application, and is not repeated.
When the monitoring area is abnormal, the video stream fragments are intercepted, the problem of the monitoring area when the abnormity occurs can be recorded, and the checking and analysis of workers are facilitated. In this embodiment, the time range of the intercepted video stream segment is 30s before and after the abnormal time, and certainly, for convenience of analysis by a worker, the time range of the video stream segment may be set to be longer, for example, 1min, 2min or 5min before and after the abnormal time.
Further, after receiving the notification information, if the staff sends a viewing command, the staff transmits the video stream clip to the monitoring terminal 1 for viewing; if no viewing command is issued, the video stream clip is saved in the front-end camera 3. In this embodiment, the notification information is used to alarm the staff, and when receiving the notification information, the monitoring terminal 1 may send out sound, light, and other signals to remind the staff. The notification information is provided with an instruction key, and a worker can conveniently send a viewing command to the front-end camera 3 through the instruction key. The content of the notification information may include images captured at abnormal times and corresponding environment information data, and when receiving the notification information, the staff may first check the images and the environment information data to determine whether to check the intercepted video stream segment. In addition, if the staff member issues a command to reject viewing, or does not issue any command, the video stream segment is stored in the front-end camera 3 so that the staff member can view it when necessary.
Furthermore, when the video stream segments are stored, the video stream segments are stored in different paths according to different abnormal states, so that a worker can conveniently check the video stream segments and analyze the frequency of the different abnormal states.
Further, after the video stream segment is intercepted, the video stream data in the normal period of the monitoring area state is deleted, so that the memory capacity of the front-end camera 3 is saved. In this embodiment, after the video stream segment is captured, the video stream data in the normal period of the monitoring area state is deleted at an interval of 1 day, and when the video stream segment is actually used, the interval duration can be set according to the monitoring requirement, so that the balance between saving the memory of the front-end camera 3 and saving the video stream data is balanced. In addition, it is also necessary to determine the allowed storage amount of the video stream segments according to the memory size of the front-end camera 3, and delete at least one oldest video stream segment when the number of the stored video stream segments reaches the allowed storage amount, so as to prevent the newly captured video stream segment from failing to be stored. In determining the allowable holding amount of the video stream segments, it should be calculated based on the memory size of the front-end camera 3 and the average size of each video stream segment. Furthermore, the allowed storage amount should be smaller than the maximum storage amount of the video stream segment, so as to avoid the problem that the video stream segment fails to reach the allowed storage amount and fails to be stored.
Furthermore, during the normal state of the monitoring area, the images of the monitoring area are captured regularly and transmitted to the monitoring terminal 1, so that the workers can know the field condition of the monitoring area through the images conveniently.
Referring to fig. 2, the present application further provides a monitoring system, which includes a front-end camera 3 and a monitoring terminal 1, a communication transmission network 2 is disposed between the front-end camera 3 and the monitoring terminal 1, the front-end camera 3 includes a lens module 32, a sensing module 33, an analyzing and controlling module 31, a storage module 34 and a communication module 35, wherein:
the lens module 32 is used for acquiring video stream data in the monitored area and capturing images in the monitored area;
the sensing module 33 is used for collecting environmental information data in the monitoring area;
an analysis and control module 31 for analyzing the video stream data and the environmental information data to detect whether the state of the monitored area is abnormal, and when the monitored area is abnormal, intercepting the video stream segment corresponding to the abnormal time and sending the notification information to the monitoring terminal 1, and
executing the command sent by the monitoring terminal 1;
a storage module 34, configured to temporarily store video stream data and store video stream fragments;
and the communication module 35 is used for communicating the front-end camera 3 with the monitoring terminal 1.
Specifically, the environmental information data collected by the sensing module 33 includes environmental information such as temperature, humidity, longitude and latitude, and azimuth information. In this embodiment, the sensing module 33 includes an infrared thermal imaging lens for measuring temperature, and is only used for measuring temperature, but in practical application, if humidity, pressure, flow rate or other environmental information in the industrial production environment needs to be monitored, the sensing module 33 with a humidity sensor may be selected, or other sensors or instruments may be selected. The environmental information data needs to be transmitted to the monitoring terminal 1 in real time for the staff to check.
Specifically, the analysis and control module 31 has functions of image recognition analysis and data comparison, and the analysis and control module 31 mainly detects whether a person or an object enters the monitoring area in the process of analyzing the video stream data; or to analyze whether a change in the shape of the component within the monitored area has occurred. If a person or an object enters the monitoring area or the shape of the member changes, it is possible to determine that the state in the monitoring range is abnormal. In addition, when environmental information data such as temperature and humidity are compared, if the acquired temperature data and humidity data are not in the normal temperature range and humidity range, the state is also abnormal. In order to satisfy the functions of identification, analysis and comparison, the analysis and control module 31 should have a built-in intelligent analysis algorithm to satisfy the requirements of different functions, which will not be described in detail herein.
In addition, the storage module 34 may be built in the front-end camera 3, and may be a hard disk memory externally connected to the front-end camera 3. The communication module 35 communicates with the monitoring terminal 1, and a specific communication mode may be 4G, 5G, WIFI or an optical communication link, which is not limited herein.
When the monitoring area is abnormal, the analysis and control module 31 intercepts the video stream segment and records the environmental information data of the monitoring area when the abnormality occurs, so that the monitoring area can be conveniently checked and analyzed by the staff. Meanwhile, the analysis and control module 31 also sends notification information to the control terminal to notify the staff to view the video stream clip. The notification information is provided with an instruction key, and a worker can conveniently send a viewing command to the front-end camera 3 through the instruction key. The content of the notification information may include images captured at abnormal times and corresponding environment information data, and when receiving the notification information, the staff may first check the images and the environment information data to determine whether to check the intercepted video stream segment. In addition, the notification information of the present embodiment has two instruction keys, and the commands of the two instruction keys are confirmation view and rejection view, respectively. The worker can easily give a command to the front camera 3 through the command key. The time range of the intercepted video stream segment is 30s before and after the abnormal time, and certainly, for the convenience of analysis of a worker, the time range of the video stream segment may be set to be longer, for example, set to be 1min, 2min or 5min before and after the abnormal time.
Further, after the staff receives the notification information, if a command for confirming viewing is sent through the command key, the analysis and control module 31 transmits the corresponding video stream segment to the monitoring terminal 1 according to the viewing command for viewing; if the staff member issues a command of rejecting viewing, or does not issue any command, the video stream segment is saved in the front-end camera 3 so that the staff member can view the video stream segment when needed. In this embodiment, the notification information is used to alert the staff, the monitoring terminal 1 may be equipped with an alarm component, and when the monitoring terminal 1 receives the notification information, the alarm component may send out sound, light, and other signals to remind the staff.
Further, when saving the video stream segments, the analyzing and controlling module 31 saves the different video stream segments in different paths of the storing module 34 according to different abnormal states, which is convenient for the staff to check the video stream segments and analyze the frequency of the different abnormal states. The abnormal state referred to in this embodiment includes abnormal states such as abnormal temperature, abnormal humidity, and abnormal shape of a member in industrial production, and abnormal states such as pedestrian intrusion, abnormal body temperature of a pedestrian, animal intrusion, and vehicle passing in daily life.
Further, the video stream data and the corresponding environmental information data during the normal state of the monitoring area are also temporarily stored in the storage module 34, and when the analysis and control module 31 intercepts the video stream segment at an interval of 1 day, the video stream data and the corresponding environmental information data during the normal state of the monitoring area are deleted, so as to save the memory capacity of the storage module 34. In practical use, the interval duration may be set according to the monitoring requirement, and the memory saving of the storage module 34 and the amount of video stream data stored may be balanced. In addition, it is also necessary to determine the allowed storage amount of the video stream segments according to the memory size of the storage module 34, and delete at least one oldest video stream segment when the number of the stored video stream segments reaches the allowed storage amount, so as to prevent the newly intercepted video stream segment from failing to be stored. In determining the allowable storage amount of the video stream segments, it should be calculated according to the memory size of the storage module 34 and the average size of each video stream segment. Furthermore, the allowed storage amount should be smaller than the maximum storage amount of the video stream segment, so as to avoid the problem that the video stream segment fails to reach the allowed storage amount and fails to be stored.
Further, during the normal state of the monitoring area, the analysis and control module 31 controls the lens module 32 to capture the image of the monitoring area periodically, and transmits the image to the monitoring terminal 1, so that the staff can know the field condition of the monitoring area through the image conveniently. The frequency of capturing the images of the monitored area is 1 time/h, and of course, the capturing frequency can be adjusted according to different use requirements.
Further, the front-end camera 3 further includes a pan-tilt module 36, the lens module 32 is mounted on the pan-tilt module 36, and the pan-tilt module 36 is configured to adjust a position direction of the lens module 32. The analysis and control module 31 is also configured to:
analyzing the image to derive an offset for lens module 32; and
and controlling the operation of the holder module 36 according to the offset to adjust the position and the direction of the lens module 32.
After the front-end camera 3 is mounted, sometimes the mounting structure is loosened or shifted due to vibration, so that the lens module 32 cannot be aligned with the monitored object. In order to solve this problem, the analysis and control module 31 is used to compare and analyze the images of the monitoring area periodically captured by the lens module 32, so as to measure the offset of the lens module 32. The analysis and control module 31 may directly control the pan-tilt module 36 to adjust the position and the direction of the lens module 32, so that the lens module 32 continues to be aligned with the monitored object. Of course, in this case, the control and analysis module may also send a message to the monitoring terminal 1 informing the operator to issue an adjustment command. It should be noted that, the component in the sensing module 33 responsible for collecting the environmental information data needs to determine whether to be installed on the pan/tilt head module 36, for example, if the structure for measuring temperature is an infrared thermal imaging lens, the infrared thermal imaging lens should be installed on the pan/tilt head module 36, and if the structure for measuring temperature is a temperature sensor or other type of detection component, it may determine whether to install the temperature sensor on the pan/tilt head structure according to whether the temperature sensor or the detection component needs to be aligned with the monitored object during operation.
The working principle is as follows:
the analysis and control module 31 continuously analyzes the video stream data and the environmental information data, and only transmits the environmental information data to the monitoring terminal 1 when the state of the monitoring area is normal, so that a large amount of network bandwidth can be saved. When the monitoring area is abnormal, the analysis and control module 31 intercepts the video stream fragments and transmits notification information to the monitoring terminal 1, and whether the corresponding video stream fragments are transmitted to the monitoring terminal 1 is determined according to the command of a worker, so that the requirement on the network bandwidth can be obviously reduced, and the method is particularly suitable for controlling the monitoring terminal 1 of a plurality of front-end cameras 3, namely the communication transmission network 2 does not need to simultaneously transmit the video stream data acquired by the plurality of front-end cameras 3, the transmission fluency of the video stream fragments can be ensured when the high-definition video stream fragments are transmitted, and the worker can conveniently know the detail problems.
All possible combinations of the technical features of the above embodiments may not be described for the sake of brevity, but should be considered as within the scope of the present disclosure as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.