Disclosure of Invention
The present invention is directed to solve the technical problems in the above technologies to at least a certain extent, and therefore an object of the present invention is to provide a mobile detection method, device and system, which can solve the problem that the monitoring system in the prior art cannot detect sudden cases in time.
In a first aspect, the present invention provides a motion detection method for an intelligent analysis device, the method including: the first receiving module receives first video data from the mobile acquisition equipment; the algorithm processing module carries out edge processing on the first video data to obtain second video data; the judging module judges whether the second video data needs to be sent to a background processor; and if the second video data does not need to be sent to the background processor, the first sending module sends the second video data to a display terminal.
Preferably, the method further comprises: and if the second video data needs to be sent to the background processor, the first sending module sends the second video data to the background processor, so that the background processor identifies, marks and displays the second video data according to preset target characteristics.
Preferably, before the first receiving module receives the first video data from the mobile capture device, the method further comprises: the first receiving module receives configuration parameters of the mobile acquisition equipment; and the identification module identifies the identity of the mobile acquisition equipment according to the configuration parameters, so that the first receiving module receives the first video data from the mobile acquisition equipment matched with the configuration parameters.
Preferably, when the first receiving module receives multiple sets of configuration parameters, the method further comprises: the first receiving module receives multiple groups of first video data, wherein the multiple groups of first video data come from multiple mobile acquisition devices matched with the multiple groups of configuration parameters; and the algorithm processing module performs face detection, pedestrian detection and quality screening according to the multiple groups of first video data to obtain second video data.
In a second aspect, the present invention provides a motion detection method for a background processor, the method comprising: the streaming media service receiving module receives second video data from the intelligent analysis equipment; the background algorithm module identifies and marks the second video data according to preset target characteristics and converts the second video data into target video data; the streaming media service sending module sends the target video data to a display terminal; and the early warning module sends out early warning prompts according to the target characteristics and the target video data.
Preferably, before the streaming media service receiving module receives the second video data from the intelligent analysis device, the streaming media service receiving module further includes: the second receiving module receives the configuration parameters of the mobile acquisition equipment; and the second sending module sends the configuration parameters to the intelligent analysis equipment, so that the intelligent analysis equipment receives the first video data from the mobile acquisition equipment matched with the configuration parameters.
In a third aspect, the present invention provides a motion detection apparatus applied to an intelligent analysis device, the apparatus comprising: the first receiving module is used for receiving first video data from the mobile acquisition equipment; the algorithm processing module is used for performing edge processing on the first video data to obtain second video data; the judging module is used for judging whether the second video data needs to be sent to a background processor or not; the first sending module is used for sending the second video data to the background processor if the second video data needs to be sent to the background processor, so that the background processor identifies, marks and displays the second video data according to preset target characteristics; and the video processing device is also used for sending the second video data to a display terminal if the second video data does not need to be sent to the background processor.
Preferably, the apparatus further comprises: the identification module is used for identifying the identity of the mobile acquisition equipment according to configuration parameters, so that the transmission module receives the first video data from the mobile acquisition equipment matched with the configuration parameters, and the configuration parameters are from the configuration parameters of the mobile acquisition equipment received by the first receiving module.
Preferably, the apparatus further comprises: and the audio and video processing module is used for editing the received first video data.
Preferably, the apparatus further comprises: and the storage module is used for storing the first video data and also used for storing the second video data.
Preferably, the apparatus further comprises: and the encryption module is used for decrypting the encrypted first video data and encrypting the second video data.
In a fourth aspect, the present invention provides a motion detection apparatus for a background processor, the apparatus comprising: the streaming media service receiving module is used for receiving the second video data from the intelligent analysis equipment; the background algorithm module is used for identifying and marking the second video data according to preset target characteristics and converting the second video data into target video data; the streaming media service sending module is used for sending the target video data to a display terminal; and the early warning module is used for sending out early warning prompts according to the target characteristics and the target video data.
Preferably, the apparatus further comprises: and the encryption management module is used for setting an encryption mode and a decryption mode in video image data transmission.
Preferably, the apparatus further comprises: and the background management module is used for managing the running state, the user authority and the interface service of the mobile acquisition equipment.
In a fifth aspect, the present invention provides a motion detection system, comprising: the mobile acquisition equipment is used for acquiring audio and video images to obtain first video data; the intelligent analysis equipment is in wireless connection with the mobile acquisition equipment and is used for performing edge processing on the received first video data and converting the first video data into second video data; and the background processor is connected with the intelligent analysis equipment and is used for processing, identifying and early warning the received second video data.
Preferably, the system further comprises: the relay equipment is in wireless connection with the mobile acquisition equipment and also in wireless connection with the intelligent analysis equipment and is used for increasing the wireless transmission distance between the mobile acquisition equipment and the intelligent analysis equipment.
The embodiment of the invention provides a movement detection method for intelligent analysis equipment, which comprises the following steps: the first receiving module receives first video data from the mobile acquisition equipment; the algorithm processing module carries out edge processing on the first video data to obtain second video data; the judging module judges whether the second video data needs to be sent to a background processor; and if the second video data does not need to be sent to the background processor, the first sending module sends the second video data to a display terminal. The mobile detection method can carry out edge calculation such as real-time face detection, pedestrian detection, image quality screening and the like on video images acquired by a plurality of acquisition devices, can directly send the video images subjected to edge calculation to a mobile terminal carried by an inspector for display when the situation is urgent or the network condition is limited, provides timely and effective video images for the analysis and judgment of the inspector, and can adjust the position, the angle and the like of the on-site acquisition devices in time according to the effect of the received video images so as to meet the requirements of the inspection work.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application. Like numbered functional units in the examples of the present invention have the same and similar structure and function.
Fig. 1 is a flowchart of a motion detection method according to an embodiment of the present invention, and as shown in fig. 1, the motion detection method according to the embodiment of the present invention specifically includes the following steps when applied to an intelligent analysis device:
step S101, a first receiving module receives first video data from a mobile acquisition device.
In particular, the mobile acquisition device includes but is not limited to a miniature camera or a wearable camera, and can be arranged at a required concealed shooting place by a scout or carried on glasses, clothes, a backpack or a watch, and the like, and is used for acquiring and encrypting and storing audio and video images. The acquired data is encrypted and then transmitted in a wireless mode, namely, the acquired data is first video data received by a first receiving module of the intelligent analysis equipment, and the first video data comprises but is not limited to audio, video and pictures.
And step S102, the algorithm processing module carries out edge processing on the first video data to obtain second video data.
Specifically, the algorithm processing module detects and screens the received first video data, detects AI algorithms including but not limited to face detection, pedestrian detection, attribute detection and the like, mainly detects a human body in a picture or a video stream, returns coordinate information in the image where the human body is located in real time, marks a frame, and performs analysis and processing on the basis of the human body, and the detected human body can perform posture estimation, feature extraction and attribute analysis, so that pedestrian re-identification and tracking are realized. The screening is to perform quality screening on the detected video image, cut the blurred image, and obtain second video data after the detection and the screening, wherein the second video data includes but is not limited to audio, video and pictures.
Step S103, the judging module judges whether the second video data needs to be sent to the background processor.
And step S104, if the second video data does not need to be sent to the background processor, the first sending module sends the second video data to the display terminal.
Specifically, the method provided by the embodiment of the invention can select whether the video image after edge processing needs to be sent to a background processor for further processing and analysis; under the condition that the investigation environment is simple or the network environment is not good, the user can also choose not to send the background processor, and the result processed by the intelligent analysis equipment is directly sent to a terminal display module carried by the investigation personnel so as to deal with some emergency situations.
The embodiment of the invention provides a movement detection method, which is used for intelligent analysis equipment, and comprises the following steps: the first receiving module receives first video data from the mobile acquisition equipment; the algorithm processing module carries out edge processing on the first video data to obtain second video data; the judging module judges whether the second video data needs to be sent to a background processor; and if the second video data does not need to be sent to the background processor, the first sending module sends the second video data to a display terminal. The mobile detection method can carry out edge calculation such as real-time face detection, pedestrian detection, image quality screening and the like on video images acquired by a plurality of acquisition devices, can directly send the video images subjected to edge calculation to a mobile terminal carried by an inspector for display when the situation is urgent or the network condition is limited, provides timely and effective video images for the analysis and judgment of the inspector, and can adjust the position, the angle and the like of the on-site acquisition devices in time according to the effect of the received video images so as to meet the requirements of the inspection work.
Fig. 2 is a flowchart illustrating a motion detection method according to an embodiment of the invention; as shown in fig. 2, the motion detection method provided in the embodiment of the present invention, when applied to an intelligent analysis device, includes the following steps:
step S201, the first receiving module receives configuration parameters of the mobile acquisition device.
And step S202, the identification module identifies the identity of the mobile acquisition equipment according to the configuration parameters.
Step S203, the first receiving module receives the first video data from the mobile capturing device matched with the configuration parameter.
And step S204, the algorithm processing module performs edge processing on the first video data to obtain second video data.
In step S205, the determining module determines whether the second video data needs to be sent to the background processor.
Step S206, the first sending module sends the second video data to the display terminal.
Step S207, the first sending module sends the second video data to the background processor, so that the background processor identifies, marks and displays the second video data according to the preset target feature.
Specifically, there may be a plurality of miniature cameras or wearable acquisition devices in an actual detection environment, and video images of one or more of the cameras need to be received, so that identification of the camera at the front end needs to be performed. Each camera has configuration parameters including the equipment model, brightness, saturation, definition, focal length and the like, and the intelligent analysis equipment can set the front-end acquisition equipment according to the received configuration parameters and also can receive the video image of the equipment matched with the front-end acquisition equipment. When receiving multiple sets of configuration parameters, the identification module identifies cameras corresponding to the multiple sets of configuration parameters, receives multiple sets of video images sent by corresponding cameras, and performs face detection, pedestrian detection and quality screening on the multiple sets of received video images to obtain second video data, wherein the second video data can be composed of multiple sets of first video data sub-modules and marks the same character characteristics in different video images. The video image after edge calculation can be sent to a mobile display terminal of a field investigation personnel for manual analysis and judgment, and can also be simultaneously sent to a background processor for further target feature comparison and classification.
Furthermore, the images of the target characteristics are preset in the background processor, the background processor performs target identification and target tracking according to the target characteristics and the received video images, so that multiple groups of investigation personnel can perform multi-aspect analysis and judgment on the same scene, the efficiency and accuracy of investigation work are improved, and timely and effective video images can be provided under the conditions of emergency and limited network conditions.
Fig. 3 is a flowchart illustrating a motion detection method according to an embodiment of the invention; as shown in fig. 3, the motion detection method provided in the embodiment of the present invention is applied to a background processor, and specifically includes the following steps:
in step S301, the streaming media service receiving module receives second video data from the intelligent analysis device.
Step S302, the background algorithm module identifies and marks the second video data according to the preset target characteristics, and converts the second video data into target video data.
Step S303, the streaming media service sending module sends the target video data to a display terminal.
And step S304, the early warning module sends out early warning prompts according to the target characteristics and the target video data.
Specifically, the streaming media service receiving module may receive, in an audio/video stream pulling manner, second video data processed by the intelligent analysis device, and may also receive first video data from the intelligent analysis device, that is, an original video image; the first video data can be stored and further processed, generally, the received second video data is subjected to further comparative analysis, target video data is obtained by performing target identification and target tracking according to preset target characteristics and the second video data, and a sound early warning or highlighting method can be given out after similar target characteristics are found to attract the attention of an inspector so as to avoid missing important characteristics to influence the inspection progress; wherein the target video data includes, but is not limited to, audio, video, and pictures; the early warning prompt may also display the details of the early warning message in a message bar.
Further, the streaming media service sending module sends the target video data to a display terminal for displaying and interacting; a second receiving module of the background processor can receive configuration parameters of the mobile acquisition device, and a second sending module of the background processor sends the configuration parameters to the intelligent analysis device, so that the intelligent analysis device receives first video data from the mobile acquisition device matched with the configuration parameters; the configuration parameters may be configured by the investigator to perform corresponding adjustment according to the on-site monitoring video image and the actual situation, such as the position relationship of the start-up acquisition device, the adjustment of the focal length of the acquisition device, the setting of the wide angle of the acquisition device, and the like.
Fig. 4 is a block diagram of a motion detection apparatus according to an embodiment of the invention; as shown in fig. 4, a movement detection device provided in an embodiment of the present invention is applied to an intelligent analysis device, and the device includes:
a first receiving module 110, configured to receive first video data from a mobile capture device;
an algorithm processing module 120, configured to perform edge processing on the first video data to obtain second video data;
a determining module 130, configured to determine whether the second video data needs to be sent to a background processor;
a first sending module 140, configured to send the second video data to the background processor if the second video data needs to be sent to the background processor, so that the background processor identifies, marks, and displays the second video data according to a preset target feature; and the video processing device is also used for sending the second video data to a display terminal if the second video data does not need to be sent to the background processor.
Fig. 5 is a block diagram of a motion detection apparatus according to an embodiment of the invention; as shown in fig. 5, a motion detection apparatus provided in an embodiment of the present invention is applied to a background processor, and the apparatus includes:
a streaming media service receiving module 210, configured to receive the second video data from the intelligent analysis device;
the background algorithm module 220 is configured to identify and mark the second video data according to a preset target feature, and convert the second video data into target video data;
a streaming media service transmitting module 230, configured to transmit the target video data to a display terminal;
and the early warning module 240 is configured to send an early warning prompt according to the target feature and the target video data.
Fig. 6 is a block diagram of a motion detection system according to an embodiment of the invention; as shown in fig. 6, a motion detection system according to an embodiment of the present invention includes:
the mobile acquisition equipment 300 is used for acquiring audio and video images to obtain first video data;
the intelligent analysis equipment 100 is in wireless connection with the mobile acquisition equipment and is used for performing edge processing on the received first video data and converting the first video data into second video data;
and the background processor 200 is connected with the intelligent analysis device and is used for processing, identifying and early warning the received second video data.
Fig. 7 is a block diagram of a motion detection system according to an embodiment of the invention; as shown in fig. 7, a motion detection system according to an embodiment of the present invention includes:
the mobile acquisition equipment 300 is used for acquiring audio and video images, and may include a plurality of miniature cameras 310 or a plurality of wearable cameras 320, and the wearable or miniature acquisition equipment is convenient to hide and deploy and is suitable for various investigation environments; and data transmission is carried out in a wireless mode, so that temporary and concealed arrangement can be carried out on site, and complicated operations such as wiring transmission, wiring power supply and the like are omitted.
And the intelligent analysis device 100 is configured to perform edge processing on the received first video data and convert the first video data into second video data. The intelligent analysis device 100 comprises a first receiving module 110 for receiving first video data from the mobile capture device; an algorithm processing module 120, configured to perform edge processing on the first video data to obtain second video data; a determining module 130, configured to determine whether the second video data needs to be sent to a background processor; a first sending module 140, configured to send the second video data to the background processor; the second video data is also used for sending the second video data to a display terminal; the identification module 160 is configured to identify the identity information of the mobile collection device 300 according to the received configuration parameters.
And the background processor 200 is connected with the intelligent analysis device and is used for processing, identifying and early warning the received second video data. The background processor 200 comprises a streaming media service receiving module 210 for receiving the second video data from the intelligent analysis device; the background algorithm module 220 is configured to identify and mark the second video data according to a preset target feature, and convert the second video data into target video data; a streaming media service transmitting module 230, configured to transmit the target video data to a display terminal; and the early warning module 240 is configured to send an early warning prompt according to the target feature and the target video data.
The relay device 400 is wirelessly connected with the mobile acquisition device and the intelligent analysis device, and is used for increasing the wireless transmission distance between the mobile acquisition device and the intelligent analysis device.
In practical applications, in order to ensure the security of data during transmission, the intelligent analysis device 100 further includes an encryption module, configured to decrypt the encrypted first video data and encrypt the second video data; the mobile acquisition device 300 at the front end encrypts the acquired video image and transmits the encrypted video image to the intelligent analysis device 100, so that the encryption module 150 in the intelligent analysis device 100 needs to decrypt the received video image first and encrypt the video image before transmitting the video image, and the encryption technology in the prior art can be adopted, thereby effectively preventing the video from being stolen in the transmission process.
Further, the intelligent analysis apparatus 100 further includes: and the audio and video processing module is used for editing the received first video data.
Further, the intelligent analysis apparatus 100 further includes: and the storage module is used for storing the first video data and also used for storing the second video data.
It should be noted that, the mobile acquisition device 300 acquires audio/video or image data, and transmits the acquired audio/video or image data to the intelligent analysis device 100 through the wireless network, the algorithm processing module 120 performs AI edge calculation such as detection and preliminary screening on the acquired original video image, and encrypts the calculated video image result and the original audio/video and then transmits the encrypted video image result and the original audio/video to the background processor 200 through the 4G network for further processing; under the condition that the investigation environment is simple or the network environment is not good, the user can also choose not to pass through the background and directly send the result processed by the portable AI intelligent analysis equipment to the terminal display module carried by the investigation personnel so as to deal with some emergency situations. The intelligent analysis equipment 100 has AI data analysis and processing capabilities, comprehensively and effectively realizes intelligent analysis functions of monitoring suspicious objects, detecting intrusion behaviors, abnormal movement or stay of personnel, people stream analysis and the like, improves the accuracy and efficiency of detection work, and reduces resource investment; and the high-performance portable AI intelligent analysis device 100 can seamlessly combine the AI algorithm with mass data in the safety monitoring field, the strong edge computing capability of the system reduces the processing delay of the system, reduces the transmission bandwidth, lightens the background computation amount, and supports off-line processing.
In practical applications, the background processor 200 further includes: and the encryption management module 250 is used for setting an encryption mode and a decryption mode in video image data transmission. The encryption mode adopts encryption and decryption algorithms of traditional monitoring manufacturers, such as AES, RSA and DES, and in order to ensure the security of data transmission, the data transmission among the three terminals of the mobile acquisition device 300, the intelligent analysis device 100 and the background processor 200 needs to be encrypted and decrypted, so that the three-terminal encryption and decryption modes can be set through the encryption management module 250. Further background processor 200 also includes: the background management module 260 is used for managing the running state, the user authority and the interface service of the mobile acquisition equipment; the system has the advantages of configuration and management of using place authorities, log management, database access management, safe data storage and controlled use, and high safety.
The embodiment of the invention provides a movement detection method, a device and a system, which are used for intelligent analysis equipment, wherein the method comprises the following steps: the first receiving module receives first video data from the mobile acquisition equipment; the algorithm processing module carries out edge processing on the first video data to obtain second video data; the judging module judges whether the second video data needs to be sent to a background processor; and if the second video data does not need to be sent to the background processor, the first sending module sends the second video data to a display terminal. The mobile detection method can carry out edge calculation such as real-time face detection, pedestrian detection, image quality screening and the like on video images acquired by a plurality of acquisition devices, can directly send the video images subjected to edge calculation to a mobile terminal carried by an inspector for display when the situation is urgent or the network condition is limited, provides timely and effective video images for the analysis and judgment of the inspector, and can adjust the position, the angle and the like of the on-site acquisition devices in time according to the effect of the received video images so as to meet the requirements of the inspection work.
It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The foregoing are merely exemplary embodiments of the present invention, which enable those skilled in the art to understand or practice the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.