CN113923413A - Monitoring equipment relation determining method based on data processing - Google Patents

Abstract

The invention provides a monitoring equipment relation determining method based on data processing, and relates to the technical field of monitoring. In the invention, whether the equipment relationship among a plurality of monitoring terminal equipment needs to be determined is judged; if the device relationship among the monitoring terminal devices needs to be determined, acquiring first device characteristic information and second device characteristic information of each monitoring terminal device, wherein the first device characteristic information is used for representing static characteristic information of the corresponding monitoring terminal device, and the second device characteristic information is used for representing dynamic characteristic information of the corresponding monitoring terminal device; and determining equipment relation information among the plurality of monitoring terminal equipment based on the first equipment characteristic information and the second equipment characteristic information of each monitoring terminal equipment. Based on the method, the problem that the reliability of the determined equipment relation information between the monitoring terminal equipment is poor in the prior art can be solved.

Description

Monitoring equipment relation determining method based on data processing

Technical Field

The invention relates to the technical field of monitoring, in particular to a monitoring equipment relation determining method based on data processing.

Background

In some applications of monitoring technology, sometimes a large number of monitoring terminal devices need to be arranged in a monitoring scene for information collection. For convenience of processing information acquired by each monitoring terminal device and for convenience of management and control of each monitoring terminal device, the device relationship among each monitoring terminal device needs to be determined, so that corresponding management and control can be performed on each monitoring terminal device or corresponding processing can be performed on the information acquired by each monitoring terminal device based on the device relationship among each monitoring terminal device. However, the inventor has found that, in the prior art, the device relationship between the monitoring terminal devices is generally customized based on the corresponding administrator, and thus, the reliability of the determined device relationship information between the monitoring terminal devices may be poor.

Disclosure of Invention

In view of the above, an object of the present invention is to provide a method for determining a relationship between monitoring devices based on data processing, so as to solve the problem in the prior art that the reliability of the determined device relationship information between the monitoring terminal devices is not good.

In order to achieve the above purpose, the embodiment of the invention adopts the following technical scheme:

a monitoring device relation determining method based on data processing is applied to a monitoring background server, the monitoring background server is in communication connection with a plurality of monitoring terminal devices, and the monitoring device relation determining method based on data processing comprises the following steps:

judging whether the equipment relationship among the plurality of monitoring terminal equipment needs to be determined or not;

if the device relationship among the plurality of monitoring terminal devices needs to be determined, acquiring first device characteristic information and second device characteristic information of each monitoring terminal device in the plurality of monitoring terminal devices, wherein the first device characteristic information is used for representing static characteristic information of the corresponding monitoring terminal device, and the second device characteristic information is used for representing dynamic characteristic information of the corresponding monitoring terminal device;

determining device relationship information between the plurality of monitoring terminal devices based on the first device characteristic information and the second device characteristic information of each monitoring terminal device.

In some preferred embodiments, in the above monitoring device relationship determining method based on data processing, the step of determining whether the device relationship between the plurality of monitoring terminal devices needs to be determined includes:

determining whether a relationship determination notification instruction indicating that determination of the device relationship among the plurality of monitoring terminal devices is required is received;

if a relation determination notification instruction for indicating that the device relation among the plurality of monitoring terminal devices needs to be determined is determined to be received, counting the number of the plurality of monitoring terminal devices to obtain a corresponding device counting number, and determining the size relation between the device counting number and a preset device counting number threshold;

and if the device statistical number is greater than or equal to the device statistical number threshold, determining that the device relationship among the plurality of monitoring terminal devices needs to be determined.

In some preferred embodiments, in the above method for determining a relationship between monitoring devices based on data processing, the step of determining whether the device relationship between the monitoring terminal devices needs to be determined further includes:

if it is determined that the relationship determination notification instruction indicating that the determination of the device relationship among the plurality of monitoring terminal devices is required is not received, it is determined that the determination of the device relationship among the plurality of monitoring terminal devices is not required.

In some preferred embodiments, in the above method for determining a relationship between monitoring devices based on data processing, the step of determining whether the device relationship between the monitoring terminal devices needs to be determined further includes:

if the device statistics number is smaller than the device statistics number threshold, generating corresponding relationship determination confirmation request information, and sending the relationship determination confirmation request information to a target management terminal device, wherein the relationship determination notification instruction is generated and sent based on the target management terminal device, and the target management terminal device is configured to, after receiving the relationship determination confirmation request information, respond to a selection operation performed by a corresponding management user based on a requirement whether the device relationship among the plurality of monitoring terminal devices needs to be determined, generate corresponding first confirmation feedback information or generate corresponding second confirmation feedback information, and send the first confirmation feedback information or the second confirmation feedback information to the monitoring background server;

if the first confirmation feedback information is received, it is determined that the device relationship among the plurality of monitoring terminal devices is not required to be determined, and if the second confirmation feedback information is received, it is determined that the device relationship among the plurality of monitoring terminal devices is required to be determined.

In some preferred embodiments, in the above method for determining a relationship between monitoring devices based on data processing, if it is determined that a device relationship between the monitoring terminal devices needs to be determined, the step of obtaining first device characteristic information and second device characteristic information of each of the monitoring terminal devices includes:

if the device relationship among the plurality of monitoring terminal devices needs to be determined, generating first acquisition notification information and second acquisition notification information, and sending the first acquisition notification information and the second acquisition notification information to each monitoring terminal device in the plurality of monitoring terminal devices, wherein each monitoring terminal device is used for performing first information acquisition operation based on the first acquisition notification information to obtain corresponding first device characteristic information and performing second information acquisition operation based on the second acquisition notification information to obtain corresponding second device characteristic information after receiving the first acquisition notification information and the second acquisition notification information;

and acquiring first device characteristic information and second device characteristic information which are acquired and sent by each monitoring terminal device based on the first acquisition notification information and the second acquisition notification information.

In some preferred embodiments, in the above method for determining a relationship between monitoring devices based on data processing, if it is determined that a device relationship between the monitoring terminal devices needs to be determined, the step of generating first collection notification information and second collection notification information, and sending the first collection notification information and the second collection notification information to each of the monitoring terminal devices includes:

if the equipment relationship among the plurality of monitoring terminal equipment needs to be determined, generating first acquisition notification information for indicating the monitoring terminal equipment to acquire and send the position information of the monitoring terminal equipment, and generating second acquisition notification information for indicating the monitoring terminal equipment to acquire and send the environment information of the monitoring terminal equipment, wherein the acquired position information is used as the first equipment characteristic information, and the acquired environment information is used as the second equipment characteristic information;

and sending the first acquisition notification information and the second acquisition notification information to each monitoring terminal device in the plurality of monitoring terminal devices.

In some preferred embodiments, in the above monitoring device relationship determining method based on data processing, the step of determining device relationship information between the plurality of monitoring terminal devices based on the first device characteristic information and the second device characteristic information of each of the monitoring terminal devices includes:

for each monitoring terminal device in the plurality of monitoring terminal devices, calculating the similarity between the first device characteristic information of the monitoring terminal device and the first device characteristic information of each other monitoring terminal device to obtain corresponding first characteristic similarity information;

for each monitoring terminal device in the plurality of monitoring terminal devices, calculating the similarity between the second device characteristic information of the monitoring terminal device and the second device characteristic information of each other monitoring terminal device to obtain corresponding second characteristic similarity information;

and performing fusion processing on the first feature similarity information and the second feature similarity information corresponding to each monitoring terminal device, and determining device relationship information among the plurality of monitoring terminal devices based on the obtained feature similarity fusion information.

In some preferred embodiments, in the above method for determining a relationship between monitoring devices based on data processing, the step of calculating, for each of the monitoring terminal devices, a similarity between the first device characteristic information of the monitoring terminal device and the first device characteristic information of each of the other monitoring terminal devices to obtain corresponding first characteristic similarity information includes:

for each monitoring terminal device in the plurality of monitoring terminal devices, calculating to obtain position distance information between the monitoring terminal device and each other monitoring terminal device based on the position information corresponding to the first device characteristic information of the monitoring terminal device and the position information corresponding to the first device characteristic information of each other monitoring terminal device;

determining position distance information with the maximum value from the position distance information between all two monitoring terminal devices as target position distance information;

and for each monitoring terminal device in the plurality of monitoring terminal devices, calculating a corresponding distance ratio based on the target position distance information and the position distance information between the monitoring terminal device and each other monitoring terminal device to obtain first feature similarity information between the monitoring terminal device and each other monitoring terminal device.

In some preferred embodiments, in the above method for determining a relationship between monitoring devices based on data processing, the step of calculating, for each of the monitoring terminal devices, a similarity between the second device characteristic information of the monitoring terminal device and the second device characteristic information of each of the other monitoring terminal devices to obtain corresponding second characteristic similarity information includes:

for each monitoring terminal device in the plurality of monitoring terminal devices, performing segmentation processing on the multi-frame environment monitoring image included in the second device characteristic information of the monitoring terminal device to obtain a plurality of monitoring video segments corresponding to the monitoring terminal device, wherein each monitoring video segment includes a plurality of continuous multi-frame environment monitoring images in time;

for each monitoring terminal device in the plurality of monitoring terminal devices, sequentially performing image duplicate removal processing on each monitoring video segment corresponding to the monitoring terminal device, including the environment monitoring image, to obtain each monitoring video duplicate removal segment corresponding to the monitoring terminal device;

sequentially carrying out duplicate removal processing on two adjacent duplicate removal fragments of the monitoring video corresponding to the monitoring terminal equipment aiming at each monitoring terminal equipment in the plurality of monitoring terminal equipment to obtain at least one target fragment of the monitoring video corresponding to the monitoring terminal equipment, and taking each frame of environment monitoring image included by each target fragment of the monitoring video as a target environment monitoring image;

and aiming at every two monitoring terminal devices in the plurality of monitoring terminal devices, performing target image similarity calculation operation on the multi-frame target environment monitoring images corresponding to the two monitoring terminal devices to obtain second characteristic similarity information between the two monitoring terminal devices.

In some preferred embodiments, in the method for determining a relationship between monitoring devices based on data processing, the step of performing fusion processing on the first feature similarity information and the second feature similarity information corresponding to each monitoring terminal device, and determining device relationship information between the plurality of monitoring terminal devices based on the obtained feature similarity fusion information includes:

performing product processing on the first feature similarity information and the second feature similarity information between the two monitoring terminal devices aiming at each two monitoring terminal devices in the plurality of monitoring terminal devices to obtain feature similarity fusion information between the two monitoring terminal devices;

and determining equipment relation information between the two monitoring terminal devices based on the feature similarity fusion information between the two monitoring terminal devices aiming at every two monitoring terminal devices in the multiple monitoring terminal devices so as to determine the equipment relation information between the multiple monitoring terminal devices.

In the method for determining a relationship between monitoring devices based on data processing provided by the embodiments of the present invention, when it is determined that a device relationship between a plurality of monitoring terminal devices needs to be determined, first device characteristic information and second device characteristic information of each monitoring terminal device may be obtained first, so that device relationship information between the plurality of monitoring terminal devices may be determined based on the first device characteristic information and the second device characteristic information of each monitoring terminal device. In this way, because the basis for determining the device relationship information between the monitoring terminal devices is not the experience of the administrator in the prior art, but the first device characteristic information and the second device characteristic information of each monitoring terminal device, the reliability of the basis is ensured, thereby ensuring the reliability of the determined device relationship information, and further improving the problem in the prior art that the reliability of the determined device relationship information between the monitoring terminal devices is poor.

In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.

Drawings

Fig. 1 is a schematic diagram of a monitoring backend server according to an embodiment of the present invention.

Fig. 2 is a schematic diagram of a monitoring device relationship determining method based on data processing according to an embodiment of the present invention.

Fig. 3 is a schematic diagram of a monitoring device relationship determination system based on data processing according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.

Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

As shown in fig. 1, an embodiment of the present invention provides a monitoring backend server. Wherein the monitoring backend server may include a memory and a processor.

In detail, the memory and the processor are electrically connected directly or indirectly to realize data transmission or interaction. For example, they may be electrically connected to each other via one or more communication buses or signal lines. The memory can have stored therein at least one software function (computer program) which can be present in the form of software or firmware. The processor may be configured to execute the executable computer program stored in the memory, so as to implement the monitoring device relationship determination method based on data processing provided by the embodiment of the present invention (as described later).

Alternatively, in some preferred embodiments, the Memory may be, but is not limited to, Random Access Memory (RAM), Read Only Memory (ROM), Programmable Read-Only Memory (PROM), Erasable Read-Only Memory (EPROM), electrically Erasable Read-Only Memory (EEPROM), and the like.

Alternatively, in some preferred embodiments, the Processor may be a general-purpose Processor including a Central Processing Unit (CPU), a Network Processor (NP), a System on Chip (SoC), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components.

Optionally, in some preferred embodiments, the structure shown in fig. 1 is only an illustration, and the monitoring backend server may further include more or fewer components than those shown in fig. 1, or have a different configuration from that shown in fig. 1, for example, may include a communication unit for information interaction with other devices (such as a monitoring terminal device, etc.).

With reference to fig. 2, an embodiment of the present invention further provides a monitoring device relationship determining method based on data processing, which is applicable to the monitoring background server. The method steps defined by the relevant flows of the monitoring equipment relation determining method based on data processing can be realized by the monitoring background server, and the monitoring background server is in communication connection with a plurality of monitoring terminal equipment.

The specific process shown in FIG. 2 will be described in detail below.

Step 110, determining whether to determine the device relationship among the plurality of monitoring terminal devices.

In the embodiment of the present invention, the monitoring background server may first determine whether the device relationship among the plurality of monitoring terminal devices needs to be determined.

Step 120, obtaining first device characteristic information and second device characteristic information of each of the plurality of monitoring terminal devices.

In this embodiment of the present invention, the monitoring background server may obtain the first device characteristic information and the second device characteristic information of each of the plurality of monitoring terminal devices after determining that the device relationship between the plurality of monitoring terminal devices needs to be determined. The first device characteristic information may be used to represent static characteristic information of the corresponding monitoring terminal device, and the second device characteristic information may be used to represent dynamic characteristic information of the corresponding monitoring terminal device.

Step 130, determining device relationship information between the plurality of monitoring terminal devices based on the first device characteristic information and the second device characteristic information of each monitoring terminal device.

In this embodiment of the present invention, after acquiring the first device characteristic information and the second device characteristic information of each monitoring terminal device, the monitoring background server may determine device relationship information between the plurality of monitoring terminal devices based on the first device characteristic information and the second device characteristic information of each monitoring terminal device.

Based on the steps included in the method, when it is determined that the device relationship between the plurality of monitoring terminal devices needs to be determined, the first device characteristic information and the second device characteristic information of each monitoring terminal device may be obtained first, so that the device relationship information between the plurality of monitoring terminal devices may be determined based on the first device characteristic information and the second device characteristic information of each monitoring terminal device. In this way, because the basis for determining the device relationship information between the monitoring terminal devices is not the experience of the administrator in the prior art, but the first device characteristic information and the second device characteristic information of each monitoring terminal device, the reliability of the basis is ensured, thereby ensuring the reliability of the determined device relationship information, and further improving the problem in the prior art that the reliability of the determined device relationship information between the monitoring terminal devices is poor.

Optionally, in some preferred embodiments, step 110 in the foregoing embodiments may include the following steps to determine whether to determine the device relationship between multiple monitoring terminal devices:

firstly, determining whether a relation determination notification instruction for indicating that the device relation among the plurality of monitoring terminal devices needs to be determined is received;

secondly, if a relation determination notification instruction for indicating that the device relation among the plurality of monitoring terminal devices needs to be determined is determined to be received, counting the number of the plurality of monitoring terminal devices to obtain the corresponding device counting number, and determining the size relation between the device counting number and a preset device counting number threshold;

then, if the device count number is greater than or equal to the device count number threshold, it is determined that the device relationship between the plurality of monitoring terminal devices needs to be determined.

Optionally, in some preferred embodiments, step 110 in the foregoing embodiments may further include the following step to determine whether to determine the device relationship between the multiple monitoring terminal devices:

first, if it is determined that a relationship determination notification instruction indicating that determination of the device relationship between the plurality of monitoring terminal devices is required is not received, it is determined that determination of the device relationship between the plurality of monitoring terminal devices is not required.

Optionally, in some preferred embodiments, step 110 in the foregoing embodiments may further include the following step to determine whether to determine the device relationship between the multiple monitoring terminal devices:

firstly, if the device statistics number is smaller than the device statistics number threshold, generating corresponding relationship determination confirmation request information, and sending the relationship determination confirmation request information to a target management terminal device, wherein the relationship determination notification instruction is generated and sent based on the target management terminal device, and the target management terminal device is configured to, after receiving the relationship determination confirmation request information, respond to a selection operation performed by a corresponding management user based on a requirement whether the determination of the device relationship among the plurality of monitoring terminal devices is required, generate corresponding first confirmation feedback information or generate corresponding second confirmation feedback information, and send the first confirmation feedback information or the second confirmation feedback information to the monitoring background server;

secondly, if the first acknowledgement feedback information is received, it is determined that the device relationship among the plurality of monitoring terminal devices does not need to be determined, and if the second acknowledgement feedback information is received, it is determined that the device relationship among the plurality of monitoring terminal devices needs to be determined.

Optionally, in some preferred embodiments, the step 120 in the foregoing embodiments may include the following steps to obtain the first device characteristic information and the second device characteristic information of each of the plurality of monitoring terminal devices:

firstly, if it is determined that the device relationship among the plurality of monitoring terminal devices needs to be determined, generating first acquisition notification information and second acquisition notification information, and sending the first acquisition notification information and the second acquisition notification information to each of the plurality of monitoring terminal devices, wherein each monitoring terminal device is configured to, after receiving the first acquisition notification information and the second acquisition notification information, perform a first information acquisition operation based on the first acquisition notification information to obtain corresponding first device characteristic information, and perform a second information acquisition operation based on the second acquisition notification information to obtain corresponding second device characteristic information;

and secondly, acquiring first device characteristic information and second device characteristic information (namely the first device characteristic information and the second device characteristic information of each monitoring terminal device) acquired and sent by each monitoring terminal device based on the first acquisition notification information and the second acquisition notification information.

Optionally, in some preferred embodiments, if it is determined that the device relationship between the plurality of monitoring terminal devices needs to be determined, the step of generating first acquisition notification information and second acquisition notification information, and sending the first acquisition notification information and the second acquisition notification information to each of the plurality of monitoring terminal devices may include the following steps:

firstly, if the equipment relationship among the plurality of monitoring terminal equipment needs to be determined, generating first acquisition notification information for instructing the monitoring terminal equipment to acquire and send the position information of the monitoring terminal equipment, and generating second acquisition notification information for instructing the monitoring terminal equipment to acquire and send the environment information of the monitoring terminal equipment, wherein the acquired position information is used as the first equipment characteristic information, and the acquired environment information is used as the second equipment characteristic information;

secondly, the first acquisition notification information and the second acquisition notification information are sent to each monitoring terminal device in the plurality of monitoring terminal devices.

Optionally, in some preferred embodiments, the step 130 in the foregoing embodiments may include the following steps to determine whether to determine the device relationship between the multiple monitoring terminal devices:

firstly, calculating the similarity between the first device characteristic information of the monitoring terminal device and the first device characteristic information of each other monitoring terminal device aiming at each monitoring terminal device in the plurality of monitoring terminal devices to obtain corresponding first characteristic similarity information;

secondly, calculating the similarity between the second device characteristic information of the monitoring terminal device and the second device characteristic information of each other monitoring terminal device aiming at each monitoring terminal device in the plurality of monitoring terminal devices to obtain corresponding second characteristic similarity information;

then, the first feature similarity information and the second feature similarity information corresponding to each monitoring terminal device are subjected to fusion processing, and device relationship information among the plurality of monitoring terminal devices is determined based on the obtained feature similarity fusion information.

Optionally, in some preferred embodiments, the step of calculating, for each of the multiple monitoring terminal devices, a similarity between the first device characteristic information of the monitoring terminal device and the first device characteristic information of each of the other monitoring terminal devices to obtain corresponding first characteristic similarity information may include the following steps:

firstly, for each monitoring terminal device in the plurality of monitoring terminal devices, calculating to obtain position distance information between the monitoring terminal device and each other monitoring terminal device based on position information corresponding to first device characteristic information of the monitoring terminal device and position information corresponding to first device characteristic information of each other monitoring terminal device;

secondly, determining position distance information with the maximum value in the position distance information between all two monitoring terminal devices as target position distance information;

then, for each monitoring terminal device in the plurality of monitoring terminal devices, based on the target position distance information and the position distance information between the monitoring terminal device and each other monitoring terminal device, a corresponding distance ratio calculation (the former is divided by the latter, and then, a value that can be normalized is taken as the first feature similarity information) is performed to obtain first feature similarity information between the monitoring terminal device and each other monitoring terminal device.

Optionally, in some preferred embodiments, the step of calculating, for each of the multiple monitoring terminal devices, a similarity between the second device characteristic information of the monitoring terminal device and the second device characteristic information of each of the other monitoring terminal devices to obtain corresponding second characteristic similarity information may include the following steps:

firstly, for each monitoring terminal device in the plurality of monitoring terminal devices, performing segmentation processing on a multi-frame environment monitoring image included in second device characteristic information of the monitoring terminal device to obtain a plurality of monitoring video segments corresponding to the monitoring terminal device, wherein each monitoring video segment includes a plurality of temporally continuous multi-frame environment monitoring images;

secondly, for each monitoring terminal device in the plurality of monitoring terminal devices, sequentially performing target image duplicate removal processing on each monitoring video segment corresponding to the monitoring terminal device, including the environment monitoring image, to obtain each monitoring video duplicate removal segment corresponding to the monitoring terminal device;

then, for each monitoring terminal device in the multiple monitoring terminal devices, sequentially performing deduplication processing on two adjacent surveillance video deduplication segments corresponding to the monitoring terminal device (for example, if the two surveillance video deduplication segments are completely the same or the similarity is higher than a threshold, one of the two surveillance video deduplication segments may be discarded, and if the two surveillance video deduplication segments are completely different or the similarity is not higher than a threshold, the two surveillance video deduplication segments may be retained), obtaining at least one surveillance video target segment corresponding to the monitoring terminal device, and taking each frame of environment monitoring image included in each surveillance video target segment as a target environment monitoring image;

then, for each two monitoring terminal devices in the plurality of monitoring terminal devices, a target image similarity calculation operation is performed on the multi-frame target environment monitoring images corresponding to the two monitoring terminal devices (for example, for each frame of target environment monitoring image corresponding to a first monitoring terminal device in the two monitoring terminal devices, a multi-frame target environment monitoring image with a collection time within a range is determined in the multi-frame target environment monitoring image corresponding to a second monitoring terminal device based on the collection time of the target environment monitoring image, and is used as a comparison target environment monitoring image, then, an image similarity between the target environment monitoring image and each comparison target environment monitoring image is calculated, and the image similarity with the maximum value is used as the image similarity corresponding to the target environment monitoring image, and thus, the average value of the image similarity corresponding to each frame of target environment monitoring image corresponding to the first monitoring terminal device may be calculated and used as the second feature similarity information between the two corresponding monitoring terminal devices), so as to obtain the second feature similarity information between the two monitoring terminal devices.

Optionally, in some preferred embodiments, the performing, for each of the plurality of monitoring terminal devices, target image deduplication processing in the step of sequentially performing, on each of the monitoring video segments corresponding to the monitoring terminal device and including the environment monitoring image, to obtain each of the monitoring video deduplication segments corresponding to the monitoring terminal device may include:

firstly, for each frame of the environment monitoring image in the monitoring video segment, segmenting a plurality of corresponding frames of environment monitoring sub-images (for example, 4 frames of environment monitoring sub-images corresponding to an upper left position, an upper right position, a lower left position and a lower right position, the number of frames of the environment monitoring sub-images can be more, for example, hundreds of frames and the like, based on the precision requirement) from the environment monitoring image to obtain a monitoring sub-image set corresponding to the environment monitoring image, wherein the monitoring sub-image set comprises the plurality of corresponding environment monitoring sub-images, and the plurality of environment monitoring sub-images form the corresponding environment monitoring image according to the corresponding segmented position relationship;

secondly, aiming at each frame of the environment monitoring image in the monitoring video clip, taking the environment monitoring subimage in the monitoring subimage set corresponding to the environment monitoring image as an index key word, taking the environment monitoring image as an index relation object corresponding to the index key word, and forming a corresponding index relation pair by the index key word and the corresponding index relation object to obtain a target index corresponding relation between the environment monitoring image and the environment monitoring subimage in the corresponding monitoring subimage set;

then, aiming at each kind of environment monitoring sub-image (multiple frames of Hanzi rape monitoring sub-images which are completely the same can be used as the same environment monitoring sub-image), determining each frame of environment monitoring image corresponding to the environment monitoring sub-image based on the target index corresponding relation, and obtaining an environment monitoring image set corresponding to the environment monitoring sub-image;

then, aiming at each environment monitoring sub-image, selecting one frame of environment monitoring image from the environment monitoring image set corresponding to the environment monitoring sub-image as an environment monitoring image to be processed, and adding the environment monitoring image to be processed into a pre-constructed image initial set, wherein the image initial set is a null set during construction;

further, traversing each frame of the environment monitoring image in the environment monitoring image set, and determining whether the currently traversed environment monitoring image and the environment monitoring image in the image initial set belong to similar environment monitoring images;

further, if the currently traversed environment monitoring image and the environment monitoring image in the image initial set do not belong to a similar environment monitoring image, adding the currently traversed environment monitoring image to the image initial set, traversing a next frame of the environment monitoring image in the environment monitoring image set, and if the currently traversed environment monitoring image and the environment monitoring image in the image initial set belong to a similar environment monitoring image, traversing a next frame of the environment monitoring image in the environment monitoring image set;

and finally, when all the environment monitoring images in the environment monitoring image set are traversed, taking the image initial set as a monitoring image deduplication set of the corresponding environment monitoring sub-images, and taking a union set of the surveillance image deduplication sets of each environment monitoring sub-image as a surveillance video deduplication segment corresponding to the surveillance video segment.

Optionally, in some preferred embodiments, the step of traversing each frame of the environment monitoring image in the environment monitoring image set and determining whether the currently traversed environment monitoring image and the environment monitoring image in the initial image set belong to similar environment monitoring images may include the following steps:

firstly, traversing each frame of the environment monitoring image in the environment monitoring image set;

secondly, acquiring image similarity information between the currently traversed environment monitoring image and the environment monitoring images in the image initial set;

and then, determining whether the currently traversed environment monitoring image and the environment monitoring image in the initial image set are similar environment monitoring images according to the image similarity information.

Optionally, in some preferred embodiments, the step of obtaining image similarity information between the currently traversed environment monitoring image and the environment monitoring images in the initial set of images may include the following steps:

firstly, respectively carrying out pixel grouping processing on the currently traversed environment monitoring image and the environment monitoring image in the image initial set (for example, sequencing sequentially from top left to bottom right, and then sequentially segmenting at certain intervals to obtain a corresponding pixel group), so as to obtain a first pixel group set corresponding to the currently traversed environment monitoring image and a second pixel group set corresponding to the environment monitoring image in the image initial set;

then, according to the first pixel grouping set and the second pixel grouping set, a monitoring image similarity between the currently traversed environment monitoring image and the environment monitoring image in the image initial set is calculated (for example, the first pixel grouping set and the second pixel grouping set may be an ordered combination, such as ordered according to the positions of the corresponding pixels in the environment monitoring image, so that whether the pixel groupings at the corresponding positions in the two pixel grouping sets are the same or not may be determined, and then, the same number ratio of the pixel groupings at the corresponding positions is calculated as the monitoring image similarity).

Optionally, in some preferred embodiments, the step of performing fusion processing on the first feature similarity information and the second feature similarity information corresponding to each monitoring terminal device, and determining device relationship information between the multiple monitoring terminal devices based on the obtained feature similarity fusion information may include the following steps:

firstly, for each two monitoring terminal devices in the plurality of monitoring terminal devices, performing product processing on the first feature similarity information and the second feature similarity information between the two monitoring terminal devices to obtain feature similarity fusion information between the two monitoring terminal devices;

secondly, for each two monitoring terminal devices of the multiple monitoring terminal devices, determining device relationship information between the two monitoring terminal devices based on the feature similarity fusion information between the two monitoring terminal devices to determine the device relationship information between the multiple monitoring terminal devices (for example, the feature similarity fusion information may be directly used as a corresponding device relationship closeness degree, and if the feature similarity is greater, the corresponding device relationship closeness degree is higher).

With reference to fig. 3, an embodiment of the present invention further provides a monitoring device relationship determining system based on data processing, which is applicable to the monitoring background server. The monitoring equipment relation determining system based on data processing can comprise the following modules:

a relationship determination judging module, configured to judge whether a device relationship between the multiple monitoring terminal devices needs to be determined;

an equipment characteristic information obtaining module, configured to obtain first equipment characteristic information and second equipment characteristic information of each monitoring terminal device in the multiple monitoring terminal devices if it is determined that an equipment relationship between the multiple monitoring terminal devices needs to be determined, where the first equipment characteristic information is used to represent static characteristic information of the corresponding monitoring terminal device, and the second equipment characteristic information is used to represent dynamic characteristic information of the corresponding monitoring terminal device;

and the device relationship information determining module is configured to determine device relationship information between the plurality of monitoring terminal devices based on the first device characteristic information and the second device characteristic information of each monitoring terminal device.

In summary, according to the monitoring device relationship determining method based on data processing provided by the present invention, when it is determined that the device relationship between the multiple monitoring terminal devices needs to be determined, the first device characteristic information and the second device characteristic information of each monitoring terminal device may be obtained first, so that the device relationship information between the multiple monitoring terminal devices may be determined based on the first device characteristic information and the second device characteristic information of each monitoring terminal device. In this way, because the basis for determining the device relationship information between the monitoring terminal devices is not the experience of the administrator in the prior art, but the first device characteristic information and the second device characteristic information of each monitoring terminal device, the reliability of the basis is ensured, thereby ensuring the reliability of the determined device relationship information, and further improving the problem in the prior art that the reliability of the determined device relationship information between the monitoring terminal devices is poor.

The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. A monitoring device relation determining method based on data processing is characterized in that the method is applied to a monitoring background server, the monitoring background server is in communication connection with a plurality of monitoring terminal devices, and the monitoring device relation determining method based on data processing comprises the following steps:

judging whether the equipment relationship among the plurality of monitoring terminal equipment needs to be determined or not;

if the device relationship among the plurality of monitoring terminal devices needs to be determined, acquiring first device characteristic information and second device characteristic information of each monitoring terminal device in the plurality of monitoring terminal devices, wherein the first device characteristic information is used for representing static characteristic information of the corresponding monitoring terminal device, and the second device characteristic information is used for representing dynamic characteristic information of the corresponding monitoring terminal device;

determining device relationship information between the plurality of monitoring terminal devices based on the first device characteristic information and the second device characteristic information of each monitoring terminal device.

2. The monitoring device relationship determining method based on data processing according to claim 1, wherein the step of determining whether the determination of the device relationship between the plurality of monitoring terminal devices is required comprises:

determining whether a relationship determination notification instruction indicating that determination of the device relationship among the plurality of monitoring terminal devices is required is received;

if a relation determination notification instruction for indicating that the device relation among the plurality of monitoring terminal devices needs to be determined is determined to be received, counting the number of the plurality of monitoring terminal devices to obtain a corresponding device counting number, and determining the size relation between the device counting number and a preset device counting number threshold;

and if the device statistical number is greater than or equal to the device statistical number threshold, determining that the device relationship among the plurality of monitoring terminal devices needs to be determined.

3. The monitoring device relationship determining method based on data processing according to claim 2, wherein the step of determining whether the device relationship between the plurality of monitoring terminal devices needs to be determined further comprises:

if it is determined that the relationship determination notification instruction indicating that the determination of the device relationship among the plurality of monitoring terminal devices is required is not received, it is determined that the determination of the device relationship among the plurality of monitoring terminal devices is not required.

4. The monitoring device relationship determining method based on data processing according to claim 2, wherein the step of determining whether the device relationship between the plurality of monitoring terminal devices needs to be determined further comprises:

if the device statistics number is smaller than the device statistics number threshold, generating corresponding relationship determination confirmation request information, and sending the relationship determination confirmation request information to a target management terminal device, wherein the relationship determination notification instruction is generated and sent based on the target management terminal device, and the target management terminal device is configured to, after receiving the relationship determination confirmation request information, respond to a selection operation performed by a corresponding management user based on a requirement whether the device relationship among the plurality of monitoring terminal devices needs to be determined, generate corresponding first confirmation feedback information or generate corresponding second confirmation feedback information, and send the first confirmation feedback information or the second confirmation feedback information to the monitoring background server;

if the first confirmation feedback information is received, it is determined that the device relationship among the plurality of monitoring terminal devices is not required to be determined, and if the second confirmation feedback information is received, it is determined that the device relationship among the plurality of monitoring terminal devices is required to be determined.

5. The method according to claim 1, wherein the step of obtaining the first device characteristic information and the second device characteristic information of each of the plurality of monitoring terminal devices if it is determined that the device relationship between the plurality of monitoring terminal devices needs to be determined includes:

if the device relationship among the plurality of monitoring terminal devices needs to be determined, generating first acquisition notification information and second acquisition notification information, and sending the first acquisition notification information and the second acquisition notification information to each monitoring terminal device in the plurality of monitoring terminal devices, wherein each monitoring terminal device is used for performing first information acquisition operation based on the first acquisition notification information to obtain corresponding first device characteristic information and performing second information acquisition operation based on the second acquisition notification information to obtain corresponding second device characteristic information after receiving the first acquisition notification information and the second acquisition notification information;

and acquiring first device characteristic information and second device characteristic information which are acquired and sent by each monitoring terminal device based on the first acquisition notification information and the second acquisition notification information.

6. The method according to claim 5, wherein the step of generating first collection notification information and second collection notification information and sending the first collection notification information and the second collection notification information to each of the plurality of monitoring terminal devices if it is determined that the device relationship between the plurality of monitoring terminal devices needs to be determined includes:

if the equipment relationship among the plurality of monitoring terminal equipment needs to be determined, generating first acquisition notification information for indicating the monitoring terminal equipment to acquire and send the position information of the monitoring terminal equipment, and generating second acquisition notification information for indicating the monitoring terminal equipment to acquire and send the environment information of the monitoring terminal equipment, wherein the acquired position information is used as the first equipment characteristic information, and the acquired environment information is used as the second equipment characteristic information;

and sending the first acquisition notification information and the second acquisition notification information to each monitoring terminal device in the plurality of monitoring terminal devices.

7. The monitoring device relationship determination method based on data processing according to any one of claims 1 to 6, wherein the step of determining the device relationship information between the plurality of monitoring terminal devices based on the first device characteristic information and the second device characteristic information of each of the monitoring terminal devices includes:

for each monitoring terminal device in the plurality of monitoring terminal devices, calculating the similarity between the first device characteristic information of the monitoring terminal device and the first device characteristic information of each other monitoring terminal device to obtain corresponding first characteristic similarity information;

for each monitoring terminal device in the plurality of monitoring terminal devices, calculating the similarity between the second device characteristic information of the monitoring terminal device and the second device characteristic information of each other monitoring terminal device to obtain corresponding second characteristic similarity information;

and performing fusion processing on the first feature similarity information and the second feature similarity information corresponding to each monitoring terminal device, and determining device relationship information among the plurality of monitoring terminal devices based on the obtained feature similarity fusion information.

8. The method for determining relationship between monitoring devices based on data processing according to claim 7, wherein the step of calculating, for each of the plurality of monitoring terminal devices, a similarity between the first device characteristic information of the monitoring terminal device and the first device characteristic information of each of the other monitoring terminal devices to obtain corresponding first characteristic similarity information includes:

for each monitoring terminal device in the plurality of monitoring terminal devices, calculating to obtain position distance information between the monitoring terminal device and each other monitoring terminal device based on the position information corresponding to the first device characteristic information of the monitoring terminal device and the position information corresponding to the first device characteristic information of each other monitoring terminal device;

determining position distance information with the maximum value from the position distance information between all two monitoring terminal devices as target position distance information;

and for each monitoring terminal device in the plurality of monitoring terminal devices, calculating a corresponding distance ratio based on the target position distance information and the position distance information between the monitoring terminal device and each other monitoring terminal device to obtain first feature similarity information between the monitoring terminal device and each other monitoring terminal device.

9. The method for determining relationship between monitoring devices based on data processing according to claim 7, wherein the step of calculating, for each of the plurality of monitoring terminal devices, a similarity between the second device characteristic information of the monitoring terminal device and the second device characteristic information of each of the other monitoring terminal devices to obtain corresponding second characteristic similarity information includes:

for each monitoring terminal device in the plurality of monitoring terminal devices, performing segmentation processing on the multi-frame environment monitoring image included in the second device characteristic information of the monitoring terminal device to obtain a plurality of monitoring video segments corresponding to the monitoring terminal device, wherein each monitoring video segment includes a plurality of continuous multi-frame environment monitoring images in time;

for each monitoring terminal device in the plurality of monitoring terminal devices, sequentially performing image duplicate removal processing on each monitoring video segment corresponding to the monitoring terminal device, including the environment monitoring image, to obtain each monitoring video duplicate removal segment corresponding to the monitoring terminal device;

sequentially carrying out duplicate removal processing on two adjacent duplicate removal fragments of the monitoring video corresponding to the monitoring terminal equipment aiming at each monitoring terminal equipment in the plurality of monitoring terminal equipment to obtain at least one target fragment of the monitoring video corresponding to the monitoring terminal equipment, and taking each frame of environment monitoring image included by each target fragment of the monitoring video as a target environment monitoring image;

and aiming at every two monitoring terminal devices in the plurality of monitoring terminal devices, performing target image similarity calculation operation on the multi-frame target environment monitoring images corresponding to the two monitoring terminal devices to obtain second characteristic similarity information between the two monitoring terminal devices.

10. The method according to claim 7, wherein the step of fusing the first feature similarity information and the second feature similarity information corresponding to each monitoring terminal device and determining the device relationship information between the plurality of monitoring terminal devices based on the obtained feature similarity fusion information includes:

performing product processing on the first feature similarity information and the second feature similarity information between the two monitoring terminal devices aiming at each two monitoring terminal devices in the plurality of monitoring terminal devices to obtain feature similarity fusion information between the two monitoring terminal devices;

and determining equipment relation information between the two monitoring terminal devices based on the feature similarity fusion information between the two monitoring terminal devices aiming at every two monitoring terminal devices in the multiple monitoring terminal devices so as to determine the equipment relation information between the multiple monitoring terminal devices.

Images