CN111414497B - Distributed data fusion processing method and device - Google Patents
Distributed data fusion processing method and device Download PDFInfo
- Publication number
- CN111414497B CN111414497B CN202010348078.8A CN202010348078A CN111414497B CN 111414497 B CN111414497 B CN 111414497B CN 202010348078 A CN202010348078 A CN 202010348078A CN 111414497 B CN111414497 B CN 111414497B
- Authority
- CN
- China
- Prior art keywords
- data
- information
- node
- newly
- acquisition node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 238000007499 fusion processing Methods 0.000 title claims abstract description 22
- 238000003860 storage Methods 0.000 claims abstract description 14
- 238000007726 management method Methods 0.000 description 79
- 238000010586 diagram Methods 0.000 description 14
- 230000003993 interaction Effects 0.000 description 9
- 238000004590 computer program Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 230000002452 interceptive effect Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000006399 behavior Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 210000000697 sensory organ Anatomy 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/48—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/483—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/41—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
Abstract
The invention relates to the field of data processing, in particular to a method and a device for distributed data fusion processing, which are used for solving the problems that data associated with a target object are stored at different acquisition nodes in a distributed mode, and the data need to be repeatedly searched and complete effective data are difficult to acquire, and the method comprises the following steps: and acquiring newly added data information reported by the acquisition nodes, sending the characteristic information to each other associated acquisition node, acquiring a feedback matching result, and then, when a target acquisition node with the stored original archive data successfully matched with the characteristic information exists based on the matching result, sending the newly added data information to the target acquisition node to serve as new archive data for storage. Therefore, the data intercommunication among all the acquisition nodes is realized by means of the intermediate management nodes, the archive data capable of extracting the same characteristic information is stored under the same acquisition node, the repeated establishment of the archive data under different acquisition nodes is avoided, and the data searching efficiency is improved.
Description
Technical Field
The present invention relates to the field of data processing, and in particular, to a method and apparatus for distributed data fusion processing.
Background
In the security system, each network video recorder (Network Video Recorder, NVR) can collect multimedia data through a camera, and then respectively establish multimedia data files corresponding to each target object in the multimedia data by extracting characteristic information of each target object, wherein each target object is a person, a pet or a moving vehicle with identifiable characteristic information, and the like.
However, in the prior art, for the same target object in the existing security system, different multimedia data files may be built under different management nodes, so that the multimedia data files stored by the different security management nodes overlap, and the multimedia data recorded in the corresponding multimedia data files correspond to different local areas.
For example, the NVR1 and the NVR2 collect multimedia data collected in a certain range respectively, the person a, the person B and the activity behavior of the pet a in a certain range are recorded in the multimedia data collected by the NVR1, and the activity behavior of the person B and the pet a in a certain range are recorded in the multimedia data collected by the NVR2, so that the NVR1 establishes multimedia data files for the person a, the person B and the pet a respectively, and similarly, the NVR2 establishes multimedia data files for the person B and the pet a respectively again, which obviously causes repeated establishment of the multimedia data files, the multimedia file data established in different NVRs overlap, repeated searching is performed during searching, and it is difficult to obtain complete and effective multimedia data.
In view of this, there is a need to design a new method and apparatus for distributed data fusion processing.
Disclosure of Invention
The embodiment of the invention provides a method and a device for distributed data fusion processing, which are used for solving the problems that in the prior art, data associated with a target object are stored at different acquisition nodes in a distributed mode, repeated searching is needed, and complete effective data is difficult to acquire.
The specific technical scheme provided by the embodiment of the invention is as follows:
A method of distributed data fusion processing, comprising:
acquiring newly-added data information reported by an acquisition node, wherein the newly-added data information carries characteristic information of a target object which cannot be matched by the acquisition node and multimedia data containing the target object;
the characteristic information is sent to other related acquisition nodes, and matching results fed back by the other acquisition nodes based on the characteristic information are obtained;
and based on the matching result, when the target acquisition node with the stored original archive data successfully matched with the characteristic information exists, sending the newly-added data information to the target acquisition node to serve as new archive data for storage.
Optionally, after the obtaining the newly added data information reported by the collection node, before the sending the feature information to each associated other collection node, the method further includes:
storing newly added data information corresponding to the characteristic information of the target object as temporary data;
determining that any one or a combination of the following conditions are met:
the total number of the stored temporary data reaches a preset number threshold;
the total data volume of the stored temporary data reaches a preset data volume threshold value;
The total duration of the multimedia data in the stored temporary data reaches a preset duration threshold value.
Optionally, the storing the newly added data information corresponding to the feature information of the target object as temporary data includes:
and establishing temporary data based on the newly added data information, and configuring temporary identification information for the temporary data.
Optionally, the sending the feature information to each associated other acquisition node includes:
acquiring a preset interactable range, and determining each intermediate management node of the same grade associated in the interactable range;
determining an acquisition node for reporting the characteristic information, and transmitting the characteristic information to other acquisition nodes in the jurisdiction;
and respectively sending the characteristic information to each intermediate management node, and enabling each intermediate management node to send the characteristic information to each other acquisition node in each jurisdiction.
Optionally, the sending the new data information to the target collection node as new archive data for storage includes:
and sending the newly added data information to the target acquisition node, enabling the target acquisition node to determine global identification information of original archive data successfully matched with the characteristic information, and storing the newly added data information as new archive data corresponding to the global identification information.
Optionally, after the obtaining the matching result fed back by each other collection node based on the feature information, the method further includes:
based on the matching result, when the target acquisition node which is successfully matched does not exist, configuring new global identification information for the newly-added data information;
and sending the global identification information and the newly-added data information to an acquisition node which reports the newly-added data information, enabling the acquisition node to correspond to the global identification information, and storing the newly-added data information as new archive data.
An apparatus for distributed data fusion processing, comprising:
the acquisition unit acquires newly-added data information reported by an acquisition node, wherein the newly-added data information carries characteristic information of a target object which cannot be matched by the acquisition node and multimedia data containing the target object;
the sending unit is used for sending the characteristic information to each other associated acquisition node and acquiring a matching result fed back by each other acquisition node based on the characteristic information;
and the processing unit is used for transmitting the newly added data information to the target acquisition node as new archive data to be stored when determining that the stored original archive data and the target acquisition node with the successfully matched characteristic information exist based on the matching result.
Optionally, after the obtaining the newly added data information reported by the collection node and before the sending the feature information to each associated other collection node, the obtaining unit is further configured to:
storing newly added data information corresponding to the characteristic information of the target object as temporary data;
determining that any one or a combination of the following conditions are met:
the total number of the stored temporary data reaches a preset number threshold;
the total data volume of the stored temporary data reaches a preset data volume threshold value;
the total duration of the multimedia data in the stored temporary data reaches a preset duration threshold value.
Optionally, when the new data information corresponding to the feature information of the target object is stored as temporary data, the obtaining unit is configured to:
and establishing temporary data based on the newly added data information, and configuring temporary identification information for the temporary data.
Optionally, when the feature information is sent to each associated other acquisition node, the sending unit is configured to:
acquiring a preset interactable range, and determining each intermediate management node of the same grade associated in the interactable range;
Determining an acquisition node for reporting the characteristic information, and transmitting the characteristic information to other acquisition nodes in the jurisdiction;
and respectively sending the characteristic information to each intermediate management node, and enabling each intermediate management node to send the characteristic information to each other acquisition node in each jurisdiction.
Optionally, when the new data information is sent to the target collection node to be stored as new archive data, the processing unit is configured to:
and sending the newly added data information to the target acquisition node, enabling the target acquisition node to determine global identification information of original archive data successfully matched with the characteristic information, and storing the newly added data information as new archive data corresponding to the global identification information.
Optionally, after the obtaining the matching result fed back by each other acquisition node based on the feature information, the processing unit is further configured to:
based on the matching result, when the target acquisition node which is successfully matched does not exist, configuring new global identification information for the newly-added data information;
and sending the global identification information and the newly-added data information to an acquisition node which reports the newly-added data information, enabling the acquisition node to correspond to the global identification information, and storing the newly-added data information as new archive data.
An electronic device, comprising:
a memory for storing executable instructions;
a processor for reading and executing executable instructions stored in the memory to implement the method of distributed data fusion processing as described in any one of the above.
A storage medium, which when executed by a processor, enables a method of distributed data fusion processing as claimed in any preceding claim to be performed.
The invention has the following beneficial effects:
the present disclosure provides a method and an apparatus for distributed data fusion processing, where newly added data information reported by an acquisition node is obtained, where the newly added data information carries feature information of a target object that the acquisition node cannot complete matching and multimedia data including the target object, and then the feature information is sent to each other associated acquisition node, and a matching result fed back by each other acquisition node based on the feature information is obtained, and then, based on the matching result, when it is determined that there is a target acquisition node that the saved original archive data and the feature information are successfully matched, the newly added data information is sent to the target acquisition node to be saved as new archive data. Therefore, by means of the intermediate management node, data intercommunication among all the acquisition nodes is realized, further, archive data capable of extracting the same characteristic information is stored under the same acquisition node, repeated establishment of the archive data under different acquisition nodes is avoided, effective data can be obtained when data corresponding to a target object are searched, the searching efficiency of the data is improved, and the data searching pressure is reduced while the data storage pressure is reduced.
Drawings
FIG. 1 is a schematic diagram illustrating interaction between an intermediate management node and an acquisition node in an embodiment of the disclosure;
fig. 2 is a schematic diagram of a global identification information list recorded by an acquisition node in an embodiment of the disclosure;
fig. 3 is a schematic diagram of a list of identification information of recording data of an acquisition node in an embodiment of the disclosure;
FIG. 4 is a flow chart of a distributed data fusion process in an embodiment of the disclosure;
fig. 5 is a schematic diagram of a temporary identifier list recorded by an intermediate management node in an embodiment of the disclosure;
FIG. 6 is a schematic diagram of a global identification information list recorded by an intermediate management node in an embodiment of the disclosure;
FIG. 7 is a schematic diagram of a logic structure of an intermediate management node according to an embodiment of the disclosure;
fig. 8 is a schematic entity structure diagram of an intermediate management node in an embodiment of the disclosure.
Detailed Description
In order to solve the problems that in the prior art, data associated with a target object are stored in different intermediate management nodes in a distributed manner, repeated searching is needed, and complete effective data are difficult to obtain, newly-added data information reported by an acquisition node is obtained, the newly-added data information carries characteristic information of the target object, which cannot be matched by the acquisition node, and multimedia data containing the target object, the characteristic information is sent to other associated acquisition nodes, a matching result fed back by the other acquisition nodes based on the characteristic information is obtained, and then, when the existence of the target acquisition node, which is successfully matched with the characteristic information, of the saved original archive data is determined based on the matching result, the newly-added data information is sent to the target acquisition node to be used as new archive data for storage.
In the present disclosure, referring to the interactive schematic diagram shown in fig. 1, the distributed collection nodes and the intermediate management nodes for managing the collection nodes and processing the multimedia data collected by the collection nodes are respectively referred to. The acquisition nodes are distributed and configured at different positions and are used for acquiring multimedia data within a certain range, and optionally, the acquired multimedia data are locally identified or sent to an intermediate management node, and the identification result of the target object in the multimedia data returned by the intermediate management node is received, wherein the target object comprises but is not limited to a person, a pet and a car, and equipment which can be used as the acquisition node comprises but is not limited to a network video recorder (Network Video Recorder, NVR).
After receiving the multimedia data sent by the managed acquisition node, the intermediate management node performs feature recognition on each frame of image included in the multimedia data.
For example, the intermediate management node adopts a face key point detection technology to identify face feature information of each target person contained in the multimedia data, determines the positions of face contours and feature points of five sense organs, further determines all target persons contained in the multimedia data, and feeds back the face feature information of the identified target person to the corresponding acquisition node as feature information of the corresponding target person.
For another example, the intermediate management node adopts a license plate recognition technology to recognize license plate feature information of all vehicles contained in the multimedia data, further determines all target vehicles contained in the multimedia data, and feeds back the recognized license plate feature information to the corresponding acquisition nodes as feature information of the corresponding target vehicles.
After the acquisition node identifies the characteristic information of the target object in the multimedia data, or when the characteristic information sent by the intermediate management node is received, matching processing is carried out based on the characteristic information. Specifically, referring to fig. 2, each collection node stores archive data, feature information of the same target object corresponds to global identification information, the global identification information corresponds to a plurality of archive data, and the archive data at least includes: the system comprises multimedia data of the target object, and acquisition nodes and corresponding acquisition time for acquiring the multimedia data.
The acquisition node judges whether the locally stored archive data has archive data which can be matched with the characteristic information.
In the first case, the acquisition node determines the characteristic information of the target object which can be identified from the acquired multimedia data, and when matching with the locally stored archive data cannot be completed, establishes new data information based on the characteristic information of the identified target object and the multimedia data containing the target object, configures unique data identification information on the acquisition node for the new data information, and reports the new data information to an intermediate management node.
For example, referring to fig. 3, the collection node may selectively establish a data identification information list based on the multimedia data corresponding to the feature information that cannot be matched locally, the collection time corresponding to the multimedia data, and the feature information of the target object extracted from the multimedia data, so as to intuitively record the reported newly added data information.
In the second case, the collection node determines the characteristic information of the target object identified from the collected multimedia data, and when the characteristic information can be matched with the locally stored archive data, determines global identification information corresponding to the matched archive data, and stores the collected multimedia data containing the target object as new archive data corresponding to the global identification information.
In the third case, when the collection node determines that the received characteristic information can/cannot be matched with the locally stored archive data, a notice of success/failure of matching is fed back to the intermediate management node.
The intermediate management node may be one collection node capable of interacting with and managing other collection nodes within the interaction range, or may be an upper node capable of managing and interacting with the associated collection node. The intermediate management nodes can conduct feature recognition on multimedia data sent by each associated acquisition node and feed back the recognized feature information, the associated acquisition nodes are acquisition nodes capable of directly or indirectly conducting interaction in an interaction range, direct interaction is conducted between the intermediate management nodes and the acquisition nodes in the jurisdiction, interaction can be conducted between the intermediate management nodes in the same grade, and further in the interaction range, the intermediate management nodes can achieve indirect interaction with each acquisition node in the jurisdiction of other intermediate management nodes. And the intermediate management node processes the received newly-added data information reported by each managed acquisition node, and finally realizes the fusion processing of the multimedia data acquired by the distributed acquisition nodes.
In the following description, only the process of extracting feature information of a target object from multimedia data collected from a collection node, failing to match with original archive data locally stored in the collection node for collecting the multimedia data, generating new data information based on the feature information of the target object, including the multimedia data of the target object, and reporting the new data information to an intermediate management node for processing will be described as an example.
The preferred embodiments of the present disclosure will be described in detail below with reference to fig. 4:
step 401: the method comprises the steps that an intermediate management node obtains newly-added data information reported by an acquisition node, wherein the newly-added data information carries characteristic information of a target object which cannot be matched by the acquisition node, and multimedia data containing the target object.
And the intermediate management node receives newly-added data information reported by the acquisition node, wherein the newly-added data information is generated based on the characteristic information of the target object and the multimedia data containing the target object when the acquisition node determines that the file data stored by the acquisition node cannot be matched with the characteristic information of the target object extracted from the acquired multimedia data, and then the intermediate management node stores the newly-added data information corresponding to the characteristic information of the target object as temporary data, and specifically, the intermediate management node establishes one temporary data based on the newly-added data information and configures one temporary identification information for the one temporary data.
It should be noted that, the intermediate management node stores a temporary identifier list containing all configured temporary identifier information, where the temporary identifier information corresponds to temporary data established based on the received newly-added data information, one temporary identifier information configured by the intermediate management node can uniquely correspond to one temporary data on the intermediate management node, and based on the temporary identifier information, an acquisition node corresponding to the source of the newly-added data information of the temporary data can be obtained.
For example, referring to fig. 5, an acquisition node managed by an intermediate management node 1 receives newly added data information reported by acquisition nodes 1 and 2, extracts a target object x, corresponding feature information x and multimedia data information acquired by the acquisition node 1 included in the newly added data information based on the newly added data information reported by the acquisition node 1, identifies temporary data 1 established and displays temporary identification information 1 configured for the temporary data 1, and similarly generates related information of the temporary data 2 based on the newly added media data reported by the acquisition node 2. Therefore, the intermediate management node realizes the caching of the received newly-added data information, and the temporary data list are established to more intuitively sort out the data to be processed, so that preparation is made for the subsequent fusion processing, and the smooth proceeding of the processing is ensured.
Step 402: and the intermediate management node sends the characteristic information to each other associated acquisition node and acquires a matching result fed back by each other acquisition node based on the characteristic information.
After receiving newly-added data information reported by an acquisition node and storing the newly-added data information as temporary data, the intermediate management node sends characteristic information of a target object carried in the newly-added data information to each other associated acquisition node when determining that any one of the following conditions or combinations are met:
(1) The total number of the stored temporary data reaches a preset number threshold;
(2) The total data volume of the stored temporary data reaches a preset data volume threshold value;
(3) The total duration of the multimedia data in the stored temporary data reaches a preset duration threshold value.
For example, the intermediate management node presets the number threshold value of the temporary data as 10, the data quantity threshold value is 1G, the duration threshold value is 1h, after receiving newly-added data information reported by the acquisition node and generating temporary data based on the newly-added data information, the intermediate node acquires duration information of the multimedia data contained in the newly-added data information and the data quantity information contained in the newly-added data information, determines that the number of the temporary data in the total temporary data reaches 10, or the total duration of the multimedia data in the total temporary data reaches 1h, or when the total data quantity of the multimedia data in the total temporary data reaches 1G, the intermediate node triggers sequential processing of the temporary data.
In this way, the intermediate management node can selectively adopt a batch processing mode, when any condition or combination is achieved, the intermediate management node triggers to send characteristic information to each other associated acquisition node, so that the calculated amount of the acquisition node is effectively saved, and the processing time of the acquisition node is reduced.
When the intermediate management node processes the newly added data information, the intermediate management node may trigger batch processing when the condition is met, and in the following description of the flow, only the process of the intermediate management node processing the newly added data information X will be described in detail as an example.
When the number, the data amount or the total duration of the stored temporary data reach the condition of triggering the intermediate management nodes to perform batch processing, the intermediate management nodes send the characteristic information of the target object carried in the newly-added data information X corresponding to the temporary data 1 to each associated other acquisition node, specifically, the intermediate management nodes acquire the preset interactive range, determine each intermediate management node of the same class associated in the interactive range, then determine the acquisition node reporting the characteristic information, send the characteristic information to other acquisition nodes in the jurisdiction, respectively send the characteristic information to each intermediate management node, and enable each intermediate management node to send the characteristic information to each other acquisition node in the jurisdiction.
For example, referring to fig. 1, taking the number of intermediate management nodes in the interactive range as 2 as an example, the method includes the intermediate management nodes 1 and 2, and the collection nodes in the jurisdiction of the intermediate management node 1: acquisition nodes 1-4, acquisition nodes in jurisdiction of intermediate management 2: and (5) collecting nodes 5-7. If the collecting node for sending the newly added data information X is the collecting node 1, after the intermediate management node 1 receives the newly added data information X, after determining that the triggering condition is reached, the characteristic information of the target object carried in the newly added data information is sent to other collecting nodes in the management range: the collection nodes 2-4 send the characteristic information to the same-level intermediate management node 2 associated in the interactive range, so that the intermediate management node 2 can send the characteristic information to each other collection node in the jurisdiction, namely, the collection nodes 5-7.
Further, the intermediate management node obtains a matching result fed back by each other acquisition node based on the characteristic information. And the matching result characterizes that after the characteristic information is compared with the characteristic information corresponding to the stored archive data by each other acquisition node, the obtained comparison result comprises, but is not limited to, the similarity between the characteristic information and the characteristic information corresponding to the stored archive data is compared, and the matching can be considered successful if the similarity reaches a certain similarity threshold value.
Step 403: is the intermediate management node determining whether there is a target collection node that has successfully matched the saved raw profile data with the feature information? If yes, go to step 404, otherwise, go to step 405.
Specifically, after receiving the matching result fed back by each other acquisition node, the intermediate management node further determines whether there is matching between the saved original file data and the feature information sent to each other acquisition node in the matching result reported by each other acquisition node, if yes, the step defined in step 404 is executed, and if not, the step defined in step 405 is executed.
Step 404: and the intermediate management node sends the newly-added data information to the target acquisition node to be stored as new archive data.
And after determining that a target acquisition node which is matched with the transmitted characteristic information exists based on a matching result fed back by each other acquisition node, the intermediate management node transmits the newly-added data information to the target acquisition node, so that the target acquisition node determines global identification information of original archive data which is successfully matched with the characteristic information, and the newly-added data information is stored as new archive data corresponding to the global identification information.
It should be noted that, the global identification information is configured by the intermediate management node, the global identification information corresponds to the feature information of the target object, the feature information of one target object corresponds to one global identification information, and all multimedia data including the one target object is stored as archive data corresponding to the one global identification information.
For example, continuing to use the example in step 402, if the intermediate acquisition node 1 determines that the acquisition node 2 can complete matching with the transmitted feature information based on the obtained matching result, then new data information X corresponding to the temporary data X is transmitted to the acquisition node 2, so that the acquisition node 2 stores the new information X as a new file corresponding to the global identification information after determining the global identification information corresponding to the feature information.
Therefore, the fusion storage of the multimedia data of the target object corresponding to the feature information can be realized by judging whether the feature information is matched and storing the global identification information corresponding to the feature information corresponding to the newly added data information which is successfully matched, so that the repeated searching is not needed when the multimedia data corresponding to the target object is acquired subsequently, complete and effective data can be obtained when the multimedia data related to the target object is searched, and the searching efficiency is improved.
Step 405: the intermediate management node configures a new global identification information for the newly-added data information, and sends the global identification information and the newly-added data information to an acquisition node which reports the newly-added data information.
And the intermediate management node configures new global identification information for the newly-added data information when determining that no target acquisition node successfully matched exists based on the obtained matching result, and sends the global identification information and the newly-added data information to an acquisition node reporting the newly-added data information, so that the acquisition node corresponds to the global identification information, and the newly-added data information is stored as new archive data. Specifically, when the intermediate management node determines that no target acquisition node which is matched with the transmitted characteristic information is present in the interaction range, configuring new global identification information for newly-added data information X which is processed currently, and resending the configured global identification information and the newly-added data information X back to an acquisition node which reports the newly-added data information X, so that the acquisition node stores the newly-added data information as new archive data corresponding to the global identification information.
For example, continuing to use the example in step 402, if the intermediate acquisition node determines, based on the obtained matching information, that there is no target acquisition node that is successfully matched, configuring global identification information 1 for feature information X corresponding to newly-added data information X, and sending the global identification information 1 and the newly-added data information X to the acquisition node 1 that reports the newly-added data information X, so that the acquisition node 1 stores the newly-added identification information X as new archive data corresponding to the global identification information 1.
It should be noted that, the intermediate management node stores a global identification information list including all configured global identification information, which is used for determining the configuration situation of the global identification information in each acquisition node in the jurisdiction.
For example, referring to the global identification information list established in fig. 6, global identification information 1 corresponds to one feature information x, and it may be determined that the collection node storing the archive data corresponding to the feature information x is collection node 1 based on the global identification information list.
Therefore, after a new target object appears, the new global identification information is configured and the archive data is correspondingly stored, so that the effective management of the newly added data is realized, the fusion of the multimedia data containing the same target object is realized, the complete and effective multimedia data can be obtained in the process of searching the data by storing the multimedia data capable of extracting the same characteristic information under the same acquisition node, repeated searching is avoided, and the searching efficiency of the data is improved.
Based on the same inventive concept, in an embodiment of the present disclosure, referring to fig. 7, an apparatus for distributed data fusion processing is provided, including: at least comprises: an acquisition unit 701, a transmission unit 702, a processing unit 703, wherein,
the acquisition unit 701 acquires newly-added data information reported by an acquisition node, wherein the newly-added data information carries characteristic information of a target object which cannot be matched by the acquisition node and multimedia data comprising the target object;
the sending unit 702 sends the characteristic information to each other associated acquisition node, and obtains a matching result fed back by each other acquisition node based on the characteristic information;
and the processing unit 703 is configured to send the new data information to the target acquisition node as new archive data to store when it is determined that there is a target acquisition node where the stored original archive data and the feature information are successfully matched based on the matching result.
Optionally, after the obtaining the newly added data information reported by the collection node and before the sending the feature information to each associated other collection node, the obtaining unit 701 is further configured to:
Storing newly added data information corresponding to the characteristic information of the target object as temporary data;
determining that any one or a combination of the following conditions are met:
the total number of the stored temporary data reaches a preset number threshold;
the total data volume of the stored temporary data reaches a preset data volume threshold value;
the total duration of the multimedia data in the stored temporary data reaches a preset duration threshold value.
Optionally, when the new data information corresponding to the feature information of the target object is stored as temporary data, the obtaining unit 701 is configured to:
and establishing temporary data based on the newly added data information, and configuring temporary identification information for the temporary data.
Optionally, when the feature information is sent to each associated other collection node, the sending unit 702 is configured to:
acquiring a preset interactable range, and determining each intermediate management node of the same grade associated in the interactable range;
determining an acquisition node for reporting the characteristic information, and transmitting the characteristic information to other acquisition nodes in the jurisdiction;
and respectively sending the characteristic information to each intermediate management node, and enabling each intermediate management node to send the characteristic information to each other acquisition node in each jurisdiction.
Optionally, when the new data information is sent to the target collection node to be stored as new archive data, the processing unit 703 is configured to:
and sending the newly added data information to the target acquisition node, enabling the target acquisition node to determine global identification information of original archive data successfully matched with the characteristic information, and storing the newly added data information as new archive data corresponding to the global identification information.
Optionally, after the obtaining the matching result fed back by the other collection nodes based on the feature information, the processing unit 703 is further configured to:
based on the matching result, when the target acquisition node which is successfully matched does not exist, configuring new global identification information for the newly-added data information;
and sending the global identification information and the newly-added data information to an acquisition node which reports the newly-added data information, enabling the acquisition node to correspond to the global identification information, and storing the newly-added data information as new archive data.
Based on the same inventive concept, in an embodiment of the present disclosure, a method and an apparatus for distributed data fusion processing are provided, and refer to fig. 8. As shown, the entity apparatus may include: a processor 801, memory 802, transceiver 803, and bus interface 804;
The processor 801 is configured to read the computer instructions in the memory 802, and execute any of the above terminal positioning methods based on the multi-front end device.
The processor 801 is responsible for managing the bus architecture and general processing, and the memory 802 may store data used by the processor 801 in performing operations. The transceiver 803 is configured to receive and transmit data under the control of the processor 801.
A bus architecture may be comprised of any number of interconnected buses and bridges, and in particular one or more processors represented by the processor 801 and various circuits of memory, represented by the memory 802. The bus architecture may also link together various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., which are well known in the art and, therefore, will not be described further herein. The bus interface provides an interface.
Based on the same inventive concept, the disclosed embodiments provide a storage medium, which when instructions in the storage medium are executed by a processor, enable the processor to perform any one of the methods of the distributed data fusion process in the above-described flow.
In summary, the disclosure provides a method and an apparatus for distributed data fusion processing, where newly added data information reported by an acquisition node is obtained, where the newly added data information carries feature information of a target object that cannot be matched by the acquisition node and multimedia data including the target object, the feature information is then sent to each other associated acquisition node, a matching result fed back by each other acquisition node based on the feature information is obtained, and then, based on the matching result, when it is determined that there is a target acquisition node that has been successfully matched with the feature information, the newly added data information is sent to the target acquisition node to be stored as new archive data. Therefore, by means of the intermediate management node, data intercommunication among all the acquisition nodes is realized, further, archive data capable of extracting the same characteristic information is stored under the same acquisition node, repeated establishment of the archive data under different acquisition nodes is avoided, effective data can be obtained when data corresponding to a target object are searched, the searching efficiency of the data is improved, and the data searching pressure is reduced while the data storage pressure is reduced.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various modifications and variations can be made to the embodiments of the present invention without departing from the spirit or scope of the embodiments of the invention. Thus, if such modifications and variations of the embodiments of the present invention fall within the scope of the claims and the equivalents thereof, the present invention is also intended to include such modifications and variations.
Claims (14)
1. A method of distributed data fusion processing, comprising:
acquiring newly-added data information reported by an acquisition node, wherein the newly-added data information carries characteristic information of a target object which cannot be matched by the acquisition node and multimedia data containing the target object;
the characteristic information is sent to other related acquisition nodes, and matching results fed back by the other acquisition nodes based on the characteristic information are obtained;
and based on the matching result, when the target acquisition node with the stored original archive data successfully matched with the characteristic information exists, sending the newly-added data information to the target acquisition node to serve as new archive data for storage.
2. The method of claim 1, wherein after the obtaining the newly added data information reported by the collection node, before the sending the feature information to each associated other collection node, further comprises:
Storing newly added data information corresponding to the characteristic information of the target object as temporary data;
determining that any one or a combination of the following conditions are met:
the total number of the stored temporary data reaches a preset number threshold;
the total data volume of the stored temporary data reaches a preset data volume threshold value;
the total duration of the multimedia data in the stored temporary data reaches a preset duration threshold value.
3. The method of claim 2, wherein storing newly added data information corresponding to the characteristic information of the target object as temporary data comprises:
and establishing temporary data based on the newly added data information, and configuring temporary identification information for the temporary data.
4. The method of claim 1, wherein the sending the characteristic information to the associated respective other collection node comprises:
acquiring a preset interactable range, and determining each intermediate management node of the same grade associated in the interactable range;
determining an acquisition node for reporting the characteristic information, and transmitting the characteristic information to other acquisition nodes in the jurisdiction;
And respectively sending the characteristic information to each intermediate management node, and enabling each intermediate management node to send the characteristic information to each other acquisition node in each jurisdiction.
5. The method according to any one of claims 1-4, wherein said sending the new data information to the target collection node for saving as new archive data comprises:
and sending the newly added data information to the target acquisition node, enabling the target acquisition node to determine global identification information of original archive data successfully matched with the characteristic information, and storing the newly added data information as new archive data corresponding to the global identification information.
6. The method according to any one of claims 1-4, wherein after obtaining the matching result fed back by the respective other acquisition node based on the feature information, the method further includes:
based on the matching result, when the target acquisition node which is successfully matched does not exist, configuring new global identification information for the newly-added data information;
and sending the global identification information and the newly-added data information to an acquisition node which reports the newly-added data information, enabling the acquisition node to correspond to the global identification information, and storing the newly-added data information as new archive data.
7. An apparatus for distributed data fusion processing, comprising:
the acquisition unit acquires newly-added data information reported by an acquisition node, wherein the newly-added data information carries characteristic information of a target object which cannot be matched by the acquisition node and multimedia data containing the target object;
the sending unit is used for sending the characteristic information to each other associated acquisition node and acquiring a matching result fed back by each other acquisition node based on the characteristic information;
and the processing unit is used for transmitting the newly added data information to the target acquisition node as new archive data to be stored when determining that the stored original archive data and the target acquisition node with the successfully matched characteristic information exist based on the matching result.
8. The apparatus of claim 7, wherein after the acquiring the newly added data information reported by the collection node and before the sending the feature information to each associated other collection node, the acquiring unit is further configured to:
storing newly added data information corresponding to the characteristic information of the target object as temporary data;
Determining that any one or a combination of the following conditions are met:
the total number of the stored temporary data reaches a preset number threshold;
the total data volume of the stored temporary data reaches a preset data volume threshold value;
the total duration of the multimedia data in the stored temporary data reaches a preset duration threshold value.
9. The apparatus according to claim 8, wherein the obtaining unit is configured to, when saving newly added data information corresponding to the feature information of the target object as temporary data:
and establishing temporary data based on the newly added data information, and configuring temporary identification information for the temporary data.
10. The apparatus of claim 7, wherein the transmitting unit is configured to, when transmitting the characteristic information to each associated other acquisition node:
acquiring a preset interactable range, and determining each intermediate management node of the same grade associated in the interactable range;
determining an acquisition node for reporting the characteristic information, and transmitting the characteristic information to other acquisition nodes in the jurisdiction;
and respectively sending the characteristic information to each intermediate management node, and enabling each intermediate management node to send the characteristic information to each other acquisition node in each jurisdiction.
11. The apparatus according to any one of claims 7-10, wherein, when the new data information is sent to the target collection node to be saved as new archive data, the processing unit is configured to:
and sending the newly added data information to the target acquisition node, enabling the target acquisition node to determine global identification information of original archive data successfully matched with the characteristic information, and storing the newly added data information as new archive data corresponding to the global identification information.
12. The apparatus according to any one of claims 7-10, wherein after the obtaining the matching result fed back by the respective other acquisition node based on the feature information, the processing unit is further configured to:
based on the matching result, when the target acquisition node which is successfully matched does not exist, configuring new global identification information for the newly-added data information;
and sending the global identification information and the newly-added data information to an acquisition node which reports the newly-added data information, enabling the acquisition node to correspond to the global identification information, and storing the newly-added data information as new archive data.
13. An electronic device, comprising:
a memory for storing executable instructions;
a processor for reading and executing executable instructions stored in a memory to implement the method of distributed data fusion processing according to any one of claims 1 to 6.
14. A storage medium, wherein instructions in the storage medium, when executed by a processor, enable a method of distributed data fusion processing according to any one of claims 1 to 6 to be performed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010348078.8A CN111414497B (en) | 2020-04-28 | 2020-04-28 | Distributed data fusion processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010348078.8A CN111414497B (en) | 2020-04-28 | 2020-04-28 | Distributed data fusion processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111414497A CN111414497A (en) | 2020-07-14 |
| CN111414497B true CN111414497B (en) | 2023-11-10 |
Family
ID=71492174
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010348078.8A Active CN111414497B (en) | 2020-04-28 | 2020-04-28 | Distributed data fusion processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111414497B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110659560A (en) * | 2019-08-05 | 2020-01-07 | 深圳市优必选科技股份有限公司 | Method and system for identifying associated object |
| CN110958301A (en) * | 2019-11-04 | 2020-04-03 | 广州亚美信息科技有限公司 | Vehicle archive data processing method, device and system based on alliance chain |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6313987B2 (en) * | 2014-02-07 | 2018-04-18 | 富士通株式会社 | File management program, file management method, and file management system |
-
2020
- 2020-04-28 CN CN202010348078.8A patent/CN111414497B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110659560A (en) * | 2019-08-05 | 2020-01-07 | 深圳市优必选科技股份有限公司 | Method and system for identifying associated object |
| CN110958301A (en) * | 2019-11-04 | 2020-04-03 | 广州亚美信息科技有限公司 | Vehicle archive data processing method, device and system based on alliance chain |
Non-Patent Citations (1)
| Title |
|---|
| 陈泽琳,张湘东,黄永成.可扩展的分布式档案信息管理系统的研究与设计.计算机工程与应用.2002,(17),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111414497A (en) | 2020-07-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111125409B (en) | Control method and device of access control system and access control system | |
| CN107071005A (en) | A kind of method of data synchronization and system | |
| CN107770280B (en) | Multimedia data processing and acquiring method, acquisition terminal and processing device | |
| CN110884537A (en) | Linkage function implementation system and method | |
| CN111414497B (en) | Distributed data fusion processing method and device | |
| CN112148920B (en) | Data management method | |
| CN113470013A (en) | Method and device for detecting moved article | |
| CN105554455A (en) | Control method and system for monitoring network | |
| CN112819176B (en) | Data management method and data management device suitable for machine learning | |
| CN115689417A (en) | Material transportation management method, system, terminal equipment and medium | |
| CN113051981B (en) | Face recognition method and device | |
| CN113362233B (en) | Picture processing method, device, equipment, system and storage medium | |
| CN113886631A (en) | Video archive generation method and device and storage medium | |
| CN113434433A (en) | Intelligent auxiliary method and device for software test | |
| CN113840002A (en) | Information processing method, system, equipment and medium for locker under weak network environment | |
| CN114547182A (en) | Personnel information synchronization method, terminal device and storage medium | |
| CN117151675B (en) | Remote operation and maintenance method and system based on video monitoring and encryption | |
| CN111400161B (en) | True machine verification method, device and system of mobile terminal | |
| CN117411929B (en) | Business process monitoring method, device, equipment and storage medium | |
| CN116167713A (en) | Monitoring method and device for job ticket processing and electronic equipment | |
| CN114584389B (en) | Communication method, system and equipment with high-capacity biological recognition intelligent cell | |
| CN113156921A (en) | Vehicle fault diagnosis system, method and storage medium | |
| CN117896613A (en) | Upgrading method, device, storage medium and system of video monitoring system | |
| CN113393115A (en) | Method and device for determining battery theft, battery management system and storage medium | |
| CN113434732A (en) | Data retrieval method, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |