CN112866366A - Data perception fusion method and device - Google Patents
Data perception fusion method and device Download PDFInfo
- Publication number
- CN112866366A CN112866366A CN202110036442.1A CN202110036442A CN112866366A CN 112866366 A CN112866366 A CN 112866366A CN 202110036442 A CN202110036442 A CN 202110036442A CN 112866366 A CN112866366 A CN 112866366A
- Authority
- CN
- China
- Prior art keywords
- data information
- information
- data
- internet
- things equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/34—Network arrangements or protocols for supporting network services or applications involving the movement of software or configuration parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/55—Push-based network services
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a data perception fusion method and a device, wherein the method comprises the following steps: receiving at least two pieces of original data information of at least two pieces of Internet of things equipment; aiming at each Internet of things device, executing the following steps: adding point location information of the Internet of things equipment and first time information carried in the original data information into the original data information to obtain first data information; analyzing the first data information to obtain perception data information corresponding to the Internet of things equipment; the perception data information comprises characteristic data information required by the service requirement of the user; converting the data format of the sensing data information into a preset target data format to obtain target data information corresponding to the Internet of things equipment; fusing target data information corresponding to each Internet of things device to obtain fused data information corresponding to business requirements; and sending the fused data information to the user. The scheme can improve the applicability of the data perception fusion method.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a data perception fusion method and device.
Background
The data fusion technology is an information processing technology which associates and analyzes multiple pieces of observation data or information under a certain criterion to combine more effective data which more meets the business requirements of users, can effectively balance and reduce the energy consumption of the equipment of the Internet of things, enhances the accuracy of the collected data and improves the collection efficiency.
At present, with the continuous development and updating of internet of things equipment, the current increasing business requirements of users can be met by using high-performance internet of things equipment. However, the operating environment on which the internet of things device deployed in the current service scene depends is severe and is affected by the performance of the internet of things device, and when the data observed by the current internet of things device is fused by the existing data perception fusion method, the increased service requirement of the user cannot be met. Therefore, the existing data perception fusion method has higher requirements on the performance of the Internet of things equipment.
Disclosure of Invention
The embodiment of the invention provides a data perception fusion method and device, which can reduce the performance requirement on equipment of the Internet of things.
In a first aspect, the present invention provides a data-aware fusion method, including:
receiving at least two pieces of original data information of at least two pieces of Internet of things equipment;
for each of the internet of things devices, executing:
adding point location information of the Internet of things equipment and first time information carried in the original data information into the original data information to obtain first data information; the point location information comprises spatial information of the equipment of the Internet of things;
analyzing the first data information to obtain perception data information corresponding to the Internet of things equipment; the sensing data information comprises characteristic data information required by the service requirement of a user;
converting the data format of the sensing data information into a preset target data format to obtain target data information corresponding to the Internet of things equipment;
fusing target data information corresponding to each Internet of things device to obtain fused data information corresponding to the service requirements;
and sending the fused data information to a user.
Optionally, further comprising: the method comprises the steps that a node cluster is preset, and the node cluster comprises at least two node devices;
the analyzing the first data information includes:
forwarding the first data information to a preset node cluster so as to analyze and process the first data information by utilizing at least one node device;
determining the load of each node device which is currently operated;
judging whether the number of the loads of the node devices, which is greater than a preset load threshold value, is zero or not;
and if not, increasing the number of the currently operated node devices in the node cluster according to a preset rule.
Optionally, the receiving at least two pieces of raw data information of at least two pieces of internet-of-things equipment includes:
acquiring the service requirement of a user; the service requirement carries a subscription request of a user for required original data information;
and receiving at least two pieces of original data information of at least two pieces of Internet of things equipment included in the subscription request.
Optionally, the analyzing the first data information to obtain perception data information corresponding to the internet of things device includes:
determining the data type of the first data information; wherein the data types include: structured data, semi-structured data, and unstructured data;
analyzing the first data information according to the data type and the service requirement to obtain second data information; the second data information comprises the point location information of the internet of things equipment where the first data information is located, the first time information and feature data information required by the service requirement obtained after analysis;
determining second time information when the first data information is analyzed;
and adding the second time information and the service requirement to the second data information to obtain perception data information corresponding to the Internet of things equipment.
Optionally, the fusing the target data information corresponding to each piece of internet-of-things equipment to obtain fused data information corresponding to the service requirement includes:
determining a fusion rule according to the service requirement; wherein the fusion rule comprises: the first time information is the same and the spatial information is the same, the first time information is the same and the spatial information is different, and the first time information is different and the spatial information is the same;
and fusing the target data information corresponding to the Internet of things equipment according to the determined fusion rule to obtain fusion data information corresponding to the service requirement.
Optionally, the fusing the target data information corresponding to each piece of internet-of-things equipment according to the determined fusion rule includes:
when the determined fusion rule is that the first time information is the same and the space information is the same, each target data information with the same first time information and the same space information is obtained; fusing each target data information;
when the determined fusion rule is that the first time information is the same and the spatial information is different, acquiring each target data information with the same first time information and different spatial information; fusing each target data information;
when the determined fusion rule is that the first time information is different and the space information is the same, acquiring each target data information with different first time information and the same space information; and fusing each target data information.
Optionally, after the sending the fused data information to the user, the method further includes:
receiving a query request of the user;
acquiring target data corresponding to the service requirement and the time information carried by the query request according to the query request;
and sending the target data to the user.
In a second aspect, the present invention provides a data-aware fusion device, comprising:
the receiving module is used for receiving at least two pieces of original data information of at least two pieces of Internet of things equipment;
the adding module is used for adding point location information of the internet of things equipment and first time information carried in the original data information to the original data information received by the receiving module to obtain first data information; the point location information comprises spatial information of the Internet of things equipment;
the analysis module is used for analyzing the first data information acquired by the adding module to obtain perception data information corresponding to the Internet of things equipment; the sensing data information comprises characteristic data information required by the service requirement of a user;
the format conversion module is used for converting the data format of the perception data information obtained by the analysis module into a preset target data format to obtain target data information corresponding to the Internet of things equipment;
the fusion module is used for fusing the target data information corresponding to the Internet of things equipment obtained by the format conversion module to obtain fused data information corresponding to the service requirement;
and the sending module is used for sending the fusion data information obtained by the fusion module to a user.
In a third aspect, an embodiment of the present invention provides a data-aware fusion device, including: at least one memory and at least one processor;
the at least one memory to store a machine readable program;
the at least one processor is configured to invoke the machine-readable program to perform the method according to the first aspect or any possible implementation manner of the first aspect.
In a fourth aspect, an embodiment of the present invention provides a computer-readable medium, on which computer instructions are stored, and when executed by a processor, the computer instructions cause the processor to perform the method provided by the first aspect or any possible implementation manner of the first aspect.
The invention provides a data perception fusion method and a data perception fusion device, wherein the method comprises the steps of receiving original data information of at least two pieces of Internet of things equipment, adding spatial information of the Internet of things equipment and first time information carried by the original data information into the original data information of each piece of Internet of things equipment to obtain first data information with time information and spatial information, then carrying out analysis processing and format conversion on the first data information, fusing target data information with the same data format corresponding to each piece of Internet of things equipment to obtain fused data information corresponding to service requirements of a user, and sending the fused data information to the user. In summary, the data perception fusion method is based on the internet of things equipment, the original data are obtained and then analyzed to obtain perception data information, and then the data format of the perception data information is converted into the target data format and fused to obtain fusion data information corresponding to the user service requirements. Therefore, the perception data information is obtained by extracting the characteristic data information required by the service requirement from the original data through analysis, so that the data information not required by the current service requirement is eliminated, the data volume in the subsequent transmission process is reduced, and the efficiency of data fusion is further accelerated. In addition, the data perception fusion method does not need to use high-performance Internet of things equipment to complete perception fusion, only needs to obtain original data information of the Internet of things equipment and then carries out perception fusion processing according to the service requirements of users, and is not affected by the performance of the Internet of things equipment, so that the performance requirements on the Internet of things equipment can be reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a flow chart of a data-aware fusion method according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a device in which a data-aware fusion apparatus according to an embodiment of the present invention is located;
fig. 3 is a schematic diagram of a data-aware fusion apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer and more complete, the technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention, and based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts belong to the scope of the present invention.
As shown in fig. 1, an embodiment of the present invention provides a data-aware fusion method, which may include the following steps:
step 101: receiving at least two pieces of original data information of at least two pieces of Internet of things equipment;
step 102: aiming at each Internet of things device, executing the following steps: adding point location information of the Internet of things equipment and first time information carried in the original data information into the original data information to obtain first data information; the point location information comprises spatial information of the Internet of things equipment;
step 103: analyzing the first data information to obtain perception data information corresponding to the Internet of things equipment; the sensing data information comprises characteristic data information required by the service requirement of a user;
step 104: converting the data format of the sensing data information into a preset target data format to obtain target data information corresponding to the Internet of things equipment;
step 105: fusing target data information corresponding to each Internet of things device to obtain fused data information corresponding to business requirements;
step 106: and sending the fused data information to the user.
The embodiment of the invention provides a data perception fusion method, which comprises the steps of receiving original data information of at least two pieces of Internet of things equipment, adding spatial information of the pieces of Internet of things equipment and first time information carried by the original data information into the original data information of each piece of Internet of things equipment to obtain first data information with time information and spatial information, then carrying out analysis processing and format conversion on the first data information, fusing target data information with the same data format corresponding to each piece of Internet of things equipment to obtain fused data information corresponding to service requirements of a user, and sending the fused data information to the user. In summary, the data perception fusion method is based on the internet of things equipment, the original data are obtained and then analyzed to obtain perception data information, and then the data format of the perception data information is converted into the target data format and fused to obtain fusion data information corresponding to the user service requirements. Therefore, the perception data information is obtained by extracting the characteristic data information required by the service requirement from the original data through analysis, so that the data information not required by the current service requirement is eliminated, the data volume in the subsequent transmission process is reduced, and the efficiency of data fusion is further accelerated. In addition, the data perception fusion method does not need to use high-performance Internet of things equipment to complete perception fusion, only needs to obtain original data information of the Internet of things equipment and then carries out perception fusion processing according to the service requirements of users, and is not affected by the performance of the Internet of things equipment, so that the performance requirements on the Internet of things equipment can be reduced.
In the embodiment of the invention, the data perception fusion method can be realized based on the data transmission mode of the existing internet of things equipment, and different data transmission modes can be unified through the data format conversion in the step 104, so that the performance requirement on the internet of things equipment can be reduced, and the compatibility is higher.
In the embodiment of the invention, the user comprises a mobile terminal, a server and the like. The original data can be actual data of the internet of things equipment acquired in real time or simulation data of the internet of things equipment.
In the embodiment of the present invention, for each piece of internet-of-things equipment, the first time information carried in the original data information, that is, the time when the original data information is generated, specifically, the first time stamp may be generated according to the time, so as to ensure the time accuracy and the authenticity of the original data information. The point location information of the internet of things equipment comprises spatial information of the internet of things equipment, current state information, version parameter information and the like of the internet of things equipment, wherein the spatial information comprises information of provinces, cities, districts, streets and the like of the internet of things equipment. For example, the street lamp on the street, the point location information includes the jurisdiction of the street lamp, the street, the serial number of the street lamp, the switch state at the current time, the model of the street lamp, and the like.
In the embodiment of the invention, the fusion data information is sent to the user, and can be sent to the user through the Kafka cluster; and correspondingly sending the service requirements included in the fusion data information to the user. For example, according to the service requirement or version parameter information of the internet of things device, the converged data information is written into a redis or message queue through the Kafka cluster, so that the converged data can be timely and synchronously sent to the user. It should be noted that multiple Kafka clusters may be included in the embodiment of the present invention.
Optionally, in the data-aware fusion method shown in fig. 1, the method further includes: the method comprises the steps that a node cluster is preset, and the node cluster comprises at least two node devices;
in step 103, the analyzing process of the first data information includes:
forwarding the first data information to a preset node cluster so as to analyze and process the first data information by utilizing at least one node device;
determining the load of each node device which is currently operated;
judging whether the number of the loads of the node devices, which is greater than a preset load threshold value, is zero or not;
and if not, increasing the number of the currently operated node devices in the node cluster according to a preset rule.
In the embodiment of the invention, the first data information is forwarded to a preset node cluster, so that node devices in the node cluster analyze the first data information, the load of each node device currently performing analysis processing is determined, and if at least one of the determined loads is greater than a preset load threshold (that is, the number of the load of each node device greater than the preset load threshold is not zero), the number of the node devices currently performing analysis processing is increased according to a preset rule, so that parallel processing of each first data information is realized, the analysis efficiency is improved, the concurrency requirement of actual application services is met, and meanwhile, the efficiency of the data perception fusion method is further improved. In particular, the node cluster may be a Kafka cluster.
Specifically, the preset rule may be a pre-stored correspondence table between the load and the number of node clusters.
Optionally, in the data-aware fusion method shown in fig. 1, the receiving 101 at least two pieces of raw data information of at least two pieces of internet-of-things equipment includes:
acquiring the service requirement of a user; the service requirement carries a subscription request of a user for required original data information;
and receiving at least two pieces of original data information of at least two pieces of Internet of things equipment included in the subscription request.
In the embodiment of the invention, firstly, the service requirement of a user is obtained, the subscription request of the user for the required original data information carried in the service requirement is determined, and then at least two original data information of at least two pieces of Internet of things equipment included in the subscription request are received. Based on the subscription request, the user can flexibly subscribe according to the service requirement, the coupling degree is low, and the user can acquire the subscribed data information in real time.
In the embodiment of the invention, the original data information of each piece of internet-of-things equipment can be transmitted in a message queue mode, specifically, a user can realize real-time transmission and fast reading and writing through subscription, wherein another Kafka cluster can be used for sending original data to the user in real time based on a message sequence, so that the real-time property of data transmission is ensured. Specifically, the Kafka cluster is different from a preset node cluster.
In the embodiment of the present invention, specifically, when the Kafka cluster is used to send the original data, the data may be consumed by data packet fragmentation, and during the original data transmission process, the number of consumption nodes may be dynamically adjusted to share the processing pressure by determining the load condition of the Kafka cluster, so as to meet the concurrent requirement of the actual service. Meanwhile, the Kafka cluster can back up data, and when the data of the same equipment needs to be directed to different services, consumption nodes corresponding to data streams of the equipment of the Internet of things are only needed to be added during data transmission, so that service expansion during data use is facilitated.
In the embodiment of the invention, the Kafka cluster can process all action flow data in a consumer scale and has the capabilities of high performance, persistence, multi-copy backup and horizontal expansion.
Optionally, in the data-aware fusion method shown in fig. 1, the analyzing step 103 is performed on the first data information to obtain the perceptual data information corresponding to the internet of things device, and includes:
determining the data type of the first data information; wherein the data types include: structured data, semi-structured data, and unstructured data;
analyzing the first data information according to the data type and the service requirement to obtain second data information; the second data information comprises point location information of the Internet of things equipment where the first data information is located, first time information and feature data information required by the service requirement obtained after analysis;
determining second time information when the first data information is analyzed;
and adding the second time information and the service requirement to the second data information to obtain perception data information corresponding to the Internet of things equipment.
In the embodiment of the present invention, data fusion can be performed on structured data, semi-structured data, and unstructured data of which the data types are respectively structured data, first, parsing the first data information according to the data types and service requirements to obtain second data information including feature data information required by user service requirements, and adding second time information (specifically, a second timestamp may be generated according to the time) during parsing to the second data information to obtain perception data information corresponding to the internet of things device.
In the embodiment of the invention, first data information is grouped according to data types and forwarded to a preset node cluster (for example, a Kafka cluster) according to the grouping, different data types correspond to different analysis processing operations, analysis is performed according to data information included in the internet of things equipment corresponding to the first data information, and second time information corresponding to the analysis, data attributes of the data information obtained through analysis and corresponding service requirement labels are added to obtain sensing data information corresponding to the first data information.
In the embodiment of the invention, the characteristic data information required by the service requirement is extracted from the original data through analysis processing to obtain the perception data information, so that the data information which is not required by the current service requirement is eliminated, the redundancy of the data is reduced, the data volume in the subsequent transmission process is reduced, and the efficiency of data fusion is further improved. Meanwhile, the analysis processing can operate the data information of each data type, so that the method has higher compatibility and reusability.
Next, in the embodiment of the present invention, after the sensing data information is obtained in step 103, the data format of the sensing data information is further converted into a preset target data format according to step 104, so as to obtain target data information corresponding to the internet of things device. Specifically, the preset target data format can be a json transmission format, the characters of the json transmission format are concise, reading and writing are easy, machine analysis and generation are easy, and data transmission efficiency can be effectively improved.
In the embodiment of the present invention, specifically, the parsing process and the data format conversion may also be performed simultaneously.
For example, for structured data, original data (including a byte stream or a data stream) of the internet of things device is analyzed according to a service requirement, for example, if the service requirement is to obtain a weather condition in a certain area, and the internet of things device is a temperature and humidity sensor, the byte stream can be analyzed into characteristic data information including a temperature value (20.00 ℃) and a humidity value (45.00% RH), the characteristic data information is converted into a json conventional transmission format, and data attributes of the temperature value and the humidity value are recorded as a numerical type, and a numerical length is 4. For unstructured data, original data (including sound, video or laser dot matrix) of the internet of things equipment are analyzed according to business requirements, for example, if the business requirements are that vehicle information passing through a current intersection is obtained, the video can be subjected to framing processing, and analysis processing such as recognition, feature extraction and the like is performed on the image subjected to the framing processing so as to obtain feature data information including the vehicle license plate information, the feature data information is converted into a json conventional transmission format, and data attributes of the vehicle license plate information are recorded. For the semi-structured data, the semi-structured data may be subjected to comprehensive analysis processing according to the analysis operations of the structured data and the unstructured data to obtain target data information.
Optionally, in the data-aware fusion method shown in fig. 1, step 105 fuses target data information corresponding to each internet of things device to obtain fused data information corresponding to a service requirement, where the method includes:
determining a fusion rule according to the service requirement; wherein, the fusion rule comprises: the first time information is the same and the spatial information is the same, the first time information is the same and the spatial information is different, and the first time information is different and the spatial information is the same;
and fusing the target data information corresponding to the Internet of things equipment according to the determined fusion rule to obtain the fusion data information corresponding to the service requirements.
In the embodiment of the invention, the fusion rules are different corresponding to different service requirements of users, so that the ever-increasing service requirements of the users can be still met under the condition of not introducing new more intelligent Internet of things equipment and maintaining the existing data transmission mode.
In the embodiment of the invention, the process of data fusion is relatively backward, namely the target data information is obtained and then sent to the user, and the data in the transmission process before fusion is relatively original, so that the degree of interception and influence of the data by the outside in the transmission process is reduced, and the safety of data transmission is ensured; meanwhile, the fusion data information depends on the original data of the plurality of internet of things devices, and the more the process of data fusion is relatively backward, the more the selectable internet of things devices are fused, the more the original data is, and therefore the fault tolerance rate of the data fusion is higher.
In the embodiment of the invention, the fusion depends on the use condition of the underlying basic Internet of things equipment, not all the equipment can be updated in batch or in large area according to the actual use condition, and the original data of various equipment is integrated by adopting a proper fusion technology for fusion, so that the method better meets the current business requirements. Meanwhile, when the data perception fusion method is used for data perception fusion, the original data of the Internet of things can be more flexibly grouped and integrated, so that the application range of the same Internet of things equipment in different service application scenes can be better met.
Optionally, in the data-aware fusion method shown in fig. 1, fusing target data information corresponding to each piece of internet-of-things equipment according to the determined fusion rule, where the fusing method includes:
when the determined fusion rule is that the first time information is the same and the space information is the same, acquiring each piece of target data information with the same first time information and the same space information; fusing each target data information;
when the determined fusion rule is that the first time information is the same and the spatial information is different, acquiring each piece of target data information with the same first time information and different spatial information; fusing each target data information;
when the determined fusion rule is that the first time information is different and the space information is the same, acquiring each piece of target data information with different first time information and the same space information; and fusing each target data information.
In the embodiment of the invention, for example, when the service requirement is that the vehicle license plate information of the vehicle passing through the No. 1 traffic light at the time a is acquired, the fusion rule is determined to be that the first time information is the same and the space information is the same, then each target data information of which the first time information is the time a and the space information is the No. 1 traffic light is acquired, and the acquired target original data are fused to acquire the fusion data information including the vehicle license plate information of the vehicle passing through the No. 1 traffic light at the time a. For example, the business demand is the traffic congestion condition in city B at the early peak, the fusion rule is determined to be that the first time information is the same and the space information is different, then the obtained first time information is the target data information of each different street in city B at the early peak, and the obtained target original data are fused to obtain the fusion data information including the traffic condition in city B at the early peak. For example, the business requirement is a traffic congestion situation at an x-intersection in a c-zone of a workday, the fusion rule is that the first time information is different and the space information is the same, the first time information is obtained as the workday, and the space information is data information of each target at the x-intersection in the c-zone, and the obtained original data of each target are fused to obtain the fusion data information including the traffic situation at the x-intersection in the c-zone of the workday.
Optionally, in the data-aware fusion method shown in fig. 1, after the step 106 of sending the fused data information to the user, the method further includes:
receiving a query request of a user;
acquiring target data corresponding to the service requirement and the time information carried by the query request according to the query request;
and sending the target data to the user.
In the embodiment of the present invention, the obtained historical data, such as the first data information including the original data information, the perceptual data information, and the fused data information, may be stored by using a cluster (e.g., a Kafka cluster) (e.g., the storage is completed by using Elasticsearch, hdfs, etc.). Specifically, target data information corresponding to each piece of internet-of-things equipment is fused to obtain fused data information corresponding to the service requirement, third time information during fusion is determined (specifically, a third timestamp can be generated according to the time), and the third time information is added to the fused data information.
In the embodiment of the present invention, to sum up, when an inquiry request of a user is received, target data may be determined according to a service requirement and time information carried in the inquiry request, so as to send the target data to the user, which is convenient for the user to trace back.
As shown in fig. 2 and 3, the embodiment of the present invention provides a data-aware fusion apparatus. The device embodiments may be implemented by software, or by hardware, or by a combination of hardware and software. From a hardware level, as shown in fig. 2, a hardware structure diagram of a device in which the data-aware fusion apparatus provided in the embodiment of the present invention is located is shown, where in addition to the processor, the memory, the network interface, and the nonvolatile memory shown in fig. 2, the device in which the apparatus is located in the embodiment may also include other hardware, such as a forwarding chip responsible for processing a packet, and the like. Taking a software implementation as an example, as shown in fig. 3, as a logical apparatus, the apparatus is formed by reading, by a CPU of a device in which the apparatus is located, corresponding computer program instructions in a non-volatile memory into a memory for execution. The data perception fusion device provided by the embodiment comprises:
a receiving module 301, configured to receive at least two pieces of raw data information of at least two pieces of internet-of-things equipment;
an adding module 302, configured to add, to each piece of internet-of-things equipment, point location information of the piece of internet-of-things equipment and first time information carried in the original data information received by the receiving module 301, so as to obtain first data information; the point location information comprises spatial information of the equipment of the Internet of things;
the analyzing module 303 is configured to analyze the first data information acquired by the adding module 302 to obtain sensing data information corresponding to the internet of things device; the sensing data information comprises characteristic data information required by the service requirement of a user;
a format conversion module 304, configured to convert the data format of the sensing data information obtained by the analysis module 303 into a preset target data format, so as to obtain target data information corresponding to the internet of things device;
a fusion module 305, configured to fuse the target data information corresponding to each piece of internet-of-things equipment obtained by the format conversion module 304, so as to obtain fused data information corresponding to the service requirement;
a sending module 306, configured to send the fused data information obtained by the fusing module 305 to the user.
Optionally, on the basis of the data-aware fusion apparatus shown in fig. 3, the apparatus further includes: the method comprises the steps that a node cluster is preset, and the node cluster comprises at least two node devices;
the parsing module 303 is further configured to perform the following operations:
forwarding the first data information to a preset node cluster so as to analyze and process the first data information by utilizing at least one node device;
determining the load of each node device which is currently operated;
judging whether the number of the loads of the node devices, which is greater than a preset load threshold value, is zero or not;
and if not, increasing the number of the currently operated node devices in the node cluster according to a preset rule.
Optionally, on the basis of the data-aware fusion apparatus shown in fig. 3, the receiving module 301 is further configured to perform the following operations:
acquiring the service requirement of a user; the service requirement carries a subscription request of a user for required original data information;
and receiving at least two pieces of original data information of at least two pieces of Internet of things equipment included in the subscription request.
Optionally, on the basis of the data-aware fusion apparatus shown in fig. 3, the parsing module 303 is further configured to perform the following operations:
determining the data type of the first data information; wherein the data types include: structured data, semi-structured data, and unstructured data;
analyzing the first data information according to the data type and the service requirement to obtain second data information; the second data information comprises point location information of the Internet of things equipment where the first data information is located, first time information and feature data information required by the service requirement obtained after analysis;
determining second time information when the first data information is analyzed;
and adding the second time information and the service requirement to the second data information to obtain perception data information corresponding to the Internet of things equipment.
Optionally, on the basis of the data-aware fusion apparatus shown in fig. 3, the fusion module 305 is further configured to perform the following operations:
determining a fusion rule according to the service requirement; wherein, the fusion rule comprises: the first time information is the same and the spatial information is the same, the first time information is the same and the spatial information is different, and the first time information is different and the spatial information is the same;
and fusing the target data information corresponding to the Internet of things equipment according to the determined fusion rule to obtain the fusion data information corresponding to the service requirements.
Optionally, on the basis of the data-aware fusion apparatus shown in fig. 3, the fusion module 305 is further configured to perform the following operations:
when the determined fusion rule is that the first time information is the same and the space information is the same, acquiring each piece of target data information with the same first time information and the same space information; fusing each target data information;
when the determined fusion rule is that the first time information is the same and the spatial information is different, acquiring each piece of target data information with the same first time information and different spatial information; fusing each target data information;
when the determined fusion rule is that the first time information is different and the space information is the same, acquiring each piece of target data information with different first time information and the same space information; and fusing each target data information.
Optionally, on the basis of the data-aware fusion apparatus shown in fig. 3, the apparatus further includes: a query module to perform the following operations:
receiving a query request of a user;
acquiring target data corresponding to the service requirement and the time information carried by the query request according to the query request;
and sending the target data to the user.
Because the content of information interaction, execution process, and the like among the modules in the device is based on the same concept as the method embodiment of the present invention, specific content can be referred to the description in the method embodiment of the present invention, and is not described herein again.
In order to more clearly illustrate the technical solutions and advantages of the present invention, the following detailed description of the data-aware fusion method provided by the embodiment of the present invention specifically includes:
step S1: receiving at least two pieces of original data information of at least two pieces of Internet of things equipment.
Specifically, the service requirement of a user is obtained; the service requirement carries a subscription request of a user for required original data information; and receiving at least two pieces of original data information of at least two pieces of Internet of things equipment included in the subscription request.
Step S2: and obtaining target data information corresponding to each piece of Internet of things equipment.
Specifically, for each internet of things device, the following is executed: adding point location information of the Internet of things equipment and first time information carried in the original data information into the original data information to obtain first data information, analyzing the first data information to obtain perception data information corresponding to the Internet of things equipment, and converting the data format of the perception data information into a preset target data format to obtain target data information corresponding to the Internet of things equipment; the point location information comprises spatial information of the Internet of things equipment; the perception data information comprises characteristic data information required by the service requirement of the user.
Specifically, when the analysis processing is performed, the first data information is forwarded to a preset node cluster, so that at least one node device is used for analyzing the first data information according to the data type and the service requirement to obtain second data information, second time information during the analysis processing is determined, and the second time information and the service requirement are added to the second data information to obtain sensing data information corresponding to the internet of things device. The second data information comprises point location information of the internet of things equipment where the first data information is located, first time information and feature data information required by the service requirement obtained after analysis. And then determining the load of each node device which is currently operated, judging whether the number of the loads of the node devices which is larger than a preset load threshold value is zero, and if not, increasing the number of the node devices which are currently operated in the node cluster according to a preset rule.
Step S3: and fusing the target data information corresponding to the Internet of things equipment to obtain fused data information corresponding to the service requirements, and sending the fused data information to the user.
Specifically, according to the service requirement, a fusion rule is determined, each target data message conforming to the fusion rule is obtained, each obtained target data message is fused to obtain a fusion data message corresponding to the service requirement, and the fusion data message is sent to the user.
The embodiment of the invention also provides a data perception fusion device, which comprises: at least one memory and at least one processor;
the at least one memory to store a machine readable program;
the at least one processor is configured to invoke the machine-readable program to perform the method according to any embodiment of the invention.
An embodiment of the present invention further provides a data-aware fusion apparatus, where a computer instruction is stored on the computer-readable medium, and when the computer instruction is executed by a processor, the processor is caused to execute the method according to any embodiment of the present invention.
It is to be understood that the illustrated structure of the embodiment of the present invention does not constitute a specific limitation to the data-aware fusion apparatus. In other embodiments of the invention, the data-aware fusion device may include more or fewer components than shown, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
Specifically, a system or an apparatus equipped with a storage medium on which software program codes that realize the functions of any of the above-described embodiments are stored may be provided, and a computer (or a CPU or MPU) of the system or the apparatus is caused to read out and execute the program codes stored in the storage medium.
In this case, the program code itself read from the storage medium can realize the functions of any of the above-described embodiments, and thus the program code and the storage medium storing the program code constitute a part of the present invention.
Examples of the storage medium for supplying the program code include a floppy disk, a hard disk, a magneto-optical disk, an optical disk (e.g., CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW), a magnetic tape, a nonvolatile memory card, and a ROM. Alternatively, the program code may be downloaded from a server computer via a communications network.
Further, it should be clear that the functions of any one of the above-described embodiments may be implemented not only by executing the program code read out by the computer, but also by causing an operating system or the like operating on the computer to perform a part or all of the actual operations based on instructions of the program code.
Further, it is to be understood that the program code read out from the storage medium is written to a memory provided in an expansion board inserted into the computer or to a memory provided in an expansion unit connected to the computer, and then causes a CPU or the like mounted on the expansion board or the expansion unit to perform part or all of the actual operations based on instructions of the program code, thereby realizing the functions of any of the above-described embodiments.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it is to be noted that: the above description is only a preferred embodiment of the present invention, and is only used to illustrate the technical solutions of the present invention, and not to limit the protection scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (10)
1. A data-aware fusion method, comprising:
receiving at least two pieces of original data information of at least two pieces of Internet of things equipment;
for each of the internet of things devices, executing:
adding point location information of the Internet of things equipment and first time information carried in the original data information into the original data information to obtain first data information; the point location information comprises spatial information of the equipment of the Internet of things;
analyzing the first data information to obtain perception data information corresponding to the Internet of things equipment; the sensing data information comprises characteristic data information required by the service requirement of a user;
converting the data format of the sensing data information into a preset target data format to obtain target data information corresponding to the Internet of things equipment;
fusing target data information corresponding to each Internet of things device to obtain fused data information corresponding to the service requirements;
and sending the fused data information to a user.
2. The method of claim 1, further comprising: the method comprises the steps that a node cluster is preset, and the node cluster comprises at least two node devices;
the analyzing the first data information includes:
forwarding the first data information to a preset node cluster so as to analyze and process the first data information by utilizing at least one node device;
determining the load of each node device which is currently operated;
judging whether the number of the loads of the node devices, which is greater than a preset load threshold value, is zero or not;
and if not, increasing the number of the currently operated node devices in the node cluster according to a preset rule.
3. The method of claim 1, wherein the receiving at least two raw data messages of at least two internet of things devices comprises:
acquiring the service requirement of a user; the service requirement carries a subscription request of a user for required original data information;
and receiving at least two pieces of original data information of at least two pieces of Internet of things equipment included in the subscription request.
4. The method of claim 1, wherein the parsing the first data information to obtain perception data information corresponding to the internet of things device comprises:
determining the data type of the first data information; wherein the data types include: structured data, semi-structured data, and unstructured data;
analyzing the first data information according to the data type and the service requirement to obtain second data information; the second data information comprises the point location information of the internet of things equipment where the first data information is located, the first time information and feature data information required by the service requirement obtained after analysis;
determining second time information when the first data information is analyzed;
and adding the second time information and the service requirement to the second data information to obtain perception data information corresponding to the Internet of things equipment.
5. The method according to claim 1, wherein the fusing the target data information corresponding to each piece of internet of things equipment to obtain fused data information corresponding to the service requirement comprises:
determining a fusion rule according to the service requirement; wherein the fusion rule comprises: the first time information is the same and the spatial information is the same, the first time information is the same and the spatial information is different, and the first time information is different and the spatial information is the same;
and fusing the target data information corresponding to the Internet of things equipment according to the determined fusion rule to obtain fusion data information corresponding to the service requirement.
6. The method according to claim 5, wherein the fusing the target data information corresponding to each piece of internet-of-things equipment according to the determined fusion rule includes:
when the determined fusion rule is that the first time information is the same and the space information is the same, each target data information with the same first time information and the same space information is obtained; fusing each target data information;
when the determined fusion rule is that the first time information is the same and the spatial information is different, acquiring each target data information with the same first time information and different spatial information; fusing each target data information;
when the determined fusion rule is that the first time information is different and the space information is the same, acquiring each target data information with different first time information and the same space information; and fusing each target data information.
7. The method according to any one of claims 1 to 6, further comprising, after said sending said fused data message to a user:
receiving a query request of the user;
acquiring target data corresponding to the service requirement and the time information carried by the query request according to the query request;
and sending the target data to the user.
8. A data-aware fusion device, comprising:
the receiving module is used for receiving at least two pieces of original data information of at least two pieces of Internet of things equipment;
the adding module is used for adding point location information of the internet of things equipment and first time information carried in the original data information to the original data information received by the receiving module to obtain first data information; the point location information comprises spatial information of the Internet of things equipment;
the analysis module is used for analyzing the first data information acquired by the adding module to obtain perception data information corresponding to the Internet of things equipment; the sensing data information comprises characteristic data information required by the service requirement of a user;
the format conversion module is used for converting the data format of the perception data information obtained by the analysis module into a preset target data format to obtain target data information corresponding to the Internet of things equipment;
the fusion module is used for fusing the target data information corresponding to the Internet of things equipment obtained by the format conversion module to obtain fused data information corresponding to the service requirement;
and the sending module is used for sending the fusion data information obtained by the fusion module to a user.
9. A data-aware fusion device, comprising: at least one memory and at least one processor;
the at least one memory to store a machine readable program;
the at least one processor, configured to invoke the machine readable program to perform the method of any of claims 1 to 7.
10. A computer readable medium having stored thereon computer instructions which, when executed by a processor, cause the processor to perform the method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110036442.1A CN112866366A (en) | 2021-01-12 | 2021-01-12 | Data perception fusion method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110036442.1A CN112866366A (en) | 2021-01-12 | 2021-01-12 | Data perception fusion method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112866366A true CN112866366A (en) | 2021-05-28 |
Family
ID=76002832
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110036442.1A Pending CN112866366A (en) | 2021-01-12 | 2021-01-12 | Data perception fusion method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112866366A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102724307A (en) * | 2012-06-14 | 2012-10-10 | 哈尔滨工业大学（威海） | Information fusion engine and information fusion method for Internet of Things |
| CN102831513A (en) * | 2012-07-20 | 2012-12-19 | 大连理工大学 | Container logistics field oriented IoT (Internet of Things) application-layer middleware and information fusion integration method |
| US20180144250A1 (en) * | 2016-11-23 | 2018-05-24 | Electronics And Telecommunications Research Institute | Data processing apparatus and method for merging and processing deterministic knowledge and non-deterministic knowledge |
| CN109711479A (en) * | 2018-12-30 | 2019-05-03 | 中国电子科技集团公司信息科学研究院 | A kind of data processing and fusion method and its application |
| CN111083225A (en) * | 2019-12-19 | 2020-04-28 | 远景智能国际私人投资有限公司 | Data processing method and device in Internet of things platform and Internet of things platform |
| CN111639114A (en) * | 2020-04-07 | 2020-09-08 | 北京邮电大学 | Distributed data fusion management system based on Internet of things platform |
-
2021
- 2021-01-12 CN CN202110036442.1A patent/CN112866366A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102724307A (en) * | 2012-06-14 | 2012-10-10 | 哈尔滨工业大学（威海） | Information fusion engine and information fusion method for Internet of Things |
| CN102831513A (en) * | 2012-07-20 | 2012-12-19 | 大连理工大学 | Container logistics field oriented IoT (Internet of Things) application-layer middleware and information fusion integration method |
| US20180144250A1 (en) * | 2016-11-23 | 2018-05-24 | Electronics And Telecommunications Research Institute | Data processing apparatus and method for merging and processing deterministic knowledge and non-deterministic knowledge |
| CN109711479A (en) * | 2018-12-30 | 2019-05-03 | 中国电子科技集团公司信息科学研究院 | A kind of data processing and fusion method and its application |
| CN111083225A (en) * | 2019-12-19 | 2020-04-28 | 远景智能国际私人投资有限公司 | Data processing method and device in Internet of things platform and Internet of things platform |
| CN111639114A (en) * | 2020-04-07 | 2020-09-08 | 北京邮电大学 | Distributed data fusion management system based on Internet of things platform |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111787066A (en) | Internet of things data platform based on big data and AI | |
| KR20010064815A (en) | System and method for generating digital map using road information | |
| CN101093468A (en) | Method for automatic timed updating data of weather forecast at terminal | |
| CN109861998B (en) | Plug-in type dynamic analysis system and method based on Beidou short message protocol | |
| KR20120048525A (en) | Method and apparatus for controlling remote device via short messaging service | |
| CN102203734B (en) | Conditional processing method and apparatus | |
| CN112906206A (en) | Digital twin model construction method and device | |
| CN116016628A (en) | API gateway buried point analysis method and device | |
| CN113094166B (en) | Link tracking method, device, medium and computing equipment | |
| CN112181393B (en) | Front-end and back-end code generation method and device, computer equipment and storage medium | |
| CN112866366A (en) | Data perception fusion method and device | |
| CN111258940B (en) | Configuration method, business auditing system, business auditing equipment and storage medium | |
| CN110351202B (en) | 5G core network traffic grouping method, device, equipment and computer storage medium | |
| CN111723115A (en) | Data statistics method, device, terminal and storage medium based on multi-level cache | |
| CN110839022A (en) | Vehicle-mounted control software communication protocol analysis method based on xml language | |
| WO2022152230A1 (en) | Information flow identification method, network chip, and network device | |
| CN114201659A (en) | Message track transmission query method, device and system | |
| CN112687267A (en) | Internet of things data semantic processing system | |
| CN112000618A (en) | File change management method, device, equipment and storage medium for cluster nodes | |
| CN101110861B (en) | System and method for playing text voice in intelligent network | |
| CN106603637B (en) | Data exchange method and system between heterogeneous gridding management platforms | |
| EP1691504A1 (en) | A method for creating and parsing the traffic voice broadcasting requests in the bearing control separate network | |
| CN113676840B (en) | Data processing method, apparatus, electronic device, storage medium, and program product | |
| CN117729060B (en) | Early warning information mass-sending decision-making method and device | |
| CN115641497B (en) | Multi-channel video processing system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210528 |
|
| RJ01 | Rejection of invention patent application after publication |