CN115550472B - Heterogeneous data processing method and device - Google Patents

Heterogeneous data processing method and device Download PDF

Info

Publication number
CN115550472B
CN115550472B CN202211470696.5A CN202211470696A CN115550472B CN 115550472 B CN115550472 B CN 115550472B CN 202211470696 A CN202211470696 A CN 202211470696A CN 115550472 B CN115550472 B CN 115550472B
Authority
CN
China
Prior art keywords
protocol
data
routing
analysis rule
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202211470696.5A
Other languages
Chinese (zh)
Other versions
CN115550472A (en
Inventor
侯剑飞
李行亮
杨斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Dahua Technology Co Ltd
Original Assignee
Zhejiang Dahua Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Dahua Technology Co Ltd filed Critical Zhejiang Dahua Technology Co Ltd
Priority to CN202211470696.5A priority Critical patent/CN115550472B/en
Publication of CN115550472A publication Critical patent/CN115550472A/en
Application granted granted Critical
Publication of CN115550472B publication Critical patent/CN115550472B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/22—Parsing or analysis of headers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/74—Address processing for routing

Abstract

The application discloses a heterogeneous data processing method and device. The heterogeneous data processing method comprises the following steps: acquiring acquisition data from acquisition equipment by using protocol matching equipment; the protocol matching equipment matches the collected data with at least one protocol analysis rule to determine routing information corresponding to the protocol analysis rule matched with the collected data; and the protocol matching equipment sends the acquired data to a routing server corresponding to the matched protocol analysis rule based on the corresponding routing information so that the routing server can process the acquired data. The method and the device can realize dynamic access of different devices without frequently changing gateway configuration.

Description

Heterogeneous data processing method and device
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a heterogeneous data processing method and apparatus.
Background
With the continuous development of the internet of things industry, a large number of intelligent devices in different industries and different forms exist, and a large number of device access protocols with various characteristics are derived, so that a large amount of multi-source heterogeneous data is formed. In the traditional equipment access scheme, equipment is accessed to a corresponding protocol server through a specified protocol, and when the protocol needs to be switched to be in butt joint with other platforms, batch configuration modification and networking deployment adjustment of the equipment are involved, so that the investment of operation and maintenance cost of equipment manufacturers is increased.
Disclosure of Invention
The application provides a heterogeneous data processing method and device, which can realize dynamic access of different devices without frequently changing gateway configuration.
In order to achieve the above object, the present application provides a heterogeneous data processing method, including:
acquiring acquisition data from acquisition equipment by using protocol matching equipment;
the protocol matching equipment matches the collected data with at least one protocol analysis rule to determine the routing information corresponding to the protocol analysis rule matched with the collected data;
and the protocol matching equipment sends the acquired data to a routing server corresponding to the matched protocol analysis rule based on the corresponding routing information so that the routing server can process the acquired data.
The protocol matching device matches the collected data with at least one protocol analysis rule to determine routing information corresponding to the protocol analysis rule matched with the collected data, and the method comprises the following steps:
if the protocol matching device does not determine the protocol analysis rule matched with the acquired data, calling an intelligent contract of a block chain where the protocol matching device is located to match the acquired data with the protocol analysis rule in the block chain account book so as to determine the related information of the protocol analysis rule matched with the acquired data;
and determining corresponding routing information based on the related information fed back by the intelligent contract.
The method for determining the relevant information of the protocol analysis rule matched with the collected data by calling the intelligent contract of the block chain where the protocol matching device is located to match the collected data with the protocol analysis rule in the block chain account book includes the following steps:
if the matching is successful, obtaining related information fed back by the intelligent contract;
and if the matching fails, the intelligent contract acquires the account book information of other block chains, matches the collected data with the protocol analysis rule in the account book information of other block chains, and feeds back the relevant information of the protocol analysis rule matched with the collected data.
Wherein, the related information comprises mirror image downloading information;
the corresponding routing information is determined based on the related information fed back by the intelligent contract, and the method comprises the following steps:
the protocol matching device downloads the service mirror image corresponding to the protocol analysis rule based on the mirror image downloading information and deploys the service mirror image, and the local routing information of the deployed service mirror image is used as the corresponding routing information.
Wherein the related information further comprises routing information;
the corresponding routing information is determined based on the related information fed back by the intelligent contract, and the method comprises the following steps:
the protocol matching equipment confirms whether the load condition of the protocol matching equipment meets the preset requirement or not;
if yes, executing a service mirror image corresponding to the protocol analysis rule based on the mirror image downloading information, and deploying, wherein the local routing information of the service mirror image is used as corresponding routing information;
if not, the routing information in the related information is taken as the corresponding routing information.
The protocol matching device matches the collected data with at least one protocol analysis rule, and comprises the following steps:
the protocol matching device obtains at least one protocol parsing rule from a storage system connected with the protocol matching device and caches the protocol parsing rule.
The storage system is a distributed storage system.
Wherein, the protocol matching device sends the collected data to the routing server corresponding to the matched protocol analysis rule based on the corresponding routing information, so that the routing server processes the collected data, and then comprises:
and forwarding the processing result of the acquired data obtained from the routing server to the acquisition equipment.
Wherein, the protocol matching device sends the collected data to the routing server corresponding to the matched protocol analysis rule based on the corresponding routing information, so that the routing server processes the collected data, and then comprises:
and the protocol matching equipment stores the processing result, the acquired data, the corresponding routing information and/or the protocol analysis rule corresponding to the acquired data in an associated manner.
In order to achieve the above object, the present application provides a heterogeneous data processing method, including:
the protocol matching node calls an intelligent contract of a block chain where the protocol matching node is located, matches the collected data of the collecting equipment with the protocol analysis rule in the block chain account book to determine routing information corresponding to the protocol analysis rule matched with the collected data, and sends the collected data to a routing server corresponding to the matched protocol analysis rule based on the corresponding routing information so that the routing server processes the collected data;
the protocol matching node is connected with the acquisition equipment, or the protocol matching node is the acquisition equipment.
In order to achieve the above object, the present application provides a heterogeneous data processing method, which includes;
the acquisition equipment sends the acquired data to the protocol matching equipment so that the protocol matching equipment matches the acquired data with the protocol analysis rule to determine the routing information corresponding to the protocol analysis rule matched with the acquired data, and then the protocol matching equipment forwards the acquired data to the routing server corresponding to the matched protocol analysis rule based on the corresponding routing information.
In order to achieve the above object, the present application provides a heterogeneous data processing method, including:
acquiring the acquired data of the acquisition equipment from the protocol matching equipment in response to the fact that the first routing information is equal to the second routing information, wherein the first routing information is routing information which is determined by the protocol matching equipment and corresponds to a protocol analysis rule matched with the acquired data, and the second routing information is routing information of a protocol data processing service deployed on a routing server;
and processing the acquired data to obtain a processing result.
Wherein, obtaining the acquisition data of the acquisition device from the protocol matching device previously comprises:
and uploading the protocol analysis rule and the second routing information to the block chain where the protocol analysis rule and the second routing information are located.
To achieve the above object, the present application also provides an electronic device, which includes a processor; the processor is used for executing instructions to realize the steps of the method.
To achieve the above object, the present application also provides a computer-readable storage medium for storing instructions/program data that can be executed to implement the above method.
The protocol matching device confirms the protocol analysis rule matched with the collected data, the protocol matching device determines the routing server corresponding to the collected data based on the routing information corresponding to the protocol analysis rule, and then the protocol matching device can forward the collecting device to the routing server so that the routing server can process the collected data. Therefore, in the heterogeneous data processing method, the acquisition equipment does not need to directly send the acquired data to the routing server corresponding to the acquired data, but the acquisition equipment sends the acquired data to the protocol matching equipment connected with the acquisition equipment, the protocol matching equipment confirms the routing server corresponding to the acquired data, and then the protocol matching equipment forwards the acquired data to the routing server corresponding to the acquired data, namely the protocol matching equipment receiving the acquisition equipment in the heterogeneous data processing method does not need to be the routing server capable of processing the acquired data, so that the butt joint node of the acquisition equipment can always be the protocol matching equipment connected with the acquisition equipment in the access process of the acquisition equipment, and the butt joint node configuration or the networking deployment does not need to be modified again even if the butt joint protocol changes in the access process of the acquisition equipment.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
FIG. 1 is a schematic flow chart diagram illustrating a first embodiment of a heterogeneous data processing method according to the present application;
fig. 2 is a schematic workflow diagram of a protocol matching device in a first embodiment of the heterogeneous data processing method according to the present application;
fig. 3 is a schematic workflow diagram of a routing server in a first embodiment of the heterogeneous data processing method according to the present application;
FIG. 4 is a schematic flow chart of a second embodiment of the heterogeneous data processing method according to the present application;
FIG. 5 is a block chain structure diagram of the heterogeneous data processing method according to the present application;
fig. 6 is a schematic diagram of a blockchain ledger in a blockchain architecture to which the heterogeneous data processing method of the present application is applied;
FIG. 7 is a schematic flow chart diagram illustrating a third embodiment of a heterogeneous data processing method according to the present application;
FIG. 8 is a schematic flow chart diagram illustrating a fourth embodiment of a heterogeneous data processing method according to the present application;
FIG. 9 is a flowchart illustrating a fifth embodiment of a heterogeneous data processing method according to the present application;
FIG. 10 is a diagram illustrating another blockchain ledger in a blockchain architecture to which the heterogeneous data processing method of the present application is applied;
FIG. 11 is a schematic diagram of an embodiment of an electronic device;
FIG. 12 is a schematic structural diagram of an embodiment of a computer-readable storage medium according to the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, and not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application. Additionally, the term "or" as used herein refers to a non-exclusive "or" (i.e., "and/or") unless otherwise indicated (e.g., "or otherwise" or in the alternative). Moreover, the various embodiments described herein are not necessarily mutually exclusive, as some embodiments may be combined with one or more other embodiments to form new embodiments.
As shown in fig. 1, the present application provides a heterogeneous data processing method according to a first embodiment, which includes the following steps. It should be noted that the following step numbers are only used for simplifying the description, and are not intended to limit the execution order of the steps, and the execution order of the steps in the present embodiment may be arbitrarily changed without departing from the technical idea of the present application.
S101: the protocol matching device obtains the acquisition data from the acquisition device.
In the heterogeneous data processing method, the acquisition equipment can acquire data information, and the acquisition equipment can send the acquired data to the protocol matching equipment, so that the protocol matching equipment can confirm the protocol analysis rule matched with the acquired data, the protocol matching equipment can determine the routing server corresponding to the acquired data based on the routing information corresponding to the protocol analysis rule, and then the protocol matching equipment can forward the acquisition equipment to the routing server so that the routing server can process the acquired data. Therefore, in the heterogeneous data processing method, the acquisition equipment does not need to directly send the acquired data to the routing server corresponding to the acquired data, but the acquisition equipment sends the acquired data to the protocol matching equipment connected with the acquisition equipment, the protocol matching equipment confirms the routing server corresponding to the acquired data, and then the protocol matching equipment forwards the acquired data to the routing server corresponding to the acquired data, namely the protocol matching equipment receiving the acquisition equipment in the heterogeneous data processing method does not need to be the routing server capable of processing the acquired data, so that the butt joint node of the acquisition equipment can always be the protocol matching equipment connected with the acquisition equipment in the access process of the acquisition equipment, and the butt joint node configuration or the networking deployment does not need to be modified again even if the butt joint protocol changes in the access process of the acquisition equipment.
The acquisition device can acquire data information according to the own device capability. For example, the capturing device is a camera, and the capturing device may capture an image. For another example, the collection device may be a temperature sensor, and the collection device may collect temperature information in the environment.
After the acquisition device acquires data information according to the device capability of the acquisition device, the acquisition device can provide the acquisition data to the protocol matching device based on the docking protocol. And the agent communication module in the protocol matching device may pre-read the acquisition data from the connection with the acquisition device.
Optionally, the protocol matching device connected to the acquisition device may be a protocol matching device of an area where the acquisition device is located, that is, a protocol matching device and at least one acquisition device may be set in a deployment area, where at least one acquisition device of the deployment area is connected to the protocol matching device of the deployment area, so that each acquisition device of the at least one acquisition device transmits data acquired by each acquisition device to a routing server corresponding to the each acquisition device through the protocol matching device of the deployment area to obtain a processing result, and thus, according to the method of the present application, the acquisition device only needs to be connected to the protocol matching device of the deployment area where the acquisition device is located to process the acquired data by the routing server, that is, in a data processing process, each protocol matching device node performs discovery and consensus on neighboring nodes, and performs routing screening through acquiring data content, so that each acquisition device target node is always a protocol matching device, that each acquisition device does not need to consider a final target node, and a docking protocol change in an actual device access process does not need to modify a target node configuration or re-network deployment; and let collection equipment be connected to the agreement matching device of its deployment region, can guarantee collection equipment and agreement matching device's connection stability to effectively guarantee the steady operation of this application scheme.
In addition, one protocol matching device may be connected to one or more acquisition devices. In the case where one protocol matching device is connected to a plurality of acquisition devices, the docking protocols of the plurality of acquisition devices connected to the protocol matching device may be different or the same, which is not limited herein.
S102: and determining a protocol analysis rule matched with the collected data.
After the protocol matching device acquires the acquired data, the protocol analysis rule matched with the acquired data can be determined so as to determine a routing server corresponding to the acquired data, namely determine a routing server capable of processing the acquired data, so that the acquired data is subsequently sent to the routing server corresponding to the acquired data, and the routing server corresponding to the acquired data is used for processing the acquired data.
Optionally, the protocol matching device may obtain protocol parsing rules of the plurality of routing servers, and then match the collected data with the protocol parsing rules of the plurality of routing servers, so as to determine the protocol parsing rule matched with the collected data from the protocol parsing rules of the plurality of routing servers.
In one embodiment, each protocol analysis rule in the protocol analysis rules of the plurality of routing servers can be called in sequence to analyze the acquired data; and if a protocol analysis rule capable of successfully analyzing the collected data is found, taking the protocol analysis rule capable of successfully analyzing the collected data as a protocol analysis rule matched with the collected data.
Alternatively, the protocol matching device may store the protocol resolution rules of multiple routing servers in advance, so that in step S102, the protocol matching device may directly invoke the protocol resolution rules of multiple routing servers stored in its memory. For example, the protocol matching device may cache protocol resolution rules for multiple routing servers.
In other embodiments, the protocol matching device may be connected to a storage system, and before step S102, the protocol matching device may obtain the protocol parsing rules of the plurality of routing servers from the storage system. The memory system may be a distributed memory system or a blockchain memory system. Further, the storage System may be a distributed storage System based on a decentralized fragmented encryption storage technology of IPFS (internet File System).
Preferably, a plurality of protocol matching devices can be connected with the same storage system, so that multi-node data storage and data sharing among different protocol matching devices can be realized by connecting the plurality of protocol matching devices to the same storage system.
After the protocol parsing rule matching the collected data is determined in step S102, step S103 may be entered to send the collected data to the routing server corresponding to the matched protocol parsing rule through the routing information corresponding to the matched protocol parsing rule.
S103: and the protocol matching equipment sends the acquired data to a routing server corresponding to the matched protocol analysis rule based on the routing information corresponding to the matched protocol analysis rule.
After the protocol parsing rule matching the collected data is determined based on step S102, the collected data may be sent to the routing server corresponding to the matched protocol parsing rule based on the routing information corresponding to the matched protocol parsing rule.
The routing information corresponding to the matched protocol analysis rule can be determined based on the corresponding relation between the protocol analysis rule and the routing information, so that the collected data can be sent to the routing server corresponding to the matched protocol analysis rule based on the routing information corresponding to the matched protocol analysis rule.
In the scheme of the application, each routing server can upload the protocol analysis rule of itself. After a receiving unit (e.g., a block chain, a storage device, or a protocol matching unit) acquires a protocol parsing rule uploaded by a routing server, the protocol parsing rule uploaded by the routing server may be bound with routing information of the routing server, so that the routing information corresponding to the protocol parsing rule uploaded by the routing server is the routing information of the routing server, and thus, the protocol matching device may find the routing information of the routing server that uploads the matched protocol parsing rule through a correspondence between the protocol parsing rule and the routing information, that is, may find a routing server that can parse and process collected data, and thus, the protocol matching device may send the collected data to the routing server that can parse and process the collected data through steps S102 and S103.
In another implementation manner, when uploading the protocol resolution rule of the routing server, the routing server may upload the routing information of the routing server together, so that the receiving unit binds the protocol resolution rule uploaded by the routing server and the routing information of the routing server.
After the protocol matching device confirms the routing information corresponding to the matched protocol analysis rule, the protocol matching device can forward the acquired data to a routing server through a block chain and other units based on the routing information; or the protocol matching device can send the collected data to the routing server in a mode of logging in the routing server based on the routing information.
S104: and the routing server analyzes the acquired data to obtain a processing result.
After the routing server acquires the acquired data uploaded by the acquisition equipment from the protocol matching equipment, the acquired data can be analyzed to obtain a processing result of the acquired data.
After the routing server performs processing such as parsing on the acquired data to obtain a processing result, the processing result may be stored, and/or the processing result may be fed back to the client bound to the acquisition device, and/or the processing result may be fed back to the protocol matching device through step S105.
S105: and the routing server sends the processing result to the protocol matching equipment.
After the routing server analyzes the acquired data to obtain a processing result, the processing result can be sent to the protocol matching device, so that the protocol matching device sends the processing result to the acquisition device, and/or so that the protocol matching device retains information such as the processing result and the acquired data.
S106: and the protocol matching equipment forwards the processing result to the acquisition equipment.
And after the protocol matching equipment receives the processing result of the routing server on the acquired data from the routing server, the processing result can be fed back to the acquisition equipment.
Optionally, the protocol matching device may send the data processing result to the acquisition device that initiated the data processing request through the acquisition device connection handle.
In addition, after the protocol matching device obtains the processing result, the collected data, and/or information corresponding to the collected data (for example, a protocol parsing rule and/or routing information corresponding to the collected data) may be stored in an associated manner. For example, the communication module in the protocol matching device may query the original data content corresponding to the processing result from the temporary buffer of the storage module based on the relay handle information, and refill the actually obtained data processing result to form single-transaction data as shown in table 1 and store the single-transaction data. In addition, the data can be transmitted to the distributed storage system through protocols such as IPFS and the like for data persistence caching, so that traceability of a data distribution process can be realized, and the problems that the centralized service node is subjected to abnormal attacks and the protocol data is lost and tampered can be avoided based on the distributed storage of the protocol data and/or the transaction data.
Table 1 single transaction data
Time stamp Protocol resolution rules Destination routing information Device acquisition data Data processing results
In this embodiment, the acquisition device sends the acquired data to the protocol matching device, and the protocol matching device determines a protocol parsing rule matched with the acquired data, so that the protocol matching device determines a routing server corresponding to the acquired data based on routing information corresponding to the protocol parsing rule, and then the protocol matching device can forward the acquisition device to the routing server to allow the routing server to process the acquired data. Therefore, in the heterogeneous data processing method, the acquisition equipment does not need to directly send the acquired data to the routing server corresponding to the acquired data, but the acquisition equipment sends the acquired data to the protocol matching equipment connected with the acquisition equipment, the protocol matching equipment confirms the routing server corresponding to the acquired data, and then the protocol matching equipment forwards the acquired data to the routing server corresponding to the acquired data, namely the protocol matching equipment receiving the acquisition equipment in the heterogeneous data processing method does not need to be the routing server capable of processing the acquired data, so that the butt joint node of the acquisition equipment can always be the protocol matching equipment connected with the acquisition equipment in the access process of the acquisition equipment, and the butt joint node configuration or the networking deployment does not need to be modified again even if the butt joint protocol changes in the access process of the acquisition equipment.
Referring to fig. 2, steps of a protocol matching device for implementing the heterogeneous data processing method according to the first embodiment are shown, and fig. 2 is a schematic workflow diagram of the protocol matching device according to the first embodiment of the heterogeneous data processing method.
S201: the protocol matching device obtains the acquisition data from the acquisition device.
S202: and the protocol matching equipment matches the collected data with at least one protocol analysis rule to determine the routing information corresponding to the protocol analysis rule matched with the collected data.
S203: and the protocol matching equipment sends the acquired data to a routing server corresponding to the matched protocol analysis rule based on the corresponding routing information so that the routing server can process the acquired data.
The steps in this embodiment are similar to those in the embodiment shown in fig. 1, and are not described again in detail. The protocol matching device confirms the protocol analysis rule matched with the collected data, so that the protocol matching device determines the routing server corresponding to the collected data based on the routing information corresponding to the protocol analysis rule, and then the protocol matching device can forward the collected data to the routing server so that the routing server can process the collected data. Therefore, in the heterogeneous data processing method, the acquisition equipment does not need to directly send the acquired data to the routing server corresponding to the acquired data, but the acquisition equipment sends the acquired data to the protocol matching equipment connected with the acquisition equipment, the protocol matching equipment confirms the routing server corresponding to the acquired data, and then the protocol matching equipment forwards the acquired data to the routing server corresponding to the acquired data, namely the protocol matching equipment receiving the acquisition equipment in the heterogeneous data processing method does not need to be the routing server capable of processing the acquired data, so that the butt joint node of the acquisition equipment can always be the protocol matching equipment connected with the acquisition equipment in the access process of the acquisition equipment, and the butt joint node configuration or the networking deployment does not need to be modified again even if the butt joint protocol changes in the access process of the acquisition equipment.
For the acquisition device, the steps of implementing the heterogeneous data processing method of the first embodiment are as follows.
S301: the acquisition equipment sends the acquired data to the protocol matching equipment so that the protocol matching equipment matches the acquired data with the protocol analysis rule to determine the routing information corresponding to the protocol analysis rule matched with the acquired data, and then the protocol matching equipment forwards the acquired data to the routing server corresponding to the matched protocol analysis rule based on the corresponding routing information.
In this embodiment, the steps are similar to the related steps in the embodiment shown in fig. 1, and are not described again. The acquisition equipment sends the acquired data to the protocol matching equipment, so that the protocol matching equipment confirms the protocol analysis rule matched with the acquired data, the protocol matching equipment determines the routing server corresponding to the acquired data based on the routing information corresponding to the protocol analysis rule, and then the protocol matching equipment can forward the acquisition equipment to the routing server so that the routing server can process the acquired data. Therefore, in the heterogeneous data processing method, the acquisition equipment does not need to directly send the acquired data to the routing server corresponding to the acquired data, but the acquisition equipment sends the acquired data to the protocol matching equipment connected with the acquisition equipment, the protocol matching equipment confirms the routing server corresponding to the acquired data, and then the protocol matching equipment forwards the acquired data to the routing server corresponding to the acquired data, namely the protocol matching equipment receiving the acquisition equipment in the heterogeneous data processing method does not need to be the routing server capable of processing the acquired data, so that the butt joint node of the acquisition equipment can always be the protocol matching equipment connected with the acquisition equipment in the access process of the acquisition equipment, and the butt joint node configuration or the networking deployment does not need to be modified again even if the butt joint protocol changes in the access process of the acquisition equipment.
For a routing server, please refer to fig. 3 for implementing the steps of the heterogeneous data processing method in the foregoing embodiment, and fig. 3 is a schematic diagram of a workflow of the routing server in a first embodiment of the heterogeneous data processing method in the present application.
S401: in response to the first routing information being equal to the second routing information, the routing server obtains from the protocol matching device the acquisition data of the acquisition device.
The first routing information is routing information which is determined by the protocol matching equipment and corresponds to a protocol analysis rule matched with the acquired data, and the second routing information is routing information of a routing server or routing information of a protocol data processing service deployed on the routing server.
S402: and processing the acquired data to obtain a processing result.
The steps in this embodiment are similar to those in the embodiment shown in fig. 1, and are not described again in detail. In response to that the first routing information is equal to the second routing information, the routing server obtains the acquired data of the acquisition device from the protocol matching device, wherein the first routing information is routing information which is determined by the protocol matching device and corresponds to a protocol analysis rule matched with the acquired data, and the second routing information is routing information of a protocol data processing service deployed on the routing server; and processing the acquired data to obtain a processing result. In the scheme, the collected data of the collecting device is sent to the routing server by the protocol matching device, the protocol matching device is the routing information of the routing server corresponding to the collected data determined based on the matching result of the collected data and the protocol analysis rule, so that the collecting device is not required to directly send the collected data to the routing server corresponding to the collected data, but the collecting device sends the collected data to the protocol matching device connected with the collecting device, the protocol matching device confirms the routing server corresponding to the collected data, and then the protocol matching device forwards the collected data to the routing server corresponding to the collected data.
Alternatively, the protocol analysis rule matched with the collected data may be determined by the protocol matching device itself in step S102 of the first embodiment, and the collected data and the protocol analysis rule may be matched by a block chain.
For example, as shown in fig. 4, the present application provides a heterogeneous data processing method according to a second embodiment, which includes the following steps. It should be noted that the following step numbers are only used for simplifying the description, and are not intended to limit the execution order of the steps, and the execution order of the steps in the present embodiment may be arbitrarily changed without departing from the technical idea of the present application.
S501: and the acquisition equipment initiates a protocol matching request to the block chain where the acquisition equipment is located based on the acquired data.
In this embodiment, the acquisition device itself may serve as a node of the block chain, and the heterogeneous data processing method of the present application is implemented. Optionally, after acquiring the data, the acquisition device initiates a protocol matching request to the block chain where the acquisition device is located based on the acquired data processed by the docking protocol, so that an intelligent contract in a subsequent block chain responds to the protocol matching request to match the acquired data with the protocol parsing rule, and further forwards the acquired data based on the protocol parsing rule matched with the acquired data.
In another implementation manner, the acquisition device is connected to a transfer device, the transfer device serves as a node of the block chain, and the acquisition device may send the acquired data to the transfer device, so that the transfer device initiates a protocol matching request to the block chain where the transfer device is located based on the acquired data.
Optionally, the initiating, by the device, a protocol matching request to the blockchain in which the device is located may refer to: the equipment interacts with a contract interface of an intelligent contract address on a block chain where the equipment is located through an intelligent contract communication module of the equipment, and transmits collected data so that the intelligent contract can match the collected data with a protocol analysis rule in a block chain account book. The above-mentioned device initiates a protocol matching request to the blockchain in which it is located or may be understood as: the equipment calls an intelligent contract (specifically, a protocol matching intelligent contract) on the block chain where the equipment is located, so that the called intelligent contract performs matching operation of the collected data and the protocol analysis rule.
S502: and the block chain matches the acquired data with the protocol analysis rule and determines the routing information corresponding to the protocol analysis rule matched with the acquired data.
After the blockchain acquires the protocol matching request initiated by the acquired data, the blockchain can match the acquired data with the protocol analysis rule and determine the routing information corresponding to the protocol analysis rule matched with the acquired data, so that the subsequent blockchain transmits the acquired data to the routing server corresponding to the matched protocol analysis rule based on the routing information corresponding to the matched protocol analysis rule.
S503: and the block chain transmits the acquired data to a routing server corresponding to the matched protocol analysis rule based on the routing information corresponding to the matched protocol analysis rule.
Optionally, the intelligent contract in the block chain may be set, so that after the intelligent contract in the block chain obtains the protocol matching request of the acquisition device, the acquired data in the protocol matching request may be matched with the protocol parsing rule, and the routing information corresponding to the protocol parsing rule matched with the acquired data is determined, and then the intelligent contract in the block chain may transmit the acquired data to the routing server corresponding to the matched protocol parsing rule based on the routing information corresponding to the matched protocol parsing rule.
S504: and the routing server processes the acquired data.
After the routing server acquires the acquired data, the routing server can process the acquired data to obtain a processing result.
After the routing server processes the obtained processing result, the processing result can be sent to the protocol matching device, so that the protocol matching device sends the processing result to the acquisition device, and/or so that the protocol matching device retains information such as the processing result and the acquired data.
For a protocol matching node in a block chain, where the protocol matching node may be a collection device or a relay device (e.g., a protocol matching device) connected to the collection device, the steps of implementing the heterogeneous data processing method according to the second embodiment are as follows.
S601: the protocol matching node calls an intelligent contract of a block chain where the protocol matching node is located, matches the collected data of the collecting device with the protocol analysis rule in the block chain account book to determine the routing information corresponding to the protocol analysis rule matched with the collected data, and sends the collected data to the routing server corresponding to the matched protocol analysis rule based on the corresponding routing information so that the routing server processes the collected data.
In this embodiment, the steps are similar to those in the embodiment shown in fig. 4, and detailed description is omitted. The protocol matching node calls an intelligent contract of a block chain where the protocol matching node is located, matches the collected data of the collecting device with the protocol analysis rule in the block chain account book to determine the routing information corresponding to the protocol analysis rule matched with the collected data, and sends the collected data to the routing server corresponding to the matched protocol analysis rule based on the corresponding routing information so that the routing server processes the collected data. According to the heterogeneous data processing method, the docking protocol changes in the access process of the acquisition equipment, the acquisition equipment can send the acquired data to the corresponding routing server in a mode of sending the acquired data to a specific transfer node or directly calling an intelligent contract to process the acquired data, and the like, and the configuration of the docking node or the deployment of the networking is not required to be modified again.
In addition, the protocol matching equipment is matched with the block chain where the protocol matching equipment is located to match the collected data with the protocol analysis rule, and then the routing server corresponding to the protocol analysis rule matched with the collected data is determined.
In an implementable manner, the acquisition device, the protocol matching device, and the routing server may constitute a system as shown in fig. 5. As shown in fig. 5, the protocol matching device and the routing server may constitute an edge, cloud federation chain architecture based on the protocol matching device + the routing server.
Optionally, the protocol matching device may include a proxy communication module, a blockchain communication module, an identity authentication module, an intelligent contract communication module, a service container module, and/or a storage module.
The service container module can be used for being responsible for protocol analysis rules, service image import, downloading, service container deployment, operation and/or resource scheduling.
The agent communication module can be used for selecting the routing information of the corresponding routing server based on the protocol analysis rule of the local service container module and the protocol analysis rule acquired by the intelligent contract on the current chain and/or other chains, generating a relay node, relaying and forwarding the corresponding acquired data to the target node, and acquiring the processing result of the corresponding acquired data.
The intelligent contract communication module can be used for being in charge of a contract address contract interface interaction module on a chain, the data input refers to heterogeneous data reported by the multi-acquisition equipment, and the data output refers to routing information of a routing server node or mirror image downloading information.
The storage module can be used for temporarily storing the collected data information, the protocol analysis rule, the destination routing information, the collection equipment connection handle and the relay connection handle, integrating the protocol processing result returned by the proxy communication module and storing the single-time transaction data into a decentralized distributed storage system based on an IPFS protocol.
The identity certificate module is used for applying for downloading a corresponding identity certificate to a CA node in a PKI (Public Key Infrastructure).
The block chain communication module comprises a client-side communication module and a server-side communication module, and can be added into a block chain network in the form of a client node, and other block chain nodes can perform identity recognition based on member services to achieve consensus.
The routing server may also include a blockchain communication module and/or an identity authentication module.
When building a block chain network in an edge and cloud alliance chain architecture, different protocol matching devices and a routing server can perform identity verification on a CA node through respective identity authentication modules and obtain a corresponding identity certificate, then the CA node carries the identity certificate to establish communication with other nodes through a P2P network communication mode of a block chain communication module, and performs identity identification based on member services to achieve consensus, so that the block chain network is formed. The protocol matching equipment node can be in an intranet environment and actively discovers and connects with the routing server node through a client in the blockchain communication module. And the routing server node completes node discovery through a client and a server in the block chain communication module, and supports an active discovery mode and a passive receiving mode.
Alternatively, at least one protocol matching device may join the blockchain network in a manner that actively connects adjacent route server nodes.
Under the system framework, a plurality of routing servers jointly construct a block chain ledger and/or formulate a signing intelligent contract.
The block chain account book stores protocol analysis rules of all routing servers and corresponding routing information of the routing servers. Optionally, the routing server generates routing information based on the protocol processing address and the port, and generates a protocol parsing rule (e.g., regular expression code) based on the corresponding protocol service. As shown in fig. 6, the routing server then generates signature information by private key signature, and packages the signature information together with the identity certificate to initiate a transaction proposal application to an endorsement node in the blockchain network; after the endorsement node receives the transaction proposal, the endorsement node verifies the signature and confirms whether the submitter has the operation authority, a transaction result is returned and the signature is signed, and the client node initiates a transaction request to a sequencing node in the block chain network according to the transaction result; after the sequencing node performs consensus sequencing on the received transaction requests, a new block is generated according to a block generation strategy and sent to a submitting node, and the submitting node is responsible for checking and adding to a current block chain account book.
After different routing servers jointly make and sign the intelligent contract, the intelligent contract can be deployed after being propagated and verified through a P2P network.
In another implementation, the acquisition device and the protocol matching device may cooperate to form a cloudless private chain architecture based on the protocol matching device. And the adjacent nodes are discovered and identified by matching the equipment nodes with each protocol, and a cloud platform is not involved, so that a block chain network under an intranet is formed. In this implementation manner, the blockchain communication module of the protocol matching device has the functions of a client and a server, and supports the P2P network communication functions of active discovery and passive reception.
When a block chain network in an edge and cloud alliance chain architecture is constructed, different protocol matching device nodes conduct identity verification to CA nodes through respective identity authentication modules and obtain corresponding identity certificates, then the nodes with the identity certificates establish communication with other nodes through a P2P network communication mode of a block chain communication module, identity recognition is conducted based on member services to achieve consensus, and the block chain network is formed.
The cloudless private chain architecture can be deployed in a local area network or a private network. Of course, in other embodiments, the cloudless private chain architecture may also be deployed in a public network.
Under the system architecture, the blockchain account book can record at least one protocol analysis rule and corresponding routing information. The protocol resolution rules and their corresponding routing information may be uploaded from any node in the chain.
Furthermore, the protocol matching device may also be a routing server of at least one docking protocol. Under the condition, the protocol matching equipment acquires service mirror image routing information, download information and protocol analysis rules deployed by a self service container module, generates signature information through private key signature, and packages the signature information and an identity certificate together to initiate a transaction proposal application to an endorsement node in a block chain network; after the endorsement node receives the transaction proposal, the endorsement node verifies the signature and confirms whether the submitter has the operation authority, a transaction result is returned and the signature is signed, and the client node initiates a transaction request to a sequencing node in the block chain network according to the transaction result; after the sequencing node performs consensus sequencing on the received transaction requests, a new block is generated according to a block generation strategy and sent to a submitting node, and the submitting node is responsible for checking and adding to a current block chain account book.
Optionally, each protocol matching device in at least part of the protocol matching devices in the block chain serves as a main routing server of one docking protocol, that is, each protocol matching device is mainly responsible for processing data of one docking protocol. In addition, each protocol matching device in at least part of the protocol matching devices in the blockchain can also be used as a secondary routing server of at least one docking protocol. Illustratively, each of at least some of the protocol matching devices may download and deploy an image of the primary responsible protocol service of the other protocol matching device to become a secondary routing server for the other docking protocol. For example, one protocol matching device is an a protocol server, the protocol matching device serves as a main routing server of the a protocol, and the protocol matching device can also obtain and deploy a service image of the B protocol. That is, at least one docking protocol service deployed on the protocol matching device may include its own docking protocol service, and may also include a mirror service of the docking protocol service of another routing server. For example, one protocol matching device is an a protocol server, and at least one docking protocol service deployed on the protocol matching device may include not only an a protocol service, but also a service image of a B protocol service of the B protocol server, a service image of a C protocol service of the C protocol server, and/or a service image of a D protocol service of the D protocol server, and the like.
Optionally, the blockchain network may be formed based on a local area network and a private network, so that a higher confidentiality and privacy may be achieved, a cloudless private chain architecture may be deployed in the local area network or the private network, and dynamic protocol data routing may be achieved by sharing a protocol processing function and a protocol processing capability of a service container mirror image and combining an access load condition of a multi-node device.
Further, the routing information, recorded in the protocol matching device, corresponding to the protocol service deployed by the protocol matching device may be local routing information of the protocol matching device, and specifically may be routing information of the protocol service deployed in the protocol matching device.
In addition, under the system architecture or a system architecture similar to the system architecture, data of each routing server node or protocol matching equipment node does not need to be stored locally, persistent cache can be uniformly performed through distributed storage, and the risk of single-node data loss can be reduced through multi-node data storage; in addition, based on the P2P network, multiple nodes can simultaneously inquire and acquire data, the data inquiry efficiency is improved, data sharing can be directly realized among different protocol processing nodes, the problem of data conversion and forwarding among different service platform nodes is not required to be considered, and the data sharing capability is greatly improved.
Based on the above system architecture or a system architecture similar to the above system architecture, as shown in fig. 7, the present application provides a heterogeneous data processing method according to a third embodiment, which includes the following steps. It should be noted that the following step numbers are only used for simplifying the description, and are not intended to limit the execution order of the steps, and the execution order of the steps in the present embodiment may be arbitrarily changed without departing from the technical idea of the present application.
S701: the protocol matching device obtains the acquisition data from the acquisition device.
S702: and the protocol matching equipment initiates a protocol matching request to the block chain in which the protocol matching equipment is positioned based on the collected data.
After the protocol matching device acquires the acquired data from the acquisition device, the protocol matching device may initiate a protocol matching request to the blockchain where the protocol matching device is located based on the acquired data, so that an intelligent contract in the blockchain matches the acquired data with the protocol parsing rule, and determine routing information corresponding to the protocol parsing rule matched with the acquired data.
S703: and the block chain matches the acquired data with the protocol analysis rule and determines the routing information corresponding to the protocol analysis rule matched with the acquired data.
S704: and the block chain sends the routing information corresponding to the protocol analysis rule matched with the acquired data to the protocol matching equipment.
After determining the routing information corresponding to the protocol analysis rule matched with the acquired data, the block chain may send the routing information corresponding to the protocol analysis rule matched with the acquired data to the protocol matching device, so that the protocol matching device sends the acquired data to the routing server corresponding to the matched protocol analysis Gu Ze based on the routing information corresponding to the matched protocol analysis rule.
Optionally, the intelligent contract in the block chain may be set, so that after the intelligent contract in the block chain obtains the protocol matching request of the protocol matching device, the acquired data in the protocol matching request may be matched with the protocol parsing rule, the routing information corresponding to the protocol parsing rule matched with the acquired data is determined, and then the routing information corresponding to the protocol parsing rule matched with the acquired data is fed back to the protocol matching device. The data input value of the intelligent contract can also be understood as a protocol analysis rule submitted by each routing server in the block chain account book and pre-reading protocol data input by a contract calling party (namely, collected data input by each protocol matching device); and the data output value of the intelligent contract is the routing information corresponding to the protocol analysis rule matched with the pre-reading protocol data.
S705: and the protocol matching equipment sends the acquired data to a routing server corresponding to the matched protocol analysis rule based on the routing information corresponding to the matched protocol analysis rule.
S706: and the routing server analyzes the acquired data to obtain a processing result.
S707: and the routing server sends the processing result to the protocol matching equipment.
S708: and the protocol matching equipment forwards the processing result to the acquisition equipment.
In the embodiment, the corresponding routing server joins the blockchain network, so that the protocol matching device automatically has the corresponding protocol processing capability, and the whole process is unaware of the device access side and the data distribution process is traceable.
Also based on the system architecture described above or a system architecture similar thereto, as shown in fig. 8, the present application provides a heterogeneous data processing method according to a fourth embodiment, which includes the following steps. It should be noted that the following step numbers are only used for simplifying the description, and are not intended to limit the execution order of the steps, and the execution order of the steps in the present embodiment may be arbitrarily changed without departing from the technical idea of the present application.
S801: the protocol matching device obtains the acquisition data from the acquisition device.
S802: and the protocol matching equipment performs matching operation of the acquired data and the protocol analysis rule.
After the protocol matching equipment acquires the acquired data from the acquisition equipment, the protocol matching equipment can perform matching operation of the acquired data and the protocol analysis rule; if the protocol matching device determines the protocol parsing rule matching the collected data, step S806 is performed to send the collected data to the routing server corresponding to the matched protocol parsing rule based on the routing information corresponding to the matched protocol parsing rule; if the protocol matching device does not determine the protocol parsing rule matching the collected data, step S803 is entered to send a protocol matching request to the blockchain where the protocol matching device is located based on the collected data.
S803: and the protocol matching equipment initiates a protocol matching request to the block chain in which the protocol matching equipment is positioned based on the collected data.
And if the protocol matching equipment does not determine the protocol analysis rule matched with the acquired data, initiating a protocol matching request to the block chain where the protocol matching equipment is located based on the acquired data.
S804: and the block chain matches the acquired data with the protocol analysis rule and determines the routing information corresponding to the protocol analysis rule matched with the acquired data.
In one implementation, the blockchain matches the collected data with protocol parsing rules recorded in its blockchain book, and determines routing information corresponding to the protocol parsing rules matched with the collected data.
In another implementation, the blockchain network may be connected to other blockchain networks. And matching each protocol analysis rule in the block chain account book with the acquired data by the intelligent contract in the block chain so as to determine the protocol analysis rule matched with the acquired data. If the intelligent contract of the block chain to which the protocol matching equipment belongs does not determine the protocol analysis rule matched with the acquired data in the block chain account book of the intelligent contract; the method can initiate a cross-link request to other connected blockchain networks, so as to determine protocol analysis rules matched with the collected data in the account books of the other blockchain networks through interaction of the other connected blockchain networks.
In an example, when the protocol analysis rule matched with the collected data is not determined in the own block chain account book by the intelligent contract of the block chain to which the protocol matching device belongs, the intelligent contract of the block chain to which the protocol matching device belongs may initiate a cross-chain request to other block chains connected to the intelligent contract of the block chain to which the protocol matching device belongs to obtain account book information of the intelligent contract, and then the intelligent contract of the block chain to which the protocol matching device belongs matches the collected data with the protocol analysis rule in the account book information of the other block chains to determine whether the protocol analysis rule matched with the collected data exists in the account books of the other block chain networks.
In another example, in a case that the intelligent contract of the blockchain to which the protocol matching device belongs does not determine the protocol analysis rule matched with the collected data in the blockchain account book of the intelligent contract, the intelligent contract of the blockchain to which the protocol matching device belongs may initiate a cross-chain matching request to another blockchain connected to the intelligent contract, so that the other blockchain connected to the blockchain to which the protocol matching device belongs can determine whether the protocol analysis rule matched with the collected data exists in the blockchain account book of the intelligent contract based on the collected data of the collecting device in the cross-chain matching request, and if so, the other blockchain may send the protocol analysis rule matched with the collected data or routing information corresponding to the protocol analysis rule matched with the collected data to the blockchain to which the protocol matching device belongs.
The block chain to which the protocol matching device belongs initiates a cross-chain request to other intranet private chains through a pre-talker interface in an intelligent contract.
S805: and the block chain sends the routing information corresponding to the protocol analysis rule matched with the acquired data to the protocol matching equipment.
S806: and the protocol matching equipment sends the acquired data to a routing server corresponding to the matched protocol analysis rule based on the routing information corresponding to the matched protocol analysis rule.
S807: and the routing server analyzes the acquired data to obtain a processing result.
S808: and the routing server sends the processing result to the protocol matching equipment.
S809: and the protocol matching equipment forwards the processing result to the acquisition equipment.
In the embodiment, decentralized networking of the routing server and the protocol matching device can be achieved, multi-level routing screening of device protocol data is achieved through local service container matching of the protocol matching device, current chain intelligent contract calling and/or intelligent contract prediction machine interface cross-chain operation, and the protocol matching device can dynamically expand protocol processing capacity in a non-code intrusion mode based on a device discovery and consensus mechanism of a block chain.
In addition, the protocol matching device can deploy the corresponding service image and the protocol analysis rule through the service container module based on the corresponding protocol delay sensitivity requirement, run the image file through the container engine to perform service instantiation deployment, and generate the routing information of the deployment service. Therefore, dynamic protocol data routing can be realized by combining the access load condition of the multi-node equipment through protocol processing function sharing and protocol processing capacity sharing of the service container mirror image based on the consideration of stronger confidentiality and privacy.
Based on this, as shown in fig. 9, the present application provides a heterogeneous data processing method according to a fifth embodiment, which includes the following steps. It should be noted that the following step numbers are only used for simplifying the description, and are not intended to limit the execution order of the steps, and the execution order of the steps in the present embodiment may be arbitrarily changed without departing from the technical idea of the present application.
S901: the protocol matching device obtains the acquisition data from the acquisition device.
In the heterogeneous data processing method, the acquisition device can acquire data information, and the acquisition device can send the acquired data to the protocol matching device, so that the subsequent protocol matching device can confirm the protocol analysis rule matched with the acquired data, and the protocol matching device can send the acquired data to the service of the butt-joint protocol of the acquired data based on the routing information corresponding to the protocol analysis rule, so that the service can process the acquired data.
S902: and the protocol matching equipment is used for matching the protocol analysis rules.
The protocol matching device can perform local matching first when acquiring the acquired data. Optionally, the protocol matching device may match the collected data with at least one protocol parsing rule pre-stored in itself.
Entering step S907 when the protocol matching device matches the protocol parsing rule corresponding to the collected data; if the protocol matching device does not match the protocol analysis rule corresponding to the collected data, the process proceeds to step S903.
S903: and initiating a protocol matching request for collecting data to the block chain so that the block chain determines a protocol analysis rule corresponding to the collected data.
Under the condition that the protocol matching device is not matched with the protocol analysis rule corresponding to the acquired data, the protocol matching device can initiate a protocol matching request for acquiring the data to the block chain so that the block chain determines the protocol analysis rule corresponding to the acquired data, so that a subsequent block chain feeds back related information of the protocol analysis rule matched with the acquired data to the protocol matching device, and information storage and matching operations are performed through the block chain, so that privacy protection of protocol interaction, storage supervision of the protocol data, efficient processing of the protocol data, the property of a cashless block chain and the like can be realized, and the problems that a centralized service node is subjected to abnormal attack, protocol data storage is lost, and the centralized service node is tampered and the like can be avoided based on decentralized networking of a block chain network.
S904: and the block chain feeds back relevant information of the matched protocol analysis rule to the protocol matching equipment.
After the block chain determines the protocol analysis rule corresponding to the acquired data, the relevant information of the protocol analysis rule matched with the acquired data can be fed back to the protocol matching device, so that the subsequent protocol matching device can perform corresponding processing based on the content in the relevant information fed back by the block chain. Optionally, in a case that the feedback data includes the mirror image download information and the routing information, the step S905 is entered; in the case where the feedback data includes only the mirror download information, it proceeds to step S906; in the case where the feedback data includes only the routing information, the flow proceeds to step S907.
Optionally, the relevant information of the protocol parsing rule matched with the collected data may include routing information and/or service image downloading information corresponding to the protocol parsing rule.
The routing information and/or the service image downloading information corresponding to the protocol analysis rule may be routing information and/or service image downloading information corresponding to the protocol analysis rule recorded in the latest block node of the protocol corresponding to the protocol analysis rule, so as to ensure that the routing information and/or the service image downloading information corresponding to the protocol analysis rule determined by the block chain is latest, thereby ensuring the validity of the information fed back by the block chain.
As shown in fig. 10, the information related to the matched protocol parsing rule fed back by the blockchain may be uploaded to the blockchain by the master routing server of the protocol corresponding to the protocol parsing rule when uploading the protocol parsing rule. The main routing server of the protocol can confirm the uploaded information type based on the situation of the main routing server.
Illustratively, the master routing server of a protocol acknowledges that it is capable of and/or wants to process all data of the corresponding protocol, then the master routing server of the protocol may upload only the protocol parsing rules and routing information of the protocol to the blockchain.
Or the main routing server of the protocol does not want to process the data of the corresponding protocol, and the main routing server of the protocol can only upload the protocol analysis rule and the service image download information of the protocol to the block chain, so that the protocol matching device which receives the collected data of the protocol downloads and deploys the service image of the protocol, and further, the corresponding protocol matching device processes the collected data of the protocol.
Or the main routing server of the protocol can process the data of the corresponding protocol and allow other devices to process the data of the corresponding protocol, and the main routing server of the protocol can upload the protocol analysis rule, the routing information and the service image downloading information of the protocol to the block chain, so that the protocol matching device receiving the collected data of the protocol determines whether to process the data by the main routing server of the protocol or download the image by the protocol matching device.
Or, in the case that the own load pressure of the main routing server of the protocol is not large (which can be understood as being smaller than the pressure threshold), the main routing server of the protocol may upload the protocol parsing rule, the routing information and/or the service image download information of the protocol to the block chain. In the case that the self load pressure of the main routing server of the protocol is large (which can be understood as being larger than the pressure threshold), the main routing server of the protocol may only upload the protocol parsing rule and the service image download information of the protocol to the blockchain. The routing server can judge the load pressure of the routing server through the access number of the routing server.
In other implementation manners, the information related to the matching protocol parsing rule fed back by the blockchain may also be uploaded to the blockchain by the secondary routing server of the protocol corresponding to the protocol parsing rule when uploading the protocol parsing rule.
In addition, after the protocol matching device acquires the relevant information of the matched protocol analysis rule fed back by the blockchain, and under the condition that the relevant information of the protocol analysis rule includes the protocol analysis rule matched with the acquired data, the protocol matching device can store the protocol analysis rule, the routing information and/or the service image downloading information fed back by the blockchain, so that the subsequent protocol matching device can determine the matching relationship between the protocol analysis rule and the subsequent acquired data through local matching.
S905: and the protocol matching equipment confirms whether the load condition of the protocol matching equipment meets the preset requirement or not.
Under the condition that the feedback data comprises mirror image downloading information and routing information, the protocol matching device can determine whether the load condition of the protocol matching device meets the preset requirement or not; if the self load condition of the protocol matching device is confirmed to meet the preset requirement, the step S906 is entered; if it is determined that the load condition of the laundry matching apparatus does not satisfy the preset requirement, the process proceeds to step S907.
Optionally, whether the load condition of the vehicle meets the preset requirement may be determined by determining whether the load amount/load pressure of the vehicle exceeds a threshold. Exemplarily, in the case that the protocol matching device confirms that the load pressure of the protocol matching device itself exceeds the threshold, the load condition of the protocol matching device does not meet the preset requirement; and under the condition that the protocol matching equipment confirms that the load pressure of the protocol matching equipment is lower than the threshold value, the load condition of the protocol matching equipment meets the preset requirement.
S906: and the protocol matching equipment downloads and deploys the service mirror corresponding to the protocol analysis rule based on the mirror downloading information in the feedback information, and feeds back the local routing information.
Under the condition that the feedback data only comprises the mirror image downloading information or the feedback data comprises the mirror image downloading information and the routing information and the protocol matching equipment confirms that the load condition of the protocol matching equipment meets the preset requirement, the protocol matching equipment downloads and deploys the service mirror image corresponding to the protocol analysis rule based on the mirror image downloading information in the feedback information.
Alternatively, the image download information may be an image download link, so that the protocol matching device may download the service image of the protocol corresponding to the collected data through the image download link.
In a specific example, after the protocol parsing rule determines that a remote image downloading deployment and then a local route distribution mode are adopted, the protocol parsing rule may call a service container module of the protocol parsing rule to perform remote image downloading deployment, and then return actual deployed local route information.
S907: and sending the collected data to the service of the butt joint protocol of the collected data based on the routing information corresponding to the matched protocol analysis rule.
After determining the routing information of the protocol parsing rule corresponding to the collected data based on the above steps, the collected data may be sent to a service of a docking protocol of the collected data based on the routing information corresponding to the matched protocol parsing rule, so that the collected data is processed by the corresponding service.
Optionally, in a case that the protocol parsing rule determines that a manner of downloading and deploying the remote mirror image is adopted and then distributing the remote mirror image by using the local route is adopted, the protocol parsing rule may send the collected data to a service of a docking protocol of the collected data deployed on the protocol matching device based on the local route information of the protocol parsing rule corresponding to the collected data.
And under the condition that the protocol matching equipment determines to adopt a direct remote route distribution mode, namely the protocol matching equipment adopts a main routing server of a docking protocol for sending the acquired data to the acquired data based on the routing information, the protocol matching equipment creates a relay node and forwards the acquired data to the routing server based on the routing information corresponding to the protocol analysis rule. Specifically, the protocol matching device can log in to the server communication module of the main routing server corresponding to the collected data through the client module of the protocol matching device, and then transmit the collected data to the main routing server corresponding to the collected data under the condition of successful login.
S908: the collected data is processed by the service of the docking protocol of the collected data.
After the service corresponding to the acquired data acquires the acquired data, the acquired data can be analyzed and the like, and a processing result is obtained.
S909: and the protocol matching equipment acquires the processing result of the service of the butt joint protocol of the acquired data on the acquired data.
Referring to fig. 11, fig. 11 is a schematic structural diagram of an embodiment of an electronic device according to the present application. The present electronic device 10 includes a processor 12, and the processor 12 is configured to execute instructions to implement the above-described heterogeneous data processing method and image encoding method. For a specific implementation process, please refer to the description of the foregoing embodiment, which is not repeated herein.
The processor 12 may also be referred to as a CPU (Central Processing Unit). The processor 12 may be an integrated circuit chip having signal processing capabilities. The processor 12 may also be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The general purpose processor may be a microprocessor or the processor 12 may be any conventional processor or the like.
The electronic device 10 may further include a memory 11 for storing instructions and data required for operation of the processor 12.
The processor 12 is configured to execute instructions to implement the methods provided by any of the embodiments of the present heterogeneous data processing method and image encoding method, and any non-conflicting combinations thereof.
Referring to fig. 12, fig. 12 is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present disclosure. The computer-readable storage medium 30 of the present embodiment stores instructions/program data 31, and the instructions/program data 31 when executed implement the method provided by any one of the embodiments of the present heterogeneous data processing method, the image decoding method, and the image encoding method, and any non-conflicting combinations. In one embodiment, the instructions/program data 31 may form a program file stored in the computer-readable storage medium 30 in the form of a software product, so as to enable a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the methods according to the embodiments of the present application. And the aforementioned computer-readable storage medium 30 includes: various media capable of storing program codes, such as a usb disk, a mobile hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, or terminal devices, such as a computer, a server, a mobile phone, and a tablet.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a unit is merely a logical division, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.
The above are only embodiments of the present application, and not intended to limit the scope of the present application, and all equivalent structures or equivalent processes performed by the present application and the contents of the attached drawings, which are directly or indirectly applied to other related technical fields, are also included in the scope of the present application.

Claims (14)

1. A method for heterogeneous data processing, the method comprising:
acquiring acquired data from acquisition equipment by protocol matching equipment;
the protocol matching equipment matches the acquired data with at least one protocol analysis rule;
if the protocol analysis rule matched with the acquired data is not determined by the protocol matching equipment, calling an intelligent contract of a block chain where the protocol matching equipment is located to match the acquired data with the protocol analysis rule in the block chain account book so as to determine the related information of the protocol analysis rule matched with the acquired data;
determining corresponding routing information based on the related information fed back by the intelligent contract, wherein the block chain comprises at least one routing server, and a protocol analysis rule of each routing server in the block chain account book of the block chain is uploaded by each routing server;
and the protocol matching equipment sends the acquired data to a routing server corresponding to the matched protocol analysis rule based on the corresponding routing information so as to enable the routing server to process the acquired data.
2. The method as claimed in claim 1, wherein the step of invoking an intelligent contract of a blockchain in which the protocol matching device is located to match the collected data with a protocol parsing rule in a blockchain ledger to determine information related to the protocol parsing rule matching the collected data includes:
if the matching is successful, the related information fed back by the intelligent contract is obtained;
and if the matching fails, the intelligent contract acquires the account book information of other block chains, matches the collected data with the protocol analysis rule in the account book information of the other block chains, and feeds back the relevant information of the protocol analysis rule matched with the collected data.
3. The heterogeneous data processing method of claim 1, wherein the related information comprises image download information;
the determining the corresponding routing information based on the related information fed back by the intelligent contract comprises:
and the protocol matching equipment downloads and deploys the service mirror corresponding to the protocol analysis rule based on the mirror downloading information, and takes the local routing information for deploying the service mirror as the corresponding routing information.
4. The heterogeneous data processing method of claim 3, wherein the related information further comprises routing information;
the determining the corresponding routing information based on the relevant information fed back by the intelligent contract comprises:
the protocol matching equipment confirms whether the load condition of the protocol matching equipment meets a preset requirement or not;
if yes, executing the step of downloading and deploying the service mirror corresponding to the protocol analysis rule based on the mirror downloading information, and taking the local routing information for deploying the service mirror as the corresponding routing information;
and if not, taking the routing information in the related information as the corresponding routing information.
5. The heterogeneous data processing method of claim 1, wherein the protocol matching device matches the collected data with at least one protocol parsing rule, previously comprising:
and the protocol matching equipment acquires the at least one protocol analysis rule from a storage system connected with the protocol matching equipment and caches the protocol analysis rule.
6. The heterogeneous data processing method of claim 5, wherein the storage system is a distributed storage system.
7. The heterogeneous data processing method according to claim 1, wherein the protocol matching device sends the collected data to a routing server corresponding to the matched protocol parsing rule based on the corresponding routing information, so that the routing server processes the collected data, and then includes:
and forwarding the processing result of the acquired data obtained from the routing server to the acquisition equipment.
8. The heterogeneous data processing method according to claim 7, wherein the protocol matching device sends the collected data to a routing server corresponding to the matched protocol parsing rule based on the corresponding routing information, so that the routing server processes the collected data, and then includes:
and the protocol matching equipment stores the processing result, the acquired data, the corresponding routing information and/or the protocol analysis rule corresponding to the acquired data in an associated manner.
9. A method for heterogeneous data processing, the method comprising:
the method comprises the steps that a protocol matching node calls an intelligent contract of a block chain where the protocol matching node is located, and matches collected data of a collecting device with protocol analysis rules in a block chain account book to determine routing information corresponding to the protocol analysis rules matched with the collected data, and sends the collected data to a routing server corresponding to the matched protocol analysis rules based on the corresponding routing information, so that the routing server processes the collected data;
the protocol matching node is connected with the acquisition device, or the protocol matching node is the acquisition device, the block chain includes at least one routing server, and a protocol analysis rule of each routing server in the block chain ledger of the block chain is uploaded by each routing server.
10. A heterogeneous data processing method, comprising;
the method comprises the steps that acquisition equipment sends acquired data to protocol matching equipment so that the protocol matching equipment matches the acquired data with a protocol analysis rule, if the protocol matching equipment does not determine the protocol analysis rule matched with the acquired data, an intelligent contract of a block chain where the protocol matching equipment is located is called to match the acquired data with the protocol analysis rule in a block chain account book so as to determine relevant information of the protocol analysis rule matched with the acquired data, the corresponding routing information is determined based on the relevant information fed back by the intelligent contract, and then the protocol matching equipment forwards the acquired data to a routing server corresponding to the matched protocol analysis rule based on the corresponding routing information;
wherein the blockchain includes at least one routing server, and a protocol resolution rule of each routing server in the blockchain ledger of the blockchain is uploaded by the each routing server.
11. A method for heterogeneous data processing, the method comprising:
in response to that first routing information is equal to second routing information, a routing server obtains collected data of a collection device from a protocol matching device, wherein the first routing information is routing information which is determined by the protocol matching device and corresponds to a protocol analysis rule matched with the collected data, and the second routing information is routing information of a protocol data processing service deployed on the routing server, if the protocol matching device does not determine the protocol analysis rule matched with the collected data, the first routing information is determined by the protocol matching device matching the collected data with a protocol analysis rule in a block chain account by calling an intelligent contract of the block chain in which the protocol matching device is located, the block chain comprises at least one routing server, and the protocol analysis rule of each routing server in the block chain account of the block chain is uploaded by each routing server;
and processing the acquired data to obtain a processing result.
12. The heterogeneous data processing method of claim 11, wherein the obtaining acquisition data of the acquisition device from the protocol matching device previously comprises:
and uploading the protocol analysis rule and the second routing information to the block chain where the second routing information is located.
13. An electronic device, characterized in that the electronic device comprises a processor; the processor is configured to execute instructions to implement the steps of the method according to any of claims 1-12.
14. A computer readable storage medium having stored thereon instructions/program data, characterized in that said instructions/program data, when executed, implement the steps of the method according to any of claims 1-12.
CN202211470696.5A 2022-11-22 2022-11-22 Heterogeneous data processing method and device Active CN115550472B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211470696.5A CN115550472B (en) 2022-11-22 2022-11-22 Heterogeneous data processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211470696.5A CN115550472B (en) 2022-11-22 2022-11-22 Heterogeneous data processing method and device

Publications (2)

Publication Number Publication Date
CN115550472A CN115550472A (en) 2022-12-30
CN115550472B true CN115550472B (en) 2023-03-28

Family

ID=84720312

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211470696.5A Active CN115550472B (en) 2022-11-22 2022-11-22 Heterogeneous data processing method and device

Country Status (1)

Country Link
CN (1) CN115550472B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110048995A (en) * 2018-12-05 2019-07-23 阿里巴巴集团控股有限公司 The content check method and device of multi-media protocol, electronic equipment
CN113067822A (en) * 2021-03-19 2021-07-02 中国工商银行股份有限公司 Block chain-based information processing method, apparatus, device, medium, and product
CN113902574A (en) * 2021-10-19 2022-01-07 中国平安人寿保险股份有限公司 Protocol data processing method, device, computer equipment and storage medium
CN114357459A (en) * 2021-12-24 2022-04-15 香港城市大学成都研究院 Information security detection method for block chain system

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102052515B1 (en) * 2011-06-29 2019-12-05 프리스타일 테크놀러지 피티와이 리미티드 Systems, methods, and/or apparatus for enabling communication between devices using different communication protocols
EP2860912A1 (en) * 2013-10-11 2015-04-15 Telefonica Digital España, S.L.U. A method for correlating network traffic data from distributed systems and computer program thereof
CN108259371A (en) * 2016-12-28 2018-07-06 亿阳信通股份有限公司 A kind of network flow data analysis method and device based on stream process
CN106685815A (en) * 2017-01-04 2017-05-17 上海建坤信息技术有限责任公司 Multi - protocol hardware acquisition gateway system
US11627003B2 (en) * 2018-03-05 2023-04-11 SmartAxiom, Inc. Systems and methods for a blockchain multi-chain smart contract time envelope
US10893022B1 (en) * 2018-12-20 2021-01-12 Equinix, Inc. Routing protocol security using a distributed ledger
CN111083149A (en) * 2019-12-23 2020-04-28 北京简网科技有限公司 Variable data detection and analysis method and device of Modbus protocol
CN111083168A (en) * 2019-12-31 2020-04-28 广东嘉泰智能技术有限公司 Configurable data transmission method and device of Internet of things platform gateway and gateway
US11184436B2 (en) * 2020-03-02 2021-11-23 International Business Machines Corporation Automated storage selection with blockchain and NLP
CN111427664B (en) * 2020-03-25 2024-04-12 杭州电子科技大学 Container-based protocol analysis method, device, system and storage medium
CN112714045B (en) * 2020-12-31 2023-05-19 浙江远望信息股份有限公司 Rapid protocol identification method based on device fingerprint and port
CN112995153B (en) * 2021-02-09 2021-10-15 天津大学 Multi-source heterogeneous IoT (Internet of things) equipment data unified access and storage system and method
CN113923272A (en) * 2021-09-16 2022-01-11 珠海格力电器股份有限公司 Data analysis method and device and server equipment
CN114153468A (en) * 2021-11-04 2022-03-08 云镝智慧科技有限公司 Industrial protocol adaptation method and device, edge device and cloud server
CN115022333B (en) * 2022-06-22 2023-10-24 杭州迪普科技股份有限公司 Message forwarding method and device of load balancing equipment and electronic equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110048995A (en) * 2018-12-05 2019-07-23 阿里巴巴集团控股有限公司 The content check method and device of multi-media protocol, electronic equipment
CN113067822A (en) * 2021-03-19 2021-07-02 中国工商银行股份有限公司 Block chain-based information processing method, apparatus, device, medium, and product
CN113902574A (en) * 2021-10-19 2022-01-07 中国平安人寿保险股份有限公司 Protocol data processing method, device, computer equipment and storage medium
CN114357459A (en) * 2021-12-24 2022-04-15 香港城市大学成都研究院 Information security detection method for block chain system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
康博涵.基于区块链的智能服务交易跨链服务框架与通信机制.《网络与信息安全学报》.2021,全文. *
文莉莉 ; 邬满 ; .基于区块链的海洋数据采集与共享系统.信息技术与网络安全.2020,(07),全文. *

Also Published As

Publication number Publication date
CN115550472A (en) 2022-12-30

Similar Documents

Publication Publication Date Title
CN108650262B (en) Cloud platform expansion method and system based on micro-service architecture
CN110535872B (en) Method and apparatus for processing data requests in a blockchain network
Tanganelli et al. Edge-centric distributed discovery and access in the internet of things
CN110601906B (en) Data transmission method and device based on block chain
Tran et al. Optimal sybil-resilient node admission control
CN101491063A (en) Method and arrangement for data transmission between peer-to-peer networks
US20220232068A1 (en) Computer-implemented system and method for propagation and communication of data in a network such as a blockchain network
US10637794B2 (en) Resource subscription method, resource subscription apparatus, and resource subscription system
CN111801925B (en) Block chain based system and method for propagating data in a network
EP3477561A1 (en) System for goods delivery
CN111885133A (en) Data processing method and device based on block chain and computer storage medium
JP2024505692A (en) Data processing methods, devices and computer equipment based on blockchain networks
WO2022142405A1 (en) Cross-chain communication method and apparatus for internal network and external network, computer device, and storage medium
CN104980528A (en) Method, system and apparatus for realizing communication between nodes
CN111461720B (en) Identity verification method and device based on blockchain, storage medium and electronic equipment
JP2022534311A (en) Blockchain network addressing method based on public chain
CN101471878B (en) Safety routing method, network system and equipment for peer-to-peer session initiation protocol network
US20220182243A1 (en) Method and Apparatus for Distributed Ledger
CN115550472B (en) Heterogeneous data processing method and device
CN110995829B (en) Instance calling method and device and computer storage medium
CN112491935A (en) Water wave type broadcasting method and system for block chain
WO2022004894A1 (en) Transmission source terminal, communication system, communication method, and program
CN116846908B (en) Method and platform for sharing Handle identification data based on blockchain
CN111541732A (en) Method for avoiding invalid occupation of connection resources by clients in P2P network, computer readable storage medium and P2P network
CN111541733B (en) Method for testing message storage in P2P network, computer readable storage medium and P2P network

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant