CN113282462B - Information processing method applied to block chain and big data platform - Google Patents
Information processing method applied to block chain and big data platform Download PDFInfo
- Publication number
- CN113282462B CN113282462B CN202110619368.6A CN202110619368A CN113282462B CN 113282462 B CN113282462 B CN 113282462B CN 202110619368 A CN202110619368 A CN 202110619368A CN 113282462 B CN113282462 B CN 113282462B
- Authority
- CN
- China
- Prior art keywords
- information
- node
- state information
- target
- block chain
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computing Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Mathematical Physics (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
According to the information processing method and the big data platform applied to the block chains and the big data, the current local state information of each target block chain device and the current global state information of the block chain nodes can be determined according to the real-time state information and the change condition of the network topology of the block chain network monitored when the real-time state information is extracted, and therefore synchronization of the current local state information and the current global state information on the time sequence and the encryption logic is guaranteed.
Description
Technical Field
The present application relates to the field of information processing technologies for a block chain and big data, and in particular, to an information processing method and a big data platform applied to the block chain and the big data.
Background
The blockchain is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism and an encryption algorithm. Due to the characteristics of decentralization, non-tamper property and the like, the block chain technology can be applied to the fields of finance, internet of things, public services and the like.
Specifically, a block chain technology is applied in the field of the internet of things, and the block chain can realize comprehensive transmission of information in the whole network through a scattered network hierarchical structure connected by nodes, and can check the accuracy of the information.
However, since the internet of things system has distributed block chain nodes (internet of things nodes), how to perform global and systematic state monitoring on the block chain nodes is a technical problem to be solved at the present stage.
Disclosure of Invention
In order to solve the above technical problems in the related art, the present application provides an information processing method applied to a block chain and big data.
In a first aspect, an information processing method applied to a blockchain and big data is provided, where the method at least includes:
on the premise that the current occupation ratio of a target block chain node in an effective operation state is monitored to reach a target occupation ratio determined according to a historical state monitoring result corresponding to a block chain network, different recording information with a set number is selected from a preset information set; the record information comprises historical global state information and at least two pieces of historical local state information, and the historical local state information at least corresponds to a target block link node;
Generating and sending a memory resource occupation request to each target block link node according to the historical global state information and the historical local state information, and calling a clock resource in the target block link node to establish an extraction link of the state information when receiving confirmation information fed back by the target block link node based on the corresponding memory resource occupation request;
the real-time state information of each target block chain node is synchronously acquired through each extraction link, and the current local state information of each target block chain device and the current global state information of the block chain nodes are determined according to the real-time state information and the monitored change condition of the network topology of the block chain network when the real-time state information is extracted.
Optionally, determining current local state information of each target blockchain device and current global state information of the blockchain node according to the real-time state information and the monitored change condition of the network topology of the blockchain network when extracting the real-time state information includes:
according to the target state feature distribution of the real-time state information when the network topology has the update identification, obtaining a correlation coefficient of the real-time state information relative to each topology node in the network topology;
Identifying a node protocol list of each topological node in the network topology according to a network layer protocol configured by network structure parameters of the block chain network in advance; for each topological node in the network topology, selecting a protocol synchronization key from a node protocol list of the topological node according to a consistency identification result between the node protocol list of the topological node and a correlation coefficient corresponding to the topological node; for each protocol synchronous secret key, judging whether a target secret key matched with the protocol synchronous secret key exists in a stored secret key set, and if so, determining the protocol synchronous secret key as a current synchronous secret key of the network topology;
and determining the current local state information of each target block chain device based on the current synchronous secret key and the real-time state information, and integrating the current local state information based on the change of the synchronous coefficient of the current synchronous secret key when each piece of current local state information is determined to obtain the current global state information of the block chain node.
Optionally, the identifying a node protocol list of each topology node in the network topology according to a network layer protocol configured in advance through a network structure parameter of the blockchain network includes:
According to a network layer protocol configured by network structure parameters of the block chain network in advance, identifying protocol field distribution and a protocol authority queue of a node protocol list of each topological node in the network topology; acquiring list resource distribution information of each node protocol list according to the protocol field distribution of each node protocol list; the key set stores list resource distribution information and protocol authority queues of each target key; the determining whether a target key matched with the protocol synchronization key exists in the stored key set includes: and judging whether a target key matched with both the list resource distribution information of the protocol synchronous key and the protocol authority queue exists in the stored key set.
Optionally, before the determining whether a target key matching the protocol synchronization key exists in the saved key set, the method further includes: performing key decryption verification on all protocol synchronous keys in the network topology to obtain a result confidence coefficient of decryption verification results of each group of protocol synchronous keys and a confidence coefficient weight list belonging to the decryption verification results of each group of protocol synchronous keys; the determining whether a target key matched with the protocol synchronization key exists in the stored key set, and if yes, determining the protocol synchronization key as a current synchronization key of the network topology, including: and aiming at the decryption verification result of each group of protocol synchronous keys, judging whether a target key matched with the list resource distribution information of the result confidence coefficient and the protocol authority queue exists in the stored key set, and if so, weighting the protocol synchronous key corresponding to the result confidence coefficient according to a historical confidence coefficient distribution track corresponding to the target key and determining the protocol synchronous key as the current synchronous key of the network topology.
Optionally, obtaining a correlation coefficient of the real-time status information with respect to each topology node in the network topology according to a target status feature distribution of the real-time status information when the update identifier exists in the network topology, includes:
acquiring a state distribution area set in the target state feature distribution, and determining a first distribution area histogram corresponding to the state distribution area set, wherein the state distribution area set is obtained by identifying the target state feature distribution under a time sequence limiting condition by using a multi-dimensional feature model, and a distribution area boundary parameter corresponding to the state distribution area set is unchanged;
acquiring an initial node connection state of each topology node in the network topology, and calculating the matching degree between the state distribution area set and the initial node connection state according to the first distribution area histogram;
if the matching degree between the state distribution area set and the initial node connection state is smaller than a preset matching degree threshold value, mapping the real-time state information into the first distribution area histogram to obtain a second distribution area histogram; converting the real-time state information into a state curve, and carrying out multi-dimensional correlation calculation by taking the state curve as a target curve and the target state characteristic distribution as a reference to obtain a first correlation distribution diagram; correcting the first correlation distribution diagram according to the second distribution region histogram to obtain a second correlation distribution diagram, namely adding the consideration of the clustering centrality of the state distribution region set, and correcting the first correlation distribution diagram to obtain a correlation distribution diagram with high clustering centrality, namely the second correlation distribution diagram; determining a first correlation mapping list of the second correlation distribution graph and the state curve, and matching a list unit in the first correlation mapping list with each topological node in the network topology to obtain a correlation coefficient of each topological node in the network topology;
If the matching degree between the state distribution area set and the initial node connection state is greater than or equal to the matching degree threshold value, determining a second correlation mapping list of the first correlation distribution graph and the state curve, and matching a list unit in the second correlation mapping list with each topology node in the network topology to obtain a correlation coefficient of each topology node in the network topology.
Optionally, identifying a node protocol list of each topology node in the network topology according to a network layer protocol configured in advance by using the network structure parameter of the blockchain network includes:
determining message sequence information of a protocol message in the network layer protocol according to the network layer protocol; calculating and obtaining a message frame sequence of a protocol message in the network layer protocol by using preset message interface data, and obtaining a message frame format of each message frame sequence; the message frame format comprises a frame header format and a data information format;
according to the message frame format of each message frame sequence, calculating and obtaining the target format of the global sequence corresponding to each message frame sequence by using the global change factor of the network topology;
Respectively judging whether the first sequence continuity of each message frame sequence and the message sequence information is greater than the second sequence continuity of the corresponding global sequence and the message sequence information according to the target formats of each message frame sequence and the global sequence;
if yes, determining a format generation path corresponding to the target format of the global sequence corresponding to each message frame sequence as a path to be processed; if not, determining the format generation path of the data information format of each message frame sequence as a path to be processed;
and respectively carrying out node protocol identification on each topological node in the network topology based on the path to be processed to obtain a node protocol list of each topological node in the network topology.
Optionally, determining current local state information of each target blockchain device based on the current synchronization key and the real-time state information, and integrating the current local state information based on a change of a synchronization coefficient of the current synchronization key when each current local state information is determined to obtain current global state information of the blockchain node, where the method includes:
acquiring current equipment operation data of target block chain equipment based on the current synchronous secret key and the real-time state information; locating a state node from the current device operating data;
Judging whether the thread log parameters in the current equipment operation data are changed relative to the thread log parameters corresponding to the last operation duration of the current equipment operation data; if yes, determining the state node positioned from the current equipment operation data as an effective state node of the current equipment operation data; otherwise, performing cross validation on the state node located in the current device operating data and the valid state node at the corresponding position in the previous operating duration, where a cross validation result is determined to be the valid state node of the current device operating data, and the method specifically includes: acquiring whether the thread log parameter in the previous running time length is changed relative to the thread log parameter in the next previous running time length of the current equipment running data; if so, performing cross validation on the state node positioned in the current equipment operation data and the effective state node at the corresponding position in the last operation duration based on the authority validation data;
determining the current local state information of each target block chain device based on the effective state node of the current device operation data, acquiring a change rate curve of a synchronization coefficient of the current synchronization key when each current local state information is determined, performing mean calculation on the change rate curve to obtain a target curve, and integrating the current local state information by using the target curve to obtain the current global state information of the block chain node.
In a second aspect, a big data platform is provided, which includes an information processing apparatus, and a plurality of functional modules in the information processing apparatus implement the method when running.
In a third aspect, a big data platform is provided, comprising a processor and a memory, which are in communication with each other, the processor implementing the above method when running a computer program fetched from the memory.
A fourth aspect provides a computer-readable storage medium having stored thereon a computer program which, when executed, implements the method described above.
Based on the scheme, the first step is to select a set number of different record information from a preset information set when the current occupation ratio of the target block chain node in an effective operation state is monitored to reach the target occupation ratio.
And the second step is that a memory resource occupation request is generated and sent to each target block chain node according to historical global state information and historical local state information in the recorded information so as to call clock resources in the target block chain nodes to establish an extraction link of the state information.
And thirdly, synchronously acquiring the real-time state information of each target block chain node through each extraction link, and determining the current local state information of each target block chain device and the current global state information of the block chain nodes according to the real-time state information and the change condition of the network topology of the block chain network.
Therefore, the big data platform can be deployed at the cloud end of the block chain nodes, and memory resources distributed to the state monitoring part by the block chain nodes can be effectively reduced, so that global state and system state monitoring between the block chain nodes is realized through the big data platform, and the real-time performance and the accuracy of the current global state information and the current local state information are ensured.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
FIG. 1 is a schematic diagram of an information handling system applied to blockchains and big data according to the present application;
FIG. 2 is a flow diagram illustrating an information processing method applied to a blockchain and big data according to an exemplary embodiment;
FIG. 3 is a functional block diagram illustrating an information processing apparatus applied to a blockchain and big data according to an exemplary embodiment;
FIG. 4 is a diagram illustrating a hardware architecture of a big data platform, according to an example embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The inventor analyzes the technical problems existing in the background art and finds that if a state monitoring program is deployed for each block link point, on one hand, the working efficiency of the block chain nodes is reduced, and on the other hand, because the block chain nodes are independent from each other, the state monitoring program cannot realize data integration between the block chain nodes, so that the global and systematic state monitoring of the block link points cannot be realized.
In order to solve the above problem, embodiments of the present invention provide an information processing method and a big data platform applied to a block chain and big data, where the big data platform is deployed at a cloud of a plurality of block chain nodes, so that memory resources allocated to a state monitoring portion by the block chain nodes can be effectively reduced, and global and systematic state monitoring between block chain link points is realized through the big data platform.
To achieve the above objective, please first refer to fig. 1, which is a schematic diagram of a communication architecture of an information processing system 100 applied to a blockchain and big data, wherein the information processing system 100 may include a big data platform 110 and a plurality of blockchain nodes 120, which communicate with each other. In this embodiment, the block link point 120 may be an internet of things device.
The big data platform 110 can be applied to the field of block chain internet of things, smart medical treatment, smart industrial park, smart industrial internet, and the information processing system 100 can be applied to scenes such as big data, cloud computing, edge computing, and the like, including but not limited to new energy automobile system management, intelligent online office, intelligent online education, cloud game data processing, live e-commerce delivery processing, cloud internet of vehicles processing, block chain digital financial currency service, block chain supply chain financial service, and the like, and is not limited herein.
Further, on the basis of fig. 1, an information processing method applied to a block chain and big data is provided, and the method may be applied to the big data platform 110 in fig. 1, and specifically may include the contents described in the following steps S21 to S23.
Step S21, under the premise that the current occupation ratio of the target block chain node in the effective operation state is monitored to reach the target occupation ratio determined according to the historical state monitoring result corresponding to the block chain network, selecting a set number of different record information from a preset information set; the record information comprises historical global state information and at least two pieces of historical local state information, and the historical local state information at least corresponds to one target block chain node.
For example, the historical state monitoring result is used to represent a normal operation state or an abnormal operation state of the block chain node in a previous period, and the preset information set is used to record a state monitoring record corresponding to the historical state monitoring result.
Step S22, generating and sending a memory resource occupation request to each target block link node according to the historical global state information and the historical local state information, and calling a clock resource in the target block link node to establish an extraction link of the state information when receiving confirmation information fed back by the target block link node based on the corresponding memory resource occupation request.
For example, the memory resource occupation requests corresponding to different target block link points need different clock resources, the clock resources are used for providing processing rates for the target block link points, and the state information extraction speed of the extraction link is determined according to the resource quantity of the clock resources.
Step S23, synchronously acquiring real-time status information of each target blockchain node through each extraction link, and determining current local status information of each target blockchain device and current global status information of the blockchain node according to the real-time status information and the change condition of the network topology of the blockchain network monitored during the extraction of the real-time status information.
For example, the communication activity between the block chain nodes in the block chain network changes with time, the network topology of the corresponding block chain network is updated, and the real-time performance and the accuracy of the determined current local state information and the determined current global state information can be ensured by taking the clustering center of the network topology into consideration.
By applying the steps S21 to S23, the first step is to select a set number of different pieces of recorded information from a preset information set when it is monitored that the current occupancy of a target block link node in an effective operating state reaches a target occupancy, the second step is to generate and send a memory resource occupancy request to each target block link node according to historical global state information and historical local state information in the recorded information to call clock resources in the target block link node to establish an extraction link of state information, and the third step is to synchronously acquire real-time state information of each target block link node through each extraction link, and determine the current local state information of each target block link device and the current global state information of the block link node according to the real-time state information and the change condition of the network topology of the block link network. Therefore, the large data platform can be deployed at the cloud end of the plurality of block chain nodes, and memory resources distributed to the state monitoring part by the block chain nodes can be effectively reduced, so that monitoring of the global state and the system state among the block chain nodes is realized through the large data platform, and the real-time performance and the accuracy of the current global state information and the current local state information are ensured.
In practical applications, the inventor finds that when determining the current local state information and the current global state information, a technical problem that the current local state information and the current global state information are not synchronized may occur. Further, the inventors found that the cause of this technical problem is caused by inconsistency in correlation between network layer protocols. Therefore, in order to improve this technical problem, the determining of the current local state information of each target blockchain device and the current global state information of the blockchain node according to the real-time state information and the monitored change of the network topology of the blockchain network when the real-time state information is extracted, which is described in step S23, may exemplarily include the following steps S231 to S234.
Step S231, obtaining a correlation coefficient of the real-time status information with respect to each topology node in the network topology according to the target status feature distribution of the real-time status information when the network topology has the update identifier.
Step S232, identifying a node protocol list of each topological node in the network topology according to a network layer protocol configured in advance through the network structure parameters of the block chain network; for each topological node in the network topology, selecting a protocol synchronization key from a node protocol list of the topological node according to a consistency identification result between the node protocol list of the topological node and a correlation coefficient corresponding to the topological node; and for each protocol synchronous secret key, judging whether a target secret key matched with the protocol synchronous secret key exists in a stored secret key set, and if so, determining the protocol synchronous secret key as the current synchronous secret key of the network topology.
Step S233, determining current local state information of each target block chain device based on the current synchronization key and the real-time state information, and integrating the current local state information based on a change of a synchronization coefficient of the current synchronization key when determining each current local state information to obtain current global state information of the block chain node.
In this way, based on the contents described in the above steps S231 to S233, the current local state information and the current global state information can be ensured to be synchronized in terms of timing and encryption logic.
In a specific embodiment, in order to ensure the accuracy and integrity of the identified node protocol list, the identifying the node protocol list of each topology node in the network topology according to the network layer protocol configured in advance by the network structure parameters of the blockchain network, which is described in step S232, may further include the following steps: according to a network layer protocol configured by network structure parameters of the block chain network in advance, identifying protocol field distribution and a protocol authority queue of a node protocol list of each topological node in the network topology; acquiring list resource distribution information of each node protocol list according to the protocol field distribution of each node protocol list; the key set stores list resource allocation information and protocol authority queue of each target key. In this way, the accuracy and integrity of the identified node protocol list can be ensured.
Further, determining whether a target key matching the protocol synchronization key exists in the stored key set includes: and judging whether a target key matched with both the list resource distribution information of the protocol synchronous key and the protocol authority queue exists in the stored key set.
In a possible implementation manner, before the determining whether a target key matching the protocol synchronization key exists in the saved key set, the method further includes: and performing key decryption verification on all protocol synchronous keys in the network topology to obtain the result confidence of decryption verification results of each group of protocol synchronous keys and a confidence weight list of the decryption verification results belonging to each group of protocol synchronous keys.
Further, determining whether a target key matched with the protocol synchronization key exists in the stored key set, and if yes, determining the protocol synchronization key as the current synchronization key of the network topology, including: and aiming at the decryption verification result of each group of protocol synchronous keys, judging whether a target key matched with both the list resource distribution information of the result confidence coefficient and the protocol authority queue exists in the stored key set, and if so, weighting the protocol synchronous key corresponding to the result confidence coefficient according to a historical confidence coefficient distribution track corresponding to the target key and determining the protocol synchronous key as the current synchronous key of the network topology.
In this way, the real-time and reliability of the current synchronization key of the network topology can be ensured.
In a specific implementation process, in order to ensure accuracy of the correlation coefficient of each topology node in the network topology and avoid a deviation of the correlation coefficient, the correlation coefficient of the real-time status information with respect to each topology node in the network topology is obtained according to the target status feature distribution of the real-time status information when the update identifier exists in the network topology, which is described in step S231.
Step S2311, obtaining a state distribution area set in the target state feature distribution, and determining a first distribution area histogram corresponding to the state distribution area set, where the state distribution area set is obtained by identifying the target state feature distribution under a time sequence limiting condition with a multi-dimensional feature model, and a distribution area boundary parameter corresponding to the state distribution area set is unchanged.
Step S2312, obtaining an initial node connection state of each topology node in the network topology, and calculating a matching degree between the state distribution area set and the initial node connection state according to the first distribution area histogram.
Step S2313, if the matching degree between the state distribution region set and the initial node connection state is smaller than a preset matching degree threshold, mapping the real-time state information to the first distribution region histogram to obtain a second distribution region histogram; converting the real-time state information into a state curve, and carrying out multi-dimensional correlation calculation by taking the state curve as a target curve and the target state characteristic distribution as a reference to obtain a first correlation distribution diagram; correcting the first correlation distribution diagram according to the second distribution region histogram to obtain a second correlation distribution diagram, namely adding the consideration of the clustering centrality of the state distribution region set, and correcting the first correlation distribution diagram to obtain a correlation distribution diagram with high clustering centrality, namely the second correlation distribution diagram; and determining a first correlation mapping list of the second correlation distribution graph and the state curve, and matching a list unit in the first correlation mapping list with each topology node in the network topology to obtain a correlation coefficient of each topology node in the network topology.
Step S2314, if the matching degree between the state distribution area set and the initial node connection state is greater than or equal to the matching degree threshold, determining a second correlation mapping list of the first correlation distribution map and the state curve, and matching a list unit in the second correlation mapping list with each topology node in the network topology to obtain a correlation coefficient of each topology node in the network topology.
It can be understood that based on the steps S2311 to S2314, the accuracy of the correlation coefficient of each topology node in the network topology can be ensured, and the occurrence of deviation of the correlation coefficient can be avoided.
In an alternative embodiment, the protocol packet may be analyzed to determine a node protocol list of each topology node in the network topology, so as to ensure that the node protocol list cannot be tampered with based on the network layer protocol. In detail, the node protocol list identifying each topological node in the network topology according to the network layer protocol configured in advance by the network structure parameters of the blockchain network may include the contents described in the following steps a to e.
Step a, determining message sequence information of a protocol message in a network layer protocol according to the network layer protocol; calculating and obtaining a message frame sequence of a protocol message in the network layer protocol by using preset message interface data, and obtaining a message frame format of each message frame sequence; the message frame format comprises a frame header format and a data information format.
And b, calculating and obtaining the target format of the global sequence corresponding to each message frame sequence by using the global change factor of the network topology according to the message frame format of each message frame sequence.
And c, respectively judging whether the first sequence continuity of each message frame sequence and the message sequence information is greater than the second sequence continuity of the corresponding global sequence and the message sequence information according to the target formats of each message frame sequence and the global sequence.
Step d, if yes, determining a format generation path corresponding to the target format of the global sequence corresponding to each message frame sequence as a path to be processed; if not, determining the format generation path of the data information format of each message frame sequence as the path to be processed.
And e, respectively carrying out node protocol identification on each topological node in the network topology based on the path to be processed to obtain a node protocol list of each topological node in the network topology.
In one implementation, the determining, in step S233, the current local state information of each target blockchain device based on the current synchronization key and the real-time state information, and integrating the current local state information based on the change of the synchronization coefficient of the current synchronization key when determining each current local state information to obtain the current global state information of the blockchain node may specifically include the following steps S2331-S2333.
Step S2331, collecting current device operation data of the target block chain device based on the current synchronization key and the real-time status information; and locating the state node from the current equipment operation data.
Step S2332, judging whether the thread log parameter in the current equipment operation data is changed relative to the thread log parameter corresponding to the last operation time of the current equipment operation data; if so, determining the state node positioned from the current equipment operation data as an effective state node of the current equipment operation data; otherwise, performing cross validation on the state node located in the current device operating data and the valid state node at the corresponding position in the previous operating duration, and determining a cross validation result as the valid state node of the current device operating data, which specifically includes: acquiring whether the thread log parameter in the previous running time length is changed relative to the thread log parameter in the next previous running time length of the current equipment running data; if so, cross-verifying the state node positioned from the current equipment operation data and the effective state node at the corresponding position in the last operation duration based on the authority verification data.
Step S2333, determining current local state information of each target block link device based on the valid state node of the current device operation data, obtaining a change rate curve of a synchronization coefficient of the current synchronization key when each current local state information is determined, performing mean calculation on the change rate curve to obtain a target curve, and integrating the current local state information by using the target curve to obtain current global state information of the block link node.
When the contents described in the above-described step S2331 to step S2333 are applied, it is possible to ensure that the current local state information and the current global state information are synchronized in terms of timing and encryption logic.
In an alternative embodiment, in step S21, the target blockchain node of the active operation state may be obtained through the following steps S211 to S213.
Step S211, determining the operation identification of the block chain node to be monitored extracted based on the state monitoring thread; and aiming at the current identification in the operation identifications of the to-be-monitored block chain nodes, determining the state heat degree of the current identification in the preset monitoring time length based on the first switching frequency of the current identification in the preset monitoring time length and the second switching frequency of other identifications except the current identification in the operation identifications in the preset monitoring time length.
Step S212, determining a state heat weight of the current identifier between two adjacent preset monitoring durations according to the state heat of the current identifier within the two adjacent preset monitoring durations.
Step S213, judging whether the state heat weight is in a set heat interval; and when the state heat weight is positioned in the set heat interval, determining the block chain node to be monitored corresponding to the state heat weight as a target block chain node in an effective running state.
Therefore, the target block chain node in the effective operation state can be accurately determined.
In an alternative embodiment, in order to ensure the accuracy of the memory resource occupying request and avoid affecting the normal operation of the target blockchain node, the step S22 generates and sends the memory resource occupying request to each target blockchain node according to the historical global state information and the historical local state information, which may exemplarily include the following steps S2211 to S2214.
Step S2211, determining a state association path between the historical global state information and the historical local state information, and acquiring a first information set of the historical global state information and a second information set of the historical local state information.
Step S2212, when it is determined that a variable information tag exists in the first information set corresponding to the historical global state information and a static information tag exists in the second information set corresponding to the historical local state information according to the state association path, based on information association coefficients between each group of first target information in the first information set of the historical global state information and each group of second target information in the second information set of the historical local state information, respectively calculating a first tag level of each group of first target information in the first information set of the historical global state information and a second tag level of each group of second target information in the second information set of the historical local state information; and dividing the first target information and the second target information under the variable information label and the static information label respectively according to the first label grade and the second label grade.
Step S2213, determining the memory resource distribution information of each target block chain node based on the cluster matching rate between the third target information under the variable information tag and the fourth target information under the static information tag.
Step S2214, the system memory occupancy rate and the idle memory occupancy rate of each target block chain node are extracted from the memory resource distribution information of each target block chain node, and a memory resource occupancy request corresponding to each target block chain node is generated and sent according to the ratio between the system memory occupancy rate of each target block chain node and the idle memory occupancy rate of the target block chain node.
Therefore, the accuracy of the memory resource occupation request can be ensured through the contents described in the steps S2211 to S2214, and the influence on the normal operation of the target block link node is avoided.
Further, in step S22, the extracting link for establishing the clock resource state information in the target block link node is called, which may specifically include the contents described in the following step S2221 and step S2222.
Step S2221, call a clock resource in the target block chain node and determine resource frequency band information of the clock resource.
Step S2222, an extraction link of the state information is established according to the resource frequency band information.
Further, the step of synchronously acquiring the real-time status information of each target blockchain node through each extraction link described in step S23 specifically includes: and determining the information extraction delay of each extraction link, and synchronously adjusting each extraction link according to the information extraction delay to acquire the real-time state information of each target block link node.
The various technical features in the above embodiments can be arbitrarily combined, so long as there is no conflict or contradiction between the combinations of the features, but the combination is limited by the space and is not described one by one, and therefore, any combination of the various technical features in the above embodiments also belongs to the scope disclosed in the present specification.
Based on the same inventive concept, there is also provided an information processing apparatus 300 as shown in fig. 3, which is applied to a blockchain and big data, and the apparatus can be applied to the big data platform 110 shown in fig. 1, the apparatus at least comprising:
an information selecting module 310, configured to select a set number of different pieces of recorded information from a preset information set on the premise that a current occupancy of a target blockchain node in an effective operating state is monitored to reach a target occupancy determined according to a historical state monitoring result corresponding to a blockchain network; the record information comprises historical global state information and at least two pieces of historical local state information, and the historical local state information at least corresponds to a target block chain node;
a link establishing module 320, configured to generate and send a memory resource occupation request to each target block link node according to the historical global state information and the historical local state information, and when receiving confirmation information fed back by the target block link node based on the corresponding memory resource occupation request, call a clock resource in the target block link node to establish an extraction link of the state information;
The state determining module 330 is configured to synchronously acquire real-time state information of each target blockchain node through each extraction link, and determine current local state information of each target blockchain device and current global state information of the blockchain node according to the real-time state information and a change condition of the network topology of the blockchain network monitored during extraction of the real-time state information.
For the description of the functional modules, reference is made to the description of the method shown in fig. 2, and no further description is made here.
Based on the same inventive concept, the invention also provides an information processing system applied to the block chain and the big data, which comprises a big data platform and a plurality of block chain nodes, wherein the big data platform and the plurality of block chain nodes are communicated with each other; wherein the big data platform is configured to:
on the premise that the current occupation ratio of a target block chain node in an effective operation state is monitored to reach the target occupation ratio determined according to a historical state monitoring result corresponding to a block chain network, different record information with a set number is selected from a preset information set; the record information comprises historical global state information and at least two pieces of historical local state information, and the historical local state information at least corresponds to a target block chain node;
Generating and sending a memory resource occupation request to each target block chain node according to the historical global state information and the historical local state information, and calling a clock resource in the target block chain node to establish an extraction link of the state information when receiving confirmation information fed back by the target block chain node based on the corresponding memory resource occupation request;
the method comprises the steps of synchronously acquiring real-time state information of each target block chain node through each extraction link, and determining current local state information of each target block chain device and current global state information of the block chain node according to the real-time state information and the change condition of the network topology of the block chain network monitored during extraction of the real-time state information.
On the basis of the above, please refer to fig. 4 in combination, a big data platform 110 is provided, which includes a processor 111 and a memory 112 that are in communication with each other, and when the processor 111 runs a computer program called from the memory 112, the method shown in fig. 2 is implemented.
Further, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when executed, implements the method as shown in fig. 2.
In summary, the technical solution provided by the embodiment of the present invention can deploy the big data platform at the cloud of the plurality of block chain nodes, and can effectively reduce the memory resources allocated to the state monitoring portion by the block chain nodes, thereby realizing global and system state monitoring between the block chain nodes through the big data platform, and ensuring the real-time performance and accuracy of the current global state information and the current local state information.
It will be understood that the invention is not limited to the precise arrangements that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
Claims (4)
1. An information processing method applied to block chains and big data, the method at least comprising:
according to the target state feature distribution of real-time state information when an update identifier exists in the network topology, obtaining a correlation coefficient of the real-time state information relative to each topology node in the network topology;
identifying a node protocol list of each topological node in the network topology according to a network layer protocol configured by network structure parameters of a block chain network in advance; for each topological node in the network topology, selecting a protocol synchronization key from a node protocol list of the topological node according to a consistency identification result between the node protocol list of the topological node and a correlation coefficient corresponding to the topological node; for each protocol synchronous secret key, judging whether a target secret key matched with the protocol synchronous secret key exists in a stored secret key set, and if so, determining the protocol synchronous secret key as a current synchronous secret key of the network topology;
Determining current local state information of each target block chain device based on the current synchronous secret key and the real-time state information, and integrating the current local state information based on the change of a synchronous coefficient of the current synchronous secret key when each current local state information is determined to obtain current global state information of the block chain node;
before the step of obtaining a correlation coefficient of real-time status information with respect to each topology node in the network topology according to target status feature distribution of the real-time status information when an update identifier exists in the network topology, the method further includes:
synchronously acquiring real-time state information of each target block link node through each extraction link;
wherein, prior to the step of synchronously obtaining real-time status information for each target blockchain node through each extraction link, the method further comprises:
on the premise that the current occupation ratio of a target block chain node in an effective operation state is monitored to reach a target occupation ratio determined according to a historical state monitoring result corresponding to a block chain network, different recording information with a set number is selected from a preset information set; the record information comprises historical global state information and at least two pieces of historical local state information, and the historical local state information at least corresponds to a target block link node;
Generating and sending a memory resource occupation request to each target block link node according to the historical global state information and the historical local state information, and calling a clock resource in the target block link node to establish an extraction link of the state information when receiving confirmation information fed back by the target block link node based on the corresponding memory resource occupation request;
the target block chain node in the effective operation state is obtained through the following steps:
determining the operation identification of the block chain node to be monitored extracted based on the state monitoring thread; aiming at a current identifier in the running identifiers of the block chain nodes to be monitored, determining the state heat of the current identifier in a preset monitoring time length based on a first switching frequency of the current identifier in the preset monitoring time length and a second switching frequency of other identifiers except the current identifier in the running identifiers in the preset monitoring time length;
determining the state heat weight of the current identifier between two adjacent preset monitoring durations according to the state heat of the current identifier in the two adjacent preset monitoring durations;
judging whether the state heat weight is in a set heat interval or not; and when the state heat weight is positioned in the set heat interval, determining the block chain node to be monitored corresponding to the state heat weight as a target block chain node in an effective running state.
2. The method according to claim 1, wherein generating and sending a memory resource occupation request to each target blockchain node according to the historical global state information and the historical local state information comprises:
determining a state association path between the historical global state information and the historical local state information, and acquiring a first information set of the historical global state information and a second information set of the historical local state information;
when it is determined that a variable information tag exists in a first information set corresponding to the historical global state information and a static information tag exists in a second information set corresponding to the historical local state information according to the state association path, respectively calculating a first tag grade of each group of first target information in the first information set of the historical global state information and a second tag grade of each group of second target information in the second information set of the historical local state information based on an information association coefficient between each group of first target information in the first information set of the historical global state information and each group of second target information in the second information set of the historical local state information; dividing the first target information and the second target information under the variable information label and the static information label respectively according to the first label grade and the second label grade;
Determining the memory resource distribution information of each target block chain node based on the cluster matching rate between the third target information under the variable information label and the fourth target information under the static information label;
extracting the system memory occupancy rate and the idle memory occupancy rate of each target block chain node from the memory resource distribution information of each target block chain node, and generating and sending a memory resource occupancy request corresponding to each target block chain node according to the ratio of the system memory occupancy rate of each target block chain node to the idle memory occupancy rate of the target block chain node.
3. A big data platform comprising a processor and a memory in communication with each other, the processor implementing the method of claim 1 or 2 when running a computer program fetched from the memory.
4. A computer-readable storage medium, on which a computer program is stored which, when executed, implements the method of claim 1 or 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110619368.6A CN113282462B (en) | 2020-08-28 | 2020-08-28 | Information processing method applied to block chain and big data platform |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010889106.7A CN111930598B (en) | 2020-08-28 | 2020-08-28 | Information processing method based on block chain and big data analysis and big data platform |
| CN202110619368.6A CN113282462B (en) | 2020-08-28 | 2020-08-28 | Information processing method applied to block chain and big data platform |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010889106.7A Division CN111930598B (en) | 2020-08-28 | 2020-08-28 | Information processing method based on block chain and big data analysis and big data platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113282462A CN113282462A (en) | 2021-08-20 |
| CN113282462B true CN113282462B (en) | 2022-06-28 |
Family
ID=73308401
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010889106.7A Active CN111930598B (en) | 2020-08-28 | 2020-08-28 | Information processing method based on block chain and big data analysis and big data platform |
| CN202110619368.6A Active CN113282462B (en) | 2020-08-28 | 2020-08-28 | Information processing method applied to block chain and big data platform |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010889106.7A Active CN111930598B (en) | 2020-08-28 | 2020-08-28 | Information processing method based on block chain and big data analysis and big data platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN111930598B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113704272B (en) * | 2021-10-25 | 2022-01-18 | 北京大学 | Digital object state expression method and device under man-machine-object fusion environment |
| CN114095746B (en) * | 2021-11-22 | 2023-10-27 | 广州华云数据服务有限公司 | Live order data processing and storing system based on block chain |
| CN114531651B (en) * | 2022-04-24 | 2022-08-16 | 华南理工大学 | Multi-agent wireless network dynamic networking method based on UWB technology |
| CN115601034B (en) * | 2022-09-30 | 2023-05-12 | 北京交通大学 | Attack detection method for decentralised finance |
| CN117134998B (en) * | 2023-10-26 | 2024-03-19 | 国网冀北电力有限公司 | SDN-based power information authentication method of Gossip blockchain |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106506203A (en) * | 2016-10-25 | 2017-03-15 | 杭州云象网络技术有限公司 | A kind of monitoring nodes system for being applied to block chain |
| CN109150972A (en) * | 2018-07-17 | 2019-01-04 | 湖南宸瀚信息科技有限责任公司 | A kind of the common recognition mechanism and its working method of the efficient block chain of bilayer fragment |
| US10200197B1 (en) * | 2017-12-18 | 2019-02-05 | Nec Corporation | Scalable crash fault-tolerance consensus protocol with efficient message aggregation |
| CN110138596A (en) * | 2019-04-13 | 2019-08-16 | 山东公链信息科技有限公司 | A kind of block chain common recognition method based on handover network topology mode |
| CN110268691A (en) * | 2017-02-07 | 2019-09-20 | 微软技术许可有限责任公司 | Alliance's block chain network with verified block chain and common recognition agreement |
| CN110445657A (en) * | 2019-08-15 | 2019-11-12 | 北京计算机技术及应用研究所 | A kind of distributed group network management system based on block chain |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106951185B (en) * | 2017-03-01 | 2019-12-06 | 武汉爱宁智慧科技有限公司 | health detection data management system and method based on block chain technology |
| CN107317730B (en) * | 2017-08-21 | 2020-09-04 | 上海点融信息科技有限责任公司 | Method, equipment and system for monitoring state of block chain node |
| CN107943580A (en) * | 2017-11-13 | 2018-04-20 | 上海点融信息科技有限责任公司 | For managing the method and equipment of user's intelligence contract at block chain link point |
| CN109408319B (en) * | 2018-08-30 | 2020-09-29 | 中国地质大学（武汉） | Software running technology state monitoring method based on block chain |
| CN109639751B (en) * | 2018-10-16 | 2021-12-21 | 平安科技（深圳）有限公司 | Block chain link point monitoring method, device and system and computer storage medium |
| CN109376275A (en) * | 2018-10-29 | 2019-02-22 | 上海点融信息科技有限责任公司 | For monitoring the method, apparatus and medium of the operational indicator on block chain |
| CN110618838A (en) * | 2019-08-29 | 2019-12-27 | 象翌微链科技发展有限公司 | Configuration method based on block chain service platform |
| CN110752969B (en) * | 2019-10-21 | 2021-03-16 | 腾讯科技（深圳）有限公司 | Performance detection method, device, equipment and medium |
| US11637687B2 (en) * | 2019-12-20 | 2023-04-25 | Intel Corporation | Methods and apparatus to determine provenance for data supply chains |
-
2020
- 2020-08-28 CN CN202010889106.7A patent/CN111930598B/en active Active
- 2020-08-28 CN CN202110619368.6A patent/CN113282462B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106506203A (en) * | 2016-10-25 | 2017-03-15 | 杭州云象网络技术有限公司 | A kind of monitoring nodes system for being applied to block chain |
| CN110268691A (en) * | 2017-02-07 | 2019-09-20 | 微软技术许可有限责任公司 | Alliance's block chain network with verified block chain and common recognition agreement |
| CN110300973A (en) * | 2017-02-07 | 2019-10-01 | 微软技术许可有限责任公司 | The foundation of alliance's block chain network |
| US10200197B1 (en) * | 2017-12-18 | 2019-02-05 | Nec Corporation | Scalable crash fault-tolerance consensus protocol with efficient message aggregation |
| CN109150972A (en) * | 2018-07-17 | 2019-01-04 | 湖南宸瀚信息科技有限责任公司 | A kind of the common recognition mechanism and its working method of the efficient block chain of bilayer fragment |
| CN110138596A (en) * | 2019-04-13 | 2019-08-16 | 山东公链信息科技有限公司 | A kind of block chain common recognition method based on handover network topology mode |
| CN110445657A (en) * | 2019-08-15 | 2019-11-12 | 北京计算机技术及应用研究所 | A kind of distributed group network management system based on block chain |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113282462A (en) | 2021-08-20 |
| CN111930598B (en) | 2021-11-02 |
| CN111930598A (en) | 2020-11-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113282462B (en) | Information processing method applied to block chain and big data platform | |
| CN110933072B (en) | Data transmission method and device based on block chain and electronic equipment | |
| CN111625593B (en) | Block chain-based data processing method and device and computer equipment | |
| CN113347164B (en) | Block chain-based distributed consensus system, method, device and storage medium | |
| CN111949672B (en) | Block chain storage method for supporting incremental update of Internet-of-things data | |
| EP4300323A1 (en) | Data processing method and apparatus for blockchain network, computer device, computer readable storage medium, and computer program product | |
| CN112714192B (en) | Data synchronization method and device, computer readable medium and electronic equipment | |
| CN111726414B (en) | Vehicle reporting data processing method and vehicle data reporting system | |
| CN105991412A (en) | Method and device for pushing message | |
| CN111641563B (en) | Flow self-adaption method and system based on distributed scene | |
| CN111262726A (en) | Configuration information updating method and device and computer readable storage medium | |
| CN111447234A (en) | Block chain structure suitable for edge calculation | |
| CN111654538B (en) | Communication processing method based on block chain and big data and cloud side computing server | |
| CN115379581A (en) | Method, system, equipment and storage medium for unloading edge cloud server traffic | |
| CN111866181B (en) | Block chain-based task unloading optimization method in fog network | |
| CN116886309A (en) | Slice security mapping method and system for intelligent identification network | |
| CN114422227B (en) | Data acquisition and analysis system based on network security | |
| CN105429795A (en) | Alarm monitoring system and method | |
| CN111510484B (en) | Block chain processing method, system, device, computer equipment and storage medium | |
| CN115987858A (en) | Pressure testing method of block chain network and related equipment | |
| CN109657447B (en) | Equipment fingerprint generation method and device | |
| CN115221125A (en) | File processing method and device, electronic equipment and readable storage medium | |
| CN112395647A (en) | Block chain light node data acquisition system | |
| CN112434341A (en) | Block chain light node data acquisition method and device for preventing service tampering | |
| CN116627619B (en) | Cloud edge end cooperative information interaction method and system for multi-service heterogeneous resource scheduling |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220610 Address after: 518000 1101, building 2, aerospace building, No. 53, Gaoxin South ninth Road, Gaoxin community, Yuehai street, Nanshan District, Shenzhen, Guangdong Applicant after: Shenzhen jinmaili Media Technology Co.,Ltd. Address before: 157000 No. 90, xidazhi street, Nangang District, Harbin City, Heilongjiang Province Applicant before: Xu Dongjun |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |