CN110225095B - Data processing method, device and system - Google Patents

Data processing method, device and system Download PDF

Info

Publication number
CN110225095B
CN110225095B CN201910417662.1A CN201910417662A CN110225095B CN 110225095 B CN110225095 B CN 110225095B CN 201910417662 A CN201910417662 A CN 201910417662A CN 110225095 B CN110225095 B CN 110225095B
Authority
CN
China
Prior art keywords
side chain
block
field information
service
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910417662.1A
Other languages
Chinese (zh)
Other versions
CN110225095A (en
Inventor
沈思铭
邓小兵
李熳
虞雅丽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bank of China Ltd
Original Assignee
Bank of China Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bank of China Ltd filed Critical Bank of China Ltd
Priority to CN201910417662.1A priority Critical patent/CN110225095B/en
Publication of CN110225095A publication Critical patent/CN110225095A/en
Application granted granted Critical
Publication of CN110225095B publication Critical patent/CN110225095B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/14Network analysis or design
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/16Threshold monitoring
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/104Peer-to-peer [P2P] networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/60Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/06Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols the encryption apparatus using shift registers or memories for block-wise or stream coding, e.g. DES systems or RC4; Hash functions; Pseudorandom sequence generators
    • H04L9/0643Hash functions, e.g. MD5, SHA, HMAC or f9 MAC

Abstract

The embodiment of the specification discloses a data processing method, a device and a system, wherein the method comprises the steps of obtaining a side chain block to be analyzed in a side chain, wherein the data of the side chain block to be analyzed comprises service field information and father node field information; calling the business data corresponding to the side chain block to be analyzed from a business system database according to the business field information, and comparing the similarity between the business data and the business data corresponding to each side chain father node block; if the similarity meets the requirement of a preset threshold, determining the field information of the father node of the side chain block to be analyzed according to the service field information of the side chain father node block of which the similarity meets the requirement of the preset threshold; if the side chain block to be analyzed is determined to be a side chain father node block, uploading the service field information of the side chain block to be analyzed to a main chain; and the main chain receives the service field information uploaded by the side chain and generates a main chain block corresponding to the service field information.

Description

Data processing method, device and system
Technical Field
The present invention relates to the field of computer data processing technologies, and in particular, to a data processing method, device and system.
Background
In a financial institution, a plurality of different business departments exist, the different business departments have business systems which belong to the jurisdiction of the business departments, and the business systems have huge data. In recent years, the management of internal information data by financial institutions such as banks becomes more and more refined, and the data unification and management become very complicated due to huge and complex system relationships and data relationships.
For an organization, business system data managed by different departments is also a valuable resource for the organization, competition relationships may exist among the departments, and data windows of all the business departments are kept secret for other departments. However, different service systems are managed by different service personnel, and different systems have the possibility that two sets of different service information exist for the same service, so that the data management in the mechanism is seriously influenced. Therefore, how to realize effective treatment of internal data of the organization becomes a technical problem to be solved urgently.
Disclosure of Invention
An object of the embodiments of the present specification is to provide a data processing method, device, and system, which can implement effective management of an organization on overall service data.
The specification provides a data processing method, a device and a system, which are realized by the following modes:
a method of data processing, comprising:
acquiring a side chain block to be analyzed in a side chain, wherein the data of the side chain block to be analyzed comprises service field information and father node field information;
calling the business data corresponding to the side chain block to be analyzed from a business system database according to the business field information, and comparing the similarity between the business data and the business data corresponding to each side chain father node block;
if the similarity meets the requirement of a preset threshold, determining the field information of the father node of the side chain block to be analyzed according to the service field information of the side chain father node block of which the similarity meets the requirement of the preset threshold;
if the side chain block to be analyzed is determined to be a side chain father node block, uploading the service field information of the side chain block to be analyzed to a main chain;
and the main chain receives the service field information uploaded by the side chain and generates a main chain block corresponding to the service field information.
In another aspect, this specification further provides a data processing method, including:
acquiring a side chain block to be analyzed, wherein the side chain block data to be analyzed comprises service field information and father node field information;
calling the business data corresponding to the side chain block to be analyzed from a business system database according to the business field information of the side chain block to be analyzed, and comparing the similarity between the business data and the business data corresponding to each side chain father node block;
and determining the parent node field information of the side chain block to be analyzed according to the service field information of the side chain parent node block with the similarity meeting the preset threshold requirement.
In another embodiment of the method provided in this specification, the method further comprises:
and if the similarity does not meet the requirement of a preset threshold and the side chain block to be analyzed is determined to be a side chain father node block, uploading the service field information of the side chain block to be analyzed to a main chain.
In another embodiment of the method provided in this specification, the determining parent node field information of the side-chain block to be analyzed includes:
and determining the business field information and the hash value of the side chain father node block with the similarity meeting the preset threshold requirement as the father node field information of the side chain block to be analyzed.
In another embodiment of the method provided in the present specification, the obtaining a side chain block to be analyzed includes:
and determining the side chain blocks to be analyzed according to the identifiers of the side chain blocks, wherein the identifiers are used for identifying the matching states of the corresponding side chain blocks.
In another embodiment of the method provided in this specification, the method further comprises:
and constructing and acquiring a service index knowledge graph according to the parent node field information of each side chain block, wherein the service index is used for identifying the corresponding side chain block.
In another aspect, the present specification also provides a data processing apparatus comprising:
the data acquisition module is used for acquiring a side chain block to be analyzed, and the data of the side chain block to be analyzed comprises service field information and father node field information;
the first data calling module is used for calling the business data corresponding to the side chain block to be analyzed from a business system database according to the business field information of the side chain block to be analyzed;
the first data comparison module is used for comparing the similarity between the business data and the business data corresponding to each side chain father node block;
and the first father node determining module is used for determining the father node field information of the side chain block to be analyzed according to the service field information of the side chain father node block with the similarity meeting the preset threshold requirement.
In another embodiment of the apparatus provided in this specification, the apparatus further comprises:
and the data synchronization module is used for uploading the service field information of the side chain block to be analyzed to the main chain if the similarity does not meet the requirement of a preset threshold and the side chain block to be analyzed is determined to be a side chain father node block.
In another aspect, the present specification also provides a data processing apparatus comprising a processor and a memory for storing processor-executable instructions, which when executed by the processor, implement steps comprising:
acquiring a side chain block to be analyzed, wherein the side chain block data to be analyzed comprises service field information and father node field information;
calling the business data corresponding to the side chain block to be analyzed from a business system database according to the business field information of the side chain block to be analyzed, and comparing the similarity between the business data and the business data corresponding to each side chain father node block;
and determining the parent node field information of the side chain block to be analyzed according to the service field information of the side chain parent node block with the similarity meeting the preset threshold requirement.
In another aspect, this specification further provides a data processing method, including:
receiving service field information uploaded by a side chain, and generating a main chain block corresponding to the service field information;
calling the business data corresponding to the main chain block from a business system database according to the business field information, and comparing the similarity between the business data and the business data corresponding to each main chain father node block;
and determining the parent node field information of the main chain block according to the service field information of the main chain parent node block with the similarity meeting the preset threshold requirement.
In another embodiment of the method provided in this specification, the method further comprises:
if the similarity does not meet the requirement of a preset threshold value, acquiring the service index of the main chain block, and judging whether the service index corresponds to other main chain blocks;
and if so, performing consistency check processing on the other main chain blocks corresponding to the service indexes and the service data of the main chain blocks, and sending a modification instruction to a side chain needing service data modification according to the check processing result.
In another aspect, the present specification also provides a data processing apparatus comprising:
the data receiving module is used for receiving the service field information uploaded by the side chain and generating a main chain block corresponding to the service field information;
the second data calling module is used for calling the business data corresponding to the main chain block from a business system database according to the business field information;
the second data comparison module is used for comparing the similarity between the business data and the business data corresponding to each main chain father node block;
and the second father node determining module is used for determining the father node field information of the main chain block according to the service field information of the main chain father node block with the similarity meeting the preset threshold requirement.
In another embodiment of the apparatus provided in this specification, the apparatus further comprises:
the judging module is used for acquiring the service index of the main chain block if the similarity does not meet the requirement of a preset threshold value, and judging whether the service index corresponds to other main chain blocks;
the checking processing module is used for checking the consistency of the business data of the other main chain blocks corresponding to the business indexes and the main chain blocks if the judgment result is yes;
and the instruction sending module is used for sending a modification instruction to the side chain needing service data modification according to the checking processing result.
In another aspect, the present specification also provides a data processing apparatus comprising a processor and a memory for storing processor-executable instructions, which when executed by the processor, implement steps comprising:
receiving service field information uploaded by a side chain, and generating a main chain block corresponding to the service field information;
calling the business data corresponding to the main chain block from a business system database according to the business field information, and comparing the similarity between the business data and the business data corresponding to each main chain father node block;
and determining the parent node field information of the main chain block according to the service field information of the main chain parent node block with the similarity meeting the preset threshold requirement.
In another aspect, the present specification also provides a data processing system comprising at least one processor and a memory storing computer-executable instructions, which when executed by the processor, implement the steps of the method according to any one of the above embodiments.
In another aspect, the present specification further provides a data processing system, where the system includes a main chain, a plurality of side chains connected to the main chain, and a service system database, where data in each block of the main chain and the side chains includes service field information and parent node field information, and the service system database is used to store service data corresponding to each block, where,
the service field information of each side chain block in the side chain is determined according to the corresponding service data, and the father node field information is the service field information of the side chain father node block corresponding to the corresponding side chain block;
the service field information of each main chain block in the main chain is the service field information of a side chain father node block in each side chain, and the father node field information is the service field information of the main chain father node block corresponding to the corresponding main chain block.
In another embodiment of the system provided in this specification, the main chain includes a first information query module, a first information modification module, a relationship analysis module, a first intelligent analysis module, a first user management module, a first knowledge graph presentation module, a first interface management module, a first key management module, and a first storage module,
the first information query module is used for querying data of a main chain block corresponding to the service index;
the first information modification module is used for adding a main chain block when the main chain receives the data of the side chain father node block uploaded by the side chain;
the relation analysis module is used for determining a unique service index corresponding to the repeated service field information and system information of the repeated service index;
the first intelligent analysis module is used for analyzing and comparing service field information among the main chain blocks to determine a parent-child node relationship among the main chain blocks;
the first user management module is used for managing the relation between each side chain connected with the main chain;
the first knowledge graph display module is used for displaying a business index relation structure diagram in a main chain;
the first interface management module is used for managing an information interaction interface between the main chain and the side chain;
the first key management module is used for encrypting and decrypting data transmission;
the first storage module is used for storing data in the main chain block.
In another embodiment of the system provided in the present specification, the side chain includes a second information query module, a second information modification module, a second intelligent analysis module, a second user management module, a second knowledge graph presentation module, a data retrieval module, a second interface management module, a second key management module, and a second storage module, wherein,
the second information query module is used for querying data of the side chain block corresponding to the service index;
the second information modification module is used for newly adding a side chain block when a service index is newly added;
the second intelligent analysis module is used for analyzing and comparing service field information among the side chain blocks to determine a parent-child node relationship among the side chain blocks;
the second user management module is used for managing the authority of the user corresponding to the side chain;
the second knowledge graph display module is used for displaying a business index relation structure diagram in the side chain;
the data calling module is used for calling the service data corresponding to the corresponding side chain block from the service system database according to the service field information of the side chain block;
the second interface management module is used for uploading data to the main chain and receiving information fed back by the main chain;
the second key management module is used for encrypting and decrypting data transmission;
the second storage module is used for storing data in the side chain block.
The data processing method, the data processing device, and the data processing system provided in one or more embodiments of the present specification can implement effective management of service data by laying a service management system based on a block chain technology on the basis of an existing database storage system. Each business department can carry out maintenance treatment on the business data of the department through the side chain of the block chain so as to realize unified treatment on the internal data of the department. The upper-layer mechanism can link each side chain through the main chain of the block chain so as to realize the synchronization and the treatment of the data of each department of business. Therefore, the effective management of the whole business data by the organization can be realized on the basis of ensuring the management and transformation cost of the organization data.
Drawings
In order to more clearly illustrate the embodiments of the present specification or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments described in the present specification, and for those skilled in the art, other drawings can be obtained according to the drawings without any creative effort. In the drawings:
FIG. 1 is a schematic flow chart diagram illustrating an embodiment of a data processing method provided herein;
FIG. 2 is a schematic flow chart diagram illustrating another embodiment of a data processing method provided herein;
FIG. 3 is a schematic flow chart diagram illustrating another embodiment of a data processing method provided herein;
FIG. 4 is a schematic flow chart diagram illustrating another embodiment of a data processing method provided herein;
FIG. 5 is a schematic flow chart diagram illustrating another embodiment of a data processing method provided herein;
FIG. 6 is a block diagram of an embodiment of a data processing apparatus;
FIG. 7 is a block diagram of another embodiment of a data processing apparatus;
FIG. 8 is a schematic block diagram of a server in accordance with an exemplary embodiment of the present description;
FIG. 9 is a block diagram illustrating an embodiment of a data processing system that is provided herein;
FIG. 10 is a schematic representation of the backbone structure in one embodiment provided herein;
FIG. 11 is a schematic side chain structure in one embodiment provided herein.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in the present specification, the technical solutions in one or more embodiments of the present specification will be clearly and completely described below with reference to the drawings in one or more embodiments of the present specification, and it is obvious that the described embodiments are only a part of the embodiments of the specification, and not all embodiments. All other embodiments obtained by a person skilled in the art based on one or more embodiments of the present specification without making any creative effort shall fall within the protection scope of the embodiments of the present specification.
For an organization, business system data managed by different departments is generally kept secret from other departments. However, different service systems are managed by different service personnel, and different systems have the possibility that two sets of different service information exist for the same service, so that the data management in the mechanism is seriously influenced.
Correspondingly, the embodiments of the present specification provide a data processing method to implement that an organization effectively governs complex business data. Before the embodiments of the present disclosure are explained in detail, a brief description is given to the system architecture and the application scenario of the embodiments of the present disclosure. The embodiment of the specification implements effective management of the business data of the organization on the basis of the characteristics of information synchronization and untrustworthy property in the block chain by managing the business data stored in the existing database of the organization by using the block chain technology.
Each department or branch of the organization carries out maintenance treatment on the business data of the department or branch through the side chain of the block chain, so that unified treatment on the internal data of the department or branch is realized at first. And then, the upper-layer mechanism links the side chains of all departments through the main chains of the block chains so as to realize the synchronization and the treatment of the data of all departments. Meanwhile, the main chain can also set corresponding authority management, and each department can also share part of service data among the departments through the main chain while ensuring the confidentiality of the internal data of each department.
Meanwhile, the data governance framework provided by the embodiment of the present specification is based on the existing database of the organization, the specific service data is still stored in the existing database, and the service fields for managing the specific service data can be stored in the main chain and the side chain. By using the data management architecture provided by the embodiment of the specification, the simplicity of data management architecture deployment in actual operation can be improved, and the requirement on block chain data storage can be reduced.
Fig. 1 is a schematic diagram of an embodiment of the data processing method provided in this specification. Although the present specification provides the method steps or apparatus structures as shown in the following examples or figures, more or less steps or modules may be included in the method or apparatus structures based on conventional or non-inventive efforts. In the case of steps or structures which do not logically have the necessary cause and effect relationship, the execution order of the steps or the block structure of the apparatus is not limited to the execution order or the block structure shown in the embodiments or the drawings of the present specification. When the described method or module structure is applied to a device, a server or an end product in practice, the method or module structure according to the embodiment or the figures may be executed sequentially or in parallel (for example, in a parallel processor or multi-thread processing environment, or even in an implementation environment including distributed processing and server clustering).
In a specific embodiment of the data processing method provided in this specification, as shown in fig. 1, the method may include:
s102: and acquiring a side chain block to be analyzed in the side chain, wherein the data of the side chain block to be analyzed comprises service field information and father node field information.
Each side chain can correspond to each business department or branch organization of the organization according to preset requirements, and is used for internal data management of each department or branch structure. The main chain can correspond to the upper mechanism and is used for the upper mechanism to carry out overall management on data of each subordinate business department or branch institution. The data in each block in the main chain and each side chain can be a business field for representing the storage position, the affiliated department and the like of the actual business data so as to realize effective treatment on the actual business data.
The organization specific business data may be stored in the organization's business system database. The subordinate departments of the organization can respectively correspond to own business system databases and are used for storing specific business data in the departments. The upper-layer mechanism and each department subordinate to the upper-layer mechanism can respectively inquire concrete business data in the business system database through the business fields of the blocks in the main chain or the side chain.
In some embodiments, the data in each tile of the main chain and side chains may include traffic field information and parent node field information. The service field information is determined according to the storage position, the affiliated department and the like of specific service data corresponding to the block, and the father node field information can be determined according to the service field information of the father node block to which the block belongs. The data in the block is actually recorded on the block from generation to extinction.
The block data storage format of the main chain and the side chain may be preset, for example, the data storage format given in table 1 may be used. Corresponding to table 1, the service field information of each block may include an organization name, a department name corresponding to the block, a system name storing specific service data, a data table name, a field name corresponding to the specific service data, a field chinese description, and the like. The specific service data corresponding to the service field information can be determined through the service field information, so that the representation and management of the specific data in the service system database by using the service field information in the block are realized.
The parent field information of each block may include whether there is a parent, a parent hash value, a parent department name, a parent system name, a parent data table name, a parent field name, etc. Accordingly, the parent node field information may be determined according to the traffic field information of the parent node block to which the block belongs. For example, the department name, system name, data table name, and field name of the parent node block may be written into the parent node department name, parent node system name, parent node data table name, and parent node field name, respectively. The father node hash value can be generated through a hash algorithm according to the service field information of the father node block, so that the block to be analyzed is effectively associated with the corresponding father node block.
Table 1 block data storage structure table
Figure BDA0002064945200000091
In some embodiments, each tile may be identified using a service indicator. Accordingly, each block in the side chain has a unique service index corresponding to it to identify the block. The user or the personnel in the organization can inquire the corresponding block through the service index. In some embodiments, for example, the field name may be used as a service indicator for identifying the block.
For the sake of differential presentation, blocks in the side chain may be defined as side chain blocks, parent node blocks in the side chain as side chain parent node blocks, blocks in the main chain as main chain blocks, and parent node blocks in the main chain as main chain parent node blocks.
In some embodiments of the present specification, the data in the side chain block may further include an identifier for characterizing the matching state of the side chain block. Accordingly, the side chain block to be analyzed can be determined based on the identifier of the side chain block.
If the side chain block identifier is "1", the side chain block is in the state to be matched, and if the side chain block identifier is "0", the side chain block is in the matched state. A side chain block identifier of "1" may correspond to two cases: firstly, the newly added service corresponds to a side chain block which is not matched; secondly, when the field data of a certain side chain block is updated, the value corresponding to the identifier of the certain side chain block is changed from '0' to '1'. The side chains can be matched against a side chain block with a side chain block identifier of "1".
By setting the identifier form for the side chain block, the updated side chain block can be re-matched in time. Meanwhile, the condition that the corresponding service data block is modified when the main chain and the side chain data are synchronized can be prevented, writing conflict is prevented, and data interaction management between the main chain and the side chain is effectively realized.
S104: and calling the business data corresponding to the side chain block to be analyzed from a business system database according to the business field information, and comparing the similarity between the business data and the business data corresponding to each side chain father node block.
For example, the data of the side chain block to be analyzed of a certain business department includes "system X-table Y-field A". The actual service data corresponding to the block can be obtained by combining the description of the service field information. For example, the following method can be adopted to read specific service data from the service system database of the department: "select field A from Table Y linked database instances of event System X".
In some embodiments, the parent node block may be preset. If a certain service is newly added in a department, the block corresponding to the service when the service is initially set is used as a father node block, the father node field information of the father node block can be set to be null, and whether the father node field information is negative or not can be determined. Then, the similarity between the service data and the service data corresponding to each side-chain parent node block may be compared.
For example, for a business segment 1 block chain block area, there are one or more side chain parent node blocks corresponding to it. For any one of the side-chain parent node blocks, it is assumed that its traffic field data includes "system 1-table 1-field 1". The data of the side chain block to be analyzed of the business department includes "system 2-table 2-field 2". The actual service data corresponding to the block may be obtained in combination with the description of the service field information, for example, the actual service data may be read in the following manner: "select field 1from Table 1 for the database instance of System 1; "select field 2from Table 2 linked database instances of System 2".
Then, the two sets of acquired data are compared, for example, the two sets of data can be compared in a fuzzy matching or similarity matching mode, and if the data greater than a preset threshold (for example, 80%) are the same or similar, it is determined that the two sets of data belong to the same service. The preset threshold value can be determined according to the actual situation.
And if the comparison result of the two groups of data is smaller than a preset threshold value, determining that the two groups of data belong to different services. And analogizing in turn, comparing the specific service data of the side chain block to be analyzed with other father node side chain blocks of the service department. If no father node side chain block meeting the threshold requirement exists, the threshold requirement can be adjusted or specific business data can be checked, and the analysis and comparison can be carried out again.
S106: and if the similarity meets the requirement of a preset threshold, determining the field information of the father node of the side chain block to be analyzed according to the service field information of the side chain father node block with the similarity meeting the requirement of the preset threshold.
If the similarity between the service data of the side chain block to be analyzed and the service data of a certain side chain father node block is determined to be greater than the preset threshold value through the comparison, the services corresponding to the two groups of data can be considered to be the same. And correspondingly determining the side chain block to be analyzed as a child node block of the side chain parent node block. Correspondingly, the parent node field information of the side chain block to be analyzed can be determined according to the service field information of the side chain parent node block with the similarity meeting the preset threshold requirement.
For the above example, if the comparison result is greater than 80%, the parent node field information of the block corresponding to "system 2-table 2-field 2" may be determined according to the service field information corresponding to "system 1-table 1-field 1".
In some embodiments, the service field information corresponding to the "system 1-table 1-field 1" may be correspondingly written into the parent node field information of the block corresponding to the "system 2-table 2-field 2", and if there is a parent node set as yes, the hash value of the corresponding parent node is generated by using a hash algorithm according to the service field information of the block corresponding to the "system 1-table 1-field 1".
Therefore, the side chain block to be analyzed is associated with the corresponding parent node side chain block through the parent node field information of the side chain block to be analyzed.
In an example scenario of this specification, like the subscription information main table of the system a, a certain field in this table is named as personal _ ID, the corresponding chinese is described as the party number, and the actual meaning of this field describes the unique attribute number information of the party. Meanwhile, a staff information table is arranged in the B system, the staff information table has a field name of peoples _ ID, corresponding Chinese description is a subject of a party, and the actual meaning of the field is also used for uniquely describing a client. The two fields are different from the system, the data table, the field name, and the like, but their corresponding service data are similar, i.e., the actual service data meaning is the same.
A service definition can be given as the client identity and as the parent side-chain block in advance or a field-party number of system a can be determined as the parent side-chain block. Then, the data in different systems, different data tables and different field names are compared with the data, and if the business meanings are determined to be the same, the child side chain block of the father side chain block is determined. And data with the same business meaning in the whole department are correlated through step-by-step analysis. After the unified association is performed in the above manner, in practical application, the newly added service data can be compared with the service field description corresponding to each father node side chain block, and if the comparison result meets the similarity condition, the newly added service data can be determined to be child node data of some existing father node side chain block. Then, a side chain block corresponding to the newly added service data can be constructed according to the service field information structure of the side chain block of the parent node, and the service field information corresponding to the side chain block of the parent node is filled into the parent node field information of the side chain block corresponding to the newly added service data.
By the above manner, for each side chain block of the business department, as long as the parent node field information corresponding to the side chain block is not null, it can be determined that the business meaning of the side chain block is the same as the business meaning of the corresponding side chain parent node block, so that each side chain block determined to have the same business meaning is effectively associated. The business data with the same business meaning corresponds to a side chain father node block, and other side chain blocks with the same business meaning with the side chain father node block are child node blocks of the side chain father node block. The business data with the same business meaning stored in different positions can be represented by the business index of the side chain father node area, so that the business in each business department can be effectively managed.
In an embodiment of the present specification, a service index knowledge graph may also be obtained by determining a structural relationship between service indexes corresponding to each side-chain block according to parent node field information of each side-chain block. In some embodiments, through the above comparison analysis, the parent-child node relationship between the side-link blocks can be determined by using the parent node field information of each side-link block. And then, a relation structure chart between the service indexes corresponding to each side chain block can be constructed and obtained according to the relationship of the parent-child nodes, so that a service index knowledge graph is formed. The index knowledge graph can visually show the relation among all the service indexes and the storage relation of data corresponding to all the service indexes. Therefore, service personnel can more visually analyze the field names, storage positions and the like of the service data with the same service meaning, and the management of each service department on the internal services of the department can be further effectively realized.
S108: and if the side chain block to be analyzed is determined to be the side chain father node block, uploading the service field information of the side chain block to be analyzed to a main chain.
If the comparison result between the side chain block to be analyzed and each side chain father node block in the side chain does not meet the preset requirement after the comparison analysis, the father node field information of the side chain block to be analyzed can be set to be null.
Then, the specific service data corresponding to the side chain block to be analyzed may be further analyzed, for example, whether the specific service data has an entry error or not may be analyzed.
If the specific service data corresponding to the side chain block to be analyzed is determined to be the newly added service after the analysis, the side chain block to be analyzed can be determined to be the side chain father node block. Then, the service field information of the side chain block to be analyzed can be uploaded to the main chain.
Of course, in an actual service scenario, if a department determines that a service is newly added, the block corresponding to the service may also be directly determined as a side chain parent node block without data comparison. Then, the service field information of the block corresponding to the newly added service may be uploaded to the main chain.
S110: and the main chain receives the service field information uploaded by the side chain and generates a main chain block corresponding to the service field information.
The side chain corresponding to each department can synchronize the service field information corresponding to the side chain father node block into the main chain. The main chain can generate a corresponding main chain block while receiving the information uploaded by the side chain, and the data of the main chain block can comprise service field information and parent node field information. Correspondingly, the service field information of the main chain block is the service field information uploaded by the side chain.
Therefore, the main chain is connected with the side chains corresponding to all the departments, and the main chain can analyze and process the data uploaded by the side chains to realize the same management of the data of all the departments or all the branch structures by an upper-layer mechanism.
By using the scheme provided by each embodiment, each business department can effectively realize the management of the business data in the department by using the business field information of the side chain father node block. Meanwhile, the service field information of the side chain father node block corresponding to the side chain of each service department can be synchronized to the main chain so as to be used for analyzing and managing the data of each side chain by the main chain and realize that the upper-layer mechanism analyzes and manages the service data in the whole mechanism.
Fig. 2 and fig. 3 are schematic flow charts of a data processing method in another embodiment provided in the present specification. The method is described by taking the angle of performing the method by the side chain end as an example, and as shown in fig. 2, the method provided by one or more embodiments of the present specification may include:
s202: acquiring a side chain block to be analyzed, wherein the side chain block data to be analyzed comprises service field information and father node field information;
s204: calling the business data corresponding to the side chain block to be analyzed from a business system database according to the business field information of the side chain block to be analyzed, and comparing the similarity between the business data and the business data corresponding to each side chain father node block;
s206: and determining the parent node field information of the side chain block to be analyzed according to the service field information of the side chain parent node block with the similarity meeting the preset threshold requirement.
By comparing and analyzing the specific service data, the parent-child node relationship between the blocks corresponding to the same service in the department can be determined. And the same service is represented by using the unique service field information corresponding to the father node block, so that the data management of the service in the department is realized.
Preferably, in an embodiment of the present specification, the traffic field information and the hash value of the side chain parent node block whose similarity satisfies the preset threshold requirement may be determined as the parent node field information of the side chain block to be analyzed.
In another embodiment of the present description, as shown in fig. 3, the method may further include:
s208: and if the similarity does not meet the requirement of a preset threshold and the side chain block to be analyzed is determined to be a side chain father node block, uploading the service field information of the side chain block to be analyzed to a main chain.
Each side chain can upload the information of each father node block in the department to the main chain, so that the main chain can analyze and manage the data of each side chain, and the upper-layer mechanism can analyze and manage the service data in the whole mechanism.
In another embodiment of the present specification, the side chain blocks to be analyzed may be determined according to identifiers of the side chain blocks, which are used to identify matching states of the respective side chain blocks.
In another embodiment of the present description, the method may further include:
and determining the structural relationship between the service indexes corresponding to the side chain blocks according to the father node field information of the side chain blocks to obtain a service index knowledge graph, wherein the service indexes are used for identifying the corresponding side chain blocks. Therefore, business personnel can analyze the storage position of the business data more visually.
The specific comparison analysis method and the knowledge graph construction method can be implemented by referring to the above embodiments, and are not described herein again.
FIG. 4 is a schematic flow chart diagram of a data processing method for a primary link end in another embodiment provided herein. For the primary link ends, in one or more embodiments of the present description, the method may further comprise:
s302: and receiving the service field information uploaded by the side chain and generating a main chain block corresponding to the service field information.
S304: and calling the business data corresponding to the main chain block from a business system database according to the business field information, and comparing the similarity between the business data and the business data corresponding to each main chain father node block.
S306: and determining the parent node field information of the main chain block according to the service field information of the main chain parent node block with the similarity meeting the preset threshold requirement.
The side chain corresponding to each department can synchronize the service field information corresponding to the side chain father node block into the main chain. If a new service is added in the side chain, the service field information of the side chain parent node block corresponding to the service can be uploaded to the main chain, the main chain can generate a corresponding main chain block while receiving the information uploaded by the side chain, and the data of the main chain block can include the service field information and the parent node field information. Correspondingly, the service field information of the main chain block is the service field information uploaded by the side chain.
Then, specific service data can be called from a service system database according to the service field information of the main chain block to be analyzed by referring to the analysis and comparison mode in the side chain. And comparing the business data with the specific business data corresponding to each main chain father node block in the main chain.
And filling the business field information of the main chain father node block with the similarity meeting the preset threshold requirement into the corresponding father node field information of the main chain block to be analyzed, wherein the father node hash value is determined by carrying out hash operation on the business field information of the main chain father node block.
In an actual service scene, service data corresponding to each service department is usually different, but some service data may overlap. Through further comparison and analysis in the main chain, the same business data among all departments can be correlated.
Through the structure, the main chain can obtain the unique service field information of the blocks with the same service meaning in each side chain, and the treatment result of the unique meaning of the data service of the upper-layer mechanism is realized; meanwhile, the upper-layer mechanism can also analyze the block field names of the side chains corresponding to each department and issue an adjusting and modifying instruction to the departments with the field names not meeting the standard, thereby further realizing the unified management of the upper-layer mechanism on the data storage structure of each department. Meanwhile, the upper-layer mechanism can further realize the verification, inquiry and the like of other department data by a department with a requirement by setting a certain authority, and further realize the information sharing of the whole data of the mechanism while ensuring the security management of the data in the department.
In some embodiments, the data in the backbone block may also include a backbone block identifier for indicating a matching status of the backbone block. Accordingly, if the main chain block identifier is "1", the main chain block is in the state to be matched, and if the main chain block identifier is "0", the main chain block is in the matched state. A backbone block identifier of "1" may correspond to two cases: firstly, newly adding main chain blocks which are not matched; secondly, when the data of the side chain father node block is updated, the data is synchronously updated to the main chain, and when the data of the main chain block starts to be synchronously updated, the value corresponding to the identifier is changed from '0' to '1'. The backbone may perform a matching process for a backbone block with a backbone block identifier of "1".
Fig. 5 is a flow chart illustrating a data processing method in another embodiment provided in the present specification. As shown in fig. 5, the method may further include:
s308: and if the similarity does not meet the requirement of a preset threshold, acquiring the service index of the main chain block, and judging whether the service index corresponds to other main chain blocks.
S310: and if so, performing consistency check processing on the other main chain blocks corresponding to the service indexes and the service data of the main chain blocks, and sending a modification instruction to a side chain needing service data modification according to the check processing result.
If the similarity does not meet the requirement of a preset threshold, the upper-layer mechanism can check each block in the main chain. If the service index of the main chain block to be analyzed can be obtained, and whether the service index corresponds to other main chain blocks or not is judged. If the service data is the same as the service data of the main chain block, the main chain block is judged to be the same as the service data of the main chain block, and the service data is judged to be the same as the service data of the main chain block. If the data exists, the command can be issued to the corresponding department for modification and perfection, and the uniformity and the accuracy of the whole data of the organization are ensured.
If the result of the determination is negative, the main chain block to be analyzed can be determined to be the newly added service data, and the main chain can set the parent node field information of the main chain block to be analyzed to be null and determine the main chain block to be the parent node block of the main chain.
Similarly, through the comparison analysis, a service index relation map can be obtained in the main chain. Furthermore, the main chain can also analyze information of departments, storage systems and the like with the same service index, so that the upper-layer mechanism can conveniently analyze and manage the internal data of the whole mechanism.
According to the scheme provided by the embodiment of the specification, on the basis of realizing the internal data management of departments, the main chain can further analyze and manage the data of the side chains synchronized to the main chain. Particularly, whether the condition that two sets of different service information exist in the same service can be effectively determined through main chain analysis, and if the condition exists, related departments can be responsible for modification and perfection. Furthermore, the main chain can realize data sharing of partial services among departments on the basis of setting certain authority, and effectively realize overall management of the whole services of the organization.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. For details, reference may be made to the description of the related embodiments of the related processing, and details are not repeated herein.
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
In the data processing method provided in one or more embodiments of the present specification, each service department may perform maintenance and treatment on its own service data through a side chain of a block chain, so as to implement unified treatment on data inside the department at first. Then, the side chain can synchronize the service data list obtained after the unified management of the side chain to the main chain corresponding to the upper-layer mechanism so as to realize the synchronization and management of the data of all service departments. Various embodiments of the present description are utilized. The management of the whole business data of the organization can be effectively realized.
Based on the data processing method, one or more embodiments of the present specification further provide a data processing apparatus. The apparatus may include systems, software (applications), modules, components, servers, etc. that utilize the methods described in the embodiments of the present specification in conjunction with hardware implementations as necessary. Based on the same innovative conception, embodiments of the present specification provide an apparatus as described in the following embodiments. Since the implementation scheme of the apparatus for solving the problem is similar to that of the method, the specific implementation of the apparatus in the embodiment of the present specification may refer to the implementation of the foregoing method, and repeated details are not repeated. As used hereinafter, the term "unit" or "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated. Specifically, fig. 6 is a schematic block diagram of an embodiment of a data processing apparatus provided in the specification, and as shown in fig. 6, the apparatus may include:
a data obtaining module 402, configured to obtain a side-chain block to be analyzed, where the side-chain block to be analyzed includes service field information and parent node field information;
a first data retrieving module 404, configured to retrieve, from a service system database, service data corresponding to the side-chain block to be analyzed according to the service field information of the side-chain block to be analyzed;
a first data comparison module 406, configured to compare similarity between the service data and service data corresponding to each side-chain parent node block;
the first parent node determining module 408 may be configured to determine, according to the service field information of the side chain parent node block whose similarity satisfies the preset threshold requirement, the parent node field information of the side chain block to be analyzed.
As shown in fig. 6, in another embodiment of the present specification, the apparatus may further include:
the data synchronization module 410 may be configured to upload the service field information of the side chain block to be analyzed to the main chain if the similarity does not meet the requirement of the preset threshold and it is determined that the side chain block to be analyzed is the side chain parent node block.
Fig. 7 is a schematic block diagram of an embodiment of a data processing apparatus provided in the specification, and as shown in fig. 7, the apparatus may further include:
the data receiving module 502 may be configured to receive service field information uploaded by a side chain, and generate a main chain block corresponding to the service field information;
the second data retrieving module 504 may be configured to retrieve service data corresponding to the main-chain block from a service system database according to the service field information;
a second data comparison module 506, configured to compare similarity between the service data and service data corresponding to each main-chain parent node block;
the second parent node determining module 508 may be configured to determine, according to the service field information of the main chain parent node block whose similarity meets the preset threshold requirement, parent node field information of the main chain block.
As shown in fig. 7, in another embodiment of the present specification, the apparatus may further include:
the determining module 510 may be configured to, if the similarity does not meet a preset threshold requirement, obtain a service index of the main chain block, and determine whether the service index corresponds to another main chain block;
the checking processing module 512 is configured to, if the determination result is yes, perform consistency checking processing on the service data of the other main-chain blocks corresponding to the service index and the main-chain block;
the instruction sending module 514 may be configured to send a modification instruction to the side chain requiring service data modification according to the result of the checking process.
It should be noted that the above-described apparatus may also include other embodiments according to the description of the method embodiment. The specific implementation manner may refer to the description of the related method embodiment, and is not described in detail herein.
In the data processing apparatus provided in one or more embodiments of the present specification, each service department may perform maintenance and treatment on its own service data through a side chain of a block chain, so as to implement unified treatment on data inside the department at first. Then, the side chain can synchronize the service data list obtained after the unified management of the side chain to the main chain corresponding to the upper-layer mechanism so as to realize the synchronization and management of the data of all service departments. Various embodiments of the present description are utilized. The management of the whole business data of the organization can be effectively realized.
The method or apparatus provided by the present specification and described in the foregoing embodiments may implement service logic through a computer program and record the service logic on a storage medium, where the storage medium may be read and executed by a computer, so as to implement the effect of the solution described in the embodiments of the present specification. Accordingly, the present specification also provides a data processing apparatus comprising a processor and a memory storing processor-executable instructions which, when executed by the processor, implement steps comprising:
acquiring a side chain block to be analyzed, wherein the side chain block data to be analyzed comprises service field information and father node field information;
and calling the business data corresponding to the side chain block to be analyzed from a business system database according to the business field information of the side chain block to be analyzed. Comparing the similarity between the business data and the business data corresponding to each side chain father node block;
and determining the parent node field information of the side chain block to be analyzed according to the service field information of the side chain parent node block with the similarity meeting the preset threshold requirement.
In other embodiments, the instructions when executed by the processor may further implement steps comprising:
receiving service field information uploaded by a side chain, and generating a main chain block corresponding to the service field information;
calling the business data corresponding to the main chain block from a business system database according to the business field information, and comparing the similarity between the business data and the business data corresponding to each main chain father node block;
and determining the parent node field information of the main chain block according to the service field information of the main chain parent node block with the similarity meeting the preset threshold requirement.
The storage medium may include a physical device for storing information, and typically, the information is digitized and then stored using an electrical, magnetic, or optical media. The storage medium may include: devices that store information using electrical energy, such as various types of memory, e.g., RAM, ROM, etc.; devices that store information using magnetic energy, such as hard disks, floppy disks, tapes, core memories, bubble memories, and usb disks; devices that store information optically, such as CDs or DVDs. Of course, there are other ways of storing media that can be read, such as quantum memory, graphene memory, and so forth.
It should be noted that the above description of the apparatus according to the method embodiment may also include other embodiments. The specific implementation manner may refer to the description of the related method embodiment, and is not described in detail herein.
The method embodiments provided by the embodiments of the present specification can be executed in a mobile terminal, a computer terminal, a server or a similar computing device. Taking the example of the data processing server running on the server, fig. 8 is a hardware configuration block diagram of the data processing server to which the embodiments of the present specification are applied. As shown in fig. 8, the server 10 may include one or more (only one shown) processors 100 (the processors 100 may include, but are not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 200 for storing data, and a transmission module 300 for communication functions. It will be understood by those skilled in the art that the structure shown in fig. 8 is merely an illustration and is not intended to limit the structure of the electronic device. For example, the server 10 may also include more or fewer components than shown in FIG. 8, and may also include other processing hardware, such as a database or multi-level cache, a GPU, or have a different configuration than shown in FIG. 8, for example.
The memory 200 may be used to store software programs and modules of application software, such as program instructions/modules corresponding to the search method in the embodiment of the present invention, and the processor 100 executes various functional applications and data processing by executing the software programs and modules stored in the memory 200. Memory 200 may include high speed random access memory and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, memory 200 may further include memory located remotely from processor 100, which may be connected to a computer terminal through a network. Examples of such networks include, but are not limited to, the internet, intranet, local area networks, mobile communication networks, and combinations thereof.
The transmission module 300 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the computer terminal. In one example, the transmission module 300 includes a Network adapter (NIC) that can be connected to other Network devices through a base station so as to communicate with the internet. In one example, the transmission module 300 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In the data processing apparatus in the above embodiment, each business department may perform maintenance and management on its own business data through the side chain of the block chain, so as to implement unified management on internal data of the department at first. Then, the side chain can synchronize the service data list obtained after the unified management of the side chain to the main chain corresponding to the upper-layer mechanism so as to realize the synchronization and management of the data of all service departments. Various embodiments of the present description are utilized. The management of the whole business data of the organization can be effectively realized.
The present specification also provides a data processing system which may be a stand-alone data processing system or may be implemented in a variety of computer data processing systems. The system may be a single server, or may include a server cluster, a system (including a distributed system), software (applications), an actual operating device, a logic gate device, a quantum computer, etc. using one or more of the methods or one or more of the example devices of the present specification, in combination with a terminal device implementing hardware as necessary. The data processing system may comprise at least one processor and a memory storing computer-executable instructions which, when executed by the processor, perform the steps of the method described in any one or more of the embodiments above.
FIG. 9 is a block diagram of a data processing system provided in the present specification. As shown in fig. 9, the system may include a main chain, a plurality of side chains connected to the main chain, and a service system database, where data in each block of the main chain and the side chains includes service field information and parent node field information, and the service system database is configured to store service data corresponding to each block, where,
the service field information of each side chain block in the side chain is determined according to the corresponding service data, and the father node field information is the service field information of the side chain father node block corresponding to the corresponding side chain block;
the service field information of each main chain block in the main chain is the service field information of a side chain father node block in each side chain, and the father node field information is the service field information of the main chain father node block corresponding to the corresponding main chain block.
Fig. 10 is a main chain structure diagram provided in the present specification. As shown in fig. 10, the main chain may include a first information query module, a first information modification module, a relationship analysis module, a first intelligent analysis module, a first user management module, a first knowledge graph presentation module, a first interface management module, a first key management module, and a first storage module.
The first information query module may be configured to query data of a main chain block corresponding to the service indicator. The service index corresponding to each main chain block is determined when the data corresponding to each main chain block is generated in the side chain. That is, when the main chain receives the service field information uploaded by the side chain, the main chain can receive the corresponding service index at the same time, and the main chain block generated aiming at the service field information is identified by the service index. The user can inquire the data of the corresponding main chain block through the service index, and can also inquire the side chain block information and the specific service data corresponding to the service index within the permission range.
The first information modification module may be configured to add a new main-chain block to the main chain when the main chain receives the data of the side-chain parent node block uploaded by the side chain.
The relationship analysis module may be configured to analyze a relationship between the business indicators. Each service index has a physical block, and the data storage mode of each service index can refer to the data structure in table 1. The field information of the father node can be analyzed, the father-son node relation among all service indexes and the system information corresponding to the same service index are determined, and a head office can conveniently conduct data governance analysis on the inside of the whole mechanism.
The first intelligent analysis module is used for analyzing and comparing the service field information among the main chain blocks and determining the parent-child node relationship among the main chain blocks.
The first intelligent analysis module can be used for analyzing the relation between the business indexes. Through the information on the data structure, the specific service data of each service index can be searched, and the similarity between the two service indexes can be obtained through comparison and analysis of the specific service data. By setting the threshold value (for example: 90%), it can be basically determined that the service information of the two service indexes is the same or very close to each other, so that the parent-child node relationship between the blocks can be obtained. The information can be further used for a relation analysis module, and can also be used for manual identification and data governance of business personnel.
The first user management module may be for managing a relationship between the side chains connected to the main chain. The first user management module can be used for managing the relationship of department side chains, and managing the side chains strictly according to the organization requirements among business departments, such as the authority of each department.
The first knowledge graph display module can be used for displaying a business index relation structure diagram in a main chain, so that business personnel can analyze the business index relation structure diagram conveniently and visually.
The first interface management module can be used for managing an information interaction interface between the main chain and the side chain. The first interface management module may be configured to manage an interface between a main chain and a side chain. For example, the situation that the corresponding service data block is modified when the main chain data and the side chain data are synchronized can be prevented, and the writing conflict is prevented. And meanwhile, the information interaction between the main chain and the side chain can be managed.
The first key management module is used for encrypting and decrypting data transmission. The encryption and decryption actions of data transmission in the network are managed, the data security in a network link is guaranteed, and the reliability of the data is enhanced.
The first storage module is used for storing data in the main chain block, such as service field information, father node field information, service indexes, identification codes and the like of the main chain block.
FIG. 11 is a side chain structure diagram provided in the present specification. As shown in fig. 11, the side chain may include a second information query module, a second information modification module, a second intelligent analysis module, a second user management module, a second knowledge graph presentation module, a data retrieval module, a second interface management module, a second key management module, and a second storage module.
The second information query module may be configured to query data of a side-chain block corresponding to the service indicator. Each side chain block corresponds to a service index, service field information and father node field information of the corresponding side chain block can be inquired through the service index, and further, service data can be called from a service system database through the service field information to be checked.
The second information modification module may be configured to add a side-chain block when a service indicator is added. If there is new business index in the department, it relates to the block information of new index in the department side chain block chain system.
The second intelligent analysis module can be used for analyzing and comparing service field information among the side chain blocks to determine a parent-child node relationship among the side chain blocks.
The second intelligent analysis module is mainly used for analyzing the relation among all the service indexes. Physical data information of each service index can be searched through the information on the data structure, and the similarity between the two service indexes can be obtained through comparison and analysis of the physical information. By setting the threshold value (for example, 90%), it can be basically determined that the service information of the two service indexes is the same or very close to each other, so that the parent-child node relationship between the fields can be obtained. The method can be used for manual identification and data management of service personnel.
The second user management module may be configured to manage the authority of the user corresponding to the side chain. The second user management module can be used for managing users in a department block chain system, and only the specified user can newly add and modify the service block information of the department.
The second knowledge graph display module may be configured to display a business index relationship structure diagram in the side chain. The whole block chain can be constructed into the structural relationship among the service indexes, and the second knowledge graph display module can be constructed into the form of a knowledge graph and can be used for displaying, so that service personnel can analyze the knowledge graph more intuitively.
The data retrieving module may be configured to retrieve service data corresponding to the corresponding side-chain block from a service system database according to the service field information of the side-chain block. The specific service data information corresponding to the service field can be obtained from the service system database through the information of the data structure, for example, the specific service data information can be obtained in the form of "select field from table 1".
The second interface management module can be used for uploading data to the main chain and receiving information fed back by the main chain, and information synchronization and interaction between the side chain and the main chain are achieved.
The second key management module is used for encrypting and decrypting data transmission. The second key management module can be used for managing encryption and decryption actions of data transmitted in the network, ensuring data security in a network link and enhancing the reliability of the data.
The second storage module is used for storing data in the side chain block, service field information, father node field information, identification codes, service indexes and the like of the side chain block.
It should be noted that the above-mentioned system may also include other implementation manners according to the description of the method or apparatus embodiment, and specific implementation manners may refer to the description of the related method embodiment, which is not described in detail herein.
The system provided by the embodiment of the specification realizes effective management of the whole data of the mechanism by arranging the block chain on the basis of the traditional database architecture. The characteristics of synchronous accounting and non-tampering among blocks in a block chain are utilized, data are strictly managed, and meanwhile, the data can be treated by utilizing the efficient data processing capacity of a traditional database. Furthermore, the cost of mechanism data management and transformation can be reduced.
It should be noted that, the above-mentioned apparatus or system in this specification may also include other implementation manners according to the description of the related method embodiment, and a specific implementation manner may refer to the description of the method embodiment, which is not described herein in detail. The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the hardware + program class, storage medium + program embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments of the present description are not limited to what must be consistent with a standard data model/template or described in the embodiments of the present description. Certain industry standards, or implementations modified slightly from those described using custom modes or examples, may also achieve the same, equivalent, or similar, or other, contemplated implementations of the above-described examples. The embodiments using these modified or transformed data acquisition, storage, judgment, processing, etc. may still fall within the scope of the alternative embodiments of the present description.
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a vehicle-mounted human-computer interaction device, a cellular telephone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
For convenience of description, the above devices are described as being divided into various modules by functions, and are described separately. Of course, when implementing one or more of the present description, the functions of each module may be implemented in one or more software and/or hardware, or a module implementing the same function may be implemented by a combination of multiple sub-modules or sub-units, etc. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
Those skilled in the art will also appreciate that, in addition to implementing the controller as pure computer readable program code, the same functionality can be implemented by logically programming method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Such a controller may therefore be considered as a hardware component, and the means included therein for performing the various functions may also be considered as a structure within the hardware component. Or even means for performing the functions may be regarded as being both a software module for performing the method and a structure within a hardware component.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method or apparatus that comprises the element.
As will be appreciated by one skilled in the art, one or more embodiments of the present description may be provided as a method, system, or computer program product. Accordingly, one or more embodiments of the present description may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, one or more embodiments of the present description may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
One or more embodiments of the present description may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. One or more embodiments of the present specification can also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment. In the description of the specification, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the specification. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
The above description is only an example of the present specification, and is not intended to limit the present specification. Various modifications and alterations to this description will become apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present specification should be included in the scope of the claims of the present specification.

Claims (18)

1. A data processing method, comprising:
acquiring a side chain block to be analyzed in a side chain, wherein the data of the side chain block to be analyzed comprises service field information and father node field information;
calling the business data corresponding to the side chain block to be analyzed from a business system database according to the business field information, and comparing the similarity between the business data and the business data corresponding to each side chain father node block;
if the similarity meets the requirement of a preset threshold, determining the business field information and the hash value of the side chain father node block with the similarity meeting the requirement of the preset threshold as the father node field information of the side chain block to be analyzed;
if the side chain block to be analyzed is determined to be a side chain father node block, uploading the service field information of the side chain block to be analyzed to a main chain;
and the main chain receives the service field information uploaded by the side chain and generates a main chain block corresponding to the service field information.
2. A data processing method, comprising:
acquiring a side chain block to be analyzed, wherein the side chain block data to be analyzed comprises service field information and father node field information;
calling the business data corresponding to the side chain block to be analyzed from a business system database according to the business field information of the side chain block to be analyzed, and comparing the similarity between the business data and the business data corresponding to each side chain father node block;
and determining the business field information and the hash value of the side chain father node block with the similarity meeting the preset threshold requirement as the father node field information of the side chain block to be analyzed.
3. The method of claim 2, further comprising:
and if the similarity does not meet the requirement of a preset threshold and the side chain block to be analyzed is determined to be a side chain father node block, uploading the service field information of the side chain block to be analyzed to a main chain.
4. The method of claim 2, wherein the determining parent node field information of the side-chain block to be analyzed comprises:
and determining the business field information and the hash value of the side chain father node block with the similarity meeting the preset threshold requirement as the father node field information of the side chain block to be analyzed.
5. The method of claim 2, wherein the obtaining the side-chain block to be analyzed comprises:
and determining the side chain blocks to be analyzed according to the identifiers of the side chain blocks, wherein the identifiers are used for identifying the matching states of the corresponding side chain blocks.
6. The method of claim 2, further comprising:
and constructing and acquiring a service index knowledge graph according to the parent node field information of each side chain block, wherein the service index is used for identifying the corresponding side chain block.
7. A data processing apparatus, characterized in that the apparatus comprises:
the data acquisition module is used for acquiring a side chain block to be analyzed, and the data of the side chain block to be analyzed comprises service field information and father node field information;
the first data calling module is used for calling the business data corresponding to the side chain block to be analyzed from a business system database according to the business field information of the side chain block to be analyzed;
the first data comparison module is used for comparing the similarity between the business data and the business data corresponding to each side chain father node block;
and the first father node determining module is used for determining the business field information and the hash value of the side chain father node block with the similarity meeting the preset threshold requirement as the father node field information of the side chain block to be analyzed.
8. The apparatus of claim 7, further comprising:
and the data synchronization module is used for uploading the service field information of the side chain block to be analyzed to the main chain if the similarity does not meet the requirement of a preset threshold and the side chain block to be analyzed is determined to be a side chain father node block.
9. A data processing apparatus comprising a processor and a memory for storing processor-executable instructions, which when executed by the processor implement steps comprising:
acquiring a side chain block to be analyzed, wherein the side chain block data to be analyzed comprises service field information and father node field information;
calling the business data corresponding to the side chain block to be analyzed from a business system database according to the business field information of the side chain block to be analyzed, and comparing the similarity between the business data and the business data corresponding to each side chain father node block;
and determining the business field information and the hash value of the side chain father node block with the similarity meeting the preset threshold requirement as the father node field information of the side chain block to be analyzed.
10. A data processing method, comprising:
receiving service field information uploaded by a side chain, and generating a main chain block corresponding to the service field information;
calling the business data corresponding to the main chain block from a business system database according to the business field information, and comparing the similarity between the business data and the business data corresponding to each main chain father node block;
and determining the parent node field information of the main chain block according to the service field information of the main chain parent node block with the similarity meeting the preset threshold requirement.
11. The method of claim 10, further comprising:
if the similarity does not meet the requirement of a preset threshold value, acquiring the service index of the main chain block, and judging whether the service index corresponds to other main chain blocks;
and if so, performing consistency check processing on the other main chain blocks corresponding to the service indexes and the service data of the main chain blocks, and sending a modification instruction to a side chain needing service data modification according to the check processing result.
12. A data processing apparatus, characterized in that the apparatus comprises:
the data receiving module is used for receiving the service field information uploaded by the side chain and generating a main chain block corresponding to the service field information;
the second data calling module is used for calling the business data corresponding to the main chain block from a business system database according to the business field information;
the second data comparison module is used for comparing the similarity between the business data and the business data corresponding to each main chain father node block;
and the second father node determining module is used for determining the father node field information of the main chain block according to the service field information of the main chain father node block with the similarity meeting the preset threshold requirement.
13. The apparatus of claim 12, further comprising:
the judging module is used for acquiring the service index of the main chain block if the similarity does not meet the requirement of a preset threshold value, and judging whether the service index corresponds to other main chain blocks;
the checking processing module is used for checking the consistency of the business data of the other main chain blocks corresponding to the business indexes and the main chain blocks if the judgment result is yes;
and the instruction sending module is used for sending a modification instruction to the side chain needing service data modification according to the checking processing result.
14. A data processing apparatus comprising a processor and a memory for storing processor-executable instructions, which when executed by the processor implement steps comprising:
receiving service field information uploaded by a side chain, and generating a main chain block corresponding to the service field information;
calling the business data corresponding to the main chain block from a business system database according to the business field information, and comparing the similarity between the business data and the business data corresponding to each main chain father node block;
and determining the parent node field information of the main chain block according to the service field information of the main chain parent node block with the similarity meeting the preset threshold requirement.
15. A data processing system comprising at least one processor and a memory storing computer-executable instructions which, when executed by the processor, implement the steps of the method of any one of claims 1 to 6 and 10 to 11.
16. A data processing system is characterized in that the system comprises a main chain, a plurality of side chains connected with the main chain and a service system database, wherein data in each block of the main chain and the side chains comprises service field information and father node field information, the service system database is used for storing service data corresponding to each block, wherein,
the service field information of each side chain block in the side chain is determined according to the corresponding service data, and the field information of the father node is determined by adopting the following method: calling service data corresponding to the corresponding side chain blocks from the service system database according to the service field information of the side chain blocks, comparing the similarity between the called service data and the service data corresponding to each side chain father node block, and determining the service field information and the hash value of the side chain father node block with the similarity meeting the preset threshold requirement as the father node field information of the corresponding side chain block;
the service field information of each main chain block in the main chain is the service field information of a side chain father node block in each side chain, and the father node field information is determined by adopting the following method: and calling the service data corresponding to the corresponding main chain block from the service system database according to the service field information of the main chain block, comparing the similarity between the called service data and the service data corresponding to each main chain father node block, and determining the father node field information of the corresponding main chain block according to the service field information of the main chain father node block of which the similarity meets the requirement of a preset threshold.
17. The system of claim 16, wherein the backbone comprises a first information query module, a first information modification module, a relationship analysis module, a first intelligent analysis module, a first user management module, a first knowledge graph presentation module, a first interface management module, a first key management module, and a first storage module, wherein,
the first information query module is used for querying data of a main chain block corresponding to the service index;
the first information modification module is used for adding a main chain block when the main chain receives the data of the side chain father node block uploaded by the side chain;
the relation analysis module is used for determining a unique service index corresponding to the repeated service field information and system information of the repeated service index;
the first intelligent analysis module is used for analyzing and comparing service field information among the main chain blocks to determine a parent-child node relationship among the main chain blocks;
the first user management module is used for managing the relation between each side chain connected with the main chain;
the first knowledge graph display module is used for displaying a business index relation structure diagram in a main chain;
the first interface management module is used for managing an information interaction interface between the main chain and the side chain;
the first key management module is used for encrypting and decrypting data transmission;
the first storage module is used for storing data in the main chain block.
18. The system of claim 16, wherein the side chain comprises a second information query module, a second information modification module, a second intelligent analysis module, a second user management module, a second knowledge graph presentation module, a data retrieval module, a second interface management module, a second key management module, and a second storage module, wherein,
the second information query module is used for querying data of the side chain block corresponding to the service index;
the second information modification module is used for newly adding a side chain block when a service index is newly added;
the second intelligent analysis module is used for analyzing and comparing service field information among the side chain blocks to determine a parent-child node relationship among the side chain blocks;
the second user management module is used for managing the authority of the user corresponding to the side chain;
the second knowledge graph display module is used for displaying a business index relation structure diagram in the side chain;
the data calling module is used for calling the service data corresponding to the corresponding side chain block from the service system database according to the service field information of the side chain block;
the second interface management module is used for uploading data to the main chain and receiving information fed back by the main chain;
the second key management module is used for encrypting and decrypting data transmission;
the second storage module is used for storing data in the side chain block.
CN201910417662.1A 2019-05-20 2019-05-20 Data processing method, device and system Active CN110225095B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910417662.1A CN110225095B (en) 2019-05-20 2019-05-20 Data processing method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910417662.1A CN110225095B (en) 2019-05-20 2019-05-20 Data processing method, device and system

Publications (2)

Publication Number Publication Date
CN110225095A CN110225095A (en) 2019-09-10
CN110225095B true CN110225095B (en) 2022-02-11

Family

ID=67821359

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910417662.1A Active CN110225095B (en) 2019-05-20 2019-05-20 Data processing method, device and system

Country Status (1)

Country Link
CN (1) CN110225095B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111128325B (en) * 2019-12-23 2023-08-11 医渡云(北京)技术有限公司 Medical data storage method and device, electronic equipment and storage medium
CN111159429B (en) * 2019-12-30 2023-05-05 中信百信银行股份有限公司 Knowledge graph-based data analysis method and device, equipment and storage medium
CN111401284B (en) * 2020-03-23 2022-02-15 武汉大学 Door opening and closing state identification method based on image processing
CN112015870A (en) * 2020-09-14 2020-12-01 支付宝(杭州)信息技术有限公司 Data uploading method and device
CN113177235A (en) * 2020-12-01 2021-07-27 李孔雀 Data processing method combining big data and cloud computing and big data server
CN112463890B (en) * 2020-12-10 2023-05-26 电子科技大学 Cross-system data sharing method based on block chain and machine learning
CN113407624A (en) * 2021-06-05 2021-09-17 广东辰宜信息科技有限公司 Block chain automatic grouping method and device and computer readable storage medium
CN116018796A (en) * 2021-08-20 2023-04-25 京东方科技集团股份有限公司 Creation method, information processing method, storage method, electronic device, and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107368259A (en) * 2017-05-25 2017-11-21 阿里巴巴集团控股有限公司 A kind of method and apparatus that business datum is write in the catenary system to block
CN109600433A (en) * 2018-12-06 2019-04-09 北京磁云数字科技有限公司 Data summarization method and device in a kind of system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10135870B2 (en) * 2016-02-22 2018-11-20 Bank Of America Corporation System for external validation of secure process transactions
US9985964B2 (en) * 2016-03-28 2018-05-29 Black Gold Coin, Inc. Systems and methods for providing block chain-based multifactor personal identity verification

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107368259A (en) * 2017-05-25 2017-11-21 阿里巴巴集团控股有限公司 A kind of method and apparatus that business datum is write in the catenary system to block
CN109600433A (en) * 2018-12-06 2019-04-09 北京磁云数字科技有限公司 Data summarization method and device in a kind of system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Rong Wang.A Privacy-Aware PKI System Based on Permissioned.《 2018 IEEE 9th International Conference on Software Engineering and Service Science (ICSESS)》.2018, *

Also Published As

Publication number Publication date
CN110225095A (en) 2019-09-10

Similar Documents

Publication Publication Date Title
CN110225095B (en) Data processing method, device and system
CN109450638A (en) Electronic component data management system and method based on block chain
US20230319001A1 (en) Snippet(s) of content associated with a communication platform
CN111382956A (en) Enterprise group relationship mining method and device
CN107343007A (en) Distributed file management method and system based on user identity and purview certification
CN106886535A (en) A kind of data pick-up method and apparatus for being adapted to multiple data sources
CN115544183A (en) Data visualization method and device, computer equipment and storage medium
CN112182004A (en) Method and device for viewing data in real time, computer equipment and storage medium
CN113742338A (en) Structured storage system for project acceptance forms
CN109829138A (en) File comparison method, device, electronic equipment and computer readable storage medium
CN110555129A (en) space image data interaction method and device based on alliance chain
Xu et al. Cloud computing boosts business intelligence of telecommunication industry
Sultanov et al. Development of a centralized system for data storage and processing on operation modes and reliability indicators of power equipment
CN116842012A (en) Method, device, equipment and storage medium for storing Redis cluster in fragments
CN116415203A (en) Government information intelligent fusion system and method based on big data
CN115543428A (en) Simulated data generation method and device based on strategy template
CN113868253B (en) Data relationship capturing and big data relationship tree construction method
CN111611220A (en) File sharing method and system based on hierarchical nodes
CN115471582A (en) Map generation method and device, computer equipment and storage medium
CN112256760B (en) Data prediction method and device, computer equipment and storage medium
Coupaye et al. A graph-based cross-vertical digital twin platform for complex cyber-physical systems
CN107622124B (en) Data query method and system based on block data
US10621198B1 (en) System and method for secure database replication
CN114510465B (en) Data management method, device and computer readable storage medium
CN116841650B (en) Sample construction method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant