CN112734545A - Block chain data sharing method, device and system - Google Patents

Block chain data sharing method, device and system Download PDF

Info

Publication number
CN112734545A
CN112734545A CN202011634633.XA CN202011634633A CN112734545A CN 112734545 A CN112734545 A CN 112734545A CN 202011634633 A CN202011634633 A CN 202011634633A CN 112734545 A CN112734545 A CN 112734545A
Authority
CN
China
Prior art keywords
data
node
service information
target service
block chain
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011634633.XA
Other languages
Chinese (zh)
Other versions
CN112734545B (en
Inventor
镇超
卞小香
邓洪文
吴多
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN202011634633.XA priority Critical patent/CN112734545B/en
Publication of CN112734545A publication Critical patent/CN112734545A/en
Application granted granted Critical
Publication of CN112734545B publication Critical patent/CN112734545B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/64Protecting data integrity, e.g. using checksums, certificates or signatures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/546Message passing systems or structures, e.g. queues

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Databases & Information Systems (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Marketing (AREA)
  • General Health & Medical Sciences (AREA)
  • Bioethics (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Finance (AREA)
  • Computer Hardware Design (AREA)
  • Strategic Management (AREA)
  • Technology Law (AREA)
  • General Business, Economics & Management (AREA)
  • Computing Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the application provides a method, a device and a system for sharing block chain data, which relate to the field of block chains, wherein the method comprises the following steps: receiving target service information sent by a block chain node, wherein the target service information is uploaded to the block chain node by a service system node and is issued after the block chain node completes node consensus operation; collecting and aggregating the target service information according to a preset data processing rule, and generating a data service interface according to the collected and aggregated target service information so that other service system nodes call the data service interface to perform service processing operation on the target service information; the method and the device can effectively improve the processing efficiency of the data on the block chain.

Description

Block chain data sharing method, device and system
Technical Field
The application relates to the field of block chains, and can also be used in the financial field, in particular to a block chain data sharing method, device and system.
Background
In recent years, financial technologies (FinTech) represented by a series of innovative technologies such as cloud computing, block chaining, artificial intelligence and the like are rapidly emerging in the global scope, and a brand-new financial ecological environment is shaped by taking scientific and technological innovation as driving force. The block chain is valued and applied in more and more fields due to the technical characteristics of 'open transparency', 'non-tamper' and 'traceability', along with the wide application of the block chain in the financial industry, a plurality of uplink business applications often have the requirement of business data report statistics on the chain, for example, for data on the block chain of a public settlement business application system, dozens of other business application systems may need to be inquired and counted, but the block chain link point resources are limited, and an intelligent contract is not suitable for complex calculation, such as big data analysis and the like.
Disclosure of Invention
Aiming at the problems in the prior art, the application provides a method, a device and a system for sharing block chain data, which can effectively improve the processing efficiency of the data on the block chain.
In order to solve at least one of the above problems, the present application provides the following technical solutions:
in a first aspect, the present application provides a method for sharing blockchain data, including:
receiving target service information sent by a block chain node, wherein the target service information is uploaded to the block chain node by a service system node and is issued after the block chain node completes node consensus operation;
and performing collection and cohesion processing on the target service information according to a preset data processing rule, and generating a data service interface according to the target service information subjected to collection and cohesion processing, so that other service system nodes call the data service interface to perform service processing operation on the target service information.
Further, the collecting and aggregating the target service information according to a preset data processing rule, and generating a data service interface according to the target service information after the collecting and aggregating processing includes:
collecting and aggregating the target service information according to at least one of the main key characteristics, the attribute characteristics and the dimension characteristics of the target service information;
and encapsulating the target service information corresponding to various characteristics to obtain a data service interface.
In a second aspect, the present application provides a method for sharing blockchain data, including:
receiving target service information sent by a service system node, and carrying out node consensus operation on the target service information;
and sending the target service information which completes the node consensus operation to a data lake node so that the data lake node performs collection and cohesion processing on the target service information according to a preset data processing rule, and generating a data service interface according to the target service information after the collection and cohesion processing so that other service system nodes call the data service interface to perform service processing operation on the target service information.
Further, the sending the target service information completing the node consensus operation to the data lake node includes:
and sequentially sending the target service information which completes the node consensus operation in a message queue to the data lake nodes through a preset message middleware, wherein the target service information sequentially sent by the service system nodes is stored in the message queue.
In a third aspect, the present application provides a method for sharing block chain data, including:
and calling a data service interface of a data lake node to perform service processing operation on target service information, wherein the data service interface is generated after the data lake node performs collection and cohesion processing on the target service information according to a preset data processing rule, and the target service information is transmitted to the data lake node after a service system node is uploaded to a block chain node and node consensus operation is completed by the block chain node.
Further, still include:
receiving initial service information and corresponding picture data sent by a user, and obtaining target service information according to a preset structured data mapping rule;
and performing service rechecking on the target service information, and uploading the target service information to a block chain node after the service rechecking is effective.
In a fourth aspect, the present application provides a device for sharing blockchain data, including:
the system comprises a target service information receiving module, a block chain node and a block service system node, wherein the target service information is transmitted by the block chain node after the block chain node completes node consensus operation;
and the data service interface generating module is used for collecting and aggregating the target service information according to a preset data processing rule and generating a data service interface according to the collected and aggregated target service information so as to enable other service system nodes to call the data service interface to perform service processing operation on the target service information.
In a fifth aspect, the present application provides a device for sharing blockchain data, including:
the node consensus operation module is used for receiving target service information sent by a service system node and carrying out node consensus operation on the target service information;
and the target service information issuing module is used for sending the target service information which completes the node consensus operation to a data lake node so as to enable the data lake node to carry out collection and cohesion processing on the target service information according to a preset data processing rule, and a data service interface is generated according to the target service information after collection and cohesion processing so as to enable other service system nodes to call the data service interface to carry out service processing operation on the target service information.
In a sixth aspect, the present application provides a device for sharing blockchain data, including:
the data service interface calling module is used for calling a data service interface of a data lake node to perform service processing operation on target service information, wherein the data service interface is generated by the data lake node after the target service information is collected and cohered according to a preset data processing rule, and the target service information is transmitted to the data lake node after a service system node is uploaded to a block chain node and node consensus operation is completed by the block chain node.
In a seventh aspect, the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the block chain data sharing method when executing the program.
In an eighth aspect, the present application provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the blockchain data sharing method.
In view of the above technical solutions, the present application provides a method, an apparatus and a system for sharing block chain data, by uploading various service system nodes to the target service information of the block chain node and synchronously downloading the target service information to the data lake node under the chain in a message middleware mode, collecting and cohering target service information in the data lake nodes to form a shared index data service interface in the professional field, provides block data sharing service for the outside, thereby realizing the read-write separation of the data of each service system node block, the data processing on the block chain link points does not need to inquire the original data on the chain, and only needs to call the shared data service interface provided by the data lake nodes to obtain the block data of each service system node, namely, the target service information, effectively improves the data processing performance of the block chain system, and promotes the block data of each service system node to be quickly converted and applied in each service system.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart illustrating a method for sharing blockchain data according to an embodiment of the present disclosure;
fig. 2 is a second flowchart illustrating a block chain data sharing method according to an embodiment of the present application;
fig. 3 is a third flowchart illustrating a method for sharing blockchain data according to an embodiment of the present invention;
FIG. 4 is a fourth flowchart illustrating a method for sharing blockchain data according to an embodiment of the present invention;
fig. 5 is a block diagram of a device for sharing blockchain data according to an embodiment of the present invention;
fig. 6 is a structural diagram of a service system node in an embodiment of the present application;
fig. 7 is a block chain node structure diagram in an embodiment of the present application;
FIG. 8 is a block diagram of a data lake node in an embodiment of the present application;
fig. 9 is a schematic structural diagram of an electronic device in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In consideration of the problems that the resource of a block chain node is limited and an intelligent contract is not suitable for complex calculation in the prior art, the application provides a block chain data sharing method, a device and a system, various service system nodes are uploaded to target service information of the block chain node and synchronously downloaded to a data lake node under a chain in a message middleware mode, the target service information in the data lake node is collected and cohered to form a shared index data service interface in the professional field, block data sharing service is provided for the outside, therefore, the read-write separation of the block data of each service system node is realized, the data processing on the block chain node does not need to inquire original data on the chain, only the shared data service interface provided by the data lake node is called, the block data of each service system node, namely the target service information can be obtained, the data processing performance of the block chain system is effectively improved, and the block data of each service system node is promoted to be rapidly converted and applied in each service system.
In order to effectively improve the processing efficiency of data on a blockchain, the present application provides an embodiment of a blockchain data sharing method, where an execution subject may be a data lake node, and referring to fig. 1, the blockchain data sharing method specifically includes the following contents:
step S101: and receiving target service information sent by a block chain node, wherein the target service information is sent by a service system node after the block chain node uploads the target service information to the block chain node and the block chain node finishes node consensus operation.
Optionally, the execution main body of the application may be a data lake node, and after receiving the target service information pushed down by the message middleware of the blockchain node, the execution main body may perform interpretation of the target service information, convert the interpreted target service information into a database operation statement, for example, a DML operation statement, and then execute the DML statement to update the target service information into a local database of the data lake node.
Step S102: and performing collection and cohesion processing on the target service information according to a preset data processing rule, and generating a data service interface according to the target service information subjected to collection and cohesion processing, so that other service system nodes call the data service interface to perform service processing operation on the target service information.
Optionally, the method and the system can convert target business information (namely block data) in the local database of the data lake node into an organization structure facing big data query and analysis based on the business object, and carry out recombination, collection and cohesion on the block data around a single theme to form a complete and unified aggregation view facing analysis, so as to support professional block shared data service construction.
As can be seen from the above description, the block chain data sharing method provided in the embodiments of the present application can synchronously download target service information, which is uploaded to various service system nodes by a block chain node, to a data lake node under a chain in a message middleware manner, collecting and cohering target service information in the data lake nodes to form a shared index data service interface in the professional field, provides block data sharing service for the outside, thereby realizing the read-write separation of the data of each service system node block, the data processing on the block chain link points does not need to inquire the original data on the chain, and only needs to call the shared data service interface provided by the data lake nodes to obtain the block data of each service system node, namely, the target service information, effectively improves the data processing performance of the block chain system, and promotes the block data of each service system node to be quickly converted and applied in each service system.
In order to enable each service system node to conveniently obtain target service information from the data lake node, in an embodiment of the block chain data sharing method of the present application, referring to fig. 2, the step S102 may further include the following contents:
step S201: and performing collection and cohesion processing on the target service information according to at least one of the primary key characteristics, the attribute characteristics and the dimension characteristics of the target service information.
Step S202: and encapsulating the target service information corresponding to various characteristics to obtain a data service interface.
Optionally, the theme aggregation may be composed of multiple features, such as three pieces of information, namely, primary key information, attribute information, and dimension information, and the information aggregation ensures that the upper layer data requirements are met in the presentation form of a small number of tables.
The primary key information is used to describe the minimum granularity of the data record, and may be a joint primary key, for example, a loan consists of a loan account number + a product + a contract + loan data.
The attribute information is used for describing the characteristics of the data recording object, and the service elements which are possibly used subsequently are expanded as much as possible at the granularity of the primary key according to the application requirements.
The dimension information may be summary information of the data record object counted according to a certain frequency or range, or may be information of a non-local level of granularity related to the record object. The goal is to precipitate according to the user concentration, and the information can support different requirements.
In order to effectively improve the processing efficiency of data on a blockchain, the present application provides an embodiment of a blockchain data sharing method, where an execution subject may be a blockchain node, and referring to fig. 3, the blockchain data sharing method specifically includes the following contents:
step S301: receiving target service information sent by a service system node, and carrying out node consensus operation on the target service information.
Optionally, the execution main body of this step may be a blockchain node, which processes and identifies the target service information broadcasted by the service system node and then stores the target service information in the database on the blockchain, so that other service systems accessing the blockchain platform can efficiently and quickly process the information on the blockchain from the blockchain platform synchronously, thereby implementing efficient service processing and transmission.
Step S302: and sending the target service information which completes the node consensus operation to a data lake node so that the data lake node performs collection and cohesion processing on the target service information according to a preset data processing rule, and generating a data service interface according to the target service information after the collection and cohesion processing so that other service system nodes call the data service interface to perform service processing operation on the target service information.
Optionally, after the block link points complete the on-chain data storage, a data synchronization mechanism may be triggered at the same time, the on-chain target service information is automatically packaged and pushed to the message middleware, the message middleware stores the message in the message queue according to a first-in first-out rule after receiving the service message pushed from the up-down chain, and automatically distributes and pushes the message in the message queue according to a preset pushing rule, and pushes the message down to the data lake node.
As can be seen from the above description, the block chain data sharing method provided in the embodiments of the present application can synchronously download target service information, which is uploaded to various service system nodes by a block chain node, to a data lake node under a chain in a message middleware manner, collecting and cohering target service information in the data lake nodes to form a shared index data service interface in the professional field, provides block data sharing service for the outside, thereby realizing the read-write separation of the data of each service system node block, the data processing on the block chain link points does not need to inquire the original data on the chain, and only needs to call the shared data service interface provided by the data lake nodes to obtain the block data of each service system node, namely, the target service information, effectively improves the data processing performance of the block chain system, and promotes the block data of each service system node to be quickly converted and applied in each service system.
In order to accurately send the target service information to the data lake node, in an embodiment of the block chain data sharing method of the present application, the step S202 may further include the following steps:
and sequentially sending the target service information which completes the node consensus operation in a message queue to the data lake nodes through a preset message middleware, wherein the target service information sequentially sent by the service system nodes is stored in the message queue.
Optionally, after the block link points complete the on-chain data storage, a data synchronization mechanism may be triggered at the same time, the on-chain target service information is automatically packaged and pushed to the message middleware, the message middleware stores the message in the message queue according to a first-in first-out rule after receiving the service message pushed from the up-down chain, and automatically distributes and pushes the message in the message queue according to a preset pushing rule, and pushes the message down to the data lake node.
In order to effectively improve the processing efficiency of data on a blockchain, the present application provides an embodiment of a blockchain data sharing method, where an execution subject may be a service system node, and the blockchain data sharing method specifically includes the following contents:
and calling a data service interface of a data lake node to perform service processing operation on target service information, wherein the data service interface is generated after the data lake node performs collection and cohesion processing on the target service information according to a preset data processing rule, and the target service information is transmitted to the data lake node after a service system node is uploaded to a block chain node and node consensus operation is completed by the block chain node.
Optionally, the execution main body of the content may be a service system node, which may receive an online application and record and store information, or automatically complete automatic record and store of service information according to a structured data mapping rule after recording by an information background through uploading related picture data such as an application book and a contract book, so as to improve the handling efficiency of a service system.
Optionally, the service system node of the present application may further perform rechecking validation on the input service application, and then broadcast the target service information with rechecking validation to the block link points for consensus.
It can be understood that each service system node can perform big data analysis or statistical query on target service information through a data service interface of a data lake node, and the like, without searching data up, and provides data convenient query and analysis capability for a data consumer by means of strong engine and search capability of the data lake node under a chain, and meanwhile, data access pressure on a block chain is reduced.
In order to flexibly receive information sent by a user, in an embodiment of the block chain data sharing method of the present application, referring to fig. 4, the following may be further included:
step S401: and receiving initial service information and corresponding picture data sent by a user, and obtaining target service information according to a preset structured data mapping rule.
Step S402: and performing service rechecking on the target service information, and uploading the target service information to a block chain node after the service rechecking is effective.
In order to effectively improve the processing efficiency of data on a blockchain, the present application provides an embodiment of a blockchain data sharing device for implementing all or part of contents of the blockchain data sharing method, which may specifically be a data lake node device, where the blockchain data sharing device specifically includes the following contents:
and the target service information receiving module is used for receiving target service information sent by the block chain node, wherein the target service information is sent by the block chain node after the service system node uploads the target service information to the block chain node and the block chain node completes node consensus operation.
And the data service interface generating module is used for collecting and aggregating the target service information according to a preset data processing rule and generating a data service interface according to the collected and aggregated target service information so as to enable other service system nodes to call the data service interface to perform service processing operation on the target service information.
As can be seen from the above description, the device for sharing blockchain data provided in the embodiments of the present application can synchronously download target service information, which is uploaded to various service system nodes by a blockchain node, to a data lake node under a chain in a message middleware manner, collecting and cohering target service information in the data lake nodes to form a shared index data service interface in the professional field, provides block data sharing service for the outside, thereby realizing the read-write separation of the data of each service system node block, the data processing on the block chain link points does not need to inquire the original data on the chain, and only needs to call the shared data service interface provided by the data lake nodes to obtain the block data of each service system node, namely, the target service information, effectively improves the data processing performance of the block chain system, and promotes the block data of each service system node to be quickly converted and applied in each service system.
In order to effectively improve the processing efficiency of data on a blockchain, the present application provides an embodiment of a blockchain data sharing device for implementing all or part of the contents of the blockchain data sharing method, which may specifically be a blockchain link point device, where the blockchain data sharing device specifically includes the following contents:
and the node consensus operation module is used for receiving the target service information sent by the service system node and carrying out node consensus operation on the target service information.
And the target service information issuing module is used for sending the target service information which completes the node consensus operation to a data lake node so as to enable the data lake node to carry out collection and cohesion processing on the target service information according to a preset data processing rule, and a data service interface is generated according to the target service information after collection and cohesion processing so as to enable other service system nodes to call the data service interface to carry out service processing operation on the target service information.
As can be seen from the above description, the device for sharing blockchain data provided in the embodiments of the present application can synchronously download target service information, which is uploaded to various service system nodes by a blockchain node, to a data lake node under a chain in a message middleware manner, collecting and cohering target service information in the data lake nodes to form a shared index data service interface in the professional field, provides block data sharing service for the outside, thereby realizing the read-write separation of the data of each service system node block, the data processing on the block chain link points does not need to inquire the original data on the chain, and only needs to call the shared data service interface provided by the data lake nodes to obtain the block data of each service system node, namely, the target service information, effectively improves the data processing performance of the block chain system, and promotes the block data of each service system node to be quickly converted and applied in each service system.
In order to effectively improve the processing efficiency of data on a blockchain, the present application provides an embodiment of a blockchain data sharing device for implementing all or part of contents of the blockchain data sharing method, which may specifically be a service system node device, where the blockchain data sharing device specifically includes the following contents:
the data service interface calling module is used for calling a data service interface of a data lake node to perform service processing operation on target service information, wherein the data service interface is generated by the data lake node after the target service information is collected and cohered according to a preset data processing rule, and the target service information is transmitted to the data lake node after a service system node is uploaded to a block chain node and node consensus operation is completed by the block chain node.
As can be seen from the above description, the device for sharing blockchain data provided in the embodiments of the present application can synchronously download target service information, which is uploaded to various service system nodes by a blockchain node, to a data lake node under a chain in a message middleware manner, collecting and cohering target service information in the data lake nodes to form a shared index data service interface in the professional field, provides block data sharing service for the outside, thereby realizing the read-write separation of the data of each service system node block, the data processing on the block chain link points does not need to inquire the original data on the chain, and only needs to call the shared data service interface provided by the data lake nodes to obtain the block data of each service system node, namely, the target service information, effectively improves the data processing performance of the block chain system, and promotes the block data of each service system node to be quickly converted and applied in each service system.
To further illustrate the present invention, the present application further provides a specific application example of the method for implementing block chain data sharing by using the above block chain data sharing apparatus, and the specific application example refers to fig. 5, which specifically includes the following contents:
service system node 10, block chain node 20, data lake node 30. Specifically, the method comprises the following steps:
the service system node 10 is responsible for generating all service system data and then broadcasting the data to the block link points for consensus.
And the block chain node 20 is responsible for completing consensus of the data files of the service system, realizing storage on a data chain, ensuring data accuracy and preventing tampering. Meanwhile, data are synchronously downloaded to the data lake in real time through the message middleware. For use in data analysis or query by the data lake node 30.
When there is a need for data analysis or data query on the block chain, the data lake node 30 does not need to directly link the chain to query the data information on the block chain, and each application system only needs to directly query the block information synchronized from the chain according to the block data sharing service provided by the data lake.
Referring to fig. 6, the service system node 10 includes a service processing module 11, a service review module 12, and a broadcast blockchain module 13. Specifically, the method comprises the following steps:
the business system module 11 provides an information online entry unit 111, an attachment uploading unit 112, and an information background entry unit 113. The applicant can complete the online application and information input and storage of the service through the online input unit 111; or the application book, the contract book and other related picture data are uploaded by the accessory uploading unit 112, and the information background recording unit 113 automatically records and stores the service information according to the structured data mapping rule, so that the handling efficiency of the service system is improved or the service information is manually recorded by the background.
And the service rechecking module 12 is responsible for completing rechecking and validation of the service application input by the service system module 11. And completing the rechecking and the establishment of the business in the banking system.
The broadcast blockchain module 13 is responsible for broadcasting the service information with the re-check effect to the blockchain link point consensus.
Referring to fig. 7, the block chain node 20 includes:
the service intelligent contract 21 is responsible for processing and identifying the service information broadcasted and then storing the data in the database on the block chain, and other systems connected to the block chain platform can efficiently and quickly process the information on the chain synchronously from the block chain platform. And high-efficiency service processing and transmission are realized. After the on-chain data storage is completed, a data synchronization mechanism is triggered at the same time, and the on-chain service information is automatically packaged and pushed to the message middleware.
The message receiving module 22, after the message middleware receives the service message pushed up and down by the chain, stores the message in the message queue according to the first-in first-out rule.
And the data distribution module 23 automatically distributes and pushes the messages in the message queue according to preset push rules, and pushes the messages down to the data lake application server.
Referring to fig. 8, the data lake node 30 includes:
the data storage module 31, after receiving the message pushed down by the message middleware, interprets the data, converts the interpreted data into a DML operation statement, and then executes the DML statement to update the block data into the data lake.
The theme aggregation module 32 is used for converting block data in the data lake into an organization structure facing large data query and analysis based on the business object, recombining, collecting and aggregating the block data around a single theme to form a complete and uniform aggregation view facing analysis, and supporting professional block shared data service construction.
The theme aggregation is composed of aggregation main key information, attribute information and dimension information, and information cohesion guarantees that requirements of upper layer data are met in a display mode of a small number of tables.
Primary key information: the minimum granularity of the description data record may be a joint primary key composition, such as a loan consisting of a loan account number + product + contract + loan data.
Attribute information: describing the characteristics of the data record object, and expanding the service elements which are possibly used subsequently at the granularity of the primary key as much as possible according to the application requirements.
Dimension information: the information may be summary information that is counted up by the data record object at a certain frequency or range, or information of a non-local level of granularity related to the record object. The goal is to precipitate according to the user concentration, and the information can support different requirements.
And the data sharing module 33 is used for packaging the theme aggregated data or the common block data generated by processing the front 32 modules and providing service modes comprising online interfaces, batch data services, flexible query, data services with interfaces, table call and the like. If each service system needs to perform big data analysis or statistical query on data on the block chain, data query statistics can be directly performed according to services provided by a data lake under the chain without uploading data.
In addition, this embodiment further provides a method for implementing block chain data sharing in the bank field by using the above modules, and the specific steps are as follows:
step S1, the applicant uploads the information data of the business system application, including information of currency, amount, contract, etc., and applies for the transaction business to the bank.
And step S2, the bank completes the examination and verification of the business data, completes the business transaction in the business system of the bank, and generates the text of the business-related confirmation.
And step S3, uploading the opened service text information to a block chain platform, and broadcasting to the block chain link points for consensus.
And step S4, the service intelligent contract processes and recognizes the uploaded service text and stores the data in the database on the block chain, and other systems connected to the block chain platform can efficiently and quickly acquire the information on the service chain from the block chain platform. And high-efficiency service processing and transmission are realized.
And step S5, after the data storage on the chain is completed, triggering a data synchronization mechanism, automatically packaging the service information on the chain, and pushing the service information to the message middleware.
Step S6, after the message middleware receives the service message pushed up and down by the chain, the message is stored in the message queue according to the first-in first-out rule.
And step S7, the message middleware automatically distributes and pushes the messages in the message queue according to preset pushing rules, and pushes the messages to the data lake server.
And step S8, after receiving the message pushed down by the message middleware, the service platform server interprets the data. And converting the interpreted data into a library DML operation statement, and executing the DML statement to update the data lake.
And step S9, performing patent processing such as theme aggregation on the data of the data lake region to generate a professional shared data service.
Step S10, if the business systems need to perform big data analysis or statistical query on the data on the block chain, the business systems do not need to search the data up, and can directly perform data query statistics according to the data sharing service provided by the data lake under the chain. The powerful engine and retrieval capability of the data lake under the chain are used for providing data convenient query and analysis capability for a data consumer, and meanwhile, the data access pressure on the block chain is reduced.
As can be seen from the above, data on the block chains of various application systems are synchronously downloaded to the data lake below the chain in a message middleware manner, and the block data in the data lake is subject aggregated, refined, and the like, so as to form shared index data in the professional field and provide block data sharing service to the outside. The read-write separation of the block data of each application system is realized, the data on the block chain is subjected to statistical analysis, the original data does not need to be directly inquired on the chain, and the block data of each application field can be obtained only by calling the shared data service provided by the data lake. The performance of the block chain system is effectively improved, the block data of each application system of the bank is promoted to be rapidly converted and applied in each product system, the innovation requirement of banking business can be rapidly responded, and the construction of a banking service ecosystem is enabled. Service efficiency is improved.
In terms of hardware, in order to effectively improve the processing efficiency of data on a blockchain, the present application provides an embodiment of an electronic device for implementing all or part of contents in the method for sharing blockchain data, where the electronic device specifically includes the following contents:
a processor (processor), a memory (memory), a communication Interface (Communications Interface), and a bus; the processor, the memory and the communication interface complete mutual communication through the bus; the communication interface is used for realizing information transmission between the block chain data sharing device and relevant equipment such as a core service system, a user terminal, a relevant database and the like; the logic controller may be a desktop computer, a tablet computer, a mobile terminal, and the like, but the embodiment is not limited thereto. In this embodiment, the logic controller may be implemented with reference to the embodiments of the method for sharing blockchain data and the embodiments of the device for sharing blockchain data in the embodiments, and the contents thereof are incorporated herein, and repeated descriptions thereof are omitted.
It is understood that the user terminal may include a smart phone, a tablet electronic device, a network set-top box, a portable computer, a desktop computer, a Personal Digital Assistant (PDA), an in-vehicle device, a smart wearable device, and the like. Wherein, intelligence wearing equipment can include intelligent glasses, intelligent wrist-watch, intelligent bracelet etc..
In practical applications, part of the blockchain data sharing method may be performed on the electronic device side as described above, or all operations may be performed in the client device. The selection may be specifically performed according to the processing capability of the client device, the limitation of the user usage scenario, and the like. This is not a limitation of the present application. The client device may further include a processor if all operations are performed in the client device.
The client device may have a communication module (i.e., a communication unit), and may be communicatively connected to a remote server to implement data transmission with the server. The server may include a server on the task scheduling center side, and in other implementation scenarios, the server may also include a server on an intermediate platform, for example, a server on a third-party server platform that is communicatively linked to the task scheduling center server. The server may include a single computer device, or may include a server cluster formed by a plurality of servers, or a server structure of a distributed apparatus.
Fig. 9 is a schematic block diagram of a system configuration of an electronic device 9600 according to an embodiment of the present application. As shown in fig. 9, the electronic device 9600 can include a central processor 9100 and a memory 9140; the memory 9140 is coupled to the central processor 9100. Notably, this fig. 9 is exemplary; other types of structures may also be used in addition to or in place of the structure to implement telecommunications or other functions.
In one embodiment, the blockchain data sharing method function may be integrated into the central processor 9100. The central processor 9100 may be configured to control as follows:
step S101: and receiving target service information sent by a block chain node, wherein the target service information is sent by a service system node after the block chain node uploads the target service information to the block chain node and the block chain node finishes node consensus operation.
Step S102: and performing collection and cohesion processing on the target service information according to a preset data processing rule, and generating a data service interface according to the target service information subjected to collection and cohesion processing, so that other service system nodes call the data service interface to perform service processing operation on the target service information.
As can be seen from the above description, the electronic device provided in the embodiment of the present application synchronously downloads, in a message middleware manner, target service information uploaded from various service system nodes to a blockchain node to a data lake node below the chain, collecting and cohering target service information in the data lake nodes to form a shared index data service interface in the professional field, provides block data sharing service for the outside, thereby realizing the read-write separation of the data of each service system node block, the data processing on the block chain link points does not need to inquire the original data on the chain, and only needs to call the shared data service interface provided by the data lake nodes to obtain the block data of each service system node, namely, the target service information, effectively improves the data processing performance of the block chain system, and promotes the block data of each service system node to be quickly converted and applied in each service system.
In another embodiment, the blockchain data sharing device may be configured separately from the central processor 9100, for example, the blockchain data sharing device may be configured as a chip connected to the central processor 9100, and the functions of the blockchain data sharing method may be implemented by the control of the central processor.
As shown in fig. 9, the electronic device 9600 may further include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is noted that the electronic device 9600 also does not necessarily include all of the components shown in fig. 9; in addition, the electronic device 9600 may further include components not shown in fig. 9, which may be referred to in the prior art.
As shown in fig. 9, a central processor 9100, sometimes referred to as a controller or operational control, can include a microprocessor or other processor device and/or logic device, which central processor 9100 receives input and controls the operation of the various components of the electronic device 9600.
The memory 9140 can be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information relating to the failure may be stored, and a program for executing the information may be stored. And the central processing unit 9100 can execute the program stored in the memory 9140 to realize information storage or processing, or the like.
The input unit 9120 provides input to the central processor 9100. The input unit 9120 is, for example, a key or a touch input device. Power supply 9170 is used to provide power to electronic device 9600. The display 9160 is used for displaying display objects such as images and characters. The display may be, for example, an LCD display, but is not limited thereto.
The memory 9140 can be a solid state memory, e.g., Read Only Memory (ROM), Random Access Memory (RAM), a SIM card, or the like. There may also be a memory that holds information even when power is off, can be selectively erased, and is provided with more data, an example of which is sometimes called an EPROM or the like. The memory 9140 could also be some other type of device. Memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application/function storage portion 9142, the application/function storage portion 9142 being used for storing application programs and function programs or for executing a flow of operations of the electronic device 9600 by the central processor 9100.
The memory 9140 can also include a data store 9143, the data store 9143 being used to store data, such as contacts, digital data, pictures, sounds, and/or any other data used by an electronic device. The driver storage portion 9144 of the memory 9140 may include various drivers for the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging applications, contact book applications, etc.).
The communication module 9110 is a transmitter/receiver 9110 that transmits and receives signals via an antenna 9111. The communication module (transmitter/receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, which may be the same as in the case of a conventional mobile communication terminal.
Based on different communication technologies, a plurality of communication modules 9110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, may be provided in the same electronic device. The communication module (transmitter/receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide audio output via the speaker 9131 and receive audio input from the microphone 9132, thereby implementing ordinary telecommunications functions. The audio processor 9130 may include any suitable buffers, decoders, amplifiers and so forth. In addition, the audio processor 9130 is also coupled to the central processor 9100, thereby enabling recording locally through the microphone 9132 and enabling locally stored sounds to be played through the speaker 9131.
An embodiment of the present application further provides a computer-readable storage medium capable of implementing all the steps in the blockchain data sharing method in which the execution subject is the server or the client in the above embodiments, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the computer program implements all the steps in the blockchain data sharing method in which the execution subject is the server or the client in the above embodiments, for example, when the processor executes the computer program, the processor implements the following steps:
step S101: and receiving target service information sent by a block chain node, wherein the target service information is sent by a service system node after the block chain node uploads the target service information to the block chain node and the block chain node finishes node consensus operation.
Step S102: and performing collection and cohesion processing on the target service information according to a preset data processing rule, and generating a data service interface according to the target service information subjected to collection and cohesion processing, so that other service system nodes call the data service interface to perform service processing operation on the target service information.
As can be seen from the above description, the computer-readable storage medium provided in the embodiments of the present application synchronously downloads, in a message middleware manner, target service information uploaded to a blockchain node by various service system nodes into a data lake node under a chain, collecting and cohering target service information in the data lake nodes to form a shared index data service interface in the professional field, provides block data sharing service for the outside, thereby realizing the read-write separation of the data of each service system node block, the data processing on the block chain link points does not need to inquire the original data on the chain, and only needs to call the shared data service interface provided by the data lake nodes to obtain the block data of each service system node, namely, the target service information, effectively improves the data processing performance of the block chain system, and promotes the block data of each service system node to be quickly converted and applied in each service system.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The principle and the implementation mode of the invention are explained by applying specific embodiments in the invention, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (12)

1. A method for sharing block chain data, the method comprising:
receiving target service information sent by a block chain node, wherein the target service information is uploaded to the block chain node by a service system node and is issued after the block chain node completes node consensus operation;
and performing collection and cohesion processing on the target service information according to a preset data processing rule, and generating a data service interface according to the target service information subjected to collection and cohesion processing, so that other service system nodes call the data service interface to perform service processing operation on the target service information.
2. The method according to claim 1, wherein the collecting and aggregating the target service information according to a preset data processing rule, and generating a data service interface according to the collected and aggregated target service information comprises:
collecting and aggregating the target service information according to at least one of the main key characteristics, the attribute characteristics and the dimension characteristics of the target service information;
and encapsulating the target service information corresponding to various characteristics to obtain a data service interface.
3. A method for sharing block chain data, the method comprising:
receiving target service information sent by a service system node, and carrying out node consensus operation on the target service information;
and sending the target service information which completes the node consensus operation to a data lake node so that the data lake node performs collection and cohesion processing on the target service information according to a preset data processing rule, and generating a data service interface according to the target service information after the collection and cohesion processing so that other service system nodes call the data service interface to perform service processing operation on the target service information.
4. The method according to claim 3, wherein the sending the target service information for completing the node consensus operation to a data lake node comprises:
and sequentially sending the target service information which completes the node consensus operation in a message queue to the data lake nodes through a preset message middleware, wherein the target service information sequentially sent by the service system nodes is stored in the message queue.
5. A method for sharing block chain data, the method comprising:
and calling a data service interface of a data lake node to perform service processing operation on target service information, wherein the data service interface is generated after the data lake node performs collection and cohesion processing on the target service information according to a preset data processing rule, and the target service information is transmitted to the data lake node after a service system node is uploaded to a block chain node and node consensus operation is completed by the block chain node.
6. The method of claim 5, further comprising:
receiving initial service information and corresponding picture data sent by a user, and obtaining target service information according to a preset structured data mapping rule;
and performing service rechecking on the target service information, and uploading the target service information to a block chain node after the service rechecking is effective.
7. An apparatus for sharing block chain data, comprising:
the system comprises a target service information receiving module, a block chain node and a block service system node, wherein the target service information is transmitted by the block chain node after the block chain node completes node consensus operation;
and the data service interface generating module is used for collecting and aggregating the target service information according to a preset data processing rule and generating a data service interface according to the collected and aggregated target service information so as to enable other service system nodes to call the data service interface to perform service processing operation on the target service information.
8. An apparatus for sharing block chain data, comprising:
the node consensus operation module is used for receiving target service information sent by a service system node and carrying out node consensus operation on the target service information;
and the target service information issuing module is used for sending the target service information which completes the node consensus operation to a data lake node so as to enable the data lake node to carry out collection and cohesion processing on the target service information according to a preset data processing rule, and a data service interface is generated according to the target service information after collection and cohesion processing so as to enable other service system nodes to call the data service interface to carry out service processing operation on the target service information.
9. An apparatus for sharing block chain data, comprising:
the data service interface calling module is used for calling a data service interface of a data lake node to perform service processing operation on target service information, wherein the data service interface is generated by the data lake node after the target service information is collected and cohered according to a preset data processing rule, and the target service information is transmitted to the data lake node after a service system node is uploaded to a block chain node and node consensus operation is completed by the block chain node.
10. A blockchain data sharing system, comprising: data lake nodes, block chain link points and service system nodes;
the data lake node comprises:
the system comprises a target service information receiving module, a block chain node and a block service system node, wherein the target service information is transmitted by the block chain node after the block chain node completes node consensus operation;
the data service interface generating module is used for collecting and aggregating the target service information according to a preset data processing rule and generating a data service interface according to the collected and aggregated target service information so as to enable other service system nodes to call the data service interface to perform service processing operation on the target service information;
the block link point includes:
the node consensus operation module is used for receiving target service information sent by a service system node and carrying out node consensus operation on the target service information;
the target service information issuing module is used for sending the target service information which completes the node consensus operation to the data lake node;
the service system node includes:
and the data service interface calling module is used for calling the data service interface of the data lake node to perform service processing operation on the target service information.
11. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the blockchain data sharing method of any one of claims 1 to 6 when executing the program.
12. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the blockchain data sharing method according to any one of claims 1 to 6.
CN202011634633.XA 2020-12-31 2020-12-31 Block chain data sharing method, device and system Active CN112734545B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011634633.XA CN112734545B (en) 2020-12-31 2020-12-31 Block chain data sharing method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011634633.XA CN112734545B (en) 2020-12-31 2020-12-31 Block chain data sharing method, device and system

Publications (2)

Publication Number Publication Date
CN112734545A true CN112734545A (en) 2021-04-30
CN112734545B CN112734545B (en) 2024-02-02

Family

ID=75608718

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011634633.XA Active CN112734545B (en) 2020-12-31 2020-12-31 Block chain data sharing method, device and system

Country Status (1)

Country Link
CN (1) CN112734545B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113515546A (en) * 2021-07-12 2021-10-19 中国工商银行股份有限公司 Data processing method and device and server

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108234457A (en) * 2017-12-18 2018-06-29 苏州涞泽信息科技有限公司 A kind of credible government data based on block chain shares network system and sharing method
CN109787815A (en) * 2018-12-27 2019-05-21 云南财经大学 Government information resources shared system based on block chain
CN110069932A (en) * 2019-05-08 2019-07-30 济南浪潮高新科技投资发展有限公司 A kind of data lake fused data safety analytical method based on intelligent contract
CN112039986A (en) * 2020-08-28 2020-12-04 刘凤 System and method for realizing information interaction among departments of enterprise
CN112134834A (en) * 2020-05-19 2020-12-25 北京天德科技有限公司 Data lake system architecture based on block chain

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108234457A (en) * 2017-12-18 2018-06-29 苏州涞泽信息科技有限公司 A kind of credible government data based on block chain shares network system and sharing method
CN109787815A (en) * 2018-12-27 2019-05-21 云南财经大学 Government information resources shared system based on block chain
CN110069932A (en) * 2019-05-08 2019-07-30 济南浪潮高新科技投资发展有限公司 A kind of data lake fused data safety analytical method based on intelligent contract
CN112134834A (en) * 2020-05-19 2020-12-25 北京天德科技有限公司 Data lake system architecture based on block chain
CN112039986A (en) * 2020-08-28 2020-12-04 刘凤 System and method for realizing information interaction among departments of enterprise

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113515546A (en) * 2021-07-12 2021-10-19 中国工商银行股份有限公司 Data processing method and device and server

Also Published As

Publication number Publication date
CN112734545B (en) 2024-02-02

Similar Documents

Publication Publication Date Title
CN111031058A (en) Websocket-based distributed server cluster interaction method and device
CN110413673B (en) Database data unified acquisition and distribution method and system
CN110781373B (en) List updating method and device, readable medium and electronic equipment
CN111782470B (en) Distributed container log data processing method and device
CN109586929B (en) Conference content transmission method and device, electronic equipment and storage medium
CN110990482A (en) Data synchronization method and device between asynchronous databases
CN113392158A (en) Service data processing method and device and data center
CN111445331A (en) Transaction matching method and device
CN111510493B (en) Distributed data transmission method and device
CN113435989A (en) Financial data processing method and device
CN112396511B (en) Distributed wind control variable data processing method, device and system
CN112734545A (en) Block chain data sharing method, device and system
CN111367561B (en) Remote development method and device for software program
CN112559158A (en) Micro-service timing task scheduling method and device
CN104506616A (en) Method, device and system for sending information by browser client side
CN113268272B (en) Application delivery method, device and system based on private cloud
CN115495519A (en) Report data processing method and device
CN115134254A (en) Network simulation method, device, equipment and storage medium
CN115205009A (en) Account opening business processing method and device based on virtual technology
CN111061518B (en) Data processing method, system, terminal equipment and storage medium based on drive node
CN113672488A (en) Log text processing method and device
CN112905611A (en) Credit certificate data offline synchronization method, storage method and device based on block chain
CN112417018A (en) Data sharing method and device
CN113342501B (en) System fault processing method and device
CN112565173B (en) Method and apparatus for message processing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant