CN109241361A - Data processing method based on block chain - Google Patents
Data processing method based on block chain Download PDFInfo
- Publication number
- CN109241361A CN109241361A CN201811012227.2A CN201811012227A CN109241361A CN 109241361 A CN109241361 A CN 109241361A CN 201811012227 A CN201811012227 A CN 201811012227A CN 109241361 A CN109241361 A CN 109241361A
- Authority
- CN
- China
- Prior art keywords
- block chain
- keyword
- projects
- project
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present invention discloses a kind of data processing method based on block chain, comprising: whether real-time detection block chain node generates new block；The keyword of project to be checked is inputted, primary key data set is constituted；Keyword in projects file in projects type stored in block chain data memory module is extracted；The keyword for inputting project to be checked keyword corresponding with projects file in projects type of storage is compared one by one；The corresponding item file of degree of association matching factor is sequentially output according to the sequence of degree of association matching factor from high to low.The present invention is in such a way that block chain data memory module stores storing data using synchrodata and temporarily stores, improve the accuracy and safety of data storage, and it is compared by keyword, obtain degree of association matching factor, improve the accuracy to business information inquiry, and recall precision is improved, greatly save the time of data processing.
Description
Technical field
The invention belongs to block chain technical fields, are related to the data processing method based on block chain.
Background technique
Block chain is generally understood as a distributed account book, it is substantially also a distributed computing and storage system
System.Block chain has multiple nodes, and different nodes is reached common understanding by certain computation rule, and the transaction after common recognition is held
Row result is stored in the form of block into database, and multiple blocks constitute block chain.
With the development of block chain technology, as the core technology of decentralization book keeping operation platform, block chain is used in
The various fields such as finance, letter sign, Internet of Things, economic trade clearing and asset management.
During the storage of block chain data, storage can be caused to fail because memory space is abnormal, data is caused to store
Safety it is lower, in addition, needing to be examined according to block number during the data stored in block chain are retrieved
The process of rope is carried out indeed through multiple retrieval in this layout, then is scanned for, and efficiency is very low, while retrieval is accurate
It is fixed relatively low, in order to solve problem above, now design the data processing method based on block chain.
Summary of the invention
The purpose of the present invention is to provide the data processing method based on block chain, solve block chain data processing
In the process, there is a problem of data storage safety is low and the accuracy difference and recall precision of data retrieval are low.
The purpose of the present invention can be achieved through the following technical solutions:
A kind of data processing system based on block chain, including block monitoring modular, keyword input module, block chain number
According to screening module, keyword match analysis module and block chain data memory module；
Keyword match analysis module is connect with keyword input module and block chain data screening module respectively, block counts
It is connect according to screening module with block chain data memory module, block chain data memory module is connect with block monitoring modular.
Further, whether block monitoring modular generates new block for real-time detection block chain node, if generating new district
Domain then extracts the block chain data in new block and the block chain data of extraction is sent to block chain data memory module, institute
Stating block chain data is business information；
Block chain data memory module includes several block chain data storage cells, and the block chain data storage cell is
Region unit, region unit is for storing block chain data information corresponding to disparity items type, to projects type according to setting
Sequence be numbered, respectively 1,2 ..., j ..., m, m are expressed as the total quantity of item types, wrap in same project type
Some projects file is included, some projects file in same project type is successively compiled according to the chronological order of storage
Number, respectively 1,2 ..., k ..., t, t are expressed as the total quantity of projects file in same project type；
In the block chain data for receiving the write-in of block chain link point in the block chain data memory module, and to the area of write-in
Block chain data carry out classification storage according to item types, meanwhile, block chain data memory module is for receiving block monitoring modular
The block chain data of transmission and the storage for carrying out block chain data, the block chain data include several groups business information, and every group
Business information includes project essential information and project specific information；
Keyword input module is used for the keyword for inputting project to be checked, and by the keyword of input according to setting
The sequence of the importance that keyword occurs in business information from high to low is numbered, and the keyword inputted constitutes primary close
The keyword that key digital data set A (a1, a2 ..., ai ..., an), ai expression number order are i, and primary key data
Specific gravity factor shared by keyword in set is respectively ga1, ga2 ..., gai ..., gan, ga1 > ga2 > ... > gai
> ... > gan, ga1+ga2+...+gai+...+gan=1；
Block chain data screening module is connect with block chain data memory module, for in block chain data memory module
Block chain data in each block chain data storage cell carry out keyword screening, constitute block chain keyword and screen set Bjk
(bjk1,bjk2,...,bjkf,...,bjkH), bjkF is expressed as the f extracted in k-th of item file in j-th of item types
The keyword of screening is sent to keyword match analysis module by a keyword, block chain data screening module；
Keyword match analysis module receives the keyword that keyword input module is sent and receives block chain data sieve
The corresponding keyword of projects file in projects type that modeling block is sent, and by the keyword to be detected and projects of input
Keyword in type in projects file is compared one by one, obtains keyword match comparison set B 'jk(b′jk1,b′jk2,...,b′jki,...,b′jkN), b 'jkI is expressed as whether occurring i-th in k-th of item file in j-th of item types
Keyword to be detected inputs keyword to be detected if existing in the keyword screened in k-th of project text in j-th of item types
In i-th of keyword, then take b 'jkI is equal to 1, otherwise, takes b 'jkI is equal to 0；
Keyword match analysis module compares in set statistics input keyword and projects type according to keyword match
The degree of association matching factor of projects file, and project information is successively sent according to the sequence of degree of association matching factor from high to low
Acquisition instruction to block chain data memory module, the block chain data of block chain data memory module storage successively feed back to key
Word matching analysis module, keyword match analysis module successively export corresponding block chain data information, wherein the association
Degree matching factor calculation formula beb′jkI is expressed as in j-th of item types
Whether i-th to be detected keyword is occurred in k-th of item file, and n is expressed as the quantity of keyword to be detected, and gai is expressed as
Specific gravity factor corresponding to the keyword that the keyword number of input is i.
Further, the business information includes project essential information and project specific information.
Further, project essential information includes project name, project application condition, item types, project specific information
Including contents of a project introduction, Project in Operation mode, and the item types include agricultural projects, education programs, hydraulic engineering item
Mesh, Health Project.
Further, the block chain data memory module includes memory database, disk database, the first interim storage
Map unit and the second interim storage mapping unit, the memory database and disk database are used for memory block chain link simultaneously
The block chain data of point write-in, the first interim storage mapping unit are connect with memory database, are used for scratchpad area (SPA) block
The block chain data of chain node write-in, and the block chain data of storage are sent to memory database, the second interim storage mapping
Unit is connect with disk database, for the block chain data of scratchpad area (SPA) block chain node write-in, and by the block chain of storage
Data are sent in disk database.
Further, when block chain node read area block chain data, node first obtains block chain from memory database
Data read block chain data, and the block chain that will be read from disk database if obtaining failure from disk database
Data are synchronized in memory database；
When block chain data failure is written in the inside deposit data library of block chain node, block chain node is by block chain data
It stores into the first interim storage mapping unit, until recovery of MMDB, node will be stored to the first interim storage mapping
In block chain data write-in memory database in unit.
When block chain data failure is written into disk database for block chain node, block chain node is by block chain data
It stores into the second interim storage mapping unit, until disk database restores, node will be stored to the second interim storage mapping
In block chain data write-in disk database in unit.
A kind of data processing method based on block chain, comprising the following steps:
Whether S1, real-time detection block chain node generate new block, if generating new region, extract the block in new block
The block chain data of extraction are simultaneously sent to block chain data memory module by chain data；
The keyword of S2, input project to be checked constitute primary key data set, and are arranged shared by each keyword
Specific gravity factor；
S3, the keyword in projects file in projects type stored in block chain data memory module is carried out
It extracts, constitutes block chain keyword screening set；
S4, keyword and storage that project to be checked will be inputted projects type in the corresponding key of projects file
Word is compared one by one, and counts the degree of association matching factor of projects file Yu project to be checked；
S5, the corresponding project text of degree of association matching factor is sequentially output according to the sequence of degree of association matching factor from high to low
Part.
Beneficial effects of the present invention:
Data processing system and method provided by the invention based on block chain, by block chain data memory module to depositing
Storage data improve the accuracy and safety of data storage in such a way that synchrodata stores and temporarily stores, and lead to
The corresponding keyword of projects file that will be stored in the keyword of business to be checked and block chain data memory module is crossed to carry out
Comparison, obtains degree of association matching factor, improves the accuracy to business information inquiry, and improve recall precision, saves significantly
The about time of data processing.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, will be described below to embodiment required
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for ability
For the those of ordinary skill of domain, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 is a kind of schematic diagram of the data processing system based on block chain in the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts all other
Embodiment shall fall within the protection scope of the present invention.
Refering to Figure 1, a kind of data processing system based on block chain, including block monitoring modular, keyword are defeated
Enter module, block chain data screening module, keyword match analysis module and block chain data memory module；
Keyword match analysis module is connect with keyword input module and block chain data screening module respectively, block counts
It is connect according to screening module with block chain data memory module, block chain data memory module is connect with block monitoring modular；
Whether block monitoring modular generates new block for real-time detection block chain node, if generating new region, extracts
The block chain data of extraction are simultaneously sent to block chain data memory module, the block chain number by block chain data in new block
According to for business information, the business information includes project essential information and project specific information, wherein project essential information includes
Project name, project application condition, item types etc., project specific information include contents of a project introduction, Project in Operation mode etc.,
The item types include agricultural projects, education programs, water project, Health Project etc.；
Block chain data memory module includes several block chain data storage cells, and the block chain data storage cell is
Region unit, region unit is for storing block chain data information corresponding to disparity items type, according to the agricultural in item types
The sequence of project, education programs, water project, Health Project is successively numbered projects type, and respectively 1,
2 ..., j ..., m, m are expressed as the total quantity of item types, include some projects file in same project type, to same item
Some projects file in mesh type is successively numbered according to the chronological order of storage, respectively 1,2 ..., k ...,
T, t are expressed as the total quantity of projects file in same project type；
In the block chain data for receiving the write-in of block chain link point in the block chain data memory module, and to the area of write-in
Block chain data carry out classification storage according to item types, meanwhile, block chain data memory module is for receiving block monitoring modular
The block chain data of transmission and the storage for carrying out block chain data, the block chain data include several groups business information, and every group
Business information includes project essential information and project specific information, and the block chain data memory module includes internal storage data
Library, disk database, the first interim storage mapping unit and the second interim storage mapping unit, the memory database and disk
Database is used for the block chain data of memory block chain node write-in, the first interim storage mapping unit and memory number simultaneously
It is connected according to library, for the block chain data of scratchpad area (SPA) block chain node write-in, and in the block chain data of storage are sent to
Deposit data library, the second interim storage mapping unit are connect with disk database, the area for the write-in of scratchpad area (SPA) block chain node
Block chain data, and the block chain data of storage are sent in disk database.
When block chain node read area block chain data, node first obtains block chain data from memory database, if obtaining
Failure is taken, then reads block chain data from disk database, and the block chain data read from disk database are synchronous
Into memory database.
In addition, when block chain data failure is written in the inside deposit data library of block chain node, block chain node is by block
Chain data are stored into the first interim storage mapping unit, until recovery of MMDB, node will be stored to first and temporarily deposited
It stores up in the block chain data write-in memory database in map unit.
When block chain data failure is written into disk database for block chain node, block chain node is by block chain data
It stores into the second interim storage mapping unit, until disk database restores, node will be stored to the second interim storage mapping
In block chain data write-in disk database in unit.
Keyword input module is used for the keyword for inputting project to be checked, and by the keyword of input according to setting
The sequence of the importance that keyword occurs in business information from high to low is numbered, and the keyword inputted constitutes primary close
The keyword that key digital data set A (a1, a2 ..., ai ..., an), ai expression number order are i, and primary key data
Specific gravity factor shared by keyword in set is respectively ga1, ga2 ..., gai ..., gan, ga1 > ga2 > ... > gai
> ... > gan, ga1+ga2+...+gai+...+gan=1；
Block chain data screening module is connect with block chain data memory module, for in block chain data memory module
Block chain data in each block chain data storage cell carry out keyword screening, constitute block chain keyword and screen set Bjk
(bjk1,bjk2,...,bjkf,...,bjkH), bjkF is expressed as the f extracted in k-th of item file in j-th of item types
The keyword of screening is sent to keyword match analysis module by a keyword, block chain data screening module；
Keyword match analysis module receives the keyword that keyword input module is sent and receives block chain data sieve
The corresponding keyword of projects file in projects type that modeling block is sent, and by the keyword to be detected and projects of input
Keyword in type in projects file is compared one by one, obtains keyword match comparison set B 'jk(b′jk1,b′jk2,...,b′jki,...,b′jkN), b 'jkI is expressed as whether occurring i-th in k-th of item file in j-th of item types
Keyword to be detected inputs keyword to be detected if existing in the keyword screened in k-th of project text in j-th of item types
In i-th of keyword, then take b 'jkI is equal to 1, otherwise, takes b 'jkI is equal to 0；
Keyword match analysis module compares in set statistics input keyword and projects type according to keyword match
The degree of association matching factor of projects file, and project information is successively sent according to the sequence of degree of association matching factor from high to low
Acquisition instruction to block chain data memory module, the block chain data of block chain data memory module storage successively feed back to key
Word matching analysis module, keyword match analysis module successively export corresponding block chain data information, wherein the association
Degree matching factor calculation formula beb′jkI is expressed as in j-th of item types
Whether i-th to be detected keyword is occurred in k-th of item file, and n is expressed as the quantity of keyword to be detected, and gai is expressed as
Specific gravity factor corresponding to the keyword that the keyword number of input is i.
A kind of data processing method based on block chain, comprising the following steps:
Whether S1, real-time detection block chain node generate new block, if generating new region, extract the block in new block
The block chain data of extraction are simultaneously sent to block chain data memory module by chain data；
The keyword of S2, input project to be checked constitute primary key data set, and are arranged shared by each keyword
Specific gravity factor；
S3, the keyword in projects file in projects type stored in block chain data memory module is carried out
It extracts, constitutes block chain keyword screening set；
S4, keyword and storage that project to be checked will be inputted projects type in the corresponding key of projects file
Word is compared one by one, and counts the degree of association matching factor of projects file Yu project to be checked；
S5, the corresponding project text of degree of association matching factor is sequentially output according to the sequence of degree of association matching factor from high to low
Part.
Data processing system and method provided by the invention based on block chain, by block chain data memory module to depositing
Storage data improve the accuracy and safety of data storage in such a way that synchrodata stores and temporarily stores, and lead to
The corresponding keyword of projects file that will be stored in the keyword of business to be checked and block chain data memory module is crossed to carry out
Comparison, obtains degree of association matching factor, improves the accuracy to business information inquiry, and improve recall precision, saves significantly
The about time of data processing.
The above content is just an example and description of the concept of the present invention, affiliated those skilled in the art
It makes various modifications or additions to the described embodiments or is substituted in a similar manner, without departing from invention
Design or beyond the scope defined by this claim, be within the scope of protection of the invention.
Claims (2)
1. a kind of data processing method based on block chain, it is characterised in that: the following steps are included:
Whether S1, real-time detection block chain node generate new block；
The keyword of S2, input project to be checked constitute primary key data set；
S3, the keyword stored in block chain data memory module is extracted, constitutes block chain keyword screening set；
S4, keyword and storage that project to be checked will be inputted projects type in the corresponding keyword pair of projects file
Than；
S5, the corresponding item file of output degree of association matching factor.
2. a kind of data processing method based on block chain as described in claim 1, it is characterised in that: the following steps are included:
Whether S1, real-time detection block chain node generate new block, if generating new region, extract the block chain number in new block
Block chain data memory module is sent to according to and by the block chain data of extraction；
The keyword of S2, input project to be checked constitute primary key data set, and specific gravity shared by each keyword are arranged
Coefficient；
S3, the keyword in projects file in projects type stored in block chain data memory module is mentioned
It takes, constitutes block chain keyword screening set；
S4, keyword and storage that project to be checked will be inputted projects type in the corresponding keyword of projects file into
Row compares one by one, and counts the degree of association matching factor of projects file Yu project to be checked；
S5, the corresponding item file of degree of association matching factor is sequentially output according to the sequence of degree of association matching factor from high to low.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811012227.2A CN109241361A (en) | 2018-08-31 | 2018-08-31 | Data processing method based on block chain |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811012227.2A CN109241361A (en) | 2018-08-31 | 2018-08-31 | Data processing method based on block chain |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109241361A true CN109241361A (en) | 2019-01-18 |
Family
ID=65069157
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811012227.2A Pending CN109241361A (en) | 2018-08-31 | 2018-08-31 | Data processing method based on block chain |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109241361A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110162540A (en) * | 2019-04-17 | 2019-08-23 | 平安科技（深圳）有限公司 | Querying method, electronic device and the storage medium of block chain account book data |
| CN110598043A (en) * | 2019-09-24 | 2019-12-20 | 腾讯科技（深圳）有限公司 | Video processing method and device, computer equipment and storage medium |
| CN111368004A (en) * | 2020-03-16 | 2020-07-03 | 深圳市望岳安全技术有限公司 | Block chain financial data processing system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101146288A (en) * | 2007-09-24 | 2008-03-19 | 中兴通讯股份有限公司 | A SMS mobile search method and system |
| CN106294595A (en) * | 2016-07-29 | 2017-01-04 | 海尔优家智能科技（北京）有限公司 | A kind of document storage, search method and device |
| CN106845210A (en) * | 2017-01-19 | 2017-06-13 | 布比（北京）网络技术有限公司 | Event authentication method and apparatus |
| US20170286880A1 (en) * | 2012-09-28 | 2017-10-05 | Rex Wiig | System and method of a requirement, compliance and resource management |
| CN107239479A (en) * | 2017-03-28 | 2017-10-10 | 阿里巴巴集团控股有限公司 | A kind of method and device of data storage and inquiry based on block chain |
| CN107943951A (en) * | 2017-11-24 | 2018-04-20 | 中钞信用卡产业发展有限公司杭州区块链技术研究院 | A kind of search method and system of block chain business information |
| US10061834B1 (en) * | 2014-10-31 | 2018-08-28 | Amazon Technologies, Inc. | Incremental out-of-place updates for datasets in data stores |
-
2018
- 2018-08-31 CN CN201811012227.2A patent/CN109241361A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101146288A (en) * | 2007-09-24 | 2008-03-19 | 中兴通讯股份有限公司 | A SMS mobile search method and system |
| US20170286880A1 (en) * | 2012-09-28 | 2017-10-05 | Rex Wiig | System and method of a requirement, compliance and resource management |
| US10061834B1 (en) * | 2014-10-31 | 2018-08-28 | Amazon Technologies, Inc. | Incremental out-of-place updates for datasets in data stores |
| CN106294595A (en) * | 2016-07-29 | 2017-01-04 | 海尔优家智能科技（北京）有限公司 | A kind of document storage, search method and device |
| CN106845210A (en) * | 2017-01-19 | 2017-06-13 | 布比（北京）网络技术有限公司 | Event authentication method and apparatus |
| CN107239479A (en) * | 2017-03-28 | 2017-10-10 | 阿里巴巴集团控股有限公司 | A kind of method and device of data storage and inquiry based on block chain |
| CN107943951A (en) * | 2017-11-24 | 2018-04-20 | 中钞信用卡产业发展有限公司杭州区块链技术研究院 | A kind of search method and system of block chain business information |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110162540A (en) * | 2019-04-17 | 2019-08-23 | 平安科技（深圳）有限公司 | Querying method, electronic device and the storage medium of block chain account book data |
| CN110162540B (en) * | 2019-04-17 | 2023-06-06 | 平安科技（深圳）有限公司 | Block chain account book data query method, electronic device and storage medium |
| CN110598043A (en) * | 2019-09-24 | 2019-12-20 | 腾讯科技（深圳）有限公司 | Video processing method and device, computer equipment and storage medium |
| CN110598043B (en) * | 2019-09-24 | 2024-02-09 | 腾讯科技（深圳）有限公司 | Video processing method, device, computer equipment and storage medium |
| CN111368004A (en) * | 2020-03-16 | 2020-07-03 | 深圳市望岳安全技术有限公司 | Block chain financial data processing system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105468605B (en) | Entity information map generation method and device | |
| CN110489561A (en) | Knowledge mapping construction method, device, computer equipment and storage medium | |
| CN110275920A (en) | Data query method, apparatus, electronic equipment and computer readable storage medium | |
| CN109241361A (en) | Data processing method based on block chain | |
| CN109271362A (en) | A kind of data processing system based on block chain | |
| CN112612908A (en) | Natural resource knowledge graph construction method and device, server and readable memory | |
| CN110471917B (en) | Intelligent customs declaration and customs clearance filling method based on historical data mining | |
| CN110458324A (en) | Calculation method, device and the computer equipment of risk probability | |
| CN104133838A (en) | Data processing method and system with system detection function | |
| CN115438199A (en) | Knowledge platform system based on smart city scene data middling platform technology | |
| CN109408574A (en) | Complaint confirmation of responsibility system based on Text Mining Technology | |
| CN109145016A (en) | A kind of finance internet big data searching system | |
| CN108228787A (en) | According to the method and apparatus of multistage classification processing information | |
| Dias et al. | A method for the identification of collaboration in large scientific databases | |
| CN104657130A (en) | Method for hierarchically layering business support system | |
| CN110008239A (en) | Logic based on precomputation optimization executes optimization method and system | |
| CN115481111A (en) | Data fusion method and device, computer equipment and storage medium | |
| Andrews et al. | Knowledge discovery through creating formal contexts | |
| CN114691835A (en) | Audit plan data generation method, device and equipment based on text mining | |
| CN114817557A (en) | Enterprise risk detection method and device based on enterprise credit investigation big data knowledge graph | |
| CN104239314A (en) | Search word expanding method and system | |
| Marple et al. | Collapsing corporate confusion: Leveraging network structures for effective entity resolution in relational corporate data | |
| CN106326472B (en) | One kind investigation information integrity verification method | |
| Nogueira et al. | pytwanalysis: Twitter data management and analysis at scale | |
| CN108595691A (en) | A kind of novel library structure data processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190118 |