CN113434520A - Block chain based data storage and query method, device, equipment and medium - Google Patents
Block chain based data storage and query method, device, equipment and medium Download PDFInfo
- Publication number
- CN113434520A CN113434520A CN202110995156.8A CN202110995156A CN113434520A CN 113434520 A CN113434520 A CN 113434520A CN 202110995156 A CN202110995156 A CN 202110995156A CN 113434520 A CN113434520 A CN 113434520A
- Authority
- CN
- China
- Prior art keywords
- data
- project
- storage
- storage device
- chain
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2379—Updates performed during online database operations; commit processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/205—Parsing
- G06F40/216—Parsing using statistical methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/279—Recognition of textual entities
- G06F40/289—Phrasal analysis, e.g. finite state techniques or chunking
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Software Systems (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Computer Security & Cryptography (AREA)
- Mathematical Physics (AREA)
- Computing Systems (AREA)
- Probability & Statistics with Applications (AREA)
- Computer Hardware Design (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the application discloses a data storage and query method, a device, equipment and a medium based on a block chain, wherein the storage method comprises the following steps: collecting project data of at least one power grid infrastructure project; according to project attributes of power grid infrastructure projects to which the project data belong, packaging the project data to generate at least one data set, and determining storage equipment corresponding to each data set in a storage equipment chain; respectively storing each data set to corresponding storage equipment; generating data hash of the first storage device in the storage device chain according to the locally stored data set, and locally storing the data hash; and aiming at each non-first storage device in the storage device chain, generating self data hash according to the data set stored locally and the data hash of the previous storage device, and storing locally. According to the technical scheme, the storage pressure on mass project data is reduced, and the storage safety is improved.
Description
Technical Field
The embodiment of the application relates to the technical field of data processing, in particular to a data storage and query method, a data storage and query device, data storage and query equipment and a data storage and query medium based on a block chain.
Background
The power grid infrastructure project is a power grid infrastructure project which mainly aims at expanding power transmission and distribution capacity according to a certain project rule program and a certain amount of investment money to complete new construction, expansion and the like.
The power grid infrastructure project has the influence of a plurality of factors such as large construction difficulty, long construction period and more participating main bodies, so that massive project data can be generated in the construction period. Therefore, how to reduce the storage pressure of mass project data and improve the storage safety becomes a technical problem to be solved urgently.
Disclosure of Invention
The application provides a data storage and query method, a device, equipment and a medium based on a block chain, so that the storage pressure of mass data is reduced, and the storage safety is improved.
In a first aspect, the present application provides a data storage method based on a block chain, including:
collecting project data of at least one power grid infrastructure project;
according to the project attributes of the power grid infrastructure projects to which the project data belong, packaging the project data to generate at least one data set, and determining storage equipment corresponding to each data set in a storage equipment chain;
respectively storing each data set to corresponding storage equipment;
generating data hash of the first storage device in the storage device chain according to a locally stored data set, and locally storing the data hash;
and aiming at each non-first storage device in the storage device chain, generating self data hash according to the data set stored locally and the data hash of the previous storage device, and storing locally.
In a second aspect, the present application further provides a data query method based on a block chain, including:
reading project data of each power grid infrastructure project from a storage equipment chain; the storage device chain stores data by adopting the method provided by the embodiment of the first aspect;
creating at least one index field according to the data type of the project data;
and storing the item data in a preset database for query based on the index field.
In a third aspect, the present application further provides a data storage device in a block chain, including:
the project data acquisition module is used for acquiring project data of at least one power grid infrastructure project;
the data set packaging module is used for packaging the project data to generate at least one data set according to the project attributes of the power grid infrastructure projects to which the project data belong, and determining storage equipment corresponding to each data set in a storage equipment chain;
the data set storage module is used for respectively storing each data set to corresponding storage equipment;
the data hash generation module is used for generating data hash of the first storage device in the storage device chain according to the locally stored data set and locally storing the data hash;
and the data hash generation module is further configured to generate, for each non-first storage device in the storage device chain, a data hash of itself according to the locally stored data set and the data hash of the previous storage device, and locally store the data hash.
In a fourth aspect, the present application further provides a data query apparatus based on a block chain, including:
the project data reading module is used for reading project data of each power grid infrastructure project from the storage equipment chain; the storage device chain stores data by adopting the method provided by the embodiment of the first aspect;
the index field creating module is used for creating at least one index field according to the data type of the project data;
and the item data storage module is used for storing the item data in a preset database for query based on the index field.
In a fifth aspect, the present application further provides an electronic device, including:
one or more processors;
a memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the method for storing data based on the block chain as provided in the embodiment of the first aspect; and/or, implementing the data query method based on the block chain provided by the embodiment of the second aspect.
In a sixth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the method for storing data based on a block chain as provided in the embodiment of the first aspect; and/or, implementing the data query method based on the block chain provided by the embodiment of the second aspect.
According to the embodiment of the application, the project data are stored in different storage devices in a scattered manner, so that the storage pressure of a single storage device is reduced. In the non-first storage device, the data hash of the storage device is generated and stored locally based on the data hash of the data set and the data hash of the previous storage device, so that random modification of data stored in a storage device chain is avoided, and the safety of the stored data in the storage device chain is ensured.
Drawings
Fig. 1A is a flowchart of a data storage method based on a block chain according to an embodiment of the present application;
FIG. 1B is a schematic structural diagram of a storage device chain according to an embodiment of the present disclosure;
fig. 2 is a flowchart of another block chain-based data storage method according to an embodiment of the present application;
fig. 3 is a flowchart of a data query method based on a blockchain according to an embodiment of the present disclosure;
fig. 4 is a block diagram of a data storage device based on a block chain according to an embodiment of the present application;
fig. 5 is a block diagram of a data query apparatus based on a block chain according to an embodiment of the present application;
fig. 6 is a block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.
Example one
Fig. 1A is a flowchart of a data storage method based on a block chain according to an embodiment of the present application, where the embodiment is suitable for a case of storing mass item data. The block chain-based data storage method provided by the embodiment of the present application may be executed by a data storage device, and the data storage device may be implemented by software and/or hardware and is specifically configured in an electronic device. Illustratively, the electronic device may be a server.
Referring to fig. 1A, the block chain based data storage method includes:
s101, collecting project data of at least one power grid infrastructure project.
The project data of the power grid infrastructure project can be data of the power grid infrastructure project collected based on different project collection fields. The project collection fields used by different projects may be different or at least partially the same, and the project collection field corresponding to each project may be determined by a technician according to actual needs or project attributes.
For example, the item collection field may be determined based on the voltage level of the item.
Alternatively, the voltage levels may include two levels of 35 kv and above, and 10 kv and below.
In a specific implementation manner, the project acquisition fields corresponding to the voltage classes of 35 kv and above may include, but are not limited to, first-level project acquisition fields such as project book information, construction scale, new start-up scale of the project, production capacity of the year, investment plan, initial investment composition, start-up time, project progress, actual construction progress of the power transformation project, actual construction progress of the overhead line project, actual construction progress of the cable line project, production time, and posting cost for four charges.
For example, a portion of the primary project collection fields may further include secondary project collection fields, and a portion of the secondary project collection fields may further include tertiary project collection fields. For example, project base information may include, but is not limited to, secondary project collection fields such as project name, project code, singleton code, WBS (Work Break Down Structure) code, and voltage level. At least one of the construction size, the new start-up size and the capacity of the year may include, but is not limited to, secondary project acquisition fields such as bars, lengths, seats, stands and capacities. The investment plan may include, but is not limited to, secondary project collection fields such as cumulative delivery plans and year delivery plans. The initial investment composition can include, but is not limited to, secondary project acquisition fields such as initial total investment, construction project cost, installation project cost, equipment purchase cost and other cost; the other fees may include, but are not limited to, construction site levying and clearing fees, project supervision fees, project upfront work fees, reconnaissance design fees, and construction loan interest, among other three-level project collection fields. The project progress condition can include, but is not limited to, secondary project acquisition fields such as power transformation project progress, overhead line progress and cable line progress; the power transformation project progress can include, but is not limited to, three-level project acquisition fields such as a civil engineering completion progress, an installation completion progress and a debugging completion progress; the overhead line progress can include, but is not limited to, three-level project acquisition fields such as a foundation completion progress, a tower building completion progress and an overhead line completion progress; the cable route progress may include, but is not limited to, three levels of project acquisition fields, channel completion progress, installation completion progress, and debugging completion progress. The actual construction progress of the power transformation project can include, but is not limited to, secondary project acquisition fields such as civil engineering milestones and subsection project completion time thereof, equipment installation milestones and subsection project completion time thereof, and equipment debugging milestones and subsection project completion time thereof. The actual construction progress of the overhead line project can include, but is not limited to, secondary project acquisition fields such as basic milestones and subsection project completion time thereof, tower building milestones and subsection project completion time thereof, and stringing milestones and subsection project completion time thereof. The actual construction progress of the cable line project can include, but is not limited to, secondary project acquisition fields such as completion time of a passage and a subsection project thereof, completion time of a laying milestone and a subsection project thereof, and completion time of a debugging milestone and a subsection project thereof. The four-item charge entry cost can include, but is not limited to, secondary item collection fields such as accumulated entry cost from the beginning, construction installation project cost, equipment purchase cost and other expenses; the other fees may include, but are not limited to, construction site levying and clearing fees, project supervision fees, project upfront work fees, construction period loan interest, production preparation fees, and the like.
In another specific implementation manner, the project collection fields corresponding to voltage levels of 10 kv and below may include, but are not limited to, first-level project collection fields such as project basic information, construction scale, new start scale of the year, capacity of production of the year, investment plan, initial investment, start time, production time, cost entry and material.
For example, a portion of the primary project collection fields may further include secondary project collection fields, and a portion of the secondary project collection fields may further include tertiary project collection fields. For example, project base information may include, but is not limited to, project name, project code, single project code, WBS code, and secondary project collection fields such as voltage level. At least one of the construction size, the new start-up size and the capacity of the year may include, but is not limited to, secondary project acquisition fields such as bars, lengths, seats, stands and capacities. The investment plan may include, but is not limited to, secondary project collection fields such as cumulative delivery plans and year delivery plans. Cost posting may include, but is not limited to, secondary item collection fields that accumulate posting costs from the beginning; the accumulated posting cost from the beginning may include, but is not limited to, three-level project collection fields, such as material type accumulated cost posting from the beginning and service type accumulated cost posting. The supplies may include, but are not limited to, secondary item collection fields such as total amount of material received and total amount of material returned.
And S102, according to the project attributes of the power grid infrastructure projects to which the project data belong, packaging the project data to generate at least one data set, and determining the storage device corresponding to each data set in the storage device chain.
Wherein the item attribute may include at least one of a voltage level and an item partition, etc.
The storage device chain may be understood as a device cluster formed by a plurality of storage devices numbered in a certain order, and data storage may be performed in the cluster.
Illustratively, the data capacity of the data set is reduced by packing the project data in batches according to the project attributes; and determining storage equipment corresponding to different data sets in the storage equipment chain according to the item attributes, so that the different data sets can be stored in different storage equipment in a distributed manner.
In an optional embodiment, association relations between different item attributes and the storage devices may be pre-constructed, so that data set generation and determination of corresponding storage devices are performed based on the association relations.
It should be noted that different data sets may correspond to the same storage device, and the number of data sets and the number of storage devices are not limited in this application, and only the data sets are required to have corresponding storage devices in a one-to-one correspondence.
It will be appreciated that for ease of management, the size of the data set is typically controlled to within a certain range.
And S103, storing each data set to a corresponding storage device respectively.
Different data sets are respectively stored in corresponding storage devices, so that distributed storage of the data sets is realized, and the storage pressure of a single storage device is reduced.
And S104, generating self data hash according to the locally stored data set aiming at the first storage device in the storage device chain, and locally storing the data hash.
And S105, aiming at each non-first storage device in the storage device chain, generating self data hash according to the data set stored locally and the data hash of the previous storage device, and storing locally.
In order to ensure data security and avoid data from being maliciously tampered, data hash can be introduced into each storage device in the data storage process, and association among different storage devices is established through the data hash.
Illustratively, for a first storage device in a storage device chain, determining a set hash of each data set in the storage device; and generating data hash of the storage device according to the set hash, and storing the data hash locally. Determining a set hash of each data set in a storage device aiming at a non-first storage device in a storage device chain; and generating the data hash of the storage device according to the set hashes and the data hash of the previous storage device, and storing the data hash of the storage device locally.
It can be understood that, in the adjacent storage devices, the data hash of the former storage device constrains the data hash of the latter storage device, thereby avoiding the random modification of the data in the storage devices and ensuring the storage safety of the data.
See FIG. 1B for a schematic diagram of a chain of storage devices. In the figure, it is exemplarily given that the chain of storage devices includes n storage devices. Each storage device EiIn which a data set S is storedi1-SimAnd a data hash of itself. Wherein m is the storage device EiThe total number of current data sets in. The arrows for any pair of adjacent storage devices indicate the sequence of the storage devices in the chain of storage devices. Wherein, the storage device E1Data hash of (H)1S based on local storage11-S1mDetermining; other storage devices Ei+1Data hash H of (where i =1,2, …, n-1)i+1Based on locally stored data sets S(i+1)1-S(i+1)mAnd a previous storage device EiData hash of (H)iAnd (4) determining. It should be noted that the total number m of current data sets in different storage device chains may be the same or different.
According to the embodiment of the application, the project data are stored in different storage devices in a scattered manner, so that the storage pressure of a single storage device is reduced. In the non-first storage device, the data hash of the storage device is generated and stored locally based on the data hash of the data set and the data hash of the previous storage device, so that random modification of data stored in a storage device chain is avoided, and the safety of the stored data in the storage device chain is ensured.
Example two
Fig. 2 is a flowchart of another block chain-based data storage method according to an embodiment of the present application, where the embodiment is optimized and improved based on the technical solutions of the foregoing embodiments.
Further, additionally collecting project updating data of the project to be updated; according to the item attributes of the items to be updated, packaging the item update data to generate a data update set, and determining the storage equipment to be updated corresponding to the data update set in the storage equipment chain; sequentially updating the local data set and the data hash in the storage equipment to be updated according to the data updating set; and sequentially updating the data hashes of other storage devices behind the storage device to be updated in the storage device chain according to the data hashes of the storage device to be updated so as to update the stored project data.
In the embodiment, reference may be made to the description of the foregoing embodiment.
Referring to fig. 2, the method for storing data based on a block chain includes:
s201, collecting project data of at least one power grid infrastructure project.
S202, according to project attributes of power grid infrastructure projects to which project data belong, packing the project data to generate at least one data set, and determining storage equipment corresponding to each data set in a storage equipment chain.
And S203, storing each data set to a corresponding storage device.
And S204, generating self data hash according to the locally stored data set aiming at the first storage device in the storage device chain, and locally storing the data hash.
S205, aiming at each non-first storage device in the storage device chain, generating self data hash according to the data set stored locally and the data hash of the previous storage device, and storing locally.
And S206, collecting the project updating data of the project to be updated.
Wherein the item update data may include at least one of item modification data, item addition data, and item deletion data. Different item update data may be distinguished by adding an update identification. Generally, the project update data is new project data generated along with the development of the power grid infrastructure project.
In an optional embodiment, the collection of the item update data of the item to be updated is performed according to a certain update period.
It should be noted that, when a plurality of power grid infrastructure projects are provided, to avoid confusion in the project data updating process, the update time node of each power grid infrastructure project is usually predetermined, so as to ensure that only one and only one project data of a power grid infrastructure project is updated in the same time.
It can be understood that, in order to ensure the relative synchronous update of different power grid infrastructure projects, the same update period is usually adopted to update each power grid infrastructure project in turn.
And S207, according to the item attribute of the item to be updated, packaging the item update data to generate a data update set, and determining the storage equipment to be updated corresponding to the data update set in the storage equipment chain.
According to the project attributes of the projects to be updated, the project updating data can be divided into at least one data updating set, and the storage devices to be updated corresponding to the data updating sets are determined.
And S208, sequentially updating the local data set and the data hash in the storage equipment to be updated according to the data updating set.
In an optional embodiment, if the item update data includes item modification data, replacing the item modification data with response data in the storage device to be updated, thereby implementing updating of the local data set of the storage device to be updated; and regenerating the data hash of the storage equipment to be updated according to the updated local data set.
In another optional embodiment, if the item update data includes item addition data, sequentially adding the item addition data to the storage device to be updated, thereby updating the local data set of the storage device to be updated; and regenerating the data hash of the storage equipment to be updated according to the updated local data set.
In another optional embodiment, if the item update data includes item deletion data, the item deletion data is directly deleted in the storage device to be updated, so as to update the local data set of the storage device to be updated; and regenerating the data hash of the storage equipment to be updated according to the updated local data set.
For example, regenerating the data hash of the storage device to be updated according to the updated local data set may be: determining the set hash of each data set in the local data set; and generating the data hash of the storage equipment to be updated according to the set hashes and the data hash of the previous storage equipment.
It should be noted that, during the process of storing or updating data, a full device may occur due to the data storage amount of the storage device, which will affect the adding operation of the item data corresponding to the full device. In order to avoid the situation that the data update is not timely due to the fact that the devices are full, in an optional embodiment, the full devices in the storage device chain can be further identified; control migrates at least a portion of the data set in the fully loaded device to the associated storage device of the fully loaded device.
And S209, sequentially updating the data hashes of other storage devices positioned behind the storage device to be updated in the storage device chain according to the data hashes of the storage device to be updated.
The hash of the data of the storage device to be updated may change along with the addition, deletion, or modification of the data in the storage device to be updated. The data hashes of other storage devices located behind the storage device to be updated in the storage device chain will directly or indirectly receive the influence of the data hashes in the storage device to be updated, and therefore, after the data hashes of the storage device to be updated are updated, the data hashes of other storage devices located behind the storage device to be updated need to be updated in a correlated manner.
For example, according to the data hashes of the storage devices to be updated, the data hashes of other storage devices located after the storage device to be updated in the storage device chain are sequentially updated, which may be: aiming at a first non-updated storage device positioned behind a storage device to be updated in a storage device chain, generating a new data hash according to a local data set of the first non-updated storage device and a data hash of a previous storage device, so as to realize a thinner operation on the data hash of the non-updated storage device; and sequentially obtaining the next un-updated storage device, and updating the corresponding data hash until the tail storage device in the storage device chain is updated.
According to the method and the device, when the stored project data need to be updated, the project data of the project to be updated, which corresponds to the storage device to be updated, is updated, the data hash of the storage device to be updated and the data hash of other storage devices behind the storage device to be updated are associated and updated, so that the updating mechanism of the stored project data is perfected, the ordered execution of the project data updating process in the whole storage device chain is realized, and the data confusion caused by random project data updating is avoided.
In order to avoid the waste of computing resources caused by data tampering, in an optional embodiment, before updating the local data set and the data hash in the storage device to be updated, an authority verification mechanism may be further introduced, and only in the case that the local data set and the data hash of the storage device to be updated are verified, the update operation of the local data set and the data hash of the storage device to be updated is executed, otherwise, the update operation of the local data set and the data hash of the storage device to be updated is prohibited.
Illustratively, before updating the local data set and the data hash in the storage device to be updated according to the data update set, controlling the storage device to be updated to send a data update request to an authority verification device in the storage device chain, so that the authority verification device performs authority verification on the authority data to be verified in the data update request; if the verification is passed, controlling to execute the data updating operation of the storage equipment to be updated; and if not, forbidding to execute the data updating operation of the storage device to be updated.
Wherein the authority verification device is at least one storage device in the storage device chain.
If the initiating device of the data updating request is a certain storage device in the storage device chain, in order to avoid that the storage device performs permission verification cheating on the data updating request sent by the storage device itself, so that a verification result is inaccurate, and further data storage safety is affected, the permission verification device is usually at least one other storage device in the storage device chain except the initiating device of the data updating request.
It can be understood that, in order to achieve comprehensive control over the data updating process, so as to improve the accuracy of the permission verification result and further ensure the data storage security, in a preferred embodiment, the permission verification device is all other storage devices in the storage device chain except the storage device to be updated.
In an optional embodiment, the to-be-verified authority data includes at least one of account information to be verified, interface information to be verified, and interface information to be verified. Correspondingly, the permission verification device performs permission verification on the data update request, which may be: and performing authority verification on the authority data to be verified by adopting at least one of the following modes: according to the standard account information in the standard authority data, performing account authority verification on the account information to be verified, so as to verify whether an initiating account of the data updating request has account authority; according to the standard interface information in the standard authority data, performing interface authority verification on the interface information to be verified, and thus verifying whether the operation interface of the data updating request has interface authority; and according to the standard interface information in the standard authority data, performing interface authority verification on the interface information to be verified, thereby verifying whether the sending interface of the data updating request has the interface authority.
It can be understood that, by performing authority verification with different dimensions on the authority data to be verified in at least one mode, the verification process is richer and more comprehensive, so that the accuracy of the authority verification result is improved, the data storage safety is improved, and malicious tampering of the stored data is avoided.
Optionally, the standard permission data may be pre-stored locally in each storage device in the storage device chain, and then the standard permission data is acquired and used in a local data acquisition manner, and when the standard permission data is updated, the standard permission data is updated correspondingly in each storage device in the storage device chain. The standard authority data update can be modification or deletion of the existing standard authority data, or addition of new standard authority data, and the like.
The storage of the standard authority data in each storage device will bring about a certain waste of storage resources, and meanwhile, if the standard authority data in part of the storage devices are not updated timely, the condition of verification failure will occur, and the normal update of the stored project data is affected. In order to avoid the above situation, optionally, a right management platform may be further preset, and the right management platform stores and subsequently updates standard right data; correspondingly, when the authority verification equipment needs to carry out authority verification, the standard authority data can be directly obtained from the authority management platform, and the unified management of the standard authority data is convenient to realize.
EXAMPLE III
Fig. 3 is a flowchart of a block chain-based data query method according to an embodiment of the present application, where the embodiment is suitable for a case where data query is performed on data stored in a storage device chain. The block chain-based data query method according to the present application may be executed by a data query apparatus, which may be implemented by software and/or hardware and is specifically configured in an electronic device. The electronic device may be the same as or different from the aforementioned electronic device that performs the blockchain-based data storage method. Illustratively, the electronic device may be a server.
Referring to fig. 3, the block chain-based data query method includes:
and S301, reading project data of each power grid infrastructure project from the storage equipment chain.
And each storage device in the storage device chain stores and updates the project data in the manner of the previous embodiments.
S302, at least one index field is created according to the data type of the project data.
The index field is used as identification information of a certain dimension in the item data, so that a user can conveniently search at least part of contents in the item data.
The data type may include the item collection fields in the foregoing embodiments, and at least some fields having a search value in the item collection fields are selected according to a preset rule to create the index field.
Illustratively, each item collection field can be divided into a detachable field and an undetachable field in advance; determining word segmentation devices corresponding to the detachable fields, and performing word segmentation processing on the detachable fields by adopting the corresponding word segmentation devices to obtain at least one word segmentation result; and selecting fields with search values from the non-detachable fields and the word segmentation results of all detachable fields as index fields.
Optionally, determining a word segmentation device corresponding to the detachable field may be to pre-construct a correspondence between the data type and the word segmentation device; correspondingly, the word segmentation device of each detachable field is determined according to the corresponding relation.
Illustratively, for a Chinese-identified field such as "project name," a first tokenizer (e.g., ik _ smart tokenizer) is employed for tokenization. For example, the word segmentation processing is performed on the Hangzhou Xiaoshan melon juice 220 KV power transmission and transformation project to obtain the word segmentation results of Hangzhou, Xiaoshan, melon juice, 220 KV, power transmission and transformation project. Illustratively, for character fields such as 'project code', 'WBS code', etc. which are matched as a whole, a second word segmenter (e.g. a keyword segmenter) is used for processing, and the whole input is taken as a single word unit, so that the indexing and searching of special types of texts are facilitated. Illustratively, no word segmentation is performed for fields of numerical type such as "construction size".
In an alternative embodiment, the field with search value selected from the word segmentation results of the non-detachable field and each detachable field as the field may be: and selecting fields with search values as index fields from the non-detachable fields and the word segmentation results of all the detachable fields according to the statistical business rules. The statistical business rules may be determined empirically by a technician, or determined using a number of tests, or determined by screening based on historical statistical frequencies.
And S303, storing the item data in a preset database for query based on the index field.
The preset database may be an es (elastic search) database, which facilitates distributed query.
In order to avoid that a query result is affected by loss of part of stored content during single storage, in an optional embodiment, a main fragment and a copy fragment may be set in the ES database, full project data is stored in the main fragment and the copy fragment respectively, and the main fragment or the copy fragment is designated to perform data query in a self-defined routing manner. In order to facilitate the operation user to know the data storage condition in time, after the project data is finished, reminding information can be fed back to the user operation interface.
For example, when writing project data into the ES database, project data writing can be performed in the main slice; after the writing of the project data in the main fragment is completed, the project data is synchronized to the copy fragment to copy the data, and the project data storage process is completed only after the writing in both the main fragment and the copy fragment is completed, so that the consistency of the stored data of the main fragment and the copy fragment is ensured.
According to the embodiment of the application, the project data is stored in the preset database, so that the project data can be conveniently inquired offline. In addition, by introducing the index field, item data query can be carried out from multiple dimensions, and convenience is provided for a query user.
It should be noted that, in the item data, the search values corresponding to different index fields are different, and in order to distinguish the index fields, the index weight of each index field may also be set to represent the search value of the corresponding index field, so as to strengthen the index field with higher search value, weaken the index field with lower search value, and further contribute to improving the accuracy of the query result.
In one particular implementation, the index weight of the index field may be determined based on historical search frequencies of the index field. The historical search frequency may be a search frequency for setting a historical period, and the set historical period may be set by a technician according to needs or experience values, for example, the set historical period may be the last 1 month. Specifically, the higher the historical search frequency of the index field, the higher the corresponding index weight.
Illustratively, a search text is obtained; sorting the project data according to the matching degree of the search text and each index field and the index weight of each index field; and displaying the project data according to the sorting result.
Optionally, the matching degree between the search text and each index field can be calculated based on a vector space model or a probability correlation model. For example, the matching degree is determined based on a TF-IDF (Term Frequency-Inverse text Frequency index) algorithm, a BM25 algorithm, or the like.
Specifically, the matching degrees of the search text and each index field can be weighted respectively through the index weight of the index field to obtain a weighted matching score; sorting the project data according to the weighted matching score; and according to the sequencing result, sequentially displaying the project data from high to low or sequentially displaying the project data with set number from high to low.
Example four
Fig. 4 is a structural diagram of a data storage device based on a block chain according to an embodiment of the present application, where the embodiment is suitable for a case where mass item data is stored. The apparatus may be implemented in software and/or hardware and is embodied in an electronic device.
Referring to fig. 4, the block chain based data storage device includes: a project data collection module 401, a data set packing module 402, a data set storage module 403, and a data hash generation module 404. Wherein the content of the first and second substances,
the project data acquisition module 401 is configured to acquire project data of at least one power grid infrastructure project;
a data set packing module 402, configured to pack the project data to generate at least one data set according to the project attribute of the power grid infrastructure project to which the project data belongs, and determine a storage device corresponding to each data set in a storage device chain;
a data set storage module 403, configured to store each data set to a corresponding storage device;
a data hash generation module 404, configured to generate, for a first storage device in the storage device chain, a data hash of itself according to a locally stored data set, and locally store the data hash;
the data hash generation module 404 is further configured to generate, for each non-first storage device in the storage device chain, a data hash of itself according to the locally stored data set and the data hash of the previous storage device, and locally store the data hash.
According to the embodiment of the application, the project data are stored in different storage devices in a scattered manner, so that the storage pressure of a single storage device is reduced. In the non-first storage device, the data hash of the storage device is generated and stored locally based on the data hash of the data set and the data hash of the previous storage device, so that random modification of data stored in a storage device chain is avoided, and the safety of the stored data in the storage device chain is ensured.
In an optional embodiment, the apparatus further comprises:
the project updating data acquisition module is used for acquiring project updating data of a project to be updated;
a data update set generation module, configured to package the item update data according to the item attribute of the item to be updated to generate a data update set, and determine a storage device to be updated, corresponding to the data update set, in the storage device chain;
the data updating module is used for sequentially updating the local data set and the data hash in the storage equipment to be updated according to the data updating set;
and the data updating module is further used for sequentially updating the data hashes of other storage devices positioned behind the storage device to be updated in the storage device chain according to the data hashes of the storage device to be updated.
In an optional embodiment, the apparatus further comprises:
a data update request sending module, configured to control the storage device to be updated to send a data update request to an authorization verification device in the storage device chain before updating the local data set and the data hash in the storage device to be updated according to the data update set, so that the authorization verification device performs authorization verification on authorization data to be verified in the data update request; the authority verification device is other storage devices except the storage device to be updated in the storage device chain;
and the control execution module is used for controlling and executing the data updating operation of the storage equipment to be updated if the verification is passed.
In an optional embodiment, the to-be-verified authority data includes at least one of account information to be verified, interface information to be verified, and interface information to be verified;
correspondingly, when the data update request sending module performs the permission verification on the data update request by the permission verification device, the data update request sending module is specifically configured to:
the right verification equipment acquires standard right data from the right management platform; the standard authority data comprises at least one of standard account information, standard interface information and standard interface information;
and performing authority verification on the authority data to be verified by adopting at least one of the following modes:
according to standard account information in standard authority data, performing account authority verification on the account information to be verified;
according to standard interface information in standard authority data, performing interface authority verification on the interface information to be verified;
and according to the standard interface information in the standard authority data, performing interface authority verification on the interface information to be verified.
In an optional embodiment, the apparatus further comprises:
a full load god recognition module for recognizing a full load device in the chain of storage devices;
and the data migration module is used for controlling at least part of the data set in the fully-loaded equipment to be migrated to the associated storage equipment of the fully-loaded equipment.
The data storage device based on the block chain can execute the data storage method based on the block chain provided by any embodiment of the application, and has the corresponding functional modules and beneficial effects of executing the data storage method based on the block chain.
EXAMPLE five
Fig. 5 is a structural diagram of a data query apparatus based on a block chain according to an embodiment of the present application, where the embodiment is suitable for a case where data query is performed on data stored in a storage device chain. The apparatus may be implemented in software and/or hardware and is embodied in an electronic device.
Referring to fig. 5, the block chain-based data query apparatus includes: an item data reading module 501, an index field creation module 502, and an item data storage module 503. Wherein the content of the first and second substances,
a project data reading module 501, configured to read project data of each power grid infrastructure project from a storage device chain; the storage device chain stores data by adopting any one of the block chain-based data storage methods provided by the foregoing embodiments;
an index field creating module 502, configured to create at least one index field according to a data type of the item data;
and an item data storage module 503, configured to store the item data in a preset database for querying, based on the index field.
According to the embodiment of the application, the project data is stored in the preset database, so that the project data can be conveniently inquired offline. In addition, by introducing the index field, item data query can be carried out from multiple dimensions, and convenience is provided for a query user.
In an optional embodiment, the apparatus further comprises:
the search text acquisition module is used for acquiring a search text;
the item data sorting module is used for sorting the item data according to the matching degree of the search text and each index field and the index weight of each index field; the index weight of the index field is determined based on the historical search frequency of the index field;
and the project data display module is used for displaying the project data according to the sequencing result.
The data query device based on the block chain can execute the data query method based on the block chain provided by any embodiment of the application, and has the corresponding functional modules and beneficial effects of executing the data query method based on the block chain.
EXAMPLE six
Fig. 6 is a block diagram of an electronic device according to an embodiment of the present application. FIG. 6 illustrates a block diagram of an exemplary electronic device 612 suitable for use in implementing embodiments of the present application. The electronic device 612 shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application. Illustratively, the electronic device may be a server.
As shown in fig. 6, the electronic device 612 is in the form of a general purpose computing device. The components of the electronic device 612 may include, but are not limited to: one or more processors or processing units 616, a system memory 628, and a bus 618 that couples various system components including the system memory 628 and the processing unit 616.
The electronic device 612 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by electronic device 612 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 628 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 630 and/or cache memory 632. The electronic device 612 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 634 may be used to read from or write to non-removable, nonvolatile magnetic media (not shown in FIG. 6, commonly referred to as a "hard disk drive"). Although not shown in FIG. 6, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In such cases, each drive may be connected to bus 618 by one or more data media interfaces. Memory 628 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the application.
A program/utility 640 having a set (at least one) of program modules 642 may be stored, for example, in memory 628, such program modules 642 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. The program modules 642 generally perform the functions and/or methods of the embodiments described herein.
The electronic device 612 may also communicate with one or more external devices 614 (e.g., keyboard, pointing device, display 624, etc.), with one or more devices that enable a user to interact with the electronic device 612, and/or with any devices (e.g., network card, modem, etc.) that enable the electronic device 612 to communicate with one or more other computing devices. Such communication may occur via input/output (I/O) interfaces 622. Also, the electronic device 612 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 620. As shown, the network adapter 620 communicates with the other modules of the electronic device 612 via the bus 618. It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with the electronic device 612, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 616 executes various functional applications and data processing by executing at least one of other programs of the programs stored in the system memory 628, for example, to implement the data storage method based on the block chain provided in the embodiment of the present application.
EXAMPLE seven
The embodiment of the present application also provides another electronic device, which may refer to the structure diagram of the electronic device in fig. 6. In the electronic device, the processing unit 616 executes various functional applications and data processing by executing at least one of other programs in the programs stored in the system memory 628, for example, to implement the data query method based on the block chain provided in the embodiment of the present application.
Example eight
An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a block chain-based data storage method provided in any embodiment of the present application, where the method includes: collecting project data of at least one power grid infrastructure project; according to the project attributes of the power grid infrastructure projects to which the project data belong, packaging the project data to generate at least one data set, and determining storage equipment corresponding to each data set in a storage equipment chain; respectively storing each data set to corresponding storage equipment; generating data hash of the first storage device in the storage device chain according to a locally stored data set, and locally storing the data hash; and aiming at each non-first storage device in the storage device chain, generating self data hash according to the data set stored locally and the data hash of the previous storage device, and storing locally.
An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a block chain-based data query method provided in any embodiment of the present application, where the method includes: reading project data of each power grid infrastructure project from a storage equipment chain; the storage device chain stores data by adopting a data storage method based on a block chain provided by any embodiment of the application; creating at least one index field according to the data type of the project data; and storing the item data in a preset database for query based on the index field.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present application and the technical principles employed. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the appended claims.
Claims (10)
1. The data storage method based on the block chain is characterized by comprising the following steps:
collecting project data of at least one power grid infrastructure project;
according to the project attributes of the power grid infrastructure projects to which the project data belong, packaging the project data to generate at least one data set, and determining storage equipment corresponding to each data set in a storage equipment chain;
respectively storing each data set to corresponding storage equipment;
generating data hash of the first storage device in the storage device chain according to a locally stored data set, and locally storing the data hash;
and aiming at each non-first storage device in the storage device chain, generating self data hash according to the data set stored locally and the data hash of the previous storage device, and storing locally.
2. The method of claim 1, further comprising:
collecting project updating data of a project to be updated;
according to the item attributes of the items to be updated, packaging the item update data to generate a data update set, and determining the storage equipment to be updated corresponding to the data update set in the storage equipment chain;
sequentially updating the local data set and the data hash in the storage equipment to be updated according to the data updating set;
and sequentially updating the data hashes of other storage devices positioned behind the storage device to be updated in the storage device chain according to the data hashes of the storage device to be updated.
3. The method of claim 2, wherein before updating the local data set and the data hash in the storage device to be updated according to the data update set, the method further comprises:
controlling the storage device to be updated to send a data updating request to an authority verification device in the storage device chain, so that the authority verification device performs authority verification on the authority data to be verified in the data updating request; the authority verification device is other storage devices except the storage device to be updated in the storage device chain;
and if the verification is passed, controlling to execute the data updating operation of the storage equipment to be updated.
4. The method according to claim 3, wherein the to-be-verified authority data includes at least one of account information to be verified, interface information to be verified, and interface information to be verified;
the permission verification device performs permission verification on the data updating request, and the permission verification device comprises:
the right verification equipment acquires standard right data from the right management platform; the standard authority data comprises at least one of standard account information, standard interface information and standard interface information;
and performing authority verification on the authority data to be verified by adopting at least one of the following modes:
according to standard account information in standard authority data, performing account authority verification on the account information to be verified;
according to standard interface information in standard authority data, performing interface authority verification on the interface information to be verified;
and according to the standard interface information in the standard authority data, performing interface authority verification on the interface information to be verified.
5. The method of claim 2, further comprising:
identifying a fully loaded device in the chain of storage devices;
controlling migration of at least a portion of the data set in the fully loaded device to an associated storage device of the fully loaded device.
6. The data query method based on the block chain is characterized by comprising the following steps:
reading project data of each power grid infrastructure project from a storage equipment chain; the chain of storage devices storing data using the method of any one of claims 1-5;
creating at least one index field according to the data type of the project data;
and storing the item data in a preset database for query based on the index field.
7. A blockchain-based data storage device, comprising:
the project data acquisition module is used for acquiring project data of at least one power grid infrastructure project;
the data set packaging module is used for packaging the project data to generate at least one data set according to the project attributes of the power grid infrastructure projects to which the project data belong, and determining storage equipment corresponding to each data set in a storage equipment chain;
the data set storage module is used for respectively storing each data set to corresponding storage equipment;
the data hash generation module is used for generating data hash of the first storage device in the storage device chain according to the locally stored data set and locally storing the data hash;
and the data hash generation module is further configured to generate, for each non-first storage device in the storage device chain, a data hash of itself according to the locally stored data set and the data hash of the previous storage device, and locally store the data hash.
8. Data inquiry device based on block chain, characterized by comprising:
the project data reading module is used for reading project data of each power grid infrastructure project from the storage equipment chain; the chain of storage devices storing data using the method of any one of claims 1-5;
the index field creating module is used for creating at least one index field according to the data type of the project data;
and the item data storage module is used for storing the item data in a preset database for query based on the index field.
9. An electronic device, comprising:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the blockchain based data storage method of any one of claims 1-5; and/or implementing the block chain-based data query method of claim 6.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the blockchain-based data storage method according to any one of claims 1 to 5; and/or implementing the block chain-based data query method of claim 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110995156.8A CN113434520A (en) | 2021-08-27 | 2021-08-27 | Block chain based data storage and query method, device, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110995156.8A CN113434520A (en) | 2021-08-27 | 2021-08-27 | Block chain based data storage and query method, device, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113434520A true CN113434520A (en) | 2021-09-24 |
Family
ID=77798240
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110995156.8A Pending CN113434520A (en) | 2021-08-27 | 2021-08-27 | Block chain based data storage and query method, device, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113434520A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105868253A (en) * | 2015-12-23 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Data importing and query methods and apparatuses |
| CN110598394A (en) * | 2019-03-28 | 2019-12-20 | 腾讯科技（深圳）有限公司 | Authority verification method and device and storage medium |
| CN112087530A (en) * | 2020-11-02 | 2020-12-15 | 支付宝(杭州)信息技术有限公司 | Method, device, equipment and medium for uploading data to block chain system |
-
2021
- 2021-08-27 CN CN202110995156.8A patent/CN113434520A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105868253A (en) * | 2015-12-23 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Data importing and query methods and apparatuses |
| CN110598394A (en) * | 2019-03-28 | 2019-12-20 | 腾讯科技（深圳）有限公司 | Authority verification method and device and storage medium |
| CN112087530A (en) * | 2020-11-02 | 2020-12-15 | 支付宝(杭州)信息技术有限公司 | Method, device, equipment and medium for uploading data to block chain system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9195952B2 (en) | Systems and methods for contextual mapping utilized in business process controls | |
| TW201232294A (en) | Formatting data by example | |
| US11526754B2 (en) | Feature generation for asset classification | |
| CN112506486A (en) | Search system establishing method and device, electronic equipment and readable storage medium | |
| US9613168B2 (en) | Computer aided modeling | |
| CN112288604A (en) | Judicial case data processing method and device, electronic equipment and readable storage medium | |
| CN114398346A (en) | Data migration method, device, equipment and storage medium | |
| CN114862140A (en) | Behavior analysis-based potential evaluation method, device, equipment and storage medium | |
| CN114005135A (en) | Intelligent construction project drawing verification method, system and device and readable storage medium | |
| CN112783989A (en) | Data processing method and device based on block chain | |
| CN112486957A (en) | Database migration detection method, device, equipment and storage medium | |
| CN115167785B (en) | Label-based network disk file management method and device, network disk and storage medium | |
| CN113434520A (en) | Block chain based data storage and query method, device, equipment and medium | |
| CN115115244B (en) | Evaluation method and device for investment environment of mining projects and computer equipment | |
| CN105320737A (en) | Firefighting inspection and acceptance retrieving system | |
| CN109949013A (en) | Document treatment circulation method and system | |
| CN112396547B (en) | Course recommendation method, device, equipment and medium based on unsupervised learning | |
| CN114490590A (en) | Data warehouse quality evaluation method and device, electronic equipment and storage medium | |
| KR102324086B1 (en) | Cost efficiency tracking for configuration management database | |
| Pruessner et al. | Efficient algorithm for the forest fire model | |
| CN113591881A (en) | Intention recognition method and device based on model fusion, electronic equipment and medium | |
| CN113360548A (en) | Data processing method, device, equipment and medium based on data asset analysis | |
| CN112364651A (en) | Express bill two-segment code generation method, device, equipment and storage medium | |
| CN111861227A (en) | User recommendation method and device based on membership analysis, electronic equipment and medium | |
| CN115187250B (en) | Detection method, terminal and storage medium for ether house privacy transaction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210924 |
|
| RJ01 | Rejection of invention patent application after publication |