CN113138989A - Block chain data retrieval method and device - Google Patents

Abstract

The invention provides a block chain data retrieval method and a block chain data retrieval device, wherein the method comprises the following steps: acquiring retrieval contents and an established index table in a data warehouse, and searching all index information conforming to the retrieval contents in an increment index table and a global index table of the index table; the data warehouse is used for storing each data uploaded into the block chain; the index table comprises an increment index table and a global index table; the increment index table is used for caching index information of each data uploaded to the block chain in the current time period; the global index table is used for storing index information of each data uploaded to the block chain before the current time period; and acquiring data corresponding to each index information which is consistent with the retrieval content in the data warehouse, and feeding back each acquired data to the user. By applying the method, the data of the block chain is stored in the data warehouse in advance, and the rapid retrieval of each data in the block chain is realized in real time through the increment index table and the global index table in the index table of the data warehouse.

Description

Block chain data retrieval method and device

The present application claims priority of chinese patent application entitled "block chain data retrieval method and apparatus" filed by chinese patent office at 12/03/2021 under the reference of application number 202110270899.9, which is incorporated herein by reference in its entirety.

Technical Field

The present invention relates to the field of data processing technologies, and in particular, to a block chain data retrieval method and apparatus.

Background

The blockchain is used as a basic platform and needs to carry a large amount of data, and the data are respectively stored in different blocks of the blockchain. When the data stored in the block chain needs to be retrieved, the related data in different accounts, different transactions and different blocks need to be retrieved comprehensively, so as to obtain the data required by the user.

In the prior art, the manner of retrieving data in a block chain is too complex, when the data in the block chain needs to be retrieved, under huge data, it needs to consume a long time to retrieve the data of each block in the block chain, and as the data in the block chain is increased and updated, the number of blocks in the block chain will also increase, the process of retrieving the data will be more complicated, and the consumed retrieval time will be longer and longer.

Disclosure of Invention

In view of this, the present invention provides a block chain data retrieval method, by which an index of each data in a block chain is pre-constructed, and when a user needs to retrieve the data in the block chain, the data that the user needs to retrieve is searched through the index.

The invention also provides a block chain data retrieval device which is used for ensuring the realization and the application of the method in practice.

A method for retrieving block chain data comprises the following steps:

when receiving a data retrieval message sent by a user, acquiring retrieval content corresponding to the data retrieval message;

acquiring an established index table in a preset data warehouse, and searching all constructed index information which is consistent with the retrieval content in the index table; the data warehouse is used for storing each data uploaded to a preset block chain; the index table is used for storing index information corresponding to each data; the index table comprises an incremental index table and a global index table; the increment index table is used for caching index information of each data uploaded to the block chain in the current time period; the global index table is used for storing index information of each data uploaded to the block chain before the current time period;

acquiring data corresponding to each index information in the data warehouse, which is consistent with the retrieval content, and feeding back each acquired data to the user;

the process of constructing the index information comprises the following steps: when detecting that the blockchain generates data in the current time period, storing the data currently generated by the blockchain into the data warehouse; extracting each keyword of the currently generated data, and constructing index information corresponding to the currently generated data in the incremental index table based on each keyword; judging whether the current time period is finished or not; if the current time period is over, transferring each constructed index information in the incremental index table to the global index table, and emptying the incremental index table; setting the next time period of the current time period as the latest current time period, wherein the current time period is the last time period, so as to construct index information corresponding to each data generated by the block chain in the latest current time in the incremental index table.

In the foregoing method, optionally, before detecting that the block chain generates data in the current time period, the method further includes:

when a data uplink request sent by a client is received, acquiring a preset data semantic specification;

sending the data semantic specification to the client, triggering the client to adjust the data semantics of the data to be uploaded to the block chain based on the data semantic specification, and uploading the adjusted data to the block chain.

The method described above, optionally, the storing the data currently generated by the blockchain into the data warehouse includes:

analyzing the currently generated data based on the data semantic specification to obtain the data content of the currently generated data;

determining each generated cluster in the data warehouse, and performing cluster calculation on the currently generated data based on a preset clustering algorithm and the data content to determine a cluster to which the currently generated data belongs;

and in the data warehouse, associating and storing the currently generated data with each data in the cluster to which the currently generated data belongs.

Optionally, in the method, the extracting each keyword of the currently generated data, and constructing, based on each keyword, index information corresponding to the currently generated data in the incremental index table includes:

extracting each vocabulary in the data content of the currently generated data;

according to a preset filtering rule, eliminating words without actual meanings from the words to obtain each keyword in the data content;

searching at least one word position of each keyword in the data content;

and constructing index information corresponding to the currently generated data based on each keyword and each word position corresponding to the keyword, and caching the index information to the increment index table.

Optionally, the method for feeding back each acquired data to the user includes:

performing data cleaning on each acquired data to obtain each cleaned data;

determining the generation time of each cleaned data in the block chain, and sequencing each cleaned data based on the generation time corresponding to each cleaned data;

and feeding back the sorted data to the user.

A blockchain data retrieval device, comprising:

the device comprises a first acquisition unit, a second acquisition unit and a third acquisition unit, wherein the first acquisition unit is used for acquiring retrieval contents corresponding to a data retrieval message when the data retrieval message sent by a user is received;

the retrieval unit is used for acquiring an established index table in a preset data warehouse and searching all constructed index information which is consistent with the retrieval content in the index table; the data warehouse is used for storing each data uploaded to a preset block chain; the index table is used for storing index information corresponding to each data; the index table comprises an incremental index table and a global index table; the increment index table is used for caching index information of each data uploaded to the block chain in the current time period; the global index table is used for storing index information of each data uploaded to the block chain before the current time period;

the feedback unit is used for acquiring data corresponding to each index information which is in accordance with the retrieval content in the data warehouse and feeding back each acquired data to the user;

the index building unit is used for storing the data currently generated by the block chain into the data warehouse when the block chain is detected to generate the data in the current time period; extracting each keyword of the currently generated data, and constructing index information corresponding to the currently generated data in the incremental index table based on each keyword; judging whether the current time period is finished or not; if the current time period is over, transferring each constructed index information in the incremental index table to the global index table, and emptying the incremental index table; setting the next time period of the current time period as the latest current time period, wherein the current time period is the last time period, so as to construct index information corresponding to each data generated by the block chain in the latest current time in the incremental index table.

The above apparatus, optionally, further comprises:

the second acquisition unit is used for acquiring a preset data semantic specification when a data uplink request sent by a client is received;

and the sending unit is used for sending the data semantic specification to the client, triggering the client to adjust the data semantics of the data to be uploaded to the block chain based on the data semantic specification, and uploading the adjusted data to the block chain.

The above apparatus, optionally, the index building unit is configured to include:

the analysis subunit is used for analyzing the currently generated data based on the data semantic specification to obtain the data content of the currently generated data;

the clustering subunit is used for determining each generated clustering cluster in the data warehouse, performing clustering calculation on the currently generated data based on a preset clustering algorithm and the data content, and determining the clustering cluster to which the currently generated data belongs;

and the storage subunit is used for associating and storing the currently generated data with each data in the cluster to which the currently generated data belongs in the data warehouse.

The above apparatus, optionally, the index building unit is configured to include:

the extraction subunit is used for extracting each vocabulary in the data content of the currently generated data;

the filtering subunit is used for eliminating the vocabulary without actual meaning from each vocabulary according to the preset filtering rule to obtain each keyword in the data content;

the searching subunit is used for searching at least one word position of each keyword in the data content;

and the constructing subunit is used for constructing index information corresponding to the currently generated data based on each keyword and each word position corresponding to the keyword, and caching the index information to the increment index table.

The above apparatus, optionally, the feedback unit includes:

the data cleaning subunit is used for cleaning the data of each acquired data to obtain each cleaned data;

the sorting subunit is used for determining the generation time of each cleaned data in the block chain and sorting each cleaned data based on the generation time corresponding to each cleaned data;

and the feedback subunit is used for feeding back the sorted data to the user.

A storage medium, the storage medium including stored instructions, wherein when the instructions are executed, a device where the storage medium is located is controlled to execute the above block chain data retrieval method.

An electronic device comprising a memory, and one or more instructions stored in the memory and configured to be executed by one or more processors to perform the above block chain data retrieval method.

Compared with the prior art, the invention has the following advantages:

the invention provides a block chain data retrieval method, which comprises the following steps: when receiving a data retrieval message sent by a user, acquiring retrieval content corresponding to the data retrieval message; acquiring an established index table in a preset data warehouse, and searching all constructed index information which is consistent with the retrieval content in the index table; the data warehouse is used for storing each data uploaded to a preset block chain; the index table is used for storing index information corresponding to each data; the index table comprises an incremental index table and a global index table; the increment index table is used for caching index information of each data uploaded to the block chain in the current time period; the global index table is used for storing index information of each data uploaded to the block chain before the current time period; and acquiring data corresponding to each index information which is consistent with the retrieval content in the data warehouse, and feeding back each acquired data to the user. By applying the method provided by the invention, the data of the block chain is stored in the data warehouse in advance, and the quick retrieval of each data in the block chain is realized in real time through the increment index table and the global index table in the index table of the data warehouse.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.

Fig. 1 is a flowchart of a method for retrieving block chain data according to an embodiment of the present invention;

fig. 2 is a flowchart of another method of retrieving block chain data according to an embodiment of the present invention;

fig. 3 is a flowchart of another method of retrieving block chain data according to an embodiment of the present invention;

fig. 4 is a block chain data retrieving apparatus according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In this application, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions, and the terms "comprises", "comprising", or any other variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

The invention is operational with numerous general purpose or special purpose computing device environments or configurations. For example: personal computers, server computers, hand-held or portable devices, tablet-type devices, multi-processor apparatus, distributed computing environments that include any of the above devices or equipment, and the like.

The embodiment of the invention provides a block chain data retrieval method, which can be applied to a plurality of system platforms, wherein an execution main body of the method can be a computer terminal or a processor of various mobile devices, and a flow chart of the method is shown in fig. 1 and specifically comprises the following steps:

s101: and when receiving a data retrieval message sent by a user, acquiring retrieval content corresponding to the data retrieval message.

In the embodiment of the invention, a data query service is provided in the server, the data query service comprises a query interface of block chain data, and when receiving a data retrieval message sent by a user, retrieval content corresponding to the data retrieval message input by the user is acquired from the query interface.

The search content may be specific whole paragraph content or related vocabulary of data to be queried. The data in the blockchain can be the sensing data of the internet of things equipment, the transaction service data of terminal users such as mobile phones or the service data of a server and the like.

S102: and acquiring an established index table in a preset data warehouse, and searching all constructed index information which is consistent with the retrieval content in the index table.

The data warehouse is used for storing each data uploaded to a preset block chain; the index table is used for storing index information corresponding to each data; the index table comprises an incremental index table and a global index table; the increment index table is used for caching index information of each data uploaded to the block chain in the current time period; the global index table is used for storing index information of each data uploaded to the block chain before the current time period.

In an embodiment of the invention, the data warehouse is a database for storing data within a block chain. An index table for data retrieval is established in the data warehouse, and each index information in the index table is a data index of each data stored in the data warehouse. Since each data stored in the data warehouse is each data generated in the blockchain, when a user needs to perform data retrieval, the retrieval of the data in the blockchain is realized through the data warehouse and the index table in the data warehouse. Based on the retrieval content, searching the index information corresponding to the retrieval content in the increment index table and the global index table of the index table.

It should be noted that each index information of the index table includes each keyword in the data corresponding to the index information, and each keyword corresponds to a position in the data content of the data. Through the search content, each vocabulary input by the user is determined, and all index information containing each vocabulary is searched in the index table.

Further, since each piece of index information cached in the incremental index table is only the index information corresponding to each piece of data generated by the blockchain in the current time period, the global index table stores the index information corresponding to each piece of data generated by the blockchain before the current time period. Therefore, when the data in the block chain is increased, the amount of the index information stored in the global index table is far larger than the data amount of the cache index information in the incremental index table, in the process of searching each index information corresponding to the search content, whether the index information corresponding to the search content exists can be quickly searched from the incremental index table, and data can be quickly fed back to the user according to each index information searched from the incremental index table.

S103: and acquiring data corresponding to each index information which is consistent with the retrieval content in the data warehouse, and feeding back each acquired data to the user.

In the embodiment of the invention, according to each index information corresponding to the retrieval content, the data corresponding to each searched index information is acquired in the data warehouse, and each acquired data is fed back to the user. After receiving the data, the user can screen out data which is in line with the retrieval expectation according to other data information such as data subject, data content and the like of the data.

In order to facilitate a user to retrieve data in a block chain, index information corresponding to each data in the block chain needs to be pre-constructed, and a specific process is shown in fig. 2, in the block chain data retrieval method provided in an embodiment of the present invention, a process of constructing index information for each data in the block chain is as follows:

s201: detecting whether data are generated in the block chain in real time, and storing the data currently generated by the block chain into the data warehouse when the data generated by the block chain in the current time period are detected.

In the embodiment of the invention, the blockchain faces a huge user group, and the blockchain receives data uploaded by the users in real time according to the requests of the users so as to store the data uploaded by the users. In order to ensure that a user can search data in a block chain in real time under the condition of not influencing the uploading of the data to the block chain, the block chain is detected in real time so as to determine whether the block chain generates the data or not. When blockchain generated data is detected, the data currently generated by the blockchain is stored in a data warehouse.

Specifically, the block chain is detected according to a set time period in the invention, so as to determine whether the block chain generates data in the current time period.

S202: extracting each keyword of the currently generated data, and constructing index information corresponding to the currently generated data in the incremental index table based on each keyword.

In the embodiment of the invention, each keyword in the currently generated data is extracted, each keyword is used as the data index of the currently generated data, and the index information corresponding to the currently generated data is constructed in the incremental index table.

Wherein, only a small amount of index information is stored in the increment index table, namely: the incremental index table only stores index information corresponding to each data generated by the block chain in the current time period. Therefore, when a user searches data, because the increment index table stores less index information, whether the increment index table has the index information which is in accordance with the search content can be quickly determined according to the search content which the user needs to search.

S203: judging whether the current time period is finished or not; if yes, executing S204; if not, the process returns to the step S201.

In the embodiment of the present invention, the cycle duration of each time period is consistent, and it is necessary to determine whether the current time period is finished in real time in the process of detecting whether a block chain generates data in real time and constructing index information for the data generated each time.

S204: and if the current time period is finished, transferring each index information constructed in the incremental index table to the global index table, and emptying the incremental index table.

In the embodiment of the invention, in order to avoid the increase of the number of the index information stored in the incremental index table, when the current time period is over, the constructed index information in the incremental index table is transferred to the global index table, the global index table stores the index information corresponding to each data in the block chain, and the incremental index table is emptied at the same time.

S205: setting the next time period of the current time period as the latest current time period, wherein the current time period is the last time period, and returning to execute the step S201.

When the next time period of the current time period is set to be the latest current time period, and the current time period is the last time period, the incremental index table is used for caching index information corresponding to each data generated by the block chain in the latest current time.

It can be understood that, at the end of the current time period, the next time period is continued to be entered for continuing to detect the blockchain, where the next time period is a new current time period, and the previous current time period is changed to the previous time period. At this time, when the blockchain generates new data in the new time period, the new data is still stored in the data warehouse, and index information corresponding to the new data is constructed in the incremental index table.

In the block chain data retrieval method provided by the embodiment of the invention, when a data retrieval message sent by a user is received, retrieval content corresponding to the data retrieval message is obtained. And searching all index information corresponding to the retrieval content from a preset index table to obtain data corresponding to each index information in a data warehouse through the index information, wherein the data warehouse is a database for storing each data in the block chain. In order to improve the efficiency of retrieving data in a block chain, it is necessary to detect whether data is generated in the block chain in real time, and when it is detected that data is generated in the block chain in the current time period, the data currently generated in the block chain is stored in the data warehouse. The data warehouse is provided with an index table for retrieving data in the block chain, the index table is respectively provided with an increment index table and a global index table, the increment index table is used for caching index information corresponding to each data generated by the block chain in the current time period, and the global index table is used for storing the index information corresponding to each data generated by the block chain before the current time period. And after the currently generated data is stored in the data warehouse, extracting each keyword of the currently generated data, and constructing index information corresponding to the currently generated data in the incremental index table based on each keyword. And if the index information comprises each vocabulary in the retrieval content in each keyword corresponding to the index information corresponding to the currently generated data, the index information corresponding to the currently generated data is the index information conforming to the retrieval content. After the incremental index table constructs the index information corresponding to the currently generated data, whether the current time period is finished or not is judged, so as to determine whether all the index information in the incremental index table needs to be stored in the global index table or not. If the current time period is over, the representation has entered the next time period, the next time period is a new current time period, the original current time period is set as the previous time period, each piece of index information cached in the original current time period of the incremental index table is transferred to the global index table, the incremental index table is emptied, and the incremental index table continues to cache the index information corresponding to each piece of data generated by the block chain in the new current time period.

Based on the method provided by the above embodiment, when the user performs data search, the input search content may be a keyword of data to be searched. For example, if the search content corresponding to the data search request sent by the user includes three keys, namely "5G", "communication", and "base station", the index information including the three keys is searched in the incremental index table and the global index table, and the data corresponding to each searched index information is fed back to the user as the search result.

By applying the method provided by the embodiment of the invention, the block chain data is stored in the data warehouse, the index information corresponding to each data is constructed, and the index information of the data is stored in the global index table or the incremental index table, so that the data can be retrieved in real time through the global index table and the incremental index table, and meanwhile, each data related to the retrieval content of the user can be rapidly obtained when the user retrieves the data.

In the method provided by the embodiment of the invention, the data in the block chain is uploaded by a user through the client. However, in practice, the data semantics supported by each client are different, and after the client uploads data to the blockchain data, the client cannot identify data with different data semantics from the data semantics supported by the client to other clients. Therefore, the data semantic specification of the data value block chain uploaded among the clients can be specified, the client modifies the data semantics according to the data semantic specification before uploading the data to the block chain, and when users of other clients retrieve the data, the data semantics meeting the support of the client can be analyzed according to the semantic specification. Therefore, before detecting that the block chain generates data in the current time period, the embodiment of the present invention further includes:

when a data uplink request sent by a client is received, acquiring a preset data semantic specification;

sending the data semantic specification to the client, triggering the client to adjust the data semantics of the data to be uploaded to the block chain based on the data semantic specification, and uploading the adjusted data to the block chain.

It can be understood that, before the ue needs to send data to the blockchain, a data uplink request corresponding to the data to be uplink sent is sent. When the processor receives the uplink request sent by the client, the processor acquires the set data semantic specification, wherein the data semantic specification is the data format standard of the data required to be stored when the data is stored in the specified block chain. Wherein, the data semantics in the data semantics specification refers to the meaning of each field of the data. The data semantics of different formats or different services are different. For example: there is an essential difference between the semantics of the data of the internet of things and the data semantics of the financial statement of the user. In order to avoid the difference of data semantics among different data, the data semantics of the data uploaded to the block chain are normalized, that is: setting data semantic specifications. After the data semantic specification is obtained, the data semantic specification is sent to a client, the client changes the data semantics of the data of the block chain in the time zone to be uploaded according to the data semantic specification, and the data with the adjusted data semantics is uploaded to the block chain, so that new data is generated in the block chain.

For example, the data semantics specification is in the following format:

DataFormat1{

Key1:Integer:1

Key2:String:2

Key3:Array(String):3

…

KeyN:Map(Integer,Integer):N

}

the Key is a name of a numeric field, and Integer, String and Array are value field types of data, such as a character String or an Integer value. The number id following the value range type is used as a unique identifier to refer to a particular key-value pair when binary serialized. Taking the internet of things temperature and humidity sensor data as an example, if the internet of things temperature and humidity sensor data uploaded to the block chain by the client is as follows:

THSensorData{

Temperature:Integer:1

Humidity:Float:2

Timetamp:Integer:3

MetaInfo:String:4

}

the actual data content of the data of the temperature and humidity sensor of the internet of things is as follows:

Instantiated From THSensorData{

1:30Celsius

2:0.2

3:1800000899

4:“node 3has beenrecently repaired.”

}

furthermore, in the process of applying the data semantic specification, besides the set data semantic specification, the data to be uploaded can be adjusted, and the original data semantic specification of the data to be uploaded can be reused in the adjustment process, so that the flexibility of the data semantic specification is improved, and the storage overhead is reduced.

It should be noted that the data semantic specification may be defined by a user in advance, the user compiles the data semantic specification and uploads the compiled data semantic specification to the blockchain, an address of the data semantic specification in the blockchain is determined by a hash value of the data semantic specification, and when the client needs to upload data to the blockchain, the processor acquires the data semantic specification on the chain according to the address of the data semantic specification and feeds the data semantic specification back to the client.

By applying the method provided by the embodiment of the invention, the data semantics of the data which needs to be uploaded to the block chain are normalized, so that the data openness in the block chain is further improved and the storage consumption of the data is reduced.

In the method provided in the embodiment of the present invention, if data is modified according to a preset data semantic specification before linking, when data currently generated by the blockchain needs to be stored in a data warehouse, the data currently generated by the blockchain needs to be processed according to the data semantic specification, and then the data is stored in the data warehouse, where a specific process is shown in fig. 3, and may specifically include:

s301: and analyzing the currently generated data based on the data semantic specification to obtain the data content of the currently generated data.

In the embodiment of the present invention, for each new data uploaded to the block chain, the data semantics in the data currently generated by the block chain needs to be scanned, so as to analyze the currently generated data according to the data semantics specification, and obtain the data content of the data.

S302: and determining each generated cluster in the data warehouse, and performing cluster calculation on the currently generated data based on a preset clustering algorithm and the data content to determine the cluster to which the currently generated data belongs.

It can be understood that, in the data warehouse, each data type corresponds to a cluster, and for data of the same data type, the data content of the data has certain similarity, so that, when the data content of the currently generated data is obtained, the cluster calculation is performed on the currently generated data based on the data content and by applying a clustering algorithm, and the cluster to which the currently generated data belongs in the data warehouse is determined.

S303: and in the data warehouse, associating and storing the currently generated data with each data in the cluster to which the currently generated data belongs.

In the embodiment of the invention, for each data belonging to the same cluster, each data is associated and stored.

For each cluster in the data warehouse, each cluster can be correspondingly provided with a storage table, and each data belonging to the same cluster is stored in the same table.

In the block chain data retrieval method provided by the embodiment of the invention, in order to facilitate the retrieval of data in a block chain by a user, when the data generated by the block chain is detected, the currently generated data is analyzed according to a preset semantic specification to obtain the data content of the data. In the data warehouse, data of the same data type are clustered in the same cluster according to a clustering algorithm. And for each cluster, a central point corresponding to the cluster is provided, a clustering algorithm is applied to calculate the data content of the currently generated data, the distance between the currently generated data and the central point of each cluster is determined, the cluster with the closest distance between the central point and the currently generated data in each cluster is determined as the cluster to which the currently generated data finally belongs, the currently generated data is stored in a data warehouse, and the currently generated data is associated with each data in the cluster to which the currently generated data belongs.

Optionally, if the preset data semantics are not specified, after the block chain generates data, extracting the currently generated data of the block chain, scanning the data semantics of the currently generated data, and determining the data content of the currently generated data according to the data semantics.

In the method provided by the embodiment of the invention, the data in the block chain are classified according to the corresponding data types through the clustering algorithm, and the data in the same clustering cluster are stored in the data warehouse in an associated manner, so that the data can be quickly retrieved and fed back according to the retrieval content when a user retrieves the data according to the association between the data of the same data type.

In the method provided by the embodiment of the present invention, after the currently generated data is stored in the data warehouse, index information corresponding to the currently generated data needs to be constructed in an index table of the data warehouse. Extracting each keyword of the currently generated data, and constructing index information corresponding to the currently generated data in the incremental index table based on each keyword, specifically including:

extracting each vocabulary in the data content of the currently generated data;

according to a preset filtering rule, eliminating words without actual meanings from the words to obtain each keyword in the data content;

searching at least one word position of each keyword in the data content;

and constructing index information corresponding to the currently generated data based on each keyword and each word position corresponding to the keyword, and caching the index information to the increment index table.

In the block chain data retrieval method provided by the embodiment of the invention, the data content of the currently generated data consists of a plurality of vocabularies, each vocabulary in the currently generated data is extracted, and each vocabulary is filtered according to the filtering rule. Wherein, the filtering rule specifies the vocabulary to be filtered, such as: the words "a" and "the" have no practical meaning. And filtering the vocabulary without actual meaning in each vocabulary according to the filtering rule, wherein the rest vocabularies are keywords of the currently generated data. And searching the word position of each keyword in the data content, constructing index information corresponding to the currently generated data according to each keyword and each word position corresponding to each keyword, and caching the index information into an increment index table of the index table.

It should be noted that the index information corresponding to each data in the index table is an inverted index, and the inverted index is a mapping using a keyword as data, and related data is retrieved by the keyword.

By applying the method provided by the embodiment of the invention, index information corresponding to the data is constructed through each keyword in the data and the word position of the keyword in the data content, so that the data can be quickly retrieved through the index information.

In the method provided by the embodiment of the invention, on the premise of constructing the index table of the data warehouse, if the data retrieval message sent by the user is received, all index information corresponding to the retrieval content corresponding to the data retrieval message can be searched through the increment index table and the global index table in the index table. Specifically, searching all constructed index information corresponding to the retrieved content in the index table specifically includes:

acquiring at least one retrieval word contained in the retrieval content;

and searching index information containing each retrieval vocabulary in an increment index table and a global index table of the index table.

Based on the method provided by the above embodiment, in the process of searching all index information corresponding to the search content, the search content may be specific whole paragraph content or related vocabulary of data to be queried. If the retrieval content is the integral paragraph content, performing word segmentation processing on the integral paragraph content to obtain each retrieval word corresponding to the retrieval content; if the retrieval content is related words of the data to be queried, each word is a retrieval word. Because each index information in the index table is composed of a plurality of keywords and word positions corresponding to the keywords, all index information corresponding to the search content in the index table is searched according to the search words, and each index information corresponding to the search content comprises the keywords corresponding to the search words. By the method, the data required to be retrieved by the user can be quickly determined.

In the method provided in the embodiment of the present invention, based on the content of the above S103, the process of feeding back each acquired data to the user may specifically include:

performing data cleaning on each acquired data to obtain each cleaned data;

determining the generation time of each cleaned data in the block chain, and sequencing each cleaned data based on the generation time corresponding to each cleaned data;

and feeding back the sorted data to the user.

In the block chain data retrieval method provided by the embodiment of the invention, after data corresponding to each index information corresponding to the retrieval content in the data warehouse is acquired, data cleaning needs to be performed on each acquired data. The specific data cleaning is to perform deduplication processing on repeatedly acquired data, perform completion or elimination on data with missing or fuzzy information, perform denoising processing on each acquired data, and the like, and acquire each cleaned data. And sequencing the cleaned data according to the time generated in the blockchain, and sequentially feeding back the sequenced data to a user.

It should be noted that, in the index table, the index information included in the incremental index table is less, so that each piece of index information in the incremental index table that matches with the retrieved content can be quickly acquired in the process of searching for the index information, and the index information stored in the incremental index table is data generated in the recent block chain, and generally, the requirement of the user on the recently uploaded data is much higher than that of the data that is not recently uploaded.

It can be understood that the invention sets two sub threads in the index table, which are respectively used for realizing the retrieval in the incremental index table and the global index table.

By applying the method provided by the embodiment of the invention, when the data are fed back to the user, the data are cleaned and sequenced, so that the retrieval requirement of the user on the data is met to the greatest extent.

The specific implementation procedures and derivatives thereof of the above embodiments are within the scope of the present invention.

Corresponding to the method described in fig. 1, an embodiment of the present invention further provides a block chain data retrieval device, which is used for implementing the method in fig. 1 specifically, the block chain data retrieval device provided in the embodiment of the present invention may be applied to a computer terminal or various mobile devices, and a schematic structural diagram of the block chain data retrieval device is shown in fig. 4, and specifically includes:

a first obtaining unit 401, configured to obtain, when a data retrieval message sent by a user is received, retrieval content corresponding to the data retrieval message;

a retrieving unit 402, configured to obtain an established index table in a preset data warehouse, and search all constructed index information that matches the retrieved content in the index table; the data warehouse is used for storing each data uploaded to a preset block chain; the index table is used for storing index information corresponding to each data; the index table comprises an incremental index table and a global index table; the increment index table is used for caching index information of each data uploaded to the block chain in the current time period; the global index table is used for storing index information of each data uploaded to the block chain before the current time period;

a feedback unit 403, configured to obtain data corresponding to each piece of index information in the data warehouse, where the index information corresponds to the retrieved content, and feed back each obtained data to the user;

an index building unit 404, configured to, when it is detected that the blockchain generates data in the current time period, store the data currently generated by the blockchain into the data warehouse; extracting each keyword of the currently generated data, and constructing index information corresponding to the currently generated data in the incremental index table based on each keyword; judging whether the current time period is finished or not; if the current time period is over, transferring each constructed index information in the incremental index table to the global index table, and emptying the incremental index table; setting the next time period of the current time period as the latest current time period, wherein the current time period is the last time period, so as to construct index information corresponding to each data generated by the block chain in the latest current time in the incremental index table.

In the block chain retrieval device provided by the embodiment of the invention, when a data retrieval message sent by a user is received, retrieval content corresponding to the data retrieval message is acquired. And searching all index information corresponding to the retrieval content from a preset index table to obtain data corresponding to each index information in a data warehouse through the index information, wherein the data warehouse is a database for storing each data in the block chain. In order to improve the efficiency of retrieving data in a block chain, it is necessary to detect whether data is generated in the block chain in real time, and when it is detected that data is generated in the block chain in the current time period, the data currently generated in the block chain is stored in the data warehouse. The data warehouse is provided with an index table for retrieving data in the block chain, the index table is respectively provided with an increment index table and a global index table, the increment index table is used for caching index information corresponding to each data generated by the block chain in the current time period, and the global index table is used for storing the index information corresponding to each data generated by the block chain before the current time period. And after the currently generated data is stored in the data warehouse, extracting each keyword of the currently generated data, and constructing index information corresponding to the currently generated data in the incremental index table based on each keyword. After the incremental index table constructs the index information corresponding to the currently generated data, whether the current time period is finished or not is judged, so as to determine whether all the index information in the incremental index table needs to be transferred to the global index table or not. If the current time period is over, the representation has entered the next time period, the next time period is a new current time period, the original current time period is a previous time period, the index information cached in the original current time period by the incremental index table is transferred to the global index table, the incremental index table is emptied, and the index information corresponding to each data generated by the block chain in the new current time period is continuously cached by the incremental index table.

By applying the device provided by the embodiment of the invention, the block chain data is stored in the data warehouse, the index information corresponding to each data is constructed, and the index information of the data is stored in the global index table or the incremental index table, so that each data related to the retrieval content of the user can be quickly obtained when the user retrieves the data.

The device provided by the embodiment of the invention further comprises:

the second acquisition unit is used for acquiring a preset data semantic specification when a data uplink request sent by a client is received;

and the sending unit is used for sending the data semantic specification to the client, triggering the client to adjust the data semantics of the data to be uploaded to the block chain based on the data semantic specification, and uploading the adjusted data to the block chain.

In the apparatus provided in the embodiment of the present invention, the index creating unit is configured to:

the analysis subunit is used for analyzing the currently generated data based on the data semantic specification to obtain the data content of the currently generated data;

the clustering subunit is used for determining each generated clustering cluster in the data warehouse, performing clustering calculation on the currently generated data based on a preset clustering algorithm and the data content, and determining the clustering cluster to which the currently generated data belongs;

and the storage subunit is used for associating and storing the currently generated data with each data in the cluster to which the currently generated data belongs in the data warehouse.

In the apparatus provided in the embodiment of the present invention, the index creating unit is configured to:

the extraction subunit is used for extracting each vocabulary in the data content of the currently generated data;

the filtering subunit is used for eliminating the vocabulary without actual meaning from each vocabulary according to the preset filtering rule to obtain each keyword in the data content;

the searching subunit is used for searching at least one word position of each keyword in the data content;

and the constructing subunit is used for constructing index information corresponding to the currently generated data based on each keyword and each word position corresponding to the keyword, and caching the index information to the increment index table.

In the apparatus provided in the embodiment of the present invention, the feedback unit includes:

the data cleaning subunit is used for cleaning the data of each acquired data to obtain each cleaned data;

the sorting subunit is used for determining the generation time of each cleaned data in the block chain and sorting each cleaned data based on the generation time corresponding to each cleaned data;

and the feedback subunit is used for feeding back the sorted data to the user.

The specific working processes of each unit and sub-unit in the block chain data retrieval device disclosed in the above embodiment of the present invention can refer to the corresponding contents in the block chain data retrieval method disclosed in the above embodiment of the present invention, and are not described herein again.

The embodiment of the invention also provides a storage medium, which comprises a stored instruction, wherein when the instruction runs, the device where the storage medium is located is controlled to execute the block chain data retrieval method.

An electronic device is provided in an embodiment of the present invention, and the structural diagram of the electronic device is shown in fig. 5, which specifically includes a memory 501 and one or more instructions 502, where the one or more instructions 502 are stored in the memory 501, and are configured to be executed by one or more processors 503 to perform the following operations according to the one or more instructions 502:

when receiving a data retrieval message sent by a user, acquiring retrieval content corresponding to the data retrieval message;

acquiring an established index table in a preset data warehouse, and searching all constructed index information which is consistent with the retrieval content in the index table; the data warehouse is used for storing each data uploaded to a preset block chain; the index table is used for storing index information corresponding to each data; the index table comprises an incremental index table and a global index table; the increment index table is used for caching index information of each data uploaded to the block chain in the current time period; the global index table is used for storing index information of each data uploaded to the block chain before the current time period;

acquiring data corresponding to each index information in the data warehouse, which is consistent with the retrieval content, and feeding back each acquired data to the user;

the process of constructing the index information comprises the following steps: when detecting that the blockchain generates data in the current time period, storing the data currently generated by the blockchain into the data warehouse; extracting each keyword of the currently generated data, and constructing index information corresponding to the currently generated data in the incremental index table based on each keyword; judging whether the current time period is finished or not; if the current time period is over, transferring each constructed index information in the incremental index table to the global index table, and emptying the incremental index table; setting the next time period of the current time period as the latest current time period, wherein the current time period is the last time period, so as to construct index information corresponding to each data generated by the block chain in the latest current time in the incremental index table.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, the system or system embodiments are substantially similar to the method embodiments and therefore are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for related points. The above-described system and system embodiments are only illustrative, wherein the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both.

To clearly illustrate this interchangeability of hardware and software, various illustrative components and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. A method for retrieving block chain data, comprising:

when receiving a data retrieval message sent by a user, acquiring retrieval content corresponding to the data retrieval message;

acquiring an established index table in a preset data warehouse, and searching all constructed index information which is consistent with the retrieval content in the index table; the data warehouse is used for storing each data uploaded to a preset block chain; the index table is used for storing index information corresponding to each data; the index table comprises an incremental index table and a global index table; the increment index table is used for caching index information of each data uploaded to the block chain in the current time period; the global index table is used for storing index information of each data uploaded to the block chain before the current time period;

acquiring data corresponding to each index information in the data warehouse, which is consistent with the retrieval content, and feeding back each acquired data to the user;

the process of constructing the index information comprises the following steps: when detecting that the blockchain generates data in the current time period, storing the data currently generated by the blockchain into the data warehouse; extracting each keyword of the currently generated data, and constructing index information corresponding to the currently generated data in the incremental index table based on each keyword; judging whether the current time period is finished or not; if the current time period is over, transferring each constructed index information in the incremental index table to the global index table, and emptying the incremental index table; setting the next time period of the current time period as the latest current time period, wherein the current time period is the last time period, so as to construct index information corresponding to each data generated by the block chain in the latest current time in the incremental index table.

2. The method of claim 1, further comprising, before detecting that the blockchain generates data in the current time period:

when a data uplink request sent by a client is received, acquiring a preset data semantic specification;

sending the data semantic specification to the client, triggering the client to adjust the data semantics of the data to be uploaded to the block chain based on the data semantic specification, and uploading the adjusted data to the block chain.

3. The method of claim 2, wherein storing the data currently generated by the blockchain into the data warehouse comprises:

analyzing the currently generated data based on the data semantic specification to obtain the data content of the currently generated data;

determining each generated cluster in the data warehouse, and performing cluster calculation on the currently generated data based on a preset clustering algorithm and the data content to determine a cluster to which the currently generated data belongs;

and in the data warehouse, associating and storing the currently generated data with each data in the cluster to which the currently generated data belongs.

4. The method according to claim 3, wherein the extracting each keyword of the currently generated data and constructing index information corresponding to the currently generated data in the incremental index table based on each keyword comprises:

extracting each vocabulary in the data content of the currently generated data;

according to a preset filtering rule, eliminating words without actual meanings from the words to obtain each keyword in the data content;

searching at least one word position of each keyword in the data content;

and constructing index information corresponding to the currently generated data based on each keyword and each word position corresponding to the keyword, and caching the index information to the increment index table.

5. The method of claim 1, wherein the feeding back each acquired data to the user comprises:

performing data cleaning on each acquired data to obtain each cleaned data;

determining the generation time of each cleaned data in the block chain, and sequencing each cleaned data based on the generation time corresponding to each cleaned data;

and feeding back the sorted data to the user.

6. A block chain data retrieval apparatus, comprising:

the device comprises a first acquisition unit, a second acquisition unit and a third acquisition unit, wherein the first acquisition unit is used for acquiring retrieval contents corresponding to a data retrieval message when the data retrieval message sent by a user is received;

the retrieval unit is used for acquiring an established index table in a preset data warehouse and searching all constructed index information which is consistent with the retrieval content in the index table; the data warehouse is used for storing each data uploaded to a preset block chain; the index table is used for storing index information corresponding to each data; the index table comprises an incremental index table and a global index table; the increment index table is used for caching index information of each data uploaded to the block chain in the current time period; the global index table is used for storing index information of each data uploaded to the block chain before the current time period;

the feedback unit is used for acquiring data corresponding to each index information which is in accordance with the retrieval content in the data warehouse and feeding back each acquired data to the user;

the index building unit is used for storing the data currently generated by the block chain into the data warehouse when the block chain is detected to generate the data in the current time period; extracting each keyword of the currently generated data, and constructing index information corresponding to the currently generated data in the incremental index table based on each keyword; judging whether the current time period is finished or not; if the current time period is over, transferring each constructed index information in the incremental index table to the global index table, and emptying the incremental index table; setting the next time period of the current time period as the latest current time period, wherein the current time period is the last time period, so as to construct index information corresponding to each data generated by the block chain in the latest current time in the incremental index table.

7. The apparatus of claim 6, further comprising:

the second acquisition unit is used for acquiring a preset data semantic specification when a data uplink request sent by a client is received;

and the sending unit is used for sending the data semantic specification to the client, triggering the client to adjust the data semantics of the data to be uploaded to the block chain based on the data semantic specification, and uploading the adjusted data to the block chain.

8. The apparatus of claim 7, wherein the index building unit is configured to include:

the analysis subunit is used for analyzing the currently generated data based on the data semantic specification to obtain the data content of the currently generated data;

the clustering subunit is used for determining each generated clustering cluster in the data warehouse, performing clustering calculation on the currently generated data based on a preset clustering algorithm and the data content, and determining the clustering cluster to which the currently generated data belongs;

and the storage subunit is used for associating and storing the currently generated data with each data in the cluster to which the currently generated data belongs in the data warehouse.

9. The apparatus of claim 8, wherein the index building unit is configured to include:

the extraction subunit is used for extracting each vocabulary in the data content of the currently generated data;

the filtering subunit is used for eliminating the vocabulary without actual meaning from each vocabulary according to the preset filtering rule to obtain each keyword in the data content;

the searching subunit is used for searching at least one word position of each keyword in the data content;

and the constructing subunit is used for constructing index information corresponding to the currently generated data based on each keyword and each word position corresponding to the keyword, and caching the index information to the increment index table.

10. The apparatus of claim 6, wherein the feedback unit comprises:

the data cleaning subunit is used for cleaning the data of each acquired data to obtain each cleaned data;

the sorting subunit is used for determining the generation time of each cleaned data in the block chain and sorting each cleaned data based on the generation time corresponding to each cleaned data;

and the feedback subunit is used for feeding back the sorted data to the user.

Images