CN113297203A - Data query and write-in method and device, computer storage medium and electronic equipment - Google Patents

Abstract

The present application discloses a data query method and device, query data acquisition method and device, query data identification information sending method and device, data writing method and device, data writing request sending method and device, writing data reading Obtaining method and device, analytical database system, and computer storage medium and electronic equipment; the query method includes: obtaining a data query request; according to the data query request, determining whether the identification information of the target data to be queried is the same as that of the stored currently written data. The information matches; if it does not match, obtain the identification information of the new written data and the newly written data adjacent to the identification information of the current written data and whose writing order is after the current written data; determine the new write Whether the identification information of the data matches the identification information of the target data to be queried; if so, the newly written data is determined as the target data to be queried; to avoid inaccurate or biased query data due to factors such as delays.

Description

Data query and writing method and apparatus, computer storage medium and electronic device

technical field

The present application relates to the field of computer applications, and in particular to a method and device for querying data, a method and device for acquiring query data, a method and device for sending identification information of query data, a method and device for writing data, a method and device for sending a data writing request, and a method and device for sending query data identification information. Apparatus, method and apparatus for reading written data, analytical database system, computer storage medium, and electronic equipment.

Background technique

Traditional databases are mainly used for data storage and related data processing operations such as reading and writing data. With the development of computer information technology, the great change that prevails is the generation of big data, because it is crucial to extract useful information from the collected data to improve the development orientation of various industries and promote economic development Therefore, a large amount of data is required to provide a service basis for subsequent data information extraction and other related operations.

In recent years, with the continuous development of big data, all walks of life have higher requirements for the exploration of data value. For traditional data storage systems for big data, operations such as offline reading, writing and computing are no longer sufficient for online data statistics, online data analysis, ad hoc query and other work to explore the value of information and data. Therefore, the traditional database facing Big Data (BigData) processing gradually develops to the database that can provide higher requirements on timeliness and processing speed.

SUMMARY OF THE INVENTION

The present application provides a data query method to solve the problem of poor real-time visibility of queried data in the prior art.

The present application provides a data query method, including:

Obtain a data query request, where the data query request carries the identification information of the target data to be queried, wherein the identification information is used to identify the information of the writing sequence of the written data, and the identification information of the target data to be queried is according to the written The identification information of the last written written data determined by the sequence range;

According to the data query request, determine whether the identification information of the target data to be queried matches the stored identification information of the currently written data;

If it does not match, then acquire the identification information of the newly written data and the newly written data adjacent to the identification information of the current written data and whose writing order is after the current written data;

Determine whether the identification information of the newly written data matches the identification information of the target data to be queried;

If so, the newly written data is determined as the target data to be queried.

In some embodiments, it also includes:

Read and write data information;

Determine the identification information in the read write data information as the identification information of the current write data;

The write data corresponding to the identification information of the current write data and the identification information of the current write data are stored locally;

Determining, according to the data query request, whether the identification information of the target data to be queried matches the identification information of the stored currently written data, including:

It is determined whether the identification information of the target data to be queried matches the identification information of the currently written data stored locally.

In some embodiments, the reading and writing data information includes:

In an asynchronous manner, the write data information is read according to the read cycle.

In some embodiments, it also includes:

When the identification information of the newly written data matches the identification information of the target data to be queried, update the current written data to the acquired new written data, and update the current written data The identification information is updated to the identification information of the newly written data.

In some embodiments, determining whether the identification information of the target data matches the stored identification information of the currently written data according to the data query request includes:

Compare the identification code of the identification information of the target data to be queried with the identification code of the identification information of the currently written data;

If the identification code of the identification information of the target data to be queried is greater than the identification code of the identification information of the currently written data, determine the identification code of the identification information of the target data to be queried and the identification of the currently written data The identifiers of the messages do not match.

In some embodiments, it also includes:

If the identification code of the identification information of the target data to be queried is less than or equal to the identification code of the identification information of the currently written data, determine the identification code of the identification information of the target data to be queried and the current written data The identification code of the identification information matches;

The currently written data is determined as the target data to be queried.

In some embodiments, the determining whether the identification information of the newly written data matches the identification information of the target data to be queried includes:

Compare the identification code of the identification information of the newly written data with the identification code of the identification information of the target data to be queried;

If the identification code of the identification information of the newly written data is greater than or equal to the identification code of the identification information of the target data to be queried, it is determined that the identification information of the newly written data matches the identification information of the target data.

In some embodiments, comparing the identification code of the identification information of the newly written data with the identification code of the identification information of the target data to be queried further includes:

If the identification code of the identification information of the newly written data is smaller than the identification code of the identification information of the target data to be queried, then it is determined that the identification information of the newly written data does not match the identification information of the target data;

Return to the step of acquiring the identification information of newly written data and the newly written data adjacent to the identification information of the current written data and whose writing order is after the current writing order.

In some embodiments, it also includes:

The determined target data to be queried is sent.

The application also provides a data query device, comprising:

a first obtaining unit, configured to obtain a data query request, where the data query request carries identification information of the target data to be queried, wherein the identification information is used to identify the information of the writing sequence of the written data, the target data to be queried The identification information of the data is the identification information of the last written written data determined according to the writing sequence range;

a first determining unit, configured to determine, according to the data query request, whether the identification information of the target data to be queried matches the stored identification information of the currently written data;

a second obtaining unit, configured to obtain, when the matching result of the first determining unit is a mismatch, obtain the identification information adjacent to the currently written data and whose writing order is after the current writing order The newly written data and the identification information of the newly written data;

a second determining unit, configured to determine whether the identification information of the newly written data matches the identification information of the target data to be queried;

A third determining unit, configured to determine the newly written data as the target data to be queried based on the matching result in the second determining unit being a match.

The present application also provides a method for acquiring query data, including:

Receive data query requests;

According to the data query request, the identification information of the newly written data is obtained, and the identification information of the newly written data is the identification information of the last written write data determined according to the writing sequence range;

Encapsulate the identification information into the data query request and send it;

Obtain the target data returned in response to the data query request encapsulated with the identification information.

The present application also provides a device for acquiring query data, including:

a receiving unit for receiving a data query request;

a first obtaining unit, configured to obtain, according to the data query request, the identification information of newly written data, where the newly written data is the last written write data determined according to the writing sequence range;

an encapsulation sending unit, configured to encapsulate the identification information into the data query request and send it;

A second acquiring unit, configured to acquire target data returned in response to the data query request encapsulated with the identification information.

The present application also provides a method for sending query data identification information, including:

Receive an acquisition request for the identification information of the newly written data, wherein the identification information of the newly written data is the identification information of the last written write data determined according to the writing sequence range;

According to the acquisition request, the identification information of the last written write data determined according to the write sequence range is sent as the identification information of the newly written data.

The present application also provides a sending device for querying data identification information, including:

A receiving unit for receiving an acquisition request for the identification information of the newly written data, wherein the identification information of the newly written data is the identification information of the last written write data determined according to the writing sequence range;

The sending unit is used for, according to the acquisition request in the receiving unit, according to the acquisition request, the identification information of the last written write data determined according to the writing sequence range is used as the identification information of the new write data. send.

The present application also provides a data writing method, comprising:

receiving a data write request, wherein the data write request carries write data that needs to be written;

According to the data write request, configure identification information for the write data; wherein, the identification information is used to identify the information of the write data writing sequence;

The write operation is performed according to the write data and the identification information of the write data.

In some embodiments, it also includes:

receiving state information describing the write state of the write data;

Send the status information.

In some embodiments, the receiving a data write request includes:

According to the set receive data write request range, receive data write requests for different write data in the same write partition.

In some embodiments, the receiving data write requests for different write data of the same write partition according to the set range of the received data write request includes:

Receive data write requests for different write data of the same write partition according to the set receiving time range for receiving the data write request; or,

According to the set receiving capacity range for receiving the data write request, data write requests for different write data of the same write partition are received.

In some embodiments, configuring identification information for the write data according to the data write request includes:

determining the different write data in the data write request as a write data set;

The identification information is configured for the write data set.

In some embodiments, performing the write operation according to the write data and the identification information of the write data includes:

The write operation is performed according to the write data set and the identification information corresponding to the write data set.

The application also provides a data writing device, comprising:

a receiving unit, configured to receive a data write request; wherein, the data write request carries write data that needs to be written;

a configuration unit, configured to configure identification information for the write data according to the data write request; wherein the identification information is used to identify the information of the write order of the write data;

The writing unit is configured to perform a writing operation according to the writing data and the identification information of the writing data.

The present application also provides a method for sending a data write request, including:

Sending a data write request, wherein the data write request carries write data that needs to be written;

Receive write status information for the write data returned in response to the data write request.

In some embodiments, the sending the data write request includes:

determining a cache node corresponding to the write data according to the attribute information carried in the data write request and used to describe the write data;

Send the data write request to the corresponding cache node.

In some embodiments, determining the cache node corresponding to the write data according to the attribute information carried in the data write request and used to describe the write data includes:

According to the identifier of the write database and the identifier of the write data table describing the write data in the attribute information, establish write path information for the write data;

According to the write path information, obtain the partition information of the write data table;

According to the partition information, the cache node corresponding to the write data is determined.

The present application also provides a device for sending a data write request, including:

a sending unit, configured to send a data write request, wherein the data write request carries write data that needs to be written;

A receiving unit, configured to receive write status information for the write data returned in response to the data write request.

The present application also provides a method for reading written data, comprising:

According to the read request sent to read the write data information, read the write data and the identification information of the write data;

The write data is determined as the current write data, and the identification information of the write data is determined as the identification information of the current write data;

The currently written data and the identification information of the currently written data are stored locally.

In some embodiments, the reading of the write data and the identification information of the write data according to the sent read request to read the write data information includes:

sending the read request according to the read cycle in an asynchronous manner;

According to the read request, the write data and the identification information of the write data are read.

The application also provides a reading device for writing data, comprising:

a reading unit, configured to read the write data and the identification information of the write data according to the read request sent to read the write data information;

a determining unit, configured to determine the write data as the current write data, and determine the identification information of the write data as the identification information of the current write data;

A storage unit, configured to store the currently written data and the identification information of the currently written data locally.

The application also provides an analytical database system, including: a front-end node, a cache node and a computing node;

Wherein, the front-end node is used to send a data operation request to the cache node, and the operation status or target data or identification information of newly written data returned for the data operation request; when the front-end node receives the When the data operation request is a data write request, send the received data write request to the cache node, and receive the data write request returned by the cache node in response to the data write request. , the write status information of the written data; when the data operation request received by the front-end node is a data query request, the identifier of the newly written data will be obtained from the cache node according to the received data query request information, the identification information of the newly written data is the identification information of the last written written data determined according to the writing sequence range, and the identification information of the newly written data is encapsulated into the data query request and sent to The computing node obtains the target data determined by the computing node for the data query request;

The cache node is configured to receive the data operation request from the front-end node, and send information in response to the data operation request to the front-end node; wherein, when the data operation request received by the cache node For the data write request, according to the data write request, configure identification information for the write data carried in the data write request; wherein, the identification information is used to identify the write data write sequence information, and perform the write operation according to the write data and the identification information of the write data; when the data operation request received by the cache node is the data query request, the cache node receives the request from The acquisition request of the front-end node for the identification information of the newly written data, according to the acquisition request, the identification information of the last written write data determined according to the writing sequence range is sent as the identification information of the newly written data to the front-end node;

The computing node is used to obtain a data query request from the front-end node, and the data query request carries the identification information of the target data to be queried, wherein the identification information is used to identify the information of the writing sequence of the written data, The identification information of the target data to be queried is the identification information of the last written written data determined according to the writing sequence range; according to the data query request, it is determined whether the identification information of the target data to be queried is the same as the stored data. The identification information of the current write data matches; if it does not match, then acquire the new write data and the new write data adjacent to the identification information of the current write data and whose writing order is after the current writing order. Identification information of the written data; determine whether the identification information of the newly written data matches the identification information of the target data to be queried; if so, determine the newly written data as the target data to be queried; or , according to the read request to read and write data information sent to the cache node, read the write data and the identification information of the write data; determine the write data as the current write data, The identification information of the written data is determined as the identification information of the currently written data; the current written data and the identification information of the currently written data are stored locally.

In some embodiments, it also includes:

a service coordination node, configured to provide the cache node corresponding to the written data according to the attribute information of the written data in the data write request in the front-end node;

The front-end node sends the data write request to the cache node corresponding to the location information according to the cache node provided by the service coordination node.

In some embodiments, the service coordination node, based on the identifier of the write database and the identifier of the write data table used to describe the write data in the attribute information, established by the front-end node for the Write path information of the write data, providing partition information of the write data table;

The front-end node can determine the cache node corresponding to the write data according to the address and port of the cache node in the partition information.

In some embodiments, the method further includes: a storage node, configured to store the write data received by the cache node and need to be written, and return write status information for the write data.

The present application also provides a computer storage medium for storing data generated by a network platform and a program for processing the data generated by the network platform;

When the program is read and executed, the following steps are performed:

Obtain a data query request, where the data query request carries the identification information of the target data to be queried, wherein the identification information is used to identify the information of the writing sequence of the written data, and the identification information of the target data to be queried is according to the written The identification information of the last written written data determined by the sequence range;

According to the data query request, determine whether the identification information of the target data to be queried matches the stored identification information of the currently written data;

If it does not match, then acquire the identification information of the newly written data and the newly written data adjacent to the identification information of the current written data and whose writing order is after the current writing order;

Determine whether the identification information of the newly written data matches the identification information of the target data to be queried;

If so, determine the newly written data as the target data to be queried;

Alternatively, perform the following steps:

Receive data query requests;

According to the data query request, the identification information of the newly written data is obtained, and the identification information of the newly written data is the identification information of the last written write data determined according to the writing sequence range;

Encapsulate the identification information into the data query request and send it;

obtaining target data returned in response to the data query request encapsulated with the identification information;

Alternatively, perform the following steps:

Receive an acquisition request for the identification information of the newly written data, wherein the identification information of the newly written data is the identification information of the last written write data determined according to the writing sequence range;

According to the acquisition request, the identification information of the last written write data determined according to the writing sequence range is sent as the identification information of the newly written data;

Alternatively, perform the following steps:

receiving a data write request, wherein the data write request carries write data that needs to be written;

According to the data write request, configure identification information for the write data; wherein, the identification information is used to identify the information of the write data writing sequence;

Perform a write operation according to the write data and the identification information of the write data;

Alternatively, perform the following steps:

Sending a data write request, wherein the data write request carries write data that needs to be written;

receiving write status information for the write data returned in response to the data write request;

Alternatively, perform the following steps:

According to the read request sent to read the write data information, read the write data and the identification information of the write data;

The write data is determined as the current write data, and the identification information of the write data is determined as the identification information of the current write data;

The currently written data and the identification information of the currently written data are stored locally.

The application also provides an electronic device, comprising:

processor;

The memory is used to store a program for processing data generated by the network platform. When the program is read and executed by the processor, the following steps are performed:

Obtain a data query request, where the data query request carries the identification information of the target data to be queried, wherein the identification information is used to identify the information of the writing sequence of the written data, and the identification information of the target data to be queried is according to the written The identification information of the last written written data determined by the sequence range;

According to the data query request, determine whether the identification information of the target data to be queried matches the stored identification information of the currently written data;

If it does not match, then acquire the identification information of the newly written data and the newly written data adjacent to the identification information of the current written data and whose writing order is after the current writing order;

Determine whether the identification information of the newly written data matches the identification information of the target data to be queried;

If so, determine the newly written data as the target data to be queried;

Alternatively, perform the following steps:

Receive data query requests;

According to the data query request, the identification information of the newly written data is obtained, and the identification information of the newly written data is the identification information of the last written write data determined according to the writing sequence range;

Encapsulate the identification information into the data query request and send it;

obtaining target data returned in response to the data query request encapsulated with the identification information;

Alternatively, perform the following steps:

Receive an acquisition request for the identification information of the newly written data, wherein the identification information of the newly written data is the identification information of the last written write data determined according to the writing sequence range;

According to the acquisition request, the identification information of the last written write data determined according to the writing sequence range is sent as the identification information of the newly written data;

Alternatively, perform the following steps:

receiving a data write request, wherein the data write request carries write data that needs to be written;

According to the data write request, configure identification information for the write data; wherein, the identification information is used to identify the information of the write data writing sequence;

Perform a write operation according to the write data and the identification information of the write data;

Alternatively, perform the following steps:

Sending a data write request, wherein the data write request carries write data that needs to be written;

receiving write status information for the write data returned in response to the data write request;

Alternatively, perform the following steps:

According to the read request sent to read the write data information, read the write data and the identification information of the write data;

The write data is determined as the current write data, and the identification information of the write data is determined as the identification information of the current write data;

The currently written data and the identification information of the currently written data are stored locally.

Compared with the prior art, the present application has the following advantages:

A data query method provided by the present application includes: obtaining a data query request, wherein the data query request carries identification information of target data to be queried, wherein the identification information is used to identify the information of the writing sequence of the written data, The identification information of the target data to be queried is the identification information of the last written written data determined according to the writing sequence range; according to the data query request, it is determined whether the identification information of the target data to be queried is the same as the stored data. The identification information of the current written data matches; if it does not match, then acquire the new written data and the new written data adjacent to the identification information of the current written data and whose writing order is after the current written data. Identification information of the written data; determine whether the identification information of the newly written data matches the identification information of the target data to be queried; if so, determine the newly written data as the target data to be queried. It can determine whether the currently written data is the latest data written to the analytical database system by matching the identification information in the data query request, so as to ensure that the latest real-time data can be queried and avoid inaccurate query data due to factors such as delays. Or there is a deviation.

A data writing method provided by the present application includes: receiving a data writing request, wherein the data writing request carries write data that needs to be written; input data configuration identification information; wherein, the identification information is used to identify the information of the writing sequence of the write data; the write operation is performed according to the write data and the identification information of the write data. Therefore, information identification information for identifying the writing sequence of the written data can be configured for the written data when the data is written, so as to ensure the real-time performance of the data query.

Description of drawings

1 is a flowchart of an embodiment of a data query method provided by the present application;

2 is a schematic diagram of a query principle according to an embodiment of a data query method provided by the present application;

3 is a schematic structural diagram of an embodiment of a data query apparatus provided by the present application;

4 is a flowchart of an embodiment of a method for acquiring query data provided by the present application;

5 is a schematic structural diagram of an embodiment of an apparatus for acquiring query data provided by the present application;

6 is a flowchart of an embodiment of a method for sending query data identification information provided by the present application;

7 is a schematic structural diagram of an embodiment of a sending device for querying data identification information provided by the present application;

8 is a flowchart of an embodiment of a data writing method provided by the present application;

9 is a schematic diagram of a writing principle of an embodiment of a data writing method provided by the present application;

10 is a schematic structural diagram of an embodiment of a data writing device provided by the present application;

11 is a flowchart of an embodiment of a method for sending a data write request provided by the present application;

12 is a schematic structural diagram of an embodiment of a device for sending a data write request provided by the present application;

13 is a flowchart of an embodiment of a method for reading written data provided by the present application;

14 is a schematic structural diagram of an embodiment of a reading device for writing data provided by the present application;

FIG. 15 is a schematic structural diagram of an embodiment of an analytical database system provided by the present application.

Detailed ways

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. However, the present application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar promotions without violating the connotation of the present application. Therefore, the present application is not limited by the specific implementation disclosed below.

The terminology used in this application is for the purpose of describing particular embodiments only and is not intended to limit the application. The descriptions used in this application and the appended claims, such as "a", "first", and "second", etc., are not limitations on quantity or sequence, but Used to distinguish information of the same type from each other.

In combination with the descriptions in the above background art, with the development of big data, the analysis of big data faces higher real-time visibility requirements, so as to improve the accuracy of data analysis. In the face of massive data analysis scenarios, it is not only necessary to ensure the efficient writing of massive data, but also to ensure the real-time query of massive data, so as to give users the ability to explore the value of real-time data and meet the increasingly strong demand for fast data (FastData). demand to enhance the value of data. However, the big data analysis technology provided in the prior art can only achieve near real-time, and even near real-time is difficult to achieve. The so-called near real-time refers to the scale (second level) that can be felt in human-computer interaction, rather than the real-time level (ns/us level) of automatic processing by machines.

At present, for big data analysis, the existing technology provides the following two big data analysis technologies:

One is that Hive (data warehouse analysis system) is based on Hadoop (distributed system infrastructure) and provides rich SQL query methods to realize the query and analysis capabilities of big data. Hive maps structured data files stored in HDFS (Hadoop Distributed File System: Distributed File System) into database tables, and converts SQL submitted by users into MapReduce (programming model for large-scale data sets ( More than 1TB) parallel operation) task operation, realize big data analysis through SQL. Hadoop, which Hive relies on at the bottom layer, can solve most of the problems of big data analysis. However, because Hadoop executes MapReduce tasks, specifically, users put a batch of data into Hadoop for execution, and obtain the results after analysis. Depending on the amount of data, There are also significant differences in the execution time. Usually, the difference in execution time ranges from a few hours to a few days. During the above execution process, the newly written data will not participate in the relevant analysis and calculation. Therefore, Hive uses Hadoop for big data. During analysis, timeliness cannot be guaranteed, so Hive does not have the ability to visualize data in real time.

The other is PALO (Data Warehouse Analysis System), which is a parallel database system for real-time analysis of 100 TB-PB level big data, with low-latency point checking and high-throughput Ad-hoc (ad-hoc query) query ability. At present, PALO supports two data import methods, object storage file import and local file import. By increasing the frequency of data import, the above-mentioned near real-time data can be seen.

It can be seen that none of the above solutions can realize real-time visibility of data analysis, and accordingly, the accuracy of data analysis cannot be guaranteed.

Based on the above analysis, a data query method provided by the present application can ensure the real-time visibility of data query, so as to improve the accuracy of data analysis. Please refer to FIG. 1 and FIG. 2 , FIG. 1 is a flowchart of an embodiment of a data query method provided by the present application, and FIG. 2 is a schematic diagram of a query principle of an embodiment of a data query method provided by the present application. The query method in this embodiment is mainly described from the perspective of a computing node (ComputeNode) in an analytical database system, and specifically includes:

Step S101: Obtain a data query request, where the data query request carries identification information of the target data to be queried, wherein the identification information is used to identify the information of the writing sequence of the written data.

In this embodiment, data analysis can mainly be understood as a query operation on data and related data processing for the query operation.

The identification information of the target data to be queried carried in the data query request may be information used to identify the writing sequence of the written data, and the identification information may be expressed in the form of a version number. Identified in the form of a version number. The operation here mainly involves the operation when writing data, so I will not elaborate too much here. Please refer to the description of the subsequent part of writing data. It should be clearly stated here that the writing data can be understood as including: Insert, modify, delete, etc. operations involving data update.

In this embodiment, the query request for acquiring data may be a data query request received from a front-end node (FrontNode), that is, the data query request sent by the front-end node will carry the version number of the target data to be queried. The identification information of the query target data is the version number of the last written write data determined according to the write sequence range, that is, the data query request carries the version number of the last written write data. If the version number uses a numerical value as the identification type and is set in ascending order, in order to ensure the real-time visibility of the data to be queried, the data query request carries the largest version number within the range of the written data version number. Similarly, if According to the setting in descending order, the data query request carries the smallest version number within the version number range of the written data. Normally, the version number is determined to be the latest written data, which is also the case in this embodiment.

Step S102: According to the data query request, determine whether the identification information of the target data to be queried matches the stored identification information of the currently written data.

The identification information of the currently written data in the step S102 may be the written data read from the buffer node (BufferNode) and stored locally. Of course, in this embodiment, in order to facilitate subsequent operations, the currently written data is stored locally, but this does not mean that the currently written data can only be stored locally. There are no restrictions on the storage location.

Based on the above, it can be understood that after obtaining the data query request, it is also necessary to perform a matching operation between the identification information of the target data to be queried in the data query request and the identification information of the currently written data. Therefore, it is necessary to obtain The identification information of the currently written data, therefore, also includes:

Step S100+11: read and write data information;

Step S100+12: determining the identification information in the read write data information as the identification information of the current write data;

Step S100+13: storing the write data corresponding to the identification information of the current write data and the identification information of the current write data locally;

Step S100+14: Determine whether the identification information of the target data to be queried matches the identification information of the currently written data stored locally.

The reading and writing data information in the step S100+11 is mainly to read and write data information to the cache node. A specific implementation process may be that, in an asynchronous manner, the write data information is read according to a read cycle, and the read cycle may be, for example, 1 ms. A read request to read and write data is sent to the cache node in 1ms, and the cache node sends the corresponding read write data information to the computing node according to the read request, and the write data information includes: write Data identification information and write data.

The reading of the currently written data may be performed according to a set read cycle, or a read operation of reading the currently written data may be initiated according to the acquired data query request.

In this embodiment, the computing node can read the written data in the cache node through an asynchronous data reading module (AsyncIncDataReaderService), and specifically, can be read from the cache through an asynchronous data reading module (AsyncIncDataReaderService). The data service module (DataServer) in the node reads and writes data; of course, the data can also be read and written from the data service module (DataServer) in the cache node through the synchronous data read module (SyncIncDataReaderService) in the computing node, It should be noted that, in this embodiment, the write data mainly refers to incremental data.

How to match the identification information of the target data to be queried with the stored identification information of the currently written data in step S102 may include the following steps:

Step S102-1: Compare the identification code of the identification information of the target data to be queried with the identification code of the identification information of the currently written data;

According to the description in the above step S101, if the identification information is version information, the identification code is a version number, and in this embodiment, the version number is represented by a numeric type. The specific implementation of the step S102-1 may be to compare the value of the version number of the target data to be queried with the stored value of the currently written data version number, the same is a match, and the difference is a mismatch.

Step S102-2: If the identification code of the identification information of the target data to be queried is greater than the identification code of the identification information of the currently written data, then determine that the identification code of the identification information of the target data to be queried is the same as the current identification code. The identification codes of the identification information of the written data do not match.

The identification code of the identification information of the target data to be queried in the step S102-2 is greater than the identification code of the identification information of the currently written data, indicating the identification information of the current written data stored in the computing node and the current written data. It is not the latest written data, because in this embodiment, in the order of the above version numbers, the larger the version number, the closer the time of writing the data to the request time of the data query request, that is, the data stored in the computing node. The current write data for is not the most recent write data in the Analytical Database system.

The above is the case of mismatch, and also includes a case of matching. In this embodiment, when the identification code of the identification information of the target data to be queried is less than or equal to the identification code of the identification information of the currently written data , it is determined that the identification code of the identification information of the target data to be queried matches the identification code of the identification information of the currently written data. That is, the value of the version number of the target data to be queried is less than or equal to the value of the version number of the currently written data, indicating that the version number of the target data to be queried matches the version number of the currently written data. . That is: when the numerical value of the version number of the target data to be queried is less than the numerical value of the version number of the currently written data, it means that the target data to be queried can be near real-time data, and when the numerical value of the version number of the target data to be queried is If the value is equal to the version number of the currently written data, it indicates that the target data to be queried is real-time data, and the currently written data needs to be determined as the target data to be queried.

In the case of matching, the currently written data will be determined as the target data to be queried.

If the value of the version number of the target data to be queried is greater than the value of the version number of the currently written data, that is, in the case of no match, the following step S103 is executed.

Step S103: if it does not match, then acquire the identification information of the new write data and the new write data whose writing order is adjacent to the identification information of the current writing data and whose writing order is after the current writing order;

Usually, the writing order represents the order in which data is written into the analytical database system, that is, the new and the old. Because the post-written data is incremental data for the first-written data, from the perspective of the total amount of data, the total amount of the post-written data plus the previous data volume is usually greater than the first-written data volume and the previous data volume. The sum of the existing data volumes. In this embodiment, each time the data written into the analytical database system is written in increments of data.

The step S103 is based on the step S102 that in the case where the identification information of the target data to be queried does not match the identification information of the stored currently written data, the newly written data needs to be read from the cache node, which is the same as the The same as described in step S101, when the identification information of the target data to be queried does not match the identification information of the stored current write data, the asynchronous data reading module (AsyncIncDataReaderService) in the computing node is used from the cache node. The data service module (DataServer) reads the newly written data, where the new written data refers to reading the identification information adjacent to the current written data currently stored by the computing node, and the writing sequence is Describe the data after the current write data and the corresponding identification information, that is, the version number value of the new write data read should be adjacent to the current write data version number value, and greater than the current write data version number value , because each time the data is written, it is an incremental data, and there is no inclusion relationship between each incremental data. Therefore, in order to obtain complete data, it is necessary to read in the order of writing. Of course, the The sequential reading in the writing sequence is performed based on the fact that the version number of the currently written data is smaller than the version number of the target data to be queried.

After the newly written data is read, step S104 needs to be executed.

Step S104: Determine whether the identification information of the newly written data matches the identification information of the target data to be queried.

The matching judgment process in the step S104 is the same as the above, and may specifically include:

Step S104-1: Compare the identification code of the identification information of the newly written data with the identification code of the identification information of the target data to be queried;

The step S104-1 specifically compares the version number of the newly written data with the version number of the target data to be queried.

Step S104-2: If the identification code of the identification information of the newly written data is greater than or equal to the identification code of the identification information of the target data to be queried, then determine the identification information of the newly written data and the target data. match the identification information.

There are two situations in which the matching is successful. One is that the version number of the newly written data is greater than the version number of the target data to be queried, and the other is that the version number of the newly written data is equal to the target data to be queried. The version number of the data.

For the case of greater than or equal to, the newly written data read from the cache node is the latest written data, and the version number of the target data to be queried in the computing node indicates that the version number corresponds to the target data to be queried in the new write data. The data has been written before, so for the range of data written in the cache node, the newly written data is the latest written data.

For the case of equal, it means that the version number of the newly written data read from the cache node is exactly the same as the version number of the target data to be queried in the computing node, indicating that the version number of the latest written data in the current analytical database system is is the version number of the newly written data, and the version number in the computing node also corresponds to the version number of the newly written data, thereby ensuring that the computing node can determine the newly written data according to the version number of the newly written data, and Perform corresponding calculation processing.

It can be understood that, in this embodiment, when it is determined that the identification information of the newly written data matches the identification information of the target data, it may further include:

Update the current write data to the acquired new write data, and update the identification information of the current write data to the identification information of the new write data, so that the next read in the computing node Before the cycle comes, the current write data can be updated to the latest write data determined according to the matching result and the corresponding latest identification information. Of course, since the computing node will read the written data according to the set read cycle, the update of the read data in the computing node can still be guaranteed without updating.

It should be noted that the "latest" involved in this embodiment is only a phased description. For example, the description during matching does not mean that the write data that is successfully matched is still the latest write except for the matching operation. data, because when the matching is performed, there is still another data written, this time, relative to the entire analytical database system, the other data can be the latest written data.

The above is the description for the matching case. Then, the comparison result in the step S104-1 is another case where the identification code of the identification information of the newly written data is smaller than the identification information of the target data to be queried. identification code, at this time, it means that the identification information of the newly written data does not match the identification information of the target data, and it is necessary to return to step S103 to continue reading the written data until the data read from the cache node is Only when the version number of the newly written data is greater than or equal to the version number of the target data to be queried can start the corresponding calculation. The calculation here refers to processing such as the selection of the target data to be queried.

Based on the above content, when the version number of the newly written data matches the version number of the target data to be queried, step S105 is performed.

Step S105: If yes, determine the newly written data as the target data to be queried.

In step S105, based on whether the matching result in step S104 is greater than or equal to, the newly written data corresponding to the version number of the newly written data can be determined as the target data to be queried.

So far, the data query is completed. It can be seen that in the entire query process, the latest written data is determined according to the version number of the target data to be queried carried in the data query request, so as to ensure that the target data to be queried is the latest written data. The system writes data, and then the computing node can process the latest data accordingly to ensure the timeliness of the query data.

The above is a specific description of an embodiment of a data query method provided by the present application. Corresponding to the above-mentioned embodiment of a data query method, the present application also discloses an embodiment of a data query device. Please refer to FIG. 3. Since the device The embodiment is basically similar to the method embodiment, so the description is relatively simple, and for related parts, please refer to the partial description of the method embodiment. The apparatus embodiments described below are merely illustrative.

As shown in FIG. 3, FIG. 3 is a schematic structural diagram of an embodiment of a data query apparatus provided by the present application, and the apparatus embodiment includes:

The first obtaining unit 301 is configured to obtain a data query request, where the data query request carries identification information of the target data to be queried, wherein the identification information is used to identify the information of the writing sequence of the data to be queried. The identification information of the target data is the identification information of the last written written data determined according to the writing sequence range;

a first determining unit 302, configured to determine, according to the data query request, whether the identification information of the target data to be queried matches the stored identification information of the currently written data;

The first determination unit 302 includes: a comparison subunit and a first matching determination subunit.

The comparison subunit is used to compare the identification code of the identification information of the target data to be queried with the identification code of the identification information of the currently written data;

The first matching determination subunit is configured to determine the identity of the identification information of the target data to be queried if the identification code of the identification information of the target data to be queried is greater than the identification code of the identification information of the currently written data. The identification code does not match the identification code of the identification information of the currently written data.

Also includes: a second matching determination subunit and a data determination subunit;

The second matching determination subunit is used to determine the identification of the target data to be queried if the identification code of the identification information of the target data to be queried is less than or equal to the identification code of the identification information of the currently written data The identification code of the information matches the identification code of the identification information of the currently written data;

The data determination subunit is configured to determine the currently written data as the target data to be queried.

Also includes:

A read unit for writing data information;

The current identification determination unit is used to determine the identification information in the read write data information as the identification information of the current write data;

a storage unit for storing the write data corresponding to the identification information of the current write data and the identification information of the current write data locally;

The first determining unit 302 is specifically configured to determine whether the identification information of the target data to be queried matches the identification information of the currently written data stored locally.

Specifically, the read unit may read the write data information according to the read cycle in an asynchronous manner. For example, as described in step S102 above, the write data in the cache node is read through the AsyncIncDataReaderService module in the computing node.

The second obtaining unit 303 is configured to obtain, when the matching result of the first determining unit 302 is a mismatch, obtain the identification information adjacent to the currently written data and whose writing order is in the current writing order The following new write data and the identification information of the new write data.

A second determining unit 304, configured to determine whether the identification information of the newly written data matches the identification information of the target data to be queried;

The second determination unit 304 includes: a comparison subunit and a first matching determination subunit.

The comparison subunit is used to compare the identification code of the identification information of the newly written data with the identification code of the identification information of the target data to be queried;

The first matching determination subunit is used to determine the identification of the newly written data if the identification code of the identification information of the newly written data is greater than or equal to the identification code of the identification information of the target data to be queried The information matches the identification information of the target data.

The second determining unit 304 further includes: a second matching determining subunit and a returning subunit;

The second matching determination subunit is used to determine the identification information of the newly written data if the identification code of the identification information of the newly written data is smaller than the identification code of the identification information of the target data to be queried Does not match the identification information of the target data.

The returning subunit is used for returning to the second obtaining unit 303 for execution.

The third determining unit 305 is configured to determine the newly written data as the target data to be queried based on the matching result in the second determining unit 302 being a match.

In this embodiment, an update unit may be further included, configured to update the current write data to the data obtained in the second obtaining unit 303 when the determination result of the second determining subunit is a match. The newly written data is updated, and the identification information of the currently written data is updated to the identification information of the newly written data.

In this embodiment, it may further include: a sending unit, configured to send the determined target data to be queried. In this embodiment, the determined target data to be queried may be sent to the front-end node, that is, to the front-end node. The end side where the computing node sends the data query request.

The above is a description of an embodiment of a data query apparatus provided for a data query method embodiment provided by the present application. For specific content, reference may be made to the above data query method embodiment, and repeated repetition is not repeated.

Based on the above content, the present application further provides a method for acquiring query data, which can be understood as how to obtain the query data, so that the real-time visibility of the query data can be ensured. In this embodiment, the obtaining method is mainly described from the perspective of the front-end node. As shown in FIG. 4 , FIG. 4 is a flowchart of an embodiment of a method for obtaining query data provided by the present application, and the embodiment of the obtaining method includes:

Step S401: receiving a data query request;

The step S401 is specifically that the front-end node receives a data query request from a user.

Step S402: according to the data query request, obtain the identification information of the newly written data, the identification information of the newly written data is the identification information of the last written write data determined according to the writing sequence range;

The specific implementation process of step S402 may be that after the current end node receives the data query request, in order to ensure that the latest data can be queried, it needs to obtain the identification information of the newly written data from the cache node, and the identification information is as described above in the In this embodiment, it may be a version number, which is expressed in the form of a numerical value. The identifier of the newly written data here may refer to the identifier of the data last written to the analytical data system determined according to the writing sequence range, that is, the new version number.

Step S403: encapsulate the identification information into the data query request and send it;

The step S403 may specifically include:

The identification information obtained from the step S402 is encapsulated into the data query request, and then the data query request encapsulated with the identification information is sent to the computing node. The corresponding data query is performed by the computing node, and the query process is as described in the above steps S101-S104.

Step S404: Obtain the target data returned in response to the data query request encapsulated with the identification information.

The front-end node will receive the target data returned by the computing node relative to the data query request, so as to provide it to the user.

At this point, the query data acquisition process is completed. Since the data query request carries the identification information of the newly written data, it can be guaranteed that the obtained data is real-time data when querying.

The above is a detailed description of an embodiment of a method for acquiring query data provided by the present application. Corresponding to the embodiment of a method for acquiring query data provided above, the present application also discloses an embodiment of an apparatus for acquiring query data. Referring to FIG. 5 , since the apparatus embodiment is basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to the partial description of the method embodiment. The apparatus embodiments described below are merely illustrative.

As shown in FIG. 5 , FIG. 5 is a schematic structural diagram of an embodiment of an apparatus for acquiring query data provided by the present application, and the embodiment of the acquiring apparatus includes:

a receiving unit 501, configured to receive a data query request;

The first obtaining unit 502 is configured to obtain, according to the data query request, the identification information of newly written data, where the newly written data is the last written write data determined according to the writing sequence range;

An encapsulation sending unit 503, configured to encapsulate the identification information into the data query request and send it;

The second obtaining unit 504 is configured to obtain target data returned in response to the data query request encapsulated with the identification information.

For the description of the foregoing obtaining apparatus embodiments, reference may be made to steps S401 to S404 in the foregoing obtaining method embodiments, which will not be repeated here.

Based on the above content, the present application also provides an embodiment of a sending method for query data identification information. The sending method embodiment is to describe the query data from the perspective of a cache node. As shown in FIG. 6 , the sending method embodiment includes:

Step S601: receiving an acquisition request for the identification information of the newly written data, wherein the identification information of the newly written data is the identification information of the last written write data determined according to the writing sequence range;

The acquisition request in the step S601 may be an acquisition request for acquiring newly written data from the cache node based on a query data request sent from the user to the front-end node.

Step S602: According to the acquisition request, send the identification information of the last written write data determined according to the writing sequence range as the identification information of the newly written data.

The step S602 may specifically be that the cache node can also provide the front-end node with the identification information of the newly written data based on the acquisition request received in the step S601; thus, it can be ensured that the query data request carries The identification information of the newly written data written into the analytical database system when the request is sent, thereby ensuring that the subsequent computing nodes can perform corresponding calculation processing for the newly written data to ensure the real-time nature of the data.

So far, the description of how to send the query data identification information in the data query process can be combined with the description of the above steps S101-S104 and S401-S404.

Based on the above content, the present application also provides an embodiment of a sending apparatus for querying data identification information, corresponding to the above-mentioned embodiment of the method for sending query data identification information, please refer to FIG. 7 , because the apparatus embodiment is basically similar to the method implementation. For example, the description is relatively simple, and for related parts, please refer to the partial description of the method embodiment. The apparatus embodiments described below are merely illustrative.

As shown in FIG. 7 , the embodiment of the sending device for query data identification information provided by this application includes:

The receiving unit 701 is used to receive an acquisition request for the identification information of the newly written data, wherein the identification information of the newly written data is the identification information of the last written write data determined according to the writing sequence range;

The sending unit 702 is configured to, according to the acquisition request in the receiving unit, according to the acquisition request, take the identification information of the last written write data determined according to the writing sequence range as the identification information of the newly written data to send.

The above is a detailed description of various processing methods involved in the data query process. In order to ensure the real-time visibility of data, the present application also provides a data writing method. Please refer to FIG. 8 and FIG. 9 . FIG. 8 It is a flowchart of an embodiment of a data writing method provided by the present application, and FIG. 9 is a schematic diagram of a writing principle of an embodiment of a data writing method provided by the present application. This embodiment of the data writing method is mainly described from the perspective of a cache node, and the embodiment may include:

Step S801: Receive a data write request, wherein the data write request carries write data that needs to be written;

The specific implementation process of the step S801 may be receiving a data write request sent from the front-end node, where the data write request carries the write data to be written.

In this embodiment, the cache node may receive a data write request through a data service module (DataServer). Receiving can be receiving data write requests for different write data in the same write partition according to the set range of received data write requests, that is, it can accumulate write data requests written to the same partition. When the incoming data request reaches the set receive data write request range, submit the accumulated batch of data write requests, then continue to accumulate data write requests, and submit it whenever the receive data write request range is reached. Adopting this method of batch submission can on the one hand improve the throughput of data writing, and on the other hand can avoid damage to the storage node caused when data is written to the storage node separately for each data request.

In this embodiment, the received data write request range may include at least two ranges, one is the receiving time range, and the other is the receiving capacity range. The so-called receiving time range can be understood as the length of the set receiving time, for example: 1 minute. The receiving capacity range can be understood as the size of the received data write request, for example: 1MB, that is, when the received data write request reaches 1MB, the data write request within the receiving range is submitted as a batch of requests.

Step S802: according to the data writing request, configure identification information for the written data; wherein, the identification information is used to identify the information of the writing sequence of the written data;

The purpose of the step S802 is to configure the identification information for the data write request. In the present embodiment, the identification information can be in the form of an auto-incremented version number, so the identification information can be understood as an identification for the writing sequence of the written data. , the writing order can be the order of writing, for example: the order of writing time, etc., that is, it can identify new written data and historical written data. In this embodiment, the version number can be in ascending order. Configuration, that is, a larger version number indicates that the corresponding written data is the last written data. On the contrary, it is also possible to follow the descending order, but a smaller version number indicates that the corresponding written data is the last written data. data, that is, the latest written data.

Of course, the configuration of the identification information can also be identified in other ways, for example: direct identification according to the writing time, as long as the order of writing data can be distinguished by the identification information, and it is not limited to such expressions as version numbers. Way.

Based on the description in the above step S801, after the accumulated write data request reaches the upper limit of the received data write request range, the identification information is configured for the accumulated write data in the batch of write data requests. Then, the specific implementation process of the step S802 may include:

determining the different write data in the data write request as a write data set;

The identification information is configured for the write data set.

This processing method can improve the throughput of writing data, and can also avoid damage to the storage node caused by writing data. Of course, instead of using the accumulation method, the identification information can be configured separately for the write data in each received data write request, and subsequently each write data can be written once.

Based on the above content, it is clear that the purpose of step S802 is to configure identification information for writing data in the received data writing request, so as to provide a basis for subsequent determination of newly written data.

Step S803: Perform a write operation according to the write data and the identification information of the write data.

Based on the description of the above step S802, the specific implementation process of the step S803 may include:

The write operation is performed according to the write data set and the identification information corresponding to the write data set.

In this embodiment, the write data or the write data set together with the corresponding identification information may be written into the underlying storage node, so as to complete the write operation of the write data.

After the write-based operation is complete, it can also include:

Step S80+11: Receive state information for describing the write state of the write data;

The purpose of the step S80+11 is to receive the status information for the write status of the write data after the write data is written to the underlying storage node, and the status information may include: status information of successful writing or status of writing failure information.

Step S80+12: Send the status information.

In the step S80+12 described in this embodiment, the status information is sent to the front-end node, so that the front-end node can perform corresponding processing on the write status, for example, if the write fails, the data write request will be sent again, which is understandable What's more, if the write data is successfully written, the write status may not be returned, or the write status may be returned.

The above is a detailed description of an embodiment of a data writing method provided by the present application. Corresponding to the data writing method embodiment provided above, the present application also discloses an embodiment of a data writing device, please refer to FIG. 10 , since the apparatus embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant part may refer to the partial description of the method embodiment. The apparatus embodiments described below are merely illustrative.

As shown in FIG. 10, the embodiment of the data writing device includes:

A receiving unit 1001, configured to receive a data write request; wherein, the data write request carries write data that needs to be written;

The receiving unit 1001 may include: a range setting subunit and a receiving subunit, where the range setting subunit is used to set the range of the received data write request. The receiving subunit is configured to receive data write requests for different write data in the same write partition according to the range of the received data write request set in the range setting subunit.

The range setting subunit may include: a time range setting subunit and a capacity range setting subunit, wherein the time range setting subunit is used to set a receiving time range for receiving the data write request; the capacity range setting The subunit is used to set a receiving capacity range for receiving the data write request.

The receiving subunit may be specifically configured to set the receiving time range for receiving the data write request set in the time range setting subunit, and receive data write requests for different write data in the same write partition; According to the receiving capacity range for receiving the data write request set in the capacity range setting subunit, data write requests for different write data of the same write partition are received.

A configuration unit 1002, configured to configure identification information for the write data according to the data write request; wherein, the identification information is used to identify the information of the write order of the write data;

The configuration unit 1002 includes: a determination subunit and a configuration subunit;

the determining subunit, configured to determine the different write data in the data write request as a write data set;

The configuration subunit is configured to configure the identification information for the write data set.

The writing unit 1003 is configured to perform a writing operation according to the writing data and the identification information of the writing data.

The writing unit 1003 is specifically configured to perform a writing operation according to the writing data set determined in the determining subunit and the corresponding identification information of the writing data set.

Also includes:

Status information receiving unit and sending unit;

the state information receiving unit, configured to receive state information used to describe the write state of the write data;

The sending unit is configured to send the state information received in the state information receiving unit.

The above is a general description of an embodiment of a data writing apparatus provided in the present application. For the specific content of the data writing apparatus embodiment, reference may be made to the description of the above data writing method embodiment, which will not be repeated here.

The embodiments of the above-mentioned data writing method and apparatus are mainly described from the perspective of the cache node, and the data writing process of the analytical database system also includes a front-end node. In this embodiment, the core content of the front-end node is: Sending of a data write request, therefore, the present application also provides a method for sending a data write request, please refer to FIG. 11 , which is a flowchart of an embodiment of a method for sending a data write request provided by the present application picture. Embodiments of the method for sending the data write request may include:

Step S1101: Send a data write request, wherein the data write request carries write data that needs to be written;

For the analytical database system, the data write request is performed by the cache node. Therefore, in step S1101, the front-end node sends the data write request sent by the user to the cache node, and the cache node will write the data request for the data. The write data configuration identification information in , of course, as described in the above steps S801-S803, may be to accumulate a batch of write data configuration identification information.

For a distributed analytical database system, there will be a large number of cache nodes, so which cache node should the write data in the data write request be written to is a problem that needs to be considered. In this embodiment, the specific steps of step S1101 are Implementation can include:

Step S1101-11: Determine a cache node corresponding to the write data according to the attribute information carried in the data write request and used to describe the write data;

The attribute information in the step S1101-11 may be the identifier of the write database and the identifier of the data table in which the data is written, such as: database name (database name) and data table name (table name).

The step S1101-11 determines that the cache node corresponding to the write data can be written by splicing the database name (database name) and the data table name (table name) into the write path information, and then to the analytical database system. The service coordination node (Zookeeper) searches according to the write path information, obtains the partition information corresponding to the written data, and records the address (ip) information and port ( port) information, the cache node corresponding to the written data can be determined through the address information and port information.

It should be noted here for the partition information that in an analytical database, there may be multiple cache nodes, including a master cache node (Master) and multiple slave cache nodes (Slave), the process of establishing a data table or a cache node. After restarting, the main cache node will determine the distribution of each partition of the table on each cache node (including the master and slave cache nodes) according to the table structure information of the data table, and issue a command to the corresponding cache node to divide the table partition corresponding to the online. After the table partition of the cache node is successfully online, the partition information of the table will be registered in the service coordination module (Zookeeper). Based on the address information and port information, a data write request is sent to the cache node according to the address information and port information of the cache node, so that the cache node completes the data write. In this embodiment, the data writing request may be completed through an RPC (Remote Procedure Call: Remote Procedure Call).

In this embodiment, the above-mentioned determination of the cache node may be completed by a writing module (Writer) in the front-end node.

Therefore, the step S1101-11 may include:

Step S1101-11-1: According to the identifier of the write database describing the write data and the identifier of the write data table in the attribute information, establish write path information for the write data, for example: /dbName /tableName/;

Step S1101-11-2: Obtain the partition information of the write data table according to the write path information;

Step S1101-11-3: Determine the cache node corresponding to the write data according to the partition information.

So far, the cache node corresponding to the write data is determined, and the process proceeds to step S1101-12.

Step S1101-12: Send the data write request to the corresponding cache node.

Based on the above data write request, it is sent to the corresponding cache node for subsequent write operations.

Step S1102: Receive write status information for the write data returned in response to the data write request.

The front-end node can receive the write status information for the write data in the write data request returned from the cache node when sending the write data request or after sending the write data request or before sending the write data request. The write status information is used to describe the success or failure of the writing of the write data.

The above is a detailed description of an embodiment of a method for sending a data write request provided by the present application. Corresponding to the foregoing embodiment of a method for sending a data write request, the present application also discloses a method for sending a data write request. Referring to FIG. 12 , for an embodiment of a sending apparatus, since the apparatus embodiment is basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to the partial description of the method embodiment. The apparatus embodiments described below are merely illustrative.

As shown in FIG. 12, FIG. 12 is a schematic structural diagram of an embodiment of a sending apparatus for a data write request provided by the present application, and the sending apparatus embodiment includes:

A sending unit 1201, configured to send a data write request, wherein the data write request carries write data that needs to be written;

The sending unit 1201 includes: a determining subunit and a sending subunit;

The determining subunit is configured to determine a cache node corresponding to the write data according to the attribute information carried in the data write request and used to describe the write data;

The sending subunit is configured to send the data write request to the corresponding cache node determined in the determining subunit.

The determining subunits include: establishing subunits and acquiring subunits;

The establishment subunit is used to establish the write path information for the write data according to the identifier of the write database and the identifier of the write data table describing the write data in the attribute information;

The acquisition subunit is configured to acquire the partition information of the write data table according to the write path information established in the establishment subunit;

The determining subunit is specifically configured to determine the cache node corresponding to the write data according to the partition information acquired in the acquiring subunit.

The receiving unit 1202 is configured to receive write status information for the write data returned in response to the data write request.

Based on the above content, the present application further provides a method for reading written data, and the method for reading is described from the perspective of a computing node. As shown in FIG. 13 , FIG. 13 is a flowchart of an embodiment of a method for reading written data provided by the present application, and the embodiment of the reading method includes:

Step S1301: according to the sent read request to read and write data information, read the write data and the identification information of the write data;

The purpose of the step S1301 is: whether in the operation process of writing data or the operation process of querying data, the computing node needs to be able to read the write data in the cache node. Therefore, the computing node needs to send a read request to the cache node so that the computing node can read and write data from the cache node.

As described above, in this embodiment, the specific implementation process of step 1301 may include:

Step S1301-1: Send the read request according to the read cycle in an asynchronous manner;

Step S1301-2: Read the write data and the identification information of the write data according to the read request.

For details, please refer to the relevant description of step S100+11 in the above data query method, which will not be repeated here.

Step S1302: determining the write data as the current write data, and determining the identification information of the write data as the identification information of the current write data;

Step S1303: Store the currently written data and the identification information of the currently written data locally.

Regarding steps S1302 and S1303, reference may also be made to the descriptions of steps S102 to S103 in the above data query method, which will not be repeated here.

The above is a detailed description of an embodiment of a method for reading written data provided by the present application. Corresponding to the embodiment of a method for reading written data provided in the foregoing, the present application also discloses a method for reading written data. For an apparatus embodiment, please refer to FIG. 14 . Since the apparatus embodiment is basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to the partial description of the method embodiment. The device embodiments described below are merely illustrative.

As shown in FIG. 14 , an embodiment of a reading device for writing data provided by the present application includes:

a reading unit 1401, configured to read the write data and the identification information of the write data according to the sent read request to read the write data information;

The reading unit 1401 includes: a sending subunit and a reading subunit;

The sending subunit is configured to send the read request according to the read cycle in an asynchronous manner;

The read subunit is configured to read the write data and the identification information of the write data according to the read request.

A determination unit 1402, configured to determine the write data as the current write data, and determine the identification information of the write data as the identification information of the current write data;

The storage unit 1403 is configured to store the currently written data and the identification information of the currently written data locally.

The above is a general description of an embodiment of a reading device for writing data provided by the present application. For specific content, please refer to the above-mentioned relevant descriptions about the data query method, data writing method and other embodiments.

Based on the above content, the present application also provides an analytical database system, as shown in FIG. 15 , which is a schematic structural diagram of the analytical database system, and the analytical database includes:

A front-end node (FrontNode), a buffer node (BufferNode), and a computing node (ComputeNode), wherein the front-end node is used to send a data operation request to the cache node, and the operation status or target data returned for the data operation request or the identification information of newly written data; when the data operation request received by the front-end node is a data write request, send the received data write request to the cache node, and receive the data write request from the cache node In response to the data write request returned by the data write request, write data write status information; when the data operation request received by the front-end node is a data query request, the data will be In the data query request, the identification information of the newly written data is obtained from the cache node, and the identification information of the newly written data is the identification information of the last written written data determined according to the writing sequence range, and the The identification information of the newly written data is encapsulated into the data query request and sent to the computing node, and the target data determined by the computing node for the data query request is obtained;

The cache node is configured to receive the data operation request from the front-end node, and send information in response to the data operation request to the front-end node; wherein, when the data operation request received by the cache node For the data write request, according to the data write request, configure identification information for the write data carried in the data write request; wherein, the identification information is used to identify the write data write sequence information, and perform the write operation according to the write data and the identification information of the write data; when the data operation request received by the cache node is the data query request, the cache node receives the request from The acquisition request of the front-end node for the identification information of the newly written data, according to the acquisition request, the identification information of the last written write data determined according to the writing sequence range is sent as the identification information of the newly written data to the front-end node;

The computing node is used to obtain a data query request from the front-end node, and the data query request carries identification information of the target data to be queried, wherein the identification information is used to identify the information of the writing sequence of the written data, The identification information of the target data to be queried is the identification information of the last written written data determined according to the writing sequence range; according to the data query request, it is determined whether the identification information of the target data to be queried is the same as the stored data. The identification information of the current write data matches; if it does not match, then acquire the new write data and the new write data adjacent to the identification information of the current write data and whose writing order is after the current writing order. identification information of the written data; determine whether the identification information of the newly written data matches the identification information of the target data to be queried; if so, determine the newly written data as the target data to be queried; or , according to the read request to read and write data information sent to the cache node, read the write data and the identification information of the write data; determine the write data as the current write data, The identification information of the written data is determined as the identification information of the currently written data; the current written data and the identification information of the currently written data are stored locally.

Regarding the foregoing front-end nodes, cache nodes, and computing nodes, the foregoing data query method embodiments, query data acquisition method embodiments, query data identification information sending method embodiments, data writing method embodiments, and data writing request sending embodiments may be combined The descriptions in the method embodiments and the method embodiments for reading written data will not be repeated here.

It should be noted that, in this embodiment, the number of nodes of any one of the front-end node, the cache node, and the computing node can be expanded or reduced according to different usage scenarios to meet different write traffic requirements or query traffic requirements.

In this embodiment, it may further include: a service coordination node, configured to provide the cache node corresponding to the written data according to the attribute information of the written data in the data write request in the front-end node; The front-end node sends the data write request to the cache node corresponding to the location information according to the cache node provided by the service coordination node. Regarding the service coordination node, reference may also be made to the description of the above step S1101-11.

The cache node needs to perform a write operation on the write data, therefore, it may also include:

The storage node is configured to store the write data received by the cache node and need to be written, and return write status information for the write data.

Based on the above content, the present application also provides a computer storage medium for storing data generated by a network platform and a program for processing the data generated by the network platform;

When the program is read and executed, the following steps are performed:

Obtain a data query request, where the data query request carries the identification information of the target data to be queried, wherein the identification information is used to identify the information of the writing sequence of the written data, and the identification information of the target data to be queried is according to the written The identification information of the last written written data determined by the sequence range;

According to the data query request, determine whether the identification information of the target data to be queried matches the stored identification information of the currently written data;

If it does not match, then acquire the identification information of the newly written data and the newly written data adjacent to the identification information of the current written data and whose writing order is after the current writing order;

Determine whether the identification information of the newly written data matches the identification information of the target data to be queried;

If so, determine the newly written data as the target data to be queried;

Alternatively, perform the following steps:

Receive data query requests;

According to the data query request, the identification information of the newly written data is obtained, and the identification information of the newly written data is the identification information of the last written write data determined according to the writing sequence range;

Encapsulate the identification information into the data query request and send it;

obtaining target data returned in response to the data query request encapsulated with the identification information;

Alternatively, perform the following steps:

Receive an acquisition request for the identification information of the newly written data, wherein the identification information of the newly written data is the identification information of the last written write data determined according to the writing sequence range;

According to the acquisition request, the identification information of the last written write data determined according to the writing sequence range is sent as the identification information of the newly written data;

Alternatively, perform the following steps:

receiving a data write request, wherein the data write request carries write data that needs to be written;

According to the data write request, configure identification information for the write data; wherein, the identification information is used to identify the information of the write data writing sequence;

Perform a write operation according to the write data and the identification information of the write data;

Alternatively, perform the following steps:

Sending a data write request, wherein the data write request carries write data that needs to be written;

receiving write status information for the write data returned in response to the data write request;

Alternatively, perform the following steps:

According to the read request sent to read the write data information, read the write data and the identification information of the write data;

The write data is determined as the current write data, and the identification information of the write data is determined as the identification information of the current write data;

The currently written data and the identification information of the currently written data are stored locally.

Based on the above content, the present application also provides an electronic device, comprising:

processor;

The memory is used to store a program for processing data generated by the network platform. When the program is read and executed by the processor, the following steps are performed:

Obtain a data query request, where the data query request carries the identification information of the target data to be queried, wherein the identification information is used to identify the information of the writing sequence of the written data, and the identification information of the target data to be queried is according to the written The identification information of the last written written data determined by the sequence range;

According to the data query request, determine whether the identification information of the target data to be queried matches the stored identification information of the currently written data;

If it does not match, then acquire the identification information of the newly written data and the newly written data adjacent to the identification information of the current written data and whose writing order is after the current writing order;

Determine whether the identification information of the newly written data matches the identification information of the target data to be queried;

If so, determine the newly written data as the target data to be queried;

Alternatively, perform the following steps:

Receive data query requests;

According to the data query request, the identification information of the newly written data is obtained, and the identification information of the newly written data is the identification information of the last written write data determined according to the writing sequence range;

Encapsulate the identification information into the data query request and send it;

obtaining target data returned in response to the data query request encapsulated with the identification information;

Alternatively, perform the following steps:

Receive an acquisition request for the identification information of the newly written data, wherein the identification information of the newly written data is the identification information of the last written write data determined according to the writing sequence range;

According to the acquisition request, the identification information of the last written write data determined according to the writing sequence range is sent as the identification information of the newly written data;

Alternatively, perform the following steps:

receiving a data write request, wherein the data write request carries write data that needs to be written;

According to the data write request, configure identification information for the write data; wherein, the identification information is used to identify the information of the write data writing sequence;

Perform a write operation according to the write data and the identification information of the write data;

Alternatively, perform the following steps:

Sending a data write request, wherein the data write request carries write data that needs to be written;

receiving write status information for the write data returned in response to the data write request;

Alternatively, perform the following steps:

According to the read request sent to read the write data information, read the write data and the identification information of the write data;

The write data is determined as the current write data, and the identification information of the write data is determined as the identification information of the current write data;

The currently written data and the identification information of the currently written data are stored locally.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

Memory may include non-persistent memory in computer readable media, random access memory (RAM) and/or non-volatile memory in the form of, for example, read only memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

1. Computer readable media includes both persistent and non-permanent, removable and non-removable media. Information storage can be implemented by any method or technology. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, excludes non-transitory computer-readable media, such as modulated data signals and carrier waves.

2. Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

Although the present application is disclosed above with preferred embodiments, it is not intended to limit the present application. Any person skilled in the art can make possible changes and modifications without departing from the spirit and scope of the present application. Therefore, the present application The scope of protection shall be subject to the scope defined by the claims of this application.

Claims (34)

1. A method for querying data, comprising:

acquiring a data query request, wherein the data query request carries identification information of target data to be queried, the identification information is used for identifying information of a write-in data write-in sequence, and the identification information of the target data to be queried is the identification information of the write-in data written last determined according to a write-in sequence range;

determining whether the identification information of the target data to be inquired is matched with the stored identification information of the current written data or not according to the data inquiry request;

if not, acquiring new written data which is adjacent to the identification information of the current written data and has a writing sequence after the current written data and the identification information of the new written data;

determining whether the identification information of the newly written data is matched with the identification information of the target data to be inquired;

and if so, determining the new write-in data as the target data to be queried.

2. The data query method of claim 1, further comprising:

reading the written data information;

determining the identification information in the read write data information as the identification information of the current write data;

storing the written data corresponding to the identification information of the current written data and the identification information of the current written data locally;

the determining whether the identification information of the target data to be queried matches with the stored identification information of the current written data according to the data query request includes:

and determining whether the identification information of the target data to be inquired is matched with the identification information of the current write data stored locally.

3. The data query method of claim 2, wherein the reading the written data information comprises:

and reading the written data information according to a reading period in an asynchronous mode.

4. The data query method of claim 1, further comprising:

and when the identification information of the newly written data is matched with the identification information of the target data to be inquired, updating the currently written data into the acquired newly written data, and updating the identification information of the currently written data into the identification information of the newly written data.

5. The data query method of claim 1, wherein the determining whether the identification information of the target data matches the identification information of the stored current write data according to the data query request comprises:

comparing the identification code of the identification information of the target data to be inquired with the identification code of the identification information of the currently written data;

and if the identification code of the identification information of the target data to be queried is larger than the identification code of the identification information of the currently written data, determining that the identification code of the identification information of the target data to be queried is not matched with the identification code of the identification information of the currently written data.

6. The data query method of claim 5, further comprising:

if the identification code of the identification information of the target data to be queried is less than or equal to the identification code of the identification information of the current written data, determining that the identification code of the identification information of the target data to be queried is matched with the identification code of the identification information of the current written data;

and determining the current write data as the target data to be queried.

7. The data query method according to claim 1, wherein the determining whether the identification information of the newly written data matches the identification information of the target data to be queried comprises:

comparing the identification code of the identification information of the newly written data with the identification code of the identification information of the target data to be inquired;

and if the identification code of the identification information of the newly written data is greater than or equal to the identification code of the identification information of the target data to be inquired, determining that the identification information of the newly written data is matched with the identification information of the target data.

8. The data query method according to claim 7, wherein the comparing the identification code of the identification information of the newly written data with the identification code of the identification information of the target data to be queried further comprises:

if the identification code of the identification information of the newly written data is smaller than the identification code of the identification information of the target data to be inquired, determining that the identification information of the newly written data is not matched with the identification information of the target data;

and returning to the step of acquiring the new write data which is adjacent to the identification information of the current write data and has the write sequence after the current write sequence and the identification information of the new write data.

9. The data query method of claim 1, further comprising:

and sending the determined target data to be inquired.

10. A data query apparatus, comprising:

the device comprises a first acquisition unit, a second acquisition unit and a third acquisition unit, wherein the first acquisition unit is used for acquiring a data query request, and the data query request carries identification information of target data to be queried, the identification information is used for identifying information of a write-in data write-in sequence, and the identification information of the target data to be queried is identification information of the write-in data which is written last and is determined according to a write-in sequence range;

a first determining unit, configured to determine, according to the data query request, whether the identification information of the target data to be queried matches with the identification information of the stored current write data;

a second obtaining unit, configured to obtain, when the matching result of the first determining unit is not matched, new write data and identification information of the new write data that are adjacent to the identification information of the current write data and have a write order that is subsequent to the current write order;

a second determining unit, configured to determine whether the identification information of the newly written data matches the identification information of the target data to be queried;

and the third determining unit is used for determining the new written data as the target data to be inquired when the matching result in the second determining unit is matching.

11. A query data acquisition method is characterized by comprising the following steps:

receiving a data query request;

acquiring identification information of newly written data according to the data query request, wherein the identification information of the newly written data is the identification information of the last written data determined according to the writing sequence range;

packaging the identification information into the data query request and sending the data query request;

and acquiring target data returned in response to the data query request encapsulated with the identification information.

12. An apparatus for acquiring query data, comprising:

a receiving unit, configured to receive a data query request;

a first obtaining unit, configured to obtain, according to the data query request, identification information of newly written data, where the newly written data is last written data determined according to a writing sequence range;

the packaging sending unit is used for packaging the identification information into the data query request and sending the data query request;

and the second acquisition unit is used for acquiring target data returned in response to the data query request encapsulated with the identification information.

13. A method for sending query data identification information is characterized by comprising the following steps:

receiving an acquisition request aiming at identification information of newly written data, wherein the identification information of the newly written data is the identification information of the last written data determined according to a writing sequence range;

and according to the acquisition request, sending the identification information of the last written data determined according to the writing sequence range as the identification information of the new written data.

14. A transmission apparatus for inquiring data identification information, comprising:

a receiving unit, configured to receive an acquisition request for identification information of newly written data, where the identification information of the newly written data is identification information of last written data determined according to a writing sequence range;

and the sending unit is used for sending the identification information of the last written data determined according to the writing sequence range as the identification information of the new written data according to the acquisition request in the receiving unit and the acquisition request.

15. A method of writing data, comprising:

receiving a data writing request, wherein the data writing request carries writing data needing to be written;

configuring identification information for the written data according to the data writing request; wherein the identification information is used for identifying the information of the writing sequence of the written data;

and performing writing operation according to the written data and the identification information of the written data.

16. The data writing method according to claim 15, further comprising:

receiving state information for describing a write state of the write data;

and sending the state information.

17. The data writing method according to claim 15, wherein the receiving a data writing request comprises:

and receiving data write requests of different write data aiming at the same write partition according to the set received data write request range.

18. The data writing method according to claim 17, wherein the receiving of the data writing request for different writing data of the same writing partition according to the set received data writing request range includes:

receiving data writing requests of different writing data aiming at the same writing subarea according to the set receiving time range for receiving the data writing requests; or,

and receiving data writing requests of different writing data aiming at the same writing subarea according to the set receiving capacity range for receiving the data writing requests.

19. The data writing method according to claim 17, wherein the configuring identification information for the written data according to the data writing request includes:

determining the different write data in the data write request as a write data set;

configuring the identification information for the write data set.

20. The data writing method according to claim 19, wherein the performing the writing operation according to the writing data and the identification information of the writing data includes:

and performing writing operation according to the written data set and the identification information corresponding to the written data set.

21. A data writing apparatus, comprising:

a receiving unit configured to receive a data write request; the data writing request carries writing data needing to be written;

the configuration unit is used for configuring identification information for the written data according to the data writing request; wherein the identification information is used for identifying the information of the writing sequence of the written data;

and the writing unit is used for performing writing operation according to the written data and the identification information of the written data.

22. A method for sending a data write request, comprising:

sending a data writing request, wherein the data writing request carries writing data needing to be written;

receiving write status information for the write data returned in response to the data write request.

23. The method according to claim 22, wherein the sending the data write request comprises:

determining a cache node corresponding to the written data according to attribute information which is carried in the data writing request and used for describing the written data;

and sending the data write request to the corresponding cache node.

24. The method according to claim 23, wherein the determining, according to attribute information that is carried in the data write request and used for describing the write data, a cache node corresponding to the write data includes:

establishing write-in path information aiming at the write-in data according to the identifier of the write-in database and the identifier of the write-in data table which describe the write-in data in the attribute information;

acquiring partition information of the write data table according to the write path information;

and determining the cache node corresponding to the written data according to the partition information.

25. A data write request transmitting apparatus, comprising:

the data writing device comprises a sending unit, a writing unit and a writing unit, wherein the sending unit is used for sending a data writing request, and the data writing request carries writing data needing to be written;

a receiving unit, configured to receive write status information for the write data returned in response to the data write request.

26. A method of reading write data, comprising:

reading the written data and the identification information of the written data according to the sent reading request for reading the written data information;

determining the written data as current written data, and determining the identification information of the written data as the identification information of the current written data;

and storing the current written data and the identification information of the current written data locally.

27. The method for reading data to be written according to claim 26, wherein the reading the write data and the identification information of the write data according to the transmitted read request for reading the write data information comprises:

sending the reading request according to a reading period in an asynchronous mode;

and reading the written data and the identification information of the written data according to the reading request.

28. A reading apparatus for writing data, comprising:

the reading unit is used for reading the written data and the identification information of the written data according to the sent reading request for reading the written data information;

a determining unit, configured to determine the write data as current write data, and determine identification information of the write data as identification information of the current write data;

and the storage unit is used for locally storing the current written data and the identification information of the current written data.

29. An analytical database system, comprising: the system comprises a front-end node, a cache node and a computing node;

the front-end node is used for sending a data operation request to the cache node, and returning operation state or target data or identification information of newly written data aiming at the data operation request; when the data operation request received by the front-end node is a data write request, sending the received data write request to the cache node, and receiving write state information, which is returned by the cache node in response to the data write request and aims at the data write request, of write data; when the data operation request received by the front-end node is a data query request, acquiring identification information of newly written data from the cache node according to the received data query request, wherein the identification information of the newly written data is the identification information of the last written data determined according to a writing sequence range, packaging the identification information of the newly written data into the data query request, and sending the data query request to the computing node to acquire target data determined by the computing node for the data query request;

the cache node is used for receiving the data operation request from the front-end node and sending information responding to the data operation request to the front-end node; when the data operation request received by the cache node is the data writing request, configuring identification information for written data carried in the data writing request according to the data writing request; the identification information is used for identifying the information of the writing sequence of the written data, and writing operation is carried out according to the written data and the identification information of the written data; when the data operation request received by the cache node is the data query request, the cache node receives an acquisition request for identification information of new write data from the front-end node, and according to the acquisition request, the identification information of the last write data determined according to the write sequence range is sent to the front-end node as the identification information of the new write data;

the computing node is configured to obtain a data query request from the front-end node, where the data query request carries identification information of target data to be queried, where the identification information is used to identify information of a write sequence of write data, and the identification information of the target data to be queried is identification information of the write data written last determined according to a write sequence range; determining whether the identification information of the target data to be inquired is matched with the stored identification information of the current written data or not according to the data inquiry request; if not, acquiring new write data which is adjacent to the identification information of the current write data and has a write sequence behind the current write sequence and the identification information of the new write data; determining whether the identification information of the newly written data is matched with the identification information of the target data to be inquired; if yes, determining the newly written data as the target data to be queried; or, reading the written data and the identification information of the written data according to a read request for reading the written data information sent to the cache node; determining the written data as current written data, and determining the identification information of the written data as the identification information of the current written data; and storing the current written data and the identification information of the current written data locally.

30. The analytical database system of claim 29, further comprising:

the service coordination node is used for providing the cache node corresponding to the written data according to the attribute information of the written data in the data writing request in the front-end node;

and the front-end node sends the data write request to the cache node corresponding to the position information according to the cache node provided by the service coordination node.

31. The analytical database system of claim 30, wherein the service coordinator node provides partition information for a write data table according to write path information for the write data established by the front-end node based on an identification of a write database and an identification of the write data table in the attribute information for describing the write data;

the front-end node can determine the cache node corresponding to the write-in data according to the address and the port of the cache node in the partition information.

32. The analytical database system of claim 30, further comprising: and the storage node is used for storing the write-in data which is received by the cache node and needs to be written in, and returning write-in state information aiming at the write-in data.

33. A computer storage medium for storing network platform generated data and a program for processing the network platform generated data;

when the program is read and executed, the following steps are executed:

acquiring a data query request, wherein the data query request carries identification information of target data to be queried, the identification information is used for identifying information of a write-in data write-in sequence, and the identification information of the target data to be queried is the identification information of the write-in data written last determined according to a write-in sequence range;

determining whether the identification information of the target data to be inquired is matched with the stored identification information of the current written data or not according to the data inquiry request;

if not, acquiring new write data which is adjacent to the identification information of the current write data and has a write sequence behind the current write sequence and the identification information of the new write data;

determining whether the identification information of the newly written data is matched with the identification information of the target data to be inquired;

if yes, determining the newly written data as the target data to be queried;

or, the following steps are executed:

receiving a data query request;

acquiring identification information of newly written data according to the data query request, wherein the identification information of the newly written data is the identification information of the last written data determined according to the writing sequence range;

packaging the identification information into the data query request and sending the data query request;

acquiring target data returned in response to the data query request encapsulated with the identification information;

or, the following steps are executed:

receiving an acquisition request aiming at identification information of newly written data, wherein the identification information of the newly written data is the identification information of the last written data determined according to a writing sequence range;

according to the acquisition request, sending the identification information of the last written data determined according to the writing sequence range as the identification information of the new written data;

or, the following steps are executed:

receiving a data writing request, wherein the data writing request carries writing data needing to be written;

configuring identification information for the written data according to the data writing request; wherein the identification information is used for identifying the information of the writing sequence of the written data;

performing writing operation according to the written data and the identification information of the written data;

or, the following steps are executed:

sending a data writing request, wherein the data writing request carries writing data needing to be written;

receiving write status information for the write data returned in response to the data write request;

or, the following steps are executed:

reading the written data and the identification information of the written data according to the sent reading request for reading the written data information;

determining the written data as current written data, and determining the identification information of the written data as the identification information of the current written data;

and storing the current written data and the identification information of the current written data locally.

34. An electronic device, comprising:

a processor;

a memory for storing a program for processing network platform generated data, said program when read and executed by said processor performing the steps of:

acquiring a data query request, wherein the data query request carries identification information of target data to be queried, the identification information is used for identifying information of a write-in data write-in sequence, and the identification information of the target data to be queried is the identification information of the write-in data written last determined according to a write-in sequence range;

determining whether the identification information of the target data to be inquired is matched with the stored identification information of the current written data or not according to the data inquiry request;

if not, acquiring new write data which is adjacent to the identification information of the current write data and has a write sequence behind the current write sequence and the identification information of the new write data;

determining whether the identification information of the newly written data is matched with the identification information of the target data to be inquired;

if yes, determining the newly written data as the target data to be queried;

or, the following steps are executed:

receiving a data query request;

acquiring identification information of newly written data according to the data query request, wherein the identification information of the newly written data is the identification information of the last written data determined according to the writing sequence range;

packaging the identification information into the data query request and sending the data query request;

acquiring target data returned in response to the data query request encapsulated with the identification information;

or, the following steps are executed:

receiving an acquisition request aiming at identification information of newly written data, wherein the identification information of the newly written data is the identification information of the last written data determined according to a writing sequence range;

according to the acquisition request, sending the identification information of the last written data determined according to the writing sequence range as the identification information of the new written data;

or, the following steps are executed:

receiving a data writing request, wherein the data writing request carries writing data needing to be written;

configuring identification information for the written data according to the data writing request; wherein the identification information is used for identifying the information of the writing sequence of the written data;

performing writing operation according to the written data and the identification information of the written data;

or, the following steps are executed:

sending a data writing request, wherein the data writing request carries writing data needing to be written;

receiving write status information for the write data returned in response to the data write request;

or, the following steps are executed:

reading the written data and the identification information of the written data according to the sent reading request for reading the written data information;

determining the written data as current written data, and determining the identification information of the written data as the identification information of the current written data;

and storing the current written data and the identification information of the current written data locally.

Images