CN115544077A

CN115544077A - Data determination method, device, equipment and computer storage medium

Info

Publication number: CN115544077A
Application number: CN202110730187.0A
Authority: CN
Inventors: 王凡; 陈乐君; 唐堂; 孙铖然
Original assignee: China Mobile Communications Group Co Ltd; China Mobile Group Chongqing Co Ltd
Current assignee: China Mobile Communications Group Co Ltd; China Mobile Group Chongqing Co Ltd
Priority date: 2021-06-29
Filing date: 2021-06-29
Publication date: 2022-12-30

Abstract

The application discloses a data determination method, a device, equipment and a computer storage medium, wherein the data determination method comprises the following steps: responding to a data query request sent by a user terminal, and performing data information query operation on a filtering control table; under the condition that the data information exists in the filtering control table, matching the first data information with the data information in the filtering control table; under the condition that second data information matched with the first data information exists in the filtering control table, if correction data corresponding to the second data information is cached in the cache table, the correction data is acquired; based on the correction data, feedback data for transmission to the user terminal is generated. According to the method, during the correction processing of the error data batch data, the correction data can be acquired from the cache table for inquiring the error data, and a user is prevented from inquiring the error data during the correction processing of the error data batch data.

Description

Data determination method, device, equipment and computer storage medium

Technical Field

The present application relates to the field of data security technologies, and in particular, to a data determination method, apparatus, device, and computer storage medium.

Background

In the process of providing business services (such as communication business services) for users by a business service platform, a large amount of business data is generated. The service data generated by the service platform may have error data, so that the error data needs to be processed in batch to update the error data into correct service data.

However, since it takes a long time to perform batch processing on the error data, during this period, the service platform may receive a data query request initiated by a user, which may cause the error data requested by the user to be displayed, and easily cause complaints generated by the user due to seeing the displayed error data, so that the complaint rate of the service platform is high.

Disclosure of Invention

The embodiment of the invention provides a data determination method, which aims to solve the technical problem of high complaint rate of a service platform caused by displaying error data to a user during batch error data processing.

In a first aspect, an embodiment of the present invention provides a data determining method, where the method includes:

responding to a data query request sent by a user terminal, and performing data information query operation on a filtering control table, wherein the data query request is used for requesting query of service data corresponding to first data information in a production table, and the filtering control table is used for: recording data information of error data in batch data correction processing in the production table;

under the condition that the data information exists in the filtering control table, matching the first data information with the data information in the filtering control table;

when second data information matching the first data information exists in the filtering control table, if correction data corresponding to the second data information is cached in the cache table, acquiring the correction data, where the second data information is a part or all of the first data information, and the cache table is configured to: in the batch data correction processing, caching correction data corresponding to error data which has completed the correction processing;

generating feedback data for transmission to the user terminal based on the correction data;

and if the correction data corresponding to the second data information is not cached in the cache table, not sending service data to the user terminal.

In a second aspect, an embodiment of the present invention provides a data determining apparatus, where the apparatus includes:

the query module is used for responding to a data query request sent by a user terminal and performing data information query operation on a filtering control table, wherein the data query request is used for requesting query of service data corresponding to first data information in a production table, and the filtering control table is used for: recording data information of error data in batch data correction processing in the production table;

the matching module is used for matching the first data information with the data information in the filtering control table under the condition that the data information exists in the filtering control table;

a first obtaining module, configured to, when second data information that matches the first data information exists in the filter control table, obtain correction data if the correction data corresponding to the second data information is cached in the cache table, where the second data information is a part or all of the first data information, and the cache table is configured to: in the batch data correction processing, caching correction data corresponding to error data which has completed the correction processing;

a generating module, configured to generate feedback data for sending to the user terminal based on the correction data;

In a third aspect, an embodiment of the present application provides an electronic device, where the device includes:

at least one processor, at least one memory, and computer program instructions stored in the memory that, when executed by the processor, implement the data determination methods described above.

In a fourth aspect, the present application provides a computer storage medium having computer program instructions stored thereon, where the computer program instructions, when executed by a processor, implement the data determination method described above.

Compared with the prior art, the method has the following beneficial effects:

the method and the device can establish the cache table to cache the correction data after the error data correction processing in the process of performing the batch data correction processing on the error data by the electronic equipment, judge whether the service data requested to be inquired by the user terminal is the error data in the correction processing through the filtering control table, and if the data requested to be inquired is the error data in the correction processing, obtain the correction data corresponding to the error data through the cache table and feed the correction data back to the user terminal; and if the data requested to be inquired is error data which is not subjected to correction processing, the service data is not transmitted to the user terminal. Therefore, during the batch correction processing of the error data, the access to the error data can be obtained from the cache table and fed back to the user terminal for displaying, and the technical problem of high complaint rate of the service platform caused by displaying the error data to the user is solved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments of the present application will be briefly described below, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a flow diagram illustrating a data determination in accordance with an exemplary embodiment;

FIG. 2 is a flow diagram illustrating a data determination in accordance with an illustrative embodiment;

FIG. 3 is a flow diagram illustrating a batch data correction process in accordance with an illustrative embodiment;

FIG. 4 is a schematic diagram illustrating data segments of a request query in accordance with an illustrative embodiment;

FIG. 5 is a flow diagram illustrating a data query in an exemplary embodiment

FIG. 6 is a block diagram of a data determination device, according to an exemplary embodiment;

fig. 7 is a schematic structural diagram of an electronic device according to an exemplary embodiment.

Detailed Description

Features and exemplary embodiments of various aspects of the present application will be described in detail below, and in order to make objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are intended to be illustrative only and are not intended to be limiting. It will be apparent to one skilled in the art that the present application may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present application by illustrating examples thereof.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.

In order to solve the prior art problems, embodiments of the present application provide a data determination method, apparatus, device, and computer storage medium. The following first describes a data determination method provided in an embodiment of the present application.

As shown in fig. 1, the data determining method provided in this embodiment is applied to an electronic device, where the electronic device may be a server, and the data determining method includes the following steps:

step S101, responding to a data query request sent by a user terminal, and performing data information query operation on a filtering control table; the data query request is used for requesting to query the service data corresponding to the first data information in the production table, and the filtering control table is used for: recording data information of error data in the batch data correction processing in the production table;

step S102, under the condition that the data information exists in the filtering control table, matching the first data information with the data information in the filtering control table;

step S103, when there is second data information matching the first data information in the filtering control table, if the cache table caches correction data corresponding to the second data information, acquiring the correction data, where the second data information is part or all of the first data information, and the cache table is used to: in the batch data correction processing, caching correction data corresponding to error data which has completed the correction processing;

step S104, based on the correction data, generating feedback data for sending to the user terminal;

and if the correction data corresponding to the second data information is not cached in the cache table, not sending the service data to the user terminal.

Specific implementations of the above steps will be described in detail below.

According to the embodiment of the application, in the process that the electronic equipment corrects the error data in batch, a cache table is created to cache the correction data corrected by the error data, whether the service data requested to be inquired by the user terminal is the error data in the correction process is judged through a filter control table, and if the data requested to be inquired is the error data in the batch, the correction data corresponding to the error data is obtained through the cache table and fed back to the user terminal; and if the data requested to be inquired is error data which is not subjected to correction processing, the service data is not sent to the user terminal. Therefore, during the long-time batch error data processing, the error data can be prevented from being fed back to the user terminal for displaying, and the complaint rate of the service platform can be effectively reduced.

Specific implementations of the above steps are described below.

In the step S101, in the process of performing batch data correction processing on the production table by the electronic device, if the user terminal sends a data query request to the electronic device, the electronic device performs a data information query operation on the filtering control table in response to the received data query request.

The data query request may be used to request to query service data corresponding to first data information in a production table, and specifically, the data query request may be a request carrying the first data information, and the first data information may be data information generated by a user terminal according to an operation of a user.

For example, the first data information may be a period of time that is determined as the first data information when the user terminal receives a user input, and the first data information is sent to the electronic device by carrying the first data information through a data query request.

In some embodiments, the user terminal may be a smart phone (Android phone, iOS phone, etc.), a tablet computer, a smart watch, a palmtop computer, and a Mobile Internet Devices (MID), a computer, etc.

The electronic device performs a data information query operation on the filtering control table in response to a data query request sent and received by the user terminal, and specifically, the electronic device obtains first data information carried by the data query request according to the received data query request sent and queries whether the filtering control table has data information matched with the first data information. The data information may include: table name of the production table to which the data belongs, data identification, processing status of error data, and the like.

Here, the obtaining of the first data information carried in the data query request may be that the electronic device analyzes the data query request to obtain the first data information. For example, if the data query request is an SQL statement, the electronic device may obtain the data information carried in the data query instruction by analyzing the SQL statement. The specific service data information acquisition mode is the prior art, and the method is not limited in the application and can be selected according to actual needs.

In addition, the filter control table may be configured to: data information of error data in the batch data correction process in the production table is recorded. The batch data correction processing is processing for collectively correcting error data of a large data amount in the service data.

For example, assuming that the production table includes the traffic data generated in the period 1, and the period 1 includes the period 11, the period 12, the period … …, and the period 1n, n being an integer greater than 2, in the case where the traffic data in the period 12 and the period 13 are error data and are in the batch data correction processing, the above-described filter control table records the period 12 and the period 13.

The correction process may be to correct the error data in the production table into correct data. For example, for a user list data rating error, recalculation can be performed according to correct user data to obtain correct data; it is also possible to replace the data logged in error with the correct data.

Optionally, in some embodiments, before step S101, the following steps may be further included:

determining error data in the production table under the condition of obtaining the production table;

recording data information of error data in the production table in the filtering control table;

carrying out batch data correction processing on error data corresponding to the data information recorded in the filtering control table;

in the batch data correction processing, correction data corresponding to error data having been corrected is buffered in a buffer table.

In the embodiment of the application, firstly, the error data in the production table is determined, the data information of the error data is obtained, and the data information of the error data is recorded in the filtering control table; then, a cache table is created, and after the batch data correction processing is started for the error data, the correction data corresponding to the error data having been corrected is cached in the cache table. When the user terminal inquires the error data in the batch data correction process, the correction data can be acquired from the cache table and fed back to the user terminal.

In some embodiments, the error data in the production table may be determined manually, or may be determined by other technical means in the prior art, and the present application is not limited thereto.

The cache table is used for caching correction data corresponding to error data which is subjected to correction processing in batch data correction processing.

For example, suppose that the production table includes the service data generated in time slot 1 as error data, and the error data in time slot 1 includes error data 11, error data 12, … …, and error data 1n, where n is an integer greater than 2; creating a buffer table, and starting batch data correction processing on the error data in the time slot 1: and performing correction processing on the error data 11 to generate corresponding correction data 11, storing the correction data 11 into a cache table, then continuously processing the error data 12, … … and the error data 1N, and continuously storing the newly generated correction data into the cache table in the batch data correction processing process.

Optionally, in some embodiments, after all error data are subjected to the correction processing, the data information of the error data in the filtering control table and the cache table may be deleted.

When there are error data of multiple time periods that require batch data correction processing, in order to implement batch data correction processing on the error data of multiple time periods simultaneously, in some embodiments, the performing batch data correction processing on the error data corresponding to the data information recorded in the filter control table may include:

determining that data information recorded in a filtering control table comprises N time periods, wherein N is an integer greater than 1;

and simultaneously and respectively carrying out data correction processing on the error data of N time periods through N processing threads.

In this embodiment of the present application, the data information recorded by the filter control table may include a warehousing time period of the batch error data, when the batch data correction processing needs to be performed on the error data in N time periods, the N time periods are recorded into the filter control table, and the batch data correction processing may be performed on the error data in N time periods through the N processing threads at the same time. Specifically, for the error data in N time periods, N corresponding cache tables are respectively created, batch data correction processing may be performed on the error data in N time periods at the same time, and the correction data obtained after the error data is corrected is cached in the cache table corresponding to the time period to which the error data belongs.

For example, assuming that the production table includes the service data generated in the time period 1, and the time period 1 includes a time period 11, a time period 12, a time period … …, and a time period 1n, where n is an integer greater than 2, if the time period 11 and the time period 12 are recorded in the filtering control table, the corresponding cache table 11 and cache table 12 are respectively created for the error data in the time period 11 and the time period 12; simultaneously performing batch data correction processing on the error data in the time slot 11 and the time slot 12; the correction data corresponding to the error data in the time slot 11 after the correction processing is completed is cached in the cache table 11, and the correction data corresponding to the error data in the time slot 12 after the correction processing is completed is cached in the cache table 12. The time period to which the error data requiring the batch data correction processing belongs can be determined according to the entry timestamp of the error data.

Optionally, in some embodiments, after all the error data of a time period is subjected to the correction processing, the data information of the time period in the filtering control table and the segment table corresponding to the time period are deleted.

In the above embodiment, the correction data of the error data generated in the batch data correction processing process may be cached in the cache table, so that when the user terminal queries the error data in the batch data correction processing, the correction data may be acquired from the cache table and fed back to the user terminal.

Optionally, after performing the data information query operation on the filtering control table in step S101, the method may further include:

and under the condition that the data information does not exist in the filtering control table or the data information matched with the first data information does not exist in the filtering control table, the business data corresponding to the first data information in the production table is used as feedback data.

In the embodiment of the application, if the data information does not exist in the filtering control table in the query, it indicates that error data does not exist in the production table, so that the data requesting the query can be directly acquired from the production table. If the data information matched with the first data information does not exist in the filtering control table, the error data does not exist in the business data requested to be inquired, and therefore the business data can be directly obtained from the production table according to the inquiry condition.

In step S102, in a case where it is found that there is data information in the filter control table, the first data information is matched with the data information in the filter control table.

In the embodiment of the application, if the data information exists in the filtering control table, it is indicated that error data exists in the production table, at this time, the first data information, that is, the data information of the service data requested to be queried is matched with the data information of the filtering control table, whether error data exists in the service data requested to be queried can be judged through matching of the data information, and the data information of the error data existing in the first data information is determined.

For example, it is assumed that the data information of the error data being subjected to the batch data correction processing recorded in the filter control table is time slot 1, and if the first data information is time slot 2, it indicates that there is no error data being subjected to the correction processing in the service data to be queried. Therefore, the business data corresponding to the first data can be directly obtained from the production table.

Optionally, in some embodiments, if the first data information is the target time period, the method may further include:

inquiring whether the target time period is within N time periods;

if at least part of the target time periods are in the N time periods, determining that second data information matched with the first data information exists in the filtering control table, wherein the second data information comprises: and a first time period which is coincident with the target time period in the N time periods.

The first data information is a target time period, that is, the first data information is a time period to which the service data requested to be queried belongs. The second data information refers to data information that matches the first data information in the filter control table. The first time period is a time period which coincides with the target time period among the data information recorded in the filter control table when the first data information is the target time period.

In the embodiment of the present application, in the batch data correction process of error data in which N time periods are recorded in the filter control table, if there is a time period in which the time period to which the first data information belongs and the N time periods recorded in the filter control table overlap, it may be determined that there is second data information matching the first data information in the filter control table, and the overlapping time period is the second data information.

For example, assuming that the time period in which the error data in the batch data correction process is recorded in the filtering control table is 10.

Alternatively, in some embodiments, the processing state of the error data is recorded as in-process before the correction processing is started for one time period of the error data, and the state of the error data is recorded as processed after the correction processing of all the error data is completed. If the data processing state in the data information in the filtering control table is processing, matching the first data information with the data information in the filtering control table; and if the data processing state in the data information in the filtering control table is processed, not matching the first data information with the data information marked as processed.

For example, assuming that the service data generated in the time slot 11 and the time slot 12 in the production table are determined to be error data, if the error data in the time slot 11 is marked as processed in the filter control table and the error data in the time slot 12 is marked as in-process, only the first data information is matched with the time slot 12.

The second data information may be determined by matching the first data information with the data information recorded in the filter control table in the above-described embodiment.

In step S103, when the second data information matching the first data information exists in the filter control table, if the correction data corresponding to the second data information is cached in the cache table, the correction data is acquired, and the second data information is a part or all of the first data information.

The second data information is part or all of the first data information, that is, the case where the second data information is part of the first data information means that: only part of the traffic data requested for query is error data in the batch correction process belonging to the record in the filter control table. The case where the second data is all the data information of the first data information means that all the service data requested to be queried belong to error data in the batch data correction processing recorded in the filter control table.

For example, the time period when the data information recorded in the filtering control table is error data in the batch data correction process is 10; if the first data information is 10.

In this embodiment, the electronic device may determine, according to the second data information determined in step S102, to acquire the correction data if the correction data corresponding to the second data information is cached in the cache table, specifically, the electronic device acquires the second data information by matching the first data information with the data information recorded in the filter control table, determines whether the correction data corresponding to the second data information exists in the cache table according to the second data information, and acquires the correction data corresponding to the second data information from the cache table if the correction data corresponding to the second data information exists in the cache table.

For example, assuming that the filtering control table records that the time period to which the error data in the batch data correction process belongs is 9.

In step S104, feedback data for transmission to the user terminal is generated based on the correction data; and if the correction data corresponding to the second data information is not cached in the cache table, not transmitting the service data to the user terminal.

Feedback data used for sending to the user terminal is generated based on the correction data, that is, the electronic device generates the feedback data sent to the user terminal according to the correction data acquired in step S103, and the user terminal displays the feedback data on the user terminal after receiving the feedback data.

In some embodiments, if the correction data corresponding to the second data information is not cached in the cache table, it indicates that the service data corresponding to the second data information requested to be accessed is error data that has not been subjected to the correction processing, and at this time, the service data corresponding to the second data information will not be sent to the user terminal.

For example, assuming that the filtering control table records that the time period to which the error data in the batch data correction process belongs is 9-00, and the correction data corresponding to the error data in the 9.

In some embodiments, in the case that the second data information is all data information of the first data information, correction data corresponding to the second data information is directly acquired from the cache table, and feedback data is generated according to the acquired correction data.

In some embodiments, in the case that the second data information is partial data information of the first data information, the correction data corresponding to the second data information is obtained from the cache table, the service data corresponding to the data information other than the second data information in the first data information is obtained from the production table, and the obtained correction data and the service data are combined to generate the feedback data.

Optionally, the first time period is a partial time period in which the target time period is located in N time periods, and the correction data includes service data located in the first time period in the cache table;

after the matching of the first data information and the data information in the filtering control table, the method may further include:

acquiring service data in a second time period in the production table, wherein the second time period is a time period except the first time period in the target time period;

generating feedback data for transmission to the user terminal based on the correction data, comprising: and combining the correction data and the service data positioned in the second time period to form feedback data for sending to the user terminal.

In the embodiment of the present application, when the first time period is a partial time period in which the target time period is located within N time periods, and the correction data includes service data located in the first time period in the cache table, the correction data located in the first time period is obtained from the cache table, the service data located in the second time period is obtained from the production table, and then the correction data and the service data located in the second time period are combined to generate feedback data for transmitting to the user terminal.

The first time period is a partial time period in which the target time period is located within N time periods, and refers to a time period in which a time period to which the service data requested to be queried belongs coincides with N time periods recorded in the filtering control table. The time periods of the second time period, which are the target time periods except the first time period, refer to the time period to which the service data requested to be queried belongs and the time period not corresponding to the filtering control table

For example, assuming that the time periods in the filtering control table in which the error data in the batch data correction process is recorded are 10; when the second time period is 11.

In this embodiment, when receiving the query request sent by the user terminal, the electronic device obtains the correction data obtained by correcting the error data from the cache table and obtains the service data not required to correct the batch data from the production table, so as to filter the error data and only feed back the error data to the correct data of the user terminal.

The above specific implementation manner of the data determining method provided in the embodiment of the present application may be that, in the process of performing batch data correction processing on error data by an electronic device, a cache table is created to cache correction data after the error data correction processing, whether service data requested to be queried by a user terminal is error data being subjected to correction processing is determined by a filter control table, and if the data requested to be queried is error data being subjected to correction processing, correction data is obtained through the cache table and fed back to the user terminal. The feedback of error data to the user terminal during the long-time batch error data processing is avoided.

In addition, in the batch data correction processing process, the correction data corresponding to the error data which is subjected to the correction processing is continuously cached in the cache table until the error data is processed, so that the user terminal can acquire continuously updated feedback data in the multiple service data query processes. Therefore, the technical scheme of the application can also monitor the processing condition of the error data in real time.

For ease of understanding, the following description will be given by taking N equal to 1 as an example.

In some embodiments, as shown in fig. 2, N =1 is taken as an example, that is, when the error data to be processed is data in a time period. The technical scheme of the application can be realized through the following steps:

step 21, when problem data processing starts, a piece of control information is inserted into a filter control table by a data processing program, a certain section of data (identified by a warehousing timestamp) in a certain type of original production table is identified as error data, batch processing is required (namely data information of the error data in the production table is recorded in the filter control table), query of relevant data in a period points to a fragment table (namely, for data which is requested to query and is being subjected to batch data processing, processed correction data is obtained from a buffer table), after the batch data processing is completed, the corresponding record of the filter control table is modified to be processing completed, and a query display program is informed that the filter control is not required (namely under the condition that no data information matched with first data information exists in the filter control table, service data corresponding to the first data information in the production table is used as feedback data).

At step 22, the problem data processing program starts to delete the problem data in the original production table, generate new correct data, and write the new correct data into the original production table (i.e. correct the error data).

Step 23, writing the newly generated correct data into the fragment table (that is, in the batch data correction processing, the correction data corresponding to the error data for which the correction processing has been completed is cached in the cache table).

Step 24, after receiving the front-end user request, the query display program first checks whether the interval covered by the user-related request data falls in the time segment in the filtering control table (i.e. in response to the data query request sent by the user terminal, perform data information query operation on the filtering control table).

And step 25, if the interval covered by the user-related request data falls outside the time section in the filtering control table, directly querying the production table for returning (namely, under the condition that the filtering control table does not have the data information matched with the first data information, taking the service data corresponding to the first data information in the production table as feedback data).

And 26, if the all the sections covered by the user-related request data fall into the time section in the filtering control table, directly querying the segment table for returning (that is, if second data information matched with the first data information exists in the filtering control table, if correction data corresponding to the second data information is cached in the cache table, acquiring the correction data).

Step 27, if the interval covered by the user-related request data spans the time segment in the filtering control table, the query of the user needs to be divided into two parts, the query fragment table in the filtering segment table, the query original production table outside the filtering segment table, and the two query result sets are merged and returned to the user (i.e. the service data in the first time segment in the cache table and the service data in the second time segment in the production table are obtained, and the correction data and the service data in the second time segment are merged to form feedback data for sending to the user terminal).

When N takes other values, the same embodiment is used as when N is equal to 1 as described above, and for the sake of brevity, it will not be described in detail here.

In some embodiments, the specific error data processing process may be implemented by an error data processing program, where the error data processing program mainly implements that, when the batch data correction processing is started, a filter control record is inserted into the filter control table, a segment table (i.e., a cache table) is initialized, and meanwhile, new correction data is inserted into the production table and the segment table, and after the batch data correction processing is completed, a record state identifier corresponding to the filter control table is changed.

The filter control table, the production table and the fragment table are designed according to actual conditions, the application can be applied to static data tables similar to ticket storage, and the relational database table is exemplified as shown in table 1 and table 2, wherein table 1 is the filter control database table, and table 2 is the information structure of the production table and the fragment table:

TABLE 1

TABLE 2

In some embodiments, the batch data correction process, as shown in FIG. 3, may include the following steps:

step 31, reading the configuration information, and obtaining the production table information to be processed and the data information of the problem data to be processed (i.e. determining the error data in the production table in the case of obtaining the production table).

And 32, inserting control information into the filtering control table, identifying data which needs to be inquired by the fragment table in the production table (namely, recording the data information of the problem data into the filtering control table), and setting the state of the control information to be 1 to indicate that the problem data is processed.

And step 33, storing the correct information into the production table and the fragment table, and deleting the error information in the production table (namely, performing batch data correction processing on the error data corresponding to the data information recorded in the filtering control table, and caching the correction data corresponding to the error data after the correction processing into a cache table).

And step 34, judging whether the problem data is processed. And if the problem data are not processed, returning to the step 3, and if the problem data are processed, turning to the step 35.

And step 35, changing the state of the filter control table to be 0 to indicate that the problem data processing is finished.

In some embodiments, the specific query presentation process of the data may be implemented by a query presentation program, after receiving a query request from a user, the query presentation program checks whether an interval covered by user-related request data falls in a time segment in a filtering control table, if the interval is all within the interval, directly queries a segment table to return, if the interval is outside the interval, directly queries a production table to return, if the interval is crossed as shown in fig. 4, the query from the user needs to be divided into two parts, the query segment table in the interval is filtered, the query from the interval is filtered to an original production table, and the two query result sets are merged to return to the user, that is, the query from the user needs to be divided into two parts, the upper half queries the production table, and the lower half queries the segment table.

In some embodiments, a specific query presentation process is shown in fig. 5, which may include the following steps:

step 51, after receiving the query request, querying whether the filtering control table has filtering control information with a state of 1 (i.e. responding to the data query request sent by the user terminal, performing data information query operation on the filtering control table); if not, directly inquiring the production table information according to the conditions and returning the inquiry result to the foreground; if yes, go to step 52.

Step 52, judging whether the foreground query data is in the filtering interval (i.e. performing data information query operation on the filtering control table); if yes, directly inquiring data in the fragment table and returning a result (under the condition that second data information matched with the first data information exists in the filtering control table, if correction data corresponding to the second data information is cached in the cache table, acquiring the correction data); if not, go to step 53.

Step 53, judging whether foreground query data is all outside the filtering interval (i.e. performing data information query operation on the filtering control table); if yes, directly inquiring the production table information and returning an inquiry result to the foreground (namely, under the condition that the data information matched with the first data information does not exist in the filtering control table, the service data corresponding to the first data information in the production table is used as feedback data); if not, dividing the user query into two parts, filtering the query fragment table in the interval, filtering the query original production table outside the interval, and merging and returning the two query result sets to the user (i.e. merging the correction data corresponding to the first time period and the service data in the second time period to form feedback data for sending to the user terminal).

Based on the data determination method provided by the above embodiment, correspondingly, the application further provides a specific implementation manner of the data determination device. Please see the examples below.

Please refer to fig. 6, which is a data determining apparatus provided in an embodiment of the present application, and as shown in fig. 6, the apparatus includes:

the query module 601 is configured to perform a data information query operation on a filtering control table in response to a data query request sent by a user terminal, where the data query request is used to request to query service data corresponding to first data information in a production table, and the filtering control table is used to: recording data information of error data in the batch data correction processing in the production table;

the matching module 602 is configured to match the first data information with the data information in the filter control table when the data information is found in the filter control table;

a first obtaining module 603, configured to, when second data information that matches the first data information exists in the filter control table, obtain correction data if correction data corresponding to the second data information is cached in a cache table, where the second data information is a part or all of the first data information, and the cache table is configured to: in the batch data correction processing, caching correction data corresponding to error data which has completed the correction processing;

a generating module 604, configured to generate feedback data for sending to the user terminal based on the correction data;

The data determining device provided by the embodiment of the application can create the cache table to cache the correction data after the correction processing of the error data in the process of correcting the error data in batch, judge whether the service data requested to be inquired by the user terminal is the error data in the correction processing through the filtering control table, and if the data requested to be inquired is the error data in the correction processing, obtain the correction data corresponding to the error data through the cache table and feed the correction data back to the user terminal; and if the data requested to be inquired is error data which is not subjected to correction processing, the service data is not sent to the user terminal. Therefore, during the batch correction processing of the error data, the access to the error data can be obtained from the cache table and fed back to the user terminal for displaying, and the technical problem of high complaint rate of the service platform caused by displaying the error data to the user is solved.

Optionally, in response to a data query request sent by a user terminal, the apparatus may further include:

the determining module is used for determining error data in the production table under the condition that the production table is obtained;

the control module is used for recording data information of error data in the production table in the filtering control table;

the correction module is used for carrying out batch data correction processing on the error data corresponding to the data information recorded in the filtering control table;

and the cache module is used for caching the correction data corresponding to the error data which is subjected to the correction processing in the batch data correction processing into a cache table.

The device can store the correction data of the error data generated in the batch data correction processing process into the cache table, so that when the user terminal inquires the error data in the batch data correction processing process, the correction data can be acquired from the cache table and fed back to the user terminal.

Optionally, the correction module may include:

the determining unit is used for determining that the data information recorded in the filtering control table comprises N time periods, wherein N is an integer greater than 1;

and the syndrome unit is used for simultaneously and respectively carrying out data correction processing on the error data in the N time periods through the N processing threads.

The device can realize batch data correction processing on error data of a plurality of time periods simultaneously.

Optionally, the first data information is a target time period; the above-mentioned device still includes:

the judging module is used for inquiring whether the target time period is within N time periods;

the matching result determining module is used for determining that second data information matched with the first data information exists in the filtering control table if at least part of the target time periods are in N time periods, and the second data information comprises: and a first time period which is coincident with the target time period in the N time periods.

The apparatus may determine the data information that the service data requested to be queried matches the data information in the filter control table in a case where data information of error data in the batch data correction process for N periods is recorded in the filter control table.

Optionally, the first time period is a partial time period in which the target time period is located in N time periods, and the correction data includes service data located in the first time period in the cache table, the apparatus may further include:

the second acquisition module is used for acquiring the service data in the production table within a second time period, wherein the second time period is a time period except the first time period in the target time period;

the generating module 604 is specifically configured to generate feedback data for sending to the user terminal based on the correction data, and includes:

and combining the correction data and the service data positioned in the second time period to form feedback data for sending to the user terminal.

The device can acquire the correction data corresponding to the error data from the cache table and acquire other data from the production table under the condition that the inquired service data includes the error data in the batch data correction processing and other service data except the error data in the batch data correction processing, thereby filtering the error data and displaying the correct data only at the user terminal.

Optionally, the generating module 604 may be further configured to: after the data information query operation is carried out on the filtering control table, under the condition that the data information does not exist in the filtering control table or the data information matched with the first data information does not exist in the filtering control table, the business data corresponding to the first data information in the production table is used as feedback data.

It should be noted that the data determination apparatus is an apparatus corresponding to the data determination method, and all implementation manners in the method embodiments are applicable to the embodiment of the apparatus, and the same technical effects can be achieved.

Fig. 7 shows a hardware structure diagram of an electronic device provided in an embodiment of the present application.

The electronic device may include a processor 701 and a memory 702 that stores computer program instructions.

Specifically, the processor 701 may include a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or may be configured to implement one or more Integrated circuits of the embodiments of the present Application.

Memory 702 may include a mass storage for data or instructions. By way of example, and not limitation, memory 702 may include a Hard Disk Drive (HDD), a floppy Disk Drive, flash memory, an optical Disk, a magneto-optical Disk, magnetic tape, or a Universal Serial Bus (USB) Drive or a combination of two or more of these. Memory 702 may include removable or non-removable (or fixed) media, where appropriate. The memory 702 may be internal or external to the integrated gateway disaster recovery device, where appropriate. In a particular embodiment, the memory 702 is non-volatile solid-state memory.

The memory may include Read Only Memory (ROM), random Access Memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical, or other physical/tangible memory storage devices. Thus, in general, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software comprising computer-executable instructions and when the software is executed (e.g., by one or more processors), it is operable to perform operations described with reference to methods in accordance with the present disclosure.

The processor 701 may implement any of the data determination methods in the above embodiments by reading and executing computer program instructions stored in the memory 702.

In one example, the electronic device may also include a communication interface 703 and a bus 704. As shown in fig. 7, the processor 701, the memory 702, and the communication interface 703 are connected by a bus 704 to complete mutual communication.

The communication interface 703 is mainly used for implementing communication between modules, apparatuses, units and/or devices in this embodiment.

Bus 704 includes hardware, software, or both to couple the components of the online data traffic billing device to each other. By way of example, and not limitation, a bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hypertransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (VLB) bus, or other suitable bus or a combination of two or more of these. Bus 704 may include one or more buses, where appropriate. Although specific buses are described and shown in the embodiments of the application, any suitable buses or interconnects are contemplated by the application.

In addition, in combination with the data determination method in the foregoing embodiments, the embodiments of the present application may be implemented by providing a computer storage medium. The computer storage medium having computer program instructions stored thereon; the computer program instructions, when executed by a processor, implement any of the data determination methods in the above embodiments.

It is to be understood that the present application is not limited to the particular arrangements and instrumentality described above and shown in the attached drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present application are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications, and additions or change the order between the steps after comprehending the spirit of the present application.

The functional blocks shown in the above structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, plug-in, function card, or the like. When implemented in software, the elements of the present application are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted by a data signal carried in a carrier wave over a transmission medium or a communication link. A "machine-readable medium" may include any medium that can store or transfer information. Examples of a machine-readable medium include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio Frequency (RF) links, and so forth. The code segments may be downloaded via computer networks such as the internet, intranet, etc.

It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, the present application is not limited to the order of the above steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed at the same time.

Aspects of the present disclosure are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions/acts specified in the flowchart and/or block diagram block or blocks. Such a processor may be, but is not limited to, a general purpose processor, a special purpose processor, an application specific processor, or a field programmable logic circuit. It will also be understood that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware for performing the specified functions or acts, or combinations of special purpose hardware and computer instructions.

As will be apparent to those skilled in the art, for convenience and brevity of description, the specific working processes of the systems, modules and units described above may refer to corresponding processes in the foregoing method embodiments, and are not described herein again. It should be understood that the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the present application, and these modifications or substitutions should be covered within the scope of the present application.

Claims

1. A method for data determination, the method comprising:

2. The method as claimed in claim 1, wherein before performing the data information query operation on the filtering control table in response to the data query request sent by the user terminal, the method further comprises:

determining error data in the production table under the condition that the production table is obtained;

recording data information of error data in the production table in the filter control table;

performing batch data correction processing on error data corresponding to the data information recorded in the filtering control table;

in the batch data correction processing, correction data corresponding to error data having been corrected is buffered in the buffer table.

3. The method according to claim 2, wherein the performing of the batch data correction processing on the error data corresponding to the data information recorded in the filter control table includes:

determining that the data information recorded in the filtering control table comprises N time periods, wherein N is an integer greater than 1;

and respectively carrying out data correction processing on the error data of the N time periods through N processing threads at the same time.

4. The method of claim 3, wherein the first data information is a target time period;

before the obtaining of the correction data if the second data information matching the first data information exists in the filter control table and the correction data corresponding to the second data information is cached in the cache table, the method further includes:

inquiring whether the target time period is within the N time periods;

if at least a part of the target time periods are in the N time periods, determining that second data information matched with the first data information exists in the filtering control table, wherein the second data information comprises: a first time period of the N time periods that coincides with the target time period.

5. The method according to claim 4, wherein the first time period is a partial time period of the target time period within the N time periods, and the correction data comprises traffic data in the buffer table located in the first time period;

after the matching the first data information with the data information in the filtering control table, the method further includes:

acquiring service data in the production table within the second time period, wherein the second time period is a time period except the first time period in the target time period;

the generating feedback data for transmission to the user terminal based on the correction data comprises:

6. The method of claim 1, wherein after the data information query operation on the filter control table, the method further comprises:

and under the condition that no data information exists in the filter control table or no data information matched with the first data information exists in the filter control table, using the service data corresponding to the first data information in the production table as the feedback data.

7. A data determination apparatus, characterized in that the apparatus comprises:

8. The apparatus of claim 7, further comprising:

the correction module is used for carrying out batch data correction processing on error data corresponding to the data information recorded in the filtering control table;

9. The apparatus of claim 8, wherein the correction module comprises:

and the correcting unit is used for simultaneously and respectively carrying out data correction processing on the error data of the N time periods through N processing threads.

10. The apparatus of claim 9, wherein the first data information is a target time period;

the device, still include:

the judging module is used for inquiring whether the target time period is within the N time periods;

a matching result determining module, configured to determine that second data information matching the first data information exists in the filtering control table if at least a part of the target time periods are in the N time periods, where the second data information includes: a first time period coinciding with the target time period among the N time periods.

11. The apparatus according to claim 10, wherein the first time period is a part of the N time periods within the target time period, and the correction data includes traffic data in the buffer table in the first time period;

the device further comprises:

a second obtaining module, configured to obtain service data in the production table within a second time period, where the second time period is a time period of the target time period except the first time period;

the generation module is specifically configured to:

12. The apparatus of claim 7, further comprising:

13. A data determination device, comprising: at least one processor, at least one memory, and computer program instructions stored in the memory that, when executed by the processor, implement the method of any of claims 1-6.

14. A computer-readable storage medium having computer program instructions stored thereon, which when executed by a processor implement the method of any one of claims 1-6.