CN115544077A - Data determination method, device, equipment and computer storage medium - Google Patents

Abstract

The application discloses a data determination method, a device, equipment and a computer storage medium, wherein the data determination method comprises the following steps: responding to a data query request sent by a user terminal, and performing data information query operation on a filtering control table; under the condition that the data information exists in the filtering control table, matching the first data information with the data information in the filtering control table; under the condition that second data information matched with the first data information exists in the filtering control table, if correction data corresponding to the second data information is cached in the cache table, the correction data is acquired; based on the correction data, feedback data for transmission to the user terminal is generated. According to the method, during the correction processing of the error data batch data, the correction data can be acquired from the cache table for inquiring the error data, and a user is prevented from inquiring the error data during the correction processing of the error data batch data.

Description

Data determining method, device, equipment and computer storage medium

technical field

The present application relates to the technical field of data security, in particular to a method, device, equipment and computer storage medium for determining data.

Background technique

In the process of providing business services (such as communication business services, etc.) to users by the business service platform, a large amount of business data will be generated. Among them, there may be wrong data in the business data generated by the business service platform, so the wrong data needs to be processed in batches to update the wrong data into correct business data.

However, because it takes a long time to batch process wrong data, during this period, the business service platform may receive data query requests initiated by users, which will cause the wrong data requested by users to be displayed, which may easily cause users to look at Complaints are generated due to incorrect data displayed, which makes the complaint rate of the business service platform relatively high.

Contents of the invention

The embodiment of the present invention provides a data determination method to solve the technical problem of high complaint rate on the business service platform caused by displaying wrong data to users during batch wrong data processing.

In a first aspect, an embodiment of the present invention provides a method for determining data, the method including:

In response to the data query request sent by the user terminal, perform a data information query operation on the filtering control table, the data query request is used to request querying the business data corresponding to the first data information in the production table, and the filtering control table is used for: Recording the data information of the erroneous data in the batch data correction process in the production table;

matching the first data information with the data information in the filtering control table when it is found that there is data information in the filtering control table;

In the case where there is second data information matching the first data information in the filtering control table, if correction data corresponding to the second data information is cached in the buffer table, acquiring the correction data, the second data information is part or all of the first data information, and the cache table is used to: in batch data correction processing, cache correction data corresponding to error data that has completed correction processing;

generating feedback data for transmission to the user terminal based on the correction data;

Wherein, if the correction data corresponding to the second data information is not cached in the cache table, no service data is sent to the user terminal.

In a second aspect, an embodiment of the present invention provides a device for determining data, including:

The query module is configured to perform a data information query operation on the filtering control table in response to a data query request sent by the user terminal, the data query request is used to request querying the business data corresponding to the first data information in the production table, and the filtering The control table is used to: record the data information of the erroneous data in the batch data correction process in the production table;

A matching module, configured to match the first data information with the data information in the filtering control table when it is found that there is data information in the filtering control table;

The first obtaining module is configured to: if there is second data information matching the first data information in the filtering control table, if the cache table has cached corrections corresponding to the second data information data, the corrected data is obtained, the second data information is part or all of the first data information, and the cache table is used for: in batch data correction processing, buffering error data that has been corrected Corresponding calibration data;

A generating module, configured to generate feedback data for sending to the user terminal based on the correction data;

Wherein, if the correction data corresponding to the second data information is not cached in the cache table, no service data is sent to the user terminal.

In a third aspect, an embodiment of the present application provides an electronic device, including:

At least one processor, at least one memory, and computer program instructions stored in the memory. When the computer program instructions are executed by the processor, the above data determination method is implemented.

In a fourth aspect, an embodiment of the present application provides a computer storage medium, where computer program instructions are stored on the computer storage medium, and when the computer program instructions are executed by a processor, the above data determination method is implemented.

Compared with the prior art, the present application has the following beneficial effects:

This application can create a cache table to cache the corrected data after correcting the wrong data during the batch data correction processing of the wrong data by the electronic device, and judge whether the business data requested by the user terminal is being corrected through the filtering control table erroneous data in , if the requested query data is erroneous data that is being corrected and processed, the corrected data corresponding to the erroneous data will be obtained through the cache table and fed back to the user terminal; and if the requested queryed data is erroneous data that has not been corrected and processed, then No service data is sent to the user terminal. Therefore, during the error data batch correction process, the access to the error data can obtain the correction data from the cache table and feed it back to the user terminal for display, which solves the technical problem of high complaint rate on the business service platform due to displaying error data to users .

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the accompanying drawings that need to be used in the embodiments of the present application. Additional figures can be derived from these figures.

Fig. 1 is a schematic flow chart of data determination shown in an exemplary embodiment;

Fig. 2 is a schematic flow chart of data determination shown in an exemplary embodiment;

Fig. 3 is a schematic flowchart of batch data correction processing shown in an exemplary embodiment;

Fig. 4 is a schematic diagram of a data section of a request query shown in an exemplary embodiment;

Fig. 5 is a schematic flow chart of a data query shown in an exemplary embodiment

Fig. 6 is a schematic structural diagram of a data determination device shown in an exemplary embodiment;

Fig. 7 is a schematic structural diagram of an electronic device shown in an exemplary embodiment.

detailed description

The characteristics and exemplary embodiments of various aspects of the application will be described in detail below. In order to make the purpose, technical solution and advantages of the application clearer, the application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described here are only intended to explain the present application rather than limit the present application. It will be apparent to one skilled in the art that the present application may be practiced without some of these specific details. The following description of the embodiments is only to provide a better understanding of the present application by showing examples of the present application.

It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is a relationship between these entities or operations. There is no such actual relationship or order between them. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the statement "comprising..." does not exclude the presence of additional same elements in the process, method, article or device comprising said element.

In order to solve the problems in the prior art, the embodiments of the present application provide a data determination method, device, equipment, and computer storage medium. The data determination method provided by the embodiment of the present application is firstly introduced below.

As shown in Figure 1, a data determination method provided by this embodiment is applied to an electronic device, and the electronic device may be a server or the like. The data determination method includes the following steps:

Step S101, in response to the data query request sent by the user terminal, perform a data information query operation on the filter control table; the data query request is used to query the business data corresponding to the first data information in the production table, and the filter control table is used to: Record the data information of the wrong data in the batch data correction process in the production table;

Step S102, matching the first data information with the data information in the filtering control table when it is found that there is data information in the filtering control table;

Step S103, if there is second data information matching the first data information in the filter control table, if the correction data corresponding to the second data information is cached in the cache table, then the correction data is obtained, and the second data information is Part or all of the first data information, the cache table is used to: in the batch data correction process, cache the correction data corresponding to the error data that has completed the correction process;

Step S104, based on the correction data, generate feedback data for sending to the user terminal;

Wherein, if the correction data corresponding to the second data information is not cached in the cache table, no service data is sent to the user terminal.

The specific implementation of the above steps will be described in detail below.

The embodiment of the present application can create a cache table to cache the corrected data after correcting the wrong data in the process of batch data correction processing of the wrong data by the electronic device, and judge whether the service data requested by the user terminal to be queried is in progress through the filtering control table. Error data in correction processing, if the requested query data is error data in batch data correction processing, the correction data corresponding to the error data is obtained through the cache table and fed back to the user terminal; and if the requested query data is not completed correction processing erroneous data, the service data will not be sent to the user terminal. In this way, during the long period of batch error data processing, the error data can be avoided from being fed back to the user terminal for display, thereby effectively reducing the complaint rate of the business service platform.

The specific implementation of each of the above steps is introduced below.

In the above step S101, when the electronic device performs batch data correction processing on the production table, if the user terminal sends a data query request to the electronic device, the electronic device responds to the received data query request and performs data information on the filter control table. Query operations.

Wherein, the above-mentioned data query request can be used to request to query the business data corresponding to the first data information in the production table, specifically, the above-mentioned data query request can be a request carrying the above-mentioned first data information, and the first data information can be It is the data information generated by the user terminal according to the user's operation.

For example, the first data information may be when the user terminal receives a period of time input by the user, determine the period of time as the first data information, and send the first data information to the above-mentioned Electronic equipment.

In some embodiments, the user terminal may be a smart phone (Android phone, iOS phone, etc.), a tablet computer, a smart watch, a handheld computer, a mobile Internet device (Mobile Internet Devices, MID), a computer, and the like.

Wherein, the above-mentioned electronic device performs a data information query operation on the filtering control table in response to the data query request sent and received by the user terminal. Specifically, the above-mentioned electronic device obtains the the first data information, and query whether there is data information matching the first data information in the filtering control table. The above data information may include: the table name of the production table to which the data belongs, the data identifier, the processing status of the error data, and the like.

Here, obtaining the first data information carried in the data query request may be that the electronic device parses the data query request to obtain the first data information. For example, if the data query request is an SQL statement, the electronic device can obtain the data information carried in the data query instruction by parsing the SQL statement. The specific acquisition method of service data information is an existing technology, which is not limited in this application and can be selected according to actual needs.

In addition, the above filtering control table may be used to: record the data information of the erroneous data in the batch data correction process in the production table. Batch data correction processing refers to centralized correction processing for large amount of error data in business data.

For example, assuming that the production table includes business data generated in time period 1, and time period 1 includes time period 11, time period 12, ..., and time period 1N, where N is an integer greater than 2, in time period 12 and time period In the case that the business data in segment 13 is error data and is in batch data correction processing, the filtering control table records time segment 12 and time segment 13.

Wherein, the correction processing may be to process the erroneous data in the production table and correct them into correct data. For example, for user list data approval errors, it can be recalculated based on correct user data to obtain correct data; it can also replace incorrectly entered data with correct data.

Optionally, in some embodiments, before step S101, the following steps may also be included:

In the case of obtaining the production table, determine the wrong data in the production table;

Record the data information of the wrong data in the production table in the filter control table;

Perform batch data correction processing on the error data corresponding to the data information recorded in the filter control table;

Wherein, in the batch data correction process, the correction data corresponding to the erroneous data that has completed the correction process is cached in the cache table.

In the embodiment of the present application, first determine the erroneous data in the production table, obtain the data information of the erroneous data, and record the data information of the erroneous data in the filter control table; then, create a cache table, and start batch data correction processing for the erroneous data Afterwards, the corrected data corresponding to the erroneous data that has been corrected is cached in the cache table. When the user terminal queries the erroneous data in batch data correction processing, the correction data can be obtained from the cache table and fed back to the user terminal.

In some embodiments, determining the error data in the production table may be manually determined, or other technical means for determining error data in the prior art, which is not limited in this application.

Wherein, the cache table is used for caching corrected data corresponding to error data that has been corrected during batch data correction processing.

For example, suppose it is determined that the business data generated in the production table included in time period 1 is error data, and the error data in time period 1 includes error data 11, error data 12, ..., and error data 1N, where N is greater than An integer of 2; create a cache table, and start batch correction processing on the error data in time period 1 Batch data correction processing: perform correction processing on error data 11 to generate corresponding correction data 11, store the correction data 11 in the cache table, and then Continue to process the error data 12, .

Optionally, in some embodiments, after all the erroneous data has been corrected, the data information and cache table of the erroneous data in the filter control table may be deleted.

When there are multiple time periods of erroneous data that require batch data correction processing, in order to implement batch data correction processing on multiple time period erroneous data at the same time, in some embodiments, the above-mentioned corresponding to the data information recorded in the filter control table Perform batch data correction processing on erroneous data, which can include:

Determine that the data information recorded in the filtering control table includes N time periods, where N is an integer greater than 1;

Data correction processing is performed on the error data of N time periods through N processing threads at the same time.

In this embodiment of the application, the data information recorded in the filter control table may include the storage time period of batch error data. When it is necessary to perform batch data correction processing on the error data of N time periods, these N time periods are entered into the filter The control table can perform batch data correction processing on the error data of N time periods through N processing threads at the same time. Specifically, for the erroneous data of N time periods, corresponding N cache tables are respectively created, batch data correction processing can be performed on the erroneous data of N time periods at the same time, and the corrected data obtained after the error data is corrected is cached to the cache table corresponding to the time period to which the error data belongs.

For example, assuming that the production table includes business data generated in time period 1, and time period 1 includes time period 11, time period 12, ..., and time period 1N, where N is an integer greater than 2, if the records in the filter control table After time period 11 and time period 12, corresponding cache table 11 and cache table 12 are created for the error data in time period 11 and time period 12 respectively; at the same time, batch data correction is performed on the error data in time period 11 and time period 12 Processing: cache the corrected data corresponding to the error data in the time period 11 in the cache table 11 , and cache the corrected data corresponding to the error data in the time period 12 in the cache table 12 . Wherein, the time period to which the erroneous data that needs batch data correction processing belongs can be determined according to the warehousing time stamp of the erroneous data.

Optionally, in some embodiments, after all the erroneous data of a time period have been corrected, the data information of the time period and the segment table corresponding to the time period in the filter control table are deleted.

In the above embodiment, the correction data of the error data generated during the batch data correction process can be cached in the cache table, so that when the user terminal inquires about the error data that is being processed in the batch data correction process, it can obtain correction data feedback from the cache table to the user terminal.

Optionally, after the data information query operation is performed on the filter control table in the above step S101, it may also include:

When it is found that there is no data information in the filter control table, or there is no data information matching the first data information in the filter control table, the business data corresponding to the first data information in the production table is used as feedback data.

In the embodiment of the present application, if there is no data information in the filtering control table, it means that there is no wrong data in the production table, so the requested data can be obtained directly from the production table. If there is no data information matching the first data information in the filtering control table, it means that there is no wrong data in the requested business data, so the business data can also be obtained directly from the production table according to the query conditions.

In step S102, if it is found that there is data information in the filtering control table, the first data information is matched with the data information in the filtering control table.

In the embodiment of the present application, if there is data information in the filter control table, it means that there is erroneous data in the production table. At this time, the first data information, that is, the data information of the business data requested to be queried is matched with the data information of the filter control table. The matching of the data information can determine whether there is erroneous data in the requested service data, and determine the data information of the erroneous data in the first data information.

For example, assuming that the data information of the erroneous data being corrected in the batch data recorded in the filter control table is time period 1, if the first data information is time period 2, it means that there is no erroneous data being corrected in the business data to be queried . Therefore, the service data corresponding to the first data can be obtained directly from the production table.

Optionally, in some embodiments, if the first data information is the target time period, the method may further include:

Query whether the target time period is within N time periods;

If at least part of the time periods in the target time period are in the above N time periods, then it is determined that there is second data information matching the first data information in the filtering control table, and the second data information includes: in the N time periods, the time period corresponding to the target time The first time period where the segments overlap.

Wherein, the first data information is the target time period, that is, the first data information is the time period to which the service data requested to be queried belongs. The second data information refers to the data information that matches the first data information in the filtering control table. The first time period refers to a time period that overlaps with the target time period in the data information recorded in the filtering control table when the first data information is the target time period.

In the embodiment of the present application, it is recorded in the filter control table that the wrong data with N time periods is being corrected in batch data, if the time period to which the first data information belongs and the N time periods recorded in the filter control table exist If the time periods overlap, it can be determined that there is second data information matching the first data information in the filtering control table, and the overlapping time periods are the second data information.

For example, assuming that the time periods during which the batch data correction process is recorded in the filtering control table are 10:00-11:00 and 12:00-13:00, if the first data information is 10:30-12: 30, the first data information overlaps with the data information recorded in the filtering control table, and the second data information is 10:30-11:00 and 12:00-12:30.

Optionally, in some embodiments, before the error data of a time period starts to be corrected, the processing state of the error data is recorded as being processed, and after all the error data is corrected and processed, the state of the error data is recorded as completed. deal with. If the data processing state in the data information in the filtering control table is processing, then the first data information is matched with the data information in the filtering control table; if the data processing state in the data information in the filtering control table is processed, then The first data message is not matched with the data message marked as processed.

For example, suppose it is determined that the business data generated in time period 11 and time period 12 in the production table is error data, if the error data in time period 11 is marked as processed in the filter control table, the error data in time period 12 is marked as processed. If it is not being processed, then only the first data information is matched with the time period 12 .

In the above embodiment, matching the first data information with the data information recorded in the filter control table can determine the second data information.

In step S103, if there is second data information matching the first data information in the filter control table, if the correction data corresponding to the second data information is cached in the cache table, the correction data is obtained, and the second data information is The information is part or all of the first data information.

Wherein, the second data information is part or all of the first data information, that is, the case where the second data information is part of the first data information refers to: only part of the business data requested to be queried belongs to the records in the filtering control table erroneous data in batch correction processing. The situation that the second data is all the data information of the first data information means that all the business data requested for query are error data in the batch data correction process recorded in the filtering control table.

For example, the time period for the data information recorded in the filtering control table is 10:00-11:00 for error data in batch data correction processing, if the first data information is 10:30-10:50, then the second data information The information is 10:30-10:50:00, and the service data corresponding to the second data information is obtained from the cache table; if the first data information is 10:30-12:30, the second data information is 10:30 -11:00.

In this embodiment of the present application, the electronic device may determine, based on the second data information determined in step S102, that if there is correction data corresponding to the second data information cached in the cache table, then obtain the correction data. Specifically, the electronic device obtains the correction data by setting The first data information is matched with the data information recorded in the filter control table to obtain the second data information, and judge whether there is correction data corresponding to the second data information in the cache table according to the second data information, if there is correction data corresponding to the second data information in the cache table The correction data corresponding to the information is obtained from the buffer table and the correction data corresponding to the second data information.

For example, assuming that the filtering control table records that the time period of the erroneous data being processed in the batch data correction process is 9:00-10:00, the corresponding cache table stores the time period between 9:00-9:30 during the processing. For the correction data corresponding to the erroneous data, if the second data information is 9:00-9:10, the correction data within 9:00-9:10 is obtained from the cache table.

In step S104, based on the correction data, feedback data for sending to the user terminal is generated; wherein, if the correction data corresponding to the second data information is not cached in the cache table, no service data is sent to the user terminal.

Wherein, based on the correction data, the feedback data for sending to the user terminal is generated, that is, the electronic device generates the feedback data to be sent to the user terminal according to the correction data acquired in step S103, and the user terminal, after receiving the feedback data, the user The terminal displays the feedback data.

In some embodiments, if the corrected data corresponding to the second data information is not cached in the cache table, it means that the service data corresponding to the second data information requested for access is erroneous data that has not been corrected. Send the service data corresponding to the second data information to the user terminal.

For example, assuming that the filtering control table records that the time period of the erroneous data being processed in the batch data correction process is 9:00-10:00, the corresponding cache table stores the time period between 9:00-9:30 during the processing. For the correction data corresponding to the error data, if the second data information is 9:40-9:50, and the correction data corresponding to 9:40-9:50 is not cached in the cache table at this time, the service corresponding to the second data information will not be The data is fed back to the user terminal.

In some embodiments, when the second data information is all data information of the first data information, the correction data corresponding to the second data information is directly obtained from the buffer table, and the feedback data is generated according to the obtained correction data.

In some embodiments, when the second data information is part of the first data information, the correction data corresponding to the second data information is obtained from the cache table, and the correction data corresponding to the second data information is obtained from the production table except the second For business data corresponding to data information other than data information, the obtained correction data and business data are combined to generate feedback data.

Optionally, the first time period is a part of the target time period within the N time periods, and the correction data includes the service data in the cache table located in the first time period;

After matching the first data information with the data information in the filtering control table, it may further include:

Obtain the business data in the production table within the second time period, where the second time period is a time period other than the first time period in the target time period;

Based on the correction data, generating feedback data for sending to the user terminal includes: combining the correction data and service data within the second time period to form feedback data for sending to the user terminal.

In the embodiment of the present application, when the first time period is a part of the target time period within N time periods, and the correction data includes the service data in the first time period in the cache table, from the cache table Obtain the correction data in the first time period, obtain the business data in the second time period from the production table, and then combine the correction data and the business data in the second time period to generate a feedback data.

Wherein, the first time period is a part of the time period in which the target time period is located within the N time periods, and refers to the time period in which the time period to which the requested service data belongs overlaps with the N time periods recorded in the filtering control table. The second time period is the time period other than the first time period in the target time period, which means that the time period to which the business data requested to be queried belongs is not the same as that in the filter control table

For example, assuming that the time period for recording the error data in the batch data correction process in the filtering control table is 10:00-11:00 and 12:00-13:00, if the target time period (i.e. the first data information) is 10:30-12:30, the target time period overlaps with the data information recorded in the filter control table, and the first time period (that is, the second data information) is 10:30-11:00 and 12:00-12 :30; the second time period is 11:00-12:00, then obtain the correction data corresponding to 10:30-11:00 and 12:00-12:30 from the cache table, and obtain the data corresponding to 11:00 from the production table service data corresponding to 00-12:00, and then combine the correction data and service data to generate feedback data for sending to the user terminal.

In this embodiment, when the electronic device receives the query request sent by the user terminal that contains both erroneous data that is undergoing batch data correction processing and business data that does not need batch data correction processing, Obtain the corrected data after correcting the wrong data, and obtain the business data that does not require batch data correction processing from the production table, so as to filter the wrong data and only feed back the correct data to the user terminal.

The above is the specific implementation of the data determination method provided by the embodiment of the present application. During the batch data correction process of the error data by the electronic device, a cache table can be created to cache the correction data after the error data correction process, and the filter control table can It is determined whether the service data requested by the user terminal is error data being corrected and processed, and if the requested query data is error data being corrected, the corrected data is obtained through the cache table and fed back to the user terminal. It avoids feeding back the wrong data to the user terminal during the long period of batch wrong data processing.

In addition, during the batch data correction process, the correction data corresponding to the error data that has been corrected is continuously cached in the cache table until the error data is processed, so the user terminal can obtain the Constantly updated feedback data. Therefore, the technical solution of the present application can also monitor the processing of error data in real time.

For the convenience of understanding, the description below takes N equal to 1 as an example.

In some embodiments, as shown in FIG. 2 , taking N=1 as an example, that is, when the error data to be processed is data within a time period. The technical solution of this application can be realized through the following steps:

Step 21. When the problem data processing starts, the data processing program inserts a piece of control information into the filter control table, identifying a certain range of data in a certain type of original production table (identified by the storage time stamp) as error data, which needs to be processed in batches (that is, record the data information of the wrong data in the production table in the filter control table), and the query of the relevant data during the period points to the fragment table (that is, for the data that is being processed in batch data, the processed correction data is obtained from the cache table) , after the batch data processing is completed, modify the corresponding record in the filter control table as processing completed, and notify the query display program that no filter control is required (that is, if there is no data information matching the first data information in the filter control table, the The service data corresponding to the first data information is used as the feedback data).

Step 22, the problem data processing program starts to delete the problem data in the original production table, generates new correct data, and writes it into the original production table (that is, corrects the wrong data).

Step 23. Write the newly generated correct data into the segment table (that is, in the batch data correction process, the corrected data corresponding to the corrected error data is cached in the cache table).

Step 24, after receiving the front-end user request, the query display program first checks whether the interval covered by the user-related request data falls within the time zone in the filter control table (that is, in response to the data query request sent by the user terminal, the filter control table is processed data information query operation).

Step 25. If the interval covered by the user-related request data falls outside the time zone in the filter control table, directly query the production table and return (that is, if there is no data information matching the first data information in the filter control table, The business data corresponding to the first data information in the production table is used as the feedback data).

Step 26. If the intervals covered by the user-related request data all fall within the time zone in the filter control table, then directly query the segment table and return (that is, there is a second data information matching the first data information in the filter control table Next, if the correction data corresponding to the second data information is cached in the cache table, the correction data is acquired).

Step 27. If the interval covered by the user-related request data spans the time segment in the filter control table, the user query needs to be divided into two parts, filter the query fragment table within the interval segment, and filter the query original production table outside the interval segment , and combine the two query result sets to return to the user (that is, obtain the business data in the first time period in the cache table and the business data in the second time period in the production table, and combine the correction data and the The service data in the second time period are combined to form feedback data for sending to the user terminal).

When N adopts other values, the same implementation manner as when N is equal to 1 is adopted, and for the sake of brevity, no detailed description is given here.

In some embodiments, the specific error data processing process can be realized by the error data processing program, and the error data processing program mainly realizes that when the batch data correction process is started, the filter control record is inserted in the filter control table, and the fragment table is initialized (i.e. cache table), and insert new correction data into the production table and fragment table at the same time, after the batch data correction processing is completed, change the corresponding record status identifier of the filter control table.

The filter control table, production table and segment table are designed according to the actual situation. This application can be applied to static data tables similar to bill storage, and relational database tables, as shown in Table 1 and Table 2. Table 1 is the filter control database table , Table 2 is the information structure of the production table and fragment table:

Table 1

Table 2

In some embodiments, the batch data correction processing process is shown in Figure 3, and may include the following steps:

Step 31, read the configuration information, obtain the production table information to be processed and the data information of the problem data to be processed (that is, determine the wrong data in the production table when the production table is obtained).

Step 32, insert control information into the filter control table, identify the data that needs to be queried in the fragment table in the production table (i.e. input the data information of the problem data into the filter control table), and set the state of the control information to 1 at the same time, indicating the problem data Processing.

Step 33, store the correct information into the production table and the segment table, and delete the error information in the production table at the same time (that is, perform batch data correction processing on the error data corresponding to the data information recorded in the filter control table, and complete the error correction processing. The correction data corresponding to the data is cached in the cache table).

Step 34, judging whether the problem data has been processed. If the problem data has not been processed, return to step 3; if the problem data has been processed, go to step 35.

Step 35. Change the status of the filter control table to 0, indicating that the problem data has been processed.

In some embodiments, the specific query display process of the data can be realized by the query display program. After receiving the query request from the user, the query display program checks whether the interval covered by the user-related request data falls within the time segment in the filter control table , if it is all within the range, then directly query the segment table to return, if it is outside the range, directly query the production table to return, if it spans the range, as shown in Figure 4, you need to divide the user's query into two parts, and filter the range query fragment table, filter the query original production table outside the interval, and combine the two query result sets to return to the user, that is, the user's query needs to be divided into two segments, the first half queries the production table, and the second half queries the fragments surface.

In some embodiments, the specific query presentation process is shown in Figure 5, which may include the following steps:

Step 51, after receiving the query request, check whether the filtering control table has filtering control information with a state of 1 (that is, in response to the data query request sent by the user terminal, perform a data information query operation on the filtering control table); if not, directly press Query the production table information by condition and return the query result to the front desk; if yes, go to step 52.

Step 52, judge whether the foreground query data is all in the filter interval (i.e. carry out the data information query operation to the filter control table); In the case of matching second data information, if the correction data corresponding to the second data information is cached in the cache table, the correction data is obtained); if not, go to step 53.

Step 53, judge whether the foreground query data is all outside the filter interval (i.e. carry out the data information query operation to the filter control table); In the case of the data information matching the data information, the business data corresponding to the first data information in the production table is used as the feedback data); if not, the user's query is divided into two parts, and the query fragment table in the filtering interval segment is filtered, and the Query the original production table outside the interval, and combine the two query result sets and return to the user (that is, the correction data corresponding to the first time period and the business data in the second time period are merged to form a Feedback data sent by the terminal).

Based on the data determination method provided in the foregoing embodiments, correspondingly, the present application also provides a specific implementation manner of a data determination device. See the examples below.

Please refer to FIG. 6, which is a data determination device provided by the embodiment of the present application. As shown in FIG. 6, the device includes:

The query module 601 is configured to perform a data information query operation on the filter control table in response to the data query request sent by the user terminal. The data query request is used to request to query the business data corresponding to the first data information in the production table, and the filter control table uses To: record the data information of the wrong data in the batch data correction process in the production table;

A matching module 602, configured to match the first data information with the data information in the filtering control table when it is found that there is data information in the filtering control table;

The first acquisition module 603 is configured to acquire the correction data if there is correction data corresponding to the second data information cached in the cache table when there is second data information matching the first data information in the filtering control table, The second data information is a part or all of the first data information, and the cache table is used for: in the batch data correction process, cache the corrected data corresponding to the erroneous data that has been corrected;

A generating module 604, configured to generate feedback data for sending to the user terminal based on the correction data;

Wherein, if the correction data corresponding to the second data information is not cached in the cache table, no service data is sent to the user terminal.

The data determination device provided by the embodiment of the present application can create a cache table to cache the corrected data after correcting the wrong data in the process of correcting the wrong data in batches, and judge the service data requested by the user terminal through the filtering control table Whether it is error data that is being corrected or not, if the requested query data is error data that is being corrected and processed, the correction data corresponding to the error data will be obtained through the cache table and fed back to the user terminal; and if the requested query data is not completed the correction process erroneous data, the service data will not be sent to the user terminal. Therefore, during the error data batch correction process, the access to the error data can obtain the correction data from the cache table and feed it back to the user terminal for display, which solves the technical problem of high complaint rate on the business service platform due to displaying error data to users .

Optionally, in response to the data query request sent by the user terminal, the above device may further include:

A determination module is used to determine the error data in the production table when the production table is obtained;

The control module is used to record the data information of the erroneous data in the production table in the filter control table;

A correction module, configured to perform batch data correction processing on erroneous data corresponding to the data information recorded in the filter control table;

The caching module is used for caching the corrected data corresponding to the erroneous data that has completed the correction process in the cache table during the batch data correction process.

The above device can store the correction data of the error data generated during the batch data correction process into the cache table, so that when the user terminal inquires about the error data that is being processed in the batch data correction process, the correction data can be obtained from the cache table and fed back to the user terminal.

Optionally, the above-mentioned correction module may include:

A determining unit, configured to determine that the data information recorded in the filtering control table includes N time periods, where N is an integer greater than 1;

The corrector unit is configured to perform data correction processing on the erroneous data of N time periods respectively through N processing threads at the same time.

The above device can implement batch data correction processing on error data in multiple time periods at the same time.

Optionally, the first data information is a target time period; the above device also includes:

A judging module, configured to inquire whether the target time period is within N time periods;

A matching result determination module, configured to determine that there is second data information matching the first data information in the filter control table if at least part of the time period in the target time period is in N time periods, and the second data information includes: N time periods segment, the first time segment that coincides with the target time segment.

The above device can determine the data information that the business data requested to query matches the data information in the filter control table when the data information of the wrong data in the batch data correction process is recorded in the filter control table for N time periods.

Optionally, the first time period is a part of the time period in which the target time period is within the N time periods, and the correction data includes the service data in the first time period in the cache table. The above-mentioned device may also include:

The second acquiring module is used to acquire the business data in the production table within the second time period, wherein the second time period is a time period other than the first time period in the target time period;

The above generation module 604 is specifically configured to generate feedback data for sending to the user terminal based on the correction data, including:

The correction data and the service data within the second time period are combined to form feedback data for sending to the user terminal.

The above device can obtain the correction data corresponding to the error data from the cache table when the business data queried includes both the error data in the batch data correction process and other business data other than the error data in the batch data correction process , to obtain other data from the production table, so as to filter the wrong data and only display the correct data on the user terminal.

Optionally, the above generating module 604 may also be used for: after performing data information query operation on the filter control table, it is found that there is no data information in the filter control table, or there is no data information related to the first data information in the filter control table. In the case of matching data information, the business data corresponding to the first data information in the production table is used as the feedback data.

It should be noted that the device for determining data is a device corresponding to the method for determining data above, and all implementations in the above method embodiments are applicable to the embodiments of the device, and can also achieve the same technical effect.

FIG. 7 shows a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application.

The electronic device may include a processor 701 and a memory 702 storing computer program instructions.

Specifically, the processor 701 may include a central processing unit (CPU), or an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or may be configured to implement one or more integrated circuits in the embodiments of the present application.

Memory 702 may include mass storage for data or instructions. By way of example and not limitation, the memory 702 may include a hard disk drive (Hard Disk Drive, HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a Universal Serial Bus (Universal Serial Bus, USB) drive or two or more Combinations of multiple of the above. Storage 702 may include removable or non-removable (or fixed) media, where appropriate. Under appropriate circumstances, the storage 702 can be inside or outside the comprehensive gateway disaster recovery device. In a particular embodiment, memory 702 is a non-volatile solid-state memory.

Memory may include read only memory (ROM), random access memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical, or other physical/tangible memory storage devices. Thus, in general, memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software comprising computer-executable instructions, and when the software is executed (e.g., by one or multiple processors) operable to perform the operations described with reference to the method according to the present disclosure.

The processor 701 reads and executes the computer program instructions stored in the memory 702 to implement any one of the data determination methods in the foregoing embodiments.

In an example, the electronic device may further include a communication interface 703 and a bus 704 . Wherein, as shown in FIG. 7 , a processor 701 , a memory 702 , and a communication interface 703 are connected through a bus 704 to complete mutual communication.

The communication interface 703 is mainly used to realize the communication between various modules, devices, units and/or devices in the embodiments of the present application.

The bus 704 includes hardware, software or both, and couples the components of the online data traffic charging device to each other. By way of example and not limitation, the bus may include Accelerated Graphics Port (AGP) or other graphics bus, Enhanced Industry Standard Architecture (EISA) bus, Front Side Bus (FSB), HyperTransport (HT) interconnect, Industry Standard Architecture (ISA) Bus, Infiniband Interconnect, Low Pin Count (LPC) Bus, Memory Bus, Micro Channel Architecture (MCA) Bus, Peripheral Component Interconnect (PCI) Bus, PCI-Express (PCI-X) Bus, Serial Advanced Technology Attachment (SATA) bus, Video Electronics Standards Association Local (VLB) bus or other suitable bus or a combination of two or more of these. Bus 704 may comprise one or more buses, where appropriate. Although the embodiments of this application describe and illustrate a particular bus, this application contemplates any suitable bus or interconnect.

In addition, in combination with the data determining method in the foregoing embodiments, the embodiments of the present application may provide a computer storage medium for implementation. Computer program instructions are stored on the computer storage medium; when the computer program instructions are executed by a processor, any one of the data determination methods in the foregoing embodiments is implemented.

It is to be understood that the application is not limited to the specific configurations and processes described above and shown in the figures. For conciseness, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present application is not limited to the specific steps described and shown, and those skilled in the art may make various changes, modifications and additions, or change the order of the steps after understanding the spirit of the present application.

The functional blocks shown in the above structural block diagrams may be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an application specific integrated circuit (ASIC), suitable firmware, a plug-in, a function card, or the like. When implemented in software, the elements of the present application are the programs or code segments employed to perform the required tasks. Programs or code segments can be stored in machine-readable media, or transmitted over transmission media or communication links by data signals carried in carrier waves. "Machine-readable medium" may include any medium that can store or transmit information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio frequency (RF) links, and the like. Code segments may be downloaded via a computer network such as the Internet, an Intranet, or the like.

It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, the present application is not limited to the order of the above steps, that is, the steps may be performed in the order mentioned in the embodiment, or may be different from the order in the embodiment, or several steps may be performed simultaneously.

Aspects of the present disclosure are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the present disclosure. It will be understood that each block of the flowchart and/or block diagrams, and combinations of blocks in the flowchart and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine such that execution of these instructions via the processor of the computer or other programmable data processing apparatus enables Implementation of the functions/actions specified in one or more blocks of the flowchart and/or block diagrams. Such processors may be, but are not limited to, general purpose processors, special purpose processors, application specific processors, or field programmable logic circuits. It can also be understood that each block in the block diagrams and/or flowcharts and combinations of blocks in the block diagrams and/or flowcharts can also be realized by dedicated hardware for performing specified functions or actions, or can be implemented by dedicated hardware and combination of computer instructions.

The above is only a specific implementation of the present application, and those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working process of the above-described systems, modules and units can refer to the above-mentioned method embodiments. The corresponding process will not be repeated here. It should be understood that the protection scope of the present application is not limited thereto, and any person familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the application, and these modifications or replacements should cover all Within the protection scope of this application.

Claims (14)

1. A method for determining data, characterized in that the method comprises: In response to the data query request sent by the user terminal, perform a data information query operation on the filtering control table, the data query request is used to request querying the business data corresponding to the first data information in the production table, and the filtering control table is used for: Recording the data information of the erroneous data in the batch data correction process in the production table; matching the first data information with the data information in the filtering control table when it is found that there is data information in the filtering control table; In the case where there is second data information matching the first data information in the filtering control table, if correction data corresponding to the second data information is cached in the buffer table, acquiring the correction data, the second data information is part or all of the first data information, and the cache table is used to: in batch data correction processing, cache correction data corresponding to error data that has completed correction processing; generating feedback data for transmission to the user terminal based on the correction data; Wherein, if the correction data corresponding to the second data information is not cached in the cache table, no service data is sent to the user terminal. 2. The method according to claim 1, wherein the method further comprises: In the case that the production table is acquired, determining wrong data in the production table; Record the data information of the erroneous data in the production table in the filter control table; performing batch data correction processing on the error data corresponding to the data information recorded in the filtering control table; Wherein, in the batch data correction process, the correction data corresponding to the erroneous data that has been corrected is cached in the cache table. 3. The method according to claim 2, wherein the batch data correction process is performed on the error data corresponding to the data information recorded in the filtering control table, comprising: It is determined that the data information recorded in the filtering control table includes N time periods, wherein the N is an integer greater than 1; Data correction processing is performed on the erroneous data of the N time periods through N processing threads at the same time. 4. The method according to claim 3, wherein the first data information is a target time period; In the case where there is second data information matching the first data information in the filtering control table, if the correction data corresponding to the second data information is cached in the buffer table, the obtained Before the correction data, the method also includes: Query whether the target time period is within the N time periods; If at least part of the time periods in the target time period are in the N time periods, it is determined that there is second data information matching the first data information in the filtering control table, and the second data information includes: Among the N time periods, a first time period that coincides with the target time period. 5. The method according to claim 4, wherein the first time period is a part of the time period in which the target time period is within the N time periods, and the correction data includes the cache table The business data in the first time period; After matching the first data information with the data information in the filtering control table, the method further includes: Obtaining business data in the production table within the second time period, wherein the second time period is a time period in the target time period except for the first time period; The generating the feedback data for sending to the user terminal based on the correction data includes: Combining the correction data and the service data within the second time period to form feedback data for sending to the user terminal. 6. The method according to claim 1, characterized in that, after the data information query operation is performed on the filter control table, the method further comprises: When it is found that there is no data information in the filter control table, or that there is no data information matching the first data information in the filter control table, compare the production table with the first data information The service data corresponding to the data information is used as the feedback data. 7. A data determination device, characterized in that the device comprises: The query module is configured to perform a data information query operation on the filtering control table in response to a data query request sent by the user terminal, the data query request is used to request querying the business data corresponding to the first data information in the production table, and the filtering The control table is used to: record the data information of the erroneous data in the batch data correction process in the production table; A matching module, configured to match the first data information with the data information in the filtering control table when it is found that there is data information in the filtering control table; The first obtaining module is configured to: if there is second data information matching the first data information in the filtering control table, if the cache table has cached corrections corresponding to the second data information data, the corrected data is obtained, the second data information is part or all of the first data information, and the cache table is used for: in batch data correction processing, buffering error data that has been corrected Corresponding calibration data; A generating module, configured to generate feedback data for sending to the user terminal based on the correction data; Wherein, if the correction data corresponding to the second data information is not cached in the cache table, no service data is sent to the user terminal. 8. The device according to claim 7, further comprising: A determining module, configured to determine error data in the production table when the production table is acquired; A control module, configured to record data information of erroneous data in the production table in the filtering control table; A correction module, configured to perform batch data correction processing on the erroneous data corresponding to the data information recorded in the filtering control table; Wherein, in the batch data correction process, the correction data corresponding to the erroneous data that has been corrected is cached in the cache table. 9. The device according to claim 8, wherein the calibration module comprises: A determining unit, configured to determine that the data information recorded in the filtering control table includes N time periods, where N is an integer greater than 1; The correction unit is configured to perform data correction processing on the erroneous data of the N time periods respectively through N processing threads at the same time. 10. The device according to claim 9, wherein the first data information is a target time period; The device also includes: A judging module, configured to query whether the target time period is within the N time periods; A matching result determining module, configured to determine that there is second data information matching the first data information in the filtering control table if at least part of the time periods in the target time period are within the N time periods, The second data information includes: a first time period that coincides with the target time period among the N time periods. 11. The device according to claim 10, wherein the first time period is a part of the time period in which the target time period is within the N time periods, and the correction data includes the cache table The business data in the first time period; The device also includes: A second acquiring module, configured to acquire business data in the production table within the second time period, wherein the second time period is the target time period other than the first time period period; The generating module is specifically used for: Combining the correction data and the service data within the second time period to form feedback data for sending to the user terminal. 12. The device according to claim 7, further comprising: When it is found that there is no data information in the filter control table, or that there is no data information matching the first data information in the filter control table, compare the production table with the first data information The service data corresponding to the data information is used as the feedback data. 13. A device for determining data, characterized in that it comprises: at least one processor, at least one memory, and computer program instructions stored in the memory, when the computer program instructions are executed by the processor, it can realize the The method described in any one of claims 1-6. 14. A computer-readable storage medium, on which computer program instructions are stored, wherein the method according to any one of claims 1-6 is implemented when the computer program instructions are executed by a processor.

Images