CN110704523A - Data export method, device, equipment and computer readable storage medium - Google Patents

Data export method, device, equipment and computer readable storage medium Download PDF

Info

Publication number
CN110704523A
CN110704523A CN201910842023.XA CN201910842023A CN110704523A CN 110704523 A CN110704523 A CN 110704523A CN 201910842023 A CN201910842023 A CN 201910842023A CN 110704523 A CN110704523 A CN 110704523A
Authority
CN
China
Prior art keywords
data
time point
basic data
basic
export
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910842023.XA
Other languages
Chinese (zh)
Other versions
CN110704523B (en
Inventor
陈思明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Property and Casualty Insurance Company of China Ltd
Original Assignee
Ping An Property and Casualty Insurance Company of China Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Property and Casualty Insurance Company of China Ltd filed Critical Ping An Property and Casualty Insurance Company of China Ltd
Priority to CN201910842023.XA priority Critical patent/CN110704523B/en
Publication of CN110704523A publication Critical patent/CN110704523A/en
Application granted granted Critical
Publication of CN110704523B publication Critical patent/CN110704523B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/254Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2282Tablespace storage structures; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/242Query formulation
    • G06F16/2425Iterative querying; Query formulation based on the results of a preceding query

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a data export method, which comprises the following steps: according to a data export request aiming at a basic data table in the data export equipment, a ready pre-stored result table in the data export equipment is obtained; according to the data export request, acquiring first unprocessed data from the basic data table, and preprocessing the first unprocessed data to obtain temporary incremental data; and determining data to be exported according to the data export request, the prestored result table and the temporary incremental data, and exporting the data to be exported. The invention also discloses a data export device, equipment and a computer readable storage medium. The invention reduces most of the time for preprocessing the basic data and improves the data exporting speed.

Description

Data export method, device, equipment and computer readable storage medium
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a data exporting method, apparatus, device, and computer readable storage medium.
Background
Currently, the common way to export report data is: when the data size is not large, the export time for directly exporting the report data by calling the POI (Point of Interest) interface by adopting the sql statement is shorter, but as the export data size is increased, the export time of the report data is increased, so that the export rate of the report data is reduced.
Disclosure of Invention
The invention mainly aims to provide a data export method, a device, equipment and a computer readable storage medium, aiming at solving the technical problem of reduced data export rate caused by the increase of export data.
In order to achieve the above object, the present invention provides a data export method, including the steps of:
according to a data export request aiming at a basic data table in the data export equipment, a ready pre-stored result table in the data export equipment is obtained;
according to the data export request, acquiring first unprocessed data from the basic data table, and preprocessing the first unprocessed data to obtain temporary incremental data;
and determining data to be exported according to the data export request, the prestored result table and the temporary incremental data, and exporting the data to be exported.
In addition, to achieve the above object, the present invention provides a data derivation apparatus, including:
the result table acquisition module is used for acquiring a ready pre-stored result table in the data export equipment according to a data export request aiming at a basic data table in the data export equipment;
the data processing module is used for acquiring first unprocessed data from the basic data table according to the data export request and preprocessing the first unprocessed data to obtain temporary incremental data;
and the data export module is used for determining data to be exported according to the data export request, the prestored result table and the temporary incremental data and exporting the data to be exported.
Furthermore, to achieve the above object, the present invention also provides a data exporting apparatus, which includes a processor, a memory, and a data exporting program stored on the memory and executable by the processor, wherein the data exporting program, when executed by the processor, implements the steps of the data exporting method as described above.
In addition, to achieve the above object, the present invention further provides a computer readable storage medium having a data derivation program stored thereon, wherein the data derivation program, when executed by a processor, implements the steps of the data derivation method as described above.
According to the invention, before a data export request of a basic data table of the data export equipment is not received, the basic data in the basic data table is preprocessed to obtain historical result data, and the pre-stored result table is updated according to the historical result data. After a data export request of a basic data table of data export equipment is detected, preprocessing first unprocessed data of the basic data table to obtain temporary incremental data; and finally, historical result data and temporary incremental data are directly acquired from a prestored result table and are summarized and exported, so that basic data needing to be processed is reduced when the data are exported, most of time for preprocessing the basic data is reduced, and the data exporting speed is improved.
Drawings
FIG. 1 is a schematic flow chart of a data export method according to a first embodiment of the present invention;
FIG. 2 is a flowchart illustrating a data deriving method according to a second embodiment of the present invention;
FIG. 3 is a flowchart illustrating a data deriving method according to a third embodiment of the present invention;
FIG. 4 is a functional block diagram of a data export apparatus according to a first embodiment of the present invention;
fig. 5 is a schematic hardware configuration diagram of a data export device according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The invention provides a data export method, and referring to fig. 1, fig. 1 is a schematic flow chart of a first embodiment of the data export method of the invention.
While a logical order is shown in the flow chart, in some cases, the steps shown or described may be performed in an order different than presented herein.
The data export method is applied to a data export device, a server or a terminal, and the terminal can comprise a mobile phone. Mobile terminals such as tablet computers, notebook computers, palmtop computers, Personal Digital Assistants (PDAs), and fixed terminals such as Digital TVs, desktop computers, and the like. In the embodiments of the data export method, for convenience of description, the data export apparatus is taken as an execution subject to explain the embodiments. In a first embodiment of the data derivation method of the present invention, the data derivation method includes:
step S10, according to the data export request of the basic data table in the data export device, obtaining the ready pre-stored result table in the data export device;
when data is exported in the prior art, for example, when report data is exported, after a data export request is received, firstly, data export equipment needs to preprocess basic data to obtain result data; then, summarizing result data according to the data export request to obtain data to be exported; and finally, exporting the data to be exported. Since it takes a certain time to preprocess the basic data, the time to derive the data increases as the amount of data to be derived increases. Therefore, as the amount of data that needs to be exported increases, the data export rate will decrease.
The method aims to solve the problem that the data export rate is reduced as the data quantity needing to be exported is increased. The embodiment of the invention mainly preprocesses the basic data in the data exporting equipment in advance, and stores the result data obtained after preprocessing the basic data into a prestored result table of the data exporting equipment. So that most of the time for preprocessing the underlying data can be saved when the data needs to be exported. Specifically, after a certain time interval, preprocessing basic data which are newly generated in the data export equipment and are not preprocessed in the time interval to obtain historical result data, and updating a pre-stored result table according to the historical result data. In the pre-stored result table, data is recorded mainly according to specific derivation requirements. For example, the data that users often need to export are: the total number of cases up to now and the number of cases per month in the basic data; then, after the data exporting device automatically preprocesses the basic data which is newly generated and not preprocessed in the data exporting device in the interval time interval each time at the preset time, the following results are obtained: the total number of cases in the interval time interval and the number of cases in each month in the interval time interval, and then updating the result data table according to the obtained data (namely, the total number of cases recorded in the pre-stored result table is updated to be the total number of cases in the interval time interval plus the total number of cases recorded in the pre-stored result table, and the total number of cases in each month recorded in the pre-stored result table is updated to be the total number of cases in each month in the interval time interval plus the total number of cases recorded in the corresponding month in the pre-stored result table).
The historical result data refers to data obtained after preprocessing basic data which are newly generated in data exporting equipment and are not preprocessed in the interval time interval at certain time intervals when a data exporting request is not received. And updating the result table according to the historical result data after preprocessing basic data which is newly generated in the data export equipment and is not preprocessed in the interval time interval every time or preprocessing the basic data which is not preprocessed in the data export equipment in the interval time interval to obtain the historical result data.
In the following description, the base data generated by the data export device may be data generated by the data export device or obtained by the data export device from a server or other terminals, or may be data generated by the data export device itself or obtained by the data export device from a server or other terminals. In a specific embodiment, the basic data includes information of the category, associated order, report number, generation time point, presence or absence of complaint, and the like of each case recorded by the data export device. The historical result data is as follows: counting according to the information of the type, the associated order, the report number and the like of each case to obtain the total number of cases, the total number of cases of each type, the number of cases generated in a certain time period (such as each month), the total number of complaints of cases of each type (specifically, data which needs to be counted is determined according to business requirements), and the like.
Specifically, after a data export request for the basic data table in the data export device is detected, a ready pre-stored result table in the data export device is obtained according to the data export request for the basic data table in the data export device. The pre-stored result table is a record table for recording historical result data obtained by preprocessing basic data.
The data export request can be an export request generated after a user inputs the data export request through a peripheral device of the data export device, or an export request sent by the server to the data export device.
Step S20, acquiring first unprocessed data from the basic data table according to the data export request, and preprocessing the first unprocessed data to obtain temporary incremental data;
in the embodiment of the invention, in order to avoid the need of spending a large amount of time to preprocess the basic data when the data needs to be exported, the basic data which is newly generated in the data exporting device and is not preprocessed in the interval time interval is preprocessed by a certain time interval. However, when a data export request is detected, there may be a portion of newly generated base data in the base data table of the data export device that is not pre-processed.
In order to ensure that the data export device can export the data required by the data export request completely according to the data export request, after the data export request is detected, the base data which is not preprocessed is obtained from the base data table of the data export device according to the data export request to be used as the first unprocessed data. And preprocessing the first unprocessed data to obtain temporary result data. The basic data table refers to a data table for recording basic data generated by the data deriving device, and the data table referred to herein is not limited to a table form as long as the purpose of recording the basic data can be achieved. The first unprocessed data refers to the basic data that is not preprocessed in the basic data generated by the data export device (i.e. recorded in the basic data table).
In one embodiment, when the data export request is detected, the base data that is not preprocessed in the base data of the base data table before the current time is obtained as the first unprocessed data. And preprocessing the first unprocessed data to obtain result data. Then, determining a time range where a generation time point of basic data needing to be exported is located according to the data export request; and selecting the time point closest to the current time point in the time range to be processed as a reference time point, and acquiring result data of which the generation time point of the basic data is before the reference time point from the obtained result data to obtain temporary result data.
One implementation mode is that after a data export request is detected, a time range where a generation time point of basic data needing to be exported is located is determined according to the data export request; and then selecting the time point closest to the current time point in the time range to be processed as a reference time point, acquiring the basic data which is before the reference time point and is not preprocessed at the generation time point from the basic data of the basic data table to be used as first unprocessed data, and preprocessing the first unprocessed data to obtain temporary incremental data. Therefore, when the basic data needing to be exported does not include the basic data generated in a certain time period before the current time point, the basic data generated in the certain time period before the current time point does not need to be preprocessed, and the basic data needing to be preprocessed after the data export request is received is reduced, so that the time for preprocessing the basic data is reduced, and the data export rate is improved.
The basic data which is preprocessed in the basic data table and is updated according to the result data obtained by preprocessing is corresponding to the mark, the unmarked basic data (or the basic data with other marks) is the basic data which is not preprocessed, and the situation that when the basic data needs to be preprocessed, which basic data is preprocessed and which basic data is not preprocessed cannot be identified is avoided, so that unnecessary work is caused by repeated preprocessing of the basic data, or some basic data is omitted and is not preprocessed.
The temporary result data refers to result data obtained by acquiring non-preprocessed basic data from the basic data table according to the data export request after receiving the data export request and preprocessing the non-preprocessed basic data in the basic data table. The historical result data is different from the temporary result data in that the historical result data is: before the data export equipment receives the data export request, preprocessing basic data which is not preprocessed in the basic data table to obtain result data; the temporary result data is: and after the data export equipment receives the data export request, preprocessing the base data which are not preprocessed in the base data table according to the data export request to obtain result data.
Further, in order to avoid that the data export device preprocesses the same basic data for multiple times, after the data export request is detected, the pre-stored result table is updated according to the temporary result data obtained after preprocessing the first unprocessed data, so that the preprocessed first unprocessed data does not need to be preprocessed again.
And step S30, determining data to be exported according to the data export request, the prestored result table and the temporary incremental data, and exporting the data to be exported.
The data export device determines the conditions which the data to be exported should meet according to the data export request, including the requirements of the data to be exported on time, and then exports the data which meets the conditions. Specifically, according to the data export request, a target generation time interval of basic data needing to be exported is determined, and the following data are searched from a prestored result table: and target result data of which the generation time point of the corresponding basic data is in the target generation time interval. And summarizing the target result data and the temporary incremental data to obtain data to be exported, and exporting the data to be exported.
The target generation time interval refers to a time interval which is determined according to the data export request and to which the generation time point of the basic data to be exported should be in accordance. For example, according to the data export request, the target generation time interval of the basic data to be exported is determined as follows: from 1/2001 to 2/3/2001, the basic data whose generation time points are in the interval from 1/2001 to 2/3/2001 are preprocessed and summarized before being exported.
For ease of understanding, the description is continued following the example in step S10. For example, historical result data includes: the total number of cases, the total number of cases of each category, the number of cases generated in a certain time period, the total number of complaints of cases of each category (specifically, data to be counted is determined according to business requirements), and the like. The temporary incremental data also includes: the total number of cases, the total number of cases of each category, the number of cases generated in a certain time period, the total number of complaints of cases of each category (specifically, data to be counted is determined according to business requirements), and the like. The summary of the historical result data and the temporary incremental data is mainly as follows: and adding the total number of the cases in the historical result data to the total number of the cases in the temporary incremental data to obtain the total number of the cases. And adding the number of each type of case in the historical result data to the number of each type of case in the corresponding temporary incremental data to obtain the total number of each type of case. And calculating the average daily case number of each type of case (including the average daily case number of each type of case in a year, the average daily case number of each type of case in a month, the average daily case number of each type of case in a week, the average daily case number of each type of case in the year to the present, etc.), the average daily case number of all cases (including the average daily case number of each type of case in a year, the average daily case number of each type of case in a month, the average daily case number of each type of case in a week, the average daily case number of each type of case in the year to the present, etc.), the average weekly case number of each type of case (including the average weekly case number of each type of case in a year, the average weekly case number of each type of case in a month), etc., and calculating and summarizing specific business requirements.
In this embodiment, before a data export request of a basic data table of the data export device is not received, the basic data in the basic data table is preprocessed to obtain historical result data, and the pre-stored result table is updated according to the historical result data. After a data export request of a basic data table of data export equipment is detected, preprocessing first unprocessed data of the basic data table to obtain temporary incremental data; and finally, historical result data and temporary incremental data are directly acquired from a prestored result table and are summarized and exported, so that basic data needing to be processed is reduced when the data are exported, most of time for preprocessing the basic data is reduced, and the data exporting speed is improved.
Further, referring to fig. 2, fig. 2 is a flowchart illustrating a data exporting method according to a second embodiment of the present invention. Based on the first embodiment, a second embodiment of the data export method of the present invention is provided, where the step of determining data to be exported according to the data export request, the prestored result table, and the temporary incremental data includes:
step S31, determining a target generation time interval of basic data to be exported according to the data export request;
the data export device determines the conditions which the data to be exported should meet according to the data export request, including the requirements of the data to be exported on time, and then exports the data which meets the conditions. Specifically, according to the data export request, a target generation time interval of the basic data to be exported is determined.
The target generation time interval refers to a time interval which is determined according to the data export request and to which the generation time point of the basic data to be exported should be in accordance.
Step S32, acquiring initial basic data of the target generation time interval at the generation time point;
specifically, basic data at a generation time point within the target generation time interval is acquired from the basic data table as initial basic data.
Step S33, obtaining target result data corresponding to the initial basic data from the pre-stored result table;
specifically, the following are found from the table of prestored results: and the result data corresponding to the initial basic data is used as the target result data. It should be noted that, if the initial basic data is obtained from the basic data table, and the basic data of the basic data table is updated in real time, the initial basic data does not have corresponding result data in the pre-stored result table, so that the result data is searched in the pre-stored result table only by searching the corresponding result data in the pre-stored result table. The target result data refers to result data corresponding to the initial basic data, which is acquired from a prestored result table. The target result data differs from the temporary incremental data in that: the target result data is obtained from a pre-stored result table, and the result is obtained after the basic data is pre-processed in advance; and after the temporary incremental data receives the data export request, processing the basic data which is not preprocessed in the basic data table according to the data export request to obtain a result.
For ease of understanding, the following description is given in terms of a specific embodiment. For example, the pre-stored result table records data as:
the total number of cases was 5, the number of cases with complaints was 3, and the number of cases without complaints was 2 at 31.4.2001.
Month 1 to the present in 2001 (month 4 and 31 in 2001): the average total number of cases per month is 5/4;
month 1 in 2001: the total number of cases is 2, the number of cases with complaints is 1, and the number of cases without complaints is 1;
month 2 in 2001: the total number of cases was 2, the number of cases with complaints was 2, the number of cases without complaints was 0,
month 3 in 2001: the total number of cases is 0, the number of cases with complaints is 0, and the number of cases without complaints is 0;
month 4 in 2001: the total number of cases was 1, the number of cases with complaints was 0, and the number of cases without complaints was 0.
If the data needing to be exported is determined to be:
total number of cases on average monthly from 1 month 2001 to the present (5 months and 31 days 2001);
total number of cases from 1 month 2001 to the present (31/5 month 2001);
total number of cases per month from 1 month 2001 to the present (31/5/2001);
total number of cases complained each month from 1 month 2001 to the present (31/5 month 2001);
total number of cases that were not complaint every month from 1 month 2001 to the present (31/5 month 2001).
Then, the target result data finally obtained from the pre-stored result table is:
month 1 in 2001: the total number of cases is 2, the number of cases with complaints is 1, and the number of cases without complaints is 1;
month 2 in 2001: the total number of cases was 2, the number of cases with complaints was 2, the number of cases without complaints was 0,
month 3 in 2001: the total number of cases is 0, the number of cases with complaints is 0, and the number of cases without complaints is 0;
month 4 in 2001: the total number of cases was 1, the number of cases with complaints was 0, and the number of cases without complaints was 1.
And step S34, summarizing the target result data and the temporary incremental data to obtain data to be exported.
And finally, summarizing the target result data and the temporary incremental data to obtain data to be exported. For convenience of understanding, the description is continued in the example of the above step S32, and for example, the temporary incremental data is:
month 5 in 2001: the total number of cases was 6, the number of cases with complaints was 5, and the number of cases without complaints was 1.
Summarizing the target result data and the temporary incremental data, wherein the obtained data to be exported is as follows:
the total number of cases from 1 month 2001 to the present (31/5 month 2001) is: 2+2+0+1+6 ═ 10
The average monthly total number of cases from 1 month 2001 to the present (5 months and 31 days 2001) is: (2+2+0+1+6) ÷ 5 ═ 2;
month 1 in 2001: the total number of cases is 2, the number of cases with complaints is 1, and the number of cases without complaints is 1;
month 2 in 2001: the total number of cases was 2, the number of cases with complaints was 2, the number of cases without complaints was 0,
month 3 in 2001: the total number of cases is 0, the number of cases with complaints is 0, and the number of cases without complaints is 0;
month 4 in 2001: the total number of cases is 1, the number of cases with complaints is 0, and the number of cases without complaints is 1;
month 5 in 2001: the total number of cases was 6, the number of cases with complaints was 5, and the number of cases without complaints was 1.
In this embodiment, a target generation time interval of basic data to be exported is determined according to the data export request, target result data of a corresponding basic data generation time point in the target generation time interval is acquired from a prestored result table according to the target generation time interval, and finally the target result data and the incremental data are summarized to obtain the data to be exported, so that the data export device can completely acquire the data meeting the export requirement.
Further, referring to fig. 3, fig. 3 is a flowchart illustrating a data exporting method according to a third embodiment of the present invention. Based on the first embodiment, a third embodiment of the data deriving method of the present invention is proposed, where step S10 is preceded by:
step S40, when the current time point is detected to be a preset appointed time point, acquiring second unprocessed data from the basic data table;
in this embodiment, after a certain time interval, preprocessing basic data that is newly generated in the data export device and is not preprocessed in the time interval; and after preprocessing is carried out on the basic data which is newly generated and not preprocessed in the data export equipment in the interval time interval, the obtained historical result data updates a prestored result table.
Specifically, one embodiment is to set a time point as a specified reference time point, set a cycle period duration, and add a multiple of the cycle period duration to the specified reference time point as a specified time point for preprocessing the base data that is not preprocessed in the base data table. When the current time point is detected as: after the multiple of the cycle period length is added with the designated reference time point, the basic data which is not preprocessed is obtained from the basic data table to be used as second unprocessed data. Here, the specified time point is a time point corresponding to a time point obtained by adding a multiple of the cycle period duration to the specified reference time point, the time point being a time point at which the basic data not preprocessed in the basic data table is preprocessed.
The second unprocessed data refers to the basic data that is not preprocessed in the basic data generated by the data export device. The first unprocessed data and the second unprocessed data are different in that: the first unprocessed data is the basic data which is not preprocessed in the basic data of the data export device after the data export device receives the data export request. The second unprocessed data is the basic data which is not preprocessed in the basic data of the data exporting device after the current time point is detected to be the appointed time point.
Step S50, preprocessing the second unprocessed data to obtain historical result data;
specifically, according to specific requirements, after the second unprocessed data is obtained, the second unprocessed data is preprocessed to obtain historical result data. For example, in insurance business, each event records its corresponding processing content, including the business type, the existence of complaints, and the processing time. According to specific service requirements, report data is often required to be exported according to service types and complaints. Then, when the second unprocessed data is preprocessed, events with the same service type need to be grouped together, and the time with complaint and the time without complaint need to be classified. And according to specific business requirements, counting the number of each type of case and calculating the average daily case of each type of case.
For ease of understanding, the following description is given in terms of a specific embodiment. For example, all the basic data of the basic data table are: basic data 1, basic data 2, basic data 3, basic data 4, basic data 5, basic data 6, and basic data 7. Wherein:
basic data 1: the case generation time point is 2001, 1 month, 1 day, 11:00, and the case has complaints;
basic data 2: the case generation time point is 1 month, 31 days, 8:00 in 2001, and no case complaints exist;
basic data 3: the case generation time point is 2001, 2, 1, 16:00, and the case has complaints;
basic data 4: the case generation time point is 2001, 2, 3, 10:00, and the case has complaints;
basic data 5: the case generation time point is 2001, 4, 31, 13:00, and no case complaints exist;
basic data 6: the case generation time point is 2001, 5, 3, 15:00, and no case complaints exist;
basic data 7: the case generation time point is 2001, 5, 4, 21:00, and the case has complaints.
The purpose of preprocessing the basic data each time is to update the prestored result table, which needs to be recorded: the total number of cases, the number of cases with complaints, the number of cases without complaints before the current time point, and the average total number of cases from 1 month to the current month in 2001, the total number of cases per month, the number of cases with complaints per month, and the number of cases without complaints per month. After detecting that the current time point is a preset designated time point at 31/3/2001, the data exporting device automatically preprocesses basic data which is generated at 31/3/2001 and which is not preprocessed before (wherein, the basic data from 1/2001 to 31/3/2001 are not preprocessed), and the obtained historical result data is as follows:
the total number of cases at 31 d 3/2001 and before was 4, the number of cases with complaints was 4, and the number of cases without complaints was 1;
the average monthly total number of cases from 1 month 2001 to the present (31/3/2001) is 4/3;
the total number of cases in 1 month of 2001 was 2, the number of cases with complaints was 1, and the number of cases without complaints was 1;
the total number of cases in month 2 of 2001 was 2, the number of cases with complaints was 2, and the number of cases without complaints was 0,
the total number of cases in 3 months in 2001 was 0, the number of cases with complaints was 0, and the number of cases without complaints was 0.
After detecting that the current time point is a preset designated time point at 31/4/2001, the data exporting device automatically preprocesses basic data which is generated at 31/4/2001 and which is not preprocessed before (i.e. basic data which is not preprocessed at 31/3/2001 to 31/4/2001), and the obtained historical result data is as follows:
the total number of cases in month 4 of 2001 was 1, the number of cases with complaints was 1, and the number of cases without complaints was 0.
And step S60, updating the pre-stored result table of the data export device according to the historical result data.
And storing the historical result data into a preset prestored result table in the data exporting device, and updating the prestored result table of the data exporting device according to the historical result data. Specifically, in one embodiment, after the historical result data is obtained, the historical result data is stored in a pre-stored result table in a partition manner according to the generation time point of the basic data corresponding to the historical result data. In one embodiment, after obtaining the historical result data, the historical result data is stored in a pre-stored result table in a partition manner according to the classification standard of the historical result data, such as the type of the historical result data.
For ease of understanding, the description is continued following the example of step S50 above. For example, according to the historical result data, after the data of the pre-stored result table is updated, the recorded data of the pre-stored result table is as follows:
31 d 4/2001 and before: the total number of cases is 5, the number of cases with complaints is 3, and the number of cases without complaints is 2;
the average total number of cases per month from 1 month 2001 to the present (31/4/2001) is (2+2+0+1) ÷ 4 ═ 5/4;
month 1 in 2001: the total number of cases is 2, the number of cases with complaints is 1, and the number of cases without complaints is 1;
month 2 in 2001: the total number of cases was 2, the number of cases with complaints was 2, the number of cases without complaints was 0,
month 3 in 2001: the total number of cases is 0, the number of cases with complaints is 0, and the number of cases without complaints is 0;
month 4 in 2001: the total number of cases was 1, the number of cases with complaints was 1, and the number of cases without complaints was 0.
In this embodiment, the basic data in the basic data table is preprocessed in advance, and the pre-stored result table is updated according to the historical result data obtained by preprocessing the basic data, so that when a data export instruction is received, the preprocessed target result data can be directly obtained from the pre-stored result table, and the data is simply summarized with the temporary incremental data to be exported. The problem that when data needs to be exported, the data exporting time is prolonged due to the fact that basic data need to be preprocessed is avoided, and the problem that the data exporting speed is reduced due to the fact that the data quantity needing to be exported is increased is solved.
Further, step S40 includes:
step a, when detecting that the current time point is a preset designated time point, acquiring a target time point with preset duration before the current time point;
in order to make the basic data available for preprocessing in time, in the embodiment of the present invention, the basic data of the basic data table is preprocessed periodically. In order to enable the basic data of which the generation time point is in each processing period to be completely preprocessed, when the current time point is detected to be a preset designated time point, a target time point which is a preset time length before the current time point is obtained.
The preset duration refers to a period duration for preprocessing basic data of the basic data table. The preset duration can be set according to specific requirements, and the value of the preset duration is not limited in the embodiment of the invention. The designated time point is the time point for preprocessing the basic data of the basic data table according to the cycle duration for preprocessing the basic data of the basic data table. The target time point refers to an acquisition time when the data deriving device has acquired the second unprocessed data from the basic data table last time, or a generation time point of the basic data generated earliest in the basic data table (if no record of the second unprocessed data is acquired).
Step b, acquiring a first generation time point of basic data of the basic data table;
for ease of understanding, the following description is given in terms of a specific embodiment. For example, in the base data table:
basic data 1 (pre-processed): the generation time point is 1 month, 1 day and 10: 00;
basic data 2 (pre-processed): the generation time point is 1 month, 1 day and 12: 00;
base 3 (no pre-processing): the generation time point is 1 month, 2 days and 12: 00;
basic data 4 (not pre-processed): the generation time point was 1 month, 3 days, 13: 00.
The generation time points corresponding to the basic data 1, the basic data 2, the basic data 3 and the basic data 4 are obtained.
The first generation time point refers to a generation time point of basic data in the basic data table acquired after the current time point is detected to be a preset specified time point.
And c, finding out basic data of the first generation time point in the time interval of the target time point and the current time point from the basic data table to serve as the second unprocessed data.
For ease of understanding, the description continues with the example of step b above. For example, the target time point is 1 month, 1 day, 23:00, and the current time point is: 1 month, 4 days 12:00, finding out the basic data of the first generation time point in the time interval of the target time point and the current time point from the basic data table as follows: basic data 3, basic data 4. And the basic data 3 and the basic data 4 are regarded as second unprocessed data.
In this embodiment, after detecting that the current time point is a preset designated time point, obtaining a target time point corresponding to a preset duration before the current time point, obtaining a first generation time point of basic data of a basic data table, and finding out the basic data of the first generation time point in a time interval between the target time point and the current time point from the basic data table to serve as second unprocessed data; therefore, the basic data generated in each processing period can be periodically preprocessed, and the processing period can be increased or decreased according to the data amount so as to reduce the basic data needing preprocessing in each processing period.
Further, based on the third embodiment, a fourth embodiment of the data deriving method of the present invention is proposed, where step S40 is preceded by:
step d, obtaining the working low peak time interval of the data exporting equipment;
the working low peak time interval refers to a time interval with the least data processing amount of the data deriving device in each time of a day.
In order to avoid that the data export device preprocesses the basic data of the basic data table at the time point when the data export device needs to process other data, so as to influence the processing progress of the other data, in the embodiment of the invention, the time interval with the least data processing amount is found out from each time by detecting the data processing amount of each time point of the data export device, and is used as the working low-peak time interval of the data export device. So as to further preprocess the basic data which is not preprocessed in the basic data table in the working low peak time interval.
Step e, acquiring a processing period of basic data of the basic data table according to the working low-peak time interval;
the processing period refers to a time difference between two adjacent times of obtaining second unprocessed data from the basic data table for preprocessing.
Specifically, the data amount of the basic data newly generated by the data exporting device is obtained, and when the data amount of the basic data newly generated by the data exporting device is large, the processing period of the basic data table is reduced; when the data amount of the basic data newly generated by the data export equipment is small, the processing period of the basic data table is increased. And adjusting the processing period according to the working low-peak time interval, so that the basic data which is not preprocessed in the basic data table is preprocessed into the working low-peak time interval, and the adjusted processing period is used as the processing period of the basic data in the basic data table.
And f, determining an appointed time point for preprocessing the basic data of the basic data table according to the processing period, and detecting whether the current time point is the appointed time point.
The designated time point refers to a time point at which the basic data of the basic data table is preprocessed.
Specifically, one embodiment is to acquire a time at which the second unprocessed data is acquired from the basic data table last time for preprocessing, add a time point acquired by a processing cycle to a time point at which the second unprocessed data is acquired from the basic data table last time from the current time point for preprocessing, and use the time point as a specified time point at which the basic data of the basic data table is preprocessed, and detect whether the current time point is the specified time point.
One embodiment is to acquire a time point at which second unprocessed data is acquired from the basic data table most recently from the current time point for preprocessing, acquire a generation time point of earliest generated basic data in the basic data table if no record of the second unprocessed data is acquired in the data deriving device, that is, no basic data in the basic data table is preprocessed, add the generation time point of earliest generated basic data in the basic data table to a processing cycle, as a specified time point at which the basic data in the basic data table is preprocessed, and detect whether the current time point is the specified time point.
In the embodiment, the time interval with the minimum data processing amount is found from each time by measuring the data processing amount of each time point of the data deriving device, and is used as the working low-peak time interval of the data deriving device; and determining the processing period of the basic data table according to the working low-peak time interval and the size of the basic data quantity which is not preprocessed. The data export device can preprocess the basic data which is not preprocessed in the basic data table in the working low-peak time interval, and the problem that the basic data of the basic data table is preprocessed by the data export device at the time point when other data needs to be processed, so that the processing progress of other data is influenced is avoided.
Further, based on the first embodiment described above, a fifth embodiment of the data deriving method of the present invention is proposed, wherein the step of obtaining the first unprocessed data from the basic data table includes:
step g, obtaining the obtaining time point of the second unprocessed data obtained from the basic data table at the latest time from the current time point;
the acquisition time point refers to a time when the second unprocessed data is acquired from the basic data table for preprocessing the latest time from the current time point, or a generation time point of the basic data generated earliest in the basic data table (if the record of the second unprocessed data is not acquired in the data deriving device).
Specifically, one embodiment is to acquire an acquisition time point at which second unprocessed data is acquired from the basic data table for preprocessing the latest time from the current time point.
In one embodiment, the time of the second unprocessed data from the basic data table which is the latest time from the current time point is acquired for preprocessing, and if no record of the second unprocessed data is acquired in the data export device, that is, no basic data in the basic data table is preprocessed, the generation time point of the earliest generated basic data in the basic data table is acquired.
Step h, acquiring a second generation time point of the basic data table;
for ease of understanding, the following description is given in terms of a specific embodiment. For example, in the base data table:
basic data a (pre-processed): the generation time point is 2 months, 1 day and 10: 00;
basic data B (pre-processed): the generation time point is 2 months, 1 day, 12: 00;
base data C (not pre-processed): the generation time point is 2 months, 2 days and 12: 00;
base data D (not pre-processed): the generation time point was 2 months, 3 days, 13: 00.
And acquiring the generation time points corresponding to the basic data A, the basic data B, the basic data C and the basic data D respectively.
The second generation time point is a generation time point of the basic data in the basic data table acquired after the data export instruction is detected. The first generation time point and the second generation time point are both generation time points of the basic data table, and since the basic data of the basic data table is continuously updated, the difference between the two is that: the first generation time point is the generation time point of the basic data in the obtained basic data table after the current time point is detected to be the preset specified time point. The generation time point is the generation time point of the basic data in the basic data table acquired after the data export instruction is detected.
Step i, finding out the basic data of the second generation time point in the time interval between the acquisition time point and the current time point from the basic data table to be used as the first unprocessed data.
Specifically, after an acquisition time point at which second unprocessed data is acquired from the basic data table for preprocessing the latest time from the current time point is acquired, basic data at the second generation time point in a time interval between the acquisition time point and the current time point is searched from the basic data table to be used as the first unprocessed data.
One embodiment is to obtain the time of obtaining the second unprocessed data from the basic data table for preprocessing the latest time from the current time point, and if no record of the second unprocessed data is obtained in the data export device, that is, no basic data in the basic data table is preprocessed, after obtaining the generation time point of the basic data generated earliest in the basic data table, find out from the basic data table: the second generation time point is the basic data in the time interval between the generation time point of the basic data generated earliest and the current time point as the first unprocessed data.
In this embodiment, the basic data of the second generation time point in the time interval between the acquisition time point and the current time point is found from the basic data table to be used as the first unprocessed data, so that the first unprocessed data is accurately and completely acquired for preprocessing, and the required data can be completely derived.
Further, based on the first embodiment, the second embodiment, the third embodiment, the fourth embodiment, or the fifth embodiment, a flow embodiment of the data derivation method of the present invention is provided, where the data derivation method further includes:
step j, when detecting that the data export equipment generates target basic data, acquiring the target basic data;
the target basic data refers to data generated by the data exporting device or data acquired by the data exporting device from a server or other terminals.
In order to enable the data exporting device to export the required data completely, in the embodiment of the invention, the basic data generated in the data exporting device are all recorded into the basic data table in a unified way. Specifically, when it is detected that the data deriving device newly generates the basic data, the acquisition data deriving device newly generates the basic data as the target basic data.
Step k, acquiring a third generation time point of the target basic data;
the third generation time point is a generation time point of the data export device newly generated basic data, which is acquired after the data export device is detected to newly generate the basic data. The third generation time point differs from the first generation time point and the second generation time point in that: the third generation time point refers to a generation time at which the target basic data is newly generated by the data deriving device, and the first generation time point and the second generation time point both refer to generation time points of all the basic data in the basic data table.
For ease of understanding, the following description is given in terms of a specific embodiment. For example, upon detecting that the data deriving device newly generates the basic data 1, the generation time point of the basic data 1 is acquired: 2 month, 1 day, 12: 00. Upon detecting that the data exporting apparatus newly generates the basic data 2, the generation time point of the basic data 3 is acquired: 2 months, 1 day, 16: 00. Upon detecting that the data exporting apparatus newly generates the basic data 3, acquiring a generation time point of the basic data 3: 3 months, 5 days, 16: 00. Upon detecting that the data exporting apparatus newly generates the basic data 4, acquiring a generation time point of the basic data 4: 3 months, 5 days, 17: 00. Upon detecting that the data exporting apparatus newly generates the basic data 5, the generation time point of the basic data 5 is acquired: 3 months, 6 days 17: 00.
And step l, recording the target basic data into the basic data table in a partitioning manner according to the third generation time point.
Specifically, the target basic data with the same or similar third generation time point is recorded to the same partition of the basic data table, so that only a certain partition of the basic data table can be queried according to the generation time point when the first unprocessed data or the second unprocessed data is searched in the basic data table subsequently, and the time for preprocessing the basic data is further reduced, so that the data export rate is improved. And recording the target basic data to the basic data table according to the third generation time point and time sequence. For ease of understanding, the description continues with the example of step k above. For example:
and recording the target basic data with the same day as the third generation time point to the same partition of the basic data table, namely recording the basic data 1 and the basic data 2 to the partition A of the basic data table, recording the basic data 3 and the basic data 4 to the partition B of the basic data table, and recording the basic data 5 to the partition C of the basic data table. And sequencing the partition A, the partition B and the partition C in the basic data table in sequence according to the sequence of the third generation time point.
In this embodiment, the target basic data is recorded into the basic data table in a partitioned manner according to the third generation time point, so that when the first unprocessed data or the second unprocessed data is subsequently searched in the basic data table, only a certain partition of the basic data table can be queried according to the third generation time point, and the whole basic data table does not need to be queried, thereby reducing the time for preprocessing the basic data and improving the data export rate.
Furthermore, the pre-stored result table also records the data of the pre-stored result table in a partitioning manner according to the generation time point of the basic data, so that the required data can be searched more quickly and summarized.
Furthermore, the sql statement adopted when the data is exported is optimized to improve the execution speed of the sql statement, so that the export speed of the data is improved. For example, the sql statement of the large table associated with the small table is changed into the sql statement of the small table associated with the large table, so that the query cardinality is changed from large to small, and the execution speed of sql is improved. For another example, the field index is adopted in the sql statement, so that the data query speed is increased, and the data export rate is increased.
In addition, the invention also provides a data export device.
Referring to fig. 4, fig. 4 is a functional block diagram of a data exporting apparatus according to a first embodiment of the present invention.
In this embodiment, the data deriving device includes:
a result table obtaining module 10, configured to obtain a ready pre-stored result table in the data exporting apparatus according to a data exporting request for a basic data table in the data exporting apparatus;
the data processing module 20 is configured to obtain first unprocessed data from the basic data table according to the data export request, and preprocess the first unprocessed data to obtain temporary incremental data;
and the data export module 30 is configured to determine data to be exported according to the data export request, the pre-stored result table, and the temporary incremental data, and export the data to be exported.
Further, the data export module 30 further includes:
the determining unit is used for determining a target generation time interval of basic data to be exported according to the data export request;
a first acquisition unit configured to acquire initial basic data of which a generation time point is in the target generation time interval;
a second obtaining unit, configured to obtain target result data corresponding to the initial basic data from the pre-stored result table
The summarizing unit is used for summarizing the target result data and the temporary incremental data to obtain data to be exported;
further, the data exporting apparatus further comprises:
the unprocessed data acquisition module is used for acquiring second unprocessed data from the basic data table after detecting that the current time point is a preset specified time point;
the historical result data determining module is used for preprocessing the second unprocessed data to obtain historical result data;
and the updating module is used for updating a prestored result table of the data export equipment according to the historical result data.
Further, the unprocessed data acquiring module further includes:
a target time point obtaining unit, configured to obtain a target time point with a preset duration before a current time point when it is detected that the current time point is a preset specified time later;
a first generation time point acquisition unit configured to acquire a first generation time point of basic data of the basic data table;
a second unprocessed data obtaining unit, configured to find out, from the basic data table, basic data in which the first generation time point is within a time interval between the target time point and the current time point, as the second unprocessed data.
Further, the unprocessed data acquiring module further includes:
a working low-peak time interval acquisition unit for acquiring a working low-peak time interval of the data derivation device;
a processing cycle acquiring unit, configured to acquire a processing cycle of basic data of the basic data table according to the work low peak time interval;
and the specified time point detection unit is used for determining a specified time point for preprocessing the basic data of the basic data table according to the processing period and detecting whether the current time point is the specified time point.
Further, the data processing module further includes:
an acquisition time point determining unit configured to acquire an acquisition time point at which the second unprocessed data is acquired from the basic data table most recently from a current time point;
a second generation time point acquisition unit configured to acquire a second generation time point of the basic data table;
a first unprocessed data obtaining unit, configured to find out, from the basic data table, basic data in which the second generation time point is within a time interval between the obtaining time point and a current time point, as the first unprocessed data.
Further, the data exporting apparatus further comprises:
the target basic data acquisition module is used for acquiring the target basic data after detecting that the data export equipment generates the target basic data;
a third generation time point obtaining module, configured to obtain a third generation time point of the target basic data;
and the recording module is used for recording the target basic data into the basic data table in a partitioning manner according to the third generation time point.
The embodiments of the data exporting apparatus are substantially the same as the embodiments of the data exporting method, and are not described in detail herein.
In addition, the invention also provides data export equipment. As shown in fig. 5, fig. 5 is a schematic structural diagram of a hardware operating environment of a data exporting apparatus according to an embodiment of the present invention.
It should be noted that fig. 5 is a schematic structural diagram of a hardware operating environment of the data export apparatus. The data exporting device of the embodiment of the invention can be a terminal device such as a PC, a portable computer and the like.
As shown in fig. 5, the data export device may include a processor 1001 (e.g., CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used for realizing connection communication among the components; the user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard); the network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface); the memory 1005 may be a high-speed RAM memory, or may be a non-volatile memory (e.g., a magnetic disk memory), and optionally, the memory 1005 may be a storage device independent of the processor 1001.
Optionally, the data deriving device may further include a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WiFi module, and the like.
Those skilled in the art will appreciate that the hardware configuration of the data export device shown in fig. 5 does not constitute a limitation of the data export device and may include more or less components than those shown, or some components may be combined, or a different arrangement of components.
With continued reference to fig. 5, the memory 1005 of fig. 5, which is one type of computer-readable storage medium, may include an operating system, a network communication module, and a data derivation program.
In fig. 5, the network communication module is mainly used for connecting to the database and performing data communication with the database; and the processor 1001 may call the data export program stored in the memory 1005 and perform the steps of the data export method as described above.
The specific implementation of the data deriving device of the present invention is basically the same as that of the above data deriving method, and is not described herein again.
Furthermore, the present invention also provides a computer readable storage medium having stored thereon a data derivation program, which when executed by a processor implements the steps of the data derivation method as described above.
The specific implementation of the computer-readable storage medium of the present invention is substantially the same as the embodiments of the data deriving method, and is not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (10)

1. A data derivation method applied to a data derivation apparatus, the data derivation method comprising the steps of:
according to a data export request aiming at a basic data table in the data export equipment, a ready pre-stored result table in the data export equipment is obtained;
according to the data export request, acquiring first unprocessed data from the basic data table, and preprocessing the first unprocessed data to obtain temporary incremental data;
and determining data to be exported according to the data export request, the prestored result table and the temporary incremental data, and exporting the data to be exported.
2. The data derivation method according to claim 1, wherein the step of determining data to be derived from the data derivation request, the prestored result table, and the temporary incremental data comprises:
determining a target generation time interval of basic data to be exported according to the data export request;
acquiring initial basic data of a generation time point in the target generation time interval;
acquiring target result data corresponding to the initial basic data from the pre-stored result table;
and summarizing the target result data and the temporary incremental data to obtain data to be exported.
3. The data export method of claim 1, wherein the step of obtaining a ready pre-stored result table in the data export device in accordance with a data export request for a base data table in the data export device further comprises:
when the current time point is detected to be a preset designated time point, acquiring second unprocessed data from the basic data table;
preprocessing the second unprocessed data to obtain historical result data;
and updating a prestored result table of the data export equipment according to the historical result data.
4. The data export method of claim 3, wherein the step of obtaining second unprocessed data from the basic data table after detecting that the current time point is a preset specified time point comprises:
when the current time point is detected to be a preset designated time later point, acquiring a target time point with preset duration before the current time point;
acquiring a first generation time point of basic data of the basic data table;
and finding out basic data of the first generation time point in a time interval between the target time point and the current time point from the basic data table to serve as the second unprocessed data.
5. The data export method of claim 3, wherein the step of obtaining second unprocessed data from the basic data table after detecting that the current time point is a preset specified time point further comprises:
acquiring a working low-peak time interval of the data exporting equipment;
acquiring a processing period of basic data of the basic data table according to the working low-peak time interval;
and determining an appointed time point for preprocessing the basic data of the basic data table according to the processing period, and detecting whether the current time point is the appointed time point.
6. The data derivation method of claim 1, wherein the step of retrieving the first unprocessed data from the base data table comprises:
acquiring an acquisition time point of the second unprocessed data acquired from the basic data table at the latest time from the current time point;
acquiring a second generation time point of the basic data table;
and finding out basic data of the second generation time point in a time interval between the acquisition time point and the current time point from the basic data table to serve as the first unprocessed data.
7. A data derivation method as claimed in any one of claims 1 to 6, wherein the data derivation method further comprises:
when the data export equipment is detected to generate target basic data, acquiring the target basic data;
acquiring a third generation time point of the target basic data;
and partitioning and recording the target basic data to the basic data table according to the third generation time point.
8. A data derivation apparatus, characterized in that the data derivation apparatus comprises:
the result table acquisition module is used for acquiring a ready pre-stored result table in the data export equipment according to a data export request aiming at a basic data table in the data export equipment;
the data processing module is used for acquiring first unprocessed data from the basic data table according to the data export request and preprocessing the first unprocessed data to obtain temporary incremental data;
and the data export module is used for determining data to be exported according to the data export request, the prestored result table and the temporary incremental data and exporting the data to be exported.
9. A data derivation device, comprising a processor, a memory, and a data derivation program stored on the memory and executable by the processor, wherein the data derivation program, when executed by the processor, implements the steps of the data derivation method of any one of claims 1 to 7.
10. A computer-readable storage medium, having a data derivation program stored thereon, wherein the data derivation program, when executed by a processor, implements the steps of the data derivation method as claimed in any one of claims 1 to 7.
CN201910842023.XA 2019-09-06 2019-09-06 Data export method, device, equipment and computer readable storage medium Active CN110704523B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910842023.XA CN110704523B (en) 2019-09-06 2019-09-06 Data export method, device, equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910842023.XA CN110704523B (en) 2019-09-06 2019-09-06 Data export method, device, equipment and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN110704523A true CN110704523A (en) 2020-01-17
CN110704523B CN110704523B (en) 2023-08-11

Family

ID=69194700

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910842023.XA Active CN110704523B (en) 2019-09-06 2019-09-06 Data export method, device, equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN110704523B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022205938A1 (en) * 2021-03-30 2022-10-06 苏宁易购集团股份有限公司 Data acquisition method and apparatus, computer device, and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120066263A1 (en) * 2010-09-13 2012-03-15 Sybase, Inc. Incremental data transfer in a database management system
CN108228752A (en) * 2017-12-21 2018-06-29 中国联合网络通信集团有限公司 Data full dose deriving method, data distribution device and data export node
CN109062883A (en) * 2018-07-18 2018-12-21 平安科技(深圳)有限公司 Tables of data dynamic deriving method, device, computer equipment and storage medium
CN109213818A (en) * 2018-08-15 2019-01-15 平安科技(深圳)有限公司 Table deriving method, device, computer equipment and storage medium
CN109997125A (en) * 2016-09-15 2019-07-09 英国天然气控股有限公司 System for importing data to data storage bank

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120066263A1 (en) * 2010-09-13 2012-03-15 Sybase, Inc. Incremental data transfer in a database management system
CN109997125A (en) * 2016-09-15 2019-07-09 英国天然气控股有限公司 System for importing data to data storage bank
CN108228752A (en) * 2017-12-21 2018-06-29 中国联合网络通信集团有限公司 Data full dose deriving method, data distribution device and data export node
CN109062883A (en) * 2018-07-18 2018-12-21 平安科技(深圳)有限公司 Tables of data dynamic deriving method, device, computer equipment and storage medium
CN109213818A (en) * 2018-08-15 2019-01-15 平安科技(深圳)有限公司 Table deriving method, device, computer equipment and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022205938A1 (en) * 2021-03-30 2022-10-06 苏宁易购集团股份有限公司 Data acquisition method and apparatus, computer device, and storage medium

Also Published As

Publication number Publication date
CN110704523B (en) 2023-08-11

Similar Documents

Publication Publication Date Title
US9706348B2 (en) System and method for processing location data of target user
CN109992601B (en) To-do information pushing method and device and computer equipment
CN106991196B (en) Universal data tracing method and system
CN111339171B (en) Data query method, device and equipment
CN107798135B (en) Paging query method and device and electronic equipment
US20140067548A1 (en) Saving on device functionality for business calendar
CN109814971B (en) Desktop application icon arrangement method, electronic device and storage medium
CN110502545B (en) Data storage method, device, equipment and computer readable storage medium
CN111026775A (en) Method and device for determining correlation index, server and storage medium
CN111913954A (en) Intelligent data standard catalog generation method and device
CN109656592B (en) Card management method, device, terminal and computer readable storage medium
CN109471909B (en) Method, apparatus and computer readable storage medium for address location
CN110704523B (en) Data export method, device, equipment and computer readable storage medium
CN110134721A (en) Data statistical approach, device and electronic equipment based on bitmap
CN113129155A (en) Multi-type personnel information processing method, equipment and storage medium
US20140129950A1 (en) Recurring search automation with search event detection
CN108829844B (en) Information searching method and system
CN114036132A (en) Object information processing method and device, storage medium and electronic equipment
CN115168390A (en) Multi-dimensional asset retrieval analysis method, system, terminal and storage medium
AU2015204843A1 (en) Systems and methods for contextual caller identification
CN110515946B (en) Data extraction method, device, equipment and computer readable storage medium
CN114741594A (en) Information pushing method and device, computer equipment and storage medium
CN112052382A (en) Information recommendation method and related device
WO2020233093A1 (en) Association graph generation method and apparatus, computer device, and storage medium
CN115659406B (en) Data access method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant