CN113297222A - Report data acquisition method and device, electronic equipment and storage medium - Google Patents
Report data acquisition method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113297222A CN113297222A CN202110573193.XA CN202110573193A CN113297222A CN 113297222 A CN113297222 A CN 113297222A CN 202110573193 A CN202110573193 A CN 202110573193A CN 113297222 A CN113297222 A CN 113297222A
- Authority
- CN
- China
- Prior art keywords
- data
- report
- report data
- level cache
- identifier
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 230000008569 process Effects 0.000 claims abstract description 23
- 238000012545 processing Methods 0.000 claims description 27
- 238000004590 computer program Methods 0.000 claims description 9
- 238000010586 diagram Methods 0.000 description 13
- 238000004891 communication Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 230000001960 triggered effect Effects 0.000 description 6
- 235000010627 Phaseolus vulgaris Nutrition 0.000 description 4
- 244000046052 Phaseolus vulgaris Species 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000033772 system development Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24552—Database cache management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2474—Sequence data queries, e.g. querying versioned data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Probability & Statistics with Applications (AREA)
- Mathematical Physics (AREA)
- Fuzzy Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method and a device for acquiring report data, electronic equipment and a storage medium, and relates to the technical field of computers. One embodiment of the method comprises: receiving a report data query request sent by a terminal, and acquiring a report identifier in the query request; inquiring data generation time corresponding to the report data identification in the report data identification set based on the report identification, dividing the data generation time corresponding to the report data identification into a plurality of time intervals, and generating data requests corresponding to the time intervals by combining the corresponding report data identification; and issuing a plurality of data requests to the data cluster so that the data cluster processes the plurality of data requests based on a preset data request execution rule, and further receiving report data processed by the data cluster and returning the report data to the terminal. The method and the device can solve the problem that the data cluster runs slowly or is down due to the fact that the acquired data volume is too large when the report data are acquired, and therefore the system performance of the data cluster is reduced.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a method and a device for acquiring report data, electronic equipment and a storage medium.
Background
The large-piece warehousing system is a set of clustering system, and the warehousing data of each warehouse are respectively stored in a plurality of databases of different data clusters. In order to facilitate the generation of the report, the report data required in each report is acquired and stored from each data cluster by the major warehouse system, and the generated report can be obtained by inquiring from the major warehouse system. When the major warehouse system obtains report data from each data cluster, it usually sends a data request to the data cluster to obtain data generated by data indexes in the data request within a period of time. However, in a special period such as a big short, each data is increased faster, so if the report data amount obtained by the data request is too large, the data cluster is likely to have problems of slow operation or downtime due to too large data acquisition amount, and the system performance of the data cluster is reduced.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method and an apparatus for acquiring report data, an electronic device, and a storage medium, which can solve the problem that a data cluster runs slowly or is down due to an excessively large amount of acquired data when report data is acquired, so that system performance of the data cluster is reduced.
In order to achieve the above object, according to an aspect of the embodiments of the present invention, a method for acquiring report data is provided.
The method for acquiring the report data comprises the following steps: receiving a report data query request sent by a terminal, wherein the query request carries a report identifier; inquiring data generation time corresponding to the report data identification in a report data identification set based on the report identification, dividing the data generation time corresponding to the report data identification into a plurality of time intervals, and generating a data request corresponding to each time interval by combining the corresponding report data identification; and issuing the data request to a data cluster so that the data cluster processes the data request based on a preset data request execution rule, and further receiving report data processed by the data cluster and returning the report data to the terminal.
In one embodiment, further comprising:
inquiring the expiration time of the report data corresponding to the report identifier from a first-level cache to judge whether the report data corresponding to the report identifier in the first-level cache is expired;
under the condition that the data is not expired, acquiring report data corresponding to the report identification from the first-level cache so as to send the report data to the terminal;
and under the condition of data expiration, executing the steps of generating and issuing the data request, and inquiring expiration time of the report data corresponding to the report identifier from a second-level cache to judge whether the report data corresponding to the report identifier in the second-level cache is expired, if not, acquiring the report data corresponding to the report identifier from the second-level cache to send the report data to the terminal, and if so, returning the report data processed by the data cluster to the terminal, wherein the priority of the first-level cache is higher than that of the second-level cache.
In another embodiment, after receiving the report data processed by the data cluster, the method further includes:
and updating the report data corresponding to the report types in the first-level cache and the second-level cache based on the report data processed by the data cluster, and setting the expiration time of the updated report data in the first-level cache and the second-level cache.
In another embodiment, the setting the expiration time of the updated report data in the first-level cache and the second-level cache includes:
inquiring report updating time corresponding to the report identification to set the report updating time as the expiration time of the updated report data in the first-level cache;
and inquiring the preset expiration time of the report identifier corresponding to the second-level cache to set the expiration time of the updated report data in the second-level cache, wherein the preset expiration time of the report identifier corresponding to the second-level cache is greater than the report updating time.
In another embodiment, receiving report data processed by the data cluster and returning the report data to the terminal includes:
inquiring the summary column identification corresponding to the report identification, summarizing the report data processed by the data cluster based on the column data corresponding to the summary column identification, and sending the summarized report data to the terminal.
In another embodiment, the querying, based on the report identifier, the data generation time corresponding to the report data identifier in the report data identifier set includes:
under the condition that the target task lock is in a locked state, querying data generation time corresponding to the report data identification in the report data identification set fails;
and under the condition that the target task lock is in an unlocked state, inquiring data generation time corresponding to the report data identification in a report data identification set based on the report identification, and updating the state of the target task lock to be a locked state.
In order to achieve the above object, according to another aspect of the embodiments of the present invention, an apparatus for acquiring report data is provided.
The device for acquiring the report data in the embodiment of the invention comprises: the receiving unit is used for receiving a report data query request sent by a terminal and acquiring a report identifier in the query request;
the processing unit is used for inquiring data generation time corresponding to the report data identification in a report data identification set based on the report identification, dividing the data generation time corresponding to the report data identification into a plurality of time intervals, and generating a data request corresponding to each time interval by combining the corresponding report data identification; and issuing the data request to a data cluster so that the data cluster processes the data request based on a preset data request execution rule, and further receiving report data processed by the data cluster and returning the report data to the terminal.
In an embodiment, the processing unit is specifically configured to:
inquiring the expiration time of the report data corresponding to the report identifier from a first cache to judge whether the report data corresponding to the report identifier in the first-level cache is expired;
under the condition that the data is not expired, acquiring report data corresponding to the report identification from the first-level cache so as to send the report data to the terminal;
and under the condition of data expiration, executing the steps of generating and issuing the data request, and inquiring expiration time of the report data corresponding to the report identifier from a second-level cache to judge whether the report data corresponding to the report identifier in the second-level cache is expired, if not, acquiring the report data corresponding to the report identifier from the second-level cache to send the report data to the terminal, and if so, returning the report data processed by the data cluster to the terminal, wherein the priority of the first-level cache is higher than that of the second-level cache.
In yet another embodiment, the apparatus further comprises:
and the updating unit is used for updating the report data corresponding to the report types in the first-level cache and the second-level cache based on the report data processed by the data cluster, and setting the expiration time of the updated report data in the first-level cache and the second-level cache.
In another embodiment, the update unit is specifically configured to:
inquiring report updating time corresponding to the report identification to set the report updating time as the expiration time of the updated report data in the first-level cache;
and inquiring the preset expiration time of the report identifier corresponding to the second-level cache to set the expiration time of the updated report data in the second-level cache, wherein the preset expiration time of the report identifier corresponding to the second-level cache is greater than the report updating time.
In another embodiment, the processing unit is specifically configured to:
inquiring the summary column identification corresponding to the report identification, summarizing the report data processed by the data cluster based on the column data corresponding to the summary column identification, and sending the summarized report data to the terminal.
In another embodiment, the processing unit is specifically configured to:
under the condition that the target task lock is in a locked state, querying data generation time corresponding to the report data identification in the report data identification set fails;
and under the condition that the target task lock is in an unlocked state, inquiring data generation time corresponding to the report data identification in a report data identification set based on the report identification, and updating the state of the target task lock to be a locked state.
To achieve the above object, according to still another aspect of an embodiment of the present invention, there is provided an electronic apparatus.
An electronic device of an embodiment of the present invention includes: one or more processors; the storage device is used for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors realize the report data acquisition method provided by the embodiment of the invention.
To achieve the above object, according to still another aspect of an embodiment of the present invention, there is provided a computer-readable medium.
The computer readable medium of the embodiment of the present invention stores a computer program thereon, and the program, when executed by a processor, implements the method for acquiring report data according to the embodiment of the present invention.
One embodiment of the above invention has the following advantages or benefits: in the embodiment of the invention, after a report data query request sent by a terminal is received, the report identifier in the report data query request can be obtained, the data generation time corresponding to the report data identifier in the corresponding report data identifier set can be queried based on the report identifier, namely the generation time of the report data is to be obtained, then each data generation time can be divided into a plurality of time intervals, a data request is generated by combining the corresponding report data identifier in each time interval, and then the data request is issued to a data cluster, the data cluster can execute rule processing on the basis of a preset data request to process the data request issued to the data cluster, further the processed report data is returned, and the report data processed by the received data cluster can be returned to the terminal. In the embodiment of the invention, when the report data is acquired from the data cluster, the data generation time corresponding to each report data identifier can be divided into a plurality of time intervals, and the data request is generated based on the time intervals, because the data generation time is divided, the time interval included in each data request is smaller than the data generation time, that is, the report data amount acquired by the original one-time request is divided into a plurality of data requests to be acquired, after the data requests are issued to the data cluster, the data cluster can execute the rule processing on the basis of the preset data request to process the received data requests, each data request can execute the rule batch processing based on the data request, that is, the report data corresponding to the data generation time is not required to be processed once, but the rule is executed for multiple times based on the data request, so that the data amount of the data processed by the data cluster once is reduced, therefore, even in a special period such as a large promotion period, the data cluster can reduce the data volume of the report data processed at one time based on the data request execution rule, thereby avoiding slow operation or downtime and improving the system performance of the data cluster.
Further effects of the above-mentioned non-conventional alternatives will be described below in connection with the embodiments.
Drawings
The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:
FIG. 1 is a schematic diagram of a main flow of a report data obtaining method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a report data store according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating a system architecture of a report data acquisition system according to an embodiment of the present invention;
FIG. 4 is a schematic diagram illustrating another main flow of a report data obtaining method according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a main flow of a report data updating method according to an embodiment of the present invention;
fig. 6 is a schematic diagram of main units of a report data acquisition apparatus according to an embodiment of the present invention;
FIG. 7 is a diagram of yet another exemplary system architecture to which embodiments of the present invention may be applied;
FIG. 8 is a schematic block diagram of a computer system suitable for use in implementing embodiments of the present invention.
Detailed Description
Exemplary embodiments of the present invention are described below with reference to the accompanying drawings, in which various details of embodiments of the invention are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict.
The embodiment of the invention provides a method for acquiring report data, which can be executed by a server side, and as shown in figure 1, the method comprises the following steps:
s101: and receiving a report data query request sent by the terminal, and acquiring a report identifier in the query request.
The terminal can be a report generation device, and can generate a report by sending a report data query request to the server so as to query corresponding report data. The server side can be provided with a report data acquisition system, specifically can be a major warehouse system, and can be connected with each data cluster to acquire report data required by generating each report from the data cluster. The data cluster can comprise a plurality of data clusters, and each data cluster can be used for storing data corresponding to each report.
In this step, the server may receive a report data query request sent by the terminal, where the report data query request includes a report identifier for indicating which report data is the report data of the queried report, so that the report identifier may be obtained from the report data query request.
It should be noted that, in the embodiment of the present invention, the server may set a unified entry in communication with the terminal to receive the report data query request sent by the terminal, specifically, the unified entry may be jsf, and the configuration class may be implemented based on the type of the report, so that when data is newly accessed in the report, the data may not be separately configured, and the configuration efficiency is improved. The report identifier may be an identifier obtained by combining the report data identifier and the service parameter in the report data identifier set included in the corresponding report.
S102: and inquiring data generation time corresponding to the report data identifier in the report data identifier set based on the report identifier, dividing the data generation time corresponding to the report data identifier into a plurality of time intervals, and generating a data request corresponding to each time interval by combining the corresponding report data identifier.
The report data identifier represents a data identifier included in the query report data of this time, the report data identifier set is a set of data identifiers included in the query report data of this time, and for example, if the query report data is the order quantity of yesterday, the report data identifier is the order quantity identifier. The data generation time represents the generation time of the inquired report data, namely the report data marks that the data generated by the data represented in the corresponding data generation time is the report data of the inquiry request. For example, the query report data is the order quantity within 0 to 12 points of yesterday, and yesterday 0 to 12 points are the data generation time corresponding to the order quantity.
In the embodiment of the invention, on one hand, because the report data required by the report generation usually has regularity, the server can pre-configure each report data identifier set corresponding to the report data required by each report generation and the data generation time corresponding to each report data identifier in the report data identifier set, and establish the corresponding relationship between the report identifier and the data identifier set and the data generation time corresponding to each report data identifier in the report data identifier set, so that the report identifier can be inquired based on the corresponding relationship in the step, and further the data generation time corresponding to each report data identifier in the report data identifier set and the report data identifier set corresponding to the report identifier can be inquired. On the other hand, the report data query request may include a report data identifier set corresponding to the current query of the report data, and data generation time corresponding to each report data identifier in the report data identifier set, so each report data identifier and corresponding data generation time may be obtained from the query request based on the report identifier in this step.
After the data generation time corresponding to each report data identifier is obtained, each data generation time can be divided into a plurality of time intervals, namely the data generation time is divided into segments, and the corresponding data generation time can be obtained by combining the time intervals. Specifically, in the embodiment of the present invention, a segment period corresponding to the report data identifier may be preset, so as to divide the data generation time of the report data identifier into a plurality of time intervals based on the segment period. For example, a report data identifier may be set to have a segment period of 60 minutes, and then the start time and the end time of the data generation time corresponding to the report data identifier may be obtained based on the start time and the end time of the report data identifier, which may be specifically implemented by the following codes.
@Override
public String getBeginTime(ReportReqBean bean){
return bean.getOutsideBeginTime()；
}
// nul1 denotes the current time
@Override
public String getEndTime(ReportReqBean bean){
return bean.getOutsideEndTime()；
}
// unit is minute, segmented query period, -1 represents not segmented
@Override
public int intervalCycle(){
return 60；
}
Let the start time of the data generation time (BeginTime) be: 2021-03-2209: 00:00, end time (EndTime) is: 2021-03-2211: 59:59, and the segment period (interval) is 60 minutes, the above codes are run, and the data generation time can be divided into time intervals with the duration of 60 minutes. In the above code operation, if the end time of the data generation time is nul1, the end time may be defaulted as the current time. In the embodiment of the present invention, it may also be set that the data generation time is not split, for example, the segmentation period is set to-1, to indicate that the data generation time is not split, 60 in the code may be modified to-1, and when the code runs, it may be determined that the data generation time does not need to be split.
After each data generation time is divided into a plurality of time intervals, a corresponding data request can be generated for each time interval by combining the corresponding report data identification, so that a plurality of data requests can be generated. Specifically, in the embodiment of the present invention, a code template corresponding to the generated data request may be configured in advance, and then the time interval and the corresponding report data identifier and other parameters are substituted into the code template to generate the data request.
It should be noted that the data request may further include a plurality of parameters for obtaining report data, such as a report identifier, interface information, cluster information, and the like, each of which may be stored in advance, and when the data request is generated, the data request may be obtained and brought into the code template based on the report identifier query, so as to generate the data request.
S103: and issuing a data request to the data cluster so that the data cluster executes a rule to process the data request based on a preset data request, and further receiving report data processed by the data cluster and returning the report data to the terminal.
After the data request is generated, the generated data request can be issued to the data cluster, so that report data can be obtained from the data cluster.
After receiving each data request in the data cluster, the data cluster may perform rule processing based on a preset data request, for example, adding each data request to a queue and then sequentially performing the processing. The data cluster processes each data request to obtain report data in a time interval corresponding to the data request, and further sends the processed report data to the server, and after receiving the report data processed by the data cluster, the server obtains the report data queried by the report data query request in step S101, and then returns the report data to the terminal.
In the embodiment of the invention, after receiving the report data processed by the data cluster, the server can firstly summarize the report data and then return the report data to the terminal. In the embodiment of the present invention, a data summarizing manner may be preset, and specifically, a summarizing column identifier may be preset, that is, data in a column corresponding to the summarizing column identifier is used to summarize report data, for example, data with the same value in a column corresponding to the summarizing column identifier may be merged. For example, the summary column identification may be a warehouse number, then summarization of the report data may be performed to merge data received from the report data having the same warehouse number.
For example, in the embodiment of the present invention, a summary key, that is, a summary column identifier, may be represented by a summary key in a code, and data that needs to be merged (added) when summarizing is represented by a count typeface, so as to improve code development efficiency. Specifically, the following code may be used.
String sql＝”select e.wh_no as
summaryKey,substring_index(e.wh_no,’-‘,-2)aswhNo,count(distinct(e.order_source_no))asexpCount”+”from obd_order_exception e join obd_orderoo on e.order_source_no＝oo.source_no andoo.yn＝1”+”WHERE(oo.create_time>＝str_to_date(‘”+time Section[0]+”’,’％Y-％m-％d％H:％i:％S’)andoo.create_time<＝str_to_date(‘”+timeSection[1]+”’,’％Y--％m-％d％H:％i:％S’)+param+”and oo.order_type＝1and e.is_finished＝0and oo.wh_no＝e.wh_no”+”GROUP BYoo.wh_no“”；
In the above code, wh _ no is a summary column identifier, which is represented by summary key, and indicates a data field to be added when summarizing through expCount.
In the embodiment of the present invention, the summary column identifier may be set according to a requirement, and specifically may be an identifier of one field, or may be a combination of identifiers of multiple fields. For example, as shown in fig. 2, the data stored in the general database is stored in a format shown in a create _ time field in fig. 2, the data in a week needs to be summarized by hour + by warehouse (wh _ no) from the data stored in this way, the general time field needs to intercept information of the create _ time field (year-month-day and hour) and warehouse fields for groupby summarization, and the summary data code in 7 days is usually written as create _ time > 2021-01-0100: 00:00and create _ time < 1-01-0623: 20259: 59, but the data amount is too large in this time span, which easily leads to slow sql l to cause the database cpu to be raised, so in the embodiment of the present invention, the 7-day time difference can be divided into a plurality of time intervals, and then the summary can be performed based on the report data corresponding to the time intervals. The specific code of each time interval at the time of data summarization can be as follows.
String sql＝”SELETC concat(oo.wh_no,’_’,ifnull(substring_index(oo.shipped_time,’:’1),”))”+”as summaryKey,substring_index(substring_index(oo.shipped_time,’:’1),’:’1)as time,oo.dc_no as dcNo”+“,SUM(CASE WHENoo.order_status IN(‘9’)THEN 1ELSE 0END)AScount”+“FROM obd_order oo LEFT JOIN obd_wave owON oo.wave_no＝ow.wave_no AND oo.wh_no＝oo.wh_no”+”AND oo.yn＝1 AND ow.yn＝1JOIN mst_dcdc ON oo.dc_no＝da.da_no and dc.new_org＝1left joinmst_area area”+”on dc.area_no＝area.area_no left joinmst_wh wh on oo.wh_no＝wh.wh_no”+“WHERE”+“(oo.shipped_time<＝str_to_date(‘”+timeSection[0]+”’,’％Y-％m-％d％H:％i:％S’)”+”andoo.shipped_time<＝str_to_date(‘”+timeSection[1]+”’,’％Y--％m-％d％H:％i:％S’))”+param+”and oo.order_type＝”1”and oo.is_customer_cancel＝0and wh.wh_business_type in(1,2)”+”AND oo.yn＝1GROUP BY oo.wh_no”；
In the above code, the summary dimension is the year-month-day-hour part intercepted in the wh _ no field and the shifted _ time, so that the summary dimension is determined as summary key by connecting the summary dimension with the year-month-day-hour part intercepted in the shifted _ time, that is, the summary column is identified as wh _ no field and is connected with the year-month-day-hour part intercepted in the shifted _ time, and finally the code passes through the wh _ no field group by.
It should be noted that the data cluster returns the processed report data according to the received data request, that is, each report data is sent to the server in multiple times, so in the embodiment of the present invention, the report data belonging to the report may be determined based on the report identifier, then the report data in each time interval may be merged into a whole, and then summarized by the summary column identifier, or in order to avoid that the data amount is too large after the report data in each time interval is merged into a whole, the report data corresponding to each time interval may be summarized by the summary column identifier first, and then the summary results in each time interval are merged. If the data clusters comprise a plurality of data clusters, the report data of each data cluster also needs to be merged and summarized.
In the embodiment of the invention, the report data corresponding to each time interval is received, and then summary can be carried out through summarykey, so that a large data volume is divided into a plurality of small data volumes to be acquired and summarized, and the system performance risk is reduced.
In the embodiment of the invention, when the report data is acquired from the data cluster, the data generation time corresponding to the report data identifier can be divided into a plurality of time intervals, and the data request is generated based on the time intervals, because the data generation time is divided, the time interval included in each data request is smaller than the data generation time, that is, the report data amount acquired by the original one-time request is divided into a plurality of data requests to be acquired, after the plurality of data requests are issued to the data cluster, the data cluster can execute the rule processing on the basis of the preset data request to process the received plurality of data requests, each data request can execute the rule batch processing based on the data request, that is, the report data corresponding to the data generation time is not required to be processed at one time, but the rule is executed for multiple times based on the data request to reduce the data amount of the data processed by the data cluster at one time, therefore, even in a special period such as a large promotion period, the data cluster can reduce the data volume of the report data processed at one time based on the data request execution rule, thereby avoiding slow operation or downtime and improving the system performance of the data cluster.
With reference to the embodiment shown in fig. 1, a system architecture of the report data acquisition system in the embodiment of the present invention may be as shown in fig. 3. In order to improve the system performance and stability of the acquisition system, a multi-level cache mode can be set to store the acquired report data in the embodiment of the invention.
In fig. 3, the system architecture includes a unified entry, a Sql regurator, a report data summarization method, a multithreading trigger, and a cache. The unified portal may be used to receive report data query requests.
In order to improve the system performance and stability of the acquisition system, in the embodiment of the present invention, a two-level cache manner may be set to store the acquired report data, which is a first-level cache (a first-level cache in fig. 3) and a second-level cache (a second-level cache in fig. 3), respectively, and a priority of the first-level cache is set to be higher than a priority of the second-level cache. The report data stored in the first-level cache and the second-level cache are both set with expiration time, and whether the report data in the caches can be used for report generation or not can be judged based on the expiration time. Specifically, after step S101, the expiration time of the report data corresponding to the report identifier may be first queried from the first-level cache to determine whether the report data corresponding to the report identifier in the first-level cache is expired. If the report data corresponding to the report identifier in the first-level cache is judged to be data unexpired, the report data corresponding to the report identifier can be directly obtained from the first-level cache and sent to the terminal; if the report data corresponding to the report identifier in the first-level cache is determined to be data-expired, the report data acquisition process may be triggered, that is, step S102 is executed and a data request is issued to the data cluster, and meanwhile, the expiration time of the report data corresponding to the report identifier in the second-level cache may also be queried to determine whether the report data corresponding to the report identifier in the second-level cache is data-expired. If the report data corresponding to the report identifier in the second-level cache is determined as data unexpired, indicating that the report data in the second-level cache can be used, the report data corresponding to the report identifier can be obtained from the second-level cache and sent to the terminal, and if the report data corresponding to the report identifier in the second-level cache is determined as data expired, indicating that the report data in the second-level cache is expired, the report data returned from the data cluster is received in step S103 and sent to the terminal. The first-level cache and the second-level cache in the embodiment of the invention can be jimdb caches.
The Sql rule set configures parameters required for generating data requests corresponding to each report and rules for generating data requests, for example, report identifiers correspond to report data identifier sets and data generation time corresponding to report data identifiers in the report data identifier sets, splitting modes of the data generation time, segment periods, cluster information, and the like, and can pass data requests for acquiring report data.
The cluster summarization, the time interval summarization and the identification summarization are summarization modes of report data, and can be used for summarizing the received report data. The cluster summarizing representation summarizes the report data sent by different clusters, the time interval summarizing representation summarizes the report data corresponding to each time interval, and the identification summarizing representation summarizes the report data based on the summarizing column identification.
The multithreading trigger can be used for generating a data request and summarizing report data, when a report data acquisition process is triggered, a trigger signal can be sent to the multithreading trigger, the multithreading trigger can generate a data request based on configuration information in the Sql rule device and send the data request to each data cluster, and after receiving the report data sent by each data cluster, the report data are summarized in the summarizing mode and then synchronously stored in the first-level cache, the second-level cache and the database cache.
In order to break down the manner, in the embodiment of the present invention, a distributed task lock may be set, that is, a target task is set, and only one report data acquisition process is triggered within the same time period, that is, only one trigger signal is issued to the multi-thread trigger, so that when the step S102 is executed: under the condition that the target task lock is in a locked state, querying data generation time corresponding to the report data identifier in the report data identifier set fails, namely step S102 fails to execute; under the condition that the target task lock is in the unlocked state, inquiring data generation time corresponding to the report data identifier in the report data identifier set based on the report identifier, and updating the state of the target task lock to be in the locked state, namely executing the step S102.
The following describes the method for acquiring report data in the embodiment of the present invention in detail with reference to the embodiment shown in fig. 1 and the system architecture shown in fig. 3. As shown in fig. 4, the method includes:
s401: and receiving a report data query request sent by the terminal, and acquiring a report identifier in the query request.
S402: inquiring the expiration time of the report data corresponding to the report identifier from the first-level cache to judge whether the report data corresponding to the report identifier in the first-level cache is expired, and if not, executing the step S403; if yes, steps S404 and S405 are performed.
Wherein, the first-level cache is a first-level cache in the structure shown in fig. 3. The method comprises the steps of inquiring the expiration time of the report data corresponding to the report identifier from the first-level cache to judge whether the report data corresponding to the report identifier in the first-level cache is expired.
It should be noted that, in the embodiment of the present invention, expiration time is set for each report data in the first-level cache, and this step may compare the current time with the expiration time during execution, and if the current time is greater than the expiration time, it may be determined that the data is expired; if the current time is not greater than the expiration time, it may be determined that the data is not expired.
S403: and acquiring report data corresponding to the report identification from the first-level cache so as to send the report data to the terminal.
If it is determined in step S402 that the data is not expired, it indicates that the report data corresponding to the report identifier in the first-level cache is available, so this step may be performed.
S404: inquiring data generation time corresponding to the report data identification in the report data identification set based on the report identification, dividing the data generation time corresponding to the report data identification into a plurality of time intervals, and generating data requests corresponding to the time intervals by combining the corresponding report data identification; and issuing a data request to the data cluster, and further receiving report data processed by the data cluster.
If the report data corresponding to the report identifier in the first-level cache is expired, the report data corresponding to the report identifier needs to be updated, and then the report data acquisition process can be triggered, namely the step is executed.
S405: inquiring the expiration time of the report data corresponding to the report identifier from the second-level cache to judge whether the report data corresponding to the report identifier in the second-level cache is expired, if not, executing the step S406; if yes, go to step S407.
Wherein the second level cache is the second level cache in the structure shown in fig. 3. If the report data corresponding to the report identifier in the first-level cache is expired, the report data acquisition process may be triggered, that is, step S102 is executed, and meanwhile, the report data corresponding to the report identifier may also be tried to be acquired from the second-level cache, that is, the expiration time of the report data corresponding to the report identifier is queried from the second-level cache, so as to determine whether the data is expired.
In the embodiment of the invention, the expiration time is set for each report data in the second-level cache, the step can compare the current time with the expiration time during execution, and if the current time is greater than the expiration time, the data can be judged to be expired; if the current time is not greater than the expiration time, it may be determined that the data is not expired.
S406: and acquiring report data corresponding to the report identifier from the second-level cache so as to send the report data to the terminal.
If step S405 determines that the data is not expired, it indicates that the report data corresponding to the report identifier in the second-level cache is available, so this step may be performed.
S407: and returning the report data after the received data cluster processing to the terminal.
If the data is judged to be out of date in step S405, it is indicated that the report data corresponding to the report identifier in the second-level cache cannot be used, so that the report data received after the data cluster processing performed in step S404 can be returned to the terminal.
It should be noted that, in the embodiment of the present invention, when step S407 is executed, report data processed by the data cluster may not be received yet, and at this time, report data corresponding to the report identifier may also be obtained from the database cache, so as to be sent to the terminal. Therefore, before step S407 is executed, it may be determined whether report data sent by the data cluster after step S404 is executed is received, if yes, step S407 is executed, and if not, report data corresponding to the report identifier is obtained from the database cache to be sent to the terminal.
In the embodiment of the invention, by setting two levels of caches, the access of the database caches is reduced, and meanwhile, the report data acquisition process is triggered only when the report data in the first level cache is expired, so that the number of times of acquiring the report data is reduced, the frequent acquisition of the report data is avoided, the system performance can be improved, and the system stability is ensured.
Meanwhile, by adopting the report data acquisition mode in the embodiment of the invention, the multithreading processing process is shielded, and the sql rule and the summarizing mode are set, so that the report data acquisition and summarizing details are shielded, and the system development time and the system risk are greatly saved.
Based on the system architecture shown in fig. 4, after step S404 is executed, the report data may also be updated, and an embodiment of the present invention provides a description on an updating method of the report data after step S404 in the embodiment shown in fig. 4. As shown in fig. 5, the method includes:
s501: and updating the report data corresponding to the report types in the first-level cache and the second-level cache based on the report data processed by the data cluster.
After the report data processed by the data cluster is received, the report data can be updated to the report data corresponding to the report types in the first-level cache and the second-level cache. Specifically, the report data after the data cluster processing may be summarized first, and then the summarized report data is updated to the report data corresponding to the report types in the first-level cache, the second-level cache, and the database cache. The updating method may specifically be to store the corresponding relationship between the report identifier and the summarized report data, and delete the expired report data corresponding to the report identifier.
It should be noted that, in this step, since the report data corresponding to the report type in the second-level cache may be updated after step S404, at this time, the updated report data is newly acquired, and the data is usually not out of date, if the execution process of step S404 and this step is fast, and when step S405 is executed, it is possible that the report data corresponding to the report identifier is the newly acquired report data by querying the second-level cache, then the report data received in step S404 may be returned to the terminal.
S502: and setting the expiration time of the updated report data in the first-level cache and the second-level cache.
And setting the expiration time of the report data corresponding to the updated report data in the first-level cache and the second-level cache.
Specifically, in the embodiment of the present invention, the expiration time of the report data in the first-level cache may be set to be the update time of the report data, and the expiration time of the report data in the second-level cache may be set to be longer than the update time of the report data. This step may be specifically performed as: inquiring report updating time corresponding to the report identification to set the report updating time as the expiration time of the updated report data in the first-level cache; and inquiring the preset expiration time of the report identifier corresponding to the second-level cache to set the expiration time of the updated report data in the second-level cache, wherein the preset expiration time of the report identifier corresponding to the second-level cache is greater than the report updating time.
In the embodiment of the invention, the report data in each cache is updated, so that the corresponding report data can be provided for the terminal during query.
In order to solve the problems in the prior art, an embodiment of the present invention provides an apparatus 600 for acquiring report data, as shown in fig. 6, the apparatus 600 includes:
a receiving unit 601, configured to receive a report data query request sent by a terminal, and obtain a report identifier in the query request;
a processing unit 602, configured to query, based on the report identifier, data generation time corresponding to the report data identifier in a report data identifier set, split the data generation time corresponding to the report data identifier into multiple time intervals, and generate, in combination with the corresponding report data identifier, a data request corresponding to each time interval; and issuing the data request to a data cluster so that the data cluster processes the data request based on a preset data request execution rule, and further receiving report data processed by the data cluster and returning the report data to the terminal.
It should be understood that the manner of implementing the embodiment of the present invention is the same as the manner of implementing the embodiment shown in fig. 1, and the description thereof is omitted.
In an implementation manner of the embodiment of the present invention, the processing unit 602 is specifically configured to:
inquiring the expiration time of the report data corresponding to the report identifier from a first cache to judge whether the report data corresponding to the report identifier in the first-level cache is expired;
under the condition that the data is not expired, acquiring report data corresponding to the report identification from the first-level cache so as to send the report data to the terminal;
and under the condition of data expiration, executing the steps of generating and issuing the data request, and inquiring expiration time of the report data corresponding to the report identifier from a second-level cache to judge whether the report data corresponding to the report identifier in the second-level cache is expired, if not, acquiring the report data corresponding to the report identifier from the second-level cache to send the report data to the terminal, and if so, returning the report data processed by the data cluster to the terminal, wherein the priority of the first-level cache is higher than that of the second-level cache.
In another implementation manner of the embodiment of the present invention, the apparatus 600 further includes:
and the updating unit is used for updating the report data corresponding to the report types in the first-level cache and the second-level cache based on the report data processed by the data cluster, and setting the expiration time of the updated report data in the first-level cache and the second-level cache.
In another implementation manner of the embodiment of the present invention, the update unit is specifically configured to:
inquiring report updating time corresponding to the report identification to set the report updating time as the expiration time of the updated report data in the first-level cache;
and inquiring the preset expiration time of the report identifier corresponding to the second-level cache to set the expiration time of the updated report data in the second-level cache, wherein the preset expiration time of the report identifier corresponding to the second-level cache is greater than the report updating time.
In another implementation manner of the embodiment of the present invention, the processing unit 602 is specifically configured to:
inquiring the summary column identification corresponding to the report identification, summarizing the report data processed by the data cluster based on the column data corresponding to the summary column identification, and sending the summarized report data to the terminal.
In another implementation manner of the embodiment of the present invention, the processing unit 602 is specifically configured to:
under the condition that the target task lock is in a locked state, querying data generation time corresponding to the report data identification in the report data identification set fails;
and under the condition that the target task lock is in an unlocked state, inquiring data generation time corresponding to the report data identification in a report data identification set based on the report identification, and updating the state of the target task lock to be a locked state.
It should be understood that the embodiment of the present invention is implemented in the same manner as the embodiment shown in fig. 1, 4 or 5, and is not repeated herein.
In the embodiment of the invention, when the report data is acquired from the data cluster, the data generation time corresponding to the report data identifier can be divided into a plurality of time intervals, and the data request is generated based on the time intervals, because the data generation time is divided, the time interval included in each data request is smaller than the data generation time, that is, the report data amount acquired by the original one-time request is divided into a plurality of data requests to be acquired, after the plurality of data requests are issued to the data cluster, the data cluster can execute the rule processing on the basis of the preset data request to process the received plurality of data requests, each data request can execute the rule batch processing based on the data request, that is, the report data corresponding to the data generation time is not required to be processed at one time, but the rule is executed for multiple times based on the data request to reduce the data amount of the data processed by the data cluster at one time, therefore, even in a special period such as a large promotion period, the data cluster can reduce the data volume of the report data processed at one time based on the data request execution rule, thereby avoiding slow operation or downtime and improving the system performance of the data cluster.
According to an embodiment of the present invention, an electronic device and a readable storage medium are also provided.
The electronic device of the embodiment of the invention comprises: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the processor, and the instructions are executed by the at least one processor, so that the at least one processor executes the method for acquiring report data provided by the embodiment of the invention.
Fig. 7 shows an exemplary system architecture 700 of a report data acquisition method or a report data acquisition apparatus to which an embodiment of the present invention can be applied.
As shown in fig. 7, the system architecture 700 may include terminal devices 701, 702, 703, a network 704, and a server 705. The network 704 serves to provide a medium for communication links between the terminal devices 701, 702, 703 and the server 705. Network 704 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.
A user may use the terminal devices 701, 702, 703 to interact with a server 705 over a network 704, to receive or send messages or the like. Various client applications may be installed on the terminal devices 701, 702, 703.
The terminal devices 701, 702, 703 may be, but are not limited to, smart phones, tablet computers, laptop portable computers, desktop computers, and the like.
The server 705 may be a server providing various services, and the server may analyze and perform other processes on the received report data query request and other data, and feed back the processing result (e.g., report data — just an example) to the terminal device.
It should be noted that the method for acquiring report data provided by the embodiment of the present invention is generally executed by the server 705, and accordingly, the apparatus for acquiring report data is generally disposed in the server 705.
It should be understood that the number of terminal devices, networks, and servers in fig. 7 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
Referring now to FIG. 8, a block diagram of a computer system 800 suitable for use in implementing embodiments of the present invention is shown. The computer system illustrated in FIG. 8 is only one example and should not impose any limitations on the scope of use or functionality of embodiments of the invention.
As shown in fig. 8, the computer system 800 includes a Central Processing Unit (CPU)801 that can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)802 or a program loaded from a storage section 808 into a Random Access Memory (RAM) 803. In the RAM 803, various programs and data necessary for the operation of the system 800 are also stored. The CPU 801, ROM 802, and RAM 803 are connected to each other via a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.
The following components are connected to the I/O interface 805: an input portion 806 including a keyboard, a mouse, and the like; an output section 807 including a signal such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 808 including a hard disk and the like; and a communication section 809 including a network interface card such as a LAN card, a modem, or the like. The communication section 809 performs communication processing via a network such as the internet. A drive 810 is also connected to the I/O interface 805 as necessary. A removable medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 810 as necessary, so that a computer program read out therefrom is mounted on the storage section 808 as necessary.
In particular, according to the embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication section 809 and/or installed from the removable medium 811. The computer program executes the above-described functions defined in the system of the present invention when executed by the Central Processing Unit (CPU) 801.
It should be noted that the computer readable medium shown in the present invention can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a unit, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present invention may be implemented by software or hardware. The described units may also be provided in a processor, and may be described as: a processor includes a receiving unit, a generating unit, and a transmitting unit. Where the names of these elements do not in some cases constitute a limitation of the element itself, for example, a receiving element may also be described as "an element of the function of the receiving element".
As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be separate and not incorporated into the device. The computer readable medium carries one or more programs, and when the one or more programs are executed by the device, the device executes the method for acquiring the report data provided by the invention.
The above-described embodiments should not be construed as limiting the scope of the invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions can occur, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A method for acquiring report data is characterized by comprising the following steps:
receiving a report data query request sent by a terminal, wherein the query request carries a report identifier;
inquiring data generation time corresponding to the report data identification in a report data identification set based on the report identification, dividing the data generation time corresponding to the report data identification into a plurality of time intervals, and generating a data request corresponding to each time interval by combining the corresponding report data identification;
and issuing the data request to a data cluster so that the data cluster processes the data request based on a preset data request execution rule, and further receiving report data processed by the data cluster and returning the report data to the terminal.
2. The method of claim 1, further comprising:
inquiring the expiration time of the report data corresponding to the report identifier from a first-level cache to judge whether the report data corresponding to the report identifier in the first-level cache is expired;
under the condition that the data is not expired, acquiring report data corresponding to the report identification from the first-level cache so as to send the report data to the terminal;
and under the condition of data expiration, executing the steps of generating and issuing the data request, and inquiring expiration time of the report data corresponding to the report identifier from a second-level cache to judge whether the report data corresponding to the report identifier in the second-level cache is expired, if not, acquiring the report data corresponding to the report identifier from the second-level cache to send the report data to the terminal, and if so, returning the report data processed by the data cluster to the terminal, wherein the priority of the first-level cache is higher than that of the second-level cache.
3. The method of claim 2, after receiving the data cluster processed report data, further comprising:
and updating the report data corresponding to the report types in the first-level cache and the second-level cache based on the report data processed by the data cluster, and setting the expiration time of the updated report data in the first-level cache and the second-level cache.
4. The method according to claim 3, wherein the setting of the expiration time of the updated report data in the first level cache and the second level cache comprises:
inquiring report updating time corresponding to the report identification to set the report updating time as the expiration time of the updated report data in the first-level cache;
and inquiring the preset expiration time of the report identifier corresponding to the second-level cache to set the expiration time of the updated report data in the second-level cache, wherein the preset expiration time of the report identifier corresponding to the second-level cache is greater than the report updating time.
5. The method according to claim 1, wherein receiving the report data processed by the data cluster and returning the report data to the terminal comprises:
inquiring the summary column identification corresponding to the report identification, summarizing the report data processed by the data cluster based on the column data corresponding to the summary column identification, and sending the summarized report data to the terminal.
6. The method according to claim 1, wherein querying the data generation time corresponding to the report data identifier in the report data identifier set based on the report identifier comprises:
under the condition that the target task lock is in a locked state, querying data generation time corresponding to the report data identification in the report data identification set fails;
and under the condition that the target task lock is in an unlocked state, inquiring data generation time corresponding to the report data identification in a report data identification set based on the report identification, and updating the state of the target task lock to be a locked state.
7. An apparatus for acquiring report data, comprising:
the receiving unit is used for receiving a report data query request sent by a terminal and acquiring a report identifier in the query request;
the processing unit is used for inquiring data generation time corresponding to the report data identification in a report data identification set based on the report identification, dividing the data generation time corresponding to the report data identification into a plurality of time intervals, and generating a data request corresponding to each time interval by combining the corresponding report data identification; and issuing the data request to a data cluster so that the data cluster processes the data request based on a preset data request execution rule, and further receiving report data processed by the data cluster and returning the report data to the terminal.
8. The apparatus according to claim 7, wherein the processing unit is specifically configured to:
inquiring the expiration time of the report data corresponding to the report identifier from a first cache to judge whether the report data corresponding to the report identifier in the first-level cache is expired;
under the condition that the data is not expired, acquiring report data corresponding to the report identification from the first-level cache so as to send the report data to the terminal;
and under the condition of data expiration, executing the steps of generating and issuing the data request, and inquiring expiration time of the report data corresponding to the report identifier from a second-level cache to judge whether the report data corresponding to the report identifier in the second-level cache is expired, if not, acquiring the report data corresponding to the report identifier from the second-level cache to send the report data to the terminal, and if so, returning the report data processed by the data cluster to the terminal, wherein the priority of the first-level cache is higher than that of the second-level cache.
9. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-6.
10. A computer-readable medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110573193.XA CN113297222B (en) | 2021-05-25 | 2021-05-25 | Report data acquisition method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110573193.XA CN113297222B (en) | 2021-05-25 | 2021-05-25 | Report data acquisition method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113297222A true CN113297222A (en) | 2021-08-24 |
| CN113297222B CN113297222B (en) | 2024-06-14 |
Family
ID=77325073
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110573193.XA Active CN113297222B (en) | 2021-05-25 | 2021-05-25 | Report data acquisition method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113297222B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115269709A (en) * | 2022-09-30 | 2022-11-01 | 深圳华锐分布式技术股份有限公司 | Market data-based query and playback method, device, equipment and medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20010004513A (en) * | 1999-06-29 | 2001-01-15 | 윤종용 | Transaction measurement table in the switching system |
| US20180063142A1 (en) * | 2016-08-31 | 2018-03-01 | Ca, Inc. | Identifying user equipment using tuple of browser type and elapsed hash time for challenge data set |
| CN109697209A (en) * | 2018-12-25 | 2019-04-30 | 广东亿迅科技有限公司 | A kind of report processing method and device of Based on Distributed database |
| CN109947668A (en) * | 2017-12-21 | 2019-06-28 | 北京京东尚科信息技术有限公司 | The method and apparatus of storing data |
| CN110032567A (en) * | 2019-04-24 | 2019-07-19 | 江苏满运软件科技有限公司 | Report form inquiring method, device, server and storage medium |
| WO2019178979A1 (en) * | 2018-03-21 | 2019-09-26 | 平安科技（深圳）有限公司 | Method for querying report data, apparatus, storage medium and server |
| CN110991154A (en) * | 2019-12-20 | 2020-04-10 | 深圳前海环融联易信息科技服务有限公司 | Report generation method, system, computer equipment and computer readable storage medium |
| WO2020186786A1 (en) * | 2019-03-20 | 2020-09-24 | 平安科技（深圳）有限公司 | File processing method and apparatus, computer device and storage medium |
| CN112115691A (en) * | 2020-08-25 | 2020-12-22 | 上海乾臻信息科技有限公司 | Report generation method and device |
| CN112632163A (en) * | 2020-12-18 | 2021-04-09 | 平安普惠企业管理有限公司 | Big data report exporting method and related equipment |
-
2021
- 2021-05-25 CN CN202110573193.XA patent/CN113297222B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20010004513A (en) * | 1999-06-29 | 2001-01-15 | 윤종용 | Transaction measurement table in the switching system |
| US20180063142A1 (en) * | 2016-08-31 | 2018-03-01 | Ca, Inc. | Identifying user equipment using tuple of browser type and elapsed hash time for challenge data set |
| CN109947668A (en) * | 2017-12-21 | 2019-06-28 | 北京京东尚科信息技术有限公司 | The method and apparatus of storing data |
| WO2019178979A1 (en) * | 2018-03-21 | 2019-09-26 | 平安科技（深圳）有限公司 | Method for querying report data, apparatus, storage medium and server |
| CN109697209A (en) * | 2018-12-25 | 2019-04-30 | 广东亿迅科技有限公司 | A kind of report processing method and device of Based on Distributed database |
| WO2020186786A1 (en) * | 2019-03-20 | 2020-09-24 | 平安科技（深圳）有限公司 | File processing method and apparatus, computer device and storage medium |
| CN110032567A (en) * | 2019-04-24 | 2019-07-19 | 江苏满运软件科技有限公司 | Report form inquiring method, device, server and storage medium |
| CN110991154A (en) * | 2019-12-20 | 2020-04-10 | 深圳前海环融联易信息科技服务有限公司 | Report generation method, system, computer equipment and computer readable storage medium |
| CN112115691A (en) * | 2020-08-25 | 2020-12-22 | 上海乾臻信息科技有限公司 | Report generation method and device |
| CN112632163A (en) * | 2020-12-18 | 2021-04-09 | 平安普惠企业管理有限公司 | Big data report exporting method and related equipment |
Non-Patent Citations (4)
| Title |
|---|
| YUEZHUO ZHANG 等: "A Large-Scale Online Search System of High-Dimensional Vectors Based on Key-Value Store", 2012 EIGHTH INTERNATIONAL CONFERENCE ON SEMANTICS, KNOWLEDGE AND GRIDS, 24 December 2012 (2012-12-24) * |
| 邓丽艳: "基于J2EE的电信网管独立报表系统的设计与实现", 中国优秀硕士学位论文全文数据库, 15 December 2005 (2005-12-15) * |
| 韩兵;李晶晶;方英兰;: "基于JDBC数据管理与查询优化的研究", 计算机技术与发展, no. 09, 16 May 2018 (2018-05-16) * |
| 高锦涛;李战怀;刘文洁;: "一种高效准确的基于查询结果的基数估计策略", 西北工业大学学报, no. 04, 15 August 2018 (2018-08-15) * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115269709A (en) * | 2022-09-30 | 2022-11-01 | 深圳华锐分布式技术股份有限公司 | Market data-based query and playback method, device, equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113297222B (en) | 2024-06-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10901956B2 (en) | Indexing of linked data | |
| CN110909022A (en) | Data query method and device | |
| EP3690669A1 (en) | Method, apparatus, device and storage medium for managing index technical field | |
| CN112988770A (en) | Method and device for updating serial number, electronic equipment and storage medium | |
| CN109960212B (en) | Task sending method and device | |
| CN115408381A (en) | Data processing method and related equipment | |
| CN113297222B (en) | Report data acquisition method and device, electronic equipment and storage medium | |
| CN110109912B (en) | Identifier generation method and device | |
| CN110866001A (en) | Method and device for determining order to be processed | |
| CN113761052A (en) | Database synchronization method and device | |
| CN113779412B (en) | Message touch method, node and system based on blockchain network | |
| CN110858199A (en) | Document data distributed computing method and device | |
| CN115185966A (en) | Method and device for processing data consistency in distributed cluster | |
| US11455437B1 (en) | Techniques for generating and retrieving change summary data and aggregated model version data for an infrastructure model | |
| CN113535768A (en) | Production monitoring method and device | |
| CN113495891B (en) | Data processing method and device | |
| CN109086279B (en) | Report caching method and device | |
| CN113726885A (en) | Method and device for adjusting flow quota | |
| CN113742321A (en) | Data updating method and device | |
| CN113760600A (en) | Database backup method, database restoration method and related device | |
| CN113779048A (en) | Data processing method and device | |
| CN114860721A (en) | Index data construction method and device | |
| CN117349321B (en) | Multi-table connection query method and device for document database | |
| CN108509450B (en) | Method and device for processing high-concurrency update of database | |
| CN112783904B (en) | Method and device for updating index data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |