CN114818635A - Data report generation method and device, electronic equipment and storage medium - Google Patents

Data report generation method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN114818635A
CN114818635A CN202110078168.4A CN202110078168A CN114818635A CN 114818635 A CN114818635 A CN 114818635A CN 202110078168 A CN202110078168 A CN 202110078168A CN 114818635 A CN114818635 A CN 114818635A
Authority
CN
China
Prior art keywords
data
target
data table
report
target data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110078168.4A
Other languages
Chinese (zh)
Inventor
程方会
杨宏生
封磊
郑德来
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN202110078168.4A priority Critical patent/CN114818635A/en
Publication of CN114818635A publication Critical patent/CN114818635A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/166Editing, e.g. inserting or deleting
    • G06F40/186Templates
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/30Semantic analysis

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present disclosure provides a data report generation method, an apparatus, an electronic device and a storage medium, which relate to the field of data processing, in particular to the technical fields of Natural Language Processing (NLP), big data, cloud platforms and the like, and a specific implementation scheme is to obtain a data synchronization request and obtain at least one data table based on the data synchronization request; acquiring configuration information of the data tables, and processing the at least one data table based on the configuration information to generate a target data template; responding to a report generation instruction, calling a report generation page, and determining a target chart from candidate charts displayed in the page based on monitored selection operation; and mapping the target data template and the target chart to generate a target data report. The method and the device reduce research and development cost and improve timeliness and accuracy of the acquired data report.

Description

Data report generation method and device, electronic equipment and storage medium
Technical Field
The present disclosure relates to the field of data processing, and in particular, to the technical field of Natural Language Processing (NLP), big data, cloud platforms, and the like.
Background
In the related art, data of multiple dimensions, such as data types, data formats, analysis results, and the like, included in a visual report are required to be configured according to different requirements of a visual business data report by non-research and development personnel, such as business or product operators, and the like, and then the data are fed back to a worker who needs to be configured. The problems to be solved are high communication cost, high development difficulty, low code reuse rate and low resource utilization rate.
Disclosure of Invention
The disclosure provides a data report generation method, a data report generation device, an electronic device, a storage medium and a computer program product.
According to one aspect of the disclosure, a data report generation method is provided, which includes acquiring a data synchronization request, and acquiring at least one data table based on the data synchronization request; acquiring configuration information of the data tables, and processing the at least one data table based on the configuration information to generate a target data template; responding to a report generation instruction, calling a report generation page, and determining a target chart from candidate charts displayed in the page based on monitored selection operation; and mapping the target data template and the target chart to generate a target data report.
According to a second aspect of the present disclosure, a data report generating device is provided, including a first obtaining module, configured to obtain a data synchronization request, and obtain at least one data table based on the data synchronization request; the second acquisition module is used for acquiring the configuration information of the data tables, processing the at least one data table based on the configuration information and generating a target data template; the graph module is used for responding to a report generation instruction, calling a report generation page and determining a target graph from candidate graphs displayed in the page based on monitored selection operation; and the generation module is used for mapping the target data template and the target chart to generate a target data report.
According to a third aspect of the present disclosure, there is provided an electronic device, at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executable by the at least one processor to enable the at least one processor to perform the data table generation method proposed by the first aspect.
According to a fourth aspect of the present disclosure, a computer-readable storage medium is proposed, wherein the computer instructions are configured to cause the computer to execute the data table generating method proposed according to the first aspect.
According to a fifth aspect of the present disclosure, a computer program product is proposed, comprising a computer program which, when executed by a processor, implements the data table generation method proposed in the first aspect above.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
fig. 1 is a schematic flow chart diagram illustrating a data table generating method according to an embodiment of the disclosure;
fig. 2 is a schematic flow chart diagram illustrating a data table generating method according to another embodiment of the disclosure;
fig. 3 is a schematic application diagram of a data report generation method according to another embodiment of the present disclosure;
fig. 4 is a schematic flow chart diagram illustrating a data table generating method according to another embodiment of the disclosure;
fig. 5 is a schematic application diagram of a data table generation method according to another embodiment of the present disclosure;
fig. 6 is a schematic flow chart diagram illustrating a data table generating method according to another embodiment of the disclosure;
fig. 7 is a flowchart illustrating a data table generating method according to an embodiment of the disclosure;
fig. 8 is a flowchart illustrating a data table generating method according to an embodiment of the disclosure;
fig. 9 is a block diagram of a data table generation apparatus according to an embodiment of the present disclosure;
fig. 10 is a block diagram of a data table generating apparatus according to another embodiment of the present disclosure;
fig. 11 is a schematic block diagram of an electronic device of an embodiment of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Data processing (data processing) is a process of collecting, storing, retrieving, processing, transforming and transmitting data, extracting valuable information from a large amount of raw data, i.e. converting data into information. The input data in various forms are mainly processed and sorted, and the process comprises the whole process of evolution and derivation of collection, storage, processing, classification, merging, calculation, sorting, conversion, retrieval and propagation of the data. The process of data processing is roughly divided into 3 stages of data preparation, processing and output.
Natural Language Processing (NLP) is a man-machine interaction method, which refers to a subject that uses Language as an object and utilizes computer technology to analyze, understand and process Natural Language, i.e. a computer is used as a powerful tool for Language research, and Language information is quantitatively researched under the support of the computer, and Language description is provided for people and computers to use together. The method is mainly applied to the aspects of machine translation, public opinion monitoring, automatic summarization, viewpoint extraction, text classification, question answering, text semantic comparison, voice recognition and the like.
Big Data (Big Data), which refers to a Data set that cannot be captured, managed and processed by a conventional software tool within a certain time range, is a massive, high-growth-rate and diversified information asset that needs a new processing mode to have stronger decision-making power, insight discovery power and process optimization capability.
A Cloud Computing Platform (Cloud Computing Platform) refers to a service based on hardware resources and software resources, and provides Computing, networking and storage capabilities. Cloud computing platforms can be divided into three categories: the cloud computing platform comprises a storage type cloud platform taking data storage as a main part, a computing type cloud platform taking data processing as a main part and a comprehensive cloud computing platform taking computing and data storage processing into consideration.
Fig. 1 is a flowchart illustrating a data table generating method according to an embodiment of the disclosure. As shown in the figure, the data table generating method includes the following steps:
s101, acquiring a data synchronization request, and acquiring at least one data table based on the data synchronization request.
Data synchronization refers to data synchronization and information sharing among different storage devices, terminals and servers. In the embodiment of the disclosure, data required for report generation are scattered on different data storage platforms respectively, and data synchronization and information sharing between the report generation platform and other data storage platforms can be realized through data synchronization.
In the process of generating the report, a user can log in the report generating platform and perform data synchronization operation on the report generating platform to generate a data synchronization request. Correspondingly, the report generation platform monitors the data synchronization operation of the user on the platform operation interface, and generates a data synchronization request based on the monitored data synchronization operation. Optionally, the data synchronization operation may include configuring information of a location where the data source is located, configuring fields of the demand data that need to be synchronized, and synchronization conditions of the demand data, where the synchronization conditions may be used to filter the demand data. The example synchronization condition may be a screening condition for dates greater than 20201101. The data synchronization configuration can be displayed on a data synchronization configuration page and can be configured in a checking mode.
Further, the report generation platform may obtain at least one data table from the data provider based on the obtained data synchronization request. The data providing end can be, but is not limited to, an e-commerce platform, a live broadcast platform, a search engine background, a video playing platform, a takeaway ordering platform, a game platform, and the like.
The data synchronization request may include a storage path of the required data, data requirement information, and login information of the data provider, such as a login account and a password. The data requirement information may include a field of requirement data input by the user, a name of the requirement data, a valid time range of the data, and the like. Such as a table name of the demand data, an order name, etc.
Further, the data providing end can complete login based on the login information, and then determine the storage position of the data source according to the storage path. Further, at least one data table is obtained from the data source based on the data demand information. For example, the data demand information includes an order name, and the data providing end can generate an order data table based on the order name and feed back the order data table to the report generation platform. According to the data synchronization method and device, the data table of the data providing end can be obtained based on the data synchronization request, and the data sharing efficiency and the data obtaining efficiency are improved.
S102, acquiring configuration information of the data tables, processing at least one data table based on the configuration information, and generating a target data template.
The configuration information of the data table may include a data format in the data table, a fusion mode of data in the table, or an association relationship between tables, and the like, and the client processes the acquired data table according to the configuration information of the data table to generate the target data template.
In the embodiment of the present disclosure, a configuration page for configuring a data table may be provided on a report generation platform, where the configuration page has a plurality of configuration items, for example, the configuration page may include a data format configuration item and a data fusion configuration item, where a plurality of data fusion rules, such as averaging or summing, may be stored in advance in the data fusion configuration item; and table association configuration items, wherein association expressions among various data tables can be stored in the association configuration items in advance. Each configuration item may have a selection box, each selection box corresponds to respective configuration information, and all or part of the configuration information corresponding to each configuration item may be included in the selection box.
Based on service requirements, a user can check configuration information of a corresponding configuration item required in a part of selection boxes, for example, a storage format of data in a data table is selected in the selection box corresponding to the data format configuration item, and an association relationship between the data tables is selected in a table association configuration item. The report generation platform can monitor the selection operation of the user in the selection box of each configuration item, and the configuration information of the data table is obtained based on the selection operation.
Optionally, the report generation platform may display the inquiry prompt on the configuration page before generating the configuration information of the data table, and generate the configuration information of the required data table after obtaining the determination response to the inquiry prompt.
The report generation platform acquires the configuration information of the data table based on the operation of a user, performs corresponding change on the acquired data table based on the content processing carried by the configuration information, finally generates a target data template corresponding to the data table, and stores the target data template into the report generation platform.
S103, responding to the report generation instruction, calling a report generation page, and determining a target chart from the candidate charts displayed in the page based on the monitored selection operation.
In the embodiment of the disclosure, a report generation requirement input device is arranged on the report generation platform, wherein the report generation requirement input device may be a contact generation device, such as a button or a control, or may be a non-contact device, such as voice, gesture, and the like.
And the report generation platform generates a report generation instruction based on the input of the report generation requirement, and calls a report generation page in response to the report generation instruction. The report generation page is provided with a chart selection menu bar, all daily required chart types which can be provided for the user are contained in the menu bar, and the user can automatically select the required chart in the chart selection menu bar based on business requirements so as to determine the target chart.
The target chart may be a line chart, a pie chart, a bar chart, or any combination of the above three charts or other types of charts. It should be noted that the examples are only illustrative and should not be construed as limiting the present application.
And S104, mapping the target data template and the target chart to generate a target data report.
The target graph defines an output format of the target data report, and the target data template defines data content of the target data report. In the embodiment of the disclosure, the data in the target data template is subjected to statistical analysis according to the requirements of the user, and the statistical analysis result is mapped into the selected target diagram to generate the target data report.
For example, the type of the target chart is set as a line graph, the target data template is monthly statistic summary data of business sales of the market department in the last half year, the generated target data chart is a line graph generated based on the monthly statistic summary of business sales, each node of the line graph presents monthly sales summary of each month, and meanwhile, the change trend of the line graph reflects the increase or decrease change of the monthly sales of each month.
The data table generating method provided by the disclosure acquires at least one data table based on a data synchronization request, processes the data table according to configuration information of the acquired data table, and generates a target data template. And responding to the report generation instruction, selecting a target chart, mapping the target data template to the target chart based on the content of the target data template and the expression form of the target chart, and further generating the target data report. According to the data report form acquisition method and device, research and development cost is reduced, and timeliness and accuracy of the acquired data report form are improved.
Fig. 2 is a flowchart illustrating a data table generating method according to another embodiment of the disclosure. As shown in fig. 2, the data table generating method includes the following steps:
s201, acquiring a data synchronization request, and acquiring at least one data table based on the data synchronization request.
Step S201 can refer to the related content of S101, which is not described herein again.
S202, determining the data tables needing to be associated, associating the data tables needing to be associated according to the associated expressions in the configuration information, and generating the data table view.
And determining the data tables needing to be associated in at least one acquired data table, screening the data tables according to the query conditions, the query fields and other related information contained in the data configuration information, further determining the data tables needing to be associated, and associating the determined data tables by the report generation platform according to the associated expressions carried in the configuration information to generate a data table view.
In the embodiment of the disclosure, all the selectable associated expressions stored on the report generation platform may carry data elements that need to be associated. The user selects configuration information corresponding to configuration items of the associated expressions on a configuration page of the report generation platform based on data requirements, the report generation platform monitors the selection operation of the user to further determine the associated expressions, and the data in the data table needing to be associated are associated based on the associated expressions to generate corresponding data table views.
It should be noted that the data table view is generated based on the association expression selected by the user and the associated data table, and different selections may generate different data table views, which may be understood as that the data table view is customized according to the requirements of the user.
And S203, performing format processing on the data in the data table view according to the data format in the configuration information.
The data format can be understood as a rule of data storage, and the data format in the configuration information can be various formats such as enumeration, date, character string, number and the like. When the data format is digital, the field type integer can be selected through a page button, and the data precision is selected; when the data format is an enumeration type, the enumeration type can be added with a semantic layer, a field type enumeration type is selected through a page button, and a semantic configuration file is uploaded.
In the embodiment of the present disclosure, different format processing changes are performed on the data table view according to different data formats carried in the configuration information. For example, the data format carried in the configuration information is set as the number stored in the text format, and when the number in the data table view is stored in the conventional format, the number in the data table view needs to be subjected to format processing according to the data format carried in the configuration information, so that the storage format of the number in the data table view is changed from the conventional format to the text format, and the format processing of the data in the data table view is completed.
And S204, adding the dimension field and the index field in the configuration information into the data table view to generate a target data template.
The dimension field is a reference field for operation and analysis in data statistical analysis, and specific data of the data table can be checked through the dimension field; and the index field is used for performing operation analysis on the data corresponding to the dimension field in data statistical analysis, and the field corresponding to the generated data reflects the data really concerned by the user through the index field.
For example, in an information promotion scene, click data or click occurrence time in a click data report of daily promotion information is a dimension field, click rate is an index field, and a user can know popularity or promotion effect of the promotion information through the click rate. For another example, taking an order as an example, the generation time of the order or the type of the order may be used as a dimension field, and the number of the order may be configured as an index field.
In the embodiment of the disclosure, the dimension field and the index field are core data of the business data report, the dimension field and the index field in the configuration information are added to the data table view after format processing, and then the target data template is generated and stored in the report generation platform.
S205, responding to the report generation instruction, calling a report generation page, and determining a target chart from the candidate charts displayed in the page based on the monitored selection operation.
Step S205 can refer to the related content of S103, which is not described herein again.
S206, loading the target data template to the page.
In the embodiment of the disclosure, after the target diagram is confirmed, the target data template can be loaded to the report generation page, so that the time length for mapping the subsequent target data template into the target diagram is shortened, and the generation speed of the target data report is increased.
Meanwhile, two display areas can be set on the report generation page, the target chart and the target data template are respectively displayed through a preview mode, so that a user can more visually check the content of the target data template, and whether the target chart and the target data template are correct can be confirmed again before the target data template is generated.
And S207, mapping the target data template to a target chart based on the dimension field and the index field to generate a target data report.
In the embodiment of the disclosure, data analysis is performed on the dimension field in the target data template according to the index field, different index fields correspond to different function expressions, data corresponding to the index field can be subjected to statistical analysis through the function expressions, and the result of the statistical analysis and the dimension field are mapped to the target chart, so as to generate the target data report.
To better understand the above embodiment, the number of different types of trees within the fixed area to be counted may be set in combination with the following example, where the type of the tree is a dimension field, the number of trees is an index field, and the target graph is a histogram. In the target data template, the statistical analysis result of the index field based on the dimension field is set as shown in table 1, the number of trees a is 100, the number of trees B is 80, and the number of trees C is 150, and the statistical analysis result of the data corresponding to the dimension field and the index field is mapped into the histogram, so that the target data report of the statistical histogram of the number of different types of trees as shown in fig. 3 can be obtained.
TABLE 1
Species of trees Number of trees
Tree A
100
Tree B 80
Tree C 150
The data table generating method provided by the disclosure acquires a data table based on a data synchronization request, associates the data table according to an associated expression, generates a data table view, and performs format processing and field addition on the data table view based on configuration information, thereby generating a target data template. And confirming a target diagram on a report generation page, mapping the target data template into the target diagram, and generating a target data report. According to the method and the device, the target data template is generated based on the requirements of the user, the target chart is selected based on the requirements of the user, the personalized generation of the business analysis data report is achieved, meanwhile, the timeliness of the data report for business analysis is improved, and the effectiveness of the data report is guaranteed.
Fig. 4 is a flowchart illustrating a data table generating method according to another embodiment of the disclosure. To better understand the above embodiments, a process of mapping the target data template to the target graph based on the dimension field and the index field to generate the target data report can be explained with reference to fig. 4. As shown in fig. 4, the data table generating method includes the following steps:
s401, extracting target data corresponding to the dimension field from the target data template.
In the embodiment of the present disclosure, data corresponding to the dimension field in the target data template is target data, and taking the number of different types of trees in the statistical fixed range as an example, in this example, the dimension field is a type of tree, and the target data corresponding to the dimension field is tree a, tree B, and tree C.
In the embodiment of the present disclosure, the number of different types of trees in the statistical fixed range provided in the above embodiment is taken as an example, and in this example, the index field is the number of trees.
S402, processing the target data according to the function expression of the index field to generate index data.
Further, when each index field has a corresponding function expression, after the index field is selected, the corresponding function expression is also determined, and after the target data is obtained, the target data can be analyzed based on the function expression of the index field to generate the index data.
For example, the Function expression of the index field is set as a SUM Function (SUM), the target data is summed according to the definition of the Function expression, and the summed summarized data is index data corresponding to the index field. Still taking the number of different types of trees within the statistical fixed range provided in the above embodiment as an example, in this example, the target data corresponding to the dimension field is the tree a, the tree B, and the tree C, in order to obtain the number of the various types of trees, statistical analysis needs to be performed on the details of the tree a, the tree B, and the tree C, the details of the tree a, the tree B, and the tree C are summed according to the definition of the functional expression SUM function, and then the index data is obtained that the number of the trees a is 100, the number of the trees B is 80, and the number of the trees C is 150.
And S403, mapping the target data and the index data to a target chart to generate a target data report.
The target graph can be based on the change relation between the numerical value of the image presentation data and the numerical value, and after the data content corresponding to the target data and the index data is obtained in the process of mapping the target data and the index data to the target graph, the data mapping position corresponding to the target data and the index data needs to be confirmed to generate a target data report.
Optionally, mapping the target data and the index data into a target graph, further includes: by performing semantic analysis on each element on the target image, the mapping position of the dimension field, i.e. the first position of the dimension field in the target diagram, can be identified based on the semantic analysis. Further, a second position of the indicator field in the target graph may also be identified. And after the respective positions are obtained, mapping the responses according to the requirements of the target graph.
For example, taking the histogram as an example, the first position mapped by the dimension field is a coordinate axis of the histogram, and the second position mapped by the index field is a position of a single histogram in the histogram. For another example, taking a line graph as an example, the dimension field may be the abscissa of the line graph, that is, the tree type, and the second position mapped by the index field is the ordinate, which is the number of trees.
For better understanding of the above embodiments, examples are combined, such as setting a geometric growth rate of the business sales volume of each month of the month of which the statistical year N is based on the year M and a variation trend between the months. In the target data template, the dimension field is month, the index field is monthly sales total, and the function expression of the index field is a same-ratio function. And setting the selected line graph as a target graph.
The target data extracted from the dimension field is 1 month to 12 months, and the monthly sales totals of the respective months of 1 month to 12 months of two years are corresponded from the index field, as shown in table 2.
According to the definition of a year function, the monthly total sales of each month from 1 month to 12 months of two years are calculated and analyzed, the year percentage value of each month from 1 month to 12 months of the year is obtained, the index data are mapped into the selected broken line graph, the mapping position of the target data from 1 month to 12 months is the X axis of the coordinate axis, the year percentage numerical mapping position of the index data is the node corresponding to each month of the broken line graph, and then the year N year-based monthly service total sales percentage same-ratio growth rate broken line graph based on the year M shown in the figure 5 is generated.
TABLE 2
Figure BDA0002908285400000111
The data report generation method comprises the steps of obtaining a data table based on a synchronous request, associating the data table to generate a data table view, processing the data table view according to configuration information to further generate a target data template, selecting the target diagram based on requirements, determining target data corresponding to a dimension field in the target data template, a first mapping position, data corresponding to an index field and a second mapping position, mapping according to the respective positions, and further generating a target data report. According to the method and the device, the mapping operation is carried out based on the mapping positions of the target data and the index data, the mapping accuracy is effectively guaranteed, and the accuracy and the effectiveness of generating the target data report are further guaranteed.
Fig. 6 is a flowchart illustrating a data table generating method according to another embodiment of the disclosure. As shown in fig. 6, the data table generating method includes the steps of:
s601, determining a target data providing end to be inquired according to the data storage path in the data synchronization request.
The data synchronization request may include a storage path of the required data, data requirement information, a login account and a password of a platform where the data is stored, and the like, and the data required by the target data table generation is stored on different data storage platforms respectively.
In the embodiment of the disclosure, the report generation platform queries and confirms the target data providing end where the data to be synchronized is located according to the data storage path in the data synchronization request, and then sends the data synchronization request to the target data providing end.
S602, at least one data table is obtained from the target data providing terminal according to the query field and the query condition in the data synchronization request.
In the embodiment of the disclosure, the data synchronization request includes the query field and the query condition, and the report generation platform can acquire the data table according to the query field and the query condition.
The query field may be, but is not limited to, keywords, numerical values, and other similar information, such as sales, search volume, on-demand volume, and the like; the query condition may be, but is not limited to, a time condition, a region condition, and the like, such as a last week, a last month, north of Qinling mountain, and the like.
And the report generation platform screens and acquires the target data from the target data providing end according to the query field and the range limited by the query condition, and synchronizes to the report generation platform.
In the embodiment of the disclosure, by configuring the data synchronization process, data of the relationship can be acquired without other research and development personnel, and the speed and accuracy of data table generation are further improved.
S603, acquiring the configuration information of the data tables, processing at least one data table based on the configuration information, and generating a target data template.
S604, responding to the report generation instruction, calling a report generation page, and determining a target chart from the candidate charts displayed in the page based on the monitored selection operation.
And S605, mapping the target data template and the target chart to generate a target data report.
The steps S603-S605 can refer to the related contents, and are not described herein again.
The data report generation method comprises the steps of confirming a target data providing end according to a data storage path in a data synchronization request, screening and obtaining at least one data table from target data based on a query field and a query condition, generating a target data template according to configuration information, selecting the target data template based on requirements, mapping the target data template to the target data template, and further generating a target data report. According to the data table synchronization method and device, the data table is obtained based on the data storage path and the query condition carried by the data synchronization request, the accuracy of the data table and the degree of conformity with user requirements are guaranteed, and the effectiveness of the target data report is further guaranteed.
Fig. 7 is a flowchart illustrating a data table generating method according to another embodiment of the disclosure. As shown in the figure, the data table generating method includes the following steps:
s701, obtaining the scheduling configuration information, and generating a scheduling strategy based on the scheduling configuration information.
The scheduling configuration information may be time granularity, such as day, hour, minute, and the like, after the client acquires the scheduling configuration information, a scheduling policy is generated according to the content of the configuration information, and the target data report can be updated according to a specified frequency based on the scheduling policy.
In the embodiment of the disclosure, the report generation platform is provided with a scheduling configuration page, a user can automatically check and define configuration information on the scheduling configuration page, and the report generation platform generates a scheduling strategy according to the scheduling configuration information selected by the user.
The scheduling policy may be an update frequency of the data table or an update time of the data table.
S702, based on the scheduling policy, obtaining the update data of at least one data table from the data providing terminal.
And the report generation platform screens and acquires the updated data from the data providing end where the data table is located based on the scheduling strategy.
In the embodiment of the disclosure, after the report generation platform acquires the scheduling policy, according to the data synchronization request generated by the target data template, the related contents such as the storage path, the query field, the query condition, and the like of the data to be updated of the data table are acquired, and based on the scheduling policy, the latest data source meeting the requirement is screened from the data platform where the data providing end of the data to be updated of the data table is located, so as to acquire at least one data table update data.
S703, generating at least one updated data table based on the respective updated data of the at least one data table.
Acquiring required updating data of the data table, wherein the updating data comprises a dimension field and an index field, extracting data corresponding to the dimension field for updating first data, extracting data corresponding to the index field and processing the extracted data according to a function expression for updating the index data, and mapping the data for updating the first data and the data for updating the index data into a target chart according to a first position and a second position so as to complete updating of the data table.
The data table generating method provided by the disclosure generates a scheduling strategy based on scheduling configuration information, acquires updating data of a data table according to the scheduling strategy, and further generates an updated data table. According to the method and the device, the scheduling configuration information is defined by a user, the updating of the data table is completed according to the scheduling strategy, and the timeliness of the data in the target data report is effectively guaranteed.
To better understand the data table generating method proposed in the above embodiment, fig. 8 is a schematic flow chart of a data table generating method according to another embodiment of the present disclosure. As shown in fig. 8, the data table generating method includes:
and S801, synchronizing data.
In the embodiment of the disclosure, the client acquires a request for data synchronization and acquires at least one data table based on the request for data synchronization.
And S802, generating a data model.
In the embodiment of the disclosure, a data table view is generated by associating a data table, format processing is performed on the data table view according to a data format contained in data table configuration information, and then a target data model is generated based on the data table configuration information containing a dimension field and an index field.
And S803, generating a report.
In the embodiment of the disclosure, the target diagram is selected on the data report generation page, and the target data model is mapped into the target diagram to generate the target data report.
And S804, representing the layer.
In the embodiment of the present disclosure, the presentation layer may be understood as a presentation layer of the client, and the generated target data report is presented to the user in this area.
And S805, scheduling data.
In the embodiment of the disclosure, scheduling can update the target data report, acquire scheduling configuration information, generate a scheduling policy, then acquire updated data of the data table based on the scheduling policy, and further complete updating and generating the updated report.
The data report generation method provided by the disclosure acquires at least one data table based on a data synchronization request, generates a target data template according to data table configuration information, selects a target chart, and maps the target data template into the target chart to generate a target data report. And generating a scheduling strategy based on the acquired scheduling configuration information, acquiring data table updating data according to the scheduling strategy, and further completing the data updating of the target data report. According to the method and the device, different target data reports are generated based on user-defined check, different customizations based on different requirements can be achieved, data stored by other platforms are called, resource sharing and resource utilization maximization are achieved, operation is simple, non-research and development personnel can obtain the business analysis data reports by themselves, research and development cost and communication cost are reduced, and timeliness and accuracy of the non-research and development personnel in data obtaining are further improved.
Corresponding to the data report generation methods proposed by the above several embodiments, an embodiment of the present disclosure also proposes a data report generation device, and since the data report generation device proposed by the embodiment of the present disclosure corresponds to the data report generation methods proposed by the above several embodiments, the embodiments of the data report generation method are also applicable to the data report generation device proposed by the embodiment of the present disclosure, and will not be described in detail in the following embodiments.
To implement the foregoing embodiments, the present disclosure provides a data report generating device, as shown in fig. 9, fig. 9 is a schematic structural diagram of the data report generating device according to an embodiment of the present disclosure, and the data report generating device 900 includes a first obtaining module 91, a second obtaining module 92, a chart obtaining module 93, and a generating module 94, where:
a first obtaining module 91, configured to obtain a data synchronization request, and obtain at least one data table based on the data synchronization request;
a second obtaining module 92, configured to obtain configuration information of the data tables, and process at least one data table based on the configuration information, so as to generate a target data template;
the graph obtaining module 93 is configured to invoke a report generation page in response to a report generation instruction, and determine a target graph from candidate graphs displayed in the page based on monitored selection operations;
and the generating module 94 is configured to map the target data template with the target graph to generate a target data report.
The data table generating device provided by the present disclosure acquires at least one data table based on a data synchronization request, processes the data table according to configuration information of the acquired data table, and generates a target data template. And responding to the report generation instruction, selecting a target chart, mapping the target data template to the target chart, and further generating a target data report.
Fig. 10 is a schematic structural diagram of a data table generating apparatus according to another embodiment of the present disclosure, and as shown in fig. 10, the data table generating apparatus 1000 includes a first obtaining module 11, a second obtaining module 12, a table obtaining module 13, a generating module 14, a scheduling configuration module 15, a data updating module 16, and a table updating module 17.
It should be noted that the first obtaining module 91, the second obtaining module 92, the graph obtaining module 93, and the generating module 94 have the same structure and function as the first obtaining module 11, the second obtaining module 12, the graph obtaining module 13, and the generating module 14.
The data table generating device provided in the embodiment of the present disclosure, the second obtaining module 12, includes:
the association unit 121 is configured to determine a data table to be associated, associate the data table to be associated according to an association expression in the configuration information, and generate a data table view;
a format processing unit 122, configured to perform format processing on data in the data table view according to the data format in the configuration information;
and the configuration unit 123 is configured to add the dimension field and the index field in the configuration information to the graphical view to generate the target data template.
The data table generating device provided by the embodiment of the present disclosure, the generating module 14, includes:
a loading unit 141, configured to load the target data template into a page;
and the mapping unit 142 is configured to map the target data template to the target graph based on the dimension field and the index field, so as to generate a target data report.
Wherein, the mapping unit 142 further includes:
an extracting subunit 1421, configured to extract target data corresponding to the dimension field from the target data template;
an index generation subunit 1422, configured to process the target data according to the function expression of the index field, and generate index data;
and a mapping subunit 1423, configured to map the target data and the indication data into the target graph, so as to generate a target data report.
Wherein, the mapping subunit 1423 is further configured to: acquiring a first position where a dimension field in a target graph is located; acquiring a second position where the index field in the target chart is located; and mapping the target data to a first position, and mapping the index data to a second position to generate a target data report.
The data table generating device provided in the embodiment of the present disclosure, the first obtaining module 11, includes:
the query unit 111 is configured to determine a target data provider to be queried according to a data storage path in the data synchronization request;
the obtaining unit 112 is configured to obtain at least one data table from the target data provider according to the query field and the query condition in the data synchronization request.
The data table generating device provided in the embodiment of the present disclosure further includes a scheduling configuration module 15, a data updating module 16, and a table updating module 17, where:
the scheduling configuration module 15 is configured to obtain scheduling configuration information, and generate a scheduling policy based on the scheduling configuration information;
a data updating module 16, configured to obtain update data of at least one data table from a data providing end based on a scheduling policy;
and a table updating module 17, configured to generate at least one updated data table based on respective update data of the at least one data table.
The data report generation device provided by the disclosure acquires at least one data table based on a data synchronization request, generates a target data template according to data table configuration information, selects a target chart, and maps the target data template into the target chart to generate a target data report. And generating a scheduling strategy based on the acquired scheduling configuration information, acquiring data table updating data according to the scheduling strategy, and further completing the data updating of the target data report. According to the data report form management method and device, research and development cost and communication cost are reduced, and timeliness and accuracy of data report forms obtained by non-research and development personnel are further improved.
The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.
FIG. 11 shows a schematic block diagram of an example electronic device 1100 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 11, the device 1100 comprises a computing unit 1101, which may perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM)1102 or a computer program loaded from a storage unit 1108 into a Random Access Memory (RAM) 1103. In the RAM 1103, various programs and data necessary for the operation of the device 1100 may also be stored. The calculation unit 1101, the ROM1102, and the RAM 1103 are connected to each other by a bus 1104. An input/output (I/O) interface 1105 is also connected to bus 1104.
A number of components in device 1100 connect to I/O interface 1105, including: an input unit 1106 such as a keyboard, a mouse, and the like; an output unit 1107 such as various types of displays, speakers, and the like; a storage unit 1108 such as a magnetic disk, optical disk, or the like; and a communication unit 1109 such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 1109 allows the device 1100 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.
The computing unit 1101 can be a variety of general purpose and/or special purpose processing components having processing and computing capabilities. Some examples of the computing unit 1101 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and the like. The calculation unit 1101 performs the respective methods and processes described above, such as the data table generation method. For example, in some embodiments, the data table generation method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 1108. In some embodiments, part or all of the computer program may be loaded and/or installed onto device 1100 via ROM1102 and/or communication unit 1109. When a computer program is loaded into RAM 1103 and executed by computing unit 1101, one or more steps of the data table generation method described above may be performed. Alternatively, in other embodiments, the computing unit 1101 may be configured to perform the data report generation method by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), the internet, and blockchain networks.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The service end can be a cloud Server, also called a cloud computing Server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service (Virtual Private Server, or VPS for short). The server can also be a server of a distributed system or a server combined with a block chain
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel or sequentially or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.
The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.

Claims (17)

1. A data report generation method comprises the following steps:
acquiring a data synchronization request, and acquiring at least one data table based on the data synchronization request;
acquiring configuration information of the data tables, and processing the at least one data table based on the configuration information to generate a target data template;
responding to a report generation instruction, calling a report generation page, and determining a target chart from candidate charts displayed in the page based on monitored selection operation;
and mapping the target data template and the target chart to generate a target data report.
2. The data table generation method of claim 1, wherein the processing the at least one data table based on the configuration information to generate a target data template comprises:
determining a data table needing to be associated, and associating the data table needing to be associated according to an associated expression in the configuration information to generate a data table view;
according to the data format in the configuration information, carrying out format processing on the data in the data table view;
and adding the dimension field and the index field in the configuration information to the data table view to generate the target data template.
3. The data report generation method according to claim 2, wherein said mapping said target data template with said target graph to generate a target data report comprises:
loading the target data template to the page;
and mapping the target data template to the target chart based on the dimension field and the index field to generate the target data report.
4. The data report generation method of claim 3, wherein said mapping said target data template into said target graph based on said dimension field and said indicator field to generate said target data report comprises:
extracting target data corresponding to the dimension field from the target data template;
processing the target data according to the function expression of the index field to generate index data;
and mapping the target data and the index data to the target chart to generate the target data report.
5. The data report generation method of claim 4, wherein said mapping said target data and said target data into said target graph to generate said target data report comprises:
acquiring a first position where a dimension field in the target chart is located;
acquiring a second position of an index field in the target chart;
and mapping the target data to the first position, and mapping the index data to the second position to generate the target data report.
6. The data table generation method of any of claims 1-5, wherein the retrieving at least one data table based on the data synchronization request comprises:
determining a target data providing end to be inquired according to a data storage path in the data synchronization request;
and acquiring the at least one data table from the target data providing end according to the query field and the query condition in the data synchronization request.
7. The data table generation method of any of claims 1-5, further comprising:
acquiring scheduling configuration information, and generating a scheduling strategy based on the scheduling configuration information;
acquiring the updating data of the at least one data table from the data providing terminal based on the scheduling strategy;
and generating the at least one updated data table based on the updating data of the at least one data table.
8. A datagram table generation apparatus comprising:
the first acquisition module is used for acquiring a data synchronization request and acquiring at least one data table based on the data synchronization request;
the second acquisition module is used for acquiring the configuration information of the data tables, processing the at least one data table based on the configuration information and generating a target data template;
the graph selecting module is used for responding to a report generating instruction, calling a report generating page and determining a target graph from candidate graphs displayed in the page based on monitored selecting operation;
and the generation module is used for mapping the target data template and the target chart to generate a target data report.
9. The data table generating apparatus of claim 8, wherein the second obtaining module comprises:
the association unit is used for determining the data sheet needing to be associated, associating the data sheet needing to be associated according to the association expression in the configuration information and generating a data sheet view;
the format processing unit is used for carrying out format processing on the data in the data table view according to the data format in the configuration information;
and the configuration unit is used for adding the dimension field and the index field in the configuration information to the graphical view so as to generate the target data template.
10. The data table generating device of claim 9, wherein the generating module comprises:
a loading unit, configured to load the target data template to the page;
and the mapping unit is used for mapping the target data template to the target chart based on the dimension field and the index field so as to generate the target data report.
11. The data table generating apparatus of claim 10, wherein the mapping unit comprises:
the extraction subunit is used for extracting the target data corresponding to the dimension field from the target data template;
the index generation subunit is used for processing the target data according to the function expression of the index field to generate index data;
and the mapping subunit is used for mapping the target data and the index data to the target chart so as to generate the target data report.
12. The data table generation apparatus of claim 11, wherein the mapping subunit is further configured to:
acquiring a first position where a dimension field in the target chart is located;
acquiring a second position of an index field in the target chart;
and mapping the target data to the first position, and mapping the index data to the second position to generate the target data report.
13. The data table generation apparatus of any of claims 8-12, wherein the first obtaining module comprises:
the query unit is used for determining a target data providing end to be queried according to the data storage path in the data synchronization request;
and the acquisition unit is used for acquiring the at least one data table from the target data providing end according to the query field and the query condition in the data synchronization request.
14. A data table generating device according to any of claims 8-12, further comprising:
the scheduling configuration module is used for acquiring scheduling configuration information and generating a scheduling strategy based on the scheduling configuration information;
a data updating module, configured to obtain update data of the at least one data table from the data providing end based on the scheduling policy;
a table updating module, configured to generate the at least one updated data table based on the update data of the at least one data table.
15. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method recited in any one of claims 1-7.
16. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-7.
17. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-7.
CN202110078168.4A 2021-01-20 2021-01-20 Data report generation method and device, electronic equipment and storage medium Pending CN114818635A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110078168.4A CN114818635A (en) 2021-01-20 2021-01-20 Data report generation method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110078168.4A CN114818635A (en) 2021-01-20 2021-01-20 Data report generation method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN114818635A true CN114818635A (en) 2022-07-29

Family

ID=82524221

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110078168.4A Pending CN114818635A (en) 2021-01-20 2021-01-20 Data report generation method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114818635A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115470754A (en) * 2022-09-19 2022-12-13 北京火山引擎科技有限公司 Data analysis method and device, computer readable medium and electronic equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115470754A (en) * 2022-09-19 2022-12-13 北京火山引擎科技有限公司 Data analysis method and device, computer readable medium and electronic equipment

Similar Documents

Publication Publication Date Title
CN107102941B (en) Test case generation method and device
WO2021147559A1 (en) Service data quality measurement method, apparatus, computer device, and storage medium
CA3089097C (en) Domain-based search engine
CN112818230B (en) Content recommendation method, device, electronic equipment and storage medium
CN115640300A (en) Big data management method, system, electronic equipment and storage medium
CN113407749B (en) Picture index construction method and device, electronic equipment and storage medium
CN110874366A (en) Data processing and query method and device
CN114818635A (en) Data report generation method and device, electronic equipment and storage medium
EP4216076B1 (en) Method and apparatus of processing an observation information, electronic device and storage medium
EP4116889A2 (en) Method and apparatus of processing event data, electronic device, and medium
CN105512270A (en) Method and device for determining related objects
CN115794744A (en) Log display method, device, equipment and storage medium
CN115408236A (en) Log data auditing system, method, equipment and medium
CN114661918A (en) Knowledge graph construction method and device, storage medium and electronic equipment
CN114416772A (en) Data query method and device, electronic equipment and storage medium
CN113742501A (en) Information extraction method, device, equipment and medium
CN113485763A (en) Data processing method and device, electronic equipment and computer readable medium
KR102041915B1 (en) Database module using artificial intelligence, economic data providing system and method using the same
KR102594204B1 (en) Server for providing graph of stock investment information and method thereof
CN115858325B (en) Project log adjusting method, device, equipment and storage medium
EP4187431A1 (en) Address identification method and apparatus, electronic device, and storage medium
CN116737792A (en) Method, device, equipment and storage medium for data integration
CN116975396A (en) Intelligent recommendation method, system, equipment and storage medium for government service
CN115458103A (en) Medical data processing method and device, electronic equipment and readable storage medium
CN113095788A (en) Question distribution method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination