CN114218336A - Data warehouse visual chart display method, device and equipment - Google Patents
Data warehouse visual chart display method, device and equipment Download PDFInfo
- Publication number
- CN114218336A CN114218336A CN202111556779.1A CN202111556779A CN114218336A CN 114218336 A CN114218336 A CN 114218336A CN 202111556779 A CN202111556779 A CN 202111556779A CN 114218336 A CN114218336 A CN 114218336A
- Authority
- CN
- China
- Prior art keywords
- data
- development
- data warehouse
- target
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
- G06F16/287—Visualization; Browsing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a method, a device and equipment for displaying visual charts of a data warehouse. According to the method and the device, the user development requirement information can be acquired through the target front-end tool; determining development data distributed in a plurality of databases from a preset data source according to development demand information; and carrying out multidimensional analysis on the development data to generate a multidimensional model of the data warehouse, establishing a corresponding relation between the model and a preset data source to generate a target data warehouse, and then displaying a visual chart page corresponding to the target data warehouse through a target front-end tool. The multi-dimensional analysis module corresponding to the target data warehouse is developed according to the user development requirement information acquired by the target front-end tool, visual display is carried out, the user can conveniently and visually know whether the developed data warehouse meets the self requirement or not, timely modification before delivery is facilitated, accordingly, the workload is prevented from being excessively increased, and the delivery progress of the target data warehouse is accelerated.
Description
Technical Field
The application belongs to the technical field of computers, and particularly relates to a method, a device and equipment for displaying a visual chart of a data warehouse.
Background
The traditional data warehouse project development mode has the problems of long development period and complex release flow, and the problems that the finished product does not completely meet the requirements of customers and the like due to difficult change after the project requirements are completed and low customer participation degree. Taking waterfall type development as an example, waterfall type development is the most representative traditional development mode, and follows the development flow from top to bottom, and the specific flow sequentially comprises six stages of demand collection, demand analysis, design, development, test, delivery and the like. If the previous stage is not completed, the next stage is difficult to enter, and the client only participates in the project in the demand collection and delivery stage, so that the client is dissatisfied with the product during delivery and needs to enter the waterfall model again, and the project delivery delay can be caused while the workload is increased.
Disclosure of Invention
The embodiment of the application provides a method, a device and equipment for displaying visual charts of a data warehouse, which can improve the participation of customers and facilitate the completion of development according to the requirements of users.
On one hand, the embodiment of the application provides a method for displaying a visual chart of a data warehouse, which comprises the following steps:
acquiring user development demand information through a target front-end tool;
determining development data from a preset data source according to development demand information, wherein the development data are distributed in a plurality of databases;
carrying out multi-dimensional analysis on development data distributed in a plurality of databases to generate a data warehouse multi-dimensional model;
establishing a corresponding relation between the data warehouse multi-dimensional model and the preset data source to generate a target data warehouse;
and displaying a visual chart page corresponding to the target data warehouse through the target front-end tool.
In some embodiments, the target front-end tool has a visualization interface,
through the target front-end tool, acquiring the user development requirement information, including:
inputting corresponding parameter information according to the data parameter items provided by the visual interface;
and determining the parameter information as user development requirement information.
In some embodiments, the predetermined data source includes one or more of a database table, an SQL dataset, an Excel dataset, and an analysis table;
determining development data from a preset data source according to the development demand information, wherein the method comprises the following steps:
extracting corresponding demand data from a preset data source according to development demand information through a data warehouse tool called by a target front-end tool;
converting the structure of the demand data to obtain intermediate demand data;
and loading the intermediate demand data into a corresponding database to form development data.
In some embodiments, the target front-end tool is embedded with an online analytical processing tool,
carrying out multi-dimensional analysis on development data distributed in a plurality of databases to generate a data warehouse multi-dimensional model, wherein the multi-dimensional model comprises the following steps:
carrying out multi-dimensional analysis on the development data in the databases through an online analysis processing tool to obtain a plurality of single-dimensional data;
and fusing a plurality of single-dimensional data to generate a data warehouse multi-dimensional model.
In some embodiments, performing multidimensional analysis on development data in a plurality of databases by an online analysis processing tool to obtain a plurality of single-dimensional data comprises:
after the development data in the databases are gathered through the online analysis processing tool, slicing or dicing is carried out according to the target dimension, and a plurality of corresponding single-dimensional data are obtained.
In some embodiments, fusing a plurality of single-dimensional data to generate a data warehouse multi-dimensional model comprises:
and after the plurality of single-dimensional data are rotated, drilling down according to a user-defined fusion rule to generate the data warehouse multi-dimensional model.
In some embodiments, the displaying the visual chart page corresponding to the target data warehouse by the target front-end tool includes:
converting multi-dimensional data accessed by a target data warehouse into a visual instrument panel and/or a report form through a preset data model; the multidimensional data is determined according to a corresponding relation established with the preset data source;
and displaying the page of the visual dashboard and/or report through the visual interface.
In some embodiments, after displaying the visualization chart page corresponding to the target data warehouse, the method includes:
acquiring user requirement modification information, wherein the user requirement modification information is determined according to a visual chart page;
and according to the requirement modification information, returning to execute the step of determining development data from the preset data source until the corresponding visual chart page is generated again.
In another aspect, an embodiment of the present application provides a data warehouse visual chart display apparatus, including:
the first acquisition module is used for acquiring the development requirement information of the user through a target front-end tool;
the first determining module is used for determining development data from a preset data source according to the development demand information, and the development data are distributed in a plurality of databases;
the first generation module is used for carrying out multi-dimensional analysis on development data distributed in a plurality of databases to generate a data warehouse multi-dimensional model;
the second generation module is used for establishing a corresponding relation between the data warehouse multi-dimensional model and the preset data source to generate a target data warehouse;
and the first display module is used for displaying a visual chart page corresponding to the multi-dimensional model of the target data warehouse through the target front-end tool.
In another aspect, an embodiment of the present application provides a visualization chart display device for a data warehouse, where the device includes: a processor and a memory storing computer program instructions;
a processor, when executing computer program instructions, implements a data warehouse visualization chart display method as described in an aspect.
In yet another aspect, the present application provides a computer storage medium having computer program instructions stored thereon, where the computer program instructions, when executed by a processor, implement a data warehouse visualization chart display method according to an aspect.
In yet another aspect, the present application provides a computer program product, and when executed by a processor of an electronic device, the instructions enable the electronic device to perform a data warehouse visualization chart display method according to an aspect.
According to the data warehouse visual chart display method, the data warehouse visual chart display device, the data warehouse visual chart display equipment and the computer storage medium, user development requirement information can be acquired through a target front-end tool; determining development data from a preset data source according to development demand information, wherein the development data are distributed in a plurality of databases; carrying out multi-dimensional analysis on development data distributed in a plurality of databases to generate a data warehouse multi-dimensional model; and establishing a corresponding relation between the data warehouse multi-dimensional model and the preset data source to generate a target data warehouse, and then displaying a visual chart page corresponding to the data warehouse multi-dimensional model through a target front-end tool. The multi-dimensional analysis module corresponding to the target data warehouse is developed according to the user development requirement information acquired by the target front-end tool, visual display is carried out, the user can conveniently and visually know whether the developed data warehouse meets the self requirement or not, timely modification before delivery is facilitated, accordingly, the workload is prevented from being excessively increased, and the delivery progress of the target data warehouse is accelerated.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments of the present application will be briefly described below, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic flow chart diagram of a data warehouse visualization chart display method according to an embodiment of the present application;
FIG. 2 is a schematic illustration of slicing and dicing of data in one embodiment of the present application;
FIG. 3 is a schematic illustration of data rotation performed in another embodiment of the present application;
FIG. 4 is a schematic illustration of data drilling down in yet another embodiment of the present application;
FIG. 5 is a schematic flow chart diagram illustrating a method for displaying visual charts of a data warehouse according to another embodiment of the present application;
FIG. 6 is a schematic diagram of a data warehouse visual chart display apparatus according to yet another embodiment of the present application;
fig. 7 is a schematic structural diagram of a data warehouse visualization chart display device according to another embodiment of the present application.
Detailed Description
Features and exemplary embodiments of various aspects of the present application will be described in detail below, and in order to make objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are intended to be illustrative only and are not intended to be limiting. It will be apparent to one skilled in the art that the present application may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present application by illustrating examples thereof.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The traditional development mode, especially the development process from top to bottom like the waterfall model, needs to be performed in sequence according to the process stages strictly, so that if the previous stage is not completed, the next stage is difficult to start, which causes a problem in the progress of the whole project if one stage is in problem. And because the traditional mode generally acquires the user requirements through a offline communication mode, for non-professional users, the often expressed requirement information is inconsistent with the actual requirement data warehouse product, the probability of changing the requirements of the customers is increased, so that the development mode which cannot flexibly face the change of the customer requirements is caused, and the development progress is difficult to advance when the customer requirements change. For example, customers have changed requirements as the project progresses through the development or testing stages, project groups have to re-analyze requirements, data, development, testing, project cost escalation, and user satisfaction.
Moreover, the traditional method is only suitable for a single development scene with small data volume, and needs to spend more time to complete the requirement in the face of a large amount of multi-dimensional data. For example, conventional data development generally uses EXCEL data analysis tables, or uses SQL (Structured Query Language) statements to extract desired data from a database, such data sources run slowly and waste time when faced with large amounts of data.
In order to solve the prior art problems, embodiments of the present application provide a method, an apparatus, a device, and a computer storage medium for displaying a visual chart of a data warehouse. First, a method for displaying a visual chart of a data warehouse provided by the embodiment of the present application is described below. And it should be understood that the technical solution of the present application, such as obtaining, storing, using, processing, etc., of data all conform to relevant regulations of national laws and regulations.
Fig. 1 is a flowchart illustrating a data warehouse visualization chart display method according to an embodiment of the present application. As shown in fig. 1, the method includes steps S110 to S150:
and S110, acquiring the development requirement information of the user through a target front-end tool.
Illustratively, the target front-end tool may be a BI (Business Intelligence) front-end tool.
The target front-end tool provides relevant requirement parameters for the standardized data warehouse project development, so that a user can conveniently determine the development requirement information of the user according to the standardized relevant requirement parameters provided by the current front-end tool, and the accuracy of determining the customer requirement is improved compared with a traditional offline determination mode.
It should be understood that, in the embodiment of the present application, the user may be a demand side or an application side of the target data warehouse.
And S120, determining development data from a preset data source according to the development requirement information of the user, wherein the development data are distributed in a plurality of databases.
The preset data source can comprise internal data and external data, wherein the internal data can comprise related data generated by the internal operation of the user; the external data may include data crawled through web crawlers from big data servers or the internet. Such as business data related to the user's business, filtered from a predetermined data source.
And screening development data which are useful for developing a target data warehouse from a preset data source according to the development requirement information of the user, wherein the development data can be distributed in different databases. Moreover, the development data distributed in different databases may have different dimension attributes, such as time dimension, region dimension, category dimension, and the like, and one database may store development data corresponding to only one dimension.
And S130, carrying out multi-dimensional analysis on the development data distributed in the plurality of databases to generate a multi-dimensional model of the data warehouse.
The development data distributed in the databases correspond to different dimensions respectively, and through dimension analysis, the dimensions are associated and combined in a certain mode to generate a multi-dimensional data model serving as the multi-dimensional data model of the data warehouse.
S140, establishing a corresponding relation between the multidimensional model of the data warehouse and the preset data source to generate a target data warehouse;
and S150, displaying a visual instrument panel page corresponding to the multi-dimensional model of the data warehouse through a target front-end tool.
And establishing a corresponding relation between the multidimensional model of the data warehouse and multidimensional data in a preset data source, and accessing the multidimensional data into the multidimensional model of the data warehouse according to the corresponding relation to generate a target data warehouse.
Illustratively, the BI front-end tool has a visualization interface, so that the multidimensional data in the target data warehouse can be converted into a corresponding report or a corresponding dashboard based on the multidimensional data model of the data warehouse, and the corresponding report or a visualization dashboard page can be displayed based on the BI front-end tool for the user to know.
A user can know whether the target data warehouse and the accessed data meet the requirements of the user or not by checking the report or the visual dashboard page, and if not, the user can timely modify the unsatisfactory data before delivery. If so, the target data warehouse may be committed.
According to the data warehouse visual chart display method, user development requirement information can be acquired through a target front-end tool; determining development data from a preset data source according to development demand information, wherein the development data are distributed in a plurality of databases; carrying out multi-dimensional analysis on development data distributed in a plurality of databases to generate a multi-dimensional model of a data warehouse, establishing a corresponding relation between the model and a preset data source to generate a target data warehouse, and then displaying a visual instrument panel page corresponding to the target data warehouse through a target front-end tool. The multi-dimensional analysis module corresponding to the target data warehouse is developed through the user development demand information acquired by the target front-end tool, visual display is performed, the user participation is improved, the user can conveniently and visually know whether the developed data warehouse meets the self demand, timely modification before delivery is facilitated, the workload is prevented from being excessively increased, and the delivery progress of the target data warehouse is accelerated.
In some embodiments, in order to improve the consistency between the requirement expressed by the user and the actual project desired by the user, thereby reducing the possibility of modifying the requirement by the user, optionally, in this embodiment of the application, the target front-end tool has a visualization interface, and some normalized data parameter items related to project development are provided through the visualization interface. Then, in acquiring the user development requirement information through step S110, the method may specifically include steps S111 to S112:
s111, inputting corresponding parameter information according to data parameter items provided by a visual interface;
and S112, determining the parameter information as the user development requirement information.
Because the data parameter items provided by the BI front-end tool are normalized, the parameter information based on input is relatively normalized, the BI front-end tool can conveniently acquire the clear development requirement information of the user, and the accuracy of acquiring the development requirement is improved.
For example, for users in the catering industry, the BI front-end tool provides item parameter items regarding restaurant addresses, restaurant grades, dish prices, and the like. Corresponding parameter information is input based on the item parameter item, for example, the restaurant address is A, B and C, the restaurant grade is 4 star grade, the price of a certain dish is 20 yuan, and the like. And developing a corresponding catering related data warehouse according to the user development demand information so as to judge whether the address field is suitable for business or not by applying the data warehouse.
According to the user development requirement information, the direction of the data warehouse product required by the user can be determined, so that the evaluation on the development feasibility of the product is facilitated, and the generation of invalid development cost is avoided.
In some embodiments, in order to enrich the data of the data source so as to screen more comprehensive available data and speed up development efficiency when the data volume is large, optionally, in the embodiment of the present application, the preset data source may include one or more of a database table, an SQL dataset, an Excel dataset, and an analysis table.
The database table, the SQL dataset, the EXCEL dataset, and the like may be divided into internal data and external data. The internal data source can be data generated by the user corresponding to the internal operation of the company, for example, the catering industry can generate different kinds of data such as daily sales amount, meal sales data volume and the like. The external data source can be data from a big data company or a corresponding web crawler, for example, how many companies similar to the restaurant user want to know in the area, the outside data source is needed, so as to improve the development strategy of the companies.
For example, in the step S120 of determining the development data from the preset data source according to the development requirement information, the method may specifically include steps S121 to S123:
and S121, extracting corresponding demand data from a preset data source according to the user development demand information through a data warehouse tool called by the target front-end tool.
The data warehouse tool may be an ELT (Extraction-Loading-Transformation) tool, and is used for extracting, converting and recording data in a preset data source.
The BI front end tool screens data in a preset data source through an ELT tool according to user development demand information, and extracts data useful for current project development, namely demand data. For example, when developing a data warehouse related to a food and beverage business, demand data related to the food and beverage business is extracted.
S122, converting the structure of the demand data to obtain intermediate demand data;
and S123, loading the intermediate demand data into a corresponding database to form development data.
Before the extracted required data is loaded into the database, the data quality needs to be ensured, that is, the data is accurate, complete and uniform in format, and the existence of repeated data, relation conflict data or outdated data is avoided.
Therefore, the structure of the demand data is transformed and cleaned through step S122, so that the demand data meets the warehousing requirement of the database.
For example, structure transformations may include format transformations on demand data, relationship transformations on demand data, and the like, and cleansing may include deleting inaccurate, incomplete, duplicate, and stale data. And when different data tables are used in a crossed mode, a result table can be formed, and the tables can be used as physical tables to be reserved in the database.
For example, the format conversion can be performed by respectively extracting a part of data useful for project development from the a table and the B table in the demand data, and combining the extracted two parts of data into the C table. And converting the C table into an intermediate database to form a new table, namely intermediate demand data. The data is loaded into a database and can be used as development data for subsequent analysis processing.
The data extracted from the preset data source generally includes data of multiple dimensions, and the formed development data can be correspondingly stored in different databases according to the corresponding dimensions.
In this embodiment, through the strong data processing capabilities of the BI front-end tool and the ELT technology, the data is screened, converted and combined, and the useless data is screened out, so that the time consumed by data analysis can be reduced, and the purpose of rapidly delivering the demand can be achieved.
In some embodiments, in order to quickly create the data warehouse model, in an optional aspect of the present application, the On-Line analysis Processing tool is embedded in the target front-end tool, and the On-Line analysis Processing tool may be an OLAP (On-Line Analytical Processing) tool. Then, the step S130 performs multidimensional analysis on the development data distributed in the multiple databases to generate a multidimensional data warehouse model, which may specifically include steps S131 to S132:
s131, carrying out multi-dimensional analysis on the development data in the databases through an online analysis processing tool to obtain a plurality of single-dimensional data.
The data screened from the preset data source is loaded into different databases, and the BI front-end tool can extract the data in each database and analyze multiple dimensions through OLAP, and combines different dimensions to form a model.
In a traditional development model, Excel or written SQL sentences are mostly adopted to query data in a database, a report is extracted and generated, and a large amount of time is spent on writing the sentences and calculating. Through the OLAP tool, the tool has the capability of dimension analysis and processing, the manual investment can be greatly simplified, and the development process is accelerated.
For example, the BI front-end tool may extract the development data in each database through the OLAP tool, and distinguish the dimension of each development data, for example, distinguish the development data by a time dimension, a region dimension, a category dimension, or a customer group dimension. The dimension of the database development data can be one or more dimensions determined by the user development requirement information.
Therefore, optionally, in step S131, performing multidimensional analysis on the development data in the multiple databases through the online analysis processing tool to obtain multiple single-dimensional data, which may specifically include:
after the development data in the databases are aggregated through the online analysis processing tool, slicing or dicing is carried out on the target dimension according to the target dimension, and a plurality of corresponding single-dimension data are obtained.
After the OLAP tool aggregates the development data in the databases, a data set of a development data heap with multiple dimensions is obtained, and the development data heap is processed according to the target dimension from the target dimension. Wherein if the target dimension is 1, a slicing operation is performed, and if the target dimension is greater than or equal to 2, a slicing operation is performed.
If the aggregated development data comprises N dimensions, any one single-dimension data obtained after one target dimension is sliced according to one dimension is actually a combination of multi-dimension data on the target dimension.
For example, as shown in fig. 2 (2a), the development data 201 includes three type dimensions (a beijing dish type, a xiangcai type, and a cantonese dish type), three time dimensions (three time dimensions of a first quarter, a second quarter, and a third quarter), and three region dimensions (three road segment dimensions of a south road, a north road, and a west road). With the "beijing style" as the target dimension, the single-dimension data 202 shown in (2b) in fig. 2 can be obtained after one-dimensional slicing; the single-dimension data 203 shown in (2c) in fig. 2 can be obtained by performing two-dimensional dicing with the "beijing dish type" and the "xiangcai style" as target dimensions.
And S312, fusing the single-dimensional data to generate a data warehouse multi-dimensional model.
And fusing the obtained single-dimensional data according to the user development requirement information to generate a corresponding data warehouse multi-dimensional model.
Illustratively, S312 may specifically include:
and after the plurality of single-dimensional data are rotated, drilling down according to a user-defined fusion rule to generate the data warehouse multi-dimensional model.
And rotating, namely changing the field sequence in the query statement so as to convert the corresponding relation between the single-dimensional data and other data. For example, in the multiple pieces of single-dimension data 301 shown in (3a) in fig. 3, the type dimension therein is rotated to obtain a data result 302 shown in (3b) in fig. 3.
After the plurality of single-dimensional data are rotated, the fusion rule can be customized according to the development requirement information of the user, and the drilling process is carried out based on the rule. Wherein the drill-down process fuses the data by ignoring certain dimensions. As shown in (4a) in fig. 4, a plurality of single-dimensional data 401 are fused by a user-defined fusion rule according to the user development requirement information to omit data 402 of the "first quarter" dimension, so as to obtain a fused data warehouse multi-dimensional model 403.
The fused data warehouse multi-dimensional model is a result of intersection of data of multiple dimensions, and is applied to analysis of user requirements to obtain a comprehensive and accurate analysis result.
In some examples, based on the visualization interface of the BI front-end tool, the data obtained in each stage step may be displayed based on the visualization interface, and the data may be extracted, converted, or associated and processed by calculation in a manner of dragging a data table, so as to implement flexible and agile project development.
In some embodiments, after the target data warehouse is obtained through S110 to S140, in order to allow the user to intuitively know details of the project development data before the project is delivered, optionally, in this embodiment of the application, a report or a dashboard of the target data warehouse accessed to the multidimensional data may be displayed in real time through a visualization interface of the BI front-end tool. The visual chart page is a visual instrument panel and/or a report page. Specifically, the displaying a visualization chart page corresponding to the target data warehouse through step S150 may specifically include steps S151 to S152:
s151, converting multi-dimensional data accessed by a target data warehouse into a visual instrument panel and/or a report through a preset data model; is determined according to the corresponding relation established with the preset data source;
and S152, displaying the page of the visual instrument panel and/or the report through the visual interface.
The preset data model can be a model used for forming a chart or a page with a certain style, the input of the model is multi-dimensional data accessed by the target data warehouse, and the output of the model is the chart or the page with a corresponding style.
In the embodiment of the application, multi-dimensional data accessed by a target data warehouse is converted through a preset data model to form a visual instrument panel or a report with a corresponding chart, and the visual instrument panel or the report is displayed on a visual interface of a BI front-end tool for a user to know. And the multidimensional data accessed by the target data warehouse is determined according to the corresponding relation established with the preset data source, and the corresponding data is input according to the dimensionality contained in the multidimensional data warehouse model. The multidimensional data may be derived from the predetermined data source.
Because the BI front-end tool acquires and displays the data in real time, the displayed visual instrument panel or report is also real-time, and if a user is unsatisfied with the fusion result of certain data or data in the visual instrument panel or report, the user can timely and accurately carry out special modification.
Optionally, if the user has modification suggestions based on the visual dashboard or report, as shown in fig. 5, the method may further include steps S160 to S170:
s160, acquiring user requirement modification information which is determined according to the visual chart page;
and S170, according to the requirement modification information, returning to execute the step of determining development data from the preset data source until the corresponding visual chart page is generated again.
And determining user requirement modification information according to the visual chart page, returning to the step of iteratively executing the step S120 based on the user requirement modification information, re-acquiring corresponding development data, and analyzing the development data and displaying the model through the steps S130-S150 until the user requirement is met.
And after the user requirements are met, the target data warehouse corresponding to the data warehouse multi-dimensional model can be delivered. The embodiment of the application is based on the BI front-end tool displayed in real time, and is beneficial to timely changing product design, so that the development of re-implementation projects is promoted.
Fig. 6 shows a schematic structural diagram of a data warehouse visual chart display device according to an embodiment of the present application. As shown in fig. 6, the apparatus includes:
a first obtaining module 601, configured to obtain user development requirement information through a target front-end tool;
the first determining module 602 is configured to determine development data from a preset data source according to development requirement information, where the development data are distributed in multiple databases;
the first generating module 603 is configured to perform multidimensional analysis on development data distributed in multiple databases to generate a multidimensional model of a data warehouse;
a second generating module 604, configured to establish a corresponding relationship between the multidimensional model of the data warehouse and the preset data source, and generate a target data warehouse;
the first display module 605 is configured to display, by using the target front-end tool, a visual dashboard page corresponding to the multidimensional model of the data warehouse.
According to the data warehouse visual chart display device, user development requirement information can be acquired through a target front-end tool; determining development data distributed in a plurality of databases from a preset data source according to development demand information; and carrying out multidimensional analysis on the development data to generate a multidimensional model of the data warehouse, establishing a corresponding relation between the model and a preset data source to generate a target data warehouse, and then displaying a visual chart page corresponding to the target data warehouse through a target front-end tool. The multi-dimensional analysis module corresponding to the target data warehouse is developed according to the user development requirement information acquired by the target front-end tool, visual display is carried out, the user can conveniently and visually know whether the developed data warehouse meets the self requirement or not, timely modification before delivery is facilitated, accordingly, the workload is prevented from being excessively increased, and the delivery progress of the target data warehouse is accelerated.
In some embodiments, in order to improve the consistency between the requirement expressed by the user and the actual item desired by the user, thereby reducing the possibility of the user modifying the requirement, the first obtaining module 601 may optionally include:
the input sub-module 6011 is configured to input corresponding parameter information according to the data parameter items provided by the visualization interface;
a first determining submodule 6012, configured to determine the parameter information as the user development requirement information.
In some embodiments, in order to enrich the data of the data source so as to screen more comprehensive available data and speed up development efficiency when the data volume is large, optionally, in the embodiment of the present application, the preset data source may include one or more of a database table, an SQL dataset, an Excel dataset, and an analysis table.
For example, the first determining module 602 may include:
the extraction submodule 6021 is configured to extract corresponding demand data from a preset data source according to the user development demand information through the data warehouse tool called by the target front-end tool;
the first conversion submodule is used for converting the structure of the demand data to obtain intermediate demand data;
and the loading submodule is used for loading the intermediate demand data into the corresponding database to form development data.
In some embodiments, in order to quickly create the data warehouse model, in an optional aspect of the present application, the On-Line analysis Processing tool is embedded in the target front-end tool, and the On-Line analysis Processing tool may be an OLAP (On-Line Analytical Processing) tool. The first generating module 603 may specifically include;
an analysis submodule 6031 configured to perform multidimensional analysis on development data in the multiple databases by using an online analysis processing tool to obtain multiple single-dimensional data;
and the fusion sub-module 6032 is configured to fuse multiple single-dimensional data to generate a data warehouse multi-dimensional model.
Optionally, the analysis submodule 6031 may be specifically configured to:
after the development data in the databases are aggregated through the online analysis processing tool, slicing or dicing is carried out on the target dimension according to the target dimension, and a plurality of corresponding single-dimension data are obtained.
Optionally, the fusion submodule 6032 may be specifically configured to:
after the plurality of single-dimensional data are rotated, drilling down is carried out according to a user-defined fusion rule, and the data warehouse multi-dimensional model is generated
In some embodiments, in order for the user to visually understand details of the project development data before delivering the project, optionally, the first display module 605 may specifically include:
the second conversion submodule 6051 is configured to convert the multidimensional data accessed by the target data warehouse into a visual instrument panel and/or a report through a preset data model;
and the display sub-module 6052 is configured to display a page of the visual dashboard and/or the report through the visual interface.
Optionally, the apparatus may further include:
a second obtaining module 606, configured to obtain user requirement modification information, where the user requirement modification information is determined according to the visual chart page;
and a return execution module 607, configured to return to execute the step of determining development data from the preset data source according to the demand modification information until the corresponding visualization chart page is generated again.
It should be noted that all relevant contents of each step related to the above method embodiment may be referred to the functional description of the corresponding functional module, and the corresponding technical effect can be achieved, and for brevity, no further description is provided herein.
Fig. 7 shows a hardware structure diagram of a data warehouse visualization chart display device according to an embodiment of the present application.
The data warehouse visualization chart display device may include a processor 701 and a memory 702 having stored computer program instructions.
Specifically, the processor 701 may include a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or may be configured to implement one or more Integrated circuits of the embodiments of the present Application.
The memory may include Read Only Memory (ROM), Random Access Memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical, or other physical/tangible memory storage devices. Thus, in general, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software comprising computer-executable instructions and when the software is executed (e.g., by one or more processors), it is operable to perform operations described with reference to the methods according to an aspect of the application.
The processor 701 may read and execute the computer program instructions stored in the memory 702 to implement any one of the data warehouse visual chart display methods in the above embodiments.
In one example, the data warehouse visualization chart display device may also include a communication interface 703 and a bus 710. As shown in fig. 7, the processor 701, the memory 702, and the communication interface 703 are connected by a bus 710 to complete mutual communication.
The communication interface 703 is mainly used for implementing communication between modules, apparatuses, units and/or devices in this embodiment of the application.
In addition, in combination with the data warehouse visualization chart display method in the foregoing embodiment, the embodiment of the present application may provide a computer storage medium to implement. The computer storage medium having computer program instructions stored thereon; the computer program instructions, when executed by a processor, implement any of the data warehouse visual chart display methods in the above embodiments.
Furthermore, the present application further provides a computer program product, where instructions of the computer program product, when executed by a processor of an electronic device, enable the electronic device to execute any one of the data warehouse visual chart display methods in the foregoing embodiments.
It is to be understood that the present application is not limited to the particular arrangements and instrumentality described above and shown in the attached drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present application are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications, and additions or change the order between the steps after comprehending the spirit of the present application.
The functional blocks shown in the above-described structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, plug-in, function card, or the like. When implemented in software, the elements of the present application are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted by a data signal carried in a carrier wave over a transmission medium or a communication link. A "machine-readable medium" may include any medium that can store or transfer information. Examples of a machine-readable medium include electronic circuits, semiconductor memory devices, ROM, flash memory, Erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, Radio Frequency (RF) links, and so forth. The code segments may be downloaded via computer networks such as the internet, intranet, etc.
It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, the present application is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed simultaneously.
Aspects of the present application are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions/acts specified in the flowchart and/or block diagram block or blocks. Such a processor may be, but is not limited to, a general purpose processor, a special purpose processor, an application specific processor, or a field programmable logic circuit. It will also be understood that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware for performing the specified functions or acts, or combinations of special purpose hardware and computer instructions.
As described above, only the specific embodiments of the present application are provided, and it can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the system, the module and the unit described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. It should be understood that the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the present application, and these modifications or substitutions should be covered within the scope of the present application.
Claims (12)
1. A method for displaying visual charts of a data warehouse is characterized by comprising the following steps:
acquiring user development demand information through a target front-end tool;
determining development data from a preset data source according to the user development demand information, wherein the development data are distributed in a plurality of databases;
carrying out multi-dimensional analysis on the development data distributed in the databases to generate a multi-dimensional model of the data warehouse;
establishing a corresponding relation between the data warehouse multi-dimensional model and the preset data source to generate a target data warehouse;
and displaying a visual chart page corresponding to the target data warehouse through the target front-end tool.
2. The method of claim 1, wherein the target front-end tool has a visualization interface,
the method for acquiring the user development requirement information through the target front-end tool comprises the following steps:
inputting corresponding parameter information according to the data parameter items provided by the visual interface;
and determining the parameter information as the user development requirement information.
3. The method according to claim 1, wherein the preset data source comprises one or more of a database table, an SQL dataset, an Excel dataset, and an analysis table;
the determining development data from a preset data source according to the user development requirement information includes:
extracting corresponding demand data from the preset data source according to the user development demand information through a data warehouse tool called by the target front-end tool;
converting the structure of the demand data to obtain intermediate demand data;
and loading the intermediate demand data into a corresponding database to form the development data.
4. The method of claim 2, wherein the target front-end tool is embedded with an online analytical processing tool,
performing multidimensional analysis on the development data distributed in the plurality of databases to generate a multidimensional model of the data warehouse, including:
performing multi-dimensional analysis on the development data in the databases through the online analysis processing tool to obtain a plurality of single-dimensional data;
and fusing the single-dimensional data to generate the data warehouse multi-dimensional model.
5. The method of claim 4, wherein performing a multidimensional analysis on the development data in the plurality of databases by the online analysis processing tool to obtain a plurality of single-dimensional data comprises:
after the development data in the databases are gathered through the online analysis processing tool, slicing or dicing is carried out on the target dimension according to the target dimension, and a plurality of corresponding single-dimension data are obtained.
6. The method of claim 5, wherein the fusing the plurality of single-dimensional data to generate the data warehouse multi-dimensional model comprises:
and after the plurality of single-dimensional data are rotated, drilling down according to a user-defined fusion rule to generate the data warehouse multi-dimensional model.
7. The method according to any one of claims 2 to 5, wherein the visualization chart page is a visualization dashboard and/or report page, and the displaying the visualization chart page corresponding to the target data warehouse by the target front-end tool comprises:
converting the multi-dimensional data accessed by the target data warehouse into a visual instrument panel and/or a report form through a preset data model; the multidimensional data is determined according to a corresponding relation established with the preset data source;
and displaying the page of the visual instrument panel and/or the report through the visual interface.
8. The method of claim 1, wherein after said displaying a visualization chart page corresponding to the target data warehouse, the method comprises:
acquiring user requirement modification information which is determined according to the visual chart page;
and according to the user requirement modification information, returning to execute the step of determining development data from the preset data source until the corresponding visual chart page is generated again.
9. A data warehouse visual chart display apparatus, the apparatus comprising:
the first acquisition module is used for acquiring the development requirement information of the user through a target front-end tool;
the first determining module is used for determining development data from a preset data source according to the user development demand information, and the development data are distributed in a plurality of databases;
the first generation module is used for carrying out multi-dimensional analysis on the development data distributed in the databases to generate a multi-dimensional model of the data warehouse;
the second generation module is used for establishing a corresponding relation between the data warehouse multi-dimensional model and the preset data source to generate a target data warehouse;
and the first display module is used for displaying a visual chart page corresponding to the target data warehouse through the target front-end tool.
10. A data warehouse visualization chart display apparatus, the apparatus comprising: a processor and a memory storing computer program instructions;
the processor, when executing the computer program instructions, implements the data warehouse visualization chart display method of any of claims 1-8.
11. A computer storage medium having computer program instructions stored thereon which, when executed by a processor, implement a data warehouse visual chart display method according to any one of claims 1 to 8.
12. A computer program product, wherein instructions in the computer program product, when executed by a processor of an electronic device, enable the electronic device to perform a data warehouse visual chart display method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111556779.1A CN114218336A (en) | 2021-12-17 | 2021-12-17 | Data warehouse visual chart display method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111556779.1A CN114218336A (en) | 2021-12-17 | 2021-12-17 | Data warehouse visual chart display method, device and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114218336A true CN114218336A (en) | 2022-03-22 |
Family
ID=80703996
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111556779.1A Pending CN114218336A (en) | 2021-12-17 | 2021-12-17 | Data warehouse visual chart display method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114218336A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114969040A (en) * | 2022-05-26 | 2022-08-30 | 上海快仓智能科技有限公司 | Data display method and device, electronic equipment and storage medium |
| CN115422167A (en) * | 2022-09-27 | 2022-12-02 | 北京柏睿数据技术股份有限公司 | Cross-data source database view visualization construction method and system |
| CN116028248A (en) * | 2023-03-30 | 2023-04-28 | 紫金诚征信有限公司 | Data processing method and device suitable for WEB terminal and electronic equipment |
| CN117076430A (en) * | 2023-10-09 | 2023-11-17 | 北京数语科技有限公司 | Method, system, electronic equipment and storage medium for acquiring data model through data gateway |
-
2021
- 2021-12-17 CN CN202111556779.1A patent/CN114218336A/en active Pending
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114969040A (en) * | 2022-05-26 | 2022-08-30 | 上海快仓智能科技有限公司 | Data display method and device, electronic equipment and storage medium |
| CN115422167A (en) * | 2022-09-27 | 2022-12-02 | 北京柏睿数据技术股份有限公司 | Cross-data source database view visualization construction method and system |
| CN115422167B (en) * | 2022-09-27 | 2023-02-17 | 北京柏睿数据技术股份有限公司 | Cross-data source database view visualization construction method and system |
| CN116028248A (en) * | 2023-03-30 | 2023-04-28 | 紫金诚征信有限公司 | Data processing method and device suitable for WEB terminal and electronic equipment |
| CN116028248B (en) * | 2023-03-30 | 2023-07-25 | 紫金诚征信有限公司 | Data processing method and device suitable for WEB terminal and electronic equipment |
| CN117076430A (en) * | 2023-10-09 | 2023-11-17 | 北京数语科技有限公司 | Method, system, electronic equipment and storage medium for acquiring data model through data gateway |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114218336A (en) | Data warehouse visual chart display method, device and equipment | |
| CN108932625B (en) | User behavior data analysis method, device, medium and electronic equipment | |
| CN111738805A (en) | Behavior log-based search recommendation model generation method, device and storage medium | |
| CN102985939A (en) | Art evaluation engine and method for automatic development of an art index | |
| CN110704486B (en) | Data processing method, device, system, storage medium and server | |
| CN102402684B (en) | Method and device for determining type of certificate and method and device for translating certificate | |
| CN110598108A (en) | Search term recommendation method, device, equipment and storage medium | |
| US7992126B2 (en) | Apparatus and method for quantitatively measuring the balance within a balanced scorecard | |
| CN112214557B (en) | Data matching classification method and device | |
| CN108549672A (en) | A kind of intelligent data analysis method and system | |
| CN110826306B (en) | Data acquisition method and device, computer readable storage medium and electronic equipment | |
| CN110807042B (en) | SQL statement generation system and method | |
| CN111008913A (en) | Electronic commerce platform for promoting intellectual property trade by product | |
| CN112783762B (en) | Software quality assessment method, device and server | |
| CN115775172A (en) | Product shelving information display method and system, electronic equipment and readable storage medium | |
| CN114912866A (en) | Information association method, device, equipment and storage medium | |
| CN108255920A (en) | Display methods, device, equipment and the storage medium of organization names retrieval type | |
| CN112967106A (en) | Quotation method, quotation server and system of hygienic products | |
| CN113220667A (en) | Scientific and technological big data element construction method and system, electronic equipment and storage medium | |
| JPH09282307A (en) | Commodity sales trend analysis method and system therefor | |
| CN115983220B (en) | Report generation method and device and electronic equipment | |
| CN113127597A (en) | Processing method and device for search information and electronic equipment | |
| CN108595693A (en) | A kind of matrimony vine data-reduction system | |
| CN117648339B (en) | Data exploration method and device, server and storage medium | |
| US20220114169A1 (en) | Pre-constructed query recommendations for data analytics |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |