CN113138998A

CN113138998A - Large screen display method and device of data index and storage medium

Info

Publication number: CN113138998A
Application number: CN202110372630.1A
Authority: CN
Inventors: 张雯洁
Original assignee: Weilai Automobile Technology Anhui Co Ltd
Current assignee: Weilai Automobile Technology Anhui Co Ltd
Priority date: 2021-04-07
Filing date: 2021-04-07
Publication date: 2021-07-20

Abstract

The invention belongs to the field of big data, and particularly provides a big screen display method, a big screen display device and a big screen display storage medium for data indexes, aiming at solving the problem that the data formats of data index database storage and data query return are not uniform. To this end, the method of the invention comprises: constructing a database table of metadata of the data indexes; configuring one or more global dimension filters for the large screen, and defining the types of the dimension filters and corresponding dimension information; configuring a single legend for a data index display; according to the configuration information of the large screen, the calculation logic of the data index is called, SQL sentences are spliced according to the calculation logic, and data query is directly carried out on a database in an OLAP mode; and packaging the data returned by the data query according to a standard format, and returning the data to the large screen for display in an interface mode. By the method and the device, the service personnel can configure the needed personalized large screen according to the existing index metadata, and the development efficiency of large screen work is greatly improved.

Description

Large screen display method and device of data index and storage medium

Technical Field

The invention belongs to the field of big data, and particularly provides a big screen display method and device of data indexes and a storage medium.

Background

Under the background of big data, a large amount of business data can be extracted into various data indexes and displayed externally in a form of large-screen report, so that visual and visual data display is provided for sales analysis, commodity analysis and the like of enterprise operation.

However, the following problems generally exist in the current data index large-screen display application: firstly, data indexes displayed by different large screens are not uniform, for example, the data indexes are also order quantity indexes, and finally displayed index values are different due to the difference of order screening logics, so that great confusion is brought to personnel viewing the large screens of the indexes, and development personnel are often required to spend time to search for the reason of inconsistent display; secondly, different indexes carry different information, and the structures of returned index values are different, so that different service lines and the required indexes of the service lines generally need to be developed in a customized manner, and a large screen belongs to a quick iterative product, so that the large screen development efficiency is low.

Accordingly, there is a need in the art for a new solution to the above-mentioned problems.

Disclosure of Invention

The method aims to solve the problems in the prior art that the large-screen development efficiency is low due to the fact that the structures of index values returned by data query are different from each other when the data indexes are not uniform. In a first aspect, the present invention provides a method for displaying a data indicator on a large screen, where the method includes:

constructing a database table of metadata of the data indexes, wherein the metadata comprises basic information of a parent index, basic information of a dimension, an incidence relation between the parent index and the dimension and enumeration value information of the dimension;

configuring one or more global dimension filters for the large screen, and defining types of the dimension filters and corresponding dimension information, wherein the types of the dimension filters comprise a single filter and a plurality of filters;

configuring a single legend for the large screen, wherein the content of the legend configuration comprises a chart style, a parent index required to be displayed, the dimension of the parent index required to be displayed and the dimension value of the parent index required to be displayed;

calling the computational logic of the data index according to the configuration information of the large screen, splicing SQL sentences according to the computational logic, and performing data query on a database;

and packaging the data returned by the data query according to a standard format, and returning the data to the large screen for display in an interface mode.

In one embodiment of the method for displaying a large screen of a data index, the basic information of the parent index includes a name of the parent index, a fact data table, a measure and a screening condition; the metric is a function of the statistics of the parent indicators.

In an embodiment of the method for displaying a data index on a large screen, the basic information of the dimension includes a dimension name, a field name, and an attribute name; the dimension name is the name of the dimension in the computational logic that needs to be queried.

In an embodiment of the method for displaying a large screen of data indicators, the information associated with the parent indicator and the dimension includes a parent indicator ID and a dimension ID, and one parent indicator ID corresponds to zero, one or more dimension IDs.

In an embodiment of the method for displaying a large screen of a data index, the enumerated value information of the dimension includes a dimension ID, a dimension value, and an attribute value name;

the dimension ID in the enumeration value information of the dimension is the same as the dimension ID in the associated information of the parent index and the dimension;

and realizing linkage screening of the index data through the dimension value and the attribute dimension value.

In an embodiment of the method for displaying a data index on a large screen, the content displayed by the single filter is an enumerated value of a dimension corresponding to a single dimension.

In an embodiment of the method for displaying the data index on the large screen, the content displayed by the multi-filter is an enumerated value of all dimensions and a dimension corresponding to each dimension in all dimensions.

In one embodiment of the above-described large screen display method of data indexes, the chart style includes at least one of: pie charts, line charts, bar charts, thermodynamic diagrams, single values, tables.

In an embodiment of the method for displaying a large screen of the data index, the SQL statement splicing rule includes:

selecting a field name for the dimension and a measure for the parent index;

specifying a data source as a fact data table of the parent index;

determining data screening conditions, wherein the screening conditions at least comprise screening conditions of the parent indexes and dimension names of the indexes; the dimension name of the index is a dimension specific value of the dimension name of the index, and the dimension names of the index are zero, one or more.

In an embodiment of the method for displaying a large screen of a data index, the content in the standard format includes:

the number of query results returned by the SQL statement query;

a dimension name;

a dimension value;

a metric field.

In an embodiment of the method for displaying a data index on a large screen, the database is a database supporting an OLAP mode.

In a second aspect, the present invention provides a large-screen display device for data indexes, including a processor and a storage device, where the storage device is adapted to store a plurality of program codes, and the program codes are adapted to be loaded and run by the processor to execute the large-screen display method for data indexes according to any one of the above technical solutions.

In a third aspect, the present invention provides a storage medium adapted to store a plurality of program codes, wherein the program codes are adapted to be loaded and executed by a processor to perform the large screen display method of the data index according to any one of the above-mentioned technical solutions of the large screen display method of the data index.

As can be understood by those skilled in the art, according to the technical scheme of the invention, a database table of metadata of the data indexes is established, and the data returned by the query is packaged according to a standard format and returned to a large screen for display in an interface mode. Therefore, the invention can realize that business personnel configure the needed personalized large screen according to the existing index metadata, thereby greatly improving the development efficiency of large screen work.

Drawings

Embodiments of the invention are described below with reference to the accompanying drawings, in which:

FIG. 1 is a flow chart of the main steps of the data index large screen display method of the present invention.

Fig. 2 is an exemplary diagram of a one-key power-up order quantity large screen display of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only for explaining the technical principle of the present invention, and are not intended to limit the scope of the present invention.

Referring to fig. 1, fig. 1 is a flowchart illustrating major steps of a large-screen display method for an index according to an embodiment of the present invention, as shown in fig. 1, the large-screen display method for an index includes:

step S101: and constructing a database table of metadata of the data indexes, wherein the metadata comprises basic information of a parent index, basic information of a dimension, an incidence relation between the parent index and the dimension and enumeration value information of the dimension.

Step S102: configuring one or more global dimension filters for the large screen, and defining dimension filter types and corresponding dimension information, wherein the dimension filter types comprise a single filter and a plurality of filters.

Step S103: configuring a single legend for a large screen, the legend configuration comprises: the method comprises the steps of drawing style, a parent index needing to be displayed, the dimension of the parent index needing to be displayed and the dimension value of the parent index needing to be displayed.

Step S104: and calling the computational logic of the data index according to the configuration information of the large screen, and inquiring the data from the database according to the computational logic.

Step S105: and packaging the data returned by the data query according to a standard format, and returning the data to a large screen for display in an interface mode.

Wherein, the database is the database of OLAP mode.

In this embodiment, a preferred OLAP (Online Analytical Processing) pattern database is a clickwouse database. The ClickHouse database is an open-source column-type database and is mainly used in the field of data analysis. In a storage layer, a ClickHouse database is customized and developed from OLAP scene requirements, and a set of brand-new efficient column-type storage engine is developed, so that the functions of data ordered storage, primary key index, sparse index and the like are realized; in the calculation layer, a plurality of important technologies such as Single-machine multi-core parallel, distributed calculation, vectorized execution and SIMD (Single Instruction Multiple Data) Instruction, code generation and the like are realized. Due to the strong computing power of the ClickHouse, good interactivity can be brought to data display of a large screen.

Firstly, a set of unified index metadata management functions is designed according to the characteristics of data indexes, namely all information carried by the indexes, including index names, calculation logic and the like, is stored in a unified mode; in the dimension part, besides basic information and dimension values of the dimensions, attribute dimensions of each dimension are recorded so as to support linkage screening. The management of metadata is typically defined and information maintained by a data developer, data analyst or business person. In the present embodiment, the detailed description of the embodiments of the present invention will be given by taking the "one-key-on order amount" index of the electric vehicle as an example.

In step S101, the parent indicator is an original indicator that does not contain any dimension, and the basic information of the parent indicator includes:

the name of the parent index is: i.e. the name of the index;

fact data table: namely, calculating a data source table of the index value;

and (3) measurement: a certain data field in the fact data table is selected and a function for counting the data field, such as COUNT, SUM, AVG, etc.;

screening conditions are as follows: namely the specific condition added after the keyword of 'WHERE' in the SQL statement;

unit: i.e. the unit of the index value, e.g. yuan, mu, km, etc.

As shown in table 1, table 1 is an example of a base information database table of a parent index. The name of the parent index is "one-key power-on order amount"; the fact data table name of the data source for calculating the index value is "one _ click _ power _ order _ table"; selecting ' order _ id ' in ' one _ click _ power _ order _ table ' data table in the measurement for statistics, wherein the statistical function is ' COUNT DISTINCT ' which is a function of calculating the number of non-repeated results '; the screening condition is that "order _ status" in the "one _ click _ power _ order _ table" data table is "completed"; the unit of the index value is "single".

Table 1: example of base information database tables for parent indices

Table 2 is an example of the fact data table in table 1, and the data table name of the fact data table in the clickwouse database is "one _ click _ power _ order _ table", and the detailed data of each order of the one-key power-on order amount is recorded.

Table 2: examples of fact data tables

Order ID	Week of order ending time	Order status	City	Zone(s)	Cost of
						order_id	week	order_status	city	district	fee
1	2020-10-19	Has been completed	Shanghai city	Quiet area	80
						2	2021-02-01	In process of proceeding	Shanghai city	Quiet area	60
3	2021-03-08	Has been completed	Shanghai city	New area of Pudong	50
						4	2021-03-15	In process of proceeding	Shanghai city	New area of Pudong	30

In step S101, the dimensions and their field names are globally and uniformly managed by the basic information of the dimensions, which includes:

dimension name: such as "city", "month", etc.;

the field name: the name of the corresponding field of the dimension in the data table;

unit: i.e. units of dimension values, such as one, one kilometer, etc., may also be empty;

attribute name: the dimension name corresponding to the attribute of the dimension, for example, the attribute of "urban area" may be "city", and for example, which urban areas are in Shanghai city may be obtained.

As shown in Table 3, Table 3 is an example of a base information database table for a dimension.

Table 3: example of base information database tables for dimensions

ID	Dimension name	Name of field	Unit of	Attribute name
					1	City	city
2	Urban area	district		City
					3	Week	week

In step S101, the associated information of the parent index and the dimensions is all the dimensions used by the parent index, and the associated information of the parent index and the dimensions includes:

parent index ID: namely ID in the basic information table of the parent index;

dimension ID: i.e., the ID in the dimension base information table.

As shown in Table 4, Table 4 is an example of a base information database table for a dimension.

Table 4: example of a database table of correlation information of parent metrics and dimensions

ID	Parent index ID	Dimension ID
			1	1	1
2	1	2
			3	1	3

In step S101, the enumerated value information of the dimension is the enumerated value included in the dimension and its corresponding interpretation, where the information can be used to make a pull-down option for the dimension value filtering box in the large screen. The enumerated value information of the dimension includes:

dimension ID: ID of the base information database table of the dimension;

dimension value/dimension value name: values included in the dimension and names of the values, for example, the enumerated values of the city dimension are Shanghai city, and the name is Shanghai city;

attribute dimension value: the dimension value of the dimension attribute, for example, the attribute of the "shanghai city area" is "city", and the city corresponding to the "quiet area" is "shanghai city".

As shown in Table 5, Table 5 is an example of a dimension's enumerated value information database table.

Table 5: example of enumerated value information database tables for dimensions

ID	Dimension ID	Dimension value	Dimension value name	Attribute dimension value
					1	1	Shanghai city	Shanghai city
2	1	Beijing City	Beijing City
					3	2	Quiet area	Quiet area	Shanghai city
4	2	New area of Pudong	New area of Pudong	Shanghai city
					5	3	2020-10-19	Year 2020, week 43

After step S101 is completed, the user or a technician may perform the global configuration of the large screen in step S102 according to the display requirement.

In step S102, a user may select whether to configure a global dimension filter, and if so, the user may add multiple filters, and each filter needs to define a corresponding type and dimension information thereof, where the types of the filters include a single filter and multiple filters.

In step S102, the single filter reads the base information database table of the dimension in step S101, presents all the currently configured dimensions, and supports selecting a single dimension from them. As an example, a single filter usually adopts a one-level drop-down box form, all values of corresponding dimensions are presented in the drop-down box, and the value is to directly read the enumerated value of the selected dimension from the enumerated value information database table of the dimension of table 5 for presentation.

In step S102, the multi-filter reads the basic information database table of the dimension in step S101, presents all currently configured dimensions, supports selection of a single dimension therefrom, and presents an attribute dimension name of the selected dimension after selection. As an example, the multi-filter usually adopts a two-level drop-down box form, where the first-level drop-down box is a dimension name in the basic information database table of the dimension in table 3, the second-level drop-down box is all values of the current dimension under the attribute dimension value, and the value will directly read the enumerated value of the selected dimension from the enumerated value information database table of the dimension in table 5 for presentation.

It should be noted that the linkage screening of data can be realized by the dimension value and the attribute dimension value defined in the enumerated value information database table of the dimension of table 5. By way of example, when the first level of the multi-filter is a city, and the Shanghai city is selected, the second level will automatically present that the attribute dimension values are all the city data of the Shanghai city, such as the quiet zone, the Pudong New zone, etc., which greatly facilitates the search and operation of the user.

After the step S102 of global large screen configuration is completed, the data display content, style, and the like need to be configured in step S103. The single legend is the smallest display chart unit of the large-screen display, each legend can be customized in size by a user, and can be laid out in a dragging mode.

In step S103, the configuration of the legend includes the configuration of the chart style, the parent indicator, the dimension to be displayed, and the specific dimension value, and the specific configuration includes:

chart style: the user may select a pie chart, line chart, bar chart, thermodynamic diagram, single value, table or other form of image for display based on the characteristics of the index data.

The parent indexes are as follows: the user can select the name and the unit of one item of the parent index in the basic information database table of the parent index shown in the table 1 to display. It should be noted that when all dimensions of the configured global filter do not include the dimension of the selected parent indicator, the legend may use a text to prompt the user that "xx global filter is invalid for the legend", and at this time, the user may ignore the information or return to step S102 to add one or more global filters.

The dimensions to be displayed are: the user can select one or more configured dimensions of the parent indexes according to the database table of the association information of the parent indexes and the dimensions in the table 4.

Specific dimension values: a user can select one or more dimensions to configure a specific enumeration value through a drop-down box mode if the selected dimension has the configured enumeration value according to the enumeration value information database table of the dimension of table 5; if the selected dimension does not have configured enumeration values, the user can fill in one or more enumeration values by himself through the text input box.

And obtaining the calculation logic of the indexes in the step S104 according to the configuration information displayed on the large screen in the step S102 and the step S103, and splicing the calculation logic into the SQL statement.

The calculation logic is the splicing rule of the SQL statement, and as an example, the content of the splicing rule of the SQL statement includes:

the number of dimension names of the index can be zero, one or more according to the actual condition of the index required to be shown.

In step S104, the spliced SQL statement is used to directly query the clickwouse database providing OLAP services. The data returned by the query is subjected to the normalization processing in step S105, and is returned to the large screen in the form of a standard interface for the presentation of the index value.

In step S105, the query returns the standard format content of the interface data including:

total _ results: querying the number of all data according to the SQL spliced in the step S104;

result _ list: all the data contents are inquired;

dim _ name: the names of the dimensions are separated by "|";

dim _ value: splicing the specific values of the dimensions according to the sequence of dim _ name and separating the specific values of the dimensions by using the 'I';

indicator _ value: a metric field.

As an example, the concrete method of step S102 to step S105 will be described by displaying the one-key power-on order amount that has been completed in the quiet zone of shanghai city every week between 10/month and 5/year 2020 and 12/month and 28/day 2020 on a large screen.

In step S102, a multi-dimensional filter is configured, the first level selects Shanghai city for the city, and the second level selects a quiet area for the city.

In step S103, the legend style is selected as a line graph, the parent index to be displayed is the one-key power-on order amount, and the selected dimension ID is a 3-dimensional value week. And setting a line graph, wherein the X axis is the dimension of the week, and the Y axis is the one-key power-on order quantity of the parent index corresponding to the week of the X axis.

In step S104, the obtained spliced SQL statement is:

wherein, the measurement displayed on the large screen is the amount of orders by one-key power-on; the data source is a fact data table of a parent index of which the data table name is one _ click _ power _ order _ table; the screening conditions are as follows: the order state is completed, the dimension of the index data is Shanghai city, quiet area and each week, and the time range of the dimension week is between 10 and 5 days of 2020 and 12 and 28 days of 2020. The data obtained by querying the ClickHouse database is shown in table 6.

Table 6: examples of data obtained after execution of step S104

ID	week	COUNT(DISTINCT order_id)
			1	2020-10-5	116
…	…	…
			13	2020-12-28	113

Step S105 processes the query result of step S104, and obtains interface data in a standard format as:

a line graph indicating the one-key power-on order amount displayed on the large screen is shown in fig. 2.

It should be noted that, in the present embodiment, the preferred OLAP schema database is the clickwouse database. However, the scope of the present invention is not limited to the ClickHouse database, and those skilled in the art may select other databases providing OLAP services according to actual situations, for example, databases such as Vertica, greenplus, Palo, and AnalyticDB, to implement the technical solution of the present invention.

Furthermore, the invention also provides a large-screen display device of the data index. In an embodiment of the large-screen display device for data indexes according to the present invention, the large-screen display device for data indexes comprises a processor and a storage device, the storage device may be configured to store a program for executing the large-screen display method for data indexes of the above-mentioned method embodiment, and the processor may be configured to execute a program in the storage device, the program including but not limited to a program for executing the large-screen display method for data indexes of the above-mentioned method embodiment. For convenience of explanation, only the parts related to the embodiments of the present invention are shown, and details of the specific techniques are not disclosed. The large-screen display device of the data index may be a control device apparatus formed including various electronic devices.

Further, the invention also provides a storage medium. In one storage medium embodiment according to the present invention, the storage medium may be configured to store a program for executing the large screen display method of the data index of the above-described method embodiment, and the program may be loaded and executed by the processor to implement the large screen display method of the data index. For convenience of explanation, only the parts related to the embodiments of the present invention are shown, and details of the specific techniques are not disclosed. The storage medium may be a storage device formed by various electronic apparatuses, and optionally, the storage medium in the embodiment of the present invention is a non-transitory computer-readable storage medium.

Those of skill in the art will appreciate that the method steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described above generally in terms of their functionality in order to clearly illustrate the interchangeability of electronic hardware and software. Whether such functionality is implemented as electronic hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

So far, the technical solutions of the present invention have been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of the present invention is obviously not limited to these specific embodiments. Equivalent changes or substitutions of related technical features can be made by those skilled in the art without departing from the principle of the invention, and the technical scheme after the changes or substitutions can fall into the protection scope of the invention.

Claims

1. A data index large screen display method is characterized by comprising the following steps:

2. The data index large-screen display method according to claim 1, wherein the basic information of the parent index includes a parent index name, a fact data table, a measure, and a filtering condition; the metric is a function of the statistics of the parent indicators.

3. The data index large-screen display method according to claim 1, wherein the basic information of the dimension includes a dimension name, a field name, and an attribute name; the dimension name is the name of the dimension in the computational logic that needs to be queried.

4. The data index large-screen display method according to claim 1, wherein the association information of the parent indexes and the dimensions comprises parent index IDs and dimension IDs, and one parent index ID corresponds to zero, one or more dimension IDs.

5. The data index large-screen display method according to claim 1, wherein the enumerated value information of the dimension includes a dimension ID, a dimension value, and an attribute value name;

6. The method according to claim 1, wherein the content displayed by the single filter is an enumerated value of a dimension corresponding to a single dimension.

7. The method according to claim 1, wherein the content displayed by the multi-filter is an enumerated value of all dimensions and the dimension corresponding to each dimension in all dimensions.

8. The method of claim 1, wherein the chart style comprises at least one of: pie charts, line charts, bar charts, thermodynamic diagrams, single values, tables.

9. The large-screen display method of the data index according to claim 1, wherein the SQL statement splicing rule includes: