CN117827876A

CN117827876A - Index management system and index query method

Info

Publication number: CN117827876A
Application number: CN202311870134.4A
Authority: CN
Inventors: 王利华; 余友波; 罗慧; 韩尚斌; 钟稳稳; 张广超
Original assignee: Guangdian Yuntong Group Co ltd
Current assignee: Guangdian Yuntong Group Co ltd
Priority date: 2023-12-29
Filing date: 2023-12-29
Publication date: 2024-04-05

Abstract

The application discloses an index management system and an index query method, and belongs to the technical field of data processing. The system comprises an application front end and a service back end which are connected; the application front end comprises a configuration module, wherein the configuration module is used for receiving index configuration information and query information of the index to be queried and configuring an index configuration table according to the index configuration information; the service back end comprises a query module and an analysis module which are connected; the query module is used for calling a data source table of the configured index configuration table according to the query information, and screening target data corresponding to the index to be queried from the data source; and the analysis module is used for calling the model table, the caliber table, the auxiliary item table and the type configuration table of the configured index configuration table based on the query information, and analyzing the target data to obtain an index query result of the index to be queried. The system realizes high configurability by flexibly configuring the index configuration table, and is convenient to use.

Description

Index management system and index query method

Technical Field

The application belongs to the technical field of data processing, and particularly relates to an index management system and an index query method.

Background

An index is a quantization standard used for measuring a certain phenomenon, characteristic or performance, and can reflect information on the number, proportion, trend, change rate and the like of the certain phenomenon or characteristic, so that the index is a very important tool in management and decision.

At present, the index management system has low configurable degree and poor calculation performance, and cannot support calculation based on a big data platform and multi-dimensional index calculation.

Disclosure of Invention

The present application aims to solve at least one of the technical problems existing in the prior art. Therefore, the index management system and the index query method can be flexibly configured, are convenient to use, have stronger calculation performance, and support calculation based on a big data platform and multidimensional index calculation.

In a first aspect, the present application provides an index management system, where the system includes a connected application front end and a service back end;

the application front end comprises a configuration module, wherein the configuration module is used for receiving index configuration information and query information of an index to be queried, and configuring an index configuration table according to the index configuration information;

the service back end comprises a query module and an analysis module which are connected;

The query module is used for calling a data source table of the index configuration table after configuration according to the query information, and screening target data corresponding to the index to be queried from the data source;

and the analysis module is used for calling the configured model table, caliber table, auxiliary item table and type configuration table of the index configuration table based on the query information, and analyzing the target data to obtain an index query result of the index to be queried.

According to the index management system, the index configuration table is flexibly configured through the configuration module at the front end of the application, high configurability is achieved, the index configuration table can be configured for long-term use, a user adjusts the index configuration table according to actual requirements, adaptability of indexes is improved, the index management system is convenient to use, high in computing capacity, target data of the computed indexes can be screened and analyzed by calling the configured index configuration table at the rear end of a service, index query results can be obtained rapidly and accurately, more and more complex index computing scenes can be met, and large data platform operation and multi-dimensional index computing are supported.

According to one embodiment of the present application, the index configuration information includes at least one of index data source configuration information, index model configuration information, index caliber configuration information, index affiliated item configuration information, and type configuration information;

The configuration module comprises at least one of a basic configuration interface, a data source configuration interface, a model management interface, a caliber management interface, an accessory item configuration interface and an index management interface;

the basic configuration interface is provided with the data source table, and the data source table is used for configuring the index data source configuration information and determining the data source;

the model management interface is provided with the model table, and the model table is used for configuring the index model configuration information and determining an index model;

the caliber management interface is provided with the caliber table, and the caliber table is used for configuring the index caliber configuration information and determining the index caliber;

the auxiliary item configuration interface is provided with the auxiliary item table, and the auxiliary item table is used for configuring the index auxiliary item configuration information and determining auxiliary indexes of index data;

the index management interface is provided with the type configuration table, and the type configuration table is used for storing type configuration information and configuring the index data.

According to one embodiment of the application, the analysis module comprises a preprocessing module and a calculation module, wherein an information intermediate table and a hierarchy intermediate table are arranged in the preprocessing module;

The information intermediate table is used for storing the target data and index data of the target data;

the hierarchy intermediate table is used for storing the index data, and hierarchy information and index types of the index data;

the preprocessing module is used for writing the target data into the information intermediate table;

invoking the auxiliary item table, the index model in the model table and the type configuration information in the type configuration table, and analyzing target data to obtain index data of a plurality of index types;

performing level deduction on the index data to obtain level information of the index data;

the calculation module is used for calling an index model in the model table and an index caliber in the caliber table, and calculating the index data according to the level information and the index type to obtain the index query result.

According to one embodiment of the present application, the index type of the index data includes any one or more of the following: external index, manual index, basic auxiliary index, compound index and compound auxiliary index;

the index data of the external index, the manual index and the basic index are obtained based on the target data;

The index data of the basic auxiliary index is obtained by calling the auxiliary item table and based on the index data of the basic index;

the index data of the composite index is obtained based on at least one of the index data of the external index, the index data of the manual index, the index data of the basic index and the index data of the basic auxiliary index;

and the index data of the composite auxiliary index is obtained by calling the auxiliary item table and based on the index data of the composite index.

According to one embodiment of the present application, the preprocessing module is further configured to:

a first level of the level intermediate table is used for storing level information of the external index, the manual index and the basic index;

the second level of the level intermediate table is used for storing level information and index data of the basic auxiliary index;

the preprocessing module is used for carrying out hierarchical deduction on the index data of the composite index based on the information intermediate table and the hierarchical intermediate table to obtain hierarchical information of the index data of the composite index;

and determining the hierarchy information of the composite auxiliary index according to the dependency relationship between the index data of the composite index and the index data of the composite auxiliary index based on the hierarchy information of the index data of the composite index.

querying first index data of the composite index in the information intermediate table, wherein the hierarchy intermediate table does not comprise the first index data;

traversing and screening the first index data according to screening conditions to obtain second index data meeting the screening conditions, wherein the screening conditions are constructed based on the information intermediate table and the hierarchy intermediate table;

determining an index level of the second index data according to the information intermediate table;

and obtaining the level information of the index data of the composite index according to the dependency relationship between the second index data and the first index data based on the index level of the second index data.

According to one embodiment of the application, the computing module is further configured to:

based on the level information and the index type, the index model and the index caliber are called;

constructing a structured query statement based on the index model and the index caliber;

and calling the structured query statement, calculating the index data, and generating the index query result.

splicing the index model and the index caliber into a selection insertion statement;

and calling the selection insertion statement, and calculating the index data layer by layer according to the level information to generate the index query result.

According to one embodiment of the application, the service backend further comprises a verification module connected with the analysis module;

and the verification module is used for verifying the index query result.

According to one embodiment of the application, the service backend further comprises an expansion module connected with the query module and the analysis module, wherein the expansion module is used for connecting and calling a service micro-service application of an external system.

In a second aspect, the present application provides an index query method, applied to an application front end, where the method includes:

receiving query information of an index to be queried, and sending the query information to a service back end;

responding to the call of the service back end based on the query information, and providing an index configuration table for the service back end, wherein the index configuration table is configured by the application front end according to the index configuration information;

And the service back end is used for calling a data source table of the index configuration table, screening target data corresponding to the index to be queried from the data source, calling a model table, a caliber table, an auxiliary item table and a type configuration table of the index configuration table, and analyzing the target data to obtain an index query result of the index to be queried.

According to the index query method, the index configuration table is flexibly configured through the application front end, high configurability is achieved, the index configuration table can be used for a long time after configuration once, a user adjusts the index configuration table according to actual requirements, adaptability of indexes is improved, the index query method is convenient to use, high in computing capacity, target data of calculated indexes can be screened and analyzed by calling the configured index configuration table at the service rear end, index query results can be obtained rapidly and accurately, more and more complex index calculation scenes can be met, and large data platform operation and multidimensional index calculation are supported.

In a third aspect, the present application provides an index query method, applied to a service backend, where the method includes:

receiving query information of an index to be queried, which is sent by an application front end;

According to the query information, calling a data source table of an index configuration table from the application front end, and screening target data corresponding to the index to be queried from the data source, wherein the index configuration table is configured by the application front end according to index configuration information;

and calling a model table, a caliber table, an accessory item table and a type configuration table of the index configuration table from the application front end based on the query information, and analyzing the target data to obtain an index query result of the index to be queried.

In a fourth aspect, the present application provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the index query method according to the second or third aspect.

In a fifth aspect, the present application provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the index query method according to the second or third aspect described above.

In a sixth aspect, the present application provides a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being configured to execute a program or instructions to implement the index query method according to the second or third aspect.

In a seventh aspect, the present application provides a computer program product comprising a computer program which, when executed by a processor, implements the index query method according to the second or third aspect described above.

Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, wherein:

FIG. 1 is a schematic diagram of a system for index management according to an embodiment of the present disclosure;

FIG. 2 is a flow chart of a method for deriving a composite index according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of an execution flow of an analysis module and a verification module according to an embodiment of the present application;

FIG. 4 is a schematic diagram of an execution flow of the index management system according to the embodiment of the present application;

FIG. 5 is a flowchart of an index query method according to an embodiment of the present disclosure;

FIG. 6 is a second flowchart of an index query method according to an embodiment of the present disclosure;

fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

Technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application are within the scope of the protection of the present application.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type and not limited to the number of objects, e.g., the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.

The index management system, the index query method, the electronic device and the readable storage medium provided by the embodiment of the application are described in detail below through specific embodiments and application scenes thereof with reference to the accompanying drawings.

The index query method can be applied to the terminal, and can be specifically executed by hardware or software in the terminal.

The terminal includes, but is not limited to, a portable communication device such as a mobile phone or tablet having a touch sensitive surface (e.g., a touch screen display and/or a touch pad). It should also be appreciated that in some embodiments, the terminal may not be a portable communication device, but rather a desktop computer having a touch-sensitive surface (e.g., a touch screen display and/or a touch pad).

In the following various embodiments, a terminal including a display and a touch sensitive surface is described. However, it should be understood that the terminal may include one or more other physical user interface devices such as a physical keyboard, mouse, and joystick.

As shown in fig. 1, the index management system 100 includes: a connected application front end 110 and service back end 120;

the application front end 110 comprises a configuration module 111, wherein the configuration module 111 is used for receiving index configuration information and query information of an index to be queried, and configuring an index configuration table according to the index configuration information;

The service back end 120 comprises a query module 121 and an analysis module 122 which are connected;

the query module 121 is configured to call a data source table of the configured index configuration table according to the query information, and screen target data corresponding to the index to be queried from the data source;

the analysis module 122 is configured to invoke the model table, the caliber table, the auxiliary item table and the type configuration table of the configured index configuration table based on the query information, and analyze the target data to obtain an index query result of the index to be queried.

Wherein the application front-end 110 is used for interaction with a user and for configuration of the index management system 100.

It will be appreciated that the index configuration table includes a data source table, a model table, a caliber table, an affiliated item table, and a type configuration table.

The index configuration information comprises information which needs to be called in the process of inquiring the index to be inquired, and comprises a data source, an index model, an index caliber, an auxiliary item and an index type, wherein the information is used for configuring a data source table, a model table, an caliber table, an auxiliary item table and a type configuration table respectively.

In addition, the index configuration information also comprises information such as index names, value ranges, precision and the like.

The data source may be a third party database or a database of the business backend 120.

The service backend 120 is configured to invoke the index configuration information configured for the index management system 100 in the application front-end 110, invoke the target data from the corresponding data source, and perform analysis and calculation of the index.

After the configuration module 111 completes the configuration of the index configuration table, the service backend 120 may repeatedly call the index configuration table to perform index calculation, and when a new index caliber needs to be added, the corresponding information in the index configuration table may be adjusted, for example, the information in the caliber table may be adjusted.

It will be appreciated that the query information includes query targets and query conditions, and may also include data formats.

The query condition may include a time range of the index to be queried, a query dimension, a filter, an aggregation mode, an arrangement mode, an output format, and the like.

The time range may be from a start time to an end time, e.g., data between the last monday and friday is acquired.

Query dimensions are dimensions, such as region, product, time, etc., that are involved in index queries, for grouping and filtering index data.

The filter is a filtering condition of index query, and index data meeting the condition can be screened according to specific conditions, for example, screening data according to product types or sales areas.

The aggregation mode is an aggregation mode of index queries, such as total, average, maximum, minimum, etc., and can be used for statistics and analysis of index data.

In actual implementation, after the configuration module 111 completes the configuration of the index configuration table of the application front end 110, the query information of the index to be queried may be manually input, or the query information of the index query task may be regularly invoked by the index management system 100, and the query information may be sent to the application front end 110, and after that, the user does not feel the query information, and enters the background processing of the index management system 100.

The application front end 110 receives the query information of the index to be queried input by the user, and forwards the query information to the service back end 120, and after receiving the query information, the service back end 120 retrieves the configured index configuration table from the application front end 110, and queries the index to be queried according to the query information.

The query module 121 obtains target data required by the index to be queried by accessing a database, calling an application programming interface (Application Programming Interface, API) or other data sources according to the query target and the query condition in the query information, such as the date of the index to be calculated, the dimension of the index to be calculated, etc., and calls the configured data source table, and sends the target data to the analysis module 122, where the target data may be stored in one or more data tables.

The analysis module 122 invokes the configured model table, caliber table, auxiliary item table and type configuration table, analyzes and calculates the target data according to the calculation logic and formula of the index to be queried to obtain a final index query result, and the analysis can comprise the operations of data aggregation, screening, sequencing, operation and the like.

The index management system 100 supports two modes of calculation for temporary test analysis and calculation for actual data, ensures that index query results are normal, and provides a data calculation function to realize that calculation data and calculation data are not affected by each other.

According to the index management system 100 provided by the embodiment of the application, the configuration module 111 of the application front end 110 flexibly configures the index configuration table to realize high configurability, the configuration can be used for a long time, a user adjusts the index configuration table according to actual requirements, the adaptability of indexes is improved, the application is convenient, manpower and material resources are saved, the service rear end 120 can call the configured index configuration table to screen and analyze target data of calculated indexes, index query results can be obtained rapidly and accurately, and more complex index calculation scenes can be met.

In some embodiments, the index configuration information includes: at least one of index data source configuration information, index model configuration information, index caliber configuration information, index affiliated item configuration information and type configuration information;

the configuration module 111 includes at least one of a basic configuration interface, a data source configuration interface, a model management interface, a caliber management interface, an accessory configuration interface and an index management interface;

the basic configuration interface is provided with a data source table, and the data source table is used for configuring index data source configuration information and determining a data source;

the model management interface is provided with a model table which is used for configuring index model configuration information and determining an index model;

the caliber management interface is provided with a caliber table which is used for configuring index caliber configuration information and determining the index caliber;

the auxiliary item configuration interface is provided with an auxiliary item table, and the auxiliary item table is used for configuring auxiliary item configuration information of the index and determining auxiliary indexes of the index data;

the index management interface is provided with a type configuration table which is used for storing type configuration information and configuring index data.

The type configuration information is used for configuring index types of indexes to form multi-dimensional indexes, and the type configuration table can comprise an index main table and an index sub-table.

It can be understood that the basic configuration interface, the data source configuration interface, the model management interface, the caliber management interface, the subordinate item configuration interface and the index management interface are all configuration/management interfaces, when two or more configuration/management interfaces are included in the configuration module 111, a connection relationship exists between each configuration/management interface, and a correspondence relationship exists between the index configuration information and the configuration/management interface in the configuration module 111.

It should be noted that, in the configuration module 111, the basic configuration interface is used to configure and manage the index data source, the index model, the index caliber, and the parameters and data sources related to the index auxiliary items, and the index data source supports the adaptation of multiple data source amounts, so as to ensure that the whole index system can be normally linked to databases of various main streams.

Among them, mainstream relational databases, such as ORACLE, database two (Database 2, db2), structured query language (My Structured Query Language, mySQL) databases, and the like, and large data platforms such as star ring, cloudera Distribution for Hadoop (CDH).

The data source configuration interface is provided with the functions of adding, deleting and checking, and is matched with a data source table, the source number of the main key of the data source table is the unique identification of the data source, and the called data source is positioned through the source number of the main key, so that the later maintenance and the problem investigation are facilitated, and other fields of the data source table are filled in according to actual requirements.

The model management interface is provided with functions of adding and deleting, importing detailed model fields and the like, is provided with a model table in a matching way, the data source number of the model table is consistent with the source number of a main key of the data source table, and is a logic main external key.

The caliber management interface is provided with functions of newly adding, deleting and checking and caliber field inputting, and is provided with a caliber table and a caliber detail table in a matching way, the system source number is consistent with the main key source number of the data source table, the system source number is a logic main external key, other caliber users can input in the caliber management interface according to actual conditions, the caliber detail table is a sub-table of the caliber table, and the caliber detail table and the sub-table are associated through the caliber numbers and are used for configuring multiple dimensionalities of index calculation, such as personnel, institutions and the like.

Wherein the system source number is a system unique identifier that identifies the index result application, listed along with the index name, index definition, data fields, and other related information, to better maintain and manage the index data.

The auxiliary item configuration interface is provided with a self-defined auxiliary item table, the auxiliary item table is an independent configuration table and is used for calculating auxiliary indexes of the current indexes, the auxiliary indexes are all extensions of the current indexes, such as increment of original values of the current indexes, increment or completion rate and the like, the auxiliary indexes must be calculated depending on the current indexes after calculation is completed, and the auxiliary indexes belong to auxiliary items and cannot exist independently.

The current index may be a base index or a composite index.

The index management interface is used for configuring functions of new addition, modification and the like of indexes of corresponding dimensions, and is provided with an index main table and an index sub-table in a matched mode, the model number of the index main table is consistent with the model number of the model table, type configuration information is stored for configuring the indexes of each dimension, the index sub-table is associated with the caliber table and the model table and is used for connecting data in series to form a configuration closed loop.

The configuration of the basic index comprises the name, bar line, legal person, label attribute fields such as negative number and the like of the index, meanwhile, the summary caliber is configured, such as employee summary mechanism summary and the like, the aggregation column is configured for summarizing corresponding fields, such as daily average, balance and the like, and finally, the filtering condition is configured as a condition for screening data from the model table.

The configuration of the composite index selects the index and the calculation rule of the selected index, such as four-rule mixing operation or other logic operation.

In addition, the data source table, the model detail table, the caliber detail table, the auxiliary item table, the index main table and the index sub-table all have corresponding public fields, such as a French number, a system number and the like, which are used for connecting the whole set of tables in series, and after the index base of the system is configured by a user, corresponding data are stored in the corresponding data table.

In this embodiment, the configuration module 111 performs a table design matching with a plurality of interfaces by itself, and correspondingly configures contents such as a data source, an index model, an index caliber, an accessory item, and the like, so that high configurability of the index management system 100 is realized, and a basis is provided for multidimensional calculation of the index.

In some embodiments, the analysis module 122 includes a preprocessing module and a calculation module, where the preprocessing module is provided with an information middle table and a hierarchical middle table;

an information intermediate table for storing target data and index data of the target data;

a hierarchy intermediate table for storing index data, and hierarchy information and index types of the index data;

the preprocessing module is used for writing target data into the information intermediate table;

Invoking an auxiliary item table, an index model in the model table and type configuration information in the type configuration table, and analyzing target data to obtain index data of a plurality of index types;

performing hierarchical deduction on the index data to obtain hierarchical information of the index data;

and the calculation module is used for calling the index model in the model table and the index caliber in the caliber table, and calculating the index data according to the level information and the index type to obtain an index query result.

The index type of the index data may be obtained by analyzing and defining the target data by calling a type configuration table.

The hierarchy information is used for representing the hierarchy where the index data are located after the index data are divided and organized according to the hierarchy where the index data are located, and can be obtained according to the relation, the dependence and the dimension among the index data.

In actual execution, after the service backend 120 receives the query information, the query module 121 queries the main index configuration table, the sub index configuration table and the data source table through the query conditions in the query information, and inserts the target data meeting the query conditions into the information intermediate table.

Meanwhile, in the analysis module 122, the preprocessing module moves the data stored in the information intermediate table and the hierarchical intermediate table into the history table, so as to facilitate operation and maintenance and log analysis, and simultaneously clears the data in the current information intermediate table and the hierarchical intermediate table, so that preparation is made for analysis and calculation of indexes to be queried.

The main index configuration table is used for storing the basic and label information of the indexes, and the sub-index configuration table is used for configuring specific subdivision indexes of the indexes to be queried in the main index configuration table.

The preprocessing module calls an index model in the model table and type configuration information in the type configuration table, performs calculation and conversion operations such as aggregation, screening, grouping and the like on target data according to a calculation method and rules defined in the index model to obtain a plurality of index data, configures index types of the index data according to the type configuration information, and stores the index types in the information intermediate table.

The preprocessing module conducts level deduction on the index data of each index type to obtain level information of each index data, and stores the index data into a corresponding level in the level intermediate table according to the level information.

For example, a sales performance index data set includes several indexes of total revenue, net profit, sales quantity and average sales price, then the first level index is sales quantity and average sales price, and the second level index is total revenue and net profit.

And in the calculation module, an index model, an index caliber and an affiliated item table are called, the index data is calculated from low level to high level according to the level information of the index data, analysis of index types is completed, and an index query result of the index to be queried is obtained.

It should be noted that, the index model is a framework for logically modeling and defining the index, and the index type is used for defining the application form in the specific scene of the index data, so as to facilitate the management and analysis decision of the index.

In this embodiment, by analyzing and calculating the target data, a plurality of index data, and index type and level information of each index data are obtained, efficient index calculation is realized.

In some embodiments, the index type of the index data includes any one or more of the following: external index, manual index, basic auxiliary index, compound index and compound auxiliary index;

the index data of the basic auxiliary index is obtained by calling an auxiliary item table and based on the index data of the basic index;

the index data of the composite auxiliary index is obtained by calling the auxiliary item table and based on the index data of the composite index.

Wherein, the manual index belongs to the operation of directly importing the index result value, the external index belongs to the index result directly accessed from the external system, the manual index and the external index only provide a data entry in the index management system 100, and the two indexes only have basic index number, index name, bar line and other attribute fields.

The manual index and the external index directly analyze the result value in the index management system 100, and no rule analysis exists, for example, a manual index of the intermediate business income of an organization is configured in the index management system 100, the index management system 100 only records attribute fields such as index numbers, index names, lines and the like, the external index is similar to the manual index configuration mode, and business personnel can manually import the index result value of the intermediate business income of the organization in the index management system 100 as index data.

The index data of the basic auxiliary index is obtained by calling an auxiliary item table to calculate the index data of the basic index, and the index data of the composite auxiliary index is obtained by calling the auxiliary item table to calculate the index data of the composite index

For example, an institutional economic added value (Economic Value Added, EVA) index is accessed from outside the administrative accounting system, and institutional EVA data that manages the accounting system is directly imported through daily data extraction, conversion and Loading (ETL) scheduling.

The index data of the basic index needs to configure specific rules in the index management system 100, for example, configure a staff to daily average index of public deposit, after the configuration of basic attributes such as index name, index line, etc. is completed, an aggregation column needs to be configured in the index management system 100, the caliber of the index is configured as the caliber of the staff, the daily average field of year is selected in the public deposit model table, the aggregation mode is SUM total, and meanwhile, calculation conditions are added, for example, the deposit subject is limited to the subject of examination.

The index data of the composite index is obtained by four operations or logic judgment and the like based on other index data, for example, the average of the deposit year of an employee is calculated, the addition operation is needed to be carried out on the two indexes of the average of the deposit year of the employee and the average of the deposit year of the private, for example, the increment of the public deposit is positive double, the logic judgment is needed to be carried out on the increment index of the public deposit, if the increment is more than 0, the increment is twice, and if the increment is < =0, the increment is the original increment value.

The external index, the manual index, the basic auxiliary index, the composite index and the composite auxiliary index are all grouped and aggregated according to one dimension, belong to the single-dimensional index, and the multi-dimensional index is that the single-dimensional index is grouped and aggregated in a plurality of dimensions.

The index type may further include a multidimensional index, where the multidimensional index is a custom extension on a single-dimensional index, for example, the employee index and the organization index are both single-dimensional indexes, the organization product index, the organization customer index, the organization subject product index, and the like are multidimensional indexes, the implementation mode of the index management system 100 is similar to a single-dimensional analysis mode, the multidimensional index configures a multidimensional field and a stored multidimensional result table of aggregation in the caliber management interface, and the analysis mode of the multidimensional index is similar to the single-dimensional index, and is to dynamically acquire a configuration item to analyze, so that 1 grouping aggregation is changed into grouping aggregation of multiple fields.

The index query and calculation process comprises the steps of preprocessing and analyzing basic indexes, manual indexes, external indexes, basic auxiliary indexes, composite index processing and auxiliary indexes thereof, and generating index query results through the verification of each level.

In the embodiment, the method and the device provide a basis for the hierarchical derivation of the indexes by obtaining the index types of the basic indexes, the manual indexes, the external indexes, the basic auxiliary indexes, the composite index processing, the composite auxiliary indexes and the like, so that the efficiency of the hierarchical derivation is improved.

In some embodiments, the preprocessing module is further configured to:

The first level of the level intermediate table is used for storing the level information of the external index, the manual index and the basic index;

the hierarchy information of the composite subordinate index is determined based on the hierarchy information of the index data of the composite index according to the dependency relationship between the index data of the composite index and the index data of the composite subordinate index.

The basic index belongs to data formed by directly processing and polymerizing a data model, for example, indexes such as average of public deposit and balance of public deposit by staff, filtering and polymerizing the public deposit model, configuring basic auxiliary indexes such as average increment and amplification of the public deposit and the like by staff on the basis of average of the public deposit and balance of the public deposit, and processing the basic auxiliary indexes based on the basic index on the basis of processing completion of the basic index.

The index level is determined by the dependency relationship between the index type and the index data, the manual index and the external index essentially belong to a direct access index result, the index data are not dependent, the basic index is subjected to aggregation analysis on the processed model table, and the basic index is not dependent, so that the manual index, the external index and the three indexes are directly placed in the first layer of the level middle table of the index analysis according to the index type.

The basic auxiliary indexes are all calculated by the analysis calculation of the basic indexes, so the basic auxiliary indexes are directly placed at the second layer of the hierarchical middle table of the index analysis according to the index types.

The composite index is calculated based on four operations or logic operations of the index, the hierarchy derivation is needed according to the dependency sequence, and no fixed hierarchy exists, for example, one composite index can refer to another composite index, or refer to a composite auxiliary index of another composite index, or refer to a basic index, a manual index or an external index, and the like.

In this embodiment, the calculation of the index query results is based by determining the hierarchical information for each index type.

In some embodiments, the preprocessing module is further configured to:

querying first index data of the composite index in an information intermediate table, wherein the hierarchical intermediate table does not comprise the first index data;

traversing and screening the first index data according to screening conditions to obtain second index data meeting the screening conditions, wherein the screening conditions are constructed based on an information intermediate table and a hierarchy intermediate table;

The index type of the first index data is a composite index, the first index data exists in the information middle table, and the first index data does not exist in the hierarchy middle table.

The filtering condition is that the information intermediate table has a mark number and an index number, but the index data in the hierarchy intermediate table is not present.

As shown in fig. 2, deriving the level information of the composite index requires first querying the information intermediate table for the composite index, and traversing the queried first index data without the first index data in the level intermediate table, excluding the index data with the mark number and the index number in the information intermediate table, but without the index data in the level intermediate table, to obtain second index data with all the conditions satisfied, wherein the level of the second index data is the next level in the first index data which does not satisfy the screening condition, and so on.

The index management system 100 defines a maximum index deducing level (configuration level number) to prevent the phenomenon that the maximum index deducing level depends on the system itself from occurring in configuration, for example, the maximum index deducing level is set to 20, and the system can be modified by self-definition through parameter input, in normal use, indexes with 20 levels are almost rare or even absent, if the analysis level exceeds 20 levels, the index management system 100 automatically breaks analysis and throws out abnormality, an administrator can analyze which index analysis exceeds the level by checking the log of the index management system 100 and the current analysis result, and when the analysis exceeds a certain level, the program considers that the index is in error configuration, the indexes are interdependent, exits deduction and puts error information into an index analysis process table.

The derivation process of the composite auxiliary index is the same as the derivation process of the composite index.

The index analysis process table and other index configuration tables are arranged under the same database, belong to tables used by ETL scheduling, are emptied every day, are independently processed every day, and are developed for Java language, and have cross-platform characteristics.

In actual execution, if no corresponding data is found in any link in the preprocessing module, because the parameters of the whole set of index management system 100 are manually configured by the user, the situation of less configuration in daily use is unavoidable, or because of operation and maintenance problems, a data table is misoperated, such as that a model table reduces fields, indexes are not synchronously modified, or data sources are added, a model table is not configured, or the situation that the corresponding result table of the indexes is configured incorrectly, and the like, the index management system 100 can record specific information of the current link and detailed information of the data cannot be found. Similarly, if the index management system 100 is abnormal during the processing, the process will also be recorded in detail, the data in the process will be marked for easy viewing, and the index management system 100 will perform the preprocessing of the next index data until the whole preprocessing stage is completed.

In the embodiment, the composite index is subjected to level deduction to obtain the level information of the composite index, so that the dependency relationship of the composite index is solved, the calculation sequence of index data and the index data which can be calculated concurrently are determined, and a foundation is provided for calculation of the index data.

In some embodiments, the computing module is further to:

based on the level information and the index type, an index model and an index caliber are called;

and calling the structured query statement, calculating the index data, and generating an index query result.

The method comprises the steps of executing a structured query (Structure Query Language, SQL) statement, and performing flexible and efficient processing, analysis and calculation on index data according to the level information and the index type, so as to obtain an accurate index query result.

In actual execution, the data model configured during the configuration of the index in the model table and the index caliber such as the caliber of staff and the caliber of a mechanism are acquired through the related attribute information such as the level information and the index type acquired from the information intermediate table and the level intermediate table, page configuration information such as aggregation fields such as balance, average day and the like is counted, the number of the information intermediate table and the level intermediate table is put into the history table each time, and meanwhile, the information intermediate table and the level intermediate table are emptied.

The method comprises the steps of dynamically assembling related attribute information such as level information, index types and the like into executable SQL sentences by offline calculation of a large data platform, inserting a basic index script information intermediate table into background ETL scheduling processing, storing index analysis sentences and target tables to be inserted, and completing processing and analysis of basic indexes, basic auxiliary indexes, manual indexes, external indexes, composite indexes and composite auxiliary indexes by analyzing and executing the executable SQL sentences stored in the basic index script information intermediate table to generate index query results.

In the embodiment, the index data is flexibly and efficiently processed and analyzed and calculated by constructing the structured query statement, so that an accurate index query result is obtained.

In some embodiments, the computing module is further to:

and calling a selection insertion statement, calculating index data layer by layer according to the level information, and generating an index query result.

The selection insertion statement is an insert+select statement, and is used for flexibly selecting data from one table according to requirements, inserting the selected data into another table, and realizing functions of copying, converting, screening, merging and the like of the data.

In actual execution, the calculation module generates a standard analysis SQL statement according to the level information, the index type and other related attribute information, the analysis SQL statement depends on the data model table, the index caliber, the index rule column, the index measurement and other information to generate, and the analysis SQL statement is dynamically spliced into an executable INSERT+SELECT statement, and meanwhile, according to the level information of index data, the index analysis calculation is carried out in a mode of serial scheduling among each layer and parallel scheduling in each layer.

In the embodiment, index data is calculated layer by layer according to the level information by splicing the selection insertion sentences, so that index query results are rapidly and accurately generated.

In some embodiments, the business backend 120 further includes a verification module coupled to the analysis module 122;

and the verification module is used for verifying the index query result.

In actual execution, after the analysis module 122 finishes the index analysis, the index query result is sent to the verification module to perform data result verification, for example, index result verification, index number verification and other user-defined verification, for example, the index query result executed this time is compared with the last time, and if 30% of data errors occur, an error prompt is generated.

The checking method comprises threshold checking of index results, number checking of indexes before and after, and other customized checking.

After the verification is successful, the index result can be directly covered to an index result table which is finally used according to public information fields such as data date, legal person and the like.

In this embodiment, by checking the index, the accuracy of the index query result can be ensured, the risk can be reduced, and the data quality can be improved.

In some embodiments, the business backend 120 further includes an extension module connected to the query module 121 and the analysis module 122, the extension module being used to connect and invoke business micro-service applications of external systems.

The business micro-service application is used for solving specific business problems, and decomposing the whole business logic into a plurality of small independent services, wherein each service is responsible for a specific function or field.

In actual execution, the service backend 120 is connected with the corresponding service micro-service application through the expansion module to realize batch application, and the service micro-service application can dynamically create, configure and trigger batch tasks according to service requirements, so that the task efficiency and flexibility are improved.

After the expansion module is connected with the service micro-service application, the processed data can be distributed according to the needs for different service micro-service applications.

The batch application of the service back end 120 connected with the service micro service application can be applied to various application scenes such as data processing and distribution, batch task scheduling, asynchronous processing and decoupling, system integration and collaborative work, data synchronization and consistency, and the like, so that the flexibility, the expandability and the efficiency of the index management system 100 can be improved, and different service requirements can be met.

In this embodiment, the query module 121 and the analysis module 122 are connected to the business micro-service through the extension module, so that high concurrency and high performance parallel processing of the index data can be realized.

A specific embodiment is described below.

As shown in fig. 3, in the preprocessing module of the analysis module 122, preprocessing of target data is performed, and the preprocessing process includes processing the current batch index base information, index level derivation, parameter intermediate processing, and history data processing.

Deriving the level information of the composite index requires that the composite index is firstly inquired in an information intermediate table, the first index data of the level intermediate table is not searched, then the inquired first index data is traversed, the index data in the information intermediate table, which are provided with the mark number and the index number, are excluded, the index data in the level intermediate table are not searched, the second index data with all the conditions met are obtained, the level of the second index data is the next level in the first index data, which does not meet the screening conditions, and the like.

In the calculation module of the analysis module 122, the first-level index processing is performed, including external index processing, manual index processing, basic index processing, and basic index analysis, the second-level auxiliary index processing is performed, including basic auxiliary index rule analysis and basic auxiliary index script execution, and the composite index processing is performed, including executing the composite index data source analysis script, analyzing the composite index, and executing the script of the composite index and the composite auxiliary index, and performing the composite auxiliary index analysis, to obtain an index query result.

The calculation module generates a standard analysis SQL statement according to the level information, the index type and other related attribute information, the analysis SQL statement depends on the data model table, the index caliber, the index rule column, the index measurement and other information to generate, and the analysis SQL statement is dynamically spliced into an executable INSERT+SELECT statement, and meanwhile, the index analysis calculation is carried out in a mode of serial scheduling among each layer and parallel scheduling in each layer according to the level information of index data.

And carrying out result verification on the index query result in a verification module.

After the analysis module 122 finishes the index analysis, the index query result is sent to a verification module to perform data result verification, for example, index result verification, index number verification and other custom verification, for example, the index query result executed this time is compared with the previous time, and if 30% of data errors occur, an error prompt is generated.

The data which are called and generated in the whole execution process are put into an execution process table, and the data are stored in a database related to index configuration information in the execution process, so that information such as specific errors in the execution process is recorded.

When the computing module executes, performance bottlenecks such as slow execution and the like may be encountered, the execution efficiency can be accelerated through multi-thread parallel execution, and if situations such as program error reporting, abnormality and the like occur in the execution process, marks are left until the computation is completed.

As shown in fig. 4, the application front end 110 may configure the index configuration table according to the index configuration information, for example, the configuration of the index data source, the configuration of the index model and the configuration of the index rule, where the application front end 110 mainly configures the dimension configuration and the matched table design, the index model, the index calculation dimension, the index rule, the index auxiliary item and other contents, so that the application front end has high configurability, can be reused after the configuration is completed, and does not need to adjust for multiple times, if there is a need to change, the index configuration information can be adjusted again at the application front end 110.

The service backend 120 is connected with the service micro-service application through the database to realize batch application, can call target data from the database, store the generated index query result into the database, and perform various application scenarios such as data processing and distribution, batch task scheduling, asynchronous processing and decoupling, system integration and collaborative work, data synchronization and consistency through batch application, so that the flexibility, expandability and efficiency of the index management system 100 can be improved, and different service requirements can be met.

The service back end 120 performs scheduling processing through configuration information of the application front end 110, reads an index configuration table of the application front end 110 during each scheduling, stores the index configuration information of the application front end 110 in an information intermediate table and a hierarchy intermediate table related to scheduling, includes index information, hierarchy information, rule information and the like, generates standard analysis SQL statements according to the index configuration information, generates analysis SQL statements according to information such as a data model table, an index caliber, an index rule column, index measurement and the like, dynamically splices the analysis SQL into an executable INSERT+SELECT statement, and performs index analysis calculation in a mode of serial scheduling and intra-layer parallel scheduling among each layer according to the hierarchy information of index data.

When the index management system 100 faces performance bottlenecks of large-scale data, the system processing capacity can be improved by laterally expanding business micro-service applications, and the index management system 100 is an application based on multi-thread development and can well support high-concurrency requests.

In the related art, the index management system 100 has the problems of poor computing performance, incapability of supporting operation based on a big data platform, low configurability degree, incapability of supporting multidimensional indexes, and the like.

The index management system 100 provided by the embodiment of the application flexibly realizes one-stop efficient processing from index configuration to result output based on a big data platform, is applicable to different service platforms, can meet different service requirements, improves the processing capacity of the index management system 100, can run calculation across platforms, improves the adaptability of indexes, does not depend on the specific grammar of a database, processes data with high concurrency and high performance, can automatically analyze index operation scripts, supports calculation on the big data platform, fully utilizes the performance of the big data platform to perform multi-thread parallel processing, and realizes efficient index calculation.

The execution body of the index query method provided in the embodiment of the present application is the application front end 110 of the index management system 100, and the application front end 110 may be an electronic device or a functional module or a functional entity capable of implementing the index query method in the electronic device.

As shown in fig. 5, the index query method is applied to the application front end 110, and the method includes: step 510 and step 520.

Step 510, receiving query information of the index to be queried, and sending the query information to the service backend 120.

Step 520, in response to the invocation of the service backend 120 based on the query information, providing an index configuration table to the service backend 120, the index configuration table being configured by the application front-end 110 according to the index configuration information; the service backend 120 is configured to call a data source table of the index configuration table, screen target data corresponding to the index to be queried from the data source, call a model table, a caliber table, an auxiliary item table and a type configuration table of the index configuration table, and analyze the target data to obtain an index query result of the index to be queried.

According to the index query method, the index configuration table is flexibly configured through the application front end 110, high configurability is achieved, the index configuration table can be configured for long-term use, a user adjusts the index configuration table according to actual requirements, adaptability of indexes is improved, the index query method is convenient to use, high in computing capacity, target data of the computed indexes can be screened and analyzed by calling the configured index configuration table at the service rear end 120, index query results can be obtained rapidly and accurately, more and more complex index computing scenes can be met, and large data platform operation and multi-dimensional index computing are supported.

The execution main body of the index query method provided in the embodiment of the present application is the service back end 120 of the index management system 100, and the service back end 120 may be an electronic device or a functional module or a functional entity capable of implementing the index query method in the electronic device.

As shown in fig. 6, the index query method is applied to the service backend 120, and the method includes: steps 610 through 630.

Step 610, receiving query information of the index to be queried sent by the application front end 110.

Step 620, according to the query information, a data source table of an index configuration table is called from the application front end 110, target data corresponding to the index to be queried is screened out from the data source, and the index configuration table is configured by the application front end 110 according to the index configuration information.

Step 630, based on the query information, the model table, the caliber table, the auxiliary item table and the type configuration table of the index configuration table are called from the application front end 110, and the target data is analyzed to obtain the index query result of the index to be queried.

In some embodiments, as shown in fig. 7, the embodiment of the present application further provides an electronic device 700, including a processor 701, a memory 702, and a computer program stored in the memory 702 and capable of running on the processor 701, where the program when executed by the processor 701 implements the processes of the above-mentioned index query method embodiment, and the same technical effects can be achieved, and for avoiding repetition, a description is omitted herein.

The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device.

The embodiment of the application further provides a non-transitory computer readable storage medium, on which a computer program is stored, which when executed by a processor, implements the processes of the above-mentioned index query method embodiment, and can achieve the same technical effects, so that repetition is avoided, and no further description is given here.

The processor is a processor in the electronic device in the above embodiment. Readable storage media include computer readable storage media such as computer readable memory ROM, random access memory RAM, magnetic or optical disks, and the like.

The embodiment of the application also provides a computer program product, which comprises a computer program, and the computer program realizes the index query method when being executed by a processor.

The embodiment of the application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled with the processor, the processor is used for running a program or instructions, the processes of the above index query method embodiment can be realized, the same technical effects can be achieved, and in order to avoid repetition, the description is omitted here.

It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the system in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solutions of the present application may be embodied essentially or in a part contributing to the prior art in the form of a computer software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), comprising several instructions for causing a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the methods of the embodiments of the present application.

In the description of the present application, the meaning of "plurality" is two or more.

The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are also within the protection of the present application.

In the description of the present specification, reference to the terms "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

While embodiments of the present application have been shown and described, it will be understood by those of ordinary skill in the art that: many changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the application, the scope of which is defined by the claims and their equivalents.

Claims

1. An index management system is characterized by comprising an application front end and a service back end which are connected;

2. The index management system of claim 1, wherein the index configuration information comprises at least one of index data source configuration information, index model configuration information, index caliber configuration information, index attachment configuration information, and type configuration information;

3. The index management system according to claim 1, wherein the analysis module comprises a preprocessing module and a calculation module, and an information intermediate table and a hierarchy intermediate table are arranged in the preprocessing module;

4. The index management system of claim 3, wherein the index type of the index data comprises any one or more of: external index, manual index, basic auxiliary index, compound index and compound auxiliary index;

5. The index management system of claim 4, wherein the preprocessing module is further configured to:

6. The index management system of claim 5, wherein the preprocessing module is further configured to:

7. The index management system of claim 5, wherein the computing module is further configured to:

8. The index management system of claim 7, wherein the computing module is further configured to:

9. The index management system according to any one of claims 1-8, wherein the business back-end further comprises a verification module connected to the analysis module;

and the verification module is used for verifying the index query result.

10. The system according to any one of claims 1-8, wherein the business backend further comprises an extension module connected to the query module and the analysis module, the extension module being configured to connect to and invoke business micro-service applications of an external system.

11. An index query method is characterized by being applied to an application front end, and comprises the following steps:

12. The index query method is characterized by being applied to the service back end, and comprises the following steps: