CN107491505B - Universal index processing method and system - Google Patents
Universal index processing method and system Download PDFInfo
- Publication number
- CN107491505B CN107491505B CN201710641060.5A CN201710641060A CN107491505B CN 107491505 B CN107491505 B CN 107491505B CN 201710641060 A CN201710641060 A CN 201710641060A CN 107491505 B CN107491505 B CN 107491505B
- Authority
- CN
- China
- Prior art keywords
- data
- index
- predefined
- source data
- definition table
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
Abstract
The embodiment of the invention provides a method and a system for processing a general index. The method comprises the following steps: the method comprises the steps of obtaining a plurality of source data of each equipment manufacturer, wherein the source data are used for calculating predefined index data, and storing the source data in a first data layer according to a preset index definition table; acquiring predefined index data according to the source data, and storing the predefined index data in a second data layer according to the preset index definition table; and acquiring public index data according to the predefined index data, and storing the public index data in a third data layer according to the preset index definition table. According to the universal index processing method provided by the embodiment of the invention, the multiple source data of each equipment manufacturer are subjected to summary conversion through hierarchical storage, and the public index data of the same type are obtained finally, so that the workload of index acquisition, processing and development is reduced, and when a subsequent processing algorithm is updated, the source data of each equipment manufacturer does not need to be acquired and counted again, and the subsequent maintenance is simpler.
Description
Technical Field
The embodiment of the invention relates to the technical field of data processing, in particular to a method and a system for processing a general index.
Background
In communication network optimization and network management, it is common to analyze indicators that are derived from source data of multiple different data types from multiple equipment vendors. Therefore, it is necessary to convert the source data into index data for analysis and processing, normalize the index data of each equipment manufacturer, analyze the normalized index data, and design a corresponding optimization algorithm, thereby implementing the communication network optimization and network management functions.
In the prior art, usually, each equipment manufacturer develops a set of index acquisition and processing system for each data type, obtains normalized index data from source data, and then obtains the normalized index data from each equipment manufacturer by an optimization algorithm to perform optimization design.
Disclosure of Invention
Aiming at the defects in the prior art, the embodiment of the invention provides a method and a system for processing a general index.
In a first aspect, an embodiment of the present invention provides a method for processing a general indicator, including:
the method comprises the steps of obtaining a plurality of source data of each equipment manufacturer, wherein the source data are used for calculating predefined index data, and storing the source data in a first data layer according to a preset index definition table;
acquiring predefined index data according to the source data, and storing the predefined index data in a second data layer according to the preset index definition table;
and acquiring public index data according to the predefined index data, and storing the public index data in a third data layer according to the preset index definition table.
In a second aspect, an embodiment of the present invention provides a general indicator processing system, including:
the system comprises a first acquisition module, a first data layer and a second data layer, wherein the first acquisition module is used for acquiring a plurality of source data of each equipment manufacturer for calculating predefined index data and storing the source data in the first data layer according to a preset index definition table;
the second acquisition module is used for acquiring predefined index data according to the source data and storing the predefined index data in a second data layer according to a preset index definition table;
and the third acquisition module is used for acquiring public index data according to the predefined index data and storing the public index data in a third data layer according to a preset index definition table.
In a third aspect, an embodiment of the present invention provides an electronic device, including:
the processor and the memory are communicated with each other through a bus; the memory stores program instructions executable by the processor, the processor invoking the program instructions to perform a method comprising: the method comprises the steps of obtaining a plurality of source data of each equipment manufacturer, wherein the source data are used for calculating predefined index data, and storing the source data in a first data layer according to a preset index definition table; acquiring predefined index data according to the source data, and storing the predefined index data in a second data layer according to the preset index definition table; and acquiring public index data according to the predefined index data, and storing the public index data in a third data layer according to the preset index definition table.
In a fourth aspect, an embodiment of the present invention provides a storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the following method: the method comprises the steps of obtaining a plurality of source data of each equipment manufacturer, wherein the source data are used for calculating predefined index data, and storing the source data in a first data layer according to a preset index definition table; acquiring predefined index data according to the source data, and storing the predefined index data in a second data layer according to the preset index definition table; and acquiring public index data according to the predefined index data, and storing the public index data in a third data layer according to the preset index definition table.
According to the universal index processing method and system provided by the embodiment of the invention, a plurality of source data for calculating predefined index data of each equipment manufacturer are subjected to summary conversion through hierarchical storage, and the same type of public index data is finally obtained, so that subsequent processing can be directly analyzed from the stored public index data, the workload of index acquisition, processing and development is reduced, and when a subsequent processing algorithm is updated, the source data of each equipment manufacturer does not need to be acquired and counted again, and the subsequent maintenance is simpler.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a schematic flow chart of a general indicator processing method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a general index processing system according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic flow chart of a general indicator processing method according to an embodiment of the present invention, and as shown in fig. 1, the method includes:
step S11, obtaining a plurality of source data of each equipment manufacturer for calculating predefined index data, and storing the source data in a first data layer according to a preset index definition table;
specifically, when network management or network optimization is required, various index data is generally analyzed, and the index data is derived from raw data of a plurality of different data types of equipment manufacturers, and the raw data comprises source data of different types and different formats. Therefore, firstly, a plurality of source data for calculating predefined index data of each equipment manufacturer are acquired, after the source data are acquired, the source data need to be stored, and then unified conversion processing is performed to obtain various index data capable of being analyzed.
For example, a plurality of source data for calculating telephone traffic, source data for calculating 4G internet traffic, and the like provided by each mobile phone manufacturer are obtained, for example, obtaining data of source for calculating telephone traffic, data of source for mobile phone traffic of chinese style, data of source for mobile phone traffic of millet style, and the like, where the source data of telephone traffic includes data of call time, call place, and call place, that is, the source data of call time, call place, and the like are obtained in this step, and then all the source data are uniformly stored in a first data layer according to an index definition table, for example, the source data may be stored in a persistent layer in the first data layer, and the source data generally have a large quantity, include original data used by each equipment manufacturer for calculating various indexes, and have a main function of providing a data source for subsequent processing.
Step S12, predefined index data are obtained according to the source data, and the predefined index data are stored in a second data layer according to the preset index definition table;
specifically, predefined index data of each equipment manufacturer, such as Huawei mobile phone traffic data, 4G internet traffic data, Zhongxing mobile phone traffic data, 4G internet traffic data and the like, is obtained according to source data stored in a first data layer, most of the predefined indexes correspond to common indexes, the common indexes are indexes to be analyzed finally, and then the predefined index data are stored in a second data layer according to the preset index definition table, for example, the predefined index data are stored in a persistent layer in the second data layer.
For example, source data for calculating telephone traffic of each equipment manufacturer in the first data layer may be obtained, for example, source data such as call time, a calling place, a called place, and the like in the Huawei mobile phone telephone traffic source data are obtained, and then the Huawei mobile phone telephone traffic data is calculated; acquiring source data such as call time, a calling place, a called place and the like in the Zhongxing mobile phone traffic source data, and then calculating the traffic data of the Zhongxing mobile phone; the method comprises the steps of obtaining source data such as conversation time, a calling place and a called place in millet mobile phone traffic source data, calculating the traffic data of the Zhongxing mobile phone, and storing the traffic data of the Zhongxing mobile phone, the traffic data of the Zhongxing mobile phone and the traffic data of the millet mobile phone into a second data layer according to a preset index definition table.
And step S13, acquiring public index data according to the predefined index data, and storing the public index data in a third data layer according to the preset index definition table.
Specifically, the common index data is obtained according to predefined index data stored in the second data layer, and in the common index data, the common index data of each equipment manufacturer are the same in type and meaning. The traffic data is obtained according to predefined index data such as Hua-shi mobile phone traffic data, Zhongxing mobile phone traffic data, millet mobile phone traffic data and the like, 4G internet traffic data is obtained according to predefined index data such as Hua-shi mobile phone 4G internet traffic data, Zhongxing mobile phone 4G internet traffic data, millet mobile phone 4G internet traffic data and the like, and then public index data such as the traffic data, the 4G internet traffic data and the like are stored in a third data layer according to a preset index definition table. In practical application, the common index data may also be data obtained by normalizing predefined index data, such as normalized chinese mobile phone traffic data, normalized millet mobile phone traffic data, and the like, so that the data formats of the equipment manufacturers are completely consistent and stored together, and cross-equipment manufacturer analysis and whole network analysis can be performed. The source data, the predefined index data and the public index data all belong to index data and respectively represent a certain layer form of the index data. For example, the traffic index corresponds to the normalized traffic data of all equipment manufacturers in the common index data, corresponds to the traffic data of each equipment manufacturer in the predefined index data, and corresponds to the source data used by each equipment manufacturer to calculate the traffic data.
For example, after source data for calculating an index of each equipment manufacturer is converted and stored in three data layers, when the traffic of a certain period of time needs to be counted, the traffic data is searched from the common index data stored in the third data layer, and then the traffic of a certain period of time is counted. If the 4G internet traffic data of a certain area needs to be counted, the 4G internet traffic data is directly searched from the public index data stored in the third data layer, and then the 4G internet traffic data of the certain area is counted.
According to the universal index processing method provided by the embodiment of the invention, a plurality of source data for calculating the predefined index data of each equipment manufacturer are subjected to summary conversion through hierarchical storage, and the same type of public index data is finally obtained, so that the subsequent processing can be directly analyzed from the stored public index data, the workload of index acquisition, processing and development is reduced, and when a subsequent processing algorithm is updated, the source data of each equipment manufacturer does not need to be acquired and counted again, and the subsequent maintenance is simpler.
On the basis of the foregoing embodiment, further, the acquiring a plurality of source data of each device manufacturer for calculating predefined indicator data, and storing the source data in a first data layer according to a preset indicator definition table includes:
collecting original files of equipment manufacturers;
analyzing the original file to obtain a plurality of source data for calculating indexes of each equipment manufacturer and a first calculation formula corresponding to each source data;
and storing the source data and the corresponding first calculation formula in a first data layer according to a preset index definition table.
Specifically, the method includes the steps of obtaining an original file of each equipment manufacturer from an equipment side interface of each equipment manufacturer, analyzing the original file of each equipment manufacturer by using an adapter mode, obtaining a plurality of source data used for calculating indexes of each equipment manufacturer and a first calculation formula between the source data and the corresponding indexes, wherein the first calculation formula can be an index data algorithm in a protocol of each equipment manufacturer, analyzing the algorithm through the protocol to obtain a first calculation formula between each source data and the corresponding index, and storing all the source data and the corresponding first calculation formula in a first data layer according to a preset index definition table. The first calculation formula may be a constant, that is, the source data may be directly mapped to the predefined index data, and if the first calculation formula is 100, the predefined index data corresponding to the source data may be obtained by replacing the source data with 100. The first calculation formula can also be simple four-way operation, variable operation and function, such as A + B-C, @ bsc0id and func (A, B).
For example, an original file of a mobile phone is obtained, the original file is analyzed, a plurality of source data used for calculating indexes and a first calculation formula between the source data and the corresponding indexes are obtained, and then the source data and the corresponding first calculation formula are stored in a persistent layer of a first data layer according to a preset index definition table for subsequent use.
According to the universal index processing method provided by the embodiment of the invention, the source data and the corresponding first calculation formula are stored in the first data layer, so that if the index algorithm of an equipment manufacturer is changed, the first calculation formula corresponding to the source data is only required to be adjusted, the updating of the subsequent processing algorithm can be realized under the condition of no or little code modification, and the development workload is reduced.
On the basis of the foregoing embodiments, further, the acquiring predefined index data according to the source data and storing the predefined index data in a second data layer according to the preset index definition table includes:
acquiring source data in a first data layer and a first calculation formula corresponding to the source data;
acquiring predefined index data according to the source data and a first calculation formula corresponding to the source data;
and storing the predefined index data in a second data layer according to a preset index definition table.
Specifically, source data stored in a first data layer and a first calculation formula corresponding to the source data are obtained, predefined index data are calculated according to the source data corresponding to the index of the same equipment manufacturer and the first calculation formula corresponding to the source data, and then all the predefined index data are stored in a persistent layer of the first data layer according to a preset index definition table.
For example, the source data corresponding to the hua-shi mobile phone traffic is source data such as call time, a calling call place, a called call place, and the like, each source data corresponds to a first calculation formula, the source data and the first calculation formula are stored in a first data layer, then the source data related to the hua-shi mobile phone traffic and the first calculation formula corresponding to the source data are obtained, the hua-shi mobile phone traffic data are obtained by performing operation and combination on the source data, and then the hua-shi mobile phone traffic data are stored in a persistent layer of a second data layer according to a preset index definition table. In practical application, a java inverse modulation mode can be used for reading a first calculation formula corresponding to each source data in the first data layer, and the source data are processed to obtain predefined index data.
According to the general index processing method provided by the embodiment of the invention, the predefined index data is obtained according to the source data in the first data layer and the corresponding first calculation formula, so that if the index algorithm of an equipment manufacturer is changed, new predefined index data can be obtained only by adjusting the first calculation formula corresponding to the source data under the condition of not modifying or slightly modifying codes, the updating of a subsequent processing algorithm is realized, and the development workload is reduced.
On the basis of the foregoing embodiments, further, the storing the pre-indicator definition data in the second data layer according to a preset indicator definition table includes:
acquiring a second calculation formula according to the relation between the predefined index data and the public index data;
and storing the predefined index data and the corresponding second calculation formula in a second data layer according to the preset index definition table.
Specifically, predefined index data of each equipment manufacturer in the second data layer is obtained, and a second calculation formula is obtained according to a relation between each predefined index data and the common index data, wherein the second calculation formula comprises: the four arithmetic, functions, variables, etc. can implement direct mapping between predefined index data and common index data, calculation of other indexes at the same level, calculation of lower-level indexes, calculation of other special formulas, etc., where the index level corresponds to the data layer in which the data is stored, for example, the level number corresponding to the source data in the first data layer is 1, the level corresponding to the predefined index data in the second data layer is 2, the level corresponding to the common index data in the third data layer is 3, if there is data obtained by processing the common index data on the common index data, the level corresponding to the common index data is 4, this root source data may also be referred to as 1-level index data, the predefined index data may also be referred to as 2-level index data, and the common index data may also be referred to as 3-level index data. And then, storing the predefined index data of each equipment manufacturer and a corresponding second calculation formula in a second data layer according to a preset index definition table.
For example, if the common index data is the normalized predefined index data, the predefined index data and the corresponding normalized calculation formula are stored according to the normalized formula, and if the predefined index data are Huawei mobile phone traffic A, Zhongxing mobile phone traffic B and Setarium mobile phone traffic C, respectively, and the corresponding normalized formulas are 40% A, 30% B and 30% C, respectively, A, 40% A, B, 30% B and C and 30% C are stored in the second data layer, respectively.
In the general index processing method provided by the embodiment of the invention, the predefined index data and the corresponding second calculation formula are stored in the second data layer, so that the common index algorithm is changed, and the update of the subsequent processing algorithm can be realized under the condition of not modifying or slightly modifying codes by only adjusting the second calculation formula corresponding to the predefined index data, and the development workload is reduced.
On the basis of the foregoing embodiments, further, the acquiring common index data according to the predefined index data and storing the common index data in a third data layer according to the preset index definition table includes:
acquiring predefined index data in a second data layer and a second calculation formula corresponding to the predefined index data;
acquiring public index data according to the predefined index data and a second calculation formula corresponding to the predefined index data;
and storing the public index data in a third data layer according to the preset index definition table.
Specifically, predefined index data in the second data layer and a second calculation formula corresponding to the predefined index data are obtained, the predefined index data are processed according to the second calculation formula, public index data are obtained, the processing process comprises direct mapping, predefined index data combination operation and the like, and the public index data can be calculated by reading the second calculation formula in the second data layer in a java inverse modulation mode. And then, storing the public index data according to a preset index definition table.
In practical applications, a preset index definition table may be set according to actual situations, and preferably, the preset index definition table includes, but is not limited to, an index system code, an index name, an index level, a calculation formula, and the like, for example, table 1 is the preset index definition table provided in the embodiment of the present invention, and index data information and operation information may be configured and stored through the preset index definition table.
TABLE 1 Preset index definition Table
Index data of each level is stored according to a preset index definition table defined in table 1, wherein the index level represents the dimensionality of index calculation and is used for distinguishing index data of different data layers, the index type is used for distinguishing direct mapping index data and index data needing to be calculated, the index data needing to be calculated can read a corresponding calculation formula for calculation, the calculation priorities can be configured with different calculation priorities for different index data, calculation is performed according to a specified priority sequence, nested calculation of index data formula calculation is achieved, and the calculation formula is used for configuring a calculation formula for the index data, so that the purpose of flexible calculation is achieved. After the index data of different levels are stored according to the preset index definition table, when the calculation formula corresponding to the index data of a certain level is changed, only the corresponding calculation formula needs to be changed, so that different subsequent processing optimization algorithms can be realized through configuring different calculation formulas, adjusting the calculation formulas, increasing, modifying, deleting the attributes of the index data and the like. In practical application, in order to facilitate operation, all index data can be stored in a corresponding index data table in a structured and visualized manner, query, modification, addition and deletion of index data and calculation formulas thereof can be conveniently implemented through an interface or a client mode, and the index data and the calculation formulas can also be integrated with other functions as a part of an integral platform.
For example, the method includes the steps of firstly obtaining original files of equipment manufacturers, analyzing source data used for calculating predefined index data and a first calculation formula corresponding to the source data from the original files, storing the source data and the first calculation formula corresponding to the source data in a first data layer according to a preset index definition table, then obtaining the predefined index data of the equipment manufacturers according to the source data in the first data layer and the first calculation formula, storing the predefined index data of the equipment manufacturers and a second calculation formula corresponding to the predefined index data in a second data layer according to the preset index definition table, finally processing the predefined index data according to the second calculation formula to obtain public index data, and storing the public index data according to the preset index definition table.
According to the general index processing method provided by the embodiment of the invention, the common index data is calculated according to the predefined index data and the corresponding second calculation formula, and the formats of the predefined index data of all equipment manufacturers are unified and stored together, so that cross-equipment manufacturer analysis and whole-network analysis can be performed, the updating of a subsequent processing algorithm can be realized under the condition of no or little code modification, and the development workload is reduced.
Fig. 2 is a schematic structural diagram of a general index processing system according to an embodiment of the present invention, and as shown in fig. 2, the system includes: a first obtaining module 21, a second obtaining module 22 and a third obtaining module 23, wherein:
the first obtaining module 21 is configured to obtain a plurality of source data for calculating predefined index data of each equipment manufacturer, and store the source data in a first data layer according to a preset index definition table; the second obtaining module 22 is configured to obtain predefined index data according to the source data, and store the predefined index data in a second data layer according to a preset index definition table; the third obtaining module 23 is configured to obtain common index data according to the predefined index data, and store the common index data in a third data layer according to a preset index definition table.
Specifically, the first obtaining module 21 obtains a plurality of source data for calculating the predefined index data of each equipment manufacturer, and after obtaining the source data, they are also needed to be stored, the source data is stored in the first data layer according to the preset index definition table, the acquired source data are stored in the form of an index table, the second acquisition module 22 acquires predefined index data of each equipment manufacturer according to the source data stored in the first data layer, such as predefined index data of mobile phone traffic data, 4G internet traffic data, Zhongxing mobile phone traffic data, 4G internet traffic data, etc., these predefined indicators mostly correspond to common indicators, i.e. the indicators that eventually need to be analyzed, and then storing the predefined index data in a second data layer according to the preset index definition table, for example, storing the predefined index data in a persistent layer in the second data layer. The third obtaining module 23 obtains the common index data according to the predefined index data stored in the second data layer, where the common index data of each equipment manufacturer are the same in type and meaning. The traffic data is obtained according to predefined index data such as Hua-shi mobile phone traffic data, Zhongxing mobile phone traffic data, millet mobile phone traffic data and the like, 4G internet traffic data is obtained according to predefined index data such as Hua-shi mobile phone 4G internet traffic data, Zhongxing mobile phone 4G internet traffic data, millet mobile phone 4G internet traffic data and the like, and then public index data such as the traffic data, the 4G internet traffic data and the like are stored in a third data layer according to a preset index definition table. The functions of the system provided by the embodiment of the present invention specifically refer to the above method embodiment, and are not described herein again.
According to the general index processing system provided by the embodiment of the invention, a plurality of source data used for calculating the predefined index data of each equipment manufacturer are subjected to summary conversion through hierarchical storage, and the public index data of the same type are finally obtained, so that the subsequent processing can be directly analyzed from the stored public index data, the workload of index acquisition processing development is reduced, and when the subsequent processing algorithm is updated, the source data of each equipment manufacturer does not need to be acquired and counted again, and the subsequent maintenance is simpler.
On the basis of the foregoing embodiment, further, the first obtaining module includes:
the acquisition unit is used for acquiring original files of equipment manufacturers;
the analysis unit is used for analyzing the original file to obtain a plurality of source data used for calculating indexes of each equipment manufacturer and a first calculation formula corresponding to each source data;
and the first storage unit is used for storing the source data and the corresponding first calculation formula in a first data layer according to a preset index definition table.
Specifically, the acquisition unit acquires an original file of each equipment manufacturer from an equipment side interface of each equipment manufacturer, the analysis unit analyzes the original file of each equipment manufacturer by using an adapter mode, acquires a plurality of source data for calculating indexes of each equipment manufacturer and a first calculation formula between the source data and the corresponding indexes, wherein the first calculation formula can be an index data algorithm in a protocol of each equipment manufacturer, the algorithm is analyzed through the protocol to obtain a first calculation formula between each source data and the corresponding index, and then the first storage unit stores all the source data and the corresponding first calculation formula in a first data layer according to a preset index definition table. The first calculation formula may be a constant, that is, the source data may be directly mapped to the predefined index data, and if the first calculation formula is 100, the predefined index data corresponding to the source data may be obtained by replacing the source data with 100. The first calculation formula can also be simple four-way operation, variable operation and function, such as A + B-C, @ bsc0id and func (A, B). The functions of the system provided by the embodiment of the present invention specifically refer to the above method embodiment, and are not described herein again.
According to the general index processing system provided by the embodiment of the invention, the source data and the corresponding first calculation formula are stored in the first data layer, so that if the index algorithm of an equipment manufacturer is changed, the first calculation formula corresponding to the source data is only required to be adjusted, the updating of the subsequent processing algorithm can be realized under the condition of no or little code modification, and the development workload is reduced.
On the basis of the foregoing embodiments, further, the second obtaining module includes:
the acquisition unit is used for acquiring the source data in the first data layer and a first calculation formula corresponding to the source data;
the calculation unit is used for acquiring predefined index data according to the source data and a corresponding first calculation formula;
and the second storage unit is used for storing the pre-index definition data in a second data layer according to a preset index definition table.
Specifically, the obtaining unit obtains source data stored in a first data layer and a first calculation formula corresponding to the source data, the calculation unit calculates predefined index data according to the source data corresponding to the same equipment manufacturer index and the first calculation formula corresponding to the source data, and then the second storage unit stores all the predefined index data in a persistent layer of the first data layer according to a preset index definition table. The functions of the system provided by the embodiment of the present invention specifically refer to the above method embodiment, and are not described herein again.
According to the general index processing system provided by the embodiment of the invention, the predefined index data is obtained according to the source data in the first data layer and the corresponding first calculation formula, so that if the index algorithm of an equipment manufacturer is changed, new predefined index data can be obtained only by adjusting the first calculation formula corresponding to the source data under the condition of not modifying or slightly modifying codes, the updating of a subsequent processing algorithm is realized, and the development workload is reduced.
Fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 3, the electronic device includes: a processor (processor)301, a memory (memory)302, and a bus 303;
the processor 301 and the memory 302 complete communication with each other through the bus 303;
An embodiment of the present invention discloses a computer program product, which includes a computer program stored on a non-transitory computer readable storage medium, the computer program including program instructions, when the program instructions are executed by a computer, the computer can execute the methods provided by the above method embodiments, for example, the method includes: the method comprises the steps of obtaining a plurality of source data of each equipment manufacturer, wherein the source data are used for calculating predefined index data, and storing the source data in a first data layer according to a preset index definition table; acquiring predefined index data according to the source data, and storing the predefined index data in a second data layer according to the preset index definition table; and acquiring public index data according to the predefined index data, and storing the public index data in a third data layer according to the preset index definition table.
Embodiments of the present invention provide a non-transitory computer-readable storage medium, which stores computer instructions, where the computer instructions cause the computer to perform the methods provided by the above method embodiments, for example, the methods include: the method comprises the steps of obtaining a plurality of source data of each equipment manufacturer, wherein the source data are used for calculating predefined index data, and storing the source data in a first data layer according to a preset index definition table; acquiring predefined index data according to the source data, and storing the predefined index data in a second data layer according to the preset index definition table; and acquiring public index data according to the predefined index data, and storing the public index data in a third data layer according to the preset index definition table.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
The above-described embodiments of the system and the like are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the embodiments of the present invention, and are not limited thereto; although embodiments of the present invention have been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (8)
1. A method for processing a universal index is characterized by comprising the following steps:
the method comprises the steps of obtaining a plurality of source data of each equipment manufacturer, wherein the source data are used for calculating predefined index data, and storing the source data in a first data layer according to a preset index definition table;
acquiring predefined index data according to the source data, and storing the predefined index data in a second data layer according to the preset index definition table;
obtaining public index data according to the predefined index data, and storing the public index data in a third data layer according to the preset index definition table;
the method for acquiring a plurality of source data of each equipment manufacturer for calculating predefined index data and storing the source data in a first data layer according to a preset index definition table includes:
collecting original files of equipment manufacturers;
analyzing the original file to obtain a plurality of source data for calculating indexes of each equipment manufacturer and a first calculation formula corresponding to each source data;
and storing the source data and the corresponding first calculation formula in a first data layer according to a preset index definition table.
2. The method according to claim 1, wherein the obtaining predefined index data according to the source data and storing the predefined index data in a second data layer according to the preset index definition table comprises:
acquiring source data in a first data layer and a first calculation formula corresponding to the source data;
acquiring predefined index data according to the source data and a first calculation formula corresponding to the source data;
and storing the predefined index data in a second data layer according to a preset index definition table.
3. The method of claim 2, wherein storing the predefined metric data in the second data layer according to a preset metric definition table comprises:
acquiring a second calculation formula according to the relation between the predefined index data and the public index data;
and storing the predefined index data and the corresponding second calculation formula in a second data layer according to the preset index definition table.
4. The method according to claim 3, wherein the obtaining common index data according to the predefined index data and storing the common index data in a third data layer according to the preset index definition table comprises:
acquiring predefined index data in a second data layer and a second calculation formula corresponding to the predefined index data;
acquiring public index data according to the predefined index data and a second calculation formula corresponding to the predefined index data;
and storing the public index data in a third data layer according to the preset index definition table.
5. A general purpose index processing system, comprising:
the system comprises a first acquisition module, a first data layer and a second data layer, wherein the first acquisition module is used for acquiring a plurality of source data of each equipment manufacturer for calculating predefined index data and storing the source data in the first data layer according to a preset index definition table;
the second acquisition module is used for acquiring predefined index data according to the source data and storing the predefined index data in a second data layer according to a preset index definition table;
the third acquisition module is used for acquiring public index data according to the predefined index data and storing the public index data in a third data layer according to a preset index definition table;
the first acquisition module comprises:
the acquisition unit is used for acquiring original files of equipment manufacturers;
the analysis unit is used for analyzing the original file to obtain a plurality of source data used for calculating indexes of each equipment manufacturer and a first calculation formula corresponding to each source data;
and the first storage unit is used for storing the source data and the corresponding first calculation formula in a first data layer according to a preset index definition table.
6. The system of claim 5, wherein the second obtaining module comprises, comprising:
the acquisition unit is used for acquiring the source data in the first data layer and a first calculation formula corresponding to the source data;
the calculation unit is used for acquiring predefined index data according to the source data and a corresponding first calculation formula;
and the second storage unit is used for storing the predefined index data in a second data layer according to a preset index definition table.
7. An electronic device, comprising:
the processor and the memory are communicated with each other through a bus; the memory stores program instructions executable by the processor, the processor invoking the program instructions to perform the method of any of claims 1 to 4.
8. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710641060.5A CN107491505B (en) | 2017-07-31 | 2017-07-31 | Universal index processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710641060.5A CN107491505B (en) | 2017-07-31 | 2017-07-31 | Universal index processing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107491505A CN107491505A (en) | 2017-12-19 |
| CN107491505B true CN107491505B (en) | 2020-06-16 |
Family
ID=60644016
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710641060.5A Active CN107491505B (en) | 2017-07-31 | 2017-07-31 | Universal index processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107491505B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110163492B (en) * | 2019-04-30 | 2021-11-12 | 南京南瑞继保电气有限公司 | Index processing method and device of rail transit energy management system and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101198134A (en) * | 2007-12-29 | 2008-06-11 | 中国移动通信集团湖北有限公司 | Real time telephone traffic and channel load monitoring method and system used for mobile network |
| CN103532776B (en) * | 2013-09-30 | 2016-06-22 | 广东电网公司电力调度控制中心 | Service traffics detection method and system |
| CN105550940A (en) * | 2015-11-25 | 2016-05-04 | 中国南方电网有限责任公司电网技术研究中心 | Power gird equipment standard index data mining and extraction method |
-
2017
- 2017-07-31 CN CN201710641060.5A patent/CN107491505B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107491505A (en) | 2017-12-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9634902B1 (en) | Bloom filter index for device discovery | |
| US20190318026A1 (en) | Resource condition correction using intelligently configured dashboard widgets | |
| CN107273369B (en) | Table data modification method and device | |
| CN114760201B (en) | Data acquisition method, device and equipment of industrial control equipment and storage medium | |
| US9706005B2 (en) | Providing automatable units for infrastructure support | |
| CN111343267B (en) | Configuration management method and system | |
| CN114021156A (en) | Method, device and equipment for organizing vulnerability automatic aggregation and storage medium | |
| CN114816393B (en) | Information generation method, device, equipment and storage medium | |
| CN107819745B (en) | Method and device for defending against abnormal traffic | |
| CN115455046A (en) | Duplicate determination in the figure | |
| CN109240893B (en) | Application running state query method and terminal equipment | |
| CN107491505B (en) | Universal index processing method and system | |
| CN114741392A (en) | Data query method and device, electronic equipment and storage medium | |
| CN112346775B (en) | Index data general processing method, electronic device and storage medium | |
| CN116502273B (en) | Dynamic data desensitization method, device and equipment based on data blood edges | |
| JP7098735B2 (en) | Optimization of large-scale data analysis | |
| US20230153357A1 (en) | Method of processing an observation information, electronic device and storage medium | |
| CN110275880B (en) | Data analysis method, device, server and readable storage medium | |
| CN111858617A (en) | User searching method and device, computer readable storage medium and electronic equipment | |
| CN113641567B (en) | Database inspection method and device, electronic equipment and storage medium | |
| CN110781410A (en) | Community detection method and device | |
| CN114860362A (en) | Interface updating method and device | |
| CN115222444A (en) | Method, apparatus, device, medium and product for outputting model information | |
| CN110471708B (en) | Method and device for acquiring configuration items based on reusable components | |
| CN113779335A (en) | Information generation method and device, electronic equipment and computer readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |