CN105574128A - Method for finishing complex data operations in business intelligence system - Google Patents
Method for finishing complex data operations in business intelligence system Download PDFInfo
- Publication number
- CN105574128A CN105574128A CN201510933001.6A CN201510933001A CN105574128A CN 105574128 A CN105574128 A CN 105574128A CN 201510933001 A CN201510933001 A CN 201510933001A CN 105574128 A CN105574128 A CN 105574128A
- Authority
- CN
- China
- Prior art keywords
- complete
- business intelligence
- year
- dynamic column
- function
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
Abstract
The invention discloses a method for finishing complex data operations in a business intelligence system. According to the method provided by the invention, related counting results can be directly used for follow-up operations in analysis of business intelligence through adding dynamic columns to a to-be-processed data result set, finishing frequently used complex operations such as column operation and year on year, year on year developing rate, link relative ratio, link relative ratio developing rate, fixed base relative and fixed base relative developing rate and traversing for once. According to the method of the invention, the problems of improving the calculating efficiency and finishing the related complex operations without writing complex expressions in statistic and analysis of the business intelligence are solved; and the method is efficient, simple and convenient.
Description
Technical field
The invention belongs to Business intelligence field, especially relate in a kind of business intelligence the method completing complex calculation under realizing prerequisite that business intelligence system data operation limits at limited resources.
Background technology
Business intelligence is collection to business information, management and analytic process, and decision maker's acquire knowledge at different levels of object Shi Shi enterprise or clairvoyance, impel them to make the decision-making more favourable to enterprise.Business intelligence is generally made up of parts such as data warehouse, on-line analytical processing, data mining, data backup and resumes.The realization of business intelligence relates to software, hardware, consulting service and application, and its basic architecture comprises data warehouse, on-line analytical processing and data mining three parts.
The key of business intelligence goes out useful data from many extracting data from different corporate operation systems and clear up, to ensure the correctness of data, then through extracting, change and loading, be merged in the data warehouse of an enterprise-level, thus obtain a global view of business data, utilize suitable inquiry and analysis instrument, Data Mining Tools etc. to carry out treatment and analysis to it on this basis.
Therefore, in the data analysis process of business intelligence, often can carry out complex calculation to basic data, cause producing repeatedly data traversal or other expenses, add operation time, cause cost to increase.
Summary of the invention
The problem to be solved in the present invention is to provide in the middle of the data analysis process of business intelligence, expands the result set of basic data, part rows computing is shared once in traversal and completes.Save operation time and cost.
The core concept that the present invention adopts is: reduce data traversal and other expenses as far as possible, as far as possible, completes computing as early as possible, and carries out certain dynamic expansion to result set.
For solving the problems of the technologies described above, the technical solution used in the present invention is:
Business intelligence system data complete a method for complex calculation, comprise the following steps:
1) dynamic column is added to data result set, be each dynamic column setting title, and ensure uniqueness;
2) expression formula of each row is set;
3) call parameter setting is carried out to data result set;
4) need to data carry out traversal use time, dynamically update dynamic train value, namely directly obtain, data buffer storage can be returned results needed by computing engines while acquisition.
Preferably, described dynamic column comprises common dynamic column, text dynamic column, phase than function dynamic column.
Further, the expression formula of described common dynamic column, can complete without the need to traversal.
Further, the expression formula of described text dynamic column, can complete without the need to traversal.
Further, the described phase comprises than function: on year-on-year basis function, year-on-year growth rate function, the function of development rate on year-on-year basis, chain rate function, sequential growth rate function, chain rate development rate function, determine base and compare function.
Further, the described phase than function dynamic column, in step 2) except setting expression formula except, also need formulate step-length, and statistics row.
Further, described step-length is a circulation of fixed time period, and the described fixed time period comprises day, the moon, season, year.
Further, the described phase, than the computing of function dynamic column, once travels through in advance, can complete.
Further, step 3) setting of described call parameter comprises and upgrades metadata information, upgrades row head, row sequence number.
Beneficial effect of the present invention is:
The present invention is by adding dynamic column to the data result collection being about to process, complete the column operations of often using and on year-on-year basis, development rate on year-on-year basis, chain rate, chain rate development rate, determine base ratio, determine base than complex calculation such as development rates, through once traveling through, in subsequent arithmetic, directly ASSOCIATE STATISTICS result can be used.The present invention can solve when business intelligence carries out statistical study, improves counting yield, completes the problem that relevant complex calculation does not need again to write complex expression, efficiently, simply, convenient.
Accompanying drawing explanation
Fig. 1 is that the present invention adds text dynamic column or common dynamic column inquiry schematic diagram;
Fig. 2 is that the present invention adds the phase than function dynamic column inquiry schematic diagram.
Embodiment
Below in conjunction with accompanying drawing, specific embodiments of the invention are elaborated.
The present invention is to data result set:
1) add dynamic column and dynamic column type is set
2) common dynamic column calculates, without the need to traveling through the calculating that can complete between row
3) text dynamic column calculates, and can complete expression formula calculate without the need to traversal
4) phase calculates than function dynamic column, once travels through in advance, can complete computing
Wherein dynamic column can be divided into common dynamic column, text dynamic column, phase than function dynamic column etc.
The computing method of common dynamic column, namely common list reach formula calculate, such as data result shown in Fig. 1 concentrate comprises row A, B, C, dynamic column expression formula is A+B, then represent the value of this dynamic column be row A and the B of current line with.
Text dynamic column computing method, namely textual expression calculates, and such as packet shown in Fig. 1 is containing row A, B, C, and current row value is C=' Guan Yu ', and text dynamic column expression formula is for ' I is C ', and ' I is Guan Yu ' to result of calculation.
Therefore the present invention add text dynamic column or common dynamic column inquiry schematic diagram as shown in Figure 1:
First need to build general query.
Then row name is set for each dynamic column and expression formula is set.
Wait in use and dynamically update dynamic train value.
Phase calculates than the dynamic column of function, and the dynamic column expression formula namely comprising phase ratio calculates, and the phase comprises than function: on year-on-year basis, year-on-year growth rate, development rate on year-on-year basis, chain rate, sequential growth rate, chain rate development rate, determine the functions such as base ratio.Definition fundamental, one of step-length and fixed time period circulates such as day, the moon, season, year.Calculate than function according to time limit and the computing formula phase that completes.Successfully time dimension must be contained, so the data set that will calculate must comprise time dimension as calculated.If do not comprised time dimension, system can add time dimension data to query results voluntarily according to setting.To calculate.
Phase of the present invention inquires about schematic diagram as shown in Figure 2 than the dynamic column of function:
First need to build general query.
Then row name is set for each dynamic column and expression formula is set.And require to arrange step-length, if the system that do not arrange can default setting.Add in the inquiry of basis.
Then once travel through in advance, add additional virtual row ' phase ' and ' ID ' represent the row data ' phase ' and as unique identification.To obtain data.
Finally, when subsequent analysis needs usage data, the given period is than dynamic train value.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (9)
1. business intelligence system data complete a method for complex calculation, it is characterized in that, comprise the following steps:
1) dynamic column is added to data result set, be each dynamic column setting title, and ensure uniqueness;
2) expression formula of each row is set;
3) call parameter setting is carried out to data result set;
4) need to data carry out traversal use time, dynamically update dynamic train value, namely directly obtain, data buffer storage can be returned results needed by computing engines while acquisition.
2. a kind of business intelligence system data according to claim 1 complete the method for complex calculation, it is characterized in that, described dynamic column comprises common dynamic column, text dynamic column, phase than function dynamic column.
3. a kind of business intelligence system data according to claim 2 complete the method for complex calculation, it is characterized in that, the expression formula of described common dynamic column, can complete without the need to traversal.
4. a kind of business intelligence system data according to claim 2 complete the method for complex calculation, it is characterized in that, the expression formula of described text dynamic column, can complete without the need to traversal.
5. a kind of business intelligence system data according to claim 2 complete the method for complex calculation, it is characterized in that, the described phase comprises than function: on year-on-year basis function, year-on-year growth rate function, the function of development rate on year-on-year basis, chain rate function, sequential growth rate function, chain rate development rate function, determine base and compare function.
6. a kind of business intelligence system data according to claim 2 complete the method for complex calculation, it is characterized in that, the described phase than function dynamic column, in step 2) except setting expression formula except, also need formulate step-length, and statistics row.
7. a kind of business intelligence system data according to claim 6 complete the method for complex calculation, it is characterized in that, described step-length is a circulation of fixed time period, and the described fixed time period comprises day, the moon, season, year.
8. a kind of business intelligence system data according to claim 2 complete the method for complex calculation, and it is characterized in that, the described phase, than the computing of function dynamic column, once travels through in advance, can complete.
9. a kind of business intelligence system data according to any one of claim 1-8 complete the method for complex calculation, it is characterized in that, step 3) setting of described call parameter comprises and upgrades metadata information, upgrades row head, row sequence number.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510933001.6A CN105574128A (en) | 2015-12-12 | 2015-12-12 | Method for finishing complex data operations in business intelligence system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510933001.6A CN105574128A (en) | 2015-12-12 | 2015-12-12 | Method for finishing complex data operations in business intelligence system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105574128A true CN105574128A (en) | 2016-05-11 |
Family
ID=55884259
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510933001.6A Pending CN105574128A (en) | 2015-12-12 | 2015-12-12 | Method for finishing complex data operations in business intelligence system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105574128A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101178711A (en) * | 2006-11-30 | 2008-05-14 | 腾讯科技（深圳）有限公司 | Chinese auto-answer method and system |
| CN102750356A (en) * | 2012-06-11 | 2012-10-24 | 清华大学 | Construction and management method for secondary indexes of key value library |
| WO2014015828A1 (en) * | 2012-07-27 | 2014-01-30 | 腾讯科技（深圳）有限公司 | Data storage space processing method and processing system, and data storage server |
| CN104216924A (en) * | 2013-06-03 | 2014-12-17 | 肖瑞 | Time sequence index based on trends |
-
2015
- 2015-12-12 CN CN201510933001.6A patent/CN105574128A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101178711A (en) * | 2006-11-30 | 2008-05-14 | 腾讯科技（深圳）有限公司 | Chinese auto-answer method and system |
| CN102750356A (en) * | 2012-06-11 | 2012-10-24 | 清华大学 | Construction and management method for secondary indexes of key value library |
| WO2014015828A1 (en) * | 2012-07-27 | 2014-01-30 | 腾讯科技（深圳）有限公司 | Data storage space processing method and processing system, and data storage server |
| CN104216924A (en) * | 2013-06-03 | 2014-12-17 | 肖瑞 | Time sequence index based on trends |
Non-Patent Citations (3)
| Title |
|---|
| 仲任: ""基于ETL的Web报表循环打印研究与应用"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 孙琦: ""网络音乐企业商业智能系统的设计"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 林伟富: ""面向流程的全面预算管理系统的设计与实现"", 《万方数据库》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Meng et al. | Training deeper models by GPU memory optimization on TensorFlow | |
| Chen et al. | T-DBSCAN: A Spatiotemporal Density Clustering for GPS Trajectory Segmentation. | |
| Thesen | Computer methods in operations research | |
| CN106649656A (en) | Spatial-temporal trajectory big data storage method for database | |
| CN106547627A (en) | The method and system that a kind of Spark MLlib data processings accelerate | |
| US20110208691A1 (en) | Accessing Large Collection Object Tables in a Database | |
| CN104991898A (en) | Processing method and apparatus for pushing information | |
| US8768979B2 (en) | In-memory data grid hash scheme optimization | |
| CN102314491B (en) | Method for identifying similar behavior mode users in multicore environment based on massive logs | |
| CN104572709A (en) | Data mining system used for enterprise innovation system | |
| US20190116236A1 (en) | System and method for selecting proxy computer | |
| CN105630934A (en) | Data statistic method and system | |
| CN103699441A (en) | MapReduce report task execution method based on task granularity | |
| Tran et al. | A hybrid water flow algorithm for multi-objective flexible flow shop scheduling problems | |
| CN104516976A (en) | Intellectual property infringement reminding system based on cloud database | |
| US20140201132A1 (en) | Storing a key value to a deleted row based on key range density | |
| Jun et al. | Cloud computing based solution to decision making | |
| Tank et al. | Speeding ETL processing in data warehouses using high-performance joins for changed data capture (cdc) | |
| CN110322931A (en) | A kind of base recognition methods, device, equipment and storage medium | |
| CN103136244A (en) | Parallel data mining method and system based on cloud computing platform | |
| CN104112011A (en) | Method and device for extracting mass data | |
| Cho et al. | A basis of spatial big data analysis with map-matching system | |
| Hibino et al. | A synchronization mechanism with shared storage model for distributed manufacturing simulation systems | |
| CN104217032A (en) | Method and device for processing database dimensions | |
| CN105574128A (en) | Method for finishing complex data operations in business intelligence system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160511 |
|
| RJ01 | Rejection of invention patent application after publication |