CN107958048A - A kind of multi-dimensions database system and implementation method based on financial data analysis - Google Patents
A kind of multi-dimensions database system and implementation method based on financial data analysis Download PDFInfo
- Publication number
- CN107958048A CN107958048A CN201711207964.3A CN201711207964A CN107958048A CN 107958048 A CN107958048 A CN 107958048A CN 201711207964 A CN201711207964 A CN 201711207964A CN 107958048 A CN107958048 A CN 107958048A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- server
- financial
- analysis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/12—Accounting
- G06Q40/125—Finance or payroll
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Development Economics (AREA)
- General Business, Economics & Management (AREA)
- Technology Law (AREA)
- Strategic Management (AREA)
- Marketing (AREA)
- Economics (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)
Abstract
The invention discloses a kind of multi-dimensions database system based on financial data analysis, including data acquisition end, ETL process processing server, data warehouse server and multidimensional data analysis server；Data acquisition end connects ETL process processing server, ETL process processing server connection data warehouse server, data warehouse server connection multidimensional data analysis server.The present invention to raw financial data be converted into integrating in data warehouse server after specific format by ETL process processing server, integrated data in data bins builds Multidimensional Data Model in multidimensional data analysis server, and form multiple Data Marts, then comprehensive analysis is carried out, accessed easy to data query, and then improve rate of people logging in.
Description
Technical field
The invention belongs to financial analysis field, is related to a kind of multi-dimensions database system based on financial data analysis and realization
Method.
Background technology
Under the overall situation of China's rapid economic development, group enterprise is also in Quick Extended, high speed development, belonging to group
The business and financial system of each enterprise pass through long-term operation, have accumulated substantial amounts of data, but these substantial amounts of data are only deposited
With in each financial information system, data be not fully used, the value of data is not embodied.Business data should
The following aspects is mainly reflected in present situation：(1) enterprise have accumulated mass data；(2) data disperse to store, and are difficult to realize comprehensive
Close analysis application；(3) report species is various, collects difficulty, and data are error-prone；(4) it is difficult the analysis that gives a forecast；(5) cannot surround
The strategic objective of group, carries out Coordination Decision.
Financial system simply solves financial general ledger procedure, standardization, and database is designed a model according to traditional ER
Design, it then follows the normal form rule in database design, therefore data convenient storage and the uniformity, the integrality that preserve data, but
It is unfavorable for multi-dimensional query and analysis, it is less efficient.By using the multidimensional analysis database of the data warehouse in business intelligence
Design method, multiple financial indicators in financial general ledger are divided according to theme, are built using " Star Model " and " snowflake model "
Vertical data warehouse, to improve financial data access efficiency.
The content of the invention
, should it is an object of the invention to provide a kind of multi-dimensions database system and implementation method based on financial data analysis
System be converted into after specific format in data warehouse server raw financial data by ETL process processing server
Integrated, the integrated data in data bins builds Multidimensional Data Model in multidimensional data analysis server, and is integrated
Analysis, accesses easy to data query, and then improves rate of people logging in.
The purpose of the present invention can be achieved through the following technical solutions：
A kind of multi-dimensions database system based on financial data analysis, including data acquisition end, ETL process processing service
Device, data warehouse server and multidimensional data analysis server；Data acquisition end connects ETL process processing server, ETL process
Processing server connects data warehouse server, data warehouse server connection multidimensional data analysis server；
The data acquisition end is collection enterprise raw financial data；
The ETL process processing server includes data extraction module, data cleansing module, data conversion module and data
Load-on module, data extraction module are the data cleansing modules by being extracted financial data in financial system by interface
That basic data to not meeting specification or invalid data are cleared up, modular converter be by each financial data carry out conversion plus
Work, to realize the storage of Uniform data format, data load-on module is that the financial data after processing is loaded into data warehouse clothes
It is engaged in device；
The data bins server is used for the financial data after the financial data of unified form and calculating is unified according to not
Same theme is integrated；
The multidimensional data analysis server includes presetting module, data analysis module, data display module, presetting module
In be stored with integrated data, default dimension and preset themes；Data analysis module is by calling the default dimension in presetting module
Analyzed with preset themes and to integrated data, so as to establish theme metadata table；Data exhibiting module is more by accessing
The mode of dimension data collection, is presented in door end, there is provided Analysis of Policy Making by financial data with abundant graph mode.
Further, the raw financial data is Excel spreadsheets.
Further, the data extraction module converts instrument for ETL, can be from any OLE-DB or ODBC or JDBC numbers
According to reading data in source.
A kind of implementation method of the multi-dimensional database based on financial data analysis, specific implementation step are as follows：
(1) calculation formula is stored in the memory module of ETL process processing server, and in multidimensional data analysis service
Dimension and preset themes are preset in the presetting module of device；
(2) data acquisition end collection enterprise raw financial data, and by the data of collection in ETL process processing server
Financial data extraction is carried out in data extraction module, then using data cleansing module to not meeting the basic data or nothing of specification
Effect data are cleared up, and each financial data after cleaning is carried out conversion processing, to realize the storage of Uniform data format, most
Financial data after handling at last is loaded into data warehouse server；
(3) data bins server is unified according to different masters by the financial data after the financial data of unified form and calculating
Topic is integrated, and forms integrated data；
(4) integrated data transmission in data bins is into the presetting module of multidimensional data analysis server, and passes through data
Analysis module calls default dimension and preset themes in presetting module to analyze integrated data, so as to establish theme member number
According to table, financial data is then presented in by door end with the graph mode enriched by data display module, there is provided Analysis of Policy Making.
Beneficial effects of the present invention：
The present invention be converted into after specific format in data bins by ETL process processing server to raw financial data
Being integrated in the server of storehouse, the integrated data in data bins builds Multidimensional Data Model in multidimensional data analysis server,
And comprehensive analysis is carried out, accessed easy to data query, and then improve rate of people logging in.
The present invention is equipped with data bins server, and the data after unified form and the data after calculating can be integrated,
Time limit of the data in data bins overcomes database and is difficult to meet need considerably beyond the data time limit in manipulation type environment
The shortcomings that seeking deficiency.
Brief description of the drawings
In order to facilitate the understanding of those skilled in the art, the present invention is further illustrated below in conjunction with the accompanying drawings.
Fig. 1 is multi-dimensions database system schematic diagram of the present invention；
Fig. 2 is multi-dimensions database system schematic diagram of the present invention.
Embodiment
A kind of multi-dimensions database system based on financial data analysis, as shown in Figure 1, including data acquisition end, ETL process
Processing server, data warehouse server and multidimensional data analysis server；Data acquisition end connection ETL process processing service
Device, ETL process processing server connection data warehouse server, data warehouse server connection multidimensional data analysis server；
The data acquisition end is collection enterprise raw financial data, and raw financial data is Excel spreadsheets；
As shown in Fig. 2, the ETL process processing server includes data extraction module, data cleansing module, data conversion
Module and data load-on module, data extraction module are the numbers by being extracted financial data in financial system by interface
That basic data to not meeting specification or invalid data are cleared up according to cleaning module, modular converter be by each financial data into
Row conversion processing, to realize the storage of Uniform data format, data load-on module is that the financial data after processing is loaded into number
According in warehouse server, wherein data extraction module converts instrument for ETL, can be from any OLE-DB or ODBC or JDBC data
Data are read in source；
The data bins server is used for the financial data after the financial data of unified form and calculating is unified according to not
Same theme is integrated, and data integration hardly updates after entering data bins, and the integrated data in data bins is in multidimensional data
Multidimensional Data Model is built in Analysis server, and carries out comprehensive analysis；
The multidimensional data analysis server includes presetting module, data analysis module, data display module, presetting module
In to be stored with integrated data, default dimension and preset themes, preset themes be according to actual financial analysis application scenarios, by finance
Theme storage is divided, such as assets theme, receivable theme, deal with theme, stock theme；Default dimension is according to actual finance point
Application scenarios are analysed, determine dimensional analysis granularity, should pay the utmost attention to develop dimension for the information that business processing acquisition most has atomicity
Model is spent, atomic data is collected most detailed information, and such data cannot do further subdivision again, at the same time
According to actual financial analysis application scenarios, determine that dimension is formed, shared dimension merged, and to each dimension defined attribute,
The contents such as level, member；Data analysis module is by calling the default dimension and preset themes in presetting module and being counted to integrated
According to being analyzed, so as to establish theme metadata table；Financial data is presented in by data exhibiting module with abundant graph mode
Door end, there is provided Analysis of Policy Making.
A kind of multi-dimensional database implementation method based on financial data analysis, specific implementation step are as follows：
(1) calculation formula is stored in the memory module of ETL process processing server, and in multidimensional data analysis service
Dimension and preset themes are preset in the presetting module of device；
(2) data acquisition end collection enterprise raw financial data, and by the data of collection in ETL process processing server
Financial data extraction is carried out in data extraction module, then using data cleansing module to not meeting the basic data or nothing of specification
Effect data are cleared up, and each financial data after cleaning is carried out conversion processing, to realize the storage of Uniform data format, most
Financial data after handling at last is loaded into data warehouse server；
(3) data bins server is unified according to different masters by the financial data after the financial data of unified form and calculating
Topic is integrated, and forms integrated data；
(4) integrated data transmission in data bins is into the presetting module of multidimensional data analysis server, and passes through data
Analysis module calls default dimension and preset themes in presetting module to analyze integrated data, so as to establish theme member number
According to table, financial data is then presented in by door end with the graph mode enriched by data display module, there is provided Analysis of Policy Making.
Present invention disclosed above preferred embodiment is only intended to help and illustrates the present invention.Preferred embodiment is not detailed
All details are described, are not limited the invention to the specific embodiments described.Obviously, according to the content of this specification,
It can make many modifications and variations.This specification is chosen and specifically describes these embodiments, is in order to preferably explain the present invention
Principle and practical application so that skilled artisan can be best understood by and utilize the present invention.The present invention is only
Limited by claims and its four corner and equivalent.
Claims (4)
1. a kind of multi-dimensions database system based on financial data analysis, it is characterised in that including data acquisition end, ETL process
Processing server, data warehouse server and multidimensional data analysis server；Data acquisition end connection ETL process processing service
Device, ETL process processing server connection data warehouse server, data warehouse server connection multidimensional data analysis server；
The data acquisition end is collection enterprise raw financial data；
The ETL process processing server includes data extraction module, data cleansing module, data conversion module and data loading
Module, data extraction module are that data cleansing module is pair by being extracted financial data in financial system by interface
The basic data or invalid data for not meeting specification are cleared up, and modular converter is that each financial data is carried out conversion processing, with
Realize the storage of Uniform data format, data load-on module is that the financial data after processing is loaded into data warehouse server
In；
The data bins server is used for the financial data after the financial data of unified form and calculating is unified according to different
Theme is integrated；
The multidimensional data analysis server includes presetting module, data analysis module, data display module, is deposited in presetting module
Contain integrated data, default dimension and preset themes；Data analysis module is by calling default dimension in presetting module and pre-
If theme simultaneously analyzes integrated data, so as to establish theme metadata table；Data exhibiting module is by accessing more dimensions
According to the mode of collection, financial data is presented in door end with abundant graph mode, there is provided Analysis of Policy Making.
2. a kind of multi-dimensions database system based on financial data analysis according to claim 1, it is characterised in that described
Raw financial data is Exce l spreadsheets.
3. a kind of multi-dimensions database system based on financial data analysis according to claim 1, it is characterised in that described
Data extraction module converts instrument for ETL, can read data from any OLE-DB or ODBC or JDBC data sources.
4. a kind of implementation method of the multi-dimensional database based on financial data analysis described in claim 1, implements step
It is as follows：
(1) calculation formula is stored in the memory module of ETL process processing server, and in multidimensional data analysis server
Dimension and preset themes are preset in presetting module；
(2) data acquisition end collection enterprise raw financial data, and by the data of collection ETL process processing server data
Financial data extraction is carried out in abstraction module, then using data cleansing module to not meeting the basic data or invalid number of specification
According to being cleared up, and each financial data after cleaning is subjected to conversion processing, to realize the storage of Uniform data format, most at last
Financial data after processing is loaded into data warehouse server；
(3) data bins server by the financial data after the financial data of unified form and calculating it is unified according to different themes into
Row is integrated, forms integrated data；
(4) integrated data transmission in data bins is into the presetting module of multidimensional data analysis server, and passes through data analysis
Module calls default dimension and preset themes in presetting module to analyze integrated data, so as to establish theme metadata
Table, is then presented in door end, there is provided Analysis of Policy Making by financial data by data exhibiting module with the graph mode enriched.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711207964.3A CN107958048A (en) | 2017-11-27 | 2017-11-27 | A kind of multi-dimensions database system and implementation method based on financial data analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711207964.3A CN107958048A (en) | 2017-11-27 | 2017-11-27 | A kind of multi-dimensions database system and implementation method based on financial data analysis |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107958048A true CN107958048A (en) | 2018-04-24 |
Family
ID=61962128
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711207964.3A Pending CN107958048A (en) | 2017-11-27 | 2017-11-27 | A kind of multi-dimensions database system and implementation method based on financial data analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107958048A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108766542A (en) * | 2018-05-28 | 2018-11-06 | 镇江市第人民医院 | A kind of data analysis processing method and system |
| CN108829731A (en) * | 2018-05-15 | 2018-11-16 | 吉贝克信息技术（北京）有限公司 | Data analysing method, system, computer readable storage medium and electric terminal |
| CN109189865A (en) * | 2018-08-09 | 2019-01-11 | 广东电网有限责任公司 | The overall analysis system and method for project data |
| CN110955413A (en) * | 2019-11-28 | 2020-04-03 | 国网河北省电力有限公司沧州供电分公司 | Financial data processing system |
| CN111062012A (en) * | 2019-12-13 | 2020-04-24 | 深圳迅策科技有限公司 | Financial integrated delivery and receipt system based on image recognition |
| CN111625537A (en) * | 2020-04-24 | 2020-09-04 | 山东电子职业技术学院 | Multidimensional data analysis system and multidimensional data analysis method |
| CN113190630A (en) * | 2021-05-31 | 2021-07-30 | 深圳金石创新科技有限公司 | Data integration method and system for constructing enterprise data warehouse |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030093429A1 (en) * | 2001-11-12 | 2003-05-15 | Hitachi, Inc. | Data warehouse system |
| CN101042746A (en) * | 2006-03-21 | 2007-09-26 | 上海浦东国际集装箱码头有限公司 | Container pier intellectualized report forms based on store house and method |
| CN104966133A (en) * | 2015-06-11 | 2015-10-07 | 安徽融信金模信息技术有限公司 | Method for analyzing operation conditions of small and medium-sized enterprises |
| CN105787059A (en) * | 2016-02-29 | 2016-07-20 | 四川长虹电器股份有限公司 | Data warehouse based financial data integration method |
| CN107301206A (en) * | 2017-06-01 | 2017-10-27 | 华南理工大学 | A kind of distributed olap analysis method and system based on pre-computation |
-
2017
- 2017-11-27 CN CN201711207964.3A patent/CN107958048A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030093429A1 (en) * | 2001-11-12 | 2003-05-15 | Hitachi, Inc. | Data warehouse system |
| CN101042746A (en) * | 2006-03-21 | 2007-09-26 | 上海浦东国际集装箱码头有限公司 | Container pier intellectualized report forms based on store house and method |
| CN104966133A (en) * | 2015-06-11 | 2015-10-07 | 安徽融信金模信息技术有限公司 | Method for analyzing operation conditions of small and medium-sized enterprises |
| CN105787059A (en) * | 2016-02-29 | 2016-07-20 | 四川长虹电器股份有限公司 | Data warehouse based financial data integration method |
| CN107301206A (en) * | 2017-06-01 | 2017-10-27 | 华南理工大学 | A kind of distributed olap analysis method and system based on pre-computation |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108829731A (en) * | 2018-05-15 | 2018-11-16 | 吉贝克信息技术（北京）有限公司 | Data analysing method, system, computer readable storage medium and electric terminal |
| CN108766542A (en) * | 2018-05-28 | 2018-11-06 | 镇江市第人民医院 | A kind of data analysis processing method and system |
| CN109189865A (en) * | 2018-08-09 | 2019-01-11 | 广东电网有限责任公司 | The overall analysis system and method for project data |
| CN110955413A (en) * | 2019-11-28 | 2020-04-03 | 国网河北省电力有限公司沧州供电分公司 | Financial data processing system |
| CN110955413B (en) * | 2019-11-28 | 2023-04-18 | 国网河北省电力有限公司沧州供电分公司 | Financial data processing system |
| CN111062012A (en) * | 2019-12-13 | 2020-04-24 | 深圳迅策科技有限公司 | Financial integrated delivery and receipt system based on image recognition |
| CN111625537A (en) * | 2020-04-24 | 2020-09-04 | 山东电子职业技术学院 | Multidimensional data analysis system and multidimensional data analysis method |
| CN113190630A (en) * | 2021-05-31 | 2021-07-30 | 深圳金石创新科技有限公司 | Data integration method and system for constructing enterprise data warehouse |
| CN113190630B (en) * | 2021-05-31 | 2022-02-01 | 深圳金石创新科技有限公司 | Data integration method and system for constructing enterprise data warehouse |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107958048A (en) | A kind of multi-dimensions database system and implementation method based on financial data analysis | |
| CN103593422B (en) | Virtual access management method of heterogeneous database | |
| CN108595621B (en) | Early warning analysis method and system for false value-added tax invoice | |
| CN104820670B (en) | A kind of acquisition of power information big data and storage method | |
| CN103678665B (en) | A kind of big data integration method of isomery based on data warehouse and system | |
| CN105989129B (en) | Real time data statistical method and device | |
| CN109272155A (en) | A kind of corporate behavior analysis system based on big data | |
| CN107193967A (en) | A kind of multi-source heterogeneous industry field big data handles full link solution | |
| CN105653609B (en) | Data processing method memory-based and device | |
| CN101777079B (en) | Realization method for fast generating electronic report forms | |
| CN105335479B (en) | A kind of text data statistics implementation method based on SQL | |
| CN105787059A (en) | Data warehouse based financial data integration method | |
| CN105825326A (en) | Innovative method for scientific and technological resource management | |
| CN107895017A (en) | A kind of electric energy quality monitoring system construction method based on big data technology | |
| Girsang et al. | Business intelligence for construction company acknowledgement reporting system | |
| CN103473444A (en) | Electronic medical record system based on intelligent analyzing data structure and processing method of system | |
| Soumiya et al. | Converting UML class diagrams into temporal object relational database | |
| CN116049193A (en) | Data storage method and device | |
| Liu et al. | Analysis of the application of digital agricultural technology in the development of farm economy | |
| CN110083067A (en) | A kind of intelligent gradevin control method and system | |
| CN103617181A (en) | Method and device for establishing universal database of relationships | |
| CN114676208A (en) | Data warehouse | |
| CN102567803A (en) | Complex event scheduling system and method based on priority-assigned event graph | |
| Shen et al. | Research on application of computer technology in the optimization of department information system | |
| Li et al. | A Comparative Study of Row and Column Storage for Time Series Data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180424 |
|
| RJ01 | Rejection of invention patent application after publication |