CN106202540A - The data base of a kind of large-scale application system can method extending transversely - Google Patents
The data base of a kind of large-scale application system can method extending transversely Download PDFInfo
- Publication number
- CN106202540A CN106202540A CN201610595003.3A CN201610595003A CN106202540A CN 106202540 A CN106202540 A CN 106202540A CN 201610595003 A CN201610595003 A CN 201610595003A CN 106202540 A CN106202540 A CN 106202540A
- Authority
- CN
- China
- Prior art keywords
- data
- dimension
- base
- scale application
- extending transversely
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/211—Schema design and management
Abstract
The invention discloses a kind of large-scale application system data base can method extending transversely, it implements process and is: first defines data-base cluster, determines data-base cluster component content；Then definition data route dimension and data route mapping relationship；Routing resolution, access particular data storehouse is performed finally according to context data.A kind of data base of the large-scale application system of the present invention can method extending transversely compared with prior art, can be under the big data quantity of large-scale application system, high complications, effective by data routing configuration and mechanism for resolving, the access of data will be diverted in different data bases, make the data base of same application can be the most extending transversely, thus reduce the large-scale application access pressure to centralized database, solve the performance bottleneck problem of centralized database, improve the performance of large-scale application overall operation.
Description
Technical field
The present invention relates to computer software technical field, the data base of a kind of large-scale application system can be horizontal
Extended method.
Background technology
Along with development and the maturation of cloud computing technology, cloud computing center in the informationization of large-size enterprise group progressively
Enter the practical stage.The application model of large-size enterprise group also from general headquarters, two grades of groups " distribution concentrate " application model to always
Portion " concentrates greatly " application model to change.
Under general headquarters " concentrate greatly " application model, the user of all of application system of large-size enterprise group shares general headquarters and provides
A set of application system, such application system is huge, number of users from several ten thousand to hundreds of thousands, cloud computing center all kinds of
Server is between tens to hundreds, and the single business function transaction data amount of storage of a year is at tens million of to several hundred million row.
In large-scale application, along with the increase of trading volume in the unit interval, application server quantity passes through application service
Device trunking mode is easy to extending transversely to increase computing capability, and system R self is to support extending transversely
Motility is poor, and the relation between data is intricate, is difficult to be carried out flexibly horizontal stroke by simple, consistent technological means
To extension, the ability extending transversely of data base often becomes bottleneck.Based on this, now provide the data base of a kind of large-scale application system
Can method extending transversely.
Summary of the invention
The technical assignment of the present invention is for above weak point, it is provided that the data base of a kind of large-scale application system can be horizontal
Extended method.
A kind of data base of large-scale application system can method extending transversely, it implements process and is:
First define data-base cluster, determine data-base cluster component content；
Then definition data route dimension and data route mapping relationship；
Routing resolution, access particular data storehouse is performed finally according to context data.
Described data-base cluster is made up of some data bases, and the description information of each data base is data source, this data source
Including with properties: data source identification, data source numbering, DSN, data source description, data source types, data base are even
Connect information；Wherein data source identification is data major keys, and data source numbering is that data source can the unique of artificial cognition identify, data source
Type is an enumeration type.
A MDL, several Service Databases and several inquiry data are comprised in each data-base cluster
Storehouse；Corresponding, data source types comprises three below enumerated value: master library, business library, inquiry storehouse.
Described data route dimension is the list of a record, and in list, every a line includes with properties: dimension mark, dimension
Numbering, dimension name, the most essential, dimension description；Wherein dimension mark is data major keys, and dimension numbering is that dimension can manually be known
Other unique mark, if essential for identifying whether this latitude value allows as null value.
Data route mapping relationship is the list of a record, and in list, every a line includes with properties: dimension values set, number
According to source mark, describing, wherein dimension values combination is the sequence letter of multiple values that record list based on data route dimension is constituted
Breath.
Context data is to access the context data information in program process, comprises dimension in context data
Information list, this dimensional information list is key-value pair list, and its key is the dimension mark in data route dimension, and its value is this dimension
The data value of degree.
Access in program process, when obtaining the data base that should access, based on the dimension comprised in context data
Information list, by the dimension values set in data route mapping relationship makes a look up coupling, thus gets specific number
Identify according to source, complete to access.
A kind of data base of the large-scale application system of the present invention can method extending transversely compared to the prior art, have following
Beneficial effect:
A kind of data base of the large-scale application system of the present invention can method extending transversely, by data routing configuration and parsing
Mechanism, will be diverted in different data bases the access of data, makes the data base of same application can be the most extending transversely, from
And reduce the large-scale application access pressure to centralized database, solve the performance bottleneck problem of centralized database, improve large-scale answering
By the performance of overall operation, practical, applied widely, it is easy to promote.
Accompanying drawing explanation
What accompanying drawing 1 was the present invention realizes schematic diagram.
Detailed description of the invention
Below in conjunction with the accompanying drawings and specific embodiment the invention will be further described.
As shown in Figure 1, the present invention provide a kind of large-scale application system data base can method extending transversely, it is specifically real
Existing process is:
First define data-base cluster, determine data-base cluster component content；
Then definition data route dimension and data route mapping relationship；
Routing resolution, access particular data storehouse is performed finally according to context data.
Described data-base cluster is made up of some data bases, and the description information of each data base is data source, this data source
Including with properties: data source identification, data source numbering, DSN, data source description, data source types, data base are even
Connect information；Wherein data source identification is data major keys, and data source numbering is that data source can the unique of artificial cognition identify, data source
Type is an enumeration type.
A MDL, several Service Databases and several inquiry data are comprised in each data-base cluster
Storehouse；Corresponding, data source types comprises three below enumerated value: master library, business library, inquiry storehouse.
Described data route dimension is for describing the structure that application program accesses the routing relation of data base.
Data route dimension is the list of a record, and in list, every a line includes with properties: dimension mark, dimension are compiled
Number, dimension name, the most essential, dimension describe；Wherein dimension mark is data major keys, and dimension numbering is that dimension can artificial cognition
Unique mark, if essential for identifying whether this latitude value allows as null value.
Data route mapping relationship, is based on the data source definitions in data-base cluster, data route dimension and data road
Defined by dimension, definition different dimensional angle value set under with data source mate mapping relations.
Data route mapping relationship is the list of a record, and in list, every a line includes with properties: dimension values set, number
According to source mark, describing, wherein dimension values combination is the sequence letter of multiple values that record list based on data route dimension is constituted
Breath.
Dimension values set is the unique constraints of data route mapping relationship record list row, and specific dimension values set is only
One one data source identification of coupling.
Context data is to access the context data information in program process, comprises dimension in context data
Information list, this dimensional information list is key-value pair list, and its key is the dimension mark in data route dimension, and its value is this dimension
The data value of degree.
Access in program process, when obtaining the data base that should access, based on the dimension comprised in context data
Information list, by the dimension values set in data route mapping relationship makes a look up coupling, thus gets specific number
Identify according to source, complete to access.
Further, according to the specific data source identification got, based on the data source defined in step one, get
The data source information mated with data source identification, thus further get the database linkage information in data source information,
Set up the data base that this data source is specified in a program, carry out data access.
Instantiation:
In certain large scale system, based on step 1, definition data-base cluster information is as follows:
| Data source identification | Data source is numbered | DSN | Data source types | Database linkage information |
| DS1 | Master | Shared library | Master library | … |
| DS2 | Biz1 | Business library 1 | Business library | … |
| DS3 | Biz2 | Business library 2 | Business library | … |
Based on step 2, the data route dimensional information of definition is as follows, represents within the system, and service application data are permissible
Data division is carried out according to the module of system and industry:
| Dimension identifies | Dimension is numbered | Dimension name | The most essential | Dimension describes |
| D1 | Module | Module | It is | System module dimension |
| D2 | Scope | Industry | It is | Industry dimension |
Based on step 3, it is assumed that system has two modules of M1, M2 simultaneously, there are two industries of S1, S2, the then data set up
Route mapping relationship is as follows:
Based on step 4, if present procedure function is the function of M1 module, and the industry set is S1, then in program
Context data in the dimensional information list information that comprises as follows:
| Key | Value |
| Module | M1 |
| Scope | S1 |
Then resolution rules based on step 4, getting data source information corresponding to current function is DS1, according to DS1 program
Database linkage information corresponding to DS1 can be got, thus set up corresponding data base and connect, access data base corresponding to DS1
Data message.
The present invention by above Implementation Technology, can under the big data quantity of large-scale application system, high complications,
Effectively by data routing configuration and mechanism for resolving, the access of data will be diverted in different data bases, make same answering
Data base can be the most extending transversely, thus reduce the large-scale application access pressure to centralized database, solve single number
According to the performance bottleneck problem in storehouse, improve the performance of large-scale application overall operation.
By detailed description of the invention above, described those skilled in the art can readily realize the present invention.But should
Working as understanding, the present invention is not limited to above-mentioned detailed description of the invention.On the basis of disclosed embodiment, described technical field
Technical staff can the different technical characteristic of combination in any, thus realize different technical schemes.
In addition to the technical characteristic described in description, it is the known technology of those skilled in the art.
Claims (7)
1. the data base of a large-scale application system can method extending transversely, it is characterised in that it implements process and is:
First define data-base cluster, determine data-base cluster component content；
Then definition data route dimension and data route mapping relationship；
Routing resolution, access particular data storehouse is performed finally according to context data.
The data base of a kind of large-scale application system the most according to claim 1 can method extending transversely, it is characterised in that institute
Stating data-base cluster to be made up of some data bases, the description information of each data base is data source, and this data source includes with subordinate
Property: data source identification, data source numbering, DSN, data source description, data source types, database linkage information；Wherein
Data source identification is data major keys, and data source numbering is that data source can the unique of artificial cognition identify, and data source types is one
Enumeration type.
The data base of a kind of large-scale application system the most according to claim 2 can method extending transversely, it is characterised in that
Each data-base cluster comprises a MDL, several Service Databases and several inquiries data base；Corresponding,
Data source types comprises three below enumerated value: master library, business library, inquiry storehouse.
The data base of a kind of large-scale application system the most according to claim 1 can method extending transversely, it is characterised in that institute
Stating data route dimension is the list of a record, and in list, every a line includes with properties: dimension mark, dimension numbering, dimension
Title, the most essential, dimension description；Wherein dimension mark is data major keys, and dimension numbering is that dimension can artificial cognition unique
Mark, if essential for identifying whether this latitude value allows as null value.
The data base of a kind of large-scale application system the most according to claim 4 can method extending transversely, it is characterised in that number
According to route mapping relationship be one record list, in list, every a line includes with properties: dimension values set, data source identification,
Describing, wherein dimension values combination is the sequence information of multiple values that record list based on data route dimension is constituted.
The data base of a kind of large-scale application system the most according to claim 2 can method extending transversely, it is characterised in that on
Context data is to access the context data information in program process, comprises dimensional information list in context data,
This dimensional information list is key-value pair list, and its key is the dimension mark in data route dimension, and its value is the data of this dimension
Value.
The data base of a kind of large-scale application system the most according to claim 5 can method extending transversely, it is characterised in that visit
Ask in program process, when obtaining the data base that should access, based on the dimensional information list comprised in context data, logical
Cross and the dimension values set in data route mapping relationship is made a look up coupling, thus get specific data source identification, complete
Become to access.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610595003.3A CN106202540A (en) | 2016-07-26 | 2016-07-26 | The data base of a kind of large-scale application system can method extending transversely |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610595003.3A CN106202540A (en) | 2016-07-26 | 2016-07-26 | The data base of a kind of large-scale application system can method extending transversely |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106202540A true CN106202540A (en) | 2016-12-07 |
Family
ID=57495903
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610595003.3A Pending CN106202540A (en) | 2016-07-26 | 2016-07-26 | The data base of a kind of large-scale application system can method extending transversely |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106202540A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106682173A (en) * | 2016-12-28 | 2017-05-17 | 华南理工大学 | Social security big data OLAP pre-processing method and on-line analysis and query method |
| WO2019097362A1 (en) * | 2017-11-17 | 2019-05-23 | International Business Machines Corporation | Automatically connecting external data to business analytics process |
| CN110661684A (en) * | 2019-09-29 | 2020-01-07 | 北京浪潮数据技术有限公司 | Flow statistical method and device |
| CN110765190A (en) * | 2019-09-30 | 2020-02-07 | 北京淇瑀信息科技有限公司 | Method and device for automatically expanding database cluster and electronic equipment |
| WO2021197432A1 (en) * | 2020-04-02 | 2021-10-07 | 北京京东振世信息技术有限公司 | Routing method and apparatus for database cluster |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104462421A (en) * | 2014-12-12 | 2015-03-25 | 中国科学院声学研究所 | Multi-tenant expanding method based on Key-Value database |
| CN105138638A (en) * | 2015-08-24 | 2015-12-09 | 浪潮通用软件有限公司 | Database distribution method based on application layer |
| CN105677915A (en) * | 2016-02-29 | 2016-06-15 | 浪潮通用软件有限公司 | Distributed service data access method based on engine |
-
2016
- 2016-07-26 CN CN201610595003.3A patent/CN106202540A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104462421A (en) * | 2014-12-12 | 2015-03-25 | 中国科学院声学研究所 | Multi-tenant expanding method based on Key-Value database |
| CN105138638A (en) * | 2015-08-24 | 2015-12-09 | 浪潮通用软件有限公司 | Database distribution method based on application layer |
| CN105677915A (en) * | 2016-02-29 | 2016-06-15 | 浪潮通用软件有限公司 | Distributed service data access method based on engine |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106682173A (en) * | 2016-12-28 | 2017-05-17 | 华南理工大学 | Social security big data OLAP pre-processing method and on-line analysis and query method |
| CN106682173B (en) * | 2016-12-28 | 2019-10-18 | 华南理工大学 | A kind of social security big data OLAP preprocess method and on-line analysis querying method |
| WO2019097362A1 (en) * | 2017-11-17 | 2019-05-23 | International Business Machines Corporation | Automatically connecting external data to business analytics process |
| GB2581917A (en) * | 2017-11-17 | 2020-09-02 | Ibm | Automatically connecting external data to business analytics process |
| US10956420B2 (en) | 2017-11-17 | 2021-03-23 | International Business Machines Corporation | Automatically connecting external data to business analytics process |
| US11188536B2 (en) | 2017-11-17 | 2021-11-30 | International Business Machines Corporation | Automatically connecting external data to business analytics process |
| CN110661684A (en) * | 2019-09-29 | 2020-01-07 | 北京浪潮数据技术有限公司 | Flow statistical method and device |
| CN110765190A (en) * | 2019-09-30 | 2020-02-07 | 北京淇瑀信息科技有限公司 | Method and device for automatically expanding database cluster and electronic equipment |
| CN110765190B (en) * | 2019-09-30 | 2023-09-26 | 北京淇瑀信息科技有限公司 | Automatic database cluster capacity expansion method and device and electronic equipment |
| WO2021197432A1 (en) * | 2020-04-02 | 2021-10-07 | 北京京东振世信息技术有限公司 | Routing method and apparatus for database cluster |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106202540A (en) | The data base of a kind of large-scale application system can method extending transversely | |
| Aboutorabiª et al. | Performance evaluation of SQL and MongoDB databases for big e-commerce data | |
| US9081837B2 (en) | Scoped database connections | |
| US8943059B2 (en) | Systems and methods for merging source records in accordance with survivorship rules | |
| Feldman et al. | Entity model clustering: Structuring a data model by abstraction | |
| US8341131B2 (en) | Systems and methods for master data management using record and field based rules | |
| WO2012012968A1 (en) | Data partitioning method for distributed parallel database system | |
| CA2712028C (en) | Geospatial database integration using business models | |
| CN110597870A (en) | Enterprise relation mining method | |
| CN104933173B (en) | It is a kind of for the data processing method of isomery multi-data source, device and server | |
| US20140074774A1 (en) | Distributed data base system and data structure for distributed data base | |
| US10877995B2 (en) | Building a distributed dwarf cube using mapreduce technique | |
| CN103617175A (en) | Method for virtualization of large-scale distributed heterogeneous data | |
| CN112084182A (en) | Data modeling method for data mart and data warehouse | |
| US20150169656A1 (en) | Distributed database system | |
| CN104778236A (en) | ETL (Extract-Transform-Load) realization method and system based on metadata | |
| CN103246719B (en) | A kind of Network Information Resource Integration method of sing on web | |
| CN107491476A (en) | A kind of data model translation and query analysis method suitable for a variety of big data management systems | |
| CN103606032B (en) | A kind of method in two dimension power grid GIS data set | |
| Mazumdar et al. | A theoretical analysis of first heuristics of crowdsourced entity resolution | |
| US11113267B2 (en) | Enforcing path consistency in graph database path query evaluation | |
| CN110738528B (en) | Rule freight rate preprocessing method and system | |
| CN113377758A (en) | Data quality auditing engine and auditing method thereof | |
| CN100573511C (en) | Produce the system and method for the self-defined hierarchical system of analyzing data structure | |
| Mahajan et al. | Grouping techniques for update propagation in intermittently connected databases |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161207 |
|
| RJ01 | Rejection of invention patent application after publication |