CN111639083A - Management system of unified database management method - Google Patents

Management system of unified database management method Download PDF

Info

Publication number
CN111639083A
CN111639083A CN202010280582.9A CN202010280582A CN111639083A CN 111639083 A CN111639083 A CN 111639083A CN 202010280582 A CN202010280582 A CN 202010280582A CN 111639083 A CN111639083 A CN 111639083A
Authority
CN
China
Prior art keywords
data
database
target
data source
cloud platform
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010280582.9A
Other languages
Chinese (zh)
Inventor
杜苏秦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xinzhi Cloud Data Service Co ltd
Enn Cloud Data Service Co Ltd
Original Assignee
Xinzhi Cloud Data Service Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xinzhi Cloud Data Service Co ltd filed Critical Xinzhi Cloud Data Service Co ltd
Priority to CN202010280582.9A priority Critical patent/CN111639083A/en
Publication of CN111639083A publication Critical patent/CN111639083A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/254Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses

Abstract

The invention discloses a management system of a management method of a unified database, which comprises the following steps: establishing a first mapping from a target database data source to a specified database, and establishing a second mapping from a target cloud platform data source to the specified database; storing target data of the target database data source into the specified database according to the first mapping, and storing the target data of the target cloud platform data source into the specified database according to the second mapping; and issuing a configuration program so as to acquire specified data from the target database data source and/or the target cloud platform data source according to the configuration program and store the specified data into the specified database. The invention has the following advantages: the problem of many monitoring sources and many cloud platform data dispersion is solved, can concentrate the storage with monitoring data and performance data to work such as the convergence, analysis, statistics and external integration of follow-up operation and maintenance aspect.

Description

Management system of unified database management method
Technical Field
The invention relates to the technical field of data processing, in particular to a management system of a management method of a unified database.
Background
With the improvement of the hardware computing capability of the physical machine and the gradual maturity of the virtualization technology, the enterprise starts to gradually transfer the service to the virtual cloud platform, and the diversification of the cloud platform used by the enterprise derives a plurality of problems to be solved by operation and maintenance: 1. centralized summarizing and processing of monitoring alarm data; 2. the problems of concentration, storage, aggregation and analysis of a large amount of performance data; 3. monitoring the associated mapping of the class data and the configuration data, and the like. These problems need to be solved in the daily operation and maintenance process.
The ETL tool for data extraction processing, which is mainstream in the market at present, is mainly used for processing on a database level, and aims at the problems that interface type data processing of the existing multi-cloud platform is less, the development workload is large, or the coverage range of the cloud platform supporting processing is less, and the processing requirements of multiple monitoring sources and multiple platforms are difficult to meet.
Disclosure of Invention
The present invention is directed to solving at least one of the above problems.
Therefore, a first objective of the present invention is to provide a method for managing a unified database, which can satisfy the requirement of unified storage of data of multiple monitoring sources and multiple platforms.
In order to achieve the above object, an embodiment of the present invention discloses a method for managing a unified database, which includes the following steps: establishing a first mapping from a target database data source to a specified database, and establishing a second mapping from a target cloud platform data source to the specified database; storing target data of the target database data source into the specified database according to the first mapping, and storing the target data of the target cloud platform data source into the specified database according to the second mapping; issuing a configuration program to acquire specified data from the target database data source and/or the target cloud platform data source according to the configuration program and store the specified data into the specified database; the specified data is updated data of the target database data source and/or the target cloud platform data source.
According to the unified database management method provided by the embodiment of the invention, a first mapping between a target database data source and a specified database (such as a local database of a management system) is established, a second mapping from the target cloud platform data source to the specified database is established, and then the target data of the target database and the target cloud platform can be stored in the specified database according to the first mapping and the second mapping; in addition, the configuration program is released, so that updated data can be acquired from the target database data source and/or the target cloud platform data source through the configuration program, the problem of data dispersion of multiple monitoring sources and multiple cloud platforms is solved, and the monitoring data and the performance data can be stored in a centralized manner, so that the subsequent operations of convergence, analysis, statistics, external integration and the like in an operation and maintenance level are facilitated.
In addition, the method for managing a unified database according to the above embodiment of the present invention may further have the following additional technical features:
according to an embodiment of the present invention, the establishing a first mapping of the target database data source to a specified database includes: acquiring data of the target database data source to derive relevant information; establishing the first mapping of data derivation related information corresponding to the target database data source.
According to an embodiment of the present invention, the establishing a second mapping of the target cloud platform data source to the specified database includes: acquiring data export related information of the target cloud platform data source; establishing the second mapping of data derivation related information corresponding to the target cloud platform data source.
According to an embodiment of the present invention, the data export related information of the target cloud platform data source includes application programming interface, API, information of the target cloud platform.
According to an embodiment of the present invention, the publishing configuration program includes: and releasing a configuration program at regular time according to preset time so as to avoid the data use peak time of the target database data source and/or the target cloud platform data source.
The second purpose of the present invention is to provide a management system for a unified database, which can satisfy the requirement of unified storage of data of multiple monitoring sources and multiple platforms.
In order to achieve the above object, an embodiment of the present invention discloses a management system for a unified database, including: the mapping establishing module is used for establishing a first mapping from a target database data source to a specified database and establishing a second mapping from a target cloud platform data source to the specified database; the data import storage module is used for storing the target data of the target database data source into the specified database according to the first mapping and storing the target data in the target cloud platform data source into the specified database according to the second mapping; the publishing module is used for publishing a configuration program so that the data import storage module obtains specified data from the target database data source and/or the target cloud platform data source according to the configuration program and stores the specified data into the specified database; the specified data is updated data of the target database data source and/or the target cloud platform data source.
According to the management system of the unified database, a first mapping between a target database data source and a specified database (such as a local database of the management system) is established, a second mapping from the target cloud platform data source to the specified database is established, and then the target data of the target database and the target cloud platform can be stored in the specified database according to the first mapping and the second mapping; in addition, the configuration program is released, so that updated data can be acquired from the target database data source and/or the target cloud platform data source through the configuration program, the problem of data dispersion of multiple monitoring sources and multiple cloud platforms is solved, and the monitoring data and the performance data can be stored in a centralized manner, so that the subsequent operations of convergence, analysis, statistics, external integration and the like in an operation and maintenance level are facilitated.
In addition, the management system of the unified database according to the above embodiment of the present invention may further have the following additional technical features:
according to an embodiment of the present invention, the mapping establishing module is specifically configured to acquire data derivation related information of the target database data source, and further establish the first mapping corresponding to the data derivation related information of the target database data source.
According to an embodiment of the present invention, the mapping establishing module is specifically configured to acquire data export related information of the target cloud platform data source, and further establish the second mapping corresponding to the data export related information of the target cloud platform.
According to an embodiment of the present invention, the data export related information of the target cloud platform data source includes application programming interface, API, information of the target cloud platform.
According to an embodiment of the present invention, the publishing module is specifically configured to publish the configuration program at regular time according to preset time, so as to avoid a data use peak time of the target database data source and/or the target cloud platform data source.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a flow diagram of a unified database management method according to one embodiment of the invention;
FIG. 2 is a schematic diagram of a unified database management method according to an embodiment of the present invention;
fig. 3 is a block diagram of a unified database management system according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention.
In the description of the present invention, it is to be understood that the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
These and other aspects of embodiments of the invention will be apparent with reference to the following description and attached drawings. In the description and drawings, particular embodiments of the invention have been disclosed in detail as being indicative of some of the ways in which the principles of the embodiments of the invention may be practiced, but it is understood that the scope of the embodiments of the invention is not limited correspondingly. On the contrary, the embodiments of the invention include all changes, modifications and equivalents coming within the spirit and terms of the claims appended hereto.
The management system of the unified database management method of the present invention is described below with reference to the drawings.
Fig. 1 is a flowchart of a unified database management method according to an embodiment of the present invention, and fig. 2 is a schematic diagram of the unified database management method according to an embodiment of the present invention. As shown in fig. 1 and fig. 2, the method for managing a unified database according to an embodiment of the present invention includes the following steps:
s1: establishing a first mapping from a target database data source to a specified database, and establishing a second mapping from a target cloud platform data source to the specified database.
Specifically, the target database data source is a data source of a database which a user needs to view for monitoring. The target database data source can be one or more, and is determined according to the requirements of users.
In one embodiment of the present invention, establishing a first mapping of the target database data source to a specified database includes: acquiring data of the target database data source to derive relevant information; establishing the first mapping of data derivation related information corresponding to the target database data source.
In some examples, the target database data source may include one or a combination of Access, MySQL, SqlServer, Oracle, and Oracle databases.
When a first mapping from a target database data source to a specific database is established, a corresponding mapping is required to be established according to all database-specific rules in the target database data source, and the mapping is equivalent to establishing a data transmission link between the target database data source and the specific database.
The target cloud platform data source is a data source of another database which needs to be checked and monitored by a user. The target cloud platform data source can be one or more, and is determined according to user requirements.
In one embodiment of the present invention, establishing a second mapping of target cloud platform data sources to the specified database includes: acquiring data export related information of the target cloud platform data source; establishing the second mapping of data derivation related information corresponding to the target cloud platform data source. Further, the data export related information of the target cloud platform data source includes Application Programming Interface (API) information of the target cloud platform.
In particular, since the target cloud platform data source may only provide the API and not directly provide the database, the second mapping needs to be established according to the target cloud platform data source providing API.
S2: and storing the target data of the target database data source into the specified database according to the first mapping, and storing the target data of the target cloud platform data source into the specified database according to the second mapping.
At this time, the first mapping can only store the data of the target database data source in the current state into the designated database, and after the data of the target database data source is updated, the updated data cannot be acquired from the target database data source through the first mapping.
At this time, the second mapping can only store the data of the target cloud platform data source in the current state into the designated database, and after the data of the target cloud platform data source is updated, the updated data cannot be acquired from the target cloud platform data source through the second mapping.
S3: and issuing a configuration program so as to acquire specified data from the target database data source and/or the target cloud platform data source according to the configuration program and store the specified data into the specified database. The specified data is updated data of the target database data source and/or the target cloud platform data source. And the configuration program is relative to an update package, and a user can store the target database data source and/or the target cloud platform data source and new data into a specified database by releasing the configuration program.
In one embodiment of the invention, the publishing of the configuration program comprises: and releasing a configuration program at regular time according to preset time so as to avoid the data use peak time of the target database data source and/or the target cloud platform data source. For example, the preset time may be three to five morning hours per monday, so that the data usage peak of the target database data source and/or the target cloud platform data source may be avoided when the configuration program is released.
According to the unified database management method provided by the embodiment of the invention, a first mapping between a target database data source and a specified database (such as a local database of a management system) is established, a second mapping from the target cloud platform data source to the specified database is established, and then the target data of the target database and the target cloud platform can be stored in the specified database according to the first mapping and the second mapping; in addition, the configuration program is released, so that updated data can be acquired from the target database data source and/or the target cloud platform data source through the configuration program, the problem of data dispersion of multiple monitoring sources and multiple cloud platforms is solved, and the monitoring data and the performance data can be stored in a centralized manner, so that the subsequent operations of convergence, analysis, statistics, external integration and the like in an operation and maintenance level are facilitated.
Fig. 3 is a block diagram of a unified database management system according to an embodiment of the present invention. As shown in fig. 3, the management system of the unified database according to the embodiment of the present invention includes a mapping establishing module 100, a data importing storage module 200, and a publishing module.
The mapping establishing module 100 is configured to establish a first mapping from a target database data source to a specified database, and establish a second mapping from a target cloud platform data source to the specified database. The data import storage module 200 is configured to store the target data of the target database data source into the specified database according to the first mapping, and store the target data of the target cloud platform data source into the specified database according to the second mapping. The publishing module 300 is configured to publish a configuration program, so that the data import storage module 200 obtains specified data from the target database data source and/or the target cloud platform data source according to the configuration program and stores the specified data in the specified database. The specified data is updated data of the target database data source and/or the target cloud platform data source.
According to the management system of the unified database, a first mapping between a target database data source and a specified database (such as a local database of the management system) is established, a second mapping from the target cloud platform data source to the specified database is established, and then the target data of the target database and the target cloud platform can be stored in the specified database according to the first mapping and the second mapping; in addition, the configuration program is released, so that updated data can be acquired from the target database data source and/or the target cloud platform data source through the configuration program, the problem of data dispersion of multiple monitoring sources and multiple cloud platforms is solved, and the monitoring data and the performance data can be stored in a centralized manner, so that the subsequent operations of convergence, analysis, statistics, external integration and the like in an operation and maintenance level are facilitated.
In an embodiment of the present invention, the mapping establishing module 100 is specifically configured to obtain data derivation related information of the target database data source, and further establish the first mapping corresponding to the data derivation related information of the target database data source.
In an embodiment of the present invention, the mapping establishing module 100 is specifically configured to obtain data derivation related information of the target cloud platform data source, and further establish the second mapping corresponding to the data derivation related information of the target cloud platform.
In an embodiment of the present invention, the data export related information of the target cloud platform data source includes application programming interface, API, information of the target cloud platform.
In an embodiment of the present invention, the publishing module 300 is specifically configured to publish the configuration program at regular time according to a preset time, so as to avoid a data use peak time of the target database data source and/or the target cloud platform data source.
It should be noted that, a specific implementation of the management system of the unified database in the embodiment of the present invention is similar to a specific implementation of the management method of the unified database in the embodiment of the present invention, and specific reference is specifically made to the description of the management method portion of the unified database, and details are not repeated for reducing redundancy.
In addition, other configurations and functions of the management system of the unified database according to the embodiment of the present invention are known to those skilled in the art, and are not described in detail for reducing redundancy.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the invention have been shown and described, it will be understood by those of ordinary skill in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.

Claims (10)

1. A unified database management method is characterized by comprising the following steps:
establishing a first mapping from a target database data source to a specified database, and establishing a second mapping from a target cloud platform data source to the specified database;
storing target data of the target database data source into the specified database according to the first mapping, and storing the target data of the target cloud platform data source into the specified database according to the second mapping;
issuing a configuration program to acquire specified data from the target database data source and/or the target cloud platform data source according to the configuration program and store the specified data into the specified database;
the specified data is updated data of the target database data source and/or the target cloud platform data source.
2. The method for unified database management according to claim 1, wherein said establishing a first mapping of said target database data source to a specific database comprises:
acquiring data of the target database data source to derive relevant information;
establishing the first mapping of data derivation related information corresponding to the target database data source.
3. The unified database management method according to claim 1, wherein the establishing a second mapping of target cloud platform data sources to the designated database comprises:
acquiring data export related information of the target cloud platform data source;
establishing the second mapping of data derivation related information corresponding to the target cloud platform data source.
4. The unified database management method according to claim 3, wherein the data export related information of the target cloud platform data source comprises API (application programming interface) information of the target cloud platform.
5. The unified database management method according to claim 1, wherein the release configuration procedure comprises:
and releasing a configuration program at regular time according to preset time so as to avoid the data use peak time of the target database data source and/or the target cloud platform data source.
6. A unified database management system, comprising:
the mapping establishing module is used for establishing a first mapping from a target database data source to a specified database and establishing a second mapping from a target cloud platform data source to the specified database;
the data import storage module is used for storing the target data of the target database data source into the specified database according to the first mapping and storing the target data in the target cloud platform data source into the specified database according to the second mapping;
the publishing module is used for publishing a configuration program so that the data import storage module obtains specified data from the target database data source and/or the target cloud platform data source according to the configuration program and stores the specified data into the specified database; the specified data is updated data of the target database data source and/or the target cloud platform data source.
7. The system for managing a unified database according to claim 6, wherein the mapping establishing module is specifically configured to obtain data export related information of the target database data source, and further establish the first mapping corresponding to the data export related information of the target database data source.
8. The system for managing a unified database according to claim 6, wherein the mapping establishing module is specifically configured to obtain data export related information of the target cloud platform data source, and further establish the second mapping corresponding to the data export related information of the target cloud platform.
9. The unified database management system according to claim 8, wherein the data export related information of the target cloud platform data source comprises Application Programming Interface (API) information of the target cloud platform.
10. The system for managing a unified database according to claim 6, wherein the publishing module is specifically configured to publish the configuration program at regular time according to a preset time, so as to avoid a data usage peak period of the target database data source and/or the target cloud platform data source.
CN202010280582.9A 2020-04-10 2020-04-10 Management system of unified database management method Pending CN111639083A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010280582.9A CN111639083A (en) 2020-04-10 2020-04-10 Management system of unified database management method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010280582.9A CN111639083A (en) 2020-04-10 2020-04-10 Management system of unified database management method

Publications (1)

Publication Number Publication Date
CN111639083A true CN111639083A (en) 2020-09-08

Family

ID=72333186

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010280582.9A Pending CN111639083A (en) 2020-04-10 2020-04-10 Management system of unified database management method

Country Status (1)

Country Link
CN (1) CN111639083A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101327477B1 (en) * 2013-07-16 2013-11-08 서원기 Total monitoring and control management system
CN104486445A (en) * 2014-12-30 2015-04-01 北京天云融创软件技术有限公司 Distributed extendable resource monitoring system and method based on cloud platform
CN106504144A (en) * 2016-10-19 2017-03-15 中国矿业大学 A kind of campus service system based on cloud computing and mobile phone terminal
CN106648964A (en) * 2016-10-12 2017-05-10 上海爱数信息技术股份有限公司 Database backup method and system
EP3321799A1 (en) * 2016-11-11 2018-05-16 Sap Se Database object lifecycle management
CN108846076A (en) * 2018-06-08 2018-11-20 山大地纬软件股份有限公司 The massive multi-source ETL process method and system of supporting interface adaptation
CN109067903A (en) * 2018-08-29 2018-12-21 郑州云海信息技术有限公司 A kind of cloud platform cascade system
CN109831513A (en) * 2019-02-28 2019-05-31 广州达安临床检验中心有限公司 Data processing method, system and device
CN109936555A (en) * 2018-06-13 2019-06-25 国网安徽省电力有限公司信息通信分公司 A kind of date storage method based on cloud platform, apparatus and system

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101327477B1 (en) * 2013-07-16 2013-11-08 서원기 Total monitoring and control management system
CN104486445A (en) * 2014-12-30 2015-04-01 北京天云融创软件技术有限公司 Distributed extendable resource monitoring system and method based on cloud platform
CN106648964A (en) * 2016-10-12 2017-05-10 上海爱数信息技术股份有限公司 Database backup method and system
CN106504144A (en) * 2016-10-19 2017-03-15 中国矿业大学 A kind of campus service system based on cloud computing and mobile phone terminal
EP3321799A1 (en) * 2016-11-11 2018-05-16 Sap Se Database object lifecycle management
CN108846076A (en) * 2018-06-08 2018-11-20 山大地纬软件股份有限公司 The massive multi-source ETL process method and system of supporting interface adaptation
CN109936555A (en) * 2018-06-13 2019-06-25 国网安徽省电力有限公司信息通信分公司 A kind of date storage method based on cloud platform, apparatus and system
CN109067903A (en) * 2018-08-29 2018-12-21 郑州云海信息技术有限公司 A kind of cloud platform cascade system
CN109831513A (en) * 2019-02-28 2019-05-31 广州达安临床检验中心有限公司 Data processing method, system and device

Similar Documents

Publication Publication Date Title
CN104407926B (en) A kind of dispatching method of cloud computing resources
CN104462432B (en) Adaptive distributed computing method
CN104793988B (en) The implementation method and device of integration across database distributed transaction
US7418489B2 (en) Method and apparatus for applying policies
US7937493B2 (en) Connection pool use of runtime load balancing service performance advisories
US8171414B2 (en) System and method for consolidated reporting of characteristics for a group of file systems
KR101683321B1 (en) Monitoring of distributed applications
CN102043682B (en) Workflow exception handing method and system
US5511191A (en) Status monitoring arrangement for a data processing system comprising a number of managed objects
WO2023142054A1 (en) Container microservice-oriented performance monitoring and alarm method and alarm system
CN107800808A (en) A kind of data-storage system based on Hadoop framework
US5093782A (en) Real time event driven database management system
US20060143178A1 (en) Dynamic remastering for a subset of nodes in a cluster environment
US20010034732A1 (en) Architecture and method for deploying remote database administration
CN107967175A (en) A kind of resource scheduling system and method based on multiple-objection optimization
CN105302697A (en) Running state monitoring method and system of density data model database
CN108847995A (en) A kind of method and apparatus of the configuration O&M alarm template based on private clound
CN116777182A (en) Task dispatch method for semiconductor wafer manufacturing
CN114968739A (en) Operation and maintenance task management method, operation and maintenance method, device, equipment and medium
CN109067903B (en) Cloud platform cascade system
US20170010948A1 (en) Monitoring a computing environment
CN106790705A (en) A kind of Distributed Application local cache realizes system and implementation method
CN110381136A (en) A kind of method for reading data, terminal, server and storage medium
US8285752B1 (en) System and method for maintaining a plurality of summary levels in a single table
Lee et al. A big data management system for energy consumption prediction models

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200908

RJ01 Rejection of invention patent application after publication