CN107391720A - A kind of data summarization method and device - Google Patents
A kind of data summarization method and device Download PDFInfo
- Publication number
- CN107391720A CN107391720A CN201710640382.8A CN201710640382A CN107391720A CN 107391720 A CN107391720 A CN 107391720A CN 201710640382 A CN201710640382 A CN 201710640382A CN 107391720 A CN107391720 A CN 107391720A
- Authority
- CN
- China
- Prior art keywords
- subdata base
- base system
- database
- resource
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
Abstract
The invention discloses a kind of data summarization method and device, creates container database；Multiple pluggable databases are created in container database, multiple pluggable databases and multiple subdata base systems of total Database system correspond；Performed for each subdata base system：By data duplication to be collected in the subdata base system into corresponding pluggable database.From the embodiment of the present invention, it is possible to increase the utilization rate of resource, while avoid the respective normal operation that influenced each other between total Database system and subdata base system.
Description
Technical field
The present invention relates to database technology, espespecially a kind of data summarization method and device.
Background technology
With internet, cloud computing, the continuous development of big data, enterprise need data volume to be processed increasingly to increase, it is necessary to
The data source of timely aggregation process is more and more wider, and form is also more and more diversified.For example, have under a total Database system more
, it is necessary to according to the demand of business, sent to total Database system needs individual sub- Database Systems each subdata base timing
The data to be collected.In the related art, two schemes realize data summarization, the first scheme is, in total Database system
System subdata base system between create database link (Database Link, dblink) come cause total Database system with
It can be interacted between subdata base system, and each independent internal memory and process, subdata are distributed for each subdata base system
The process of storehouse system by dblink by the data summarization of subdata base system into total Database system.Second scheme is,
The set (schema) of multiple database objects, multiple schema and multiple subdata base systems are created in total Database system
Correspond, being deposited in each schema has corresponding subdata base system, and multiple schema common memories and process will be each
The data summarization of individual sub- Database Systems is into total Database system.
But the first scheme, due to each subdata base system committed memory and process, and some subdata base systems
The internal memory and process of system only use in the peak traffic stage, are all idle in other times section, which results in the utilization of resources
Rate is not high.Although operation maintenance personnel can adjust internal memory and the process that each subdata base system takes in different time sections,
Need operation maintenance personnel constantly to adjust, add the burden of operation maintenance personnel.Second scheme, because each subdata base system is divided
In schema corresponding to being interposed between, multiple schema common memories and process, when needing to restart total Database system, all sons
Database Systems can also be involved and are restarted, and have impact on the normal operation of subdata base system.
The content of the invention
In order to solve the above-mentioned technical problem, the invention provides a kind of data summarization method and device, it is possible to increase resource
Utilization rate, while avoid the respective normal operation that influenced each other between total Database system and subdata base system.
In order to reach the object of the invention, the invention provides a kind of data summarization method, including：
Create container database；
Multiple pluggable databases are created in container database, multiple pluggable databases are more with total Database system
Individual sub- Database Systems correspond；
Performed for each subdata base system：By data duplication to be collected in the subdata base system corresponding to
In pluggable database.
Further, described by data duplication to be collected in the subdata base system to corresponding pluggable data
After in storehouse, in addition to：
Calculate the total resources amount that the multiple subdata base system uses each single item resource；
Performed for each subdata base system：The resource of each single item resource is used according to the subdata base system
Amount accounts for ratio of the multiple subdata base system using the total resources amount of this resource, by being somebody's turn to do for the container database
Item resource allocation gives pluggable database corresponding to the subdata base system.
Further, the total resources amount for calculating the multiple subdata base system and using each single item resource, including：
Performed for each single item resource that the multiple subdata base system uses：The multiple subdata base system is made
It is added with the resource amount of this resource, obtains the total resources amount that the multiple subdata base system uses this resource.
Further, described by data duplication to be collected in the subdata base system to corresponding pluggable data
After in storehouse, in addition to：
Performed for each subdata base system：Made according to pluggable database corresponding to the subdata base system
With the priority of resource, the resource allocation of the container database is given to pluggable data corresponding to the subdata base system
Storehouse.
Further, it is described by data duplication to be collected in the subdata base system to corresponding pluggable database
In, including：
Replicate data to be collected in the subdata base system；
The data to be collected of duplication are exported from the subdata base system；
Derived data pluggable database corresponding to the subdata base system will be imported into from the subdata base
In.
Present invention also offers a kind of Data Transform Device, including：
First creation module, for creating container database；
Second creation module, for creating multiple pluggable databases, multiple pluggable databases in container database
Corresponded with multiple subdata base systems of total Database system；
Replication module, for being performed for each subdata base system：By number to be collected in the subdata base system
According in pluggable database corresponding to copying to.
Further, in addition to：
Computing module, the total resources amount of each single item resource is used for calculating the multiple subdata base system；
First allocation unit, for being performed for each subdata base system：Made according to the subdata base system
Ratio of the multiple subdata base system using the total resources amount of this resource is accounted for the resource amount of each single item resource, will
This resource allocation of the container database gives pluggable database corresponding to the subdata base system.
Further, the computing module is specifically used for,
Performed for each single item resource that the multiple subdata base system uses：The multiple subdata base system is made
It is added with the resource amount of this resource, obtains the total resources amount that the multiple subdata base system uses this resource.
Further, in addition to：
Second allocation unit, for being performed for each subdata base system：According to the subdata base system pair
The pluggable database answered uses the priority of resource, gives the resource allocation of the container database to the subdata base system
Corresponding pluggable database.
Further, the replication module includes：
Copied cells, for replicating data to be collected in the subdata base system；
Lead-out unit, for the data to be collected of duplication to be exported from the subdata base system；
Import unit, for derived data will be imported into from the subdata base corresponding to the subdata base system
In pluggable database.
Compared with prior art, the present invention, which comprises at least, creates container database；Created in container database it is multiple can
Database is plugged, multiple pluggable databases and multiple subdata base systems of total Database system correspond；For each
Subdata base system performs：By data duplication to be collected in the subdata base system into corresponding pluggable database.
From the embodiment of the present invention, due to the resource of multiple pluggable database common container databases, therefore resource is improved
Utilization rate, it also avoid operation maintenance personnel and constantly the service condition of resource be adjusted, simplify the operation management of operation maintenance personnel
Work.And due to being stored with the combined data of each subdata base system in pluggable database, from pluggable database
The middle data for obtaining each subdata base system, therefore even if total Database system, which goes wrong, does not interfere with subdata
The normal operation of storehouse system, or subdata base system go wrong and do not interfere with the normal operation of total Database system, from
And it ensure that the operational reliability of total Database system and subdata base system.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can be by specification, rights
Specifically noted structure is realized and obtained in claim and accompanying drawing.
Brief description of the drawings
Accompanying drawing is used for providing further understanding technical solution of the present invention, and a part for constitution instruction, with this
The embodiment of application is used to explain technical scheme together, does not form the limitation to technical solution of the present invention.
Fig. 1 is a kind of schematic flow sheet of data summarization method provided in an embodiment of the present invention；
Fig. 2 is a kind of structural representation of Data Transform Device provided in an embodiment of the present invention；
Fig. 3 is the structural representation of another Data Transform Device provided in an embodiment of the present invention；
Fig. 4 is the structural representation of another Data Transform Device provided in an embodiment of the present invention.
Embodiment
For the object, technical solutions and advantages of the present invention are more clearly understood, below in conjunction with accompanying drawing to the present invention
Embodiment be described in detail.It should be noted that in the case where not conflicting, in the embodiment and embodiment in the application
Feature can mutually be combined.
Can be in the computer system of such as one group computer executable instructions the flow of accompanying drawing illustrates the step of
Perform.Also, although logical order is shown in flow charts, in some cases, can be with suitable different from herein
Sequence performs shown or described step.
The embodiment of the present invention provides a kind of data summarization method, as shown in figure 1, this method includes：
Step 101, create container database (Container DataBase, CDB).
Specifically, oracle container databases are created on database all-in-one.
Step 102, multiple pluggable databases (Pluggable DataBase, PDB) are created in container database, it is more
Individual pluggable database and multiple subdata base systems of total Database system correspond.
For example, total Database system is provincial Database Systems, subdata base system is the data in each city saved
Storehouse system, or the Database Systems that total Database system is whole company, subdata base system are each department of company
Database Systems, pluggable database are the pluggable databases of oracle.It is multiple pluggable due to being created in container database
Database, therefore internal memory, storage, the central processing unit (Central of multiple pluggable database common container Database Systems
Processing Unit, CPU), background process, the resource such as bandwidth and input and output (Input/Output, IO).
The database version of plurality of subdata base system and total Database system is oracle 12cR2 versions, is easy to
Make full use of the multi-tenant characteristic of the database of oracle 12cR2 versions and the function of resource consolidation management.
An application client is corresponding with for each subdata base system, the application client passes through company
Connect character and be series-connected to corresponding subdata base system, to access the data in the subdata base system.When some subdata base
The IP address of system is changed, for example, the IP address of subdata base system is initially in Beijing, later subdata base system
IP address is changed, and is changed to Tianjin, then the connection string of the subdata base systematic difference program is accessed by changing, is made
Application program can correctly access subdata system in Tianjin.
Step 103, performed for each subdata base system：By data duplication to be collected in subdata base system to pair
In the pluggable database answered.
If not having data in pluggable database, data to be collected are exactly all numbers in subdata base system
According to if having there is the partial data in subdata base system in pluggable database, data to be collected are exactly subdata
Data that are being updated in the system of storehouse but being not copied in pluggable database.
Further, on the basis of embodiment corresponding to Fig. 1, after step 103, in addition to：
Calculate the total resources amount that the multiple subdata base system uses each single item resource；For each subdata
Storehouse system performs：The multiple subdata base system is accounted for using the resource amount of each single item resource according to the subdata base system
Using the ratio of the total resources amount of this resource, this resource allocation of the container database is given to the subdata base system
Pluggable database corresponding to system.
The resource that each subdata base system uses includes but is not limited to one below or arbitrary combination：CPU, internal memory,
Hard disk, bandwidth.The total resources amount that multiple subdata base systems use each single item resource is calculated, for example, calculating multiple subdatas
Total check figures of CPU that storehouse system uses, the size of internal memory is used altogether, uses size, the amount of bandwidth taken altogether of hard disk altogether.According to
Each subdata base system accounts for total money of multiple subdata base systems using this resource using the resource amount of each single item resource
The ratio of source amount, more reasonably to give the resource allocation of container database to pluggable database, so as to improve resource
Utilization rate.
Further, the total resources amount for calculating the multiple subdata base system and using each single item resource, including：
Performed for each single item resource that the multiple subdata base system uses：The multiple subdata base system is made
It is added with the resource amount of this resource, obtains the total resources amount that the multiple subdata base system uses this resource.
For example, there are 4 cities in some province, resource that the subdata base system in each city uses is CPU, the subnumber in specific A cities
The CPU of 6 cores is used according to storehouse system, the subdata base system in B cities uses the CPU of 6 cores, and the subdata base system in C cities uses 4 cores
The subdata base system in CPU, D city uses the CPU of 4 cores, and the subdata base system in 4 cities is using CPU total resources amount
20 cores.Therefore, calculate the CPU core number that the subdata base system in A cities uses and account for the total check figures of CPU that this 4 cities useB
The CPU core number that the subdata base system in city uses accounts for the total check figures of CPU that this 4 cities useThe subdata base system in C cities makes
CPU core number accounts for the total check figures of CPU that this 4 cities useThe CPU core number that the subdata base system in D cities uses accounts for this 4
The total check figures of CPU that city usesIf container database has the CPU of 10 cores, for corresponding to the subdata base system in A cities
Pluggable database distributes the CPU of 3 cores, is the CPU that pluggable database corresponding to the subdata base system in B cities distributes 3 cores, is
Pluggable database distributes the CPU of 2 cores corresponding to the subdata base system in C cities, for that can be inserted corresponding to the subdata base system in D cities
Pull out the CPU that database distributes 2 cores.
Further, after step 103, in addition to：
Performed for each subdata base system：Made according to pluggable database corresponding to the subdata base system
With the priority of resource, the resource allocation of the container database is given to pluggable data corresponding to the subdata base system
Storehouse.
When each pluggable database is higher for the demand of resource, for instance in peak traffic phase, container number
Each pluggable database is not enough distributed to according to the resource in storehouse, then is distributed according to the priority using resource for pluggable database
Resource, ensure that resource priority is assigned to the urgent pluggable database of business.Pluggable database uses the priority of resource
Pre-set.
For example, there are tetra- cities of A, B, C, D in certain province, and the CPU of at least core of demand 3 of pluggable database corresponding to A cities, B cities pair
The CPU of the pluggable database the answered at least core of demand 3, the CPU of at least core of demand 2 of pluggable database corresponding to C cities, D cities pair
The CPU of the pluggable database the answered at least core of demand 2, it is seen that the pluggable database in tetra- cities of A, B, C, D needs 10 cores altogether
CPU, but the only CPU of 9 cores can use container database at present, the highest priority of pluggable database, D corresponding to A cities
The priority of pluggable database is minimum corresponding to city, therefore, is the CPU that pluggable database corresponding to A cities distributes 3 cores, is B
Pluggable database distributes the CPU of 3 cores corresponding to city, is the CPU that pluggable database corresponding to C cities distributes 2 cores, is D cities pair
The pluggable database answered distributes the CPU of 1 core.
When multiple subdata base systems the peak traffic phase occur simultaneously, multiple pluggable databases are all to container database
Resource have more demand, now can account for multiple subdata base systems according to the resource amount that subdata base system uses makes
The ratio of total resources amount, or pluggable database uses the priority of resource according to corresponding to subdata base system,
By the resource allocation of container database to pluggable database corresponding to subdata base system.Certain multiple subdata base systems are same
When the situation of peak traffic phase occur fewer, it is not to occur the peak traffic phase simultaneously that multiple subdata base systems are most of
, now the available resources of container database are still more plentiful, the use of database pluggable enough.
Specifically, the resource allocation of container database is given to each pluggable database by code below.
A) rough draft area (creating pending area) is created：
exec DBMS_RESOURCE_MANAGER.CREATE_PENDING_AREA()；
B) the resource application plan (creating CDB Daytime resource plan) of container database is created：
BEGIN
DBMS_RESOURCE_MANAGER.CREATE_CDB_PLAN(
Plan=>'CDB_DayTime_plan',
Comment=>'CDB resource plan for Daytime')；
END；
/
C) instruct, i.e., insert the resource allocation of container database to each for the application plan of container database establishing resource
Formula database is pulled out, is realized especially by following code：
BEGIN
DBMS_RESOURCE_MANAGER.CREATE_CDB_PLAN_DIRECTIVE(
Plan=>'CDB_DayTime_plan',
Pluggable_database=>'pdb1',
Shares=>3,
Utilization_limit=>100,
Parallel_server_limit=>100)；
END；
/
BEGIN
DBMS_RESOURCE_MANAGER.CREATE_CDB_PLAN_DIRECTIVE(
Plan=>'CDB_DayTime_plan',
Pluggable_database=>'pdb2',
Shares=>3,
Utilization_limit=>100,
Parallel_server_limit=>100)；
END；
/
BEGIN
DBMS_RESOURCE_MANAGER.CREATE_CDB_PLAN_DIRECTIVE(
Plan=>'CDB_DayTime_plan',
Pluggable_database=>'pdb3',
Shares=>1,
Utilization_limit=>70,
Parallel_server_limit=>70)；
END；
/
D) resource application plan instruction so far has been created for container database, has performed following steps to enable, submit
Resource application plan instructs：
exec DBMS_RESOURCE_MANAGER.VALIDATE_PENDING_AREA()；
exec DBMS_RESOURCE_MANAGER.SUBMIT_PENDING_AREA()；
E) iops (the Input/Output Operations Per that following code calculates container database are performed
Second, it is per second be written and read (I/O) operation number) and bandwidth mbps the limit：
SQL>show parameter timed
SQL>Alter system set timed_statistics=true；
System altered.
SQL>show parameter filesystemio
SQL>Alter system set filesystemio_options=SETALL scope=spfile；
System altered.
SQL>select count(*)from v$asm_disk_stat；// it is assumed to be 100
SQL>set timing on serveroutput on；
SQL>declare
v_max_iops BINARY_INTEGER；
v_max_mbps BINARY_INTEGER；
v_act_lat BINARY_INTEGER；
begin
dbms_resource_manager.CALIBRATE_IO(100,10,v_max_iops,v_max_mbps,v_
act_lat)；
dbms_output.put_line('max iops:'||v_max_iops)；
dbms_output.put_line('max mbps:'||v_max_mbps)；
dbms_output.put_line('actual latency:'||v_act_lat)；
end；
/
F) iops of container database limit max_iops=100 ten thousand, the limit max_ of bandwidth is drawn more than assuming
Mbps=10G, performs following code, and respectively each pluggable database carries out the planning and limitation of io resources and bandwidth resources：
ALTER SESSION SET CONTAINER=PDB1；
STARTUP；
ALTER SYSTEM SET MAX_IOPS=600000scope=both；
ALTER SYSTEM SET MAX_MBPS=3000scoep=both；
ALTER SESSION SET CONTAINER=PDB2；
STARTUP；
ALTER SYSTEM SET MAX_IOPS=300000SCOPE=BOTH；
ALTER SYSTEM SET MAX_MBPS=3000SCOPE=BOTH；
ALTER SESSION SET CONTIANER=PDB3；
STARTUP；
ALTER SYSTEM SET MAX_IOPS=300000SCOPE=BOTH；
ALTER SYSTEM SET MAX_MBPS=4000SCOPE=BOTH；
So far, the resource constraint planning of each pluggable database finishes.
Further, step 103 includes：
Replicate data to be collected in the subdata base system；By the data to be collected of duplication from the subdata base
Exported in system；Derived data pluggable data corresponding to the subdata base system will be imported into from the subdata base
In storehouse.
The topology of container database and pluggable database is very simple, is easy to operation maintenance personnel management, and manage container
The operation maintenance personnel of database can have one, and can be had by managing the operation maintenance personnel of multiple pluggable databases by one, save manpower
Cost.
The data summarization method that the embodiment of the present invention is provided, create container database；Created in container database more
Individual pluggable database, multiple pluggable databases and multiple subdata base systems of total Database system correspond；For
Each subdata base system performs：By data duplication to be collected in subdata base system into corresponding pluggable database.
From technical scheme provided by the invention, due to the resource of multiple pluggable database common container databases, therefore can be with
The utilization rate of resource is improved, also avoids operation maintenance personnel from being constantly adjusted to the service condition of resource, simplifies the fortune of operation maintenance personnel
Tie up management work.And due to being stored with the combined data of each subdata base system in pluggable database, from pluggable
The data of each subdata base system are obtained in database, therefore are not interfered with even if total Database system goes wrong
The normal operation of subdata base system, or subdata base system go wrong and do not interfere with the normal fortune of total Database system
OK, so as to ensure that the operational reliability of total Database system and subdata base system.
The embodiment of the present invention provides a kind of Data Transform Device, as shown in Fig. 2 the Data Transform Device 2 includes：
First creation module 21, for creating container database.
Second creation module 22, for creating multiple pluggable databases, multiple pluggable data in container database
Storehouse and multiple subdata base systems of total Database system correspond.
Replication module 23, for being performed for each subdata base system：By data to be collected in subdata base system
In pluggable database corresponding to copying to.
Further, on the basis of embodiment corresponding to Fig. 2, the invention provides another Data Transform Device, such as
Shown in Fig. 3, the Data Transform Device 2 also includes：
Computing module 24, the total resources amount of each single item resource is used for calculating multiple subdata base systems.
First allocation unit 25, for being performed for each subdata base system：Used according to subdata base system each
The resource amount of item resource accounts for ratio of multiple subdata base systems using the total resources amount of this resource, by container database
This resource allocation to pluggable database corresponding to subdata base system.
Further, computing module 24 is specifically used for,
Performed for each single item resource that multiple subdata base systems use：Multiple subdata base systems are provided using this
The resource amount in source is added, and obtains the total resources amount that multiple subdata base systems use this resource.
Further, as shown in figure 3, replication module 23 includes：
Copied cells 231, for data to be collected in replicon Database Systems.
Lead-out unit 232, for the data to be collected of duplication to be exported from subdata base system.
Import unit 233, for derived data will imported into corresponding to subdata base system and can insert from subdata base
Pull out in database.
Further, on the basis of embodiment corresponding to Fig. 2, the invention provides another Data Transform Device, such as
Shown in Fig. 4, the Data Transform Device 2 also includes：
Second allocation unit 26, for being performed for each subdata base system：Can according to corresponding to subdata base system
The priority that database uses resource is plugged, by the resource allocation of container database to pluggable number corresponding to subdata base system
According to storehouse.
Further, as shown in figure 4, replication module 23 includes：
Copied cells 231, for data to be collected in replicon Database Systems.
Lead-out unit 232, for the data to be collected of duplication to be exported from subdata base system.
Import unit 233, for derived data will imported into corresponding to subdata base system and can insert from subdata base
Pull out in database.
In actual applications, the first creation module 21, the second creation module 22, replication module 23, computing module 24, first
Distribute module 25, the second distribute module 26 can be by the CPU in Data Transform Device 2, microprocessor (Micro Processor
Unit, MPU), digital signal processor (Digital Signal Processor, DSP) or field programmable gate array
(Field Programmable Gate Array, FPGA) etc. is realized.
The Data Transform Device that the embodiment of the present invention is provided, create container database；Created in container database more
Individual pluggable database, multiple pluggable databases and multiple subdata base systems of total Database system correspond；For
Each subdata base system performs：By data duplication to be collected in subdata base system into corresponding pluggable database.
From technical scheme provided by the invention, due to the resource of multiple pluggable database common container databases, therefore can be with
The utilization rate of resource is improved, also avoids operation maintenance personnel from being constantly adjusted to the service condition of resource, simplifies the fortune of operation maintenance personnel
Tie up management work.And due to being stored with the combined data of each subdata base system in pluggable database, from pluggable
The data of each subdata base system are obtained in database, therefore are not interfered with even if total Database system goes wrong
The normal operation of subdata base system, or subdata base system go wrong and do not interfere with the normal fortune of total Database system
OK, so as to ensure that the operational reliability of total Database system and subdata base system.
The embodiment of the present invention provides another Data Transform Device, the Data Transform Device include memory, processor with
The step realized and storage is on a memory and the computer program that can run on a processor, during computing device computer program
Suddenly include：
Create container database；
Multiple pluggable databases are created in container database, multiple pluggable databases are more with total Database system
Individual sub- Database Systems correspond；
Performed for each subdata base system：Data duplication to be collected in subdata base system can be inserted corresponding to
Pull out in database.
Further, the step of being realized during above-mentioned computing device computer program also includes：
Calculate the total resources amount that the multiple subdata base system uses each single item resource；
Performed for each subdata base system：The resource of each single item resource is used according to the subdata base system
Amount accounts for ratio of the multiple subdata base system using the total resources amount of this resource, by being somebody's turn to do for the container database
Item resource allocation gives pluggable database corresponding to the subdata base system.
Further, the step of being realized during above-mentioned computing device computer program specifically includes：
Performed for each single item resource that the multiple subdata base system uses：The multiple subdata base system is made
It is added with the resource amount of this resource, obtains the total resources amount that the multiple subdata base system uses this resource.
Further, the step of being realized during above-mentioned computing device computer program also includes：
Performed for each subdata base system：Made according to pluggable database corresponding to the subdata base system
With the priority of resource, the resource allocation of the container database is given to pluggable data corresponding to the subdata base system
Storehouse.
Further, the step of being realized during above-mentioned computing device computer program specifically includes：
Replicate data to be collected in the subdata base system；
The data to be collected of duplication are exported from the subdata base system；
Derived data pluggable database corresponding to the subdata base system will be imported into from the subdata base
In.
Although disclosed herein embodiment as above, described content be only readily appreciate the present invention and use
Embodiment, it is not limited to the present invention.Technical staff in any art of the present invention, taken off not departing from the present invention
On the premise of the spirit and scope of dew, any modification and change, but the present invention can be carried out in the form and details of implementation
Scope of patent protection, still should be subject to the scope of the claims as defined in the appended claims.
Claims (10)
- A kind of 1. data summarization method, it is characterised in that including：Create container database；Multiple pluggable databases, multiple pluggable databases and more height of total Database system are created in container database Database Systems correspond；Performed for each subdata base system：Data duplication to be collected in the subdata base system can be inserted corresponding to Pull out in database.
- 2. data summarization method according to claim 1, it is characterised in that will be treated described in the subdata base system After the data duplication collected is into corresponding pluggable database, in addition to：Calculate the total resources amount that the multiple subdata base system uses each single item resource；Performed for each subdata base system：The resource amount of each single item resource is used according to the subdata base system Ratio of the multiple subdata base system using the total resources amount of this resource is accounted for, this of the container database is provided Distribute to pluggable database corresponding to the subdata base system in source.
- 3. data summarization method according to claim 2, it is characterised in that described to calculate the multiple subdata base system Using the total resources amount of each single item resource, including：Performed for each single item resource that the multiple subdata base system uses：The multiple subdata base system is used should The resource amount of item resource is added, and obtains the total resources amount that the multiple subdata base system uses this resource.
- 4. data summarization method according to claim 1, it is characterised in that will be treated described in the subdata base system After the data duplication collected is into corresponding pluggable database, in addition to：Performed for each subdata base system：Pluggable database uses money according to corresponding to the subdata base system The priority in source, give the resource allocation of the container database to pluggable database corresponding to the subdata base system.
- 5. data summarization method according to any one of claim 1 to 4, it is characterised in that described by the subdata Data duplication to be collected is into corresponding pluggable database in the system of storehouse, including：Replicate data to be collected in the subdata base system；The data to be collected of duplication are exported from the subdata base system；Derived data it will be imported into from the subdata base in pluggable database corresponding to the subdata base system.
- A kind of 6. Data Transform Device, it is characterised in that including：First creation module, for creating container database；Second creation module, for creating multiple pluggable databases in container database, multiple pluggable databases with it is total Multiple subdata base systems of Database Systems correspond；Replication module, for being performed for each subdata base system：Data to be collected in the subdata base system are answered Make in corresponding pluggable database.
- 7. Data Transform Device according to claim 6, it is characterised in that also include：Computing module, the total resources amount of each single item resource is used for calculating the multiple subdata base system；First allocation unit, for being performed for each subdata base system：Used according to the subdata base system every The resource amount of one resource accounts for ratio of the multiple subdata base system using the total resources amount of this resource, by described in This resource allocation of container database gives pluggable database corresponding to the subdata base system.
- 8. Data Transform Device according to claim 7, it is characterised in that the computing module is specifically used for,Performed for each single item resource that the multiple subdata base system uses：The multiple subdata base system is used should The resource amount of item resource is added, and obtains the total resources amount that the multiple subdata base system uses this resource.
- 9. Data Transform Device according to claim 6, it is characterised in that also include：Second allocation unit, for being performed for each subdata base system：According to corresponding to the subdata base system Pluggable database uses the priority of resource, and the resource allocation of the container database is corresponding to the subdata base system Pluggable database.
- 10. the Data Transform Device according to any one of claim 6 to 9, it is characterised in that the replication module bag Include：Copied cells, for replicating data to be collected in the subdata base system；Lead-out unit, for the data to be collected of duplication to be exported from the subdata base system；Import unit, for derived data will imported into corresponding to the subdata base system and can insert from the subdata base Pull out in database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710640382.8A CN107391720A (en) | 2017-07-31 | 2017-07-31 | A kind of data summarization method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710640382.8A CN107391720A (en) | 2017-07-31 | 2017-07-31 | A kind of data summarization method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107391720A true CN107391720A (en) | 2017-11-24 |
Family
ID=60342301
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710640382.8A Pending CN107391720A (en) | 2017-07-31 | 2017-07-31 | A kind of data summarization method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107391720A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110457181A (en) * | 2019-08-02 | 2019-11-15 | 武汉达梦数据库有限公司 | A kind of the log method for optimization analysis and device of database |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102929929A (en) * | 2012-09-24 | 2013-02-13 | 深圳市网信联动技术有限公司 | Method and device for data summarization |
| CN104781809A (en) * | 2012-09-28 | 2015-07-15 | 甲骨文国际公司 | Container database |
| CN104834570A (en) * | 2015-05-13 | 2015-08-12 | 北京汉柏科技有限公司 | Cloud computing platform resource management method and cloud computing platform resource management system based on resource pools |
| US20150254240A1 (en) * | 2014-03-10 | 2015-09-10 | Oracle International Corporation | Instantaneous Unplug of Pluggable Database From One Container Database and Plug Into Another Container Database |
| US20160078178A1 (en) * | 2014-09-17 | 2016-03-17 | Bryan Laskin | Record builder |
-
2017
- 2017-07-31 CN CN201710640382.8A patent/CN107391720A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102929929A (en) * | 2012-09-24 | 2013-02-13 | 深圳市网信联动技术有限公司 | Method and device for data summarization |
| CN104781809A (en) * | 2012-09-28 | 2015-07-15 | 甲骨文国际公司 | Container database |
| US20150254240A1 (en) * | 2014-03-10 | 2015-09-10 | Oracle International Corporation | Instantaneous Unplug of Pluggable Database From One Container Database and Plug Into Another Container Database |
| US20160078178A1 (en) * | 2014-09-17 | 2016-03-17 | Bryan Laskin | Record builder |
| CN104834570A (en) * | 2015-05-13 | 2015-08-12 | 北京汉柏科技有限公司 | Cloud computing platform resource management method and cloud computing platform resource management system based on resource pools |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110457181A (en) * | 2019-08-02 | 2019-11-15 | 武汉达梦数据库有限公司 | A kind of the log method for optimization analysis and device of database |
| CN110457181B (en) * | 2019-08-02 | 2023-05-16 | 武汉达梦数据库股份有限公司 | Log optimization analysis method and device for database |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11544623B2 (en) | Consistent filtering of machine learning data | |
| US20200242129A1 (en) | System and method to improve data synchronization and integration of heterogeneous databases distributed across enterprise and cloud using bi-directional transactional bus of asynchronous change data system | |
| US10073888B1 (en) | Adjusting partitioning policies of a database system in view of storage reconfiguration | |
| US9589041B2 (en) | Client and server integration for replicating data | |
| US10031935B1 (en) | Customer-requested partitioning of journal-based storage systems | |
| US8538985B2 (en) | Efficient processing of queries in federated database systems | |
| US20120284228A1 (en) | User-Defined Parallelization in Transactional Replication of In-Memory Database | |
| US10242052B2 (en) | Relational database tree engine implementing map-reduce query handling | |
| US20210382899A1 (en) | Dual-stack architecture that integrates relational database with blockchain | |
| US9081837B2 (en) | Scoped database connections | |
| US7010538B1 (en) | Method for distributed RDSMS | |
| US20130191523A1 (en) | Real-time analytics for large data sets | |
| US20130110873A1 (en) | Method and system for data storage and management | |
| CN103581332B (en) | HDFS framework and pressure decomposition method for NameNodes in HDFS framework | |
| CN107506464A (en) | A kind of method that HBase secondary indexs are realized based on ES | |
| CN105405070A (en) | Distributed memory power grid system construction method | |
| CN104462185A (en) | Digital library cloud storage system based on mixed structure | |
| WO2013074260A1 (en) | Mutli-path replication in databases | |
| US11700314B2 (en) | Aggregated service status reporter | |
| US9489423B1 (en) | Query data acquisition and analysis | |
| CN114328759A (en) | Data construction and management method and terminal of data warehouse | |
| US11809421B2 (en) | System and method for data analytics | |
| WO2021109777A1 (en) | Data file import method and device | |
| US11163801B2 (en) | Execution of queries in relational databases | |
| US11567957B2 (en) | Incremental addition of data to partitions in database tables |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171124 |
|
| RJ01 | Rejection of invention patent application after publication |