CN104506663A - Intelligent cloud computing operation management system - Google Patents
Intelligent cloud computing operation management system Download PDFInfo
- Publication number
- CN104506663A CN104506663A CN201510032891.3A CN201510032891A CN104506663A CN 104506663 A CN104506663 A CN 104506663A CN 201510032891 A CN201510032891 A CN 201510032891A CN 104506663 A CN104506663 A CN 104506663A
- Authority
- CN
- China
- Prior art keywords
- data
- circuit
- analog machine
- operand
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5083—Techniques for rebalancing the load in a distributed system
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multi Processors (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides an intelligent cloud computing operation management system. By arranging a data summarization relay unit, a first resource adjustment unit, a second resource adjustment unit and a data assistance processing unit, the accurate operation amount adjustment and the accurate energy consumption control of a whole cloud computing system are achieved, and meanwhile the data failure-resistant level is enhanced and the operation efficiency of the whole system is improved.
Description
Technical field
The present invention relates to field of cloud calculation, particularly relate to a kind of intelligent cloud and calculate operation management system.
Background technology
Cloud computing (cloud computing), the one of distributed computing technology, its the most basic concept, be through network and huge computing program is split into numerous less subprogram automatically, then result is returned to user by the bulky systems transferring to multi-section server to form after search, computational analysis.Through this technology, Internet Service Provider can within the several seconds, reach process number in necessarily even hundred million information, reach and the network service of " supercomputer " same powerful usefulness.
Computer run based on a cloud computing technology management is called " cloud ".Cloud computing has following characteristics:
(1) ultra-large." cloud " has suitable scale, and the privately owned cloud of enterprise generally has hundreds of thousands of station server." cloud " can give user unprecedented computing capability;
(2) simulated.Cloud computing support user at an arbitrary position, use various terminal obtain application service.Requested resource is from " cloud ", instead of fixing tangible entity.Be applied in somewhere in " cloud " to run, but in fact user applies without the need to understanding, also not worrying the particular location run;
(3) high reliability." cloud " employs the measures such as the many copies of data are fault-tolerant, computing node isomorphism is interchangeable to ensure the high reliability of service, and it is more reliable than using local computer to use cloud computing;
(4) versatility.Cloud computing, not for specific application, can construct Protean application under the support of " cloud ", and same " cloud " can support different application simultaneously and run;
(5) enhanced scalability.The scale of " cloud " can dynamic retractility, meets the needs of application and userbase growth;
(6) extremely cheap.Special fault-tolerant measure due to " cloud " can adopt extremely cheap node to form cloud.
But existing cloud computing system, the defect that efficiency is low, energy consumption is high is still there is in overall resource or the allotment of entire system operand, and the problem that the reliability of system distributed terminal machine data acquisition is low, this causes whole cloud computing system cannot play its huge efficient computing capability.
Summary of the invention
The object of the invention is to be achieved through the following technical solutions.
According to the embodiment of the present invention, propose a kind of intelligent cloud and calculate operation management system, described system comprises: CPU, multiple data acquiring unit, multiple data summarization TU Trunk Unit, first resource regulon, Secondary resource regulon and data assist process unit; Wherein,
Described multiple data acquiring unit, arranges respectively and runs on each distributed computer in described operation management system, obtains for the instruction according to CPU the instant operation information running on each analog machine of distributed computer;
Described multiple data summarization TU Trunk Unit, for gathering the instant operation information that each data acquiring unit obtains, and is sent to first resource regulon and Secondary resource regulon by the instant operation information gathered;
Described first resource regulon, for receiving the instant operation information that each data summarization TU Trunk Unit transmits, carries out first kind adjustment according to the first resource adjustment criteria preset to the distribution of system resource;
Described Secondary resource regulon, for receiving the instant operation information that each data summarization TU Trunk Unit transmits, carries out Second Type adjustment according to the Secondary resource adjustment criteria preset to the distribution of system resource; And
Described data assist process unit, for needing the intermediate data carrying out cloud computing process to carry out assist process.
According to the embodiment of the present invention, described data acquiring unit specifically comprises:
Data receiver circuit, obtains CPU instruction for receiving, and is obtained the instant operation information of the analog machine operated on distributed computer by analog machine locator, then the information of acquisition is sent to data redundancy deletes circuit;
Data redundancy deletes circuit, for receiving the instruction obtaining CPU, to the instant operation information of analog machine that obtained data receiver circuit transmits, usage data redundancy Pruning algorithm carries out redundancy and deletes process, and the information after redundancy being deleted is stored in local memory;
Local memory, operates on distributed computer, the instant operation information of the analog machine after deleting for storage redundancy;
Message reference circuit, under the control of the central processing unit, reads the instant operation information of analog machine from local memory, and by described information transmission in first serial circuit; And
First serial circuit, is responsible for the passage providing data communication, for safeguard and communications and data between data summarization TU Trunk Unit and CPU transmits; Receive the instant operation information of analog machine of message reference circuit transmission, and these information are sent in data summarization TU Trunk Unit.
According to the embodiment of the present invention, described data summarization TU Trunk Unit specifically comprises:
Program control I/O sequence circuit, for the MAC Address of the distributed computer that receiving sequence management circuit sends, and by described address stored in program control I/O sequence, then under packing processing circuit controls, the MAC Address in program control I/O sequence is transferred to packing treatment circuit;
Sequence management circuit, receives the MAC Address of the distributed computer that data acquiring unit sends from second serial circuit, and sends described MAC Address to program control I/O sequence circuit; When the MAC Address in program control I/O sequence is invalid, described circuit is responsible for deleting the invalid MAC Address in program control I/O sequence;
Packing treatment circuit, is responsible for obtaining MAC Address periodically from program control I/O sequence circuit, and processes described MAC Address, after being packaged as data transfer instruction, described instruction is sent to second serial circuit;
Second serial circuit, is transmitted to sequence management circuit for the MAC Address sent to data summarization TU Trunk Unit by data acquiring unit; Receive the data transfer instruction that the transmission of packing treatment circuit comes simultaneously, then according to the MAC Address in described data transfer instruction, described data transfer instruction is sent to the data acquiring unit of specifying;
Data summarization circuit, as the core of data summarization TU Trunk Unit, receive the instant operation information of the analog machine that multiple data acquiring unit is uploaded, and after these information are combined, gathering, be sent to first resource regulon and Secondary resource regulon.
According to the embodiment of the present invention, described first resource regulon specifically comprises:
Operand obtains circuit, for receiving the operand information of data acquiring unit quantity and the data acquiring unit acquisition frequency gathered from data summarization TU Trunk Unit periodically, then these operand information transmission to operand counting circuit;
Operand counting circuit, for processing the operand information obtaining circuit from operand, and uses upgrade operand information table, with the operand situation making operand information table can reflect distributed computer in real time the information cycle after process;
Operand information table, for receiving the information of the operand situation of the sign distributed computer that operand counting circuit sends, make the operand information of showing each data summarization TU Trunk Unit that first resource regulon manages and data acquiring unit with tabular form;
Operand adapter circuit, for reading operand information table, and the regulation scheme of the deal with data summary request stored according to described circuit, the summary request of new data acquiring unit is assigned in the data summarization TU Trunk Unit of setting.
According to the embodiment of the present invention, described Secondary resource regulon comprises:
Information Receiving Circuits, for receiving the instant operation information of system that data summarization TU Trunk Unit sends;
First analog machine statistical circuit, for obtaining the analog machine number had in current cloud computing system according to the instant operation information of system;
Second analog machine statistical circuit, for adding up the analog machine number in current cloud computing system on every platform distributed computer according to the instant operation information of system, and arranges according to the analog machine number on described every platform distributed computer;
Threshold decision circuit, for judging the minimum threshold number n of required distributed computer according to the maximum analog machine capacity of platform distributed computer every in described cloud computing system and described analog machine number;
Target group determination circuit, for selecting n distributed computer that analog machine number is maximum as target group according to the rank results of the second analog machine statistical circuit;
Data-moving group determination circuit, the analog machine on the distributed computer that will remove outside described target group as data-moving group, and arranges according to the analog machine number of the distributed computer outside the described target group of removing;
Data-moving circuit, for selecting successively from less to more according to analog machine number on distributed computer in data-moving group, and the present day analog machine of selection is carried out corresponding with described target group, until in data-moving group all analog machines all corresponding with described target group after, realize analog machine data-moving successively according to the corresponding relation between described data-moving group and described target group.
According to the embodiment of the present invention, described data assist process unit specifically comprises: the 3rd serial port circuit, data calamity are for circuit, data format decision circuitry, standardized data pre-process circuit and nonstandardized technique data prediction circuit; Wherein,
The data that described 3rd serial port circuit is sent by first serial circuit for receiving data acquiring unit;
Described data calamity is used for carrying out the standby process of calamity to the data that the data acquiring unit received sends for circuit;
The data that described data format decision circuitry is used for the data capture unit received sends carry out form judgement, and described form comprises standardized format and nonstandardized technique form;
Described standardized data pre-process circuit is used for carrying out preliminary treatment to standardized format data, comprises and the multiple standards formatted data of acquisition is converted to unified formatted data;
Described nonstandardized technique data prediction circuit is used for carrying out preliminary treatment to nonstandardized technique formatted data; It comprises the characteristic obtaining described nonstandardized technique form, and described characteristic is stored, and then memory address is sent to CPU;
Described 3rd serial port circuit is also for carrying out subsequent treatment by above-mentioned through pretreated Data dissemination to each distributed computer according to CPU instruction.
Intelligent cloud of the present invention calculates operation management system, TU Trunk Unit, first resource regulon, Secondary resource regulon and data assist process unit is gathered by setting data, achieve the accurate control of fine adjustment to the operand of whole cloud computing system and energy consumption, enhance the level of the anti-inefficacy of data simultaneously, improve the operational efficiency of whole system.
Accompanying drawing explanation
By reading hereafter detailed description of the preferred embodiment, various other advantage and benefit will become cheer and bright for those of ordinary skill in the art.Accompanying drawing only for illustrating the object of preferred implementation, and does not think limitation of the present invention.And in whole accompanying drawing, represent identical parts by identical reference symbol.In the accompanying drawings:
Figure 1 show and calculate operation management system structural representation according to the intelligent cloud of embodiment of the present invention;
Figure 2 illustrate the data acquiring unit structural representation according to embodiment of the present invention;
Figure 3 show the data summarization TU Trunk Unit structural representation according to embodiment of the present invention;
Fig. 4 illustrate the first resource regulon structural representation according to embodiment of the present invention;
Fig. 5 illustrate the Secondary resource regulon structural representation according to embodiment of the present invention;
Figure 6 show the data assist process cellular construction schematic diagram according to embodiment of the present invention.
Embodiment
Below with reference to accompanying drawings illustrative embodiments of the present disclosure is described in more detail.Although show illustrative embodiments of the present disclosure in accompanying drawing, however should be appreciated that can realize the disclosure in a variety of manners and not should limit by the execution mode of setting forth here.On the contrary, provide these execution modes to be in order to more thoroughly the disclosure can be understood, and complete for the scope of the present disclosure can be conveyed to those skilled in the art.
According to the embodiment of the present invention, propose a kind of intelligent cloud and calculate operation management system, as shown in Figure 1, described system comprises: CPU, multiple data acquiring unit, multiple data summarization TU Trunk Unit, first resource regulon, Secondary resource regulon and data assist process unit; Wherein,
Described multiple data acquiring unit, arranges respectively and runs on each distributed computer in described operation management system, obtains for the instruction according to CPU the instant operation information running on each analog machine of distributed computer; Described instant operation information can include, but not limited to computer MAC Address, obtain element number, data acquisition frequency, each analog machine operating state etc.;
Described multiple data summarization TU Trunk Unit, for gathering the instant operation information that each data acquiring unit obtains, and is sent to first resource regulon and Secondary resource regulon by the instant operation information gathered;
Described first resource regulon, for receiving the instant operation information that each data summarization TU Trunk Unit transmits, carries out first kind adjustment according to the first resource adjustment criteria preset to the distribution of system resource;
Described Secondary resource regulon, for receiving the instant operation information that each data summarization TU Trunk Unit transmits, carries out Second Type adjustment according to the Secondary resource adjustment criteria preset to the distribution of system resource; And
Described data assist process unit, for needing the intermediate data carrying out cloud computing process to carry out assist process.
According to the embodiment of the present invention, as shown in Figure 2, described data acquiring unit specifically comprises:
Data receiver circuit, obtains CPU instruction for receiving, and is obtained the instant operation information of the analog machine operated on distributed computer by analog machine locator, then the information of acquisition is sent to data redundancy deletes circuit;
Data redundancy deletes circuit, for receiving the instruction obtaining CPU, to the instant operation information of analog machine that obtained data receiver circuit transmits, usage data redundancy Pruning algorithm carries out redundancy and deletes process, and the information after redundancy being deleted is stored in local memory;
Local memory, operates on distributed computer, the instant operation information of the analog machine after deleting for storage redundancy;
Message reference circuit, under the control of the central processing unit, reads the instant operation information of analog machine from local memory, and by described information transmission in first serial circuit; And
First serial circuit, is responsible for the passage providing data communication, for safeguard and communications and data between data summarization TU Trunk Unit and CPU transmits; Receive the instant operation information of analog machine of message reference circuit transmission, and these information are sent in data summarization TU Trunk Unit.
According to the embodiment of the present invention, as shown in Figure 3, described data summarization TU Trunk Unit specifically comprises:
Program control I/O sequence circuit, for the MAC Address of the distributed computer that receiving sequence management circuit sends, and by described address stored in program control I/O sequence, then under packing processing circuit controls, the MAC Address in program control I/O sequence is transferred to packing treatment circuit;
Sequence management circuit, receives the MAC Address of the distributed computer that data acquiring unit sends from second serial circuit, and sends described MAC Address to program control I/O sequence circuit; When the MAC Address in program control I/O sequence is invalid, described circuit is responsible for deleting the invalid MAC Address in program control I/O sequence;
Packing treatment circuit, is responsible for obtaining MAC Address periodically from program control I/O sequence circuit, and processes described MAC Address, after being packaged as data transfer instruction, described instruction is sent to second serial circuit;
Second serial circuit, is transmitted to sequence management circuit for the MAC Address sent to data summarization TU Trunk Unit by data acquiring unit; Receive the data transfer instruction that the transmission of packing treatment circuit comes simultaneously, then according to the MAC Address in described data transfer instruction, described data transfer instruction is sent to the data acquiring unit of specifying;
Data summarization circuit, as the core of data summarization TU Trunk Unit, receive the instant operation information of the analog machine that multiple data acquiring unit is uploaded, and after these information are combined, gathering, be sent to first resource regulon and Secondary resource regulon.
According to the embodiment of the present invention, described data summarization TU Trunk Unit carrying out practically step comprises:
A1, first determine combined data cycle of data summarization TU Trunk Unit: set data acquisition span cycle time of each data acquiring unit and it sends the time span of data to data summarization TU Trunk Unit;
Distributed computer address is sent out MAC by first serial circuit and is delivered to data summarization TU Trunk Unit by A2, data acquiring unit, and data summarization TU Trunk Unit uses second serial circuit to add in program control I/O sequence circuit by described address by sequence management circuit;
The program control I/O sequence circuit of packing treatment circuit cycle access of A3, data summarization TU Trunk Unit, after obtaining distributed computer MAC Address wherein, described MAC Address is treated to a data transfer instruction, more described instruction is sent to data acquiring unit by second serial circuit; While packing treatment circuit obtains distributed computer MAC Address, data summarization circuit prepares the instant operation information of analog machine receiving data acquiring unit transmission;
After A4, data summarization TU Trunk Unit start to receive data, using the data of current reception as a data block stored in buffer memory, and give described data block one unique identifier, for showing that current what gather is the acquisition data of which data acquiring unit;
A5, because of arrange data transmission period span determine, when described data acquiring unit end data transmission, data block in its buffer memory is just directly sent to distributed memory by data summarization TU Trunk Unit, thus completes the data summarization of a data acquiring unit;
A6, packing treatment circuit start to access program control I/O sequence circuit, start the acquisition data gathering next data acquiring unit, namely return and perform steps A 2.
According to the embodiment of the present invention, as shown in Figure 4, described first resource regulon specifically comprises:
Operand obtains circuit, for receiving the operand information of data acquiring unit quantity and the data acquiring unit acquisition frequency gathered from data summarization TU Trunk Unit periodically, then these operand information transmission to operand counting circuit;
Operand counting circuit, for processing the operand information obtaining circuit from operand, and uses upgrade operand information table, with the operand situation making operand information table can reflect distributed computer in real time the information cycle after process;
Operand information table, for receiving the information of the operand situation of the sign distributed computer that operand counting circuit sends, make the operand information of showing each data summarization TU Trunk Unit that first resource regulon manages and data acquiring unit with tabular form;
Operand adapter circuit, for reading operand information table, and the regulation scheme of the deal with data summary request stored according to described circuit, the summary request of new data acquiring unit is assigned in the data summarization TU Trunk Unit of setting.
According to the embodiment of the present invention, described first resource regulon carrying out practically step comprises:
B1, first resource regulon are according to the operand computing formula of data summarization TU Trunk Unit
Obtain the operand of each data summarization TU Trunk Unit; In formula, L
cthe operand of data summarization TU Trunk Unit c, host
1, host
2..., host
nbe data summarization TU Trunk Unit c gather n data acquiring unit of management; The operand factor-alpha of data summarization point c
cbe the empirical value characterizing described data summarization point c disposal ability, its numerical value carries out adjustment according to operation maintenance experience and arranges in system operation, and 0< α
c≤ 1; Count
i(vm) be the analog machine sum that i-th data acquiring unit is responsible for obtaining; f
ibe the period frequency that i-th data acquiring unit obtains data, namely i-th data acquiring unit is deployed in host
ion, and with frequency f
iobtain host
ithe state information of the analog machine of deploy;
Result of calculation is directly loaded in operand information table after calculating the operand that each data summarization point obtains by B2, operand counting circuit; The operand information table of the real-time operation amount situation for characterizing data summarization point in current system is made to obtain real-time update;
B3, operand adapter circuit access operand information table obtains the operand information of each data summarization point, then according to the operand regulation scheme that described circuit provides, new operand is distributed to corresponding data summarization TU Trunk Unit.
According to the embodiment of the present invention, as shown in Figure 5, described Secondary resource regulon comprises:
Information Receiving Circuits, for receiving the instant operation information of system that data summarization TU Trunk Unit sends;
First analog machine statistical circuit, for obtaining the analog machine number had in current cloud computing system according to the instant operation information of system;
Second analog machine statistical circuit, for adding up the analog machine number in current cloud computing system on every platform distributed computer according to the instant operation information of system, and arranges according to the analog machine number on described every platform distributed computer;
Threshold decision circuit, for judging the minimum threshold number n of required distributed computer according to the maximum analog machine capacity of platform distributed computer every in described cloud computing system and described analog machine number, n is positive integer;
Target group determination circuit, for selecting n distributed computer that analog machine number is maximum as target group according to the rank results of the second analog machine statistical circuit;
Data-moving group determination circuit, the analog machine on the distributed computer that will remove outside described target group as data-moving group, and arranges according to the analog machine number of the distributed computer outside the described target group of removing;
Data-moving circuit, for selecting successively from less to more according to analog machine number on distributed computer in data-moving group, and the present day analog machine of selection is carried out corresponding with described target group, until in data-moving group all analog machines all corresponding with described target group after, realize analog machine data-moving successively according to the corresponding relation between described data-moving group and described target group.
According to the embodiment of the present invention, described data-moving circuit specifically comprises:
Data-moving cost counting circuit, corresponding for the present day analog machine distributed computer maximum with analog machine number in target group that will select, and calculate corresponding total data and move cost, and using described data-moving cost as minimum cost;
Limit circuit, for other distributed computer in target group described in limit, calculate corresponding running total according to moving cost, and current data is moved total cost and described minimum cost compares, if current data moves total cost be more than or equal to described minimum cost, then repeat limit circuit, otherwise current data is moved total cost as minimum cost, present day analog machine is corresponding with current distributed computer.
According to the embodiment of the present invention, the total cost of described data-moving passes through following formulae discovery,
Cost(V
i，P
h)＝mig×D(V
i，P
h)+∑[W(V
i，V
j)×D′(P
h，V
j)]
Wherein, Cost (V
i, P
h) be present day analog machine V
idata-moving is to current distributed computer P
htotal data move cost, mig is constant, D (V
i, P
h) be present day analog machine V
ito current distributed computer P
htopological step number, W (V
i, V
j) be present day analog machine V
iwith other analog machine V in cloud computing system
jbetween communication flows, D ' (P
h, V
j) be present day analog machine V
idata-moving is to distributed computer P
hafter, distributed computer P
hother analog machine V in cloud computing system
jdistance.
According to the embodiment of the present invention, as shown in Figure 6, described data assist process unit specifically comprises: the 3rd serial port circuit, data calamity are for circuit, data format decision circuitry, standardized data pre-process circuit and nonstandardized technique data prediction circuit; Wherein,
The data that described 3rd serial port circuit is sent by first serial circuit for receiving data acquiring unit;
Described data calamity is used for carrying out the standby process of calamity to the data that the data acquiring unit received sends for circuit;
The data that described data format decision circuitry is used for the data capture unit received sends carry out form judgement, and described form comprises standardized format and nonstandardized technique form; Described standardized format comprises, and such as, can use the data of bivariate table structure representation, described nonstandardized technique form comprises, such as, and text, picture, audio frequency etc.;
Described standardized data pre-process circuit is used for carrying out preliminary treatment to standardized format data, comprises and the multiple standards formatted data of acquisition is converted to unified formatted data;
Described nonstandardized technique data prediction circuit is used for carrying out preliminary treatment to nonstandardized technique formatted data; It comprises the characteristic obtaining described nonstandardized technique form, and described characteristic is stored, and then memory address is sent to CPU;
Described 3rd serial port circuit is also for carrying out subsequent treatment by above-mentioned through pretreated Data dissemination to each distributed computer according to CPU instruction.
According to the embodiment of the present invention, described data calamity is carried out calamity for circuit specifically comprise for process the data that the data acquiring unit received sends:
D1, described CPU obtain system operations amount information, and tasks carrying progress and positional information, determine disaster recovery solution;
D2, described data calamity judge for circuit task input data and divide, and to determine that data are standby the need of calamity, and propose the standby application of calamity to CPU;
D3, returning according to the standby order of the calamity of CPU, calculate and utilize idle bandwidth, considers to compare resource consumption, calamity for factors such as times, and it is standby to carry out data calamity;
D4, return calamity for situation to CPU, more new data calamity is for information;
Wherein, system operations amount information spinner described in described D1 will comprise round-trip delay and packet loss, namely increase with round-trip delay increase and packet loss in present period network and weigh system operations amount situation, too much cause overall performance to decline to avoid taking Internet resources because calamity is standby; Described tasks carrying progress, position are executed the task according to current, the MAC Address of reception task, tasks carrying analog machine position, task executed time, Task Progress score information, with the maximum duration needed for the complete execution of anticipation task and calamity for memory location;
Wherein, standby the relating generally to of the data calamity described in described D3 utilizes idle bandwidth calamity standby, considers that resource consumption compares and compares factor with calamity for the time; According to the system operations amount information that D1 receives, analyze its previous system operand rule, consider analog machine position, resource behaviour in service, calculate network idle condition in following 1 minute further, and it is standby to carry out data calamity this period;
Wherein, calamity described in described D4 for situation refer to by the anticipation of system operations amount and disaster recovery solution success calamity standby after information: data calamity for circuit after the standby success of intermediate data calamity, CPU is sent to the form of heartbeat message, described in notice CPU, data calamity is for success and memory location, for the invalid rear use of current data; CPU receives the calamity of data calamity for circuit for after information, upgrades data positional information.
Wherein, in described D3, calamity compares for the time and refers to that data calamity preparedness need be shorter than task execution time for the time, namely CPU receives data calamity and carrys out control data calamity for the return information of circuit and ensure that data calamity is for the time for speed and computing node monitor task implementation progress two aspect, if calamity exceedes task completion time for the time, then abandon calamity standby; The previous time that resource consumption compares mainly through the actual execution of CPU logger task compares for resource consumption as calamity for the time as the calamity of task execution resource consumption and intermediate data, be greater than calamity for resource consumption as performed resource consumption, then abandon calamity standby.
The above; be only the present invention's preferably embodiment, but protection scope of the present invention is not limited thereto, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; the change that can expect easily or replacement, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should described be as the criterion with the protection range of claim.
Claims (6)
1. intelligent cloud calculates an operation management system, and described system comprises: CPU, multiple data acquiring unit, multiple data summarization TU Trunk Unit, first resource regulon, Secondary resource regulon and data assist process unit; Wherein,
Described multiple data acquiring unit, arranges respectively and runs on each distributed computer in described operation management system, obtains for the instruction according to CPU the instant operation information running on each analog machine of distributed computer;
Described multiple data summarization TU Trunk Unit, for gathering the instant operation information that each data acquiring unit obtains, and is sent to first resource regulon and Secondary resource regulon by the instant operation information gathered;
Described first resource regulon, for receiving the instant operation information that each data summarization TU Trunk Unit transmits, carries out first kind adjustment according to the first resource adjustment criteria preset to the distribution of system resource;
Described Secondary resource regulon, for receiving the instant operation information that each data summarization TU Trunk Unit transmits, carries out Second Type adjustment according to the Secondary resource adjustment criteria preset to the distribution of system resource; And
Described data assist process unit, for needing the intermediate data carrying out cloud computing process to carry out assist process.
2. a system as claimed in claim 1, described data acquiring unit specifically comprises:
Data receiver circuit, obtains CPU instruction for receiving, and is obtained the instant operation information of the analog machine operated on distributed computer by analog machine locator, then the information of acquisition is sent to data redundancy deletes circuit;
Data redundancy deletes circuit, for receiving the instruction obtaining CPU, to the instant operation information of analog machine that obtained data receiver circuit transmits, usage data redundancy Pruning algorithm carries out redundancy and deletes process, and the information after redundancy being deleted is stored in local memory;
Local memory, operates on distributed computer, the instant operation information of the analog machine after deleting for storage redundancy;
Message reference circuit, under the control of the central processing unit, reads the instant operation information of analog machine from local memory, and by described information transmission in first serial circuit; And
First serial circuit, is responsible for the passage providing data communication, for safeguard and communications and data between data summarization TU Trunk Unit and CPU transmits; Receive the instant operation information of analog machine of message reference circuit transmission, and these information are sent in data summarization TU Trunk Unit.
3. a system as claimed in claim 2, described data summarization TU Trunk Unit specifically comprises:
Program control I/O sequence circuit, for the MAC Address of the distributed computer that receiving sequence management circuit sends, and by described address stored in program control I/O sequence, then under packing processing circuit controls, the MAC Address in program control I/O sequence is transferred to packing treatment circuit;
Sequence management circuit, receives the MAC Address of the distributed computer that data acquiring unit sends from second serial circuit, and sends described MAC Address to program control I/O sequence circuit; When the MAC Address in program control I/O sequence is invalid, delete the invalid MAC Address in program control I/O sequence;
Packing treatment circuit, is responsible for obtaining MAC Address periodically from program control I/O sequence circuit, and processes described MAC Address, after being packaged as data transfer instruction, described instruction is sent to second serial circuit;
Second serial circuit, is transmitted to sequence management circuit for the MAC Address sent to data summarization TU Trunk Unit by data acquiring unit; Receive the data transfer instruction that the transmission of packing treatment circuit comes simultaneously, then according to the MAC Address in described data transfer instruction, described data transfer instruction is sent to the data acquiring unit of specifying;
Data summarization circuit, receives the instant operation information of the analog machine that multiple data acquiring unit is uploaded, and after combining these information, gathering, is sent to first resource regulon and Secondary resource regulon.
4. a system as claimed in claim 3, described first resource regulon specifically comprises:
Operand obtains circuit, for receiving the operand information of data acquiring unit quantity and the data acquiring unit acquisition frequency gathered from data summarization TU Trunk Unit periodically, then these operand information transmission to operand counting circuit;
Operand counting circuit, for processing the operand information obtaining circuit from operand, and uses upgrade operand information table, with the operand situation making operand information table can reflect distributed computer in real time the information cycle after process;
Operand information table, for receiving the information of the operand situation of the sign distributed computer that operand counting circuit sends, make the operand information of showing each data summarization TU Trunk Unit that first resource regulon manages and data acquiring unit with tabular form;
Operand adapter circuit, for reading operand information table, and the regulation scheme of the deal with data summary request stored according to described circuit, the summary request of new data acquiring unit is assigned in the data summarization TU Trunk Unit of setting.
5. a system as claimed in claim 4, described Secondary resource regulon comprises:
Information Receiving Circuits, for receiving the instant operation information of system that data summarization TU Trunk Unit sends;
First analog machine statistical circuit, for obtaining the analog machine number had in current cloud computing system according to the instant operation information of system;
Second analog machine statistical circuit, for adding up the analog machine number in current cloud computing system on every platform distributed computer according to the instant operation information of system, and arranges according to the analog machine number on described every platform distributed computer;
Threshold decision circuit, for judging the minimum threshold number n of required distributed computer according to the maximum analog machine capacity of platform distributed computer every in described cloud computing system and described analog machine number;
Target group determination circuit, for selecting n distributed computer that analog machine number is maximum as target group according to the rank results of the second analog machine statistical circuit;
Data-moving group determination circuit, the analog machine on the distributed computer that will remove outside described target group as data-moving group, and arranges according to the analog machine number of the distributed computer outside the described target group of removing;
Data-moving circuit, for selecting successively from less to more according to analog machine number on distributed computer in data-moving group, and the present day analog machine of selection is carried out corresponding with described target group, until in data-moving group all analog machines all corresponding with described target group after, realize analog machine data-moving successively according to the corresponding relation between described data-moving group and described target group.
6. a system as claimed in claim 5, described data assist process unit specifically comprises: the 3rd serial port circuit, data calamity are for circuit, data format decision circuitry, standardized data pre-process circuit and nonstandardized technique data prediction circuit; Wherein,
The data that described 3rd serial port circuit is sent by first serial circuit for receiving data acquiring unit;
Described data calamity is used for carrying out the standby process of calamity to the data that the data acquiring unit received sends for circuit;
The data that described data format decision circuitry is used for the data capture unit received sends carry out form judgement, and described form comprises standardized format and nonstandardized technique form;
Described standardized data pre-process circuit is used for carrying out preliminary treatment to standardized format data, comprises and the multiple standards formatted data of acquisition is converted to unified formatted data;
Described nonstandardized technique data prediction circuit is used for carrying out preliminary treatment to nonstandardized technique formatted data; It comprises the characteristic obtaining described nonstandardized technique form, and described characteristic is stored, and then memory address is sent to CPU;
Described 3rd serial port circuit is also for carrying out subsequent treatment by above-mentioned through pretreated Data dissemination to each distributed computer according to CPU instruction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510032891.3A CN104506663B (en) | 2015-01-22 | 2015-01-22 | A kind of intelligent cloud computing operation management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510032891.3A CN104506663B (en) | 2015-01-22 | 2015-01-22 | A kind of intelligent cloud computing operation management system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104506663A true CN104506663A (en) | 2015-04-08 |
| CN104506663B CN104506663B (en) | 2018-03-13 |
Family
ID=52948378
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510032891.3A Active CN104506663B (en) | 2015-01-22 | 2015-01-22 | A kind of intelligent cloud computing operation management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104506663B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112905348A (en) * | 2021-03-09 | 2021-06-04 | 国网河北省电力有限公司信息通信分公司 | Intelligent cloud computing management system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104216782A (en) * | 2014-08-19 | 2014-12-17 | 东南大学 | Dynamic resource management method for high-performance computing and cloud computing hybrid environment |
| CN104283964A (en) * | 2014-10-22 | 2015-01-14 | 国网上海市电力公司 | Power customer intelligent interactive terminal system |
| CN104301389A (en) * | 2014-09-19 | 2015-01-21 | 华侨大学 | Energy efficiency monitoring and managing method and system of cloud computing system |
| CN104301403A (en) * | 2014-09-26 | 2015-01-21 | 东北大学 | Cloud service resource dynamic allocation system and method based on module service copy addition and deletion |
| CN104298339A (en) * | 2014-10-11 | 2015-01-21 | 东北大学 | Server integration method oriented to minimum energy consumption |
-
2015
- 2015-01-22 CN CN201510032891.3A patent/CN104506663B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104216782A (en) * | 2014-08-19 | 2014-12-17 | 东南大学 | Dynamic resource management method for high-performance computing and cloud computing hybrid environment |
| CN104301389A (en) * | 2014-09-19 | 2015-01-21 | 华侨大学 | Energy efficiency monitoring and managing method and system of cloud computing system |
| CN104301403A (en) * | 2014-09-26 | 2015-01-21 | 东北大学 | Cloud service resource dynamic allocation system and method based on module service copy addition and deletion |
| CN104298339A (en) * | 2014-10-11 | 2015-01-21 | 东北大学 | Server integration method oriented to minimum energy consumption |
| CN104283964A (en) * | 2014-10-22 | 2015-01-14 | 国网上海市电力公司 | Power customer intelligent interactive terminal system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112905348A (en) * | 2021-03-09 | 2021-06-04 | 国网河北省电力有限公司信息通信分公司 | Intelligent cloud computing management system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104506663B (en) | 2018-03-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103761309B (en) | Operation data processing method and system | |
| US20110271135A1 (en) | Data management method and node apparatus | |
| CN103685368A (en) | Method and system for migrating data | |
| CN103678133A (en) | Task scheduling system for application software cloud testing | |
| CN107729138B (en) | Method and device for analyzing high-performance distributed vector space data | |
| CA3137748A1 (en) | Method and apparatus for determining configuration knob of database | |
| CN111966289A (en) | Partition optimization method and system based on Kafka cluster | |
| CN104410699A (en) | Resource management method and system of open type cloud computing | |
| CN107004003B (en) | Model parameter fusion method and device | |
| CN104346426A (en) | Shared data de-duplication method and system | |
| CN110083504B (en) | Running state monitoring method and device for distributed tasks | |
| CN107807845A (en) | A kind of incremented data parallel processing apparatus and method | |
| CN112650618A (en) | Method, apparatus and computer program product for backing up data | |
| CN106534259B (en) | Web data acquisition method, Web server and web data acquisition system based on Docker | |
| CN104506663A (en) | Intelligent cloud computing operation management system | |
| CN104503846A (en) | Resource management system based on cloud computing system | |
| CN106919574B (en) | Method for processing remote synchronous file in real time | |
| CN104580498A (en) | Self-adaptive cloud management platform | |
| CN107623580B (en) | Task processing method, device and system in content distribution network | |
| CN105530140A (en) | Cloud scheduling system, method and device for removing tight coupling of use case and environment | |
| CN115481097A (en) | Method and device for realizing real-time data report under mass flow and computer equipment | |
| CN105634999A (en) | Aging method and device for medium access control address | |
| CN114610798A (en) | Resource allocation management method, system, device, storage medium and electronic equipment | |
| CN101909283B (en) | M2M (Machine-to-Machine) platform and method for sharing load downloaded with in high capacity | |
| CN116910568B (en) | Training method and device of graph neural network model, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 610000 Tianfu Software Park Area C, 219 Tianhua Road, Chengdu High-tech Zone, Sichuan Province, 12 buildings and 14 floors Patentee after: Chengdu Peiwat Technology Co., Ltd. Address before: 610000 Tianfu Software Park Area C, 219 Tianhua Road, Chengdu High-tech Zone, Sichuan Province, 12 buildings and 14 floors Patentee before: CHENGDU PVIRTECH TECHNOLOGY CO., LTD. |
|
| CP01 | Change in the name or title of a patent holder | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Intelligent cloud computing operation management system Effective date of registration: 20191120 Granted publication date: 20180313 Pledgee: China Minsheng Banking Corp Chengdu branch Pledgor: Chengdu Peiwat Technology Co., Ltd. Registration number: Y2019510000054 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PC01 | Cancellation of the registration of the contract for pledge of patent right |
Date of cancellation: 20210226 Granted publication date: 20180313 Pledgee: China Minsheng Banking Corp Chengdu branch Pledgor: CHENGDU PVIRTECH Co.,Ltd. Registration number: Y2019510000054 |
|
| PC01 | Cancellation of the registration of the contract for pledge of patent right |