CN103595815A - Method for distributing storage resources based on cloud computing - Google Patents
Method for distributing storage resources based on cloud computing Download PDFInfo
- Publication number
- CN103595815A CN103595815A CN201310603747.1A CN201310603747A CN103595815A CN 103595815 A CN103595815 A CN 103595815A CN 201310603747 A CN201310603747 A CN 201310603747A CN 103595815 A CN103595815 A CN 103595815A
- Authority
- CN
- China
- Prior art keywords
- capacity
- storage
- storage resources
- operation system
- requirement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention provides a method for distributing storage resources based on cloud computing. The method comprises the steps that storage resource distribution requests are received, statistics is carried on the levels and the capacity needs of the storage resources according to the service attributes of service systems sending the storage resource distribution requests out, and the levels and the capacities of the storage resources needed by the service systems are obtained; according to the levels and the capacities of the storage resources needed by the service systems, a storage equipment system is controlled through an equipment webmaster or an API, and the corresponding storage resources are distributed to the service systems. The storage resources of all the systems can be distributed and dispatched on the basis of a cloud computing technology, the optimum dispatching of the storage resources between the service systems can be achieved on the basis of the cloud computing technology, the storage resources with the most proper capacity are distributed to all the service systems, and the use ratio of the storage resources is greatly improved.
Description
Technical field
The present invention relates to the technical field of data storing, particularly relate to a kind of storage resources distribution method based on cloud computing.
Background technology
Through informatization for many years, electrical network unit has all built up the reliable data center machine room of standard, and the construction that these data center machine room are electric network information system provides reliable physical support environment.But along with the application system of building is more and more, amount of data storage is increasing, server and memory device newly-increased in each data center machine room are also more and more, and the utilized area of machine room is also more and more less, and O&M becomes increasingly complex.Thus, propose the first task of wound of " optimize information system running environment, improve the usefulness of software and hardware resources ", required to introduce green IT theory, built green data center.
Along with the development of cloud computing technology, the application of the cloud of memory device is to have become the important means of building green data center that realize.Cloud computing is as brand-new IT payment, IT operation and serviceization management mode, merge again multiple IT technology simultaneously, make the interactivity grow between informationization and business, easily expenditure reduces, Future Services Development can be better met to informationalized demand, cost and the pressure of O&M can greatly be reduced.
Summary of the invention
For solving the problem that improves data storing resource utilization, the present invention proposes a kind of storage resources distribution method based on cloud computing, by cloud computing technology, can carry out allocation schedule to the storage resources between each system, improves the utilance of data storing resource.
A storage resources distribution method for cloud computing, comprises the following steps:
Receive storage resources and distribute request, according to sending described storage resources, distribute the service attribute of the operation system of request, carry out grade and the capacity requirement statistics of storage resources, obtain grade and the capacity of the required storage resources of operation system;
According to grade and the capacity of the required storage resources of described operation system, by equipment webmaster or api interface, realize the control to memory apparatus system, described operation system is distributed to corresponding storage resources.
Storage resources distribution method based on cloud computing of the present invention is added up by grade and the capacity requirement of distributing the operation system of request to carry out storage resources to sending storage resources, obtain grade and the capacity of the required storage resources of operation system, grade and the capacity of the storage resources that the described operation system that obtains according to analysis is required carry out storage resources distribution, making can realize by cloud computing technology the optimal scheduling of storage resources between a plurality of operation systems, is the non-storage resources of joining most suitable capacity of each operation system.That is, neither can affect data storing because storage resources distributes not enough, can not distribute too much storage resources again and cause the waste of storage resources, greatly improve the utilance of storage resources.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of the storage resources distribution method based on cloud computing of the present invention.
Embodiment
Refer to Fig. 1, Fig. 1 is the schematic flow sheet of the storage resources distribution method based on cloud computing of the present invention.
The described storage resources distribution method based on cloud computing, comprises the following steps:
S102, receives storage resources and distributes request;
S104, distributes the service attribute of the operation system of request according to sending described storage resources, carries out grade and the capacity requirement statistics of storage resources, obtains grade and the capacity of the required storage resources of operation system;
S106, according to grade and the capacity of the required storage resources of described operation system, realizes the control to memory apparatus system by equipment webmaster or api interface, and described operation system is distributed to corresponding storage resources.
Storage resources distribution method based on cloud computing of the present invention is added up by grade and the capacity requirement of distributing the operation system of request to carry out storage resources to sending storage resources, obtain grade and the capacity of the required storage resources of operation system, grade and the capacity of the storage resources that the described operation system that obtains according to analysis is required carry out storage resources distribution, making can realize by cloud computing technology the optimal scheduling of storage resources between a plurality of operation systems, is the non-storage resources of joining most suitable capacity of each operation system.That is, neither can affect data storing because storage resources distributes not enough, can not distribute too much storage resources again and cause the waste of storage resources, greatly improve the utilance of storage resources.
Wherein, the described storage resources receiving in step S102 distributes request to be sent by any one operation system.The service attribute that described storage resources allocation request packet contains described operation system, or the indications such as communication identifier of described operation system.After cloud computing server receives and says that described storage resources distributes request, execution step S104.
In step S104, storage capacity requirement assessment, under the pattern in cloud computing infrastructure resources pond, i.e. the preset value problem of virtual resources.The assessment of computational resource is common a series of evaluation methods such as TPC-C, SPEC, but storage resources also lacks appraising model clearly at present, is generally to estimate based on industry experience, provides wherein two kinds of methods below:
In a preferred implementation, described basis is sent the service attribute that described storage resources distributes the operation system of request, carries out grade and the capacity requirement statistics of storage resources, obtains the grade of the required storage resources of operation system and the step of capacity and comprises:
According to the service attribute of described operation system, obtain the grade of corresponding storage resources;
Obtain the storage capacity requirement of database in described operation system, the storage capacity requirement of ordinary file, and the storage capacity requirement of system operating software, the in such a way required storage resources capacity of computing service system:
R=D+F+O；
Wherein, the required storage resources capacity that R is described operation system, the storage capacity requirement that D is database, the storage capacity requirement that F is ordinary file, the storage capacity requirement that O is system operating software.
The required resource of depositing of application system, analyzes from the angle of Data classification, is mainly divided into: database, ordinary file and systems soft ware.Therefore obtain the storage volume demand of above-mentioned three types data, just can determine the storage resources capacity that described operation system is required.
Wherein, can obtain in the following manner the storage capacity requirement of the database of described operation system:
Obtain the storage data capacity of every record in the entity list of described database, calculate in such a way the initial storage capacity of gathering around database:
Wherein, D (n) is for having the initial storage capacity of the database of n entity list, and Si is the storage data capacity of every record in i entity list, and each capacity of the index of this entity list is Ii, and the total number of record is Mi;
Obtain the year memory capacity redundancy rate and use the capacity redundancy ratio under different hard disk Raid protected modes of described database;
According to the initial storage capacity of described database, the year memory capacity redundancy rate of described database, and the capacity redundancy ratio under the different hard disk Raid protected mode of described use, calculate the storage capacity requirement of described database in such a way:
D=D（n）*(1+Td(t))*(1+Raid(r))
Wherein, the storage capacity requirement that D is described database, the database storage capacity redundancy rate that Td (t) is t, Raid (r) is for being used the capacity redundancy ratio under different hard disk Raid protected modes.
Raid; be disk array (Redundant Arrays of Independent Disks); by the capacity redundancy ratio under the protected mode of analysis ceramics array, can obtain the storage volume redundancy of bringing due to disk array protection, guarantee the normal operation of system.
Capacity redundancy ratio under the different hard disk Raid protected mode of described use can be set to: Raid1 mode increases by 100%, Raid10 mode and increases by 100%, Raid5 mode and increase by 50%.
The step of storage capacity requirement of obtaining the ordinary file of described operation system can realize in the following manner:
Obtain the capacity of various journal files, and the capacity of various other types files, calculate in such a way the initial storage capacity of ordinary file:
Wherein, the ordinary file initial storage capacity of F (l, k) for comprising l kind journal file and other type file of k kind, Li is the capacity of i kind journal file, Ej is the capacity of j kind other types file;
Obtain the year memory capacity redundancy rate and use the capacity redundancy ratio under different hard disk Raid protected modes of ordinary file;
According to the initial storage capacity of described ordinary file, described ordinary file year memory capacity redundancy rate and the different hard disk Raid protected mode of described use under capacity redundancy ratio, calculate in such a way the storage capacity requirement of described ordinary file:
F=F（l,k）*(1+Tf(t))*(1+Raid(r))；
Wherein, the storage capacity requirement that F is ordinary file, the memory capacity redundancy rate of the ordinary file that Td (t) is t, Raid (r) is for being used the capacity redundancy ratio under different hard disk Raid protected modes.
Capacity redundancy ratio under the different hard disk Raid protected mode of described use can be set to: Raid1 mode increases by 100%, Raid10 mode and increases by 100%, Raid5 mode and increase by 50%.
The step of storage capacity requirement of obtaining the system operating software of described operation system can realize in the following manner:
Obtain the requisite space capacity of the operating system of operation system, the initialization capacity requirement of system software, and the total initial capacity demand of other operating software;
The initial storage capacity requirement of computing system operating software in such a way:
Wherein, the initial storage capacity requirement that O (m) is the system operating software that comprises m kind application software, OS is the requisite space capacity of operating system, and APPi is the initialization capacity requirement of i kind system software, and H is the total initial capacity demand of other operating software;
Obtain the year memory capacity redundancy rate and use the capacity redundancy ratio under different hard disk Raid protected modes of system operating software;
According to the initial storage capacity requirement of described system operating software, described system operating software year memory capacity redundancy rate and the different hard disk Raid protected mode of described use under capacity redundancy ratio, calculate in such a way described storage capacity requirement:
O=O（m）*(1+Tf(t))*(1+Raid(r))；
Wherein, the storage capacity requirement that O is described system operating software, the memory capacity redundancy rate of the system operating software that Td (t) is t, Raid (r) is for being used the capacity redundancy ratio under different hard disk Raid protected modes.
Capacity redundancy ratio under the different hard disk Raid protected mode of described use can be set to: Raid1 mode increases by 100%, Raid10 mode and increases by 100%, Raid5 mode and increase by 50%.
The storage capacity requirement of comprehensive above-mentioned database, the storage capacity requirement of ordinary file, and the account form of the storage capacity requirement of system operating software, when the operation system that can be applied is reached the standard grade, the expression formula of required storage capacity requirement is as follows:
In another kind of preferred implementation, can passing ratio method obtain the required storage resources capacity of described operation system.
Specifically comprise the following steps:
Obtain the historical data of the storage resources capacity of this operation system, and the traffic carrying capacity under the environment of historical usage and data volume, and the traffic carrying capacity under the environment of existing application and data volume;
By the traffic carrying capacity under the environment of the traffic carrying capacity under the environment of existing application and data volume and described historical usage and data volume contrast, obtain linear scale;
The historical data of the storage resources capacity of described operation system, according to described linear scale adjustment, is obtained to the required storage resources capacity of described operation system under the environment of existing application.
Said method is that a comparatively general brand-new operation system of the capacity estimation method ，Dui enterprise volume calculation of reaching the standard grade is the most applicable; And to promoting or science application system (i.e. this application obtains and disposes and application under other user environment), can also usage ratio method estimate.
First to this application system, the capacity historical data under the environment of application deployment is collected, analyze traffic carrying capacity, data volume etc. under new and old environment simultaneously and memory capacity is there is to the business datum of crucial impact, utilize its quantity contrast, press linear scale, the required memory capacity of the deployment system that must make new advances.
By obtain the required storage resources capacity of operation system in the mode of proportional algorithm, can avoid a large amount of computings, and the storage resources distributing also can reach certain accuracy.
And in step S106, according to grade and the capacity of the required storage resources of described operation system, by equipment webmaster or api interface, realize the control to memory apparatus system, described operation system is distributed to corresponding storage resources.
Wherein, the grade of the required storage resources of described operation system can be searched the storage resources grade corresponding with described service attribute according to the service attribute of described operation system.
After getting the grade and capacity of the required storage resources of described operation system, by equipment webmaster or api interface, realize the control to memory apparatus system, the storage resources with respective level and capacity is distributed to corresponding operation system.
Divide timing the storage address of corresponding storage resources can be sent to corresponding described operation system, operation system is realized the access of corresponding storage resources is utilized by described storage address.In a preferred embodiment of the present invention, the described storage resources distribution method based on cloud computing is being distributed after corresponding storage resources described operation system, further comprising the steps: the storage resources of described operation system is carried out to on-line monitoring, the storage resources capacity of the described operation system that monitoring is obtained and fiducial value contrast, in conjunction with the volume change trend of the storage resources of described operation system, adjust the distribution of the storage resources of described operation system.
Described on-line monitoring can be by reading the storage resources capacity data of this operation system in real time, and real time traffic and data volume realize, when increasing, the real time traffic of described operation system and data volume cause the storage resources capacity of described operation system to reduce, or when the real time traffic of described operation system and data volume reduce the storage resources capacity increase that causes described operation system, can send monitoring alarm information, the adjustment of the storage resources of described operation system is carried out in prompting.
The storage resources capacity of the described operation system that monitoring is obtained and fiducial value contrast, the storage resources capacity of each operation system must be higher than fiducial value, to guarantee the normal operation of operation system.And storage resources capacity is on the basis higher than fiducial value, in conjunction with the volume change trend of storage resources, if storage resources capacity reduces, can increase the storage resources of distributing to described operation system; If the storage resources capacity of described operation system increases, can reduce the storage resources of distributing to described operation system.
The above-mentioned operation that increases or reduce the storage resources of distributing to described operation system can be realized the control of memory apparatus system is realized by equipment webmaster or api interface equally.
By the way, can after distributing corresponding storage resources, to the storage resources of each operation system, carry out on-line monitoring, according to monitored results, implement the allocation result of the storage resources of each operation system of adjustment.
According to ILM(Information Lifecycle Management) theory of Information Lifecycle Management; ILM is as a kind of information management module; think that information has one from the cycle that produces, protects, reads, changes, moves, files, reclaims, the life cycle that again activates and exit, the corresponding strategy of managerial demand and the technology that information are run through to its whole life realize means.The object of Information Lifecycle Management is to help enterprise with minimum cost, to obtain maximum value in each stage of life cycle of information.
According to ILM administrative model, we think that the use of storage resources also possesses following life cycle: produce, use, change, reclaim, exit equally.
The present invention introduces the applied business attribute of storage resources, in conjunction with the O&M flow process of storage resources, builds the closed loop management mechanism for the utilization of resources.Integrated mechanism flow process can divide three parts to realize:
1) analysis and evaluation
According to the service attribute that proposes resource bid, to it, need the grade of storage resources and capacity requirement etc. to assess.Specifically can store assessment and two (software) modules of storage capacity requirement assessment realize by classification.
2) Resource Supply
Complete the operation that provides to concrete storage system or resource, i.e. the direct control to memory apparatus system.Specifically can by the control of equipment webmaster, be come to realize or directly realize by api interface by hand.
3) usage monitoring and feedback
To the resource providing, by business unit, carry out online monitoring, contrast properties baseline and trend in capacity, form feedback suggestion to revise assessment models, or the occupation mode of change resource.Concrete passability energy baseline and trend in capacity (software) module realize.
For Resource Supply and monitoring, there have been the research of many this respects and the system tool that can realize at present, foregoing of the present invention is inquired into mainly for the assessment of storage resources capacity.
Under cloud computing mode, user obtains and uses storage resources to become simply, but how information system management person manages and improve resource utilization and become more complicated.The present invention builds the method for the storage resources capacity closed loop management based on business, can promote the effective utilization to storage resources.
The present invention is by the research to cloud computing correlation technique, formulate storage virtualization technology, store high techniques available, store unified management innovation generation cloud memory technology in application standard and the standard of electrical network industry, be used for instructing the adjustment of existing memory device framework, integrate and optimize, realize flexibly dynamic storage architecture, further improve storage and data redundancy, high availability, the continuity of guarantee business, meanwhile, utilize cloud computing technology to realize the integrated, intelligent of memory management.
By the research to correlation techniques such as cloud computing, Storage Virtualization, classification storages, formulate the storage virtualization technology standard and the guideline that are applicable to electrical network industry; By the research to correlation techniques such as cloud computing, cluster storage, storage replications, formulate the high techniques available standard of storage and the guideline that are applicable to electrical network industry; By the research to correlation techniques such as cloud computing, storage monitoring, isomery storage unified managements, formulate the isomery storage management platform technical specification that is applicable to electrical network industry.
The present invention can also be in conjunction with following key technology:
1. can adopt J2EE technology path to realize.
The J2EE architecture adopting provides intermediate layer integrated framework to be used for meeting the demand without the application of too many expense and needs high availability, high reliability and extensibility.By unified development platform is provided, J2EE has reduced expense and the complexity of exploitation multilayer application, provide the integrated strong support of existing application simultaneously, support Enterprise JavaBeans completely, there is good guide to support packing and application deployment, add catalogue support, strengthened security mechanism, improved performance.
J2EE has scalability for building, E-Government/business platform system of flexibility, ease for maintenance provides good mechanism:
Retain existing IT assets;
Because enterprise must adapt to new business demand, utilize the existing investment aspect information system of enterprise, rather than reformulate overall scheme and just become very important.Like this, the server end platform mechanism being based upon on existed system in progressive (rather than radical, totally repudiate) mode is that enterprise is required.J2EE framework can make full use of the original investment of user, and why this becomes may be because J2EE has industry support widely and some important " enterprise calculation " field suppliers' participation.Each supply commercial city provides and need not discard existing investment existing IT service management system, enters the upgrading approach in transplantable J2EE field.Because the product based on J2EE platform almost can move in any operating system and hardware configuration, existing operating system and hardware also can be retained use.
2. can realize efficient exploitation:
J2EE permission company gives middleware supplier some general, very loaded down with trivial details service end tasks and has gone.Developer can concentrate one's energy how, to create on business logic like this, has correspondingly shortened the development time.Senior middleware supplier provides following these complicated middleware services:
Condition managing service--allow developer write code still less, how need not to be concerned about and controlled state can to complete quickly program development like this.
Durative services--developer need not be encoded and just can write application program data access logic, can generate lighter and handier, the application program of independent of database, this application program is easier to development and maintenance.
Distributed shared data object CACHE service--allow and develop the high performance system of staffing, greatly improve the retractility of integral deployment.
Support that isomerous environment--J2EE can the portable program of development deployment in isomerous environment.Application program based on J2EE does not rely on any specific operation system, middleware, hardware.Therefore the program based on J2EE reasonable in design only need be developed once and just can be deployed to various platforms.This is very crucial in typical isomery enterprise computing environment.J2EE standard also allows the third-party ready-made assembly of IT service management system order and J2EE compatibility, and they are deployed in isomerous environment, has saved by oneself and has worked out the required expense of whole scheme.
3. there is scalability:
A kind of server end platform must be selected by enterprise, and this platform should be able to provide splendid scalability to go to meet the large quantities of new client that those carry out commercial operation in their system.Application program based on J2EE platform can be deployed in various operating system.For example can be deployed to high-end UNIX and large computer system, this system unit can be supported 64 to 256 processors.And the supplier in J2EE field provides load balancing strategy more widely, the bottleneck in energy elimination system, the integrated deployment of permission multiple servers.This deployment can reach thousands of processors, and the system that realization can be highly flexible meets the needs that following business is applied.
4. there is stable availability:
Server end platform must round-the-clock running to meet government, corporate client, affiliate's needs.J2EE is deployed in reliable operating environment, and they support the most healthy and the strongest operating system of long-term availability can reach 99.999% availability or only need every year 5 minute downtime, and this is the desirable selection of the very strong business system of real-time.
The present invention can adopt open interface mode, support that open business function encapsulation is the mode of Web Service, support to dispose Web service, can use one or more and other system and EAI platform in popular protocol (SNMP, CORBA, SOAP, Socket etc.) to realize interoperability.
The present invention also can be in conjunction with the IT Object Model Technique based on CIM.CIM model (common information model (CIM, Common Information Model)) is the basis of IEC61970 agreement general frame.It is a kind of information model of describing all object logics structures of electric power system and relation, for each application provides the unified electric power system logical description with platform independence.It has defined the standard object model of power industry, and a kind of expression power system objects is provided, and comprises the standard of its attribute and correlation.
CIM common information model is described as object class, attribute and the relation between them electric power system resource (Power System Resource).Since in April, 1998, CCAPI has issued cimu07a.mdl, starts to adopt object-oriented UML UML to describe CIM.In UML, the type of real world entities is defined as " class ", and the character of entity type is defined as " attribute of class ", and the relationship description between entity type is " relation between class ", comprising: succession, associated, gathering.
Object in CIM model is abstract in essence, can be applied in each system.CIM model contributes to EMS system integrated of different supplier developments, contributes to EMS system and other to relate to application system integrated of power system operation operation different field.
CIM defines with OO modeling technique.Specifically, CIM standard is used UML (UML) expression, and it is defined as one group of bag by CIM.
Each bag in CIM comprises one or more class figure, by graphics mode, shows all classes in this bag and their relation.Then according to the attribute of class and with the relation of other class, with written form, define each class.
By the present invention, can provide:
1) Standardization System research
Analyze the standardization body of representative storage, cloud storage, as (the Storage Networking Industry Association of SNIA, SNIA) relevant criterion standard and interface specification, tracer technique and standardized development trend.
2) research of storage virtualization technology
Existing storage virtualization technology and main product are studied.Such as the research of comparing of the technology based on virtual modes such as main frame, storage system, networks and main product, the concept of clear Storage Virtualization, technology realize the quality of main points and different solutions, for following informatization type selecting provides foundation.
3) research of layering memory technology
Solution to existing classification storage is studied, and by the classification memory technology to main product, compares, and studies the implementation of its storage lifecycle management, for following storage architecture and analytical model build, offers reference.
4) research of storage system best practices framework
By comprehensive technology and analysis of cases, draft the best practices framework of storage system, analyze the current storage architecture of electrical network and the gap of best practices, for following construction is offered reference.
Research towards storage system monitoring expansion:
The present invention is to functions such as the unified monitoring of storage resources, operation baseline structure and baseline analysis.
By storage system is carried out to deep analysis, set up comprehensively, reasonably move (performance, availability etc.) index system, and should pursue minimizing of system index and gather and typicalness.
All kinds of business based on electric network data center, comprise the management information systems such as electrical network marketing, finance, human resources, production management, and other aided management system business, build the storage behavior of electrical network business and rely on model and running baseline, for service application performance, service quality assessment, trouble correlation analytic diagnosis provides support, also for framework deployment design and the infrastructure option of similar new business system provide reference in the future.
Assembly module can connect with associated electrical O&M system (as: IT service management system etc.), realizes triggering, the circulation of fault ticket.
Memory device NE quantity >=200 of management.
Monitored results of the present invention is shown can be in the following ways:
Realization represents the distribution of storage resources and service condition in real time from the visual angle based on business.At least comprise following view (topology):
Substantially represent view.For based on SAN(Storage Area Network and SAN Protocols(SAN: storage area network and agreement thereof) topology of storage networking represents.Under this view, can clearly recognize the physical connection situation of whole SAN storage networking.The bandwidth of each link, server, HBA card, storage switch, storage system state (normal, alarm, fault etc.).
Resource Dependence view.In basic view, click individual equipment, there will be Resource Dependence view.Such as clicking server, there will be the connected link of server therewith and the topological diagram of the storage resources that relies on.
Service view.The operation list of model Shantou power supply administration, when clicking certain business of selection, can be relevant server, link, storage switch, storage system, and concrete storage resources basic condition is carried out association displaying on a topological diagram.
Monitor storage resources behaviour in service, dependent resource and the path situation of all kinds of business.
In modes such as topological diagrams, carry out representing of resource and connection status.
When monitoring in real time, by comparing of real time data and performance baseline, while there is abnormal (difference reaches default threshold values), send early warning.
Baseline to the fiducial value of the storage resources capacity as operation system.Set up the operation monitoring Index System Model of storage system.And by the collection of the historical data of the operating index of the storage system of electrical network typical services and statistical analysis, set up the corresponding storage system operation baseline of all kinds of electrical network typical services systems.
Realization based on operation baseline supervision analysis and early warning.By real-time operating index value and the operation baseline of having set up, compare analysis, once gap reaches default degree, can produce the informations such as alarm.
Support the time of baseline to set (day, week, the moon etc.).
Carry out the relevant parameter of module, the setting of supervision alarm threshold value.
The present invention is to storage resource demands analysis, and demand analysis, the storage resources based on memory hierarchy of realizing the storage resources (capacity etc.) based on business such as represents at the function.The storage demand assessment models of setting up operation system, this assessment models is comprised of two parts: the one, certain operation system is to the computation model of storage demand (being mainly capacity etc.) (index based on quantizing); The 2nd, the appraisement system of electrical network operation system, and corresponding rating calculation assessment models.Assessment models is supported the assessment to online operation system (in the operation system of running) and non-online operation system (not the new business system of on-line running).The default value of assessment models should be Full Parameterized, ensures when system environments changes the validity of assessment models.To evaluated operation system, system module should produce the results such as corresponding operation system deciding grade and level, storage demand analysis, and can provide according to current actual stored resource corresponding expert opinion, for the allocation manager of storage resources provides decision-making foundation.Graphic exhibition grid company classification storage resources system.
The present invention carries out resource requirement analysis, realizes the storage resource demands analysis of operation system, for the memory utilization of operation system provides the foundation of science.Set up operation system capacity requirement analytical model, and the parameter by quantizing (such as: data/file format etc. is set aside some time, stored to service-user number, Operational Visit amount, data) storage capacity requirement of business is carried out to computational analysis.By different business storage demand (database, file etc.), set up corresponding memory model.By different class of service (application of having reached the standard grade, the application of not reaching the standard grade etc.), set up corresponding memory model.Realize by input parameter, capacity requirement is calculated; To the part calculated factor in line service assessment models (such as: calling party numbers etc.) system can be carried out real-time extraction.
The present invention has realized memory hierarchy and has represented, and the classification storage evaluation and the system that realize the storage resources of grid company represent, for more reasonably planning and using the storage resources of grid company that technical support is provided.The memory hierarchy model of foundation based on operation system grade evaluation, carries out ranking and division (such as core business, key business, important service, general business etc.) to the business of grid company.According to Grade, can assessing concrete operation system.By different grades, the memory state of each operation system is carried out to staging hierarchy and represent.Carry out the parameter setting of the relevant parameter of module, the setting of supervision alarm threshold value.
System interface of the present invention to realize with IT O&M related system carry out integrated, integrate, comprise IT service management system and and IT concentrate operation monitoring system, and with other systems of this two system integrations as CTI system etc.Because original system interface mode complexity is various, comprise WebService, Socket, J2EE/EJB, CORBA, message queue (Message Queue) etc., the integrated of assembly module and these systems must be followed original system interface specification, avoids the transformation of original system code.Meanwhile, in order to guarantee the safe operation of system, various interface mode all should guarantee the fail safe of its access.System interface is to realize a system with other system, to carry out the bridge of information interaction, and below should supporting in data transmission procedure, some requires: transmit in real time, efficiently and safely and reliably batch data; Breakpoint transmission function; Data compression transmission; Error control in transmitting procedure etc.
The present invention can will realize with IT service management system integratedly with IT service management system interface, completes transfer of data.The warning information that native system produces etc., should be able to be transferred to IT service management system, connect with the incident management of IT service management system.Realize monitoring module and occur after alarm, can be automatically brought to the incident management flow process of IT service management system.
The present invention can concentrate operation monitoring system to integrate with IT.The module of exploitation, realizes the integration of concentrating operation monitoring system with IT in the mode of assembly module.Assembly module need to concentrate operation monitoring system to obtain data from IT, comprises application system monitor data, basic platform monitor data, support platform monitor data, alarm data etc.
The beneficial effect that technical solution of the present invention is brought comprises:
1. economic benefit:
Facing cloud storage device management architectural study, can improve the utilance of memory space greatly, increases work efficiency, benefit.Reduce personnel cost, improve management quality.
By to memory apparatus system and resource, introducing under cloud computing mode and correlation technique, how effectively to carry out storage system transformation, structure; And realize following target:
By the research to correlation techniques such as cloud storage, Storage Virtualization, classification storages, arrange and submit storage correlation technique research report and best practices research report to.
Under cloud computing environment, store the storage system operating index system of unified monitoring, the realization of the storage behavior baseline model based on business is studied, and formulate the embodiment of storage system monitor component.
By studying as the storage system framework of guiding take business, determine storage architecture model, and set up the storage demand quantitative appraisement model based on business.
Research and develop above assembly module, and in IT centralized monitoring system, realize assembly and integrate, on the basis of application study achievement, carry out Software for Design.
2. social benefit:
Power supply enterprise is the public service enterprise that is related to national economy.At present, the inner working of power supply enterprise and the service that externally provides have largely relied on the normal operation with IT system.The fault of IT system, except meeting brings the economic loss of enterprise, also will cause severe social influence.Use native system, can grasp in advance system operation situation, fault is eliminated in bud, avoided the serious accident involving serious consequences of power supply enterprise.
The service quality of IT system (SLA) is to concern power supply enterprise to client's promise and the significant problem of bearing to society; It is the significant problem that concerns power supply enterprise's social image and reputation.Use native system can analyze IT service level, find short slab, conscientiously improve IT service level, thereby improve the community service image of power supply enterprise.
The above embodiment has only expressed several execution mode of the present invention, and it describes comparatively concrete and detailed, but can not therefore be interpreted as the restriction to the scope of the claims of the present invention.It should be pointed out that for the person of ordinary skill of the art, without departing from the inventive concept of the premise, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection range of patent of the present invention should be as the criterion with claims.
Claims (9)
1. the storage resources distribution method based on cloud computing, is characterized in that, comprises the following steps:
Receive storage resources and distribute request, according to sending described storage resources, distribute the service attribute of the operation system of request, carry out grade and the capacity requirement statistics of storage resources, obtain grade and the capacity of the required storage resources of operation system;
According to grade and the capacity of the required storage resources of described operation system, by equipment webmaster or api interface, realize the control to memory apparatus system, described operation system is distributed to corresponding storage resources.
2. the storage resources distribution method based on cloud computing as claimed in claim 1, it is characterized in that, according to sending described storage resources, distribute the service attribute of the operation system of request, carry out grade and the capacity requirement statistics of storage resources, obtain the grade of the required storage resources of operation system and the step of capacity and comprise:
According to the service attribute of described operation system, obtain the grade of corresponding storage resources;
Obtain the storage capacity requirement of database in described operation system, the storage capacity requirement of ordinary file, and the storage capacity requirement of system operating software, the in such a way required storage resources capacity of computing service system:
R=D+F+O；
Wherein, the required storage resources capacity that R is described operation system, the storage capacity requirement that D is database, the storage capacity requirement that F is ordinary file, the storage capacity requirement that O is system operating software.
3. the storage resources distribution method based on cloud computing as claimed in claim 2, is characterized in that, the step of storage capacity requirement of obtaining the database of described operation system comprises:
Obtain the storage data capacity of every record in the entity list of described database, calculate in such a way the initial storage capacity of gathering around database:
Wherein, D (n) is for having the initial storage capacity of the database of n entity list, and Si is the storage data capacity of every record in i entity list, and each capacity of the index of this entity list is Ii, and the total number of record is Mi;
Obtain the year memory capacity redundancy rate and use the capacity redundancy ratio under different hard disk Raid protected modes of described database;
According to the initial storage capacity of described database, the year memory capacity redundancy rate of described database, and the capacity redundancy ratio under the different hard disk Raid protected mode of described use, calculate the storage capacity requirement of described database in such a way:
D=D（n）*(1+Td(t))*(1+Raid(r))
Wherein, the storage capacity requirement that D is described database, the database storage capacity redundancy rate that Td (t) is t, Raid (r) is for being used the capacity redundancy ratio under different hard disk Raid protected modes.
4. the storage resources distribution method based on cloud computing as claimed in claim 3; it is characterized in that; capacity redundancy ratio under the different hard disk Raid protected mode of described use is: Raid1 mode increases by 100%, Raid10 mode and increases by 100%, Raid5 mode and increase by 50%.
5. the storage resources distribution method based on cloud computing as claimed in claim 2, is characterized in that, the step of storage capacity requirement of obtaining the ordinary file of described operation system comprises:
Obtain the capacity of various journal files, and the capacity of various other types files, calculate in such a way the initial storage capacity of ordinary file:
Wherein, the ordinary file initial storage capacity of F (l, k) for comprising l kind journal file and other type file of k kind, Li is the capacity of i kind journal file, Ej is the capacity of j kind other types file;
Obtain the year memory capacity redundancy rate and use the capacity redundancy ratio under different hard disk Raid protected modes of ordinary file;
According to the initial storage capacity of described ordinary file, described ordinary file year memory capacity redundancy rate and the different hard disk Raid protected mode of described use under capacity redundancy ratio, calculate in such a way the storage capacity requirement of described ordinary file:
F=F（l,k）*(1+Tf(t))*(1+Raid(r))；
Wherein, the storage capacity requirement that F is ordinary file, the memory capacity redundancy rate of the ordinary file that Td (t) is t, Raid (r) is for being used the capacity redundancy ratio under different hard disk Raid protected modes.
6. the storage resources distribution method based on cloud computing as claimed in claim 5; it is characterized in that; capacity redundancy ratio under the different hard disk Raid protected mode of described use is: Raid1 mode increases by 100%, Raid10 mode and increases by 100%, Raid5 mode and increase by 50%.
7. the storage resources distribution method based on cloud computing as claimed in claim 2, is characterized in that, the step of storage capacity requirement of obtaining the system operating software of described operation system comprises:
Obtain the requisite space capacity of the operating system of operation system, the initialization capacity requirement of system software, and the total initial capacity demand of other operating software;
The initial storage capacity requirement of computing system operating software in such a way:
Wherein, the initial storage capacity requirement that O (m) is the system operating software that comprises m kind application software, OS is the requisite space capacity of operating system, and APPi is the initialization capacity requirement of i kind system software, and H is the total initial capacity demand of other operating software;
Obtain the year memory capacity redundancy rate and use the capacity redundancy ratio under different hard disk Raid protected modes of system operating software;
According to the initial storage capacity requirement of described system operating software, described system operating software year memory capacity redundancy rate and the different hard disk Raid protected mode of described use under capacity redundancy ratio, calculate in such a way described storage capacity requirement:
O=O（m）*(1+Tf(t))*(1+Raid(r))；
Wherein, the storage capacity requirement that O is described system operating software, the memory capacity redundancy rate of the system operating software that Td (t) is t, Raid (r) is for being used the capacity redundancy ratio under different hard disk Raid protected modes.
8. the storage resources distribution method based on cloud computing as claimed in claim 7; it is characterized in that; capacity redundancy ratio under the different hard disk Raid protected mode of described use is: Raid1 mode increases by 100%, Raid10 mode and increases by 100%, Raid5 mode and increase by 50%.
9. the storage resources distribution method based on cloud computing as claimed in claim 1, is characterized in that, further obtains in the following manner the required storage resources capacity of operation system:
Obtain the historical data of the storage resources capacity of this operation system, and the traffic carrying capacity under the environment of historical usage and data volume, and the traffic carrying capacity under the environment of existing application and data volume;
By the traffic carrying capacity under the environment of the traffic carrying capacity under the environment of existing application and data volume and described historical usage and data volume contrast, obtain linear scale;
The historical data of the storage resources capacity of described operation system, according to described linear scale adjustment, is obtained to the required storage resources capacity of described operation system under the environment of existing application.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310603747.1A CN103595815A (en) | 2013-11-25 | 2013-11-25 | Method for distributing storage resources based on cloud computing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310603747.1A CN103595815A (en) | 2013-11-25 | 2013-11-25 | Method for distributing storage resources based on cloud computing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103595815A true CN103595815A (en) | 2014-02-19 |
Family
ID=50085793
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310603747.1A Pending CN103595815A (en) | 2013-11-25 | 2013-11-25 | Method for distributing storage resources based on cloud computing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103595815A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104038392A (en) * | 2014-07-04 | 2014-09-10 | 云南电网公司 | Method for evaluating service quality of cloud computing resources |
| CN105653373A (en) * | 2016-02-25 | 2016-06-08 | 腾讯科技（深圳）有限公司 | Resource distributing method and device |
| CN109582234A (en) * | 2018-11-23 | 2019-04-05 | 金色熊猫有限公司 | Storage resources distribution method, device, electronic equipment and computer-readable medium |
| CN110389710A (en) * | 2018-04-20 | 2019-10-29 | 华为技术有限公司 | The method and apparatus for distributing storage resource |
| CN112000634A (en) * | 2020-07-28 | 2020-11-27 | 中国建设银行股份有限公司 | Capacity management method, system, equipment and storage medium of NAS storage file system |
| CN112965806A (en) * | 2021-03-26 | 2021-06-15 | 北京汇钧科技有限公司 | Method and apparatus for determining resources |
| CN113419671A (en) * | 2021-05-20 | 2021-09-21 | 佛山市禅城区政务服务数据管理局 | Personal data space access control method and system |
| CN115310954A (en) * | 2022-10-11 | 2022-11-08 | 南通翁海电气有限公司 | IT service operation maintenance method and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102263823A (en) * | 2011-07-25 | 2011-11-30 | 中兴通讯股份有限公司 | Communication method and communication device based on cloud computing |
| CN102497409A (en) * | 2011-12-08 | 2012-06-13 | 曙光信息产业(北京)有限公司 | Resource management method for cloud computing system |
| WO2013097147A1 (en) * | 2011-12-29 | 2013-07-04 | 华为技术有限公司 | Cloud computing system and method for managing storage resources therein |
-
2013
- 2013-11-25 CN CN201310603747.1A patent/CN103595815A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102263823A (en) * | 2011-07-25 | 2011-11-30 | 中兴通讯股份有限公司 | Communication method and communication device based on cloud computing |
| CN102497409A (en) * | 2011-12-08 | 2012-06-13 | 曙光信息产业(北京)有限公司 | Resource management method for cloud computing system |
| WO2013097147A1 (en) * | 2011-12-29 | 2013-07-04 | 华为技术有限公司 | Cloud computing system and method for managing storage resources therein |
Non-Patent Citations (1)
| Title |
|---|
| 陈森利 等: "云计算模式下企业存储资源管理探索", 《信息与电脑(理论版) 》 * |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104038392A (en) * | 2014-07-04 | 2014-09-10 | 云南电网公司 | Method for evaluating service quality of cloud computing resources |
| CN105653373A (en) * | 2016-02-25 | 2016-06-08 | 腾讯科技（深圳）有限公司 | Resource distributing method and device |
| CN110389710A (en) * | 2018-04-20 | 2019-10-29 | 华为技术有限公司 | The method and apparatus for distributing storage resource |
| CN109582234A (en) * | 2018-11-23 | 2019-04-05 | 金色熊猫有限公司 | Storage resources distribution method, device, electronic equipment and computer-readable medium |
| CN112000634A (en) * | 2020-07-28 | 2020-11-27 | 中国建设银行股份有限公司 | Capacity management method, system, equipment and storage medium of NAS storage file system |
| CN112000634B (en) * | 2020-07-28 | 2023-11-14 | 中国建设银行股份有限公司 | Capacity management method, system, equipment and storage medium of NAS storage file system |
| CN112965806A (en) * | 2021-03-26 | 2021-06-15 | 北京汇钧科技有限公司 | Method and apparatus for determining resources |
| WO2022199204A1 (en) * | 2021-03-26 | 2022-09-29 | 北京汇钧科技有限公司 | Method and apparatus for determining resources |
| CN112965806B (en) * | 2021-03-26 | 2023-08-04 | 北京汇钧科技有限公司 | Method and device for determining resources |
| CN113419671A (en) * | 2021-05-20 | 2021-09-21 | 佛山市禅城区政务服务数据管理局 | Personal data space access control method and system |
| CN113419671B (en) * | 2021-05-20 | 2022-02-18 | 佛山市禅城区政务服务数据管理局 | Personal data space access control method |
| CN115310954A (en) * | 2022-10-11 | 2022-11-08 | 南通翁海电气有限公司 | IT service operation maintenance method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103581339A (en) | Storage resource allocation monitoring and processing method based on cloud computing | |
| CN103595815A (en) | Method for distributing storage resources based on cloud computing | |
| Daki et al. | Big Data management in smart grid: concepts, requirements and implementation | |
| CN106020715B (en) | Storage pool capacity management | |
| CN100530133C (en) | Method and system for managing work load in network environment | |
| CN103281344B (en) | Method and system for the integrating metrology that the service of mixed cloud uses | |
| WO2017036244A1 (en) | Digital simulation system of power distribution network | |
| US9716746B2 (en) | System and method using software defined continuity (SDC) and application defined continuity (ADC) for achieving business continuity and application continuity on massively scalable entities like entire datacenters, entire clouds etc. in a computing system environment | |
| CN105407159B (en) | Logistics transportation position service system | |
| CN112425137A (en) | System and method for modeling and simulating IoT system | |
| CN103761309A (en) | Operation data processing method and system | |
| US8433675B2 (en) | Optimization and staging | |
| CN103299274A (en) | Determining an optimal computing environment for running an image | |
| CN103002005A (en) | Cloud service monitoring system | |
| WO2015039122A1 (en) | Client-selectable power source options for network-accessible service units | |
| CN108092813A (en) | Data center's total management system server hardware Governance framework and implementation method | |
| US20100063643A1 (en) | Policy-based energy management | |
| CN113037857B (en) | Multi-robot cooperative sensing service system, method and equipment facing cloud environment | |
| US11579982B2 (en) | Calculating bandwidth requirements for a specified recovery point objective | |
| Biran et al. | Federated cloud computing as system of systems | |
| Melo et al. | Models for hyper-converged cloud computing infrastructures planning | |
| CN116614385A (en) | Service scheduling path planning method, device and equipment based on digital twin | |
| Hussain et al. | Fog assisted cloud models for smart grid architectures-comparison study and optimal deployment | |
| CN207704481U (en) | Urban energy panorama interactive mode big data platform manages system | |
| Mendes et al. | Decision-theoretic planning for cloud computing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140219 |