CN102929693A - Performance evaluation method and device for servers of whole equipment cabinet - Google Patents

Abstract

The invention relates to the communication field and discloses a performance evaluation method and a device for servers of the whole equipment cabinet. The evaluation method comprises the steps that sever call commands are transmitted to virtual servers in any one load unit of the evaluated servers of the whole equipment cabinet, and the server call command comprises information of tasks to be respectively executed by the virtual servers, and the load units are in one-to-one correspondence with users; and the actual execution result information of the tasks executed by the virtual servers to the tasks is obtained, and the performance of the load units and the virtual servers are determined according to the actual execution result information of the tasks. the performance parameters of the servers of the whole equipment cabinet, obtained by the technical scheme, is more close to user application scenarios, and the obtained evaluation results are more accurate and further accord with actual application.

Description

Performance evaluation methodology and the device of complete machine cabinet server

Technical field

The present invention relates to the Server performance field, particularly a kind of performance evaluation methodology and device of complete machine cabinet server.

Background technology

Along with the development of computer hardware, powerful server becomes main flow.And with the development that computer technology solution and cloud computing technology are used, just expedite the emergence of functional powerful complete machine cabinet server.

Particularly, complete machine cabinet server is, the underlying hardware framework such as conformity calculation node (claiming again S-Blade), disk storage cabinet, network structure and a kind of integrating server of forming.In this complete machine cabinet server, pass through Intel Virtualization Technology, can in a physical server, create a plurality of independently virtual servers, although the basic physics resource of each virtual server (such as the disk storage cabinet etc.) share, but each virtual server is fully independent when work, each virtual server can be carried out respectively independently operating system and independently application software, each independently virtual server provide different services to the user independently of one another, user's side seem just as a plurality of " hardware " server jointly for this user provide the service.

The application of complete machine cabinet server improves the utilization rate of traditional physical server greatly, and is conducive to the abundant application of Internet resources and integrated.

In carrying out research process of the present invention, the inventor finds that there is following defective at least in prior art:

Although complete machine cabinet server has obtained the approval in market, support that the performance evaluating technology for assessment of the performance of this complete machine cabinet server of complete machine cabinet Server development and marketing but is present difficult point.

At present traditional performance evaluating instrument is still generally adopted in the performance evaluating of complete machine cabinet server, such as: VMmark (Virtual Machine mark), SPECvirt (Standard Performance Evaluation Corporation, standard performance appraisal agency) etc. evaluate and test, and traditional performance evaluating is the evaluating tool that traditional physical server is carried out performance evaluating, and each virtual server in the complete machine cabinet server may be for belonging to the virtualized server that the real network service independently is provided to the user respectively on the physical hardware, at present traditional performance evaluating demand that can't satisfy present complete machine cabinet server to the Server performance instrument far away can't obtain the service performance that this complete machine rack server provides to the user when practical application.

Summary of the invention

The embodiment of the invention the first purpose is to provide a kind of performance evaluation methodology of complete machine cabinet server, uses the complete machine cabinet server performance parameter that this technical scheme obtains, the application scenarios of more being close to the users, and the evaluation result that obtains is more accurate, more realistic application.

The embodiment of the invention the second purpose is to provide the performance evaluating apparatus of the first complete machine cabinet server, use the complete machine cabinet server performance parameter that this technical scheme obtains, the application scenarios of more being close to the users, the evaluation result that obtains is more accurate, more realistic application.

The embodiment of the invention the 3rd purpose is to provide the performance evaluating apparatus of the second complete machine cabinet server, use the complete machine cabinet server performance parameter that this technical scheme obtains, the application scenarios of more being close to the users, the evaluation result that obtains is more accurate, more realistic application.

The embodiment of the invention the 4th purpose is to provide the performance evaluating apparatus of the third complete machine cabinet server, use the complete machine cabinet server performance parameter that this technical scheme obtains, the application scenarios of more being close to the users, the evaluation result that obtains is more accurate, more realistic application.

The embodiment of the invention the 5th purpose is to provide the performance evaluating apparatus of the 4th kind of complete machine cabinet server, use the complete machine cabinet server performance parameter that this technical scheme obtains, the application scenarios of more being close to the users, the evaluation result that obtains is more accurate, more realistic application.

The performance evaluation methodology of a kind of complete machine cabinet server that the embodiment of the invention provides comprises:

Each virtual server in the tested complete machine cabinet server in arbitrary load unit sends server calls order,

Described server calls order comprises: require the information of the task that each described virtual server carries out respectively,

Wherein, each described load unit is corresponding one by one with each user respectively;

Obtain each described virtual server to the actual execution result information of described task,

According to the actual execution result information to each described task, determine the performance of described load unit and each described virtual server.

Alternatively, described virtual server comprises the actual execution result information of described task: actual execution number of times and the execution time of carrying out described task.

Alternatively, step: each virtual server in the tested complete machine cabinet server in arbitrary load unit sends server calls order, specifically:

According to the IP address of each described virtual server or the domain name of each described virtual server, described server calls order is sent to respectively each described virtual server in the described load unit.

Alternatively, described load unit comprises: at least one server cluster, each described server cluster respectively by: at least two described virtual servers form;

When described virtual server belonged to arbitrary described server cluster, step: each virtual server in the tested complete machine cabinet server in arbitrary load unit sent server calls order, specifically:

Domain name according to floating IP address or each described server cluster of each described server cluster respectively to each described server cluster, sends described server calls order,

According to predetermined cluster balance policy, specify each described virtual server to carry out described task for described server cluster;

In step: obtain after the actual execution result information of each described virtual server to described task, also comprise:

According to the actual execution result information to described task of described virtual server in each server cluster, determine respectively the cluster performance of each described server cluster.

Alternatively, described server cluster is: be used for the mail server cluster that provides the described virtual server of mail service to form to described user by at least two;

Perhaps, described server cluster is: be used for the web server cluster that provides the described virtual server of Web service to form to described user by at least two.

Alternatively, in step: each virtual server in tested complete machine cabinet server in arbitrary load unit also comprises after sending the server calls order:

The utilization factor of the virtual cpu of each described virtual server in the described load unit of periodic monitor,

If the current overloaded cpu virtual server that exists is then further:

According to the utilization factor of each described virtual cpu, unappropriated at least one virtual cpu in the resource pool with described complete machine cabinet server is distributed to described overloaded cpu virtual server,

Wherein, described overloaded cpu virtual server is: the utilization factor of described virtual cpu is equal to or greater than the virtual server of the predetermined cpu busy percentage upper limit corresponding to described virtual server;

And/or in step: each virtual server in tested complete machine cabinet server in arbitrary load unit sends after server calls order, also comprises:

The utilization factor of the virtual memory of each described virtual server in the described load unit of periodic monitor,

If the current internal memory overload virtual server that exists is then further:

According to the utilization factor of each described virtual memory, with the part of unappropriated virtual memory in the described resource pool, distribute to described internal memory overload virtual server,

Wherein, described internal memory overload virtual server is: the utilization factor of described virtual memory is equal to or greater than the virtual server of the predetermined virtual memory utilization factor upper limit corresponding to described virtual server.

Alternatively, in step: according to the utilization factor of each described virtual cpu, unappropriated at least one virtual cpu in the resource pool with described complete machine cabinet server is distributed to after the described overloaded cpu virtual server,

And/or, in step: according to the utilization factor of each described virtual memory, with the part of unappropriated virtual memory in the described resource pool, distribute to after the described internal memory overload virtual server, also comprise:

Historical record according to the batch operation of described virtual cpu, and/or, according to the historical record of the batch operation of described virtual memory, determine the resource allocation ability of described complete machine cabinet server, described resource comprises: the arbitrary or combination of described virtual cpu, virtual memory.

Alternatively, the utilization factor of the virtual cpu of each described virtual server is respectively:

Start initialization finish described virtual server constantly described virtual cpu take quantity, with the ratio value that takies quantity of the current described virtual cpu of described virtual server;

The utilization factor of the virtual memory of each described virtual server is respectively:

Finish the constantly occupancy of the described virtual memory of described virtual server starting initialization, with the ratio value of the occupancy of the current virtual memory of described virtual server.

Alternatively, in step: obtain after the actual execution result information of each described virtual server to described task, also comprise:

Store the performance of described load unit and each described virtual server, for the performance according to all described load units and all described virtual servers, determine the combination property of described complete machine cabinet server.

Alternatively, also comprise:

Send the framework call instruction to the framework manager, in described framework call instruction, comprise: require described framework manager to the mission bit stream of the clone of the described virtual server of appointment and deployment and require described framework manager to the mission bit stream of the migration of the described virtual server of appointment and require described framework manager to the mission bit stream of the migration of the data at least two described storeies of appointment, wherein each described storer is connected with each described virtual server respectively

Obtain described framework manager to the practical task execution result information of the task of the clone of described virtual server and deployment,

Obtain described framework manager to the practical task execution result information of the mission bit stream of the migration of described virtual server,

Obtain described framework manager to the practical task execution result information of the mission bit stream of the migration of the data on the described storer,

According to each described practical task execution result information, determine the framework managerial ability of described framework manager;

Wherein said framework manager is connected respectively with all described load units.

The performance evaluating apparatus of a kind of complete machine cabinet server that the embodiment of the invention provides comprises:

The call instruction transmitting element sends server calls order for each virtual server in the arbitrary load unit of tested complete machine cabinet server,,

Described server calls order comprises: require the information of the task that each described virtual server carries out respectively,

Wherein, each described load unit is corresponding one by one with each user respectively;

The execution result determining unit is used for obtaining each described virtual server to the actual execution result information of described task;

The performance evaluating unit is connected with described execution result determining unit, is used for determining the performance of described load unit and each described virtual server according to the actual execution result information to each described task.

Alternatively, described call instruction transmitting element, sends to respectively each described virtual server with described server calls order at concrete being used for according to the IP address of each described virtual server or the domain name of each described virtual server.

Alternatively, described call instruction transmitting element, specifically also be used for: when described virtual server belongs to arbitrary described server cluster, domain name according to floating IP address or each described server cluster of each described server cluster, respectively to each described server cluster, send described server calls order

According to predetermined cluster balance policy, specify each described virtual server to carry out described task for described server cluster;

Described performance evaluating unit also is used for the actual execution result information to described task according to described virtual server in each server cluster, determines respectively the cluster performance of each described server cluster.

Alternatively, also comprise:

The utilization factor determining unit of virtual cpu is used for the utilization factor of the virtual cpu of each described virtual server in the described load unit of periodic monitor;

The virtual cpu deployment unit, be connected with the utilization factor determining unit of described virtual cpu, be used for the utilization factor according to each described virtual cpu, unappropriated at least one virtual cpu in the resource pool with described complete machine cabinet server, distribute to described overloaded cpu virtual server

Wherein, described overloaded cpu virtual server is: the utilization factor of described virtual cpu is equal to or greater than the virtual server of the predetermined cpu busy percentage upper limit corresponding to described virtual server.

Alternatively, also comprise:

The utilization factor determining unit of virtual memory is used for the utilization factor of the virtual memory of each described virtual server in the described load unit of periodic monitor;

The virtual memory deployment unit connects with the utilization factor determining unit of described virtual memory, is used for the utilization factor according to each described virtual memory, with the part of unappropriated virtual memory in the described resource pool, distributes to described internal memory overload virtual server,

Wherein, described internal memory overload virtual server is: the utilization factor of described virtual memory is equal to or greater than the virtual server of the predetermined virtual memory utilization factor upper limit corresponding to described virtual server.

Alternatively, described performance evaluating unit, also be connected respectively with described virtual cpu deployment unit, virtual memory deployment unit, also be used for the historical record according to the batch operation of described virtual cpu, and/or, according to the historical record of the batch operation of described virtual memory, determine the resource allocation ability of described complete machine cabinet server, described resource comprises: the arbitrary or combination of described virtual cpu, virtual memory.

Alternatively, described call instruction unit, also be used for sending the framework call instruction to the framework manager of described complete machine cabinet server, in described framework call instruction, comprise: require described framework manager to the clone of the described virtual server of appointment and the mission bit stream of deployment, and require described framework manager to the mission bit stream of the migration of the described virtual server of appointment, and require described framework manager to the mission bit stream of the migration of the data at least two described storeies of appointment, wherein each described storer is connected with each described virtual server respectively, and wherein said framework manager is connected respectively with all described load units;

Framework manager information determining unit is used for obtaining the following information of described framework manager: to the practical task execution result information of the task of the clone of described virtual server and deployment, to the practical task execution result information of the mission bit stream of the migration of described virtual server, to the practical task execution result information of the mission bit stream of the migration of the data on the described storer;

Described performance evaluating unit also is connected with described framework manager information determining unit, is used for according to each described practical task execution result information, determines the framework managerial ability of described framework manager.

The performance evaluating apparatus of a kind of complete machine cabinet server that the embodiment of the invention provides comprises:

Main test cell and at least one the auxiliary test cell that is connected with described main test cell;

Described main test cell comprises: the first configuration information obtains subelement, the first call instruction sends subelement, execution result determining unit, the first storing sub-units and determination of property parameter subelement,

Described the first configuration information obtains subelement, be used for obtaining the configuration information of each virtual server in tested complete machine cabinet server and the described load unit that described main test cell is connected, described configuration information is stored to described the first storing sub-units, and the configuration information of described virtual server comprises: the routing information of each described virtual server;

Described the first call instruction sends subelement, obtain subelement with described the first configuration information respectively, described load unit is connected, send server calls order for each the described virtual server in described load unit, described server calls order comprises: the information that requires the task that each described virtual server carries out respectively, wherein, each described load unit is corresponding one by one with each user respectively, and

Be used for sending the subtest call instruction to each described auxiliary test cell, send call instruction according to described call instruction to each described load unit that described auxiliary test cell connects for described auxiliary test cell;

The first execution result determining unit is used for obtaining each described virtual server to the actual execution result information of described task and the execution result information to described subtest call instruction of obtaining described auxiliary test cell;

Described the first storing sub-units, be used for storage information, described information comprises: the configuration information of each described virtual server and each described virtual server are to the actual execution result information of described task and the execution result information to described subtest call instruction of described auxiliary test cell;

Described determination of property parameter subelement, respectively with described the first storing sub-units, described the second storing sub-units in the described auxiliary test machine is connected, be used for the data according to described the first storing sub-units and each described the second storing sub-units, according to the actual execution result information of each the described virtual server in each described load unit to each described task, determine the performance of each described load unit and each described virtual server, according to the execution result information to described subtest call instruction of each described auxiliary test cell, determine the performance of described auxiliary test cell;

Described auxiliary test cell is the unit of exerting pressure of simulation client terminal access behavior,

Described auxiliary test cell comprises: the second configuration information obtains subelement, the second call instruction sends subelement, the second execution result determining unit and the second storing sub-units;

Described the second configuration information obtains subelement, be used for the control according to the call instruction of described master controller, obtain the configuration information of each described virtual server in the described load unit that is connected with described auxiliary test cell, the configuration information of described each described virtual server is stored to described the second storing sub-units, and described configuration information comprises: the routing information of each described virtual server;

Described the second call instruction sends subelement, obtain subelement with described the second configuration information respectively, described load unit is connected, be used for the control according to the call instruction of described master controller, each described virtual server in described load unit sends the server calls order, described server calls order comprises: the information that requires the task that each described virtual server carries out respectively

The second execution result determining unit is used for obtaining each described virtual server to the actual execution result information of described task;

Described the second storing sub-units is used for storage information, and described information comprises: the configuration information of each described virtual server and each described virtual server are to the actual execution result information of described task.

The performance evaluating apparatus of a kind of complete machine cabinet server that the embodiment of the invention provides comprises:

The call instruction transmitter sends server calls order for each virtual server in the arbitrary load unit of tested complete machine cabinet server,

Described server calls order comprises: require the information of the task that each described virtual server carries out respectively,

Wherein, each described load device is corresponding one by one with each user respectively;

The execution result determiner is used for obtaining each described virtual server to the actual execution result information of described task;

The performance evaluating device is connected with described execution result determiner, is used for determining the performance of described load device and each described virtual server according to the actual execution result information to each described task.

Alternatively, described call instruction transmitter, specifically also be used for: when described virtual server belongs to arbitrary described server cluster, domain name according to floating IP address or each described server cluster of each described server cluster, respectively to each described server cluster, send described server calls order

According to predetermined cluster balance policy, specify each described virtual server to carry out described task for described server cluster;

Described performance evaluating device also is used for the actual execution result information to described task according to described virtual server in each server cluster, determines respectively the cluster performance of each described server cluster.

Alternatively, also comprise:

The utilization factor determiner of virtual cpu is used for the utilization factor of the virtual cpu of each described virtual server in the described load device of periodic monitor;

The virtual cpu tuner is connected with the utilization factor determiner of described virtual cpu, is used for the utilization factor according to each described virtual cpu, and unappropriated at least one virtual cpu in the resource pool with described complete machine cabinet server is distributed to described overloaded cpu virtual server,

Wherein, described overloaded cpu virtual server is: the utilization factor of described virtual cpu is equal to or greater than the virtual server of the predetermined cpu busy percentage upper limit corresponding to described virtual server.

Alternatively, also comprise:

The utilization factor determiner of virtual memory is used for the utilization factor of the virtual memory of each described virtual server in the described load device of periodic monitor;

The virtual memory tuner connects with the utilization factor determiner of described virtual memory, is used for the utilization factor according to each described virtual memory, with the part of unappropriated virtual memory in the described resource pool, distributes to described internal memory overload virtual server,

Wherein, described internal memory overload virtual server is: the utilization factor of described virtual memory is equal to or greater than the virtual server of the predetermined virtual memory utilization factor upper limit corresponding to described virtual server.

Alternatively, described performance evaluating device, also be connected respectively with described virtual cpu tuner, virtual memory tuner, also be used for the historical record according to the batch operation of described virtual cpu, and/or, according to the historical record of the batch operation of described virtual memory, determine the resource allocation ability of described complete machine cabinet server, described resource comprises: the arbitrary or combination of described virtual cpu, virtual memory.

Alternatively, described call instruction device, also be used for sending the framework call instruction to the framework manager of described complete machine cabinet server, in described framework call instruction, comprise: require described framework manager to the clone of the described virtual server of appointment and the mission bit stream of deployment, and require described framework manager to the mission bit stream of the migration of the described virtual server of appointment, and require described framework manager to the mission bit stream of the migration of the data at least two described storeies of appointment, wherein each described storer is connected with each described virtual server respectively, and wherein said framework manager is connected respectively with all described load devices;

Framework manager information determiner is used for obtaining the following information of described framework manager: to the practical task execution result information of the task of the clone of described virtual server and deployment, to the practical task execution result information of the mission bit stream of the migration of described virtual server, to the practical task execution result information of the mission bit stream of the migration of the data on the described storer;

Described performance evaluating device also is connected with described framework manager information determiner, is used for according to each described practical task execution result information, determines the framework managerial ability of described framework manager.

The performance evaluating apparatus of a kind of complete machine cabinet server that the embodiment of the invention provides comprises:

Main tester and at least one the auxiliary tester that is connected with described main tester;

Described main tester comprises: the first configuration information getter, the first call instruction transmitter, execution result determiner, first memory and determination of property parameter device,

Described the first configuration information getter, be used for obtaining the configuration information of each described virtual server in tested complete machine cabinet server and the described load device that described main tester is connected, described configuration information is stored to described first memory, and the configuration information of described virtual server comprises: the routing information of each described virtual server;

Described the first call instruction transmitter, be connected with described the first configuration information getter, described load device respectively, send server calls order for each the described virtual server in described load device, described server calls order comprises: the information that requires the task that each described virtual server carries out respectively, wherein, each described load device is corresponding one by one with each user respectively, and

Be used for sending the subtest call instruction to each described auxiliary tester, send call instruction according to described call instruction to each described load device that described auxiliary tester connects for described auxiliary tester;

The first execution result determiner is used for obtaining each described virtual server to the actual execution result information of described task and the execution result information to described subtest call instruction of obtaining described auxiliary tester;

Described first memory, be used for storage information, described information comprises: the configuration information of each described virtual server and each described virtual server are to the actual execution result information of described task and the execution result information to described subtest call instruction of described auxiliary tester;

Described determination of property parameter device, be connected with described second memory in described first memory, the described auxiliary test machine respectively, be used for the data according to described first memory and each described second memory, according to the actual execution result information of each the described virtual server in each described load device to each described task, determine the performance of each described load device and each described virtual server, according to the execution result information to described subtest call instruction of each described auxiliary tester, determine the performance of described auxiliary tester;

Described auxiliary tester is the pressure applicator of simulation client terminal access behavior,

Described auxiliary tester comprises: the second configuration information getter, the second call instruction transmitter, the second execution result determiner and second memory;

Described the second configuration information getter, be used for the control according to the call instruction of described master controller, obtain with described load device that described auxiliary tester is connected in the configuration information of each described virtual server, the configuration information of described each described virtual server is stored to described second memory, and described configuration information comprises: the routing information of each described virtual server;

Described the second call instruction transmitter, be connected with described the second configuration information getter, described load device respectively, be used for the control according to the call instruction of described master controller, each described virtual server in described load device sends the server calls order, described server calls order comprises: the information that requires the task that each described virtual server carries out respectively

The second execution result determiner is used for obtaining each described virtual server to the actual execution result information of described task;

Described second memory is used for storage information, and described information comprises: the configuration information of each described virtual server and each described virtual server are to the actual execution result information of described task.

Therefore, use the technical scheme among the present invention, the embodiment of the invention is when carrying out the performance evaluating of complete machine cabinet server, respectively in this complete machine cabinet server, with the user one to one each virtual server in the load unit send server calls order, after sending call instruction, to calling the actual execution result information of the task in the order, obtain the performance of each load unit and the performance of each virtual server in each load unit according to each virtual server.Because tested object is the load unit corresponding with the user in the present embodiment technical scheme, and when performance evaluating, simulate when the user uses to the mode that each virtual server in the load unit issues call instruction by test machine, the tasks carrying actual result of each virtual server in load unit corresponding to this user, the performance parameter that obtains according to the tasks carrying actual result of each virtual server in load unit corresponding to user more can reflect the reality of user's application scenarios, therefore the evaluation result that obtains is more accurate, more realistic application.

Description of drawings

In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, the below will do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art, apparently, accompanying drawing in the following describes only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain according to these accompanying drawings other accompanying drawing.

The performance evaluation methodology schematic flow sheet of a kind of complete machine cabinet server that Fig. 1 provides for the embodiment of the invention 1;

A kind of method flow schematic diagram that obtains virtual server CPU and virtual memory resource utilization that Fig. 2 provides for the embodiment of the invention 2;

A kind of method flow schematic diagram that obtains virtual server CPU and virtual memory resource utilization that Fig. 3 provides for the embodiment of the invention 3;

A kind of method flow schematic diagram that obtains virtual server CPU and virtual memory resource utilization that Fig. 4 provides for the embodiment of the invention 4;

A kind of method flow schematic diagram that obtains virtual server CPU and virtual memory resource utilization that Fig. 5 provides for the embodiment of the invention 5;

The performance evaluating apparatus structural representation of a kind of complete machine cabinet server that Fig. 6 provides for the embodiment of the invention 6;

The performance evaluating apparatus structural representation of a kind of complete machine cabinet server that Fig. 7 provides for the embodiment of the invention 7;

The performance evaluating apparatus structural representation of a kind of complete machine cabinet server that Fig. 8 provides for the embodiment of the invention 8;

The performance evaluating apparatus structural representation of a kind of complete machine cabinet server that Fig. 9 provides for the embodiment of the invention 9;

The performance evaluating apparatus structural representation of a kind of complete machine cabinet server that Figure 10 provides for the embodiment of the invention 10;

The performance evaluating apparatus structural representation of a kind of complete machine cabinet server that Figure 11 provides for the embodiment of the invention 11;

The performance evaluating apparatus structural representation of a kind of complete machine cabinet server that Figure 12 provides for the embodiment of the invention 12;

The performance evaluating apparatus structural representation of a kind of complete machine cabinet server that Figure 13 provides for the embodiment of the invention 13;

The performance evaluating apparatus structural representation of a kind of complete machine cabinet server that Figure 14 provides for the embodiment of the invention 14;

The performance evaluating apparatus structural representation of a kind of complete machine cabinet server that Figure 15 provides for the embodiment of the invention 15.

Embodiment

Below in conjunction with the accompanying drawing in the embodiment of the invention, the technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that obtains under the creative work prerequisite.

Embodiment 1:

Referring to shown in Figure 1, the present embodiment provides a kind of performance evaluation methodology of complete machine cabinet server.This complete machine cabinet server provides the virtualizing performance service, comprises at least two load units, and each load unit comprises respectively at least two virtual servers,

In the present embodiment, the performance evaluating of complete machine cabinet mainly be may further comprise the steps:

Step 101: each virtual server in the complete machine cabinet server in arbitrary load unit sends server calls order.

In the present embodiment in tested complete machine cabinet server respectively with the user one to one each load unit be connected, wherein this load unit can but be not limited to self-defined division, each load unit is corresponding with a user, it is equivalent to this user's server load, and each load unit is comprised of one or more virtual server.

In the present embodiment, can be according to the configuration information of each virtual server in the tested load unit that obtains in advance, this configuration information comprises: the routing information of this virtual server in this network architecture in this complete machine cabinet server, specifically according to these configuration informations, each virtual server in tested load unit sends: the server calls order.

This server calls order is including but not limited to comprising following information: the information that requires the task that each virtual server carries out respectively.The service that this virtual server provided to the user when this task was specially the analog subscriber application, such as but be not limited to basis: require virtual server one to carry out N mail transmission/reception, perhaps require virtual server two to carry out M web web site url service etc., perhaps other.

Wherein each virtual server can be mail server, web server or electronic transaction server etc., specifically can preset according to various application scenarios.

In the present embodiment, can but be not limited to according to IP address or domain name in the network architecture of each virtual server in the tested load unit in this complete machine cabinet server, send above-mentioned call instruction to each virtual server.

Step 102: obtain interior each virtual server of tested load unit to the actual execution result information of corresponding task.

After sending the call instruction that is used for the analog subscriber application to tested load unit, according to the feedack in the process of executing the task or after executing the task of each virtual server in the load unit, according to feedack, determine that each virtual server is to the actual execution result information of corresponding task in the tested load unit, each virtual server to the actual execution result information of corresponding task for example can for: carry out actual execution number of times and the execution time of corresponding task, perhaps also comprise time delay and error rate etc.

In addition, each virtual server can by the virtual server active feedback in each tested load unit, also can initiatively be obtained by inquiry or request etc. mode to each virtual server by this test subject the actual execution result information of task in the tested load unit.

Step 103: according to the actual execution result information of each virtual server to corresponding task, determine the performance of each virtual server in tested load unit and this tested load unit.

In the present embodiment, according to each virtual server in the tested load unit (set of the corresponding all virtual server of the user who namely simulated) according to execution (be simulation that in analog subscriber application process virtual server for user the provide service) structure of call instruction to task: actual execution result information, can determine that this tested load unit is when the practical application scene, this complete machine rack server that user's side obtains provides the service performance of service to the user, i.e. the performance of each virtual server in the performance of tested load unit and this load unit.

The performance parameter of each virtual server in the performance of tested load unit and this load unit in the present embodiment, can but be not limited to can be definite with comparing of predetermined gross data by actual execution result information, for example but be not limited to:

Can adopt interior virtual server of the schedule time to the actual execution number of times of preplanned mission, the actual execution result information to corresponding task as virtual server, if actual execution number of times is A1, this virtual server is carried out number of times to the theory of corresponding task within this schedule time be A0, in the present embodiment can be with the performance parameter of following ratio value: A1/A0 as this virtual server.

Wherein this above-mentioned virtual server theory execution number of times to corresponding task within this schedule time is that A0 can be predetermined by the user, also can be the numerical value that records under laboratory fc-specific test FC environment.

Therefore, use the technical scheme among the present invention, the embodiment of the invention is when carrying out the performance evaluating of complete machine cabinet server, respectively in this complete machine cabinet server, with the user one to one each virtual server in the load unit send server calls order, after sending call instruction, to calling the actual execution result information of the task in the order, obtain the performance of each load unit and the performance of each virtual server in each load unit according to each virtual server.Because tested object is the load unit corresponding with the user in the present embodiment technical scheme, and when performance evaluating, simulate when the user uses to the mode that each virtual server in the load unit issues call instruction by test machine, the tasks carrying actual result of each virtual server in load unit corresponding to this user, the performance parameter that obtains according to the tasks carrying actual result of each virtual server in load unit corresponding to user more can reflect the reality of user's application scenarios, therefore the evaluation result that obtains is more accurate, more realistic application.

When using the present embodiment technical scheme, can adopt respectively the present embodiment technical scheme at arbitrary user side, load unit corresponding to arbitrary user and the performance of each virtual server in this load unit are tested, obtain respectively the performance parameter of this complete machine cabinet server that each user's side obtains, and the performance parameter of this complete machine cabinet server that can obtain according to all user's sides, obtain the combination property parameter of this complete machine cabinet server according to predetermined performance synthesis estimating algorithm.

Embodiment 2:

1 different dwelling of the present embodiment and embodiment mainly comprise: load unit virtual memory tested in the complete machine cabinet server of this enforcement is at one or more server cluster, namely a plurality of virtual servers in this load unit form a server cluster, when user task is arranged, can be by cluster according to predetermined cluster protocol, by the principle of the arbitrary or a plurality of virtual server in the cluster according to load balancing, for the user provides service.This server cluster further is conducive to bring into play service provision capacity and the load balance ability of complete machine rack server.

Referring to shown in Figure 2, correspondingly, the complete machine cabinet Server performance flow process in this enforcement is as follows:

Step 201: each virtual server in the complete machine cabinet server in arbitrary load unit sends server calls order.

When if some virtual server in the tested load unit does not belong to arbitrary server cluster, specifically the same as described in example 1 above, according to IP address or the domain name of this virtual server in the network architecture of this complete machine cabinet server, directly send this call instruction to this virtual server.

When if some virtual server in this tested load unit belongs to arbitrary server cluster, specifically can but be not limited to floating IP address (corresponding to cluster) according to this server cluster or the domain name (corresponding to cluster) of this server cluster, to this server cluster, send call instruction respectively.After this server cluster was received this call instruction, take server cluster as unit, the task of appointment was purpose in the complete call order, according to predetermined cluster balance policy, specified the virtual server of determining to carry out corresponding task.

Cluster balance policy that wherein should be predetermined can be predetermined by User Defined, also can be by the network management user when cluster make up, and in advance fixing setting of agreement in cluster.

Each server cluster in the present embodiment can be the cluster of various virtual servers, for example can serve as reasons at least two to be used for providing to the user mail server cluster of the virtual server composition of mail service; Also can serve as reasons at least two and be used for providing to the user web server cluster of the virtual server composition of Web service.Do not do at this and to give unnecessary details and to limit.

Step 202: obtain interior each virtual server of tested load unit to the actual execution result information of corresponding task.

Step 203: according to the actual execution result information of each virtual server to corresponding task, determine the performance of each virtual server in tested load unit and this tested load unit.

Above step 202-203 respectively with embodiment 1 in step 102,103 in like manner.

Step 204: according to the actual execution result information to corresponding task of virtual server in each server cluster, determine respectively the cluster performance of each server cluster.

The present embodiment is for the complete machine cabinet server of presence server cluster, in obtaining each load unit after the performance of each virtual server, also further according to the actual execution result information to corresponding task of each virtual server in each server cluster, further determine the cluster performance of each server cluster in the complete machine cabinet server, i.e. the cluster equalization performance.

Therefore, the present embodiment technical scheme is except can obtaining the beneficial effect described in the embodiment 1, can also further obtain the server cluster ability in the complete machine cabinet server, obtain the more complete machine cabinet performance of various dimensions, so that evaluation result is more accurate, more react real network framework situation.

Embodiment 3:

Referring to shown in Figure 3,2 differences of the present embodiment and embodiment mainly are: after step 201, before step 202,203,204 the arbitrary step or afterwards, also further comprise

Step 301: periodicity or aperiodicity ground, the utilization factor of the virtual cpu of each virtual server in the tested load unit of periodic monitor.

Wherein, the utilization factor of the virtual cpu of virtual server can but do not limit and adopt following the sign: start initialization finish virtual server constantly virtual cpu take quantity, with the ratio value that takies quantity of the virtual cpu of current time in the virtual server.

Step 302: according to monitoring result: the utilization factor of the virtual cpu of each virtual server in the tested load unit determines whether to exist the overloaded cpu virtual server.

In the present embodiment, this overloaded cpu Virtual Service implement body is defined as: the utilization factor of virtual cpu is equal to or greater than the virtual server of the predetermined cpu busy percentage upper limit;

CPU is non-, and the overload virtual server is: the utilization factor of virtual cpu is less than the virtual server of the predetermined cpu busy percentage upper limit.

Wherein can be set to all virtual servers identical for the above-mentioned cpu busy percentage upper limit, also can preset to be decided to be difference, and the virtual server that namely is respectively different is set the different cpu busy percentage upper limits.

Wherein, the utilization factor of the virtual cpu of each virtual server is respectively: finish constantly starting initialization, the virtual cpu of this virtual server take quantity, with the ratio value that takies quantity of virtual cpu shown in current in this virtual server.

Therefore, in embodiments of the present invention, because to the virtual cpu of the virtual server in each load unit and the virtual memory resource is monitored and dynamically allotment, can be so that virtual resource be fully utilized, real simulation user's use scenes is so that the result of evaluation and test is more accurate.

Step 303: if there is the overloaded cpu virtual server, then execution in step 304; Otherwise return, wait for next monitoring arrival constantly, continue monitoring, do not carry out the virtual cpu allotment.

Step 304: obtain the utilization factor of each virtual cpu of each virtual server according to monitoring, carry out the virtual cpu allotment.

Concrete virtual cpu allotment is, utilization factor according to each virtual cpu, unappropriated at least one virtual cpu in the resource pool with complete machine cabinet server, distribute to current C PU overload virtual server, to alleviate the overload condition of this overloaded cpu virtual server, improve the task treatment effeciency of this virtual server.

After carrying out this step 304, return step 301, wait for next monitoring arrival constantly, continue monitoring, until monitor complete, each when the above-mentioned situation that has an overloaded cpu virtual server of above-mentioned appearance occurring when each monitoring, all carry out this step and carry out the virtual cpu adjustment.

Determining specifically of the utilization factor of the virtual cpu of each concrete virtual server can be according to following scheme:

If tested load unit virtual memory is at following virtual server: the first mail server, the second mail server, the first web server, the second web server.

After each virtual server starts successfully, finish constantly (being the idle task load this moment) in the startup initialization, read initially value of taking of interior each the virtual server virtual cpu of tested load unit, if the virtual cpu number that a certain virtual server is assigned with is 10, the number of finishing constantly in running order virtual cpu (being occupied virtual cpu) in moving initialization is 1, then this virtual server virtual cpu initially the value of taking be: 1/10, the virtual cpu that is in idle condition is 9.

(this moment, each virtual server was respectively according to call instruction after sending call instruction, carry out the corresponding task in the call instruction), the virtual cpu utilization factor of each virtual server of periodic monitor, being located at the current number that monitors the in running order virtual cpu (being occupied virtual cpu) of the first virtual server is 10, then this first virtual server virtual cpu initially the value of taking be: 10/10, and the cpu busy percentage of the first virtual server on be limited to 9/10, then this moment the first virtual server be: the overloaded cpu virtual server;

The number of the current in running order virtual cpu (being occupied virtual cpu) of current the second virtual server that monitors is 3, then this second virtual server virtual cpu initially the value of taking be: 3/10, and the cpu busy percentage of the second virtual server on be limited to 9/10, then this moment the second virtual server be: the non-overload virtual server of CPU.

Then can carry out virtual cpu allotment operation this moment, according to predefined allotment flow process, a current unappropriated virtual cpu or a plurality of virtual cpu in the resource pool with complete machine cabinet server (also claiming the residue virtual cpu) are distributed to this overloaded cpu virtual server.For example current 2 virtual cpus that are not yet assigned to arbitrary virtual server are allocated to the first virtual server and are used in the resource pool, to share the work on the first virtual server, improve treatment effeciency and speed, this moment, the first virtual server had 12 virtual cpus.As seen, adopt this technical scheme can further integrate the resource of complete machine cabinet server, improve substantially service processing efficient and the speed of complete machine cabinet server, be conducive to improve the stability of service.

In order further to improve the various dimensions of evaluation and test performance, can also be in each periodic monitor execution in step 302 rear further execution in step 3011: store current monitoring result.

And, in the rear execution in step 305 of step 3011: store current allotment result.

And when the result of determination when step 304 is no, and after step 305, go back execution in step 3051: the utilization factor monitoring of virtual cpu is finished, if do not finish, then returns step 301; Otherwise execution in step 306.

Step 306: according to virtual cpu allotment operation historical record, determine the resource allocation ability of complete machine cabinet server.

Therefore, adopt technique scheme can further determine tested complete machine cabinet server resource allotment ability, obtain the more performance information of various dimensions.

Need to prove, Fig. 3 only is the signal of the present embodiment flow process, wherein, arbitrary step that step 301-3051 can be after step 201 front or after.

Embodiment 4:

Referring to shown in Figure 4, after step 201, before step 202,203,204 the arbitrary step or afterwards, also further comprise

The complete machine cabinet server evaluating method of the present embodiment mainly comprises following flow process:

Step 401: periodicity or aperiodicity ground, the utilization factor of the virtual cpu of each virtual server and the utilization factor of virtual memory in the tested load unit of periodic monitor.

The utilization factor of the virtual memory of virtual server can but be not limited to adopt following sign: finish the constantly occupancy of the virtual memory of virtual server starting initialization, with the ratio value of the occupancy of current virtual memory in the virtual server.

Step 402: store current monitoring result.

Step 403: according to monitoring result: the utilization factor of the virtual cpu of each virtual server in the tested load unit, determine whether to exist internal memory overload virtual server, determine whether the overloaded cpu virtual server.

In the present embodiment, this internal memory overload virtual server is: the utilization factor of virtual memory is equal to or greater than the virtual server of the predetermined virtual memory utilization factor upper limit corresponding to virtual server;

The non-overload virtual server of internal memory is: the utilization factor of virtual memory is less than the virtual server of the predetermined virtual memory utilization factor upper limit corresponding to virtual server.

Wherein can be set to all virtual servers identical for the utilization factor upper limit of above-mentioned virtual memory, also can preset to be decided to be difference, and the virtual server that namely is respectively different is set the utilization factor upper limit of different virtual memorys.

Step 404: if there is the overloaded cpu virtual server, then execution in step 405; Otherwise execution in step 407 and do not carry out virtual memory allotment between virtual server.

Step 405: obtain the utilization factor of each virtual cpu of each virtual server according to monitoring, carry out the virtual cpu allotment.

Specifically can but be not limited to record referring to step 304 among the embodiment 2.

Step 306: store current allotment result.

Step 407: if there is internal memory overload virtual server, then execution in step 408; Otherwise execution in step 410 and do not carry out overloaded cpu virtual server allotment between virtual server.

Step 408: obtain the utilization factor of the virtual memory of each virtual server according to monitoring, carry out the virtual memory allotment.

Determining of the utilization factor of the virtual memory of each concrete virtual server, specifically can determine according to the scheme of the utilization factor of reference virtual cpu:

If have following virtual server in the tested load unit: the first mail server, the second mail server, the first web server, the second web server.

After each virtual server starts successfully, finish constantly (being the idle task load this moment) in the startup initialization, read initially value of taking of each virtual server virtual memory in the tested load unit, if the virtual memory that a certain virtual server is assigned with size is 1G, finish constantly initially value of taking 5% of in running order virtual memory in moving initialization.

(this moment, each virtual server was respectively according to call instruction after sending call instruction, carry out the corresponding task in the call instruction), the utilization factor of the virtual memory of each virtual server of periodic monitor, if current current value of taking that monitors the virtual memory of the first virtual server is: 98%, be limited to 80% on the utilization factor of the virtual memory of the first virtual server, then this moment, the first virtual server was: internal memory overload virtual server.

If the current total virtual memory of the second virtual server that monitors is 1G, the value of taking of current virtual memory is: 10%, be limited to 80% on the utilization factor of the virtual virtual memory of the second virtual server, then this moment, the second virtual server was: the non-overload virtual server of internal memory.

At this moment, can carry out following virtual memory allotment operation: according to predefined allotment flow process, with the current part that is not yet assigned to the virtual memory (claiming again the residue virtual memory) of arbitrary virtual server in the resource pool, distribute to current internal memory overload virtual server.For example the 200M of current unappropriated virtual memory in the resource pool can be distributed to above-mentioned internal memory overload virtual server: the first virtual server, to share the virtual memory load of the first virtual server, improve treatment effeciency and speed, this moment, the virtual memory of the first virtual server was 1.2G.

Therefore, the beneficial effect of the present embodiment in can obtaining embodiment 3, also because carry out dynamic virtual cpu allotment to the monitoring of virtual cpu and according to current monitoring outside, virtual memory to each virtual server in the load unit carries out dynamic monitoring and dynamically allotment, therefore can be further so that virtual resource utilized more fully, real simulation user's use scenes more is so that the result of evaluation and test is more accurate.

Step 409: store current allotment result.

Step 410: whether the utilization factor monitoring of virtual cpu and virtual memory is finished, if do not finish, then returns step 401; Otherwise execution in step 410.

Step 411: according to virtual cpu allotment operation historical record and virtual memory allotment operation historical record, determine the resource allocation ability of complete machine cabinet server.

Each when occurring that above-mentioned appearance is above-mentioned to exist overloaded cpu virtual server situation when each monitoring, all carry out the virtual cpu adjustment, occur above-mentionedly when having internal memory overload virtual server situation each, all carry out the virtual memory adjustment,

To sum up, adopt this technical scheme can further integrate the resource of complete machine cabinet server, dynamically improve substantially service processing efficient and the speed of complete machine cabinet server, be conducive to improve the stability of service.

The embodiment of the resource allocation ability of this complete machine cabinet server can be being deployed into power or allocating quality reaction virtual cpu and virtual memory.

Therefore, adopt technique scheme can further determine tested complete machine cabinet server resource allotment ability, obtain the more performance information of various dimensions.

Wherein, the resource pool in the various embodiments of the present invention is the set of various resources in the complete machine cabinet server, and this resource includes but not limited to virtual cpu and virtual memory.

When carrying out the deployment of virtual server, each virtual cpu in the resource pool and each virtual memory can be distributed to respectively each virtual server use.

The resource pool of complete machine cabinet server can be realized at a physical hardware, also can realize at a plurality of physical hardwares.

Embodiment 5:

Referring to shown in Figure 5, the difference of the present embodiment and embodiment 4 mainly is, go back the task operating of virtual server clone and deployment, virtual server dynamic migration, storage dynamic migration in the present embodiment, specifically after the step 204 in embodiment 1, also further comprise:

Step 501: send the framework call instruction to the framework manager.

Wherein each load unit in each load unit in framework manager and the tested complete machine cabinet server is connected respectively, be used in complete machine cabinet server, carrying out the operation of framework class: such as the clone of virtual server and deployment (comprising the setting of information and the network information), storage Data Migration between the storer that each virtual server is shared in the virtual server migration (virtualizing performance of the first virtual server is realized elsewhere), complete machine cabinet server etc.

In the framework call instruction, comprise: require the framework manager to the mission bit stream of the clone of the virtual server of appointment and deployment and require the framework manager to the mission bit stream of the migration of the virtual server of appointment and require the framework manager to the mission bit stream of the migration of the data at least two storeies of appointment.

For example: clone's virtual server is specially, create each virtual server in each load unit, as create each virtual server among the load unit N, clone's mail server is the first mail server N, the second mail server N, clone's standard server is standard server N, clone web database server is web database server N, clone's Web server is the first Web server N, the second Web server N, clone's electronic trade database server is electronic trade database server N, clone's electronic trade Web server is the first electronic trade Web server N, the second electronic trade Web server N, the 3rd electronic trade Web server N, its N represents 1,2,3,4......, after the clone is complete, carry out configuration information and set, namely dispose.

Step 502: obtain the framework manager to the framework result of virtual server.

The present embodiment specifically, obtain framework manager clone to the practical task execution result information of the task of the clone of virtual server and deployment, obtain the framework manager to the practical task execution result information of the mission bit stream of the migration of virtual server, obtain the framework manager to the practical task execution result information of the mission bit stream of the migration of the data on the storer.

Can determine that the framework manager is to the practical task execution result of each framework task by number of times and the time of carrying out above-mentioned framework operation in the present embodiment.

Step 503: to above-mentioned each practical task execution result information, determine the framework managerial ability of framework manager according to the framework manager.

Need to prove, in the present embodiment describing as example at the rear execution in step 501-503 of step 204, but be not limited to this, actual can be in the flow process of execution in step 501-503 before or after step 201 or the arbitrary step.

Therefore in embodiments of the present invention, because to the simulated operation of virtual server clone and deployment, virtual server dynamic migration, storage dynamic migration, use scenes that can the real simulation user is so that the result who evaluates and tests is more accurate.

In sum, the evaluating method of employing above-described embodiment can obtain the multidimensional performance of this complete machine cabinet server, and concrete sees table.

Table one: the performance parameter table of virtual server

The performance of above-mentioned each virtual server wherein, namely under the computing method of so-called relatively score shown in:

1: the total relative of each virtual server must be divided in the load unit 1 $\mathrm{\Σw}=\sqrt[7]{(c1*c2*c3*c5*c6*c7)}*y1;$

2: framework is relative must being divided into always $\mathrm{\Σi}=\sqrt[3]{(c8*c9*c10)}*y2;$

3: monitoring and resource dynamic allotment are total must to be divided into ∑ v=c11*y3 relatively;

4: cluster is relative must being divided into always $\mathrm{\Σc}=\sqrt[2]{(c11*c12)}*y4;$

The y1+y2+y3+y4=100% in above-mentioned 1,2,3,4 wherein;

5: the overall scores of load unit 1 is

$\mathrm{\Σ}1=\sqrt[7]{(c1*c2*c3*c5*c6*c7*)}*y1+\sqrt[3]{(c8*c9*c10)}*y2+c11*y3+\sqrt[2]{(c11*c12)}*y4;$

The overall scores of 6:N load unit is

$\mathrm{\Σ}1=\sqrt[7]{(c1*c2*c3*c5*c6*c7)}*y1+K\sqrt[7]{(\mathrm{cN}*\mathrm{cN}*\mathrm{cN}*\mathrm{cN}*\mathrm{cN}*\mathrm{cN})}*y1+\sqrt[3]{(c8*c9*c10)}*y2+$

$c11*y3+\sqrt[2]{(c11*c12)}*y4$

In Table 1, " reference value " specifically, by the theoretical value that this load server is calculated according to each payload traffic model, this theoretical reference value is the value that records under laboratory fc-specific test FC environment;

" actual score " in the above-mentioned table one specifically, the number of times of executing the task with each virtual server actual characterizes.

The first mail server in the upper table one, the second mail server, the first web server, the second web server, the first electronic trade web server, the second electronic trade web server, the 3rd electronic trade web server are actual virtual server;

Standard server in the upper table one is: the load virtual server of standard, and namely without the virtual server of any business load, purpose is the true use scenes of analog subscriber;

Framework operation in the upper table one comprises virtual server clone and deployment, virtual server dynamic migration, storage dynamic migration;

In the upper table one, server cluster comprises: mail server cluster and web server cluster;

Monitoring in the upper table one comprises the monitoring to monitoring and resource allocation server;

In the upper table two, y1, y2, y3, y4 are respectively percentages, and y1+y2+y3+y4=100%, and in the account form, the total relatively score of each virtual server, the total relatively score of framework operation total relatively score, monitoring and resource allocation, the total relatively score of cluster are got percent value again in the load unit, and purpose is that error of calculation rate is reduced as far as possible;

In the upper table one, the overall scores of each load unit is " total relatively score, framework of each virtual server always operates the total relatively score of relative score, monitoring and resource allocation, the total relatively score of cluster in the load unit " sum;

The overall scores of N load unit is " the total relatively score of total relatively score, framework operation total relatively score, monitoring and resource allocation, the total relatively score of cluster of each virtual server in each load unit " sum;

In the upper table one, the overall scores presentation format is: " X.X Y VMs (Partitions Z) ", wherein: X.X is a numerical value, the overall scores score value of N load unit of expression, and numerical value X.X is accurate to 1 of radix point; Y is illustrated in this load unit to be provided with several virtual servers, for example load unit is interior to be provided with N virtual server, Y=N*10+1 then, Vms is tag, the Z in " Partitions Z) " represents what subregions complete machine cabinet server has been divided and evaluated and tested.

As the achievement that comprises the load unit of 12 virtual servers is: 50.9@121VMs (Partitions2), wherein the complete machine cabinet at its place is that 2 subregions are evaluated and tested by Huawei.

When the physical cpu of complete machine cabinet and virtual memory resource were utilized fully, total performance of each load unit reached maximal value.

Embodiment 6:

Referring to shown in Figure 6, the present embodiment provides a kind of performance evaluating apparatus 600 of complete machine cabinet server, and it comprises: call instruction transmitting element 601, execution result determining unit 602, performance evaluating unit 603.Annexation and the principle of work of each several part are as follows:

Call instruction transmitting element 601, respectively with tested complete machine cabinet server in the north side load unit in each virtual server send server calls order.In the server calls order, comprise: the information that requires the task that each virtual server carries out respectively.Wherein, each load unit is corresponding one by one with each user respectively.

In the present embodiment, as a kind of optional technical scheme, this call instruction transmitting element 601, sends to respectively each virtual server with above-mentioned server calls order at concrete being used for according to the IP address of each virtual server or the domain name of each virtual server.Further can be referring to the record among the embodiment 2.

In the present embodiment, as a kind of optional technical scheme, when virtual server belongs to arbitrary server cluster, this call instruction transmitting element 601 specifically can be according to the domain name of floating IP address or each server cluster of each server cluster, respectively to each server cluster, send the server calls order, according to predetermined cluster balance policy, specify each virtual server to execute the task for each server cluster.Further can be referring to the record among the embodiment 2.

Execution result determining unit 602 is used for determining that each virtual server is to the actual execution result information of corresponding task after call instruction transmitting element 601 sends call instruction.

Performance evaluating unit 603 is connected with execution result determining unit 602, is used for according to the actual execution result information of virtual server to corresponding task, determines the performance of each virtual server in tested load unit and the tested load unit.

Correspondingly, if in this complete machine cabinet server, include server cluster, then above-mentioned performance evaluating unit 603 also is used for the actual execution result information to corresponding task according to virtual server in each server cluster, determines respectively the cluster performance of each server cluster.Further can be referring to the record among the embodiment 2.Complete machine cabinet server to the presence server cluster, in obtaining each load unit after the performance of each virtual server, also further according to the actual execution result information to corresponding task of each virtual server in each server cluster, further determine the cluster performance of each server cluster in the complete machine cabinet server, i.e. the cluster equalization performance.

Further principle of work can but be not limited to referring to embodiment 1,2 record.

Therefore, use the technical scheme among the present invention, the embodiment of the invention is when carrying out the performance evaluating of complete machine cabinet server, call instruction transmitting element 601 in the complete machine cabinet Server performance device of the present embodiment is in this complete machine cabinet server, with the user one to one each virtual server in the tested load unit send server calls order, after sending call instruction, execution result determining unit 602 determines that each virtual server is to calling the actual execution result information of the task in the order, performance evaluating unit 603 to calling the actual execution result information of the task in the order, obtains the performance of each load unit and the performance of each virtual server in each load unit according to each virtual server.

Because tested object is the load unit corresponding with the user in the present embodiment technical scheme, and when performance evaluating, simulate when the user uses to the mode that each virtual server in the load unit issues call instruction by test machine, the tasks carrying actual result of each virtual server in load unit corresponding to this user, the performance parameter that obtains according to the tasks carrying actual result of each virtual server in load unit corresponding to user more can reflect the reality of user's application scenarios, therefore the evaluation result that obtains is more accurate, more realistic application.

Embodiment 7:

Referring to shown in Figure 7, the performance evaluating apparatus 700 of the complete machine cabinet server that the present embodiment provides also comprises with respect to embodiment 6 evaluating apparatus:

The utilization factor determining unit 701 of virtual cpu is used for the utilization factor of the virtual cpu of each virtual server in the tested load unit of periodic monitor;

Virtual cpu deployment unit 702 is connected with the utilization factor determining unit 701 of virtual cpu, is used for the utilization factor according to each virtual cpu, and unappropriated at least one virtual cpu is distributed to the overloaded cpu virtual server in the resource pool with complete machine cabinet server,

Wherein, the overloaded cpu virtual server is: the utilization factor of virtual cpu is equal to or greater than the virtual server of the predetermined cpu busy percentage upper limit corresponding to virtual server; CPU is non-, and the overload virtual server is: the utilization factor of virtual cpu is less than the virtual server of the predetermined cpu busy percentage upper limit corresponding to virtual server.

Further principle of work can but be not limited to referring to the detailed description among the embodiment 3,4.

Therefore, adopt technique scheme can further determine tested complete machine cabinet server resource allotment ability, obtain the more performance information of various dimensions.

Embodiment 8:

Referring to shown in Figure 8, the performance evaluating apparatus 800 of the complete machine cabinet server that the present embodiment provides also comprises with respect to embodiment 7 evaluating apparatus:

The utilization factor determining unit 801 of virtual memory is used for the utilization factor of the virtual memory of each virtual server in the tested load unit of periodic monitor.

Virtual memory deployment unit 802, connect with the utilization factor determining unit 801 of virtual memory, be used for the utilization factor according to each virtual memory, with the part of current unappropriated virtual memory in the resource pool of complete machine cabinet server, distribute to current internal memory overload virtual server.

Wherein, internal memory overload virtual server is: the utilization factor of virtual memory is equal to or greater than the virtual server of the predetermined virtual memory utilization factor upper limit corresponding to virtual server; The non-overload virtual server of internal memory is: the utilization factor of virtual memory is less than the virtual server of the predetermined virtual memory utilization factor upper limit corresponding to virtual server.

Performance evaluating unit 803 also is connected respectively with virtual cpu deployment unit, virtual memory deployment unit 802, also is used for determining the resource allocation ability of complete machine cabinet server according to virtual cpu allotment operation historical record and virtual memory allotment operation historical record.

Further principle of work can but be not limited to referring to the detailed description among the embodiment 4.

Therefore, adopt technique scheme can further determine tested complete machine cabinet server resource allotment ability, obtain the more performance information of various dimensions.

Embodiment 9:

Referring to shown in Figure 9, the performance evaluating apparatus 900 of the complete machine cabinet server that the present embodiment provides mainly is with respect to embodiment 8 evaluating apparatus institute difference:

Call instruction transmitting element 901 in the performance evaluating apparatus of the complete machine cabinet server of the present embodiment also is used for sending the framework call instruction to the framework manager of complete machine cabinet server.

In the framework call instruction, comprise: require the framework manager to the mission bit stream of the clone of the virtual server of appointment and deployment and require the framework manager to the mission bit stream of the migration of the virtual server of appointment and require the framework manager to the mission bit stream of the migration of the data at least two storeies of appointment, wherein each storer is connected with each virtual server respectively, and wherein the framework manager is connected respectively with all load units;

The performance evaluating apparatus of the complete machine cabinet server of the present embodiment also comprises:

Framework manager information determining unit 902 is used for obtaining the following information of framework manager: to the practical task execution result information of the task of the clone of virtual server and deployment, to the practical task execution result information of the mission bit stream of the migration of virtual server, to the practical task execution result information of the mission bit stream of the migration of the data on the storer;

The performance evaluating unit 603 of the performance evaluating apparatus of the complete machine cabinet server of the present embodiment also is connected with framework manager information determining unit 902, also be used for each the practical task execution result information according to the framework manager, determine the framework managerial ability of framework manager.

More detailed principle of work can but be not limited to record referring to embodiment 5.

Therefore in embodiments of the present invention, because to the simulated operation of virtual server clone and deployment, virtual server dynamic migration, storage dynamic migration, use scenes that can the real simulation user is so that the result who evaluates and tests is more accurate.

Embodiment 10:

Referring to shown in Figure 10, it mainly comprises the complete machine cabinet server that the present embodiment provides: main test cell 101 and at least one the auxiliary test cell 102 that is connected with main test cell 101.

Main test cell 101 is mainly pressure test control master unit, is used for the configuration testing parameter, the control and management test process.Auxiliary test cell 102 is the unit of exerting pressure of simulation client terminal access behavior.

Main test cell 101 comprises: the first configuration information obtains subelement 1011, the first call instruction sends subelement 1012, the first execution result determining unit 1013, the first storing sub-units 1014 and determination of property parameter unit 1015.

Auxiliary test cell 102 comprises: the second configuration information obtains subelement 1021, the second call instruction sends subelement 1022, the second execution result determining unit 1023 and the second storing sub-units 1024.

Each modular construction and principle of work in the auxiliary test cell 102 are as follows:

The second configuration information obtains subelement 1021, be used for the control according to the call instruction of master controller, obtain the configuration information of each virtual server in the tested load unit that is connected with auxiliary test cell 102, the configuration information of each virtual server is stored to the second storing sub-units 1024, and configuration information comprises: the routing information of each virtual server;

The second call instruction sends subelement 1022, obtain subelement 1021 with the second configuration information respectively, tested load unit is connected, be used for the control according to the call instruction of master controller, each virtual server in load unit sends the server calls order, in the server calls order, comprise: the information that requires the task that each virtual server carries out respectively

The second execution result determining unit 1023 is used for obtaining each virtual server to the actual execution result information of corresponding task.

The second storing sub-units 1024 is used for storage information, and information includes but not limited to: the configuration information of each virtual server and each virtual server are to the actual execution result information of corresponding task.

Structure in the main test cell 101 is as follows:

The first configuration information obtains subelement 1011, be used for obtaining the configuration information of each virtual server in complete machine cabinet server and the tested load unit that described main tester is connected, configuration information is stored to the first storing sub-units 1014 in the main test cell 101, and the configuration information of virtual server comprises but is not limited to: the routing information of each virtual server.

The first call instruction sends subelement 1012, obtain subelement 1011 with the first configuration information respectively, and tested load unit is connected, send server calls order for each virtual server in tested load unit, in the server calls order, comprise: the information that requires the task that each virtual server carries out respectively, wherein, each load unit is corresponding one by one with each user respectively, and first call instruction send subelement 1012 and also be used for sending the subtest call instructions to each auxiliary test cell 102, each virtual server in the tested load unit that connects to auxiliary test cell 102 according to the subtest call instruction for auxiliary test cell 102 sends server calls order.

The first execution result determining unit 1013 is used for obtaining each virtual server to the actual execution result information of corresponding task and the execution result information to the subtest call instruction of obtaining each auxiliary test cell 102.

The first storing sub-units 1014, be used for storage information, information includes but not limited to: the configuration information of each virtual server and each tested virtual server are to the actual execution result information of corresponding task and the execution result information to the subtest call instruction of each auxiliary test cell 102.

Determination of property parameter unit 1015, be connected with the second storing sub-units 1024 in the first storing sub-units 1014, the auxiliary test machine respectively, be used for the data according to the first storing sub-units 1014 and each the second storing sub-units 1024, according to the actual execution result information of each virtual server in each tested load unit to corresponding task, determine the performance of each load unit and each virtual server, and, according to the execution result information to the subtest call instruction of each auxiliary test cell 102, determine the performance of auxiliary test cell 102.

Therefore, the present embodiment is except having embodiment 1, outside the beneficial effect in 6, because the performance evaluating apparatus of the complete machine cabinet server during this has been implemented is divided into a main test cell 101 and a plurality of attached test cell, when using, can improve testing efficiency by coordinated management control, and can be when arbitrary test cell breaks down, by the alternative function of having served as of other test cells (main test cell 101 or attached test cell), execution is to the test of tested load unit, so that the robustness of complete machine cabinet Server performance device more.

Embodiment 11:

Embodiment 11:

Referring to shown in Figure 11, the present embodiment provides a kind of performance evaluating apparatus 110 of complete machine cabinet server, and it comprises: call instruction transmitter 1101, execution result determiner 1102, performance evaluating device 1103.Annexation and the principle of work of each several part are as follows:

Call instruction transmitter 1101, respectively with tested complete machine cabinet server in north side load device in each virtual server send server calls order.In the server calls order, comprise: the information that requires the task that each virtual server carries out respectively.Wherein, each load device is corresponding one by one with each user respectively.

In the present embodiment, as a kind of optional technical scheme, this call instruction transmitter 1101, sends to respectively each virtual server with above-mentioned server calls order at concrete being used for according to the IP address of each virtual server or the domain name of each virtual server.Further can be referring to the record among the embodiment 2.

In the present embodiment, as a kind of optional technical scheme, when virtual server belongs to arbitrary server cluster, this call instruction transmitter 1101 specifically can be according to the domain name of floating IP address or each server cluster of each server cluster, respectively to each server cluster, send the server calls order, according to predetermined cluster balance policy, specify each virtual server to execute the task for each server cluster.Further can be referring to the record among the embodiment 2.

Execution result determiner 1102 is used for determining that each virtual server is to the actual execution result information of corresponding task after call instruction transmitter 1101 sends call instruction.

Performance evaluating device 1103 is connected with execution result determiner 1102, is used for according to the actual execution result information of virtual server to corresponding task, determines the performance of each virtual server in tested load device and the tested load device.

Correspondingly, if in this complete machine cabinet server, include server cluster, then above-mentioned performance evaluating device 1103 also is used for the actual execution result information to corresponding task according to virtual server in each server cluster, determines respectively the cluster performance of each server cluster.Further can be referring to the record among the embodiment 2.Complete machine cabinet server to the presence server cluster, in obtaining each load device after the performance of each virtual server, also further according to the actual execution result information to corresponding task of each virtual server in each server cluster, further determine the cluster performance of each server cluster in the complete machine cabinet server, i.e. the cluster equalization performance.

Further principle of work can but be not limited to referring to embodiment 1,2 record.

Therefore, use the technical scheme among the present invention, the embodiment of the invention is when carrying out the performance evaluating of complete machine cabinet server, call instruction transmitter 1101 in the complete machine cabinet Server performance device of the present embodiment is in this complete machine cabinet server, with the user one to one each virtual server in the tested load device send server calls order, after sending call instruction, execution result determiner 1102 determines that each virtual server is to calling the actual execution result information of the task in the order, performance evaluating device 1103 to calling the actual execution result information of the task in the order, obtains the performance of each load device and the performance of each virtual server in each load device according to each virtual server.

Because tested object is the load device corresponding with the user in the present embodiment technical scheme, and when performance evaluating, simulate when the user uses to the mode that each virtual server in the load device issues call instruction by test machine, the tasks carrying actual result of each virtual server in load device corresponding to this user, the performance parameter that obtains according to the tasks carrying actual result of each virtual server in load device corresponding to user more can reflect the reality of user's application scenarios, therefore the evaluation result that obtains is more accurate, more realistic application.

Embodiment 12:

Referring to shown in Figure 12, the performance evaluating apparatus 120 of the complete machine cabinet server that the present embodiment provides also comprises with respect to embodiment 11 evaluating apparatus:

The utilization factor determiner 1201 of virtual cpu is used for the utilization factor of the virtual cpu of each virtual server in the tested load device of periodic monitor;

Virtual cpu tuner 1202 is connected with the utilization factor determiner 1201 of virtual cpu, is used for the utilization factor according to each virtual cpu, and unappropriated at least one virtual cpu is distributed to the overloaded cpu virtual server in the resource pool with complete machine cabinet server,

Wherein, the overloaded cpu virtual server is: the utilization factor of virtual cpu is equal to or greater than the virtual server of the predetermined cpu busy percentage upper limit corresponding to virtual server; CPU is non-, and the overload virtual server is: the utilization factor of virtual cpu is less than the virtual server of the predetermined cpu busy percentage upper limit corresponding to virtual server.

Further principle of work can but be not limited to referring to the detailed description among the embodiment 3,4.

Therefore, adopt technique scheme can further determine tested complete machine cabinet server resource allotment ability, obtain the more performance information of various dimensions.

Embodiment 13:

Referring to shown in Figure 13, the performance evaluating apparatus 130 of the complete machine cabinet server that the present embodiment provides also comprises with respect to embodiment 12 evaluating apparatus:

The utilization factor determiner 1301 of virtual memory is used for the utilization factor of the virtual memory of each virtual server in the tested load device of periodic monitor.

Virtual memory tuner 1302, connect with the utilization factor determiner 1301 of virtual memory, be used for the utilization factor according to each virtual memory, with the part of current unappropriated virtual memory in the resource pool of complete machine cabinet server, distribute to current internal memory overload virtual server.

Wherein, internal memory overload virtual server is: the utilization factor of virtual memory is equal to or greater than the virtual server of the predetermined virtual memory utilization factor upper limit corresponding to virtual server; The non-overload virtual server of internal memory is: the utilization factor of virtual memory is less than the virtual server of the predetermined virtual memory utilization factor upper limit corresponding to virtual server.

Performance evaluating device 1303 also is connected respectively with virtual cpu tuner, virtual memory tuner 1302, also is used for determining the resource allocation ability of complete machine cabinet server according to virtual cpu allotment operation historical record and virtual memory allotment operation historical record.

Further principle of work can but be not limited to referring to the detailed description among the embodiment 4.

Therefore, adopt technique scheme can further determine tested complete machine cabinet server resource allotment ability, obtain the more performance information of various dimensions.

Embodiment 14:

Referring to shown in Figure 14, the performance evaluating apparatus 140 of the complete machine cabinet server that the present embodiment provides mainly is with respect to embodiment 13 evaluating apparatus institute difference:

Call instruction transmitter 1401 in the performance evaluating apparatus of the complete machine cabinet server of the present embodiment also is used for sending the framework call instruction to the framework manager of complete machine cabinet server.

In the framework call instruction, comprise: require the framework manager to the mission bit stream of the clone of the virtual server of appointment and deployment and require the framework manager to the mission bit stream of the migration of the virtual server of appointment and require the framework manager to the mission bit stream of the migration of the data at least two storeies of appointment, wherein each storer is connected with each virtual server respectively, and wherein the framework manager is connected respectively with all load devices;

The performance evaluating apparatus of the complete machine cabinet server of the present embodiment also comprises:

Framework manager information determiner 1402 is used for obtaining the following information of framework manager: to the practical task execution result information of the task of the clone of virtual server and deployment, to the practical task execution result information of the mission bit stream of the migration of virtual server, to the practical task execution result information of the mission bit stream of the migration of the data on the storer;

The performance evaluating device 1103 of the performance evaluating apparatus of the complete machine cabinet server of the present embodiment also is connected with framework manager information determiner 1402, also be used for each the practical task execution result information according to the framework manager, determine the framework managerial ability of framework manager.

More detailed principle of work can but be not limited to record referring to embodiment 5.

Therefore in embodiments of the present invention, because to the simulated operation of virtual server clone and deployment, virtual server dynamic migration, storage dynamic migration, use scenes that can the real simulation user is so that the result who evaluates and tests is more accurate.

Embodiment 15:

Referring to shown in Figure 15, it mainly comprises the complete machine cabinet server that the present embodiment provides: main tester 151 and at least one the auxiliary tester 152 that is connected with main tester 151.

Main tester 151 is mainly pressure test and controls main device, is used for the configuration testing parameter, the control and management test process.Auxiliary tester 152 is the pressure applicator of simulation client terminal access behavior.

Main tester 151 comprises: the first configuration information getter 15011, the first call instruction transmitter 15012, the first execution result determiner 15013, first memory 15014 and determination of property parameter device 15015.

Auxiliary tester 152 comprises: the second configuration information getter 15021, the second call instruction transmitter 15022, the second execution result determiner 15023 and second memory 15024.

Each modular construction and principle of work in the auxiliary tester 152 are as follows:

The second configuration information getter 15021, be used for the control according to the call instruction of master controller, obtain with tested load device that auxiliary tester 152 is connected in the configuration information of each virtual server, the configuration information of each virtual server is stored to second memory 15024, and configuration information comprises: the routing information of each virtual server;

The second call instruction transmitter 15022, be connected with the second configuration information getter 15021, tested load device respectively, be used for the control according to the call instruction of master controller, each virtual server in the load device sends the server calls order, in the server calls order, comprise: the information that requires the task that each virtual server carries out respectively

The second execution result determiner 15023 is used for obtaining each virtual server to the actual execution result information of corresponding task.

Second memory 15024 is used for storage information, and information includes but not limited to: the configuration information of each virtual server and each virtual server are to the actual execution result information of corresponding task.

Structure in the main tester 151 is as follows:

The first configuration information getter 15011, be used for obtaining the configuration information of each virtual server in complete machine cabinet server and the tested load device that described main tester is connected, configuration information is stored to first memory 15014 in the main tester 151, and the configuration information of virtual server comprises but is not limited to: the routing information of each virtual server.

The first call instruction transmitter 15012, respectively with the first configuration information getter 15011, and tested load device is connected, send server calls order for each virtual server in tested load device, in the server calls order, comprise: the information that requires the task that each virtual server carries out respectively, wherein, each load device is corresponding one by one with each user respectively, and first call instruction transmitter 15012 also be used for sending the subtest call instructions to each auxiliary tester 152, each virtual server in the tested load device that connects to auxiliary tester 152 according to the subtest call instruction for auxiliary tester 152 sends server calls order.

The first execution result determiner 15013 is used for obtaining each virtual server to the actual execution result information of corresponding task and the execution result information to the subtest call instruction of obtaining each auxiliary tester 152.

First memory 15014, be used for storage information, information includes but not limited to: the configuration information of each virtual server and each tested virtual server are to the actual execution result information of corresponding task and the execution result information to the subtest call instruction of each auxiliary tester 152.

Determination of property parameter device 15015, be connected with second memory 15024 in first memory 15014, the auxiliary test machine respectively, be used for the data according to first memory 15014 and each second memory 15024, according to the actual execution result information of each virtual server in each tested load device to corresponding task, determine the performance of each load device and each virtual server, and, according to the execution result information to the subtest call instruction of each auxiliary tester 152, determine the performance of auxiliary tester 152.

Therefore, the beneficial effect of the present embodiment in having embodiment 1,6, because the performance evaluating apparatus of the complete machine cabinet server during this has been implemented is divided into a main tester 151 and a plurality of attached tester, when using, can improve testing efficiency by coordinated management control, and can be when arbitrary tester breaks down, by the alternative function of having served as of other testers (main tester 151 or attached tester), execution is to the test of tested load device, so that the robustness of complete machine cabinet Server performance device more.

Need to prove, in each embodiment of the present invention, tested complete machine cabinet server can be various complete machine cabinet servers, for example can for the complete machine cabinet server of supporting subregion also can be for not supporting the complete machine cabinet server of subregion.

Such as, when tested complete machine cabinet server is supported subregion, usually, can be by the server admin instrument when practical application, needs according to the user are divided into N subregion with complete machine cabinet server logic, at each subregion virtual server are set, and each virtual server is provided services on the Internet to the user respectively independently, one of them virtual server can be provided services on the Internet to a user, also can provide services on the Internet to a plurality of users respectively.In this complete machine cabinet server, the storage resources between each virtual server is shared mutually;

More specifically, when if this complete machine cabinet server is supported subregion, such as when the subregion number N=1, in the present embodiment can be with jointly being divided in this subregion of all virtual servers, specifically the virtual cpu that each virtual server is corresponding with and corresponding virtual memory all be divided in this subregion.And, storer can also be divided into n logical storage (n〉1), and the subregion that n logical storage be virtualized all virtual servers is set shares;

When subregion number N ≠ 1, in in the present embodiment can N the subregion of average division with all virtual servers, specifically be virtual cpu that each virtual server is corresponding with and corresponding virtual memory on average divide in N the subregion, and, storage is divided into n logical storage (n=N), and it is shared by N subregion that n logical storage is set.

Such as, when tested object complete machine cabinet server is supported not subregion, can regard complete machine cabinet server as traditional server and evaluate and test, storage is divided into n logical storage (n 〉=3), wherein 1 logical storage is used for virtual platform, and (n-1) individual logical storage configuration is shared.

Device embodiment described above only is schematic, wherein said unit as the separating component explanation can or can not be physically to separate also, the parts that show as the unit can be or can not be physical locations also, namely can be positioned at a place, perhaps also can be distributed on a plurality of network element.Can select according to the actual needs wherein some or all of module to realize the purpose of the present embodiment scheme.Those of ordinary skills namely can understand and implement in the situation that do not pay performing creative labour.

Through the above description of the embodiments, those skilled in the art can be well understood to each embodiment and can realize by the mode that software adds essential general hardware platform, can certainly pass through hardware.Based on such understanding, the part that technique scheme contributes to prior art in essence in other words can embody with the form of software product, this computer software product can be stored in the computer-readable recording medium, such as ROM/RAM, magnetic disc, CD etc., comprise that some instructions are with so that a computer installation (can be personal computer, server, perhaps network equipment etc.) carry out some Part Methods of each embodiment or embodiment.

Above embodiment does not consist of the restriction to this technical scheme protection domain.Any at above-mentioned embodiment spirit and principle within do modification, be equal to and replace and improvement etc., all should be included within the protection domain of this technical scheme.

Claims (25)

1. the performance evaluation methodology of a complete machine cabinet server is characterized in that, comprising:

Each virtual server in the tested complete machine cabinet server in arbitrary load unit sends server calls order,

Described server calls order comprises: require the information of the task that each described virtual server carries out respectively,

Wherein, each described load unit is corresponding one by one with each user respectively;

Obtain each described virtual server to the actual execution result information of described task,

According to the actual execution result information to each described task, determine the performance of described load unit and each described virtual server.

2. the performance evaluation methodology of described a kind of complete machine cabinet server according to claim 1 is characterized in that,

Described virtual server comprises the actual execution result information of described task: actual execution number of times and the execution time of carrying out described task.

3. the performance evaluation methodology of described a kind of complete machine cabinet server according to claim 1 and 2 is characterized in that,

Step: each virtual server in the tested complete machine cabinet server in arbitrary load unit sends server calls order, specifically:

According to the IP address of each described virtual server or the domain name of each described virtual server, described server calls order is sent to respectively each described virtual server in the described load unit.

4. the performance evaluation methodology of described a kind of complete machine cabinet server according to claim 1 and 2 is characterized in that,

Described load unit comprises: at least one server cluster, each described server cluster respectively by: at least two described virtual servers form;

When described virtual server belonged to arbitrary described server cluster, step: each virtual server in the tested complete machine cabinet server in arbitrary load unit sent server calls order, specifically:

Domain name according to floating IP address or each described server cluster of each described server cluster respectively to each described server cluster, sends described server calls order,

According to predetermined cluster balance policy, specify each described virtual server to carry out described task for described server cluster;

In step: obtain after the actual execution result information of each described virtual server to described task, also comprise:

According to the actual execution result information to described task of described virtual server in each server cluster, determine respectively the cluster performance of each described server cluster.

5. the performance evaluation methodology of described a kind of complete machine cabinet server according to claim 4 is characterized in that,

Described server cluster is: be used for the mail server cluster that provides the described virtual server of mail service to form to described user by at least two;

Perhaps, described server cluster is: be used for the web server cluster that provides the described virtual server of Web service to form to described user by at least two.

6. the performance evaluation methodology of described a kind of complete machine cabinet server according to claim 1 is characterized in that,

In step: each virtual server in tested complete machine cabinet server in arbitrary load unit sends after server calls order, also comprises:

The utilization factor of the virtual cpu of each described virtual server in the described load unit of periodic monitor,

If the current overloaded cpu virtual server that exists is then further:

According to the utilization factor of each described virtual cpu, unappropriated at least one virtual cpu in the resource pool with described complete machine cabinet server is distributed to described overloaded cpu virtual server,

Wherein, described overloaded cpu virtual server is: the utilization factor of described virtual cpu is equal to or greater than the virtual server of the predetermined cpu busy percentage upper limit corresponding to described virtual server;

And/or in step: each virtual server in tested complete machine cabinet server in arbitrary load unit sends after server calls order, also comprises:

The utilization factor of the virtual memory of each described virtual server in the described load unit of periodic monitor,

If the current internal memory overload virtual server that exists is then further:

According to the utilization factor of each described virtual memory, with the part of unappropriated virtual memory in the described resource pool, distribute to described internal memory overload virtual server,

Wherein, described internal memory overload virtual server is: the utilization factor of described virtual memory is equal to or greater than the virtual server of the predetermined virtual memory utilization factor upper limit corresponding to described virtual server.

7. the performance evaluation methodology of described a kind of complete machine cabinet server according to claim 6 is characterized in that,

In step: according to the utilization factor of each described virtual cpu, unappropriated at least one virtual cpu in the resource pool with described complete machine cabinet server is distributed to after the described overloaded cpu virtual server,

And/or, in step: according to the utilization factor of each described virtual memory, with the part of unappropriated virtual memory in the described resource pool, distribute to after the described internal memory overload virtual server, also comprise:

Historical record according to the batch operation of described virtual cpu, and/or, according to the historical record of the batch operation of described virtual memory, determine the resource allocation ability of described complete machine cabinet server, described resource comprises: the arbitrary or combination of described virtual cpu, virtual memory.

8. the performance evaluation methodology of described a kind of complete machine cabinet server according to claim 6 is characterized in that,

The utilization factor of the virtual cpu of each described virtual server is respectively:

Start initialization finish described virtual server constantly described virtual cpu take quantity, with the ratio value that takies quantity of the current described virtual cpu of described virtual server;

The utilization factor of the virtual memory of each described virtual server is respectively:

Finish the constantly occupancy of the described virtual memory of described virtual server starting initialization, with the ratio value of the occupancy of the current virtual memory of described virtual server.

9. the performance evaluation methodology of a kind of complete machine cabinet server according to claim 1 and 2 is characterized in that,

In step: obtain after the actual execution result information of each described virtual server to described task, also comprise:

Store the performance of described load unit and each described virtual server, for the performance according to all described load units and all described virtual servers, determine the combination property of described complete machine cabinet server.

10. the performance evaluation methodology of a kind of complete machine cabinet server according to claim 1 and 2 is characterized in that, also comprises:

Send the framework call instruction to the framework manager, in described framework call instruction, comprise: require described framework manager to the mission bit stream of the clone of the described virtual server of appointment and deployment and require described framework manager to the mission bit stream of the migration of the described virtual server of appointment and require described framework manager to the mission bit stream of the migration of the data at least two described storeies of appointment, wherein each described storer is connected with each described virtual server respectively

Obtain described framework manager to the practical task execution result information of the task of the clone of described virtual server and deployment,

Obtain described framework manager to the practical task execution result information of the mission bit stream of the migration of described virtual server,

Obtain described framework manager to the practical task execution result information of the mission bit stream of the migration of the data on the described storer,

According to each described practical task execution result information, determine the framework managerial ability of described framework manager;

Wherein said framework manager is connected respectively with all described load units.

11. the performance evaluating apparatus of a complete machine cabinet server is characterized in that, comprising:

The call instruction transmitting element sends server calls order for each virtual server in the arbitrary load unit of tested complete machine cabinet server,,

Described server calls order comprises: require the information of the task that each described virtual server carries out respectively,

Wherein, each described load unit is corresponding one by one with each user respectively;

The execution result determining unit is used for obtaining each described virtual server to the actual execution result information of described task;

The performance evaluating unit is connected with described execution result determining unit, is used for determining the performance of described load unit and each described virtual server according to the actual execution result information to each described task.

12. the performance evaluating apparatus of complete machine cabinet server according to claim 11 is characterized in that,

Described call instruction transmitting element, sends to respectively each described virtual server with described server calls order at concrete being used for according to the IP address of each described virtual server or the domain name of each described virtual server.

13. the performance evaluating apparatus of complete machine cabinet server according to claim 11 is characterized in that,

Described call instruction transmitting element, specifically also be used for: when described virtual server belongs to arbitrary described server cluster, according to the domain name of floating IP address or each described server cluster of each described server cluster, respectively to each described server cluster, send described server calls order

According to predetermined cluster balance policy, specify each described virtual server to carry out described task for described server cluster;

Described performance evaluating unit also is used for the actual execution result information to described task according to described virtual server in each server cluster, determines respectively the cluster performance of each described server cluster.

14. the performance evaluating apparatus of complete machine cabinet server according to claim 11 is characterized in that, also comprises:

The utilization factor determining unit of virtual cpu is used for the utilization factor of the virtual cpu of each described virtual server in the described load unit of periodic monitor;

The virtual cpu deployment unit, be connected with the utilization factor determining unit of described virtual cpu, be used for the utilization factor according to each described virtual cpu, unappropriated at least one virtual cpu in the resource pool with described complete machine cabinet server, distribute to described overloaded cpu virtual server

Wherein, described overloaded cpu virtual server is: the utilization factor of described virtual cpu is equal to or greater than the virtual server of the predetermined cpu busy percentage upper limit corresponding to described virtual server.

15. the performance evaluating apparatus of complete machine cabinet server according to claim 14 is characterized in that, also comprises:

The utilization factor determining unit of virtual memory is used for the utilization factor of the virtual memory of each described virtual server in the described load unit of periodic monitor;

The virtual memory deployment unit connects with the utilization factor determining unit of described virtual memory, is used for the utilization factor according to each described virtual memory, with the part of unappropriated virtual memory in the described resource pool, distributes to described internal memory overload virtual server,

Wherein, described internal memory overload virtual server is: the utilization factor of described virtual memory is equal to or greater than the virtual server of the predetermined virtual memory utilization factor upper limit corresponding to described virtual server.

16. the performance evaluating apparatus of complete machine cabinet server according to claim 15 is characterized in that,

Described performance evaluating unit, also be connected respectively with described virtual cpu deployment unit, virtual memory deployment unit, also be used for the historical record according to the batch operation of described virtual cpu, and/or, historical record according to the batch operation of described virtual memory, determine the resource allocation ability of described complete machine cabinet server, described resource comprises: the arbitrary or combination of described virtual cpu, virtual memory.

17. to the performance evaluating apparatus of 16 arbitrary described complete machine cabinet server, it is characterized in that according to claim 11,

Described call instruction unit, also be used for sending the framework call instruction to the framework manager of described complete machine cabinet server, in described framework call instruction, comprise: require described framework manager to the clone of the described virtual server of appointment and the mission bit stream of deployment, and require described framework manager to the mission bit stream of the migration of the described virtual server of appointment, and require described framework manager to the mission bit stream of the migration of the data at least two described storeies of appointment, wherein each described storer is connected with each described virtual server respectively, and wherein said framework manager is connected respectively with all described load units;

Framework manager information determining unit is used for obtaining the following information of described framework manager: to the practical task execution result information of the task of the clone of described virtual server and deployment, to the practical task execution result information of the mission bit stream of the migration of described virtual server, to the practical task execution result information of the mission bit stream of the migration of the data on the described storer;

Described performance evaluating unit also is connected with described framework manager information determining unit, is used for according to each described practical task execution result information, determines the framework managerial ability of described framework manager.

18. the performance evaluating apparatus of a complete machine cabinet server is characterized in that, comprising:

Main test cell and at least one the auxiliary test cell that is connected with described main test cell;

Described main test cell comprises: the first configuration information obtains subelement, the first call instruction sends subelement, execution result determining unit, the first storing sub-units and determination of property parameter subelement,

Described the first configuration information obtains subelement, be used for obtaining the configuration information of each virtual server in tested complete machine cabinet server and the described load unit that described main test cell is connected, described configuration information is stored to described the first storing sub-units, and the configuration information of described virtual server comprises: the routing information of each described virtual server;

Described the first call instruction sends subelement, obtain subelement with described the first configuration information respectively, described load unit is connected, send server calls order for each the described virtual server in described load unit, described server calls order comprises: the information that requires the task that each described virtual server carries out respectively, wherein, each described load unit is corresponding one by one with each user respectively, and

Be used for sending the subtest call instruction to each described auxiliary test cell, send call instruction according to described call instruction to each described load unit that described auxiliary test cell connects for described auxiliary test cell;

The first execution result determining unit is used for obtaining each described virtual server to the actual execution result information of described task and the execution result information to described subtest call instruction of obtaining described auxiliary test cell;

Described the first storing sub-units, be used for storage information, described information comprises: the configuration information of each described virtual server and each described virtual server are to the actual execution result information of described task and the execution result information to described subtest call instruction of described auxiliary test cell;

Described determination of property parameter subelement, respectively with described the first storing sub-units, described the second storing sub-units in the described auxiliary test machine is connected, be used for the data according to described the first storing sub-units and each described the second storing sub-units, according to the actual execution result information of each the described virtual server in each described load unit to each described task, determine the performance of each described load unit and each described virtual server, according to the execution result information to described subtest call instruction of each described auxiliary test cell, determine the performance of described auxiliary test cell;

Described auxiliary test cell is the unit of exerting pressure of simulation client terminal access behavior,

Described auxiliary test cell comprises: the second configuration information obtains subelement, the second call instruction sends subelement, the second execution result determining unit and the second storing sub-units;

Described the second configuration information obtains subelement, be used for the control according to the call instruction of described master controller, obtain the configuration information of each described virtual server in the described load unit that is connected with described auxiliary test cell, the configuration information of described each described virtual server is stored to described the second storing sub-units, and described configuration information comprises: the routing information of each described virtual server;

Described the second call instruction sends subelement, obtain subelement with described the second configuration information respectively, described load unit is connected, be used for the control according to the call instruction of described master controller, each described virtual server in described load unit sends the server calls order, described server calls order comprises: the information that requires the task that each described virtual server carries out respectively

The second execution result determining unit is used for obtaining each described virtual server to the actual execution result information of described task;

Described the second storing sub-units is used for storage information, and described information comprises: the configuration information of each described virtual server and each described virtual server are to the actual execution result information of described task.

19. the performance evaluating apparatus of a complete machine cabinet server is characterized in that, comprising:

The call instruction transmitter sends server calls order for each virtual server in the arbitrary load unit of tested complete machine cabinet server,

Described server calls order comprises: require the information of the task that each described virtual server carries out respectively,

Wherein, each described load device is corresponding one by one with each user respectively;

The execution result determiner is used for obtaining each described virtual server to the actual execution result information of described task;

The performance evaluating device is connected with described execution result determiner, is used for determining the performance of described load device and each described virtual server according to the actual execution result information to each described task.

20. the performance evaluating apparatus of complete machine cabinet server according to claim 19 is characterized in that,

Described call instruction transmitter, specifically also be used for: when described virtual server belongs to arbitrary described server cluster, according to the domain name of floating IP address or each described server cluster of each described server cluster, respectively to each described server cluster, send described server calls order

According to predetermined cluster balance policy, specify each described virtual server to carry out described task for described server cluster;

Described performance evaluating device also is used for the actual execution result information to described task according to described virtual server in each server cluster, determines respectively the cluster performance of each described server cluster.

21. the performance evaluating apparatus of complete machine cabinet server according to claim 19 is characterized in that, also comprises:

The utilization factor determiner of virtual cpu is used for the utilization factor of the virtual cpu of each described virtual server in the described load device of periodic monitor;

The virtual cpu tuner is connected with the utilization factor determiner of described virtual cpu, is used for the utilization factor according to each described virtual cpu, and unappropriated at least one virtual cpu in the resource pool with described complete machine cabinet server is distributed to described overloaded cpu virtual server,

Wherein, described overloaded cpu virtual server is: the utilization factor of described virtual cpu is equal to or greater than the virtual server of the predetermined cpu busy percentage upper limit corresponding to described virtual server.

22. the performance evaluating apparatus of complete machine cabinet server according to claim 21 is characterized in that, also comprises:

The utilization factor determiner of virtual memory is used for the utilization factor of the virtual memory of each described virtual server in the described load device of periodic monitor;

The virtual memory tuner connects with the utilization factor determiner of described virtual memory, is used for the utilization factor according to each described virtual memory, with the part of unappropriated virtual memory in the described resource pool, distributes to described internal memory overload virtual server,

Wherein, described internal memory overload virtual server is: the utilization factor of described virtual memory is equal to or greater than the virtual server of the predetermined virtual memory utilization factor upper limit corresponding to described virtual server.

23. the performance evaluating apparatus of complete machine cabinet server according to claim 22 is characterized in that,

Described performance evaluating device, also be connected respectively with described virtual cpu tuner, virtual memory tuner, also be used for the historical record according to the batch operation of described virtual cpu, and/or, historical record according to the batch operation of described virtual memory, determine the resource allocation ability of described complete machine cabinet server, described resource comprises: the arbitrary or combination of described virtual cpu, virtual memory.

24. to the performance evaluating apparatus of 23 arbitrary described complete machine cabinet server, it is characterized in that according to claim 19,

Described call instruction device, also be used for sending the framework call instruction to the framework manager of described complete machine cabinet server, in described framework call instruction, comprise: require described framework manager to the clone of the described virtual server of appointment and the mission bit stream of deployment, and require described framework manager to the mission bit stream of the migration of the described virtual server of appointment, and require described framework manager to the mission bit stream of the migration of the data at least two described storeies of appointment, wherein each described storer is connected with each described virtual server respectively, and wherein said framework manager is connected respectively with all described load devices;

Framework manager information determiner is used for obtaining the following information of described framework manager: to the practical task execution result information of the task of the clone of described virtual server and deployment, to the practical task execution result information of the mission bit stream of the migration of described virtual server, to the practical task execution result information of the mission bit stream of the migration of the data on the described storer;

Described performance evaluating device also is connected with described framework manager information determiner, is used for according to each described practical task execution result information, determines the framework managerial ability of described framework manager.

25. the performance evaluating apparatus of a complete machine cabinet server is characterized in that, comprising:

Main tester and at least one the auxiliary tester that is connected with described main tester;

Described main tester comprises: the first configuration information getter, the first call instruction transmitter, execution result determiner, first memory and determination of property parameter device,

Described the first configuration information getter, be used for obtaining the configuration information of each described virtual server in tested complete machine cabinet server and the described load device that described main tester is connected, described configuration information is stored to described first memory, and the configuration information of described virtual server comprises: the routing information of each described virtual server;

Described the first call instruction transmitter, be connected with described the first configuration information getter, described load device respectively, send server calls order for each the described virtual server in described load device, described server calls order comprises: the information that requires the task that each described virtual server carries out respectively, wherein, each described load device is corresponding one by one with each user respectively, and

Be used for sending the subtest call instruction to each described auxiliary tester, send call instruction according to described call instruction to each described load device that described auxiliary tester connects for described auxiliary tester;

The first execution result determiner is used for obtaining each described virtual server to the actual execution result information of described task and the execution result information to described subtest call instruction of obtaining described auxiliary tester;

Described first memory, be used for storage information, described information comprises: the configuration information of each described virtual server and each described virtual server are to the actual execution result information of described task and the execution result information to described subtest call instruction of described auxiliary tester;

Described determination of property parameter device, be connected with described second memory in described first memory, the described auxiliary test machine respectively, be used for the data according to described first memory and each described second memory, according to the actual execution result information of each the described virtual server in each described load device to each described task, determine the performance of each described load device and each described virtual server, according to the execution result information to described subtest call instruction of each described auxiliary tester, determine the performance of described auxiliary tester;

Described auxiliary tester is the pressure applicator of simulation client terminal access behavior,

Described auxiliary tester comprises: the second configuration information getter, the second call instruction transmitter, the second execution result determiner and second memory;

Described the second configuration information getter, be used for the control according to the call instruction of described master controller, obtain with described load device that described auxiliary tester is connected in the configuration information of each described virtual server, the configuration information of described each described virtual server is stored to described second memory, and described configuration information comprises: the routing information of each described virtual server;

Described the second call instruction transmitter, be connected with described the second configuration information getter, described load device respectively, be used for the control according to the call instruction of described master controller, each described virtual server in described load device sends the server calls order, described server calls order comprises: the information that requires the task that each described virtual server carries out respectively

The second execution result determiner is used for obtaining each described virtual server to the actual execution result information of described task;

Described second memory is used for storage information, and described information comprises: the configuration information of each described virtual server and each described virtual server are to the actual execution result information of described task.

Images