CN113688057A - Method and system for testing performance of computing equipment, computing equipment and storage medium - Google Patents
Method and system for testing performance of computing equipment, computing equipment and storage medium Download PDFInfo
- Publication number
- CN113688057A CN113688057A CN202111224993.7A CN202111224993A CN113688057A CN 113688057 A CN113688057 A CN 113688057A CN 202111224993 A CN202111224993 A CN 202111224993A CN 113688057 A CN113688057 A CN 113688057A
- Authority
- CN
- China
- Prior art keywords
- test
- task
- data
- control server
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 458
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000009434 installation Methods 0.000 claims abstract description 65
- 238000011156 evaluation Methods 0.000 claims abstract description 11
- 238000012544 monitoring process Methods 0.000 claims description 9
- 238000004891 communication Methods 0.000 abstract description 22
- 238000011056 performance test Methods 0.000 abstract description 4
- 230000006870 function Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000007723 transport mechanism Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012854 evaluation process Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 239000013585 weight reducing agent Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a performance test method of computing equipment, which is suitable for being executed in a test system of the computing equipment and comprises the following steps: the task server creates a test task and sends the test task to the control server; the control server constructs a test installation package according to the test task and sends the test installation package to a plurality of computing devices in communication connection with the control server; the computing equipment installs the received test installation package, executes the test task in the test installation package to obtain test data, and sends the test data to the control server; the control server receives the test data sent by each computing device to obtain multiple items of test data, draws a test data table according to the multiple items of test data, and sends the test data table to the task server; and the task server performs performance evaluation on each computing device according to the test data table. The invention also discloses a system for testing the performance of the computing equipment, the computing equipment and a storage medium.
Description
Technical Field
The invention relates to the field of cloud computing, in particular to a server performance testing method, a server performance testing system, computing equipment and a storage medium.
Background
With the development of computer technology, in order to further improve the reliability of computer equipment and systems, the computer and the systems need to be tested. The existing testing method is low in efficiency, a tester needs to independently test on a machine every day, and test data are called for analysis after the test is finished. The method is time-consuming, the testing time and environment of different machines are different, different testing results cannot be summarized and counted, a uniform testing standard cannot be formed, and comprehensive and objective evaluation on computer equipment and systems is inconvenient.
For this reason, a new computing device performance testing method is needed.
Disclosure of Invention
To this end, the present invention provides a computing device performance testing method that seeks to solve, or at least alleviate, the above-identified problems.
According to one aspect of the present invention, there is provided a computing device performance testing method adapted to be executed in a computing device testing system comprising a control server, a task server communicatively connected to the control server and a plurality of computing devices, the method comprising the steps of: the task server creates a test task and sends the test task to the control server; the control server constructs a test installation package according to the test task and sends the test installation package to the plurality of computing devices; the computing equipment installs the received test installation package, executes the test task in the test installation package to obtain test data, and sends the test data to the control server; the control server receives the test data sent by each computing device to obtain multiple items of test data, draws a test data table according to the multiple items of test data, and sends the test data table to the task server; and the task server performs performance evaluation on each computing device according to the test data table.
Optionally, in the method according to the present invention, further comprising the step of: the control server creates a monitoring process and monitors a test instruction from the task server according to the monitoring process; the task server generates a test instruction and sends the test instruction to the control server; when the control server monitors a test instruction from the task server, the test instruction is sent to a plurality of computing devices connected with the control server, so that the computing devices execute the test task according to the test instruction.
Optionally, in the method according to the present invention, the test task includes a plurality of test items, the test instruction includes a test item to be tested, the received test installation package is installed, and executing the test task in the test installation package to obtain the test data includes: and when receiving a test instruction from the control server, selecting a test item specified by the execution test instruction from the test task to obtain test data.
Optionally, in the method according to the present invention, the step of selecting a test item specified by the test instruction from the test task, and obtaining the test data further includes: executing the test items in the test task according to the test times to obtain a project data set, wherein the project data set comprises the same number of project data as the test times; and calculating according to the project data set and the test times to obtain test data.
Optionally, in the method according to the present invention, the project data includes peaks and valleys, and the step of calculating the test data according to the project data set and the test times includes the steps of: sorting the project data in the project data set; calculating a peak score, a valley score and a mean score according to the sorted project data sets and the test times; the peak score, the trough score and the mean score were used as test data.
Optionally, in the method according to the present invention, the step of drawing the test data table according to the plurality of test data includes: and drawing the data rows of the test data table according to the peak score, the valley score and the average score of the test data and the name of the computing equipment to which each item of test data belongs to obtain the test data table comprising a plurality of data rows.
Optionally, in the method according to the present invention, the sending the test data to the control server includes the steps of: carrying out serialization operation on the test data to obtain serialized data; the serialized data is sent to a control server.
Optionally, in the method according to the present invention, the step of receiving, by the control server, the test data sent by each computing device includes: the control server receives serialized data sent by the computing equipment; and performing deserialization operation on the serialized data to obtain test data.
Optionally, in the method according to the present invention, the computing device testing system further includes a data server communicatively connected to the control server, and the method further includes the steps of: the control server sends the received multiple items of test data to the data server; the data server stores the received multiple test data, so that the task server can inquire the test data.
According to another aspect of the present invention, there is provided a computing device performance testing method adapted to be executed in a control server communicatively connected to a task server and a plurality of computing devices, the method comprising the steps of: receiving a test task created by a task server, and constructing a test installation package according to the test task; sending the test installation package to a plurality of computing devices so that the computing devices can install the received test installation package and execute the test tasks in the test installation package to obtain test data; receiving test data sent by each computing device to obtain a plurality of items of test data; and drawing a test data table according to the plurality of items of test data, and sending the test data table to the task server so that the task server can evaluate the performance of each computing device according to the test data table.
Optionally, in the method according to the present invention, further comprising the step of: establishing a monitoring process, and monitoring a test instruction from a task server according to the monitoring process; when a test instruction from the task server is monitored, the received test instruction is sent to a plurality of computing devices connected with the control server, so that the computing devices execute the test task according to the test instruction.
Optionally, in the method according to the present invention, the control server is further connected to a data server in communication, and the method further includes the steps of: and sending the received multiple items of test data to a data server, and storing the test data in the data server so that the task server can inquire the stored test data.
According to yet another aspect of the present invention, there is provided a computing device testing system, the system comprising a control server, a task server and a plurality of computing devices, wherein the task server is communicatively connected to the control server, wherein the task server is adapted to create a test task, and to send the test task to the control server; the control server is suitable for constructing a test installation package according to the test task and sending the test installation package to the plurality of computing devices; the computing equipment is suitable for installing the received test installation package, executing a test task in the test installation package to obtain test data, and sending the test data to the control server; the control server is also suitable for receiving the test data sent by each computing device to obtain a plurality of items of test data, drawing a test data table according to the plurality of items of test data, and sending the test data table to the task server; the task server is further adapted to perform a performance evaluation for each computing device according to the test data table.
Optionally, in the system according to the present invention, the control server is further adapted to create a monitoring process, and monitor the test instruction from the task server according to the monitoring process; the task server is also suitable for generating a test instruction and sending the test instruction to the control server; the control server is further adapted to send test instructions to a plurality of computing devices connected to the control server when listening for the test instructions from the task server, so that the computing devices execute the test tasks according to the test instructions.
Optionally, in the system according to the present invention, the test instruction further includes a number of tests, the computing device is further adapted to: executing the test items in the test task according to the test times to obtain a project data set, wherein the project data set comprises the same number of project data as the test times; and calculating according to the project data set and the test times to obtain test data.
Optionally, in a system according to the invention, the item data comprises peaks and troughs, the computing device being further adapted to: sorting the project data in the project data set; calculating a peak score, a valley score and a mean score according to the sorted project data sets and the test times; the peak score, the trough score and the mean score were used as test data.
Optionally, in the system according to the present invention, the control server is further adapted to: and drawing the data rows of the test data table according to the peak score, the valley score and the average score of the test data and the name of the computing equipment to which each item of test data belongs to obtain the test data table comprising a plurality of data rows.
Optionally, in the system according to the present invention, the system further includes a data server in communication connection with the control server, and the control server is further adapted to send the received plurality of items of test data to the data server; the data server is adapted to store the received items of test data for the task server to query for the test data.
According to yet another aspect of the present invention, there is provided a computing device comprising: one or more processors; a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing a server cluster deployment method in accordance with the present invention.
According to yet another aspect of the present invention, there is provided a computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device, cause the computing device to perform a server cluster deployment method according to the present invention.
The invention relates to a performance test method of computing equipment, which is suitable for being executed in a testing system of the computing equipment. After the task server creates the test task, the control server constructs a test installation package according to the test task and distributes the test installation package to all the computing devices to be tested, each computing device installs the test installation package, and the test tasks in the test installation package are executed in the same environment. And each computing device also sends the test data for executing the test task to the control server, and the control server collects the test data of all the computing devices and draws a test data table according to the test data so that the task server can evaluate the performance of each computing device according to the test data table. The invention improves the testing efficiency of the server, and all the servers to be tested execute the same testing task in the same environment, thereby being convenient for evaluating the performance of the server according to the uniform testing standard. Meanwhile, test data of all the computing devices are automatically collected, the difficulty of collecting the test data is reduced, and the test efficiency is further improved.
Drawings
To the accomplishment of the foregoing and related ends, certain illustrative aspects are described herein in connection with the following description and the annexed drawings, which are indicative of various ways in which the principles disclosed herein may be practiced, and all aspects and equivalents thereof are intended to be within the scope of the claimed subject matter. The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description when read in conjunction with the accompanying drawings. Throughout this disclosure, like reference numerals generally refer to like parts or elements.
To the accomplishment of the foregoing and related ends, certain illustrative aspects are described herein in connection with the following description and the annexed drawings, which are indicative of various ways in which the principles disclosed herein may be practiced, and all aspects and equivalents thereof are intended to be within the scope of the claimed subject matter. The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description when read in conjunction with the accompanying drawings. Throughout this disclosure, like reference numerals generally refer to like parts or elements.
FIG. 1 shows a schematic diagram of a computing device testing system according to an exemplary embodiment of the present invention;
FIG. 2 illustrates a block diagram of a computing device 200, according to an exemplary embodiment of the invention; and
FIG. 3 shows a flowchart of a computing device performance testing method 300 according to an exemplary embodiment of the invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art. Like reference numerals generally refer to like parts or elements.
FIG. 1 shows a schematic diagram of a computing device testing system according to an exemplary embodiment of the present invention. As shown in FIG. 1, the computing device testing system includes a control server 140, a task server 150 communicatively coupled to the control server 140, a data server 160, and a computing device 110 and 130. The connection manner between the computing devices 110 and 130 and the control server 140 in fig. 1 is only exemplary, the number of the computing devices connected to the control server 140 is not limited in the present invention, and the control server 140 may be connected to hundreds or thousands of computing devices, so as to implement simultaneous testing of a large batch of computing devices, and improve testing efficiency.
The task server 150 creates a test task and transmits the test task to the control server 140 so that the control server 140 generates a test installation package according to the test task. A test command is also generated and sent to the control server 140. The test instruction indicates the computing device 110 that installs the test installation package 130 to execute the test item in the test task for testing, and generate the test data.
The control server 140 receives the test task and the test command sent by the task server 150, and generates a test installation package according to the test task. The control server 140 further issues the test installation package to the connected computing device 110 and 130, forwards the test command to the computing device 110 and 130, receives the test data returned by each computing device to obtain a plurality of test data, and further draws a test data table according to the plurality of test data, so that the task server 150 performs performance evaluation on each computing device according to the test data table.
According to an embodiment of the present invention, the control server 140 may be provided with a plurality of backup servers (not shown), and the control server 140 is communicatively connected to the plurality of backup servers. When the control server 140 fails, the control server 140 timely transfers the communication connection with the plurality of computing devices 110 and 130 to the backup server, the backup server serves as the control server, receives the test task and the test command of the task server 150, creates a test installation package, and sends the test installation package to the computing devices 110 and 130 to forward the test command. The backup server also receives the test data of each computing device to obtain a plurality of items of test data, and draws a test data table according to the plurality of items of test data, so that the task server 150 performs performance evaluation on each computing device according to the test data table.
The computing device 110 receives the test installation package and installs the test installation package according to the received test installation package; and receiving the test command, executing the test task in the test installation package according to the test command to obtain test data, and transmitting the test data back to the control server 140.
The control server 140, the task server 150 communicatively connected to the control server 140, the data server 160, and the computing device 110 and 130 in fig. 1 may be implemented as computing devices as shown in fig. 2. FIG. 2 illustrates a block diagram of a computing device 200, according to an exemplary embodiment of the invention. As shown in FIG. 2, in a basic configuration 202, a computing device 200 typically includes a system memory 206 and one or more processors 204. A memory bus 208 may be used for communication between the processor 204 and the system memory 206.
Depending on the desired configuration, the processor 204 may be any type of processing, including but not limited to: a microprocessor (μ P), a microcontroller (μ C), a digital information processor (DSP), or any combination thereof. The processor 204 may include one or more levels of cache, such as a level one cache 210 and a level two cache 212, a processor core 214, and registers 216. Example processor cores 214 may include Arithmetic Logic Units (ALUs), Floating Point Units (FPUs), digital signal processing cores (DSP cores), or any combination thereof. The example memory controller 218 may be used with the processor 204, or in some implementations the memory controller 218 may be an internal part of the processor 204.
Depending on the desired configuration, system memory 206 may be any type of memory, including but not limited to: volatile memory (such as RAM), non-volatile memory (such as ROM, flash memory, etc.), or any combination thereof. System memory 206 may include an operating system 220, one or more programs 222, and program data 228. In some embodiments, the program 222 may be arranged to execute the instructions 223 of the method 300 according to the invention on an operating system by one or more processors 204 using the program data 228.
Computing device 200 may also include a storage interface bus 234. The storage interface bus 234 enables communication from the storage devices 232 (e.g., removable storage 236 and non-removable storage 238) to the basic configuration 202 via the bus/interface controller 230. Operating system 220, programs 222, and at least a portion of data 224 can be stored on removable storage 236 and/or non-removable storage 238, and loaded into system memory 206 via storage interface bus 234 and executed by one or more processors 204 when computing device 200 is powered on or programs 222 are to be executed.
Computing device 200 may also include an interface bus 240 that facilitates communication from various interface devices (e.g., output devices 242, peripheral interfaces 244, and communication devices 246) to the basic configuration 202 via the bus/interface controller 230. The example output device 242 includes a graphics processing unit 248 and an audio processing unit 250. They may be configured to facilitate communication with various external devices, such as a display or speakers, via one or more a/V ports 252. Example peripheral interfaces 244 can include a serial interface controller 254 and a parallel interface controller 256, which can be configured to facilitate communications with external devices such as input devices (e.g., keyboard, mouse, pen, voice input device, touch input device) or other peripherals (e.g., printer, scanner, etc.) via one or more I/O ports 258. An example communication device 246 may include a network controller 260, which may be arranged to communicate with one or more other computing devices 262 over a network communication link via one or more communication ports 264.
A network communication link may be one example of a communication medium. Communication media may typically be embodied by computer readable instructions, data structures, program modules, and may include any information delivery media, such as carrier waves or other transport mechanisms, in a modulated data signal. A "modulated data signal" may be a signal that has one or more of its data set or its changes made in such a manner as to encode information in the signal. By way of non-limiting example, communication media may include wired media such as a wired network or private-wired network, and various wireless media such as acoustic, Radio Frequency (RF), microwave, Infrared (IR), or other wireless media. The term computer readable media as used herein may include both storage media and communication media.
In a computing device 200 according to the present invention, the program 222 comprises a plurality of program instructions that instruct the execution method 300 to instruct the processor 204 to perform some of the steps of the computing device performance testing method 300 executed in the computing device 200 of the present invention so that some of the components in the computing device 200 implement the testing of the server performance by executing the computing device performance testing method 300 of the present invention.
Computing device 200 may be implemented as a server, e.g., file server 240, database 250, a server, an application server, etc., which may be a device such as a Personal Digital Assistant (PDA), a wireless web-browsing device, an application-specific device, or a hybrid device that include any of the above functions. May be implemented as a personal computer including both desktop and notebook computer configurations, and in some embodiments, the computing device 200 is configured to perform the computing device performance testing method 300.
FIG. 3 shows a flowchart of a computing device performance testing method 300 according to an exemplary embodiment of the invention. The computing device performance testing method 300 of the present invention is suitable for execution in a computing device testing system, and further suitable for execution in the computing device testing system shown in fig. 1, wherein the computing device testing system comprises a control server 140, a task server 150 communicatively connected to the control server 140, and a plurality of computing devices 110 and 130.
As shown in FIG. 3, the computing device performance testing method 300 begins at step S310, where the task server 150 creates a test task and sends the test task to the control server 140. The test task includes a plurality of test items, and the task server 150 constructs a configuration file for each test item, and combines the configuration files of the plurality of test items to be tested as the test task.
Subsequently, step S320 is executed, in which the control server 140 constructs a test installation package according to the test task, and transmits the test installation package to the plurality of computing devices 110 and 130. When the control server 140 constructs a test installation package according to the test task, the serialization structure protocol is encapsulated into the test installation package. The control server 140 further establishes a server list related to the computing devices 110 and 130, writes all the computing devices 110 and 130 in communication connection with the control server 140 into the server list, and sends the test installation package to all the connected computing devices 110 and 130 according to the server list. When the control server 140 sends the test installation package to the computing device 110 and 130, it also sends an installation instruction to the computing device 110 and 130, which instructs the computing device 110 and 130 to install the received test installation package.
Subsequently, step S330 is executed, the computing device 110 installs the received test installation package, executes the test task in the test installation package to obtain the test data, and sends the test data to the control server 140.
According to an embodiment of the present invention, the computing device 110 and 130 construct the installation catalog of the test installation package before installing the test installation package according to the received test installation package. After receiving the installation instruction sent by the control server 140, the control server 140 installs the test installation package in the installation directory. After receiving the test installation package, the control server 140 communicates with the control server 140 according to a serialization protocol in the test installation package.
According to one embodiment of the present invention, the task server 150 generates a test instruction and transmits the test instruction to the control server 140. The test instructions include test items and test times indicating the test items and corresponding execution times to be executed by the computing device 110 and 130. The control server 140 creates a listening process according to which to listen for test instructions from the task server 150. Each time the task server 150 instructs the computing device 110 and 130 to execute the test item, the test instruction is generated and sent to the control server 140, and the control server 140 distributes the test instruction to the computing device 110 and 130.
When the control server 140 monitors the test instruction from the task server 150, the test instruction is sent to the plurality of computing devices 110 and 130 connected to the control server 140, so that the computing devices 110 and 130 execute the test task according to the test instruction. The computing device 110 and 130, upon receiving the test command from the control server 140, selects the test item specified by the execution test command from the test task to obtain the test data.
According to an embodiment of the present invention, when the control server 140 sends the test instruction to the computing device 110-. When the computing device 110 and 130 receives the test instruction from the control server 140, the received serialized instruction is subjected to anti-sequence operation according to the serialization protocol to obtain the test instruction, so that the test instruction is reconstructed through anti-sequence according to the test instruction state and the description information stored in the byte stream. In the above steps, serializing the test instruction refers to converting the test instruction into a serialized instruction in an ordered byte stream form, and deserializing the serialized instruction refers to reconstructing the serialized instruction in the ordered byte stream form into the test instruction.
When the computing device 110 executes the test items 130, the test items in the test task are executed according to the test times, so as to obtain an item data set. The project data set comprises project data with the same number as the test times, and the test data is obtained through calculation according to the project data set and the test times. The computing device 110 executes the test item once to obtain a piece of item data, and executes the test item for the number of times corresponding to the number of times of the test to obtain an item data set.
According to an embodiment of the present invention, the computing device 110 executes the test item by means of popen each time the test item is executed, calls the popen () function to create a pipeline, and calls the fork () function to generate a sub-process through which the test item is executed. The present invention does not limit the kind of the test items.
According to an embodiment of the present invention, the test items of the computing device 110 and 130 are to perform a stress test on computer components, which include, but are not limited to, a hard disk, a CPU, a network card, a graphics card, and a memory. When the computing device 110 performs the stress test, the resource occupation ratio per second is collected, and the highest value and the lowest value within 60 seconds are saved every 60 seconds until the whole test item is completed. A line graph is then drawn according to the highest and lowest values within every 60 seconds of the time that the test item was executed. And determining the whole-course highest value and the whole-course lowest value of the resource occupation ratio per second in the whole test project according to the discount graph. Subsequently, the global highest value and the global lowest value are taken as project data. The test items are repeatedly executed to obtain an item data set including a plurality of item data.
And when the test data is obtained through calculation according to the project data set and the test times, sequencing the project data in the project data set. Specifically, the sum of the global highest value and the global lowest value can be used as a sorting basis, and the item data in the item data set can be sorted from high to low.
A peak score, a valley score, and an average score are then calculated from the sorted item data sets and test times. The present invention does not limit the manner in which the peak score, the trough score, and the mean score are calculated. According to one embodiment of the invention, when the peak value is calculated, the sorted item data sets, the item data of the highest value in the whole course, the lowest value in the whole course and the first third of the highest value in the whole course are selected, and the highest value in the whole course is extracted to calculate the average value to obtain the peak value score. And correspondingly selecting the project data of the last third of the highest value and the lowest value of the whole course, and extracting the lowest value of the whole course to calculate an average value to obtain a valley score. And selecting project data of the whole-course highest value and the whole-course lowest value and one third of the project data in the middle part, firstly calculating to obtain an average value of each project data according to the whole-course lowest value and the whole-course highest value of each project data, and then calculating to obtain an average value score according to the following formula according to the average value of each project data of the one third of the project data in the middle part:
where score is the mean score, x1, x2 … … xnIs an average value of each item data of one third of the middle part, N is the number of item data of one third of the middle part, Dim is a weight reduction coefficient, and takes a value of (0, 1)]Default is 0.9.
The peak score, the valley score and the average score are then used as test data, and the test data is transmitted to the control server 140. The computing device 110 and the computing device 130 analyze the data collected by executing the test task to obtain test data, and then transmit the test data to the control server 140, so that the data transmission amount of the network is reduced, and the test efficiency of the whole system can be improved.
Then, step S340 is executed, in which the control server 140 receives the test data sent by each computing device to obtain multiple items of test data, draws a test data table according to the multiple items of test data, and sends the test data table to the task server 150.
According to an embodiment of the present invention, when the computing device 110 and 130 sends the test data to the control server 140, the test data is serialized according to a serialization protocol to obtain serialized data, so that the test data is converted into serialized data in an ordered byte stream form, integrity and transferability of the test data are ensured when a test instruction is transmitted, the test data is more conveniently and rapidly transmitted, and then the serialized data is sent to the control server 140. The control server 140 receives the serialized data sent by the computing devices 110 and 130 when receiving the test data sent by each of the computing devices 110 and 130. And performing anti-sequence operation on the received serialized data according to a serialization protocol to obtain test data, and reconstructing the test data through anti-serialization according to the test data state and description information stored in the byte stream. In the above step, serializing the test data refers to converting the test data into serialized data in an ordered byte stream form, and deserializing the serialized data refers to reconstructing the serialized data in the ordered byte stream form into the test data.
When the control server 140 draws the test data table according to the plurality of items of test data, drawing the data lines of the test data table according to the peak score, the valley score and the average score of the test data and the name of the computing device to which each item of test data belongs, so as to obtain the test data table including the plurality of data lines.
Finally, step S350 is executed, and the task server 150 performs performance evaluation on each computing device according to the test data table. After receiving the test data table, the task server 150 may perform performance evaluation on the computing devices corresponding to the data rows according to the data rows of the test data table. Specifically, in the performance evaluation process, the performance of the computing device 110 and the computing device 130 may be determined according to whether the peak score, the valley score, and the average score in the data row reach the set threshold. The control server 140 collects the test data of all the computing devices 110 and 130 and draws a test data table, so that performance evaluation of each computing device is facilitated, steps of receiving the test data from the host one by testing personnel are saved, and efficiency of performance test of a large number of servers is improved.
According to an embodiment of the present invention, the control server 140 transmits the received plurality of items of test data to the data server 160, and the data server 160 stores the received plurality of items of test data so that the task server 150 queries the test data. The task server 150 can query the past test data in the data server 160 through the control server 140 to compare the test results of the same computing device at different times, and determine whether the performance of the computing device is improved. The present invention is not limited to the specific form of the data server 160, and the data server 160 may be implemented as a sqlite database.
The invention relates to a performance test method of computing equipment, which is suitable for being executed in a testing system of the computing equipment. After the task server creates the test task, the control server constructs a test installation package according to the test task and distributes the test installation package to all the computing devices to be tested, each computing device installs the test installation package, and the test tasks in the test installation package are executed in the same environment. And each computing device also sends the test data for executing the test task to the control server, and the control server collects the test data of all the computing devices and draws a test data table according to the test data so that the task service can evaluate the performance of each computing device according to the test data table. The invention improves the testing efficiency of the server, and all the servers to be tested execute the same testing task in the same environment, thereby being convenient for evaluating the performance of the server according to the uniform testing standard. Meanwhile, test data of all the computing devices are automatically collected, the difficulty of collecting the test data is reduced, and the test efficiency is further improved.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim.
Those skilled in the art will appreciate that the modules or units or groups of devices in the examples disclosed herein may be arranged in a device as described in this embodiment, or alternatively may be located in one or more devices different from the devices in this example. The modules in the foregoing examples may be combined into one module or may be further divided into multiple sub-modules.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. Modules or units or groups in embodiments may be combined into one module or unit or group and may furthermore be divided into sub-modules or sub-units or sub-groups. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments.
Furthermore, some of the described embodiments are described herein as a method or combination of method elements that can be performed by a processor of a computer system or by other means of performing the described functions. A processor having the necessary instructions for carrying out the method or method elements thus forms a means for carrying out the method or method elements. Further, the elements of the apparatus embodiments described herein are examples of the following apparatus: the apparatus is used to implement the functions performed by the elements for the purpose of carrying out the invention.
The various techniques described herein may be implemented in connection with hardware or software or, alternatively, with a combination of both. Thus, the methods and apparatus of the present invention, or certain aspects or portions thereof, may take the form of program code (i.e., instructions) embodied in tangible media, such as floppy diskettes, CD-ROMs, hard drives, or any other machine-readable storage medium, wherein, when the program is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the invention.
In the case of program code execution on programmable computers, the computing device will generally include a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. Wherein the memory is configured to store program code; the processor is configured to perform the computing device performance testing method of the present invention according to instructions in the program code stored in the memory.
By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. Computer-readable media includes both computer storage media and communication media. Computer storage media store information such as computer readable instructions, data structures, program modules or other data. Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. Combinations of any of the above are also included within the scope of computer readable media.
As used herein, unless otherwise specified the use of the ordinal adjectives "first", "second", "third", etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this description, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as described herein. Furthermore, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense, and the scope of the present invention is defined by the appended claims.
Claims (10)
1. A computing device performance testing method adapted to be executed in a computing device testing system comprising a control server, a task server communicatively connected to the control server and a plurality of computing devices, the method comprising the steps of:
the task server creates a test task and sends the test task to the control server;
the control server constructs a test installation package according to the test task and sends the test installation package to a plurality of computing devices;
the computing equipment installs the received test installation package, executes the test task in the test installation package to obtain test data, and sends the test data to the control server;
the control server receives test data sent by each computing device to obtain multiple items of test data, draws a test data table according to the multiple items of test data, and sends the test data table to the task server;
and the task server performs performance evaluation on each computing device according to the test data table.
2. The method of claim 1, wherein the method further comprises the steps of:
the control server creates a monitoring process and monitors a test instruction from the task server according to the monitoring process;
the task server generates a test instruction and sends the test instruction to the control server;
when the control server monitors a test instruction from the task server, the test instruction is sent to a plurality of computing devices connected with the control server, so that the computing devices can execute the test task according to the test instruction.
3. The method of claim 2, wherein the test task includes a plurality of test items, the test instructions include test items to be tested, the installing the received test installation package, and executing the test tasks in the test installation package to obtain test data includes:
and when a test instruction from the control server is received, selecting and executing a test item specified by the test instruction from the test task to obtain test data.
4. The method of claim 3, wherein the test instruction further comprises a test number, and the selecting a test item specified by the test instruction from the test task to execute to obtain test data comprises:
executing the test items in the test task according to the test times to obtain a project data set, wherein the project data set comprises the same number of project data as the test times;
and calculating according to the project data set and the test times to obtain test data.
5. The method of claim 4, wherein said project data includes peaks and valleys, and said calculating test data from said project data set and said number of tests includes the steps of:
sorting the project data in the project data set;
calculating a peak score, a valley score and a mean score according to the sorted project data sets and the test times;
and taking the peak score, the valley score and the average score as test data.
6. The method of claim 5, wherein said drawing a test data table from a plurality of test data comprises the steps of:
and drawing data rows of a test data table according to the peak score, the valley score and the average score of the test data and the name of the computing equipment to which each item of test data belongs to obtain the test data table comprising a plurality of data rows.
7. The method of any one of claims 1-6, wherein said sending said test data to said control server comprises the steps of:
carrying out serialization operation on the test data to obtain serialized data;
and sending the serialized data to the control server.
8. A computing device testing system, the system comprising a control server, a task server and a plurality of computing devices communicatively connected to the control server, wherein the task server is adapted to create a test task, send the test task to the control server;
the control server is suitable for constructing a test installation package according to the test task and sending the test installation package to a plurality of computing devices;
the computing equipment is suitable for installing the received test installation package to execute the test task in the test installation package to obtain test data, and the test data is sent to the control server;
the control server is also suitable for receiving the test data sent by each computing device to obtain a plurality of items of test data, drawing a test data table according to the plurality of items of test data, and sending the test data table to the task server;
the task server is further adapted to perform a performance evaluation on each computing device according to the test data table.
9. A computing device, comprising:
one or more processors;
a memory; and
one or more apparatuses comprising instructions for performing the method of any of claims 1-7.
10. A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device, cause the computing device to perform the method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111224993.7A CN113688057A (en) | 2021-10-21 | 2021-10-21 | Method and system for testing performance of computing equipment, computing equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111224993.7A CN113688057A (en) | 2021-10-21 | 2021-10-21 | Method and system for testing performance of computing equipment, computing equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113688057A true CN113688057A (en) | 2021-11-23 |
Family
ID=78587655
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111224993.7A Pending CN113688057A (en) | 2021-10-21 | 2021-10-21 | Method and system for testing performance of computing equipment, computing equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113688057A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010012986A1 (en) * | 2000-02-04 | 2001-08-09 | Conan Chan Ming Yam Terence | Automated testing of computer system components |
| CN103902414A (en) * | 2012-12-25 | 2014-07-02 | 鸿富锦精密工业（深圳）有限公司 | Network type test system and method |
| CN104021077A (en) * | 2014-06-10 | 2014-09-03 | 广州市久邦数码科技有限公司 | Mobile terminal software test system and method |
| CN105095089A (en) * | 2015-09-14 | 2015-11-25 | 北京金山安全软件有限公司 | Method and device for testing performance of application software |
| CN105302727A (en) * | 2015-11-17 | 2016-02-03 | 小米科技有限责任公司 | Testing method, device and system |
| CN105607992A (en) * | 2015-09-29 | 2016-05-25 | 网易（杭州）网络有限公司 | Application program test method, device and system |
| CN107126222A (en) * | 2017-06-23 | 2017-09-05 | 中国科学院心理研究所 | A kind of cognitive ability evaluation system and its assessment method |
| CN109766258A (en) * | 2018-11-30 | 2019-05-17 | 北京奇艺世纪科技有限公司 | A kind of performance test methods, device and computer readable storage medium |
| CN110781085A (en) * | 2019-10-23 | 2020-02-11 | 腾讯科技（深圳）有限公司 | Game automatic testing method, device, terminal and computer storage medium |
-
2021
- 2021-10-21 CN CN202111224993.7A patent/CN113688057A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010012986A1 (en) * | 2000-02-04 | 2001-08-09 | Conan Chan Ming Yam Terence | Automated testing of computer system components |
| CN103902414A (en) * | 2012-12-25 | 2014-07-02 | 鸿富锦精密工业（深圳）有限公司 | Network type test system and method |
| CN104021077A (en) * | 2014-06-10 | 2014-09-03 | 广州市久邦数码科技有限公司 | Mobile terminal software test system and method |
| CN105095089A (en) * | 2015-09-14 | 2015-11-25 | 北京金山安全软件有限公司 | Method and device for testing performance of application software |
| CN105607992A (en) * | 2015-09-29 | 2016-05-25 | 网易（杭州）网络有限公司 | Application program test method, device and system |
| CN105302727A (en) * | 2015-11-17 | 2016-02-03 | 小米科技有限责任公司 | Testing method, device and system |
| CN107126222A (en) * | 2017-06-23 | 2017-09-05 | 中国科学院心理研究所 | A kind of cognitive ability evaluation system and its assessment method |
| CN109766258A (en) * | 2018-11-30 | 2019-05-17 | 北京奇艺世纪科技有限公司 | A kind of performance test methods, device and computer readable storage medium |
| CN110781085A (en) * | 2019-10-23 | 2020-02-11 | 腾讯科技（深圳）有限公司 | Game automatic testing method, device, terminal and computer storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106970880B (en) | Distributed automatic software testing method and system | |
| CN111897638B (en) | Distributed task scheduling method and system | |
| CN110557420B (en) | Operation method and system of independent sub-chains | |
| CN107977167B (en) | Erasure code based degeneration reading optimization method for distributed storage system | |
| CN107608893B (en) | Pressure test scheduling method and device, scheduling server and computing equipment | |
| CN112306719B (en) | Task scheduling method and device | |
| CN111563014A (en) | Interface service performance test method, device, equipment and storage medium | |
| US20130346427A1 (en) | Method and procedure for unassisted data collection, extraction and report generation and distribution | |
| CN103941662A (en) | Task scheduling system and method based on cloud computing | |
| WO2022007755A1 (en) | Robot software testing method and device and storage medium | |
| CN112051771B (en) | Multi-cloud data acquisition method and device, computer equipment and storage medium | |
| CN113886162A (en) | Computing equipment performance test method, computing equipment and storage medium | |
| CN113918352B (en) | Service resource allocation method, computing device and storage medium | |
| CN113704077A (en) | Test case generation method and device | |
| CN114519006A (en) | Test method, device, equipment and storage medium | |
| CN113688057A (en) | Method and system for testing performance of computing equipment, computing equipment and storage medium | |
| CN115373826B (en) | Task scheduling method and device based on cloud computing | |
| US20180203628A1 (en) | Method, apparatus and computer program product for evaluating data storage systems for energy efficiency | |
| US7680921B2 (en) | Management system, management computer, managed computer, management method and program | |
| CN109634792A (en) | A kind of server hardware test platform system based on cloud computing | |
| CN102394911B (en) | Computer aided engineering integrated cloud analysis system and method | |
| CN111209102A (en) | Distributed task distribution method and system | |
| CN111666156B (en) | Container arranging method, device, equipment and storage medium | |
| CN118069374B (en) | Method, device, equipment and medium for accelerating intelligent training simulation transaction of data center | |
| CN110958144B (en) | Method and device for acquiring network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |