TWI766480B - Test management cloud platform and method - Google Patents

Abstract

The present invention provides a test management cloud platform and method, wherein the test management cloud platform includes a connection module, an automatic function test module and a database module; the connection module is configured to establish a communication connection with a testing machine; the database module is configured to store an installation application of a software; the automatic function test module is configured to establish a communication connection with the test machine through the connection module, and install the corresponding software into the test machine remotely according to the software information required by the test item, and remotely control the test machine to execute the test item after the installation is completed. The test management method includes remotely controlling the test machine to execute test item through a test management cloud platform. The present invention discloses establishing the connection between the test management cloud platform and the test machine by building a network, which greatly improves the test efficiency of function verification.

Description

Test management cloud platform and method

The invention relates to the technical field of server verification testing, in particular to a test management cloud platform and method.

At present, in the development of the server design project, it is necessary to verify the function of the server, that is, power on and run the server before and after the test or during the test, and check various parameters of the server or test components. In the prior art, for server-based functional verification tests, engineers generally need to complete the following steps: after copying the relevant installation program through a storage device such as a USB flash drive, install the operating system on a designated server and update the BMC/BIOS (for example, Update the component parameter settings in the server), install the test component driver, and install the test tool; only then can the relevant functional tests be performed and test data obtained. The above testing process requires engineers to complete a large number of tedious steps, and also requires engineers to master the installation methods of different software, which has the problems of low work efficiency and high learning cost.

Aiming at the technical problem of low efficiency pointed out above in the current project test, the present invention aims to provide a test management cloud platform.

According to an embodiment of the present invention, including:

The object of the present invention adopts the following technical solutions to realize:

In the first aspect, the present invention shows a test management cloud platform, the test management cloud platform includes a connection module, an automatic function test module and a database module; wherein the automatic function test module is respectively connected with the connection module and the database module. Group communication connection; the connection module is used to establish a communication connection with the test machine; the database module is used to store the software installation program; the automatic function test module is used to establish a communication connection with the test machine through the connection module, according to the test The software information required by the project will install the corresponding software into the test machine remotely, and after the software installation is completed, the test machine will be remotely controlled to execute the test project.

In one embodiment, the test management cloud platform further includes a web front-end module; the web front-end module is used for users to log in to the test management cloud platform through a web interface.

In one embodiment, the software includes an operating system, drivers, and testing tools.

In one embodiment, the automatic function test module includes a task management unit, an automatic test unit, a remote control unit and a recording unit; the task management unit is used to manage test items, including establishing test items and updating the status of test items; automation The test unit is used to establish a communication connection with the test machine, generate the corresponding PXE installation configuration according to the software information required by the test project, and remotely install the corresponding software to the test machine; the remote control unit is used for the test machine. After installing the corresponding software, establish a remote control connection with the test machine for users to remotely control the test machine to complete the test project; the recording unit is used to obtain the test data generated by the test machine in the process of completing the test project. , generate a test log and store it in the database module.

In one embodiment, in the automated testing unit, the software information required by the test item is a software list selected by the user through the web interface.

In one embodiment, the test management cloud platform further includes a management module; the management module is used to manage test items, including displaying, counting, and analyzing test item information.

In one embodiment, the test management cloud platform further includes a forum module; the forum module is used for users to upload technical problems encountered in the test process or provide solutions to technical problems, and record the technical problems and corresponding solutions to the in the technical dictionary.

In one embodiment, the database module further includes a management unit; the management unit is used to manage the software in the database module, including software entry and update.

In a second aspect, the present invention shows a test management method, which is characterized in that the method is performed based on the test management cloud platform of any one of the above-mentioned first aspects, and the method includes: logging in to the test management cloud platform; selecting a test according to a test item machine and software, so that the test management cloud platform establishes a communication connection with the test machine, and the software is remotely installed in the test machine; the test management cloud platform is used to remotely control the test machine to execute the test project.

The beneficial effects of the present invention are:

1) By building a network to establish the connection between the test management cloud platform and the test machine, engineers only need to log in to the test management cloud platform, and then they can automatically complete the software installation of the test machine and remotely control the target test machine through the test management cloud platform. The relevant test items are completed on the platform, which greatly improves the test efficiency of functional verification.

2) The engineer only needs to select the software required for the test project through the web interface, and the relevant software installation can be completed by the information management system, which helps to reduce the learning cost and training cost of the engineer for different software installation steps and installation instructions.

3) Unified management of completed or to-be-tested test items through the test management cloud platform, record relevant information of test items, facilitate managers to manage test progress, test results of specific test items, etc., and improve the management level of project testing .

The above description of the present disclosure and the following description of the embodiments are used to demonstrate and explain the spirit and principle of the present invention, and provide further explanation of the scope of the patent application of the present invention.

The detailed features and advantages of the present invention are described in detail below in the embodiments, and the content is sufficient to enable any person skilled in the relevant art to understand the technical content of the present invention and implement it accordingly, and according to the content disclosed in this specification, the scope of the patent application and the drawings , any person skilled in the related art can easily understand the related objects and advantages of the present invention. The following examples further illustrate the viewpoints of the present invention in detail, but do not limit the scope of the present invention in any viewpoint.

The present invention will be further described with reference to the following application scenarios.

Referring to FIG. 1, it shows a frame structure diagram of a test management cloud platform proposed by the present invention, which shows a frame structure diagram of a test management cloud platform 10 proposed by the present invention, wherein the test management cloud platform 10 (TE&MS Cloud Platform; TE&MS Cloud Platform; TE&MS Cloud Platform 10) : Test Engineering & Management System) can run in the self-built server and local area network, the machine to be tested is connected to the local area network through the switch, establishes a communication connection with the test management cloud platform, and the user connects to the test management through the user terminal cloud platform. The test machine is a server that establishes a communication connection with the test management cloud platform 10 , and the user connects to the test management cloud platform 10 through the user terminal 20 . The testing machine 30 is a server.

Wherein, the test management cloud platform 10 includes a connection module 11, an automatic function test module 12 and a database module 13; wherein the automatic function test module 12 is respectively connected to the connection module 11 and the database module 13 for communication and connection; The module 11 is used to establish a communication connection with the test machine 30, which includes establishing communication connection with a plurality of test machines 30 through a switch; the database module 13 is used to store the installation program of the software, wherein the software is required for the test project Software, including operating system (OS), driver (Driver), test tool (Rool), etc. Meanwhile, the database module 13 is also used to save the test data generated by the project test and other data generated by the test management cloud platform 10; automatic function The test module 12 is used to establish a communication connection with the test machine 30 through the connection module 11 , install the corresponding software into the test machine 30 remotely according to the software information required by the test project, and perform the test after the software is installed. The machine 30 is remotely controlled to execute the test items.

For the current server-based functional verification projects, there are technical problems of inefficiency and high learning costs, that is, engineers need to manually install the server operating system, drivers and test tool software, and the installation process engineers are skilled in using a large number of operations and instructions , there are problems of low efficiency and high learning cost. In the above-mentioned embodiment of the present application, by constructing the test management cloud platform 10, the software required for the test project is pre-stored in the database module 13, and at the same time, a remote communication connection is established on the test machine 30 through the automatic function test module 12. After that, install the required software into the test machine 30 by means of remote installation, and operate the server by means of remote control to execute the corresponding project test after the software installation is completed, which can effectively reduce the engineer's workload on the server function. The operation steps in the verification process realize the function of operating multiple test machines at the same time, which helps to improve efficiency and convenience.

In one embodiment, the test management cloud platform 10 further includes a web front-end module 14; the web front-end module 14 is used for a user to log in to the test management cloud platform 10 through a web interface.

The engineer operates the user terminal 20 (OA computer or laptop, etc.), and can log in to the test management cloud platform 10 through the web interface, and operate the functional modules in the test management cloud platform 10, which is very convenient to use. At the same time, the user is in the test management cloud platform. All the operation records or generated test data in 10 can be recorded online, which is helpful for the management of verification test items.

In one embodiment, the test management cloud platform 10 further includes a management module 15; the management module 15 is used to manage test items, including display, statistics, and analysis of test item information.

By logging into the test management cloud platform 10, the administrator can manage the test items performed by engineers in a unified manner, including consulting the test data and test logs corresponding to each test item stored in the database module 13, and the tests performed by each engineer. Project statistics, assign test projects to designated engineers, output test project reports or charts, manage user rights, monitor platform load and operating status, and maintain database modules 13, etc., to facilitate administrators to verify test projects on server functions Carry out overall management.

An exemplary management structure of the test management cloud platform is shown in Figure 2: the administrator, as the maintainer of the system, is responsible for managing users, assigning user permissions, monitoring the load and running status of the platform, maintaining the database, and supplementing manually if necessary database.

Engineers are the executors of test tasks in the test management cloud platform, save test data, submit test reports, and update test progress.

Project manager/department supervisor users can view the test tasks and progress of the project/department through the management platform, and have the authority to create/edit test tasks. They are the publishers and supervisors of test tasks.

Senior executive users can view all test task statistics and monthly/annual reports through the management platform.

The database module is used to store user account data, OS/Driver and other software, and needs to be updated regularly.

The PXE module is set in the automatic function test module, and is used to generate the installation configuration of the test management cloud platform 10 and execute the installation of software such as OS/Driver.

The remote control is set in the automatic function test module, and the remote control authority is open to the engineer user, and the engineer operates the machine to be tested on the OA computer for functional testing.

The file system is used to store test data/logs, test reports, and execute the file sign-off process.

The online test machines are set up by engineers in advance and connected to the local area network, and engineers can connect multiple test machines at the same time.

In one embodiment, the test management cloud platform 10 further includes a forum module 16; the forum module 16 is used for users to upload technical problems encountered in the test process or provide solutions to technical problems, and combine the technical problems and corresponding solutions. The scheme is recorded in the technical dictionary.

Engineers can upload the technical problems they encounter to the forum module 16 in the process of executing the project test, and can also answer the technical questions raised by other engineers in the forum module 16, and provide the technology to solve the technical problems. After the technical problem is successfully answered, the technical problem and the corresponding technical solution are entered into the technical dictionary; the technical dictionary records each technical problem and the corresponding solution, forming an effective question and answer (lesson&learn) database, And for engineers to consult or call. The setting of the forum module 16 can provide engineers with an online and centralized communication platform, and at the same time form a systematic management of technical problems and corresponding solutions, which helps to further reduce communication and learning costs.

In one embodiment, the test management cloud platform 10 further includes an extension module; the extension module is used to develop the extension function modules of the test management cloud platform 10, such as compatibility with third-party function modules, etc. The functional modules of the platform 10 are further developed.

In one embodiment, the database module 13 further includes a management unit; the management unit is used to manage the software in the database, including software entry and update.

There are many kinds of software required for project testing, and the software versions are constantly updated. Therefore, the software stored in the database module 13 can be maintained and managed through the management unit, such as adding new software installers or updating future software. The installer performs updates, etc., to maintain the validity of the software libraries in the database module 13 .

The automatic function test module 10 is a core module in the test management cloud platform 10 , and an exemplary workflow of the automatic function test module is shown in FIG. 3 .

In one embodiment, the automatic function test module 12 includes a task management unit, an automated test unit, a remote control unit and a recording unit; the task management unit is used to manage the test items, including establishing the test items and updating the status of the test items; The automated test unit is used to establish a communication connection with the test machine 30, generate the corresponding PXE installation configuration according to the software information required by the test item, and remotely install the corresponding software to the test machine 30; the remote control unit is used to After the test machine 30 is installed with the corresponding software, a remote control connection is established with the test machine 30 for the user to perform remote control of the test machine 30 to complete the test item; the recording unit is used to obtain the test machine 30 when the test is completed. The test data generated in the project process generates a test log and stores it in the database module 13 .

In one embodiment, in the automated testing unit, the software information required by the test item is a software list selected by the user through the web interface.

After the engineer logs into the automatic functional testing module 12, the engineer can manage the test items (item) through the task management unit, including obtaining the test task list, creating a new test item, etc. After the engineer confirms the test item that needs to be tested, the engineer enters The automated test unit selects the corresponding test machine 30 through the web interface, and selects the software to be installed through the web interface, the automated test unit establishes a connection with the corresponding test machine 30, and generates the corresponding PXE configuration according to the selected software, The software is remotely installed into the testing machine 30 . After the installation is completed, the installation completion message is fed back to the engineer through the web interface; at this time, the engineer establishes a remote control connection with the test machine 30 through the remote control unit, and controls the test machine 30 through the remote control to execute the test, and the test machine 30 After completing the test item, the test data log is automatically saved in the database module 13, and the status of the test item is updated.

For the management of test items in the task management unit, an exemplary workflow of the project management unit is shown in Figure 4; in the project management unit, test items (item) can be created by engineers, or by supervisors or administrators. , in which the test project can be created by creating a new method, or it can be assigned by the administrator to the designated engineer for execution; when the engineer starts to execute a test project, the status displayed by the test project changes to "Testing" "Medium"; after the engineer completes the functional test through the automated test unit, update the status of the test project and upload the corresponding test report, the project management unit will send the test report to the supervisor terminal, and the supervisor will review the test report and update the test project The status is "Test Complete".

For the workflow of the automated test unit, an exemplary workflow of the automated test unit is shown in Figure 5; the engineer can log in to the WEB front-end through a computer or mobile terminal, and after selecting the designated test machine 30 through the web interface, the engineer can The interface is connected to the designated test machine 30. According to the needs of different test machines 30 and test items, the engineer selects the corresponding software (including OS\Driver\BMC\Tool) through the web interface to generate the corresponding PXE configuration, which is set by The automated testing unit starts the remote installation, and installs the corresponding software into the designated testing machine 30 . After the installation is completed, the remote control unit is used to enter the remote control mode, and the test software tool is run in the test machine 30 to perform the function verification test. And after the test is completed, the test data and test log generated by the test machine 30 are acquired. And disconnect the connection with the testing machine 30 after the data is acquired.

The above OS is the operating system. According to the type of different test machines 30 (server) or the operating environment of the test software, different operating systems such as Linux7.2, Linux7.6, CentOS, Windows Server, etc. can be selected; the above-mentioned BMC For the configuration parameters of the server BMC (Baseboard Manager Controller, baseboard management controller), for example, in the server cooling test, the server fan module can be turned on and off by updating the BMC; the above Driver is the driver, according to To run the server, you need to select drivers for related components such as GPU, NIC, MOC, and HBA. The above tools are test tool software, including ilvss, BurnIn, Nvqual and other test tools.

Taking the stress test of the server as an example, the above-mentioned management and testing cloud platform of the present invention is further described as follows: In an application scenario, the engineer logs into the management and testing cloud platform through the OA computer, and after entering the automatic function testing module 12, establishes The test item of the stress test for the server, and according to the test item, select the corresponding server device from the web interface and check the relevant software, and the test management cloud platform 10 establishes a communication connection with the server device, and the required software Remotely installed into this server device. After the installation is completed, the engineer establishes a remote control connection with the server device, and the remote control server device performs the test project. For the server stress test, the control server will run all the hardware (CPU\GPU, etc.) at full load. The sensor on the server equipment records the temperature data of each component in the server as the test data of the test project. The engineer can optimize the heat dissipation structure of the server according to the obtained temperature data and change the relevant design, which is conducive to further improving the performance of the server. Design is optimized. After the test is completed, the engineer organizes the test report from the data log output by the server and the analysis results obtained from the data, uploads the test report to the management and test cloud platform, and binds and stores it with the test project as a server device. The basis for optimization, design and adjustment.

In another application scenario, the test item can also be used to test the performance of a single cooling module of the server, for example, a drop test of the server equipment, to analyze the comparison data of the cooling performance of a specific cooling module before and after the drop test .

In the above embodiment, the test management cloud platform of the present invention has the following advantages: an efficient working mode. For engineers, the functional verification of the machine only needs to log in to the user terminal 20 for remote operation, especially in the scenario where multiple machines are tested at the same time, one engineer can operate multiple machines, which greatly improves the test efficiency of functional verification.

Extremely low learning and training costs. Engineers do not need to memorize and learn the steps and commands of functional verification such as installing the system and installing the driver. They only need to select them on the WEB interface. For new employees, the training cost is greatly reduced.

Improve the level of test management. The test management cloud platform records the relevant information of each test, you can check the test progress, count the number of tests and the completion rate, which improves the management level.

Aiming at the test management cloud platform provided above, the present invention also provides a test management method. The test management is performed based on any of the above test management cloud platforms. The method includes: logging in to the test management cloud platform; selecting a test machine according to a test item and software, so that the test management cloud platform establishes a communication connection with the test machine, and the software is remotely installed in the test machine; the test management cloud platform is used to remotely control the test machine to execute the test project.

It should be noted that the above-mentioned test management method operates on the above-mentioned test management cloud platform as shown in FIG. 1 , and the test management method can correspond to the specific operation process of the above-mentioned functional modules, especially the realization of FIG. 3 to FIG. 5 . The shown work flow will not be repeated here.

It should be noted that each functional unit/module in each embodiment of the present invention may be integrated into one processing unit/module, or each unit/module may exist physically alone, or two or two The above units/modules are integrated into one unit/module. The above-mentioned integrated units/modules may be implemented in the form of hardware, or may be implemented in the form of software functional units/modules.

From the above description of the embodiments, those skilled in the art can clearly understand and understand that the embodiments described herein can be implemented in hardware, software, firmware, middleware, code or any appropriate combination thereof. For hardware implementation, the processor may be implemented in one or more of the following units: Application Specific Integrated Circuit (ASIC), Digital Signal Processor (DSP), Digital Signal Processing Device (DSPD), Programmable Logic Device (PLD), Field Programmable Gate Arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, other electronic units designed to implement the functions described herein, or combinations thereof. For software implementation, part or all of the processes of the embodiments may be completed by instructing the relevant hardware through a computer program. When implemented, the above programs can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media includes both computer storage media and communication media, where communication media includes any medium that facilitates transfer of a computer program from one place to another. Storage media can be any available media that the computer can access. Computer readable media may include, but are not limited to, RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program code in the form of instructions or data structures and any other media that can be accessed by the computer.

Although the present invention is disclosed in the foregoing embodiments, it is not intended to limit the present invention. Changes and modifications made without departing from the spirit and scope of the present invention belong to the scope of patent protection of the present invention. For the protection scope defined by the present invention, please refer to the attached patent application scope.

10: Test Management Cloud Platform 11: Connect the module 12: Automatic functional test module 13:Database module 14: web front-end module 15: Management Modules 16: Forum Mods 20: User terminal 30: Test machine

The present invention will be further described by using the accompanying drawings, but the embodiments in the accompanying drawings do not constitute any limitation to the present invention. For those skilled in the art, without creative work, other Attached. FIG. 1 is a schematic diagram of the framework structure of an exemplary test management cloud platform of the present invention. FIG. 2 is a schematic diagram of the management structure of an exemplary test management cloud platform of the present invention. FIG. 3 is a schematic diagram of an exemplary workflow of an automatic function test module of the present invention. FIG. 4 is a schematic diagram of an exemplary workflow of the project management unit of the present invention. FIG. 5 is a schematic diagram of an exemplary workflow of an automated testing unit of the present invention.

10: Test Management Cloud Platform

11: Connect the module

12: Automatic functional test module

13:Database module

14: web front-end module

15: Management Modules

16: Forum Mods

20: User terminal

30: Test machine

Claims (9)

A test management cloud platform, the test management cloud platform includes a connection module, an automatic function test module and a database module; wherein the automatic function test module communicates with the connection module and the database module respectively connection; the connection module is used to establish a communication connection with the test machine; the database module is used to store the installation program of the software; and the automatic function test module is used to communicate with the The test machine establishes a communication connection, remotely installs the corresponding software into the test machine according to the software information required by the test item, and performs remote control on the test machine after the software installation is completed to execute all Describe the test item. The test management cloud platform according to claim 1, wherein the test management cloud platform further comprises a web front-end module; the web front-end module is used for a user to log in to the test management cloud platform through a web interface. The test management cloud platform of claim 1, wherein the software includes an operating system, a driver and a test tool. The test management cloud platform according to claim 1, wherein the automatic function test module includes a task management unit, an automatic test unit, a remote control unit and a recording unit; the task management unit is used to perform Management, including establishing the test item and updating the state of the test item; the automated test unit is used to establish a communication connection with the test machine, and generate a corresponding PXE installation configuration according to the software information required by the test item , and remotely install the corresponding software to the test machine; the remote control unit is used to establish a remote control connection with the test machine after the corresponding software is installed in the test machine, for The user performs remote control on the test machine to complete the test item; the recording unit is used to obtain the test data generated by the test machine in the process of completing the test item, generate a test log and store it in the test log. in the database module described above. The test management cloud platform according to claim 4, wherein in the automated test unit, the software information required by the test item is a software list selected by a user through a web interface. The test management cloud platform according to claim 1, wherein the test management cloud platform further includes a management module; the management module is used to manage the test items, including displaying, counting, and analyzing test item information. The test management cloud platform according to claim 1, wherein the test management cloud platform further includes a forum module; the forum module is used for users to upload technical problems encountered in the test process or provide solutions to technical problems , and record technical problems and corresponding solutions in the technical dictionary. The test management cloud platform according to claim 1, wherein the database module further includes a management unit; the management unit is used to manage the software in the database module, including software entry and update. A test management method, the method is performed based on the test management cloud platform described in any one of the above request items 1-8, the method includes: logging in to the test management cloud platform; selecting the test machine according to the test item and the software, so that the test management cloud platform establishes a communication connection with the test machine, and the software is remotely installed in the test machine; and the test machine is remotely controlled by the test management cloud platform The platform executes the test project.

Images