CN115185820A

CN115185820A - Test method and test device for system installer and computing equipment

Info

Publication number: CN115185820A
Application number: CN202210709065.8A
Authority: CN
Inventors: 徐新乐; 陈婷玉; 王梦可
Original assignee: Uniontech Software Technology Co Ltd
Current assignee: Uniontech Software Technology Co Ltd
Priority date: 2022-06-21
Filing date: 2022-06-21
Publication date: 2022-10-14

Abstract

The invention discloses a testing method of a system installer and a computing device, wherein the method executes an installation process of the testing system installer on an operating system in the computing device, the operating system has a plurality of installation modes, and the method comprises the following steps: creating a plurality of test kits corresponding to a plurality of installation modes of the operating system, wherein each installation mode comprises one or more corresponding installation steps and one or more test points; generating a test script based on a plurality of test kits corresponding to a plurality of installation modes; and running the test script, wherein each test suite in the test script is sequentially run so as to test the installation flow of the operating system by the system installer on the basis of each test suite and generate a test result. According to the technical scheme of the invention, the test result of the system installer can be ensured to be more accurate and comprehensive, and the test efficiency is improved.

Description

Test method and test device for system installer and computing equipment

Technical Field

The present invention relates to the field of testing technologies, and in particular, to a method and an apparatus for testing a system installer, and a computing device.

Background

Currently, operating system installers may provide an interface for configuring a system at the time of system installation for a user to configure the installed system. The system installer has many modules and check points, for example, the file system of the manual partition module includes 10 types, and the mount point includes 8 types. In order to fully cover the use scene of a user, the existing test method is a mode of manually traversing the combined operation of partition formats, mounting points, partition sizes and the like, the test method has low efficiency and accuracy, test points are easy to miss, and a long time is wasted in the process of waiting for the installation of an operating system.

For this reason, a test method of a system mounter is required to solve the problems in the above-described scheme.

Disclosure of Invention

To this end, the present invention provides a method and apparatus for testing a system mounter, which solve or at least alleviate the above problems.

According to an aspect of the present invention, there is provided a method for testing a system installer, executed in a computing device, for testing an installation procedure of the system installer on an operating system, the operating system having a plurality of installation modes, the method comprising: creating a plurality of test kits corresponding to a plurality of installation modes of an operating system, wherein each installation mode comprises one or more corresponding installation steps and one or more test points; generating a test script based on a plurality of test kits corresponding to a plurality of installation modes; and running the test scripts, wherein each test suite in the test scripts is sequentially run so as to test the installation flow of the operating system by the system installer on the basis of each test suite and generate a test result.

Optionally, in the method for testing a system installer according to the present invention, before creating a plurality of test suites corresponding to a plurality of installation manners of the operating system, the method includes: configuring corresponding virtual machine hardware information for each installation mode; and generating a corresponding test task based on the virtual machine hardware information corresponding to each installation mode and the corresponding test suite information.

Optionally, in the method for testing a system installer according to the present invention, the step of running each test suite in the test script to test the installation flow of the operating system by the system installer on a per test suite basis includes: running a test task corresponding to each test suite, and loading a corresponding virtual machine based on the hardware information of the virtual machine in the test task; and loading a corresponding test suite based on the test suite information in the test task, and running each test case in the test suite to test the installation flow of the system installer to the operating system.

Optionally, in the method for testing a system installer according to the present invention, the step of creating a plurality of test suites corresponding to a plurality of installation manners of the operating system comprises: acquiring one or more operation commands for the test suite corresponding to each installation mode; generating an expected result file corresponding to the test suite based on the one or more operational commands.

Optionally, in the method for testing a system installer according to the present invention, the step of testing an installation procedure of the system installer on the operating system on a per test suite basis includes: and running each test case in the test suite, and determining whether one or more installation steps and test points in the installation flow of the operating system pass the test or not based on the corresponding expected result file so as to generate a test result.

Optionally, in the method for testing a system installer according to the present invention, the virtual machine hardware information includes an architecture type, a disk format, a CPU core number, and a memory size of the virtual machine.

Optionally, in the test method of the system installer according to the present invention, the test point includes one or more of a language type, a partition type, a keyboard layout type, a time zone type, and a password strength type.

According to an aspect of the present invention, there is provided a test apparatus arranged in a computing device and adapted to test an installation procedure of an operating system by an installer of the system, the operating system having a plurality of installation modes, the apparatus comprising: the system comprises a creating module, a testing module and a judging module, wherein the creating module is suitable for creating a plurality of testing suites corresponding to a plurality of installation modes of the operating system, the testing suites comprise a plurality of testing cases, and each installation mode comprises one or more corresponding installation steps and one or more testing points; the generating module is suitable for generating a test script based on a plurality of test kits corresponding to a plurality of installation modes; and the test module is suitable for running the test scripts, wherein each test suite in the test scripts is sequentially run so as to test the installation process of the operating system by the system installer on the basis of each test suite and generate a test result.

According to an aspect of the invention, there is provided a computing device comprising: at least one processor; a memory storing program instructions, wherein the program instructions are configured to be executed by the at least one processor, the program instructions comprising instructions for performing the method for testing a system installer as described above.

According to an aspect of the present invention, there is provided a readable storage medium storing program instructions that, when read and executed by a computing device, cause the computing device to execute the method for testing a system installer as described above.

According to the technical scheme of the invention, the test method of the system installer is provided, the plurality of test kits corresponding to the plurality of installation modes of the operating system are created, the test script is generated based on the plurality of test kits corresponding to the plurality of installation modes, and then the installation flow of the operating system by the system installer can be tested based on the test cases in each test kit in the test script by executing the test script. Therefore, according to the test script generated by the invention, the installation flow of the automatic test system installer on the operating system can be realized, and the test script comprises the test suite and the test case which are suitable for various installation modes of various architectures, so that the test on the installation flow of the operating system can cover all test points corresponding to various architectures, the omission of the test points is avoided, the test result of the installation flow of the operating system on the system installer is ensured to be more accurate and comprehensive, the test efficiency is improved, and the labor cost and the time cost are saved.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

To the accomplishment of the foregoing and related ends, certain illustrative aspects are described herein in connection with the following description and the annexed drawings, which are indicative of various ways in which the principles disclosed herein may be practiced, and all aspects and equivalents thereof are intended to be within the scope of the claimed subject matter. The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description read in conjunction with the accompanying drawings. Throughout this disclosure, like reference numerals generally refer to like parts or elements.

FIG. 1 shows a schematic diagram of a computing device 100, according to one embodiment of the invention;

FIG. 2 shows a flow diagram of a method 200 for testing a system installer according to one embodiment of the invention;

FIG. 3 shows a schematic diagram of a testing device 300 according to one embodiment of the invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

FIG. 1 shows a schematic diagram of a computing device 100, according to one embodiment of the invention. As shown in FIG. 1, in a basic configuration, computing device 100 includes at least one processing unit 102 and system memory 104. According to one aspect, the processing unit 102 may be implemented as a processor depending on the configuration and type of computing device. The system memory 104 includes, but is not limited to, volatile storage (e.g., random access memory), non-volatile storage (e.g., read-only memory), flash memory, or any combination of such memories. In accordance with one aspect, an operating system 105 is included in system memory 104.

According to one aspect, the operating system 105 is, for example, adapted to control the operation of the computing device 100. Further, the examples are practiced in conjunction with a graphics library, other operating systems, or any other application program, and are not limited to any particular application or system. This basic configuration is illustrated in fig. 1 by those components within dashed line 108. According to one aspect, the computing device 100 has additional features or functionality. For example, according to one aspect, computing device 100 includes additional data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Such additional storage is illustrated in FIG. 1 by removable storage device 109 and non-removable storage device 110.

As stated hereinabove, according to one aspect, program modules are stored in the system memory 104. According to one aspect, the program modules may include one or more applications, the invention not being limited to the type of application, for example, the applications may include: email and contacts applications, word processing applications, spreadsheet applications, database applications, slide show applications, drawing or computer-aided applications, web browser applications, and the like. In an embodiment according to the present invention, the application program in the program module may include the system installer 150, and the testing apparatus 300 is configured to execute the testing method 200 of the system installer of the present invention, so as to test the installation flow of the operating system by the system installer 150.

According to one aspect, examples may be practiced in a circuit comprising discrete electronic elements, a packaged or integrated electronic chip containing logic gates, a circuit utilizing a microprocessor, or on a single chip containing electronic elements or microprocessors. For example, an example may be practiced via a system on a chip (SOC) in which each or many of the components shown in fig. 1 may be integrated on a single integrated circuit. According to one aspect, such SOC devices may include one or more processing units, graphics units, communication units, system virtualization units, and various application functions, all integrated (or "burned") onto a chip substrate as a single integrated circuit. When operating via an SOC, the functions described herein may be operated via application-specific logic integrated with other components of the computing device 100 on a single integrated circuit (chip). Embodiments of the invention may also be practiced using other technologies capable of performing logical operations (e.g., AND, OR, AND NOT), including but NOT limited to mechanical, optical, fluidic, AND quantum technologies. In addition, embodiments of the invention may be practiced within a general purpose computer or in any other circuit or system.

According to one aspect, computing device 100 may also have one or more input devices 112, such as a keyboard, mouse, pen, voice input device, touch input device, etc. Output device(s) 114 such as a display, speakers, printer, etc. may also be included. The foregoing devices are examples and other devices may also be used. Computing device 100 may include one or more communication connections 116 that allow communications with other computing devices 118. Examples of suitable communication connections 116 include, but are not limited to: RF transmitter, receiver and/or transceiver circuitry; universal Serial Bus (USB), parallel, and/or serial ports.

The term computer readable media as used herein includes computer storage media. Computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, or program modules. System memory 104, removable storage 109, and non-removable storage 110 are all examples of computer storage media (i.e., memory storage). Computer storage media may include Random Access Memory (RAM), read-only memory (ROM), electrically erasable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other article of manufacture that may be used to store information and that may be accessed by the computer device 100. In accordance with one aspect, any such computer storage media may be part of computing device 100. Computer storage media does not include a carrier wave or other propagated data signal.

According to one aspect, communication media is embodied by computer readable instructions, data structures, program modules, or other data in a modulated data signal (e.g., a carrier wave or other transport mechanism) and includes any information delivery media. According to one aspect, the term "modulated data signal" describes a signal that has one or more characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, radio Frequency (RF), infrared, and other wireless media.

In an embodiment according to the present invention, the computing device 100 is configured to perform the test method 200 of the system installer according to the present invention. Computing device 100 includes one or more processors, and one or more readable storage media storing program instructions that, when configured to be executed by the one or more processors, cause the computing device to perform method for testing 200 a system installer in an embodiment of the present invention.

According to an embodiment of the present invention, the testing apparatus 300 of the computing device 100 is configured to execute the testing method 200 of the system installer according to the present invention. The testing apparatus 300 includes a plurality of program instructions for executing the testing method 200 of the system installer of the present invention, and these program instructions may instruct the processor to execute the testing method 200 of the system installer of the present invention, so that the computing device 100 implements the installation flow of the operating system by the automated testing system installer by executing the testing method 200 of the system installer of the present invention.

Fig. 2 shows a flowchart of a method 200 for testing a system installer according to an embodiment of the invention. The method 200 is suitable for execution in a testing apparatus of a computing device (the aforementioned computing device 100).

It should be noted that the operating system has a plurality of installation modes. Specifically, the system installer provides multiple ways of installing the operating system. The operating system can be installed in the computing equipment with various CPU architectures based on various installation modes by using the system installer, wherein each architecture can correspond to various installation modes respectively.

As shown in FIG. 2, the method 200 includes steps S210-S230.

Before step S210 is executed, by building an OpenQA service, a virtual machine of a corresponding architecture is configured for each installation manner of the operating system, and specifically, corresponding virtual machine hardware information (a shader value) may be configured for each installation manner of the operating system that may be provided by the system installer. In this way, the corresponding virtual machine may be subsequently loaded based on the virtual machine hardware information.

Here, the virtual machine hardware information (the value of the flavour) may include information such as the architecture type of the virtual machine, the disk format, the number of CPU cores, and the memory size. For example, a virtual machine of an ARM architecture may be configured, and the architecture type of the virtual machine may be specifically aarch64.

Furthermore, the corresponding test task can be generated based on the hardware information of the virtual machine corresponding to each installation mode and the corresponding test suite information. Here, the test suite information includes a test suite name. In one implementation manner, the virtual machine hardware information corresponding to each installation manner and the corresponding test suite information are written into the job file in an associated manner, so that the association relationship between the virtual machines of different architectures and the test suites can be established, and the corresponding test tasks can be generated.

In step S210, a plurality of test suites corresponding to a plurality of installation manners of the operating system (which may be provided by the system installer) are created, and each test suite may contain a plurality of test cases. Here, each installation mode corresponds to one test suite. The test case may be a pm file.

It should be noted that the test case may define the content that needs to be verified in the process of the installation process of the test system installer on the operating system, so as to ensure that the code runs correctly. A test suite is a collection of multiple test cases.

In one implementation, when creating a plurality of test suites corresponding to a plurality of installation manners of an operating system, a test plan corresponding to each installation manner may be created first, for example, the test plan may be configured from a main.

It should be noted that each mounting method includes one or more mounting steps and one or more test points. One or more mounting steps and/or test points corresponding to different mounting manners are different. Each test case in the test suite may be used to detect one installation step in a corresponding installation. And the test suite corresponding to each installation mode is also the set of test cases corresponding to each installation step contained in the installation mode.

Specifically, the test point may include one or more of a language type, a partition mode type, a keyboard layout type, a time zone type, and a password strength type, for example. Each test point may include a plurality of different test points. For example, the partition manner types may include a first partition manner type, a second partition manner type, and a third partition manner type; the password strength types may include low password strength, medium password strength, high password strength, and the like.

In one implementation, the plurality of test cases in the test suite includes, for example: selecting a language test case, a hard disk partition test case, an installation process test case, an installation completion test case, configuring the test case after selecting the language, a keyboard layout test case, a time zone test case, an account setting test case, a login test case, a control center test case and the like.

In addition, in one embodiment, for each test suite, virtual machine hardware information (flavour value) corresponding to the test suite may be written in each test case contained in the test suite, so that the test case is associated with the virtual machine of the corresponding architecture. For example, in one implementation, the test case may be implemented as: openqa-client ISO post ISO = uos-20-desktop-amd64-20211114-1615.ISO distri = uos version = v20flagor = test arch = x86 \ "64-host http:// localhost.

In one embodiment, in creating a plurality of test suites corresponding to a plurality of installation manners of an operating system, one or more operation commands input by a user (tester) may be acquired for the test suite corresponding to each installation manner. Here, the operation command includes, for example, an inspection command, an operation of selecting an installation option, an assertion operation command, and the like. The user can input an operation command by a keyboard operation or a click operation by a mouse. In turn, an expected result file corresponding to the test suite is generated based on one or more operational commands input by the user. Here, the expected results file may be implemented as a feeds file.

It should be noted that the expected result file generated here is used for comparing with the automatically input operation command in the subsequent automatic test process of installing the operating system by running the test script to determine whether the automatically input operation command is accurate, so as to determine whether the installation process of the operating system based on the system installer passes.

For example, the operation command may include the following: get _ var (check if there is this variable, to control which piece of code the program executes); check _ var (check whether the value of a variable is a certain value, for executing the code of the corresponding module); set _ var (set the value of a certain variable to a certain value); assert _ screen (detect the presence of an element on the current screen); assert _ and _ click (detect if there is an element on the screen and click on the needls file area center); send _ key (system restore does not retain user data); type _ string (input of a character string or a number in a specified text box); mouse _ click "left" (left mouse click); mouse _ click "right" (right mouse click); mouse _ dclick (mouse double click event, double click left button); set _ var (set the value of a certain variable to a certain value).

Subsequently, in step S220, a test script is generated based on a plurality of test kits corresponding to the plurality of installation methods.

Further, a target image corresponding to a target operating system to be tested can be obtained, and the target image is stored in a predetermined directory, for example, a/var/lib/openqa/factor/iso. Then, all the mirror names in the test script are replaced by the target mirror names. In this way, the test script of the present invention can be utilized to test the installation flow of the target operating system.

Finally, in step S230, a test script is run, wherein each test suite in the test script is run in turn, so as to test the installation flow of the operating system by the system installer in turn based on each test suite, and generate a test result.

Here, during the operation of each test suite, each installation step and test point included in the corresponding installation method may be traversed, so as to perform a test on each installation step and test point in the process of installing the operating system based on the installation method corresponding to each test suite.

The test script is generated based on a plurality of test kits corresponding to a plurality of installation modes, so that the automatic test of the installation process of the operating system can be realized by executing the test script, and the test of the installation process of the operating system can cover all test points corresponding to the plurality of installation modes due to the test kits and the test cases corresponding to all the installation modes contained in the test script, thereby avoiding the omission of the test points.

In one embodiment, in step S230, by running the test task corresponding to each test suite, loading and running the corresponding virtual machine based on the virtual machine hardware information in the test task, and loading the corresponding test suite based on the test suite information in the test task and running each test case in the test suite, an installation flow of the test system installer on the operating system is implemented.

Specifically, in the process of running each test case in each test suite, a corresponding test task may be determined according to virtual machine hardware information (a flavour value) in the test case, and the test task is run. And then loading and operating the corresponding virtual machine based on the hardware information of the virtual machine in the test task, loading the corresponding test suite based on the test suite information in the test task, and operating each test case in the test suite to realize the installation flow of the test system installer on the operating system.

It can be understood that for each test suite and corresponding test task, testing of an installation process of an installation manner of an operating system can be achieved, including testing one or more installation steps and test points corresponding to the installation manner.

In one implementation, after the test script is generated, the expected result file may also be verified and updated. Specifically, by running the test script and running each test suite in the test script, the user can select alert _ screen and check _ screen timeout Confirm to control this test, and when the code in the test script is executed to the keywords such as alert _ screen or alert _ and _ click, and the like, after waiting for a predetermined time, an editing interface for editing the expected result file is popped up. The user can select one or more correct options corresponding to the installation steps and save the options, and corresponding operation commands can be input. Then, by judging whether the operation command (correct option) currently input by the user is consistent with the operation command in the expected result file, if so, continuing to run the next test suite; if not, updating the expected result file generated in the process of creating the test suite according to the operation command currently input by the user to generate a new expected result file, and saving the new expected result file into the Needles library for testing of the subsequent operating system installation. Subsequently, a "Resume test execution" button may be triggered to request to continue debugging until verification of expected result files corresponding to all test suites is completed.

In one embodiment, in step S230, in the process of running each test case in each test suite, it may be determined whether one or more installation steps and test points in the operating system installation flow pass the test based on the corresponding expected result file, and finally, the test on all installation steps and test points in the operating system installation flow is implemented, and a test result is generated.

FIG. 3 shows a schematic diagram of a testing device 300 according to an embodiment of the invention.

FIG. 3 shows a schematic diagram of a testing apparatus 300 according to an embodiment of the invention. The testing apparatus 300 is disposed in a computing device (e.g., the aforementioned computing device 100) and is adapted to perform the testing method 200 of the system installer of the present invention.

The testing apparatus 300 includes a creating module 310, a generating module 320, and a testing module 330, which are connected in sequence. The creation module 310 is adapted to create a plurality of test suites corresponding to a plurality of installation styles of an operating system, the test suites containing a plurality of test cases, wherein each installation style includes a respective one or more installation steps and one or more test points. The generating module 320 is adapted to generate a test script based on a plurality of test suites corresponding to a plurality of installation manners. The test module 330 is adapted to run test scripts, wherein each test suite in the test scripts is run in turn, so as to test the installation flow of the operating system by the system installer on the basis of each test suite and generate a test result.

It should be noted that the creating module 310 is configured to execute the aforementioned step S210, the generating module 320 is configured to execute the aforementioned step S220, and the testing module 330 is configured to execute the aforementioned step S230. Here, for the specific execution logic of the creating module 310, the generating module 320 and the testing module 330, reference is made to the description of steps S210 to S230 in the method 200, and details are not repeated here.

According to the test method of the system installer, the test scripts are generated based on the plurality of test kits corresponding to the plurality of installation modes of the operating system, and then the installation flow of the operating system by the system installer can be tested based on the test cases in each test kit in the test scripts by executing the test scripts. Therefore, according to the test script generated by the invention, the installation flow of the automatic test system installer on the operating system can be realized, and the test script comprises the test suite and the test case which are suitable for various installation modes of various architectures, so that the test on the installation flow of the operating system can cover all test points corresponding to various architectures, the omission of the test points is avoided, the test result of the installation flow of the operating system on the system installer is ensured to be more accurate and comprehensive, the test efficiency is improved, and the labor cost and the time cost are saved.

The various techniques described herein may be implemented in connection with hardware or software or, alternatively, with a combination of both. Thus, the methods and apparatus of the present invention, or certain aspects or portions thereof, may take the form of program code (i.e., instructions) embodied in tangible media, such as removable hard drives, U.S. disks, floppy disks, CD-ROMs, or any other machine-readable storage medium, wherein, when the program is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the invention.

In the case of program code execution on programmable computers, the mobile terminal generally includes a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. Wherein the memory is configured to store program code; the processor is configured to execute the testing method of the system installer of the present invention according to instructions in the program code stored in the memory.

By way of example, and not limitation, readable media includes readable storage media and communication media. Readable storage media store information such as computer readable instructions, data structures, program modules or other data. Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. Combinations of any of the above are also included within the scope of readable media.

In the description provided herein, algorithms and displays are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems may also be used with examples of this invention. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.

In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: rather, the invention as claimed requires more features than are expressly recited in each claim. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules or units or components of the devices in the examples disclosed herein may be arranged in a device as described in this embodiment or alternatively may be located in one or more devices different from the devices in this example. The modules in the foregoing examples may be combined into one module or may be further divided into multiple sub-modules.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

Additionally, some of the embodiments are described herein as a method or combination of method elements that can be implemented by a processor of a computer system or by other means of performing the described functions. A processor having the necessary instructions for carrying out the method or method elements thus forms a means for carrying out the method or method elements. Further, the elements of the apparatus embodiments described herein are examples of the following apparatus: the apparatus is used to implement the functions performed by the elements for the purpose of carrying out the invention.

As used herein, unless otherwise specified the use of the ordinal adjectives "first", "second", "third", etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.

While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this description, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as disclosed herein. Furthermore, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense with respect to the scope of the invention, as defined in the appended claims.

Claims

1. A method for testing a system installer, executed in a computing device, for testing an installation process of the system installer on an operating system, the operating system having a plurality of installation methods, the method comprising the steps of:

creating a plurality of test kits corresponding to a plurality of installation modes of the operating system, wherein the test kits comprise a plurality of test cases, and each installation mode comprises one or more corresponding installation steps and one or more test points;

generating a test script based on a plurality of test kits corresponding to a plurality of installation modes;

and running the test scripts, wherein each test suite in the test scripts is sequentially run so as to test the installation flow of the operating system by the system installer on the basis of each test suite and generate a test result.

2. The method of claim 1, wherein prior to creating a plurality of test suites corresponding to a plurality of installations of an operating system, comprising the steps of:

configuring corresponding virtual machine hardware information for each installation mode;

and generating a corresponding test task based on the virtual machine hardware information corresponding to each installation mode and the corresponding test suite information.

3. The method of claim 2, wherein the step of running each test suite in the test script to test the installation flow of the operating system by the system installer on a per test suite basis comprises:

running a test task corresponding to each test suite, and loading a corresponding virtual machine based on the hardware information of the virtual machine in the test task;

and loading a corresponding test suite based on the test suite information in the test task, and running each test case in the test suite to test the installation flow of the system installer to the operating system.

4. The method of any of claims 1-3, wherein creating a plurality of test suites corresponding to a plurality of installations of an operating system comprises:

acquiring one or more operation commands for the test suite corresponding to each installation mode;

generating an expected result file corresponding to the test suite based on the one or more operational commands.

5. The method of any of claims 1-4, wherein testing the installation flow of the operating system by the system installer on a per test suite basis comprises:

and running each test case in the test suite, and determining whether one or more installation steps and test points in the installation flow of the operating system pass the test or not based on the corresponding expected result file so as to generate a test result.

6. The method of any one of claims 2-5, wherein the virtual machine hardware information includes an architecture type, a disk format, a number of CPU cores, and a memory size of the virtual machine.

7. The method of any one of claims 1-6,

the test point comprises one or more of a language type, a partition mode type, a keyboard layout type, a time zone type and a password intensity type.

8. A testing apparatus arranged in a computing device and adapted to test an installation procedure of an operating system by an installer of the operating system, the operating system having a plurality of installation modes, the apparatus comprising:

the system comprises a creating module, a testing module and a judging module, wherein the creating module is suitable for creating a plurality of testing suites corresponding to a plurality of installation modes of the operating system, the testing suites comprise a plurality of testing cases, and each installation mode comprises one or more corresponding installation steps and one or more testing points;

the generating module is suitable for generating a test script based on a plurality of test kits corresponding to a plurality of installation modes;

and the test module is suitable for running the test scripts, wherein each test suite in the test scripts is sequentially run, so that the installation process of the operating system by the system installer is tested on the basis of each test suite, and a test result is generated.

9. A computing device, comprising:

at least one processor; and

a memory storing program instructions, wherein the program instructions are configured to be adapted to be executed by the at least one processor, the program instructions comprising instructions for performing the method of any of claims 1-7.

10. A readable storage medium storing program instructions that, when read and executed by a computing device, cause the computing device to perform the method of any of claims 1-7.