CN110471828B - Operating system testing method, device and equipment thereof - Google Patents

Operating system testing method, device and equipment thereof Download PDF

Info

Publication number
CN110471828B
CN110471828B CN201810437553.1A CN201810437553A CN110471828B CN 110471828 B CN110471828 B CN 110471828B CN 201810437553 A CN201810437553 A CN 201810437553A CN 110471828 B CN110471828 B CN 110471828B
Authority
CN
China
Prior art keywords
operating system
testing
application
test
service application
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810437553.1A
Other languages
Chinese (zh)
Other versions
CN110471828A (en
Inventor
石晓海
秦承刚
张永超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201810437553.1A priority Critical patent/CN110471828B/en
Publication of CN110471828A publication Critical patent/CN110471828A/en
Application granted granted Critical
Publication of CN110471828B publication Critical patent/CN110471828B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3664Environments for testing or debugging software
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3696Methods or tools to render software testable
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The application provides an operating system testing method, an operating system testing device and equipment thereof, comprising the following steps: before the operation system to be tested is released, determining the business application of a specific scene needing to run in the operation system according to the deployment environment information; running business applications and related tests based on an operating system to serve as important supplements of a conventional operating system test flow; and determining the test result of the operating system according to the test result of the service application. According to the technical scheme, the problem of the operation system triggered by the service application can be preposed, a test system is formed together with the test set of the sub-field of the conventional operation system, the execution is automatically triggered, and the iteration period of the release of the operation system is quickened. The business application is an application related to business and a testing set thereof, the complex business scene and the testing environment can not cover the working pressure generated by the kernel of the operating system by the conventional operating system testing set, and the complex business scene and the testing environment are integrated into the testing flow of the general operating system, so that the release efficiency and the quality of the operating system are effectively improved.

Description

Operating system testing method, device and equipment thereof
Technical Field
The application relates to the field of Internet, in particular to an operating system testing method, an operating system testing device and equipment thereof.
Background
An Operating System (OS) is a program for managing and controlling hardware resources and software resources, and is basic System software directly running on a "bare computer", and other software needs to be run under the support of the Operating System. The operating system is an interface between a user and the device, and is also an interface between hardware and other software, and can manage hardware resources, software resources and data resources and provide various forms of user interfaces.
Because of the importance of operating systems, it is necessary to test the operating system, for example, to test whether an abnormality exists in the operating system itself, before the operating system is released. If the operating system is abnormal, repairing the operating system until the operating system is not abnormal, and releasing the operating system without the abnormality.
After the operating system is released, the operating system can be operated in a service environment, a plurality of service applications can be operated on the operating system, after the service applications are operated, the operating system and the service applications can be found to be not suitable, the operating system needs to be repaired and tested again, after the test is completed, the operating system is released again, and the operating system is likely to be repaired for many times if a large number of service applications are operated on the operating system, the test efficiency of the operating system is low, and the user experience is poor.
Disclosure of Invention
The application provides an operating system testing method, which comprises the following steps:
before an operating system to be tested is released, determining service application of a specific scene needing to run in the operating system according to environmental information;
running the business application based on the operating system, and testing the business application;
and determining the test result of the operating system according to the test result of the service application.
The application provides an operating system testing method, which comprises the following steps:
before an operating system to be tested is released, determining a plurality of business applications which need to run in the operating system according to deployment environment information, and leading an application scene of the business applications to a testing environment of the operating system as a testing link in the testing environment of the operating system, wherein a testing set of the business applications and a testing set of the operating system form a testing set; the business applications comprise a plurality of applications and business behaviors of the plurality of applications;
running the business application and the test flow of the business application based on the operating system;
and determining the test result of the operating system according to the test result of the service application.
The application provides an operating system testing device, the device includes:
the acquisition module is used for determining service application of a specific scene which needs to run in the operating system according to the environmental information before the operating system to be tested is released; the test module is used for running the business application based on the operating system and testing the business application; and the determining module is used for determining the test result of the operating system according to the test result of the service application.
The application provides an operating system testing device, the device includes: the system comprises an acquisition module, a configuration module and a test module, wherein the acquisition module is used for determining a plurality of business applications which need to run in an operating system according to deployment environment information before the operating system to be tested is released, and leading an application scene of the business applications to a test environment of the operating system as a test link in the test environment of the operating system, wherein a test set of the business applications and a test set of the operating system form a test set; the business applications comprise a plurality of applications and business behaviors of the plurality of applications; the test module is used for running the business application and the test flow of the business application based on the operating system; and the determining module is used for determining the test result of the operating system according to the test result of the service application.
The application provides an operating system test device, comprising: a processor and a machine-readable storage medium having stored thereon computer instructions that when executed by the processor perform the following: before an operating system to be tested is released, determining service application of a specific scene needing to run in the operating system according to environmental information;
running the business application based on the operating system, and testing the business application;
and determining the test result of the operating system according to the test result of the service application.
Based on the above technical solution, in the embodiment of the present application, before an operating system to be tested is released, a service application of a specific scenario that needs to be run in the operating system may be determined according to deployment environment information; running the business application and related tests (i.e. testing the business application) based on the operating system as an important supplement to the conventional operating system test flow; and determining the test result of the operating system according to the test result of the service application. In summary, the problem of the operating system triggered by the service application can be pre-set, and a one-stop operating system testing system is formed together with the conventional operating system sub-field testing set, so that the execution is automatically triggered, and the iteration period of the release of the operating system is quickened. Moreover, the service application is an application related to the service and a testing set thereof, the working pressure generated by complex service scenes and testing environments on the kernel of the operating system is not covered by the conventional operating system testing set, and the complex service scenes and testing environments are integrated into the testing flow of the general operating system, so that the release efficiency and the software quality of the operating system are effectively improved. Moreover, before the operation system is released, the operation system and the service application are not adapted, the operation system is repaired, the operation system problem triggered by the service application can be preposed, the problem is found in advance, the quality of the operation system is effectively ensured, the stability and compatibility of the operation system are improved, the problem solving efficiency and the release stability of the operation system are effectively improved, the release iteration period of the operation system is accelerated, the test time is shortened, the test efficiency of the operation system can be improved, the test resources can be saved, and the user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following description will briefly describe the drawings that are required to be used in the embodiments of the present application or the description in the prior art, and it is obvious that the drawings in the following description are only some embodiments described in the present application, and other drawings may also be obtained according to these drawings of the embodiments of the present application for a person having ordinary skill in the art.
FIG. 1 is a flow chart of an operating system test method in one embodiment of the present application;
FIGS. 2A and 2B are schematic views of application scenarios in one embodiment of the present application;
FIG. 3 is a flow chart of an operating system test method in another embodiment of the present application;
fig. 4 is a block diagram of an operating system test device in one embodiment of the present application.
Detailed Description
The terminology used in the embodiments of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to any or all possible combinations including one or more of the associated listed items.
It should be understood that although the terms first, second, third, etc. may be used in embodiments of the present application to describe various information, these information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, a first message may also be referred to as a second message, and similarly, a second message may also be referred to as a first message, without departing from the scope of the present application. Depending on the context, furthermore, the word "if" used may be interpreted as "at … …" or "at … …" or "in response to a determination".
The embodiment of the application provides an operating system testing method, which can be applied to operating system testing equipment, wherein the operating system testing equipment can comprise a PC (Personal Computer ), a tablet personal computer, a notebook computer, a mobile terminal, a smart phone and the like, and the type of the equipment is not limited.
Referring to fig. 1, a flow chart of an operating system testing method is shown, and the method may include:
step 101, before the to-be-tested operating system is released, determining the service application of the specific scene needing to run in the operating system according to the environment information. The specific scene is a service scene of a server which needs to run the operating system, is a complex scene, can be a large cluster and comprises a large number of service applications, is very complex, has a very complex service processing process, and is not limited.
Specifically, the environment information corresponding to the server that needs to run the operating system may be obtained, and the service application that needs to run the operating system in the specific scenario (such as a plurality of service applications included in the service scenario of the server and deployed in the service scenario of the server) may be determined according to the environment information. Wherein, the business application may include: and the business application which normally runs in the operating system of the last version.
In one example, the service applications may include a plurality of applications (i.e., APPs) and service behaviors of the plurality of applications (e.g., interactions of applications, processing of applications, etc., without limitation). The service application is an application related to the service, the condition of a test scene is very complex, the working pressure of the service application on the kernel of the operating system is very complex, and a large number of core applications can be included. For example, if a website needs to support service a, the service applications include all applications that implement service a, such as applications that support a registration function, applications that support a verification function, applications that support a retrieval function, applications that support picture data, and so on.
And 102, running the business application based on the operating system and testing the business application.
And step 103, determining the test result of the operating system according to the test result of the service application.
Wherein, determining the test result of the operating system according to the test result of the service application may further include: testing the operating system according to the test set of the operating system to obtain a test result of the test set; and determining the test result of the operating system according to the test result of the service application and the test result of the test set. For example, if the test result of the service application is abnormal, determining that the test result of the operating system is abnormal; or if the test result of the test set is abnormal, determining that the test result of the operating system is abnormal; or if the test result of the service application is abnormal and the test result of the test set is abnormal, determining that the test result of the operating system is abnormal; or if the test result of the service application is normal and the test result of the test set is normal, determining that the test result of the operating system is normal.
The method comprises the steps of determining whether a test result of at least one service application is abnormal according to a test result of the at least one service application, wherein the test result of the service application can be described as abnormal as long as the test result of at least one service application is abnormal for a plurality of service applications running in the operating system. In addition, if the test results of all the service applications are normal, it can be stated that the test results of the service applications are normal.
In one example, the above execution sequence is only given for convenience of description, and in practical application, the execution sequence between steps may be changed, which is not limited. Moreover, in other embodiments, the steps of the corresponding methods need not be performed in the order shown and described herein, and the methods may include more or less steps than described herein. Furthermore, individual steps described in this specification, in other embodiments, may be described as being split into multiple steps; various steps described in this specification, in other embodiments, may be combined into a single step.
In one example, after determining the test result of the operating system according to the test result of the service application, if the test result of the operating system is abnormal, the user may be prompted to repair the operating system, that is, the user modifies the code of the operating system, which is not limited, and then, the steps 101-103 are re-executed based on the repaired operating system. If the test result of the operating system is normal, the operating system can be issued.
In one example, after the test result of the operating system is determined according to the test result of the service application, after the operating system is released, the service application can be operated based on the released operating system, and the operated service application is tested, so that the test result of the service application is obtained, and the process is not limited.
In the above embodiments, the operating system may include, but is not limited to: linux operating system, windows operating system, android operating system and iOS operating system. Of course, the above-mentioned operating system is only a few examples, and the operating system is not limited thereto, and all operating systems are within the protection scope of the embodiments of the present application.
Based on the above technical solution, in the embodiment of the present application, a service application of a specific scenario that needs to run in an operating system to be tested is determined according to deployment environment information; running the business application and related tests (i.e. testing the business application) based on the operating system as an important supplement to the conventional operating system test flow; and determining the test result of the operating system according to the test result of the service application. In summary, the problem of the operating system triggered by the service application can be pre-set, and a one-stop operating system testing system is formed together with the conventional operating system sub-field testing set, so that the execution is automatically triggered, and the iteration period of the release of the operating system is quickened. Moreover, the service application is an application related to the service and a testing set thereof, the working pressure generated by complex service scenes and testing environments on the kernel of the operating system is not covered by the conventional operating system testing set, and the complex service scenes and testing environments are integrated into the testing flow of the general operating system, so that the release efficiency and the software quality of the operating system are effectively improved. Moreover, before the operation system is released, the operation system and the service application are not adapted, the operation system is repaired, the operation system problem triggered by the service application can be preposed, the problem is found in advance, the quality of the operation system is effectively ensured, the stability and compatibility of the operation system are improved, the problem solving efficiency and the release stability of the operation system are effectively improved, the release iteration period of the operation system is accelerated, the test time is shortened, the test efficiency of the operation system can be improved, the test resources can be saved, and the user experience is improved. Moreover, the service application is an application related to the service, the condition of the test scene is very complex, the working pressure of the service application on the kernel of the operating system is very complex, and a large number of core applications can be included, and the service scene can be a large cluster, so that the test of the complex service application can be integrated into the test process of the operating system to form a one-stop test flow.
In another example, an operating system testing method is further provided in an embodiment of the present application, where the method includes: before an operating system to be tested is released, determining a plurality of service applications which need to run in the operating system according to deployment environment information, and pre-setting application scenes of the service applications to a testing environment of the operating system to be used as a testing link in the testing environment of the operating system, wherein a testing set of the service applications and a testing set of the operating system form a testing set; the business application may include a plurality of applications and business behavior of the plurality of applications. Then, running the business application and the test flow of the business application based on the operating system; and determining the test result of the operating system according to the test result of the service application.
The method for testing the operating system (the operating system test may also be an operating system kernel test, and in this embodiment, the operating system test is taken as an example) is described in detail below with reference to a specific application scenario.
The CI (Continuous Integration ) mode is a software development mode, and the new characteristic of the software can be deployed in time through multi-frequency code integration, construction, testing and release, so that the iteration speed is increased. Based on the above, the operating system can be deployed in CI mode, i.e. aiming at the newly developed operating system, the processes of integrating the functional codes of the operating system (i.e. obtaining the operating system), testing the operating system, publishing the operating system, testing the service application, deploying the operating system on line, and the like can be performed. For example, after developing the first version of operating system a, the above-described process may be performed with respect to operating system a; after the second version of operating system B is developed, the above-described process may be performed for operating system B, and so on.
Referring to fig. 2A, in the application scenario of the present embodiment, during the integration of the functional codes of the operating system, an operating system developer (also referred to as an operating system kernel developer) may develop the code of the operating system, and store the code of the operating system into a code repository (i.e. code repository).
In the test process of the operating system, the operating system can be obtained from the code library, and the operating system is tested by utilizing a test set of the operating system to obtain a test result. If the test result is that the operating system is abnormal, the operating system developer is prompted that the operating system is abnormal, the operating system developer modifies the codes of the operating system and stores the codes of the operating system into a code base, then the modified operating system can be tested by utilizing a test set of the operating system to obtain a test result, and the like until the test result is that the operating system is normal. And if the test result is that the operating system is normal, executing the release process of the operating system.
During the publishing of the operating system, the operating system may be published to each business application to cause each business application to run on the operating system. For example, for a server that needs to run the operating system, assuming that the server is deployed with business application 1-business application 3, the operating system may also be published to business application 1-business application 3 to enable business application 1-business application 3 to run on the operating system.
In the testing process of the service application, the service application can be operated on the operating system, and the service application is tested by utilizing the testing set of the service application, so that a testing result is obtained. If the test result is that the operating system is abnormal, prompting the operating system developer of the operating system abnormality, modifying the code of the operating system by the operating system developer, and storing the code of the operating system into a code base. If the test result is abnormal, prompting the abnormal service application to a service application developer, modifying the code of the service application by the service application developer, and retesting the service application. And if the test result is that the operating system is normal and the service application is normal, obtaining the service application. When the test results of all the service applications are that the operating system is normal and the service applications are normal, the operating system is normal, and the deployment online process of the operating system is executed.
For example, the service application 1 may be run on the operating system, and the service application 1 is tested by using the test set of the service application 1, to obtain a test result. If the test result is that the operating system is abnormal, the operating system developer can be prompted to the operating system. If the test result is that the service application 1 is abnormal, the service application developer can be prompted that the service application 1 is abnormal. If the test result is that the operating system is normal and the service application 1 is normal, the service application 1 can be obtained and the service application 1 is output. However, the operating system cannot be described as normal at this time, and only when the test results of the service application 1, the service application 2 and the service application 3 are all the operating system normal and the service application is normal, the operating system can be described as normal, the deployment online process of the operating system is executed, otherwise, the operating system developer needs to be prompted that the operating system is abnormal.
During the deployment of the operating system on-line, the normal operating system may be deployed to the server.
It can be seen from the above process that, in the testing process of the operating system, the operating system is tested only by using the testing set of the operating system to obtain the test result, and the testing set of the operating system only includes the content related to the function of the operating system itself, however, many problems of the operating system come from the service environment after the release of the operating system, so the testing process of the operating system may not find the problems of the operating system.
For example, when the service application 1 is tested by using the test set of the service application 1 after the service application 1 is run in the operating system, it may be found that the operating system is abnormal, that is, the operating system cannot support the normal running of the service application 1, but the service application 1 itself has no problem, so that it is required to prompt the operating system developer for the operating system abnormality, modify the code of the operating system by the operating system developer, and store the code of the operating system in the code library. Then, referring to fig. 2A, it is necessary to re-execute a test procedure of an operating system, a release procedure of an operating system, and a test procedure of a business application. Assuming that 100 service applications need to run in the operating system, and that the testing processes of the 100 service applications all find that the operating system is abnormal, the above processes need to be repeated 100 times, the testing efficiency of the operating system is very low, the testing time is very long, and the user experience is very poor.
Different from the discovery, in the embodiment of the application, the test of the service application can be integrated into the test process of the operating system, so that related problems can be discovered in advance, and the problems of the operating system triggered by the test of the service application can be preposed into the test process of the operating system, thereby effectively ensuring the quality of the operating system.
Referring to fig. 2B, in another application scenario of the present embodiment, during the integration of the functional codes of the operating system, an operating system developer (also referred to as an operating system kernel developer) may develop the code of the operating system, and store the code of the operating system into a code library (i.e. codeposition).
In the test process of the operating system, the operating system can be obtained from the code library, and the operating system is tested by utilizing the test set of the operating system, so that the test result of the test set is obtained. And running the service application based on the operating system, and testing the service application to obtain a test result of the service application. And obtaining the test result of the operating system based on the test result of the test set and the test result of the service application. If the test result of the operating system is abnormal, prompting the operating system developer of the operating system abnormality, modifying the code of the operating system by the operating system developer, storing the code of the operating system into a code library, and then re-executing the test process of the operating system, so as to push until the test result of the operating system is normal. If the test result of the operating system is that the operating system is normal, executing the release process of the operating system.
The operating system is tested by using a test set of the operating system, and a test result of the test set is obtained, which may include: the method comprises the steps of firstly obtaining a test set of a pre-configured operating system, wherein the test set only comprises content related to the functions of the operating system, and the test set is used for testing the operating system and can be a test script which is used for testing whether the operating system is abnormal or not. And then, testing the operating system by using the test set to obtain a test result of the test set, wherein the test process is not limited, such as functional test or regression test of the operating system, and in addition, the test result of the test set is normal or abnormal.
The testing the service application to obtain a test result of the service application may include: the service application can be operated on the operating system, and the service application is tested by utilizing the test set of the service application, so that the test result of the service application is obtained. Specifically, for a plurality of service applications running in the operating system, if only one test result of the service application is abnormal, the test result of the service application is abnormal; if the test results of all the service applications are normal, the test results of the service applications are normal.
The application scenes of a plurality of business applications can be pre-arranged in the test environment of the operating system to serve as a test link in the test environment of the operating system, and the test set of the business applications and the test set of the operating system form a one-stop test set; therefore, the problem of the operation system triggered by the service application can be preposed, and a one-stop operation system test system is formed together with the sub-field test set of the conventional operation system, so that the execution is automatically triggered, and the iteration period of the release of the operation system is quickened. The service application is an application related to the service and a testing set thereof, the working pressure of complex service scenes and testing environments on the kernel of the operating system is not covered by the conventional operating system testing set, and the complex service scenes and testing environments are integrated into the testing flow of the general operating system, so that the release efficiency and the software quality of the operating system are effectively improved. The service application is an application related to the service, the condition of the test scene is very complex, the working pressure of the service application on the kernel of the operating system is very complex, and a large number of core applications can be included, and the service scene can be a large cluster, so that the test of the complex service application can be integrated into the test process of the operating system to form a one-stop test flow.
For example, the service application 1-the service application 3 may be run on the operating system, and the test set of the service application 1 is used to test the service application 1, so as to obtain a test result of the service application 1, where the test process is not limited, and the test result of the service application 1 is normal or abnormal. In addition, the service application 2 is tested by utilizing the test set of the service application 2, and a test result of the service application 2 is obtained; and testing the service application 3 by using the test set of the service application 3 to obtain a test result of the service application 3. Then, if the test result of any one or more business applications is abnormal, determining that the test result of the business applications is abnormal; if the test results of all the service applications are normal, determining that the test results of the service applications are normal.
The obtaining the test result of the operating system based on the test result of the test set and the test result of the service application may include: if the test result of the service application is abnormal, determining that the test result of the operating system is abnormal; or if the test result of the test set is abnormal, determining that the test result of the operating system is abnormal; or if the test result of the service application is abnormal and the test result of the test set is abnormal, determining that the test result of the operating system is abnormal; or if the test result of the service application is normal and the test result of the test set is normal, the test result of the operating system can be determined to be normal.
In one example, before running a business application based on an operating system and testing the business application, a business application may also be obtained that requires a particular scenario to run on the operating system. Specifically, the environment information corresponding to the server that needs to run the operating system may be obtained, and the service application that needs to run the operating system in the specific scenario (such as a plurality of service applications included in the service scenario of the server and deployed in the service scenario of the server) may be determined according to the environment information. For example, assuming that an operating system is deployed on-line in the deployment process of the operating system, the operating system may be deployed to the server a, environment information of the server a, that is, which service applications the server a will run, is acquired, assuming that the server a will run the service application 1-service application 3, the environment information of the server a is the service application 1-service application 3, and it is determined that the service application of the specific scenario that needs to run in the operating system is the service application 1-service application 3 according to the environment information. Of course, the business applications that need to run on the operating system may be obtained in other ways, without limitation.
In the above embodiment, the specific scenario is a service scenario of a server that needs to run an operating system, which is a complex scenario, and the service scenario may be a large cluster, including a large number of service applications, where the service scenario is very complex, and the service processing procedure of the service scenario is also very complex, and the service scenario is not limited. In addition, the service applications may include a plurality of applications and service behaviors of the plurality of applications (such as interaction of the applications, processing of the applications, etc.). The service application is an application related to the service, the test scene condition is very complex, the working pressure of the service application on the kernel of the operating system is very complex, and a large number of core applications can be included.
In one example, the business application may include: a business application that runs normally in the last version of the operating system, i.e., in the last version of the operating system, is normal.
For example, after the first version of operating system a is developed, business application 1-business application 3 (hereinafter, business application 1 is described as an example) can operate normally in operating system a, i.e., operating system a is normal, and business application 1 is also normal. Then, after the second version of operating system B is developed, the service application 1 that runs normally in the operating system a is obtained, so if the test result of the service application 1 is abnormal, since the service application 1 runs normally in the operating system a, but is abnormal in the operating system B, it can be stated that there is an abnormality in the operating system B, and repair of the operating system B is required.
According to the process, in the testing process of the operating system, the operating system is tested by utilizing the testing set of the operating system, and the service application is operated in the operating system to test the service application, so that the testing of the service application is integrated into the testing process of the operating system, problems are found in advance, the problems of the operating system triggered by the testing of the service application can be preposed into the testing process of the operating system, the quality of the operating system is effectively ensured, the problems are solved before the operating system is released, the problems are equivalent to the preposed problems found, the problem solving efficiency and the releasing stability of the operating system are effectively improved, and the iteration period of the operating system release is accelerated.
During the publishing of the operating system, the operating system may be published to each business application to cause each business application to run on the operating system. For example, for a server that needs to run the operating system, assuming that the server is deployed with business application 1-business application 3, the operating system may also be published to business application 1-business application 3 to enable business application 1-business application 3 to run on the operating system.
In the testing process of the service application, the service application can be operated on the operating system, and the service application is tested by utilizing the testing set of the service application, so that a testing result is obtained. If the test result is abnormal, prompting the abnormal service application to a service application developer, modifying the code of the service application by the service application developer, and retesting the service application. And if the test result is that the service application is normal, obtaining the service application. After all the business applications are normal, executing the deployment online process of the operating system.
It should be noted that, because the service application is already running in the operating system during the testing process of the operating system and the application degree is normal, when the service application is tested, the operating system abnormality will not occur in the test result, so that the operating system abnormality is prevented from being prompted to the operating system developer, that is, the code of the operating system does not need to be modified by the operating system developer, and the testing process of the operating system will not be re-executed.
In the deployment online procedure of the operating system, a normal operating system may be deployed to a server, and the server may run the business application 1, the business application 2, and the business application 3 on the operating system.
In the above application scenario, referring to fig. 3, a flowchart of an operating system testing method proposed in this embodiment is shown, where the method may be applied to an operating system testing device, and the method may include the following steps:
step 301, obtaining environment information corresponding to a server that needs to run an operating system to be tested.
Step 302, determining a business application of a specific scene required to run in the operating system according to the environment information. The service applications may include a plurality of applications (i.e. APPs) and service behaviors of the plurality of applications (such as interaction of applications, processing of applications, and the like, which are not limited).
For example, assuming that an operating system is deployed to the server a, environment information of the server a, that is, which service applications the server a will run, may be acquired, assuming that the server a will run the service application 1-service application 3, the environment information of the server a is the service application 1-service application 3, and it is determined that the service application of a specific scenario that needs to be run in the operating system is the service application 1-service application 3 according to the environment information. Of course, other manners of obtaining the business application that needs to run on the operating system may be used, which is not limited.
In one example, a business application may include: a business application that runs normally in the last version of the operating system, i.e., in the last version of the operating system, is normal. For example, after the first version of operating system a is developed, business application 1 may run normally in operating system a, i.e., operating system a is normal and business application 1 is also normal. After the second version of operating system B is developed, the service application 1 that runs normally in the operating system a is obtained, so if the test result of the service application 1 is abnormal, since the service application 1 runs normally in the operating system a, but is abnormal in the operating system B, it can be stated that the operating system B is abnormal, and repair of the operating system B is required.
Step 303, running the service application based on the operating system and testing the service application.
For example, an operating system can be obtained from a code library, a service application is run on the operating system, the service application is tested by using a test set of the service application, a test result of the service application is obtained, and the test process is not limited. The method comprises the steps that for a plurality of service applications running in the operating system, as long as one or more test results of the service applications are abnormal, the test results of the service applications can be abnormal; if the test results of all the service applications are normal, the test results of the service applications can be normal.
And step 304, determining the test result of the operating system according to the test result of the service application.
In one example, the operating system may be tested according to a test set of the operating system to obtain a test result of the test set, which is not limited in the test process; then, according to the test result of the service application and the test result of the test set, the test result of the operating system can be obtained.
Step 305, determining whether the test result of the operating system is normal. If so, step 306 may be performed, and if not (i.e., the operating system test results are abnormal), step 307 may be performed.
And 306, publishing the operation system, running the business application based on the published operation system, and testing the running business application, thereby obtaining a test result of the business application.
Referring to fig. 2B, a release process of an operating system, a test process of a service application, and a deployment online process of the operating system may be performed. And in the release process of the operating system, releasing the operating system to each business application, wherein each business application runs on the operating system. In the testing process of the business application, the business application is operated on an operating system, and the business application is tested by utilizing a testing set of the business application, so that a testing result is obtained; if the test result is abnormal service application, prompting the service application developer of abnormal service application, modifying the code of the service application by the service application developer, and retesting the service application. If the test result is that the service application is normal, the service application is obtained; after all the business applications are normal, executing the deployment online process of the operating system. The operating system may be deployed to the server during a deployment online process of the operating system.
Step 307, prompting the operating system developer of operating system exception, modifying the code of the operating system by the operating system developer, and re-executing step 303 based on the modified operating system, and the subsequent process is not described again.
Based on the above technical solution, in the embodiment of the present application, before the operating system issues, a service application that needs to be run in the operating system may be determined according to the environmental information, the service application is run based on the operating system, the service application is tested, and a test result of the operating system is determined according to a test result of the service application. Therefore, before the operation system is released, the operation system and the service application are not adapted, the operation system is repaired, the operation system problem triggered by the service application can be preposed, the problem is found in advance, the quality of the operation system is effectively ensured, the stability and compatibility of the operation system are improved, the problem solving efficiency and the release stability of the operation system are effectively improved, the release iteration period of the operation system is accelerated, the test time is shortened, the test efficiency of the operation system can be improved, the test resources can be saved, and the user experience is improved. The method can integrate the whole software stack from the bottom software of the operating system to each business application scene of the upper layer into the testing process of the operating system to form a one-stop testing flow, thereby improving the release efficiency and the software quality of the operating system.
Based on the same application concept as the method, the embodiment of the application further provides an operating system testing device, as shown in fig. 4, which is a structural diagram of the device, and the device includes:
the acquiring module 401 is configured to determine, according to environmental information, a service application of a specific scenario that needs to run in an operating system to be tested before the operating system to be tested is released; a testing module 402, configured to run the service application based on the operating system, and test the service application; a determining module 403, configured to determine a test result of the operating system according to the test result of the service application.
In one example, the obtaining module 401 is specifically configured to, when determining, according to the environmental information, a business application that needs to be executed by the operating system: acquiring environment information corresponding to a server which needs to run the operating system; determining service application of a specific scene which needs to be run in the operating system according to the environment information; wherein the business application comprises a plurality of applications and business behaviors of the plurality of applications; wherein the business application comprises: and the business application which normally runs in the operating system of the last version.
Based on the same application concept as the method, the embodiment of the application further provides an operating system testing device, which includes: a processor and a machine-readable storage medium; wherein the machine-readable storage medium has stored thereon a number of computer instructions which, when executed by the processor, perform the following: before an operating system to be tested is released, determining service application of a specific scene needing to run in the operating system according to environmental information; running the business application based on the operating system, and testing the business application; and determining the test result of the operating system according to the test result of the service application.
Based on the same application concept as the above method, the embodiments of the present application further provide a machine-readable storage medium, where a number of computer instructions are stored on the machine-readable storage medium, where the computer instructions when executed perform the following processes: before an operating system to be tested is released, determining service application of a specific scene needing to run in the operating system according to environmental information; running the business application based on the operating system, and testing the business application; and determining the test result of the operating system according to the test result of the service application.
Based on the same application concept as the method, the embodiment of the application further provides an operating system testing device, where the operating system testing device may include: the system comprises an acquisition module, a configuration module and a test module, wherein the acquisition module is used for determining a plurality of business applications which need to run in an operating system according to deployment environment information before the operating system to be tested is released, and leading an application scene of the business applications to a test environment of the operating system as a test link in the test environment of the operating system, wherein a test set of the business applications and a test set of the operating system form a test set; the business applications comprise a plurality of applications and business behaviors of the plurality of applications; the test module is used for running the business application and the test flow of the business application based on the operating system; and the determining module is used for determining the test result of the operating system according to the test result of the service application.
The system, apparatus, module or unit set forth in the above embodiments may be implemented in particular by a computer chip or entity, or by a product having a certain function. A typical implementation device is a computer, which may be in the form of a personal computer, laptop computer, cellular telephone, camera phone, smart phone, personal digital assistant, media player, navigation device, email device, game console, tablet computer, wearable device, or a combination of any of these devices.
For convenience of description, the above devices are described as being functionally divided into various units, respectively. Of course, the functions of each element may be implemented in one or more software and/or hardware elements when implemented in the present application.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present application may take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Moreover, these computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.

Claims (13)

1. A method of operating system testing, the method comprising:
before an operating system to be tested is released, determining service application of a specific scene needing to run in the operating system according to environmental information;
running the business application based on the operating system, and testing the business application; the running of the business application based on the operating system tests the business application, and the testing comprises the following steps: running the service application on the operating system, and testing the service application by utilizing a testing set of the service application to obtain a testing result of the service application;
and determining the test result of the operating system according to the test result of the service application.
2. The method of claim 1, wherein determining, based on the context information, a business application for a particular scenario that is required to run on the operating system comprises:
acquiring environment information corresponding to a server which needs to run the operating system;
determining service application of a specific scene which needs to be run in the operating system according to the environment information;
wherein the business application comprises a plurality of applications and business behaviors of the plurality of applications.
3. A method according to claim 1 or 2, characterized in that,
the business application comprises: and the business application which normally runs in the operating system of the last version.
4. The method of claim 1, wherein the step of determining the position of the substrate comprises,
the determining the test result of the operating system according to the test result of the service application comprises the following steps:
testing the operating system according to a testing set of the operating system to obtain a testing result of the testing set; and determining the test result of the operating system according to the test result of the service application and the test result of the test set.
5. The method of claim 4, wherein determining the test results of the operating system based on the test results of the business application and the test results of the test set comprises:
if the test result of the service application is abnormal, determining that the test result of the operating system is abnormal; or alternatively, the process may be performed,
if the test result of the test set is abnormal, determining that the test result of the operating system is abnormal; or alternatively, the process may be performed,
if the test result of the service application is abnormal and the test result of the test set is abnormal, determining that the test result of the operating system is abnormal; or alternatively, the process may be performed,
If the test result of the service application is normal and the test result of the test set is normal, determining that the test result of the operating system is normal.
6. The method according to claim 1 or 5, wherein after determining the test result of the operating system according to the test result of the service application, the method further comprises:
if the test result of the operating system is abnormal, prompting a user to repair the operating system;
and if the test result of the operating system is normal, releasing the operating system.
7. The method of claim 1, wherein after determining the test result of the operating system according to the test result of the business application, the method further comprises:
after the operation system is released, running a business application based on the released operation system;
and testing the running business application to obtain a test result of the business application.
8. The method of claim 1, wherein the operating system comprises: linux operating system, windows operating system, android operating system and iOS operating system.
9. A method of operating system testing, the method comprising:
Before an operating system to be tested is released, determining a plurality of business applications which need to run in the operating system according to deployment environment information, and leading an application scene of the business applications to a testing environment of the operating system as a testing link in the testing environment of the operating system, wherein a testing set of the business applications and a testing set of the operating system form a testing set; the business applications comprise a plurality of applications and business behaviors of the plurality of applications;
running the business application and the test flow of the business application based on the operating system; wherein the running the business application based on the operating system includes: running the service application on the operating system, and testing the service application by utilizing a testing set of the service application to obtain a testing result of the service application;
and determining the test result of the operating system according to the test result of the service application.
10. An operating system testing apparatus, the apparatus comprising:
the acquisition module is used for determining service application of a specific scene which needs to run in the operating system according to the environmental information before the operating system to be tested is released;
The test module is used for running the business application based on the operating system and testing the business application; the running the business application based on the operating system and testing the business application comprise the following steps: running the service application on the operating system, and testing the service application by utilizing a testing set of the service application to obtain a testing result of the service application;
and the determining module is used for determining the test result of the operating system according to the test result of the service application.
11. The apparatus of claim 10, wherein the device comprises a plurality of sensors,
the acquisition module is specifically used for determining a service application which needs to be run in the operating system according to the environment information: acquiring environment information corresponding to a server which needs to run the operating system;
determining service application of a specific scene which needs to be run in the operating system according to the environment information;
wherein the business application comprises a plurality of applications and business behaviors of the plurality of applications;
the business application comprises: and the business application which normally runs in the operating system of the last version.
12. An operating system testing apparatus, the apparatus comprising:
The system comprises an acquisition module, a configuration module and a test module, wherein the acquisition module is used for determining a plurality of business applications which need to run in an operating system according to deployment environment information before the operating system to be tested is released, and leading an application scene of the business applications to a test environment of the operating system as a test link in the test environment of the operating system, wherein a test set of the business applications and a test set of the operating system form a test set; the business applications comprise a plurality of applications and business behaviors of the plurality of applications;
the test module is used for running the business application and the test flow of the business application based on the operating system; wherein the running the business application based on the operating system includes: running the service application on the operating system, and testing the service application by utilizing a testing set of the service application to obtain a testing result of the service application;
and the determining module is used for determining the test result of the operating system according to the test result of the service application.
13. An operating system test device, comprising: a processor and a machine-readable storage medium having stored thereon computer instructions that when executed by the processor perform the following: before an operating system to be tested is released, determining service application of a specific scene needing to run in the operating system according to environmental information;
Running the business application based on the operating system, and testing the business application; the running of the business application based on the operating system tests the business application, and the testing comprises the following steps: running the service application on the operating system, and testing the service application by utilizing a testing set of the service application to obtain a testing result of the service application;
and determining the test result of the operating system according to the test result of the service application.
CN201810437553.1A 2018-05-09 2018-05-09 Operating system testing method, device and equipment thereof Active CN110471828B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810437553.1A CN110471828B (en) 2018-05-09 2018-05-09 Operating system testing method, device and equipment thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810437553.1A CN110471828B (en) 2018-05-09 2018-05-09 Operating system testing method, device and equipment thereof

Publications (2)

Publication Number Publication Date
CN110471828A CN110471828A (en) 2019-11-19
CN110471828B true CN110471828B (en) 2023-05-26

Family

ID=68503683

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810437553.1A Active CN110471828B (en) 2018-05-09 2018-05-09 Operating system testing method, device and equipment thereof

Country Status (1)

Country Link
CN (1) CN110471828B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111611159A (en) * 2020-05-13 2020-09-01 麒麟软件有限公司 Linux operating system test authentication flow management method
CN115952080B (en) * 2022-12-05 2023-08-29 安芯网盾(北京)科技有限公司 Agent limit condition stability test method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009002997A2 (en) * 2007-06-26 2008-12-31 Topcoder, Inc. System and method for distributed software testing
CN104182343A (en) * 2014-08-22 2014-12-03 工业和信息化部电子第五研究所 Performance test method and device for operating system
CN104360952A (en) * 2012-03-02 2015-02-18 北京奇虎科技有限公司 Software test system and software test method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8458666B2 (en) * 2008-10-22 2013-06-04 Oracle International Corporation Methods and systems for implementing a test automation framework for testing software applications on UNIX/LINUX based machines

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009002997A2 (en) * 2007-06-26 2008-12-31 Topcoder, Inc. System and method for distributed software testing
CN104360952A (en) * 2012-03-02 2015-02-18 北京奇虎科技有限公司 Software test system and software test method
CN104182343A (en) * 2014-08-22 2014-12-03 工业和信息化部电子第五研究所 Performance test method and device for operating system

Also Published As

Publication number Publication date
CN110471828A (en) 2019-11-19

Similar Documents

Publication Publication Date Title
CN106970873B (en) On-line mock testing method, device and system
CN110187914B (en) Application development method, system and device
CN106610839B (en) Method for issuing upgrade package, lightweight upgrade method, device and system
CN108400902B (en) Method, device and equipment for gray level test
US9513889B2 (en) System and method of automating installation of applications
CN110471828B (en) Operating system testing method, device and equipment thereof
CN107179982B (en) Cross-process debugging method and device
CN107357721B (en) Method and device for testing system
CN116775061A (en) Deployment method, device, equipment and storage medium of micro-service application
CN109542775B (en) Test script generation and execution method and device
US9262304B2 (en) Methods and systems for testing interactions between mobile applications
CN111367796B (en) Application program debugging method and device
CN114691496A (en) Unit testing method, unit testing device, computing equipment and medium
CN107766228B (en) Multi-language-based automatic testing method and device
CN110968333A (en) Configuration information replacement method and device, machine-readable storage medium and processor
CN111258873B (en) Test method and device
CN113626342A (en) Model online testing method and device
CN110888649B (en) Application deployment method, application baseline creation method and device
CN108255667B (en) Service monitoring method and device and electronic equipment
CN106815136B (en) Unit testing method and device
CN111813379B (en) Application deployment method and device, electronic equipment and computer readable storage medium
CN109446091B (en) Business entity object testing method and device
CN111858315B (en) Software debugging method, device, equipment and medium based on version management
CN115858012B (en) Program variable configuration method, device, electronic equipment and storage medium
CN112988460B (en) Data backup method and device for virtual machine

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant