CN116541270B - Method and device for testing adaptation verification of operating system - Google Patents
Method and device for testing adaptation verification of operating system Download PDFInfo
- Publication number
- CN116541270B CN116541270B CN202310358567.5A CN202310358567A CN116541270B CN 116541270 B CN116541270 B CN 116541270B CN 202310358567 A CN202310358567 A CN 202310358567A CN 116541270 B CN116541270 B CN 116541270B
- Authority
- CN
- China
- Prior art keywords
- test
- tested
- report
- product
- generating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 268
- 238000012795 verification Methods 0.000 title claims abstract description 49
- 230000006978 adaptation Effects 0.000 title claims abstract description 43
- 238000000034 method Methods 0.000 title claims description 39
- 238000004458 analytical method Methods 0.000 claims abstract description 60
- 238000013515 script Methods 0.000 claims description 32
- 238000004590 computer program Methods 0.000 claims description 6
- 238000007405 data analysis Methods 0.000 claims description 4
- 230000002159 abnormal effect Effects 0.000 claims description 3
- 238000010998 test method Methods 0.000 abstract description 5
- 238000012544 monitoring process Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 8
- 230000003287 optical effect Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 230000009471 action Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000010200 validation analysis Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application provides an adaptation verification test method and device of an operating system, wherein when the test device is connected with a product to be tested, the test device collects relevant information of the product to be tested, and determines an operation report of the product to be tested according to the relevant information; the operation report is used for evaluating the operation integrity of the test case corresponding to the product to be tested; generating analysis data corresponding to the test case according to the operation report and the related information; and generating an adaptation verification test report result according to the operation report and the analysis data. According to the scheme, various intelligent operating system debugging bridges and device connectors integrated through automatic operation are tried to be connected with different operating systems, an operating system of a test object is not required to be known in advance, and then a corresponding debugging bridge and a corresponding testing tool are manually found according to the type of the operating system, so that full-automatic test of plug and play is realized under the condition that the type of the operating system of the test object is not required to be known.
Description
Technical Field
The application relates to the field of system testing, in particular to a method and a device for testing the adaptation verification of an operating system.
Background
The existing operating system test needs to know the type and version of the operating system of the test object in advance, then the corresponding configuration can be carried out, finally a test report is generated, and when a large number of products with different product forms and different operating systems are required to be tested by the operating system, the test efficiency is lower.
Disclosure of Invention
In view of the foregoing, the present application has been developed to provide a method and apparatus for testing the fit verification of an operating system that overcomes or at least partially solves the foregoing, comprising:
an adaptation verification test method of an operating system, the method relates to a test device and a product to be tested, and comprises the following steps:
when the testing device is connected with the product to be tested, the testing device collects relevant information of the product to be tested and determines an operation report of the product to be tested according to the relevant information; the operation report is used for evaluating the operation integrity of the test case corresponding to the product to be tested;
generating analysis data corresponding to the test case according to the operation report and the related information;
and generating an adaptation verification test report result according to the operation report and the analysis data.
Further, the step of determining the operation report of the product to be tested according to the related information includes:
determining the operation information of the product to be tested according to the related information; the operation information comprises an operation condition and an operation log file;
and generating an operation report of the product to be tested according to the operation information.
Further, the step of determining the operation information of the product to be tested according to the related information includes:
determining a deployment path corresponding to the test case according to the related information;
and determining the operation information of the product to be tested according to the deployment path.
Further, the step of determining the deployment path corresponding to the test case according to the related information includes:
determining a test suite of a corresponding version of the product to be tested according to the related information; wherein the test suite is a set of the test cases;
and determining a corresponding deployment path according to the test case.
Further, the step of generating the operation report of the product to be tested according to the operation information includes:
and generating an operation report of the test case according to the deployment path and the operation condition.
Further, the analysis data comprises comparison data and solutions, and the solutions are in one-to-one correspondence with the test cases; the step of generating the analysis data corresponding to the test case according to the operation report and the related information comprises the following steps:
determining comparison data of the test cases according to the operation report;
and generating a solution corresponding to the test case according to the comparison data and the operation log file.
Further, the step of generating an adaptation verification test report result according to the operation report and the analysis data comprises the following steps:
and generating the adaptation verification test report result according to the operation report, the comparison data and the solution.
For realizing the application, the application also provides an adaptation verification test device of an operating system, wherein the device relates to a test device and a product to be tested, and is characterized by comprising:
the operation analysis module is used for acquiring related information of the product to be tested when the testing device is connected with the product to be tested, and determining an operation report of the product to be tested according to the related information; the operation report is used for evaluating the operation integrity of the test case corresponding to the product to be tested;
the data analysis module is used for generating analysis data corresponding to the test case according to the operation report and the related information;
and the report generation module is used for generating an adaptation verification test report result according to the operation report and the analysis data.
A computer device comprising a processor, a memory and a computer program stored on the memory and capable of running on the processor, which when executed by the processor implements the steps of a method of an operating system adaptation verification test as described above.
A computer readable storage medium having stored thereon a computer program which when executed by a processor implements the steps of a method of an operating system adaptation verification test as described above.
The application has the following advantages:
in the embodiment of the present application, compared with the problem that in the prior art, the operating system needs to know the operating system of the test object in advance, the present application provides a solution for configuring the test device and the test server through the debug bridge connection, so that the test device downloads the application program to be tested and the test script file from the test server, specifically: when the testing device is connected with the product to be tested, the testing device collects relevant information of the product to be tested and determines an operation report of the product to be tested according to the relevant information; the operation report is used for evaluating the operation integrity of the test case corresponding to the product to be tested; generating analysis data corresponding to the test case according to the operation report and the related information; and generating an adaptation verification test report result according to the operation report and the analysis data. According to the scheme, various intelligent operating system debugging bridges and device connectors integrated through automatic operation are tried to be connected with different operating systems, an operating system of a test object is not required to be known in advance, and then a corresponding debugging bridge and a corresponding testing tool are manually found according to the type of the operating system, so that full-automatic test of plug and play is realized under the condition that the type of the operating system of the test object is not required to be known.
Drawings
For a clearer description of the technical solutions of the present application, the drawings that are needed in the description of the present application will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained from these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of an adaptation verification test method of an operating system according to an embodiment of the present application;
FIG. 2 is a flowchart illustrating the steps of testing the fit verification of a testing device according to one embodiment of the present application;
FIG. 3 is a block diagram of an apparatus for testing the fit verification of an operating system according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a computer device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, features and advantages of the present application more comprehensible, the present application is described in further detail below with reference to the accompanying drawings and detailed description. It will be apparent that the embodiments described are some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
Referring to FIG. 1, there is shown a method for testing the fit verification of an operating system according to one embodiment of the present application, the method involving a testing device and a product to be tested;
comprising the following steps:
s110, when the testing device is connected with the product to be tested, the testing device collects relevant information of the product to be tested, and determines an operation report of the product to be tested according to the relevant information; the operation report is used for evaluating the operation integrity of the test case corresponding to the product to be tested;
s120, generating analysis data corresponding to the test case according to the operation report and the related information;
s130, generating an adaptation verification test report result according to the operation report and the analysis data.
In the embodiment of the present application, compared with the problem that in the prior art, the operating system needs to know the operating system of the test object in advance, the present application provides a solution for configuring the test device and the test server through the debug bridge connection, so that the test device downloads the application program to be tested and the test script file from the test server, specifically: when the testing device is connected with the product to be tested, the testing device collects relevant information of the product to be tested and determines an operation report of the product to be tested according to the relevant information; the operation report is used for evaluating the operation integrity of the test case corresponding to the product to be tested; generating analysis data corresponding to the test case according to the operation report and the related information; and generating an adaptation verification test report result according to the operation report and the analysis data. According to the scheme, various intelligent operating system debugging bridges and device connectors integrated through automatic operation are tried to be connected with different operating systems, an operating system of a test object is not required to be known in advance, and then a corresponding debugging bridge and a corresponding testing tool are manually found according to the type of the operating system, so that full-automatic test of plug and play is realized under the condition that the type of the operating system of the test object is not required to be known.
Next, a method of testing the fit verification of an operating system in the present exemplary embodiment will be further described.
In an embodiment of the present invention, referring to fig. 2, the test apparatus includes an information acquisition module, a test suite compiling configuration and deployment module, a test suite execution and status monitoring module, an intermediate result automatic analysis and generation module, a problem analysis comparison module, and a report automatic generation module; the information acquisition module is used for acquiring information such as an operating system version, a main chip and the like of the product to be tested through a debugging command; the test suite compiling configuration and deployment module is used for compiling the test suite corresponding to the system version and configuring and deploying the corresponding test suite; the test suite execution and state monitoring module is used for detecting the running condition of the equipment and the test script; the intermediate result automatic analysis and generation module is used for analyzing the integrity of the test case operation and generating an intermediate report; the problem analysis comparison module is used for analyzing the test cases and positioning solutions; the report automatic generation module is used for generating a report for the system test result.
Through the debugging bridge and the device connector of various intelligent operating systems integrated by automatic operation, connection with different operating systems is tried, any system can be directly accessed without being configured according to the corresponding system in advance, then test tasks are executed according to the steps of each module of the testing device, and finally an evaluation report and a problem solution are generated.
As described in step S110, when the testing device is connected with the product to be tested, the testing device collects related information of the product to be tested, and determines an operation report of the product to be tested according to the related information; the operation report is used for evaluating the operation integrity of the test case corresponding to the product to be tested.
In a specific embodiment, the evaluation products such as a finance digital service terminal, a development board or a cloud loudspeaker are connected with an information acquisition module, the information acquisition module tries to connect equipment through various integrated intelligent operating system debugging bridges and equipment connectors, after the connection is successful, information such as an operating system version, a main chip and the like is acquired through a debugging command, and the information is output to a test suite compiling configuration and deployment module.
It should be noted that the debug bridge is a command line tool with various functions, and is used for controlling the actions of downloading, installing, opening, testing, etc. of the application program running on the platform. The above actions may be specified by a preset script file. The debug bridge can help the user to view and debug any problems occurring in the device and program during the development and debug phases without affecting the normal operating state.
In one embodiment of the present invention, the specific process of determining the operation report of the product to be tested according to the related information in step S110 may be further described in conjunction with the following description.
Determining the operation information of the product to be tested according to the related information as follows; the operation information comprises an operation condition and an operation log file;
and generating an operation report of the product to be tested according to the operation information as described in the following steps.
In one embodiment of the present invention, the specific process of determining the operation information of the product to be tested according to the related information may be further described in conjunction with the following description.
Determining a deployment path corresponding to the test case according to the related information;
it should be noted that, a test suite (test suite) in software engineering is sometimes referred to as a verification suite (validation suite), which is a collection of many test cases, where a test case may be used to test whether a program works correctly, and the test suite includes many test cases, and generally will also have detailed descriptions about the test cases and their test purposes, system configuration information during testing, and steps to be performed before testing. A test script (Testing script) generally refers to a series of instructions for a specific test, where the instructions can be executed by an automated test tool, and the test script must be written corresponding to a corresponding test case, and the test script corresponds to a program written and recorded by an automated execution case.
As an example, determining a test suite of a corresponding version of the product to be tested according to the related information; wherein the test suite is a set of the test cases; and determining a corresponding deployment path according to the test case. Specifically, the test suite compiling configuration and deployment module compiles the test suite of the corresponding version according to the information such as the main chip and the operating system version output by the information acquisition module, and the test suite is automatically configured and deployed after the compiling is successful. After the test suite environment is prepared, the test suite compiling configuration and deployment module sends the environment path of the test suite to the test suite execution and state monitoring module and the intermediate result automatic analysis and generation module, and issues execution instructions to the test suite execution and state monitoring module.
In a specific implementation, if the operating system is openhard, the compiling script is executed by executing the instruction execution compiling script of +/build.sh product_name= < chip name > system_size= < operating system type >, and the corresponding version of the test suite is compiled, and after the compiling is successful, the output test case is output to the designated directory, so that the configuration and deployment of the test suite are completed. After the test suite environment is prepared, the test suite compiling configuration and deployment system sends the output directory path of the test case to the test suite execution and state monitoring module and the intermediate result automatic analysis and generation module, and issues run xxx execution instructions to the test suite execution and state monitoring module.
And determining the operation information of the product to be tested according to the deployment path as described in the following steps.
As an example, a test suite execution and state monitoring module is connected with the product to be tested, reads files such as an adaptation verification test script under a test case output catalog, executes the test scripts one by one, continuously detects the running conditions of equipment and the test scripts, runs all the test scripts to obtain running information of the product to be tested, and outputs the running information to an intermediate result automatic analysis and generation module; the running information comprises the running condition and a running log file of the product to be tested.
In an embodiment of the present invention, the specific process of "generating the operation report of the product to be tested according to the operation information" may be further described in conjunction with the following description.
And generating an operation report of the test case according to the deployment path and the operation condition as described in the following steps.
As an example, the automatic analysis and generation module of intermediate results reads the test script under the test case output directory and the results output by the test suite execution and state monitoring module, namely the running condition, analyzes the running integrity of the test case and generates an intermediate result report, namely the running report; the operation report is used for evaluating the operation integrity of the test case corresponding to the product to be tested.
In a specific implementation, the automatic analysis and generation module of intermediate results reads the test script under the test case output directory and the html result file output by the test suite execution and state monitoring module, and analyzes the integrity of test case operation and generates an intermediate result report by comparing html test items and test script names.
And step S120, generating analysis data corresponding to the test case according to the operation report and the related information.
In an embodiment of the present invention, the specific process of "generating the analysis data corresponding to the test case according to the operation report and the related information" in step S120 may be further described in conjunction with the following description.
Determining comparison data of the test cases according to the operation report;
and generating a solution corresponding to the test case according to the comparison data and the operation log file as described in the following steps.
The analysis data includes comparison data and solutions, the solutions are in one-to-one correspondence with the test cases, and the problem analysis comparison module stores a problem analysis and solution database.
As an example, according to the integrity report of test cases obtained by comparing html test items and test script names, test cases which are not passed, abnormal, failed and the like after comparison and corresponding operation log files are sent to a problem analysis comparison module, so as to obtain comparison data of the test cases, and the problem analysis comparison module positions and locks corresponding solutions according to the comparison data and the operation log files in the operation information.
In a specific implementation, the operation report is sent to an automatic generation module of the adaptation verification report, and meanwhile, test cases which are failed, abnormal, failed and the like after comparison and corresponding operation log files are sent to a problem analysis comparison module. The problem analysis comparison module traverses the test case list to be analyzed, reads corresponding test case analysis and solution information from the problem analysis and solution database, and if a certain test case has a plurality of potential problem branches, the problem analysis comparison module further locks the problem points by retrieving key information in the log file to position the solution, and finally issues the problem analysis result and the solution to the automatic generation module of the adaptation verification report.
And generating an adaptation verification test report result according to the operation report and the analysis data as shown in the step S130.
In one embodiment of the present invention, the specific process of "generating an adaptation verification test report result from the operation report and the analysis data" described in step S130 may be further described in connection with the following description.
And generating the adaptation verification test report result according to the operation report, the comparison data and the solution as follows.
In a specific implementation, the automatic generation module of the adaptation verification report integrates and typesets information of the operation report issued by the automatic analysis and generation module of the intermediate result, the problem analysis result issued by the problem analysis comparison module (namely the comparison data) and the solution, and generates a final adaptation verification test report according to the well-configured adaptation verification test report template.
For the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points.
Referring to FIG. 3, there is shown an operating system adaptation verification test apparatus provided in an embodiment of the present application, the apparatus involving a test apparatus and a product to be tested;
the method specifically comprises the following steps:
an operation analysis module 310, configured to, when the testing device is connected to the product to be tested, collect related information of the product to be tested, and determine an operation report of the product to be tested according to the related information; the operation report is used for evaluating the operation integrity of the test case corresponding to the product to be tested;
the data analysis module 320 is configured to generate analysis data corresponding to the test case according to the operation report and the related information;
and a report generating module 330, configured to generate an adaptation verification test report result according to the operation report and the analysis data.
In one embodiment of the present invention, the operation analysis module 310 includes:
the operation information determining submodule is used for determining the operation information of the product to be tested according to the related information; the operation information comprises an operation condition and an operation log file;
and the operation report generation sub-module is used for generating an operation report of the product to be tested according to the operation information.
In an embodiment of the present invention, the operation information determining sub-module includes:
the configuration deployment unit is used for determining a deployment path corresponding to the test case according to the related information;
and the information determining unit is used for determining the operation information of the product to be tested according to the deployment path.
In one embodiment of the present invention, the configuration deployment unit includes:
the test suite determining subunit is used for determining a test suite of a corresponding version of the product to be tested according to the related information; wherein the test suite is a set of the test cases;
and the deployment path determination subunit is used for determining a corresponding deployment path according to the test case.
In one embodiment of the present invention, the operation report generating sub-module includes:
and the operation report generating unit is used for generating an operation report of the test case according to the deployment path and the operation condition.
In one embodiment of the present invention, the analysis data includes comparison data and solutions, the solutions corresponding one-to-one to the test cases; the data analysis module 320 includes:
the data comparison sub-module is used for determining comparison data of the test cases according to the operation report;
and the scheme positioning sub-module is used for generating a solution corresponding to the test case according to the comparison data and the operation log file.
In one embodiment of the present invention, the report generating module 330 includes:
and the test report generation sub-module is used for generating the adaptation verification test report result according to the operation report, the comparison data and the solution.
Referring to fig. 4, a computer device of an adaptation verification test method of an operating system according to the present invention may specifically include the following:
the computer device 12 described above is embodied in the form of a general purpose computing device, and the components of the computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, a bus 18 that connects the various system components, including the system memory 28 and the processing units 16.
Bus 18 represents one or more of several types of bus 18 structures, including a memory bus 18 or memory controller, a peripheral bus 18, an accelerated graphics port, a processor, or a local bus 18 using any of a variety of bus 18 architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus 18, micro channel architecture (MAC) bus 18, enhanced ISA bus 18, video Electronics Standards Association (VESA) local bus 18, and Peripheral Component Interconnect (PCI) bus 18.
Computer device 12 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by computer device 12 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 30 and/or cache memory 32. The computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer storage media. By way of example only, storage system 34 may be used to read from or write to non-removable, nonvolatile magnetic media (commonly referred to as a "hard disk drive"). Although not shown in fig. 4, a magnetic disk drive for reading from and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable non-volatile optical disk such as a CD-ROM, DVD-ROM, or other optical media may be provided. In such cases, each drive may be coupled to bus 18 through one or more data medium interfaces. The memory may include at least one program product having a set (e.g., at least one) of program modules 42, the program modules 42 being configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least one) of program modules 42 may be stored in, for example, a memory, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules 42, and program data, each or some combination of which may include an implementation of a network environment. Program modules 42 generally perform the functions and/or methods of the embodiments described herein.
The computer device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, camera, etc.), one or more devices that enable an operator to interact with the computer device 12, and/or any devices (e.g., network card, modem, etc.) that enable the computer device 12 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 22. Moreover, computer device 12 may also communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet, through network adapter 20. As shown in fig. 4, the network adapter 20 communicates with other modules of the computer device 12 via the bus 18. It should be appreciated that although not shown in fig. 4, other hardware and/or software modules may be used in connection with computer device 12, including, but not limited to: microcode, device drivers, redundant processing units 16, external disk drive arrays, RAID systems, tape drives, data backup storage systems 34, and the like.
The processing unit 16 executes programs stored in the system memory 28 to perform various functional applications and data processing, for example, to implement a concurrency control method for a columnar database according to an embodiment of the present invention.
That is, the processing unit 16 realizes when executing the program: when the testing device is connected with the product to be tested, the testing device collects relevant information of the product to be tested and determines an operation report of the product to be tested according to the relevant information; the operation report is used for evaluating the operation integrity of the test case corresponding to the product to be tested; generating analysis data corresponding to the test case according to the operation report and the related information; and generating an adaptation verification test report result according to the operation report and the analysis data.
In an embodiment of the present invention, the present invention further provides a computer readable storage medium, where a computer program is stored, where the program when executed by a processor implements a concurrency control method for a column-store database provided in all embodiments of the present application:
that is, the program is implemented when executed by a processor: when the testing device is connected with the product to be tested, the testing device collects relevant information of the product to be tested and determines an operation report of the product to be tested according to the relevant information; the operation report is used for evaluating the operation integrity of the test case corresponding to the product to be tested; generating analysis data corresponding to the test case according to the operation report and the related information; and generating an adaptation verification test report result according to the operation report and the analysis data.
Any combination of one or more computer readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the operator's computer, partly on the operator's computer, as a stand-alone software package, partly on the operator's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the operator computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., connected through the internet using an internet service provider). In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described by differences from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other.
While preferred embodiments of the present embodiments have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the present application.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or terminal device comprising the element.
The foregoing has described in detail the method and apparatus for testing the adaptation verification of an operating system provided in the present application, and specific examples have been applied to illustrate the principles and embodiments of the present application, where the foregoing examples are only for aiding in understanding the method and core idea of the present application; meanwhile, as those skilled in the art will have modifications in the specific embodiments and application scope in accordance with the ideas of the present application, the present description should not be construed as limiting the present application in view of the above.
Claims (7)
1. A method of operating system adaptation verification testing, the method involving a testing device and a product to be tested, comprising the steps of:
when the testing device is connected with the product to be tested through the integrated various intelligent operation system debugging bridges and device connectors, the testing device collects relevant information of the product to be tested through a debugging command and determines an operation report of the product to be tested according to the relevant information; specifically, compiling a test suite of a corresponding version for the product to be tested according to the related information; after compiling is successful, outputting the output test cases to a designated deployment path; determining the operation information of the product to be tested according to the deployment path, and generating an operation report of the product to be tested according to the operation information; the method specifically comprises the following steps: connecting the products to be tested, reading an adaptation verification test script file under a test case output catalog, executing the test scripts one by one, continuously detecting the running conditions of equipment and the test scripts, and running all the test scripts to obtain the running information of the products to be tested, wherein the running information comprises the running conditions and the running log file of the products to be tested; reading a test script under the test case output directory and an html result file output, and analyzing the running integrity of the test case and generating an intermediate result report by comparing the html test item and the test script name; the related information comprises an operating system version and main chip information, the operation report is used for evaluating the operation integrity of a test case corresponding to the product to be tested, and the test suite is a set of the test cases;
generating analysis data corresponding to the test case according to the operation report and the related information; the method specifically comprises the following steps: according to the test case running integrity report obtained by comparing html test items and test script names, comparing the test cases which are failed, failed and corresponding running log files after comparison to obtain comparison data of the test cases;
and generating an adaptation verification test report result according to the operation report and the analysis data.
2. The method of claim 1, wherein the step of generating an operation report of the product to be tested based on the operation information comprises:
and generating an operation report of the test case according to the deployment path and the operation condition.
3. The method of claim 1, wherein the analysis data comprises comparison data and solutions, the solutions corresponding one-to-one to the test cases; the step of generating the analysis data corresponding to the test case according to the operation report and the related information comprises the following steps:
determining comparison data of the test cases according to the operation report;
and generating a solution corresponding to the test case according to the comparison data and the operation log file.
4. A method according to claim 3, wherein the step of generating an adaptation verification test report result from the operation report and the analysis data comprises:
and generating the adaptation verification test report result according to the operation report, the comparison data and the solution.
5. An operating system adaptation verification test device, the device relating to a test device and a product to be tested, comprising:
the operation analysis module is used for acquiring related information of the product to be tested when the testing device is connected with the product to be tested through the integrated various intelligent operation system debugging bridges and the integrated various intelligent operation system debugging device connectors, and determining an operation report of the product to be tested according to the related information; specifically, compiling a test suite of a corresponding version for the product to be tested according to the related information; after compiling is successful, outputting the output test cases to a designated deployment path; determining the operation information of the product to be tested according to the deployment path, and generating an operation report of the product to be tested according to the operation information; the method specifically comprises the following steps: connecting the products to be tested, reading an adaptation verification test script file under a test case output catalog, executing the test scripts one by one, continuously detecting the running conditions of equipment and the test scripts, and running all the test scripts to obtain the running information of the products to be tested, wherein the running information comprises the running conditions and the running log file of the products to be tested; reading a test script under the test case output directory and an html result file output, and analyzing the running integrity of the test case and generating an intermediate result report by comparing the html test item and the test script name; the related information comprises an operating system version and main chip information, the operation report is used for evaluating the operation integrity of a test case corresponding to the product to be tested, and the test suite is a set of the test cases;
the data analysis module is used for generating analysis data corresponding to the test case according to the operation report and the related information; the method specifically comprises the following steps: according to the test case operation integrity report obtained by comparing html test items and test script names, comparing the test cases which are failed, abnormal and failed after comparison with corresponding operation log files to obtain comparison data of the test cases, and positioning and locking corresponding solutions according to the comparison data and the operation log files in the operation information;
and the report generation module is used for generating an adaptation verification test report result according to the operation report and the analysis data.
6. A computer device comprising a processor, a memory and a computer program stored on the memory and capable of running on the processor, which when executed by the processor implements a method of adaptation verification testing of an operating system as claimed in any one of claims 1 to 4.
7. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program which, when executed by a processor, implements a method of adaptation verification testing of an operating system according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310358567.5A CN116541270B (en) | 2023-03-27 | 2023-03-27 | Method and device for testing adaptation verification of operating system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310358567.5A CN116541270B (en) | 2023-03-27 | 2023-03-27 | Method and device for testing adaptation verification of operating system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116541270A CN116541270A (en) | 2023-08-04 |
| CN116541270B true CN116541270B (en) | 2024-01-02 |
Family
ID=87446009
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310358567.5A Active CN116541270B (en) | 2023-03-27 | 2023-03-27 | Method and device for testing adaptation verification of operating system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116541270B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117041114B (en) * | 2023-08-21 | 2024-07-09 | 深圳国家金融科技测评中心有限公司 | Automatic test method and device for terminal communication protocol safety test |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107168879A (en) * | 2017-05-23 | 2017-09-15 | 网易（杭州）网络有限公司 | The generation method and device of centralized configuration management System Test Report |
| CN109800123A (en) * | 2018-12-14 | 2019-05-24 | 深圳壹账通智能科技有限公司 | Automate electric quantity test method, apparatus, computer equipment and storage medium |
| CN109992494A (en) * | 2017-12-29 | 2019-07-09 | 北京京东尚科信息技术有限公司 | A kind of automatic test execution method and apparatus |
| CN110162977A (en) * | 2019-04-24 | 2019-08-23 | 北京邮电大学 | A kind of Android vehicle-mounted terminal system leakage location and method |
| CN112817853A (en) * | 2021-01-30 | 2021-05-18 | 北京奇保信安科技有限公司 | Automatic test method, system and electronic equipment |
| CN114253824A (en) * | 2020-09-22 | 2022-03-29 | Igg新加坡有限私人贸易公司 | Game compatibility testing method and system |
| CN115525545A (en) * | 2022-09-20 | 2022-12-27 | 浪潮思科网络科技有限公司 | Docker-based automatic testing method, system, equipment and medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI510918B (en) * | 2014-02-20 | 2015-12-01 | Wistron Corp | Method and system for quick testing and detectiing mobile devices |
| TWI566090B (en) * | 2014-10-17 | 2017-01-11 | Insyde Software Corp | Debugging firmware / software to produce tracking systems and methods, recording media and computer program products |
-
2023
- 2023-03-27 CN CN202310358567.5A patent/CN116541270B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107168879A (en) * | 2017-05-23 | 2017-09-15 | 网易（杭州）网络有限公司 | The generation method and device of centralized configuration management System Test Report |
| CN109992494A (en) * | 2017-12-29 | 2019-07-09 | 北京京东尚科信息技术有限公司 | A kind of automatic test execution method and apparatus |
| CN109800123A (en) * | 2018-12-14 | 2019-05-24 | 深圳壹账通智能科技有限公司 | Automate electric quantity test method, apparatus, computer equipment and storage medium |
| CN110162977A (en) * | 2019-04-24 | 2019-08-23 | 北京邮电大学 | A kind of Android vehicle-mounted terminal system leakage location and method |
| CN114253824A (en) * | 2020-09-22 | 2022-03-29 | Igg新加坡有限私人贸易公司 | Game compatibility testing method and system |
| CN112817853A (en) * | 2021-01-30 | 2021-05-18 | 北京奇保信安科技有限公司 | Automatic test method, system and electronic equipment |
| CN115525545A (en) * | 2022-09-20 | 2022-12-27 | 浪潮思科网络科技有限公司 | Docker-based automatic testing method, system, equipment and medium |
Non-Patent Citations (2)
| Title |
|---|
| PATS: A Parallel GUI Testing Framework for Android Applications;H. -L. Wen 等;《2015 IEEE 39th Annual Computer Software and Applications Conference》;210-215 * |
| 桌面linux操作系统整机兼容性测试方法研究;许侃 等;《数字技术与应用》(第05期);69-70, 73 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116541270A (en) | 2023-08-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109302522B (en) | Test method, test device, computer system, and computer medium | |
| US9886375B2 (en) | Automated execution of functional test scripts on a remote system within a unit testing framework | |
| US20150100296A1 (en) | Method and system for automated test and result comparison | |
| US9996454B1 (en) | Exemplary testing of software | |
| US20060265172A1 (en) | Heterogeneous multipath path network test system | |
| CN111427765B (en) | Method and system for automatically starting interface performance test realized based on jmeter | |
| CN113505073B (en) | Performance test method, device, equipment and medium of database | |
| US9542304B1 (en) | Automated operating system installation | |
| CN116541270B (en) | Method and device for testing adaptation verification of operating system | |
| US9779014B2 (en) | Resilient mock object creation for unit testing | |
| CN115658529A (en) | Automatic testing method for user page and related equipment | |
| CN117421217A (en) | Automatic software function test method, system, terminal and medium | |
| CN111274130A (en) | Automatic testing method, device, equipment and storage medium | |
| CN112506772B (en) | Web automatic test method, device, electronic equipment and storage medium | |
| CN110134559B (en) | BMC fault detection method, system and related components | |
| CN112084108A (en) | Test script generation method and device and related components | |
| US7765541B1 (en) | Minimization methodology | |
| CN115454856A (en) | Multi-application security detection method, device, medium and electronic equipment | |
| CN113986263A (en) | Code automation test method, device, electronic equipment and storage medium | |
| CN115168124A (en) | Stability test method and device for concurrently executing multiple files on hard disk, computer equipment and medium | |
| CN113868140A (en) | Automatic testing method and storage medium | |
| CN116820946B (en) | Method and device for automatically testing compatibility of target software | |
| CN117873650B (en) | Real-time running environment generation system, method, computer device and storage medium | |
| CN115757077B (en) | System clipping degree and service assembly minimization evaluation method | |
| CN116016270B (en) | Switch test management method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |