CN110347085B - Automated test system, method, vehicle, and computer-readable medium - Google Patents
Automated test system, method, vehicle, and computer-readable medium Download PDFInfo
- Publication number
- CN110347085B CN110347085B CN201910640331.4A CN201910640331A CN110347085B CN 110347085 B CN110347085 B CN 110347085B CN 201910640331 A CN201910640331 A CN 201910640331A CN 110347085 B CN110347085 B CN 110347085B
- Authority
- CN
- China
- Prior art keywords
- test
- module
- management module
- devices
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
- G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
- G05B19/0428—Safety, monitoring
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/24—Pc safety
- G05B2219/24024—Safety, surveillance
Abstract
The embodiment of the invention provides an automatic test system, a method, a vehicle and a computer readable medium, wherein the automatic test system comprises a version control management module, at least two test devices with different test system platforms, which are connected with the version control management module, a test transfer module connected with the test devices, and a test management module with a service interface, which is connected with the test transfer module, the version control management module can respectively acquire system information of the test system platforms and determine the system versions corresponding to the system information, so that the test devices of a plurality of different test system platforms can be managed, meanwhile, the service interface arranged on the test management module can be reused for different test devices and test the test devices of a plurality of different test system platforms, therefore, cross-platform, multi-thread and multi-process automatic testing is realized.
Description
Technical Field
The present invention relates to the field of automated testing technologies, and in particular, to an automated testing system, an automated testing method, a vehicle, and a computer-readable medium.
Background
Internet eXchange Point (IXP), also known as IX. The internet is a global network formed by connecting a plurality of networks, and an internet switching center (IXP, IX), i.e. a switching point responsible for mutual communication between the different networks, is a key infrastructure of the internet.
The automated testing is the automation of software testing, and can run a system or an application program under a preset condition and evaluate a running result. By automatically testing the IXP, the labor, time or hardware resources can be effectively saved, and the testing efficiency is improved.
However, in the process of implementing the present invention, the inventors found that the following problems exist in the design of the automated test framework:
1. the structure is disordered, the test can not be carried out aiming at different test system platforms, and the function expandability is poor. The current automated testing framework cannot simultaneously test different testing system platforms, such as an Android system and a Linux system, and only a single testing system can be tested during testing.
2. There is a lack of a uniform way to configure management use cases. In the test process, test execution parameters are simply input, and the test of the test equipment is carried out, so that a uniform mode for configuring a management case is lacked, and the flexible and various configuration of a test plan cannot be realized.
3. The test reports and test log displays are not normative. After the automated test is finished, the test report generated by the test framework is simple, the test log display is incomplete, and the analysis of the test result by a tester and the test improvement are not facilitated.
4. The test frame operation platform has large limitation. The automatic test framework is often targeted and cannot test across the test platform, for example, the test framework running on the platform of the windows system cannot run on the Linux system, and the execution efficiency of the Linux system is significantly higher than that of the windows system, so that the efficiency of the automatic test is easily reduced.
5. There is a lack of management of the testing process. In the testing process, the corresponding testing result is often generated only after the test execution is finished, and the testing process cannot be correspondingly monitored.
Disclosure of Invention
In view of the above, embodiments of the present invention are proposed to provide an automated testing system and a corresponding automated testing method that overcome or at least partially solve the above-mentioned problems.
In order to solve the above problems, an embodiment of the present invention discloses an automated testing system, including a version control management module, at least two testing devices with different testing system platforms connected to the version control management module, a test transfer module connected to the testing devices, and a test management module with a service interface connected to the test transfer module, where the service interface is an interface for encapsulating testing functions of different testing system platforms;
the version control management module is used for respectively acquiring system information of the test system platform and determining a system version corresponding to the system information;
the test management module is used for configuring configuration files matched with test equipment of different system versions; sending a test execution instruction and the configuration file aiming at each test device to the test transfer module through the service interface;
the test transfer module is used for respectively sending each configuration file and the test execution instruction to corresponding test equipment;
the at least two test devices are used for respectively extracting test cases matched with the test devices from the configuration files and test execution parameters; and executing the test case and generating a test result by respectively adopting the test execution parameters.
Optionally, the test management module includes a configuration interface;
the configuration interface is used for acquiring a test plan collection aiming at the test equipment and test execution parameters aiming at the test case; generating the configuration file by adopting the test plan collection and the test execution parameters;
the test execution parameters comprise at least two of the IP address and the ID identification information of the test equipment, environment variable information, test time and test times.
Optionally, the configuration interface is an interface for searching a preset control on a display interface of the test equipment.
Optionally, the test transfer module is configured to:
in the test case execution process, performing event monitoring on a test flow and generating event monitoring information aiming at the test case;
the event monitoring information comprises at least two of test progress, error abnormity monitoring, test result analysis and log information.
Optionally, the test transfer module is further configured to:
respectively adopting the test results to generate test reports corresponding to the test devices, wherein the test results correspond to the test cases one by one;
and respectively sending the test report to the test management module.
Optionally, the method further comprises:
the service module library is used for packaging library files for executing the test function of the test system platform; and sending the library file to corresponding test equipment.
Optionally, the method further comprises:
and the plug-in module is used for determining a corresponding plug-in the test case execution process and executing the plug-in.
Optionally, the method further comprises:
and the configuration module is used for configuring a test plan collection aiming at the test equipment and writing the configuration file into the test report.
The embodiment of the invention also discloses an automatic test method, which relates to at least two test devices with different test system platforms, and comprises the following steps:
respectively acquiring system information of a test system platform of each test device, and determining a system version corresponding to the system information;
configuring a configuration file matched with test equipment of different system versions, and acquiring a test execution instruction aiming at each test equipment;
respectively sending the configuration file and the test execution instruction to corresponding test equipment through a preset service interface;
at least two test devices respectively extract test cases matched with the test devices and test execution parameters from the configuration files; and executing the test case by adopting the test execution parameters, and generating event monitoring information aiming at the test case and a test result.
Optionally, the configuring a configuration file for each of the test devices includes:
acquiring a test plan collection aiming at the test equipment and test execution parameters aiming at the test case;
generating the configuration file by adopting the test plan collection and the test execution parameters;
the test execution parameters comprise at least two of the IP address and the ID identification information of the test equipment, environment variable information, test time and test times.
Optionally, the method further comprises:
in the test case execution process, performing event monitoring on a test flow and generating event monitoring information aiming at the test case;
the event monitoring information comprises at least two of test progress, error abnormity monitoring, test result analysis and log information.
Optionally, the method further comprises:
and respectively adopting the test results to generate test reports corresponding to the test devices, wherein the test results correspond to the test cases one to one.
Optionally, the method further comprises:
packaging a library file for executing the test function of the test system platform;
and sending the library file to corresponding test equipment.
Optionally, the method further comprises:
and determining a corresponding plug-in the test case execution process, and executing the plug-in.
Optionally, also comprises
Configuring a collection of test plans for the test device, and writing the configuration file into a test report.
The embodiment of the invention also discloses a vehicle, which comprises:
one or more processors; and
one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the vehicle to perform one or more methods as described above.
Embodiments of the invention also disclose one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform one or more of the methods described above.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, the automatic test system comprises a version control management module, at least two test devices having different test system platforms connected to the version control management module, a test relay module connected with the test equipment, and a test management module connected with the test relay module and having a service interface, the system information of the test system platform can be respectively obtained through the version control management module, and the system version corresponding to the system information is determined, therefore, the test equipment of a plurality of different test system platforms can be managed, and simultaneously, through the service interface arranged on the test management module, the method can be reused in different test equipment, and test the test equipment of a plurality of different test system platforms, thereby realizing cross-platform, multi-thread and multi-process automatic test.
In addition, a test report at any moment in the test execution process can be obtained in real time, wherein the test cases correspond to the test results one to one, so that a tester can know the test condition in real time and stably run for 7 multiplied by 24 hours.
Drawings
FIG. 1 is a block diagram of an automated test system embodiment of the present invention;
FIG. 2 is a schematic diagram of an automated test framework of an embodiment of an automated test system of the present invention;
FIG. 3 is a flowchart illustrating the steps of a first embodiment of an automated testing method of the present invention;
FIG. 4 is a flowchart illustrating steps of a second embodiment of an automated testing method according to the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
Referring to fig. 1, a block diagram of an automated testing system according to an embodiment of the present invention is shown, and specifically, the automated testing system may include a version control management module 1, at least two testing devices 2 with different testing system platforms, which are connected to the version control management module 1, a test relay module 3 connected to the testing devices 2, and a test management module 4 connected to the test relay module 3 and having a service interface, where the service interface is an interface for encapsulating test functions of different testing system platforms;
the version control management module 1 is configured to respectively obtain system information of the test system platform and determine a system version corresponding to the system information;
the test management module 4 is used for configuring configuration files matched with the test equipment 2 of different system versions; sending the test execution instruction and the configuration file for each test device 2 to the test transfer module 3 through the service interface;
the test transfer module 3 is configured to send each configuration file and the test execution instruction to the corresponding test device 2;
the at least two test devices 2 are used for respectively extracting the test cases matched with the test devices 2 from the configuration files and the test execution parameters; and executing the test case and generating a test result by respectively adopting the test execution parameters.
In the embodiment of the present invention, as shown in fig. 2, a schematic diagram of an automated testing framework in an embodiment of an automated testing system of the present invention is shown, where the automated testing system may be an automated testing framework, and the testing framework may include a version control management module 1, a testing device 2, a test relay module 3, a test management module 4, and the like. The version control management module 1 may be connected to at least two test devices 2 having different test system platforms, the test relay module 3 may also be connected to at least two test devices 2 having different test system platforms, and the test relay module 3 may also be connected to at least one test management module 4 having a service interface.
In concrete realization, can encapsulate the test function of different test system platforms to the service interface in unison to register to test management module 4, when beginning the test, can pass through the system information of different test equipment 2, and automatic identification shifts to test transfer module 3, acquires corresponding service, thereby through encapsulating the test function of different test system platforms in unison to the service interface, and register to test management module 4, can make things convenient for the efficient extension to increase the test equipment 2 of different test system platforms.
In a specific implementation, the version control management module 1 may provide test codes of test cases for the test device 2. Specifically, the test code may include a code for connecting the test device 2 and the test relay module 3, an interactive code for connecting the test device 2 and the test relay module 3, a command line required for executing a test on the test device 2, and a parsing code for analyzing each parameter of the test, an operation code for displaying an interface (such as clicking, inputting, sliding, long-pressing, short-pressing, and sliding) by all simulators, a code for finding a control on the display interface of the test device 2 (such as sending a command line from the test relay module 3 to the test device 2, obtaining all information of the display interface, parsing the control according to the obtained information, finding a space and positioning coordinates, etc.), defining and developing a uniform external call interface, and satisfying different application scene requirements by configuring different parameters (such as finding different attribute information of the control, text finding, description finding, number lookup, etc., and determine whether a control exists, lookup for abnormal operation), etc.
Specifically, different test devices 2 may carry different test system platforms, for example, an Android system or a Linux system, and then the test code provided by the version control management module 1 may be used to obtain the system information of the test system platform corresponding to the test device 2 first when the test device 2 performs a test, so as to determine the system version corresponding to the system information of the test system platform.
In the embodiment of the present invention, the test management module 4 has a test case management function, and a tester can send a test execution instruction for the test equipment by using the test case management function of the test management module 4, and can also input the test execution instruction, or configure a test case configuration file for a planned test, and the like.
In a specific implementation, the test functions of different test devices 2 can be uniformly packaged to a service interface, and the service interface is registered to the test management module 4, wherein the test device 2 can be a test device carrying an Android system or a test device carrying a Linux system, before testing, after the version management control module determines the system version corresponding to the test device 2, the test management module 4 can obtain the system version corresponding to the test device 2 from the version control management module 1, and obtain the test functions corresponding to the system version through the service interface, so that the test functions required by different test system platforms can be uniformly packaged to the service interface of the test management module 4, and the services corresponding to the test system platforms can be obtained through the interface, thereby conveniently and efficiently expanding and increasing the test products of different system platforms, such as IOS systems, shift systems, etc.
In a specific implementation, the test execution command may be a start test command, a pause test command, an end test command, and the like. The configuration file can comprise a set of all test cases in the test plan and test execution parameters corresponding to all the test cases, and the configuration file is managed through the test management module 4, so that the test parameters of the test plan can be flexibly and variously configured, and the test cases can be managed in a unified mode.
In an optional embodiment of the present invention, the automated testing framework further includes a configuration module, and the configuration module may be configured to configure the test plan collection for the testing device 2, and write a configuration file into the test report, so as to facilitate tracing of information such as historical testing device case configuration. The test management module 4 is further provided with a configuration interface, and the configuration interface can be used for acquiring a test plan collection for the test equipment 2 and test execution parameters for the test case; the configuration file may then be generated using the collection of test plans and the test execution parameters. Wherein the test execution parameters include at least two of the IP address and the ID identification information of the test device 2, environment variable information, test time, and test times.
Specifically, if the test case combinations used by different test plans are different, a plurality of different test plans may be used as one test plan collection, the test management module 4 may obtain the test plan collection from the configuration module, may analyze the test plan collection to obtain the test case collection corresponding to the test equipment, then generates a configuration file for the test equipment according to the test case collection and the test execution parameters, and sends the configuration file to the configuration module, so that the configuration module writes the configuration file into a subsequent test report, thereby facilitating the tracing of information such as historical test equipment case configuration. The test execution parameters may include an IP address and ID identification information of the test device 2, environment variable information, test time, test times, and the like, and the environment variable information may include a serial port, an account password, auxiliary device information, Wifi, bluetooth, and the like.
Specifically, each test execution process corresponds to one configuration file, each configuration file may correspond to one test device 2, and the test devices 2 of different test system platforms may correspond to different configuration files, so that the test devices of different test system platforms may be tested through different configuration files, or different test devices of the same test system platform may be tested, thereby implementing automated testing of multiple threads and multiple processes between different system platforms and between different test devices. The configuration file may include a test plan (a stability test plan, a single-function test plan, a smoking test plan, and the like), a set of test cases matching the test plan, and test execution parameters corresponding to the test cases. When the test is executed, the configuration file can be used as an execution parameter and transmitted to the execution script, the test device 2 is enabled to execute the test execution command, then the test device 2 executes the script and can analyze the configuration file, the test case set and the corresponding test execution parameter are obtained, meanwhile, various plug-in functions are read and loaded, the test cases are executed, and the corresponding test results are generated.
In an example of the embodiment of the present invention, when the number of the test devices 2 is two, and the test devices include a first test device carrying an Android test platform and a second test device carrying a Linux test platform, the version management control module may first obtain system information of each test device 2 and determine a corresponding system version, and then the test management module 4 may obtain the system version corresponding to the test device 2 from the version control management module 1 and obtain a test function corresponding to the system version through the service interface, so that the test devices of different test system platforms may be conveniently and efficiently extended and added by encapsulating the test functions of different test system platforms to the service interface and registering the test functions to the test management module 4. Then, the tester can obtain a first configuration file for the Android testing platform and a second configuration file for the Linux testing platform through the test management module 4, and input a test execution command to test the testing equipment. The configuration file can be configured with the number of test cases, the test time, the test times and the like for the Android test platform or the Linux test platform.
In the embodiment of the present invention, the test relay module 3 may be a server, and after the test management module 4 may obtain the system version corresponding to the test device 2 from the version control management module 1 and obtain the test function corresponding to the system version through the service interface, the test relay module 3 may send the configuration file and the test execution command configured by the test management module 4 to the corresponding test device 2, and may also return the execution condition of the test case and the test result to the test management module 4.
In a specific implementation, the test relay module 3 may receive the test execution instruction and the configuration file sent by the test management module 4, then determine the test device 2 corresponding to the system version according to the service interface of the test management module 4, and send the configuration file and the test execution instruction to the corresponding test device 2.
In an example of the embodiment of the present invention, if the testing device 2 includes a first testing device carrying an Android testing platform and a second testing device carrying a Linux testing platform, after the version control management module 1 determines the system version corresponding to the testing device 2, the testing management module 4 may obtain the system version corresponding to the testing device 2 from the version control management module 1, and obtain the testing function corresponding to the system version through the service interface, and send the configuration file and the test execution to the test relay module 3, the test relay module 3 determines the testing device corresponding to the system version according to the service interface of the testing management module 4, such as determining the first testing device corresponding to the Android testing platform and the second testing device corresponding to the Linux testing platform, and then sends the configuration file one and the test execution command for the Android testing platform to the first testing device, and sending a second configuration file and a test execution command aiming at the Linux test platform to a second test device.
In the embodiment of the present invention, the configuration file and the test execution command may be received by at least two test devices 2, and then the test devices 2 may extract the test case and the test execution parameter matching with the test devices 2 from the configuration file, and execute the test case by using the test execution parameter, respectively, to generate the corresponding test result.
In a specific implementation, the test device 2 receives the configuration file and the test execution command, can analyze the configuration file according to the test execution command, and when the test execution command is a test starting command, can extract a test case and test execution parameters matched with the test device 2 from the configuration file, and execute the test case by using the test execution parameters to generate a corresponding test result; when the test execution instruction is a test pause instruction, pausing execution of the test case and generating a test result corresponding to the tested test case; and when the test execution instruction is the test ending instruction, ending the test and generating a corresponding test result.
In the embodiment of the present invention, the automated testing framework further includes a service module library and a plug-in module, where the service module library may be used to package a library file for executing a testing function of the testing system platform and send the library file to the corresponding testing device 2, and specifically, when the testing management module 4 may obtain a system version corresponding to the testing device 2 from the version control management module 1 and obtain a testing function corresponding to the system version through the service interface, the testing management module may further obtain a corresponding library file from the service module library to send the library file to the testing device 2 so as to execute the testing function of the testing system platform.
The plug-in module can be used for determining a corresponding plug-in the test case execution process and executing the plug-in. Specifically, the plugin module may be an interface for implementing each plugin, and may be configured to determine an interface file corresponding to a test case in a test execution process, determine a target plugin corresponding to the test process by using the interface file, acquire the interface file corresponding to the target plugin from the service library module, and execute the target plugin by using the interface file.
The plug-in may include application memory monitoring, memory analysis, test driver memory monitoring, Bug monitoring (Bug report), connection state monitoring, power monitoring, read-write function monitoring, and the like. The plug-ins can be divided into two types, one type can be plug-ins required in the testing process, such as picture comparison plug-ins, audio comparison plug-ins and the like, and the other type can be plug-ins related to the testing process, such as plug-ins required for realizing different testing stages, starting plug-ins, starting testing plug-ins, starting iteration plug-ins and the like.
In the embodiment of the present invention, in the process of executing the test case by the test device 2, the test transfer module 3 may perform event monitoring on the test flow and generate event monitoring information for the test case.
In specific implementation, a process monitoring interface may be developed in the test relay module 3, in the test process, different test links and test operations that need to be triggered in different test phases may all be registered in the process monitoring interface, and after a test execution command is triggered, the process monitoring interface may be triggered to perform event monitoring on the whole test flow, such as counting of the start of execution of each test case, recording of logs, starting of logs, monitoring of error and exception in the test case execution process, analyzing and counting of results of the completion of the test case, storing data, writing a test report, and the like.
Specifically, when the test device 2 executes the test case according to the test execution command, the process monitoring interface of the test transfer module 3 may monitor the process of executing the test case by the test device 2 according to the test execution command, and generate corresponding event monitoring information, so that the test process may be monitored in real time, and a tester may process the test flow in time. The event monitoring information includes test progress, error anomaly monitoring, test result analysis, log information and the like.
In the embodiment of the present invention, the test relay module 3 may be further configured to obtain the test results after the test device 2 completes the test of the test case, generate the test reports corresponding to the test devices 2 by respectively using the test results, where the test results correspond to the test cases one to one, and respectively send the test reports to the test management module 4.
In the concrete implementation, in the test process, the test transfer module 3 can generate the event monitoring information corresponding to the test case and send the event monitoring information to the test management module 4, and the test management module 4 displays the event monitoring information, in addition, after the test is finished, the test transfer module 3 can adopt the test result to generate the test report corresponding to each test case and send the test report to the test management module 4, so that on one hand, a tester can check the test execution progress, the information of the test equipment 2, the test time and the like in real time in the test process, and can re-execute the test, suspend the test execution, end the test and the like at any time, on the other hand, the test report can be generated in real time, in the test report, the test cases correspond to the test result one to one, and the test report can include test case logs, the test system comprises a frame log, a test device 2 state log, an operation log and other information, so that a tester can conveniently track the product problem of the test device 2, and a product developer can conveniently improve the product file.
In an example of the embodiment of the present invention, when the test device 2 includes a first test device carrying an Android test platform and a second test device carrying a Linux test platform, the version management control module may first obtain system information of each test device and determine a corresponding system version, then the test management module 4 may obtain the system version corresponding to the test device 2 from the version control management module 1, and obtain a test function and a library file corresponding to the system version through the service interface, then obtain a pre-configured configuration file for the Android test platform and a configuration file corresponding to the Linux test platform, then input a test execution command, and send the configuration file and the test execution command to the test relay module 3. And then the test transfer module 3 determines corresponding test equipment according to the service interface, if determining a first test equipment corresponding to the Android test platform and a second test equipment corresponding to the Linux test platform, then sending the first configuration file and the test execution command for the Android test platform to the first test equipment, and sending the second configuration file and the test execution command for the Linux test platform to the second test equipment. After the first testing device receives the configuration file corresponding to the Android testing platform, the configuration file can be analyzed to obtain a testing case set corresponding to the Android testing platform and corresponding testing execution parameters, various plug-in functions are read and loaded at the same time, the testing case is executed according to the library file, a corresponding testing result is generated, the testing process of the second testing device is the same as that of the first testing device, and the description is omitted here. In the testing process, the test transfer module 3 is triggered to monitor events of the testing process, event monitoring information for the testing cases is generated, the event monitoring information and the testing results are sent to the test management module 4 in real time, the test management module 4 displays equipment information, system versions and testing reports corresponding to the testing equipment, and cross-platform, multi-thread and multi-process automatic testing is achieved, so that the testing personnel can track the product problems of the testing equipment conveniently, product developers can improve product files conveniently, and the like.
In the embodiment of the invention, the automatic test system comprises a version control management module, at least two test devices having different test system platforms connected to the version control management module, a test relay module connected with the test equipment, and a test management module connected with the test relay module and having a service interface, the system information of the test system platform can be respectively obtained through the version control management module, and the system version corresponding to the system information is determined, therefore, the test equipment of a plurality of different test system platforms can be managed, and simultaneously, through the service interface arranged on the test management module, the method can be reused in different test equipment, and test the test equipment of a plurality of different test system platforms, thereby realizing cross-platform, multi-thread and multi-process automatic test.
In addition, a test report at any moment in the test execution process can be obtained in real time, wherein the test cases correspond to the test results one to one, so that a tester can know the test condition in real time and stably run for 7 multiplied by 24 hours.
Referring to fig. 3, a flowchart illustrating steps of a first embodiment of an automated testing method according to the present invention is shown, where the method involves at least two testing devices, and specifically may include the following steps:
301, respectively acquiring system information of a test system platform of each test device, and determining a system version corresponding to the system information;
In an optional embodiment of the present invention, the configuring a configuration file for each of the test devices includes:
acquiring a test plan collection aiming at the test equipment and test execution parameters aiming at the test case;
generating the configuration file by adopting the test plan collection and the test execution parameters;
the test execution parameters comprise at least two of the IP address and the ID identification information of the test equipment, environment variable information, test time and test times.
In an optional embodiment of the present invention, the method further includes:
in the test case execution process, performing event monitoring on a test flow and generating event monitoring information aiming at the test case;
the event monitoring information comprises at least two of test progress, error abnormity monitoring, test result analysis and log information.
In an optional embodiment of the present invention, the method further includes:
and respectively adopting the test results to generate test reports corresponding to the test devices, wherein the test results correspond to the test cases one to one.
In an optional embodiment of the present invention, the method further includes:
packaging a library file for executing the test function of the test system platform;
and sending the library file to corresponding test equipment.
In an optional embodiment of the present invention, the method further includes:
and determining a corresponding plug-in the test case execution process, and executing the plug-in.
In an optional embodiment of the embodiments of the present invention, further comprising
Configuring a collection of test plans for the test device, and writing the configuration file into a test report.
In the embodiment of the invention, the method is applied to an automatic test system, test system platform information of each version management control module test device is respectively obtained, a system version corresponding to the version management control module test system platform information is determined, a configuration file aiming at each version management control module test device is configured, a test execution instruction aiming at each version management control module test device is obtained, the version management control module configuration file and the version management control module test execution instruction are respectively sent to the corresponding test device, at least two version management control module test devices respectively extract a test case matched with the version management control module test device and a test execution parameter from the version management control module configuration file, the version management control module test execution parameter is adopted, and the version management control module test case is executed, and event monitoring information and test results for the version management control module test cases are generated, so that the test equipment of a plurality of different test system platforms can be managed and reused in different test equipment, and the test equipment of a plurality of different test system platforms is tested, thereby realizing cross-platform, multi-thread and multi-process automatic test.
In addition, a test report at any moment in the test execution process can be obtained in real time, wherein the test cases correspond to the test results one to one, so that a tester can know the test condition in real time and stably run for 7 multiplied by 24 hours.
Referring to fig. 4, a flowchart of steps of a second embodiment of an automatic testing method according to the present invention is shown, and is applied to an automatic testing system, where the automatic testing system may include a version control management module, at least two testing devices with different testing system platforms connected to the version control management module, a test relay module connected to the testing devices, and a test management module with a service interface connected to the test relay module, and the method may specifically include the following steps:
In an optional embodiment of the embodiments of the present invention, the test management module includes a configuration interface;
acquiring a test plan collection aiming at the test equipment and test execution parameters aiming at the test case through the configuration interface; generating the configuration file by adopting the test plan collection and the test execution parameters;
the test execution parameters comprise at least two of the IP address and the ID identification information of the test equipment, environment variable information, test time and test times.
In an optional embodiment of the present invention, the configuration interface is an interface for searching for a preset control on a display interface of the test device.
In an optional embodiment of the present invention, the test transfer module performs event monitoring on a test flow in the test case execution process, and generates event monitoring information for the test case;
the event monitoring information comprises at least two of test progress, error abnormity monitoring, test result analysis and log information.
In an optional embodiment of the present invention, the test transfer module generates a test report corresponding to each of the test devices by using the test result, respectively, where the test result corresponds to the test cases one to one; and respectively sending the test report to the test management module.
In an optional embodiment of the present invention, the automated testing system further includes a service library module, and the method further includes:
packaging a library file for executing the test function of the test system platform through a service module library; and sending the library file to corresponding test equipment.
In an optional embodiment of the present invention, the automated testing system further includes a plug-in module, and the method further includes:
and determining a corresponding plug-in the test case execution process through a plug-in module, and executing the plug-in.
In an optional embodiment of the present invention, the automated testing system further includes a configuration module, and the method further includes:
configuring, by a configuration module, a collection of test plans for the test device, and writing the configuration file in the test report.
In the embodiment of the invention, the automatic test system comprises a version control management module, at least two test devices having different test system platforms connected to the version control management module, a test relay module connected with the test equipment, and a test management module connected with the test relay module and having a service interface, the system information of the test system platform can be respectively obtained through the version control management module, and the system version corresponding to the system information is determined, therefore, the test equipment of a plurality of different test system platforms can be managed, and simultaneously, through the service interface arranged on the test management module, the method can be reused in different test equipment, and test the test equipment of a plurality of different test system platforms, thereby realizing cross-platform, multi-thread and multi-process automatic test.
In addition, a test report at any moment in the test execution process can be obtained in real time, wherein the test cases correspond to the test results one to one, so that a tester can know the test condition in real time and stably run for 7 multiplied by 24 hours.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
As for the method embodiment, since it is basically similar to the system embodiment, the description is simple, and the relevant points can be referred to the partial description of the system embodiment.
The embodiment of the invention also discloses a vehicle, which comprises:
one or more processors; and
one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the vehicle to perform one or more methods as described above.
Embodiments of the invention also disclose one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform one or more of the methods described above.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, EEPROM, Flash, eMMC, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The above detailed description of an automated testing system and an automated testing method provided by the present invention, and the specific examples applied herein have been set forth to illustrate the principles and embodiments of the present invention, and the above descriptions of the embodiments are only used to help understand the method and its core ideas of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (17)
1. An automatic test system is characterized by comprising a version control management module, at least two test devices with different test system platforms, a test transfer module and a test management module, wherein the test devices are connected with the version control management module, the test transfer module is connected with the test devices, the test management module is connected with the test transfer module and is provided with a service interface, and the service interface is an interface used for packaging test functions of different test system platforms;
the version control management module is used for respectively acquiring system information of the test system platform and determining a system version corresponding to the system information;
the test management module is used for configuring configuration files matched with test equipment of different system versions; sending a test execution instruction and the configuration file aiming at each test device to the test transfer module through the service interface;
the test transfer module is used for respectively sending each configuration file and the test execution instruction to corresponding test equipment;
the at least two test devices are used for respectively extracting test cases matched with the test devices from the configuration files and test execution parameters; and executing the test case and generating a test result by respectively adopting the test execution parameters.
2. The system of claim 1, wherein the test management module comprises a configuration interface;
the configuration interface is used for acquiring a test plan collection aiming at the test equipment and test execution parameters aiming at the test case; generating the configuration file by adopting the test plan collection and the test execution parameters;
the test execution parameters comprise at least two of the IP address and the ID identification information of the test equipment, environment variable information, test time and test times.
3. The system of claim 2, wherein the configuration interface is an interface for finding a preset control on a display interface of the test device.
4. The system of claim 1, wherein the test relay module is configured to:
in the test case execution process, performing event monitoring on a test flow and generating event monitoring information aiming at the test case;
the event monitoring information comprises at least two of test progress, error abnormity monitoring, test result analysis and log information.
5. The system of claim 1, wherein the test relay module is further configured to:
respectively adopting the test results to generate test reports corresponding to the test devices, wherein the test results correspond to the test cases one by one;
and respectively sending the test report to the test management module.
6. The system of claim 1, further comprising:
the service module library is used for packaging library files for executing the test function of the test system platform; and sending the library file to corresponding test equipment.
7. The system of claim 6, further comprising:
and the plug-in module is used for determining a corresponding plug-in the test case execution process and executing the plug-in.
8. The system of claim 5, further comprising:
and the configuration module is used for configuring a test plan collection aiming at the test equipment and writing the configuration file into the test report.
9. An automated testing method, the method involving at least two test devices having different test system platforms, the method comprising:
respectively acquiring system information of a test system platform of each test device, and determining a system version corresponding to the system information;
configuring a configuration file matched with test equipment of different system versions, and acquiring a test execution instruction aiming at each test equipment;
respectively sending the configuration file and the test execution instruction to corresponding test equipment through a preset service interface;
at least two test devices respectively extract test cases matched with the test devices and test execution parameters from the configuration files; and executing the test case by adopting the test execution parameters, and generating event monitoring information aiming at the test case and a test result.
10. The method of claim 9, wherein configuring the configuration file for each of the test devices comprises:
acquiring a test plan collection aiming at the test equipment and test execution parameters aiming at the test case;
generating the configuration file by adopting the test plan collection and the test execution parameters;
the test execution parameters comprise at least two of the IP address and the ID identification information of the test equipment, environment variable information, test time and test times.
11. The method of claim 9, further comprising:
in the test case execution process, performing event monitoring on a test flow and generating event monitoring information aiming at the test case;
the event monitoring information comprises at least two of test progress, error abnormity monitoring, test result analysis and log information.
12. The method of claim 9, further comprising:
and respectively adopting the test results to generate test reports corresponding to the test devices, wherein the test results correspond to the test cases one to one.
13. The method of claim 9, further comprising:
packaging a library file for executing the test function of the test system platform;
and sending the library file to corresponding test equipment.
14. The method of claim 13, further comprising:
and determining a corresponding plug-in the test case execution process, and executing the plug-in.
15. The method of claim 12, further comprising
Configuring a collection of test plans for the test device, and writing the configuration file into a test report.
16. A vehicle, characterized by comprising:
one or more processors; and
one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the vehicle to perform the method of any of claims 9-15.
17. One or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the method of any of claims 9-15.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910640331.4A CN110347085B (en) | 2019-07-16 | 2019-07-16 | Automated test system, method, vehicle, and computer-readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910640331.4A CN110347085B (en) | 2019-07-16 | 2019-07-16 | Automated test system, method, vehicle, and computer-readable medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110347085A CN110347085A (en) | 2019-10-18 |
| CN110347085B true CN110347085B (en) | 2020-11-10 |
Family
ID=68176509
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910640331.4A Active CN110347085B (en) | 2019-07-16 | 2019-07-16 | Automated test system, method, vehicle, and computer-readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110347085B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112416744A (en) * | 2020-01-21 | 2021-02-26 | 上海哔哩哔哩科技有限公司 | Test control system, method and equipment |
| CN112416745A (en) * | 2020-01-21 | 2021-02-26 | 上海哔哩哔哩科技有限公司 | Test control system, method and equipment |
| CN111427783A (en) * | 2020-03-24 | 2020-07-17 | 上海科世达-华阳汽车电器有限公司 | RTE interface testing method, device, equipment and storage medium |
| CN112783780A (en) * | 2021-01-28 | 2021-05-11 | 开放智能机器（上海）有限公司 | Automatic testing method and system for multi-environment multi-platform embedded system |
| CN113656283A (en) * | 2021-07-19 | 2021-11-16 | 厦门雅基软件有限公司 | Project testing method and device, electronic equipment and computer readable storage medium |
| CN113672481A (en) * | 2021-08-05 | 2021-11-19 | 北京鲸鲮信息系统技术有限公司 | Performance monitoring method and system of cross-platform heterogeneous system |
| CN117573566B (en) * | 2024-01-16 | 2024-04-12 | 麒麟软件有限公司 | Multi-system test case generation method, device and storage medium |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8645326B2 (en) * | 2009-06-30 | 2014-02-04 | Sap Ag | System to plan, execute, store and query automation tests |
| JP2015049876A (en) * | 2013-09-05 | 2015-03-16 | 株式会社日立製作所 | Test system and method |
| CN107145140B (en) * | 2017-05-18 | 2019-12-27 | 中国第一汽车股份有限公司 | Automatic test system and test method for CAN interface of vehicle-mounted electronic control unit |
| CN109086173B (en) * | 2017-06-13 | 2022-08-16 | 龙芯中科技术股份有限公司 | Equipment test method and device of operating system and storage medium |
| CN108255737A (en) * | 2018-02-27 | 2018-07-06 | 郑州云海信息技术有限公司 | Based on multi version operating system testing method, system and equipment and storage medium |
| CN108647149B (en) * | 2018-05-17 | 2022-06-21 | 珠海全志科技股份有限公司 | Method, device and system for testing electronic equipment and storage medium |
| CN108984363B (en) * | 2018-05-23 | 2022-08-30 | 福建天泉教育科技有限公司 | Parallel test method and system |
| CN109491888A (en) * | 2018-09-29 | 2019-03-19 | 中国平安人寿保险股份有限公司 | Application compatibility test method, device and computer readable storage medium |
| CN109634847A (en) * | 2018-11-21 | 2019-04-16 | 广州小鹏汽车科技有限公司 | Embedded product automated testing method and system |
-
2019
- 2019-07-16 CN CN201910640331.4A patent/CN110347085B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110347085A (en) | 2019-10-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110347085B (en) | Automated test system, method, vehicle, and computer-readable medium | |
| CN109302522B (en) | Test method, test device, computer system, and computer medium | |
| US10853232B2 (en) | Adaptive system for mobile device testing | |
| US20190294536A1 (en) | Automated software deployment and testing based on code coverage correlation | |
| EP3019962B1 (en) | Cloud services performance tuning and benchmarking | |
| US20210081308A1 (en) | Generating automated tests based on user interaction with an application | |
| US20170085458A1 (en) | Real-Time Monitoring of Computer System Processor and Transaction Performance During an Ongoing Performance Test | |
| CN103365770A (en) | Mobile terminal software testing system and software testing method | |
| CN104765678A (en) | Method and device for testing applications on mobile terminal | |
| CN109669798B (en) | Crash analysis method, crash analysis device, electronic equipment and storage medium | |
| CN110674047A (en) | Software testing method and device and electronic equipment | |
| CN111767208A (en) | Automatic test method and device | |
| CN111190827A (en) | Interface automation test method and device, storage medium and electronic equipment | |
| CN111651352B (en) | Warehouse code merging method and device | |
| CN112068852A (en) | Method, system, equipment and medium for installing open source software based on domestic server | |
| CN111190791A (en) | Application exception reporting method and device and electronic equipment | |
| CN110597704B (en) | Pressure test method, device, server and medium for application program | |
| KR20150025106A (en) | Verification apparatus, terminal device, system, method and computer-readable medium for monitoring of application verification result | |
| CN114647572A (en) | Method and system for software application component testing | |
| CN114546814A (en) | Recording playback method, recording playback device and storage medium | |
| CN110990289B (en) | Method and device for automatically submitting bug, electronic equipment and storage medium | |
| CN107077394B (en) | Method and system for monitoring requests for code sets | |
| CN106557419B (en) | Program testing method and device | |
| KR101527745B1 (en) | Method and apparatus for verifying application by using object extracting | |
| CN116383021A (en) | Software package performance testing method, system, computing device and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |