CN118550839B - Embedded automatic test system and test method thereof - Google Patents
Embedded automatic test system and test method thereof Download PDFInfo
- Publication number
- CN118550839B CN118550839B CN202411021260.7A CN202411021260A CN118550839B CN 118550839 B CN118550839 B CN 118550839B CN 202411021260 A CN202411021260 A CN 202411021260A CN 118550839 B CN118550839 B CN 118550839B
- Authority
- CN
- China
- Prior art keywords
- test
- unit
- module
- functional
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 297
- 238000010998 test method Methods 0.000 title abstract description 10
- 238000000034 method Methods 0.000 claims description 9
- 238000013515 script Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 6
- 238000004891 communication Methods 0.000 claims description 5
- 238000012544 monitoring process Methods 0.000 claims description 5
- 230000010354 integration Effects 0.000 claims description 4
- 238000013112 stability test Methods 0.000 claims description 4
- 239000000779 smoke Substances 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 abstract description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides an embedded automatic test system and a test method thereof, wherein the embedded automatic test system comprises a test module and a functional module which are connected with each other, and the functional module provides corresponding functional units for the test selected by a user in the test module; wherein, the test module is integrated with various tests, and the test information and the test equipment information corresponding to the tests; the functional module is provided with a functional unit corresponding to the test, the functional unit is a test environment matched with the corresponding test configuration, the test result is analyzed, and a corresponding log and report are generated and sent through mail; the multiple tests can be synchronously or sequentially carried out, the synchronous carrying out can save the test time and improve the test efficiency, and the sequential carrying out can maximally realize the effective utilization of the test equipment, so that the application range is wide.
Description
Technical Field
The invention relates to the technical field of automatic test frames in embedded operating systems, in particular to an embedded automatic test system and a test method thereof.
Background
Because the embedded operating system is very complicated in the test process due to the complexity of the embedded operating system, the functions and the performances of the embedded operating system are verified by a large number of tests in many cases, for example, the embedded operating system is verified by manually testing and calling a test program, the test efficiency is greatly reduced, and a large amount of data cannot be summarized, so that the data cannot be compared.
Automated testing is an indispensable tester for existing conditions. At present, a plurality of existing automatic test frameworks exist in the market, and although the existing automatic test frameworks can temporarily meet the flow of product test, the expansibility and portability of the automatic test frameworks can not completely meet the test requirements. Most of them have the following drawbacks and disadvantages:
1) The test environment is built, the test execution is complicated, and the project period is prolonged;
2) The multi-equipment test interaction test is completely dependent on manpower for manual test;
3) The test data are more, and the standard documents cannot be formed by aggregation;
4) The existing automatic test framework cannot meet the expansion type of embedded test.
Therefore, it is desirable to provide an embedded automatic test system and a test method thereof, so as to solve the above-mentioned drawbacks and disadvantages of the prior art.
Disclosure of Invention
In order to solve the defects and shortcomings in the prior art, the invention provides an embedded automatic test system and a test method thereof.
The specific scheme provided by the invention is as follows:
An embedded automatic test system, characterized in that: the system comprises a test module and a functional module which are connected with each other, wherein the functional module provides corresponding functional units for the test selected by a user in the test module; wherein,
The test module is integrated with various tests, and test information and test equipment information corresponding to the tests;
The functional module is provided with a functional unit corresponding to the test, the functional unit is a test environment matched with the corresponding test configuration, the test result is analyzed, and a corresponding log and report are generated and sent through a mail;
One end of the function module is connected with a calling module, and a user can call the function units in the function module through the calling module;
The other end of the functional module is connected with the node module so as to call corresponding test equipment according to the test selected by the user in the test module.
As a further preferred embodiment of the present invention, the tests integrated in the test module at least include a smoke test, a BSP test, a Kernel test, an IDE test, and a cloud native module test.
As a further preferred embodiment of the present invention, the tests integrated in the test module can be performed simultaneously or sequentially according to the user's selection.
As a further preferred embodiment of the present invention, the function units in the function module include an environment configuration unit, a device management unit, an environment update unit, a test execution unit, a log management unit, a mail transmission unit, a report transmission unit, and a document processing unit; wherein,
The environment configuration unit provides a corresponding test environment according to the test selected by the user;
the device management unit manages the test devices and provides the use rights of the corresponding test devices according to the tests selected by the user;
The environment updating unit updates the test environment provided by the environment configuration unit to the user;
the test execution unit adopts test equipment to carry out corresponding test in the updated test environment;
The log management unit writes the test steps and test results in the execution process into a test log in a preset format and stores the test log in a corresponding log server;
The mail sending unit and the report sending unit send the test log in a mail and report form respectively;
The document processing unit edits the test data to form a document form and provides the document form to a user.
As a further preferred embodiment of the invention, the functional units in the functional module further comprise a network interface unit and a remote interface unit, wherein,
The network interface unit at least comprises an ftp interface, an sftp interface and a tftp interface;
The remote interface unit at least comprises a telnet interface and a ssh interface.
As a further preferred embodiment of the present invention, the functional units in the functional module further include a thread support unit, and the thread support unit provides corresponding thread function support for the test selected by the user, where the thread function support includes at least a multithreading test script function support, a concurrent test function support, a system stability test function support, and a control communication interface function support.
As a further preferred embodiment of the present invention, the functional units in the functional module further include an extended functional unit, where the extended functional unit includes at least a user experience function, a debug tool integration function, a real-time feedback monitoring function, and a support remote test function.
As a further preferable implementation mode of the invention, the calling module comprises a manual calling unit, a software calling unit and an interface calling unit.
As a further preferred embodiment of the present invention, the node module includes a plurality of test devices, and provides the test devices to the corresponding test devices according to the test selected by the user.
Further, the invention also provides a testing method of the embedded automatic testing system, which is characterized in that: the method comprises the following steps:
1) The user selects the required test types according to the requirement;
2) Configuring a test environment matched with the test type according to the test type;
3) Providing the use authority of the corresponding test equipment according to the test type;
4) Updating parameters in the test environment;
5) Adopting test equipment to carry out corresponding test in the updated test environment;
6) Writing the test result into a test log in a preset format and storing the test result;
7) The test logs are sent in the form of mails and reports respectively;
8) The test data is edited to form a document form and provided to the user.
Compared with the prior art, the invention has the following technical effects:
1) The invention provides an embedded automatic test system and a test method thereof, wherein various tests can be synchronously or sequentially carried out, the synchronous execution can save test time and improve test efficiency, and the sequential execution can maximally realize effective utilization of test equipment, so that the application range is wide.
2) The invention provides an embedded automatic test system and a test method thereof, which can collect test data to form a document form for a user, and have strong readability.
3) The invention provides an embedded automatic test system and a test method thereof, which integrate a plurality of tests into the system, have simple and convenient test flow and high efficiency test process, and can meet different test requirements of users.
4) The invention provides an embedded automatic test system and a test method thereof, which are provided with a plurality of functional units and expansion functional units, thereby effectively meeting the expansion requirement of the embedded test system.
Drawings
FIG. 1 is a logic block diagram of a test system according to the present invention.
FIG. 2 is a flow chart of the testing method according to the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In the description of the present invention, it should be noted that the directions or positional relationships indicated by the terms "upper", "lower", "inner", "outer", "front", "rear", "both ends", "one end", "the other end", etc. are based on the directions or positional relationships shown in the drawings, are merely for convenience of describing the present invention and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a specific direction, be configured and operated in the specific direction, and thus should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
In the description of the present invention, it should be noted that, unless explicitly specified and limited otherwise, the terms "mounted," "provided," "connected," and the like are to be construed broadly, and may be fixedly connected, detachably connected, or integrally connected, for example; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention will be understood in specific cases by those of ordinary skill in the art.
First embodiment
Fig. 1 shows a first embodiment of the present invention, which provides an embedded automatic test system, including a test module and a functional module that are connected to each other, where the functional module provides a corresponding functional unit for a test selected by a user in the test module; wherein,
The test module is integrated with various tests, and test information and test equipment information corresponding to the tests; the integrated test in the test module in this embodiment at least includes a smoke test, a BSP test, a Kernel test, an IDE test, a cloud native test, and the like; the original independent test is integrated through the system, so that different test requirements of users can be met;
As the optimization, the integrated test in the test module in the embodiment can synchronously carry out various tests or various test sequences according to the selection of the user, the synchronous test can save the test time and improve the test efficiency, and the sequential test can maximally realize the effective utilization of the test equipment, so that the application range is wide. In this embodiment, the test module performs corresponding configuration management on the test program through the json table file, and the corresponding test program needs to be configured in the json table file in advance. When the user selects the corresponding test case set or the corresponding test program (in the process, the engineer can select the test to be synchronously performed or the test to be sequentially performed or the test to be performed according to the preset priority) at the upper layer, the automatic test framework can sequentially execute the test program according to the script return value at the upper layer.
As shown in fig. 1, the system provided in this embodiment further includes a functional module,
The functional module is provided with a functional unit corresponding to the test, the functional unit is a test environment matched with the corresponding test configuration, the test result is analyzed, and a corresponding log and report are generated and sent through mail; the system comprises a functional module and a control module, wherein the functional unit in the functional module comprises an environment configuration unit, a device management unit, an environment updating unit, a test execution unit, a log management unit, a mail sending unit, a report sending unit and a document processing unit; wherein,
The environment configuration unit provides a corresponding test environment according to the test selected by the user;
the device management unit manages the test devices and provides the use rights of the corresponding test devices according to the tests selected by the user;
The environment updating unit updates the test environment provided by the environment configuration unit to the user;
The test execution unit adopts test equipment to carry out corresponding test in the updated test environment;
the log management unit writes the test steps and test results in the execution process into a test log in a preset format and stores the test log in a corresponding log server;
The mail sending unit and the report sending unit send the test log in a mail and report form respectively;
the document processing unit edits the test data to form a document form and provides the document form to the user.
Meanwhile, the functional units in the functional module further comprise a network interface unit and a remote interface unit to meet the requirements of network connection and remote connection, wherein,
The network interface unit at least comprises an ftp interface, an sftp interface and a tftp interface;
The remote interface unit at least comprises a telnet interface and a ssh interface.
In this embodiment, as shown in fig. 1, the functional units in the functional module further include a thread support unit, where the thread support unit provides corresponding thread function support for the test selected by the user, and the thread function support includes at least a multithreading test script function support, a concurrent test function support, a system stability test function support, and a control communication interface function support. Wherein the multithreading test script function enables the test script to run in one or more threads, simulating a scene through the multithreading; concurrent test function support enables multiple test scripts or tasks to be run simultaneously to check for findings when the embedded system is multi-tasked and multi-concurrent; the system stability test function support can test the stability and reliability of the system under time operation and high load through multi-thread test; the control communication interface function support can simultaneously perform concurrent use of a Telnet interface, a ssh interface, an ftp interface and an sftp interface, wherein the Telnet interface performs command issuing, the ftp interface performs file transmission, the sftp interface performs image file uploading, the ssh interface performs account login and the like.
In addition, preferably, the functional units in the functional module further comprise an extended functional unit, and the extended function at least comprises a user experience function, a debugging tool integration function, a real-time feedback monitoring function and a remote test supporting function. The user experience function can be realized by adding a UI interface, a user can select by means of a simple script, execute test programs in a non-sense way, all the test programs are completely executed by the internal core engine, and finally are presented in a data summarizing report or a line graph, a histogram and the like and allowed to be called; the debug tool integration functionality integrates advanced debug tools, such as dynamic analysis tools and static code tools, to help developers identify and fix problems faster; the real-time feedback monitoring function provides real-time test feedback and system monitoring, so that developers and testers can know the test progress and result in time; the support of the remote test function allows a tester to execute the test in a remote environment, so that the flexibility and convenience of the test are improved; by arranging a plurality of functional units and an expansion functional unit, the expansion requirement of the embedded test system is effectively met.
One end of the functional module is connected with a calling module, and a user can call the functional units in the functional module through the calling module; in this embodiment, as shown in fig. 1, the call module includes a manual call unit, a software call unit and an interface call unit, so as to provide multiple call modes for users to use.
The other end of the functional module is connected with the node module so as to call corresponding test equipment according to the test selected by the user in the test module; as shown in fig. 1, the node module includes a plurality of test devices, and provides the test devices to the corresponding test devices according to the test selected by the user. The test equipment in the embodiment selects an embedded test board card, the selection of the test equipment depends on whether a user needs to select a plurality of nodes or a single node according to the definition of the corresponding engineering script in the upper layer, and each node has a CPU corresponding to the node, so that the test equipment performance is required to be relied on in the process of testing data.
Second embodiment
As shown in fig. 2, the second embodiment of the present invention further provides a testing method of an embedded automatic testing system, which includes the following steps:
1) The user selects the required test types according to the requirement;
2) Configuring a test environment matched with the test type according to the test type;
3) Providing the use authority of the corresponding test equipment according to the test type;
4) Updating parameters in the test environment;
5) Adopting test equipment to carry out corresponding test in the updated test environment;
6) Writing the test result into a test log in a preset format and storing the test result;
7) The test logs are sent in the form of mails and reports respectively;
8) The test data is edited to form a document form and provided to the user.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Claims (4)
1. An embedded automatic test system, characterized in that: the system comprises a test module and a functional module which are connected with each other, wherein the functional module provides corresponding functional units for the test selected by a user in the test module; wherein,
The test module is integrated with various tests, and test information and test equipment information corresponding to the tests;
The functional module is provided with a functional unit corresponding to the test, the functional unit is a test environment matched with the corresponding test configuration, the test result is analyzed, and a corresponding log and report are generated and sent through a mail;
One end of the function module is connected with a calling module, and a user can call the function units in the function module through the calling module;
The other end of the functional module is connected with the node module so as to call corresponding test equipment according to the test selected by the user in the test module;
the integrated test in the test module at least comprises a smoke test, a BSP test, a Kernel test, an IDE test and a cloud native module test;
The functional units in the functional module comprise an environment configuration unit, a device management unit, an environment updating unit, a test execution unit, a log management unit, a mail sending unit, a report sending unit and a document processing unit; wherein,
The environment configuration unit provides a corresponding test environment according to the test selected by the user;
the device management unit manages the test devices and provides the use rights of the corresponding test devices according to the tests selected by the user;
The environment updating unit updates the test environment provided by the environment configuration unit to the user;
the test execution unit adopts test equipment to carry out corresponding test in the updated test environment;
The log management unit writes the test steps and test results in the execution process into a test log in a preset format and stores the test log in a corresponding log server;
The mail sending unit and the report sending unit send the test log in a mail and report form respectively;
the document processing unit edits the test data to form a document form and provides the document form to a user;
the functional units in the functional module further comprise a network interface unit and a remote interface unit, wherein,
The network interface unit at least comprises an ftp interface, an sftp interface and a tftp interface;
the remote interface unit at least comprises a telnet interface and a ssh interface;
The functional units in the functional module further comprise thread supporting units, and the thread supporting units provide corresponding thread functional support for the test selected by the user, wherein the thread functional support at least comprises multithread test script functional support, concurrent test functional support, system stability test functional support and control communication interface functional support;
The function unit in the function module further comprises an extension function unit, wherein the extension function at least comprises a user experience function, a debugging tool integration function, a real-time feedback monitoring function and a remote test supporting function;
The calling module comprises a manual calling unit, a software calling unit and an interface calling unit.
2. An embedded automatic test system as claimed in claim 1, wherein: the integrated test in the test module can be synchronously performed in various tests or in various test sequences according to the selection of a user.
3. An embedded automatic test system as claimed in claim 1, wherein: the node module comprises a plurality of test devices and provides the test devices for the corresponding test devices according to the test selected by the user.
4. A testing method of an embedded automatic testing system according to any of claims 1-3, characterized in that: the method comprises the following steps:
1) The user selects the required test types according to the requirement;
2) Configuring a test environment matched with the test type according to the test type;
3) Providing the use authority of the corresponding test equipment according to the test type;
4) Updating parameters in the test environment;
5) Adopting test equipment to carry out corresponding test in the updated test environment;
6) Writing the test result into a test log in a preset format and storing the test result;
7) The test logs are sent in the form of mails and reports respectively;
8) The test data is edited to form a document form and provided to the user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202411021260.7A CN118550839B (en) | 2024-07-29 | 2024-07-29 | Embedded automatic test system and test method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202411021260.7A CN118550839B (en) | 2024-07-29 | 2024-07-29 | Embedded automatic test system and test method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN118550839A CN118550839A (en) | 2024-08-27 |
| CN118550839B true CN118550839B (en) | 2024-10-11 |
Family
ID=92446470
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202411021260.7A Active CN118550839B (en) | 2024-07-29 | 2024-07-29 | Embedded automatic test system and test method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118550839B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104731702A (en) * | 2013-12-23 | 2015-06-24 | 展讯通信（上海）有限公司 | Test system and service side thereof |
| CN110059008A (en) * | 2019-04-12 | 2019-07-26 | 广东电网有限责任公司信息中心 | A kind of test cloud platform system and test method towards power business |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111190812B (en) * | 2019-12-12 | 2023-12-08 | 华东计算技术研究所（中国电子科技集团公司第三十二研究所） | Automatic test framework system based on embedded equipment |
| CN116382991A (en) * | 2023-04-28 | 2023-07-04 | 飞腾信息技术有限公司 | Storage device testing method and device, computer device and storage medium |
-
2024
- 2024-07-29 CN CN202411021260.7A patent/CN118550839B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104731702A (en) * | 2013-12-23 | 2015-06-24 | 展讯通信（上海）有限公司 | Test system and service side thereof |
| CN110059008A (en) * | 2019-04-12 | 2019-07-26 | 广东电网有限责任公司信息中心 | A kind of test cloud platform system and test method towards power business |
Also Published As
| Publication number | Publication date |
|---|---|
| CN118550839A (en) | 2024-08-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109302522B (en) | Test method, test device, computer system, and computer medium | |
| CN111159049B (en) | Automatic interface testing method and system | |
| CN112286806B (en) | Automatic test method and device, storage medium and electronic equipment | |
| CN101241467B (en) | Automatized white box test system and method facing to WEB application | |
| CN103150249A (en) | Automatic testing method and system | |
| CN109977012B (en) | Joint debugging test method, device, equipment and computer readable storage medium of system | |
| CN110750458A (en) | Big data platform testing method and device, readable storage medium and electronic equipment | |
| CN112579455B (en) | Automatic interface testing method and device, electronic equipment and storage medium | |
| CN115658529A (en) | Automatic testing method for user page and related equipment | |
| CN115480746A (en) | Method, device, equipment and medium for generating execution file of data processing task | |
| US20060020931A1 (en) | Method and apparatus for managing complex processes | |
| CN118550839B (en) | Embedded automatic test system and test method thereof | |
| CN114064465A (en) | Stability testing method based on Linux cloud platform | |
| CN113434405A (en) | Method and device for determining test file, storage medium and electronic device | |
| CN111258893A (en) | Mobile terminal application automatic testing device for randomly assembling transaction path | |
| CN113535560B (en) | Test execution method, device, storage medium and computing equipment | |
| CN116467188A (en) | Universal local reproduction system and method under multi-environment scene | |
| CN113076252A (en) | Interface testing method and device, electronic equipment and storage medium | |
| CN114092169A (en) | Ordering test method and system and equipment for executing ordering test method | |
| CN112650815A (en) | Method and device for synchronizing environmental data, storage medium and electronic device | |
| CN111813662A (en) | User behavior driven sustainable integration test method, device and equipment | |
| CN117349153A (en) | Data recording and playback platform, method, electronic device and storage medium | |
| KR101550871B1 (en) | Method and system for Automation test system of the Telecommunication system using Smart phone | |
| CN115687160A (en) | Interface test system, method and equipment cluster | |
| CN109710509A (en) | Data checking, device, equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |