CN110908354A - Automatic test detection device and method - Google Patents

Automatic test detection device and method Download PDF

Info

Publication number
CN110908354A
CN110908354A CN201811082400.6A CN201811082400A CN110908354A CN 110908354 A CN110908354 A CN 110908354A CN 201811082400 A CN201811082400 A CN 201811082400A CN 110908354 A CN110908354 A CN 110908354A
Authority
CN
China
Prior art keywords
simulation
equipment
service
module
configuration file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811082400.6A
Other languages
Chinese (zh)
Inventor
廖永汉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Uniview Technologies Co Ltd
Original Assignee
Zhejiang Uniview Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Uniview Technologies Co Ltd filed Critical Zhejiang Uniview Technologies Co Ltd
Priority to CN201811082400.6A priority Critical patent/CN110908354A/en
Publication of CN110908354A publication Critical patent/CN110908354A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B23/00Testing or monitoring of control systems or parts thereof
    • G05B23/02Electric testing or monitoring
    • G05B23/0205Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults
    • G05B23/0208Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterized by the configuration of the monitoring system
    • G05B23/0213Modular or universal configuration of the monitoring system, e.g. monitoring system having modules that may be combined to build monitoring program; monitoring system that can be applied to legacy systems; adaptable monitoring system; using different communication protocols
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01DMEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
    • G01D18/00Testing or calibrating apparatus or arrangements provided for in groups G01D1/00 - G01D15/00

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention discloses an automatic test detection device and method, which are used for carrying out automatic test detection on a tested system and comprise an automatic control module, an equipment simulation module and a detection module, wherein each simulation equipment meeting the requirement is generated through the equipment simulation module, so that the automatic tests of different access protocols, different equipment types and different service types are quickly and conveniently carried out; and the interaction result recorded by the equipment simulation module is compared with the interaction result recorded by the tested system, so that whether the result of the automatic test is correct or not can be verified, and whether the function of the automatic service is correct or not can be verified by comparing the service data related to the service flow, so that the accuracy of automatic execution can be well ensured.

Description

Automatic test detection device and method
Technical Field
The invention belongs to the technical field of automatic testing of monitoring systems, and particularly relates to an automatic testing detection device and method.
Background
As monitoring systems become more complex and the version cycles become shorter, the need to test new versions of the system becomes more frequent. Because manual testing is time-consuming and labor-consuming, and testing cost is high, automatic testing of the monitoring system is more and more emphasized and popularized.
However, in the prior art, the result verification of the automatic test is a difficulty in the test of the monitoring system. At present, the automatic test result of the monitoring system is verified by inquiring the monitoring system, that is, the automatic test result is generally verified by calling an interface of the monitoring system. Such as alarm linkage, wheel cutting and other services, and whether alarm linkage is configured or not and whether wheel cutting is started or not is verified through an inquiry interface provided by the monitoring system.
However, the interface verification by calling the monitoring system has the problems that the query interface is preset in advance to be correct, so that the result of the automated test cannot be accurately verified, and the function of the automated service cannot be verified.
Disclosure of Invention
The invention aims to provide an automatic test detection device and method, which can verify the accuracy of the result of an automatic test and verify the functions of an automatic service.
In order to achieve the purpose, the technical scheme adopted by the invention is as follows:
the utility model provides an automatic test detection device for carry out automatic test to the system under test and detect, automatic test detection device includes automatic control module, equipment simulation module, detection module, wherein:
the automatic control module is used for automatically generating a simulation equipment configuration file of an automatic test according to the test case and sending the simulation equipment configuration file to the equipment simulation module; the system is also used for executing the test case and outputting a service interaction command to the tested system;
the device simulation module is used for automatically generating simulation devices according to the simulation device configuration files, sending registration signaling to the tested system by the generated simulation devices and carrying out service interaction with the tested system;
the tested system is used for responding to the registration signaling sent by the simulation equipment and carrying out service interaction with the simulation equipment according to the service interaction command output by the automatic control module;
the detection module is used for receiving the interaction result of the simulation equipment in the service interaction process and the interaction result of the system to be tested in the service interaction process, comparing and analyzing the interaction results of the simulation equipment and the system to be tested, and outputting an automatic test detection result to the automatic control module.
Preferably, the device simulation module is configured to automatically generate a simulation device according to the simulation device configuration file, send a registration signaling to the system under test by the generated simulation device, and execute the following operations:
the equipment simulation module analyzes the simulation equipment configuration file and obtains the content of the simulation equipment configuration file;
generating a corresponding IP address according to the IP address of the simulation equipment in the simulation equipment configuration file;
generating each simulation device correspondingly according to manufacturer information, device types and access protocols of the simulation devices in the simulation device configuration file;
binding the generated IP address and each simulation device according to the corresponding relation in the configuration file of the simulation device;
and each bound simulation device sends a registration signaling to the tested system for registration.
Preferably, the device simulation module is further configured to automatically generate simulation devices according to the simulation device configuration file, and after the generated simulation devices send registration signaling to the system under test, feed back a simulation result to the automation control module.
Preferably, the system under test responds to the registration signaling sent by the simulation device, performs service interaction with the simulation device according to the service interaction command output by the automation control module, and executes the following operations:
the tested system receives the registration signaling sent by the simulation equipment and responds;
the tested system sends a service request to the simulation equipment according to the service interaction command output by the automation control module, so that the simulation equipment monitors the service request of the tested system, performs service response according to the service request and sends an interaction result to the detection module according to the service response;
and the tested system receives the service response returned by the simulation equipment, executes corresponding service operation and simultaneously sends an interaction result to the detection module according to the service operation.
The invention also provides an automatic test detection method, which is used for carrying out automatic test detection on a tested system, and relates to an automatic control module, an equipment simulation module and a detection module, wherein the automatic test detection method comprises the following steps:
the automatic control module automatically generates a simulation equipment configuration file for automatic test according to the test case and sends the simulation equipment configuration file to the equipment simulation module; executing a test case and outputting a service interaction command to the tested system;
the device simulation module automatically generates simulation devices according to the simulation device configuration files, and the generated simulation devices send registration signaling to the tested system and perform service interaction with the tested system;
the tested system responds to the registration signaling sent by the simulation equipment and performs service interaction with the simulation equipment according to the service interaction command output by the automatic control module;
and the detection module receives the interaction result of the simulation equipment in the service interaction process and the interaction result of the system to be detected in the service interaction process, compares and analyzes the interaction results of the simulation equipment and the system to be detected, and outputs an automatic test detection result to the automatic control module.
Preferably, the device simulation module automatically generates simulation devices according to the simulation device configuration file, and the generated simulation devices send registration signaling to the system under test, including:
the equipment simulation module analyzes the simulation equipment configuration file and obtains the content of the simulation equipment configuration file;
generating a corresponding IP address according to the IP address of the simulation equipment in the simulation equipment configuration file;
generating each simulation device correspondingly according to manufacturer information, device types and access protocols of the simulation devices in the simulation device configuration file;
binding the generated IP address and each simulation device according to the corresponding relation in the configuration file of the simulation device;
and each bound simulation device sends a registration signaling to the tested system for registration.
Preferably, the device simulation module automatically generates simulation devices according to the simulation device configuration file, and after the generated simulation devices send registration signaling to the system under test, the device simulation module feeds back simulation results to the automation control module.
Preferably, the step of the tested system responding to the registration signaling sent by the simulation device and performing service interaction with the simulation device according to the service interaction command output by the automation control module includes:
the tested system receives the registration signaling sent by the simulation equipment and responds;
the tested system sends a service request to the simulation equipment according to the service interaction command output by the automation control module, so that the simulation equipment monitors the service request of the tested system, performs service response according to the service request and sends an interaction result to the detection module according to the service response; and the tested system receives the service response returned by the simulation equipment, executes corresponding service operation and simultaneously sends an interaction result to the detection module according to the service operation.
The invention provides an automatic test detection device and method, which generate simulation equipment meeting the requirements through an equipment simulation module, thereby quickly and conveniently carrying out automatic tests of different access protocols, different equipment types and different service types; and the interaction result recorded by the equipment simulation module is compared with the interaction result recorded by the tested system, so that whether the result of the automatic test is correct or not can be verified, and whether the function of the automatic service is correct or not can be verified by comparing the service data related to the service flow, so that the accuracy of automatic execution can be well ensured.
Drawings
FIG. 1 is a block diagram of an automated test detection apparatus according to the present invention;
FIG. 2 is a block diagram of the operation of an automated test detection apparatus according to an embodiment of the present invention.
Detailed Description
The technical solutions of the present invention are further described in detail below with reference to the drawings and examples, which should not be construed as limiting the present invention.
As shown in fig. 1 and fig. 2, the present embodiment provides an automatic test detection apparatus, configured to perform automatic test detection on a system under test, where the automatic test detection apparatus includes an automation control module, an equipment simulation module, and a detection module, where:
the automatic control module is used for automatically generating a simulation equipment configuration file of an automatic test according to the test case and sending the simulation equipment configuration file to the equipment simulation module; the system is also used for executing the test case and outputting a service interaction command to the tested system;
the device simulation module is used for automatically generating simulation devices according to the simulation device configuration files, sending registration signaling to the tested system by the generated simulation devices and carrying out service interaction with the tested system;
the tested system responds to the registration signaling sent by the simulation equipment and performs service interaction with the simulation equipment according to the service interaction command output by the automatic control module;
the detection module is used for receiving the interaction result of the simulation equipment in the service interaction process and the interaction result of the system to be tested in the service interaction process, comparing and analyzing the interaction results of the simulation equipment and the system to be tested, and outputting an automatic test detection result to the automatic control module.
In this embodiment, the content of the test case includes information of the system under test, service functions to be tested (for example, device configuration, alarm linkage service, round-robin service, storage, and the like), and networking information of the device required to be tested (for example, vendor information, device type, access protocol, and the like of the device). In this embodiment, a simulation device configuration file is automatically generated according to the content of the test case, where the content of the simulation device configuration file includes but is not limited to: the IP address of the system to be tested, the manufacturer information corresponding to each simulation device, the device type, the IP address and the access protocol.
It should be noted that, multiple simulation devices may be needed in one automated testing process, and all the multiple simulation devices are embodied in the configuration file of the simulation device, and each simulation device has manufacturer information, device type, IP address and access protocol corresponding to itself. Wherein, the device types can be IPC types of different manufacturers; the access protocol may be an IMOS protocol, an international protocol, or an ONVIF protocol, etc., and is not limited herein.
After the device simulation module receives the configuration file of the simulation device, the operation executed by the simulation device is automatically generated as follows:
(1) the equipment simulation module analyzes the simulation equipment configuration file and obtains the content of the simulation equipment configuration file.
Specifically, the device simulation module analyzes the simulation device configuration file to obtain the IP address of the system under test, the vendor information corresponding to each simulation device, the device type, the IP address, and the access protocol in the simulation device configuration file.
(2) And generating a corresponding IP address according to the IP address of the simulation equipment in the simulation equipment configuration file.
Specifically, after the device simulation module obtains the IP address of the device in the simulation device configuration file, the device simulation module virtualizes the IP address with the same number and content as the obtained IP address for standby.
(3) And correspondingly generating each simulation device according to the manufacturer information, the device type and the access protocol of the simulation device in the simulation device configuration file.
It should be noted that the number of the simulation devices generated by the device simulation module is consistent with the number of the simulation devices in the simulation device configuration file, and the vendor information, the device type, and the access protocol of each simulation device correspond to those in the simulation device configuration file.
(4) And binding the generated IP address and each simulation device according to the corresponding relation in the configuration file of the simulation device.
(5) And each bound simulation device sends a registration signaling to the tested system for registration.
Specifically, each simulation device sends a registration signaling carrying manufacturer information, device type and access protocol to the system to be tested according to the IP address of the system to be tested acquired by the device simulation module, and because each simulation device has a unique IP address, the source IP addresses of each registration signaling received by the system to be tested are different.
Through the above operation procedures, the device simulation module completes the generation operation of the simulation device.
After the device simulation module completes generation of the simulation device, a simulation result is fed back to the automatic control module, and the automatic control module adds the simulation device to the tested system. The automation control module runs an automation script adding simulation device, and the automation script can call an SDK interface provided by the tested system or is automatically realized through UI. The simulation result comprises: whether the simulation equipment is successfully generated, whether the registration operation to the tested system is successful, and the detail of the generated simulation equipment. Of course, the above is only the content of the simulation result presented in this embodiment, and in other embodiments, other required information may also be included in the simulation result.
And after receiving the registration signaling, the tested system responds according to whether the simulation equipment is successfully added, if the simulation equipment is successfully added to the tested system by the automatic control module, the response registration is successful, and otherwise, the response registration is failed.
And after receiving the simulation result, the automatic control module judges the simulation result. And if the information carried in the simulation result is judged to include one or more conditions of the generation failure of the simulation equipment or the registration operation failure of the simulation equipment to the tested system, indicating that the environmental preparation of the automatic test is not finished. At this point, the automation control module may regenerate the simulation device configuration file again, or stop the automation test and issue a false alarm.
And if the information carried in the simulation result is judged to include the conditions that the simulation equipment is successfully generated and the registration operation to the tested system is successful, the environment preparation of the automatic test is finished. At the moment, the automatic control module executes the test case and outputs a service interaction command to the tested system. After receiving the service interaction command, the tested system performs service interaction with the simulation equipment and executes the following operations:
(1) the tested system sends a service request to the simulation equipment according to the service interaction command output by the automation control module;
(2) the simulation equipment monitors the service request of the system to be tested, carries out different service responses according to different service requests, records the service interaction process in real time, and simultaneously sends an interaction result to the detection module according to the service response;
(3) and the tested system receives the service response returned by the simulation equipment, executes corresponding service operation according to the service response, and simultaneously sends an interaction result to the detection module according to the service operation.
And the detection module receives the interaction result of the simulation equipment and the interaction result of the system to be detected in real time and compares the interaction results of the simulation equipment and the system to be detected in real time. After the automatic control module executes the test case, the detection module collects the real-time comparison result to obtain the final automatic test result, and uploads the final automatic test result to the automatic control module. The automatic control module can verify whether the automatic service is normally configured and started or not according to the result of the automatic test, and simultaneously verify whether the function of the service is normal or not.
Specifically, the automated testing and detection of the technical scheme is further illustrated by the following two embodiments:
example 1: alarm linkage service
In the prior art, an automatic test case of an alarm linkage service is difficult to detect, and the difficulty is that real equipment is difficult to trigger and report the equipment alarm type required by a tested system. For example, for high and low temperature alarm, the real device rarely reaches the upper limit of high temperature or the upper limit of low temperature in the test environment, which results in that the whole automatic test case can configure the alarm linkage service but cannot execute the service.
The automatic test detection device of the embodiment can better solve the problems, and the specific implementation flow is as follows:
(1) the automatic control module generates a simulation equipment configuration file according to the test case of the alarm linkage service and transmits the simulation equipment configuration file to the equipment simulation module; the device simulation module generates simulation devices according to the simulation device configuration files and completes registration to the tested system;
(2) the automatic control module executes the test case, outputs a service interaction command to the tested system, and sends a report alarm request to the simulation equipment after the tested system receives the service interaction command;
(3) after receiving the report alarm request, the simulation equipment judges the equipment type, the access protocol and the alarm type specified in the report alarm request and reports a corresponding alarm message to the tested system;
(4) the simulation equipment sends a specified warning message to the detection module and reports an interaction result to the tested system while reporting a corresponding warning message to the tested system;
(5) the detection module records the interaction result sent by the simulation equipment and monitors the linkage action of corresponding alarm of the system to be detected within a limited time;
(6) if the detection module detects that the system to be detected has corresponding alarm linkage action triggering within the limited time, the automatic test case is judged to be correct in configuration of the alarm linkage service and correct in the function of the service; otherwise, the service configuration or the service itself has a problem.
The alarm linkage services of different access protocols, different equipment types and different alarm types can be quickly and conveniently executed through the process, the execution result of the automatic test case can be well verified according to the result reported by the equipment simulation module, and the accuracy of automatic execution is remarkably improved.
Example 2: round-robin
In the prior art, in a round-robin service, that is, a plurality of monitoring devices perform a live test in the same monitor according to a specified time interval, an automatic test case of the round-robin service is difficult to detect, and a difficulty is that it is difficult to detect which monitoring device is currently in a round-robin state. At present, the most used schemes are to preset OSD names of different monitoring devices, judge the monitoring device currently in the alternate cutting state according to the recognized OSD names, and record the alternate cutting sequence at the same time, but the scheme has the defect that the OSD names are difficult to be recognized accurately, so that the execution accuracy of the automatic use case is difficult to be ensured.
The automatic test detection device of the embodiment can better solve the problems, and the specific implementation flow is as follows:
(1) the automatic control module generates a simulation equipment configuration file according to the test case of the round-robin operation and transmits the simulation equipment configuration file to the equipment simulation module; the device simulation module generates simulation devices according to the simulation device configuration files and completes registration to the tested system;
(2) the automatic control module executes the test case, outputs a service interaction command to the tested system, and sends a live request to different simulation equipment at different moments after the tested system receives the service interaction command;
(3) after each simulation device receives the live request, audio and video data are processed according to the manufacturer, the access protocol and the device type of the simulation device, and the audio and video data are sent to the target IP address and the port of the live request through the IP address and the port which are respectively distributed, namely, the audio and video data are sent to the tested system;
(4) when the simulation equipment sends audio and video data to a tested system, reporting the live starting time, the live stopping time, the simulation equipment code, the streaming IP address and the streaming port to a detection module;
(5) the detection module records the interaction result reported by the simulation device, and in this embodiment, the recording is performed in a list manner, where the list is as follows:
emulated device encoding Time to start live Time to live down Streaming IP address Send out a class port
Code1 T11 T12 IP1 PORT1
Code2 T21 T22 IP2 PORT2
Code3 T31 T32 IP3 PORT3
Code4 T41 T42 IP4 PORT4
(6) The detection module compares the recorded interaction result uploaded by the equipment simulation module with the actual alternate cutting service of the tested system, and judges the correctness of the automatic test case of the alternate cutting service, wherein the judgment method comprises the following steps:
the detection module compares the alternate cutting sequence recorded by the received simulation equipment code with the alternate cutting sequence of the actual alternate cutting service of the tested system, so that whether the alternate cutting sequence of the alternate cutting service is correct or not can be judged;
the detection module calculates the time interval of live switching according to the received live starting time and live stopping time, and compares the time interval with the alternate switching time of the actual alternate switching service of the system to be detected, so that whether the alternate switching time of the alternate switching service is correct or not can be judged;
the detection module can judge whether the live service established by each simulation device belongs to the current alternate switching service according to the stream sending IP address and the stream sending port.
The correctness of the automatic test case of the alternate cutting service can be judged through the processes, the accuracy of the functions of the automatic service can be further judged, and the judgment process carries out the following steps:
(7) the simulation equipment sends a group of specific GOP code streams as video sources of the simulation equipment to the system to be tested through the step (3), and simultaneously the simulation equipment sends the GOP code streams to the detection module through the step (4);
(8) the detection module and the tested system decode after receiving the GOP code stream, compare the decoded data, and judge whether the alternate switching service is normally established and whether the decoding is normal according to the data comparison result, thereby further verifying the accuracy of the automatic service function.
The alternate switching and live services of different access protocol types and different equipment types can be quickly and conveniently executed through the process, the execution result of the automatic test case can be well verified according to the result reported by the equipment simulation module, and the accuracy of the automatic test is also well ensured.
The embodiment also provides an automatic test detection method, which is used for carrying out automatic test detection on a system to be tested, and relates to an automatic control module, an equipment simulation module and a detection module, wherein the automatic test detection method comprises the following steps:
the automatic control module automatically generates a simulation equipment configuration file for automatic test according to the test case and sends the simulation equipment configuration file to the equipment simulation module; executing a test case and outputting a service interaction command to the tested system;
the device simulation module automatically generates simulation devices according to the simulation device configuration files, and the generated simulation devices send registration signaling to the tested system and perform service interaction with the tested system;
the tested system responds to the registration signaling sent by the simulation equipment and performs service interaction with the simulation equipment according to the service interaction command output by the automatic control module;
and the detection module receives the interaction result of the simulation equipment in the service interaction process and the interaction result of the system to be detected in the service interaction process, compares and analyzes the interaction results of the simulation equipment and the system to be detected, and outputs an automatic test detection result to the automatic control module.
The automatic test detection method of the present embodiment corresponds to the automatic test detection apparatus, and specifically, the automatic test detection method is further described by the following embodiments:
example 3:
the device simulation module automatically generates simulation devices according to the simulation device configuration file, and the generated simulation devices send registration signaling to the tested system, wherein the registration signaling comprises the following steps:
the equipment simulation module analyzes the simulation equipment configuration file and obtains the content of the simulation equipment configuration file;
generating a corresponding IP address according to the IP address of the simulation equipment in the simulation equipment configuration file;
generating each simulation device correspondingly according to manufacturer information, device types and access protocols of the simulation devices in the simulation device configuration file;
binding the generated IP address and each simulation device according to the corresponding relation in the configuration file of the simulation device;
and each bound simulation device sends a registration signaling to the tested system for registration.
After the device simulation module completes generation of the simulation device, a simulation result is fed back to the automatic control module, and the automatic control module adds the simulation device to the tested system. The automation control module runs an automation script adding simulation device, and the automation script can call an SDK interface provided by the tested system or is automatically realized through UI.
And after the tested system receives the registration signaling, the tested system responds according to whether the simulation equipment is successfully added, if the simulation equipment is successfully added to the tested system by the automatic control module, the response registration is successful, otherwise, the response registration fails.
The tested system responds to the registration signaling sent by the simulation equipment and performs service interaction with the simulation equipment according to the service interaction command output by the automation control module, and the method comprises the following steps:
the tested system receives the registration signaling sent by the simulation equipment and responds;
the tested system sends a service request to the simulation equipment according to the service interaction command output by the automation control module, so that the simulation equipment monitors the service request of the tested system, performs service response according to the service request and sends an interaction result to the detection module according to the service response;
and the tested system receives the service response returned by the simulation equipment, executes corresponding service operation and simultaneously sends an interaction result to the detection module according to the service operation.
And the detection module receives the interaction result of the simulation equipment and the interaction result of the system to be detected in real time and compares the interaction results of the simulation equipment and the system to be detected in real time. After the automatic control module executes the test case, the detection module collects the real-time comparison result to obtain the final automatic test result, and uploads the final automatic test result to the automatic control module. The automatic control module can verify whether the automatic service is normally configured and started or not according to the result of the automatic test, and simultaneously verify whether the function of the service is normal or not.
The above embodiments are only for illustrating the technical solution of the present invention and not for limiting the same, and those skilled in the art can make various corresponding changes and modifications according to the present invention without departing from the spirit and the essence of the present invention, but these corresponding changes and modifications should fall within the protection scope of the appended claims.

Claims (8)

1. The utility model provides an automatic test detection device for carry out automatic test to the system under test and detect, its characterized in that, automatic test detection device includes automatic control module, equipment simulation module, detection module, wherein:
the automatic control module is used for automatically generating a simulation equipment configuration file of an automatic test according to the test case and sending the simulation equipment configuration file to the equipment simulation module; the system is also used for executing the test case and outputting a service interaction command to the tested system;
the device simulation module is used for automatically generating simulation devices according to the simulation device configuration files, sending registration signaling to the tested system by the generated simulation devices and carrying out service interaction with the tested system;
the tested system is used for responding to the registration signaling sent by the simulation equipment and carrying out service interaction with the simulation equipment according to the service interaction command output by the automatic control module;
the detection module is used for receiving the interaction result of the simulation equipment in the service interaction process and the interaction result of the system to be tested in the service interaction process, comparing and analyzing the interaction results of the simulation equipment and the system to be tested, and outputting an automatic test detection result to the automatic control module.
2. The automated test detection apparatus of claim 1, wherein the device simulation module is configured to automatically generate a simulation device according to the simulation device configuration file, where the generated simulation device sends a registration signaling to the system under test, and performs the following operations:
the equipment simulation module analyzes the simulation equipment configuration file and obtains the content of the simulation equipment configuration file;
generating a corresponding IP address according to the IP address of the simulation equipment in the simulation equipment configuration file;
generating each simulation device correspondingly according to manufacturer information, device types and access protocols of the simulation devices in the simulation device configuration file;
binding the generated IP address and each simulation device according to the corresponding relation in the configuration file of the simulation device;
and each bound simulation device sends a registration signaling to the tested system for registration.
3. The automated test detection apparatus of claim 1, wherein the device simulation module is further configured to automatically generate simulation devices according to the simulation device configuration file, and feed back simulation results to the automation control module after the generated simulation devices send registration signaling to the system under test.
4. The automatic test detection device of claim 1, wherein the system under test, in response to the registration signaling sent by the simulation device, performs service interaction with the simulation device according to the service interaction command output by the automation control module, and performs the following operations:
the tested system receives the registration signaling sent by the simulation equipment and responds;
the tested system sends a service request to the simulation equipment according to the service interaction command output by the automation control module, so that the simulation equipment monitors the service request of the tested system, performs service response according to the service request and sends an interaction result to the detection module according to the service response;
and the tested system receives the service response returned by the simulation equipment, executes corresponding service operation and simultaneously sends an interaction result to the detection module according to the service operation.
5. An automatic test detection method is used for carrying out automatic test detection on a system to be detected, and is characterized in that the automatic test detection method relates to an automatic control module, an equipment simulation module and a detection module, and comprises the following steps:
the automatic control module automatically generates a simulation equipment configuration file for automatic test according to the test case and sends the simulation equipment configuration file to the equipment simulation module; executing a test case and outputting a service interaction command to the tested system;
the device simulation module automatically generates simulation devices according to the simulation device configuration files, and the generated simulation devices send registration signaling to the tested system and perform service interaction with the tested system;
the tested system responds to the registration signaling sent by the simulation equipment and performs service interaction with the simulation equipment according to the service interaction command output by the automatic control module;
and the detection module receives the interaction result of the simulation equipment in the service interaction process and the interaction result of the system to be detected in the service interaction process, compares and analyzes the interaction results of the simulation equipment and the system to be detected, and outputs an automatic test detection result to the automatic control module.
6. The method as claimed in claim 5, wherein the step of the device simulation module automatically generating simulation devices according to the simulation device configuration file, and the generated simulation devices sending registration signaling to the system under test includes:
the equipment simulation module analyzes the simulation equipment configuration file and obtains the content of the simulation equipment configuration file;
generating a corresponding IP address according to the IP address of the simulation equipment in the simulation equipment configuration file;
generating each simulation device correspondingly according to manufacturer information, device types and access protocols of the simulation devices in the simulation device configuration file;
binding the generated IP address and each simulation device according to the corresponding relation in the configuration file of the simulation device;
and each bound simulation device sends a registration signaling to the tested system for registration.
7. The automated test detection method of claim 5, wherein the device simulation module automatically generates simulation devices according to the simulation device configuration file, and after the generated simulation devices send registration signaling to the system under test, the simulation results are fed back to the automation control module.
8. The method as claimed in claim 5, wherein the step of the system under test responding to the registration signaling sent by the simulation device and performing service interaction with the simulation device according to the service interaction command output by the automation control module comprises:
the tested system receives the registration signaling sent by the simulation equipment and responds;
the tested system sends a service request to the simulation equipment according to the service interaction command output by the automation control module, so that the simulation equipment monitors the service request of the tested system, performs service response according to the service request and sends an interaction result to the detection module according to the service response;
and the tested system receives the service response returned by the simulation equipment, executes corresponding service operation and simultaneously sends an interaction result to the detection module according to the service operation.
CN201811082400.6A 2018-09-17 2018-09-17 Automatic test detection device and method Pending CN110908354A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811082400.6A CN110908354A (en) 2018-09-17 2018-09-17 Automatic test detection device and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811082400.6A CN110908354A (en) 2018-09-17 2018-09-17 Automatic test detection device and method

Publications (1)

Publication Number Publication Date
CN110908354A true CN110908354A (en) 2020-03-24

Family

ID=69813155

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811082400.6A Pending CN110908354A (en) 2018-09-17 2018-09-17 Automatic test detection device and method

Country Status (1)

Country Link
CN (1) CN110908354A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113218416A (en) * 2021-04-15 2021-08-06 东风电驱动系统有限公司 Automatic test method and system for automobile instrument subtotal mileage zero clearing function
CN113406897A (en) * 2021-06-23 2021-09-17 国网智能科技股份有限公司 Automatic simulation test system and method for inspection robot

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1577274A (en) * 2003-07-01 2005-02-09 华为技术有限公司 Automation emulation method and system
CN103684925A (en) * 2013-12-26 2014-03-26 浙江宇视科技有限公司 Performance test method based on simulation terminal
CN103678124A (en) * 2013-12-03 2014-03-26 浙江宇视科技有限公司 Video surveillance platform auto-test method and device based on continuous integrated environment
CN104852912A (en) * 2015-04-29 2015-08-19 中国互联网络信息中心 Domain name registration server performance testing system and domain name registration server performance testing method
CN104932479A (en) * 2015-04-27 2015-09-23 深圳市中电电力技术股份有限公司 Automatic test method and system
CN108170889A (en) * 2017-11-28 2018-06-15 北京天地玛珂电液控制系统有限公司 A kind of emulation test method and system of hydraulic bracket controller software

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1577274A (en) * 2003-07-01 2005-02-09 华为技术有限公司 Automation emulation method and system
CN103678124A (en) * 2013-12-03 2014-03-26 浙江宇视科技有限公司 Video surveillance platform auto-test method and device based on continuous integrated environment
CN103684925A (en) * 2013-12-26 2014-03-26 浙江宇视科技有限公司 Performance test method based on simulation terminal
CN104932479A (en) * 2015-04-27 2015-09-23 深圳市中电电力技术股份有限公司 Automatic test method and system
CN104852912A (en) * 2015-04-29 2015-08-19 中国互联网络信息中心 Domain name registration server performance testing system and domain name registration server performance testing method
CN108170889A (en) * 2017-11-28 2018-06-15 北京天地玛珂电液控制系统有限公司 A kind of emulation test method and system of hydraulic bracket controller software

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113218416A (en) * 2021-04-15 2021-08-06 东风电驱动系统有限公司 Automatic test method and system for automobile instrument subtotal mileage zero clearing function
CN113406897A (en) * 2021-06-23 2021-09-17 国网智能科技股份有限公司 Automatic simulation test system and method for inspection robot

Similar Documents

Publication Publication Date Title
CN109361562B (en) Automatic testing method based on associated network equipment access
CN111600740A (en) Remote operation and maintenance management system and method
WO2020087954A1 (en) Method, apparatus, device and system for grabbing trace of nvme hard disk
CN111506489A (en) Test method, system, device, server and storage medium
CN113533887B (en) Intelligent debugging method and system for power distribution terminal
CN110501956B (en) Production test alarm system, server and alarm information acquisition equipment
CN110620685A (en) Method and device for reporting device exception
CN110908354A (en) Automatic test detection device and method
CN106776346B (en) Test method and device of CCMTS (China center testing System) equipment
CN111294652A (en) Intelligent television fault online diagnosis method and device and controller
WO2009067877A1 (en) Method and system for automatically debug-testing network device
CN111372039A (en) Monitoring and early warning method, computer device and computer readable storage medium
CN105588989B (en) Single board testing method and device
CN109802842B (en) Application topology generation method and related equipment
CN113783749B (en) Method for detecting equipment fault based on network port
JP7220231B2 (en) network diagnostics
CN111400183A (en) Automatic testing method for vehicle-mounted terminal
CN110990289A (en) Method and device for automatically submitting bug, electronic equipment and storage medium
CN108763005A (en) A kind of memory ECC failures error-reporting method and system
CN114328110A (en) Monitoring method, system and storage medium for gateway of Internet of things
CN107105100B (en) Method and system for monitoring mobile terminal game
CN112867024A (en) Test method, system and communication equipment
CN116545891A (en) Automatic distribution network testing method based on intelligent equipment
WO2016127483A1 (en) Processing method and device for collection agent management subsystem
CN110198249B (en) Power distribution automation system testing method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200324

RJ01 Rejection of invention patent application after publication