CN111563030A - Method and device for testing scheduling system, electronic equipment and storage medium - Google Patents
Method and device for testing scheduling system, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111563030A CN111563030A CN202010205107.5A CN202010205107A CN111563030A CN 111563030 A CN111563030 A CN 111563030A CN 202010205107 A CN202010205107 A CN 202010205107A CN 111563030 A CN111563030 A CN 111563030A
- Authority
- CN
- China
- Prior art keywords
- scheduling system
- abnormal data
- data
- randomly
- abnormal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 67
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000002159 abnormal effect Effects 0.000 claims abstract description 112
- 238000002347 injection Methods 0.000 claims abstract description 57
- 239000007924 injection Substances 0.000 claims abstract description 57
- 238000012545 processing Methods 0.000 claims abstract description 36
- 230000008569 process Effects 0.000 claims abstract description 15
- 230000026676 system process Effects 0.000 claims abstract description 7
- 238000004088 simulation Methods 0.000 claims description 57
- 238000004891 communication Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 10
- 238000010998 test method Methods 0.000 claims description 6
- 238000012549 training Methods 0.000 claims description 3
- 230000002547 anomalous effect Effects 0.000 claims 3
- 238000001514 detection method Methods 0.000 abstract description 17
- 230000007547 defect Effects 0.000 abstract description 10
- 230000006870 function Effects 0.000 description 9
- 230000003287 optical effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 239000000243 solution Substances 0.000 description 4
- 230000005856 abnormality Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000002349 favourable effect Effects 0.000 description 3
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 239000004566 building material Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3664—Environments for testing or debugging software
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the invention discloses a method and a device for testing a dispatching system, electronic equipment and a storage medium, wherein the method for testing the dispatching system comprises the following steps: injecting abnormal data into the scheduling system randomly so that the scheduling system processes the abnormal data; when a processing failure message sent by a scheduling system is received, suspending injection of abnormal data so that the scheduling system updates the processing failure data; and when an updating completion message sent by the scheduling system is received, injecting abnormal data into the scheduling system again randomly until the scheduling system reaches a preset robustness target. Abnormal data are injected into the dispatching system at random in a circulating mode, so that automatic detection of the dispatching system can be realized, the detection efficiency of the dispatching system is improved, and the detection cost is reduced; in addition, the coverage rate of real abnormity in the test process can be increased, the scheduling system can be updated according to potential defects before being put into use, and the robustness of the scheduling system is improved.
Description
Technical Field
The present invention relates to testing technologies, and in particular, to a method and an apparatus for testing a scheduling system, an electronic device, and a storage medium.
Background
At present, in intelligent building engineering, a robot dispatching center needs to dispatch and monitor a building robot. With the increase of the number of robots, the difficulty of the scheduling method is increased in an exponential level, the complexity of the scheduling system is higher and higher, and therefore the detection difficulty of the scheduling system is higher and higher.
The existing testing method of the dispatching system usually compiles a testing case for testers to test the dispatching system. The disadvantages of this method include at least: the detection efficiency of the scheduling system is low, and a large amount of labor and time resource cost is consumed; the coverage rate of the test case for covering the real exception is low, so that the defects are not easily exposed in the test process of the scheduling system, the system can be maintained and adjusted in a targeted manner only when the defects are exposed in the real scheduling process, the scheduling work progress is influenced, and the robustness of the scheduling system is low.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method and an apparatus for testing a scheduling system, an electronic device, and a storage medium, so as to achieve high detection efficiency and high anomaly detection coverage of the scheduling system, and facilitate improvement of robustness of the scheduling system.
In a first aspect, an embodiment of the present invention provides a method for testing a scheduling system, including:
injecting abnormal data into the dispatching system randomly so that the dispatching system processes the abnormal data;
when a processing failure message sent by the scheduling system is received, suspending injection of abnormal data so that the scheduling system updates the processing failure data;
and when an updating completion message sent by the dispatching system is received, injecting abnormal data into the dispatching system again randomly until the dispatching system reaches a preset robustness target.
In a second aspect, an embodiment of the present invention further provides a testing apparatus for a scheduling system, including:
the abnormal injection module is used for injecting abnormal data into the dispatching system randomly so that the dispatching system can process the abnormal data;
the scheduling system comprises a suspending module and a control module, wherein the suspending module is used for suspending injection of abnormal data when receiving a processing failure message sent by the scheduling system so as to update the scheduling system aiming at the processing failure data;
and the abnormal injection module is further used for injecting abnormal data to the dispatching system again randomly when receiving the updating completion message sent by the dispatching system until the dispatching system reaches the preset robustness target.
In a third aspect, an embodiment of the present invention further provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the method for testing the scheduling system according to any embodiment of the present application.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the method for testing the scheduling system according to any embodiment of the present application.
The embodiment of the invention provides a test method, a test device, electronic equipment and a storage medium of a scheduling system, wherein the test method comprises the following steps: injecting abnormal data into the scheduling system randomly so that the scheduling system processes the abnormal data; when a processing failure message sent by a scheduling system is received, suspending injection of abnormal data so that the scheduling system updates the processing failure data; and when an updating completion message sent by the scheduling system is received, injecting abnormal data into the scheduling system again randomly until the scheduling system reaches a preset robustness target. Abnormal data are injected into the dispatching system at random in a circulating mode, so that automatic detection of the dispatching system can be realized, the detection efficiency of the dispatching system is improved, and the detection cost is reduced; in addition, the coverage rate of real abnormity in the test process can be increased, the scheduling system can be updated according to potential defects before being put into use, and the robustness of the scheduling system is improved.
Drawings
Fig. 1 is a schematic flowchart illustrating a testing method of a scheduling system according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a testing apparatus of a scheduling system according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of an electronic device according to a third embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described through embodiments with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. In the following embodiments, optional features and examples are provided in each embodiment, and various features described in the embodiments may be combined to form a plurality of alternatives, and each numbered embodiment should not be regarded as only one technical solution.
Example one
Fig. 1 is a flowchart illustrating a testing method for a dispatching system according to an embodiment of the present invention, which is applicable to a testing situation of the dispatching system, for example, a testing situation of a robot dispatching system. The method may be performed by a testing apparatus of a dispatching system provided in an embodiment of the present invention, where the testing apparatus of the dispatching system is implemented in software and/or hardware, and is preferably configured in an electronic device, for example, a server of a testing platform.
Referring to fig. 1, the method for testing a scheduling system specifically includes the following steps:
and S110, injecting abnormal data into the dispatching system randomly so that the dispatching system can process the abnormal data.
The test device for executing the test method of the scheduling system according to the embodiment of the present invention may be considered to be constructed by software and/or hardware, for example, a virtual device constructed by program codes. The test device may be referred to as an exception triggering system or a scrambling system, may be independent of the scheduling system, and when configured to be in communication connection with the scheduling system, may perform simulation of a real working environment and working data in response to a scheduling instruction of the scheduling system, and may transmit the simulated data to the scheduling system, so as to implement a simulation scheduling test on the scheduling system.
In the process of carrying out simulation dispatching test, the test device can automatically and randomly inject some abnormal data into the dispatching system so as to simulate various abnormal conditions of the dispatching system in a real dispatching scene, thereby testing the fault tolerance (namely robustness) of the dispatching system aiming at the abnormal conditions and being beneficial to exposing the potential defects of the dispatching system in time. The abnormal data can be stored in the testing device in advance and can be dynamically updated according to the updating instruction.
The testing device automatically and randomly triggers the abnormity to the dispatching system, so that the automatic detection of the dispatching system can be realized, the detection efficiency of the dispatching system is improved, the detection difficulty and the dependence of the testing process on people are reduced, and the detection cost is reduced; the coverage rate of real abnormity in the test process can be increased, the scheduling system can be updated according to potential defects before being put into use, and the robustness of the scheduling system can be improved by circularly triggering abnormity-scheduling system updating training.
And S120, when a processing failure message sent by the scheduling system is received, suspending the injection of abnormal data so that the scheduling system updates the processing failure data.
In the embodiment of the invention, the scheduling system can process the abnormal data after being triggered to be abnormal, and the processing result can be divided into the success of the abnormal processing and the failure of the abnormal processing. When the processing result is that the exception processing is successful, the scheduling system can be considered to solve the exception condition; when the processing result is that the abnormal processing fails, the scheduling system can generate a processing failure message and send the processing failure message to the testing device so that the testing device can suspend injecting abnormal data, and can send an alarm to prompt developers to intervene to discover, track and solve the abnormal problem so that the scheduling system can update the data with the processing failure, thereby preventing the same abnormality from occurring in a real working environment and being beneficial to solving the potential defects of the scheduling system.
S130, when the updating completion message sent by the dispatching system is received, injecting abnormal data into the dispatching system again randomly until the dispatching system reaches the preset robustness target.
In the embodiment of the invention, when the scheduling system successfully updates the data which is failed to be processed, the updating completion message can be generated and sent to the testing device. When the testing device receives the updating completion message, abnormal data can be injected into the scheduling system again randomly, and after a plurality of iterations of 'triggering the abnormity-solving the abnormity by the scheduling system', the scheduling system achieves the expected robustness target, so that the robustness of the scheduling system is improved. The scheduling system may reach the preset robustness target, for example, a ratio of the number of successfully solved exceptions of the scheduling system to the number of triggered exceptions reaches a preset ratio, and the preset ratio may be, for example, 80% or 90%, and is not limited herein.
Optionally, injecting the abnormal data randomly into the scheduling system includes: selecting a target simulation scene from at least one simulation scene; randomly selecting at least one abnormal data corresponding to a target simulation scene according to the type of the abnormal data configured for at least one simulation scene in advance, the injection probability and the injection quantity range; and injecting the selected at least one abnormal data into the scheduling system.
In the embodiment of the invention, in order to improve the scene simulation authenticity of the testing device, the testing device can set one or more simulation scenes according to the real operation environment of the dispatching system, and can configure the type of the abnormal data introduced by triggering, the probability of injection of each type, the quantity range of the abnormal data injected in the scene and the like in advance for each simulation scene. When the testing device randomly injects abnormal data into the scheduling system, a target simulation scene can be selected from at least one simulation scene randomly according to a preset sequence or a preset trigger probability; and at least one abnormal data can be randomly selected according to the type, injection probability and injection quantity range of the abnormal data which are pre-configured in the target scene, and the selected at least one abnormal data is injected into the scheduling system.
Illustratively, if the simulated scene includes scene 1 and scene 2, the types of the abnormal data include exception 1, exception 2, exception 3 and exception 4, the types of the abnormal data corresponding to the scene 1 may be preconfigured as exception 1, exception 2 and exception 3, the injection probabilities of the exception 1, the exception 2 and the exception 3 are 97%, 54% and 32%, respectively, and the injection number range corresponding to the scene 1 is 10-20; the types of the abnormal data corresponding to the scenario 2 can be configured to be abnormal 3 and abnormal 4, the injection probabilities of the abnormal 3 and abnormal 4 are 86% and 18%, respectively, and the injection number corresponding to the scenario 2 is 1-5. When the target scene is scene 1, 6 exceptions 1, 3 exceptions 2 and 2 exceptions 3 can be randomly selected as exception data according to the injection probability and the injection quantity range of the exceptions 1, 2 and 3; when the target scene is scene 2, 3 anomalies 3 can be randomly selected as anomaly data according to the injection probability and the injection quantity range of the anomalies 3 and the anomalies 4. The simulation scenario, the exception type configured in each simulation scenario, the injection probability of each exception type, and the injection quantity range of the exception can be configured according to the actual working scenario of the scheduling system, and are not limited to the above examples.
By presetting at least one simulation scene, and configuring the type of the abnormal data introduced by triggering and the probability of injection of each type for each simulation scene in advance, the reality of scene simulation of the testing device can be improved, the abnormal injection under various scenes can be covered, the problem that developers are not easy to find potential defects of a dispatching system due to the low probability of the occurrence of real abnormality is solved, and the condition that personnel are late in intervention time and cannot rapidly detect and solve the problems is avoided.
Further, at least one simulation scene is divided according to simulation time periods and/or simulation space areas.
In the embodiment of the invention, in order to better simulate the real working environment of the scheduling system, the simulation scene can be divided according to different dimensions such as simulation time intervals and/or simulation space areas. For example, when the simulation time interval is divided according to the dimension of the simulation time interval, the simulation scene can be divided into a low load time interval, a medium load time interval and a high load time interval according to the actual operation time interval of the scheduling system. When the division is carried out according to the dimension of the simulation space region, the operation space region of the scheduled equipment can be controlled according to the scheduling system, and the simulation scene is divided into a low load region, a medium load region and a high load region. When division is performed according to the simulation time period and the simulation space region dimension, different simulation scenes can be combined by time dimension division and space region dimension division, for example, the simulation scenes can be various combination scenes such as a low load time period + a high load region and a low load time period + a low load region.
Further, the type of the abnormal data configured for at least one simulated scene, the injection probability and the injection quantity range thereof include: and configuring an injection quantity range of abnormal data for the at least one simulated scene according to the weight of the at least one simulated scene.
In the embodiment of the invention, the weight can be configured for at least one simulated scene in advance, and the injection quantity range of the abnormal data can be further configured according to the weight. The weight may identify the degree of vulnerability of the anomaly, for example, the larger the weight is, the more the anomaly is prone to occur, and the larger the minimum value in the injection quantity range is. For example, when the simulation scene is divided according to the simulation time periods, different weights can be configured for each time period, and the larger the weight is, the larger the amount of the introduced abnormal data is, so as to simulate the situation that the probability of the abnormal data possibly occurring in different time periods in the real operation is different. When the simulation scene is divided according to the simulation space areas, different weights can be configured for each simulation space area, the larger the weight is, the more the quantity of abnormal data is introduced, and the conditions that the probability of possible abnormality of different simulation space areas in real operation is different are simulated. When the simulation scenes are divided according to the simulation time periods and the simulation space regions, different weights can be configured for each simulation scene, the larger the weight is, the more the quantity of abnormal data is introduced, and the conditions that the abnormal probability possibly occurs in different simulation time periods and simulation space regions in real operation are simulated.
Optionally, injecting the abnormal data randomly into the scheduling system includes: and responding to the injection exception opening instruction, and randomly injecting exception data into the scheduling system.
In the embodiment of the invention, the test device can start the function of triggering the exception through the configuration of the start instruction and randomly inject the exception data into the dispatching system; or the abnormal pause triggering function can be configured according to the pause instruction, and the abnormal constant is paused to be injected into the scheduling system; the function of closing the trigger exception can be configured through a closing instruction, and the injection of the exception constant into the scheduling system is stopped. Therefore, the method is favorable for controlling the starting and the closing of the function of triggering the abnormity, is favorable for suspending the injection of the abnormity when the dispatching system is updated, and is favorable for closing the function of randomly triggering the abnormity when the dispatching system detects the task.
Optionally, injecting the abnormal data randomly into the scheduling system includes: injecting abnormal data into a scheduling system randomly through a preset communication interface; the preset communication interface is an RFC interface, a WebService interface, a RESTFul interface and/or an emulator script interface. The communication mode of the test device and the dispatching system can be enriched by arranging various communication interfaces.
Optionally, when the scheduling system is applied to robot scheduling, the type of the abnormal data includes at least one of the following: the robot has power shortage, dumping, collision and communication abnormity.
In the embodiment of the invention, when the dispatching system is a robot dispatching system, the robot can be monitored and dispatched. After the testing device is started to work, the robot scheduling system can be randomly introduced with exceptions to simulate various exceptions which may be encountered during the operation of the robot scheduling system, including but not limited to: the robot is dead in battery, the robot is toppled over, collision occurs between the robots, the robot hits a wall, building materials are insufficient, and network is abnormal, etc. By covering various anomalies, the problem that developers are not easy to find potential defects of a scheduling system due to low probability of occurrence of real anomalies is solved, and the condition that personnel are late in intervention time and cannot quickly detect and solve the problems is avoided.
The test method of the scheduling system provided by the embodiment of the invention randomly injects abnormal data into the scheduling system so as to enable the scheduling system to process the abnormal data; when a processing failure message sent by a scheduling system is received, suspending injection of abnormal data so that the scheduling system updates the processing failure data; and when an updating completion message sent by the scheduling system is received, injecting abnormal data into the scheduling system again randomly until the scheduling system reaches a preset robustness target. Abnormal data are injected into the dispatching system at random in a circulating mode, so that automatic detection of the dispatching system can be realized, the detection efficiency of the dispatching system is improved, and the detection cost is reduced; in addition, the coverage rate of real abnormity in the test process can be increased, the scheduling system can be updated according to potential defects before being put into use, and the robustness of the scheduling system is improved.
Example two
Fig. 2 is a schematic structural diagram of a testing apparatus of a scheduling system according to a second embodiment of the present invention. The testing device using the scheduling system can realize the testing method of the scheduling system provided by any embodiment of the invention.
Referring to fig. 2, the test apparatus of the scheduling system includes:
the exception injection module 210 is configured to inject exception data to the scheduling system randomly, so that the scheduling system processes the exception data;
the suspending module 220 is configured to suspend injecting abnormal data when receiving a processing failure message sent by the scheduling system, so that the scheduling system updates the processing failure data;
the abnormal injection module 210 is further configured to, when receiving an update completion message sent by the scheduling system, randomly inject abnormal data into the scheduling system again until the scheduling system reaches the preset robustness target.
Optionally, the exception injection module includes:
the scene selection submodule is used for selecting a target simulation scene from at least one simulation scene;
the abnormal data selection submodule is used for randomly selecting at least one abnormal data corresponding to the target simulation scene according to the type, injection probability and injection quantity range of the abnormal data which are configured for at least one simulation scene in advance;
and the injection submodule is used for injecting the selected at least one abnormal data into the scheduling system.
Further, at least one simulation scene is divided according to simulation time periods and/or simulation space areas.
Further, the type of the abnormal data configured for at least one simulated scene, the injection probability and the injection quantity range thereof include: and configuring an injection quantity range of abnormal data for the at least one simulated scene according to the weight of the at least one simulated scene.
Optionally, the exception injection module is specifically configured to: and responding to the injection exception opening instruction, and randomly injecting exception data into the scheduling system.
Optionally, the exception injection module is specifically configured to: injecting abnormal data into a scheduling system randomly through a preset communication interface; the preset communication interface is an RFC interface, a WebService interface, a RESTFul interface and/or an emulator script interface.
Optionally, when the scheduling system is applied to robot scheduling, the type of the abnormal data includes at least one of the following: the robot has power shortage, dumping, collision and communication abnormity.
The testing device of the scheduling system provided by the embodiment of the invention can execute the testing method of the scheduling system provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method. For details of the technique not described in detail, reference may be made to a method for testing a scheduling system provided in any embodiment of the present invention.
EXAMPLE III
Fig. 3 is a schematic structural diagram of an electronic device according to a third embodiment of the present invention. FIG. 3 illustrates a block diagram of an exemplary electronic device 12 suitable for use in implementing embodiments of the present invention. The electronic device 12 shown in fig. 3 is only an example and should not bring any limitations to the function and scope of use of the embodiments of the present invention. The device 12 is typically an electronic device that undertakes testing of the dispatch system or testing functions of the dispatch system.
As shown in FIG. 3, electronic device 12 is embodied in the form of a general purpose computing device. The components of electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a memory 28, and a bus 18 that couples the various components (including the memory 28 and the processing unit 16).
The processor 16 executes various functional applications and data processing by executing programs stored in the memory 28, for example, a test method of the scheduling system provided by the above embodiment of the present invention is implemented, the method includes: injecting abnormal data into the scheduling system randomly so that the scheduling system processes the abnormal data; when a processing failure message sent by a scheduling system is received, suspending injection of abnormal data so that the scheduling system updates the processing failure data; and when an updating completion message sent by the scheduling system is received, injecting abnormal data into the scheduling system again randomly until the scheduling system reaches a preset robustness target.
Of course, those skilled in the art can understand that the processor may also implement the method for testing the scheduling system or the technical solution of the method for testing the scheduling system provided in any embodiment of the present invention.
Example four
The fourth embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a method for testing a scheduling system, where the method includes:
injecting abnormal data into the scheduling system randomly so that the scheduling system processes the abnormal data; when a processing failure message sent by a scheduling system is received, suspending injection of abnormal data so that the scheduling system updates the processing failure data; and when an updating completion message sent by the scheduling system is received, injecting abnormal data into the scheduling system again randomly until the scheduling system reaches a preset robustness target.
Of course, the computer program stored on the computer-readable storage medium provided in the embodiments of the present invention is not limited to the above method operations, and may also execute the method for testing the scheduling system or the method for testing the scheduling system provided in any embodiment of the present invention.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor device, apparatus, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution apparatus, device, or apparatus.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution apparatus, device, or apparatus.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, or the like, as well as conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments illustrated herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A method for testing a scheduling system, comprising:
injecting abnormal data into the dispatching system randomly so that the dispatching system processes the abnormal data;
when a processing failure message sent by the scheduling system is received, suspending injection of abnormal data so that the scheduling system updates the processing failure data;
and when an updating completion message sent by the scheduling system is received, injecting abnormal data into the scheduling system again randomly so that the scheduling system updates the data which fails to be processed when the scheduling system fails to process the abnormal data, and circularly performing 'triggering the abnormal-scheduling system to update' training until the scheduling system reaches a preset robustness target.
2. The method of claim 1, wherein the randomly injecting anomalous data into the dispatch system comprises:
selecting a target simulation scene from at least one simulation scene;
randomly selecting at least one abnormal data corresponding to the target simulation scene according to the type, injection probability and injection quantity range of the abnormal data configured for the at least one simulation scene in advance;
and injecting the selected at least one abnormal data into the dispatching system.
3. The method of claim 2, wherein the at least one simulated scene is divided by simulation time period and/or simulation space region.
4. The method of claim 2, wherein the type of abnormal data configured for the at least one simulated scenario and the injection probability and injection quantity range thereof comprise:
and configuring an injection quantity range of abnormal data for the at least one simulated scene according to the weight of the at least one simulated scene.
5. The method of claim 1, wherein the randomly injecting anomalous data into the dispatch system comprises:
and responding to an injection exception opening instruction, and randomly injecting exception data into the scheduling system.
6. The method of claim 1, wherein the randomly injecting anomalous data into the dispatch system comprises:
injecting abnormal data into the dispatching system randomly through a preset communication interface; the preset communication interface is an RFC interface, a WebService interface, an RESTFul interface and/or an emulator script interface.
7. The method according to any one of claims 1-6, wherein the type of the anomaly data when the scheduling system is applied to robot scheduling comprises at least one of: the robot has power shortage, dumping, collision and communication abnormity.
8. A test apparatus for a dispatch system, comprising:
the abnormal injection module is used for injecting abnormal data into the dispatching system randomly so that the dispatching system can process the abnormal data;
the scheduling system comprises a suspending module and a control module, wherein the suspending module is used for suspending injection of abnormal data when receiving a processing failure message sent by the scheduling system so as to update the scheduling system aiming at the processing failure data;
and the abnormal injection module is further used for injecting abnormal data into the scheduling system again randomly when receiving an update completion message sent by the scheduling system, so that when the scheduling system fails to process the abnormal data, the scheduling system updates the data which is processed unsuccessfully, and the abnormal-scheduling system update triggering training is performed through circulation until the scheduling system reaches a preset robustness target.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method of testing a scheduling system as claimed in claims 1-7 when executing the program.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out a method for testing a scheduling system as claimed in claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010205107.5A CN111563030A (en) | 2020-03-23 | 2020-03-23 | Method and device for testing scheduling system, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010205107.5A CN111563030A (en) | 2020-03-23 | 2020-03-23 | Method and device for testing scheduling system, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111563030A true CN111563030A (en) | 2020-08-21 |
Family
ID=72074185
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010205107.5A Pending CN111563030A (en) | 2020-03-23 | 2020-03-23 | Method and device for testing scheduling system, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111563030A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115002815A (en) * | 2022-07-18 | 2022-09-02 | 北京紫光青藤微系统有限公司 | Test method and device of NFC system, readable medium and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060179349A1 (en) * | 2005-02-09 | 2006-08-10 | Preemptive Solutions, Llc | System and method for tracking exceptional states |
| CN105808420A (en) * | 2014-12-31 | 2016-07-27 | 阿里巴巴集团控股有限公司 | Implementation method and device of robustness testing process |
| CN108073519A (en) * | 2018-01-31 | 2018-05-25 | 百度在线网络技术（北京）有限公司 | Method for generating test case and device |
-
2020
- 2020-03-23 CN CN202010205107.5A patent/CN111563030A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060179349A1 (en) * | 2005-02-09 | 2006-08-10 | Preemptive Solutions, Llc | System and method for tracking exceptional states |
| CN105808420A (en) * | 2014-12-31 | 2016-07-27 | 阿里巴巴集团控股有限公司 | Implementation method and device of robustness testing process |
| CN108073519A (en) * | 2018-01-31 | 2018-05-25 | 百度在线网络技术（北京）有限公司 | Method for generating test case and device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115002815A (en) * | 2022-07-18 | 2022-09-02 | 北京紫光青藤微系统有限公司 | Test method and device of NFC system, readable medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20120159448A1 (en) | Computer program testing | |
| US20160055333A1 (en) | Protecting software application | |
| US20130326074A1 (en) | Mobile network application test | |
| CN108270837B (en) | Distributed task scheduling method and system using idle resources | |
| CN105512015A (en) | Android target application crash calculation method and device | |
| CN108022020B (en) | Equipment fault management method and device, storage medium and electronic equipment | |
| CN107045475B (en) | Test method and device | |
| US11055416B2 (en) | Detecting vulnerabilities in applications during execution | |
| CN110365641A (en) | Cross-site scripting attack leak detection method, equipment and computer-readable medium | |
| CN105512562B (en) | Vulnerability mining method and device and electronic equipment | |
| CN110727473B (en) | Resource control method, device, system, storage medium and electronic equipment | |
| CN110618853B (en) | Detection method, device and equipment for zombie container | |
| CN111858336A (en) | Software automation test method and system | |
| CN111563030A (en) | Method and device for testing scheduling system, electronic equipment and storage medium | |
| CN109947659B (en) | System, method and apparatus for testing applications | |
| CN115599645B (en) | Method and device for testing stability of linux driving module | |
| CN113836013A (en) | Embedded point testing method and device, computer equipment and computer readable storage medium | |
| CN115509925A (en) | Automatic interface testing method and related device | |
| CN114244700A (en) | Port processing method and device, electronic equipment and computer readable storage medium | |
| CN114266037B (en) | Sample detection method and device, electronic equipment and storage medium | |
| CN113704016B (en) | Cloud function component diagnosis method, device, equipment and storage medium | |
| CN115080977B (en) | Security vulnerability defending method, system, computer equipment and storage medium | |
| CN112181761B (en) | Program execution control method, program execution test device, code detection device, program execution equipment and medium | |
| CN113127001B (en) | Method, device, equipment and medium for monitoring code compiling process | |
| CN115361274B (en) | Alarm message processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| AD01 | Patent right deemed abandoned |
Effective date of abandoning: 20231110 |
|
| AD01 | Patent right deemed abandoned |