CN110391950A - A kind of application service test method and device - Google Patents
A kind of application service test method and device Download PDFInfo
- Publication number
- CN110391950A CN110391950A CN201810342284.0A CN201810342284A CN110391950A CN 110391950 A CN110391950 A CN 110391950A CN 201810342284 A CN201810342284 A CN 201810342284A CN 110391950 A CN110391950 A CN 110391950A
- Authority
- CN
- China
- Prior art keywords
- data
- service
- application service
- result
- tested
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010998 test method Methods 0.000 title abstract 2
- 238000012360 testing method Methods 0.000 claims abstract description 224
- 238000000034 method Methods 0.000 claims abstract description 25
- 230000006870 function Effects 0.000 claims description 57
- 238000011144 upstream manufacturing Methods 0.000 claims description 31
- 230000005540 biological transmission Effects 0.000 claims description 20
- 238000004088 simulation Methods 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 9
- 230000008859 change Effects 0.000 abstract description 4
- 238000010276 construction Methods 0.000 abstract description 2
- 238000005516 engineering process Methods 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 13
- 230000002776 aggregation Effects 0.000 description 11
- 238000004220 aggregation Methods 0.000 description 11
- 238000004140 cleaning Methods 0.000 description 9
- 238000012544 monitoring process Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- CZECQDPEMSVPDH-MNXVOIDGSA-N Asp-Leu-Val-Ser Chemical compound OC(=O)C[C@H](N)C(=O)N[C@@H](CC(C)C)C(=O)N[C@@H](C(C)C)C(=O)N[C@@H](CO)C(O)=O CZECQDPEMSVPDH-MNXVOIDGSA-N 0.000 description 6
- 230000001960 triggered effect Effects 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 5
- 230000003111 delayed effect Effects 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000006399 behavior Effects 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 3
- 230000010354 integration Effects 0.000 description 3
- 238000003786 synthesis reaction Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000002085 persistent effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 235000017166 Bambusa arundinacea Nutrition 0.000 description 1
- 235000017491 Bambusa tulda Nutrition 0.000 description 1
- 241001330002 Bambuseae Species 0.000 description 1
- 206010033799 Paralysis Diseases 0.000 description 1
- 235000015334 Phyllostachys viridis Nutrition 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 239000011425 bamboo Substances 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000012856 packing Methods 0.000 description 1
- 238000013215 result calculation Methods 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 238000009517 secondary packaging Methods 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0681—Configuration of triggering conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/16—Threshold monitoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/14—Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
- H04L63/1408—Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic by monitoring network traffic
- H04L63/1416—Event detection, e.g. attack signature detection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/14—Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
- H04L63/1408—Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic by monitoring network traffic
- H04L63/1425—Traffic logging, e.g. anomaly detection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/14—Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
- H04L63/1441—Countermeasures against malicious traffic
- H04L63/1458—Denial of Service
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a kind of application service test method and devices, are related to field of computer technology.One specific embodiment of this method includes: function point to be measured each for application service, source data needed for function point to be measured is tested in configuration；The service logic of the corresponding application service of function point to be measured is executed, to carry out predetermined registration operation to business datum according to the configuration information in source data, obtains actual test result data；According to the application service rule of source data and corresponding function point to be measured, expected result data are calculated；By each actual test result data and each expected result data, be applied service testing result.The embodiment can fast and convenient setting source data, realize one-stop data input, source data is controllable, and automation/semi-automation test, can quickly detect code change influences system function, it is low to operate threshold, manpower and time, customizable data query interface are saved, solves the problems, such as that test scene construction is difficult, test complexity is reduced, testing efficiency is high.
Description
Technical Field
The invention relates to the technical field of computers, in particular to an application service testing method and device.
Background
A ddos (distributed Denial of service) attack is collectively referred to as a distributed Denial of service attack. The flow statistic service is an application service in a DDOS anti-attack system, and is used for counting all flows (including but not limited to inlet flows, forwarding flows, discarding flows and the like) according to a certain rule through a statistical method to obtain a statistic value taking an IP and an IP group as granularity, comparing the statistic value with a threshold value, and sending an alarm when the statistic value exceeds the threshold value so as to trigger the cleaning action of the IP or the IP group. In addition, all IP and IP level data is stored to the persistent storage system DEEPLOG (an efficient storage, query system packaged with ELASTIC SEARCH (a distributed search engine for mass data storage, analysis) as the core) with granularity of 1 second and 5 minutes.
The three upstream modules of the traffic statistic service are a traffic monitoring cluster, a traffic cleaning cluster and a DLVS cluster (the DLVS cluster is a user-state LINUX high-availability, high-reliability and scalable service cluster). The existing traffic statistics service test scheme is integrated with the three upstream modules to acquire data from the three upstream modules, and source data are uncontrollable; and secondly, the behavior of the three upstream modules is simulated respectively to send data packets to the traffic statistic service during each test.
In the process of implementing the invention, the inventor finds that at least the following problems exist in the prior art:
each test needs manual configuration modification and a large amount of manual auxiliary work, so that a large amount of labor and time cost is consumed, the test efficiency is low, the test cannot be automatically or semi-automatically performed, and the problem of uncontrollable source data exists;
the native ELASTIC SEARCH interface is used for inquiring data, so that the operation threshold is high for a tester, and secondary data statistics are required manually;
it takes a lot of time to construct the test scenario, increasing the test complexity.
Disclosure of Invention
In view of this, embodiments of the present invention provide an application service testing method and apparatus, which enable a tester to set source data quickly and easily, implement "one-stop" data input, have controllable source data, and perform testing automatically or semi-automatically, and can quickly detect the influence of code change on system functions, reduce the operation threshold of the tester, save labor and time costs, customize a data query interface according to requirements, solve the problem that some test scenarios are difficult to construct, reduce test complexity, and improve test efficiency.
To achieve the above object, according to an aspect of an embodiment of the present invention, there is provided an application service testing method.
An application service testing method, comprising: configuring source data required for testing each functional point to be tested of the application service, wherein the source data comprises service data and configuration information; executing the service logic of the application service corresponding to the functional point to be tested, so as to perform preset operation on service data according to configuration information, and obtaining actual test result data according to the result of the preset operation; calculating expected result data according to the source data and the application service rule corresponding to the functional point to be detected; obtaining a test result of the functional point to be tested according to the actual test result data and the expected result data; and obtaining the test result of the application service according to the test results of all the functional points to be tested of the application service.
Optionally, the application service is a traffic statistic service, and the traffic data is traffic simulation data of the upstream module generated according to simulation of one or more upstream module interfaces of the traffic statistic service.
Optionally, the step of executing the service logic of the application service corresponding to the function point to be tested to perform a preset operation on the service data according to the configuration information, where the configuration information includes data statistics configuration or data alarm configuration, includes: executing the statistical logic of the application service corresponding to the functional point to be tested so as to perform data statistical operation on the service data according to the data statistical configuration; or executing the alarm logic of the application service corresponding to the function point to be tested so as to perform data alarm operation on the service data according to the data alarm configuration.
Optionally, the preset operation result includes a data statistics result or a data alarm result, and the step of obtaining actual test result data according to the preset operation result includes: reading the data statistical result from the storage system where the data statistical result is located through a self-defined ELASTIC SEARCH interface, and performing result statistics on the data statistical result according to a preset rule to obtain actual test result data; or reading the data alarm result from a database through a database query interface to obtain the actual test result data.
Optionally, before the step of executing the service logic of the application service corresponding to the functional point to be tested, the method includes: and performing data configuration corresponding to the application service according to the configuration information in the source data.
Optionally, the source data further includes a data sending rule, and before the step of executing the service logic of the application service corresponding to the functional point to be tested, the method includes: and sending the business data to the application service through the data sending rule.
Optionally, the data transmission rule includes concurrently transmitting data.
According to another aspect of the embodiments of the present invention, an application service testing apparatus is provided.
An application service testing apparatus comprising: the test execution module is used for executing the following functions for each functional point to be tested of the application service: configuring source data required for testing the functional point to be tested, wherein the source data comprises service data and configuration information; executing the service logic of the application service corresponding to the functional point to be tested, so as to perform preset operation on service data according to configuration information, and obtaining actual test result data according to the result of the preset operation; calculating expected result data according to the source data and the application service rule corresponding to the functional point to be detected; obtaining a test result of the functional point to be tested according to the actual test result data and the expected result data; and the test result determining module is used for obtaining the test result of the application service according to the test results of all the functional points to be tested of the application service.
Optionally, the application service is a traffic statistic service, and the test execution module includes a service data generation sub-module, configured to: and generating business simulation data of the upstream module according to one or more upstream module interfaces of the traffic statistic service in a simulation mode so as to take the business simulation data as the business data.
Optionally, the configuration information includes data statistics configuration or data alarm configuration, and the test execution module includes a service data operation sub-module, configured to: executing the statistical logic of the application service corresponding to the functional point to be tested so as to perform data statistical operation on the service data according to the data statistical configuration; or executing the alarm logic of the application service corresponding to the function point to be tested so as to perform data alarm operation on the service data according to the data alarm configuration.
Optionally, the result of the preset operation includes a data statistics result or a data alarm result, and the test execution module includes an actual test result data obtaining sub-module, configured to: reading the data statistical result from the storage system where the data statistical result is located through a self-defined ELASTIC SEARCH interface, and performing result statistics on the data statistical result according to a preset rule to obtain actual test result data; or reading the data alarm result from a database through a database query interface to obtain the actual test result data.
Optionally, the test execution module includes a configuration sub-module, configured to: and performing data configuration corresponding to the application service according to the configuration information in the source data.
Optionally, the source data further includes a data sending rule, and the test execution module includes a data sending submodule configured to: and sending the business data to the application service through the data sending rule.
Optionally, the data transmission rule includes concurrently transmitting data.
According to yet another aspect of an embodiment of the present invention, an electronic device is provided.
An electronic device, comprising: one or more processors; a memory for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the application service testing method provided by the present invention.
According to yet another aspect of an embodiment of the present invention, a computer-readable medium is provided.
A computer-readable medium, on which a computer program is stored, which, when executed by a processor, implements the application service testing method provided by the present invention.
One embodiment of the above invention has the following advantages or benefits: configuring source data required by testing the functional points to be tested for each functional point to be tested of the application service, wherein the source data comprises service data and configuration information; executing the business logic of the application service corresponding to the functional point to be tested, so as to perform preset operation on the business data according to the configuration information in the source data, and obtaining actual test result data according to the result of the preset operation; calculating expected result data according to the source data and the application service rule corresponding to the function point to be detected; obtaining a test result of the functional point to be tested according to the actual test result data and the expected result data; and obtaining the test result of the application service according to the test results of all the functional points to be tested of the application service. The method can enable a tester to set source data quickly and simply, and realize one-stop data input, namely, for a single test case, only one-time data configuration is needed, no intermediate manual calculation synthesis is needed, and for the whole automatic test framework, information such as database addresses and the like is configured at a higher level, and only one-time unified configuration is needed, so that the source data is controllable, automatic or semi-automatic test can be carried out, and the influence of code change on system functions can be detected quickly. Through the self-defined ELASTICSEARCH interface, the data statistical result is read from the storage system where the data statistical result is located, and the result statistics is carried out on the data statistical result according to the preset rule, so that the actual test result data is obtained, the operation threshold of testers is reduced, the labor and time cost is saved, and the data query interface can be customized according to the requirements. The service data is sent to the application service through the concurrent data sending mode, the problem that some test scenes are difficult to construct is solved, the test complexity is reduced, and the test efficiency is improved.
Further effects of the above-mentioned non-conventional alternatives will be described below in connection with the embodiments.
Drawings
The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:
FIG. 1 is a diagram illustrating the main steps of testing a functional point of an application service under test according to an embodiment of the present invention;
FIG. 2 is a flow chart illustrating a traffic statistics service testing method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of the main modules of an application service testing apparatus according to an embodiment of the present invention;
FIG. 4 is a system diagram of application service testing, according to an embodiment of the present invention;
FIG. 5 is an exemplary system architecture diagram in which embodiments of the present invention may be employed;
FIG. 6 is a schematic block diagram of a computer system suitable for use with a server implementing an embodiment of the invention.
Detailed Description
Exemplary embodiments of the present invention are described below with reference to the accompanying drawings, in which various details of embodiments of the invention are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
The application service testing method of the embodiment of the invention takes the flow statistic service of a DDOS anti-attack system as an example, and the DDOS (distributed Denial of service) attack is called as distributed Denial of service attack. The method mainly utilizes an attack tool, a server or a large number of hosts which are illegally controlled, and leads the attacked object to be in paralyzed behavior by consuming a large number of service resources, consuming link bandwidth, utilizing a universal protocol vulnerability and the like. The DDOS anti-attack system can effectively resist dnsfload (domain name system flooding), NTP FLOOD (network time protocol-based flooding), reflective amplification attack, SYNFLOOD (SYN is the first stage of establishing connection by "three-way handshake" in TCP protocol), which is a common DDOS attack for breaking down a target by sending a large number of SYN messages), ACK FLOOD (ACK is the third stage of establishing connection by "three-way handshake" in TCP protocol, which is a common DDOS attack for breaking down a target by sending a large number of ACK messages), SYN-ACK FLOOD (SYN-ACK is the second stage of establishing connection by "three-way handshake" in TCP protocol, which is a common DDOS attack for breaking down a target by sending a large number of SYN-ACK messages), FIN FLOOD (SYN is a stage of breaking connection by "four times" in TCP protocol again ", which is a large number of FIN packets for breaking down a target, the method is a common DDOS attack), CC attack (an attacker generates a legal request pointing to a victim host by means of a proxy server to realize DDOS and camouflage) and other common DDOS attack types. Interfacing with the traffic statistic service of the DDOS anti-attack system are three upstream clusters, namely, a traffic monitoring cluster, a traffic cleaning cluster and a DLVS cluster, or called an upstream module (from the viewpoint of data flow, the three clusters or modules are located upstream of the data flow of the traffic statistic service), and receiving data from the three modules. Then, the calculation is performed according to the following rule: data aggregation is carried out on the data according to the IP and the time stamp (data aggregation is a mode of data statistics), and for the same time stamp and the same IP, if the message arrives within 1 second, the data aggregation is carried out on the message; sending an alarm to part of data of the IP level exceeding the first threshold according to the first preset threshold; and carrying out IP group level aggregation on the IP, namely receiving data packets within 1 second by the data with the same timestamp in the same IP group, carrying out data aggregation, and sending an alarm to the part of the data of the IP group level exceeding a second threshold according to the second preset threshold.
Fig. 1 is a schematic diagram illustrating main steps of testing a functional point to be tested of an application service according to an embodiment of the present invention.
As shown in fig. 1, the main steps of testing a functional point to be tested of an application service according to an embodiment of the present invention include steps S101 to S104.
Step S101: and configuring source data required by testing the functional point to be tested, wherein the source data comprises service data and configuration information.
The application service may be a traffic statistics service.
The function point to be tested is any one of a plurality of function points to be tested of the application service. Taking the application service as an example of the traffic statistic service, the traffic statistic service includes a statistic function and an alarm function for the service data, and the function point to be tested may be one of the exemplary function points under the statistic function or the alarm function.
The traffic data may be traffic simulation data for the upstream module generated from simulation of one or more upstream module interfaces of the traffic statistics service. The upstream modules are a flow monitoring module, a flow cleaning module, and a DLVS module (which may also be referred to as a flow monitoring cluster, a flow cleaning cluster, and a DLVS cluster, respectively).
Determining specific simulated service simulation data of the upstream module according to the function point to be tested of the application service, for example, in a certain test case, according to the test requirement of the function point to be tested, if the service data of the flow monitoring module and the flow cleaning module needs to be simulated, simulating and generating the service simulation data of the flow monitoring module and the flow cleaning module according to the interfaces of the flow monitoring module and the flow cleaning module respectively.
The configuration information may include a data statistics configuration or a data alarm configuration. The data statistics configuration may specifically include some configuration information required by the traffic statistics service when performing data statistics, for example, an IP group name, a correspondence between an IP group and an IP, and the like. The correspondence between IP groups and IPs includes information such as whether a certain IP needs to be counted, and the name of the IP group to which the IP belongs. The data alarm configuration may specifically include some configuration information required by the traffic statistics service when performing data alarm, such as an alarm identifier, alarm source data, and the like. The alarm identifier is used for indicating alarm, the alarm source data is a data structure abstracted according to a preset alarm rule of the application service, and various alarms can be triggered or not triggered by configuring the alarm source data. For example, the preset alarm rule is: inhibits/(outbits + inhibits) >0.2, the configured warning source data can be in the form of: when the input is XXX and the output is YYY, the alarm triggering condition of the preset alarm rule is satisfied (namely the value of input/(outputs + inputs) is more than 0.2), the alarm is triggered, otherwise, the alarm is not triggered.
The source data further includes a data sending rule, and the data sending rule may specifically include information such as whether the IPs are the same, the number of the IPs (in one data packet), whether the IPs are out of order, whether the IPs are delayed, the delay time, whether the early arrival is identified, and the early arrival time. The IP identity is used for indicating whether the data IP is the same, whether the data IP is out-of-order identity, whether the data IP is delayed identity, delay time, whether the data IP is early arrival identity, the early arrival time and other information respectively indicate whether the data is sent out-of-order, whether the data is delayed to be sent, whether the data is early sent and the data is early arrival time.
The data transmission rule may further include a data transmission mode, where the data transmission mode may include concurrent data transmission, or may also include single data transmission and mixed data transmission, where the single data transmission refers to transmitting only the service simulation data of one upstream module, and the mixed data transmission refers to mixed transmission of the service simulation data of at least two upstream modules.
The source data needed by the flow statistics service test has a plurality of dimensions, the embodiment of the invention adopts one-stop data input in the initialization stage, namely, for a single test case, only one-time data configuration is needed, no intermediate manual calculation and synthesis are needed, and for the whole automatic test framework, information such as database addresses and the like is configured at a higher level, and only one-time unified configuration is needed, so that the test efficiency is improved. The configured source data comprises all function points of the application service to be tested, and is very friendly and intuitive to testing personnel.
Step S102: and executing the service logic of the application service corresponding to the functional point to be tested, so as to perform preset operation on the service data according to the configuration information in the source data, and obtaining actual test result data according to the result of the preset operation.
Before the step of executing the business logic of the application service corresponding to the functional point to be tested, the method comprises the following steps: and transmitting the service data to the application service according to the data transmission rule. Specifically, traffic data may be transmitted to an application service through a mode of concurrently transmitting data.
The data may be sent individually or mixed according to the configuration in step S101, and the specific sending method may be as default to send data in real time sequentially, or may be as configuration as delayed sending, early sending, sending data out of order, and the like.
In the embodiment of the present invention, a data aggregation rule (which is a data statistics rule) in a service logic of an application service (such as a traffic statistics service) has a high time requirement, and the following test scenario needs to be constructed, that is: data from upstream modules have the same timestamp and arrive at the application service at the same time.
Two test schemes of the existing traffic statistical service, one of which is integrated with three upstream modules (namely a traffic monitoring module, a traffic cleaning module and a DLVS module), and service data are sent from the three upstream modules, and the service data are the respective current system time of the upstream modules and cannot have the same timestamp, so that the time requirement of the data aggregation rule cannot be met; the other scheme is to simulate the behaviors of three upstream modules respectively to send simulated service data, although the service data with the same timestamp can be simulated, the service data of different upstream modules can be simulated respectively and sent to the application service, and the time of the service data reaching the application service cannot be strictly controlled, so that the time requirement cannot be met. Therefore, the problem that the test scene is difficult to construct exists in both the existing two test schemes of the traffic statistic service.
The embodiment of the invention uniformly configures the service data of each upstream module required by the application service and adopts a mode of sending messages (or called data) concurrently to send the service data, so that the data reaching the application service has the same timestamp and the same arrival time, and the problem that the test scene is difficult to construct in the existing scheme is solved.
Before the step of executing the business logic of the application service corresponding to the functional point to be tested, the method further comprises the following steps: and performing data configuration corresponding to the application service according to the configuration information in the source data. The data configuration corresponding to an application service refers to some of the configurations required by the application service to perform statistics logic and alarm logic. This may include modifying existing data configurations in a database (e.g., MySQL database) of the application service based on data statistical configurations in the source data, so that when the statistical logic of the application service is executed, the application service may read the modified data configurations from the database and execute the statistical logic according to the modified data configurations. And modifying the data configuration stored in the MySQL database of the application service according to the configuration information in the source data, for example, modifying the corresponding relation between the IP group and the IP stored in the MySQL database, wherein the stored IP is firstly cleaned, and then the IP in the configuration information of the source data is inserted into the MySQL database. The data configuration may further include configuring source data required for executing an alarm rule of the application service according to a data alarm configuration (an alarm identifier and alarm source data) in the source data, specifically, processing the alarm source data into a form of service data, and then sending the service data to the application service.
Executing the business logic of the application service corresponding to the functional point to be tested so as to perform preset operation on the business data according to the configuration information in the source data, wherein the step comprises the following steps: and executing the statistical logic of the application service corresponding to the function point to be tested to perform data statistical operation on the service data according to the data statistical configuration, or executing the alarm logic of the application service corresponding to the function point to be tested to perform data alarm operation on the service data according to the data alarm configuration.
Specifically, the data statistics operation is performed on the service data according to the data statistics configuration, which may be to perform data statistics of IP or IP group granularity on the service data according to configuration information such as a corresponding relationship between a configured IP group and an IP. Performing data alarm operation on the service data according to the data alarm configuration, for example, the amount/(amounts + amounts) >0.2, where the configured alarm source data is: and if the statistical result of the business data of the application service is that it is not XXX and that it is YYY, and the statistics result satisfies that the counts/(counts + entries) >0.2, then a data alarm operation is performed, wherein "XXX" and "YYY" represent specific data.
The application service obtains the result of the preset operation by executing the business logic, wherein the result comprises a data statistical result or a data alarm result. The data statistics result can be stored in a DEEPLOG, which is an efficient storage and query system with ELASTIC SEARCH as a core package. The data alarm result can be stored in a database of the application service, specifically, a MySQL database.
The step of obtaining actual test result data according to a result of the preset operation may specifically include: reading a data statistical result from a storage system (specifically, DEEPLOG) where the data statistical result is located through a self-defined ELASTIC SEARCH interface, and performing result statistics on the data statistical result according to a preset rule to obtain actual test result data; or, reading the data alarm result from the database (for example, MySQL database) where the data alarm result is located through the database query interface, and obtaining the actual test result data. The custom ELASTIC SEARCH interface is a data reading interface obtained by performing secondary packaging according to test requirements on the basis of a ELASTIC SEARCH interface of a native package provided by DEEPLOG.
Existing solutions query data in ELASTIC SEARCH can be simply categorized into two categories: one is to query data using the existing ELASTIC SEARCH interface, for example, inputting commands for data query, which is not supported by many filtering conditions, or to query using ELASTIC SEARCH UI interface (user), which also has a certain technical threshold for testers; secondly, secondary statistics are carried out from the result of ELASTIC SEARCH, and the operation lacks an existing interface and can only be carried out manually.
Because the flow statistic service has very high requirement on accuracy, the embodiment of the invention secondarily packages the ELASTIC SEARCH native interface and customizes the ELASTIC SEARCH interface function according to test requirements, so that when reading the data statistic result from the DEEPLOG, the result statistics can be automatically performed on the data statistic result according to a preset rule, for example, the number of the statistic data pieces and the sum of the data in a set time period according to certain field statistics. Through a self-defined ELASTIC SEARCH interface, a data statistical result is read from a storage system (such as DEEPLOG) where the data statistical result is located, the data statistical result is subjected to result statistics according to a preset rule, actual test result data are obtained, the operation threshold of a tester can be reduced, the customized function composite test requirement is met, and the test efficiency is greatly improved.
Step S103: and calculating expected result data according to the source data and the application service rule corresponding to the functional point to be detected.
The application service rule can be set according to the requirement of the functional point to be tested. For example, the preset rules may include: for data with the same timestamp and the same IP, if the time of reaching the application service is within 1 second, the data needs to be counted (which can be counted in an aggregation manner).
The execution sequence of the step of calculating the expected result data and the step of obtaining the actual test result data does not limit the embodiment of the present invention, and the expected result data may be calculated after obtaining the actual test result data.
Step S104: and obtaining a test result of the functional point to be tested according to the actual test result data and the expected result data.
Step S104 specifically, the actual test result data and the expected result number are compared, if the actual test result data and the expected result number are consistent, the test on the functional point to be tested is passed, otherwise, the test fails.
When the application service of the embodiment of the present invention is started, according to the above steps S101 to S104, the test of all the function points to be tested of the application service is executed, and the specific test is performed by executing the test case corresponding to each function point to be tested, so as to obtain the test result of each function point to be tested, and obtain the test result of the application service according to the test results of all the function points to be tested of the application service.
The application service testing method of the embodiment of the invention enables the source data to be controllable by uniformly configuring the source data, and the source data is not required to be integrated with an upstream module of the application service to obtain the service data required by the test, so that the environment building and the test execution of other modules are not required, the test complexity is reduced, and after the uniform configuration, if the application service does not add a new function, the configured test flow can be directly operated during the subsequent test, the reconfiguration is not required, a large amount of manual auxiliary operation is not required, if the application service adds a new function, only a new test case needs to be added, the expandability is good, the dependence on the manual work is reduced, and the waste of a large amount of time and energy in data calculation is avoided. By sending data concurrently, a test scenario can be easily constructed for testing functions such as a data aggregation function, a data alarm function, and mixed information processing, in which data reaches an application service within 1s (second), thereby avoiding spending a lot of time in constructing the test scenario, and enabling a tester to concentrate on the application service to be tested.
Fig. 2 is a flow chart of a traffic statistic service testing method according to an embodiment of the present invention.
As shown in fig. 2, the flow of the traffic statistic service testing method according to the embodiment of the present invention may include the following steps S201 to S205.
Step S201: and configuring source data required by each functional point to be tested.
The source data required by a certain functional point to be tested comprises service data, configuration information and a data sending rule corresponding to the functional point to be tested.
Step S202: and respectively executing the business logic of the flow statistic service corresponding to each function point to be tested so as to respectively carry out data statistics or data alarm operation on the business data corresponding to each function point to be tested and obtain actual test result data according to the result of the data statistics or the data alarm.
Step S203: and calculating expected result data of the test of each function point to be tested according to the source data and the corresponding flow statistic service rule of each function point to be tested.
The traffic statistic service rule can be set according to the requirement of the function point to be tested. For example, the preset rules may include: for data with the same timestamp and the same IP, if the time of reaching the application service is within 1 second, the data needs to be counted (which can be counted in an aggregation manner).
Step S204: and obtaining the test result of each function point to be tested according to the actual test result data and the expected result data of each function point to be tested.
Step S205: and obtaining the test result of the traffic statistic service according to the test results of all the functional points to be tested of the traffic statistic service.
Fig. 3 is a schematic diagram of main blocks of an application service testing apparatus according to an embodiment of the present invention.
As shown in fig. 3, the application service testing apparatus 300 according to the embodiment of the present invention mainly includes: a test execution module 301 and a test result determination module 302.
The test execution module 301 is configured to, for each function point to be tested of the application service, execute the following functions:
configuring source data required by testing a functional point to be tested, wherein the source data comprises service data and configuration information and can also comprise a data sending rule;
executing the service logic of the application service corresponding to the functional point to be tested to perform preset operation on the service data according to the configuration information in the source data, and obtaining actual test result data according to the result of the preset operation, wherein the result of the preset operation can include a data statistical result or a data alarm result;
calculating expected result data according to the source data and the application service rule corresponding to the function point to be detected;
and obtaining a test result of the functional point to be tested according to the actual test result data and the expected result data.
Wherein, the application service is a flow statistic service. The configuration information includes a data statistics configuration or a data alarm configuration.
The test execution module 301 may include a service data generation sub-module, configured to: and generating the business simulation data of the upstream module according to the simulation of one or more upstream module interfaces of the traffic statistic service so as to take the business simulation data as the business data.
The test execution module 301 may further include a service data operation sub-module, configured to: and executing the statistical logic of the application service corresponding to the function point to be tested to perform data statistical operation on the service data according to the data statistical configuration, or executing the alarm logic of the application service corresponding to the function point to be tested to perform data alarm operation on the service data according to the data alarm configuration.
The test execution module 301 may further include an actual test result data obtaining sub-module, configured to: reading a data statistical result from a storage system where the data statistical result is located through a self-defined ELASTIC SEARCH interface, and performing result statistics on the data statistical result according to a preset rule to obtain actual test result data; or reading the data alarm result from the database where the data alarm result is located through the database query interface to obtain the actual test result data.
The test execution module may further comprise a 301 configuration sub-module for: and performing data configuration corresponding to the application service according to the configuration information in the source data.
The test execution module 301 may further include a data transmission sub-module for: and transmitting the service data to the application service according to the data transmission rule. Wherein the data transmission rule may comprise concurrently transmitting data.
The test result determining module 302 is configured to obtain a test result of the application service according to the test results of all to-be-tested function points of the application service.
In addition, the detailed implementation of the application service testing apparatus in the embodiment of the present invention has been described in detail in the above application service testing method, and therefore, the repeated content will not be described again.
FIG. 4 is a system diagram of application service testing, according to an embodiment of the present invention.
The application service takes a traffic statistic service as an example, and as shown in fig. 4, the system for testing the application service of the embodiment of the present invention mainly includes a fast and automatic packing and deploying architecture of a persistent integration system, an automatic testing framework, and a DDOS traffic statistic service architecture.
The rapid automatic packaging deployment architecture of the continuous integration system comprises Git (an open source distributed version control system), Jenkins (a continuous integration tool developed based on Java), and an HTML (hypertext markup language)/Email module, wherein codes of an automatic test framework are stored in Git. The tested application service can be automatically constructed and deployed by Jenkins, the tested application service can be configured and started, and after the tested application service is automatically deployed and started, an automatic testing framework can be automatically triggered to execute the flow statistic service testing process of the embodiment of the invention. Jenkins obtains codes of an automatic test frame from Git, and transmits some public configurations such as the IP address of MySQL and the like to the automatic test frame, the automatic test frame executes service logic of the codes to perform automatic test, and returns test results to Jenkins, the Jenkins can display the test results by using HTML pages in an HTML/Email module or in the form of Email, and can also view logs of test execution.
The automated testing framework is a specific implementation of the application service testing apparatus 300 according to the embodiment of the present invention. The automated testing framework includes a Client (the Client in the embodiment of the present invention is an API set), TestCases (test cases), libs (libraries), and the Client module, the TestCases (test cases) module, and the libs (libraries) are combined to implement the functions of the modules of the application service testing apparatus 300. Taking a test statistic function as an example, an automatic test framework is triggered by Jenkins, a Client module operates a MySQL database in a DDOS traffic statistic service framework to modify data configuration (for example, correspondence between an IP and an IP group) in the MySQL database according to configuration information in source data (the source data is input from a TestCases module configuration), then a corresponding data packet (including traffic data in the data packet) is sent to a traffic statistic service, the traffic statistic service reads the data configuration (for example, correspondence between the IP and the IP group) from the MySQL database, executes statistic logic, and performs data statistic operation on the traffic data. lib includes common functions and intermediate processing functions required for testing, and can be used to compare actual test result data with expected result data.
The DDOS traffic statistic service architecture comprises a Bamboo Server, an Etcd Server, a DeeplogServer and MySQL. After receiving a data packet sent by an automated testing framework, the bambooo server first reads the latest data configuration from MySQL, for example: whether a certain IP needs to be processed, which IP group the IP belongs to, and the like, then, according to the latest data configuration, the service data is counted according to the data aggregation rule (or data statistical rule) of the traffic statistical service, and the statistical result is stored in a DeeplogServer. The Bambooser is two service clusters, and the Etcd Server is mainly used for data transmission inside the two service clusters. MySQL is used for storing data configuration and data alarm results.
Fig. 5 illustrates an exemplary system architecture 500 of an application service testing method or application service testing apparatus to which embodiments of the present invention may be applied.
As shown in fig. 5, the system architecture 500 may include terminal devices 501, 502, 503, a network 504, and a server 505. The network 504 serves to provide a medium for communication links between the terminal devices 501, 502, 503 and the server 505. Network 504 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.
The user may use the terminal devices 501, 502, 503 to interact with a server 505 over a network 504 to receive or send messages or the like. The terminal devices 501, 502, 503 may have various communication client applications installed thereon, such as a shopping application, a web browser application, a search application, an instant messaging tool, a mailbox client, social platform software, and the like.
The terminal devices 501, 502, 503 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.
The server 505 may be a server that provides various services, such as a background management server that supports shopping websites browsed by users using the terminal devices 501, 502, 503. The background management server may analyze and perform other processing on the received data such as the product information query request, and feed back a processing result (e.g., product information) to the terminal device.
It should be noted that the application service testing method provided by the embodiment of the present invention is generally executed by the server 505, and accordingly, the application service testing apparatus is generally disposed in the server 505.
It should be understood that the number of terminal devices, networks, and servers in fig. 5 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
Referring now to FIG. 6, shown is a block diagram of a computer system 600 suitable for use in implementing a server according to embodiments of the present application. The server shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.
As shown in fig. 6, the computer system 600 includes a Central Processing Unit (CPU)601 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)602 or a program loaded from a storage section 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data necessary for the operation of the system 600 are also stored. The CPU 601, ROM 602, and RAM 603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
The following components are connected to the I/O interface 605: an input portion 606 including a keyboard, a mouse, and the like; an output portion 607 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 608 including a hard disk and the like; and a communication section 609 including a network interface card such as a LAN card, a modem, or the like. The communication section 609 performs communication processing via a network such as the internet. The driver 610 is also connected to the I/O interface 605 as needed. A removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 610 as necessary, so that a computer program read out therefrom is mounted in the storage section 608 as necessary.
In particular, according to the embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 609, and/or installed from the removable medium 611. The above-described functions defined in the system of the present application are executed when the computer program is executed by the Central Processing Unit (CPU) 601.
It should be noted that the computer readable medium shown in the present invention can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In this application, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules described in the embodiments of the present invention may be implemented by software or hardware. The described modules may also be provided in a processor, which may be described as: a processor includes a source data configuration module 301, a test execution module 302, an expected result calculation module 303, a test result determination module 304. The names of these modules do not constitute a limitation to the modules themselves in some cases, for example, the source data configuration module 301 may also be described as a "module for configuring source data required for a test according to a functional point to be tested of an application service".
As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be separate and not incorporated into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to comprise: configuring source data required by the test according to a functional point to be tested of the application service, wherein the source data comprises service data and configuration information; executing the business logic of the application service to perform preset operation on the business data according to the configuration information in the source data and obtain actual test result data according to the result of the preset operation; calculating expected result data according to preset rules of the source data and the application service; and obtaining the test result of the application service through the actual test result data and the expected result data.
According to the technical scheme of the embodiment of the invention, for each functional point to be tested of the application service, source data required by testing the functional point to be tested is configured, wherein the source data comprises service data and configuration information; executing the business logic of the application service corresponding to the functional point to be tested, so as to perform preset operation on the business data according to the configuration information in the source data, and obtaining actual test result data according to the result of the preset operation; calculating expected result data according to the source data and the application service rule corresponding to the function point to be detected; obtaining a test result of the functional point to be tested according to the actual test result data and the expected result data; and obtaining the test result of the application service according to the test results of all the functional points to be tested of the application service. The method can enable a tester to set source data quickly and simply, and realize one-stop data input, namely, for a single test case, only one-time data configuration is needed, no intermediate manual calculation synthesis is needed, and for the whole automatic test framework, information such as database addresses and the like is configured at a higher level, and only one-time unified configuration is needed, so that the source data is controllable, automatic or semi-automatic test can be carried out, and the influence of code change on system functions can be detected quickly. Through the self-defined ELASTIC SEARCH interface, the data statistical result is read from the storage system where the data statistical result is located, and the result statistics is carried out on the data statistical result according to the preset rule, so that the actual test result data is obtained, the operation threshold of testers is reduced, the labor and time cost is saved, and the data query interface can be customized according to the requirements. The service data is sent to the application service through the concurrent data sending mode, the problem that some test scenes are difficult to construct is solved, the test complexity is reduced, and the test efficiency is improved.
The above-described embodiments should not be construed as limiting the scope of the invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions can occur, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (16)
1. An application service testing method, comprising:
configuring source data required for testing each functional point to be tested of the application service, wherein the source data comprises service data and configuration information;
executing the service logic of the application service corresponding to the functional point to be tested, so as to perform preset operation on service data according to configuration information, and obtaining actual test result data according to the result of the preset operation;
calculating expected result data according to the source data and the application service rule corresponding to the functional point to be detected;
obtaining a test result of the functional point to be tested according to the actual test result data and the expected result data;
and obtaining the test result of the application service according to the test results of all the functional points to be tested of the application service.
2. The method of claim 1, wherein the application service is a traffic statistics service, and the traffic data is traffic simulation data of the upstream module generated according to simulation of one or more upstream module interfaces of the traffic statistics service.
3. The method of claim 1, wherein the configuration information comprises a data statistics configuration or a data alarm configuration,
executing the service logic of the application service corresponding to the functional point to be tested to perform preset operation on service data according to configuration information, wherein the step comprises the following steps:
executing the statistical logic of the application service corresponding to the functional point to be tested so as to perform data statistical operation on the service data according to the data statistical configuration;
or,
and executing the alarm logic of the application service corresponding to the functional point to be tested so as to perform data alarm operation on the service data according to the data alarm configuration.
4. The method of claim 3, wherein the result of the predetermined operation comprises a data statistic result or a data alarm result,
the step of obtaining actual test result data according to the result of the preset operation comprises the following steps:
reading the data statistical result from the storage system where the data statistical result is located through a self-defined ELASTIC SEARCH interface, and performing result statistics on the data statistical result according to a preset rule to obtain actual test result data;
or,
and reading the data alarm result from a database through a database query interface to obtain the actual test result data.
5. The method according to claim 1, wherein the step of executing the business logic of the application service corresponding to the functional point to be tested is preceded by:
and performing data configuration corresponding to the application service according to the configuration information in the source data.
6. The method of claim 1, wherein the source data further comprises data transmission rules,
before the step of executing the business logic of the application service corresponding to the functional point to be tested, the method comprises the following steps:
and sending the business data to the application service through the data sending rule.
7. The method of claim 6, wherein the data transmission rule comprises concurrently transmitting data.
8. An application service testing apparatus, comprising:
the test execution module is used for executing the following functions for each functional point to be tested of the application service:
configuring source data required for testing the functional point to be tested, wherein the source data comprises service data and configuration information;
executing the service logic of the application service corresponding to the functional point to be tested, so as to perform preset operation on service data according to configuration information, and obtaining actual test result data according to the result of the preset operation;
calculating expected result data according to the source data and the application service rule corresponding to the functional point to be detected;
obtaining a test result of the functional point to be tested according to the actual test result data and the expected result data;
and the number of the first and second groups,
and the test result determining module is used for obtaining the test result of the application service according to the test results of all the functional points to be tested of the application service.
9. The apparatus of claim 8, wherein the application service is a traffic statistics service,
the test execution module comprises a service data generation submodule for:
and generating business simulation data of the upstream module according to one or more upstream module interfaces of the traffic statistic service in a simulation mode so as to take the business simulation data as the business data.
10. The apparatus of claim 8, wherein the configuration information comprises a data statistics configuration or a data alarm configuration,
the test execution module comprises a service data operation submodule for:
executing the statistical logic of the application service corresponding to the functional point to be tested so as to perform data statistical operation on the service data according to the data statistical configuration;
or,
and executing the alarm logic of the application service corresponding to the functional point to be tested so as to perform data alarm operation on the service data according to the data alarm configuration.
11. The apparatus of claim 10, wherein the result of the preset operation comprises a data statistic result or a data alarm result,
the test execution module comprises an actual test result data acquisition submodule for:
reading the data statistical result from the storage system where the data statistical result is located through a self-defined ELASTIC SEARCH interface, and performing result statistics on the data statistical result according to a preset rule to obtain actual test result data;
or,
and reading the data alarm result from a database through a database query interface to obtain the actual test result data.
12. The apparatus of claim 8, wherein the test execution module comprises a configuration submodule configured to:
and performing data configuration corresponding to the application service according to the configuration information in the source data.
13. The apparatus of claim 8, wherein the source data further comprises data transmission rules,
the test execution module comprises a data sending submodule for:
and sending the business data to the application service through the data sending rule.
14. The apparatus of claim 13, wherein the data transmission rule comprises concurrently transmitting data.
15. An electronic device, comprising:
one or more processors;
a memory for storing one or more programs,
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method recited in any of claims 1-7.
16. A computer-readable medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810342284.0A CN110391950A (en) | 2018-04-17 | 2018-04-17 | A kind of application service test method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810342284.0A CN110391950A (en) | 2018-04-17 | 2018-04-17 | A kind of application service test method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110391950A true CN110391950A (en) | 2019-10-29 |
Family
ID=68283886
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810342284.0A Pending CN110391950A (en) | 2018-04-17 | 2018-04-17 | A kind of application service test method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110391950A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112783753A (en) * | 2019-11-07 | 2021-05-11 | 北京沃东天骏信息技术有限公司 | Test method and device for stream data processing system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130185056A1 (en) * | 2012-01-12 | 2013-07-18 | Accenture Global Services Limited | System for generating test scenarios and test conditions and expected results |
| CN106649099A (en) * | 2016-11-15 | 2017-05-10 | 中国互联网络信息中心 | Automatic testing method and system for DNS monitoring service |
| CN106897216A (en) * | 2017-02-13 | 2017-06-27 | 北京趣拿软件科技有限公司 | The method and apparatus of test software |
| CN107861870A (en) * | 2017-11-02 | 2018-03-30 | 平安科技（深圳）有限公司 | Interface testing and test data generating method, device, terminal and storage medium |
-
2018
- 2018-04-17 CN CN201810342284.0A patent/CN110391950A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130185056A1 (en) * | 2012-01-12 | 2013-07-18 | Accenture Global Services Limited | System for generating test scenarios and test conditions and expected results |
| CN106649099A (en) * | 2016-11-15 | 2017-05-10 | 中国互联网络信息中心 | Automatic testing method and system for DNS monitoring service |
| CN106897216A (en) * | 2017-02-13 | 2017-06-27 | 北京趣拿软件科技有限公司 | The method and apparatus of test software |
| CN107861870A (en) * | 2017-11-02 | 2018-03-30 | 平安科技（深圳）有限公司 | Interface testing and test data generating method, device, terminal and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112783753A (en) * | 2019-11-07 | 2021-05-11 | 北京沃东天骏信息技术有限公司 | Test method and device for stream data processing system |
| CN112783753B (en) * | 2019-11-07 | 2024-04-12 | 北京沃东天骏信息技术有限公司 | Testing method and device for stream data processing system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10812513B1 (en) | Correlation and consolidation holistic views of analytic data pertaining to a malware attack | |
| US11075945B2 (en) | System, apparatus and method for reconfiguring virtual machines | |
| US10133863B2 (en) | Zero-day discovery system | |
| US10192052B1 (en) | System, apparatus and method for classifying a file as malicious using static scanning | |
| US10027705B1 (en) | Apparatuses, methods and systems for a real-time cyber threat indicator verification mechanism | |
| CN111400722B (en) | Method, apparatus, computer device and storage medium for scanning small program | |
| US9584541B1 (en) | Cyber threat identification and analytics apparatuses, methods and systems | |
| CN113315742B (en) | Attack behavior detection method and device and attack detection equipment | |
| US20160142432A1 (en) | Resource classification using resource requests | |
| CN113364804B (en) | Method and device for processing flow data | |
| CN105577799A (en) | Method and device for detecting fault of database cluster | |
| US20120266186A1 (en) | Providing inter-platform application launch in context | |
| CN113595927A (en) | Method and device for processing mirror flow in bypass mode | |
| US11636198B1 (en) | System and method for cybersecurity analyzer update and concurrent management system | |
| CN112804263A (en) | Vulnerability scanning method, system and equipment for Internet of things | |
| CN117176802B (en) | Full-link monitoring method and device for service request, electronic equipment and medium | |
| CN109522202B (en) | Software testing method and device | |
| US11985149B1 (en) | System and method for automated system for triage of cybersecurity threats | |
| US11159548B2 (en) | Analysis method, analysis device, and analysis program | |
| CN110391950A (en) | A kind of application service test method and device | |
| CN115174192A (en) | Application security protection method and device, electronic equipment and storage medium | |
| CN113890858A (en) | PMTU detection method and device | |
| US11657143B2 (en) | Request control device, request control method, and request control program | |
| CN115277506B (en) | Load balancing equipment testing method and system | |
| CN116260855B (en) | Communication method, communication device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |