CN113485918B - Test method, test device, electronic equipment and storage medium - Google Patents

Test method, test device, electronic equipment and storage medium Download PDF

Info

Publication number
CN113485918B
CN113485918B CN202110739282.7A CN202110739282A CN113485918B CN 113485918 B CN113485918 B CN 113485918B CN 202110739282 A CN202110739282 A CN 202110739282A CN 113485918 B CN113485918 B CN 113485918B
Authority
CN
China
Prior art keywords
test
job
qps
interface
optimal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110739282.7A
Other languages
Chinese (zh)
Other versions
CN113485918A (en
Inventor
李雄清
关健
李永
任政委
周东琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Travelsky Technology Co Ltd
Original Assignee
China Travelsky Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Travelsky Technology Co Ltd filed Critical China Travelsky Technology Co Ltd
Priority to CN202110739282.7A priority Critical patent/CN113485918B/en
Publication of CN113485918A publication Critical patent/CN113485918A/en
Priority to PCT/CN2022/088910 priority patent/WO2023273561A1/en
Application granted granted Critical
Publication of CN113485918B publication Critical patent/CN113485918B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3688Test management for test execution, e.g. scheduling of test suites
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3684Test management for test design, e.g. generating new test cases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3692Test management for test results analysis

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention provides a testing method, a testing device, electronic equipment and a storage medium, which are applied to a distributed performance testing platform, respond to a Seed Job selection instruction and determine the Seed Job indicated by the Seed Job selection instruction as a target Seed Job; executing the target Seed Job such that the target Seed Job generates a test execution Job based on the configuration information; executing test execution Job, and enabling the test execution Job to acquire a corresponding test script according to the configuration information; executing the test script to test the tested service system with the test flow pointed to the configuration information until the tested service system completes the test, acquiring corresponding test monitoring data through test execution Job, and generating a test report based on the test monitoring data. Based on the invention, the problems that the whole performance of the service system cannot be accurately reflected and the service system is inconvenient to maintain in the prior art can be solved.

Description

Test method, test device, electronic equipment and storage medium
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a testing method, a testing device, an electronic device, and a storage medium.
Background
With the development of networks, people rely on the networks more and more, serious system load is brought to a system for providing network services, and the performance of a service system seriously affects the benefits of enterprises, so that the performance test of the service system is more and more important to the industry.
In the existing test process, the testers of all the projects select performance test tools to perform performance tests according to the projects responsible by the testers. However, in the existing mode, the testers of different projects may have different types of performance test tools and non-uniform data such as performance test standards, scripts, execution processes, test strategies, test reports and the like, so that the overall performance of the service system cannot be accurately reflected, and the service system is inconvenient to maintain.
Disclosure of Invention
In view of the above, the present invention provides a testing method, apparatus, electronic device and storage medium, so as to solve the problems that the prior art cannot accurately reflect the overall performance of the service system and is inconvenient for maintaining the service system.
The first aspect of the invention discloses a testing method, which is applied to a distributed performance testing platform, and comprises the following steps:
Responding to a Seed Job selection instruction, and determining the Seed Job indicated by the Seed Job selection instruction as a target Seed Job;
Executing the target Seed Job, so that the target Seed Job generates a test execution Job based on configuration information, wherein the configuration information is preconfigured by a user according to project requirements;
executing test execution Job, and enabling the test execution Job to acquire a corresponding test script according to the configuration information;
And executing the test script to test the tested service system with the test flow pointed to the configuration information until the tested service system completes the test, acquiring corresponding test monitoring data by the test execution Job, and generating a test report based on the test monitoring data.
The second aspect of the invention discloses a testing device applied to a distributed performance testing platform, the device comprises:
a first determining unit, configured to determine, in response to a Seed Job selection instruction, the Seed Job indicated by the Seed Job selection instruction as a target Seed Job;
The first execution unit is used for executing the target Seed Job so that the target Seed Job generates test execution Job based on configuration information, wherein the configuration information is preconfigured by a user according to project requirements;
the second execution unit is used for executing the test execution Job, so that the test execution Job obtains a corresponding test script according to the configuration information;
And the third execution unit is used for executing the test script to test the tested service system with the test flow pointed to the configuration information until the tested service system completes the test, acquiring corresponding test monitoring data through the test execution Job, and generating a test report based on the test monitoring data.
A third aspect of the present invention discloses an electronic device, comprising: the processor and the memory are connected through a communication bus; the processor is used for calling and executing the program stored in the memory; and a memory for storing a program for implementing the test method as disclosed in the above first aspect of the present invention.
A fourth aspect of the invention discloses a computer readable storage medium having stored therein computer executable instructions for performing a test method as disclosed in the first aspect of the invention described above.
The invention provides a testing method, a device, electronic equipment and a storage medium, wherein a plurality of Seed Jobs are preset, a user can select a corresponding Seed Job from the preset plurality of Seed Jobs according to project requirements, after the user determines the selected Seed Job, the selected Seed Job indicated by the Seed Job selection instruction is determined as a target Seed Job in response to the Seed Job selection instruction, the target Seed Job is executed, so that the target Seed Job generates a corresponding test execution Job based on configuration information preset by the user, a test script corresponding to the configuration information can be acquired through executing the generated test execution, finally, the tested service system indicated by the configuration information is tested by directing test flow to the acquired test script until the tested service system completes testing, corresponding test monitoring data are acquired through the test execution Job, and a test report is generated based on the test monitoring data. According to the technical scheme provided by the invention, through presetting a plurality of Seed Jobs to support a plurality of test strategies simultaneously, a user can select the corresponding Seed Job from the preset plurality of Seed Jobs according to project requirements without selecting performance test tools of different models according to different projects, so that the problems that the overall performance of a service system cannot be accurately reflected and the service system is inconvenient to maintain due to different types of the performance test tools and the non-uniform condition of data such as performance test standards, scripts, execution processes, test strategies, test reports and the like in the prior art are solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present invention, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.
The above and other features, advantages and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.
FIG. 1 is a schematic structural diagram of a distributed performance test platform according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of a testing method according to an embodiment of the present invention;
FIG. 3 is a flow chart of another testing method according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a testing device according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While the present disclosure has been illustrated in the drawings in some form, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and examples of the present disclosure are for illustrative purposes only and are not intended to limit the scope of the present disclosure.
The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below.
It should be noted that the terms "first," "second," and the like in this disclosure are merely used for distinguishing between different devices, modules, or units and not for limiting the order or interdependence of the functions performed by these devices, modules, or units.
It should be noted that references to "one" or "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be interpreted as "one or more" unless the context clearly indicates otherwise.
Referring to fig. 1, a schematic structural diagram of a distributed performance testing platform provided by an embodiment of the present invention is shown, where the distributed performance testing platform 100 includes a configuration service module 101, a Jenkins control machine 102, a test script management module 103, a report service module 104, a Jenkins node machine cluster 105, a plurality of tested service systems 106, and a monitoring service module 107.
Referring to fig. 2, a flow chart of a testing method according to an embodiment of the present invention is shown, where the testing method is applied to the distributed performance testing platform shown in fig. 1, and the testing method specifically includes the following steps:
S201: and responding to the Seed Job selection instruction, and determining the Seed Job indicated by the Seed Job selection instruction as a target Seed Job.
In step S201, a test technician may build templates of various test execution jobs corresponding to each item, i.e., build various Seed jobs corresponding to each item, on the Jenkins controller of the distributed performance test platform.
It should be noted that, the Seed Job may be a single interface test execution Job template, a single scenario test execution Job template, a mixed scenario RPS mode test execution Job template, a load test execution Job template, a single interface optimal QPS auto discovery test execution Job template, a load point auto discovery test execution Job.
In the specific execution process of step S201, the user may select a corresponding Seed Job from multiple Seed jobs preset on the Jenkins controller of the distributed performance test platform according to the project requirement, and after the user determines the selected Seed Job, respond to the Seed Job selection instruction, and determine the Seed Job indicated by the Seed Job selection instruction as the target Seed Job.
It should be noted that, the user may be a tester or a test group.
S202: and executing the target Seed Job, so that the target Seed Job generates a test execution Job based on configuration information, wherein the configuration information is preconfigured by a user according to project requirements.
In step S202, the user may configure corresponding configuration information according to the project requirements on the configuration service module of the distributed performance test platform.
It should be noted that, the configuration information includes related information of the test group (user), the git position and branch where the test script is located, the access entry address of the tested service system, that is, the performance test flow entry, the name, version and test report archive address of the tested service system, the application name and version information of the dependent service, the application name and version information of the middleware, the monitoring service address and the monitored name, IP address, and the information of the tested service system (such as IP and login account information).
It should be noted that, a plurality of test node machine information may be configured so as to implement high concurrency processing by triggering a plurality of test node machines at the same time.
In the specific execution step S202, after determining the target Seed Job, the user may input configuration address information on the selected Seed Job, click an execution button, execute the target Seed Job, so that the target Seed Job obtains corresponding configuration information according to the input configuration address information, analyze the obtained configuration information, determine a name of the test execution Job to be created, determine whether there is a test execution Job corresponding to the name of the test execution Job to be created currently, if so, update the currently existing test execution Job corresponding to the name of the test execution Job to be created according to the configuration information, and if not, create a new test execution Job according to the configuration information.
Further, in the embodiment of the present application, while executing the target Seed Job so that the target Seed Job generates the test execution Job based on the configuration information, the engine construction Job may be updated based on the parameters corresponding to the generated test execution Job, the code of the engine construction Job is obtained from the set of test engines by using the updated engine construction Job, and the obtained code of the engine construction Job is run to obtain the test engine Bundle.
S203: executing test execution Job, and enabling the test execution Job to acquire a corresponding test script according to the configuration information.
In the specific execution process of step S203, after the target Seed Job is executed to enable the target Seed Job to generate the test execution Job based on the configuration information, the generated test execution Job may be executed, so that the test execution Job obtains the corresponding test script from the test script management module according to the bit position where the test script in the configuration information is located.
S204: executing the test script to test the tested service system with the test flow pointed to the configuration information until the tested service system completes the test, acquiring corresponding test monitoring data through test execution Job, and generating a test report based on the test monitoring data.
In the specific execution step S204, after the test execution Job is executed, the test execution Job is enabled to obtain the corresponding test script according to the configuration information, the test script is automatically executed based on the test engine Bundle to trigger the test node machine indicated by the test node machine information in the configuration information, the test flow is directed to the tested service system indicated by the test node machine information to perform the test, when the monitoring service module monitors that the tested service system completes the test, the test execution Job is triggered to obtain the corresponding test monitoring data according to the monitored tested service system name and the IP address, so that the report service module performs integration according to various information in the obtained test monitoring data to generate a test report, and stores the test report in the database. The test monitoring data comprise test model data, monitoring information, test scene data, test strategies, gatling result information and execution information generated in the execution process of test execution Job.
In the embodiment of the application, after the test report is generated, the generated test report can be displayed for a user to check, and the comprehensive test report can be generated according to a plurality of test reports obtained by carrying out a plurality of tests. The test node machine is preset in the Jenkins node machine cluster.
The invention provides a test method, which is provided with a plurality of Seed Jobs in advance, a user can select a corresponding Seed Job from the plurality of Seed Jobs in advance according to project requirements, after the user determines the selected Seed Job, the user responds to a Seed Job selection instruction, the Seed Job indicated by the Seed Job selection instruction is determined as a target Seed Job, the target SeedJob is executed, so that the target Seed Job generates a corresponding test execution Job based on configuration information configured in advance by the user, a test script corresponding to the configuration information can be acquired through executing the generated test execution, finally, the acquired test script is executed to direct test flow to a tested service system indicated by the configuration information until the tested service system completes testing, corresponding test monitoring data is acquired through the test execution Job, and a test report is generated based on the test monitoring data. According to the technical scheme provided by the invention, through presetting a plurality of Seed Jobs to support a plurality of test strategies simultaneously, a user can select the corresponding Seed Job from the preset plurality of Seed Jobs according to project requirements without selecting performance test tools of different models according to different projects, so that the problems that the overall performance of a service system cannot be accurately reflected and the service system is inconvenient to maintain due to different types of the performance test tools and the non-uniform condition of data such as performance test standards, scripts, execution processes, test strategies, test reports and the like in the prior art are solved.
In the embodiment of the present application, if the Seed Job indicated by the Seed Job selection instruction is a single-interface optimal QPS automatic discovery test execution Job template, referring to fig. 3, a flow chart of another test method provided by the embodiment of the present application is shown, where the test method specifically includes the following steps:
S301: and responding to the Seed Job selection instruction, and determining the Seed Job indicated by the Seed Job selection instruction as a target SeedJob, wherein the Seed Job indicated by the Seed Job selection instruction is a single-interface optimal QPS automatic discovery test execution Job template.
In the specific execution process of step S301, the user may select, according to the project requirement, a corresponding Seed Job from multiple Seed jobs preset on the Jenkins controller of the distributed performance test platform, and after the user determines the selected SeedJob, the user determines, in response to the Seed Job selection instruction, the Seed Job indicated by the Seed Job selection instruction as the target SeedJob. The selected Job indicated by the selected Job selection instruction is a single-interface optimal QPS automatic discovery test execution Job template.
S302: and executing the target Seed Job so that the target Seed Job generates a single-interface optimal QPS discovery test execution Job based on the configuration information.
In the specific execution of step S302, after determining the target Seed Job, the user may input configuration address information in the selected target Seed Job, click an execution button, execute the target Seed Job, so that the target Seed Job obtains corresponding configuration information according to the input configuration address information, parse the obtained configuration information, determine a name of the test execution Job to be created, determine whether there is a single-interface optimal QPS discovery test execution Job corresponding to the name of the test execution Job to be created currently, if so, update the currently existing single-interface optimal QPS discovery test execution Job corresponding to the name of the test execution Job to be created according to the configuration information, and if not, create a new single-interface optimal QPS discovery test execution Job according to the configuration information.
Further, in the embodiment of the present application, while executing the target Seed Job to enable the target Seed Job to generate the single-interface optimal QPS discovery test execution Job based on the configuration information, the engine building Job may be updated based on the generated parameters corresponding to the single-interface optimal QPS discovery test execution Job, and the updated engine building Job may be utilized to obtain the code of the engine building Job from the set of the test engine, and the obtained code of the engine building Job may be operated to obtain the test engine Bundle.
S303: executing the single-interface optimal QPS discovery test execution job, so that the single-interface optimal QPS discovery test execution job responds to an interface selection instruction of a user, determining an interface indicated by the interface selection instruction as a target interface, acquiring a test script corresponding to the target interface according to configuration information, acquiring a preparation data script returned by other interfaces associated with the target interface if the target interface needs to prepare the data script, and executing the preparation data script to obtain a data file.
In step S303, the target Seed Job is executed, so that after the target Seed Job generates the single-interface optimal QPS discovery test execution Job based on the configuration information, the generated single-interface optimal QPS discovery test execution Job is displayed, and the user can select a corresponding interface from the displayed single-interface optimal QPS discovery test execution Job and configure corresponding configuration parameters. The configured configuration parameters at least comprise a preset response time threshold and a preset error rate.
In the specific execution of step S303, after the target Seed Job is executed to enable the target Seed Job to generate a single-interface optimal QPS discovery test execution Job based on the configuration information, the single-interface optimal QPS discovery test execution Job is executed to enable the single-interface optimal QPS discovery test execution Job to respond to the interface selection instruction of the user, the interface indicated by the interface selection instruction is determined to be the target interface, the test script corresponding to the target interface is acquired from the test script management module at the bit position of the test script in the configuration information, if the target interface needs to prepare the data script, the preparation data scripts returned by other interfaces associated with the target interface are acquired, and the preparation data script is executed to obtain the data file.
It should be noted that, executing the single-interface optimal QPS discovery test execution Job, so that the single-interface optimal QPS discovery test execution Job responds to an interface selection instruction of a user, determining an interface indicated by the interface selection instruction as a target interface, acquiring a test script corresponding to the target interface, if the target interface does not need to prepare a data script, automatically executing the acquired test script to direct test flow to a tested service system indicated by configuration information for testing, when the monitoring service module monitors that the tested service system completes testing, triggering the test execution Job to acquire corresponding test monitoring data according to the name, the IP address and the corresponding tested service system, and generating a test report based on the test monitoring data.
S304: and executing a test script based on the data file to test the tested service system with the test flow pointed to the configuration information until the tested service system completes the test, acquiring corresponding test monitoring data by test execution Job, and generating a test report based on the test monitoring data.
In the specific execution step S304, a test script is executed based on the data file to trigger the test node machine indicated by the test node machine information in the configuration information, and the test flow is directed to the tested service system indicated by the test node machine information to perform a test.
The generated test report at least includes an interface QPS, and the response time and the error rate corresponding to the interface QPS.
S305: the method comprises the steps that a test execution job discovers an optimal QPS through a single interface, and judges whether the optimal QPS of the interface is discovered or not according to a test report and configuration parameters; if found, execute step S306; if not, step S308 is performed.
In the process of specifically executing step S305, after the test report is generated, the single-interface optimal QPS discovers that the test execution job obtains the interface QPS, the response time of the interface QPS, and the error rate of the interface QPS in the test report, and determines whether the response time of the interface QPS is less than the preset response time in the configuration parameters, whether the error rate of the interface QPS is less than the preset error rate in the configuration parameters, and whether the difference between the interface QPS and the last-history interface QPS exceeds the preset deviation threshold.
If the response time of the interface QPS is smaller than the preset response time in the configuration parameter, the error rate of the interface QPS is smaller than the preset error rate in the configuration parameter, and the difference between the interface QPS and the last historical interface QPS does not exceed the preset deviation threshold, the interface QPS in the test report can be determined to be the interface optimal QPS, and step S306 is executed.
If the response time of the interface QPS is not less than the preset response time in the configuration parameter, the error rate of the interface QPS is not less than the preset error rate in the configuration parameter, or the difference between the interface QPS and the last historical interface QPS exceeds the preset deviation threshold, it may be determined that the interface QPS in the test report is not the interface optimal QPS, and step S308 is executed.
S306: and (3) performing job through the single-interface optimal QPS discovery test, and judging whether the ratio of the difference between the current interface optimal QPS and the historical latest interface optimal QPS to the historical latest interface optimal QPS exceeds a preset threshold. If yes, step S307 is executed.
In the specific execution process of step S306, under the condition that the interface optimal QPS is found in the test report, the test execution job is found through the single interface optimal QPS, the difference value between the current interface optimal QPS and the history latest interface optimal QPS is calculated, whether the ratio between the current interface optimal QPS and the history latest interface optimal QPS exceeds a preset threshold value or not, if so, the performance of the tested service system can be determined to be worse, and corresponding alarm information is output; if the service system is not ultrahigh, the performance of the tested service system can be determined to be good, and the test is ended.
In the embodiment of the application, the method discovers the interface optimal QPS according to the test report and the configuration parameters in the execution job of the discovery test of the single interface optimal QPS, and saves the discovered interface optimal QPS and data related to the process of discovering the interface optimal QPS into a database.
S307: and finding out test execution job through the single-interface optimal QPS, and outputting corresponding alarm information.
In the specific execution of step S307, when it is determined that the ratio of the difference between the current interface optimal QPS and the historical latest interface optimal QPS exceeds the preset threshold, it may be determined that the performance of the tested service system is poor, the test execution job is found through the single interface optimal QPS, and corresponding alarm information is output in the form of a mail.
S308: executing job through single-interface optimal QPS discovery test, and judging whether the error rate corresponding to the current interface QPS exceeds a preset error rate; if the error rate corresponding to the current interface QPS is smaller than the preset error rate, step S309 is executed; if the error rate corresponding to the current interface QPS is not less than the preset error rate, step S310 is executed.
In the process of executing step S308 specifically, if the interface optimal QPS is not found in the present test report, the single-interface optimal QPS is used to find the test execution job, determine whether the error rate corresponding to the current interface QPS exceeds the preset error rate, and if the error rate corresponding to the current interface QPS is less than the preset error rate, execute step S309; if the error rate corresponding to the current interface QPS is not less than the preset error rate, step S310 is executed.
S309: and increasing access data of the tested service system.
In the specific execution of step S309, in the case where it is determined that the error rate corresponding to the current interface QPS is smaller than the preset error rate, the access data of the tested service system is increased, and the execution of the interface optimal QPS discovery test execution job is returned until the interface optimal QPS is discovered.
In the embodiment of the application, after the interface optimal QPS is found, the found interface optimal QPS and data generated in the process of finding the interface optimal QPS can be stored in a database, and an optimal QPS trend graph can be generated according to each interface QPS generated in the process of finding the interface optimal QPS and displayed.
S310: reducing access data of the service system under test.
In the specific execution of step S310, under the condition that the error rate corresponding to the current interface QPS is determined to be not less than the preset error rate, the access data of the tested service system is reduced, and the execution interface optimal QPS discovery test execution job is returned until the interface optimal QPS is discovered.
In the embodiment of the application, under the condition that the Seed Job indicated by the Seed Job selection instruction is a single-interface optimal QPS automatic discovery test execution Job template, namely, the target SeedJob is a single-interface optimal QPS automatic discovery test execution Job template, the target Seed Job is executed, so that the target Seed Job generates a single-interface optimal QPS discovery test execution Job based on configuration information, and executes the single-interface optimal QPS discovery test execution Job, after the single-interface optimal QPS discovery test execution Job acquires corresponding test scripts according to the configuration information, the test scripts are automatically executed, so that test flow is directed to a tested service system indicated by the configuration information until the tested service system is tested, corresponding test monitoring data is acquired through the test monitoring data, and a test report is generated based on the test monitoring data, and then whether the interface optimal QPS is discovered or not is judged according to the test report and the configuration parameters through the single-interface optimal QPS discovery test execution Job, so that the performance condition of the tested service system is judged based on the discovered interface optimal QPS is judged, and under the condition that the performance condition of the tested service system is determined, the tested service system is relatively poor, and the tested service system is accordingly the service system is output to maintain alarm information according to the operation and maintenance information.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In some embodiments, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText TransferProtocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.
The names of messages or information interacted between the devices in the disclosed embodiments are for illustrative purposes only and are not intended to limit the scope of such messages or information.
Although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including, but not limited to, an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
Corresponding to the test method disclosed in the above embodiment of the present invention, referring to fig. 4, the embodiment of the present invention further provides a schematic structural diagram of a test device, where the test device includes:
a first determining unit 41 configured to determine, in response to the Seed Job selection instruction, the Seed Job indicated by the Seed Job selection instruction as a target Seed Job;
A first execution unit 42, configured to execute a target Seed Job, so that the target Seed Job generates a test execution Job based on configuration information, where the configuration information is preconfigured by a user according to a project requirement;
The second execution unit 43 is configured to execute a test execution Job, so that the test execution Job obtains a corresponding test script according to the configuration information;
And the third execution unit 44 is configured to execute a test script to direct the test flow to the tested service system indicated by the configuration information for testing until the tested service system completes testing, obtain corresponding test monitoring data through test execution Job, and generate a test report based on the test monitoring data.
The specific principle and execution process of each unit in the test device disclosed in the above embodiment of the present invention are the same as those of the test method disclosed in the above embodiment of the present invention, and reference may be made to corresponding parts in the test method disclosed in the above embodiment of the present invention, and no redundant description is given here.
The invention provides a testing device, which is provided with a plurality of Seed Jobs in advance, a user can select a corresponding Seed Job from the plurality of Seed Jobs in advance according to project requirements, after the user determines the selected Seed Job, the user responds to a Seed Job selection instruction, the Seed Job indicated by the Seed Job selection instruction is determined as a target Seed Job, the target Seed Job is executed, so that the target Seed Job generates a corresponding test execution Job based on configuration information configured in advance by the user, a test script corresponding to the configuration information can be acquired through executing the generated test execution, finally, the test flow is directed to a tested service system indicated by the configuration information to test until the tested service system completes testing, corresponding test monitoring data is acquired through the test execution Job, and a test report is generated based on the test monitoring data. According to the technical scheme provided by the invention, through presetting a plurality of Seed Jobs to support a plurality of test strategies simultaneously, a user can select the corresponding Seed Job from the preset plurality of Seed Jobs according to project requirements without selecting performance test tools of different types according to different projects, thereby solving the problems that the overall performance of a service system cannot be accurately reflected and the maintenance of the service system is inconvenient due to different types of the performance test tools and the non-uniform condition of data such as performance test standards, scripts, execution processes, test strategies, test reports and the like in the prior art
Further, the testing device provided by the invention further comprises:
and the updating unit is used for updating the engine construction Job based on the test execution Job.
Optionally, the third execution unit is specifically configured to execute a test script based on the test engine Bundle, so as to trigger the test node machine indicated by the configuration information, and test the tested service system indicated by the configuration information with the test flow until the tested service system completes the test, obtain corresponding test monitoring data through test execution Job, and generate a test report based on the test monitoring data;
The test engine Bundle is obtained by acquiring and running codes of the engine construction Job from the Git of the test engine by utilizing the updated engine construction Job.
Optionally, the first execution unit is specifically configured to execute the target Seed Job, so that the target Seed Job obtains and analyzes the configuration information according to the input configuration address information, determines a name of the test execution Job to be created, and if no test execution Job corresponding to the name of the test execution Job to be created exists, creates the test execution Job according to the configuration information;
Wherein the configuration information is preconfigured by a user, and the configuration address information is input by the user.
Optionally, if the test execution job is the single-interface optimal QPS discovery test execution job, the second execution unit is specifically configured to execute the single-interface optimal QPS discovery test execution job, so that the single-interface optimal QPS discovery test execution job responds to an interface selection instruction of a user, determines an interface indicated by the interface selection instruction as a target interface, acquires a test script corresponding to the target interface according to the configuration information, and acquires a preparation data script returned by other interfaces associated with the target interface and executes the preparation data script if the target interface needs to prepare the data script, so as to obtain the data file;
Correspondingly, the third execution unit is further used for executing the test script based on the data file.
Further, the testing device provided by the invention further comprises:
The output unit is used for outputting corresponding alarm information when the test execution job is found through the single-interface optimal QPS, the interface optimal QPS is found according to the test report and the configuration parameters, and the ratio of the difference between the current interface optimal QPS and the historical latest interface optimal QPS exceeds a preset threshold value;
The access data adjusting unit is used for returning to execute the single-interface optimal QPS discovery test execution job until the interface optimal QPS is discovered when the single-interface optimal QPS discovery test execution job discovers that the interface optimal QPS is not discovered according to the test report and the configuration parameters and whether the error rate corresponding to the current interface QPS is smaller than a preset error rate threshold value or not; or the single-interface optimal QPS discovery test execution job is performed according to the test report and the configuration parameters, the interface optimal QPS is not discovered, when the error rate corresponding to the current interface QPS is not smaller than the preset error rate, the access data of the tested service system is reduced, and then the single-interface optimal QPS discovery test execution job is performed until the interface optimal QPS is discovered;
the configuration parameters are uploaded by a user based on the single-interface optimal QPS discovery test execution job, the configuration parameters at least comprise preset error rates, and the test report comprises the error rate corresponding to the current interface QPS.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. The name of the unit does not in any way constitute a limitation of the unit itself, for example the first acquisition unit may also be described as "unit acquiring at least two internet protocol addresses".
The above-described functions of the present application may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.
The embodiment of the application also provides electronic equipment, which comprises: the processor and the memory are connected through a communication bus; the processor is used for calling and executing the program stored in the memory; and the memory is used for storing a program for realizing the testing method.
Referring now to fig. 5, a schematic diagram of an electronic device suitable for use in implementing the disclosed embodiments of the invention is shown. The electronic device in the disclosed embodiments of the present invention may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 5 is only an example and should not be construed as limiting the functionality and scope of use of the disclosed embodiments of the invention.
As shown in fig. 5, the electronic device may include a processing means (e.g., a central processing unit, a graphic processor, etc. 501) which may perform various suitable actions and processes in accordance with a program stored in a Read Only Memory (ROM) 502 or a program loaded from a storage means 506 into a Random Access Memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device are also stored, the processing means 501, the ROM 502, and the RAM 503 are connected to each other by a bus 704. An input/output (I/O) interface 505 is also connected to the bus 504.
In general, the following devices may be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 507 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 508 including, for example, magnetic tape, hard disk, etc.; and communication means 509. The communication means 509 may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. While fig. 5 shows an electronic device having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a non-transitory computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or from the storage means 508, or from the ROM 502. The above-described functions defined in the methods of the disclosed embodiments of the invention are performed when the computer program is executed by the processing means 501.
Still further, an embodiment of the present invention provides a computer-readable storage medium having stored therein computer-executable instructions for performing a test method.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: responding to the Seed Job selection instruction, and determining the Seed Job indicated by the Seed Job selection instruction as a target Seed Job; executing the target Seed Job, so that the target Seed Job generates a test execution Job based on configuration information, wherein the configuration information is preconfigured by a user according to project requirements; executing test execution Job, and enabling the test execution Job to acquire a corresponding test script according to the configuration information; executing the test script to test the tested service system with the test flow pointed to the configuration information until the tested service system completes the test, obtaining corresponding test monitoring data, and generating a test report based on the test monitoring data.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
It should be noted that the computer readable medium disclosed in the present invention may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may comprise a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.
The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.

Claims (8)

1. A method of testing applied to a distributed performance test platform, the method comprising:
Responding to a Seed Job selection instruction, and determining the Seed Job indicated by the Seed Job selection instruction as a target Seed Job;
Executing the target Seed Job, so that the target Seed Job generates a test execution Job based on configuration information, wherein the configuration information is preconfigured by a user according to project requirements;
executing test execution Job, and enabling the test execution Job to acquire a corresponding test script according to the configuration information;
executing the test script to test the tested service system with the test flow pointed to the configuration information until the tested service system completes the test, acquiring corresponding test monitoring data by the test execution Job, and generating a test report based on the test monitoring data;
If the test execution Job finds that the test execution Job is the single-interface optimal QPS, the executing the test execution Job, so that the test execution Job obtains a corresponding test script according to the configuration information, including:
Executing the single-interface optimal QPS discovery test execution job so that the single-interface optimal QPS discovery test execution job responds to an interface selection instruction of a user, determining an interface indicated by the interface selection instruction as a target interface, acquiring a test script corresponding to the target interface according to the configuration information, acquiring the preparation data script returned by other interfaces associated with the target interface if the target interface needs to prepare the data script, and executing the preparation data script to obtain a data file;
Correspondingly, the executing the test script includes:
executing the test script based on the data file;
after the generating the test report, the method further comprises:
When the single-interface optimal QPS discovers that the test is executed job discovers interface optimal QPS according to the test report and the configuration parameters, and the ratio of the current interface optimal QPS to the historical latest interface optimal QPS exceeds a preset threshold value, outputting corresponding alarm information;
When the single-interface optimal QPS discovery test execution job does not find the interface optimal QPS according to the test report and the configuration parameters and the error rate corresponding to the current interface QPS is smaller than a preset error rate, after the access data of the tested service system are increased, the single-interface optimal QPS discovery test execution job is executed again until the interface optimal QPS is found;
or performing job through the single-interface optimal QPS discovery test, and returning to perform the single-interface optimal QPS discovery test to perform job until the interface optimal QPS is discovered when the interface optimal QPS is not discovered and the error rate corresponding to the current interface QPS is not less than the preset error rate after reducing the access data of the tested service system;
the configuration parameters are uploaded by a user based on the single-interface optimal QPS discovery test execution job, the configuration parameters at least comprise the preset error rate, and the test report at least comprises the error rate corresponding to the current interface QPS.
2. The method of claim 1, wherein after executing the target Seed Job such that the target Seed Job generates a test execution Job based on configuration information, further comprising:
Executing Job based on the test updates the engine build Job.
3. The method of claim 2, wherein executing the test script to direct test traffic to the service system under test indicated by the configuration information until the service system under test completes testing, obtaining corresponding test monitoring data by the test execution Job, and generating a test report based on the test monitoring data, comprises:
Executing the test script based on a test engine Bundle to trigger a test node machine indicated by configuration information, directing test flow to a tested service system indicated by the configuration information to test until the tested service system completes testing, acquiring corresponding test monitoring data through the test execution Job, and generating a test report based on the test monitoring data;
and the test engine Bundle is obtained by acquiring and running codes of the engine construction Job from the Git of the test engine by utilizing the updated engine construction Job.
4. The method of claim 1, wherein the executing the target Seed Job to cause the target Seed Job to generate a test execution Job based on configuration information comprises:
Executing the target Seed Job, so that the target Seed Job obtains and analyzes configuration information according to the input configuration address information, determining a name of a test execution Job to be created, and if the test execution Job corresponding to the name of the test execution Job to be created does not exist, creating the test execution Job according to the configuration information;
Wherein the configuration information is preconfigured by a user, and the configuration address information is input by the user.
5. A test apparatus for use with a distributed performance test platform, the apparatus comprising:
a first determining unit, configured to determine, in response to a Seed Job selection instruction, the Seed Job indicated by the Seed Job selection instruction as a target Seed Job;
The first execution unit is used for executing the target Seed Job so that the target Seed Job generates test execution Job based on configuration information, wherein the configuration information is preconfigured by a user according to project requirements;
the second execution unit is used for executing the test execution Job, so that the test execution Job obtains a corresponding test script according to the configuration information;
The third execution unit is used for executing the test script to test the tested service system with the test flow pointed to the configuration information until the tested service system completes the test, acquiring corresponding test monitoring data through the test execution Job, and generating a test report based on the test monitoring data;
If the test execution Job finds that the test execution Job is the single-interface optimal QPS, the second execution unit executes the test execution Job, so that the test execution Job obtains a corresponding test script according to configuration information, including:
Executing the single-interface optimal QPS discovery test execution job so that the single-interface optimal QPS discovery test execution job responds to an interface selection instruction of a user, determining an interface indicated by the interface selection instruction as a target interface, acquiring a test script corresponding to the target interface according to the configuration information, acquiring the preparation data script returned by other interfaces associated with the target interface if the target interface needs to prepare the data script, and executing the preparation data script to obtain a data file;
Correspondingly, the third execution unit executes the test script, including:
executing the test script based on the data file;
correspondingly, the device further comprises:
The output unit is used for finding out the interface optimal QPS according to the test report and the configuration parameters when the test execution job is found out through the single-interface optimal QPS, and outputting corresponding alarm information when the ratio of the current interface optimal QPS to the historical latest interface optimal QPS exceeds a preset threshold value;
An access data adjustment unit, configured to, when the single-interface optimal QPS discovery test execution job does not discover the interface optimal QPS according to the test report and the configuration parameter, and when an error rate corresponding to a current interface QPS is smaller than a preset error rate, increase access data of the tested service system, and then return to execute the single-interface optimal QPS discovery test execution job until the interface optimal QPS is discovered; or performing job through the single-interface optimal QPS discovery test, and returning to perform the single-interface optimal QPS discovery test to perform job until the interface optimal QPS is discovered when the interface optimal QPS is not discovered and the error rate corresponding to the current interface QPS is not less than the preset error rate after reducing the access data of the tested service system;
the configuration parameters are uploaded by a user based on the single-interface optimal QPS discovery test execution job, the configuration parameters at least comprise the preset error rate, and the test report at least comprises the error rate corresponding to the current interface QPS.
6. The apparatus of claim 5, wherein the apparatus further comprises:
and the updating unit is used for updating the engine construction Job based on the test execution Job.
7. An electronic device, comprising: the processor and the memory are connected through a communication bus; the processor is used for calling and executing the program stored in the memory; a memory for storing a program for implementing the test method according to any one of claims 1-4.
8. A computer readable storage medium having stored therein computer executable instructions for performing the test method of any one of claims 1-4.
CN202110739282.7A 2021-06-30 2021-06-30 Test method, test device, electronic equipment and storage medium Active CN113485918B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110739282.7A CN113485918B (en) 2021-06-30 2021-06-30 Test method, test device, electronic equipment and storage medium
PCT/CN2022/088910 WO2023273561A1 (en) 2021-06-30 2022-04-25 Test method and apparatus, electronic device, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110739282.7A CN113485918B (en) 2021-06-30 2021-06-30 Test method, test device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN113485918A CN113485918A (en) 2021-10-08
CN113485918B true CN113485918B (en) 2024-05-07

Family

ID=77937120

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110739282.7A Active CN113485918B (en) 2021-06-30 2021-06-30 Test method, test device, electronic equipment and storage medium

Country Status (2)

Country Link
CN (1) CN113485918B (en)
WO (1) WO2023273561A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113485918B (en) * 2021-06-30 2024-05-07 中国民航信息网络股份有限公司 Test method, test device, electronic equipment and storage medium
CN115934575A (en) * 2023-03-10 2023-04-07 北京全路通信信号研究设计院集团有限公司 Product testing method, device, equipment and storage medium
CN116028377B (en) * 2023-03-28 2023-08-11 之江实验室 Automatic test method, device and medium based on jenkins
CN116431523B (en) * 2023-06-12 2023-08-29 建信金融科技有限责任公司 Test data management method, device, equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109284229A (en) * 2018-10-17 2019-01-29 武汉斗鱼网络科技有限公司 A kind of dynamic adjusting method and relevant device based on QPS
US10515005B1 (en) * 2018-12-20 2019-12-24 Atlassian Pty Ltd Systems and methods for testing source code
CN111651351A (en) * 2020-05-29 2020-09-11 成都新潮传媒集团有限公司 Software performance testing method and device based on Jenkins
CN111767208A (en) * 2020-06-02 2020-10-13 北京金堤科技有限公司 Automatic test method and device
CN112527686A (en) * 2020-12-29 2021-03-19 平安普惠企业管理有限公司 Interface performance test method, device, equipment and storage medium
CN112527642A (en) * 2020-12-07 2021-03-19 中国平安人寿保险股份有限公司 Performance test index data display method, device, equipment and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9052941B1 (en) * 2011-05-27 2015-06-09 Amazon Technologies, Inc. Automated testing of online functionality providers
US10162735B2 (en) * 2015-09-30 2018-12-25 Red Hat, Inc. Distributed system test automation framework
CN111209205B (en) * 2020-01-08 2023-10-10 北京字节跳动网络技术有限公司 Configuration method, configuration device and electronic equipment
CN112597047A (en) * 2020-12-29 2021-04-02 上海瑞家信息技术有限公司 Test method, test device, electronic equipment and computer readable medium
CN113485918B (en) * 2021-06-30 2024-05-07 中国民航信息网络股份有限公司 Test method, test device, electronic equipment and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109284229A (en) * 2018-10-17 2019-01-29 武汉斗鱼网络科技有限公司 A kind of dynamic adjusting method and relevant device based on QPS
US10515005B1 (en) * 2018-12-20 2019-12-24 Atlassian Pty Ltd Systems and methods for testing source code
CN111651351A (en) * 2020-05-29 2020-09-11 成都新潮传媒集团有限公司 Software performance testing method and device based on Jenkins
CN111767208A (en) * 2020-06-02 2020-10-13 北京金堤科技有限公司 Automatic test method and device
CN112527642A (en) * 2020-12-07 2021-03-19 中国平安人寿保险股份有限公司 Performance test index data display method, device, equipment and storage medium
CN112527686A (en) * 2020-12-29 2021-03-19 平安普惠企业管理有限公司 Interface performance test method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN113485918A (en) 2021-10-08
WO2023273561A1 (en) 2023-01-05

Similar Documents

Publication Publication Date Title
CN113485918B (en) Test method, test device, electronic equipment and storage medium
CN111679990B (en) Test data generation method and device, readable medium and electronic equipment
CN112328419B (en) Test case generation method and device of remote procedure call interface, storage medium and electronic equipment
CN111309304B (en) Method, device, medium and electronic equipment for generating IDL file
CN112988494A (en) Abnormity testing method and device and electronic device
CN112015654A (en) Method and apparatus for testing
CN110928770A (en) Software testing method, device, system, storage medium and electronic equipment
CN111694757A (en) Application program testing method and device, electronic equipment and computer readable storage medium
CN110879729B (en) Channel configuration method and device for live broadcast room, readable medium and electronic equipment
CN117493150A (en) Code quality detection method, apparatus, device, storage medium, and program
CN113704079B (en) Protobuf-based interface testing method and device
CN110489341B (en) Test method and device, storage medium and electronic equipment
CN113849416A (en) Test method, test device, storage medium and electronic equipment
CN110221854B (en) Multi-process data updating method, device, medium and electronic equipment
CN113076119B (en) Updating method and device of vehicle-mounted program, medium and electronic equipment
CN112883697B (en) Workflow form generation method, device, electronic equipment and computer readable medium
CN111274150B (en) Service instance access method and device and electronic equipment
CN114398098B (en) Application script execution method, device, electronic equipment and computer readable medium
CN113485892A (en) Data analysis method, system, electronic equipment and storage medium
CN113162799B (en) Fault positioning method and device, electronic equipment, positioning system and storage medium
CN110022244B (en) Method and apparatus for transmitting information
CN118488065A (en) Server switching method, device, electronic equipment and computer readable medium
CN117762797A (en) Method, device, medium and equipment for testing function switch release
CN115373972A (en) Interface testing method and device, storage medium and electronic equipment
CN117093284A (en) Plug-in calling method, device, medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant