CN113434384B - Pressure testing method and device - Google Patents
Pressure testing method and device Download PDFInfo
- Publication number
- CN113434384B CN113434384B CN202010208778.7A CN202010208778A CN113434384B CN 113434384 B CN113434384 B CN 113434384B CN 202010208778 A CN202010208778 A CN 202010208778A CN 113434384 B CN113434384 B CN 113434384B
- Authority
- CN
- China
- Prior art keywords
- data
- data request
- request
- interface
- real response
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 101
- 230000004044 response Effects 0.000 claims abstract description 185
- 238000009662 stress testing Methods 0.000 claims abstract description 52
- 238000004519 manufacturing process Methods 0.000 claims abstract description 40
- 238000000034 method Methods 0.000 claims abstract description 32
- 238000013500 data storage Methods 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 9
- 230000002123 temporal effect Effects 0.000 claims 1
- 238000005516 engineering process Methods 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 15
- 230000006854 communication Effects 0.000 description 10
- 238000004891 communication Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 230000015654 memory Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 239000000835 fiber Substances 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000010076 replication Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Prevention of errors by analysis, debugging or testing of software
- G06F11/3698—Environments for analysis, debugging or testing of software
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/24—Marginal checking or other specified testing methods not covered by G06F11/26, e.g. race tests
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Prevention of errors by analysis, debugging or testing of software
- G06F11/3668—Testing of software
- G06F11/3672—Test management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Software Systems (AREA)
- Computer And Data Communications (AREA)
- Debugging And Monitoring (AREA)
Abstract
本发明公开了一种压力测试方法和装置,涉及互联网技术领域。该方法的一具体实施方式包括:使用第一过滤器复制待测试接口在生产环境下接收的一个或多个第一数据请求,及所述待测试接口在所述生产环境下根据所述第一数据请求返回的第一真实响应数据;相对应地存储所述第一数据请求、所述第一真实响应数据;在测试环境下,使用压力机读取所存储的所述第一数据请求,并将所述第一数据请求发送至所述待测试接口,接收所述待测试接口根据所述第一数据请求返回的测试响应数据,比较所述第一真实响应数据和所述测试响应数据,以得到压力测试结果。该实施方式能够直接复制生环境下真实的数据请求并进行压力测试,提高了压力测试的准确性、有效性。
The invention discloses a stress testing method and device, and relates to the field of Internet technology. A specific implementation of the method includes: using a first filter to copy one or more first data requests received by the interface to be tested in the production environment, and the interface to be tested in the production environment according to the first data request. The first real response data returned by the data request; correspondingly store the first data request and the first real response data; in the test environment, use a press to read the stored first data request, and Send the first data request to the interface to be tested, receive test response data returned by the interface to be tested according to the first data request, compare the first real response data and the test response data, to Get stress test results. This implementation method can directly copy real data requests in a live environment and perform stress testing, which improves the accuracy and effectiveness of stress testing.
Description
技术领域Technical field
本发明涉及互联网技术领域,尤其涉及一种压力测试方法和装置。The present invention relates to the field of Internet technology, and in particular to a stress testing method and device.
背景技术Background technique
随着互联网技术的发展,互联用户数量已增至千万甚至上亿级别,为保证良好的用户体验,互联网系统不仅需要不间断运行,还需应对大量用户同时访问的高并发情况。因此,为保证互联网系统的稳定性,需要对互联网系统进行压力测试。由于目前互联网系统大多采用分布式部署,各个子系统之间常通过远程调用接口进行调用,因而对远程调用接口进行压力测试成为了互联网系统压力测试中的关键。With the development of Internet technology, the number of Internet users has increased to tens of millions or even hundreds of millions. In order to ensure a good user experience, the Internet system not only needs to run uninterrupted, but also needs to cope with high concurrency situations where a large number of users access at the same time. Therefore, in order to ensure the stability of the Internet system, it is necessary to conduct stress testing on the Internet system. Since most current Internet systems adopt distributed deployment, and various subsystems are often called through remote call interfaces, stress testing of remote call interfaces has become the key to stress testing of Internet systems.
目前,对远程调用接口进行测试的方法主要有以下两种:利用脚本语言读取线上日志或历史记录,以模拟构建线上用户请求,然后基于多线程方式模拟多用户请求以进行压力测试;利用一些压力测试工具,如JMeter、LoadRunner等模拟线上用户请求以进行压力测试。Currently, there are two main methods for testing remote call interfaces: using scripting language to read online logs or historical records to simulate online user requests, and then simulating multi-user requests based on multi-threading for stress testing; Use some stress testing tools, such as JMeter, LoadRunner, etc. to simulate online user requests for stress testing.
在实现本发明过程中,发明人发现现有技术中至少存在如下问题:利用脚本语言或JMeter等压力测试工具进行测试时,均只能对真实的线上用户请求进行模拟,无法直接使用真实的线上用户请求进行压力测试,进而无法有效地发现系统中存在的问题;真实的互联网系统常需要成千上万台机器同时提供服务,在进行压力测试无法按照真实情况部署那么多台机器因而需要模拟线上环境,尤其是在待测试接口依赖有一个或多个第三方接口的情况下,压力测试时的线上环境部署尤为复杂。In the process of implementing the present invention, the inventor found that there are at least the following problems in the prior art: when testing using scripting languages or stress testing tools such as JMeter, real online user requests can only be simulated, and real online user requests cannot be directly used. Online users request stress testing, which makes it impossible to effectively discover problems in the system; real Internet systems often require thousands of machines to provide services at the same time, and it is impossible to deploy so many machines according to the real situation during stress testing, so it is necessary to Simulating the online environment, especially when the interface to be tested depends on one or more third-party interfaces, the deployment of the online environment during stress testing is particularly complex.
发明内容Contents of the invention
有鉴于此,本发明实施例提供了一种压力测试方法和装置,能够直接复制生环境下真实的数据请求,并根据真实的数据请求进行压力测试,且避免了需要部署大量待测试接口依赖的第三方接口等问题。In view of this, embodiments of the present invention provide a stress testing method and device that can directly copy real data requests in a live environment and perform stress testing based on the real data requests, and avoids the need to deploy a large number of interface dependencies to be tested. Issues such as third-party interfaces.
为实现上述目的,根据本发明实施例的第一方面,提供了一种压力测试方法,包括:In order to achieve the above object, according to the first aspect of the embodiment of the present invention, a stress testing method is provided, including:
使用第一过滤器复制待测试接口在生产环境下接收的一个或多个第一数据请求,及所述待测试接口在所述生产环境下根据所述第一数据请求返回的第一真实响应数据;Use the first filter to copy one or more first data requests received by the interface to be tested in the production environment, and the first real response data returned by the interface to be tested according to the first data request in the production environment. ;
相对应地存储所述第一数据请求、所述第一真实响应数据;Correspondingly store the first data request and the first real response data;
在测试环境下,使用压力机读取所存储的所述第一数据请求,并将所述第一数据请求发送至所述待测试接口,接收所述待测试接口根据所述第一数据请求返回的测试响应数据,比较所述第一真实响应数据和所述测试响应数据,以得到压力测试结果。In a test environment, use a press to read the stored first data request, send the first data request to the interface to be tested, and receive a response from the interface to be tested according to the first data request. The test response data is compared with the first real response data and the test response data to obtain the stress test result.
可选地,还包括:Optionally, also includes:
在所述待测试接口需调用一个或多个第三方接口的情况下,使用与所述第三方接口对应的第二过滤器复制在生产环境下发送至所述第三方接口的一个或多个第二数据请求,及从所述第三方接口返回的与所述第二数据请求对应的第二真实响应数据;When the interface to be tested needs to call one or more third-party interfaces, use a second filter corresponding to the third-party interface to copy one or more third-party interfaces sent to the third-party interface in the production environment. Two data requests, and second real response data corresponding to the second data request returned from the third-party interface;
相对应地存储所述第二数据请求、所述第二真实响应数据;Correspondingly store the second data request and the second real response data;
在测试环境下,使用模拟所述第三方接口的模拟器读取所存储的所述第二数据请求以及所述第二真实响应数据,其中,所述模拟器在测试环境中接收到所述第二数据请求时,返回所述第二真实响应数据。In a test environment, use a simulator that simulates the third-party interface to read the stored second data request and the second real response data, wherein the simulator receives the third data request in the test environment. When the second data is requested, the second real response data is returned.
可选地,还包括:Optionally, also includes:
在复制到所述第一数据请求或所述第二数据请求后,生成与所述第一数据请求或所述第二数据请求唯一对应的数据请求标识;After copying to the first data request or the second data request, generate a data request identifier uniquely corresponding to the first data request or the second data request;
将所述数据请求标识增加至所述第一数据请求或所述第二数据请求中,以使所复制的与所述第一数据请求或第二数据请求对应的所述第一真实响应数据或所述第二真实响应数据具有所述数据请求标识。Add the data request identifier to the first data request or the second data request, so that the copied first real response data corresponding to the first data request or the second data request or The second real response data has the data request identifier.
可选地,所述数据标识请求指示了所述第一数据请求或所述第二数据请求的时间顺序。Optionally, the data identification request indicates the time sequence of the first data request or the second data request.
可选地,所述模拟器根据所存储的所述第二数据请求对应的真实响应时间返回所述第二真实响应数据。Optionally, the simulator returns the second real response data according to the stored real response time corresponding to the second data request.
可选地,根据所述数据请求标识,所述压力机批量读取并缓存所述第一数据请求,并通过生产者/消费者模式将所述第一数据请求发送至所述待测试接口。Optionally, according to the data request identification, the press reads and caches the first data request in batches, and sends the first data request to the interface to be tested through the producer/consumer mode.
可选地,根据所述数据请求标识所指示的时间顺序,在所述压力机将所述第一数据请求发送至所述待测试接口后,所述模拟器批量读取并缓存所述第二数据请求、所述第二数据请求对应的第二真实响应数据。Optionally, according to the time sequence indicated by the data request identifier, after the press sends the first data request to the interface to be tested, the simulator reads and caches the second data request in batches. The data request and the second real response data corresponding to the second data request.
可选地,使用第一过滤器与WebSocket服务端之间的连接或第二过滤器与WebSocket服务端之间的连接,将所述第一数据请求、所述第一真实响应数据或所述第二数据请求、所述第二真实响应数据发送至WebSocket服务端,以使所述WebSocket服务端通过消息队列将所述第一数据请求、所述第一真实响应数据或所述第二数据请求、所述第二真实响应数据发送至存储引擎。Optionally, use the connection between the first filter and the WebSocket server or the connection between the second filter and the WebSocket server to send the first data request, the first real response data or the third The second data request and the second real response data are sent to the WebSocket server, so that the WebSocket server sends the first data request, the first real response data or the second data request through the message queue. The second real response data is sent to the storage engine.
可选地,还包括:Optionally, also includes:
通过所述WebSocket服务端与所述第一过滤器之间的连接,向所述第一过滤器发送开始数据复制请求或停止数据复制请求。Through the connection between the WebSocket server and the first filter, a start data copy request or a stop data copy request is sent to the first filter.
为实现上述目的,根据本发明实施例的第二方面,提供了一种压力测试装置,包括:数据复制模块、数据存储模块、压力测试模块;其中,In order to achieve the above object, according to the second aspect of the embodiment of the present invention, a stress testing device is provided, including: a data copy module, a data storage module, and a stress testing module; wherein,
所述数据复制模块,用于使用第一过滤器复制待测试接口在生产环境下接收的一个或多个第一数据请求,及所述待测试接口在所述生产环境下根据所述第一数据请求返回的第一真实响应数据;The data copy module is used to use a first filter to copy one or more first data requests received by the interface to be tested in the production environment, and the interface to be tested is configured to copy the first data request in the production environment according to the first data request. The first real response data returned by the request;
所述数据存储模块,用于相对应地存储所述第一数据请求、所述第一真实响应数据;The data storage module is used to correspondingly store the first data request and the first real response data;
所述压力测试模块,用于在测试环境下,使用压力机读取所存储的所述第一数据请求,并将所述第一数据请求发送至所述待测试接口,接收所述待测试接口根据所述第一数据请求返回的测试响应数据,比较所述第一真实响应数据和所述测试响应数据,以得到压力测试结果。The stress testing module is configured to use a press to read the stored first data request in a testing environment, send the first data request to the interface to be tested, and receive the interface to be tested. According to the test response data returned by the first data request, the first real response data and the test response data are compared to obtain a stress test result.
可选地,所述数据复制模块,还用于在所述待测试接口需调用一个或多个第三方接口的情况下,使用与所述第三方接口对应的第二过滤器复制在生产环境下发送至所述第三方接口的一个或多个第二数据请求,及从所述第三方接口返回的与所述第二数据请求对应的第二真实响应数据;Optionally, the data copy module is also configured to use a second filter corresponding to the third-party interface to copy the data in the production environment when the interface to be tested needs to call one or more third-party interfaces. One or more second data requests sent to the third-party interface, and second real response data corresponding to the second data requests returned from the third-party interface;
所述数据存储模块,还用于相对应地存储所述第二数据请求、所述第二真实响应数据;The data storage module is also used to correspondingly store the second data request and the second real response data;
所述压力测试模块,还用于在测试环境下,使用模拟所述第三方接口的模拟器读取所存储的所述第二数据请求以及所述第二真实响应数据,其中,所述模拟器在测试环境中接收到所述第二数据请求时,返回所述第二真实响应数据。The stress testing module is also configured to read the stored second data request and the second real response data using a simulator that simulates the third-party interface in a test environment, wherein the simulator When the second data request is received in the test environment, the second real response data is returned.
可选地,所述数据复制模块,还用于:Optionally, the data copy module is also used to:
在复制到所述第一数据请求或所述第二数据请求后,生成与所述第一数据请求或所述第二数据请求唯一对应的数据请求标识;After copying to the first data request or the second data request, generate a data request identifier uniquely corresponding to the first data request or the second data request;
将所述数据请求标识增加至所述第一数据请求或所述第二数据请求中,以使所复制的与所述第一数据请求或第二数据请求对应的所述第一真实响应数据或所述第二真实响应数据具有所述数据请求标识。Add the data request identifier to the first data request or the second data request, so that the copied first real response data corresponding to the first data request or the second data request or The second real response data has the data request identifier.
可选地,所述数据标识请求指示了所述第一数据请求或所述第二数据请求的时间顺序。Optionally, the data identification request indicates the time sequence of the first data request or the second data request.
可选地,所述模拟器根据所存储的所述第二数据请求对应的真实响应时间返回所述第二真实响应数据。Optionally, the simulator returns the second real response data according to the stored real response time corresponding to the second data request.
可选地,所述压力测试模块,还用于Optionally, the pressure test module is also used to
根据所述数据请求标识,所述压力机批量读取并缓存所述第一数据请求,并通过生产者/消费者模式将所述第一数据请求发送至所述待测试接口。According to the data request identification, the press reads and caches the first data request in batches, and sends the first data request to the interface to be tested through the producer/consumer mode.
可选地,所述压力测试模块,还用于Optionally, the pressure test module is also used to
根据所述数据请求标识所指示的时间顺序,在所述压力机将所述第一数据请求发送至所述待测试接口,所述模拟器批量读取并缓存所述第二数据请求、所述第二数据请求对应的第二真实响应数据。According to the time sequence indicated by the data request identifier, after the press sends the first data request to the interface to be tested, the simulator reads and caches the second data request, the The second real response data corresponding to the second data request.
可选地,所述数据存储模块,用于Optionally, the data storage module is used to
使用第一过滤器与WebSocket服务端之间的连接或第二过滤器与WebSocket服务端之间的连接,将所述第一数据请求、所述第一真实响应数据或所述第二数据请求、所述第二真实响应数据发送至WebSocket服务端,以使所述WebSocket服务端通过消息队列将所述第一数据请求、所述第一真实响应数据或所述第二数据请求、所述第二真实响应数据发送至存储引擎。Using the connection between the first filter and the WebSocket server or the connection between the second filter and the WebSocket server, the first data request, the first real response data or the second data request, The second real response data is sent to the WebSocket server, so that the WebSocket server sends the first data request, the first real response data or the second data request, the second data through the message queue. The real response data is sent to the storage engine.
可选地,所述数据复制模块,还用于,Optionally, the data copy module is also used to:
通过所述WebSocket服务端与所述第一过滤器之间的连接,向所述第一过滤器发送开始数据复制请求或停止数据复制请求。Through the connection between the WebSocket server and the first filter, a start data copy request or a stop data copy request is sent to the first filter.
为实现上述目的,根据本发明实施例的第三方面,提供了一种压力测试电子设备,包括:一个或多个处理器;存储装置,用于存储一个或多个程序,当所述一个或多个程序被所述一个或多个处理器执行时,所述一个或多个处理器实现如上所述压力测试方法中任一所述的方法。In order to achieve the above object, according to the third aspect of the embodiment of the present invention, a stress testing electronic device is provided, including: one or more processors; a storage device for storing one or more programs. When the one or more When multiple programs are executed by the one or more processors, the one or more processors implement the method described in any one of the above stress testing methods.
为实现上述目的,根据本发明实施例的第四方面,提供了一种计算机可读介质,其上存储有计算机程序,所述程序被处理器执行时实现如上所述压力测试方法中任一所述的方法。In order to achieve the above object, according to the fourth aspect of the embodiment of the present invention, a computer-readable medium is provided, a computer program is stored thereon, and when the program is executed by a processor, any one of the above stress testing methods is implemented. method described.
上述发明中具有如下优点或有益效果:因为采用第一过滤器复制生产环境下发送至待测试接口的第一数据请求及对应的第一真实响应数据的技术手段,所以克服了现有技术中采用模拟的线上用户请求进行压力测试无法真实、有效地发现系统存在问题的技术问题,进而达到了提高压力测试准确性、有效性技术效果;此外,还通过模拟器模模拟待测试接口依赖的一个或多个第三方接口的技术手段,避免了现有的压力测试中需要在测试环境中部署大量第三方接口的技术问题,降低了压力测试的复杂性,提高了压力测试的效率。The above invention has the following advantages or beneficial effects: because the first filter is used to copy the first data request and the corresponding first real response data sent to the interface to be tested in the production environment, it overcomes the technical means used in the prior art. The simulated online user request for stress testing cannot truly and effectively discover the technical problems of the system, thereby achieving the technical effect of improving the accuracy and effectiveness of the stress test; in addition, the simulator is also used to simulate a dependency of the interface to be tested. The technical means of multiple third-party interfaces avoids the technical problem of deploying a large number of third-party interfaces in the test environment in existing stress testing, reduces the complexity of stress testing, and improves the efficiency of stress testing.
上述的非惯用的可选方式所具有的进一步效果将在下文中结合具体实施方式加以说明。Further effects of the above-mentioned non-conventional optional methods will be described below in conjunction with specific implementations.
附图说明Description of the drawings
附图用于更好地理解本发明,不构成对本发明的不当限定。其中:The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention. in:
图1是根据本发明实施例的压力测试方法的主要流程的示意图;Figure 1 is a schematic diagram of the main flow of a pressure testing method according to an embodiment of the present invention;
图2是根据本发明实施例的生产环境下的数据请求复制系统的主要结构的示意图;Figure 2 is a schematic diagram of the main structure of a data request replication system in a production environment according to an embodiment of the present invention;
图3是根据本发明实施例的生产环境下的数据请求复制方法的主要流程的示意图;Figure 3 is a schematic diagram of the main flow of a data request copying method in a production environment according to an embodiment of the present invention;
图4是根据本发明实施例的测试环境下的压力测试系统的主要结构的示意图;Figure 4 is a schematic diagram of the main structure of a pressure testing system in a testing environment according to an embodiment of the present invention;
图5是根据本发明实施例的测试环境下的压力测试方法的主要流程的示意图;Figure 5 is a schematic diagram of the main flow of a stress testing method in a testing environment according to an embodiment of the present invention;
图6是根据本发明实施例的压力测试装置的主要模块的示意图;Figure 6 is a schematic diagram of the main modules of a pressure testing device according to an embodiment of the present invention;
图7是本发明实施例可以应用于其中的示例性系统架构图;Figure 7 is an exemplary system architecture diagram in which embodiments of the present invention can be applied;
图8是适于用来实现本发明实施例的终端设备或服务器的计算机系统的结构示意图。FIG. 8 is a schematic structural diagram of a computer system suitable for implementing a terminal device or server according to an embodiment of the present invention.
具体实施方式Detailed ways
以下结合附图对本发明的示范性实施例做出说明,其中包括本发明实施例的各种细节以助于理解,应当将它们认为仅仅是示范性的。因此,本领域普通技术人员应当认识到,可以对这里描述的实施例做出各种改变和修改,而不会背离本发明的范围和精神。同样,为了清楚和简明,以下的描述中省略了对公知功能和结构的描述。Exemplary embodiments of the present invention are described below with reference to the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding and should be considered to be exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted from the following description for clarity and conciseness.
图1是根据本发明实施例的压力测试方法的主要流程的示意图,如图1所示,该压力测试方法具体可以包括的步骤如下:Figure 1 is a schematic diagram of the main flow of a pressure testing method according to an embodiment of the present invention. As shown in Figure 1, the pressure testing method may specifically include the following steps:
步骤S101,使用第一过滤器复制待测试接口在生产环境下接收的一个或多个第一数据请求,及所述待测试接口在所述生产环境下根据所述第一数据请求返回的第一真实响应数据。Step S101: Use the first filter to copy one or more first data requests received by the interface to be tested in the production environment, and the first data request returned by the interface to be tested in the production environment according to the first data request. Real response data.
所谓过滤器是指一段程序,或一个服务端程序的组件,它可以拦截客户端对应的待测试接口的数据请求与响应,并对数据请求和响应的信息进行过滤。生产环境则是指实际用户通过互联网获取互联网系统提供服务的环境,即真实环境,第一数据请求包括但不限于用户发送的登录、注册、访问等,第一真实响应数据则是指待测试接口在接收到第一数据请求后执行程序后得到的结果,且第一数据请求与第一真实响应数据具有一一对应的关系。The so-called filter refers to a program or a component of a server program, which can intercept the data requests and responses of the client's corresponding interface to be tested, and filter the data requests and response information. The production environment refers to the environment where actual users obtain services provided by the Internet system through the Internet, that is, the real environment. The first data request includes but is not limited to login, registration, access, etc. sent by the user. The first real response data refers to the interface to be tested. The result obtained after executing the program after receiving the first data request, and the first data request and the first real response data have a one-to-one correspondence.
更进一步地,现有的互联网系统中待测试接口(远程调用接口,如RPC接口)常依赖一个或多个第三方接口(即其他远程调用接口),如此,在所述待测试接口需调用一个或多个第三方接口的情况下,使用与所述第三方接口对应的第二过滤器复制在生产环境下发送至所述第三方接口的一个或多个第二数据请求,及从所述第三方接口返回的与所述第二数据请求对应的第二真实响应数据。Furthermore, the interface to be tested (remote calling interface, such as RPC interface) in existing Internet systems often relies on one or more third-party interfaces (that is, other remote calling interfaces). Therefore, the interface to be tested needs to call a In the case of multiple third-party interfaces, use a second filter corresponding to the third-party interface to copy one or more second data requests sent to the third-party interface in the production environment, and obtain the data from the third-party interface. The second real response data corresponding to the second data request returned by the third-party interface.
在此基础上,为保证第一数据请求、第一真实响应数据之间的一一对应性,以及第二数据请求、第二真实响应数据请求之间的一一对应性,在复制到所述第一数据请求或所述第二数据请求后,生成与所述第一数据请求或所述第二数据请求唯一对应的数据请求标识;将所述数据请求标识增加至所述第一数据请求或所述第二数据请求中,以使所复制的与所述第一数据请求或第二数据请求对应的所述第一真实响应数据或所述第二真实响应数据具有所述数据请求标识。On this basis, in order to ensure the one-to-one correspondence between the first data request and the first real response data, and the one-to-one correspondence between the second data request and the second real response data request, after copying to the After the first data request or the second data request, generate a data request identifier uniquely corresponding to the first data request or the second data request; add the data request identifier to the first data request or In the second data request, the copied first real response data or the second real response data corresponding to the first data request or the second data request has the data request identification.
更进一步地,所述数据标识请求指示了所述第一数据请求或所述第二数据请求的时间顺序。如数据请求标识按照时间顺序依次递增为例进行说明,则数据标识对应的数据越小,则对应的第一数据请求或第二数据请求在在进行压力测试时发送至测试接口或模拟器的顺序越靠前。Furthermore, the data identification request indicates the time sequence of the first data request or the second data request. For example, if the data request identifiers increase sequentially in chronological order, the smaller the data corresponding to the data identifier, the sequence in which the corresponding first data request or second data request is sent to the test interface or simulator during stress testing. The closer to the front.
可以理解的是,在使用第一过滤器复制待测试接口在生产环境下接收的一个或多个第一数据请求,及所述待测试接口在所述生产环境下根据所述数据请求返回的第一真实响应数据之前,使用Java热部署技术将第一过滤器、待测试接口、第二过滤器部署至同一Java进程中,以降低网络或者其他程序对数据请求复制的影响。Java热部署则是指在不重启Java虚拟机的情况下,能自动侦测到class文件的变化,从而更新运行时的class的行为。It can be understood that when using the first filter to copy one or more first data requests received by the interface to be tested in the production environment, and the first data request returned by the interface to be tested in the production environment according to the data request, Before receiving real response data, use Java hot deployment technology to deploy the first filter, the interface to be tested, and the second filter into the same Java process to reduce the impact of the network or other programs on data request replication. Java hot deployment refers to the ability to automatically detect changes in class files without restarting the Java virtual machine, thereby updating the runtime class behavior.
此外,在使用第一过滤器或第二过滤器复制数据请求时,既可以采用单线程方式也可以采用多线程方式。在本实施例中,考虑有优先采用单线程方式进行数据请求及对应响应结果的复制,如此,可以尽可能降低过滤器对待测试接口或第三方接口本身执行性能的影响,力求复制到的数据请求的真实性。In addition, when using the first filter or the second filter to copy the data request, either a single-threaded method or a multi-threaded method can be used. In this embodiment, priority is given to using a single-threaded method to copy the data request and the corresponding response result. In this way, the impact of the filter on the execution performance of the interface to be tested or the third-party interface itself can be reduced as much as possible, and the data request to be copied can be minimized. authenticity.
步骤S102,相对应地存储所述第一数据请求、所述第一真实响应数据。Step S102: Store the first data request and the first real response data accordingly.
可以理解的是,在待测接口依赖一个或多个第三方接口的情况下,也即使用第三接口对应的第二过滤器复制第二数据请求、第二真实响应数据的情况下,还包括:相对应地存储所述第二数据请求、所述第二真实响应数据。It can be understood that when the interface under test relies on one or more third-party interfaces, that is, when the second filter corresponding to the third interface is used to copy the second data request and the second real response data, it also includes : Correspondingly store the second data request and the second real response data.
具体地,使用与所述第一过滤器或所述第二过滤器对应的WebSocket连接,将所述第一数据请求、所述第一真实响应数据或所述第二数据请求、所述第二真实响应数据发送至WebSocket服务端,以使所述WebSocket服务端通过消息队列将所述第一数据请求、所述第一真实响应数据或所述第二数据请求、所述第二真实响应数据发送至存储引擎。WebSocket服务则是指一种全双工通信协议,一旦客户端与服务器建立起连接,之后的全部数据通信都通过这个连接进行,通信过程中,可互相发送JSON、XML、HTML或图片等任意格式的数据。值得注意的是,为保证WebSocket连接的稳定性、持续性,第一过滤器或第二过滤器采用单线程长连接的方式传输数据请求、真实响应结果至WebSocket服务端。Specifically, using a WebSocket connection corresponding to the first filter or the second filter, the first data request, the first real response data or the second data request, the second The real response data is sent to the WebSocket server, so that the WebSocket server sends the first data request, the first real response data or the second data request, and the second real response data through the message queue. to the storage engine. WebSocket service refers to a full-duplex communication protocol. Once a connection is established between the client and the server, all subsequent data communications are conducted through this connection. During the communication process, any format such as JSON, XML, HTML or pictures can be sent to each other. The data. It is worth noting that in order to ensure the stability and continuity of the WebSocket connection, the first filter or the second filter uses a single-threaded long connection to transmit data requests and real response results to the WebSocket server.
此外,由于第一过滤器与WebSocket服务端建立的双向连接,因此,可通过所述WebSocket服务端与所述第一过滤器之间的连接,向所述第一过滤器发送开始数据复制请求或停止数据复制请求。In addition, due to the two-way connection established between the first filter and the WebSocket server, a start data copy request or a start data copy request can be sent to the first filter through the connection between the WebSocket server and the first filter. Stop the data copy request.
步骤S103,在测试环境下,使用压力机读取所存储的所述第一数据请求,并将所述第一数据请求发送至所述待测试接口,接收所述待测试接口根据所述第一数据请求返回的测试响应数据,比较所述第一真实响应数据和所述测试响应数据,以得到压力测试结果。Step S103: In the test environment, use a press to read the stored first data request, send the first data request to the interface to be tested, and receive the interface to be tested according to the first The test response data returned by the data request is compared with the first real response data and the test response data to obtain the stress test result.
具体地,若测试响应数据与第一真实响应数据一致,则表明压力测试成功并记录压力测试成功次数;若测试响应数据与第一真实响应数据不一致,则同时记录测试响应数据、第一真实响应数据,以便日后排查问题。其中,模拟器是指在使用压力机读取所存储的第一数据请求并将第一数据请求发送至待测试接口以对待测试街接口进行压力测试之前,根据预先配置的与第三方接口对应的JAR包使用Java动态生成字节码技术的生成的模拟第三方接口的模拟器。Specifically, if the test response data is consistent with the first real response data, it indicates that the stress test is successful and the number of successful stress tests is recorded; if the test response data is inconsistent with the first real response data, the test response data and the first real response are recorded at the same time. data to help troubleshoot problems in the future. Wherein, the simulator refers to using a press machine to read the stored first data request and send the first data request to the interface to be tested to perform stress testing on the interface to be tested, according to the preconfigured data corresponding to the third-party interface. The JAR package uses Java dynamically generated bytecode technology to generate a simulator that simulates third-party interfaces.
此外,在待测接口依赖一个或多个第三方接口的情况下,也即使用第三接口对应的第二过滤器复制第二数据请求、第二真实响应数据的情况下,在测试环境下,还包括:使用模拟所述第三方接口的模拟器读取所存储的所述第二数据请求以及所述第二真实响应数据,其中,所述模拟器在测试环境中接收到所述第二数据请求时,返回所述第二真实响应数据。如此,可以使用模拟器代替待测试接口真实需要依赖的一个或多个第三方测试接口,且不需要模拟器根据第二数据请求进行运算以得到响应结果,只需将存储的第二数据请求对应的第二真实响应数据发送至待测试接口即可,无需部署大量的第三方接口。In addition, when the interface under test relies on one or more third-party interfaces, that is, when the second filter corresponding to the third interface is used to copy the second data request and the second real response data, in the test environment, It also includes: using a simulator that simulates the third-party interface to read the stored second data request and the second real response data, wherein the simulator receives the second data in a test environment When requested, the second real response data is returned. In this way, the simulator can be used to replace one or more third-party test interfaces that the interface to be tested actually depends on, and the simulator does not need to perform operations according to the second data request to obtain the response result. It only needs to correspond to the stored second data request. The second real response data can be sent to the interface to be tested, without deploying a large number of third-party interfaces.
更具体地,在测试环境下,为使用模拟器真实地模拟第三方接口,模拟器在读取到第二数据请求对应的第二真实响应结果后,在接收到待测试接口发送的第二数据请求的情况下,根据第三方接口在生产环境下返回第二真实响应结果对应的真实响应时间向待测试接口返回对应的第二真实响应结果。也即是说,模拟器在返回第二真实响应结果之前,判断是否已经到达了第三方接口根据第二数据请求执行程序所消耗的时间,若已达到则返回第二真实响应数据,若未达到则模拟器将程序暂停,待达到所消耗的时间后再返回第二真实响应数据。More specifically, in the test environment, in order to use the simulator to truly simulate the third-party interface, after reading the second real response result corresponding to the second data request, the simulator receives the second data sent by the interface to be tested. In the case of a request, the corresponding second real response result is returned to the interface to be tested based on the real response time corresponding to the second real response result returned by the third-party interface in the production environment. That is to say, before returning the second real response result, the simulator determines whether the time it takes for the third-party interface to execute the program according to the second data request has been reached. If it has reached the time, it will return the second real response data. If it has not reached the Then the simulator will pause the program and return the second real response data after the consumed time is reached.
在一种可选的实施方式中,根据所述数据请求标识,所述压力机批量读取并缓存所述第一数据请求,并通过生产者/消费者模式将所述第一数据请求发送至所述待测试接口。如此,可以通过控制压力机线程数量或者待测试接口消费第一数据请求频率的方式控制发送第一数据请求的速度,也即控制压力测试时发送压力的速度。此外,还可以通过压力机批量读取并缓存第一数据请求的方式,减少压力机与存储第一数据请求、第一真实响应数据的存储引擎之间的交互。In an optional implementation, according to the data request identification, the press reads and caches the first data request in batches, and sends the first data request to The interface to be tested. In this way, the speed of sending the first data request can be controlled by controlling the number of press threads or the frequency of the first data request consumed by the interface to be tested, that is, controlling the speed of sending the pressure during the stress test. In addition, the interaction between the press and the storage engine that stores the first data request and the first real response data can also be reduced by batch reading and caching of the first data request by the press.
在此基础上,根据所述数据请求标识所指示的时间顺序,在所述压力机将所述第一数据请求发送至所述待测试接口后,所述模拟器批量读取并缓存所述第二数据请求、所述第二数据请求对应的第二真实响应数据。也即通过模拟器读取并缓存第一数据请求的方式,减少压力机与存储第二数据请求、第二真实响应数据的存储引擎之间的交互。On this basis, according to the time sequence indicated by the data request identifier, after the press sends the first data request to the interface to be tested, the simulator reads and caches the first data request in batches. Two data requests, and second real response data corresponding to the second data request. That is, by reading and caching the first data request through the simulator, the interaction between the press and the storage engine that stores the second data request and the second real response data is reduced.
基于上述实施例,通过采用第一过滤器复制生产环境下发送至待测试接口的第一数据请求及对应的第一真实响应数据的技术手段,所以克服了现有技术中采用模拟的线上用户请求进行压力测试无法真实、有效地发现系统存在问题的技术问题,进而达到了提高压力测试准确性、有效性技术效果;此外,还通过模拟器模模拟待测试接口依赖的一个或多个第三方接口的技术手段,避免了现有的压力测试中需要在测试环境中部署大量第三方接口的技术问题,降低了压力测试的复杂性,提高了压力测试的效率。Based on the above embodiment, by using the first filter to copy the first data request and the corresponding first real response data sent to the interface to be tested in the production environment, it overcomes the problem of using simulated online users in the prior art. Requesting a stress test cannot truly and effectively discover technical problems in the system, thereby achieving the technical effect of improving the accuracy and effectiveness of the stress test; in addition, the simulator model is used to simulate one or more third parties that the interface to be tested relies on. The technical means of interfaces avoids the technical problems of deploying a large number of third-party interfaces in the test environment in existing stress tests, reduces the complexity of stress tests, and improves the efficiency of stress tests.
参见图2,在上述实施例的基础上,本发明实施例提供了生产环境下的数据请求复制系统的主要结构的示意图;具体地,该数据请求复制系统包括:第一过滤器、待测试接口、一个或多个第三方接口、一个或多个与第三方接口对应的第二过滤器、WebSocket服务端、消息队列、存储引擎。其中,第一过滤器用于复制待测试接口在生产环境下接收的一个或多个第一数据请求,及所述待测试接口在所述生产环境下根据所述数据请求返回的第一真实响应数据,将第一数据请求、第一真实响应数据通过第一过滤器与WebSocket服务端之间的连接发送至WebSocket服务端;第二过滤器用于复制在生产环境下发送至所述第三方接口的一个或多个第二数据请求,及从所述第三方接口返回的与所述第二数据请求对应的第二真实响应数据,将第二数据请求、第二真实响应数据通过第二过滤器与WebSocket服务端之间连接发送至WebSocket服务端;WebSocket服务端用于通过消息队列将所述第一数据请求、所述第一真实响应数据或所述第二数据请求、所述第二真实响应数据发送至存储引擎;存储引擎则用于相对应地存储所述第一数据请求、所述第一真实响应数据,或所述第二数据请求、所述第二真实响应数据。Referring to Figure 2, on the basis of the above embodiments, the embodiment of the present invention provides a schematic diagram of the main structure of a data request copying system in a production environment; specifically, the data request copying system includes: a first filter, an interface to be tested , one or more third-party interfaces, one or more second filters corresponding to the third-party interface, WebSocket server, message queue, and storage engine. Wherein, the first filter is used to copy one or more first data requests received by the interface to be tested in the production environment, and the first real response data returned by the interface to be tested according to the data request in the production environment. , sending the first data request and the first real response data to the WebSocket server through the connection between the first filter and the WebSocket server; the second filter is used to copy a data sent to the third-party interface in the production environment. or multiple second data requests, and the second real response data corresponding to the second data request returned from the third-party interface, pass the second data request and the second real response data through the second filter and WebSocket The connection between servers is sent to the WebSocket server; the WebSocket server is used to send the first data request, the first real response data or the second data request, and the second real response data through the message queue. to the storage engine; the storage engine is used to correspondingly store the first data request, the first real response data, or the second data request, the second real response data.
参见图3,在上述实施例的基础上,本发明实施例的提供了一种生产环境下的数据请求复制方法,该方法具体可以包括的步骤如下:Referring to Figure 3, based on the above embodiments, embodiments of the present invention provide a data request copy method in a production environment. The method may specifically include the following steps:
步骤S301,第一过滤器复制待测试接口在生产环境下接收的一个或多个第一数据请求,及所述待测试接口在所述生产环境下根据所述第一数据请求返回的第一真实响应数据。Step S301: The first filter copies one or more first data requests received by the interface to be tested in the production environment, and the first real data returned by the interface to be tested according to the first data request in the production environment. response data.
为保证第一数据请求、第一真实响应数据请求之间的一一对应性,在复制到所述第一数据请求后,生成与所述第一数据请求唯一对应的数据请求标识,且该数据请求标识与时间相关联或按照时间顺序递增;将所述数据请求标识增加至所述第一数据请求中,以使所复制的与第一数据请求对应的所述第一真实响应数据具有所述数据请求标识。In order to ensure the one-to-one correspondence between the first data request and the first real response data request, after copying to the first data request, a data request identifier uniquely corresponding to the first data request is generated, and the data The request identification is associated with time or increments in chronological order; the data request identification is added to the first data request, so that the copied first real response data corresponding to the first data request has the Data request identifier.
步骤S302,第一过滤器通过与WebSocket服务端之间的连接,将所述第一数据请求、所述第一真实响应数据发送至WebSocket服务端。Step S302: The first filter sends the first data request and the first real response data to the WebSocket server through the connection with the WebSocket server.
除此之外,第一过滤器与WebSocket服务端建立的是双向连接,因此,可通过所述WebSocket服务端与所述第一过滤器之间的连接,向所述第一过滤器发送开始数据复制请求或停止数据复制请求。In addition, the first filter establishes a two-way connection with the WebSocket server. Therefore, start data can be sent to the first filter through the connection between the WebSocket server and the first filter. Copy request or stop data copy request.
步骤S303,第二过滤器复制在生产环境下发送至所述第三方接口的一个或多个第二数据请求,及从所述第三方接口返回的与所述第二数据表请求对应的第二真实响应数据。Step S303: The second filter copies one or more second data requests sent to the third-party interface in the production environment, and the second data table request corresponding to the second data table request returned from the third-party interface. Real response data.
为保证第二数据请求、第二真实响应数据请求之间的一一对应性,在复制到所述第二数据请求后,生成与所述第二数据请求唯一对应的数据请求标识,且该数据请求标识与时间相关联或按照时间顺序递增;将所述数据请求标识增加至所述第二数据请求中,以使所复制的与第二数据请求对应的所述第二真实响应数据具有所述数据请求标识。In order to ensure the one-to-one correspondence between the second data request and the second real response data request, after copying to the second data request, a data request identifier uniquely corresponding to the second data request is generated, and the data The request identification is associated with time or increments in chronological order; the data request identification is added to the second data request, so that the copied second real response data corresponding to the second data request has the Data request identifier.
步骤S304,第二过滤器通过与WebSocket服务端之间的连接,将所述第二数据请求、所述第二真实响应数据发送至WebSocket服务端。Step S304: The second filter sends the second data request and the second real response data to the WebSocket server through the connection with the WebSocket server.
步骤S305,WebSocket服务端通过消息队列将所述第一数据请求、所述第一真实响应数据或所述第二数据请求、所述第二真实响应数据发送至存储引擎。Step S305: The WebSocket server sends the first data request, the first real response data or the second data request, and the second real response data to the storage engine through the message queue.
参见图4,在上述实施例的基础上,本发明实施例提供了一种测试环境下的压力测试系统,包括:压力机、待测试接口、模拟器、存储引擎;其中,压力机用于读取所存储的所述第一数据请求,并将所述第一数据请求发送至所述待测试接口,接收所述待测试接口根据所述第一数据请求返回的测试响应数据,比较所述第一真实响应数据和所述测试响应数据,以得到压力测试结果;模拟器用于读取所存储的所述第二数据请求以及所述第二真实响应数据,并在接收到所述第二数据请求时,返回所述第二真实响应数据。Referring to Figure 4, based on the above embodiments, embodiments of the present invention provide a stress testing system in a testing environment, including: a press, an interface to be tested, a simulator, and a storage engine; wherein, the press is used to read Obtain the stored first data request, send the first data request to the interface to be tested, receive the test response data returned by the interface to be tested according to the first data request, and compare the first data request to the interface to be tested. A real response data and the test response data to obtain the stress test results; the simulator is used to read the stored second data request and the second real response data, and after receiving the second data request when the second real response data is returned.
参见图5,在上述实施例的基础上,本发明实施例提供了是一种测试环境下的压力测试方法,该方法具体可以包括的步骤如下:Referring to Figure 5, based on the above embodiments, embodiments of the present invention provide a pressure testing method in a testing environment. The method may specifically include the following steps:
步骤S501,压力机读取所存储的所述第一数据请求,并将所述第一数据请求发送至所述待测试接口。Step S501: The press reads the stored first data request and sends the first data request to the interface to be tested.
具体地,根据所述数据请求标识,所述压力机批量读取并缓存所述第一数据请求,并通过生产者/消费者模式将所述第一数据请求发送至所述待测试接口。如此,可以通过控制压力机线程数量或者待测试接口消费第一数据请求频率的方式控制发送第一数据请求的速度,也即控制压力测试时发送压力的速度。此外,还可以通过压力机批量读取并缓存第一数据请求的方式,减少压力机与存储第一数据请求、第一真实响应数据的存储引擎之间的交互。Specifically, according to the data request identification, the press reads and caches the first data request in batches, and sends the first data request to the interface to be tested through the producer/consumer mode. In this way, the speed of sending the first data request can be controlled by controlling the number of press threads or the frequency of the first data request consumed by the interface to be tested, that is, controlling the speed of sending the pressure during the stress test. In addition, the interaction between the press and the storage engine that stores the first data request and the first real response data can also be reduced by batch reading and caching of the first data request by the press.
步骤S502,模拟所述第三方接口的模拟器读取所存储的所述第二数据请求以及所述第二真实响应数据。所述模拟器批量读取并缓存所述第二数据请求、所述第二数据请求对应的第二真实响应数据。也即通过模拟器读取并缓存第一数据请求的方式,减少压力机与存储第二数据请求、第二真实响应数据的存储引擎之间的交互。Step S502: The simulator that simulates the third-party interface reads the stored second data request and the second real response data. The simulator reads and caches the second data request and the second real response data corresponding to the second data request in batches. That is, by reading and caching the first data request through the simulator, the interaction between the press and the storage engine that stores the second data request and the second real response data is reduced.
步骤S503,所述模拟器在测试环境中接收到所述第二数据请求时,返回所述第二真实响应数据。Step S503: When the simulator receives the second data request in the test environment, it returns the second real response data.
更具体地,在测试环境下,为使用模拟器真实地模拟第三方接口,模拟器在读取到第二数据请求对应的第二真实响应结果后,在接收到待测试接口发送的第二数据请求的情况下,根据第三方接口在生产环境下返回第二真实响应结果对应的真实响应时间向待测试接口返回对应的第二真实响应结果。也即是说,模拟器在返回第二真实响应结果之前,判断是否已经到达了第三方接口根据第二数据请求执行程序所消耗的时间,若已达到则返回第二真实响应数据,若未达到则模拟器将程序暂停,待达到所消耗的时间后再返回第二真实响应数据。More specifically, in the test environment, in order to use the simulator to truly simulate the third-party interface, after reading the second real response result corresponding to the second data request, the simulator receives the second data sent by the interface to be tested. In the case of a request, the corresponding second real response result is returned to the interface to be tested based on the real response time corresponding to the second real response result returned by the third-party interface in the production environment. That is to say, before returning the second real response result, the simulator determines whether the time it takes for the third-party interface to execute the program according to the second data request has been reached. If it has reached the time, it will return the second real response data. If it has not reached the Then the simulator will pause the program and return the second real response data after the consumed time is reached.
步骤S504,压力机接收所述待测试接口根据所述第一数据请求返回的测试响应数据,比较所述第一真实响应数据和所述测试响应数据,以得到压力测试结果。Step S504: The press receives the test response data returned by the interface to be tested according to the first data request, and compares the first real response data and the test response data to obtain a stress test result.
具体地,若测试响应数据与第一真实响应数据一致,则表明压力测试成功并记录压力测试成功次数;若测试响应数据与第一真实响应数据不一致,则同时记录测试响应数据、第一真实响应数据,以便日后排查问题。Specifically, if the test response data is consistent with the first real response data, it indicates that the stress test is successful and the number of successful stress tests is recorded; if the test response data is inconsistent with the first real response data, the test response data and the first real response are recorded at the same time. data to help troubleshoot problems in the future.
参见图6,在上述实施例的基础上,本发明实施例提供了一种压力测试装置600,包括:数据复制模块601、数据存储模块602、压力测试模块603;其中,Referring to Figure 6, based on the above embodiments, the embodiment of the present invention provides a stress testing device 600, including: a data copy module 601, a data storage module 602, and a stress testing module 603; wherein,
所述数据复制模块601,用于使用第一过滤器复制待测试接口在生产环境下接收的一个或多个第一数据请求,及所述待测试接口在所述生产环境下根据所述第一数据请求返回的第一真实响应数据;The data copy module 601 is configured to use a first filter to copy one or more first data requests received by the interface to be tested in the production environment, and the interface to be tested in the production environment according to the first data request. The first real response data returned by the data request;
所述数据存储模块602,用于相对应地存储所述第一数据请求、所述第一真实响应数据;The data storage module 602 is used to correspondingly store the first data request and the first real response data;
所述压力测试模块603,用于在测试环境下,使用压力机读取所存储的所述第一数据请求,并将所述第一数据请求发送至所述待测试接口,接收所述待测试接口根据所述第一数据请求返回的测试响应数据,比较所述第一真实响应数据和所述测试响应数据,以得到压力测试结果。The stress test module 603 is configured to use a press to read the stored first data request in a test environment, send the first data request to the interface to be tested, and receive the first data request to be tested. The interface compares the first real response data and the test response data according to the test response data returned by the first data request to obtain a stress test result.
在一种可选的实施方式中,所述数据复制模块601,还用于在所述待测试接口需调用一个或多个第三方接口的情况下,使用与所述第三方接口对应的第二过滤器复制在生产环境下发送至所述第三方接口的一个或多个第二数据请求,及从所述第三方接口返回的与所述第二数据请求对应的第二真实响应数据;In an optional implementation, the data copy module 601 is also configured to use the second third-party interface corresponding to the third-party interface when the interface to be tested needs to call one or more third-party interfaces. The filter copies one or more second data requests sent to the third-party interface in the production environment, and the second real response data corresponding to the second data request returned from the third-party interface;
所述数据存储模块,还用于相对应地存储所述第二数据请求、所述第二真实响应数据;The data storage module is also used to correspondingly store the second data request and the second real response data;
所述压力测试模块,还用于在测试环境下,使用模拟所述第三方接口的模拟器读取所存储的所述第二数据请求以及所述第二真实响应数据,其中,所述模拟器在测试环境中接收到所述第二数据请求时,返回所述第二真实响应数据。The stress testing module is also configured to read the stored second data request and the second real response data using a simulator that simulates the third-party interface in a test environment, wherein the simulator When the second data request is received in the test environment, the second real response data is returned.
在一种可选的实施方式中,所述数据复制模块601,还用于:In an optional implementation, the data copy module 601 is also used to:
在复制到所述第一数据请求或所述第二数据请求后,生成与所述第一数据请求或所述第二数据请求唯一对应的数据请求标识;After copying to the first data request or the second data request, generate a data request identifier uniquely corresponding to the first data request or the second data request;
将所述数据请求标识增加至所述第一数据请求或所述第二数据请求中,以使所复制的与所述第一数据请求或第二数据请求对应的所述第一真实响应数据或所述第二真实响应数据具有所述数据请求标识。Add the data request identifier to the first data request or the second data request, so that the copied first real response data corresponding to the first data request or the second data request or The second real response data has the data request identifier.
在一种可选的实施方式中,所述数据标识请求指示了所述第一数据请求或所述第二数据请求的时间顺序。In an optional implementation, the data identification request indicates the time sequence of the first data request or the second data request.
在一种可选的实施方式中,所述模拟器根据所存储的所述第二数据请求对应的真实响应时间返回所述第二真实响应数据。In an optional implementation, the simulator returns the second real response data according to the stored real response time corresponding to the second data request.
在一种可选的实施方式中,所述压力测试模块603,还用于In an optional implementation, the stress testing module 603 is also used to
根据所述数据请求标识,所述压力机批量读取并缓存所述第一数据请求,并通过生产者/消费者模式将所述第一数据请求发送至所述待测试接口。According to the data request identification, the press reads and caches the first data request in batches, and sends the first data request to the interface to be tested through the producer/consumer mode.
在一种可选的实施方式中,所述压力测试模块603,还用于In an optional implementation, the stress testing module 603 is also used to
根据所述数据请求标识所指示的时间顺序,在所述压力机将所述第一数据请求发送至所述待测试接口,所述模拟器批量读取并缓存所述第二数据请求、所述第二数据请求对应的第二真实响应数据。According to the time sequence indicated by the data request identifier, after the press sends the first data request to the interface to be tested, the simulator reads and caches the second data request, the The second real response data corresponding to the second data request.
在一种可选的实施方式中,所述数据存储模块602,用于In an optional implementation, the data storage module 602 is used to
使用第一过滤器与WebSocket服务端之间的连接或第二过滤器与WebSocket服务端之间的连接,将所述第一数据请求、所述第一真实响应数据或所述第二数据请求、所述第二真实响应数据发送至WebSocket服务端,以使所述WebSocket服务端通过消息队列将所述第一数据请求、所述第一真实响应数据或所述第二数据请求、所述第二真实响应数据发送至存储引擎。Using the connection between the first filter and the WebSocket server or the connection between the second filter and the WebSocket server, the first data request, the first real response data or the second data request, The second real response data is sent to the WebSocket server, so that the WebSocket server sends the first data request, the first real response data or the second data request, the second data through the message queue. The real response data is sent to the storage engine.
在一种可选的实施方式中,所述数据复制模块601,还用于,In an optional implementation, the data copy module 601 is also used to:
通过所述WebSocket服务端与所述第一过滤器之间的连接,向所述第一过滤器发送开始数据复制请求或停止数据复制请求。Through the connection between the WebSocket server and the first filter, a start data copy request or a stop data copy request is sent to the first filter.
图7示出了可以应用本发明实施例的压力测试方法或压力测试装置的示例性系统架构700。FIG. 7 shows an exemplary system architecture 700 in which the stress testing method or stress testing device according to the embodiment of the present invention can be applied.
如图7所示,系统架构700可以包括终端设备701、702、703,网络704和服务器705。网络704用以在终端设备701、702、703和服务器705之间提供通信链路的介质。网络704可以包括各种连接类型,例如有线、无线通信链路或者光纤电缆等等。As shown in Figure 7, the system architecture 700 may include terminal devices 701, 702, 703, a network 704 and a server 705. Network 704 is a medium used to provide communication links between terminal devices 701, 702, 703 and server 705. Network 704 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
用户可以使用终端设备701、702、703通过网络704与服务器705交互,以接收或发送消息等。终端设备701、702、703上可以安装有各种通讯客户端应用,例如购物类应用、网页浏览器应用、搜索类应用、即时通信工具、邮箱客户端、社交平台软件等。Users can use terminal devices 701, 702, 703 to interact with the server 705 through the network 704 to receive or send messages, etc. Various communication client applications can be installed on the terminal devices 701, 702, and 703, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc.
终端设备701、702、703可以是具有显示屏并且支持网页浏览的各种电子设备,包括但不限于智能手机、平板电脑、膝上型便携计算机和台式计算机等等。The terminal devices 701, 702, and 703 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and so on.
服务器705可以是提供各种服务的服务器,例如对用户利用终端设备701、702、703所浏览的购物类网站提供支持的后台管理服务器。后台管理服务器可以对接收到的产品信息查询请求等数据进行分析等处理,并将处理结果反馈给终端设备。The server 705 may be a server that provides various services, such as a backend management server that provides support for shopping websites browsed by users using the terminal devices 701, 702, and 703. The background management server can analyze and process the received product information query request and other data, and feed the processing results back to the terminal device.
需要说明的是,本发明实施例所提供的压力测试方法一般由服务器705执行,相应地,压力测试装置一般设置于服务器705中。It should be noted that the stress testing method provided by the embodiment of the present invention is generally executed by the server 705, and accordingly, the stress testing device is generally installed in the server 705.
应该理解,图7中的终端设备、网络和服务器的数目仅仅是示意性的。根据实现需要,可以具有任意数目的终端设备、网络和服务器。It should be understood that the number of terminal devices, networks and servers in Figure 7 is only illustrative. Depending on implementation needs, there can be any number of end devices, networks, and servers.
下面参考图8,其示出了适于用来实现本发明实施例的终端设备的计算机系统800的结构示意图。图8示出的终端设备仅仅是一个示例,不应对本发明实施例的功能和使用范围带来任何限制。Referring now to FIG. 8 , a schematic structural diagram of a computer system 800 suitable for implementing a terminal device according to an embodiment of the present invention is shown. The terminal device shown in FIG. 8 is only an example and should not impose any restrictions on the functions and scope of use of the embodiments of the present invention.
如图8所示,计算机系统800包括中央处理单元(CPU)801,其可以根据存储在只读存储器(ROM)802中的程序或者从存储部分808加载到随机访问存储器(RAM)803中的程序而执行各种适当的动作和处理。在RAM 803中,还存储有系统800操作所需的各种程序和数据。CPU 801、ROM 802以及RAM 803通过总线804彼此相连。输入/输出(I/O)接口805也连接至总线804。As shown in FIG. 8, computer system 800 includes a central processing unit (CPU) 801 that can operate according to a program stored in a read-only memory (ROM) 802 or loaded from a storage portion 808 into a random access memory (RAM) 803. And perform various appropriate actions and processing. In the RAM 803, various programs and data required for the operation of the system 800 are also stored. CPU 801, ROM 802, and RAM 803 are connected to each other through bus 804. An input/output (I/O) interface 805 is also connected to bus 804.
以下部件连接至I/O接口805:包括键盘、鼠标等的输入部分806;包括诸如阴极射线管(CRT)、液晶显示器(LCD)等以及扬声器等的输出部分807;包括硬盘等的存储部分808;以及包括诸如LAN卡、调制解调器等的网络接口卡的通信部分809。通信部分809经由诸如因特网的网络执行通信处理。驱动器810也根据需要连接至I/O接口805。可拆卸介质811,诸如磁盘、光盘、磁光盘、半导体存储器等等,根据需要安装在驱动器810上,以便于从其上读出的计算机程序根据需要被安装入存储部分808。The following components are connected to the I/O interface 805: an input section 806 including a keyboard, a mouse, etc.; an output section 807 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., speakers, etc.; and a storage section 808 including a hard disk, etc. ; and a communication section 809 including a network interface card such as a LAN card, a modem, etc. The communication section 809 performs communication processing via a network such as the Internet. Driver 810 is also connected to I/O interface 805 as needed. Removable media 811, such as magnetic disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on the drive 810 as needed, so that a computer program read therefrom is installed into the storage portion 808 as needed.
特别地,根据本发明公开的实施例,上文参考流程图描述的过程可以被实现为计算机软件程序。例如,本发明公开的实施例包括一种计算机程序产品,其包括承载在计算机可读介质上的计算机程序,该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中,该计算机程序可以通过通信部分809从网络上被下载和安装,和/或从可拆卸介质811被安装。在该计算机程序被中央处理单元(CPU)801执行时,执行本发明的系统中限定的上述功能。In particular, according to embodiments disclosed in the present invention, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, the disclosed embodiments of the present invention include a computer program product including a computer program carried on a computer-readable medium, the computer program including program code for executing the method shown in the flowchart. In such embodiments, the computer program may be downloaded and installed from the network via communications portion 809 and/or installed from removable media 811 . When the computer program is executed by the central processing unit (CPU) 801, the above-mentioned functions defined in the system of the present invention are performed.
需要说明的是,本发明所示的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本发明中,计算机可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本发明中,计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读介质,该计算机可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输,包括但不限于:无线、电线、光缆、RF等等,或者上述的任意合适的组合。It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard drive, random access memory (RAM), read only memory (ROM), removable Programmed read-only memory (EPROM or flash memory), fiber optics, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in conjunction with an instruction execution system, apparatus, or device. In the present invention, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, in which computer-readable program code is carried. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device . Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the foregoing.
附图中的流程图和框图,图示了按照本发明各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分,上述模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个接连地表示的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图或流程图中的每个方框、以及框图或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more logic functions that implement the specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved. It will also be noted that each block in the block diagram or flowchart illustration, and combinations of blocks in the block diagram or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or operations, or may be implemented by special purpose hardware-based systems that perform the specified functions or operations. Achieved by a combination of specialized hardware and computer instructions.
描述于本发明实施例中所涉及到的模块可以通过软件的方式实现,也可以通过硬件的方式来实现。所描述的模块也可以设置在处理器中,例如,可以描述为:一种处理器包括数据复制模块、数据存储模块、压力测试模块。其中,这些模块的名称在某种情况下并不构成对该模块本身的限定,例如,数据存储模块还可以被描述为“用于相对应地存储所述第一数据请求、所述第一真实响应数据的模块”。The modules involved in the embodiments of the present invention can be implemented in software or hardware. The described module can also be provided in a processor. For example, it can be described as follows: a processor includes a data copy module, a data storage module, and a stress testing module. The names of these modules do not constitute a limitation on the module itself under certain circumstances. For example, the data storage module can also be described as “used to correspondingly store the first data request, the first real module that responds to data".
作为另一方面,本发明还提供了一种计算机可读介质,该计算机可读介质可以是上述实施例中描述的设备中所包含的;也可以是单独存在,而未装配入该设备中。上述计算机可读介质承载有一个或者多个程序,当上述一个或者多个程序被一个该设备执行时,使得该设备包括:使用第一过滤器复制待测试接口在生产环境下接收的一个或多个第一数据请求,及所述待测试接口在所述生产环境下根据所述数据请求返回的第一真实响应数据;相对应地存储所述第一数据请求、所述第一真实响应数据;在测试环境下,使用压力机读取所存储的所述第一数据请求,并将所述第一数据请求发送至所述待测试接口,接收所述待测试接口根据所述第一数据请求返回的测试响应数据,比较所述第一真实响应数据和所述测试响应数据,以得到压力测试结果。As another aspect, the present invention also provides a computer-readable medium. The computer-readable medium may be included in the device described in the above embodiments; it may also exist separately without being assembled into the device. The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by a device, the device includes: using the first filter to copy one or more programs received by the interface to be tested in the production environment. A first data request, and the first real response data returned by the interface to be tested according to the data request in the production environment; correspondingly storing the first data request and the first real response data; In a test environment, use a press to read the stored first data request, send the first data request to the interface to be tested, and receive a response from the interface to be tested according to the first data request. The test response data is compared with the first real response data and the test response data to obtain the stress test result.
根据本发明实施例的技术方案,因为采用第一过滤器复制生产环境下发送至待测试接口的第一数据请求及对应的第一真实响应数据的技术手段,所以克服了现有技术中采用模拟的线上用户请求进行压力测试无法真实、有效地发现系统存在问题的技术问题,进而达到了提高压力测试准确性、有效性技术效果;此外,还通过模拟器模模拟待测试接口依赖的一个或多个第三方接口的技术手段,避免了现有的压力测试中需要在测试环境中部署大量第三方接口的技术问题,降低了压力测试的复杂性,提高了压力测试的效率。According to the technical solution of the embodiment of the present invention, because the first filter is used to copy the first data request and the corresponding first real response data sent to the interface to be tested in the production environment, it overcomes the problem of using simulation in the prior art. Online users requesting stress testing cannot truly and effectively discover the technical problems of system problems, thereby achieving the technical effect of improving the accuracy and effectiveness of stress testing; in addition, the simulator model is also used to simulate one or more of the interfaces to be tested that depend on it. The technical means of multiple third-party interfaces avoids the technical problems of deploying a large number of third-party interfaces in the test environment in existing stress testing, reduces the complexity of stress testing, and improves the efficiency of stress testing.
上述具体实施方式,并不构成对本发明保护范围的限制。本领域技术人员应该明白的是,取决于设计要求和其他因素,可以发生各种各样的修改、组合、子组合和替代。任何在本发明的精神和原则之内所作的修改、等同替换和改进等,均应包含在本发明保护范围之内。The above-mentioned specific embodiments do not constitute a limitation on the scope of the present invention. It will be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention shall be included in the protection scope of the present invention.
Claims (11)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010208778.7A CN113434384B (en) | 2020-03-23 | 2020-03-23 | Pressure testing method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010208778.7A CN113434384B (en) | 2020-03-23 | 2020-03-23 | Pressure testing method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113434384A CN113434384A (en) | 2021-09-24 |
CN113434384B true CN113434384B (en) | 2023-09-22 |
Family
ID=77752599
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010208778.7A Active CN113434384B (en) | 2020-03-23 | 2020-03-23 | Pressure testing method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113434384B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114064500A (en) * | 2021-11-23 | 2022-02-18 | 北京锐安科技有限公司 | Operation environment simulation method, device, equipment and storage medium |
CN116107913B (en) * | 2023-04-06 | 2023-11-14 | 阿里云计算有限公司 | Test control method, device and system of single-node server |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8325880B1 (en) * | 2010-07-20 | 2012-12-04 | Convergys Customer Management Delaware Llc | Automated application testing |
CN109165168A (en) * | 2018-09-14 | 2019-01-08 | 杭州云创共享网络科技有限公司 | A kind of method for testing pressure, device, equipment and medium |
CN109271325A (en) * | 2018-10-26 | 2019-01-25 | 携程旅游网络技术(上海)有限公司 | Test method, system, electronic equipment and the storage medium of application |
CN109446071A (en) * | 2018-09-26 | 2019-03-08 | 深圳壹账通智能科技有限公司 | Interface test method, interface test device, electronic equipment and storage medium |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10592402B2 (en) * | 2017-11-20 | 2020-03-17 | International Business Machines Corporation | Automated integration testing with mock microservices |
-
2020
- 2020-03-23 CN CN202010208778.7A patent/CN113434384B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8325880B1 (en) * | 2010-07-20 | 2012-12-04 | Convergys Customer Management Delaware Llc | Automated application testing |
CN109165168A (en) * | 2018-09-14 | 2019-01-08 | 杭州云创共享网络科技有限公司 | A kind of method for testing pressure, device, equipment and medium |
CN109446071A (en) * | 2018-09-26 | 2019-03-08 | 深圳壹账通智能科技有限公司 | Interface test method, interface test device, electronic equipment and storage medium |
CN109271325A (en) * | 2018-10-26 | 2019-01-25 | 携程旅游网络技术(上海)有限公司 | Test method, system, electronic equipment and the storage medium of application |
Non-Patent Citations (1)
Title |
---|
自动化测试技术中Mock框架的建设与应用;孟燕;;武汉理工大学学报(信息与管理工程版)(第03期);全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN113434384A (en) | 2021-09-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110858172B (en) | A method and device for generating automatic test code | |
CN111786939B (en) | Method, device and system for testing management platform of Internet of things | |
CN112131095B (en) | Pressure testing method and device | |
CN113010405B (en) | A method and device for testing an application program | |
CN110795328A (en) | Interface testing method and device | |
CN113434384B (en) | Pressure testing method and device | |
CN112052152A (en) | A method and device for simulating testing | |
CN112579447A (en) | Browser testing method and device | |
CN113127335A (en) | System testing method and device | |
CN111800511B (en) | Synchronous login state processing method, system, equipment and readable storage medium | |
CN118312440A (en) | Automated stress testing method, device, equipment, and readable storage medium | |
CN116561013B (en) | Test methods, devices, electronic equipment and media based on the target service framework | |
CN110968497B (en) | Tree interceptor-based request verification method and device, medium and electronic equipment | |
CN113760715B (en) | Method and device for testing system | |
CN116774996A (en) | Integrated development system, code processing method, electronic device, and storage medium | |
CN116662430A (en) | Data query method, device, equipment, medium and product applied to multi-system interaction | |
CN110728009A (en) | Simulation method, apparatus and system | |
CN116185806A (en) | A testing method and device for a digital currency system | |
CN112099841A (en) | Method and system for generating configuration file | |
CN112214370B (en) | Debugging device and method for large-screen terminal | |
CN113031960B (en) | Code compiling method, device, server and storage medium | |
CN111831530A (en) | Test method and apparatus | |
CN114500485B (en) | Data processing method and device | |
CN116701158A (en) | Test method and device | |
CN118733922A (en) | Page archiving method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |