CN111770002A - Test data forwarding control method and device, readable storage medium and electronic equipment - Google Patents
Test data forwarding control method and device, readable storage medium and electronic equipment Download PDFInfo
- Publication number
- CN111770002A CN111770002A CN202010535186.6A CN202010535186A CN111770002A CN 111770002 A CN111770002 A CN 111770002A CN 202010535186 A CN202010535186 A CN 202010535186A CN 111770002 A CN111770002 A CN 111770002A
- Authority
- CN
- China
- Prior art keywords
- data
- test
- server
- test server
- parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/16—Threshold monitoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1044—Group management mechanisms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Abstract
The application relates to the technical field of big data testing, in particular to a test data forwarding control method, a test data forwarding control device, a readable storage medium and electronic equipment, wherein the method comprises the following steps: after establishing connection with a data source server according to set interface parameters, acquiring online traffic data from the data source server, wherein the online traffic data sent by terminal equipment of a user is stored in the data source server; and then, copying the on-line flow data according to the data control proportion parameter to obtain test data, and sending the test data to a test server so that the test server tests the specified program based on the test data. Because real online traffic data are forwarded to the test server for testing the big data processing program, the performance problem of the big data processing program can be found and solved in advance, and the loss of actual operation is reduced.
Description
Technical Field
The present application relates to the field of big data testing technologies, and in particular, to a test data forwarding control method and apparatus, a readable storage medium, and an electronic device.
Background
The big data technology can mine hidden information and knowledge in massive big data, thereby providing a basis for human social and economic activities. The implementation of big data technology usually relies on big data handlers, for which there are functions of data processing, data analysis and data mining. The performance of large data processing programs is very important to obtain correct information from mass data.
As the actual application environment becomes more and more complex, the probability of performance problems of the big data processing program increases, and the big data processing program is likely to have problems of failure, insufficient resources and the like in unpredictable time or data. Therefore, it is imperative to test the big data processing program to obtain the performance condition of the big data processing program.
In the prior art, when an application program is tested, a test case is usually required to be constructed, and when a large data processing program is tested, a large number of test cases are required to be constructed. Because the construction of a large number of test cases is rather difficult, performance tests for large data processing programs are currently less developed. Many performance problems of the big data processing program are processed after problems occur in actual operation, so that the operation loss of the big data processing program is inevitably brought.
Disclosure of Invention
In order to solve the existing technical problems, embodiments of the present application provide a test data forwarding control method, an apparatus, a readable storage medium, and an electronic device, which can forward real online traffic data to a test server for testing a big data processing program, and are helpful for discovering and solving the performance problem of the big data processing program in advance, and reducing the loss of actual operation.
In order to achieve the above purpose, the technical solution of the embodiment of the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides a test data forwarding control method, including:
after establishing connection with a data source server according to set interface parameters, acquiring online traffic data from the data source server, wherein the data source server is a server for receiving and storing the online traffic data sent by a user terminal device;
copying the on-line flow data according to the data control proportion parameter to obtain test data; the data control proportion parameter is determined according to the operation parameter of the test server;
and sending the test data to the test server so that the test server tests a specified program based on the test data.
The test data forwarding control method provided by the embodiment of the application is used for forwarding control of test data under the situations of testing a big data processing program and the like. After establishing connection with a data source server according to set interface parameters, acquiring online traffic data from the data source server, wherein the online traffic data sent by terminal equipment of a user is stored in the data source server; and then, copying the on-line flow data according to the data control proportion parameter to obtain test data, and sending the test data to a test server so that the test server tests the specified program based on the test data. According to the method, the on-line flow data are forwarded to the test server, the massive real on-line flow data of the production environment can be used as the test cases, the construction problem of the massive test cases is solved, the performance test of the big data processing program under the simulated real scene can be completed through the on-line flow data, the performance problem of the big data processing program can be found and solved in advance, and the operation loss possibly caused by reprocessing after the problem occurs in the actual operation of the big data processing program is reduced.
In an optional embodiment, the operation parameter of the test server is a load rate of the test server, and the method further includes:
if the load rate of the test server is greater than the set highest load rate, reducing the data control proportion parameter;
and if the load rate of the test server is less than the set lowest load rate, increasing the data control proportion parameter.
The method can realize the adjustment of the data control proportion parameters according to the difference of the load rates of the test servers, so that the test servers can be kept to operate in a set load rate interval.
In an optional embodiment, after the replicating the online traffic data according to the data control ratio parameter to obtain the test data, the method further includes:
if the operating parameters of the test server meet a set first condition, caching the acquired partial or all online flow data to a cache database;
sending the test data to the test server, including:
and if the operating parameters of the test server meet a set second condition, reading online flow data from the cache database and sending the online flow data to the test server.
The method can realize the caching of the flow data on the line in busy hour; and reading the online traffic data from the buffer database in idle time and sending the online traffic data to the test server. Thus, the adjustment of the test data forwarding control can be realized.
In an alternative embodiment, the operation parameter of the test server is a current time, the first condition is that the current time is within a set busy hour period, and the second condition is that the current time is within a set idle hour period.
The method can set the busy hour time period and the idle hour time period according to the running time of the test server, uses the current time as the running parameter of the test server, and realizes the busy hour cache idle hour multiplexing of the test data forwarding control according to different time periods.
In an optional embodiment, the operation parameter of the test server is a load rate of the test server, the first condition is that the load rate of the test server is greater than a set highest load rate, and the second condition is that the load rate of the test server is less than a set lowest load rate.
The method can use the load rate of the test server as an operation parameter, distinguish busy hour from idle hour according to the operation parameter, monitor the load rate of the test server at the current time, and realize the multiplexing of busy hour cache and idle hour of test data forwarding control.
In an optional embodiment, the operation parameter of the test server is a length of a message queue of the test server, where the message queue is used to store online traffic data that has been sent to the test server and has not been used to test a specified program, the first condition is that the length of the message queue is greater than a set longest length threshold, and the second condition is that the length of the message queue is less than a set shortest length threshold.
The method can use the length of the message queue of the test server as the operation parameter of the test server, distinguish busy time and idle time according to the comparison relation between the operation parameter and the longest length threshold value and the shortest length threshold value, and realize the multiplexing of busy time and idle time of test data forwarding control by monitoring the length of the message queue.
In an optional embodiment, the method further comprises: when the acquired on-line traffic data is cached in a cache database, a cache rate graph is generated according to the cache rate of the on-line traffic data at each moment;
reading online traffic data from the cache database, comprising:
and reading the flow data on the line from the cache database according to the cache rate graph.
According to the method, the rate of reading the cache data from the cache database can be obtained according to the cache rate matching during caching, and the flow playback rate control of test data forwarding control is realized.
In a second aspect, an embodiment of the present application further provides a test data forwarding control apparatus, including:
the data acquisition module is used for acquiring online flow data from a data source server after connection with the data source server is established according to set interface parameters, wherein the data source server is a server for receiving and storing the online flow data sent by the terminal equipment of a user;
the proportion control module is used for copying the on-line flow data according to the data control proportion parameters to obtain test data; the data control proportion parameter is determined according to the operation parameter of the test server;
and the data sending module is used for sending the test data to the test server so that the test server tests the specified program based on the test data.
In an optional embodiment, the operation parameter of the test server is a load rate of the test server, and the proportional control module is further configured to:
if the load rate of the test server is greater than the set highest load rate, reducing the data control proportion parameter;
and if the load rate of the test server is less than the set lowest load rate, increasing the data control proportion parameter.
In an optional embodiment, the data sending module is further configured to:
if the operating parameters of the test server meet a set first condition, caching the acquired partial or all online flow data to a cache database;
sending the test data to the test server, including:
and if the operating parameters of the test server meet a set second condition, reading online flow data from the cache database and sending the online flow data to the test server.
Optionally, the operation parameter of the test server is a current time, the first condition is that the current time is within a set busy hour period, and the second condition is that the current time is within a set idle hour period.
Optionally, the operation parameter of the test server is a load rate of the test server, the first condition is that the load rate of the test server is greater than a set highest load rate, and the second condition is that the load rate of the test server is less than a set lowest load rate.
Optionally, the operation parameter of the test server is a length of a message queue of the test server, the message queue is configured to store online traffic data that has been sent to the test server and is not yet used to test a specified program, the first condition is that the length of the message queue is greater than a set longest length threshold, and the second condition is that the length of the message queue is less than a set shortest length threshold.
In an optional embodiment, the data sending module is further configured to: when the acquired on-line traffic data is cached in a cache database, a cache rate graph is generated according to the cache rate of the on-line traffic data at each moment;
the data sending module is specifically configured to:
and reading the flow data on the line from the cache database according to the cache rate graph.
In a third aspect, an embodiment of the present application further provides an electronic device, including a memory and a processor, where the memory stores a computer program that is executable on the processor, and when the computer program is executed by the processor, the processor is enabled to implement any one of the test data forwarding control methods in the first aspect.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method for controlling forwarding of test data in any of the first aspect is implemented.
For technical effects brought by any one implementation manner in the second aspect to the fourth aspect, reference may be made to technical effects brought by a corresponding implementation manner in the first aspect, and details are not described here.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a schematic block diagram of a structure of a test data forwarding control system according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a test data forwarding control method according to an embodiment of the present application;
fig. 3 is a schematic diagram of a pressure measurement buffer rate according to an embodiment of the present application;
fig. 4 is a schematic diagram of a traffic playback rate provided in an embodiment of the present application;
fig. 5 is a schematic structural diagram of a test data forwarding control apparatus according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application clearer, the present application will be described in further detail with reference to the accompanying drawings, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Some terms in the embodiments of the present application are explained below to facilitate understanding by those skilled in the art.
(1) Kafka is an open source stream processing platform developed by the Apache software foundation, written in Scala and Java. Kafka is a high-throughput distributed publish-subscribe messaging system that can handle all the action flow data of a consumer in a web site. This action (web browsing, searching and other user actions) is a key factor in many social functions on modern networks. These data are typically addressed by handling logs and log aggregations due to throughput requirements. This is a viable solution to the limitations of Hadoop-like log data and offline analysis systems, but which require real-time processing. The purpose of Kafka is to unify online and offline message processing through the parallel loading mechanism of Hadoop, and also to provide real-time messages through clustering.
Kafka is a high throughput distributed publish-subscribe messaging system with the following characteristics:
message persistence is provided by a disk data structure that maintains stable performance for even TB message storage.
High throughput: even the very common hardware Kafka can support millions of messages per second.
Partitioning of messages by Kafka server and consumer clusters is supported.
And Hadoop parallel data loading is supported.
(2) And (4) Broker: the Kafka cluster contains one or more servers, which are called brookers.
Topic: each message issued to the Kafka cluster has a category, which is called Topic. The messages of physically different topics are stored separately, and logically, the message of one Topic is stored on one or more brokers, but the user only needs to specify the Topic of the message to produce or consume the data without concern about where the data is stored.
Partition: partition is a physical concept, each Topic containing one or more partitions.
Producer: responsible for issuing messages to Kafka broker.
Consumer: and the message consumer reads the client of the message to the Kafka browser.
Consumer Group: each Consumer belongs to a particular Consumer Group (a Group name may be specified for each Consumer, or a default Group if a Group name is not specified).
(3) The performance test is to simulate various normal, peak and abnormal load conditions through an automatic test tool to test various performance indexes of the system. Both load tests and pressure tests belong to the performance tests, and both can be performed in combination. The performance of the system under various working loads is determined through load tests, and the aim is to test the change of various performance indexes of the system when the load is gradually increased. Stress testing is a test that achieves the maximum level of service that a system can provide by determining a bottleneck or unacceptable performance point for the system.
(4) And (3) pressure testing: the test under the strong load (large data volume, a large number of concurrent users and the like) checks the operation behavior of the application system under the condition of peak use, thereby effectively discovering some functional hidden danger of the system and whether the system has good fault-tolerant capability and restorability. The pressure test is divided into a stability pressure test for a long time (e.g., more than 24 hours) under a high load and a destructive pressure test for causing a system breakdown under an extreme load.
(5) Javabeans are a software component model that, just like ActiveX controls, provide known functionality, java classes that can be easily reused and integrated into applications. Any object that can be created with Java code can be encapsulated with a Java bean. By reasonably organizing the JavaBeans with different functions, a completely new application program can be quickly generated, and if the application program is compared with a car, the JavaBeans are compared with different parts of the car. For software developers, the biggest advantage brought by the JavaBean is that the reusability of codes is fully improved, and the JavaBean plays a positive role in the maintainability and easy maintainability of software.
(6) MySQL is a relational database. MySQL saves data in different tables instead of putting all data in one large repository, which increases speed and flexibility. The MySQL relational database released the first version in month 1 of 1998. The system provides a complete multi-thread operation mode by using a multi-thread mechanism provided by a system core, provides programming interfaces (APIs) facing programming languages such as C, C + +, Eiffel, Java, Perl, PHP, Python, Tcl and the like, supports various field types and provides complete operators to support SELECT and WHERE operations in queries.
(7) UUID (Universal Unique Identifier), a standard for software construction, is also part of the open software Foundation organization in the field of distributed computing environments. The aim is to enable all elements in the distributed system to have unique identification information without specifying the identification information through a central control end. Each person can create a UUID that does not conflict with others. In such a case, the name duplication problem at the time of database creation does not need to be considered. The UUID that is most widely used at present is the Globally Unique Identifier (GUID) of microsoft corporation, and other important applications are Linux ext2/ext3 file system, LUKS encrypted partition, GNOME, KDE, Mac OS X, and the like. In addition, we can also find the implementation in the UUID library in the e2fsprogs package. The UUID is a 128-bit value that can be calculated by a certain algorithm. To improve efficiency, the commonly used UUID may be shortened to 16 bits. The UUID is calculated based on the current time, a counter (counter), and hardware identification (typically the MAC address of the wireless network card).
UUID (Universal Unique identifier) is defined as a character string main key, is composed of 32-bit numbers, is coded by 16-system, and defines completely Unique system information in time and space.
Encoding rule of UUID:
1) 1-8 bits adopt system time, and the uniqueness on the time is ensured when the system time is accurate to millisecond level;
2) the 9-16 bits adopt IP addresses of the bottom layer and are unique in the server cluster;
3) using the HashCode value of the current object for 17-24 bits, and determining the uniqueness of the HashCode value on an internal object;
4) the method comprises the steps that 25-32 bits adopt a random number of a calling method, and uniqueness is achieved in a millisecond level in an object.
Uniqueness can be guaranteed by the above 4 strategies.
The present application will be described in further detail with reference to the following drawings and specific embodiments.
Fig. 1 is a block diagram illustrating a structure of a test data forwarding control system according to an embodiment of the present application. In the configuration shown in fig. 1, the test data transfer control system includes a data transfer device 100, at least one terminal 200, at least one data source server 300, and a test server 500. The data transfer device 100, the terminal 200, the data source server 300, and the test server 500 are connected to the network 400, respectively. The terminal 200 may be a mobile phone, a palm computer, a PC, an all-in-one machine, or other terminal devices with a communication function, and when there are multiple terminal devices, a distributed structure is formed among the terminal devices. The data source server 300 receives and stores the online traffic data sent by the terminal device 200 of the user, the data forwarding apparatus 100 copies the online traffic data according to the data control ratio parameter to obtain test data, and sends the test data to the test server 500, so that the test server 500 tests a specified program based on the test data. The test server 500 may also be composed of a plurality of servers, each server corresponds to a service node, and the designated program may be a big data processing program.
The structure of the test data forwarding control system in fig. 1 is only one example of the structure of the test data forwarding control system implementing the embodiment of the present application, and the embodiment of the present application is not limited to the structure described in fig. 1. For example, in some embodiments, the test data forwarding control system further includes a MySQL database, which may be a database server connected to the data forwarding apparatus 100 via the network 400, or a database integrated in the data forwarding apparatus 100.
In the embodiment of the application, a travel company is selected as a traffic source, the online real traffic data of the travel company is used as test data, and the specified program for testing can be a big data processing program, such as a vehicle driving state statistical program. It should be noted that the following description is only intended to illustrate the embodiments of the present application and not to limit the embodiments. In specific implementation, the technical scheme provided by the embodiment of the application can be flexibly applied according to actual needs.
Fig. 2 shows a schematic flowchart of a test data forwarding control method provided in an embodiment of the present application, please refer to fig. 2, where the method includes:
step S201, after establishing connection with the data source server according to the set interface parameters, acquiring online traffic data from the data source server.
The data source server is a server for receiving and storing online traffic data sent by the terminal equipment of the user.
Specifically, the interface parameters may be obtained according to received online traffic subscription instruction information input by the user. The connection with the data source server is established according to the set interface parameters, which may be receiving online traffic subscription instruction information input by a user through the data forwarding device 100, configuring data acquisition parameters and data transmission parameters according to the online traffic subscription instruction information, configuring the data source server 300 and the test server 500 according to the data acquisition parameters and the data transmission parameters, establishing communication between the data forwarding device 100 and the configuration data source server 300, and establishing communication with the test server 500 at the same time.
In some embodiments, the data source server 300 and the test server 500 are each a Kafka cluster comprising one or more servers. Real-time messaging is provided by Kafka clustering, providing persistence and high throughput of messaging.
Specifically, the user inputs online traffic subscription instruction information on a parameter setting interface of the data forwarding apparatus 100. The online flow subscription instruction information comprises data acquisition parameters and data transmission parameters. The data acquisition parameters may include: IP address, port, data type (Topic), etc. of local hosts (Localhost) in the online kafka cluster that constitutes the data origin server. In the present application, the data transmission parameters refer to parameters of a data transmission destination, and include an IP address, a port, a data type (Topic), and the like of a remote host (Localhost) in a test kafka cluster constituting the test server. Data communication between corresponding topics can be established according to the local address, the local port, the remote address and the remote port through the parameter setting. The setting of parameters such as IP addresses, ports, data types (Topic) and the like of the local host and the remote host corresponds to the data extraction of a specified program for testing and the online flow acquisition and storage of a production environment, so that an information channel is formed.
For example, the data source configuration of the data source server may set two kafka local machines: kafka1 and kafka2, wherein the "local address: local port" of kafka1 is "localhost 1: 9092"; the "local address: local port" of kafka2 is "localhost 2: 9092".
The kafka parameter of the data source server is configured on the program code and is realized by generating bean. Illustratively, the program code employed may be as follows.
Public class ProjectBean{
Public KafkaProperties kafka1Properties(){return newkafkaProperties()}
Public KafkaProperties kafka2Properties(){return newkafkaProperties()}
}
Parameter configuration is realized through a Bean mode, reusability of codes is fully improved, and the method plays a positive role in maintainability and maintainability of software.
Specifically, the terminal 200 may be a vehicle-mounted image capturing device for a travel company employee to operate a vehicle, and in a vehicle order journey, images of a driver position in the vehicle are captured at fixed time intervals, for example, 10 seconds, the images are used as online traffic data, a local host and a storage position of the data source server 300 are determined according to a set local address, namely a local port and topic, and the online traffic is sent to the local host and the storage position.
Illustratively, the "local address: local port" may be localhost1:9092, and the storage location may be a topic named picture created by parameter settings on the kafka local machine of the data origin server 300.
After establishing connection with the data source server 300 according to the set interface parameters, the data forwarding apparatus 100 acquires online traffic data from the data source server 300. It can be seen that the data source server 300 is a server that receives and stores online traffic data transmitted by the user's terminal 200.
And S202, copying the on-line flow data according to the data control proportion parameter to obtain test data.
Wherein, the data control proportion parameter is determined according to the operation parameter of the test server.
In one embodiment, the data control ratio parameter may be set by a user according to an operation parameter of the test server. For example, the online traffic subscription instruction information input by the user includes a data control proportion parameter, the data control proportion parameter is manually set according to the processing capacity of the big data processing program and the data scale of the online traffic, and the received online traffic data is copied according to the data control proportion parameter to obtain the test data.
Illustratively, the data control ratio parameter is a percentage value. For example, the data control ratio parameter may be selected to be 300%, and for data placed under topoic named picture of a local host with local address: local port being localhost1:9092, each data is forwarded 3 times when forwarding is selected in turn. The data control ratio parameter may be selected as a percentage value less than 1, for example, 30%, when data is forwarded, the on-line data is sent in a form of randomly sending 3 data out of 10 adjacent data in sequence.
In another embodiment, the data control proportion parameter may be dynamically changed, that is, an initial value of the data control proportion parameter may be set by a user, and the data control proportion parameter may be adjusted in real time according to the operation parameter of the test server during the test process.
For example, in some embodiments, the operation parameter of the test server is a load rate of the test server, which may be represented by a CPU usage rate of a remote host of the test server, and if the load rate of the test server is greater than a set highest load rate, the current data control proportion parameter may be decreased, and if the load rate of the test server is less than a set lowest load rate, the data control proportion parameter may be increased.
In other embodiments, the online traffic subscription instruction information includes an associated data item for determining a data control proportion parameter and a control threshold of the associated data item, and the data control proportion parameter dynamically changes according to the associated data item.
For example, the associated data item may be the CPU utilization of a remote host constituting the test server, the data control ratio parameter is automatically determined by a calculation formula related to the CPU utilization, and the data control ratio parameter is dynamically adjusted during data transmission in order to maintain the CPU utilization at a level around 70%. The data control ratio parameter may be a value determined by the following equation according to the set frequency:
in the formula, round () represents taking an integer of the calculation result.
Step S203, sending the test data to the test server, so that the test server tests the designated program based on the test data.
And sending test data obtained according to the online flow data received from the data source server to the test server so that the test server performs big data application program test based on the test data.
And forwarding the test data to the test server according to the online traffic data received by the data source server, wherein the main program code of the test data is shown in fig. 5.
Specifically, the number of records that are accessed once by a single thread, in order to prevent the amount of data that is accessed once from being too large and occupying too many memory resources, an upper limit is set for the records, for example, the upper limit may be 1000. Each time the fetch data is placed under topic named picture of the local host with localhost1:9092 as the "local address: local port" of the data source server 100. The data with the records quantity stored in the picture are sequentially forwarded to the corresponding topic of the remote host of the test server 500 defined by the remote address and the remote port specified by the parameters through the kafka message, and the status result of whether the forwarding is successful or not is monitored at the same time.
In some embodiments, the method further comprises: acquiring a busy and idle index and a control threshold of a target test server according to the online flow subscription instruction information;
monitoring whether the real-time data of the busy and idle index exceeds a control threshold value;
when the traffic exceeds the set transmission rate, caching the on-line traffic to obtain cached data and generating a transmission rate graph;
and when the data is not exceeded, controlling the playback of the buffered data according to the transmission rate map.
In an optional embodiment, after the on-line traffic data is copied according to the data control ratio parameter to obtain the test data, the method further includes:
if the operating parameters of the test server meet the set first conditions, caching the acquired partial or all online flow data to a cache database;
sending test data to a test server, comprising:
and if the running parameters of the test server meet the set second condition, reading the online flow data from the buffer database and sending the online flow data to the test server.
In some embodiments, the online traffic subscription instruction information includes an operation parameter, a control threshold, a traffic playback ratio, and a flow rate generation matching frequency, which can distinguish a busy-idle state of the test server. The operating parameter in which the busy-idle status of the test server can be distinguished may also be referred to as a busy-idle indicator. And acquiring a busy and idle index and a control threshold of the target test server according to the online flow subscription instruction information.
In an alternative embodiment, the operation parameter of the test server is the current time, the first condition is that the current time is within a set busy hour period, and the second condition is that the current time is within a set idle hour period.
For example, the online traffic subscription instruction information may include the settings of busy time period and idle time period, such as 8: 00-18: the time 00 may be set as a busy time period. The run time of the test server is 11: 00-13: 00, the test server can be judged to be in the busy hour period.
In an optional embodiment, the operation parameter of the test server is a load rate of the test server, the first condition is that the load rate of the test server is greater than a set highest load rate, and the second condition is that the load rate of the test server is less than a set lowest load rate.
Wherein, the load rate of the test server can also be represented by the CPU utilization rate of the remote host of the test server, the CPU utilization rate of the remote host is 50%, which represents that the load rate of the test server is 50%; the CPU usage of the remote host is 36%, representing a load rate of the test server of 36%.
Illustratively, the busy-idle indicator is the CPU utilization of the remote host constituting the test server, the control threshold of the indicator may be 70%, the flow rate generation matching frequency may be 1/min, and the flow playback ratio may be 200%.
When the CPU utilization rate value exceeds 70%, judging that the target test server is busy, and meeting a first condition; and when the CPU utilization rate value does not exceed 70%, judging that the target test server is idle, and meeting a second condition.
In an optional embodiment, the operation parameter of the test server is a length of a message queue of the test server, the message queue is used to store online traffic data that has been sent to the test server and has not been used to test the specified program, the first condition is that the length of the message queue is greater than a set longest length threshold, and the second condition is that the length of the message queue is less than a set shortest length threshold.
In some embodiments, the message backlog may also be monitored by calculating the length of the message queue of the test server, and a message backlog warning may be issued when the message backlog exceeds a preset threshold.
For example, the total amount of messages in the message queue of the test server may be calculated, the number of messages that have not been processed by the test server may be continuously monitored at certain time intervals, and when the number of messages that have not been processed exceeds a preset upper limit value, a message backlog warning may be triggered.
In an optional embodiment, the method further includes: when the acquired on-line traffic data is cached in a cache database, a cache rate graph is generated according to the cache rate of the on-line traffic data at each moment;
reading online traffic data from the cache database, comprising:
and reading the flow data on the line from the cache database according to the cache rate graph.
Specifically, when the target test server is busy, the kafka message is generated and forwarded to a cache queue of a remote host forming the target test server, and meanwhile, the cache task ID is generated and stored in the MySQL database.
The caching task ID may be a universally unique identifier UUID.
And generating a matching frequency according to the flow rate to calculate the average flow rate, so as to obtain the pressure measurement cache rate. And inserting each pressure measurement cache rate into the MySQL database and correlating the cache rate with the cache task ID to obtain a cache rate graph. The cache rate graph comprises a cache task ID and matching corresponding relation information of the pressure measurement cache rate calculated according to the flow rate generation matching frequency.
Table 1 is a statistical table of pressure measurement buffer rates for a 12 minute time period corresponding to the pressure measurement buffer rate diagram shown in fig. 3. The consumption online rate refers to an average transmission rate of online traffic data corresponding to the cache data corresponding to each cache task ID, and is also an average flow rate calculated according to the flow rate generation matching frequency.
TABLE 1
| Serial number | Time of day | Consuming online rates | Pressure measurement buffer rate |
| 1 | 18:51 | 1160 | 1160 |
| 2 | 18:52 | 1180 | 1180 |
| 3 | 18:53 | 1410 | 1410 |
| 4 | 18:54 | 1430 | 1430 |
| 5 | 18:55 | 1450 | 1450 |
| 6 | 18:56 | 1480 | 1480 |
| 7 | 18:57 | 1440 | 1440 |
| 8 | 18:58 | 1455 | 1455 |
| 9 | 18:59 | 1510 | 1510 |
| 10 | 18:60 | 1500 | 1500 |
| 11 | 18:61 | 1200 | 1200 |
| 12 | 18:62 | 1160 | 1160 |
And when the target test server is idle, controlling the playback of the cache data according to the cache rate graph.
Specifically, according to the cache flow rate of the cache task ID matched with the corresponding cache task ID, the flow control thread is started to play back according to the flow rate matching frequency, and flow playback rate control is carried out according to the flow playback proportion and the cache flow rate. The flow control thread has a certain waiting time interval after each data forwarding until the next forwarding, and the time interval is expressed by throughput control timing. And the flow control thread periodically updates the throughput control timing to realize the playback flow rate control.
Alternatively, the throughput control timing may be determined by the following equation:
illustratively, for the cached data shown in table 1, the flow rate of the cache task ID is matched according to the pressure-measured cache rate associated with the cache task ID, the matching frequency is generated according to the flow rate and is 1 time/minute, and playback of the cache flow is started. The flow playback rate is determined by the pressure measurement cache rate and the flow playback proportion of the cache task ID.
Table 2 is a traffic playback rate statistics table for a 12min period corresponding to the traffic playback rate diagram shown in fig. 4.
TABLE 2
Optionally, in some optional embodiments, an online flow desensitization process is further included.
And certain sensitive information is subjected to data deformation through a preset desensitization rule, so that the reliable protection of sensitive private data is realized. For example, in the case of client security data or some business sensitive data, the real data is modified and test use is provided according to preset conditions, and data desensitization is performed on personal information such as an identification number, a mobile phone number, a card number, a client number and the like.
Corresponding to the foregoing test data forwarding control method embodiment, an embodiment of the present application further provides a data forwarding apparatus 100, and as shown in fig. 5, the data forwarding apparatus 100 includes:
a data acquisition module 501, configured to acquire online traffic data from the data source server 300 after establishing a connection with the data source server 300 according to the set interface parameter, where the data source server 300 is a server that receives and stores the online traffic data sent by the user terminal 200;
the proportion control module 502 is used for copying the on-line flow data according to the data control proportion parameter to obtain test data; the data control ratio parameter is determined according to the operation parameter of the test server 500;
a data sending module 503, configured to send the test data to the test server 500, so that the test server 500 tests the specified program based on the test data.
In an alternative embodiment, the operation parameter of the test server 500 is a load rate of the test server, and the proportional control module 502 is further configured to:
if the load rate of the test server is greater than the set highest load rate, reducing the data control proportion parameter;
and if the load rate of the test server is less than the set lowest load rate, increasing the data control proportion parameter.
In an alternative embodiment, the data sending module 503 is further configured to:
if the operating parameters of the test server meet the set first conditions, caching the acquired partial or all online flow data to a cache database;
sending test data to a test server, comprising:
if the operating parameters of the test server meet the set second condition, the online traffic data is read from the cache database and sent to the test server 500.
Optionally, the operation parameter of the test server is the current time, the first condition is that the current time is within a set busy hour period, and the second condition is that the current time is within a set idle hour period.
Optionally, the operation parameter of the test server is a load rate of the test server, the first condition is that the load rate of the test server is greater than a set highest load rate, and the second condition is that the load rate of the test server is less than a set lowest load rate.
Optionally, the operation parameter of the test server is a length of a message queue of the test server, the message queue is used to store online traffic data that has been sent to the test server 500 and is not yet used to test the specified program, the first condition is that the length of the message queue is greater than a set longest length threshold, and the second condition is that the length of the message queue is less than a set shortest length threshold.
In an alternative embodiment, the data sending module 503 is further configured to: when the acquired on-line traffic data is cached in a cache database, a cache rate graph is generated according to the cache rate of the on-line traffic data at each moment;
the data sending module 503 is specifically configured to:
and reading the flow data on the line from the cache database according to the cache rate graph.
The method shown in fig. 2 is based on the same inventive concept, and the embodiment of the application also provides an electronic device. As shown in fig. 6, for convenience of explanation, only the parts related to the embodiments of the present application are shown, and details of the technology are not disclosed, and reference may be made to the parts of the embodiments of the method of the present application. The electronic equipment can be any equipment including a tablet computer, a vehicle-mounted computer, a PC and the like.
Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure; as shown in fig. 6, the electronic device 600 in the embodiment of the present application includes: a processor 101, a display 102, a memory 103, an input device 106, a bus 105, and a communication module 104; the processor 101, memory 103, input device 106, display 102 and communication module 104 are all connected by a bus 105, the bus 105 being used to transfer data between the processor 101, memory 103, display 102, communication module 104 and input device 106.
The memory 103 may be configured to store software programs and modules, such as program instructions/modules corresponding to the test data forwarding control method in the embodiment of the present application, and the processor 101 executes various functional applications and data processing of the electronic device 600 by running the software programs and modules stored in the memory 103, such as the test data forwarding control method provided in the embodiment of the present application. The memory 103 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program of at least one application, and the like; the storage data area may store data (such as a dialog data set) created according to the use of the electronic device 600, and the like. Further, the memory 103 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 101 is a control center of the electronic apparatus 600, connects various parts of the entire electronic apparatus 600 using the bus 105 and various interfaces and lines, and performs various functions of the electronic apparatus 600 and processes data by running or executing software programs and/or modules stored in the memory 103 and calling data stored in the memory 103. Alternatively, processor 101 may include one or more processing units, such as a CPU, GPU, digital processing unit, etc.
The input device 106 is mainly used for obtaining input operation of a user, and when the electronic devices are different, the input device 106 may be different. For example, when the electronic device is a computer, the input device 106 can be a mouse, a keyboard, or other input device; when the electronic device is a portable device such as a smart phone or a tablet computer, the input device 106 may be a touch screen. When the electronic device is a chat robot, the input device 106 can be a key, a microphone, or other input device.
It will be appreciated that the configuration shown in FIG. 6 is merely illustrative and that electronic device 600 may include more or fewer components than shown in FIG. 6 or have a different configuration than shown in FIG. 6. The components shown in fig. 6 may be implemented in hardware, software, or a combination thereof.
The embodiment of the application also provides a computer storage medium, wherein computer executable instructions are stored in the computer storage medium and used for realizing the test data forwarding control method in any embodiment of the application.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (10)
1. A test data forwarding control method is characterized by comprising the following steps:
after establishing connection with a data source server according to set interface parameters, acquiring online traffic data from the data source server, wherein the data source server is a server for receiving and storing the online traffic data sent by a user terminal device;
copying the on-line flow data according to the data control proportion parameter to obtain test data; the data control proportion parameter is determined according to the operation parameter of the test server;
and sending the test data to the test server so that the test server tests a specified program based on the test data.
2. The method of claim 1, wherein the operational parameter of the test server is a load rate of the test server, the method further comprising:
if the load rate of the test server is greater than the set highest load rate, reducing the data control proportion parameter;
and if the load rate of the test server is less than the set lowest load rate, increasing the data control proportion parameter.
3. The method of claim 1, wherein after the replicating the online traffic data according to the data control ratio parameter to obtain the test data, the method further comprises:
if the operating parameters of the test server meet a set first condition, caching the acquired partial or all online flow data to a cache database;
sending the test data to the test server, including:
and if the operating parameters of the test server meet a set second condition, reading online flow data from the cache database and sending the online flow data to the test server.
4. The method of claim 3, wherein the operating parameter of the test server is a current time, wherein the first condition is that the current time is within a set busy hour period, and wherein the second condition is that the current time is within a set idle hour period.
5. The method according to claim 3, wherein the operation parameter of the test server is a load rate of the test server, the first condition is that the load rate of the test server is greater than a set maximum load rate, and the second condition is that the load rate of the test server is less than a set minimum load rate.
6. The method of claim 3, wherein the operating parameter of the test server is a length of a message queue of the test server, the message queue is configured to store online traffic data that has been sent to the test server and that has not been used to test a specified program, the first condition is that the length of the message queue is greater than a set longest length threshold, and the second condition is that the length of the message queue is less than a set shortest length threshold.
7. The method of claim 3, further comprising: when the acquired on-line traffic data is cached in a cache database, a cache rate graph is generated according to the cache rate of the on-line traffic data at each moment;
reading online traffic data from the cache database, comprising:
and reading the flow data on the line from the cache database according to the cache rate graph.
8. A test data transfer control apparatus, comprising:
the data acquisition module is used for acquiring online flow data from a data source server after connection with the data source server is established according to set interface parameters, wherein the data source server is a server for receiving and storing the online flow data sent by the terminal equipment of a user;
the proportion control module is used for copying the on-line flow data according to the data control proportion parameters to obtain test data; the data control proportion parameter is determined according to the operation parameter of the test server;
and the data sending module is used for sending the test data to the test server so that the test server tests the specified program based on the test data.
9. A computer-readable storage medium having a computer program stored therein, the computer program characterized by: the computer program, when executed by a processor, implements the method of any of claims 1 to 7.
10. An electronic device comprising a memory and a processor, the memory having stored thereon a computer program operable on the processor, the computer program, when executed by the processor, causing the processor to carry out the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010535186.6A CN111770002B (en) | 2020-06-12 | 2020-06-12 | Test data forwarding control method and device, readable storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010535186.6A CN111770002B (en) | 2020-06-12 | 2020-06-12 | Test data forwarding control method and device, readable storage medium and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111770002A true CN111770002A (en) | 2020-10-13 |
| CN111770002B CN111770002B (en) | 2022-02-25 |
Family
ID=72720672
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010535186.6A Active CN111770002B (en) | 2020-06-12 | 2020-06-12 | Test data forwarding control method and device, readable storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111770002B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112187589A (en) * | 2020-11-10 | 2021-01-05 | 珠海市新德汇信息技术有限公司 | System testing method based on flow playback |
| CN113094272A (en) * | 2021-04-14 | 2021-07-09 | 北京京东振世信息技术有限公司 | Application testing method and device, electronic equipment and computer readable medium |
| CN113315677A (en) * | 2021-05-19 | 2021-08-27 | 湖南快乐阳光互动娱乐传媒有限公司 | Mirror flow based pressure measurement method and device, storage medium and equipment |
| CN114827033A (en) * | 2022-04-15 | 2022-07-29 | 咪咕文化科技有限公司 | Data flow control method, device, equipment and computer readable storage medium |
| CN115309597A (en) * | 2022-08-15 | 2022-11-08 | 北京星汉未来网络科技有限公司 | Server cluster testing method and device, storage medium and electronic equipment |
| CN115396346A (en) * | 2022-08-30 | 2022-11-25 | 北京知道创宇信息技术股份有限公司 | Simulation pressure test method, device and system and electronic equipment |
| CN114827033B (en) * | 2022-04-15 | 2024-04-19 | 咪咕文化科技有限公司 | Data flow control method, device, equipment and computer readable storage medium |
Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101919242A (en) * | 2007-12-05 | 2010-12-15 | 生命力有限公司 | Video compression system and method for compensating for bandwidth limitations of a communication channel |
| KR20110112495A (en) * | 2010-04-07 | 2011-10-13 | 주식회사 인아웃정보기술 | Medical analysis serve system for medical data |
| CN103580943A (en) * | 2012-08-03 | 2014-02-12 | 亿赞普(北京)科技有限公司 | Network software online testing method and system |
| CN105227952A (en) * | 2009-03-23 | 2016-01-06 | 索尼电脑娱乐美国公司 | For performing the computer-implemented method and system of video compression |
| CN105759784A (en) * | 2016-02-04 | 2016-07-13 | 北京宇航系统工程研究所 | Fault diagnosis method based on data envelopment analysis |
| CN107908548A (en) * | 2017-10-10 | 2018-04-13 | 深圳市买买提乐购金融服务有限公司 | A kind of method and apparatus for generating test case |
| CN107992398A (en) * | 2017-12-22 | 2018-05-04 | 宜人恒业科技发展（北京）有限公司 | The monitoring method and monitoring system of a kind of operation system |
| CN108376112A (en) * | 2018-02-09 | 2018-08-07 | 腾讯科技（深圳）有限公司 | Method for testing pressure, device and readable medium |
| CN108696399A (en) * | 2017-04-07 | 2018-10-23 | 腾讯科技（深圳）有限公司 | The test method and device of business service |
| CN108874655A (en) * | 2017-05-15 | 2018-11-23 | 华为技术有限公司 | A kind of method and device handling crowdsourcing test data |
| CN109669853A (en) * | 2018-10-23 | 2019-04-23 | 深圳壹账通智能科技有限公司 | Test report generation method and device, storage medium, electric terminal |
| CN109729131A (en) * | 2018-04-12 | 2019-05-07 | 平安普惠企业管理有限公司 | A kind of processing method of application request, device and router |
| CN109814910A (en) * | 2018-12-14 | 2019-05-28 | 深圳壹账通智能科技有限公司 | Automate gray scale dissemination method, device, computer system and storage medium |
| CN110162382A (en) * | 2019-04-09 | 2019-08-23 | 平安科技（深圳）有限公司 | Gray scale dissemination method, device, computer equipment and storage medium based on container |
| CN110266610A (en) * | 2019-05-30 | 2019-09-20 | 阿里巴巴集团控股有限公司 | Method for recognizing flux, device, electronic equipment |
| CN110362464A (en) * | 2018-04-11 | 2019-10-22 | 腾讯科技（深圳）有限公司 | Software analysis method and equipment |
| CN110825607A (en) * | 2019-11-13 | 2020-02-21 | 郑州西亚斯学院 | Big data-based computer network test system |
| CN110830384A (en) * | 2019-09-30 | 2020-02-21 | 浙江口碑网络技术有限公司 | Method, device and system for limiting service flow |
| CN110909004A (en) * | 2019-11-29 | 2020-03-24 | 南京领行科技股份有限公司 | Data verification method and equipment for database and table |
| CN111258897A (en) * | 2020-01-15 | 2020-06-09 | 网银在线（北京）科技有限公司 | Service platform testing method, device and system |
-
2020
- 2020-06-12 CN CN202010535186.6A patent/CN111770002B/en active Active
Patent Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101919242A (en) * | 2007-12-05 | 2010-12-15 | 生命力有限公司 | Video compression system and method for compensating for bandwidth limitations of a communication channel |
| CN105227952A (en) * | 2009-03-23 | 2016-01-06 | 索尼电脑娱乐美国公司 | For performing the computer-implemented method and system of video compression |
| KR20110112495A (en) * | 2010-04-07 | 2011-10-13 | 주식회사 인아웃정보기술 | Medical analysis serve system for medical data |
| CN103580943A (en) * | 2012-08-03 | 2014-02-12 | 亿赞普(北京)科技有限公司 | Network software online testing method and system |
| CN105759784A (en) * | 2016-02-04 | 2016-07-13 | 北京宇航系统工程研究所 | Fault diagnosis method based on data envelopment analysis |
| CN108696399A (en) * | 2017-04-07 | 2018-10-23 | 腾讯科技（深圳）有限公司 | The test method and device of business service |
| CN108874655A (en) * | 2017-05-15 | 2018-11-23 | 华为技术有限公司 | A kind of method and device handling crowdsourcing test data |
| CN107908548A (en) * | 2017-10-10 | 2018-04-13 | 深圳市买买提乐购金融服务有限公司 | A kind of method and apparatus for generating test case |
| CN107992398A (en) * | 2017-12-22 | 2018-05-04 | 宜人恒业科技发展（北京）有限公司 | The monitoring method and monitoring system of a kind of operation system |
| CN108376112A (en) * | 2018-02-09 | 2018-08-07 | 腾讯科技（深圳）有限公司 | Method for testing pressure, device and readable medium |
| CN110362464A (en) * | 2018-04-11 | 2019-10-22 | 腾讯科技（深圳）有限公司 | Software analysis method and equipment |
| CN109729131A (en) * | 2018-04-12 | 2019-05-07 | 平安普惠企业管理有限公司 | A kind of processing method of application request, device and router |
| CN109669853A (en) * | 2018-10-23 | 2019-04-23 | 深圳壹账通智能科技有限公司 | Test report generation method and device, storage medium, electric terminal |
| CN109814910A (en) * | 2018-12-14 | 2019-05-28 | 深圳壹账通智能科技有限公司 | Automate gray scale dissemination method, device, computer system and storage medium |
| CN110162382A (en) * | 2019-04-09 | 2019-08-23 | 平安科技（深圳）有限公司 | Gray scale dissemination method, device, computer equipment and storage medium based on container |
| CN110266610A (en) * | 2019-05-30 | 2019-09-20 | 阿里巴巴集团控股有限公司 | Method for recognizing flux, device, electronic equipment |
| CN110830384A (en) * | 2019-09-30 | 2020-02-21 | 浙江口碑网络技术有限公司 | Method, device and system for limiting service flow |
| CN110825607A (en) * | 2019-11-13 | 2020-02-21 | 郑州西亚斯学院 | Big data-based computer network test system |
| CN110909004A (en) * | 2019-11-29 | 2020-03-24 | 南京领行科技股份有限公司 | Data verification method and equipment for database and table |
| CN111258897A (en) * | 2020-01-15 | 2020-06-09 | 网银在线（北京）科技有限公司 | Service platform testing method, device and system |
Non-Patent Citations (2)
| Title |
|---|
| HONGHUI LI等: "Research on Cloud Performance Testing Model", 《2019 IEEE 19TH INTERNATIONAL SYMPOSIUM ON HIGH ASSURANCE SYSTEMS ENGINEERING (HASE)》 * |
| 朱星宇等: "基于DPDK的流量测试平台设计", 《微型电脑应用》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112187589A (en) * | 2020-11-10 | 2021-01-05 | 珠海市新德汇信息技术有限公司 | System testing method based on flow playback |
| CN112187589B (en) * | 2020-11-10 | 2022-08-12 | 珠海市新德汇信息技术有限公司 | System testing method based on flow playback |
| CN113094272A (en) * | 2021-04-14 | 2021-07-09 | 北京京东振世信息技术有限公司 | Application testing method and device, electronic equipment and computer readable medium |
| CN113094272B (en) * | 2021-04-14 | 2023-11-03 | 北京京东振世信息技术有限公司 | Application testing method, device, electronic equipment and computer readable medium |
| CN113315677A (en) * | 2021-05-19 | 2021-08-27 | 湖南快乐阳光互动娱乐传媒有限公司 | Mirror flow based pressure measurement method and device, storage medium and equipment |
| CN113315677B (en) * | 2021-05-19 | 2023-03-24 | 湖南快乐阳光互动娱乐传媒有限公司 | Mirror flow based pressure measurement method and device, storage medium and equipment |
| CN114827033A (en) * | 2022-04-15 | 2022-07-29 | 咪咕文化科技有限公司 | Data flow control method, device, equipment and computer readable storage medium |
| CN114827033B (en) * | 2022-04-15 | 2024-04-19 | 咪咕文化科技有限公司 | Data flow control method, device, equipment and computer readable storage medium |
| CN115309597A (en) * | 2022-08-15 | 2022-11-08 | 北京星汉未来网络科技有限公司 | Server cluster testing method and device, storage medium and electronic equipment |
| CN115396346A (en) * | 2022-08-30 | 2022-11-25 | 北京知道创宇信息技术股份有限公司 | Simulation pressure test method, device and system and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111770002B (en) | 2022-02-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111770002B (en) | Test data forwarding control method and device, readable storage medium and electronic equipment | |
| US10467105B2 (en) | Chained replication techniques for large-scale data streams | |
| US9787706B1 (en) | Modular architecture for analysis database | |
| US10237295B2 (en) | Automated event ID field analysis on heterogeneous logs | |
| US9471585B1 (en) | Decentralized de-duplication techniques for largescale data streams | |
| CN108228322B (en) | Distributed link tracking and analyzing method, server and global scheduler | |
| CN112737800A (en) | Service node fault positioning method, call chain generation method and server | |
| CN112313627B (en) | Mapping mechanism of event to serverless function workflow instance | |
| CN111586126A (en) | Method, device and equipment for pre-downloading small program and storage medium | |
| US20170085653A1 (en) | Method, device and system for message distribution | |
| CN111694644A (en) | Message processing method and device based on robot operating system and computer equipment | |
| CN111880948A (en) | Data refreshing method and device, electronic equipment and computer readable storage medium | |
| CN112286930A (en) | Method, device, storage medium and electronic equipment for resource sharing of redis business side | |
| US9378230B1 (en) | Ensuring availability of data in a set being uncorrelated over time | |
| CN103778218A (en) | Cloud computation-based standard information consistency early warning system and method | |
| CN113421109A (en) | Service checking method, device, electronic equipment and storage medium | |
| CN110990213A (en) | Method and device for monitoring user logs in cluster environment in real time | |
| CN115270110B (en) | Account inspection method and device, electronic equipment and storage medium | |
| CN112783886B (en) | Cache cleaning method, device, computer equipment and storage medium | |
| CN111966993B (en) | Equipment identification code identification and generation algorithm test method, device, equipment and medium | |
| CN114205412A (en) | Information pushing method and device, server and storage medium | |
| CN116932621A (en) | Data acquisition method, device, storage medium and terminal | |
| CN116401150A (en) | Method and device for testing real-time operating system, computer equipment and storage medium | |
| CN113765693A (en) | Demand testing method, device, server and storage medium | |
| CN114969139A (en) | Big data operation and maintenance management method, system, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |