CN110752968B - Performance benchmark test method and device, electronic equipment and storage medium - Google Patents

Performance benchmark test method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN110752968B
CN110752968B CN201910987360.8A CN201910987360A CN110752968B CN 110752968 B CN110752968 B CN 110752968B CN 201910987360 A CN201910987360 A CN 201910987360A CN 110752968 B CN110752968 B CN 110752968B
Authority
CN
China
Prior art keywords
test
flow
modified
test flow
traffic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910987360.8A
Other languages
Chinese (zh)
Other versions
CN110752968A (en
Inventor
吴玉
王伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201910987360.8A priority Critical patent/CN110752968B/en
Publication of CN110752968A publication Critical patent/CN110752968A/en
Application granted granted Critical
Publication of CN110752968B publication Critical patent/CN110752968B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/14Network analysis or design
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0876Network utilisation, e.g. volume of load or congestion level
    • H04L43/0894Packet rate
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

The application discloses a performance benchmark test method and device, electronic equipment and a storage medium, and relates to the field of tests. The specific implementation scheme is as follows: calling a flow modification module of the server, and respectively modifying the first test flow and the second test flow by adopting the flow modification module; the flow modification module is pre-established according to flow modification requirements; and sending the modified first test flow to the tested system, and sending the modified second test flow to the reference system. The embodiment of the application can flexibly and conveniently modify the test flow and improve the efficiency of performance benchmark test.

Description

Performance benchmark test method and device, electronic equipment and storage medium
Technical Field
The application relates to the technical field of computers, in particular to the field of testing.
Background
Benchmark-based performance testing (also called performance benchmark testing) refers to testing that a proper testing tool is selected to carry out quantitative and comparative testing on one or more performance indexes of a tested system through designing a reasonable testing scheme. The performance benchmark test is an important test mode which is widely applied in the service test.
The existing performance benchmark test mode uses the same pressure test tool and the same flow word list to generate the same test flow, and the same test flow is adopted to respectively test a tested system and a benchmark system. And then, acquiring and comparing the performance data of the tested system and the performance data of the reference system, thereby obtaining various performance indexes of the tested system. The flow vocabulary can only be prepared in advance and cannot be modified in the testing process in real time, so that the flow modification is not convenient enough, and the testing efficiency is low.
Disclosure of Invention
In a first aspect, an embodiment of the present application provides a performance benchmark testing method, including:
calling a flow modification module of the page server, and modifying the first test flow and the second test flow respectively by adopting the flow modification module; the flow modification module is pre-established according to flow modification requirements;
and sending the modified first test flow to the tested system, and sending the modified second test flow to the reference system.
By calling the pre-established flow modification module to modify the test flow, the embodiment of the application can flexibly and conveniently modify the test flow and improve the efficiency of performance benchmark test.
In one embodiment, before the invoking the traffic modification module of the server, the method further includes:
receiving an initial test flow;
and calling a mirror image module of the server, and copying the initial test flow by adopting the mirror image module to obtain the first test flow and the second test flow.
According to the method and the system, the mirror image module of the server is adopted to copy the initial test flow from the pressure test tool, so that the parallel test of the tested system and the reference system can be realized by only one pressure test tool, and the test efficiency is improved; and the test flow of the tested system and the test flow of the reference system can be ensured to be completely the same at the same time, and the confidence coefficient of the test result is improved.
In one embodiment, the mirror module copies the initial test traffic to obtain the second test traffic and at least one of the first test traffic;
the sending the modified first test traffic to the system under test includes: and respectively sending the modified at least one first test flow to each tested system.
The embodiment of the application can synchronously realize performance benchmark test of a plurality of tested systems, and improve the test efficiency.
In one embodiment, the method further comprises:
acquiring first performance data generated when the modified first test flow is processed by the tested system, and acquiring second performance data generated when the modified second test flow is processed by the reference system;
and comparing the first performance data with the second performance data to obtain a performance benchmark test result of the tested system.
The embodiment of the application can compare and analyze the performance data of the tested system and the performance data of the reference system, and automatically obtain the performance reference test result of the tested system.
In a second aspect, an embodiment of the present application provides a performance benchmark testing apparatus, including:
the first calling unit is used for calling a flow modification module of the server and modifying the first test flow and the second test flow by adopting the flow modification module respectively; the flow modification module is pre-established according to flow modification requirements;
and the sending unit is used for sending the modified first test flow to the tested system and sending the modified second test flow to the reference system.
In one embodiment, the method further comprises:
a receiving unit, configured to receive an initial test flow;
and the second calling unit is used for calling a mirror image module of the server, and copying the initial test flow by adopting the mirror image module to obtain the first test flow and the second test flow.
In one embodiment, the mirror module copies the initial test traffic to obtain the second test traffic and at least one of the first test traffic;
and the sending unit is used for sending the modified at least one first test flow to each tested system respectively.
In one embodiment, the method further comprises:
an obtaining unit, configured to obtain first performance data generated when the modified first test flow is processed by the system under test, and obtain second performance data generated when the modified second test flow is processed by the reference system;
and the comparison unit is used for comparing the first performance data with the second performance data to obtain a performance benchmark test result of the tested system.
In a third aspect, an embodiment of the present application provides an electronic device, including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of the first aspects.
In a fourth aspect, embodiments of the present application provide a non-transitory computer-readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of the first aspects.
One embodiment in the above application has the following advantages or benefits: according to the embodiment of the application, the testing flow is modified by calling the pre-established flow modification module, the testing flow can be flexibly and conveniently modified, and the efficiency of performance benchmark testing is improved.
Other effects of the above-described alternative will be described below with reference to specific embodiments.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
FIG. 1 is a first flowchart of an implementation of a performance benchmark testing method according to the present application;
FIG. 2 is a flowchart of a second implementation of a performance benchmark testing method according to the present application;
FIG. 3 is a first schematic diagram illustrating the flow direction between a pressure testing tool and a tested system and a benchmark system according to the performance benchmark testing method of the present application;
FIG. 4 is a schematic diagram of a flow direction between a pressure test tool and a tested system and a reference system according to a performance reference test method of the present application;
FIG. 5 is a schematic diagram of an implementation architecture of a performance benchmark testing method according to the present application;
FIG. 6 is a first schematic diagram of a performance benchmark device according to the present application;
FIG. 7 is a second schematic structural diagram of a performance benchmark device according to the present application;
FIG. 8 is a block diagram of an electronic device for implementing the performance benchmarking method of embodiments of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
The embodiment of the present application provides a performance benchmark testing method, and fig. 1 is a first flow chart of an implementation of the performance benchmark testing method according to the present application, including:
step S101: calling a flow modification module of the server, and respectively modifying the first test flow and the second test flow by adopting the flow modification module; the flow modification module is pre-established according to the flow modification requirement;
step S102: and sending the modified first test flow to the tested system, and sending the modified second test flow to the reference system.
In one embodiment, the Server may be a Web Server (Web Server), and specifically may be a Nginx Server.
In one embodiment, the traffic modification module may be a scripting tool written using the LUA scripting language for implementing traffic modification. Specifically, the traffic modification module acquires a value corresponding to a field to be modified from a traffic vocabulary according to a traffic modification requirement, converts the acquired value into required data according to a preset conversion rule, and rewrites the converted data into the corresponding field, thereby implementing modification of the traffic vocabulary. Because the flow word list is used for generating the test flow, the modification of the test flow can be realized by modifying the flow word list.
In an embodiment, the first test flow and the second test flow before modification are identical, and the flow modification module performs the same modification on the first test flow and the second test flow respectively, so that the first test flow and the second test flow after modification are also identical. Therefore, the test flow of all systems at the same time can be ensured to be the same, and the test result error caused by flow difference is eliminated.
An embodiment of the present application provides another performance benchmark testing method, and fig. 2 is a flowchart illustrating an implementation of the performance benchmark testing method according to the present application, where the method includes:
step S201: receiving an initial test flow;
step S202: and calling a mirror image module of the server, and copying the initial test flow by adopting the mirror image module to obtain a first test flow and a second test flow.
Step S101: calling a flow modification module of the server, and respectively modifying the first test flow and the second test flow by adopting the flow modification module; the flow modification module is pre-established according to the flow modification requirement;
step S102: and sending the modified first test flow to the tested system, and sending the modified second test flow to the reference system.
In one embodiment, the mirror module of the server may adopt an ngx _ http _ mirror _ module built in the nginnx server, and the ngx _ http _ mirror _ module may be capable of copying the initial test traffic from the pressure testing tool. After replication, two or more test flows, all of which are identical, can be obtained along with the initial test flow. For clear distinction, in the embodiments of the present application, the test traffic for testing the system under test is referred to as a first test traffic, and the test traffic for testing the reference system is referred to as a second test traffic. The foregoing nomenclature is used for clarity of description only and does not constitute a limitation on the embodiments of the present application. In the embodiment of the present application, the pressure test tool may be simply referred to as a pressure test tool, and the test flow may be referred to as a pressure test flow.
In addition, other web servers may also be used in the embodiments of the present application. The embodiment of the application can also define the mirror image module by user, and the copy function of the initial test flow is realized by adopting the defined mirror image module.
In an implementation manner, the embodiment of the application may send the modified first test traffic or the modified second test traffic by using a routing function of the web server.
The method and the device for testing the performance of the multiple tested systems can perform performance benchmark testing on the multiple tested systems, and in one implementation mode, a mirror image module copies initial test flow to obtain second test flow and at least one first test flow; each first test flow is used for pressure testing of one tested system, and the second test flow is used for pressure testing of the reference system. Fig. 3 is a first schematic diagram illustrating a flow direction between a pressure testing tool and a tested system and a benchmark system in a performance benchmark testing method according to the present application. As shown in fig. 3, the pressure testing tool generates an initial testing flow, and the mirror module copies the initial testing flow to obtain a plurality of first testing flows and a second testing flow. Among the test traffic obtained after the replication, one is original initial test traffic, and the rest is mirror traffic after the replication. And then, respectively sending the first test flow to each tested system, and sending the second test flow to the reference system.
In another embodiment, the mirror module copies the initial test traffic to obtain a second test traffic and at least one first test traffic; the second test flow and the first test flow are modified by the flow modification module, each modified first test flow is used for pressure testing of one tested system, and the modified second test flow is used for pressure testing of the reference system. Fig. 4 is a schematic diagram of a flow direction between a pressure test tool and a tested system and a flow direction between the pressure test tool and a reference system in a performance reference test method according to the present application. As shown in fig. 4, the pressure testing tool generates an initial testing flow, and the mirror module copies the initial testing flow to obtain a plurality of first testing flows and a second testing flow. Among the test traffic obtained after the replication, one is original initial test traffic, and the rest is mirror traffic after the replication. And then, modifying each first test flow and each second test flow by adopting a flow modification module, respectively sending each modified first test flow to each tested system, and sending the modified second test flow to the reference system.
Fig. 5 is a schematic diagram of an implementation architecture of a performance benchmark testing method according to the present application. Fig. 5 illustrates an example of a system under test, and as shown in fig. 5, the pressure testing tool generates an initial testing flow, and the mirror module copies the initial testing flow to obtain a first testing flow and a second testing flow. And then, modifying the first test flow and the second test flow respectively by adopting a flow modification module, sending the modified first test flow to a tested system, and sending the modified second test flow to a reference system. And collecting first performance data generated when the tested system processes the modified first test flow and second performance data generated when the reference system processes the modified second test flow, and analyzing and comparing the first performance data and the second performance data to obtain a performance reference test result of the tested system.
The embodiment of the application adopts the mirror image module to copy the initial test flow, thereby realizing that one pressure measurement flow is adopted to simultaneously pressure-measure a plurality of tested systems, avoiding the problem that a plurality of pressure measurement tools need to be synchronously started when multi-path parallel pressure measurement is carried out, ensuring that the pressure measurement flow of all the systems at the same moment is the same, and eliminating the pressure measurement result error caused by flow difference.
There is a very common test scenario in the benchmark test of performance, that is, service logic is upgraded by upgrading system request parameters of a service system, and particularly, for a large system which controls the service logic by the request parameters, the test scenario is more common. In order to test the performance difference between the modified tested system and the reference system, a comparison test needs to be performed, but at this time, the parameters supported by the modified tested system are different from those of the reference system, so that a single flow mirroring function is not sufficient, and the test flow needs to be modified. The embodiment of the application designs the flow modification module, and when the flow parameters need to be modified, the flow modification module is called to modify the first test flow and the second test flow. In one embodiment, the user can configure the required flow modification rule by himself, so that all the test flows modified by the flow modification module can modify the corresponding parameters according to the requirements configured by the user, and finally the test flows are routed to the test environment.
Compared with the existing method for directly testing the test environment through the pressure testing tool, the design of the embodiment of the application can not only perfect the flow mirroring function, but also avoid modifying the pressure testing word list before the pressure testing. And for the test flow which cannot be simulated by using the flow word table, modifying by using a flow modifying module. Therefore, the embodiment of the application enriches the types of the test flow, makes the performance benchmark test more convenient, and can also improve the accuracy of the performance benchmark test.
The embodiment of the present application further provides a performance benchmark, fig. 6 is a schematic structural diagram of the performance benchmark testing device according to the present application, and the performance benchmark testing device 600 shown in fig. 6 includes:
the first calling unit 601 is configured to call a flow modification module of the server, and modify the first test flow and the second test flow by using the flow modification module respectively; the flow modification module is pre-established according to the flow modification requirement;
a sending unit 602, configured to send the modified first test traffic to the system under test, and send the modified second test traffic to the reference system.
The embodiment of the present application further provides another performance benchmark testing device, and fig. 7 is a schematic structural diagram of the performance benchmark testing device according to the present application, which includes:
a first calling unit 601, a sending unit 602, a receiving unit 703 and a second calling unit 704; the first calling unit 601 and the sending unit 602 have the same functions as the corresponding units in the above embodiments, and are not described again.
A receiving unit 703, configured to receive an initial test traffic;
and a second calling unit 704, configured to call a mirror module of the server, and copy the initial test traffic by using the mirror module to obtain the first test traffic and the second test traffic.
In one embodiment, a mirror module copies an initial test flow to obtain a second test flow and at least one first test flow;
a sending unit 602, configured to send the modified at least one first test traffic to each tested system respectively.
As shown in fig. 7, in one embodiment, the apparatus further comprises:
an obtaining unit 705, configured to obtain first performance data generated when the modified first test flow is processed by the tested system, and obtain second performance data generated when the modified second test flow is processed by the reference system;
the comparing unit 706 is configured to compare the first performance data with the second performance data to obtain a performance benchmark test result of the system under test.
The functions of the modules in the devices in the embodiments of the present application can be referred to the corresponding descriptions in the above methods, and are not described herein again.
According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.
Fig. 8 is a block diagram of an electronic device according to the performance benchmark testing method of the embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 8, the electronic apparatus includes: one or more processors 801, memory 802, and interfaces for connecting the various components, including a high speed interface and a low speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display Graphical information for a Graphical User Interface (GUI) on an external input/output device, such as a display device coupled to the Interface. In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). Fig. 8 illustrates an example of a processor 801.
The memory 802 is a non-transitory computer readable storage medium as provided herein. Wherein the memory stores instructions executable by at least one processor to cause the at least one processor to perform the performance benchmarking method provided herein. The non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to perform the performance benchmarking method provided herein.
The memory 802, as a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules (e.g., the first invoking unit 601 and the sending unit 602 shown in fig. 6) corresponding to the performance benchmark testing method in the embodiments of the present application. The processor 801 executes various functional applications of the server and data processing by running non-transitory software programs, instructions, and modules stored in the memory 802, that is, implements the performance benchmarking method in the above-described method embodiments.
The memory 802 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created from use of the electronic device for performance benchmark testing, and the like. Further, the memory 802 may include high speed random access memory and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, memory 802 optionally includes memory located remotely from processor 801, which may be connected to the performance benchmarking electronics via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the performance benchmark test method may further include: an input device 803 and an output device 804. The processor 801, the memory 802, the input device 803, and the output device 804 may be connected by a bus or other means, and are exemplified by a bus in fig. 8.
The input device 803 may receive input numeric or character information and generate key signal inputs related to user settings and function controls of the electronic device being benchmarked, such as an input device like a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointer, one or more mouse buttons, a track ball, a joystick, etc. The output devices 804 may include a display device, auxiliary lighting devices (e.g., LEDs), and haptic feedback devices (e.g., vibrating motors), among others. The Display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) Display, and a plasma Display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, Integrated circuitry, Application Specific Integrated Circuits (ASICs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (Cathode Ray Tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area networks (wans), and the internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
According to the technical scheme of the embodiment of the application, the flow modification module in the webpage server is adopted to modify the test flow, so that the modification control on the test flow is more flexible and convenient, and a large amount of time for modifying the test flow before the test can be saved. In addition, the mirror image module in the webpage server is adopted to copy the initial test traffic from the pressure test tool, so that the performance data of the tested system and the reference system can be produced and evaluated only by sending the test traffic from one side by the pressure test tool, and a test conclusion can be given. Compared with the mode that the tested system and the reference system are deployed at the same time and the same pressure testing tool is used for parallel testing in the prior art, the testing time can be shortened by half and the efficiency can be improved by 50 percent; especially when a plurality of (N) tested systems need to be tested simultaneously, the efficiency can be improved by (N-1)/N. In addition, the embodiment of the application adopts a flow mirroring mode, so that the test flows of the tested system and the reference system can be completely the same at the same time, and the problem of confidence degree of the pressure test result caused by different test flows is solved.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, and the present invention is not limited thereto as long as the desired results of the technical solutions disclosed in the present application can be achieved.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims (8)

1. A performance benchmark test method is characterized by comprising the following steps:
calling a flow modification module of a webpage server, and modifying a first test flow and a second test flow respectively by adopting the flow modification module, wherein the first test flow and the second test flow are obtained by copying an initial test flow, the modification is to convert a field needing to be modified in a flow word table into required data according to a preset conversion rule according to a flow modification requirement, the flow word table is used for generating the test flow, and the modified first test flow is the same as the modified second test flow; the flow modification module is pre-established according to flow modification requirements;
sending the modified first test flow to a tested system, and sending the modified second test flow to a reference system;
acquiring first performance data generated when the modified first test flow is processed by the tested system, and acquiring second performance data generated when the modified second test flow is processed by the reference system;
and comparing the first performance data with the second performance data to obtain a performance benchmark test result of the tested system.
2. The method of claim 1, wherein before invoking the traffic modification module of the web server, further comprising:
receiving an initial test flow from a pressure test tool;
and calling a mirror image module of the webpage server, and copying the initial test flow by adopting the mirror image module to obtain the first test flow and the second test flow.
3. The method according to claim 2, wherein the mirror module is adopted to copy the initial test traffic to obtain the second test traffic and at least one first test traffic, wherein the second test traffic is the same as all the first test traffic;
the sending the modified first test traffic to the system under test includes: and respectively sending the modified at least one first test flow to the corresponding tested systems.
4. A performance benchmark device, comprising:
the first calling unit is used for calling a flow modification module of the webpage server and modifying a first test flow and a second test flow respectively by adopting the flow modification module, wherein the first test flow and the second test flow are obtained by copying an initial test flow, the modification is to convert a field needing to be modified in a flow word table into required data according to a preset conversion rule according to a flow modification requirement, the flow word table is used for generating the test flow, and the modified first test flow is the same as the modified second test flow; the flow modification module is pre-established according to flow modification requirements;
the sending unit is used for sending the modified first test flow to a tested system and sending the modified second test flow to a reference system;
an obtaining unit, configured to obtain first performance data generated when the modified first test flow is processed by the system under test, and obtain second performance data generated when the modified second test flow is processed by the reference system;
and the comparison unit is used for comparing the first performance data with the second performance data to obtain a performance benchmark test result of the tested system.
5. The apparatus of claim 4, further comprising:
a receiving unit for receiving an initial test flow from a pressure test tool;
and the second calling unit is used for calling a mirror image module of the webpage server, and copying the initial test flow by adopting the mirror image module to obtain the first test flow and the second test flow.
6. The apparatus according to claim 5, wherein the mirror module is adopted to copy the initial test traffic to obtain the second test traffic and at least one of the first test traffic, wherein the second test traffic is the same as all the first test traffic;
and the sending unit is used for sending the modified at least one first test flow to the corresponding tested systems respectively.
7. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-3.
8. A non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 1-3.
CN201910987360.8A 2019-10-16 2019-10-16 Performance benchmark test method and device, electronic equipment and storage medium Active CN110752968B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910987360.8A CN110752968B (en) 2019-10-16 2019-10-16 Performance benchmark test method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910987360.8A CN110752968B (en) 2019-10-16 2019-10-16 Performance benchmark test method and device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110752968A CN110752968A (en) 2020-02-04
CN110752968B true CN110752968B (en) 2021-12-07

Family

ID=69278791

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910987360.8A Active CN110752968B (en) 2019-10-16 2019-10-16 Performance benchmark test method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110752968B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111311584B (en) * 2020-02-24 2023-06-23 北京百度网讯科技有限公司 Video quality evaluation method and device, electronic equipment and readable medium
CN113315677B (en) * 2021-05-19 2023-03-24 湖南快乐阳光互动娱乐传媒有限公司 Mirror flow based pressure measurement method and device, storage medium and equipment
CN115085772B (en) * 2022-08-24 2022-12-09 北京紫光青藤微系统有限公司 Test method, processor, NFC device, electronic apparatus, and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103780449A (en) * 2012-10-23 2014-05-07 百度在线网络技术(北京)有限公司 Flow multiplexing method based on cache storage and device thereof
CN107566206A (en) * 2017-08-04 2018-01-09 华为技术有限公司 A kind of flow-measuring method, equipment and system
CN108694104A (en) * 2017-04-12 2018-10-23 北京京东尚科信息技术有限公司 A kind of interface function contrast test method, apparatus, electronic equipment and storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9225601B2 (en) * 2013-06-17 2015-12-29 The Board Of Trustees Of The University Of Illinois Network-wide verification of invariants
CN110175118A (en) * 2019-05-08 2019-08-27 重庆八戒电子商务有限公司 Software performance testing method and device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103780449A (en) * 2012-10-23 2014-05-07 百度在线网络技术(北京)有限公司 Flow multiplexing method based on cache storage and device thereof
CN108694104A (en) * 2017-04-12 2018-10-23 北京京东尚科信息技术有限公司 A kind of interface function contrast test method, apparatus, electronic equipment and storage medium
CN107566206A (en) * 2017-08-04 2018-01-09 华为技术有限公司 A kind of flow-measuring method, equipment and system

Also Published As

Publication number Publication date
CN110752968A (en) 2020-02-04

Similar Documents

Publication Publication Date Title
CN110765024B (en) Simulation test method, simulation test device, electronic equipment and computer readable storage medium
US9009183B2 (en) Transformation of a system change set from machine-consumable form to a form that is readily consumable by a human
US10175977B2 (en) User profile based code review
CN110752968B (en) Performance benchmark test method and device, electronic equipment and storage medium
CN111080243A (en) Service processing method, device, system, electronic equipment and storage medium
CN112527748B (en) Method, device, equipment and storage medium for analyzing user operation behavior
CN111984476B (en) Test method and device
US9946630B2 (en) Efficiently debugging software code
CN111752843A (en) Method, device, electronic equipment and readable storage medium for determining influence surface
JP2021068413A (en) Rendering method, apparatus, electronic device, storage medium, and program
CN111949272A (en) Compilation optimization method and device for hosted application, electronic device and readable storage medium
CN112506854A (en) Method, device, equipment and medium for storing page template file and generating page
KR102451678B1 (en) Method and apparatus for data processing based on smart contract, device and storage medium
WO2023169193A1 (en) Method and device for generating smart contract
CN111796851A (en) Client base library updating method and device, electronic equipment and storage medium
JP7135142B2 (en) Code reuse processing method, device, electronic device, storage medium and computer program product
US20190258462A1 (en) Batch script decomposer
US20230393836A1 (en) Method and apparatus for updating cloud platform
CN112069071B (en) Method and device for determining program suitability
CN111639116B (en) Data access connection session protection method and device
CN114721686A (en) Configuration data updating method and device, electronic equipment and storage medium
CN113296772A (en) Page configuration method and device, computer equipment and readable storage medium
CN111857656A (en) Data processing method and device, electronic equipment and storage medium
CN108170557B (en) Method and apparatus for outputting information
US20160103721A1 (en) Correlating multiple disjoint events via an operation identifier

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant