CN110727573A - Performance test method, device, equipment and medium of application programming interface - Google Patents
Performance test method, device, equipment and medium of application programming interface Download PDFInfo
- Publication number
- CN110727573A CN110727573A CN201810779870.1A CN201810779870A CN110727573A CN 110727573 A CN110727573 A CN 110727573A CN 201810779870 A CN201810779870 A CN 201810779870A CN 110727573 A CN110727573 A CN 110727573A
- Authority
- CN
- China
- Prior art keywords
- api
- test
- access requests
- hosts
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3664—Environments for testing or debugging software
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Abstract
The embodiment of the invention discloses a performance testing method, a device, equipment and a medium of an application programming interface, which are used for testing the performance of an API (application programming interface) facing massive concurrent access requests. The API performance testing method comprises the following steps: receiving an API test request, wherein the test request comprises a corresponding relation between an API identification and the number of access requests required by the test; and indicating a plurality of test hosts to respectively send access requests to the API corresponding to the API identification at a preset time, wherein the total amount of the access requests sent by the plurality of test hosts is greater than or equal to the number of the access requests required by the test.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a method, a device, equipment and a medium for testing the performance of an Application Programming Interface (API).
Background
Functions of an Internet Technology (IT) system are released to users in the form of Application Programming Interfaces (APIs), and these open API services have become important ways for enterprises to open their own businesses and to merge with partners and users.
When an enterprise opens the APIs, it is necessary to ensure that the APIs can correctly respond to users within an acceptable time when facing trillion user requests per second, i.e. can better bear a large amount of service requests. Therefore, before an enterprise opens an API, it is very necessary to simulate the initiation of massive API requests to test the performance of the API.
In the prior art, when testing the performance of the API, a performance testing computer is mostly used to simulate that multiple users frequently initiate multiple API requests to the API to be tested, so as to test the performance of the API when facing a larger concurrent access request.
Although the test mode in the prior art can test the performance of the API in the face of a large concurrent access request, the magnitude of the concurrent access request cannot meet the requirement of a large number of test requests, and the performance of the API in the face of a large number of concurrent access requests cannot be tested.
Disclosure of Invention
The embodiment of the invention provides a performance testing method, a device, equipment and a medium of an Application Programming Interface (API), which are used for testing the performance of the API facing massive concurrent access requests.
In a first aspect, an embodiment of the present invention provides a method for testing performance of an application programming interface API, including:
receiving an API test request, wherein the test request comprises the corresponding relation between the API identification and the number of the access requests required by the test;
and instructing the plurality of test hosts to respectively send access requests to the API corresponding to the API identification at a preset time, wherein the total amount of the access requests sent by the plurality of test hosts is greater than or equal to the number of the access requests required by the test.
In a second aspect, an embodiment of the present invention provides a performance testing apparatus for an application programming interface API, including:
the device comprises a receiving unit, a processing unit and a processing unit, wherein the receiving unit is used for receiving an API test request which comprises the corresponding relation between the API identification and the number of the access requests required by the test;
and the processing unit is used for indicating the plurality of test hosts to respectively send access requests to the API corresponding to the API identification at preset time, and the total amount of the access requests sent by the plurality of test hosts is greater than or equal to the number of the access requests required by the test.
In a third aspect, an embodiment of the present invention provides a performance testing apparatus for an application programming interface API, including: at least one processor, at least one memory, and computer program instructions stored in the memory, which when executed by the processor, implement the method of the first aspect of the embodiments described above.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which computer program instructions are stored, which, when executed by a processor, implement the method of the first aspect in the foregoing embodiments.
The method, the device, the equipment and the medium for testing the performance of the API provided by the embodiment of the invention can provide massive concurrent access requests for the API and test the performance of the API facing the massive concurrent access requests.
Drawings
FIG. 1 is a schematic flow chart of a method for testing the performance of an API according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a performance testing apparatus for an API provided in an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a performance testing apparatus for an API provided in an embodiment of the present invention.
Detailed Description
The following describes in detail specific embodiments of a method, an apparatus, a device, and a medium for testing the performance of an API according to an embodiment of the present invention with reference to the accompanying drawings.
As shown in fig. 1, the method for testing the performance of the API according to the embodiment of the present invention may include the following steps:
step 101, receiving an API test request, where the test request includes a corresponding relationship between an API identifier and the number of access requests required for testing.
In this step, the API test request refers to a test request for testing the API. The test request may be a test request for testing one API, or may be a test request for testing multiple APIs, which is not limited in the embodiment of the present invention.
Specifically, when the test request is a test request for testing an API, the test request includes an API identifier of the API and the number of access requests required for testing the API; and when the test request is a test request for testing the plurality of APIs, the test request comprises the API identification of each API in the plurality of APIs and the number of access requests required by each API in the test.
And 102, indicating the plurality of test hosts to respectively send access requests to the API corresponding to the API identification at a preset time, wherein the total amount of the access requests sent by the plurality of test hosts is greater than or equal to the number of the access requests required by the test.
The predetermined time may be a time specified in the test request, or a time specified by the system, which is not limited in the embodiment of the present invention.
In this step, when the plurality of test hosts are instructed to send access requests to the APIs corresponding to the API identifiers respectively at predetermined time, the number of access requests sent by each of the plurality of test hosts to the APIs corresponding to the API identifiers may be the same or different, and in specific implementation, the number may be allocated according to the configuration of each test host, which is not limited in the embodiment of the present invention.
In specific implementation, the test host can manage the number of concurrent users of the request by using the thread pool technology, so as to improve the utilization efficiency of the test host processor.
During specific implementation, the total amount of the access requests sent by the multiple test hosts to the API corresponding to the API identifier needs to be greater than or equal to the number of the access requests required for testing, so as to meet the test requirements for API testing.
It should be noted that, when the test request in step 101 is a test request for testing a plurality of APIs, the test request includes an API identifier of each API in the plurality of APIs and the number of access requests required for testing each API. In this case, in this step, when the multiple test hosts send access requests to the APIs corresponding to the API identifiers, the total amount of the access requests sent by the multiple test hosts to the APIs corresponding to each API identifier needs to be greater than or equal to the number of the access requests required for testing the API.
Compared with the prior method for sending the access request to the API to be tested by using one testing host, the method for testing the performance of the API provided by the embodiment of the invention can obviously improve the quantity of the sent access requests, namely can provide massive concurrent access requests to the API, and tests the performance of the API when facing the massive concurrent access requests.
In a possible implementation manner, when the plurality of test hosts are instructed to send the access requests to the APIs corresponding to the API identifications respectively at a predetermined time in step 102, the plurality of test hosts may be controlled to be in different test environments, and then the plurality of test hosts in different test environments may be instructed to send the access requests to the APIs corresponding to the API identifications respectively at a predetermined time.
In the embodiment of the invention, the test environment is the environment or scene where the API is located when sending the access request. For example, assuming that the API function is to query an order, the user may initiate a query order request on a homepage of the user, or may initiate a query order request on an order page.
When testing the API with the function of inquiring the order, one testing host can be controlled to send an access request to the API on the personal main page interface, and the other testing host is controlled to send an access request to the API on the order page, and at the moment, the two testing hosts are in different testing environments.
In actual application, the access request received by each API usually comes from different application environments, so that the access request is sent to the API corresponding to the API identifier in different test environments, which is more approximate to a real application scenario, and the actual performance of the API can be tested more comprehensively.
In a possible embodiment, after instructing a plurality of test hosts to respectively send access requests to the APIs corresponding to the API identifications at predetermined time, during the test process, one or more of the following data may be recorded and stored as test data: the time length of each access request transmitted from the test host to the API corresponding to the API identification, the response state of each access request, the response message of the API corresponding to the API identification for responding to each access request, and the corresponding relation between the API identification included in the test request and the number of the access requests required by the test.
In a possible implementation manner, in the testing process, when it is further required to continuously determine whether the preset condition is met and it is determined that the preset test end condition is met, the plurality of test hosts are instructed to terminate sending the access request to the API corresponding to the API identifier, that is, terminate the test.
In specific implementation, the preset test ending condition includes one or more of the following conditions: the number of the access requests sent to the API corresponding to the API identifier is greater than or equal to a preset number threshold, the timeout rate of the API corresponding to the API identifier for responding to the access requests is greater than a first preset proportion threshold, and the success rate of the API corresponding to the API identifier for responding to the access requests is smaller than a second preset proportion threshold, wherein the first preset proportion threshold is smaller than the second preset proportion threshold.
The time-out rate of the API response access request corresponding to the API identifier is: the ratio of the number of access requests for responding to timeout to the total number of access requests corresponding to the API identifier, where the success rate of the API for responding to the access requests corresponding to the API identifier is: the API identifies a ratio of the number of access requests to the total number of access requests that the corresponding API successfully responds.
It should be noted that the preset number threshold, the first preset proportion threshold, and the second preset proportion threshold may be set freely, for example, the preset number threshold is set to be the same as the number of access requests required for the test, the value of the first preset proportion threshold is 5%, and the value of the second preset proportion threshold is 98%.
In the embodiment of the present invention, the preset test ending condition may be flexibly defined by a tester, and one test ending condition or a plurality of test ending conditions may be set. Of course, it should be understood by those skilled in the art that in other embodiments of the present invention, the preset test ending condition may also include other ending conditions, for example, the test operation is performed for a preset time length.
In a possible implementation manner, after the test is finished, a test report of the API corresponding to the API identifier may be generated by analyzing, based on the test data, the service log recorded when the API corresponding to the API identifier responds to the access request.
In specific implementation, by combining the test data and the service log recorded when the API corresponding to the API identifier responds to the access request, one or more of the following indexes may be statistically analyzed to generate a test report: the response rate of the API to the access request, the success rate of the API responding to the access request, the time length of the access request transmitted from the test host to the API, the time consumption among all layers in the API server, failed request response messages and the like.
In one possible embodiment, the plurality of test hosts are deployed in a distributed architecture. The test host may be a physical machine, a virtual machine, or a cloud host, which is not limited in the embodiments of the present invention.
It should be noted that, when a plurality of test hosts are deployed by using a distributed architecture, not only can cooperative work among the plurality of test hosts be better ensured, but also the test hosts can be conveniently added according to actual test requirements or test scale, and a test host cluster is ensured to have good dynamic expansibility.
Based on the same inventive concept, the embodiment of the invention also provides a performance testing device of the application programming interface API.
As shown in fig. 2, the performance testing apparatus for API provided in the embodiment of the present invention includes:
the receiving unit 201 is configured to receive an API test request, where the test request includes a corresponding relationship between an API identifier and a number of access requests required for testing.
And the processing unit 202 is configured to instruct the multiple test hosts to send access requests to the APIs corresponding to the API identifications at predetermined time, where a total amount of the access requests sent by the multiple test hosts is greater than or equal to a number of access requests required for testing.
In one possible embodiment, the device for testing the performance of the API further includes: a storage unit 203 for recording and storing one or more of the following data as test data: the time length of each access request transmitted from the test host to the API corresponding to the API identification, the response state of each access request, the response message of the API corresponding to the API identification for responding to each access request, and the corresponding relation between the API identification included in the test request and the number of the access requests required by the test.
In a possible implementation, the processing unit 202 is further configured to: and analyzing and generating a test report of the API corresponding to the API identification based on the test data by combining the service log recorded when the API corresponding to the API identification responds to the access request.
In a possible implementation, the processing unit 202 is specifically configured to: controlling a plurality of test hosts to be in different test environments; and indicating a plurality of test hosts under different test environments to respectively send access requests to the API corresponding to the API identification at a preset time.
In a possible implementation, the processing unit 202 is further configured to: and when the preset test ending condition is determined to be met, instructing the plurality of test hosts to terminate sending the access requests to the API corresponding to the API identification.
In a possible embodiment, the preset test end condition comprises one or more of the following conditions: the number of the access requests sent to the API corresponding to the API identifier is greater than or equal to a preset number threshold, the timeout rate of the API corresponding to the API identifier for responding to the access requests is greater than a first preset proportion threshold, and the success rate of the API corresponding to the API identifier for responding to the access requests is smaller than a second preset proportion threshold, wherein the first preset proportion threshold is smaller than the second preset proportion threshold.
In one possible embodiment, the plurality of test hosts are deployed in a distributed architecture.
In the embodiment of the invention, the API performance testing device and the API performance testing program are in decoupling design, so that the API performance testing device can run different API performance testing programs to test different APIs, and has better compatibility and adaptability.
In addition, the method and apparatus for testing the performance of the API according to the embodiment of the present invention described in conjunction with fig. 1-2 may be implemented by a performance testing device of the API. Fig. 3 is a schematic diagram illustrating a hardware structure of a performance testing device of an API provided in an embodiment of the present invention.
The performance testing apparatus of the API may comprise a processor 301 and a memory 302 in which computer program instructions are stored.
In particular, the processor 301 may include a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or may be configured as one or more Integrated circuits implementing embodiments of the present invention.
The processor 301 implements the performance testing method of any one of the APIs in the above embodiments by reading and executing the computer program instructions stored in the memory 302.
In one example, the performance testing apparatus of the API may further include a communication interface 303 and a bus 310. As shown in fig. 3, the processor 301, the memory 302, and the communication interface 303 are connected via a bus 310 to complete communication therebetween.
The communication interface 303 is mainly used for implementing communication between modules, apparatuses, units and/or devices in the embodiment of the present invention.
The bus 310 includes hardware, software, or both that couple the components of the API's performance testing device to one another. By way of example, and not limitation, a bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hypertransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (VLB) bus, or other suitable bus or a combination of two or more of these. Bus 310 may include one or more buses, where appropriate. Although specific buses have been described and shown in the embodiments of the invention, any suitable buses or interconnects are contemplated by the invention.
The performance testing device of the API may execute the performance testing method of the API in the embodiment of the present invention based on the received test request, thereby implementing the performance testing method and apparatus of the API described with reference to fig. 1-2.
In addition, in combination with the API performance testing method in the foregoing embodiments, the embodiments of the present invention may provide a computer-readable storage medium to implement. The computer readable storage medium having stored thereon computer program instructions; the computer program instructions, when executed by a processor, implement the method for testing the performance of an API of any of the above embodiments.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. A performance test method of an Application Programming Interface (API) is characterized by comprising the following steps:
receiving an API test request, wherein the test request comprises a corresponding relation between an API identification and the number of access requests required by the test;
and indicating a plurality of test hosts to respectively send access requests to the API corresponding to the API identification at a preset time, wherein the total amount of the access requests sent by the plurality of test hosts is greater than or equal to the number of the access requests required by the test.
2. The method of claim 1, further comprising:
recording and storing one or more of the following data as test data: the time length of each access request transmitted from the test host to the API corresponding to the API identification, the response state of each access request, the response message of the API corresponding to the API identification responding to each access request, and the corresponding relation between the API identification included in the test request and the number of the access requests required by the test.
3. The method of claim 2, further comprising:
and analyzing and generating a test report of the API corresponding to the API identification based on the test data and by combining the service log recorded when the API corresponding to the API identification responds to the access request.
4. The method of claim 1, wherein the instructing the plurality of test hosts to send access requests to the APIs corresponding to the API identifications respectively at predetermined time includes:
controlling the plurality of test hosts to be in different test environments;
and indicating a plurality of test hosts under different test environments to respectively send access requests to the API corresponding to the API identification at a preset time.
5. The method of claim 1, further comprising:
and when the preset test ending condition is determined to be met, indicating the plurality of test hosts to terminate sending access requests to the API corresponding to the API identification.
6. The method of claim 5, wherein the preset test end conditions comprise one or more of the following conditions: the number of access requests sent to the API corresponding to the API identifier is greater than or equal to a preset number threshold, the timeout rate of the API corresponding to the API for responding to the access requests is greater than a first preset proportion threshold, and the success rate of the API corresponding to the API for responding to the access requests is less than a second preset proportion threshold, wherein the first preset proportion threshold is less than the second preset proportion threshold.
7. The method of any of claims 1-6, wherein the plurality of test hosts are deployed in a distributed architecture.
8. A device for testing the performance of an API, comprising:
the device comprises a receiving unit, a processing unit and a processing unit, wherein the receiving unit is used for receiving an API test request, and the test request comprises the corresponding relation between an API mark and the number of access requests required by the test;
and the processing unit is used for indicating a plurality of test hosts to respectively send access requests to the API corresponding to the API identification at preset time, and the total amount of the access requests sent by the plurality of test hosts is greater than or equal to the number of the access requests required by the test.
9. A performance testing apparatus of an application programming interface API, comprising: at least one processor, at least one memory, and computer program instructions stored in the memory that, when executed by the processor, implement the method of any of claims 1-7.
10. A computer-readable storage medium having computer program instructions stored thereon, which when executed by a processor implement the method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810779870.1A CN110727573A (en) | 2018-07-16 | 2018-07-16 | Performance test method, device, equipment and medium of application programming interface |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810779870.1A CN110727573A (en) | 2018-07-16 | 2018-07-16 | Performance test method, device, equipment and medium of application programming interface |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110727573A true CN110727573A (en) | 2020-01-24 |
Family
ID=69216871
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810779870.1A Pending CN110727573A (en) | 2018-07-16 | 2018-07-16 | Performance test method, device, equipment and medium of application programming interface |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110727573A (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107688526A (en) * | 2017-08-25 | 2018-02-13 | 上海壹账通金融科技有限公司 | Performance test methods, device, computer equipment and the storage medium of application program |
-
2018
- 2018-07-16 CN CN201810779870.1A patent/CN110727573A/en active Pending
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107688526A (en) * | 2017-08-25 | 2018-02-13 | 上海壹账通金融科技有限公司 | Performance test methods, device, computer equipment and the storage medium of application program |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20160300044A1 (en) | Anti-debugging method | |
| CN106919485B (en) | System based on hardware testing tool configured on server | |
| CN104216840B (en) | The method and device that a kind of USB sets and operated to external equipment | |
| CN108768730B (en) | Method and device for operating intelligent network card | |
| TWI470436B (en) | System, method, and computer program product for ordering a plurality of write commands associated with a storage device | |
| CN108228444B (en) | Test method and device | |
| CN107659455B (en) | Method, storage medium, device and system for Mock data of iOS (internet operating system) end | |
| US20170201563A1 (en) | Video data providing method, video playback method, device, and system | |
| CN108241580B (en) | Client program testing method and terminal | |
| CN107506145B (en) | Physical storage scheduling method and cloud host creation method | |
| CN104317684A (en) | Method for synchronously automatic testing of bandwidth and transmission rate of multiple USB (Universal Serial Bus) interfaces | |
| CN109240802B (en) | Request processing method and device | |
| US10282120B2 (en) | Method, apparatus and system for inserting disk | |
| WO2020177385A1 (en) | Virtual machine function detection method and apparatus, electronic device and storage medium | |
| CN109324959B (en) | Method for automatically transferring data, server and computer readable storage medium | |
| CN108231132B (en) | NAND flash memory verification device and verification system | |
| CN108234551B (en) | Data processing method and device | |
| CN110569157B (en) | Storage testing method, device, server and storage medium | |
| CN104753741A (en) | Network card test performance adjustment method and device | |
| KR101794016B1 (en) | Method of analyzing application objects based on distributed computing, method of providing item executable by computer, server performing the same and storage media storing the same | |
| CN110727573A (en) | Performance test method, device, equipment and medium of application programming interface | |
| WO2023024246A1 (en) | Out-of-order data generation method, apparatus and device, and storage medium | |
| CN115048255A (en) | Automatic test method, device, host and storage medium | |
| CN115454576A (en) | Virtual machine process management method and system and electronic equipment | |
| CN111400117B (en) | Method for automatically testing Ceph cluster |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200124 |