CN114003503A

CN114003503A - Platform performance test method and device, electronic equipment and readable storage medium

Info

Publication number: CN114003503A
Application number: CN202111300665.0A
Authority: CN
Inventors: 李珍
Original assignee: Beijing Topsec Technology Co Ltd; Beijing Topsec Network Security Technology Co Ltd; Beijing Topsec Software Co Ltd
Current assignee: Beijing Topsec Technology Co Ltd; Beijing Topsec Network Security Technology Co Ltd; Beijing Topsec Software Co Ltd
Priority date: 2021-11-04
Filing date: 2021-11-04
Publication date: 2022-02-01

Abstract

The application belongs to the technical field of testing, and discloses a method, a device, electronic equipment and a readable storage medium for testing platform performance, wherein the method comprises the steps of obtaining service attribute information and resource attribute information of a target application product when a platform testing task for the target application product is determined to be received, wherein the target application product is a product developed through a product development platform; determining a performance index to be tested according to the service attribute information and the resource attribute information; testing a product development platform aiming at the performance index to obtain platform test data; and sending the platform test data to a target application product. Therefore, different performance tests can be performed on the product development platform aiming at different target application products, the personalized performance test aiming at the target application products is realized, and the effectiveness of platform test data pushing is improved.

Description

Platform performance test method and device, electronic equipment and readable storage medium

Technical Field

The present application relates to the field of test technologies, and in particular, to a method and an apparatus for testing platform performance, an electronic device, and a readable storage medium.

Background

With the development of internet technology, developers can develop different application products, such as firewalls, through a product development platform. Product development platforms can typically support tens of application products and development and operation. In practical application, performance test is usually required to be performed on a product development platform, so that whether the product development platform can meet the performance requirement of a target application product or not can be judged through platform test data.

In the prior art, a plurality of performance indexes of a product development platform are usually tested to obtain platform test data, and the platform test data is sent to a target application product. The target application product can judge whether the product development platform meets the performance requirement of the target application product according to the platform test data.

However, the performance indexes of the product development platforms required by different application products are usually different, and this testing method cannot perform personalized performance testing on the product development platforms according to the performance requirements of different application products, and will provide invalid garbage data for the target application products.

Therefore, when the product development platform is tested, how to carry out personalized performance test on the product development platform aiming at different application products is achieved, and platform test data effective to the application products is obtained.

Disclosure of Invention

An object of the embodiments of the present application is to provide a method and an apparatus for testing platform performance, an electronic device, and a readable storage medium, which are used to perform personalized performance testing on a product development platform for different application products when testing the product development platform, so as to obtain platform test data effective for the application products.

In one aspect, a method for testing platform performance is provided, including:

when a platform test task for a target application product is determined to be received, acquiring service attribute information and resource attribute information of the target application product, wherein the target application product is a product developed through a product development platform;

determining a performance index to be tested according to the service attribute information and the resource attribute information;

testing a product development platform aiming at the performance index to obtain platform test data;

and sending the platform test data to a target application product.

In the implementation process, according to the service attribute information and the resource attribute information of the target application product, the performance index of the product development platform required to be acquired by the target application product can be determined, and according to the determined performance index, the product development platform is subjected to personalized test to obtain platform test data required by the target application product, so that the system can be used for different target application products, different performance tests are carried out on the product development platform, the personalized performance test aiming at the target application product is realized, the consumed labor cost and time cost are reduced, can provide effective platform test data for target application products, reduces the pushing of invalid garbage test data, and the target application product can judge whether the product development platform meets the performance requirements of development and application of the target application product according to the obtained effective platform test data.

In one embodiment, before obtaining the service attribute information and the resource attribute information of the target application product, the method includes:

acquiring a service message of a target application product and resource configuration information;

analyzing and extracting the characteristics of the service message to obtain the service characteristics of the service message;

generating and storing service attribute information of the target application product according to the service characteristics;

and extracting the resource attribute of the resource configuration information, and acquiring and storing the resource attribute information.

In the implementation process, the service attribute information and the resource attribute information are extracted, so that the performance index to be tested can be determined in the subsequent steps according to the service attribute information and the resource attribute information.

In one embodiment, determining a performance indicator to be tested according to a platform test task, service attribute information, and resource attribute information includes:

and acquiring the performance indexes corresponding to the service attribute information and the resource attribute information according to the corresponding relationship among the preset service attribute information, the preset resource attribute information and the preset performance indexes.

In the implementation process, the performance index to be tested is determined according to the service attribute information and the resource attribute information.

In one embodiment, testing a product development platform for performance indicators to obtain platform test data includes:

configuring a performance test environment according to the resource attribute information and the service attribute information, wherein the performance test environment comprises: the system comprises a test server, a test client and a tested module;

acquiring an initial index value of the performance index;

based on the performance test environment, the following steps are executed in a circulating manner until the preset index test condition is determined to be reached: controlling the test server and the test client to transmit the test message through the tested module based on the index value, acquiring the packet loss rate of the test message, and adjusting the index value of the performance index according to the packet loss rate;

and generating platform test data according to the adjusted index value.

In the implementation process, the index value is adjusted through the packet loss rate to generate platform test data.

In one embodiment, configuring a performance test environment according to resource attribute information and service attribute information includes:

configuring a module to be tested according to the resource attribute information to generate a software and hardware testing environment;

configuring a test server and a test client according to the service attribute information to generate a service test environment;

and obtaining a performance test environment based on the hardware test environment and the service test environment.

In the implementation process, a performance test environment for testing can be configured through the resource attribute information and the service attribute information.

In one embodiment, after testing a product development platform for a performance index and obtaining platform test data, the method further includes:

storing the target application product and the platform test data in a database in a correlation manner;

and when determining that a platform performance query instruction of a user for the target application product is received, outputting platform test data which is stored in association with the target application product.

In the implementation process, platform test data can be stored and inquired.

In one aspect, an apparatus for testing platform performance is provided, including:

the system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring the service attribute information and the resource attribute information of a target application product when determining that a platform test task aiming at the target application product is received, wherein the target application product is a product developed by a product development platform;

the determining unit is used for determining the performance index to be tested according to the service attribute information and the resource attribute information;

the test unit is used for testing the product development platform according to the performance index to obtain platform test data;

and the sending unit is used for sending the platform test data to the target application product.

In one embodiment, the obtaining unit is further configured to:

In one embodiment, the determining unit is configured to:

In one embodiment, the test unit is configured to:

acquiring an initial index value of the performance index;

and generating platform test data according to the adjusted index value.

In one embodiment, the test unit is configured to:

In one embodiment, the test unit is further configured to:

In one aspect, an electronic device is provided, comprising a processor and a memory, the memory storing computer readable instructions which, when executed by the processor, perform the steps of the method provided in any of the various alternative implementations of platform performance testing described above.

In one aspect, a readable storage medium is provided, on which a computer program is stored, which, when being executed by a processor, performs the steps of the method as provided in any of the various alternative implementations of platform performance testing described above.

In one aspect, a computer program product is provided, which when run on a computer causes the computer to perform the steps of the method as provided in any of the various alternative implementations of platform performance testing described above.

In the method, the device, the electronic device and the readable storage medium for testing the platform performance provided by the embodiment of the application, when the platform test task for the target application product is determined to be received, the service attribute information and the resource attribute information of the target application product are acquired, wherein the target application product is a product developed through a product development platform; determining a performance index to be tested according to the service attribute information and the resource attribute information; testing a product development platform aiming at the performance index to obtain platform test data; and sending the platform test data to a target application product. Therefore, different performance tests can be performed on the product development platform aiming at different target application products, the personalized performance test aiming at the target application products is realized, and the effectiveness of platform test data pushing is improved.

Additional features and advantages of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the application. The objectives and other advantages of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.

Fig. 1 is a first schematic diagram of a platform performance testing system according to an embodiment of the present disclosure;

FIG. 2 is a flowchart illustrating an implementation of a method for extracting product attribute data according to an embodiment of the present disclosure;

fig. 3 is a schematic diagram of a message parsing process provided in an embodiment of the present application;

fig. 4 is a flowchart illustrating an implementation of a method for testing platform performance according to an embodiment of the present disclosure;

fig. 5 is a schematic diagram of an architecture of a performance index determining system according to an embodiment of the present application;

FIG. 6 is a schematic diagram of performance indicator determination provided in an embodiment of the present application;

fig. 7 is a schematic diagram illustrating a second architecture of a platform performance testing system according to an embodiment of the present disclosure;

fig. 8 is a schematic diagram of service attribute information extraction according to an embodiment of the present application;

fig. 9 is a schematic diagram of resource attribute information extraction according to an embodiment of the present application;

fig. 10 is a block diagram illustrating a structure of a device for testing platform performance according to an embodiment of the present disclosure;

fig. 11 is a schematic structural diagram of an electronic device in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.

First, some terms referred to in the embodiments of the present application will be described to facilitate understanding by those skilled in the art.

The terminal equipment: may be a mobile terminal, a fixed terminal, or a portable terminal such as a mobile handset, station, unit, device, multimedia computer, multimedia tablet, internet node, communicator, desktop computer, laptop computer, notebook computer, netbook computer, tablet computer, personal communication system device, personal navigation device, personal digital assistant, audio/video player, digital camera/camcorder, positioning device, television receiver, radio broadcast receiver, electronic book device, gaming device, or any combination thereof, including the accessories and peripherals of these devices, or any combination thereof. It is also contemplated that the terminal device can support any type of interface to the user (e.g., wearable device), and the like.

A server: the cloud server can be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, and can also be a cloud server for providing basic cloud computing services such as cloud service, a cloud database, cloud computing, cloud functions, cloud storage, network service, cloud communication, middleware service, domain name service, security service, big data and artificial intelligence platform and the like.

In order to perform personalized performance testing on a product development platform aiming at different application products and obtain platform testing data effective for the application products when the product development platform is tested, the embodiment of the application provides a platform performance testing method and device, electronic equipment and a readable storage medium.

Fig. 1 is a schematic diagram of a first architecture of a platform performance testing system according to an embodiment of the present disclosure. Fig. 1 includes an application product and a platform performance test system. The platform performance test system comprises a performance index determining module, a performance index storage module, a performance test platform and a platform test data storage module.

The application product is a product developed and obtained by research personnel on the basis of a product development platform. Research and development personnel can develop one or more application products on a product development platform, and different software and hardware module resources are usually configured in the product development platform in order to support the development of different application products and the performance requirements of application operation. Different application products can select different software and hardware module resources to be accessed in a product development platform.

That is to say, the application product includes two parts, one part is the software and hardware resources used for supporting the development and operation of the target application product in the product development platform, and the other part is the service program developed and added by the research and development personnel on the basis of the product development platform. After the application product development is completed, the user can use the product service provided by the application product.

Optionally, the target application product may be a firewall. In fig. 1, only two application products are taken as an example for illustration, and in practical applications, one or more application products may be developed on a product development platform, which is not limited herein.

A performance index determination module: the method is used for extracting product attribute data of the application product, namely service attribute information and resource attribute information, and determining performance indexes to be tested by the product development platform according to the product attribute data of the application product.

The performance index storage module: storing product attribute data of the application product, and establishing and storing a corresponding relation between the application product and the performance index.

A performance test platform: and configuring a performance test environment according to the product attribute data of the target application product, and testing the product development platform aiming at the performance indexes through the performance test environment to obtain platform test data.

Platform test data storage module: storing the application product and the platform test data in an associated mode, and sending the associated platform test data to the target application product.

Optionally, the performance index storage module and the platform test data storage module may be the same database or different databases, which is not limited herein.

In one embodiment, the performance index storage module and the platform test data storage module are the same database, and the product attribute data of the application product, the correspondence between the application product and the performance index, and the target application product and the associated platform test data may all be stored in the same database.

The execution subject is the platform performance testing system in fig. 1, and may also be other electronic devices such as a server, which is not limited herein.

In the embodiment of the application, before the platform performance test is performed on the product development platform, the product attribute data of the target application product developed on the product development platform is extracted, so that in the subsequent step, the platform performance test can be performed on the product development platform according to the product attribute data of the target application product, and the platform test data related to the target application product is obtained.

Referring to fig. 2, an implementation flow chart of a method for extracting product attribute data according to an embodiment of the present application is described with reference to the product development platform shown in fig. 1, where a specific implementation flow of the method is as follows:

step 200: and acquiring the service message of the target application product and the resource configuration information.

Specifically, a service message of the target application product is collected, and resource configuration information of software and hardware resources supporting the operation of the target application product in a product development platform is read.

When the service message of the target application product is collected, any one of the following modes or combinations can be adopted:

mode 1: and collecting the service message through the target application product.

Mode 2: and collecting the service message through other equipment interacting with the target application product.

Optionally, the other device may be a server or a terminal device, and is not limited herein.

The resource configuration information may include at least one of software configuration information and hardware resource information. The software configuration information may be information such as an operating system and software components. The hardware resource information may include, but is not limited to, at least one of a CPU model, a memory size, and a memory allocation relationship.

In this way, relevant data of the target application product can be collected.

Step 201: and analyzing and extracting the characteristics of the service message to obtain the service characteristics of the service message.

Specifically, the service message is analyzed to obtain message analysis information of the service message, and the feature extraction is performed on the message analysis information to obtain the service feature of the service message.

In one embodiment, at least one of a protocol type, a field length range and a message length range of Open System Interconnection Reference Model (OSI) layers 3 to 7 is extracted from message parsing information of a service message, and extracted feature information is abstracted to obtain service features of the service message.

For example, a service packet is subjected to packet parsing to obtain the following parsing information: internet Protocol version 4(Internet Protocol version 4, IPv4) Transmission Control Protocol (TCP, Transmission Control Protocol) hypertext transfer Protocol (HTTP) GET (GET) service, the average length of the GET request packet is 128 bytes, the average length of the GET response packet is 2K, and if there is a fragment, a service feature, that is, HTTP GET can download a file of 2K size.

Fig. 3 is a schematic diagram of a message parsing process provided in the embodiment of the present application. Fig. 3 includes an OSI three-layer message parsing module, an OSI four-layer message parsing module, and an OSI seven-layer message parsing module. Through an OSI three-layer message analysis module, IPv4, Internet Protocol version 6 (IPv 6), message length and whether fragmentation is performed on the service message are obtained. Through an OSI four-Layer message analysis module, TCP Protocol information, User Datagram Protocol (UDP) Protocol information, and Transport Layer Security Protocol (TLS) information of a service message are obtained. And acquiring the service type, the service message length, the service message interaction process and the carrying parameters of the service message through an OSI seven-layer message analysis module.

Therefore, the service characteristics of the service message can be extracted, and the message identification capability of the target application product is realized.

Step 202: and generating and storing the service attribute information of the target application product according to the service characteristics.

Specifically, the service attribute information is information including service characteristics.

Step 203: and extracting the resource attribute of the resource configuration information, and acquiring and storing the resource attribute information.

Specifically, from the resource configuration information, configuration information that affects performance is extracted, and resource attribute information is obtained and stored.

Step 204: and obtaining the product attribute information of the target application product according to the service attribute information and the resource attribute information.

Specifically, the product attribute information includes service attribute information and resource attribute information.

Therefore, after the product attribute data are extracted, the platform performance test can be performed on the product development platform according to the product attribute data of the target application product, namely the service attribute information and the resource attribute information of the target application product, so that the platform test data required by the target application product can be obtained.

Referring to fig. 4, an implementation flow chart of a method for testing platform performance provided in the embodiment of the present application is described with reference to the platform performance testing system shown in fig. 1, where the implementation flow of the method is as follows:

step 400: and when the platform test task aiming at the target application product is determined to be received, acquiring the service attribute information and the resource attribute information of the target application product.

Specifically, the target application product is a product developed on a product development platform.

In one embodiment, a user terminal or a target application product sends a platform test task to a platform performance test system. And after receiving the platform test task, the platform performance test system acquires the service attribute information and the resource attribute information of the target application product.

Step 401: and determining the performance index to be tested according to the service attribute information and the resource attribute information.

Specifically, the performance indexes corresponding to the service attribute information and the resource attribute information are obtained according to the corresponding relationship among the preset service attribute information, the preset resource attribute information and the preset performance indexes.

Optionally, the performance indicators may include, but are not limited to, at least one of the following indicators: new creation rate, concurrency number, throughput and forwarding delay.

Before step 401 is executed, a correspondence relationship among the service attribute information, the resource attribute information, and the performance index is pre-established.

Fig. 5 is a schematic diagram of an architecture of a performance index determining system according to an embodiment of the present disclosure. In fig. 5, the performance index determining system includes a service attribute information extracting module, a resource attribute information extracting module, a performance index establishing module, and may further include a performance index standardizing module. The service attribute information can be extracted according to the target application product through the service attribute information extraction module, the resource attribute information of the target application product can be extracted through the resource attribute information extraction module, and the performance index to be tested, which is set aiming at the service attribute information and the resource attribute information, is obtained through the performance index establishment module. Furthermore, the performance index can be standardized by a performance index standardization module.

Further, when step 401 is executed, the following steps may also be adopted:

s4011: and acquiring a first index set contained in the platform test task.

Specifically, the first index set includes at least one performance index.

In one embodiment, the first set of metrics is a user indicated performance metric requiring testing.

S4012: and acquiring a second index set aiming at the service attribute information and the resource attribute information.

Specifically, before S4012 is executed, a correspondence between product attribute information including service attribute information and resource attribute information and a performance index is established in advance.

It should be noted that the corresponding relationship is established according to the performance index influenced by the service attribute information and/or the resource attribute information.

And when the second index is determined, the second index corresponding to the service attribute information and the resource attribute information is obtained according to the corresponding relation.

S4013: and determining a second index contained by the first index set as a performance index to be tested.

That is, the intersection between the first set of metrics and the second metric is determined as the performance metric to be tested.

This is because the first index indicated by the user may not be determined by the product attribute information of the target application product, and therefore, the performance index that can be determined by the product attribute information of the target application product is screened from the first index set.

Therefore, the personalized performance index to be tested can be set for the target application product.

Fig. 6 is a schematic diagram illustrating determination of a performance index provided in the embodiment of the present application. In fig. 6, each performance index includes: new creation rate, concurrency number, throughput and forwarding delay. The performance indicators corresponding to different product attributes may be different. Then, according to the product attribute information of the target application product, the performance index to be tested corresponding to the target application product can be screened out from the performance indexes. The performance index corresponding to the product attribute information 1 is throughput. The performance index corresponding to the product attribute information 2 is the new rate. The performance index corresponding to the product attribute information 3 is throughput. The performance indexes corresponding to the product attribute information 4 are concurrency number and forwarding delay.

Step 402: and testing the product development platform according to the performance index to obtain platform test data.

Specifically, when step 402 is executed, the following steps may be adopted:

s4021: and configuring a performance test environment according to the resource attribute information and the service attribute information.

Specifically, the performance test environment includes: the system comprises a test server, a test client and a module to be tested, and further comprises: software and hardware testing environment and business testing environment.

When S4021 is executed, the following steps may be adopted:

the first step is as follows: and configuring the tested module according to the resource attribute information to generate a software and hardware testing environment.

In one embodiment, software and hardware resources meeting the resource attribute information of the target application product are selected, and according to the resource attribute information, a process is configured and a memory is allocated to generate a module to be tested, so that a software and hardware testing environment is obtained.

In one embodiment, the CPU model, the CPU core count, the memory size, and the memory allocation relationship of the module under test are configured according to the resource attribute information of the target application product.

Optionally, the software and hardware module may be a module in a product development platform.

The second step is that: and configuring a test server and a test client according to the service attribute information to generate a service test environment.

It should be noted that the service packet is transmitted between the test server and the test client through the tested module.

The third step: and obtaining a performance test environment based on the hardware test environment and the service test environment.

S4022: and acquiring an initial index value of the performance index.

Specifically, an initial index value is set according to the historical message data of the target application product.

S4023: and controlling the test server side and the test client side to transmit the test message through the tested module based on the performance test environment, and adjusting the index value of the performance index according to the packet loss rate.

Specifically, when executing S4023, the following steps may be executed in a loop until it is determined that the preset index test condition is reached:

the first step is as follows: and controlling the test server side and the test client side to transmit the test message through the tested module based on the index value.

Specifically, during the first test, the message sending rate is determined according to the initial index value, the test server is controlled, and the test message is transmitted with the test client through the tested module according to the message sending rate.

And during the cycle test after the first test, determining the message sending rate according to the adjusted index value, controlling the test server, and transmitting the test message with the test client through the tested module according to the message sending rate.

The second step is that: and acquiring the packet loss rate of the test message.

The third step: and adjusting the index value of the performance index according to the packet loss rate.

In one embodiment, if the packet loss rate is higher than the specified packet loss threshold, the message sending rate is reduced, otherwise, the message sending rate is increased until the index value is determined to meet the preset index test condition.

In one embodiment, when an inflection point of an index value is determined, it is determined that a predetermined index test condition is satisfied.

In practical application, the initial index value, the specified packet loss threshold value and the preset index test condition may be set according to a practical application scenario, which is not limited herein.

Thus, the index value can be determined according to the packet loss rate.

S4024: and generating platform test data according to the adjusted index value.

Further, the resource utilization rate in the test process is obtained, and platform test data containing the index value and the resource utilization rate is obtained.

Further, the platform test data can be stored in a database.

In one embodiment, the target application product and the platform test data are stored in an associated mode, and when a platform performance query instruction of a user for the target application product is determined to be received, the platform test data stored in the associated mode of the target application product is output.

Step 403: and sending the platform test data to a target application product.

In one embodiment, after the platform test data is obtained, the platform test data is pushed to the target application product.

In one embodiment, after obtaining the platform test data, the platform test data is returned to the user terminal that sent the test task.

Fig. 7 is a schematic diagram of a second architecture of a platform performance testing system according to an embodiment of the present application. In fig. 7, the platform performance test system includes: the system comprises a test server, a test client, a module to be tested, a resource attribute module, a service environment building module, a test adjusting module and a data standardization module.

Testing the service end: and the test module is used for transmitting the test message with the test client.

Testing the client: and the test server is used for transmitting the test message with the test server through the tested module.

A tested module: the method is used for simulating a target application product, and processing and forwarding the test message.

In one embodiment, the test message is generated according to the service attribute information of the target application product, so as to simulate the service message of the target application product for testing.

In practical application, the test packet may also be set according to a practical application scenario, which is not limited herein.

A resource attribute module: and the module under test is configured according to the resource attribute information.

A business environment building module: and the test server and the test client are configured according to the service attribute information.

A test adjusting module: and the system is used for generating a performance test strategy according to the service attribute information and the resource attribute information, controlling the test server and the test client to transmit a test message through the tested module based on the performance test strategy, and obtaining platform test data.

A data standardization module: the platform test data processing device is used for carrying out standardized processing on the platform test data and storing the processed platform test data to the index database.

In one embodiment, the data normalization module establishes a correspondence between the target application product and the platform test data, and stores the correspondence to the index database.

The above embodiments are illustrated below using a specific application scenario. For example, the target Application product is a advanced Web Application level intrusion prevention system (WAF). TopWAF is used for WEB attack detection and defense of hypertext Transfer Protocol (HTTP) and hypertext Transfer Protocol over Secure Socket Layer (HTTPs), and can realize basic functions such as log alarm, vulnerability scanning, webpage tamper prevention and the like on a management plane.

Firstly, extracting service characteristics of a service message of the TopWAF to obtain service attribute information. The service characteristics of TopWAF may include, but are not limited to, at least one of: the processing performance of the HTTP or HTTPS protocol, the number and the length of parameters of the HTTP, the line length and the method type of a start line (start line), the line length and the number of headers of a head (header), the length of a trunk (body) and the number of caches (cookies). Fig. 8 is a schematic diagram illustrating service attribute information extraction. In fig. 8, analyzing and extracting features of a service packet of a target application product to obtain service attribute information of the service packet includes: http, https, start line length and method type, header line length and number, body length, number of cookies, and length of cookies.

Then, the resource attribute information of TopWAF is extracted. TopWAF includes a variety of hardware product models, e.g., TWF-62128, TWF-62228, … …. Fig. 9 is a schematic diagram illustrating resource attribute information extraction. In fig. 9, the resource attribute information of TopWAF with hardware product model TWF-62128 may include: a CPU and a memory. The number of the CPU cores is 4 cores, and the CPU cores include a management plane 1 core and a forwarding plane 3 core, and the memory includes a total memory 8G, a Virtual Memory Area (VMA) 2G, and a buffer 1G.

Determining 24 service flows of the TopWAF to be tested according to the service attribute information of the TopWAF, determining 4 types of hardware configuration to be covered according to the resource attribute information of the TopWAF, and constructing a 384 individual performance index to be tested according to the service attribute information and the resource attribute information. Furthermore, a performance test environment can be configured on the product development platform according to the resource attribute information and the service attribute information, and the product development platform is tested through the performance test environment to obtain platform test data.

Therefore, the omnibearing performance construction aiming at the target application product is realized, and the performance foundation of the target application product is established.

In the embodiment of the application, the performance index of the product development platform required to be acquired by the target application product can be determined according to the service attribute information and the resource attribute information of the target application product, and according to the determined performance index, the product development platform is subjected to personalized test to obtain platform test data required by the target application product, so that the system can be used for different target application products, different performance tests are carried out on the product development platform, the personalized performance test aiming at the target application product is realized, the consumed labor cost and time cost are reduced, can provide effective platform test data for target application products, reduces the pushing of invalid garbage test data, and the target application product can judge whether the product development platform meets the performance requirements of development and application of the target application product according to the obtained effective platform test data.

Based on the same inventive concept, the embodiment of the present application further provides a device for testing platform performance, and because the principle of the device and the equipment for solving the problem is similar to that of a method for testing platform performance, the implementation of the device can refer to the implementation of the method, and repeated details are not repeated.

As shown in fig. 10, which is a schematic structural diagram of an apparatus for testing platform performance provided in an embodiment of the present application, the apparatus includes:

an obtaining unit 1001, configured to obtain service attribute information and resource attribute information of a target application product when determining that a platform test task for the target application product is received, where the target application product is a product developed through a product development platform;

a determining unit 1002, configured to determine a performance index to be tested according to the service attribute information and the resource attribute information;

the test unit 1003 is used for testing the product development platform according to the performance index to obtain platform test data;

the sending unit 1004 is configured to send the platform test data to the target application product.

In one embodiment, the obtaining unit 1001 is further configured to:

In one embodiment, the determining unit 1002 is configured to:

In one embodiment, the test unit 1003 is configured to:

acquiring an initial index value of the performance index;

and generating platform test data according to the adjusted index value.

In one embodiment, the test unit 1003 is configured to:

In one embodiment, the test unit 1003 is further configured to:

Fig. 11 shows a schematic structural diagram of an electronic device 1100. Referring to fig. 11, an electronic device 1100 includes: the processor 1110 and the memory 1120 may further include a power source 1130, a display unit 1140, and an input unit 1150.

The processor 1110 is a control center of the electronic device 1100, connects various components using various interfaces and lines, and performs various functions of the electronic device 1100 by running or executing software programs and/or data stored in the memory 1120, thereby performing overall monitoring of the electronic device 1100.

In this embodiment, the processor 1110, when calling the computer program stored in the memory 1120, executes the method for testing the performance of the platform provided by the embodiment shown in fig. 4.

Optionally, processor 1110 may include one or more processing units; preferably, the processor 1110 may integrate an application processor, which mainly handles operating systems, user interfaces, applications, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1110. In some embodiments, the processor, memory, and/or memory may be implemented on a single chip, or in some embodiments, they may be implemented separately on separate chips.

The memory 1120 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, various applications, and the like; the storage data area may store data created according to the use of the electronic device 1100, and the like. Further, the memory 1120 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The electronic device 1100 also includes a power supply 1130 (e.g., a battery) that provides power to the various components and that may be logically coupled to the processor 1110 via a power management system to manage charging, discharging, and power consumption via the power management system.

The display unit 1140 may be used to display information input by a user or information provided to the user, various menus of the electronic device 1100, and the like, and in the embodiment of the present invention, the display unit is mainly used to display a display interface of each application in the electronic device 1100 and objects such as texts and pictures displayed in the display interface. The display unit 1140 may include a display panel 1141. The Display panel 1141 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The input unit 1150 may be used to receive information such as numbers or characters input by a user. The input unit 1150 may include a touch panel 1151 and other input devices 1152. Touch panel 1151, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 1151 (e.g., operations by a user on or near touch panel 1151 using any suitable object or accessory such as a finger, a stylus, etc.).

Specifically, the touch panel 1151 may detect a touch operation of a user, detect signals generated by the touch operation, convert the signals into touch point coordinates, transmit the touch point coordinates to the processor 1110, receive a command transmitted from the processor 1110, and execute the command. In addition, the touch panel 1151 can be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. Other input devices 1152 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, power on and off keys, etc.), a trackball, a mouse, a joystick, and the like.

Of course, the touch panel 1151 can cover the display panel 1141, and when the touch panel 1151 detects a touch operation on or near the touch panel, the touch panel is transmitted to the processor 1110 to determine the type of the touch event, and then the processor 1110 provides a corresponding visual output on the display panel 1141 according to the type of the touch event. Although in fig. 11, the touch panel 1151 and the display panel 1141 are two separate components to implement the input and output functions of the electronic device 1100, in some embodiments, the touch panel 1151 and the display panel 1141 may be integrated to implement the input and output functions of the electronic device 1100.

The electronic device 1100 may also include one or more sensors, such as pressure sensors, gravitational acceleration sensors, proximity light sensors, and the like. Of course, the electronic device 1100 may also include other components such as a camera, which are not shown in fig. 11 and will not be described in detail since they are not components that are used in the embodiments of the present application.

Those skilled in the art will appreciate that fig. 11 is merely an example of an electronic device and is not intended to limit the electronic device and may include more or fewer components than those shown, or some components may be combined, or different components.

In an embodiment of the present application, a readable storage medium has a computer program stored thereon, and when the computer program is executed by a processor, the communication device may perform the steps in the above embodiments.

For convenience of description, the above parts are separately described as modules (or units) according to functional division. Of course, the functionality of the various modules (or units) may be implemented in the same one or more pieces of software or hardware when implementing the present application.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims

1. A method for platform performance testing, comprising:

testing the product development platform aiming at the performance index to obtain platform test data;

and sending the platform test data to the target application product.

2. The method of claim 1, wherein prior to said obtaining service attribute information and resource attribute information for the target application product, comprising:

acquiring a service message of the target application product and resource configuration information;

generating and storing the service attribute information of the target application product according to the service characteristics;

3. The method of claim 1, wherein determining the performance indicators to be tested based on the platform test task, the service attribute information, and the resource attribute information comprises:

4. The method of any one of claims 1-3, wherein said testing said product development platform for said performance metric to obtain platform test data comprises:

acquiring an initial index value of the performance index;

based on the performance testing environment, the following steps are executed in a circulating manner until the preset index testing condition is determined to be reached: based on the index value, controlling the test server and the test client to transmit a test message through the tested module, acquiring the packet loss rate of the test message, and adjusting the index value of the performance index according to the packet loss rate;

and generating platform test data according to the adjusted index value.

5. The method of claim 4, wherein configuring a performance test environment based on the resource attribute information and the service attribute information comprises:

and obtaining the performance test environment based on the hardware test environment and the service test environment.

6. The method of any of claims 1-3, wherein after said testing said product development platform for said performance metric to obtain platform test data, further comprising:

and when a platform performance query instruction of a user for the target application product is determined to be received, outputting the platform test data stored in association with the target application product.

7. An apparatus for platform performance testing, comprising:

the system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring the service attribute information and the resource attribute information of a target application product when determining that a platform test task aiming at the target application product is received, wherein the target application product is a product developed through a product development platform;

the determining unit is used for determining a performance index to be tested according to the service attribute information and the resource attribute information;

8. The apparatus of claim 7, wherein the obtaining unit is further configured to:

9. The apparatus of claim 7, wherein the determination unit is to:

10. The apparatus of any one of claims 7-9, wherein the test unit is to:

acquiring an initial index value of the performance index;

and generating platform test data according to the adjusted index value.

11. The apparatus of claim 10, wherein the test unit is to:

12. The apparatus of any one of claims 7-9, wherein the test unit is further to:

13. An electronic device comprising a processor and a memory, the memory storing computer readable instructions that, when executed by the processor, perform the method of any of claims 1-6.

14. A readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-6.