CN108460612B - Advertisement delivery test method, device and equipment - Google Patents
Advertisement delivery test method, device and equipment Download PDFInfo
- Publication number
- CN108460612B CN108460612B CN201710090722.4A CN201710090722A CN108460612B CN 108460612 B CN108460612 B CN 108460612B CN 201710090722 A CN201710090722 A CN 201710090722A CN 108460612 B CN108460612 B CN 108460612B
- Authority
- CN
- China
- Prior art keywords
- request
- test
- inquiry
- volume
- test request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0242—Determining effectiveness of advertisements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0277—Online advertisement
Abstract
The embodiment of the invention discloses a method for testing advertisement putting, which comprises the following steps: receiving a test request sent by a business intelligent workbench; the test request is used for determining whether the advertisement can be accurately put when the advertisement is put; analyzing the test request, and determining the request type of the test request; responding to the test request, and generating a target information parameter corresponding to the request type of the test request; generating a test result corresponding to the request type of the test request based on the target information parameter and the request type of the test request; and sending the test result to the business intelligent workbench so that the business intelligent workbench can conveniently carry out advertisement putting according to the test result. The embodiment of the invention also discloses a device and equipment for testing the advertisement delivery.
Description
Technical Field
The invention relates to an advertisement putting technology in the communication field, in particular to a method, a device and equipment for testing advertisement putting.
Background
With the increasing number of Chinese internet users, the internet has increasingly prominent function as an information transmission medium. In such a market environment, the value of the advertising platform of each large internet company is increasing. A Business Intelligence (BI) workbench is a delivery platform for realizing on-line automation of inventory inquiry, lock quantity, examination and approval processes, the work process comprises the steps of creating an inquiry quantity sheet and inquiry quantity resources, carrying out inquiry quantity and lock quantity operations on the resources, evaluating and examining the demand quantity of the resources, and carrying out resource transfer to medium planning (planning) to release the sheet after confirming the demand quantity. In the whole process, real-time interaction between the BI workbench and an upstream inventory algorithm module is frequent, a plurality of operation steps of storing an inventory inquiry list, submitting and evaluating, confirming the inventory inquiry, cancelling and the like can trigger the inventory inquiry, and the inventory algorithm is relied on to return an inventory inquiry result in real time, the resource state can be circulated, and the next operation can be continued.
In order to complete the whole testing process of the business intelligent workbench, the existing testing scheme is to deploy a set of real inventory algorithm testing environment to interact with the business intelligent workbench. However, the coupling of two different systems, namely the business intelligent workbench and the inventory algorithm, is high, so that the testing efficiency is low; and the inventory algorithm of the test environment is unstable, if the inquiry service is unavailable, the flow test of the business intelligent workbench can be directly influenced, and the risk of test blockage exists.
Disclosure of Invention
In order to solve the above technical problems, embodiments of the present invention are expected to provide a method, an apparatus, and a device for testing advertisement delivery, which solve the problem of high coupling between a business intelligence workstation and an inventory algorithm in the existing testing scheme, improve testing efficiency, ensure normal operation of a testing process of the business intelligence workstation, and overcome a risk of test blocking.
The technical scheme of the invention is realized as follows:
in a first aspect, a method for testing advertisement delivery is provided, where the method includes:
receiving a test request sent by a business intelligent workbench; the test request is used for determining whether the advertisement can be accurately put when the advertisement is put;
analyzing the test request, and determining the request type of the test request;
responding to the test request, and generating a target information parameter corresponding to the request type of the test request;
generating a test result corresponding to the request type of the test request based on the target information parameter and the request type of the test request;
and sending the test result to the business intelligent workbench so that the business intelligent workbench can conveniently carry out advertisement putting according to the test result.
Optionally, the analyzing the test request to determine the request type of the test request includes:
analyzing the test request to obtain a sending path of the test request; wherein the sending path is carried in the test request;
and determining the request type of the test request based on the parameters of the sending path of the test request.
Optionally, the responding to the test request and generating an information parameter corresponding to a request type of the test request includes:
if the request type of the test request is a request for volume inquiry, responding to the request for volume inquiry, and generating information parameters required by a volume inquiry result corresponding to the request for volume inquiry;
filtering the required information parameters according to a preset principle to obtain target information parameters corresponding to the request for the volume inquiry; wherein the target information parameter comprises a query resource basic information parameter.
Optionally, the generating a test result corresponding to the request type of the test request based on the target information parameter and the request type of the test request includes:
if the request type of the test request is a volume inquiry request, generating a volume inquiry result corresponding to the volume inquiry request based on the target information parameter; wherein, the query volume result comprises a query volume return parameter;
converting the format of the query quantity return parameter into a preset format;
correspondingly, the sending the test result to the business intelligence workstation includes:
and sending the inquiry quantity return parameters with the preset format to the business intelligent workbench.
In a second aspect, there is provided a device for testing advertisement placement, the device comprising: receiving unit, acquisition unit, first generation unit, second generation unit and transmitting unit, wherein:
the receiving unit is used for receiving a test request sent by the business intelligent workbench; the test request is used for determining whether the advertisement can be accurately put when the advertisement is put;
the obtaining unit is used for analyzing the test request and determining the request type of the test request;
the first generating unit is used for responding to the test request and generating a target information parameter corresponding to the request type of the test request;
the second generating unit is configured to generate a test result corresponding to the request type of the test request based on the target information parameter and the request type of the test request;
and the sending unit is used for sending the test result to the business intelligent workbench so as to be convenient for the business intelligent workbench to carry out advertisement putting according to the test result.
In a third aspect, a device for testing advertisement placement is provided, the device comprising: a processor and a communication interface, wherein:
the processor is used for receiving a test request sent by the business intelligent workbench through the communication interface; the test request is used for determining whether the advertisement can be accurately put when the advertisement is put; analyzing the test request, and determining the request type of the test request; responding to the test request, and generating a target information parameter corresponding to the request type of the test request; generating a test result corresponding to the request type of the test request based on the target information parameter and the request type of the test request; and sending the test result to the business intelligent workbench through the communication interface so as to be convenient for the business intelligent workbench to carry out advertisement putting according to the test result.
The method, the device and the equipment for testing the advertisement delivery provided by the embodiment of the invention receive a test request sent by a business intelligent workbench, wherein the test request is used for determining whether the advertisement delivery can be accurately carried out when the advertisement delivery is carried out, then the test request is analyzed and processed, the request type of the test request is determined, a test request is responded, a target information parameter corresponding to the request type of the test request is generated, a test result corresponding to the request type of the test request is generated based on the target information parameter and the request type of the test request, and finally the test result is sent to the business intelligent workbench so that the business intelligent workbench can carry out the advertisement delivery according to the test result; therefore, the whole testing process of the business intelligent workbench does not need to interact with a real inventory algorithm testing environment, the condition that the inventory algorithm of the testing environment is unstable does not exist, the problem that the coupling of the business intelligent workbench and the inventory algorithm in the existing testing scheme is high is solved, the testing efficiency is improved, the normal operation of the testing process of the business intelligent workbench is ensured, and the risk of testing blockage is overcome.
Drawings
Fig. 1 is a schematic flowchart of a method for testing advertisement delivery according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of another advertisement placement testing method according to an embodiment of the present invention;
fig. 3 is a schematic flowchart of another method for testing advertisement delivery according to an embodiment of the present invention;
fig. 4 is a schematic diagram illustrating an effect of the test pile after being started according to the embodiment of the present invention;
fig. 5 is a flowchart illustrating a method for testing advertisement delivery according to another embodiment of the present invention;
FIG. 6 is a schematic diagram illustrating the distribution of daily polling results within a test date according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of a test system provided by an embodiment of the invention;
fig. 8 is a schematic structural diagram of a device for testing advertisement delivery according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of another advertisement delivery test apparatus according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of a testing apparatus for advertisement delivery according to another embodiment of the present invention;
fig. 11 is a schematic structural diagram of a test device for advertisement delivery according to an embodiment of the present invention.
Detailed Description
The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.
An embodiment of the present invention provides a method for testing advertisement delivery, which is shown in fig. 1 and includes the following steps:
The test request is used for determining whether the advertisement can be accurately placed when the advertisement is placed.
Specifically, the step 101 of receiving the test request sent by the business intelligent workbench can be realized by a test device for advertisement delivery; the test device for advertisement delivery can be equipment for inquiring quantity interaction with a BI workbench when advertisement delivery is carried out; the test device for advertisement placement may be a test stub, for example, a server. The test request can be that when the user needs to put the advertisement, the BI workbench is used for putting the advertisement; before using the BI workbench to launch the advertisement, the flow test needs to be performed first, and then a test request is sent to the server (test pile).
The main process of system test of the BI workbench is the test of the whole operation process and the state circulation of the query volume resource. The whole test process of the BI workbench relates to the operation of multiple roles such as BI, a chip totality and the like, and the examination of circulation of more than ten resource states, and belongs to a relatively complex long-flow test. The upstream of the BI workbench is an inventory algorithm, so that real-time inventory inquiry of resources is realized, namely, the total inventory amount which can be preset and the daily amount in a resource delivery period are calculated, and an inquiry result is returned; downstream of the BI workstation is a media planning (planning) system that can implement scheduling of resources to be requested. In the embodiment of the invention, the test pile is used for replacing the real inventory algorithm test environment in the test flow for testing during the existing advertisement putting, so that the BI workstation can only circulate the resource state without depending on the inventory algorithm to return the inquiry result in real time, and the BI workstation does not need to wait for the return of the inquiry result, thereby improving the working efficiency.
And 102, analyzing the test request and determining the request type of the test request.
Specifically, step 102 analyzes the test request, and determines the request type of the test request to be implemented by the advertisement delivery test device; the request type of the test request may be the same as the request type of the test request generated in the test flow in the prior art; the obtained test request can be analyzed, a request path of the test request is obtained, and the request type of the test request is judged according to the request path.
And 103, responding to the test request, and generating a target information parameter corresponding to the request type of the test request.
Specifically, step 103 may be implemented by the advertisement delivery test device in response to the test request, and generating the target information parameter corresponding to the request type of the test request. After the test pile receives the sent test request and analyzes the request type of the test request, the information parameters required to be obtained by different request types of different test requests can be determined and obtained; and then, determining a target information parameter corresponding to the request type of the test request according to the acquired information parameter.
It should be noted that the target information parameters corresponding to all request types of the test request are stored in the test stub (server) in advance, and can be obtained without a test process of a real inventory algorithm test environment, so that the real inventory algorithm test environment is not relied on, the working efficiency is greatly improved, and the operation waiting is avoided.
And 104, generating a test result corresponding to the request type of the test request based on the target information parameter and the request type of the test request.
Specifically, the method comprises the following steps. Step 104 may be implemented by the advertisement delivery test apparatus, based on the target information parameter and the request type of the test request, to generate a test result corresponding to the request type of the test request. After the target information parameters corresponding to the request types of the test requests are obtained, the test results required to be obtained by the test requests of the corresponding request types can be obtained according to the target information parameters corresponding to each request type.
And 105, sending the test result to a business intelligent workbench so that the business intelligent workbench can conveniently carry out advertisement putting according to the test result.
Specifically, step 105 sends the test result to the business intelligence workbench, so that the business intelligence workbench can perform advertisement delivery according to the test result by the advertisement delivery testing device. Of course, when sending the obtained test result to the BI workstation, the format of the test result needs to be converted into a format that can be recognized by the BI workstation, and then the format-converted test result needs to be sent to the BI workstation.
The method for testing advertisement delivery provided by the embodiment of the invention receives a test request sent by a business intelligent workbench, wherein the test request is used for determining whether the advertisement delivery can be accurately carried out when the advertisement delivery is carried out, then the test request is analyzed, the request type of the test request is determined, the test request is responded, a target information parameter corresponding to the request type of the test request is generated, a test result corresponding to the request type of the test request is generated based on the target information parameter and the request type of the test request, and finally the test result is sent to the business intelligent workbench so as to be convenient for the business intelligent workbench to carry out the advertisement delivery according to the test result; therefore, the whole testing process of the business intelligent workbench does not need to interact with a real inventory algorithm testing environment, the condition that the inventory algorithm of the testing environment is unstable does not exist, the problem that the coupling of the business intelligent workbench and the inventory algorithm in the existing testing scheme is high is solved, the testing efficiency is improved, the normal operation of the testing process of the business intelligent workbench is ensured, and the risk of testing blockage is overcome.
Based on the foregoing embodiments, an embodiment of the present invention provides a method for testing advertisement delivery, which is shown in fig. 2 and includes the following steps:
In particular, the request receiving port on the test stub (server) may be one of the ports of the test stub (server) that is not used; for example, it may be a 39011 port in the server that would be configured as a port to interact with the BI workbench, thereby fixing usage.
Specifically, the request receiving module of the testing stub (server) will monitor the port all the time and receive the testing request transmitted from the port.
Wherein the transmission path is carried in the test request.
Specifically, when the BI workstation sends the test request, the sending path of each test request may be carried in the corresponding test request and sent to the test pile together; and after the test pile receives the test request, analyzing the corresponding test request to obtain a sending path of the test request.
Of course, it should be noted that the test stub may support all possible request types of test requests and perform corresponding processing.
Specifically, after the sent test request is obtained and analyzed to obtain a sending path corresponding to the test request, all parameters in the sending path are analyzed and judged, and finally, the request type to which the test request belongs is determined according to the parameters in the sending path. Different parameters carried in the sending path of the test request have different request types of the corresponding test request.
And step 206, the advertisement delivery test device generates a test result corresponding to the request type of the test request based on the target information parameter and the request type of the test request.
And step 207, the test result is sent to the business intelligent workbench by the advertisement delivery test device, so that the business intelligent workbench can deliver the advertisement according to the test result.
It should be noted that, for the explanation of the same steps or related concepts in the present embodiment as in the other embodiments, reference may be made to the description in the other embodiments, and details are not described here.
The method for testing the advertisement putting provided by the embodiment of the invention receives a test request sent by a business intelligent workbench, wherein the test request is used for determining whether the advertisement putting can be accurately carried out when the advertisement putting is carried out, then the test request is analyzed and processed, the request type of the test request is determined, the test request is responded, a target information parameter corresponding to the request type of the test request is generated, a test result corresponding to the request type of the test request is generated based on the target information parameter and the request type of the test request, and finally the test result is sent to the business intelligent workbench so as to be convenient for the business intelligent workbench to carry out the advertisement putting according to the test result; therefore, the whole testing process of the business intelligent workbench does not need to interact with a real inventory algorithm testing environment, the condition that the inventory algorithm of the testing environment is unstable does not exist, the problem that the coupling of the business intelligent workbench and the inventory algorithm in the existing testing scheme is high is solved, the testing efficiency is improved, the normal operation of the testing process of the business intelligent workbench is ensured, and the risk of testing blockage is overcome.
Based on the foregoing embodiments, an embodiment of the present invention provides a method for testing advertisement delivery, which is shown in fig. 3 and includes the following steps:
And 303, analyzing the test request by the advertisement delivery test device to acquire a sending path of the test request.
Wherein the transmission path is carried in the test request.
Specifically, if the test request is determined to be a request for volume, the test stub returns a simple _ response: { "FjobResponse": [ { "status":200} for indicating that the request for traffic has been successfully received, and then the following process is followed.
Of course, in the present invention, if the transmission path of the test request does not carry the bimultidomain parameter, the request type of the test request may be determined according to the parameter specifically carried in the transmission path of the test request, for example, the test request may further include: update or cancel volume of inquiry or adjust proportion of crowd requests, inventory visualization requests, etc.
Specifically, if the transmission path of the test request includes the BiUpdate parameter, the advertisement delivery test apparatus determines that the request type of the test request is an update or cancellation query volume or an adjustment crowding proportion request.
For the request of updating or canceling the inquiry quantity or adjusting the occupation ratio, the real inventory algorithm needs to refresh the inventory occupation condition, but the processing result of the inventory algorithm does not need to be fed back to the BI workstation, and the BI workstation only concerns whether the inventory algorithm receives the request, so that the test pile does not need to further process the request, and only needs to return an empty _ response: { "status":200, indicating that the request has been successfully received, so the BI workbench will not be blocked, and the request has been successfully processed.
Specifically, optionally, if the sending path of the test request includes a bicpmvisualreturn parameter, the advertisement delivery test device determines that the request type of the test request is an inventory visualization request.
For the inventory visualization request, the BI workbench still only cares whether the inventory algorithm receives the request, so the instrumentation pile still only needs to return an empty _ response { "status":200} for the request, which indicates that the request has been successfully received, and the request has been successfully processed. Whether the visual specific information is pushed to the BI workstation or not does not block the main testing process of the BI workstation, so the visual specific information is not considered in the scope of the test pile.
Wherein the target information parameter comprises a query resource basic information parameter.
Specifically, the test stub generates information parameters required by the volume inquiry result corresponding to the volume inquiry request, filters irrelevant request parameters in the required information parameters, and finally packages the required information parameters into parameters in an easy-to-read JavaScript Object Notation (json) format for further executing the next process.
The basic information parameters of the polling resource may include: the inquiry amount request unique identification, the inquiry amount list number, the inquiry amount resource identification number, the inquiry amount date list, the inquiry amount advertisement position, the product form of the inquiry amount resource, the inquiry amount of CPU, the inquiry amount entity advertisement position identification number and other parameters.
It should be noted that, the basic information parameter of the query resource can be obtained through the following programming languages in the present invention:
of course, in the embodiment of the present invention, the target information parameter includes not only the basic information parameter of the polling resource, but also: inquiring the directional information parameter of the resource; the directional information parameters of the polling resource comprise: city orientation, age orientation, frequency control orientation, content orientation, and the like. In the polling request, the directional information parameter of the polling resource is not an information parameter necessary for the BI workstation to complete the test procedure, and whether to acquire the directional information parameter of the polling resource can be determined according to specific requirements.
The polling quantity result comprises a polling quantity return parameter.
Specifically, the test stub is used for simulating the volume query result of the real inventory algorithm, so that the volume query result returned to the BI workstation by the real inventory algorithm includes volume query return parameters, the test stub needs to generate and return, and the volume query return parameters include: response status code, unique identifier of request for volume, number of request for volume, date of request for volume, result of request for volume per day of each resource in request for volume date, result of total request for volume of each resource in request for volume date, etc. Of course, these parameters are the parameters that the test pile must be returned to the BI bench.
Of course, the query volume return parameter may also include: each entity advertisement position identification number, the inquiry quantity result of the entity advertisement position, the total stock of the entity advertisement position, the base guarantee quantity, the default priority base guarantee quantity, the influence ratio and other parameters. Of course, these query volume return parameters are not parameters that the test pile must return to the BI workstation, and specifically, whether to return to the BI workstation may be determined according to the acquired target information parameters.
The concrete description is as follows: if the Freel _ location _ id in the target information parameter of the query volume request has a corresponding parameter value, the test stub needs to return the Floc _ cpm _ info parameter in the query volume return parameter to the BI workbench; if Fproduct _ type in the target information parameter of the query volume request indicates that the product form is the first patch, bomber, first vision, then the test stub needs to return the Fguarantee _ cpm and Fdefault _ guarantee _ cpm parameters in the query volume return parameter to the BI workstation; if Fis _ cpu in the target information parameter of the query request is positive, the test stub needs to return Feffect _ uv _ ratio in the query return parameter to the BI workstation.
It should be noted that, the above query volume return parameter can be obtained through the following programming languages in the present invention:
Specifically, the query result returned to the BI workstation by the real inventory algorithm service is a structure body conforming to a protobuf protocol (pb protocol for short) format, and is pushed to the BI workstation after being serialized into string, and the BI workstation can only receive and analyze data in the protocol format. In order not to affect the analysis mechanism of the BI workbench, the test stub also needs to generate the query quantity result according to the same pb protocol format and serialize the query quantity result.
A protobuf extension plug-in can be installed on the test pile, and then a pb protocol bi _ interface _ proto file in an agreed request/response information format is converted into a library file bi _ interface _ pb2.Py which python can import; in this way, the query volume return parameter that needs to be returned in the side query volume result can be constructed as a query volume result structure by using the syntax and function of protobuf only by importing the py file into the code. And finally, serializing a query result structure into a string type by applying a self-contained SerialeToString () function of the protobuf, and transmitting the string type to a BI (business intelligence) workbench for use.
Specifically, the test pile can push the generated query quantity result to a call-back interface of the BI workbench; the callback interface is formed by splicing two parts, namely a fixed callback _ url and a jobid parameter. The test pile firstly splices a callback interface browsing address of the request according to the analyzed Fjobid, then establishes a hypertext transfer Protocol (HTTP) connection with a BI workbench, sends a test request, and pushes a query result to the callback interface browsing address. And closing the HTTP connection after detecting that the callback interface of the BI workbench normally receives the push.
In order to realize the interaction between the BI workbench and the test piles, the test piles are deployed on any one test machine (server), the test piles are started/stopped through a python script, the inventory estimation interface address of the BI workbench is configured to be the request receiving port address (39011 port) of the test piles, and fig. 4 shows the working effect after the test piles are started.
The test pile does not relate to inventory calculation, only constructs a plurality of query quantity return parameters, can generate query quantity results in a self-adaptive manner according to query quantity dates, can finish the steps of query quantity analysis, query quantity result generation and pushing in 1 second in actual measurement, and does not need long waiting for a BI workbench; the python service is a relatively stable service, and the situation of test blocking caused by unavailable inquiry service cannot occur; in addition, the deployment of the test pile only needs a python + protobuf framework, the occupied system memory is little during the operation, the test pile is very convenient to deploy on any test machine, and the test resource is not occupied additionally. And moreover, long-flow testing of the BI workbench is efficiently finished, and the testing efficiency of the BI workbench is improved by 20%.
It should be noted that, for the explanation of the same steps or related concepts in the present embodiment as in the other embodiments, reference may be made to the description in the other embodiments, and details are not described here.
The method for testing advertisement delivery provided by the embodiment of the invention receives a test request sent by a business intelligent workbench, wherein the test request is used for determining whether the advertisement delivery can be accurately carried out when the advertisement delivery is carried out, then the test request is analyzed, the request type of the test request is determined, the test request is responded, a target information parameter corresponding to the request type of the test request is generated, a test result corresponding to the request type of the test request is generated based on the target information parameter and the request type of the test request, and finally the test result is sent to the business intelligent workbench so as to be convenient for the business intelligent workbench to carry out the advertisement delivery according to the test result; therefore, the whole testing process of the business intelligent workbench does not need to interact with a real inventory algorithm testing environment, the condition that the inventory algorithm of the testing environment is unstable does not exist, the problem that the coupling of the business intelligent workbench and the inventory algorithm in the existing testing scheme is high is solved, the testing efficiency is improved, the normal operation of the testing process of the business intelligent workbench is ensured, and the risk of testing blockage is overcome.
Based on the foregoing embodiment, an embodiment of the present invention further provides a method for testing advertisement delivery, and as shown in fig. 5, the method for generating a daily query result for each resource in a query volume date in a query volume return parameter and a total query volume result for each query volume resource in the query volume date includes the following steps:
Specifically, a reference line is set in the test pile as a reference value for generating a total query quantity result, for example, the reference line bi _ cpm _ base =1000 for the query quantity result of each resource per day, then if the query quantity date is n days, the total query quantity result Fres _ response, and Fbi _ remaining _ cpm are 1000 × n; since the polling date is determined when the polling request is initiated, the total polling result also becomes a predictable value. Further, to test the flow distribution of the BI workbench, if the daily bookable amount is 1000, the flow automatic distribution becomes an average distribution, which is not favorable for observing the test result. Therefore, a change threshold value is set, step =200, and the daily inquiry result Fday _ res _ response, fbi _ remain _ cpm takes a random value in the range of [ bi _ cpm _ base-step, bi _ cpm _ base + step ], namely 800-1200; but the total polling volume result of the last day is subtracted by the total polling volume result of the previous day, and the total polling volume result is filled up to 1000 x n. If the request is the request of the virtual advertisement position, the result of the daily total inquiry amount is evenly distributed on each entity advertisement position. The reference lines bi _ cpm _ base and step are configurable.
As follows, the date of inquiry is 12.1 to 12.6, and 6 days are taken as an example: before initiating the polling amount, it is known that the total polling amount returned is 1000 × 6=6000, and if the examination is to be checked within 15% of the shortage, the demand amount is set to be <6900, and the daily polling amount results of 12.1 to 12.6 fluctuate randomly, and each request is different, it may be set to be 801 at 12 month and 1 day, 932 at 12 month and 1 day, 1174 at 12 month and 4 days, 1145 at 12 month and 5 at 12 month and 1039 at 12 month and 900 at 12 month and 6 days, as shown in fig. 6. Therefore, the query result generated by the self-adaptive strategy maintains the flexibility of the query result and retains the predictability of the query result, and the query result is linearly related to the query time, so that the test return parameter of the shortage scene test is convenient to prepare.
The advertisement putting test method provided by the embodiment of the invention solves the problems that the return value cannot be expected before the volume inquiry, and the preparation of the test return parameter (total volume inquiry result) is not facilitated; meanwhile, the strategy adopted by the test pile only considers the inquiry quantity date, does not consider other factors, and adaptively generates a total inquiry quantity result (the total quantity can be reserved) according to the inquiry quantity date, so that richer test scenes are supported, the inquiry quantity date is more flexible, and the preparation of test return parameters is more convenient.
Based on the foregoing embodiment, the advertisement delivery testing method provided by the embodiment of the present invention may be applied to the testing system shown in fig. 7, where the testing system is an interactive frame diagram of a testing pile and a BI workstation; wherein, the test stake comprises 4 main modules: a. a request receiving module: the system comprises a request receiving port, a request receiving module, a response module and a response module, wherein the request receiving port is used for judging the request type received by the request receiving port, returning different response messages aiming at different request types such as query volume, update/cancel, visualization and the like, and judging whether to transfer to other three modules; b. a query request analysis module: the system comprises a request generation module, a request analysis module, a data acquisition module and a data processing module, wherein the request generation module is used for analyzing a request for inquiring quantity, removing irrelevant request parameters and reserving parameters required for generating a corresponding result of inquiring quantity to obtain target information parameters; c. the inquiry quantity result generating module: the method is used for adaptively generating expected volume inquiry results according to volume inquiry requests, and comprises the steps of constructing a total volume inquiry result (a predeterminable total volume) and a daily volume inquiry result (a predeterminable volume per day) of volume inquiry resources, and converting the volume inquiry results into a well agreed protocol format; d. the query quantity result pushing module: and the callback interface is used for pushing the generated query volume result to the BI workbench.
An embodiment of the present invention provides an advertisement placement testing apparatus 5, which can be applied to an advertisement placement testing method provided in the embodiments corresponding to fig. 1 to 3 and 5, and as shown in fig. 8, the apparatus includes: a receiving unit 51, an acquiring unit 52, a first generating unit 53, a second generating unit 54, and a transmitting unit 55, wherein:
and the receiving unit 51 is used for receiving the test request sent by the business intelligent workbench.
The test request is used for determining whether the advertisement can be accurately put when the advertisement is put.
The obtaining unit 52 is configured to perform parsing processing on the test request, and determine a request type of the test request.
The first generating unit 53 is configured to generate, in response to the test request, a target information parameter corresponding to a request type of the test request.
And a second generating unit 54, configured to generate a test result corresponding to the request type of the test request based on the target information parameter and the request type of the test request.
And the sending unit 55 is configured to send the test result to the intelligent business workbench, so that the intelligent business workbench can conveniently deliver the advertisement according to the test result.
The test device for advertisement putting provided by the embodiment of the invention receives a test request sent by a business intelligent workbench, wherein the test request is used for determining whether the advertisement putting can be accurately carried out when the advertisement putting is carried out, then the test request is analyzed and processed, the request type of the test request is determined, the test request is responded, a target information parameter corresponding to the request type of the test request is generated, a test result corresponding to the request type of the test request is generated based on the target information parameter and the request type of the test request, and finally the test result is sent to the business intelligent workbench so as to be convenient for the business intelligent workbench to carry out the advertisement putting according to the test result; therefore, the whole testing process of the business intelligent workbench does not need to interact with a real inventory algorithm testing environment, the condition that the inventory algorithm of the testing environment is unstable does not exist, the problem that the coupling of the business intelligent workbench and the inventory algorithm in the existing testing scheme is high is solved, the testing efficiency is improved, the normal operation of the testing process of the business intelligent workbench is ensured, and the risk of testing blockage is overcome.
Further, as shown in fig. 9, the apparatus further includes: a setting unit 56, wherein:
a setting unit 56 is used for receiving the request receiving port of the test request.
Correspondingly, the receiving unit 51 is specifically configured to perform the following steps:
and receiving a test request sent by the business intelligent workbench through the request receiving port.
Specifically, as shown in fig. 9, the acquiring unit 52 includes: a first obtaining module 521 and a determining module 522, wherein:
the first obtaining module 521 is configured to perform parsing on the test request to obtain a sending path of the test request.
Wherein the transmission path is carried in the test request.
The determining module 522 is configured to determine a request type of the test request based on a parameter of a transmission path of the test request.
Further, the determining module 522 is specifically configured to perform the following steps:
and if the sending path of the test request comprises the BiMultiRemain parameter, determining the request type of the test request as a request for volume inquiry.
And if the transmission path of the test request comprises the BiUpdate parameter, determining the request type of the test request to be a request for updating or canceling the query volume or adjusting the proportion of the occupation.
And if the sending path of the test request comprises a BICPmVisualRemain parameter, determining the request type of the test request to be an inventory visualization request.
Specifically, referring to fig. 10, the first generation unit 53 includes: a first generating module 531 and a second obtaining module 532, wherein:
the first generating module 531 is configured to, if the request type of the test request is a volume query request, respond to the volume query request and generate information parameters required for a volume query result corresponding to the volume query request.
The second obtaining module 532 is configured to filter the required information parameter according to a preset rule to obtain a target information parameter corresponding to the request for volume inquiry.
Wherein the target information parameter comprises a query resource basic information parameter.
The basic information parameters of the polling resource comprise: the inquiry amount request unique identification, the inquiry amount list number, the inquiry amount resource identification number, the inquiry amount date list, the inquiry amount advertisement position, the product form of the inquiry amount resource, the inquiry amount of CPU and the inquiry amount entity advertisement position identification number.
Further, the target information parameter further includes: and (4) orientation information parameters of the polling resources.
Specifically, referring to fig. 10, the second generating unit 54 includes: a second generation module 541 and a conversion module 542, wherein:
the second generating module 541 is configured to generate, if the request type of the test request is an inquiry quantity request, an inquiry quantity result corresponding to the inquiry quantity request based on the target information parameter.
The polling quantity result comprises a polling quantity return parameter.
The converting module 542 is configured to convert the format of the query volume return parameter into a preset format.
Correspondingly, the sending unit 55 is specifically configured to execute the following steps:
and sending the query volume return parameter with the preset format to the business intelligent workbench.
Wherein the query volume return parameter comprises: the response status code, the unique identifier of the request for the amount of inquiry, the number of the inquiry amount list, the inquiry amount date, the result of the daily inquiry amount of each resource in the inquiry amount date and the result of the total inquiry amount of each inquiry amount resource in the inquiry amount date.
Further, referring to fig. 10, the second generating unit 54 further includes: a setting module 543 and a third obtaining module 544, wherein:
the setting module 543 is used for setting the polling date and the daily polling result of each resource in the polling date.
The third obtaining module 544 is configured to obtain a total polling amount result of each polling resource in the polling amount date according to the polling amount date and the daily polling amount result of each resource in the polling amount date.
It should be noted that, in the embodiment, the interaction process between each unit and each module may refer to the interaction process in the advertisement delivery test method provided in the embodiments corresponding to fig. 1 to 3 and 5, and details are not described here.
The test device for advertisement putting provided by the embodiment of the invention receives a test request sent by a business intelligent workbench, wherein the test request is used for determining whether the advertisement putting can be accurately carried out when the advertisement putting is carried out, then the test request is analyzed and processed, the request type of the test request is determined, the test request is responded, a target information parameter corresponding to the request type of the test request is generated, a test result corresponding to the request type of the test request is generated based on the target information parameter and the request type of the test request, and finally the test result is sent to the business intelligent workbench so as to be convenient for the business intelligent workbench to carry out the advertisement putting according to the test result; therefore, the whole testing process of the business intelligent workbench does not need to interact with a real inventory algorithm testing environment, the condition that the inventory algorithm of the testing environment is unstable does not exist, the problem that the coupling of the business intelligent workbench and the inventory algorithm in the existing testing scheme is high is solved, the testing efficiency is improved, the normal operation of the testing process of the business intelligent workbench is ensured, and the risk of testing blockage is overcome.
An embodiment of the present invention provides an advertisement placement test device 6, which can be applied to the advertisement placement test method provided in the embodiments corresponding to fig. 1 to 3 and 5, and as shown in fig. 11, the device includes: a processor 61 and a communication interface 62, wherein:
the processor 61 is used for receiving a test request sent by the business intelligent workbench through the communication interface 62; the test request is used for determining whether the advertisement can be accurately put when the advertisement is put; analyzing the test request, and determining the request type of the test request; responding to the test request, and generating a target information parameter corresponding to the request type of the test request; generating a test result corresponding to the request type of the test request based on the target information parameter and the request type of the test request; the test results are also sent to the business intelligence workbench via the communication interface 62 to facilitate advertising by the business intelligence workbench based on the test results.
It should be noted that, in the interaction process between the processor and the communication interface in this embodiment, reference may be made to the interaction process in the advertisement delivery test method provided in the embodiments corresponding to fig. 1 to 3 and 5, and details are not described here.
The test equipment for advertisement delivery provided by the embodiment of the invention receives a test request sent by a business intelligent workbench, wherein the test request is used for determining whether the advertisement delivery can be accurately carried out when the advertisement delivery is carried out, then the test request is analyzed, the request type of the test request is determined, the test request is responded, a target information parameter corresponding to the request type of the test request is generated, a test result corresponding to the request type of the test request is generated based on the target information parameter and the request type of the test request, and finally the test result is sent to the business intelligent workbench so as to be convenient for the business intelligent workbench to carry out the advertisement delivery according to the test result; therefore, the whole testing process of the business intelligent workbench does not need to interact with a real inventory algorithm testing environment, the condition that the inventory algorithm of the testing environment is unstable does not exist, the problem that the coupling of the business intelligent workbench and the inventory algorithm in the existing testing scheme is high is solved, the testing efficiency is improved, the normal operation of the testing process of the business intelligent workbench is ensured, and the risk of testing blockage is overcome.
In practical applications, the receiving Unit 51, the obtaining Unit 52, the first generating Unit 53, the second generating Unit 54, the sending Unit 55, the setting Unit 56, the first obtaining module 521, the determining module 522, the first generating module 531, the second obtaining module 532, the second generating module 541, the converting module 542, the setting module 543, and the third obtaining module 544 can all be implemented by a Central Processing Unit (CPU), a Microprocessor (MPU), a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), or the like, which are located in the wireless data sending device.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention.
Claims (13)
1. The method is applied to a test device for advertisement putting, the test device is used for replacing a real inventory algorithm test environment in a test pile mode, and the inventory algorithm test environment is coupled with a business intelligent workbench;
the method comprises the following steps:
receiving a test request sent by a business intelligent workbench; the test request is used for determining whether the advertisement can be accurately put when the advertisement is put;
analyzing the test request to obtain a sending path of the test request; wherein the sending path is carried in the test request;
determining a request type of the test request based on parameters of a sending path of the test request, wherein target information parameters corresponding to all request types of the test request are stored in the test device in advance;
responding to the test request, and generating a target information parameter corresponding to the request type of the test request;
when the request type of the test request is any one of an update request, a request for canceling an inquiry amount, a request for adjusting an occupation proportion and a stock visualization request, sending a state value indicating that the test request is successfully received to the business intelligent workbench so that the business intelligent workbench determines that the test request is processed;
when the request type of the test request is a volume inquiry request, responding to the volume inquiry request, generating information parameters required by a volume inquiry result corresponding to the volume inquiry request, filtering the required information parameters according to a preset principle to obtain target information parameters corresponding to the volume inquiry request, and generating the volume inquiry result corresponding to the volume inquiry request based on the target information parameters; the target information parameters comprise basic information parameters of quantity inquiry resources, the quantity inquiry result comprises quantity inquiry return parameters, and the quantity inquiry return parameters are parameters generated by simulating the real inventory algorithm test environment by the test piles;
converting the format of the query volume return parameter into a preset format, wherein the preset format is a protocol format followed by the query volume result returned to the business intelligent workbench by the real inventory algorithm test environment;
and sending the inquiry quantity return parameter with the preset format to the business intelligent workbench so as to facilitate the business intelligent workbench to carry out advertisement delivery according to the inquiry quantity return parameter.
2. The method of claim 1, further comprising:
setting a request receiving port for receiving the test request;
correspondingly, the receiving of the test request sent by the business intelligence workbench includes:
and receiving the test request sent by the business intelligent workbench through the request receiving port.
3. The method of claim 1, wherein the determining the request type of the test request based on the parameter of the transmission path of the test request comprises:
if the sending path of the test request comprises a BiMultiRemain parameter, determining the request type of the test request as a volume inquiry request;
if the sending path of the test request comprises a BiUpdate parameter, determining the request type of the test request as a request for updating or canceling the query volume or adjusting the proportion of the squeeze ratio;
and if the sending path of the test request comprises a BICPmVisualRemain parameter, determining that the request type of the test request is an inventory visualization request.
4. The method of claim 1, wherein the query resource basic information parameter comprises: the inquiry amount request unique identification, the inquiry amount bill number, the inquiry amount resource identification number, the inquiry amount date list, the inquiry amount advertisement position, the product form of the inquiry amount resource, the inquiry amount of CPU and the inquiry amount entity advertisement position identification number.
5. The method of claim 1, wherein the target information parameter further comprises: a directional information parameter of the polling resource.
6. The method of claim 1, wherein the query volume return parameter comprises: the response status code, the unique identifier of the volume inquiry request, the number of the volume inquiry sheet, the volume inquiry date, the daily volume inquiry result of each resource in the volume inquiry date, and the total volume inquiry result of each volume inquiry resource in the volume inquiry date.
7. The method of claim 6, wherein generating a daily polling amount result for each resource in the polling amount date and a total polling amount result for each polling amount resource in the polling amount date in the polling amount return parameter comprises:
setting the polling amount date and the daily polling amount result of each resource in the polling amount date;
and obtaining the total inquiry quantity result of each inquiry quantity resource in the inquiry quantity date according to the inquiry quantity date and the daily inquiry quantity result of each resource in the inquiry quantity date.
8. A test device for advertisement placement, the test device for replacing a real inventory algorithm test environment by means of test stakes, the inventory algorithm test environment being coupled to a business intelligence workstation, the device comprising: a receiving unit, an obtaining unit, a first generating unit, a second generating unit and a sending unit, wherein the first generating unit comprises a first generating module and a second obtaining module, the second generating unit comprises a second generating module and a converting module,
the receiving unit is used for receiving a test request sent by the business intelligent workbench; the test request is used for determining whether the advertisement can be accurately put when the advertisement is put;
the obtaining unit is configured to analyze the test request and obtain a sending path of the test request; wherein the transmission path is carried in the test request; determining a request type of the test request based on parameters of a sending path of the test request, wherein target information parameters corresponding to all request types of the test request are stored in the test device in advance;
the first generating unit is used for responding to the test request and generating a target information parameter corresponding to the request type of the test request;
the first generating unit is further configured to send a status value indicating that the test request has been successfully received to the business intelligence workbench when the request type of the test request is any one of an update request, a request for canceling an inquiry amount, a request for adjusting an occupation proportion and a request for stock visualization, so that the business intelligence workbench determines that the test request has been processed;
the first generating module is used for responding to the volume inquiry request and generating information parameters required by a volume inquiry result corresponding to the volume inquiry request when the request type of the test request is the volume inquiry request;
the second obtaining module is configured to filter the required information parameter according to a preset principle to obtain a target information parameter corresponding to the request for volume inquiry; the target information parameter comprises a query resource basic information parameter;
the second generating module is configured to generate a volume inquiry result corresponding to the volume inquiry request based on the target information parameter if the request type of the test request is the volume inquiry request; the quantity inquiry result comprises quantity inquiry return parameters which are generated by simulating the real inventory algorithm test environment by the test piles;
the conversion module is used for converting the format of the query quantity return parameter into a preset format, wherein the preset format is a protocol format followed by the query quantity result returned to the business intelligent workbench by the real inventory algorithm test environment;
and the sending unit is used for sending the inquiry quantity return parameter with the preset format to the business intelligent workbench so as to facilitate the business intelligent workbench to carry out advertisement delivery according to the inquiry quantity return parameter.
9. The apparatus of claim 8, further comprising: a setting unit, wherein:
the setting unit is used for setting a request receiving port for receiving the test request;
correspondingly, the receiving unit is specifically configured to: and receiving the test request sent by the business intelligent workbench through the request receiving port.
10. The apparatus of claim 8, wherein the second generating unit further comprises: a setting module and a third obtaining module, wherein:
the setting module is used for setting the polling amount date and the daily polling amount result of each resource in the polling amount date;
and the third obtaining module is used for obtaining a total inquiry quantity result of each inquiry quantity resource in the inquiry quantity date according to the inquiry quantity date and the daily inquiry quantity result of each resource in the inquiry quantity date.
11. A test device for advertisement placement, the device comprising: a processor and a communication interface, wherein:
the processor is used for receiving a test request sent by the business intelligent workbench through the communication interface; the test request is used for determining whether the advertisement can be accurately put when the advertisement is put; analyzing the test request to obtain a sending path of the test request; the sending path is carried in the test request, and the request type of the test request is determined based on the parameters of the sending path of the test request; target information parameters corresponding to all request types of the test request are stored in a testing device in advance, the testing device is used for replacing a real inventory algorithm testing environment in a testing pile mode, and the inventory algorithm testing environment is coupled with a business intelligent workbench; responding to the test request, and generating a target information parameter corresponding to the request type of the test request; when the request type of the test request is any one of an update request, a request for canceling an inquiry amount, a request for adjusting an occupation proportion and a stock visualization request, sending a state value indicating that the test request is successfully received to the business intelligent workbench so that the business intelligent workbench determines that the test request is processed; when the request type of the test request is a volume inquiry request, responding to the volume inquiry request, generating information parameters required by a volume inquiry result corresponding to the volume inquiry request, filtering the required information parameters according to a preset principle to obtain target information parameters corresponding to the volume inquiry request, and generating the volume inquiry result corresponding to the volume inquiry request based on the target information parameters; the target information parameters comprise basic information parameters of quantity inquiry resources, the quantity inquiry result comprises quantity inquiry return parameters, and the quantity inquiry return parameters are parameters generated by simulating the real inventory algorithm test environment by the test piles; converting the format of the query volume return parameter into a preset format, wherein the preset format is a protocol format followed by the query volume result returned to the business intelligent workbench by the real inventory algorithm test environment; and sending the inquiry quantity return parameter with the preset format to the business intelligent workbench through the communication interface so as to facilitate the business intelligent workbench to carry out advertisement delivery according to the inquiry quantity return parameter.
12. An apparatus for testing advertisement placement, the apparatus comprising:
a memory for storing executable instructions;
a processor for implementing the method of testing for ad placement of any of claims 1-7 when executing executable instructions stored in the memory.
13. A computer-readable storage medium having stored thereon executable instructions for, when executed by a processor, implementing the method for testing advertisement placement of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710090722.4A CN108460612B (en) | 2017-02-20 | 2017-02-20 | Advertisement delivery test method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710090722.4A CN108460612B (en) | 2017-02-20 | 2017-02-20 | Advertisement delivery test method, device and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108460612A CN108460612A (en) | 2018-08-28 |
| CN108460612B true CN108460612B (en) | 2023-01-06 |
Family
ID=63221614
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710090722.4A Active CN108460612B (en) | 2017-02-20 | 2017-02-20 | Advertisement delivery test method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108460612B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109614314B (en) * | 2018-11-01 | 2024-03-01 | 北京奇虎科技有限公司 | Performance test method, device, server and readable storage medium |
| CN111324524A (en) * | 2018-12-14 | 2020-06-23 | 北京奇虎科技有限公司 | Advertisement stability testing method and device |
| CN110020894B (en) * | 2019-04-03 | 2022-12-27 | 腾讯科技（深圳）有限公司 | Information processing method and device and server |
| CN111210280A (en) * | 2020-01-14 | 2020-05-29 | 北京达佳互联信息技术有限公司 | Content item conversion tracking method, device, terminal, server and medium |
| CN113011910B (en) * | 2021-01-18 | 2023-08-08 | 腾讯科技（深圳）有限公司 | Data processing method and device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104461903A (en) * | 2014-12-26 | 2015-03-25 | 北京奇虎科技有限公司 | Method and device for testing client side based on browser |
| CN105721251A (en) * | 2016-03-04 | 2016-06-29 | 深圳市分期乐网络科技有限公司 | Reconfigurable testing pile service method and system |
| CN106027330A (en) * | 2016-05-23 | 2016-10-12 | 中国银行股份有限公司 | Message testing method for front-end system, and simulation baffle system |
| EP3097662A1 (en) * | 2014-01-24 | 2016-11-30 | Ixia | Methods, systems and computer readable media for testing network devices using simulated application traffic |
| CN106294113A (en) * | 2015-06-03 | 2017-01-04 | 阿里巴巴集团控股有限公司 | A kind of creation method based on programmable type testing service and device |
-
2017
- 2017-02-20 CN CN201710090722.4A patent/CN108460612B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3097662A1 (en) * | 2014-01-24 | 2016-11-30 | Ixia | Methods, systems and computer readable media for testing network devices using simulated application traffic |
| CN104461903A (en) * | 2014-12-26 | 2015-03-25 | 北京奇虎科技有限公司 | Method and device for testing client side based on browser |
| CN106294113A (en) * | 2015-06-03 | 2017-01-04 | 阿里巴巴集团控股有限公司 | A kind of creation method based on programmable type testing service and device |
| CN105721251A (en) * | 2016-03-04 | 2016-06-29 | 深圳市分期乐网络科技有限公司 | Reconfigurable testing pile service method and system |
| CN106027330A (en) * | 2016-05-23 | 2016-10-12 | 中国银行股份有限公司 | Message testing method for front-end system, and simulation baffle system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108460612A (en) | 2018-08-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108460612B (en) | Advertisement delivery test method, device and equipment | |
| CN108632101B (en) | Method and apparatus for updating configuration object, edge computing device, and medium | |
| CN109213597A (en) | Resource allocation methods, device, computer equipment and computer readable storage medium | |
| CN104834602B (en) | A kind of program dissemination method, device and program delivery system | |
| CN105593835A (en) | Managing a number of secondary clouds by a master cloud service manager | |
| CN109447610A (en) | Method and apparatus for determining payment channel | |
| CN103176790A (en) | Application releasing method and application releasing system | |
| CN110401720A (en) | Information processing method, device, system, application server and medium | |
| CN111127154A (en) | Order processing method, device, server and nonvolatile storage medium | |
| CN105208125A (en) | Message transmission method, device and system | |
| CN109246201A (en) | cloud resource delivery method, processor and storage medium | |
| CN110533536A (en) | Transaction risk appraisal procedure, device and computer system | |
| CN101615116B (en) | Method, device and system for acquiring interface | |
| CN108512869A (en) | A kind of method and system handling concurrent data using asynchronization mode | |
| CN109348434A (en) | A kind of sending method of scene information, sending device and terminal device | |
| CN111401991A (en) | Data information distribution method and device, storage medium and computer equipment | |
| CN107895289A (en) | A kind of task dissemination method and device | |
| CN109831474B (en) | Keep-alive system, method, server and readable storage medium for http long connection | |
| CN104683473A (en) | Service quality monitoring method, server side, client and system | |
| CN103873558B (en) | The processing method of a kind of business object based on third-party platform and system | |
| CN109344351B (en) | Webpage loading method, intermediate server and webpage loading system | |
| CN109600321A (en) | Message forwarding method and device | |
| CN110363566A (en) | Resource object distribution method, device, storage medium and computer equipment | |
| CN105988932B (en) | A kind of test method and system of ESB | |
| CN110311977A (en) | A kind of formal verification platform and its method based on cloud computing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |