CN110427323A - A kind of application testing method, device, proxy server and system - Google Patents
A kind of application testing method, device, proxy server and system Download PDFInfo
- Publication number
- CN110427323A CN110427323A CN201910690397.4A CN201910690397A CN110427323A CN 110427323 A CN110427323 A CN 110427323A CN 201910690397 A CN201910690397 A CN 201910690397A CN 110427323 A CN110427323 A CN 110427323A
- Authority
- CN
- China
- Prior art keywords
- page
- response
- client
- proxy server
- fault message
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Abstract
The invention discloses a kind of application testing methods, suitable for being executed in proxy server, the method comprising the steps of: receiving the page to certain page in target application that client is sent and starts request, page starting request includes the sole task mark and one or more interface requests of this starting；The response contents of each interface requests are intercepted, each response contents include multiple fields, and multiple field has hierarchical relationship；The boundary value of a certain type is uniformly revised as to the same layer field in each response contents according to pre-defined rule, and modified response is returned into client and is run；And judge that the sole task has identified whether corresponding fault message from the fault message that client reports, if so, the fault message and corresponding response are then carried out auto-associating.The present invention also discloses corresponding application test device and system together.
Description
Technical field
The present invention relates to automatic test field more particularly to a kind of application testing method, device, proxy server and it is
System.
Background technique
With becoming increasingly popular for intelligent mobile terminal, more and more developers put into the application and development for moving terminal device
In, and applying test is important link indispensable in application development process.Whether will be seen that application by application test
There are mistake, whether operational process or operation result meet the expected requirements.Robustness testing is tested as a kind of application, mainly
For test macro when breaking down, if can restore or ignore failure to continue to run automatically.
Usually there are two types of modes for the robustness testing of application.One is unit testing is write, as Android passes through PowerMock
Equal third parties' Open Framework carries out mock to network request method.But unit testing be only suitable for it is small for interface Context-dependent
Code, for rely on by force context such as Activity, method in the components such as Service, its main feature is that most of for private
There is method and related to its life cycle, can not directly carry out unit testing.And the cost of this mode is relatively high, needs depth
Enter code logic.Another kind is that packet capturing mock data are realized by the packet catcher of such as Charles, Fiddle etc., needs people
Work modifies the field in interface one by one and carries out mock, and cost is very high, and application can generally request multiple interfaces simultaneously, manually
It carries out mock and is well over application request duration, once few a quotation marks or comma more than one can all cause to malfunction, and when hair
It needs manually to record the value of mock and scene after existing problem, bug recorded cost is very high, is not easy to file.
Summary of the invention
In view of the above problems, the invention proposes a kind of application testing method, device, proxy server and systems, with power
Diagram certainly or above at least solving the problems, such as exists.
According to an aspect of the invention, there is provided a kind of application testing method should suitable for executing in proxy server
Method starts request, page starting request comprising steps of receiving the page to certain page in target application that client is sent
Sole task mark and one or more interface requests including this starting；The response contents of each interface requests are intercepted, each
Response contents include multiple fields, and the multiple field has hierarchical relationship；According to pre-defined rule in each response contents
Same layer field be uniformly revised as the boundary value of a certain type, and modified response is returned into client and is transported
Row；And judge that the sole task has identified whether corresponding fault message from the fault message that client reports, if so,
The fault message and corresponding response are then subjected to auto-associating.
Optionally, in application according to the present invention test method, the type of boundary value is comprised at least one of the following: random
Character string, overlength character string, special string, integer, single-precision floating point type, double-precision floating point type, the time, array, Boolean type,
Url, mailbox, IP, picture, expression, empty array, empty object, null, undefined.
Optionally, in application according to the present invention test method, pre-defined rule includes: successively to modify each response contents
Field, modify the same layer field of all response contents every time, and this layer of field is revised as same type of side every time
Dividing value；And after by all types of boundary values of one layer of field traversal, then modify next layer of all response contents
Field.
Optionally, in application according to the present invention test method, after modified response is returned to client, also
Comprising steps of by the sole task mark of this starting, page iden-tity, the level modified and boundary Value Types, device identification
It is sent in message queue between when operation starts, thinks to complete a page test assignment at this time.
Optionally, in application according to the present invention test method, target application includes multiple page iden-tities, and this method is also
Comprising steps of clear up the test environment of target application after page test assignment of every completion, and carry out other page iden-tities or
The page test assignment of other levels or other boundary Value Types, until completing all of all levels under all page iden-tities
The page test assignment of boundary Value Types.
Optionally, in application according to the present invention test method, page starting request is sent by schema mode, and
The field of each response contents is at most divided into ten levels.
Optionally, in application according to the present invention test method, proxy server and multiple client are communicated to connect, often
A client all includes the target application, and this method, which is further comprised the steps of:, distributes to multiple client for multiple page iden-tities, and deposits
Device identification and the incidence relation table for the page iden-tity distributed of client are stored up, so as to each page iden-tity institute of each client executing
Corresponding page test assignment.
Optionally, it in application according to the present invention test method, further comprises the steps of: and distributes multiple types of boundary value
To multiple client, and device identification and the incidence relation table of the boundary Value Types distributed of each client are stored, so as to each
Client executes the border value testing of corresponding types to each page.
Optionally, in application according to the present invention test method, interface requests include service class interface requests and non-industry
Business class interface requests, the proxy server only modify the response contents of service class interface requests.
Optionally, in application according to the present invention test method, service class interface is also stored in proxy server
Domain name white list, this method further comprise the steps of: the domain name value in the request header for obtaining each interface requests, and according to the white name of domain name
It is single to identify service class interface requests therein.
Optionally, in the method according to the invention, service class interface is related to application interface logic, non-traffic class interface
Including burying point interface and advertisement exposure request interface.
Optionally, in application according to the present invention test method, building marginal testing spectacle case is further comprised the steps of:, and
The marginal testing spectacle case is sent to client to install, which supports mock function, interface log
Upload function and interface respond upload function.
Optionally, in application according to the present invention test method, fault message that client reports in the process of running
Sole task mark, service class interface requests and corresponding response when including breaking down.
Optionally, in application according to the present invention test method, fault message is reported with JSON format, further includes setting
At least one of standby mark, Network status, application version information, software package title and exception stack information.
Optionally, in application according to the present invention test method, consumption message queue is further comprised the steps of:, is taken out one by one
Sole task mark, and whether corresponding fault message is had according to sole task mark inquiry；If so, then determining the secondary operation
Boundary value exist it is abnormal, and will the fault message and corresponding message queue information carry out auto-associating after be sent to tester
Member.
According to another aspect of the present invention, a kind of application testing method is provided, comprising: client passes through agency service
Device is sent to service server starts request to the page of certain page in target application, and page starting request includes this starting
Sole task mark and one or more interface requests；Each interface requests that proxy server interception service server returns
Response contents, each response contents include multiple fields, and the multiple field has hierarchical relationship；Proxy server is according to pre-
Set pattern is then uniformly revised as the boundary value of a certain type to the same layer field in each response contents, and by modified response
Value returns to client；Client runs the response, and reports current event from trend service server when breaking down
Hinder information, which includes current sole task mark；And proxy server is sentenced from the record reported
The sole task that breaks has identified whether corresponding fault message, if so, then carrying out the fault message and corresponding response
Auto-associating.
According to another aspect of the present invention, provide it is a kind of using test device, suitable for residing in proxy server,
The device includes: request receiving module, starts request suitable for receiving the page to certain page in target application that client is sent,
Page starting request includes the sole task mark and one or more interface requests of this starting；Blocking module is responded, is fitted
In the response contents for intercepting each interface requests, each response contents include multiple fields, and multiple field has hierarchical relationship；It rings
Modified module is answered, suitable for being uniformly revised as the side of a certain type to the same layer field in each response contents according to pre-defined rule
Dividing value, and modified response is returned into client operation；And failure analysis module, suitable for the event reported from client
Judge that the sole task has identified whether corresponding fault message in barrier information, if so, then by the fault message and corresponding sound
Carry out auto-associating should be worth.
According to another aspect of the invention, a kind of proxy server is provided, comprising: one or more processors；Memory；
And one or more programs, wherein one or more programs store in memory and are configured as being handled by one or more
The step of device executes, which realizes application testing method as described above when being executed by processor.
According to another aspect of the invention, a kind of readable storage medium storing program for executing storing one or more programs is provided, this
Or multiple programs include instruction, described instruction realizes the step of application testing method as described above when being executed by proxy server
Suddenly.
According to the technique and scheme of the present invention, by intercepting the network request of application end, interface is responded according to pre-defined rule
It is revised as the data return value of non-standard.It carries out only modifying a kind of boundary value class under a response level when mock modification every time
Type is responded by hierarchical modification interface, the abnormal logic as much as possible for traversing application end.On the other hand the present invention is automatic receives
Failure (crash) information for collecting application end carries out auto-associating with the mock data modified, tester is facilitated to find in time
The defects of program and loophole reduce exception and reduce the human cost of robustness testing.Moreover, the present invention can also to application end
Numerical Boundary value existing for energy defines a variety of (such as 18 kinds) types, and supports only to single equipment mock and only to business
Class interface mock, without influencing other users normal use.
Further, the present invention is application end each page setup schema, can directly open any page, so that
The executory cost for reaching the page is minimum, also improves the stability of automatic test.Operation can be remembered according to sole task mark
Record, crash information, interface requests and response data associate, and are convenient for orientation problem reason.The program can it is full automatic,
Without manually running on dutyly, and it is designed that mock rule is general suitable for total interface, without suitable according to physical interface
Match, so maintenance cost is extremely low.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention,
And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can
It is clearer and more comprehensible, the followings are specific embodiments of the present invention.
Detailed description of the invention
To the accomplishment of the foregoing and related purposes, certain illustrative sides are described herein in conjunction with following description and drawings
Face, these aspects indicate the various modes that can practice principles disclosed herein, and all aspects and its equivalent aspect
It is intended to fall in the range of theme claimed.Read following detailed description in conjunction with the accompanying drawings, the disclosure it is above-mentioned
And other purposes, feature and advantage will be apparent.Throughout the disclosure, identical appended drawing reference generally refers to identical
Component or element.
Fig. 1 shows the structural block diagram of application test systems 100 according to an embodiment of the invention；
Fig. 2 shows the structure charts according to an embodiment of the invention for calculating equipment 200；
Fig. 3 shows the application testing method 300 according to an embodiment of the invention executed in proxy server
Flow chart；
Fig. 4 shows the signal of multiple field hierarchical relationships of interface response contents according to an embodiment of the invention
Figure；
Fig. 5 shows the flow chart of application testing method 500 in accordance with another embodiment of the present invention；
Fig. 6 shows the application testing method of another embodiment according to the present invention executed in application test systems
600 flow chart；And
Fig. 7 shows the structure chart according to an embodiment of the invention using test device 700；
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
It is fully disclosed to those skilled in the art.
Fig. 1 shows the schematic diagram of application test systems 100 according to an embodiment of the invention.As shown in Figure 1, using
It include one or more clients 110 (such as client 1-3), proxy server 120 and service server in test macro 100
130.Proxy server 120 is communicated to connect with client 110 and service server 130 respectively, in client 110 and business
The forwarding for making requests and responding between server 130.According to one embodiment, proxy server 120 can be anyproxy
Proxy server.
It is mounted on target application in each client 110, and is imported into trusted https certificate to realize mock interface
Function is additionally provided with proxy server mechanism in client 110.In this way client 110 send all requests and response just
It will be forwarded by proxy server 120.It is also equipped with marginal testing spectacle case in client 110, supports mock function
Energy, interface log (including interface requests and response) upload function.Wherein, interface log upload is by 110 network of client
The switch of component is requested to control, marginal testing spectacle case can open interface log and upload switch, and request and response all can every time
Upload to the service server 130 of rear end.
In general, target application includes multiple application pages, in order to guarantee stability and high efficiency using test, the present invention
It is provided with schema for each page, any one page can be directly initiated by schema, and in starting schema
This starting of Shi Huiwei generates a sole task mark, passes to target application as schema parameter.Here, scheme is
Agreement is jumped in a kind of page, each page in application, lattice very convenient can be jumped to by customized scheme agreement
Does is formula, for example, autohome: //cardetail/goodsDetail task_id=b27214cba92b11e99bd090b11c
30468d。
It should be understood that a page can may rely on multiple interfaces simultaneously, therefore the page that client 110 is sent opens
Dynamic request would generally include one or more interface requests.It may include service class interface and non-traffic interface in these interfaces.
The field that service class interface, that is, interface returns is related to application interface logic, and non-traffic interface such as buries a request interface, advertisement exposes
Light request interface etc. is displayed without direct pass with using normal interface primarily to operation counts and checks and writes off what advertisement used
System.And when doing using test, proxy server 120 responds by the way of excluding for non-traffic class interface requests,
Its response contents for only modifying service class interface, and the response contents for non-traffic class interface of directly letting pass.
It is, proxy server 120 when receiving these interface requests, can identify that service class interface therein is asked
It asks, and is run to being returned again to after the response of service class interface requests progress mock modification to client 110.In general, agency
It can store the domain name white list of a service class interface in server 120, it is contemplated that the request header category of interface requests (https)
Property in HOST field value be current request domain name.Therefore, it when proxy server 120 receives interface requests, can obtain
Domain name value in the request header of interface requests, and service class interface requests therein are identified according to the domain name white list, and to industry
The response contents of business class interface requests are modified.If HOST field is non-business interface domain name, such as bury point interface domain name or
Ad interface domain name etc. does not execute mock logic then, and the original response for burying point interface and ad interface is returned to client
110.After the response for excluding non-traffic class interface requests in this way, the number of request for needing to do mock rule process is greatly reduced
Amount, improves the efficiency of marginal testing.
Service server 130 can handle request and return to request response, and can collect client 110 in operational process
In report oneself failure (crash) information automatically, which generally includes currently running equipment state and is locating
Request and response of reason etc..
It should be pointed out that the application test systems 100 in Fig. 1 are merely exemplary, and in specific practice situation, system
Can there are the proxy server 120 and service server 130 of different number in 100, the present invention is to included each in system 100
Number of devices is with no restrictions.Moreover, proxy server 120 and service server 130 may each be an individual server,
It can be the server cluster consisted of several servers or a cloud computing service center, for forming server
Cluster or multiple servers of cloud computing service center may reside in multiple geographical locations, portion of the present invention to each server
Management side formula is with no restrictions.
According to one embodiment of present invention, it may also include one or more 140 (such as clients of client in system 100
I-III etc.), not set proxy server mechanism in these clients 140, therefore client 140 can directly and service server
130 communication connections, that is, directly can send access request to service server 130 and receive its response contents returned,
And the forwarding for making requests and responding by proxy server 120 is not had to.In this way, the present invention is just for being provided with agency mechanism
Equipment component is carried out using test (such as marginal testing, abnormality detection robustness testing), without will affect other users just
It is often used.
According to one embodiment of present invention, the proxy server 120 and business service in above-mentioned application test systems 100
Device 130 can be realized by calculating equipment 200 as described below.Fig. 2 shows meters according to an embodiment of the invention
Calculate the structural block diagram of equipment 200.
In basic configuration 202, calculate equipment 200 typically comprise system storage 206 and one or more at
Manage device 204.Memory bus 208 can be used for the communication between processor 204 and system storage 206.
Depending on desired configuration, processor 104 can be any kind of processing, including but not limited to: microprocessor
(μ P), microcontroller (μ C), digital information processor (DSP) or any combination of them.Processor 204 may include such as
The cache of one or more rank of on-chip cache 210 and second level cache 212 etc, processor core
214 and register 216.Exemplary processor core 214 may include arithmetic and logical unit (ALU), floating-point unit (FPU),
Digital signal processing core (DSP core) or any combination of them.Exemplary Memory Controller 218 can be with processor
204 are used together, or in some implementations, and Memory Controller 218 can be an interior section of processor 204.
Depending on desired configuration, system storage 206 can be any type of memory, including but not limited to: easily
The property lost memory (RAM), nonvolatile memory (ROM, flash memory etc.) or any combination of them.System storage
Device 106 may include operating system 220, one or more is using 222 and program data 224.In some embodiments,
It may be arranged to be operated using program data 124 on an operating system using 222.Program data 124 includes instruction, in root
According in calculating equipment 200 of the invention, program data 224 includes the instruction for executing application testing method 300 and/or 500.
Calculating equipment 200 can also include facilitating from various interface equipments (for example, output equipment 242, Peripheral Interface
244 and communication equipment 246) to basic configuration 202 via the communication of bus/interface controller 230 interface bus 240.Example
Output equipment 242 include graphics processing unit 248 and audio treatment unit 250.They can be configured as facilitate via
One or more port A/V 252 is communicated with the various external equipments of such as display or loudspeaker etc.Outside example
If interface 244 may include serial interface controller 254 and parallel interface controller 256, they, which can be configured as, facilitates
Via one or more port I/O 258 and such as input equipment (for example, keyboard, mouse, pen, voice-input device, touch
Input equipment) or the external equipment of other peripheral hardwares (such as printer, scanner etc.) etc communicated.Exemplary communication is set
Standby 246 may include network controller 260, can be arranged to convenient for via one or more communication port 264 and one
A or multiple other calculate communication of the equipment 262 by network communication link.
Network communication link can be an example of communication media.Communication media can be usually presented as in such as carrier wave
Or computer readable instructions, data structure, program module in the modulated data signal of other transmission mechanisms etc, and can
To include any information delivery media." modulated data signal " can such signal, one in its data set or more
It is a or it change can the mode of encoded information in the signal carry out.As unrestricted example, communication media can be with
Wired medium including such as cable network or private line network etc, and it is such as sound, radio frequency (RF), microwave, infrared
(IR) the various wireless mediums or including other wireless mediums.Term computer-readable medium used herein may include depositing
Both storage media and communication media.
Calculating equipment 200 can be implemented as server, such as file server, database server, application program service
Device and WEB server etc. also can be implemented as a part of portable (or mobile) electronic equipment of small size, these electronic equipments
It can be such as cellular phone, personal digital assistant (PDA), wireless network browsing apparatus, application specific equipment or can wrap
Include the mixing apparatus of any of the above function.Equipment 200 is calculated to be also implemented as including desktop computer and notebook computer
The personal computer of configuration.In some embodiments, calculate equipment 200 be configured as execute application testing method 300 and/or
500。
Fig. 3 shows the flow diagram of application testing method 300 according to an embodiment of the invention.Method 300 exists
Execute in proxy server, such as executed in proxy server 120, to test target application, such as marginal testing and
The robustness testings such as abnormality detection.
As shown in figure 3, this method starts from step S310.In step s310, receive client send to target application
In certain page the page start request, the page starting request include this starting sole task mark and one or more connect
Mouth request.Here it is possible to start any one page by schema mode, and page starting request is sent, in this way without pressing
Correlate the page path operation with itself, guarantees that each page can directly initiate.
Then, in step s 320, the response contents of each interface requests are intercepted, each response contents include multiple fields,
And multiple field has hierarchical relationship.
Here, the response contents that proxy server can intercept service class interface requests are modified, and it is non-directly to let pass
The response contents of service class interface.Such as 4 show the schematic diagram of interface response contents according to an embodiment of the invention, the sound
It answers content using JSON format, generally can all have the data-interface of multi-layer, level 2 is nested in level 1, and level 3 is nested in
In level 2, and so on, ten levels generally can be at most marked off, can specifically be divided according to interface, some are divided into
Pyatyi, some are divided into six grades, some are ten grades.6 hierarchical relationships are illustratively marked in Fig. 4, as included in level 1
Message and result field, level 2 include bsdata, bucard, bupkcard and focusing field, etc..It should manage
Solution is also level 1 if occurring being in the field of concurrency relation with level 1 in subsequent content.Similarly, whole section of response contents
In may also have the parallel field of level 2, these fields also belong to level 2, and so on.
Then, in step S330, the same layer field in each response contents is uniformly revised as according to pre-defined rule
The boundary value of a certain type, and modified response is returned into client and is run.
According to some embodiments of the present invention, boundary value may include following at least one type: random string, overlength
Character string, special string, integer, single-precision floating point type, double-precision floating point type, the time, array, Boolean type, url, mailbox,
IP, picture, expression, empty array, empty object, null, undefined.Pre-defined rule includes: successively to modify each response contents
Field modifies the same layer field of all response contents every time, and this layer of field is revised as same type of boundary every time
Value；And after by all types of boundary values of one layer of field traversal, then modify next layer of word of all response contents
Section.
Other embodiments according to the present invention, after modified response is returned to client by proxy server, also
It can be by sole task mark, page iden-tity, the level modified and the boundary Value Types, equipment mark of this starting or this modification
Know and when operation starts between be sent in message queue, at this time it is believed that completing a page test assignment.The following are tasks
The example of the transmitted message to message queue of queue:
After page test assignment of every completion, the test environment of target application will be cleared up (in order to guarantee to execute every time
It is independent, interference-free, application cache can be all cleared up after the completion of each run), and carry out other page iden-tities or other levels
Or the page test assignment of other boundary Value Types, until completing all boundary value classes of all levels under all page iden-tities
The page test assignment of type.
It is, the carry out application boundary test of the present invention page by page, that is, allow in application specified page on scheduled various sides
It is run under the conditions of dividing value, and captures interface log and the fault message of application end automatically in the process of running.For a certain target
The page carries out first time page starting by schema mode, and proxy server can intercept in page starting request later
Service class interface response contents carry out mock modification.In modification, first the field of the level 1 of all service class interfaces is united
One is revised as returning to client operation after the boundary value of a type, is such as uniformly revised as the boundary of random character string type
Value.
Later, after cleaning test environment, second of page starting is carried out to the target pages, proxy server can be again at this time
The secondary response for intercepting the service class interface in second of page starting request is modified.As shown in table 1, it is repaired for the second time at this
When changing, so that it may which the field of level 1 is revised as to the boundary value of second of type.The rest may be inferred, until all boundaries of level 1
Value Types have all been traversed and have been finished.For a level, if there is the boundary value of 18 seed types, then will do it the starting of 18 pages and
18 secondary response content intercepts and modification.And then start to carry out the border value testing of level 2, when all types boundary of level 2
After the completion of value all traverses, then carry out the border value testing of level 3, and so on.
The application test option example of table 1
After all boundary Value Types all mock of all levels of a page, then to next target pages into
Row bound test, test similarly and successively.A line configuration is namely chosen in table 1 every time to modify, until by table 1
In every row all traverse and finish.It is this successively sufficiently to excavate the potential fault message of application end by the mcok mode of type, it protects
Card application end handles problem potential in logic to every layer of interface and is exposed.The modification of monohierarchy and single type also facilitates exploitation
Personnel fast implement fault location, improve testing efficiency.
It, can be respectively by specification when carrying out the boundary value modification of 18 seed types to it by taking the url field of level 6 in Fig. 4 as an example
Http be revised as the nonstandard value in table 2 observe using whether break down.
The boundary value of 2 18 seed type of table
For marginal testing, when the field type of application agreement is integer, shaping numberical range is -65536~
65536, then can distinguish the exceptional values such as assignment 65537, null, 5.5 in the mock field type, then observing application end is
It is no to break down.And when the field type of application agreement is character string type, then character string can be assigned a value of spy in mock
Different character, supertext, emoticon, null, null character are equivalent, then observe whether application end can break down.
In view of needing the boundary value to multiple pages and multiple types to test, therefore in one implementation,
Multiple page iden-tities multiple client be can be distributed into, and the device identification of client and the page iden-tity distributed stored
Incidence relation table, so as to page test assignment corresponding to each page iden-tity of each client executing.In this way, each client difference
It is responsible for the marginal testing to several pages, after completing to the test of a page, can starts automatically to next page mark
The test of knowledge.Here it when being allocated, can be distributed equally according to device identification number and page iden-tity number, it can also
To carry out equilibrium assignment according to the software and hardware of each client.
It should be noted that page iden-tity can also sort all page iden-tity sequences without allocating in advance
At table, after each client is completed to the test assignment of a page, current first can be chosen in the table automatically and is not tested
Page iden-tity execute page test assignment.The task of this load balancing is got mode and be can avoid because hard between client
Task completion speed is uneven caused by part and software differences, improves the integrated testability efficiency to target application.
In another implementation, multiple types of boundary value can be distributed into multiple client, and stores each visitor
The incidence relation table of the device identification at family end and the boundary Value Types distributed, so that each client executes corresponding class to each page
The border value testing of type.The present invention realizes the interface mock to single equipment, and proxy server arrives difference according to client
Device identification makes different modifications to respond to interface requests.For example, A equipment can be with mock with mock integer field, B device
Character string type field, two equipment can be with concurrent testing without influencing each other.Here, an equipment can execute one or more
Boundary Value Types, if any 18 clients, then each client can only carry out a kind of boundary Value Types, and proxy server is carrying out
Response contents can be only revised as the boundary value of corresponding types when response mock modification.If any 9 clients, then each client
Two types boundary value can be distributed, when testing only with the completion two kinds of border value testing.Certainly, may be used also
To carry out equilibrium assignment according to the hardware and softwares difference such as the memory of client, network speed, to realize testing efficiency most on the whole
Bigization.
Then, in step S340, judge that the sole task has identified whether pair from the fault message that client reports
The fault message answered, if so, the fault message and corresponding response are then carried out auto-associating.
Client in operational objective in application, can by operational process interface requests and response be reported to business service
Device, and attendant equipment mark, application version information, software package title, runing time and sole task mark.Once operational process
In break down, the exception stack information that will capture failure automatically is uploaded to service server together.Therefore, client uploads
Fault message may include sole task mark when breaking down, service class interface requests, corresponding response, equipment mark
Knowledge, Network status, application version information, software package title and exception stack information etc., the fault message this can be with JSON format
It reports.It shown below the example of a segment fault information:
The sole task in the message format of message queue comprising this subtask is reported to identify, therefore can be unique by this
Task identification is closed the responses such as level, the boundary Value Types of modification corresponding in fault message and the message format automatically
Connection.Specifically, message queue can be consumed, takes out sole task mark one by one, and whether inquiry is identified according to the sole task
There is corresponding fault message.If so, it is abnormal then to determine that the boundary value of the secondary operation exists, and by the fault message and corresponding disappear
Breath queuing message is sent to tester after carrying out auto-associating.Notification message transmitted by it is as follows:
App packet: 637 marginal testing packet of AUTO QUOTED PRICE
App version number: V6.2.1
Runing time: 2019-07-17 19:00:17
The unique id:b27214cba92b11e99bd090b11c30468d of task
Alarm content: price.android has abnormal log 1 when executing carDetailActivity marginal testing.
Crash details are referring to http://athm.cn/QpnQKnc
Event type: crash
Boundary value: string
Interface response sets: referring to http://athm.cn/QpnQKnc
Fig. 5 shows the flow chart of another embodiment application testing method 500 according to an embodiment of the invention, fits
It in being executed in proxy server, is such as executed in proxy server 120, is mainly with what application boundary test mutually decoupled
It is tested using abnormality detection.
As shown in figure 5, method 500 starts from step S510.In step S510, the data in message queue are consumed, from team
Sole task mark, boundary value, mock level, the page, device identification, time are obtained in column.
Then, in step S520, whether having corresponding fault message according to the inquiry of globally unique task identification, (boundary is surveyed
The fault information reporting generated in the process is tried to service server end).
If server end inquires corresponding fault message, in step S530, determine that this time runs corresponding side
There are problems in application end for dividing value, and according to the sole task of the secondary execution mark inquiry request in operational process at that time and
Response data after mock.Later, in step S540, set failure for the secondary log, and by the result inquired and
Marginal testing value, the page iden-tity taken out from queue are sent to related personnel, such as tester and corresponding research staff).
If not inquiring corresponding fault message, in step S550, determine that this time runs corresponding boundary value and exist
There is no problem for application end, and sets success for the secondary log.
To sum up, whether method 500 mainly has crash information to judge whether application is good for during operation by detection
It is strong, and the interface data that auto-associating was run at that time is identified according to sole task, it applies to obtain in which kind of boundary value
There are problems.
Fig. 6 shows the flow chart of the application testing method 600 of another embodiment according to the present invention, and method 600 can be with
It is executed in application test systems 100.As shown in fig. 6, method 600 starts from step S610.
In step S610, client is sent to service server to certain page in target application by proxy server
Page starting request, page starting request include the sole task mark and one or more interface requests of this starting.
Then, in step S620, the response contents for each interface requests that proxy server interception service server returns,
Each response contents include multiple fields, and multiple field has hierarchical relationship.
Then, in step S630, proxy server is according to pre-defined rule to the same layer field in each response contents
It is uniformly revised as the boundary value of a certain type, and modified response is returned into client.
Then, in step S640, client runs the response, and when breaking down from trend service server
Current fault message is reported, which includes current sole task mark.
Then, in step S650, proxy server judges that the sole task has been identified whether from the record reported
Corresponding fault message, if so, the fault message and corresponding response are then carried out auto-associating.
Fig. 7 shows the structural block diagram according to an embodiment of the invention using test device 700, which can
To reside in proxy server 120.As shown in fig. 7, device 700 includes: request receiving module 710, response blocking module
720, response modification module 730 and failure analysis module 740.
Request receiving module 710 receives the page to certain page in target application that client is sent and starts request, the page
Face starting request includes the sole task mark and one or more interface requests of this starting.Request receiving module 710 can be with
Processing corresponding with the processing described in step s310 above is carried out, it is not reinflated here to repeat.
Response blocking module 720 intercepts the response contents of each interface requests, and each response contents include multiple fields, this is more
A field has hierarchical relationship.Response blocking module 720 can carry out corresponding with the processing described in step s 320 above
Processing, it is not reinflated here to repeat.
Response modification module 730 is uniformly revised as the same layer field in each response contents according to pre-defined rule a certain
The boundary value of type, and modified response is returned into client operation.Response modification module 730 can carry out with above
The corresponding processing of processing, not reinflated here to repeat described in step S330.
Failure analysis module 740 judges that sole task has identified whether corresponding event from the fault message that client reports
Hinder information, if so, the fault message and corresponding response are then carried out auto-associating.Failure analysis module 740 can carry out
Processing corresponding with the processing described in step S340 above, it is not reinflated here to repeat.
According to one embodiment of present invention, device 700 can also include that reporting module and distribution module (are not shown in figure
Out).Reporting module can by this starting sole task mark, page iden-tity, the level modified and boundary Value Types, set
Standby mark and when operation starts between be sent in message queue, think to complete a page test assignment at this time.Distribution module
Multiple page iden-tities can be distributed into multiple client in one case, and store the device identification of client and distributed
Page iden-tity incidence relation table, so as to page test assignment corresponding to each page iden-tity of each client executing.Distribute mould
Multiple types of boundary value can be distributed to multiple client in another case by block, and store the equipment mark of each client
The incidence relation table with the boundary Value Types distributed is known, so that the boundary value that each client executes corresponding types to each page is surveyed
Examination.
According to another embodiment of the invention, device 700 can also include restarting module, be suitable for completing primary page every
After the test assignment of face, the test environment of target application is cleared up, and carries out other page iden-tities or other levels or other boundary values
The page test assignment of type, until completing the page test of all boundary Value Types of all levels under all page iden-tities
Task.
According to the technique and scheme of the present invention, it is healthy and strong to establish a kind of application full automatic, that coverage rate is high, maintenance cost is low
Property test method and system.By intercepting the network request of client, it is non-for responding interface according to scheduled rules modification
The data return value of specification, and the crash information of application end is collected automatically, it is associated, is oriented in the presence of scarce with mock data
Sunken code.The boundary value for 18 seed types that the present invention is arranged covers the common boundary value of application end, and application end may be deposited
Type parsing mistake be exposed.Interface hierarchical mock can sufficiently expose the logic of application end interface per treatment,
It avoids that internal layer logic error can not be exposed because of outer layer processing logic error.Pass through boundary value polymorphic type and hierarchical mock two
Aspect measure ensure that the high coverage rate of marginal testing.Moreover, the present invention is each to be tested page setup schema, pass through
The each page of schema independent startup guarantees that each page can be direct without operating according to the page path of application itself
Starting, improves the stability of marginal testing.
A6, the method as described in any one of A1-A5, wherein page starting request is sent by schema mode,
And the field of each response contents is at most divided into ten levels.A7, method as described in a5, wherein the proxy server
It being communicated to connect with multiple client, each client includes the target application, the method includes the steps: by the multiple page
Face mark distributes to the multiple client, and stores device identification and the incidence relation for the page iden-tity distributed of client
Table, so as to page test assignment corresponding to each page iden-tity of each client executing.A8, the side as described in any one of A1-A6
Method further comprises the steps of: multiple types of boundary value distributing to multiple client, and stores device identification and the institute of each client
The incidence relation table of the boundary Value Types of distribution, so that each client executes the border value testing of corresponding types to each page.
A9, the method as described in any one of A1-A8, wherein the interface requests include service class interface requests and non-industry
Business class interface requests, the proxy server only modify the response contents of service class interface requests.A10, the method as described in A9,
It is wherein also stored with the domain name white list of service class interface in the proxy server, the method also includes steps: obtaining every
Domain name value in the request header of a interface requests, and service class interface requests therein are identified according to domain name white list.
A11, the method as described in A9, wherein the service class interface is related to application interface logic, the non-traffic class interface includes
Bury point interface and advertisement exposure request interface.A12, the method as described in any one of A1-A11 further comprise the steps of: building boundary
Spectacle case is tested, and the marginal testing spectacle case is sent to client and is installed, the marginal testing spectacle case is supported
Mock function and interface log upload function.
A13, the method as described in any one of A1-A12, the failure letter that wherein client reports in the process of running
Breath includes sole task mark, service class interface requests and the corresponding modified response when breaking down.A14, such as A13 institute
The method stated, wherein the fault message is reported with JSON format, it further include device identification, Network status, application version letter
At least one of breath, software package title and exception stack information.A15, the method as described in any one of A1-A14 further include
Step: consumption message queue, one by one take out sole task mark, and according to the sole task mark inquiry whether have it is corresponding
Fault message；If so, it is abnormal then to determine that the boundary value of the secondary operation exists, and the fault message and corresponding message queue are believed
Breath is sent to tester after carrying out auto-associating.
Various technologies described herein are realized together in combination with hardware or software or their combination.To the present invention
Method and apparatus or the process and apparatus of the present invention some aspects or part can take insertion tangible media, such as can
Program code (instructing) in mobile hard disk, USB flash disk, floppy disk, CD-ROM or other any machine readable storage mediums
Form, wherein when program is loaded into the machine of such as computer etc, and when being executed by the machine, the machine becomes to practice
Equipment of the invention.
In the case where program code executes on programmable computers, calculates equipment and generally comprise processor, processor
Readable storage medium (including volatile and non-volatile memory and or memory element), at least one input unit, and extremely
A few output device.Wherein, memory is configured for storage program code；Processor is configured for according to the memory
Instruction in the said program code of middle storage executes application testing method of the invention.
By way of example and not limitation, readable medium includes readable storage medium storing program for executing and communication media.Readable storage medium storing program for executing
Store the information such as computer readable instructions, data structure, program module or other data.Communication media is generally such as to carry
The modulated message signals such as wave or other transmission mechanisms embody computer readable instructions, data structure, program module or other
Data, and including any information transmitting medium.Above any combination is also included within the scope of readable medium.
In the instructions provided here, algorithm and display not with any certain computer, virtual system or other
Equipment is inherently related.Various general-purpose systems can also be used together with example of the invention.As described above, it constructs this kind of
Structure required by system is obvious.In addition, the present invention is also not directed to any particular programming language.It should be understood that can
With using various programming languages realize summary of the invention described herein, and the description that language-specific is done above be for
Disclosure preferred forms of the invention.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that implementation of the invention
Example can be practiced without these specific details.In some instances, well known method, knot is not been shown in detail
Structure and technology, so as not to obscure the understanding of this specification.
Similarly, it should be understood that in order to simplify the disclosure and help to understand one or more of the various inventive aspects, In
Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. required to protect
Shield the present invention claims than feature more features expressly recited in each claim.More precisely, as following
As claims reflect, inventive aspect is all features less than single embodiment disclosed above.Therefore, it abides by
Thus the claims for following specific embodiment are expressly incorporated in the specific embodiment, wherein each claim itself
As a separate embodiment of the present invention.
Those skilled in the art should understand that the module of the equipment in example disclosed herein or unit or groups
Part can be arranged in equipment as depicted in this embodiment, or alternatively can be positioned at and the equipment in the example
In different one or more equipment.Module in aforementioned exemplary can be combined into a module or furthermore be segmented into multiple
Submodule.
Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment
Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or
Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any
Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed
All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power
Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose
It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included certain features rather than other feature, but the combination of the feature of different embodiments mean it is of the invention
Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed
Meaning one of can in any combination mode come using.
In addition, be described as herein can be by the processor of computer system or by executing by some in the embodiment
The combination of method or method element that other devices of the function are implemented.Therefore, have for implementing the method or method
The processor of the necessary instruction of element forms the device for implementing this method or method element.In addition, Installation practice
Element described in this is the example of following device: the device be used for implement as in order to implement the purpose of the invention element performed by
Function.
As used in this, unless specifically stated, come using ordinal number " first ", " second ", " third " etc.
Description plain objects, which are merely representative of, is related to the different instances of similar object, and is not intended to imply that the object being described in this way must
Must have the time it is upper, spatially, sequence aspect or given sequence in any other manner.
Although the embodiment according to limited quantity describes the present invention, above description, the art are benefited from
It is interior it is clear for the skilled person that in the scope of the present invention thus described, it can be envisaged that other embodiments.Additionally, it should be noted that
Language used in this specification primarily to readable and introduction purpose and select, rather than in order to explain or limit
Determine subject of the present invention and selects.Therefore, without departing from the scope and spirit of the appended claims, for this
Many modifications and changes are obvious for the those of ordinary skill of technical field.For the scope of the present invention, to this
It invents done disclosure to be illustrative and be not restrictive, it is intended that the scope of the present invention be defined by the claims appended hereto.
Claims (10)
1. a kind of application testing method, suitable for being executed in proxy server, the method includes the steps:
It receives the page to certain page in target application that client is sent and starts request, page starting request is opened including this
Dynamic sole task mark and one or more interface requests；
The response contents of each interface requests are intercepted, each response contents include multiple fields, and the multiple field has level
Relationship；
The boundary value of a certain type is uniformly revised as to the same layer field in each response contents according to pre-defined rule, and will be repaired
Response after changing returns to client and is run；And
Judge that the sole task has identified whether corresponding fault message from the fault message that client reports, if so, then
The fault message and corresponding response are subjected to auto-associating.
2. the method as described in claim 1, wherein the type of the boundary value comprises at least one of the following:
Random string, overlength character string, special string, integer, single-precision floating point type, double-precision floating point type, time, number
Group, Boolean type, url, mailbox, IP, picture, expression, empty array, empty object, null, undefined.
3. it is method according to claim 1 or 2, wherein the pre-defined rule includes:
The field of each response contents is successively modified, modifies the same layer field of all response contents every time, and every time by the layer
Field is revised as same type of boundary value；And
After by all types of boundary values of one layer of field traversal, then modify next layer of field of all response contents.
4. method as claimed in any one of claims 1-3, wherein also being wrapped after modified response is returned to client
Include step:
By the sole task mark of this starting, page iden-tity, the level modified and boundary Value Types, device identification and operation
Time started is sent in message queue, thinks to complete a page test assignment at this time.
5. method as claimed in claim 4, wherein the target application includes multiple page iden-tities, the method also includes steps
It is rapid:
After page test assignment of every completion, clear up the test environment of target application, and carry out other page iden-tities or other
The page test assignment of level or other boundary Value Types, until completing all boundaries of all levels under all page iden-tities
The page test assignment of Value Types.
6. a kind of application testing method, comprising:
Client, which is sent by proxy server to service server, starts request, the page to the page of certain page in target application
Face starting request includes the sole task mark and one or more interface requests of this starting；
The response contents for each interface requests that proxy server interception service server returns, each response contents include multiple words
Section, and the multiple field has hierarchical relationship；
Proxy server is uniformly revised as the side of a certain type according to pre-defined rule to the same layer field in each response contents
Dividing value, and modified response is returned into client；
Client runs the response, and reports current fault message automatically when breaking down, which includes working as
Preceding sole task mark；And
Proxy server judges that the sole task has identified whether corresponding fault message from the record reported, if so,
The fault message and corresponding response are then subjected to auto-associating.
7. a kind of apply test device, suitable for residing in proxy server, described device includes:
Request receiving module starts request, the page suitable for receiving the page to certain page in target application that client is sent
Starting request includes the sole task mark and one or more interface requests of this starting；
Blocking module is responded, suitable for identifying the service class interface requests in one or more of interface requests, and intercepts each industry
The response contents for class interface requests of being engaged in, each response contents include multilayer field；
Response modification module, suitable for being uniformly revised as certain one kind to the same layer field in each response contents according to pre-defined rule
The boundary value of type, and modified response is returned into client operation；And
Failure analysis module, it is corresponding suitable for judging that the sole task has been identified whether from the fault message that client reports
Fault message, if so, the fault message and corresponding response are then carried out auto-associating.
8. a kind of proxy server, comprising:
One or more processors；
Memory；And
One or more programs, wherein one or more of programs are stored in the memory and are configured as by described one
A or multiple processors execute, and realize described in any one of claim 1-14 when one or more of programs are executed by processor
Method the step of.
9. a kind of readable storage medium storing program for executing for storing one or more programs, one or more of programs include instruction, the finger
Enable the step of described in any item methods of claim 1-14 are realized when being executed by proxy server.
10. a kind of application test systems, comprising:
One or more clients, service server and proxy server as claimed in claim 8；
Wherein, the proxy server is connect with the service server and one or more of client communications respectively, is fitted
Start request in receiving the page that one or more of clients are sent, and intercepts in the response that the service server returns
Appearance is modified.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910690397.4A CN110427323B (en) | 2019-07-29 | 2019-07-29 | Application testing method, device, proxy server and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910690397.4A CN110427323B (en) | 2019-07-29 | 2019-07-29 | Application testing method, device, proxy server and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110427323A true CN110427323A (en) | 2019-11-08 |
| CN110427323B CN110427323B (en) | 2022-12-02 |
Family
ID=68413015
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910690397.4A Active CN110427323B (en) | 2019-07-29 | 2019-07-29 | Application testing method, device, proxy server and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110427323B (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111209202A (en) * | 2020-01-06 | 2020-05-29 | 北京字节跳动网络技术有限公司 | Terminal application testing method and device |
| CN111427766A (en) * | 2020-02-20 | 2020-07-17 | 北京齐尔布莱特科技有限公司 | Request processing method and device and proxy server |
| CN111582922A (en) * | 2020-04-27 | 2020-08-25 | 支付宝(杭州)信息技术有限公司 | Method and device for detecting cheating behaviors and electronic equipment |
| CN111813696A (en) * | 2020-08-25 | 2020-10-23 | 中国工商银行股份有限公司 | Application testing method, device and system and electronic equipment |
| CN111858381A (en) * | 2020-07-31 | 2020-10-30 | 北京字节跳动网络技术有限公司 | Application program fault tolerance capability test method, electronic device and medium |
| CN112256984A (en) * | 2020-10-22 | 2021-01-22 | 上海悦易网络信息技术有限公司 | Method and device for acquiring interface background screenshot corresponding to webpage |
| CN112711566A (en) * | 2020-12-28 | 2021-04-27 | 广州品唯软件有限公司 | Cross-service Modify data sharing and using method, system, equipment and storage medium |
| CN112910722A (en) * | 2019-12-04 | 2021-06-04 | 北京达佳互联信息技术有限公司 | Network request testing method, device, terminal and storage medium |
| CN113014440A (en) * | 2019-12-19 | 2021-06-22 | 中国电信股份有限公司 | Safety testing method and device based on industrial platform as service cloud platform |
| CN113127345A (en) * | 2021-04-06 | 2021-07-16 | 北京字跳网络技术有限公司 | Application testing method and device, electronic equipment and storage medium |
| CN113448839A (en) * | 2020-12-24 | 2021-09-28 | 北京新氧科技有限公司 | Application program testing method, device, equipment and storage medium |
| CN113448746A (en) * | 2020-12-30 | 2021-09-28 | 北京新氧科技有限公司 | Configuration processing method, configuration platform and related equipment |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140344663A1 (en) * | 2013-05-15 | 2014-11-20 | Christopher Stephen Joel | Method and Apparatus for Automatically Optimizing the Loading of Images in a Cloud-Based Proxy Service |
| US20150128121A1 (en) * | 2013-11-06 | 2015-05-07 | Improvement Interactive, LLC | Dynamic application version selection |
| US20150227518A1 (en) * | 2014-02-13 | 2015-08-13 | Salesforce.Com, Inc. | Providing a timeline of events regarding a database record |
| US20160063043A1 (en) * | 2014-08-29 | 2016-03-03 | Accenture Global Services Limited | Versatile Data Model |
| CN105553775A (en) * | 2015-12-24 | 2016-05-04 | 珠海市君天电子科技有限公司 | Method and device for acquiring information in test system and test system |
| CN106302337A (en) * | 2015-05-22 | 2017-01-04 | 腾讯科技（深圳）有限公司 | leak detection method and device |
| WO2017045538A1 (en) * | 2015-09-14 | 2017-03-23 | 阿里巴巴集团控股有限公司 | Http-based cache, request and response methods, and corresponding apparatuses |
| CN107423217A (en) * | 2017-07-10 | 2017-12-01 | 东北大学秦皇岛分校 | Black box fuzz testing method and system based on variation tree |
| CN108089978A (en) * | 2017-11-28 | 2018-05-29 | 华北电力大学（保定） | A kind of diagnostic method for analyzing ASP.NET application software performance and failure |
| CN109634851A (en) * | 2018-11-30 | 2019-04-16 | 苏州洞察云信息技术有限公司 | A kind of system-level real-time method for obtaining tested program internal operation data |
| CN109656797A (en) * | 2018-12-20 | 2019-04-19 | 浙江口碑网络技术有限公司 | The correlating method and device of daily record data |
-
2019
- 2019-07-29 CN CN201910690397.4A patent/CN110427323B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140344663A1 (en) * | 2013-05-15 | 2014-11-20 | Christopher Stephen Joel | Method and Apparatus for Automatically Optimizing the Loading of Images in a Cloud-Based Proxy Service |
| US20150128121A1 (en) * | 2013-11-06 | 2015-05-07 | Improvement Interactive, LLC | Dynamic application version selection |
| US20150227518A1 (en) * | 2014-02-13 | 2015-08-13 | Salesforce.Com, Inc. | Providing a timeline of events regarding a database record |
| US20160063043A1 (en) * | 2014-08-29 | 2016-03-03 | Accenture Global Services Limited | Versatile Data Model |
| CN106302337A (en) * | 2015-05-22 | 2017-01-04 | 腾讯科技（深圳）有限公司 | leak detection method and device |
| WO2017045538A1 (en) * | 2015-09-14 | 2017-03-23 | 阿里巴巴集团控股有限公司 | Http-based cache, request and response methods, and corresponding apparatuses |
| CN105553775A (en) * | 2015-12-24 | 2016-05-04 | 珠海市君天电子科技有限公司 | Method and device for acquiring information in test system and test system |
| CN107423217A (en) * | 2017-07-10 | 2017-12-01 | 东北大学秦皇岛分校 | Black box fuzz testing method and system based on variation tree |
| CN108089978A (en) * | 2017-11-28 | 2018-05-29 | 华北电力大学（保定） | A kind of diagnostic method for analyzing ASP.NET application software performance and failure |
| CN109634851A (en) * | 2018-11-30 | 2019-04-16 | 苏州洞察云信息技术有限公司 | A kind of system-level real-time method for obtaining tested program internal operation data |
| CN109656797A (en) * | 2018-12-20 | 2019-04-19 | 浙江口碑网络技术有限公司 | The correlating method and device of daily record data |
Non-Patent Citations (2)
| Title |
|---|
| MAHENDRA DATA 等: ""Optimizing single low-end LAMP server using NGINX reverse proxy caching"", 《2017 INTERNATIONAL CONFERENCE ON SUSTAINABLE INFORMATION ENGINEERING AND TECHNOLOGY》 * |
| 冯兴利 等: ""基于Fiddler + Loadrunner 的微信公众号自动化压力测试"", 《计算机应用》 * |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112910722A (en) * | 2019-12-04 | 2021-06-04 | 北京达佳互联信息技术有限公司 | Network request testing method, device, terminal and storage medium |
| CN112910722B (en) * | 2019-12-04 | 2022-07-22 | 北京达佳互联信息技术有限公司 | Network request testing method, device, terminal and storage medium |
| CN113014440A (en) * | 2019-12-19 | 2021-06-22 | 中国电信股份有限公司 | Safety testing method and device based on industrial platform as service cloud platform |
| CN111209202A (en) * | 2020-01-06 | 2020-05-29 | 北京字节跳动网络技术有限公司 | Terminal application testing method and device |
| CN111427766B (en) * | 2020-02-20 | 2023-08-18 | 北京齐尔布莱特科技有限公司 | Request processing method and device and proxy server |
| CN111427766A (en) * | 2020-02-20 | 2020-07-17 | 北京齐尔布莱特科技有限公司 | Request processing method and device and proxy server |
| CN111582922A (en) * | 2020-04-27 | 2020-08-25 | 支付宝(杭州)信息技术有限公司 | Method and device for detecting cheating behaviors and electronic equipment |
| CN111858381A (en) * | 2020-07-31 | 2020-10-30 | 北京字节跳动网络技术有限公司 | Application program fault tolerance capability test method, electronic device and medium |
| CN111813696A (en) * | 2020-08-25 | 2020-10-23 | 中国工商银行股份有限公司 | Application testing method, device and system and electronic equipment |
| CN111813696B (en) * | 2020-08-25 | 2023-09-15 | 中国工商银行股份有限公司 | Application testing method, device and system and electronic equipment |
| CN112256984A (en) * | 2020-10-22 | 2021-01-22 | 上海悦易网络信息技术有限公司 | Method and device for acquiring interface background screenshot corresponding to webpage |
| CN112256984B (en) * | 2020-10-22 | 2022-09-30 | 上海万物新生环保科技集团有限公司 | Method and device for acquiring interface background screenshot corresponding to webpage |
| CN113448839A (en) * | 2020-12-24 | 2021-09-28 | 北京新氧科技有限公司 | Application program testing method, device, equipment and storage medium |
| CN113448839B (en) * | 2020-12-24 | 2024-01-26 | 北京新氧科技有限公司 | Application program testing method, device, equipment and storage medium |
| CN112711566A (en) * | 2020-12-28 | 2021-04-27 | 广州品唯软件有限公司 | Cross-service Modify data sharing and using method, system, equipment and storage medium |
| CN113448746A (en) * | 2020-12-30 | 2021-09-28 | 北京新氧科技有限公司 | Configuration processing method, configuration platform and related equipment |
| CN113448746B (en) * | 2020-12-30 | 2023-09-15 | 北京新氧科技有限公司 | Configuration processing method, configuration platform and related equipment |
| CN113127345A (en) * | 2021-04-06 | 2021-07-16 | 北京字跳网络技术有限公司 | Application testing method and device, electronic equipment and storage medium |
| CN113127345B (en) * | 2021-04-06 | 2023-07-14 | 北京字跳网络技术有限公司 | Application testing method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110427323B (en) | 2022-12-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110427323A (en) | A kind of application testing method, device, proxy server and system | |
| US10445222B2 (en) | Debugging in-cloud distributed code in live load environment | |
| US10282281B2 (en) | Software testing platform and method | |
| CN105868039B (en) | A kind of method, system and equipment for management software problem report | |
| CN102195970B (en) | Based on the debugging of client session | |
| US8707264B2 (en) | Methods and systems for testing methods in a multi-tenant database environment | |
| US20200012493A1 (en) | Performance monitoring of system version releases | |
| CN110347596A (en) | A kind of test method, device, system, electronic equipment and medium | |
| CN107832207A (en) | Interface performance test method, apparatus, storage medium and computer equipment | |
| US20130197863A1 (en) | Performance and capacity analysis of computing systems | |
| Bagheri et al. | Software architectural principles in contemporary mobile software: from conception to practice | |
| US10025701B2 (en) | Application pre-release report | |
| EP3111328A1 (en) | Diagnosis and optimization of cloud release pipelines | |
| CN109558746A (en) | Data desensitization method, device, electronic equipment and storage medium | |
| US9329979B2 (en) | Derivation of generalized test cases | |
| US20140023185A1 (en) | Characterizing Time-Bounded Incident Management Systems | |
| US20200012545A1 (en) | Event to serverless function workflow instance mapping mechanism | |
| CN110490559A (en) | A kind of mobile law enforcement inspection method, device, system and server | |
| CN111597114A (en) | Method, device and equipment for verifying small program and storage medium | |
| US20120331440A1 (en) | Optimized software development | |
| US11232019B1 (en) | Machine learning based test coverage in a production environment | |
| CN108304321A (en) | A kind of method, system and device creating front and back end exploitation joint debugging environment | |
| CN108520481A (en) | House type is quoted and the method, apparatus and computer storage media of house type partition | |
| CN110362294A (en) | Development task executes method, apparatus, electronic equipment and storage medium | |
| US20220067639A1 (en) | Native Mobile Application for Tracking Physical Items |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |