CN110380936A - Test method and device - Google Patents
Test method and device Download PDFInfo
- Publication number
- CN110380936A CN110380936A CN201910670518.9A CN201910670518A CN110380936A CN 110380936 A CN110380936 A CN 110380936A CN 201910670518 A CN201910670518 A CN 201910670518A CN 110380936 A CN110380936 A CN 110380936A
- Authority
- CN
- China
- Prior art keywords
- service
- request message
- test
- transaction
- message
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/10—Active monitoring, e.g. heartbeat, ping or trace-route
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
Abstract
Present disclose provides a kind of test methods, are applied to micro services framework, which includes first service and second service, this method comprises: monitoring the first transaction request message that first service is sent to second service；Determine whether the first transaction request message can be used in testing second service；If it is determined that the first transaction request message can be used in testing second service, then generated based on the first transaction request message for multiple first test request message (TRM)s to second service request service；Multiple first test request message (TRM)s are sent to second service；And the response that second service is directed to multiple first test request message (TRM)s is monitored, to realize the test to second service.The disclosure additionally provides a kind of device to test, a kind of electronic equipment and a kind of computer readable storage medium.
Description
Technical field
This disclosure relates to field of computer technology, more particularly to a kind of test method and device.
Background technique
System business can be split as more fine-grained clothes by function as a kind of open platform by micro services framework
Business.Each service externally provides public API, and (Application Programming Interface, application programming connect
Mouthful), and independently undertake the responsibility externally serviced.One transaction flow for being related to micro services may include that " initiator-> services A-
> services B- > service C- > service D- > service E " etc. multiple links and backtracking.It is assumed that current project modifying point is improved
Be service B and service D, then actual test should focus on service B and service D on, do not need to other storages service send out
Play performance test.
But traditional test method or be to initiate a certain number of concurrent requests from initiator at present, then monitoring is rung
Between seasonable and system resource overhead etc. or be only to the service B of single node and service D concurrent request, then when monitoring response
Between and system resource overhead etc..
The former generally requires to prepare data for services all in whole process and builds environmental resource involved in these services.
Such as above-mentioned example just need from service A to service E environmental resource and data it is all complete.This necessarily causes cost excessively high, surveys
It is lower to try efficiency.The latter generally requires baffle program of the exploitation for analog service B and service the called service of D, and can not be complete
The performance verification for process of growing up.
Summary of the invention
An aspect of this disclosure provides a kind of test method, is applied to micro services framework, the micro services framework packet
First service and second service are included, this method comprises: monitoring the first transaction that the first service is sent to the second service
Request message；Determine whether the first transaction request message can be used in testing the second service；If it is determined that
The first transaction request message can be used in testing the second service, then is based on the first transaction request message
It generates for multiple first test request message (TRM)s to second service request service；It is sent to the second service described more
A first test request message (TRM)；And the response that the second service is directed to the multiple first test request message (TRM) is monitored, with
Realize the test to the second service.
Optionally, whether the determination the first transaction request message can be used in surveying the second service
Examination, comprising: determine predetermined instruction whether is carried in the first transaction request message, the predetermined instruction is used to indicate to institute
Second service is stated to be tested.
Optionally, the micro services framework further includes third service；And the method also includes monitoring described second
During service is directed to the response of the multiple first test request message (TRM): preventing the second service to the third service
Send multiple second test request message (TRM)s, wherein the multiple second test request message (TRM) is the second service in response to institute
The message being used for the third service request service stating multiple first test request message (TRM)s and generating.
Optionally, the method also includes: obtain the second transaction request message, the second transaction request message is described
The message being used for the third service request service that second service is generated in response to the first transaction request message；To
The third service forwards the second transaction request message；The third service response is obtained in the second transaction request report
Literary and generation transaction response message；Based on the transaction response message, multiple test response messages, the multiple test are generated
Response message and the multiple second test request message (TRM) correspond；And the multiple test is sent to the second service
Response message.
Optionally, after sending the multiple test response message to the second service, the method also includes: resistance
Only the second service forwards the multiple test response message to the first service.
Optionally, before obtaining the second transaction request message, the method also includes: it obtains and comes from the first service
The first transaction request message；And the first transaction request message is forwarded to the second service.
Optionally, the transaction response report generated in the acquisition third service response in the second transaction request message
After text, the method also includes: Xiang Suoshu second service forwards the transaction response message.
Another aspect of the disclosure provides a kind of test device, is applied to micro services framework, the micro services framework
Including first service and second service, described device includes: the first monitoring module, for monitoring the first service to described
The first transaction request message that two services are sent；Determining module, for determining whether the first transaction request message can be used
It is tested in the second service；Generation module, for determining that the first transaction request message can be used in institute
It states in the case that second service tested, is generated based on the first transaction request message for being requested to the second service
Multiple test request message (TRM)s of service；Sending module, for sending the multiple first test request report to the second service
Text；And second monitor module, for monitor the second service be directed to the multiple first test request message (TRM) response, with
Realize the test to the second service.
Another aspect of the present disclosure provides a kind of electronic equipment, comprising: one or more processors；Memory is used for
Store one or more programs, wherein when one or more of programs are executed by one or more of processors, so that
One or more of processors realize method as described above.
Another aspect of the present disclosure provides a kind of computer readable storage medium, is stored with computer executable instructions,
Described instruction is when executed for realizing method as described above.
Another aspect of the present disclosure provides a kind of computer program, and the computer program, which includes that computer is executable, to be referred to
It enables, described instruction is when executed for realizing method as described above.
Detailed description of the invention
In order to which the disclosure and its advantage is more fully understood, referring now to being described below in conjunction with attached drawing, in which:
Fig. 1 diagrammatically illustrates the system architecture suitable for test method and device according to the embodiment of the present disclosure；
Fig. 2 diagrammatically illustrates the flow chart of the test method according to the embodiment of the present disclosure；
Fig. 3 diagrammatically illustrates the flow chart that request message is handled according to the reproducing unit of the embodiment of the present disclosure；
Fig. 4 diagrammatically illustrates the flow chart handled according to the retaining device of the embodiment of the present disclosure；
Fig. 5 diagrammatically illustrates the flow chart that response message is handled according to the reproducing unit of the embodiment of the present disclosure；
Fig. 6 diagrammatically illustrates the signal of the Targeting Performance test based on micro services framework according to the embodiment of the present disclosure
Figure；
Fig. 7 diagrammatically illustrates the block diagram of the reproducing unit according to the embodiment of the present disclosure；
Fig. 8 diagrammatically illustrates the block diagram of the retaining device according to the embodiment of the present disclosure；
Fig. 9 diagrammatically illustrates the block diagram of the test device according to the embodiment of the present disclosure；And
Figure 10 diagrammatically illustrates the block diagram of the electronic equipment according to the embodiment of the present disclosure.
Specific embodiment
Hereinafter, will be described with reference to the accompanying drawings embodiment of the disclosure.However, it should be understood that these descriptions are only exemplary
, and it is not intended to limit the scope of the present disclosure.In the following detailed description, to elaborate many specific thin convenient for explaining
Section is to provide the comprehensive understanding to the embodiment of the present disclosure.It may be evident, however, that one or more embodiments are not having these specific thin
It can also be carried out in the case where section.In addition, in the following description, descriptions of well-known structures and technologies are omitted, to avoid
Unnecessarily obscure the concept of the disclosure.
Term as used herein is not intended to limit the disclosure just for the sake of description specific embodiment.It uses herein
The terms "include", "comprise" etc. show the presence of the feature, step, operation and/or component, but it is not excluded that in the presence of
Or add other one or more features, step, operation or component.
There are all terms (including technical and scientific term) as used herein those skilled in the art to be generally understood
Meaning, unless otherwise defined.It should be noted that term used herein should be interpreted that with consistent with the context of this specification
Meaning, without that should be explained with idealization or excessively mechanical mode.
It, in general should be according to this using statement as " at least one in A, B and C etc. " is similar to
Field technical staff is generally understood the meaning of the statement to make an explanation (for example, " system at least one in A, B and C "
Should include but is not limited to individually with A, individually with B, individually with C, with A and B, with A and C, have B and C, and/or
System etc. with A, B, C).Using statement as " at least one in A, B or C etc. " is similar to, generally come
Saying be generally understood the meaning of the statement according to those skilled in the art to make an explanation (for example, " having in A, B or C at least
One system " should include but is not limited to individually with A, individually with B, individually with C, with A and B, have A and C, have
B and C, and/or the system with A, B, C etc.).
Shown in the drawings of some block diagrams and/or flow chart.It should be understood that some sides in block diagram and/or flow chart
Frame or combinations thereof can be realized by computer program instructions.These computer program instructions can be supplied to general purpose computer,
The processor of special purpose computer or other programmable data processing units, so that these instructions are when executed by this processor can be with
Creation is for realizing function/operation device illustrated in these block diagrams and/or flow chart.The technology of the disclosure can be hard
The form of part and/or software (including firmware, microcode etc.) is realized.In addition, the technology of the disclosure, which can be taken, is stored with finger
The form of computer program product on the computer readable storage medium of order, the computer program product is for instruction execution system
System uses or instruction execution system is combined to use.
Embodiment of the disclosure provides a kind of test method and can apply the test device of this method.This method is answered
For micro services framework, which for example may include first service and second service, and this method for example may include
The first transaction request message that first service is sent to second service is monitored, determines whether the first transaction request message can be used
It is tested in second service.If it is determined that the first transaction request message can be used in testing second service, then base
It generates in the first transaction request message for multiple first test request message (TRM)s to second service request service.And it is taken to second
Business sends multiple first test request message (TRM)s, and the response of multiple first test request message (TRM)s is directed to while listening for second service, with
Realize the test to second service.
Fig. 1 diagrammatically illustrates the system architecture suitable for test method and device according to the embodiment of the present disclosure.It needs to infuse
Meaning, being only shown in Fig. 1 can be using the example of the system architecture of the embodiment of the present disclosure, to help those skilled in the art to manage
The technology contents of the disclosure are solved, but are not meant to that the embodiment of the present disclosure may not be usable for other equipment, system, environment or field
Scape.
As shown in Figure 1, the system architecture includes: service consumer and ISP and service register center, configuration
Center and monitoring center.
It should be understood that service consumer indicates that a side of consumption service, ISP indicate to provide a side of service.Example
Such as, for above-mentioned example " initiator-> services A- > service B- > service C- > service D- > and services E ", service A- > services B
I.e. service A calls service B, it is seen that in contrast, service A is service consumer, and service B is ISP.And service B- >
It services C and services B calling service C, it is seen that in contrast, service B is service consumer, and service C is ISP ... ....
In addition, service register center is used to be the corresponding information of each service registration.Configuration center is used to be each service
Configure corresponding information.Monitoring center is for being monitored the whole process of each service, to be directed to certain service nodes therein
It is tested for the property.
The test method and device provided by the embodiment of the present disclosure, using targeting high concurrent means of testing, i.e., only to
It is clearly required the service being tested for the property and continuously transmits a plurality of test request message (TRM) and tested.Specifically, in full link
It is upper to initiate an arm's length dealing request, it, can be automatic when transaction request arrival has clearly required the service being tested for the property
This is serviced and initiates high concurrent performance test, an arm's length dealing request can be automatically restored to after this service, so as to
The technology for solving the performance verification that cost is excessively high, testing efficiency is lower present in the relevant technologies and is unable to complete long process is asked
Topic, and then dependence of the performance test to overall applicability environment can be reduced, improve the working efficiency of performance test.
Fig. 2 diagrammatically illustrates the flow chart of the test method according to the embodiment of the present disclosure.
As shown in Fig. 2, this method for example can be applied to micro services framework, which for example may include first
Service and second service, this method for example may include operation S210~S250.
In operation S210, the first transaction request message that first service is sent to second service is monitored.
It should be understood that in the embodiments of the present disclosure, first service has call relation to second service.I.e. first service is
Service consumer, second service are ISPs.
Also, in the embodiments of the present disclosure, the first transaction request message for example can be a normal transaction request report
Text.
Next, determining whether the first transaction request message can be used in testing second service in operation S220.
In order to realize targeting test, in the embodiments of the present disclosure, can be arranged in normal transaction request message corresponding
Instruction, be used to indicate and certain services be tested for the property.
Then, in operation S230, if it is determined that the first transaction request message can be used in testing second service, then
It is generated based on the first transaction request message for multiple first test request message (TRM)s to second service request service.
Specifically, multiple first test request message (TRM)s and these messages are complete can be generated based on the first transaction request message
Portion is sent to second service, carries out high concurrent pressure test to second service to realize.
Subsequently, in operation S240, multiple first test request message (TRM)s are sent to second service.
Subsequently, in operation S250, the response that second service is directed to multiple first test request message (TRM)s is monitored, with realization pair
The test of second service.
For example, the response that second service is directed to multiple first test request message (TRM)s can be monitored, to test second service institute
The high concurrent pressure that can be born and the average time responded etc..
Further, as a kind of optional embodiment, determine whether the first transaction request message can be used in taking to second
Business is tested for example can include determining that in the first transaction request message whether carry predetermined instruction.Wherein predetermined instruction is used
Second service is tested in instruction.
Fig. 3 diagrammatically illustrates the schematic diagram that request message is handled according to the reproducing unit of the embodiment of the present disclosure.Such as Fig. 3 institute
Show, in the embodiments of the present disclosure, the process of reproducing unit processing request message such as operates S310~S360.
In operation S310, starts reproducing unit, monitor all transaction request messages.
It should be understood that reproducing unit is realized by reproducer in the embodiments of the present disclosure.Some across service
In performance test project, often due to the limitation (such as test hardware resource is limited, the coordination between more services) of objective factor,
A complete test environment can not be built to complete test job.The embodiment of the present disclosure, by building tested service, then
Use software program identify tested service and using arm's length dealing request message for the basic a plurality of request message of continuous replication as
Test request message (TRM) is sent to tested service.The software program is commonly referred to as reproducer.
Next, analysing whether the spy containing performance test label to the transaction request message received in operation S320
Different instruction, to judge whether it is test request message (TRM).If test request message (TRM) and switch be true, then continue to operate
S330.If not test request message (TRM), then jump directly to operation S360.
It should be noted that in the embodiments of the present disclosure, test request message (TRM) can correspond to the data structure such as table 1.
Table 1
It should be understood that in the embodiments of the present disclosure, above-mentioned special instruction can pass through the Implementation of pseudocode of json format.
Then, it is requested when this message information reaches specified service B and service D according to arm's length dealing in operation S330
Transaction Information in message, duplication targeting request message, and the data resource for parametrization buried in advance a little is combined, from
It is dynamic to be copied into a test request message (TRM).100 card number actual values such as 2 institute of table is for example pre-defined in pre-buried data processing module
Show.
Table 2
| cardno |
| 6222123456789000001 |
| 6222123456789000002 |
| … |
| 6222123456789000100 |
It should be understood that targeting request message is to the test request for having clearly required the service transmission being tested for the property
Message.
It should be noted that in the embodiments of the present disclosure, it, can be by this message each time when duplication targeting request message
In { cardno } replace with current true card number, i.e., replace with 6222123456789000001 for the first time, second replaces
It is 6222123456789000002, and so on.
Then, in operation S340, based on the test request message (TRM) that operation S330 is generated, forwarding targeting request message is called
Request next service.
Subsequently, judge whether to have reached " number of concurrent " according to the special instruction of performance test label in operation S350
The target call of " duration ".If having reached, terminates the duplication operation for targeting request message, continues to operate S360,
Otherwise operation S330 is jumped to, again circular treatment.
Subsequently, in operation S360, arm's length dealing request message is forwarded, continues to call next service according to normal flow.
It, can be continuous to targeting service (having clearly required the service being tested for the property) by the embodiment of the present disclosure
Request is initiated, until reaching required number of concurrent and until the duration, so as to realize pressure that test targeting services
The purpose of ability to bear.
In the embodiment of the present disclosure, using the form for the special instruction for adding performance test label in transaction request message,
It is automatic to replicate when identifying that the next service to be called of transaction request message is the service for needing performance test by reproducing unit
More parts of test request message (TRM)s, and the data resource for parametrization buried in advance a little is combined, with high simultaneously to service initiation
Hair request is to realize performance test.
As a kind of optional embodiment, micro services framework for example can also include third service.Accordingly, party's rule
It such as can also include preventing second service during monitoring second service and being directed to the response of multiple first test request message (TRM)s
Multiple second test request message (TRM)s are sent to third service.Wherein, multiple second test request message (TRM)s be second service in response to
Multiple first test request message (TRM)s and generate for third service request service message.
Retaining device can be used to test request to the service that needs are tested for the property by the embodiment of the present disclosure
Message is identified, and combines arm's length dealing response message, automatically derives test returned packet (also known as targeting response message or survey
Try response message), the service that needs are tested for the property is carried out to reach and can be realized by an arm's length dealing request
Accurately the purpose that remaining service of full chain road is called in transaction is tested and do not influenced to Targeting Performance.
It should be understood that in the embodiments of the present disclosure, retaining device is the device realized by baffle program.Some across clothes
In the performance test project of business, often due to the limitation of objective factor is (as test hardware resource is limited, the coordination between more services
Deng), a complete test environment can not be built to complete test job.At this point, can generally build tested service, then adopt
The function of other related services is simulated with software program.The software program is commonly referred to as baffle program.
As a kind of optional embodiment, this method for example can also include obtaining the second transaction request message, and second hands over
Easy request message is the report being used for third service request service that second service is generated in response to the first transaction request message
Text.The second transaction request message of forwarding is serviced to third.Third service response is obtained to generate in the second transaction request message
Transaction response message.Based on transaction response message, multiple test response messages, multiple test response messages and multiple second are generated
Test request message (TRM) corresponds.Multiple test response messages are sent to second service.
Fig. 4 diagrammatically illustrates the flow chart handled according to the retaining device of the embodiment of the present disclosure.As shown in figure 4, the gear
The process of panel assembly processing request message such as operates S410~S480.
In operation S410, starts retaining device, monitor all transaction request messages.
Next, to the transaction request message received, analyzing and determining whether be test request message (TRM) in operation S420.
If not test request message (TRM), then continue to operate S430.If test request message (TRM), then operation S460 is jumped to.
Then, in operation S430, arm's length dealing request message is forwarded, continues to call next service according to normal flow.
Subsequently, in operation S440, arm's length dealing response message is monitored, obtains the arm's length dealing request by operation S430
Message calls the relevant information of the arm's length dealing response message returned after next service.
Subsequently, in operation S450, arm's length dealing response message is forwarded, returns to former request service according to normal flow.
Subsequently, the replication processes of targeting response message are carried out for each test request message (TRM) in operation S460,
The arm's length dealing response message specially got according to operation S440, in conjunction with the data for parametrization buried in advance a little
Resource is assembled into correctly test returned packet automatically.100 card number reality are for example pre-defined in pre-buried data processing module
Value is as shown in table 3.
Table 3
| cardno |
| 6222123456789000001 |
| 6222123456789000002 |
| … |
| 6222123456789000100 |
It should be understood that { cardno } in this message can be replaced with and worked as when assembling targets response message each time
Preceding true card number, i.e., replace with 6222123456789000001 for the first time, replace with for the second time
6222123456789000002, and so on.
In operation S470, test returned packet of the S460 based on generation will be operated, forwarding targeting response message returns to original
Request service.
In operation S480, judge to target whether response message duplication has been fully completed.If all test request message (TRM)s
Test returned packet has been returned, then has terminated the duplication operation for targeting response message, completes entire process flow.Otherwise it jumps
To operation S460 circular treatment.
As a kind of optional embodiment, after sending multiple test response messages to second service, this method is for example
It can also include: that second service is prevented to forward multiple test response messages to first service.
Fig. 5 diagrammatically illustrates the flow chart that response message is handled according to the reproducing unit of the embodiment of the present disclosure.Such as Fig. 5 institute
Show, the related procedure of reproducing unit processing response message such as operates S510~S550.
In operation S510, after starting reproducing unit, the All Activity response message of AM automatic monitoring return.
In operation S520, to the transaction response message received, analyze and determine whether be that test returned packet (i.e. answer by test
Answer message).If testing returned packet, then continue to operate S530.If not test returned packet, but arm's length dealing response report
Text then jumps to operation S550.
In operation S530, targeting response message processing is carried out, termination closing is carried out for each test returned packet.
In operation S540, judge to target whether response message processing has been fully completed.If all test returned packets
Terminated closing, then terminates the relevant operation for targeting response message processing, continues to operate S550；Otherwise operation is jumped to
S530 circular treatment.
In operation S550, forwarding arm's length dealing response message gives original request service, completes entire process flow.
It should be noted that being substantially transparent for originating end, only during the performance test of the embodiment of the present disclosure
Need to add a special instruction about performance test label in messages.JMeter etc. specifically can be used and initiate work
Tool initiates a test request message (TRM) from web front end or suitable point of penetration.
It should be understood that for the service in transaction flow, it is only necessary in the program of user service, following distance pole is added,
The Targeting Performance test of related service can be automatically performed by frame, example is with reference to as follows.
@Targeting
public RestTemplate restTemplate(){
}
Specifically, Targeting Performance test processes for example may include reproducing unit transaction request processing, retaining device processing,
Reproducing unit transaction reply process etc., these can be realized in the frame belonging to Targeting.All service nodes it is detailed
Thin information (such as the performance test results) is mainly provided by the monitoring center in micro services frame, the specific service comprising its each node
At the beginning of request, end time and correlation CPU, memory and the statistical data of IO etc..
It should be understood that during performance test, can make full use of distributed system can dynamic retractility characteristic, reach
Save the purpose of system resource.
Specifically, before test, mirror image can be all made into related service, is stored in mirror image warehouse.When starting test,
Basic server resource can be used early period, as long as transaction flow can be completed.In Targeting Performance test process, if
The performance capability of evaluation services B is wanted, then adding a special instruction in messages, the property of current service B can be assessed in real time
The purpose of energy index.If leading to not meet production actual demand because current Service Source is insufficient it was found that servicing B, according to
Actual performance data carry out difference calculating, and by the configuration center in micro services frame, in real time creation and starting container, to clothes
Business B carries out dynamic capacity-expanding, until performance capability index reaches scheduled target.It assesses and completes when the performance capability of service B,
The next service to be assessed can be opened, such as service D is tested for the property, then can stop deleting by dynamic at this time
The container where B is serviced, and corresponding dynamic capacity-expanding only is carried out to the service D of this secondary targeting test.
As a kind of optional embodiment, before obtaining the second transaction request message, this method for example can also include:
The first transaction request message from first service is obtained, and forwards the first transaction request message to second service.
As a kind of optional embodiment, in the transaction that acquisition third service response is generated in the second transaction request message
After response message, this method for example can also include: to second service transmitted transaction response message.
The disclosure is elaborated below with reference to Fig. 6 and in conjunction with specific embodiments.
Fig. 6 diagrammatically illustrates the signal of the Targeting Performance test based on micro services framework according to the embodiment of the present disclosure
Figure.As shown in fig. 6, details are as follows for the entire flow once traded.
Performance test transaction is initiated in initiator, dispatch service A starts transaction flow.Since service A is not known
Test object does not need to initiate high concurrent performance test at this time, and only needs to initiate an arm's length dealing request message, but need
Special instruction (i.e. predetermined instruction) of the injection about performance test label in transaction message.This special instruction can be required to specific
Service (such as service B or service D) carries out accurately Targeting Performance and tests.
It should be understood that in the embodiments of the present disclosure, performance testing index for example can include but is not limited to handling capacity (QPS,
That is the number of requests that system can be handled in the unit time, if TPS is request transaction quantity each second), number of concurrent (i.e. system energy
The number of requests of processing simultaneously), the response time, (TR executed a request when receiving the totality of response from start to finish
Between), performance counter (i.e. the data target of server or operating system performance) etc..Under ideal model, QPS (TPS)=concurrent
Number/TR, therefore corresponding specific performance index can be got by the difference of control number of concurrent.
In the embodiments of the present disclosure, the data structure of special instruction for example may include content shown in table 4.
Table 4
Whether performance test indicates whether this request needs to do the switch judgement (true/false) of performance test.When and
Only when to be true, need to initiate high concurrent performance test to special services.
Performance test destination service indicates that this request needs to carry out the service of Targeting Performance test.For example only it is provided with clothes
Be engaged in B, then only tests the service B Targeting Performance for carrying out high concurrent.If being provided with service B and service D simultaneously, only to service B
The Targeting Performance test of high concurrent is carried out with service D.For other services in transaction flow, it is only necessary to maintain single to request,
The Targeting Performance test request of initiation high concurrent is not needed.
Number of concurrent indicates that the transactions requests number that special services are initiated in this performance test simultaneously is arranged.It is for example if concurrent
Number is set as 100, then needs to test this Targeting Performance targeted service (such as service B), while initiating 100 tests and asking
It asks.
Duration indicates the duration that this performance test is arranged.For example if the duration is set as 600s, i.e.,
600 seconds, then continue to test targeted service (such as service B) to this Targeting Performance always in 600 seconds (10 minutes), incessantly
Initiate 100 test requests.
Parameter name indicates that setting needs the title of data parameterization.Cardno for example can be set, then it is high in subsequent initiation
When concurrency performance is tested, using pre-buried data processing module, set specific for the cardno in each transaction request
Different bank card numbers, rather than each transaction all uses the same card number, and data is avoided to cause hot spot.
When the Transaction Information of this carrying special instruction can pass through duplication when servicing A and entering the process for calling service B
It is the accurate object that this needs to do high concurrent performance test that device, which automatically detects service B,.It is normal in addition to retaining one at this time
Transaction request message calls outside service B for continuing, can also be by reproducing unit by the transaction in arm's length dealing request message
Information is combined with the data for burying a little, is copied into more parts of test request message (TRM)s automatically, is called service B one by one, i.e., is executed height to service B
Concurrent scheduling operation.
When being directed to transaction request message, when service B completes to respond and enter the process of dispatch service C, baffle can be passed through
It is not the object that this needs high concurrent to test that device, which automatically detects service C, then retaining device is only for original one
Arm's length dealing request message goes to call service C and obtain to return the result i.e. arm's length dealing response message.Retaining device pair
In the test request message (TRM) replicated automatically by reproducing unit before, and not practical calling services C, but according to current normal friendship
Easy response message is assembled into correctly test returned packet automatically and returns to service B one by one.
When all transaction response messages return to service A by servicing B, reproducing unit is only by a normal friendship
Easy response message returns to service A, and for the whole automatic mistake of all test returned packets by retaining device automatic-answering back device
It filters, to complete entire transaction flow.
It should be noted that in the embodiments of the present disclosure, Targeting Performance test macro for example may include two devices, point
It is not reproducing unit and retaining device.
Fig. 7 diagrammatically illustrates the block diagram of the reproducing unit according to the embodiment of the present disclosure.Reproducing unit is mainly responsible for as follows
Operation.
(1) it is directed to arm's length dealing request message ", in conjunction with the data of pre-buried point, it is copied into more parts of test request message (TRM)s automatically,
To initiate high concurrent performance test to specific service.
(2) returned packet is tested in automatic fitration, and the response message of high concurrent is carried out decompression processing, only retains one normally
Transaction response message.
In order to realize aforesaid operations, specifically, in the embodiments of the present disclosure, as shown in fig. 7, reproducing unit 700 for example may be used
To include that request message monitors module 701, response message monitors module 702, at normal forward process module 703, pre-buried data
Manage module 704, targeting request processing module 705, targeting reply process module 706.
Wherein, request message monitors module 701 for monitoring all transaction request messages, and asks to the transaction received
Message is sought, analyses whether the special instruction containing performance test label.
Response message monitors module 702 for monitoring all transaction response messages, to the transaction response message received,
Judgement is arm's length dealing response message 801 or test returned packet.
Normal forward process module 703 for the transaction request message received, with arm's length dealing request message according to
Normal flow continues to call next service.
Pre-buried data processing module 704 is for the pre-defined data resource for being used on parametrization.Parameter is needed with one
For the service for changing card number, then 100 card number actual values can be pre-defined in pre-buried data processing module 704, specifically such as
Shown in table 5.
Targeting request processing module 705 is asked for handling the transaction request message received according to arm's length dealing
The Transaction Information in message is sought, in conjunction with the data resource for parametrization of pre-buried point, is copied into more parts of test request reports automatically
Text calls next service one by one, executes to the scheduling of next service execution high concurrent.The example reference of its every a copy packet
It is as follows.
StartStresstesting (setStressMsg (data_msg, data_param))
Wherein data_msg indicates the Transaction Information in arm's length dealing request message, and data_param is indicated comprising above-mentioned
The parameter of entitled cardno predetermined in pre-buried data processing module 704.
Table 5
| cardno |
| 6222123456789000001 |
| 6222123456789000002 |
| … |
| 6222123456789000100 |
Targeting reply process module 706 is for handling the transaction response message received, only by a normal friendship
Easy response message returns to former request service, and all test returned packet whole automatic fitration is fallen.Wherein every portion
The example of end message is with reference to as follows.
if(isStresstMsg(data_msg))
endStresstesting(data_msg)
Fig. 8 diagrammatically illustrates the block diagram of the retaining device according to the embodiment of the present disclosure.As shown in figure 8, retaining device 800
It is mainly responsible for and baffle processing is carried out to the test request message (TRM) of high concurrent, be assembled into just according to actual arm's length dealing response message
True test returned packet, then direct auto-returned.
In order to realize aforesaid operations, specifically, in the embodiments of the present disclosure, as shown in figure 8, retaining device 800 for example may be used
To include that request message monitors module 801, response message monitors module 802, at normal forward process module 803, pre-buried data
Manage module 804 and targeting reply process module 805.
Request message monitors module 801 for monitoring all transaction request messages, and to the transaction request report received
Text analysis is arm's length dealing request message or test request message (TRM).
Response message monitors module 802 for monitoring all transaction response messages, and obtains arm's length dealing response message
All information.
Normal forward process module 803 is returned for the information of the arm's length dealing request message received to be forwarded
Give original request service.
Pre-buried data processing module 804 is for the pre-defined data resource for being used on parametrization.
It targets reply process module 805 to be used for for all test request message (TRM)s, module 802 is monitored according to response message
The arm's length dealing response message got is assembled into just automatically in conjunction with the data resource for parametrization buried in advance a little
True test returned packet, and former request service is returned to one by one.
Fig. 9 diagrammatically illustrates the block diagram of the test device according to the embodiment of the present disclosure.
As shown in figure 9, the test device 900 for example can be applied to micro services framework, the micro services framework includes the
One service and second service, the test device 900 include the first monitoring module 901, determining module 902, generation module 903, hair
Module 904 and second is sent to monitor module 905.The processing unit can execute the side described above with reference to embodiment of the method part
Method, details are not described herein.
Specifically, the first monitoring module 901 for example can be used for monitoring first service is sent to second service first and hand over
Easy request message.
Determining module 902 is for example determined for whether the first transaction request message can be used in carrying out second service
Test.
Generation module 903 for example can be used for determining that the first transaction request message can be used in surveying second service
In the case where examination, generated based on the first transaction request message for multiple test request message (TRM)s to second service request service.
Sending module 904 for example can be used for sending multiple first test request message (TRM)s to second service.
Second monitoring module 905 for example can be used for monitoring second service answering for multiple first test request message (TRM)s
It answers, to realize the test to second service.
It should be noted that the way of example of device part is corresponding with the way of example of method part similar, and
Technical effect achieved also corresponds to similar, and details are not described herein.
Any number of or in which any number of at least partly functions in module according to an embodiment of the present disclosure can be with
It is realized in a module.Multiple modules can be split into according to any one or more in the module of the embodiment of the present disclosure
To realize.Hardware electricity can be at least implemented partly as according to any one or more in the module of the embodiment of the present disclosure
Road, such as field programmable gate array (FPGA), programmable logic array (PLA), system on chip, the system on substrate, encapsulation
On system, specific integrated circuit (ASIC), or can be by carrying out any other reasonable side that is integrated or encapsulating to circuit
The hardware or firmware of formula realizes, or with any one in three kinds of software, hardware and firmware implementations or with wherein any
It is several appropriately combined to realize.Alternatively, can be at least by part according to one or more of module of the embodiment of the present disclosure
Ground is embodied as computer program module, when the computer program module is run, can execute corresponding function.
For example, first monitors module 901, determining module 902, generation module 903, sending module 904 and the second monitoring mould
Any number of in block 905, which may be incorporated in a module, to be realized or any one module therein can be split into
Multiple modules.Alternatively, at least partly function of one or more modules in these modules can be at least portion of other modules
Point function combines, and realizes in a module.In accordance with an embodiment of the present disclosure, first module 901, determining module are monitored
902, at least one of generation module 903, sending module 904 and second monitoring module 905 can be at least at least partially implemented
To be on hardware circuit, such as field programmable gate array (FPGA), programmable logic array (PLA), system on chip, substrate
System, the system in encapsulation, specific integrated circuit (ASIC), or can be by carrying out integrated to circuit or encapsulating any other
The hardware such as rational method or firmware realize, or with any one in three kinds of software, hardware and firmware implementations or with it
In any several appropriately combined realize.Alternatively, first monitors module 901, determining module 902, generation module 903, sends
At least one of module 904 and the second monitoring module 905 can at least be implemented partly as computer program module, when this
When computer program module is run, corresponding function can be executed.
Figure 10 diagrammatically illustrates the block diagram of the electronic equipment according to the embodiment of the present disclosure.Electronic equipment shown in Figure 10 is only
Only an example, should not function to the embodiment of the present disclosure and use scope bring any restrictions.
As shown in Figure 10, electronic equipment 1000 includes processor 1010, computer readable storage medium 1020.The electronics is set
Standby 1000 can execute the method according to the embodiment of the present disclosure.
Specifically, processor 1010 for example may include general purpose microprocessor, instruction set processor and/or related chip group
And/or special microprocessor (for example, specific integrated circuit (ASIC)), etc..Processor 1010 can also include for caching
The onboard storage device of purposes.Processor 1010 can be the different movements for executing the method flow according to the embodiment of the present disclosure
Single treatment unit either multiple processing units.
Computer readable storage medium 1020, such as can be non-volatile computer readable storage medium, specifically show
Example includes but is not limited to: magnetic memory apparatus, such as tape or hard disk (HDD)；Light storage device, such as CD (CD-ROM)；Memory,
Such as random access memory (RAM) or flash memory；Etc..
Computer readable storage medium 1020 may include computer program 1021, which may include
Code/computer executable instructions executes processor 1010 and is implemented according to the disclosure
The method or its any deformation of example.
Computer program 1021 can be configured to have the computer program code for example including computer program module.Example
Such as, in the exemplary embodiment, the code in computer program 1021 may include one or more program modules, for example including
1021A, module 1021B ....It should be noted that the division mode and number of module are not fixed, those skilled in the art
It can be combined according to the actual situation using suitable program module or program module, when these program modules are combined by processor
When 1010 execution, processor 1010 is executed according to the method for the embodiment of the present disclosure or its any deformation.
In accordance with an embodiment of the present disclosure, first module 901, determining module 902, generation module 903, sending module are monitored
904 and second monitoring at least one of module 905 can be implemented as the computer program module with reference to Fig. 8 description, in quilt
When processor 810 executes, corresponding operating described above may be implemented.
The disclosure additionally provides a kind of computer readable storage medium, which can be above-mentioned reality
It applies included in equipment/device/system described in example；Be also possible to individualism, and without be incorporated the equipment/device/
In system.Above-mentioned computer readable storage medium carries one or more program, when said one or multiple program quilts
When execution, the method according to the embodiment of the present disclosure is realized.
Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the disclosure, method and computer journey
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part of one module, program segment or code of table, a part of above-mentioned module, program segment or code include one or more
Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box
The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical
On can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wants
It is noted that the combination of each box in block diagram or flow chart and the box in block diagram or flow chart, can use and execute rule
The dedicated hardware based systems of fixed functions or operations is realized, or can use the group of specialized hardware and computer instruction
It closes to realize.
It will be understood by those skilled in the art that although showing and describing referring to the certain exemplary embodiments of the disclosure
The disclosure, it will be appreciated by those skilled in the art that in this public affairs limited without departing substantially from the following claims and their equivalents
In the case where the spirit and scope opened, a variety of changes in form and details can be carried out to the disclosure.Therefore, the model of the disclosure
It encloses and should not necessarily be limited by above-described embodiment, but should be not only determined by appended claims, also by appended claims
Equivalent be defined.
Claims (10)
1. a kind of test method, it is applied to micro services framework, the micro services framework includes first service and second service, described
Method includes:
Monitor the first transaction request message that the first service is sent to the second service；
Determine whether the first transaction request message can be used in testing the second service；
If it is determined that the first transaction request message can be used in testing the second service, then described first is based on
Transaction request message is generated for multiple first test request message (TRM)s to second service request service；
The multiple first test request message (TRM) is sent to the second service；And
The response that the second service is directed to the multiple first test request message (TRM) is monitored, to realize to the second service
Test.
2. according to the method described in claim 1, wherein, whether determination the first transaction request message can be used in pair
The second service is tested, comprising:
It determines and whether carries predetermined instruction in the first transaction request message, the predetermined instruction is used to indicate to described
Two services are tested.
3. according to the method described in claim 1, wherein,
The micro services framework further includes third service；And
The method also includes in the process for monitoring response of the second service for the multiple first test request message (TRM)
In:
The second service is prevented to send multiple second test request message (TRM)s to third service,
Wherein, the multiple second test request message (TRM) is the second service in response to the multiple first test request message (TRM)
And the message being used for the third service request service generated.
4. according to the method described in claim 3, wherein, the method also includes:
The second transaction request message is obtained, the second transaction request message is the second service in response to first transaction
Request message and generate for the third service request service message；
The second transaction request message is forwarded to third service；
Obtain the transaction response message that the third service response is generated in the second transaction request message；
Based on the transaction response message, generate multiple test response messages, the multiple test response message with it is the multiple
Second test request message (TRM) corresponds；And
The multiple test response message is sent to the second service.
5. according to the method described in claim 4, wherein, to the second service send the multiple test response message it
Afterwards, the method also includes:
The second service is prevented to forward the multiple test response message to the first service.
6. according to the method described in claim 4, wherein, before obtaining the second transaction request message, the method also includes:
Obtain the first transaction request message from the first service；And
The first transaction request message is forwarded to the second service.
7. according to the method described in claim 4, wherein, obtaining the third service response in the second transaction request report
Text and generate transaction response message after, the method also includes:
The transaction response message is forwarded to the second service.
8. a kind of test device, it is applied to micro services framework, the micro services framework includes first service and second service, described
Device includes:
First monitors module, the first transaction request message sent for monitoring the first service to the second service；
Determining module, for determining whether the first transaction request message can be used in testing the second service；
Generation module, for determining that the first transaction request message can be used in the feelings tested the second service
Under condition, generated based on the first transaction request message for multiple test request reports to second service request service
Text；
Sending module, for sending the multiple first test request message (TRM) to the second service；And
Second monitors module, the response for being directed to the multiple first test request message (TRM) for monitoring the second service, with reality
Now to the test of the second service.
9. a kind of electronic equipment, comprising:
One or more processors；
Memory, for storing one or more programs,
Wherein, when one or more of programs are executed by one or more of processors, so that one or more of
Processor realizes method described in any one of claims 1 to 7.
10. a kind of computer readable storage medium, is stored with computer executable instructions, described instruction is used for reality when executed
Method described in existing any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910670518.9A CN110380936B (en) | 2019-07-23 | 2019-07-23 | Test method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910670518.9A CN110380936B (en) | 2019-07-23 | 2019-07-23 | Test method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110380936A true CN110380936A (en) | 2019-10-25 |
| CN110380936B CN110380936B (en) | 2021-05-14 |
Family
ID=68255516
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910670518.9A Active CN110380936B (en) | 2019-07-23 | 2019-07-23 | Test method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110380936B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111865726A (en) * | 2020-07-29 | 2020-10-30 | 中国工商银行股份有限公司 | Service message testing method, device, computer system and storage medium |
| CN112866256A (en) * | 2021-01-22 | 2021-05-28 | 中信银行股份有限公司 | Data processing method, device and storage medium |
Citations (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103838625A (en) * | 2014-02-27 | 2014-06-04 | 中国工商银行股份有限公司 | Data interaction method and system |
| CN105376225A (en) * | 2015-11-02 | 2016-03-02 | 亚信科技（南京）有限公司 | Software-as-a-service method and device |
| CN106649845A (en) * | 2016-12-30 | 2017-05-10 | 上海富聪金融信息服务有限公司 | Transaction information service platform and information processing method thereof |
| CN107102947A (en) * | 2017-05-12 | 2017-08-29 | 中国工商银行股份有限公司 | ATM transaction flows test device and method |
| CN107135128A (en) * | 2017-06-28 | 2017-09-05 | 努比亚技术有限公司 | Call chain collecting method, mobile terminal and computer-readable recording medium |
| CN107193546A (en) * | 2017-04-11 | 2017-09-22 | 国网天津市电力公司信息通信公司 | A kind of micro services business application system |
| CN107203376A (en) * | 2017-04-11 | 2017-09-26 | 国网天津市电力公司信息通信公司 | A kind of enterprise-level information system |
| CN107395420A (en) * | 2017-07-26 | 2017-11-24 | 携程计算机技术（上海）有限公司 | Service end performance test methods, system, electronic installation and storage medium |
| US20180039494A1 (en) * | 2016-08-05 | 2018-02-08 | Oracle International Corporation | Zero down time upgrade for a multi-tenant identity and data security management cloud service |
| CN107895253A (en) * | 2017-10-25 | 2018-04-10 | 北京科东电力控制系统有限责任公司 | A kind of method that electricity transaction function carries out micro services transformation |
| CN107979508A (en) * | 2017-11-24 | 2018-05-01 | 深圳乐信软件技术有限公司 | Micro services test method and device |
| US10015167B1 (en) * | 2017-03-17 | 2018-07-03 | Accenture Global Solutions Limited | Extensible key management system for application program interfaces |
| CN108270818A (en) * | 2016-12-30 | 2018-07-10 | 中国移动通信集团公司 | A kind of micro services architecture system and its access method |
| CN108427581A (en) * | 2018-02-07 | 2018-08-21 | 平安普惠企业管理有限公司 | System micro services method and terminal device |
| US20180267884A1 (en) * | 2017-03-16 | 2018-09-20 | Google Llc | Systems and methods for micro-scheduler testing framework |
| KR20190008724A (en) * | 2017-07-17 | 2019-01-25 | 에스케이브로드밴드주식회사 | Apparatus and method for managing microservice |
| CN109587280A (en) * | 2019-01-21 | 2019-04-05 | 山东达创网络科技股份有限公司 | A kind of Business Process Management method and device |
| CN109639572A (en) * | 2018-12-06 | 2019-04-16 | 网易（杭州）网络有限公司 | Route management method, device and micro services system |
| CN109673232A (en) * | 2018-11-02 | 2019-04-26 | 中国农业大学 | A kind of wisdom trickle irrigation cloud service management system based on micro services framework |
| CN109691016A (en) * | 2016-07-08 | 2019-04-26 | 卡列普顿国际有限公司 | Distributing real time system and Verification System |
| CN109885485A (en) * | 2019-01-21 | 2019-06-14 | 中国光大银行股份有限公司 | Transaction collision detection method and device |
| CN109962904A (en) * | 2017-12-26 | 2019-07-02 | 中国移动通信集团公司 | A kind of IMS system based on Kubernetes |
-
2019
- 2019-07-23 CN CN201910670518.9A patent/CN110380936B/en active Active
Patent Citations (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103838625A (en) * | 2014-02-27 | 2014-06-04 | 中国工商银行股份有限公司 | Data interaction method and system |
| CN105376225A (en) * | 2015-11-02 | 2016-03-02 | 亚信科技（南京）有限公司 | Software-as-a-service method and device |
| CN109691016A (en) * | 2016-07-08 | 2019-04-26 | 卡列普顿国际有限公司 | Distributing real time system and Verification System |
| US20180039494A1 (en) * | 2016-08-05 | 2018-02-08 | Oracle International Corporation | Zero down time upgrade for a multi-tenant identity and data security management cloud service |
| CN108270818A (en) * | 2016-12-30 | 2018-07-10 | 中国移动通信集团公司 | A kind of micro services architecture system and its access method |
| CN106649845A (en) * | 2016-12-30 | 2017-05-10 | 上海富聪金融信息服务有限公司 | Transaction information service platform and information processing method thereof |
| US20180267884A1 (en) * | 2017-03-16 | 2018-09-20 | Google Llc | Systems and methods for micro-scheduler testing framework |
| US10015167B1 (en) * | 2017-03-17 | 2018-07-03 | Accenture Global Solutions Limited | Extensible key management system for application program interfaces |
| CN107193546A (en) * | 2017-04-11 | 2017-09-22 | 国网天津市电力公司信息通信公司 | A kind of micro services business application system |
| CN107203376A (en) * | 2017-04-11 | 2017-09-26 | 国网天津市电力公司信息通信公司 | A kind of enterprise-level information system |
| CN107102947A (en) * | 2017-05-12 | 2017-08-29 | 中国工商银行股份有限公司 | ATM transaction flows test device and method |
| CN107135128A (en) * | 2017-06-28 | 2017-09-05 | 努比亚技术有限公司 | Call chain collecting method, mobile terminal and computer-readable recording medium |
| KR20190008724A (en) * | 2017-07-17 | 2019-01-25 | 에스케이브로드밴드주식회사 | Apparatus and method for managing microservice |
| CN107395420A (en) * | 2017-07-26 | 2017-11-24 | 携程计算机技术（上海）有限公司 | Service end performance test methods, system, electronic installation and storage medium |
| CN107895253A (en) * | 2017-10-25 | 2018-04-10 | 北京科东电力控制系统有限责任公司 | A kind of method that electricity transaction function carries out micro services transformation |
| CN107979508A (en) * | 2017-11-24 | 2018-05-01 | 深圳乐信软件技术有限公司 | Micro services test method and device |
| CN109962904A (en) * | 2017-12-26 | 2019-07-02 | 中国移动通信集团公司 | A kind of IMS system based on Kubernetes |
| CN108427581A (en) * | 2018-02-07 | 2018-08-21 | 平安普惠企业管理有限公司 | System micro services method and terminal device |
| CN109673232A (en) * | 2018-11-02 | 2019-04-26 | 中国农业大学 | A kind of wisdom trickle irrigation cloud service management system based on micro services framework |
| CN109639572A (en) * | 2018-12-06 | 2019-04-16 | 网易（杭州）网络有限公司 | Route management method, device and micro services system |
| CN109587280A (en) * | 2019-01-21 | 2019-04-05 | 山东达创网络科技股份有限公司 | A kind of Business Process Management method and device |
| CN109885485A (en) * | 2019-01-21 | 2019-06-14 | 中国光大银行股份有限公司 | Transaction collision detection method and device |
Non-Patent Citations (4)
| Title |
|---|
| XAVIER LIMΌN: "SagaMAS: A Software Framework for Distributed Transactions in the Microservice Architecture", 《2018 6TH INTERNATIONAL CONFERENCE IN SOFTWARE ENGINEERING RESEARCH AND INNOVATION (CONISOFT)》 * |
| 张波: "网上银行信息安全系统的开发与实现", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
| 陈延彬: "银行系统交易路径自动选择的设计与实现", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
| 高洁: "建设银行业务系统性能测试通用模拟器的设计与实现", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111865726A (en) * | 2020-07-29 | 2020-10-30 | 中国工商银行股份有限公司 | Service message testing method, device, computer system and storage medium |
| CN112866256A (en) * | 2021-01-22 | 2021-05-28 | 中信银行股份有限公司 | Data processing method, device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110380936B (en) | 2021-05-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103678105B (en) | A kind of test method and device of page code | |
| CN104484273B (en) | The method of testing of application program, equipment and system | |
| CN108984418A (en) | Software testing management method, device, electronic equipment and storage medium | |
| CN104765678A (en) | Method and device for testing applications on mobile terminal | |
| CN104765689B (en) | A kind of interface capability data supervise method and apparatus in real time | |
| CN110162424A (en) | Fault handling method, system, device and storage medium | |
| US11809882B2 (en) | Interface calling method and apparatus, and computer-readable storage medium | |
| CN112860569A (en) | Automatic testing method and device, electronic equipment and storage medium | |
| CN106100913A (en) | Error message alignment system and method | |
| CN110147315A (en) | Concurrency performance test method, device, computer equipment and storage medium | |
| CN109062807B (en) | Method and device for testing application program, storage medium and electronic device | |
| US20220382936A1 (en) | Method and system for micro-service testing, and storage medium | |
| CN109885496A (en) | Test log management method and system | |
| CN110380936A (en) | Test method and device | |
| CN103246606A (en) | Method and system for testing performances of ESB (enterprises service bus) platform | |
| CN107168844B (en) | Performance monitoring method and device | |
| CN106095676A (en) | Method of testing that data report, Apparatus and system | |
| CN114448867B (en) | Route visualization method, device, equipment and storage medium | |
| CN109558297A (en) | EMS memory management process and device | |
| CN109460365B (en) | A kind of system performance testing method, apparatus, equipment and storage medium | |
| CN110380890A (en) | A kind of CDN system service quality detection method and system | |
| CN110399723A (en) | Leak detection method and device, storage medium and electronic device | |
| US8676724B2 (en) | Training with complex event processing engine to identify semantic meaning of virtual world object state changes | |
| CN116107869A (en) | Arrangement test method and device, electronic equipment and readable storage medium | |
| CN110362294A (en) | Development task executes method, apparatus, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |