CN110213119A - Test pile generation method, test macro, test method and equipment - Google Patents

Test pile generation method, test macro, test method and equipment Download PDF

Info

Publication number
CN110213119A
CN110213119A CN201810186432.4A CN201810186432A CN110213119A CN 110213119 A CN110213119 A CN 110213119A CN 201810186432 A CN201810186432 A CN 201810186432A CN 110213119 A CN110213119 A CN 110213119A
Authority
CN
China
Prior art keywords
test
test pile
data
communication protocol
pile
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810186432.4A
Other languages
Chinese (zh)
Other versions
CN110213119B (en
Inventor
丁永亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tenpay Payment Technology Co Ltd
Original Assignee
Tenpay Payment Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tenpay Payment Technology Co Ltd filed Critical Tenpay Payment Technology Co Ltd
Priority to CN201810186432.4A priority Critical patent/CN110213119B/en
Publication of CN110213119A publication Critical patent/CN110213119A/en
Application granted granted Critical
Publication of CN110213119B publication Critical patent/CN110213119B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/50Testing arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/18Multiprotocol handlers, e.g. single devices capable of handling multiple protocols

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Computer And Data Communications (AREA)

Abstract

The embodiment of the invention provides a kind of test pile generation methods, test macro, method and apparatus, belong to field of computer technology.Test pile generation method includes: to receive test pile to generate instruction, and it includes communication protocol mark and stake quantity that test pile, which generates instruction, and communication protocol mark is used to indicate test pile type, and stake quantity is used to indicate the quantity of test pile;It is generated and is instructed according to test pile, generate corresponding test pile, test pile is used to respond the request of data of system under test (SUT), and the general utility functions of different types of test pile is identical.The embodiment of the present invention is by generating the stake quantity for including in instruction and the communication protocol for being used to indicate test pile type mark generation test pile according to test pile, and since the general utility functions of different types of test pile is identical, it is not independent from each other system each other, so as to the test pile of dynamic generation different type and different number, the flexibility for generating test pile is improved, and the processing expense of test can be saved.

Description

Test pile generation method, test macro, test method and equipment
Technical field
The present embodiments relate to field of computer technology, in particular to a kind of test pile generation method, test macro, survey Method for testing and equipment.
Background technique
The communication carried out between field of communication technology, equipment, other than needing hardware supported, it is also necessary to equipment institute The support of the communication system of operation.Communication system at runtime, can be to data needed for other system requests itself.Therefore, it opens Hair personnel need to simulate the requested other systems of tested communication system by test pile when testing communication system System, to respond the request of data of tested communication system.
In the related art, different communication systems is potentially based on different communication protocol and is communicated with other systems. Therefore, it when testing multiple communication systems based on different communication protocol, needs to be tested by multiple test piles.Wherein, Multiple test piles are independent from each other system, and correspond respectively to different communication systems.
In the related technology, since different test piles is independent from each other system, when test is assisted based on different communication When multiple communication systems of view, multiple mutually independent test piles need to be run simultaneously, i.e., run multiple mutually independent systems simultaneously System causes the processing expense of test excessive to test multiple communication systems.
Summary of the invention
The embodiment of the invention provides a kind of test pile generation method, test macro, test method and equipment, can be used for solving Certainly when testing multiple communication systems based on different communication protocol, multiple mutually independent test piles need to be run simultaneously, are caused The excessive problem of the processing expense of test.The technical solution is as follows:
On the one hand, a kind of test pile generation method is provided, which comprises
Reception test pile generates instruction, and the test pile generates instruction and includes communication protocol mark and stake quantity, described logical Letter protocol-identifier is used to indicate test pile type, and the stake quantity is used to indicate the quantity of test pile;
It is generated and is instructed according to the test pile, generate corresponding test pile, the test pile is for responding system under test (SUT) The general utility functions of request of data, different types of test pile is identical.
On the other hand, a kind of test pile generating means are provided, described device includes:
Stubs are tested, generate instruction for receiving test pile, it includes that communication protocol identifies that the test pile, which generates instruction, With stake quantity, the communication protocol mark is used to indicate test pile type, and the stake quantity is used to indicate the quantity of test pile;
The test stubs are also used to generate instruction according to the test pile, generate corresponding test pile, the test For responding the request of data of system under test (SUT), the general utility functions of different types of test pile is identical for stake.
In another aspect, a kind of test macro is provided, and the system comprises: test pile management module and test stubs, The test stubs include general submodule and different agreement submodules;
The test pile management module, for calling the test stubs;
The general submodule, for receiving the request of data of system under test (SUT) transmission;
The agreement submodule, for obtaining response data, the request of data and the association according to the request of data It discusses submodule and corresponds to identical communication protocol;
The general submodule is also used to send the response data to the system under test (SUT).
Another aspect provides a kind of test method, and the method is applied in test macro, the test macro packet Include: test pile management module and test stubs, the test stubs include general submodule and different agreement submodules;
The described method includes:
The test pile management module calls the test stubs;
The general submodule receives the request of data that system under test (SUT) is sent;
The agreement submodule obtains response data, the request of data and the agreement submodule according to the request of data Block corresponds to identical communication protocol;
The general submodule sends the response data to the system under test (SUT).
Also on the one hand, a kind of computer equipment is provided, the computer equipment includes processor and memory, described to deposit Be stored at least one instruction, at least a Duan Chengxu, code set or instruction set in reservoir, at least one instruction, it is described extremely A few Duan Chengxu, the code set or described instruction collection realize the test as described in terms of above-mentioned when being executed by the processor Stake generation method or test method.
Another aspect provides a kind of computer readable storage medium, at least one finger is stored in the storage medium Enable, at least a Duan Chengxu, code set or instruction set, at least one instruction, an at least Duan Chengxu, the code set or Described instruction collection realizes the test pile generation method or test method as described in terms of above-mentioned when executed.
In another aspect, provide a kind of computer program product, when the computer program product is performed, it is used to hold Test pile generation method or test method described in the above-mentioned aspect of row.
Technical solution provided in an embodiment of the present invention can be brought the following benefits:
In embodiments of the present invention, by generating the stake quantity for including in instruction according to test pile and being used to indicate test pile The communication protocol mark of type generates test pile, and since the general utility functions of different types of test pile is identical, each other simultaneously It is not independent from each other system, so as to the test pile of dynamic generation different type and different number, improves generation test The flexibility of stake;In addition, call test stubs to be tested to realize test pile function by test pile management module, it can To save the processing expense of test.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other Attached drawing.
Fig. 1 is the schematic diagram of the application scenarios of test macro provided by one embodiment of the present invention;
Fig. 2 is the architecture diagram of test macro provided by one embodiment of the present invention;
Fig. 3 is the architecture diagram for the test macro that another embodiment of the present invention provides;
Fig. 4 is the architecture diagram for the test macro that another embodiment of the present invention provides;
Fig. 5 is the flow chart of test method provided by one embodiment of the present invention;
Fig. 6 is the flow chart of test pile generation method provided by one embodiment of the present invention;
Fig. 7 is the structural schematic diagram of computer equipment provided by one embodiment of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention Formula is described in further detail.
Referring to FIG. 1, it illustrates the schematic diagrames of the application scenarios of test macro provided by one embodiment of the present invention.It should It include: test macro 110, system under test (SUT) 120 and control system 130 in application scenarios.
Test macro 110 is for simulating the requested other systems of system under test (SUT) 120, to respond the number of system under test (SUT) 120 According to request.
System under test (SUT) 120, which refers to, needs communication system to be tested.System under test (SUT) 120 sends data to test macro 110 and asks It asks.Test macro 110 responds the request of data, to 120 returning response data of system under test (SUT), so as to complete to system under test (SUT) 120 test.
Control system 130 is for controlling test macro 110.Control system 130 can be interacted directly with user, according to The instruction of user's input controls test macro 110.It should be noted that control system 130 can control a test macro 110, multiple test macros 110 can also be controlled simultaneously.
It should be noted that illustrating only a system under test (SUT) 120 in figure, but in practical applications, test macro 110 can To respond the request of data of multiple systems under test (SUT) 120 simultaneously, while testing multiple systems under test (SUT) 120.Multiple systems under test (SUT) 120 can To correspond to different communication protocol, same communication protocol may correspond to.
Referring to FIG. 2, it illustrates the architecture diagrams of test macro 110 provided by one embodiment of the present invention.Test macro 110 include: test pile management module 111 and test stubs 112.Test stubs 112 include: general submodule 112a and not Same agreement submodule 112b.Different agreement submodule 112b correspond respectively to different communication protocol.
Test pile management module 111 is for managing test stubs 112, such as calling test stubs 112.
Test stubs 112 are used to respond the request of data of system under test (SUT) 120.Wherein, general submodule 112a is for real Be not related to the function of communication protocol now, such as receive, send, be delayed etc..Agreement submodule 112b is for realizing being related to communication protocols The function of view, such as determine the webpage for being based on hypertext transfer protocol (Hyper Text Transfer Protocal, HTTP) Request requested data.
Optionally, as shown in figure 3, test macro 110 further includes test agent module 113.Test agent module 113 is used for It is communicated with control system 130, such as receives the instruction and data that control system 130 is sent.
In the following, explanation is introduced to the process for using test macro 110 to test system under test (SUT) 120.
Test pile management module 111, for calling test stubs 112.
Test pile management module 111 can call test stubs 112, generate test pile, be based on test pile generated Respond the request of data of system under test (SUT) 120.Testing stubs 112 includes general submodule 112a and different agreement submodules 112b, different agreement submodule 112b correspond respectively to different communication protocol.Test pile management module 111 is logical by calling Test stubs 112 are called with submodule 112a and agreement submodule 112b, generate test pile.Test pile refers to calling test The process that stubs 112 are created.One system under test (SUT) 120 of every test of test macro 110 all generates a test pile.Test The request of data of response system under test (SUT) 120 is realized in stake by the test pile that general submodule 112a and agreement submodule 112b is generated Function.
Illustratively, test stubs include general submodule D, in addition, test stubs further include and A pairs of communication protocol The agreement submodule A answered, and agreement submodule B corresponding with communication protocol B.
When needing to generate the multiple test piles for corresponding to different communication protocol, test pile management module 111 calls test pile Module 112 such as sends test pile to test stubs 112 and generates instruction, which, which generates, assesses a bid for tender in instruction including communication protocols Know and stake quantity.Then test pile management module 111 is based on the test pile and generates the instruction general submodule 112a of calling, and calling pair It should be in the agreement submodule 112b of different communication protocol, to generate the multiple test piles for corresponding to different communication protocol.Example Property, it needs to generate a test pile corresponding to a test pile of communication protocol A and corresponding to communication protocol B.Test pile Management module 111 generates test pile A, and adjust by calling the general submodule D and agreement submodule A corresponding to communication protocol A With the agreement submodule B for corresponding to communication protocol B, test pile B is generated.
Test macro 110 tests multiple systems under test (SUT) 120 simultaneously, and multiple systems under test (SUT) 120 correspond to same communication protocols View, then test macro 110 needs to generate the multiple test piles for corresponding to same communication protocol.Test pile management module more than 111 times Test stubs 112 are called, the multiple test piles for corresponding to same communication protocol are generated.Test pile management module 111 is called logical With submodule 112a, and repeatedly call according to the number of the test pile of required generation the same agreement corresponding to same communication protocol Submodule 112b, to generate the multiple test piles for corresponding to same communication protocol.Illustratively, system under test (SUT) A1 and tested system The A2 that unites corresponds to same communication protocol A, then needs to generate two test piles for corresponding to communication protocol A.Test pile management module 111 call general submodule D, and call the agreement submodule A for corresponding to communication protocol A twice, generate test pile A1 and test Stake A2.Test pile A1 and test pile A2 both correspond to communication protocol A.The data that test pile A1 is used to respond system under test (SUT) A1 are asked It asks, tests system under test (SUT) A1.Test pile A2 is used to respond the request of data of system under test (SUT) A2, tests system under test (SUT) A2.
Test pile management module 111 may call upon test stubs 112, ask directly in response to the data of system under test (SUT) 120 It asks, without pre-generated test pile.Test pile management module 111 calls directly general submodule 112a, and according to system under test (SUT) 120 communication protocol calls corresponding agreement submodule 112b, and the request of data of system under test (SUT) 120 is responded with this.
Optionally, test pile management module 111 for obtaining communication protocol mark, and is identified according to the communication protocol and is adjusted With test stubs 112.Communication protocol mark is for uniquely indicating a test pile type.Different types of test pile corresponds to not Same communication protocol corresponds to different agreement submodule 112b.The general utility functions of different types of test pile is identical, this is logical Referred to function and is not related to the function of communication protocol.Test pile management module 111 is stored with configuration file, which includes Corresponding relationship between communication protocol mark, communication protocol and agreement submodule 112b.Test pile management module 111 is according to above-mentioned Configuration file calls the agreement submodule 112b of communication protocol mark instruction, to call test stubs 112.Illustratively, lead to Believe the corresponding relationship of protocol-identifier, communication protocol and agreement submodule 112b as shown in following table -1:
Communication protocol mark Communication protocol Agreement submodule
A HTTP Agreement submodule A
B TELNET Agreement submodule B
C SMTP Agreement submodule C
Table -1
As shown in above-mentioned table -1, corresponded to each other between communication protocol mark A, http communication agreement and agreement submodule A.It surveys Test pile management module 111 identifies A invocation protocol submodule A according to communication protocol, generates and is based on http communication agreement for testing System under test (SUT) test pile, or the request of data directly in response to the system under test (SUT).
It should be noted that above-mentioned configuration file is by designer according to agreement submodule 112b, agreement submodule 112b Corresponding communication protocol and the corresponding communication protocol mark of agreement submodule 112b are preset.Wherein, agreement submodule The corresponding communication protocol mark of 112b can be preset by designer.For example, test macro 110 includes assisting with http communication Corresponding agreement submodule A is discussed, and the corresponding communication protocol of agreement submodule A is identified as A, then is arranged in configuration file in advance Communication protocol identifies the corresponding relationship between A, http communication agreement and agreement submodule A.It is alternatively possible to expanded configuration file In corresponding relationship.When adding agreement submodule 112b in test macro 110, it can be arranged in configuration file and be added Agreement submodule 112b corresponding relationship.
Test pile management module 111 calls test stubs 112 first to send out to test stubs 112 when generating test pile Test pile is sent to generate instruction.It includes that communication protocol mark and stake quantity, stake quantity are used to indicate test that the test pile, which generates instruction, The quantity of stake.After testing the reception test pile generation instruction of stubs 112, pass through the agreement submodule of communication protocol mark instruction 112b and general submodule 112a generates corresponding test pile in conjunction with the test pile quantity of stake quantity instruction.
In a kind of possible embodiment, test pile management module 111, for calling when test macro 110 starts Stubs 112 are tested, test pile is generated.When test macro 110 starts, the test to be called of test pile management module 111 The corresponding communication protocol mark of agreement submodule 112b in stubs 112 and the test pile quantity to be generated, can be by setting Meter personnel preset based on practical experience, can also be by user's customized setting in advance.Test pile management module 111 is according to pre- The communication protocol mark first set and the test pile quantity to be generated call test stubs 112, generate test pile.
In alternatively possible embodiment, test agent module 113, for obtaining operational order.Operational order packet It includes at least one communication protocol mark, stake quantity corresponding with each communication protocol mark and is identified with each communication protocol Corresponding operation mark.Operation mark is used to indicate action type, which includes but is not limited to: call operation or stopping Operation.Call operation refers to calling test stubs 112, generates test pile.It stops operation and refers to that test stubs are called in stopping 112, destroy test pile.Test agent module 113 is also used to when the action type that operation mark indicates is call operation, to Test pile manage 111 pieces of transmissions call instructions of mould, the call instruction include communication protocol mark and with communication protocol identify pair The stake quantity answered.At this point, the quantity for the test pile that the stake quantity in call instruction generates needed for indicating.Test pile management module 111, for calling test stubs 112 according to call instruction, generate test pile.Illustratively, operational order includes communication protocols It assesses a bid for tender and knows A and the corresponding stake quantity of communication protocol mark A: 2, identifying the corresponding operation mark of A with communication protocol: call operation, Communication protocol identifies the corresponding stake quantity of B and communication protocol mark B: 1 and operation mark corresponding with communication protocol mark B Know.The action type of above-mentioned two operation mark instruction is call operation.Test agent module 113 according to the operational order to Test pile management module 111 sends call instruction.Test pile management module 111 calls test stubs according to the call instruction 112, generate two test piles corresponding with communication protocol mark A, and a test pile corresponding with communication protocol mark B.
Optionally, test pile management module 111 calls test stubs 112, asks directly in response to the data of system under test (SUT) 120 It asks.Test agent module 113, for obtaining operational order.Operational order include at least one communication protocol mark and with it is every A communication protocol identifies corresponding operation mark.When the action type of operation mark instruction is call operation, test agent mould Block 113 manages 111 pieces of transmission call instructions of mould to test pile, which includes communication protocol mark.Test pile manages mould Block 111 responds the request of data of system under test (SUT) 120 for calling test stubs 112 according to call instruction.
Optionally, control system 130, for sending operational order to test agent module 113.130 basis of control system Communication protocol mark, stake quantity and the action type of user's input send operational order to test agent module 113.
General submodule 112a, for receiving the request of data of the transmission of system under test (SUT) 120.
When test pile management module 111 calls test stubs 112, after generating test pile, the test pile and system under test (SUT) Data interaction is carried out between 120.Because test pile is the process for calling test stubs 112 to be created, test pile and quilt Data interaction is carried out between examining system 120 to be interacted between test stubs 112 and system under test (SUT) 120.In testing, it is tested system After system 120 sends request of data, the general submodule 112a tested in stubs 112 receives the data that system under test (SUT) 120 is sent Request.When testing the request of data that stubs 111 call test stubs 112 directly in response to system under test (SUT) 120, test pile mould General submodule 112a in block 112 receives the request of data that system under test (SUT) 120 is sent.
Optionally, test pile management module 111 is also used to be counted between test stubs 112 and system under test (SUT) 120 Before interaction, the stake information of the test pile of generation is sent to test agent module 113.Test agent module 113, be also used to by Stake information is sent to control system 130.Stake information is shown to user by control system 130.Stake information includes but is not limited to first Address information and communication protocol mark.User determines the corresponding communication protocol of test pile generated according to communication protocol mark, So that it is determined that the system under test (SUT) 120 that the test pile can be tested, then the first address information is inputted into system under test (SUT) 120.Tested system System 120 obtains the first address information of user's input, sends request of data to above-mentioned test pile further according to the first address information.It can Selection of land, the first address information are the address Socket.
Agreement submodule 112b, for obtaining response data according to request of data.
System under test (SUT) 120 and test stubs 112 are to carry out data interaction based on same communication protocol, therefore, are tested The request of data of system 120 is sent based on the communication protocol.Agreement submodule 112b base corresponding with the communication protocol Request of data is parsed in the communication protocol, and response data is obtained according to parsing result.For example, parsing data based on communication protocol Requested data type is requested, and obtains the response data of the data type.
General submodule 112a is also used to send response data to system under test (SUT) 120.
The agreement submodule 112b response data obtained is sent to system under test (SUT) 120 by general submodule 112a, completes number According to the response of request.
In a kind of possible embodiment, the request of data that system under test (SUT) 120 is sent includes the second address information.It is general Submodule 112a sends response data to system under test (SUT) 120 according to the second address information.
In alternatively possible embodiment, system under test (SUT) 120 send request of data include the second address information and System banner.System banner is for uniquely indicating a system under test (SUT) 120.When multiple systems under test (SUT) 120 share same second address When information, general submodule 112a sends response data to system under test (SUT) 120 according to the second address information and system banner.
Optionally, test agent module 113 is also used to after test, obtains operational order.Operational order includes extremely Few communication protocol mark, stake quantity corresponding with each communication protocol mark and corresponding with each communication protocol mark Operation mark.Test agent module 113 is also used to when the action type that operation mark indicates is to stop operation, to test Stake management module 111 send halt instruction, the halt instruction include communication protocol mark and it is corresponding with communication protocol mark Stake quantity.At this point, the quantity for the test pile that the stake quantity in halt instruction is destroyed needed for indicating.Test pile management module 111, also For being stopped calling test stubs 112 according to halt instruction, destroys and call the survey generated of target detection stubs 1121 Test pile.Illustratively, operational order includes communication protocol mark A, with communication protocol identifies the corresponding stake quantity of A: 2, with communicate The corresponding operation mark of protocol-identifier A, communication protocol mark B, with the corresponding stake quantity of communication protocol mark B: 1 and with lead to Believe the corresponding operation mark of protocol-identifier B.The action type of above-mentioned two operation mark instruction is to stop operation.Test agent Module 113 sends halt instruction to test pile management module 111 according to the operational order.Test pile management module 111 is according to this Halt instruction stops calling test stubs 112, destroy it is generated identify with communication protocol corresponding two test piles of A and A test pile corresponding with communication protocol mark B.
Optionally, test pile management module 111 calls test stubs 112, asks directly in response to the data of system under test (SUT) 120 It asks.Test agent module 113 is also used to manage mould to test pile when the action type that operation mark indicates is to stop operation 111 pieces of transmission halt instructions, the halt instruction include communication protocol mark.Test pile management module 111, for being referred to according to stopping It enables and calls test stubs 112.
Optionally, as shown in figure 4, test macro 110 further includes a data memory module 114.Stake data memory module 114 For data needed for storing test system under test (SUT) 120.
Optionally, test agent module 113 is also used to before calling test stubs 112, obtains preset data.This is pre- If data are preset by designer according to system under test (SUT) 120 and practical experience.The different correspondences of system under test (SUT) 120 is different Preset data.It wherein, include above-mentioned response data in preset data.Control system 130, for obtaining the present count of user's input According to, and the preset data is sent to test agent module 113.Test agent module 113 is also used to for preset data being sent to Stake data memory module 114.Stake data memory module 114, for storing preset data.Agreement submodule 112b is used for basis Request of data obtains response data from stake data memory module 114.
Optionally, since different systems under test (SUT) 120 corresponds to different preset datas, obtaining user's input When preset data, control system 130 also obtains system banner corresponding with preset data.Test agent module 113 obtains control The preset data and system banner corresponding with preset data that system 130 is sent, and by preset data and and preset data Corresponding system banner is sent to a data memory module 114.Stake data memory module 114 store preset data and with it is default The corresponding system banner of data.Agreement submodule 112b determines that system under test (SUT) 120 is corresponding according to the system banner in request of data Preset data, then obtain response data from the preset data.
Optionally, test agent module 113, the data for being also used to obtain the transmission of control system 130, which are deleted, to be instructed, and according to Data delete instruction and delete the preset data stored in stake data memory module 114.By control system 130 to test agent mould Block 113 sends data and deletes instruction, and test agent module 113 is enabled to delete stake data memory module after test The preset data stored in 114 saves the memory space of test macro 110.
Optionally, it includes system banner that data, which delete instruction,.Test agent module 113 deletes stake number according to the system banner According to the preset data corresponding with the system banner stored in memory module 114.When the test to system under test (SUT) 120 is completed, Corresponding preset data is identified by deletion system, can only delete the corresponding preset data of system under test (SUT) 120 that test is completed, Space is saved, avoids deleting the corresponding preset data of other systems under test (SUT) 120, does not influence the test of other systems under test (SUT) 120.
In embodiments of the present invention, test stubs are called by test pile management module, generated for testing tested system The test pile of system.It is tested, is shared between different test piles same since test pile is based on same general submodule General submodule, is not independent from each other system each other, to save the processing expense of test.
Referring to FIG. 5, it illustrates the flow charts of test pile generation method provided by one embodiment of the present invention.This method It can be applied in test macro shown in FIG. 1.This method may include the following steps:
Step 501, it receives test pile and generates instruction, it includes communication protocol mark and stake quantity that test pile, which generates instruction, is led to Letter protocol-identifier is used to indicate test pile type, and stake quantity is used to indicate the quantity of test pile.
When testing system under test (SUT), test pile management module needs to call test stubs, generates test pile, the test pile For responding the request of data of system under test (SUT).Test pile management module calls test stubs come when generating test pile, first to survey Test pile module sends test pile and generates instruction.It includes communication protocol mark and stake quantity, the communication protocols that the test pile, which generates instruction, Knowledge of assessing a bid for tender is used to indicate test pile type to be generated, and stake quantity can determine according to actual conditions, and the embodiment of the present invention is to this It is not limited.
Step 502, it is generated and is instructed according to test pile, generate corresponding test pile, the general function of different types of test pile It can be identical.
It tests stubs to receive after test pile generates instruction, passes through the agreement submodule and general of communication protocol mark instruction Submodule generates corresponding test pile in conjunction with the test pile quantity of stake quantity instruction.Test pile is for responding system under test (SUT) The general utility functions of request of data, different types of test pile is identical, that is, shares same general submodule.
Optionally, after generating test pile, test stubs receive the request of data that system under test (SUT) is sent based on test pile, And response data is obtained according to the request of data, finally the response data is sent to system under test (SUT).
In embodiments of the present invention, by generating the stake quantity for including in instruction according to test pile and being used to indicate test pile The communication protocol mark of type generates test pile, and since the general utility functions of different types of test pile is identical, each other simultaneously It is not independent from each other system, so as to the test pile of dynamic generation different type and different number, improves generation test The flexibility of stake, and the processing expense of test can be saved.
Referring to FIG. 6, it illustrates the flow charts of test method provided by one embodiment of the present invention.This method can be applied In test macro shown in FIG. 1.This method may include the following steps:
Step 601, test pile management module calls test stubs.
Test pile management module can call test stubs, generate test pile, respond quilt based on test pile generated The request of data of examining system.Testing stubs includes general submodule and agreement submodule.Test pile management module passes through calling General submodule and agreement submodule call test stubs, generate test pile.Test pile refers to calling test stubs institute The process of creation.Test pile realizes subsequent step by general submodule and agreement submodule, the function of being requested with response data.
Testing stubs includes general submodule and different agreement submodules, and different agreement submodules corresponds respectively to Different communication protocol.
When needing to generate the multiple test piles for corresponding to different communication protocol, test pile management module calls test pile mould Block.Test pile management module calls general submodule, and calls and correspond to the multiple agreement submodules of different communication protocol, thus raw At the multiple test piles for corresponding to different communication protocol.
Test macro can test multiple systems under test (SUT) simultaneously.Multiple systems under test (SUT) correspond to same communication protocol, then survey Test system needs to generate the multiple test piles for corresponding to same communication protocol.Test pile management module repeatedly calls test pile mould Block generates the multiple test piles for corresponding to same communication protocol.Test pile management module calls general submodule, and according to required The number of the test pile of generation repeatedly calls the same agreement submodule corresponding to same communication protocol, corresponds to together to generate Multiple test piles of one communication protocol.
Test pile management module may call upon test stubs, directly in response to the request of data of system under test (SUT), without pre- First generate test pile.Test pile management module calls directly general submodule, and calls phase according to the communication protocol of system under test (SUT) The agreement submodule answered, the request of data of system under test (SUT) is responded with this.
Optionally, test pile management module obtains communication protocol mark, and is identified according to the communication protocol and call test pile Module.Communication protocol mark is for uniquely indicating a test pile type.Different types of test pile corresponds to different communication protocols View corresponds to different agreement submodules.Test pile management module is stored with configuration file, which is used to indicate logical Believe the corresponding relationship between protocol-identifier, communication protocol and agreement submodule.Test pile management module according to above-mentioned configuration file, The agreement submodule of communication protocol mark instruction is called to call test stubs.Exemplary illustration in relation to configuration file can join The introduction seen above for table -1 illustrates that the present embodiment repeats no more this.
Test pile management module calls test stubs it is raw first to send test pile to test stubs when generating test pile At instruction.It includes that communication protocol mark and stake quantity, stake quantity are used to indicate the quantity of test pile that the test pile, which generates instruction,.It surveys After test pile module acceptance test stake generates instruction, by the agreement submodule and general submodule of communication protocol mark instruction, then In conjunction with the test pile quantity that stake quantity indicates, corresponding test pile is generated.
In a kind of possible embodiment, in test macro starting, test pile management module calls test stubs, Generate test pile.Agreement submodule in test macro starting, in the test pile management module test stubs to be called Corresponding communication protocol mark and the test pile quantity to be generated, can be preset based on practical experience by designer, It can also be by user's customized setting in advance.Test pile management module is identified and to be generated according to preset communication protocol Test pile quantity, call test stubs, generate test pile.
In alternatively possible embodiment, test agent module obtains operational order, and operational order includes at least one A communication protocol mark and each communication protocol identify corresponding stake quantity and behaviour corresponding with each communication protocol mark It makes a check mark.Operation mark is used to indicate action type, which includes but is not limited to: call operation stops operation.It adjusts Refer to calling test stubs with operation, generates test pile.It stops operation and refers to that test stubs are called in stopping, destroying test Stake.When the action type of operation mark instruction is call operation, test agent module sends to test pile management module and calls Instruction, the call instruction include communication protocol mark and stake quantity corresponding with communication protocol mark.At this point, in call instruction Stake quantity indicate needed for generate test pile quantity.Test pile management module calls test stubs according to call instruction, Generate test pile.
Optionally, test pile management module calls test stubs, directly in response to the request of data of system under test (SUT) 120.It surveys It tries proxy module and obtains operational order.Operational order includes at least one communication protocol mark and identifies with each communication protocol Corresponding operation mark.When the action type of operation mark instruction is call operation, test agent module is to test pile management Module sends call instruction, which includes communication protocol mark.Test pile management module is called according to call instruction and is surveyed Test pile module responds the request of data of system under test (SUT) 120.
Optionally, aforesaid operations instruction is sent to test agent module by control system.Control system is inputted according to user Communication protocol mark, stake quantity and action type to test agent module send operational order.
Step 602, general submodule receives the request of data that system under test (SUT) is sent.
When test pile management module call test stubs, generate test pile after, between the test pile and system under test (SUT) into Row data interaction.Because test pile is to call the process that is created of test stubs, between test pile and system under test (SUT) into Row data interaction is interacted between test stubs and system under test (SUT).In testing, after system under test (SUT) sends request of data, test General submodule in stubs receives the request of data that system under test (SUT) is sent.When test stubs call test stubs direct When responding the request of data of system under test (SUT), the general submodule tested in stubs receives the request of data that system under test (SUT) is sent.
Optionally, before carrying out data interaction between test stubs and system under test (SUT), test pile management module will be generated The stake information of test pile be sent to test agent module.Stake information is sent to control system, control system by test agent module Stake information is shown to user by system.Stake information includes but is not limited to the first address information and communication protocol mark.User is according to logical Letter protocol-identifier determines the corresponding communication protocol of test pile generated, so that it is determined that the tested system that the test pile can be tested System, then the first address information is inputted into system under test (SUT).System under test (SUT) obtains the first address information of user's input, further according to first Address information sends request of data to test pile.Optionally, the first address information is the address Socket.
Step 603, agreement submodule obtains response data according to request of data.
System under test (SUT) and test module are to carry out data interaction, therefore, the number of system under test (SUT) based on same communication protocol It according to request is sent based on the communication protocol.Agreement submodule corresponding with the communication protocol is parsed based on the communication protocol Request of data, and response data is obtained according to parsing result.For example, parsing the requested data of request of data based on communication protocol Type, and obtain the response data of the data type.
Optionally, test macro further include: stake data memory module.Before calling test stubs, test agent module Obtain preset data.The preset data is preset by designer according to system under test (SUT) and practical experience.Different tested systems The corresponding different preset data of system.It wherein, include above-mentioned response data in preset data.Control system obtains the pre- of user's input If data, and the preset data is sent to test agent module.The preset data is sent to a number again by test agent module According to memory module.Stake data memory module stores above-mentioned preset data.When testing, agreement submodule is according to request of data Response data is obtained from stake data memory module.
Optionally, since different systems under test (SUT) corresponds to different preset datas, obtaining the default of user's input When data, control system also obtains system banner corresponding with preset data.System banner is for uniquely indicating a system under test (SUT). Test agent module obtains the preset data and system banner corresponding with preset data that control system is sent, and by present count Accordingly and system banner corresponding with preset data is sent to a data memory module.Stake data memory module stores preset data And system banner corresponding with preset data.Agreement submodule confirms system under test (SUT) pair according to the system banner in request of data The preset data answered, then response data is obtained from the preset data.
Step 604, general submodule sends response data to system under test (SUT).
The response data that agreement submodule obtains is sent to system under test (SUT) by general submodule, completes the sound of request of data It answers.
In a kind of possible embodiment, the request of data that system under test (SUT) is sent includes the second address information.General son Module sends response data to system under test (SUT) according to the second address information.
In alternatively possible embodiment, the request of data that system under test (SUT) is sent includes the second address information and system Mark.When multiple systems under test (SUT) share same second address information, general submodule is according to the second address information and system mark Know to system under test (SUT) and sends response data.
Optionally, after test, test agent module obtains operational order.Operational order includes at least one communication Protocol-identifier and each communication protocol identify corresponding stake quantity and operation mark corresponding with each communication protocol mark. When the action type of operation mark instruction is to stop operation, test agent module is sent to test pile management module to be stopped referring to It enables, which includes communication protocol mark and stake quantity corresponding with communication protocol mark.At this point, in halt instruction The quantity for the test pile that stake quantity is destroyed needed for indicating.Test pile management module stops calling test pile mould according to halt instruction Block is destroyed and calls the target detection stubs test pile generated.
Optionally, test pile management module calls test stubs, directly in response to the request of data of system under test (SUT).Work as operation The action type of mark instruction is when stopping operation, and test agent module sends halt instruction to test pile management module, this stops Only instruction includes that communication protocol identifies.Test pile management module calls test stubs according to halt instruction.
Optionally, after test, test agent module obtains the data that control system is sent and deletes instruction.Test generation Reason module deletes instruction according to data and deletes the preset data stored in stake data memory module.By control system to test generation It manages module and sends data deletion instruction, test agent module is deleted after test and is deposited in stake data memory module The preset data of storage saves the memory space of test macro.
Optionally, it includes system banner that data, which delete instruction,.Test agent module deletes stake data according to the system banner The preset data corresponding with the system banner stored in memory module.When the test to system under test (SUT) is completed, pass through deletion The corresponding preset data of system banner can only delete the corresponding preset data of system under test (SUT) that test is completed, save space, keep away Exempt to delete the corresponding preset data of other systems under test (SUT), does not influence the test of other systems under test (SUT).
In embodiments of the present invention, test stubs are called to be tested by test pile management module, due to test pile Module realizes test pile function based on same general submodule and different agreement submodules, and therefore, test stubs are being realized When different test pile functions, the same general submodule can be shared, to save the processing expense of test.
Referring to FIG. 7, it illustrates the structural schematic diagrams of computer equipment provided by one embodiment of the present invention.The calculating Machine equipment runs test macro provided by the above embodiment.Specifically:
The computer equipment 700 includes central processing unit (CPU) 701 including random access memory (RAM) 702 With the system storage 704 of read-only memory (ROM) 703, and connection system storage 704 and central processing unit 701 System bus 705.The computer equipment 700 further includes that the substantially defeated of information is transmitted between each device helped in computer Enter/output system (I/O system) 706, and for storage program area 713, application program 714 and other program modules 715 Mass-memory unit 707.
The basic input/output 706 includes display 708 for showing information and inputs letter for user The input equipment 709 of such as mouse, keyboard etc of breath.Wherein the display 708 and input equipment 709 are all by being connected to The input and output controller 710 of system bus 705 is connected to central processing unit 701.The basic input/output 706 Can also include input and output controller 710 with for receive and handle from keyboard, mouse or electronic touch pen etc. it is multiple its The input of his equipment.Similarly, input and output controller 710 also provides output to display screen, printer or other kinds of defeated Equipment out.
The mass-memory unit 707 is by being connected to the bulk memory controller (not shown) of system bus 705 It is connected to central processing unit 701.The mass-memory unit 707 and its associated computer-readable medium are computer Equipment 700 provides non-volatile memories.That is, the mass-memory unit 707 may include such as hard disk or CD- The computer-readable medium (not shown) of ROM drive etc.
Without loss of generality, the computer-readable medium may include computer storage media and communication media.Computer Storage medium includes information such as computer readable instructions, data structure, program module or other data for storage The volatile and non-volatile of any method or technique realization, removable and irremovable medium.Computer storage medium includes RAM, ROM, EPROM, EEPROM, flash memory or other solid-state storages its technologies, CD-ROM, DVD or other optical storages, tape Box, tape, disk storage or other magnetic storage devices.Certainly, skilled person will appreciate that the computer storage medium It is not limited to above-mentioned several.Above-mentioned system storage 704 and mass-memory unit 707 may be collectively referred to as memory.
According to various embodiments of the present invention, the computer equipment 700 can also be connected by networks such as internets The remote computer operation being connected on network.Namely computer equipment 700 can be by being connected on the system bus 705 Network Interface Unit 711 is connected to network 712, in other words, Network Interface Unit 711 can be used also to be connected to other types Network or remote computer system.
It is stored at least one instruction, at least a Duan Chengxu, code set or instruction set in the memory, described at least one Item instruction, at least a Duan Chengxu, code set or instruction set are configured to be executed by one or more than one processor, to realize Above-mentioned test pile generation method or test method, realize the function of test macro.
In the exemplary embodiment, a kind of computer readable storage medium is additionally provided, is stored in the storage medium At least one instruction, at least a Duan Chengxu, code set or instruction set, at least one instruction, an at least Duan Chengxu, institute It states code set or described instruction collection and realizes such as above-mentioned test pile generation method or survey when being executed by the processor of computer equipment Method for testing realizes the function of test macro.
Optionally, above-mentioned computer readable storage medium can be ROM, random access memory (RAM), CD-ROM, magnetic Band, floppy disk and optical data storage devices etc..
It should be understood that referenced herein " multiple " refer to two or more."and/or", description association The incidence relation of object indicates may exist three kinds of relationships, for example, A and/or B, can indicate: individualism A exists simultaneously A And B, individualism B these three situations.Character "/" typicallys represent the relationship that forward-backward correlation object is a kind of "or".
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
The foregoing is merely exemplary embodiment of the present invention, are not intended to limit the invention, all in spirit of the invention Within principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.

Claims (15)

1. a kind of test pile generation method, which is characterized in that the described method includes:
It receives test pile and generates instruction, it includes communication protocol mark and stake quantity, the communication protocols that the test pile, which generates instruction, Knowledge of assessing a bid for tender is used to indicate test pile type, and the stake quantity is used to indicate the quantity of test pile;
It is generated and is instructed according to the test pile, generate corresponding test pile, the test pile is used to respond the data of system under test (SUT) Request, the general utility functions of different types of test pile are identical.
2. the method according to claim 1, wherein after the corresponding test pile of generation, further includes:
The request of data that the system under test (SUT) is sent is received based on the test pile;
Response data is obtained according to the request of data based on the test pile;
The response data is sent to the system under test (SUT) based on the test pile.
3. a kind of test pile generating means, which is characterized in that described device includes:
Stubs are tested, generate instruction for receiving test pile, it includes communication protocol mark and stake that the test pile, which generates instruction, Quantity, the communication protocol mark are used to indicate test pile type, and the stake quantity is used to indicate the quantity of test pile;
The test stubs are also used to generate instruction according to the test pile, generate corresponding test pile, and the test pile is used In the request of data of response system under test (SUT), the general utility functions of different types of test pile is identical.
4. a kind of test macro, which is characterized in that the system comprises: test pile management module and test stubs, the survey Test pile module includes general submodule and different agreement submodules;
The test pile management module, for calling the test stubs;
The general submodule, for receiving the request of data of system under test (SUT) transmission;
The agreement submodule, for obtaining response data, the request of data and agreement according to the request of data Module corresponds to identical communication protocol;
The general submodule is also used to send the response data to the system under test (SUT).
5. system according to claim 4, which is characterized in that the test pile management module, for obtaining communication protocol Mark;The test stubs are called according to communication protocol mark, the communication protocol mark is used to indicate test pile class Type, different types of test pile correspond to different agreement submodules.
6. system according to claim 4 or 5, which is characterized in that the system also includes: test agent module;
The test agent module, for obtaining operational order, the operational order include at least one communication protocol mark with And operation mark corresponding with communication protocol mark, the communication protocol mark indicate a test pile type for unique, The operation mark is used to indicate action type, and the action type includes: call operation or stops operation;
The test agent module is also used to when the action type that the operation mark indicates is call operation, to the survey Test pile management module sends call instruction, and the call instruction includes the communication protocol mark;
The test pile management module, for calling the test stubs according to the call instruction.
7. system according to claim 6, which is characterized in that
The test agent module is also used to when the action type that the operation mark indicates is to stop operation, to the survey Test pile management module sends halt instruction, and the halt instruction includes the communication protocol mark;
The test pile management module is also used to be stopped according to the halt instruction to call the test stubs.
8. system according to claim 6, which is characterized in that the system also includes: stake data memory module;
The test agent module is also used to before the test pile management module calls the test stubs, is obtained default Data, the preset data include the response data;The preset data is sent to the stake data memory module;
The stake data memory module, for storing the preset data;
The agreement submodule, for obtaining the number of responses from the stake data memory module according to the request of data According to.
9. system according to claim 8, which is characterized in that
The test agent module is also used to obtain data and deletes instruction, and the data are deleted instruction and are used to indicate described in deletion Preset data;Instruction, which is deleted, according to the data deletes the preset data stored in the stake data memory module.
10. a kind of test method, which is characterized in that the method is applied in test macro, and the test macro includes: test Stake management module and test stubs, the test stubs include general submodule and different agreement submodules;
The described method includes:
The test pile management module calls the test stubs;
The general submodule receives the request of data that system under test (SUT) is sent;
The agreement submodule obtains response data, the request of data and the agreement submodule pair according to the request of data It should be in identical communication protocol;
The general submodule sends the response data to the system under test (SUT).
11. according to the method described in claim 10, it is characterized in that, the test pile management module call test stubs, Include:
The test pile management module obtains communication protocol mark, and the communication protocol mark is used to indicate test pile type, no The test pile of same type corresponds to different agreement submodules;
The test pile management module calls the test stubs according to communication protocol mark.
12. method described in 0 or 11 according to claim 1, which is characterized in that the test macro further include: test agent mould Block;
The method also includes:
The test agent module obtains operational order, the operational order include at least one communication protocol mark and with institute It states communication protocol and identifies corresponding operation mark, the communication protocol mark is used to indicate test pile type, the operation mark It is used to indicate action type, the action type includes: call operation or stops operation;
When the action type of operation mark instruction is call operation, the test agent module is to the test pile management Module sends call instruction, and the call instruction includes the communication protocol mark;
The test pile management module invocation target tests stubs, comprising:
The test pile management module calls the test stubs according to the call instruction.
13. according to the method for claim 12, which is characterized in that the test macro further include: stake data memory module;
Before the test pile management module calls the test stubs, the method also includes:
The test agent module obtains preset data, and the preset data includes the response data;
The preset data is sent to the stake data memory module by the test agent module;
The stake data memory module stores the preset data;
The agreement submodule obtains response data according to the request of data, comprising:
The agreement submodule obtains the response data from the stake data memory module according to the request of data.
14. a kind of computer equipment, which is characterized in that the equipment includes processor and memory, is stored in the memory Have at least one instruction, at least a Duan Chengxu, code set or instruction set, at least one instruction, an at least Duan Chengxu, The code set or described instruction collection realize that test pile as claimed in claim 1 or 2 is generated when being executed by the processor Method, alternatively, realizing such as the described in any item test methods of claim 10 to 13.
15. a kind of computer readable storage medium, which is characterized in that be stored at least one instruction, extremely in the storage medium A few Duan Chengxu, code set or instruction set, at least one instruction, an at least Duan Chengxu, the code set or described Instruction set realizes test pile generation method as claimed in claim 1 or 2 when executed, alternatively, realizing such as claim 10 To 13 described in any item test methods.
CN201810186432.4A 2018-03-07 2018-03-07 Test pile generation method, test system, test method and test equipment Active CN110213119B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810186432.4A CN110213119B (en) 2018-03-07 2018-03-07 Test pile generation method, test system, test method and test equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810186432.4A CN110213119B (en) 2018-03-07 2018-03-07 Test pile generation method, test system, test method and test equipment

Publications (2)

Publication Number Publication Date
CN110213119A true CN110213119A (en) 2019-09-06
CN110213119B CN110213119B (en) 2022-02-22

Family

ID=67779044

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810186432.4A Active CN110213119B (en) 2018-03-07 2018-03-07 Test pile generation method, test system, test method and test equipment

Country Status (1)

Country Link
CN (1) CN110213119B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003009532A1 (en) * 2001-07-19 2003-01-30 Intrusion, Inc. System and method for detecting network events
CN1735252A (en) * 2004-08-12 2006-02-15 华为技术有限公司 Universal automatization testing device and method
CN1983990A (en) * 2006-05-11 2007-06-20 华为技术有限公司 Parallel testing method and system
CN101140541A (en) * 2007-09-29 2008-03-12 中兴通讯股份有限公司 Integration test system of distributed software system and method thereof
CN101316196A (en) * 2007-05-28 2008-12-03 华为技术有限公司 Method and apparatus for implementing simulation test of service on distributed platform
CN102214140A (en) * 2011-06-21 2011-10-12 中兴通讯股份有限公司 Method and system for automatic software testing
CN104618182A (en) * 2015-01-21 2015-05-13 中国移动通信集团广东有限公司 Simulation testing system supporting a plurality of mobile service protocols

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003009532A1 (en) * 2001-07-19 2003-01-30 Intrusion, Inc. System and method for detecting network events
CN1735252A (en) * 2004-08-12 2006-02-15 华为技术有限公司 Universal automatization testing device and method
CN1983990A (en) * 2006-05-11 2007-06-20 华为技术有限公司 Parallel testing method and system
CN101316196A (en) * 2007-05-28 2008-12-03 华为技术有限公司 Method and apparatus for implementing simulation test of service on distributed platform
CN101140541A (en) * 2007-09-29 2008-03-12 中兴通讯股份有限公司 Integration test system of distributed software system and method thereof
CN102214140A (en) * 2011-06-21 2011-10-12 中兴通讯股份有限公司 Method and system for automatic software testing
CN104618182A (en) * 2015-01-21 2015-05-13 中国移动通信集团广东有限公司 Simulation testing system supporting a plurality of mobile service protocols

Also Published As

Publication number Publication date
CN110213119B (en) 2022-02-22

Similar Documents

Publication Publication Date Title
KR101273535B1 (en) Polling system using presentation material, polling method thereof and storage medium storing plug-in program for generating the presentation material
CN108256118B (en) Data processing method, device, system, computing equipment and storage medium
US10430144B2 (en) Managed screen sharing in an enterprise application
CN106354634A (en) Interface testing method and device
CN107294808A (en) The methods, devices and systems of interface testing
US8660833B2 (en) Method, computer program product and apparatus for providing an interactive network simulator
US10084637B2 (en) Automatic task tracking
CN105897497A (en) Interface test method, application device and service device
WO2020207194A1 (en) Blockchain-based iot device changing method and apparatus
CN105915529A (en) Message generation method and device
CA2845174A1 (en) Interactive survey system
CN104683181B (en) A kind of method for monitoring performance, equipment and system
CN109656799A (en) Test method and device
CN105302709B (en) Test data generating method and equipment
CN108111499A (en) Service process performance optimization method, device, electronic equipment and storage medium
CN112950145B (en) Processing method, device, medium and electronic equipment for collaborating work order
CN106708717B (en) A kind of exploitation adjustment method and device
CN111092935B (en) Data sharing method and virtual training device for machine learning
CN110213119A (en) Test pile generation method, test macro, test method and equipment
CN105512020B (en) Test method and device
CN109446030A (en) A kind of behavior monitoring method and device
CN107566202B (en) A kind of network element state monitoring method, apparatus and system
CN111669290B (en) Network element management method, management server and storage medium
US11283748B2 (en) Message based information technology service management
Bi et al. Deadlock prevention for service orchestration via controlled Petri nets

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant