CN108399114A - A kind of system performance testing method, apparatus and storage medium - Google Patents

A kind of system performance testing method, apparatus and storage medium Download PDF

Info

Publication number
CN108399114A
CN108399114A CN201810236682.4A CN201810236682A CN108399114A CN 108399114 A CN108399114 A CN 108399114A CN 201810236682 A CN201810236682 A CN 201810236682A CN 108399114 A CN108399114 A CN 108399114A
Authority
CN
China
Prior art keywords
test
response
tested
journal file
raw requests
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810236682.4A
Other languages
Chinese (zh)
Other versions
CN108399114B (en
Inventor
杨军
李帅
丁永亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tenpay Payment Technology Co Ltd
Original Assignee
Tenpay Payment Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tenpay Payment Technology Co Ltd filed Critical Tenpay Payment Technology Co Ltd
Priority to CN201810236682.4A priority Critical patent/CN108399114B/en
Publication of CN108399114A publication Critical patent/CN108399114A/en
Application granted granted Critical
Publication of CN108399114B publication Critical patent/CN108399114B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
    • G06F11/2268—Logging of test results
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
    • G06F11/26—Functional testing

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The embodiment of the invention discloses a kind of system performance testing method, apparatus and storage medium, the strings of commands that the embodiment of the present invention is sent by receiving terminal, the strings of commands is that terminal is generated according to the test information that configuration-direct configures；Journal file to be tested is obtained according to the strings of commands；To each raw requests and its corresponding original response setting mark in journal file；System to be tested is tested for the property according to raw requests, obtains test response；Original response is compared with test response according to mark, obtains test result.The program by journal file each raw requests and its it is corresponding it is original sound setting mark, it can be after being tested for the property to obtain test response to system to be tested according to raw requests, original response is obtained according to mark to be compared with test response, obtain test result, so that improving the accuracy tested system performance by raw requests and original response setting mark to achieve the purpose that precisely to verify.

Description

A kind of system performance testing method, apparatus and storage medium
Technical field
The present invention relates to system testing technical fields, and in particular to a kind of system performance testing method, apparatus and storage are situated between Matter.
Background technology
With the development of internet and computer technology, the function of sorts of systems constantly changes and updates in network, for example, New version can be developed on the basis of the existing version of system, to increase new function in systems or improve original work( Energy.After the system development of new version is completed, it is also necessary to be tested for the property to the system of new version, to ensure new version The quality of system.
In the prior art, when the performance to system is tested, the data on line are answered generally by drainage way Environment under line is made, for example, drained using request Replication Tools tcpcopy, or the existing server of oneself Transformation, by the data on the direct line of improved server be introduced through come.It then can be according to obtained data to each of system Item performance indicator is tested, and test result is obtained.
In the research and practice process to the prior art, it was found by the inventors of the present invention that in existing drainage way to being When system performance is tested, only system performance is tested using obtained data, without checking test result, is caused The accuracy of test is relatively low.
Invention content
A kind of system performance testing method, apparatus of offer of the embodiment of the present invention and storage medium, it is intended to improve to systematicness The accuracy that can be tested.
In order to solve the above technical problems, the embodiment of the present invention provides following technical scheme：
A kind of system performance testing method, including：
The strings of commands that terminal is sent is received, described instruction string is that the terminal is given birth to according to the test information that configuration-direct configures At；
Journal file to be tested is obtained according to described instruction string；
To each raw requests and its corresponding original response setting mark in the journal file；
System to be tested is tested for the property according to the raw requests, obtains test response；
Original response is compared with test response according to the mark, obtains test result.
A kind of system performance testing device, including：
Receiving unit, the strings of commands for receiving terminal transmission, described instruction string are that the terminal is matched according to configuration-direct What the test information set generated；
Acquiring unit, for obtaining journal file to be tested according to described instruction string；
Setting unit, for each raw requests and its corresponding original response setting mark in the journal file Know；
Test cell obtains test response for being tested for the property to system to be tested according to the raw requests；
Comparing unit obtains test result for original response to be compared with test response according to the mark.
A kind of storage medium, the storage medium are stored with a plurality of instruction, and described instruction is loaded suitable for processor, with Execute the step in above system performance test methods.
The embodiment of the present invention can obtain journal file to be tested according to the strings of commands for receiving terminal transmission, and to day Each raw requests in will file and its corresponding original response setting mark, then according to raw requests to system to be tested It is tested for the property, obtains test response, and test response is compared with original response according to mark, obtain test knot Fruit.The program by obtain journal file, and in journal file each raw requests and its it is corresponding it is original sound setting mark Know, can be obtained according to mark original after being tested for the property to obtain test response to system to be tested according to raw requests Response is compared to be responded with test, obtains test result so that by raw requests and original response setting mark to reach To the purpose precisely verified, the accuracy tested system performance is improved.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached Figure.
Fig. 1 is the schematic diagram of a scenario of system performance testing system provided in an embodiment of the present invention；
Fig. 2 is the flow diagram of system performance testing method provided in an embodiment of the present invention；
Fig. 3 is the block schematic illustration provided in an embodiment of the present invention for carrying out test information configuration；
Fig. 4 is the interface schematic diagram that test environment configures in common configuration provided in an embodiment of the present invention；
Fig. 5 is the interface schematic diagram of drainage task configuration in drainage configuration provided in an embodiment of the present invention；
Fig. 6 is the interface schematic diagram provided in an embodiment of the present invention for resetting playback tasks configuration in configuration；
Fig. 7 is the block schematic illustration of system performance testing provided in an embodiment of the present invention；
Fig. 8 is the schematic diagram of data processing provided in an embodiment of the present invention；
Fig. 9 is the schematic diagram of data dyeing provided in an embodiment of the present invention；
Figure 10 is that the reading process provided in an embodiment of the present invention for calling actuator obtains raw requests from service queue The schematic diagram that test system is tested for the property；
Figure 11 is the schematic diagram that test result provided in an embodiment of the present invention obtains；
Figure 12 is the schematic diagram of performance monitoring provided in an embodiment of the present invention；
Figure 13 is the schematic diagram that answer code result provided in an embodiment of the present invention compares；
Figure 14 is another flow diagram of system performance testing method provided in an embodiment of the present invention；
Figure 15 is the structural schematic diagram of system performance testing device provided in an embodiment of the present invention；
Figure 16 is another structural schematic diagram of system performance testing device provided in an embodiment of the present invention；
Figure 17 is another structural schematic diagram of system performance testing device provided in an embodiment of the present invention；
Figure 18 is the structural schematic diagram of server provided in an embodiment of the present invention.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation describes, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, the every other implementation that those skilled in the art are obtained without creative efforts Example, shall fall within the protection scope of the present invention.
A kind of system performance testing method, apparatus of offer of the embodiment of the present invention and storage medium.
Referring to Fig. 1, the schematic diagram of a scenario for the system performance testing system that Fig. 1 is provided by the embodiment of the present invention, this is Performance Test System of uniting may include system performance testing device, which can specifically be integrated in server In, it is mainly used for receiving the strings of commands that terminal is sent, wherein the strings of commands can be the test that terminal is configured according to configuration-direct What information generated.Journal file to be tested can be obtained according to the strings of commands received at this time, for example, candidate can first be obtained Journal file, then journal file to be tested is filtered out from candidate journal file.Then, original to each of journal file Request and its corresponding original response setting mark, wherein may include one or more each raw requests in journal file, Each raw requests have corresponding original response, the corresponding original response setting of a raw requests same Mark, each raw requests after can also identifying setting are stored into corresponding business use-case queue.It secondly, can basis Raw requests are tested for the property system to be tested, obtain test response；For example, default test can be extracted from the strings of commands Information, and call at least one reading process to obtain from business use-case queue with presetting and test that information is corresponding original to ask It asks, system to be tested is tested for the property according to default test information and the raw requests got, so as to be surveyed Examination response.Finally, original response can be compared according to mark with test response, obtains test result；For example, can incite somebody to action Original response is compared with the test response that the test system to be measured to different editions is tested for the property；Etc..
In addition, the system performance testing system can also include terminal, which is mainly used for receiving the survey that user sends Information configuration request is tried, test information configuration interface, wherein test information configuration circle are requested to generate according to test information configuration May include that drainage configuration interface, playback configuration interface, modification interface and result check interface etc. in face, for example, can pass through It resets configuration interface and resets configuration-direct, the tests such as test object and manner of playback letter is selected according to configuration-direct is reset Breath.It is then possible to generate the strings of commands according to the test information of configuration, and the strings of commands is sent to server.
It should be noted that the schematic diagram of a scenario of system performance testing system shown in FIG. 1 is only an example, this hair The system performance testing system and scene of bright embodiment description are to more clearly illustrate the technology of the embodiment of the present invention Scheme does not constitute the restriction for technical solution provided in an embodiment of the present invention, those of ordinary skill in the art it is found that with The appearance of the differentiation and new business scene of system performance testing system, technical solution provided in an embodiment of the present invention is for similar Technical problem, it is equally applicable.
It is described in detail separately below.
In the present embodiment, it will be described from the angle of system performance testing device, system performance testing device tool Body can be integrated in the network equipments such as server or gateway.
A kind of system performance testing method, including：The strings of commands that terminal is sent is received, which is terminal according to configuration What the test information of instruction configuration generated；Journal file to be tested is obtained according to the strings of commands；To each original in journal file Begin request and its corresponding original response setting mark；System to be tested is tested for the property according to raw requests, is surveyed Examination response；Original response is compared with test response according to mark, obtains test result.
Referring to Fig. 2, Fig. 2 is the flow diagram for the system performance testing method that one embodiment of the invention provides.This is System performance test methods may include：
In step S101, the strings of commands that terminal is sent is received.
Wherein, which can be that the test information that terminal is configured according to configuration-direct generates, for example, terminal can be with The test information configuration request that user sends is received, test information configuration interface is requested to generate according to test information configuration, that is, is existed Display test information configuration interface in the current display interface of terminal, which can be user's login account The web interface of the test information configuration of entrance.Wherein may include task configuration interface, ring in the test information configuration interface Border configuration interface, tool configuration interface, drainage configuration interface, playback configuration interface, modification interface and result check interface etc., In, task configuration interface is mainly used for reception task configuration-direct, to be drawn the data of journal file according to task configuration-direct Mode is taken to configure etc.；Environment configurations interface is mainly used for receiving environment configuration-direct, to be instructed according to environment configurations to being Environment etc. is configured on the test environment and line of system performance test, and environment can be journal file place to be tested on the line Existing network environment；Tool configuration interface be mainly used for reception tool configuration-direct, with according to tool configuration-direct to logging tools It is configured with playback tool etc., which can be the tool that journal file is obtained from line, which can be with It is to put journal file to be tested to the tool of test environment；Drainage configuration interface is mainly used for receiving drainage configuration-direct, To be configured to drainage task dispatching according to drainage configuration-direct, which can be that the data of journal file are pulled from existing net； Reset configuration interface be mainly used for receive reset configuration-direct, with according to reset configuration-direct to test object and manner of playback etc. It is configured, which can put journal file to be tested to test environment；Modification interface is mainly used for receiving modification Instruction, changed accordingly the test information of configuration according to modification instruction；As a result check that interface is mainly used for receiving knot Fruit checks instruction, to check instruction display test information configuration result or display system the performance test results etc. according to result, connects The form of expression of mouth can be the input forms such as text box or button, and particular content is not construed as limiting here.For example, terminal can be with Interface is configured by playback and resets configuration-direct, and the tests such as test object and manner of playback are selected according to configuration-direct is reset Information；Either, terminal can be instructed by environment configurations interface environment configurations, be test wrapper according to environment configurations instruction Border parameter is configured.
For example, as shown in figure 3, in configuration testing information in terminal, common configuration can be carried out, the common configuration is main For configuring all kinds of public informations, the access of sorts of systems, all kinds of environment and all kinds of tools etc. is supported, to improve test information The open ability of configuration platform.The common configuration may include task configuration, environment configurations and tool configuration etc., wherein task Configuration may include data pull configuration etc., and data pull configuration can be configured to the mode that pulls of journal file May include environment configurations etc. on test environment configuration and line Deng, environment configurations, tool configuration may include logging tools configuration With reset tool configuration etc..For example, as shown in figure 4, when carrying out test environment configuration, interface can be configured by addition Configuration-direct is added, to add environmental labels (identification, ID), the environment of test environment according to addition configuration-direct The parameters such as title, procotol (Internet Protocol, IP), port numbers (Port) and file directory, each ginseng in Fig. 4 Several values can be flexibly arranged according to actual needs, and specific value is not construed as limiting here.
Can also carry out drainage configuration in test information configuration interface and reset configuration etc., carrying out drainage configuration (i.e. Drained on line) when, test object can be selected, environment and establish drainage task dispatching in selection line, which can be choosing System to be tested is selected, environment can be environment on the corresponding line of system on the line, which can be by selecting to drain Tool executes.Drainage task can be started after establishing drainage task, so as to by drainage tool true on line Journal file copies to environment under line, and solving manual construction data, to carry out test environment simulation not true enough, or covering is inadequate Comprehensive problem.After starting and draining and execute drainage task, the drainage task result that the drainage task after execution can be obtained It stores into drainage task list, user can inquire drainage task result, the drainage task result in draining task list May include data analysis etc. on drainage task completion status and line, wherein on line data analysis may include handling capacity, when Prolong, type of service statistics etc..For example, as shown in figure 5, can be connect by adding configuration in the drainage task configuration drained on line Mouth receives addition configuration-direct, to add task identification ID, plan name, the draining ring of drainage task according to addition configuration-direct Border drains original, drains the parameters such as resolution file and drainage state, and the value of parameters can be according to practical need in Fig. 5 Flexibly it is arranged, specific value is not construed as limiting here.
When carrying out resetting configuration, test object, selection drainage task and selection manner of playback etc., the test can be selected Object can be selection system to be tested, which can be that the one or more drainages established in drainage configuration are appointed Business, the manner of playback can be determined by the playback tool of selection.It can start playback after selecting manner of playback, pass through weight Tool is put to put to test environment the journal file for copying to environment under line.Playback tasks (i.e. performance survey is executed starting to reset Trial is engaged in) after, the playback tasks result that the playback tasks after execution obtain can be stored into playback tasks list, Yong Huke To inquire playback tasks result (i.e. performance test task result) in playback tasks list, which may include Completion status, the total stroke count of transmission, the total stroke count of success, success rate, time-consuming and goodput of performance test task etc..For example, As shown in fig. 6, in the playback tasks configuration for resetting configuration, interface can be configured by addition and add configuration-direct, with According to adding, the task identification ID of configuration-direct addition playback tasks, plan name, playback environment, drainage is planned, request is total, again Put the parameters such as rate, playback duration, playback mode and operator, in Fig. 6 the value of parameters can according to actual needs into Flexibly setting, specific value are not construed as limiting row here.
Terminal can generate the strings of commands according to the test information of above-mentioned configuration, and the strings of commands is sent to system performance testing Device.It, can be according to the strings of commands to system performance progressive after system performance testing device receives the strings of commands of terminal transmission Can test and obtained test result is simultaneously sent to terminal, the performance test can be by the testing tool of automation (such as Test pile) a variety of normal, peak values and abnormal load conditions are simulated to test etc. the property indices of system.Terminal Test result can be stored into the results list, terminal can check that interface result checks instruction by result, according to As a result it checks that instruction is extracted corresponding test result progress result from the results list and checked, and carries out result in display interface Displaying etc..
In step s 102, journal file to be tested is obtained according to the strings of commands.
System performance testing device can extract configuration after the strings of commands for receiving terminal transmission from the strings of commands Information is tested, journal file to be tested can be obtained from existing net according to test information.
In some embodiments, the step of obtaining journal file to be tested according to the strings of commands may include：According to finger String is enabled to obtain candidate journal file；Candidate journal file is parsed, the journal file after being parsed；According to preset condition Journal file after parsing is screened, journal file to be tested is obtained.
System performance testing device can obtain candidate journal file according to the strings of commands from existing net, then to candidate daily record File carries out data processing, for example, as shown in Figure 7.Specifically, after obtaining candidate journal file, system performance testing device Candidate journal file can be parsed, the journal file after being parsed；For example, as shown in figure 8, to candidate daily record text When part is parsed (i.e. daily record parses), the test information of configuration can be extracted from the strings of commands, by according to test information Each service resolution module is called, by each service resolution module to candidate journal file dissection process, which can be Daily record parses, such as carries out daily record parsing by gateway layer Relay, carries out daily record parsing by Development Framework Middle, passes through Message channel CQ/CMQ carries out daily record parsing etc., it is, of course, also possible to carry out daily record parsing, particular content by service resolution module It is not construed as limiting here.
After the journal file after being parsed, system performance testing device can according to preset condition to parsing after Journal file screened, obtain journal file to be tested, the preset condition can be configuration test information in be arranged Filtering rule etc..Wherein, the journal file after parsing is screened and carries out data mistake as to the journal file after parsing Filter and data analysis etc., wherein data analysis mainly analyzes the raw requests in candidate journal file, in data Request type and the accounting of each request type, error rate, time delay, the distribution of data traffic period etc., possible set for follow-up It sets scrnario testing and carries out data source matching application etc.；Data filtering is mainly to there may be the data that cannot be reset, abnormal numbers According to, can not temporarily remove dependence data and this reset unwanted service request etc. and be filtered, and believed according to test The filtering rule being arranged in breath carries out Content Selection to the journal file after parsing, can obtain journal file to be tested, can Journal file to be tested is carried out data storage, i.e., according to the storage path configured in test information by daily record to be tested File is stored to the storage path.
In step s 103, to each raw requests and its corresponding original response setting mark in journal file.
After obtaining journal file to be tested, system performance testing device can enter test and prepare, for example, in Fig. 7, Test preparation may include case management, Content Management and environmental management etc., wherein case management is mainly used for daily record text Data in part are dyed, and are generated drainage use-case, are matched convenient for Service tracing and result, which can be setting mark； Content Management is mainly used for carrying out Classification Management to the data in journal file according to type of message, and environmental management is mainly used for pair Test environment is managed.
After system performance testing device enters test preparation, data dyeing can be carried out to journal file to be tested, i.e., To in journal file each raw requests and its corresponding original response setting mark, a raw requests it is corresponding one The same mark is arranged in a original response.For example, as shown in figure 9, can be to each raw requests in journal file and its right The original response answered is dyed, and the raw requests after dyeing are carried out use-case distribution, which is carried out use-case It resets, and the original response after dyeing is stored into response buffer.
In some embodiments, to each raw requests and its corresponding original response setting mark in journal file Later, system performance testing method can also include：
Determine the corresponding business of each raw requests after setting mark；Each raw requests pair after being identified according to setting The business answered, each raw requests after setting is identified are stored into corresponding business use-case queue.
Specifically, in journal file each raw requests and its corresponding original response setting mark after, can be with Use-case playback is carried out, as shown in fig. 7, use-case playback may include resetting management and all kinds of actuators, wherein reset management master Be used to put to test environment journal file to be tested and be managed, all kinds of actuators may include Relay actuators and Middle actuators etc. are mainly used for putting journal file to be tested to test environment, wherein system performance testing device is set The actuator set is corresponding with the playback tool for including in the test information that above-mentioned terminal configures, that is, tests in information configuration interface and match The playback tool set, as system performance testing device need the actuator called.System performance testing device original asks this It asks during carrying out use-case playback, it may be determined that the corresponding business of each raw requests after mark is set, and then basis is set The corresponding business of each raw requests after mark is set, each raw requests after setting is identified are stored to corresponding business and used In example queue.
In step S104, system to be tested is tested for the property according to raw requests, obtains test response.
To in journal file each raw requests and its corresponding original response setting mark after, it is possible, firstly, to root System to be tested is tested for the property according to raw requests, is treated for example, can raw requests be obtained from business use-case queue Test system is tested for the property.
In some embodiments, system to be tested is tested for the property according to raw requests, obtains test response Step may include：
Default test information is extracted from the strings of commands；Call at least one reading process, and according to it is at least one read into Journey obtains raw requests corresponding with default test information from business use-case queue corresponding with raw requests；According to default Test information and the raw requests got are tested for the property system to be tested, obtain test response.
Specifically, system performance testing device can extract default test information from the strings of commands, the default test information Can be configuration test information in some or all of information, the default test information be mainly used for indicating system performance testing Device is tested for the property system to be tested.System performance testing device can call the reading of at least one actuator into Journey, and according at least one reading process from business use-case queue corresponding with raw requests, obtain and default test information Corresponding raw requests a, wherein actuator can call one or more reading processes.For example, as shown in Figure 10, each industry May include business use-case queue 1 in business use-case queue to business use-case queue n, wherein the value of n can according to actual needs into Row setting.The configuration file that system performance testing device can include from extraction test information in the strings of commands in Figure 10, this is matched It sets file and can serve to indicate that system performance testing device calls actuator and its reading process to be obtained from business use-case queue Raw requests for example, the reading process 1 of actuator A can be called to reading process n, and call the reading process of actuator B 1 to reading process n, wherein the value of n can be flexibly arranged according to actual needs, may call upon other execution certainly The reading process of device, is not limited thereto.According to the reading process 1 of the actuator A called to reading process n and actuator B Reading process 1 to read process n, concurrently or sequentially one or more of from business use-case queue 1 to business use-case queue n In business use-case queue, raw requests corresponding with default test information are obtained, which may include one or more. Then, obtained raw requests are sent to test system by system performance testing device, which is test system to be measured, The test system may include test system 1 to test system n, wherein the value of n can flexibly be set according to actual needs It sets, specific value is not construed as limiting here.To which system performance testing device according to default test information and can be got Raw requests are tested for the property system to be tested, obtain test response.
Optionally, system to be tested is tested for the property according to default test information and the raw requests got, is obtained May include to the step of test response：
The actuator for needing to call is determined according to default test information, and calls actuator；It will be got by actuator Raw requests be sent to test system to be measured so that test system to be measured will be sent to based on the test data that raw requests export The corresponding test pile of raw requests；It receives test pile and passes sequentially through the test response that test system and actuator to be measured return, test Response is what test pile was tested for the property based on test data.
Specifically, system performance testing device can determine the actuator for needing to call according to default test information, and adjust With actuator, which may include one or more.The raw requests got are sent to by actuator to be tested System for example, system performance testing device can call the reading process 1 of actuator A to reading process n in Figure 10, and is adjusted With the reading process 1 of actuator B to reading process n, concurrently or sequentially in from business use-case queue 1 to business use-case queue n In one or more business use-case queues, one or more raw requests corresponding with default test information are obtained.Then it incites somebody to action To raw requests be sent to test system 1 to test system n in any one or more, which is system to be tested System.So that test system to be measured executes raw requests, and based on the test data of raw requests output, by the test data of output It is sent to the corresponding test pile of raw requests, in Fig. 7, which may include test pile 1 to test pile n, wherein n's Value can be flexibly arranged according to actual needs, and specific value is not construed as limiting here.So that test pile is based on test Data are tested for the property system to be tested, receive test pile and pass sequentially through the test sound that test system and actuator to be measured return It answers, the test response that performance test obtains can be stored into test database.So as to realize automatic pull on line very Real journal file is played back in test environment, is not necessarily to manual construction data, and the form variation of data is not necessarily to manual simulation, not only Workload is reduced, and test data is more credible；By obtaining the raw requests in journal file to be tested to systematicness It can be tested, the data rule that test responds can be made more to meet truth, that is, meet objective law, test response Closer to reality.
In step S105, original response is compared with test response according to mark, obtains test result.
After obtaining test and ringing, system performance testing device can obtain and test the mark for responding corresponding raw requests Know, and obtain original response corresponding with the mark, for example, original sound corresponding with the mark can be obtained from response buffer It answers, original response corresponding with the mark etc. is obtained in the journal file after can also being identified from setting.Then by original response It is precisely compared with test response, obtains test result.The test result may include that the accurate check results of display result are (former Begin response with test response accurate check results), system performance monitor curve and handling capacity change curve etc..For example, as schemed Shown in 7, after obtaining test and ringing, system performance testing device can carry out test response processing, and test response processing can be with Including will test response stored, by original response with test response verified and by original response and test respond into Row obtains test result than equity.At this point, test result processing can also be carried out, for example, storage test result, analysis result Trend and for statistical analysis etc. to test result.
In some embodiments, original response is compared according to mark with test response, obtains test result Step may include：
The mark for obtaining raw requests corresponding with test response, obtains target identification；From journal file to be tested Obtain original response corresponding with target identification；Obtain that the version of system is identical waits for original response place in being responded from test The corresponding test response of test system；The original response got is compared with the test response got, is tested As a result.
Specifically, system performance testing device can obtain and test the mark for responding corresponding raw requests first, obtain To target identification, original response corresponding with target identification is then obtained from journal file to be tested, either, from response Original response corresponding with target identification is obtained in caching.Secondly, it is obtained in being responded from test and system where original response The corresponding test response of the identical test system to be measured of version, test response can be one or more.Finally, it can will obtain The original response got is compared with the test response got, obtains test result；Alternatively, original by what is got It responds and is compared respectively with the multiple tests response got, obtain test result；Alternatively, the multiple tests got are rung It should be compared respectively, obtain test result.System performance testing device can be based on drainage on line and carry out system performance testing, On Support Line raw requests pull automatically, statistical analysis, data screening and data playback dynamic adjustment etc., support raw requests It tests with the diversity of original response string, is precisely verified by that raw requests and original response setting mark, can reach Effect protects a set of comparison system without multidimensional, greatly reduces maintenance workload.
In some embodiments, original response is compared according to mark with test response, obtains test result Step may include：
The mark for obtaining raw requests corresponding with test response, obtains target identification；From journal file to be tested Obtain original response corresponding with target identification；Obtain that the version of system is different waits for original response place in being responded from test The corresponding each test response of test system；The original response got is compared respectively with each test response, is obtained Test result.
Specifically, system performance testing device can obtain and test the mark for responding corresponding raw requests first, obtain To target identification.Then, original response corresponding with target identification is obtained from journal file to be tested, either, from sound Original response corresponding with target identification is obtained in should caching.Secondly, it is obtained in being responded from test and system where original response The different corresponding each test response of test system to be measured of version, test response can be one or more.Finally, may be used The original response got and each test response to be compared respectively, for example, can by the original response got with The test response got is compared, and obtains test result；Alternatively, by the original response got and getting more A test response is compared respectively, obtains test result；Alternatively, the multiple tests got response is compared respectively, Obtain test result.The same raw requests can be used for two versions (A and B) or multiple versions by system performance testing device (A/B/n) test system to be measured is tested, and the test then obtained according to the test system to be measured of each version responds to compare The actual effect of each version improves flexibility and the reliability of test result acquisition.
It should be noted that system performance testing device can use the same raw requests more to system to be tested progress Secondary test obtains test response collection, and it includes repeatedly testing obtained multiple tests response that test response, which is concentrated,.Then, it will survey Examination response concentrates each test response to be compared respectively with original response, or is compared between each test response, obtains Test result collection.For example, as shown in figure 11, different raw requests can obtain repeatedly testing system to be tested, obtain Collection is responded to different tests, for example, response results collection 1 and test response collection 2 etc., it is, of course, also possible to including other tests Response collection, specific number are not construed as limiting here.Then more set of environments results are carried out to test response collection 1 and test response collection 2 Contrast verification, i.e., to being obtained and different to be measured of the original response place version of system in test response collection 1 and test response collection 2 The corresponding test response of test system, will obtain test response and the result of original response progress different editions or varying environment compares Verification, obtains test result.Either, single set of environments Comparative result verification is carried out to test response collection 1 and test response collection 2, I.e. to obtaining test system pair to be measured identical with the version of system where original response in test response collection 1 and test response collection 2 The test response answered will obtain test response and original response progress identical version or the result comparison of identical environment, obtain To test result.After test result is further processed, the secondary generation of test result, the survey of the secondary generation may be implemented Test result can be sent to terminal and be shown, test result is original verification result data, and secondary generation is based primarily upon original The verification result data of beginning does statistical analysis on the whole, includes mainly：Number of cases, specific mistake are always used with number of cases success rate, unsuccessfully Lose use-case, the period of batch race task execution and data source etc..
It should be noted that system performance testing device can be monitored test process, for example, as shown in fig. 7, can To be monitored management to test process, which may include system monitoring, business monitoring, traffic monitoring, daily record prison Control and test environment monitoring etc..The system monitoring may include performance monitoring etc., which is mainly used for monitoring service Can, for example, central processing unit (Central Processing Unit, CPU), memory (Memory) and handle etc., to prevent Performance issue occurs for system.Furthermore it is also possible to which the functions such as automatic spreading result verification and performance monitoring, can survey in system performance Automatic monitoring service performance while examination is automatically performed verification of data, report generation and alarm after system performance testing Deng.When system performance testing is deposited when abnormal, system performance testing device can generate test notice or monitoring notice etc., will survey It pings and knows or monitor notice etc. and be sent to reserved mailbox with lettergram mode, or reserved Instant Messenger is given to message mode transmission Believe account, or is sent to reserved cell-phone number etc. with short message mode.
System performance testing device can directly ask sorts of systems open drainage performance test ability with original in existing net It asks instead of the data configuration in performance test, saves the data configuration time, and improving performance testing reliability, and test is rung Result should be carried out with original response precisely to verify, ensure performance test accuracy, furthermore it is possible to while test, it is automatic to supervise System performance is superintended and directed, facilitates tester to judge that system is managed collectively with the presence or absence of performance issue and test result, concentrates dimension Shield, reference is provided for system optimization in the future.
In some embodiments, original response is compared according to mark with test response, obtains test result After step, system performance testing method can also include：Test result is sent to terminal, so that terminal is in display interface Interior display test result.
Specifically, the available test result of system performance testing device is sent to terminal, and terminal can be to receiving Test result stored, when terminal, which receives result, checks instruction, can show in display interface and be looked into the result See the corresponding test result of instruction.For example, can show completion status, send total stroke count, the total stroke count of success, success rate, take, System performance monitors the accurate verification etc. between curve, handling capacity change curve, original response and test response.For example, as schemed Shown in 12, terminal can show the monitoring curve that CPU occupation proportions and memory use in cpu performance monitoring in display interface. In another example as shown in figure 13, the result that different answer codes are counted in being responded to test can be shown in display interface.From And the diversity that test result is shown can be enriched.
From the foregoing, it will be observed that the embodiment of the present invention can obtain daily record text to be tested according to the strings of commands for receiving terminal transmission Part, and to each raw requests and its corresponding original response setting mark in journal file, then according to raw requests pair Test system to be measured is tested for the property, and obtains test response, and test response is compared with original response according to mark, Obtain test result.The program by obtain journal file, and in journal file each raw requests and its corresponding original Begin to ring setting mark, it can be after being tested for the property to obtain test response to system to be tested according to raw requests, according to mark Know and obtain original response to be compared with test response, obtains test result so that set by raw requests and original response Mark is set to achieve the purpose that precisely to verify, improves the accuracy tested system performance.
According to method described in above-described embodiment, citing is described in further detail below.
For the present embodiment by taking system performance testing device is server as an example, it is the embodiment of the present invention to please refer to Fig.1 4, Figure 14 Another flow diagram of the system performance testing method of offer.The system performance testing method flow may include：
201, the strings of commands that server receiving terminal is sent.
The strings of commands can be that the test information that terminal is configured according to configuration-direct generates, for example, terminal can receive The test information configuration request that user sends requests to generate test information configuration interface, i.e., in terminal according to test information configuration Display test information configuration interface in current display interface, the test information configuration interface can be that user's login account enters Test information configuration web interface.
Test information configuration request can be that user sends to terminal, for example, user can be by the aobvious of terminal Show and click test information configuration icon in interface, generates test information configuration request；Either, user can be by sending out to terminal Related voices such as " test information configurations " are sent, test information configuration request is generated；Either user can be by sending to terminal The test information configuration request generated by body-sensing instruction；Etc..It is understood that the side of the generation of test information configuration request Formula can also be that other modes, particular content are not construed as limiting here.
Terminal can generate the strings of commands according to the test information of above-mentioned configuration, and the strings of commands is sent to server, service Device receives the strings of commands that terminal is sent.
202, server obtains candidate journal file according to the strings of commands, and is screened to candidate journal file, is waited for The journal file of test.
Server can extract the test information of configuration after receiving the strings of commands from the strings of commands, can be according to survey It tries information and obtains candidate journal file from existing net, then to screening, for example, calling each service resolution module to candidate daily record File is parsed, and can be screened to the journal file after parsing according to preset condition, for example, to the number that cannot be reset It according to, abnormal data and resets the journal files such as unwanted service request and is filtered, and according to being arranged in test information Filtering rule carries out Content Selection to the journal file after parsing, can obtain journal file to be tested.
203, server is to each raw requests and its corresponding original response setting mark in journal file, and will set Each raw requests after mark are set to store into corresponding business use-case queue.
After obtaining journal file to be tested, server can be to each raw requests and its correspondence in journal file Original response setting mark, i.e. the same mark is arranged in the corresponding original response of a raw requests.To day After each raw requests and its corresponding original response setting mark in will file, it may be determined that each original after setting mark Begin to ask corresponding business, the corresponding business of each raw requests after then being identified according to setting is every after identifying setting A raw requests are stored into corresponding business use-case queue.
204, server extracts default test information from the strings of commands, and at least one reading process is called to be used from business In example queue, raw requests corresponding with default test information are obtained
Server can extract default test information from the strings of commands, which can be the test letter of configuration Information some or all of in breath, the default test information be mainly used for indicating system performance testing device to system to be tested into Row performance test.Server can call at least one reading process of at least one actuator, and according at least one reading Process obtains raw requests corresponding with default test information, this is original from business use-case queue corresponding with raw requests Request may include one or more, wherein an actuator can call one or more reading processes.
205, server is tested for the property system to be tested according to default test information and the raw requests got, Obtain test response.
Server can determine the actuator for needing to call according to default test information, and call actuator, wherein this is held Row device may include one or more.Then the raw requests got are sent to by test system to be measured by actuator, work as packet When including multiple actuators, concurrently or sequentially the raw requests got will can be sent to system to be tested by multiple actuators System, which may include one or more, so that the test number that test system to be measured will be exported based on raw requests According to being sent to the corresponding test pile of raw requests.It receives test pile and passes sequentially through the test sound that test system and actuator to be measured return It answers, test response is what test pile was tested for the property based on test data.
206, server according to mark by the corresponding original response of the raw requests got and obtained test respond into Row compares, and obtains test result.
After obtaining test and ringing, server can obtain the mark that test responds corresponding raw requests, and to be tested Journal file in or response buffer in obtain corresponding with mark original response.Then, it is obtained in being responded from test and original The corresponding test response of the identical test system to be measured of version for the system where response that begins, it can be one or more which, which responds, It is a；And the original response got is compared with the one or more test responses got, obtain test result.Or Person obtains the corresponding one or more of the to be measured test system different from the version of system where original response and surveys in being responded from test Examination response, and the original response got is compared with the one or more test responses got, obtain test result. Alternatively, by being compared between the multiple tests got response, test result is obtained.
207, test result is sent to terminal by server, so that terminal shows test result in display interface.
The available test result of server is sent to terminal, and terminal can deposit the test result received Storage can show in display interface when terminal, which receives result, checks instruction and check the corresponding test of instruction with the result As a result.It should be noted that server can be monitored system performance testing process, and exist in system performance testing When abnormal, warning information can be generated, warning information can also be sent to terminal, so that terminal outputting alarm information, with Timely notification technique personnel take corresponding measure.
The embodiment of the present invention can replace the data configuration in performance test with existing net journal file original request, carry System performance testing reliability is risen, and it is possible to by each raw requests in journal file and its corresponding original Setting mark is rung, to realize the purpose for precisely being verified test response and original response, ensure that the accurate of performance test Property.
For ease of preferably implementing system performance testing method provided in an embodiment of the present invention, the embodiment of the present invention also provides A kind of device based on above system performance test methods.The wherein meaning of noun and phase in above system performance test methods Together, specific implementation details can be with the explanation in reference method embodiment.
The structural schematic diagram that 5, Figure 15 is system performance testing device provided in an embodiment of the present invention is please referred to Fig.1, wherein The system performance testing device may include receiving unit 301, acquiring unit 302, setting unit 303, test cell 304 and Comparing unit 305.
Wherein, receiving unit 301, the strings of commands for receiving terminal transmission.
Wherein, which can be that the test information that terminal is configured according to configuration-direct generates, for example, terminal can be with The test information configuration request that user sends is received, test information configuration interface is requested to generate according to test information configuration, that is, is existed Display test information configuration interface in the current display interface of terminal, which can be user's login account The web interface of the test information configuration of entrance.Wherein may include task configuration interface, ring in the test information configuration interface Border configuration interface, tool configuration interface, drainage configuration interface, playback configuration interface, modification interface and result check interface etc., In, task configuration interface is mainly used for reception task configuration-direct, to be drawn the data of journal file according to task configuration-direct Take mode
It configures etc.；Environment configurations interface is mainly used for receiving environment configuration-direct, with according to environment configurations instruction pair Environment etc. is configured on the test environment and line of system performance testing, and environment can be journal file institute to be tested on the line Existing network environment；Tool configuration interface be mainly used for reception tool configuration-direct, with according to tool configuration-direct to day volunteer Tool and playback tool etc. are configured, which can be the tool that journal file is obtained from line, which can To be to put journal file to be tested to the tool of test environment；Drainage configuration interface is mainly used for receiving drainage and configuring referring to It enables, to be configured to drainage task dispatching according to drainage configuration-direct, which can be that the number of journal file is pulled from existing net According to；Reset configuration interface be mainly used for receive reset configuration-direct, with according to reset configuration-direct to test object and playback side Formula etc. is configured, which can put journal file to be tested to test environment；Modification interface is mainly used for receiving Modification instruction, changed accordingly the test information of configuration according to modification instruction；As a result check that interface is mainly used for connecing It receives result and checks instruction, to check instruction display test information configuration result or display system the performance test results according to result The form of expression Deng, interface can be the input forms such as text box or button, and particular content is not construed as limiting here.For example, eventually End can configure interface by playback and reset configuration-direct, according to playback configuration-direct selection test object and manner of playback Deng test information；Either, terminal can be instructed by environment configurations interface environment configurations, be according to environment configurations instruction Test environment parameter is configured.
For example, as shown in figure 3, in configuration testing information in terminal, common configuration can be carried out, the common configuration is main For configuring all kinds of public informations, the access of sorts of systems, all kinds of environment and all kinds of tools etc. is supported, to improve test information The open ability of configuration platform.The common configuration may include task configuration, environment configurations and tool configuration etc., wherein task Configuration may include data pull configuration etc., and data pull configuration can be configured to the mode that pulls of journal file May include environment configurations etc. on test environment configuration and line Deng, environment configurations, tool configuration may include logging tools configuration With reset tool configuration etc..For example, as shown in figure 4, when carrying out test environment configuration, interface can be configured by addition Configuration-direct is added, to add environmental labels, environment title, IP, port numbers and the text of test environment according to addition configuration-direct The parameters such as part catalogue, the value of parameters can be flexibly arranged according to actual needs in Fig. 4, and specific value is here not It is construed as limiting.
Can also carry out drainage configuration in test information configuration interface and reset configuration etc., carrying out drainage configuration (i.e. Drained on line) when, test object can be selected, environment and establish drainage task dispatching in selection line, which can be choosing System to be tested is selected, environment can be environment on the corresponding line of system on the line, which can be by selecting to drain Tool executes.Drainage task can be started after establishing drainage task, so as to by drainage tool true on line Journal file copies to environment under line, and solving manual construction data, to carry out test environment simulation not true enough, or covering is inadequate Comprehensive problem.After starting and draining and execute drainage task, the drainage task result that the drainage task after execution can be obtained It stores into drainage task list, user can inquire drainage task result, the drainage task result in draining task list May include data analysis etc. on drainage task completion status and line, wherein on line data analysis may include handling capacity, when Prolong, type of service statistics etc..For example, as shown in figure 5, can be connect by adding configuration in the drainage task configuration drained on line Mouth receives addition configuration-direct, to add task identification ID, plan name, the draining ring of drainage task according to addition configuration-direct Border drains original, drains the parameters such as resolution file and drainage state, and the value of parameters can be according to practical need in Fig. 5 Flexibly it is arranged, specific value is not construed as limiting here.
When carrying out resetting configuration, test object, selection drainage task and selection manner of playback etc., the test can be selected Object can be selection system to be tested, which can be that the one or more drainages established in drainage configuration are appointed Business, the manner of playback can be determined by the playback tool of selection.It can start playback after selecting manner of playback, pass through weight Tool is put to put to test environment the journal file for copying to environment under line.Playback tasks (i.e. performance survey is executed starting to reset Trial is engaged in) after, the playback tasks result that the playback tasks after execution obtain can be stored into playback tasks list, Yong Huke To inquire playback tasks result (i.e. performance test task result) in playback tasks list, which may include Completion status, the total stroke count of transmission, the total stroke count of success, success rate, time-consuming and goodput of performance test task etc..For example, As shown in fig. 6, in the playback tasks configuration for resetting configuration, interface can be configured by addition and add configuration-direct, with According to adding, the task identification ID of configuration-direct addition playback tasks, plan name, playback environment, drainage is planned, request is total, again Put the parameters such as rate, playback duration, playback mode and operator, in Fig. 6 the value of parameters can according to actual needs into Flexibly setting, specific value are not construed as limiting row here.
Terminal can generate the strings of commands according to the test information of above-mentioned configuration, and the strings of commands is sent to system performance testing Device.Receiving unit 301 can receive the strings of commands of terminal transmission, so that other units in system performance testing device can be with System performance is tested for the property according to the strings of commands and obtained test result is sent to terminal, which can be A variety of normal, peak values and abnormal load conditions are simulated come to each of system by the testing tool (such as test pile) of automation Item performance indicator is tested etc..Terminal can store test result into the results list, and terminal can be checked by result Interface result checks instruction, checks that instruction is extracted corresponding test result progress result from the results list and looked into according to result It sees, and carries out result displaying etc. in display interface.
Acquiring unit 302, for obtaining journal file to be tested according to the strings of commands.
After the strings of commands for receiving terminal transmission, acquiring unit 302 can extract the test of configuration from the strings of commands Information can obtain journal file to be tested from existing net according to test information.
In some embodiments, acquiring unit 302 specifically can be used for：Candidate journal file is obtained according to the strings of commands； Candidate journal file is parsed, the journal file after being parsed；According to preset condition to the journal file after parsing into Row screening, obtains journal file to be tested.
Acquiring unit 302 can obtain candidate journal file according to the strings of commands from existing net, then to candidate journal file Data processing is carried out, for example, as shown in Figure 7.Specifically, after obtaining candidate journal file, acquiring unit 302 can be to waiting Journal file is selected to be parsed, the journal file after being parsed；For example, as shown in figure 8, being solved to candidate journal file When analysis (i.e. daily record parses), the test information of configuration can be extracted from the strings of commands, by calling each industry according to test information Business parsing module, by each service resolution module to candidate journal file dissection process, which can be daily record parsing, Such as daily record parsing is carried out by gateway layer Relay, daily record parsing is carried out by Development Framework Middle, passes through message channel CQ/CMQ carries out daily record parsing etc., it is, of course, also possible to carry out daily record parsing by service resolution module, particular content is here not It is construed as limiting.
After the journal file after being parsed, acquiring unit 302 can be according to preset condition to the day after parsing Will file is screened, and journal file to be tested is obtained, which can be the mistake being arranged in the test information configured Filter rule etc..Wherein, to the journal file after parsing screened as to after parsing journal file carry out data filtering and Data analysis etc., wherein data analysis mainly analyzes the raw requests in candidate journal file, such as asking in data Accounting, error rate, time delay, the distribution of data traffic period etc. for asking type and each request type, for follow-up possible setting field Scape test carries out data source matching application etc.；Data filtering mainly to there may be the data that cannot be reset, abnormal data, temporarily Data and this unwanted service request of playback that Shi Wufa strippings rely on etc. are filtered, and according in test information The filtering rule of setting carries out Content Selection to the journal file after parsing, can obtain journal file to be tested, can incite somebody to action Journal file to be tested carries out data storage, i.e., according to the storage path configured in test information by journal file to be tested It stores to the storage path.
Setting unit 303, for each raw requests and its corresponding original response setting mark in journal file.
After obtaining journal file to be tested, setting unit 303 can enter test and prepare, for example, in Fig. 7, the survey Examination prepares to may include case management, Content Management and environmental management etc., wherein case management is mainly used for in journal file Data dyed, generate drainage use-case, matched convenient for Service tracing and result, which can be setting mark；Content Management is mainly used for carrying out Classification Management to the data in journal file according to type of message, and environmental management is mainly used for test Environment is managed.
After setting unit 303 enters test preparation, data dyeing can be carried out to journal file to be tested, i.e., to daily record Each raw requests in file and its corresponding original response setting mark, a raw requests corresponding one are original The same mark is arranged in response.For example, as shown in figure 9, can in journal file each raw requests and its corresponding original Begin to respond and be dyed, and the raw requests after dyeing are subjected to use-case distribution, which is subjected to use-case playback, with And the original response after dyeing is stored into response buffer.
In some embodiments, as shown in figure 16, system performance testing device can also include determination unit 306 and deposit Storage unit 307 etc., specifically can be as follows：
Determination unit 306, for determining the corresponding business of each raw requests after mark is arranged.
Storage unit 307, for the corresponding business of each raw requests after being identified according to setting, after setting is identified Each raw requests are stored into corresponding business use-case queue.
Specifically, in journal file each raw requests and its corresponding original response setting mark after, can be with Use-case playback is carried out, as shown in fig. 7, use-case playback may include resetting management and all kinds of actuators, wherein reset management master Be used to put to test environment journal file to be tested and be managed, all kinds of actuators may include Relay actuators and Middle actuators etc. are mainly used for putting journal file to be tested to test environment, wherein system performance testing device is set The actuator set is corresponding with the playback tool for including in the test information that above-mentioned terminal configures, that is, tests in information configuration interface and match The playback tool set, as system performance testing device need the actuator called.The raw requests are being subjected to use-case playback During, the corresponding business of each raw requests after setting mark can be determined by determination unit 306, it is then single by storage Member 307 according to setting identify after the corresponding business of each raw requests, will setting mark after each raw requests store to In corresponding business use-case queue.
Test cell 304 obtains test response for being tested for the property to system to be tested according to raw requests.
To in journal file each raw requests and its corresponding original response setting mark after, first, test is single Member 304 can be tested for the property system to be tested according to raw requests, for example, original can be obtained from business use-case queue Begin to ask to be tested for the property system to be tested.
In some embodiments, as shown in figure 17, test cell 304 may include extraction subelement 3041, obtain son Unit 3042 and test subelement 3043 etc., specifically can be as follows：
Subelement 3041 is extracted, for extracting default test information from the strings of commands.
Obtain subelement 3042, for calling at least one reading process, and according at least one reading process from original Begin to ask in corresponding business use-case queue, obtains raw requests corresponding with default test information.
Subelement 3043 is tested, for being carried out to system to be tested according to default test information and the raw requests got Performance test obtains test response.
Specifically, extraction subelement 3041 can extract default test information from the strings of commands, which can Be configuration test information in some or all of information, the default test information be mainly used for indicating system performance testing dress It sets and system to be tested is tested for the property.The reading process of at least one actuator can be called by obtaining subelement 3042, and According at least one reading process from business use-case queue corresponding with raw requests, obtain corresponding with default test information Raw requests a, wherein actuator can call one or more reading processes.For example, as shown in Figure 10, each business use-case May include business use-case queue 1 in queue to business use-case queue n, wherein the value of n can be set according to actual needs It sets.The configuration file that system performance testing device can include from extraction test information in the strings of commands in Figure 10, configuration text It is original that part can serve to indicate that system performance testing device calls actuator and its reading process to be obtained from business use-case queue Request, for example, the reading process 1 of actuator A can be called to reading process n, and call the reading process 1 of actuator B to Reading process n, wherein the value of n can be flexibly arranged according to actual needs, may call upon other actuators certainly Reading process, is not limited thereto.According to the reading process 1 of the actuator A called to the reading for reading process n and actuator B Take process 1 to process n is read, concurrently or sequentially from business use-case queue 1 to one or more of business use-case queue n business In use-case queue, raw requests corresponding with default test information are obtained, which may include one or more.So Afterwards, obtained raw requests are sent to test system by test subelement 3043, which is test system to be measured, the survey Test system may include test system 1 to test system n, wherein and the value of n can be flexibly arranged according to actual needs, Specific value is not construed as limiting here.It can be according to default test information and what is got original ask to test subelement 3043 It asks and system to be tested is tested for the property, obtain test response.
Optionally, test subelement 3043 specifically can be used for：The execution for needing to call is determined according to default test information Device, and call actuator；The raw requests got are sent to test system to be measured by actuator, so that test system to be measured It will be sent to the corresponding test pile of raw requests based on the test data that raw requests export；Reception test pile passes sequentially through to be measured The test response that test system and actuator return, test response are what test pile was tested for the property based on test data.
Specifically, test subelement 3043 can determine the actuator for needing to call according to default test information, and call Actuator, the actuator may include one or more.The raw requests got are sent to system to be tested by actuator System for example, system performance testing device can call the reading process 1 of actuator A to reading process n in Figure 10, and calls The reading process 1 of actuator B is to reading process n, concurrently or sequentially one in from business use-case queue 1 to business use-case queue n In a or multiple business use-case queues, one or more raw requests corresponding with default test information are obtained.Then it will obtain Raw requests be sent to test system 1 to test system n in any one or more, which is system to be tested System.So that test system to be measured executes raw requests, and based on the test data of raw requests output, by the test data of output It is sent to the corresponding test pile of raw requests, in Fig. 7, which may include test pile 1 to test pile n, wherein n's Value can be flexibly arranged according to actual needs, and specific value is not construed as limiting here.So that test pile is based on test Data are tested for the property system to be tested, receive test pile and pass sequentially through the test sound that test system and actuator to be measured return It answers, the test response that performance test obtains can be stored into test database.So as to realize automatic pull on line very Real journal file is played back in test environment, is not necessarily to manual construction data, and the form variation of data is not necessarily to manual simulation, not only Workload is reduced, and test data is more credible；By obtaining the raw requests in journal file to be tested to systematicness It can be tested, the data rule that test responds can be made more to meet truth, that is, meet objective law, test response Closer to reality.
Comparing unit 305 obtains test result for original response to be compared with test response according to mark.
After obtaining test and ringing, comparing unit 305 can obtain and test the mark for responding corresponding raw requests, and obtain Original response corresponding with the mark is taken, for example, original response corresponding with the mark can be obtained from response buffer, also may be used To obtain original response corresponding with the mark etc. from the journal file after setting mark.Then comparing unit 305 will be original Response is precisely compared with test response, obtains test result.The test result may include that display result precisely verifies knot Fruit (the accurate check results of original response and test response), system performance monitor curve and handling capacity change curve etc..Example Such as, as shown in fig. 7, after obtaining test and ringing, system performance testing device can carry out test response and handle, at the test response Reason may include will test response stored, by original response with test response verified and by original response with test Response is compared, and obtains test result.At this point, test result processing can also be carried out, for example, storing test result, dividing Analyse result trend and for statistical analysis etc. to test result.
In some embodiments, comparing unit 305 specifically can be used for：Obtain raw requests corresponding with test response Mark, obtain target identification；Original response corresponding with target identification is obtained from journal file to be tested；It is rung from test Answer the corresponding test response of middle acquisition test system to be measured identical with the version of system where original response；It is original by what is got It responds and is compared with the test response got, obtain test result.
Specifically, comparing unit 305 can obtain and test the mark for responding corresponding raw requests first, obtain target Then mark obtains original response corresponding with target identification, either, from response buffer from journal file to be tested Obtain original response corresponding with target identification.Secondly, comparing unit 305 obtains in being responded from test is with where original response The corresponding test response of the identical test system to be measured of the version of system, test response can be one or more.Finally, it compares Unit 305 original response got can be compared with the test response got, obtain test result；Or The original response got is compared with the multiple tests response got, obtains test result by person respectively；Alternatively, will The multiple tests response got is compared respectively, obtains test result.System performance testing device can be based on drawing on line Stream carries out system performance testing, on Support Line raw requests pull automatically, statistical analysis, data screening and data playback dynamic Raw requests and the test of the diversity of original response string are supported in adjustment etc., by being identified to raw requests and original response setting, It can achieve the effect that precisely to verify, protect a set of comparison system without multidimensional, greatly reduce maintenance workload.
Comparing unit 305 specifically can be used for：The mark for obtaining raw requests corresponding with test response, obtains target mark Know；Original response corresponding with target identification is obtained from journal file to be tested；It is obtained and original sound in being responded from test The corresponding each test response of the different test system to be measured of the version of system where answering；By the original response got and each survey Examination response is compared respectively, obtains test result.
Specifically, comparing unit 305 can obtain and test the mark for responding corresponding raw requests first, obtain target Mark.Then, original response corresponding with target identification is obtained from journal file to be tested, either, from response buffer It is middle to obtain original response corresponding with target identification.Secondly, where comparing unit 305 from acquisition in test response and original response The corresponding each test of test system to be measured that the version of system is different responds, and test response can be one or more.Most Afterwards, comparing unit 305 original response got can be compared respectively with each test response, for example, can will obtain The original response got is compared with the test response got, obtains test result；Alternatively, original by what is got It responds and is compared respectively with the multiple tests response got, obtain test result；Alternatively, the multiple tests got are rung It should be compared respectively, obtain test result.The same raw requests can be used for two versions (A and B) by comparing unit 305 Or the test system to be measured of multiple versions (A/B/n) is tested, the test then obtained according to the test system to be measured of each version Response carrys out the actual effect of more each version, improves flexibility and the reliability of test result acquisition.
It should be noted that comparing unit 305 can repeatedly survey system to be tested using the same raw requests Examination obtains test response collection, and it includes repeatedly testing obtained multiple tests response that test response, which is concentrated,.Then, test is rung Each test response should be concentrated to be compared respectively with original response, or be compared between each test response, tested Result set.For example, as shown in figure 11, different raw requests can obtain repeatedly testing system to be tested, obtain not Same test response collection, for example, response results collection 1 and test respond collection 2 etc., it is, of course, also possible to including other test responses Collection, specific number are not construed as limiting here.Then more set of environments Comparative results are carried out to test response collection 1 and test response collection 2 Verification, i.e., to obtaining the to be tested system different from the version of system where original response in test response collection 1 and test response collection 2 Corresponding test of uniting responds, and will obtain test response and the result of original response progress different editions or varying environment is compared and tested Card, obtains test result.Either, single set of environments Comparative result verification is carried out to test response collection 1 and test response collection 2, i.e., It is corresponding with the identical test system to be measured of version of system where original response to being obtained in test response collection 1 and test response collection 2 Test response, will obtain test response with original response progress identical version or identical environment result comparison, obtain Test result.After test result is further processed, the secondary generation of test result, the test of the secondary generation may be implemented As a result terminal can be sent to be shown, test result is original verification result data, and secondary generation is based primarily upon original Verification result data, do statistical analysis on the whole, include mainly：Number of cases, specific failure are always used with number of cases success rate, unsuccessfully Use-case, the period of batch race task execution and data source etc..
It should be noted that system performance testing device can be monitored test process, for example, as shown in fig. 7, can To be monitored management to test process, which may include system monitoring, business monitoring, traffic monitoring, daily record prison Control and test environment monitoring etc..The system monitoring may include performance monitoring etc., which is mainly used for monitoring service Can, for example, central processing unit (Central Processing Unit, CPU), memory (Memory) and handle etc., to prevent Performance issue occurs for system.Furthermore it is also possible to which the functions such as automatic spreading result verification and performance monitoring, can survey in system performance Automatic monitoring service performance while examination is automatically performed verification of data, report generation and alarm after system performance testing Deng.When system performance testing is deposited when abnormal, system performance testing device can generate test notice or monitoring notice etc., will survey It pings and knows or monitor notice etc. and be sent to reserved mailbox with lettergram mode, or reserved Instant Messenger is given to message mode transmission Believe account, or is sent to reserved cell-phone number etc. with short message mode.
System performance testing device can directly ask sorts of systems open drainage performance test ability with original in existing net It asks instead of the data configuration in performance test, saves the data configuration time, and improving performance testing reliability, and test is rung Result should be carried out with original response precisely to verify, ensure performance test accuracy, furthermore it is possible to while test, it is automatic to supervise System performance is superintended and directed, facilitates tester to judge that system is managed collectively with the presence or absence of performance issue and test result, concentrates dimension Shield, reference is provided for system optimization in the future.
In some embodiments, system performance testing device can also include：Transmission unit, for sending out test result Terminal is given, so that terminal shows test result in display interface.
Specifically, the available test result of transmission unit is sent to terminal, and terminal can be to the test knot that receives Fruit is stored, and when terminal, which receives result, checks instruction, can be shown in display interface and be checked instruction pair with the result The test result answered.For example, can show completion status, send total stroke count, the total stroke count of success, success rate, take, system performance Monitor the accurate verification etc. between curve, handling capacity change curve, original response and test response.For example, as shown in figure 12, eventually End can show the monitoring curve that CPU occupation proportions and memory use in cpu performance monitoring in display interface.In another example such as Shown in Figure 13, the result that different answer codes are counted in being responded to test can be shown in display interface.So as to rich The diversity that rich test result is shown.
From the foregoing, it will be observed that acquiring unit of the embodiment of the present invention 302 can receive the finger of terminal transmission according to receiving unit 301 String is enabled to obtain journal file to be tested, and by setting unit 303 to each raw requests in journal file and its corresponding Original response setting mark, is then tested for the property system to be tested according to raw requests by test cell 304, is surveyed Examination response, and test response is compared with original response according to mark by comparing unit 305, obtain test result.It should Scheme by obtain journal file, and in journal file each raw requests and its it is corresponding it is original sound setting mark, can With after being tested for the property to obtain test response to system to be tested according to raw requests, according to mark obtain original response come It is compared with test response, obtains test result so that by raw requests and original response setting mark to reach accurate The purpose of verification improves the accuracy tested system performance.
The embodiment of the present invention also provides a kind of server, as shown in figure 18, involved by the embodiment of the present invention The structural schematic diagram of server, specifically：
The server may include one or processor 401, one or more meters of more than one processing core The components such as memory 402, power supply 403 and the input unit 404 of calculation machine readable storage medium storing program for executing.Those skilled in the art can manage It solves, server architecture does not constitute the restriction to server shown in Figure 18, may include than illustrating more or fewer portions Part either combines certain components or different components arrangement.Wherein：
Processor 401 is the control centre of the server, utilizes each of various interfaces and the entire server of connection Part by running or execute the software program and/or module that are stored in memory 402, and calls and is stored in memory Data in 402, the various functions and processing data of execute server, to carry out integral monitoring to server.Optionally, locate Reason device 401 may include one or more processing cores；Preferably, processor 401 can integrate application processor and modulatedemodulate is mediated Manage device, wherein the main processing operation system of application processor, user interface and application program etc., modem processor is main Processing wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 401.
Memory 402 can be used for storing software program and module, and processor 401 is stored in memory 402 by operation Software program and module, to perform various functions application and data processing.Memory 402 can include mainly storage journey Sequence area and storage data field, wherein storing program area can storage program area, the application program (ratio needed at least one function Such as sound-playing function, image player function) etc.；Storage data field can be stored uses created data according to server Deng.In addition, memory 402 may include high-speed random access memory, can also include nonvolatile memory, for example, at least One disk memory, flush memory device or other volatile solid-state parts.Correspondingly, memory 402 can also include Memory Controller, to provide access of the processor 401 to memory 402.
Server further includes the power supply 403 powered to all parts, it is preferred that power supply 403 can pass through power management system System is logically contiguous with processor 401, to realize the work(such as management charging, electric discharge and power managed by power-supply management system Energy.Power supply 403 can also include one or more direct current or AC power, recharging system, power failure monitor electricity The random components such as road, power supply changeover device or inverter, power supply status indicator.
The server may also include input unit 404, which can be used for receiving the number or character letter of input Breath, and generation keyboard related with user setting and function control, mouse, operating lever, optics or trace ball signal are defeated Enter.
Although being not shown, server can also be including display unit etc., and details are not described herein.Specifically in the present embodiment, Processor 401 in server can according to following instruction, by the process of one or more application program is corresponding can It executes file to be loaded into memory 402, and the application program being stored in memory 402 is run by processor 401, to Realize various functions, it is as follows：
The strings of commands that terminal is sent is received, the strings of commands is that terminal is generated according to the test information that configuration-direct configures；Root Journal file to be tested is obtained according to the strings of commands；To in journal file each raw requests and its corresponding original response setting Mark；System to be tested is tested for the property according to raw requests, obtains test response；It by original response and is surveyed according to mark Examination response is compared, and obtains test result.
From the foregoing, it will be observed that the embodiment of the present invention can obtain daily record text to be tested according to the strings of commands for receiving terminal transmission Part, and to each raw requests and its corresponding original response setting mark in journal file, then according to raw requests pair Test system to be measured is tested for the property, and obtains test response, and test response is compared with original response according to mark, Obtain test result.The program by obtain journal file, and in journal file each raw requests and its corresponding original Begin to ring setting mark, it can be after being tested for the property to obtain test response to system to be tested according to raw requests, according to mark Know and obtain original response to be compared with test response, obtains test result so that set by raw requests and original response Mark is set to achieve the purpose that precisely to verify, improves the accuracy tested system performance.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment Point, the detailed description above with respect to system performance testing method is may refer to, details are not described herein again.
It will appreciated by the skilled person that all or part of step in the various methods of above-described embodiment can be with It is completed by instructing, or controls relevant hardware by instructing and complete, which can be stored in one and computer-readable deposit In storage media, and is loaded and executed by processor.
For this purpose, the embodiment of the present invention provides a kind of storage medium, wherein being stored with a plurality of instruction, which can be handled Device is loaded, to execute the step in any system performance testing method that the embodiment of the present invention is provided.For example, this refers to Order can execute following steps：
The strings of commands that terminal is sent is received, the strings of commands is that terminal is generated according to the test information that configuration-direct configures；Root Journal file to be tested is obtained according to the strings of commands；To in journal file each raw requests and its corresponding original response setting Mark；System to be tested is tested for the property according to raw requests, obtains test response；It by original response and is surveyed according to mark Examination response is compared, and obtains test result.
The specific implementation of above each operation can be found in the embodiment of front, and details are not described herein.
Wherein, which may include：Read-only memory (ROM, Read Only Memory), random access memory Body (RAM, Random Access Memory), disk or CD etc..
By the instruction stored in the storage medium, any systematicness that the embodiment of the present invention is provided can be executed Step in energy test method, it is thereby achieved that any system performance testing method institute that the embodiment of the present invention is provided The advantageous effect that can be realized, refers to the embodiment of front, details are not described herein.
It is provided for the embodiments of the invention a kind of system performance testing method, apparatus above and storage medium has carried out in detail Thin to introduce, principle and implementation of the present invention are described for specific case used herein, and above example is said The bright method and its core concept for being merely used to help understand the present invention；Meanwhile for those skilled in the art, according to this hair Bright thought, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not manage Solution is limitation of the present invention.

Claims (13)

1. a kind of system performance testing method, which is characterized in that including：
The strings of commands that terminal is sent is received, described instruction string is that the terminal is generated according to the test information that configuration-direct configures 's；
Journal file to be tested is obtained according to described instruction string；
To each raw requests and its corresponding original response setting mark in the journal file；
System to be tested is tested for the property according to the raw requests, obtains test response；
Original response is compared with test response according to the mark, obtains test result.
2. system according to claim 1 performance test methods, which is characterized in that described to be waited for according to the acquisition of described instruction string The step of journal file of test includes：
Candidate journal file is obtained according to described instruction string；
The candidate journal file is parsed, the journal file after being parsed；
The journal file after the parsing is screened according to preset condition, obtains journal file to be tested.
3. system according to claim 1 performance test methods, which is characterized in that described to every in the journal file After a raw requests and its corresponding original response setting mark, the method further includes：
Determine the corresponding business of each raw requests after setting mark；
The corresponding business of each raw requests after being identified according to setting, each raw requests after setting is identified are stored to right In the business use-case queue answered.
4. system performance testing method according to claim 3, which is characterized in that described to be treated according to the raw requests Test system is tested for the property, and is obtained the step of test responds and is included：
Default test information is extracted from described instruction string；
Call at least one reading process, and according at least one reading process from business corresponding with the raw requests In use-case queue, raw requests corresponding with the default test information are obtained；
System to be tested is tested for the property according to the default test information and the raw requests got, test is obtained and rings It answers.
5. system performance testing method according to claim 4, which is characterized in that described according to the default test information System to be tested is tested for the property with the raw requests got, obtaining the step of test responds includes：
The actuator for needing to call is determined according to the default test information, and calls the actuator；
The raw requests got are sent to the test system to be measured by the actuator, so that the test system to be measured The test data exported based on the raw requests is sent to the corresponding test pile of the raw requests；
It receives the test pile and passes sequentially through the test response that the test system to be measured and actuator return, the test response is The test pile is tested for the property based on the test data.
6. system according to claim 1 performance test methods, which is characterized in that described to be identified original sound according to described After the step of should being compared with test response, obtain test result, the method further includes：
The test result is sent to the terminal, so that the terminal shows the test result in display interface.
7. system performance testing method according to any one of claims 1 to 6, which is characterized in that described according to the mark Knowing the step of being compared with test response, obtain test result original response includes：
The mark for obtaining raw requests corresponding with the test response, obtains target identification；
Original response corresponding with the target identification is obtained from the journal file to be tested；
Survey corresponding with the identical test system to be measured of version of original response place system is obtained from the test response Examination response；
The original response got is compared with the test response got, obtains test result.
8. system performance testing method according to any one of claims 1 to 6, which is characterized in that described according to the mark Knowing the step of being compared with test response, obtain test result original response includes：
The mark for obtaining raw requests corresponding with the test response, obtains target identification；
Original response corresponding with the target identification is obtained from the journal file to be tested；
It is corresponding each that the to be measured test system different from the version of system where the original response is obtained from the test response A test response；
The original response got is compared respectively with each test response, obtains test result.
9. a kind of system performance testing device, which is characterized in that including：
Receiving unit, the strings of commands for receiving terminal transmission, described instruction string are what the terminal was configured according to configuration-direct Test what information generated；
Acquiring unit, for obtaining journal file to be tested according to described instruction string；
Setting unit, for each raw requests and its corresponding original response setting mark in the journal file；
Test cell obtains test response for being tested for the property to system to be tested according to the raw requests；
Comparing unit obtains test result for original response to be compared with test response according to the mark.
10. system performance testing device according to claim 9, which is characterized in that the acquiring unit is specifically used for：
Candidate journal file is obtained according to described instruction string；
The candidate journal file is parsed, the journal file after being parsed；
The journal file after the parsing is screened according to preset condition, obtains journal file to be tested.
11. system performance testing device according to claim 9, which is characterized in that the system performance testing device is also Including：
Determination unit, for determining the corresponding business of each raw requests after mark is arranged；
Storage unit, for the corresponding business of each raw requests after being identified according to setting, each original after setting is identified Begin to ask to store into corresponding business use-case queue；
The test cell includes：
Subelement is extracted, for extracting default test information from described instruction string；
Obtain subelement, for calling at least one reading process, and according at least one reading process from the original Begin to ask in corresponding business use-case queue, obtains raw requests corresponding with the default test information；
Subelement is tested, for carrying out performance to system to be tested according to the default test information and the raw requests got Test obtains test response.
12. according to claim 9 to 11 any one of them system performance testing device, which is characterized in that the comparing unit It is specifically used for：
The mark for obtaining raw requests corresponding with the test response, obtains target identification；
Original response corresponding with the target identification is obtained from the journal file to be tested；
It is corresponding each that the to be measured test system different from the version of system where the original response is obtained from the test response A test response；
The original response got is compared respectively with each test response, obtains test result.
13. a kind of storage medium, which is characterized in that the storage medium is stored with a plurality of instruction, and described instruction is suitable for processor It is loaded, the step in 1 to 8 any one of them system performance testing method is required with perform claim.
CN201810236682.4A 2018-03-21 2018-03-21 System performance testing method and device and storage medium Active CN108399114B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810236682.4A CN108399114B (en) 2018-03-21 2018-03-21 System performance testing method and device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810236682.4A CN108399114B (en) 2018-03-21 2018-03-21 System performance testing method and device and storage medium

Publications (2)

Publication Number Publication Date
CN108399114A true CN108399114A (en) 2018-08-14
CN108399114B CN108399114B (en) 2021-02-02

Family

ID=63093047

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810236682.4A Active CN108399114B (en) 2018-03-21 2018-03-21 System performance testing method and device and storage medium

Country Status (1)

Country Link
CN (1) CN108399114B (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109614314A (en) * 2018-11-01 2019-04-12 北京奇虎科技有限公司 Performance test methods, device, server and readable storage medium storing program for executing
CN109656819A (en) * 2018-12-07 2019-04-19 北京小米移动软件有限公司 File test method, device and computer readable storage medium
CN110347591A (en) * 2019-06-19 2019-10-18 平安普惠企业管理有限公司 Method, apparatus, electronic equipment and storage medium based on use-case test macro
CN110460967A (en) * 2019-07-05 2019-11-15 深圳壹账通智能科技有限公司 SMS platform test method, device, computer equipment and storage medium
CN110532170A (en) * 2019-07-18 2019-12-03 北京文渊佳科技有限公司 Build method, apparatus, electronic equipment and the medium of test environment
CN111049684A (en) * 2019-12-12 2020-04-21 闻泰通讯股份有限公司 Data analysis method, device, equipment and storage medium
CN111324538A (en) * 2020-02-20 2020-06-23 上海赛可出行科技服务有限公司 Micro-service parallel test environment management method based on dynamic routing
CN112380075A (en) * 2020-11-10 2021-02-19 海光信息技术股份有限公司 Scheduler testing method, scheduler testing device, electronic equipment and computer readable storage medium
CN112416786A (en) * 2020-11-27 2021-02-26 上海达梦数据库有限公司 Test method, device, equipment and storage medium
CN112905445A (en) * 2020-12-09 2021-06-04 江苏苏宁云计算有限公司 Log-based test method and device and computer system
CN112954621A (en) * 2021-02-02 2021-06-11 浙江百应科技有限公司 Online playback method and device after short message sending callback and electronic equipment
CN114116432A (en) * 2022-01-29 2022-03-01 中国民航信息网络股份有限公司 Migration verification method, migration verification platform, electronic device and storage medium
CN114205273A (en) * 2020-08-26 2022-03-18 腾讯科技（深圳）有限公司 System testing method, device and equipment and computer storage medium
CN114817076A (en) * 2022-06-22 2022-07-29 国汽智控(北京)科技有限公司 Data processing method, device, equipment, medium and product of vehicle-mounted operating system
CN116627849A (en) * 2023-07-24 2023-08-22 中邮消费金融有限公司 System test method, device, equipment and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102185734A (en) * 2011-04-18 2011-09-14 华为软件技术有限公司 Automatic interface testing method and server
US20130091566A1 (en) * 2011-10-10 2013-04-11 Microsoft Corporation Internet protocol address space management to mitigate and detect cloaking and other abuse
CN104270455A (en) * 2014-10-14 2015-01-07 税友软件集团股份有限公司 Data transmission method, device and system
CN104347081A (en) * 2013-08-07 2015-02-11 腾讯科技（深圳）有限公司 Method and device for testing scene statement coverage
CN106484610A (en) * 2015-09-02 2017-03-08 阿里巴巴集团控股有限公司 A kind of Beta method and apparatus
US20170220460A1 (en) * 2015-10-21 2017-08-03 Sap Portals Israel Ltd. Exploratory testing on multiple system landscapes
CN107748717A (en) * 2017-09-26 2018-03-02 深圳市牛鼎丰科技有限公司 Automatic interface testing method, device, storage medium and computer equipment
CN107783906A (en) * 2017-09-28 2018-03-09 广州酷狗计算机科技有限公司 Method of testing, device and storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102185734A (en) * 2011-04-18 2011-09-14 华为软件技术有限公司 Automatic interface testing method and server
US20130091566A1 (en) * 2011-10-10 2013-04-11 Microsoft Corporation Internet protocol address space management to mitigate and detect cloaking and other abuse
CN104347081A (en) * 2013-08-07 2015-02-11 腾讯科技（深圳）有限公司 Method and device for testing scene statement coverage
CN104270455A (en) * 2014-10-14 2015-01-07 税友软件集团股份有限公司 Data transmission method, device and system
CN106484610A (en) * 2015-09-02 2017-03-08 阿里巴巴集团控股有限公司 A kind of Beta method and apparatus
US20170220460A1 (en) * 2015-10-21 2017-08-03 Sap Portals Israel Ltd. Exploratory testing on multiple system landscapes
CN107748717A (en) * 2017-09-26 2018-03-02 深圳市牛鼎丰科技有限公司 Automatic interface testing method, device, storage medium and computer equipment
CN107783906A (en) * 2017-09-28 2018-03-09 广州酷狗计算机科技有限公司 Method of testing, device and storage medium

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109614314A (en) * 2018-11-01 2019-04-12 北京奇虎科技有限公司 Performance test methods, device, server and readable storage medium storing program for executing
CN109614314B (en) * 2018-11-01 2024-03-01 北京奇虎科技有限公司 Performance test method, device, server and readable storage medium
CN109656819A (en) * 2018-12-07 2019-04-19 北京小米移动软件有限公司 File test method, device and computer readable storage medium
CN110347591A (en) * 2019-06-19 2019-10-18 平安普惠企业管理有限公司 Method, apparatus, electronic equipment and storage medium based on use-case test macro
CN110460967B (en) * 2019-07-05 2023-05-23 深圳壹账通智能科技有限公司 Short message platform test method and device, computer equipment and storage medium
CN110460967A (en) * 2019-07-05 2019-11-15 深圳壹账通智能科技有限公司 SMS platform test method, device, computer equipment and storage medium
CN110532170A (en) * 2019-07-18 2019-12-03 北京文渊佳科技有限公司 Build method, apparatus, electronic equipment and the medium of test environment
CN110532170B (en) * 2019-07-18 2023-08-08 北京文渊佳科技有限公司 Method and device for building test environment, electronic equipment and medium
CN111049684A (en) * 2019-12-12 2020-04-21 闻泰通讯股份有限公司 Data analysis method, device, equipment and storage medium
CN111324538A (en) * 2020-02-20 2020-06-23 上海赛可出行科技服务有限公司 Micro-service parallel test environment management method based on dynamic routing
CN111324538B (en) * 2020-02-20 2024-03-08 上海赛可出行科技服务有限公司 Dynamic routing-based micro-service parallel test environment management method
CN114205273B (en) * 2020-08-26 2023-09-15 腾讯科技（深圳）有限公司 System test method, device and equipment and computer storage medium
CN114205273A (en) * 2020-08-26 2022-03-18 腾讯科技（深圳）有限公司 System testing method, device and equipment and computer storage medium
CN112380075B (en) * 2020-11-10 2023-03-14 海光信息技术股份有限公司 Scheduler testing method and device, electronic equipment and computer readable storage medium
CN112380075A (en) * 2020-11-10 2021-02-19 海光信息技术股份有限公司 Scheduler testing method, scheduler testing device, electronic equipment and computer readable storage medium
CN112416786A (en) * 2020-11-27 2021-02-26 上海达梦数据库有限公司 Test method, device, equipment and storage medium
CN112905445A (en) * 2020-12-09 2021-06-04 江苏苏宁云计算有限公司 Log-based test method and device and computer system
CN112954621A (en) * 2021-02-02 2021-06-11 浙江百应科技有限公司 Online playback method and device after short message sending callback and electronic equipment
CN114116432A (en) * 2022-01-29 2022-03-01 中国民航信息网络股份有限公司 Migration verification method, migration verification platform, electronic device and storage medium
CN114817076A (en) * 2022-06-22 2022-07-29 国汽智控(北京)科技有限公司 Data processing method, device, equipment, medium and product of vehicle-mounted operating system
CN116627849A (en) * 2023-07-24 2023-08-22 中邮消费金融有限公司 System test method, device, equipment and storage medium
CN116627849B (en) * 2023-07-24 2024-01-26 中邮消费金融有限公司 System test method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN108399114B (en) 2021-02-02

Similar Documents

Publication Publication Date Title
CN108399114A (en) A kind of system performance testing method, apparatus and storage medium
CN111756582B (en) Service chain monitoring method based on NFV log alarm
CN109446071A (en) Interface test method, interface test device, electronic equipment and storage medium
CN109582301A (en) Method for processing business, device, equipment and the medium of task based access control scheduling system
CN106484622A (en) Method of testing, apparatus and system
CN105471620A (en) Broadband intelligent terminal embedded network analysis and diagnosis device and method thereof
CN101091354A (en) Binary class based analysis and monitoring
CN106452955B (en) A kind of detection method and system of abnormal network connection
CN106569951B (en) A kind of Web test method being detached from the page
CN104427547B (en) Business and network associate method of testing, apparatus and system
CN108959048A (en) The method for analyzing performance of modular environment, device and can storage medium
CN105405221A (en) Method and device for automated test
CN108696371B (en) Network fault determination method and system
CN113360376A (en) Buried point testing method and device
CN107168844A (en) A kind of method and device of performance monitoring
CN114567505B (en) Abnormal session big data processing method and server applied to digital office
CN108108296A (en) A kind of cloud test method, server and client
CN109150569A (en) A kind of network video service fault locating analysis method, apparatus and system
CN109582751A (en) A kind of measure and server of retrieval effectiveness
CN114070707A (en) Internet performance monitoring method and system
CN111158979A (en) Service dial testing method, system, device and storage medium
CN115952098A (en) Performance test tuning scheme recommendation method and system
CN105405220A (en) Method and device for automated test
CN111222781B (en) Fault diagnosis method and device, and storage medium
CN110535972B (en) Centralized control and communication system, equipment and readable storage medium for platform gas detection equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant