CN106909499A - Method of testing and device - Google Patents
Method of testing and device Download PDFInfo
- Publication number
- CN106909499A CN106909499A CN201510975342.XA CN201510975342A CN106909499A CN 106909499 A CN106909499 A CN 106909499A CN 201510975342 A CN201510975342 A CN 201510975342A CN 106909499 A CN106909499 A CN 106909499A
- Authority
- CN
- China
- Prior art keywords
- data
- test
- network object
- line algorithm
- result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
Abstract
The invention provides method of testing and device, it is set to after input data by by the network behavior data of network object and the network object, input data is processed using on-line Algorithm program, obtain data result, and then the value of aiming field is extracted from the data result, obtain sample data, then sample data is estimated according to test index, obtain test result, due to only needing to set aiming field previously according to existing test index, and input data is set, both on-line Algorithm program was tested using the test index, and without writing the process of simulation scenario in the prior art, so as to improve on-line Algorithm program test efficiency.
Description
Technical field
The present invention relates to computer technology, more particularly to a kind of method of testing and device.
Background technology
With continuing to develop for Internet technology, for the interaction that business is carried out using Internet technology
Treatment has become main trend.In Business Processing, generally require algorithm routine is carried out to business
Support.Existing algorithm routine is generally divided into on-line Algorithm program and off-line algorithm program.It is online to calculate
Method program is different from off-line algorithm program, and on-line Algorithm program need not know whole inputs in advance
Data, it can one by one process input in serialized fashion such that it is able to quickly respond
Input data.
In the application process of algorithm routine, in order to obtain faster response speed, more and more
Employ the form of on-line Algorithm program.In the prior art, if being surveyed to on-line Algorithm program
Examination, can be rewritten to on-line Algorithm program by way of simulation using offline copy mode,
That is need to write the extensive works such as test script and debugging could complete to on-line Algorithm program
Test, after test passes through, then on-line Algorithm program be invested in business run.
But in existing method of testing, because the workload for writing simulation scenario is larger, meanwhile, institute
The simulation scenario write not only easily malfunctions, and plasticity is poor, so as to cause on-line Algorithm journey
The testing efficiency of sequence is not high.
The content of the invention
The present invention provides a kind of method of testing and device, for solving on-line Algorithm of the prior art
The inefficient technical problem of program test.
To reach above-mentioned purpose, embodiments of the invention are adopted the following technical scheme that：
A kind of first aspect, there is provided method of testing, including：
The network behavior data of network object and the network object are set to input data；
The input data is processed using on-line Algorithm program, obtains data result；
The value of aiming field is extracted from the data result, sample data is obtained；
The sample data is estimated according to test index, obtains test result.
A kind of second aspect, there is provided test device, including：
Setup module, for the network behavior data of network object and the network object to be set
It is input data；
Processing module, for being processed the input data using on-line Algorithm program, is obtained
Data result；
Extraction module, the value for extracting aiming field from the data result, obtains sample
Data；
Test module, for being estimated to the sample data according to test index, is tested
As a result.
Method of testing provided in an embodiment of the present invention and device, by by network object and the network
The network behavior data of object are set to after input data, using on-line Algorithm program to input number
According to being processed, data result is obtained, and then the value of aiming field is extracted from the data result,
Sample data is obtained, sample data is estimated according to test index then, obtain test result,
Due to only needing to set aiming field previously according to existing test index, and input data is set,
Both on-line Algorithm program was tested using the test index, and without writing in the prior art
The process of simulation scenario, so as to improve on-line Algorithm program test efficiency.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the present invention
Technological means, and can be practiced according to the content of specification, and in order to allow it is of the invention on
Stating can become apparent with other objects, features and advantages, below especially exemplified by specific reality of the invention
Apply mode.
Brief description of the drawings
By reading the detailed description of hereafter preferred embodiment, various other advantage and benefit
Place will be clear understanding for those of ordinary skill in the art.Accompanying drawing is only used for showing preferably
The purpose of implementation method, and it is not considered as limitation of the present invention.And in whole accompanying drawing
In, identical part is denoted by the same reference numerals.In the accompanying drawings：
Fig. 1 is the schematic flow sheet of the method for testing that the embodiment of the present invention one is provided；
Fig. 2 is the schematic flow sheet of the method for testing that the embodiment of the present invention two is provided；
Fig. 3 is the structural representation of the test device that the embodiment of the present invention three is provided；
Fig. 4 is the structural representation of the test device that the embodiment of the present invention four is provided.
Specific embodiment
The main thought of the application is, by running online algorithm routine after, for
The data result that line algorithm routine is exported carries out treatment and obtains sample data so that the sample
The form of data can be applied to existing test index, such that it is able to utilize the test index
Sample data is estimated, test result is obtained, the calculating to on-line Algorithm program is realized
Effect is tested, to avoid in the prior art rewriteeing the offline copy mode of on-line Algorithm program
Process, that is to say, that without writing simulation scenario, this makes it possible to avoid writing simulation
The huge workload that script is brought, easily the problem of error and poor plasticity, improves
The testing efficiency of line algorithm routine.
According to the method that the present embodiment is provided, user only needs to enter to on-line Algorithm program
Before row test, aiming field is set previously according to existing test index, and input number is set
According to, on-line Algorithm program was tested using the test index both, reduce the work of test
Amount, improves testing efficiency.
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although attached
The exemplary embodiment of the disclosure is shown in figure, it being understood, however, that can be with various shapes
Formula realizes the disclosure without that should be limited by embodiments set forth here.Conversely, there is provided these
Embodiment is able to be best understood from the disclosure, and can be by the scope of the present disclosure
Complete conveys to those skilled in the art.
Method of testing provided in an embodiment of the present invention and device are carried out in detail below in conjunction with the accompanying drawings
Description.
Embodiment one
Fig. 1 is the schematic flow sheet of the method for testing that the embodiment of the present invention one is provided, this implementation
The method that is there is provided of example can by algorithm evaluate and test platform (Algorithm Evaluation Carrier,
AEC) perform, each offline test index and right has been integrated with algorithm evaluation and test platform
The test program answered, as shown in figure 1, method includes：
Step 101, by the network behavior data of network object and network object be set to be input into number
According to.
Specifically, can be by being previously recorded in the network behavior of produced network object in business
Come network object and the network behavior data of network object needed for getting.Further, since industry
Just the network behavior data of each network object are recorded in business daily record, can be by from business diary
Extract the network behavior data for obtaining network object and network object.Specifically in the selection of business,
The business that tested on-line Algorithm program is layouted, that is, on-line Algorithm program can be paid the utmost attention to
The business being applied to.
It should be noted that network object can refer to the network user, network behavior can be pointer
Buying behavior to commodity browses row for the search behavior of commodity or for commodity
For etc..
As the typical application scenarios of application scheme, in poly- business to one's profit, can be to each net
Search behavior each time of the network user in the business is recorded, and the content for being recorded can be wrapped
The used keyword of search, the duration that search takes and frequency are included but are not limited to, and when acquisition
Commodity sign in the Search Results clicked on during Search Results.Wherein, adopted by recording search
Keyword can know the merchandise classification interested to the network user, and specific merchandise classification can
Clothes, household, mother and baby and automobile etc. are thought, it can in addition contain know trade name and commodity details
Feature.In addition, by recording the commodity sign in the Search Results that the network user is clicked on, may be used also
Further to know that more accurately commodity are believed for Price Range, brand interested to the network user etc.
Breath.Meanwhile, by recording duration and the frequency that search takes, the network user can be known to commodity
Relative extent interested.
Based on content noted above, the feature of the network user can be taken out, work as on-line Algorithm
Program is to layout when the program of poly- to one's profit business for Recommendations, can be recorded these
Content as input data such that it is able to the feature for each network user carries out commercial product recommending,
Improve the efficiency recommended.Simultaneously as above input data be to necessary being network object and
The network behavior data of network object carry out recording acquisition, it is to avoid defeated by writing before test
Enter the process that data build data pool, not only reduce workload, and avoid due to writing
Occurs failure caused by mistake in journey.
Step 102, input data is processed using on-line Algorithm program, obtain data result.
Specifically, test request is generated according to input data, to the service for running online algorithm routine
Device cluster distributes test request, and then the data result of journal file form is obtained from server cluster.
The data result is that server cluster is entered using on-line Algorithm program to the input data in test request
Row treatment is obtained.
In addition, in the data result for being obtained, it is possible that some abnormal datas, thus can
After data result is obtained, to realize rejecting these abnormal datas by investigating.So as to
The step of value of follow-up extraction aiming field is performed to the data result after investigation.
Step 103, from data result extract aiming field value, obtain sample data.
Specifically, for the data result of journal file form, being sequentially completed the stream disassembled and assemble
Journey, so as to obtain sample data.
Wherein, disassembling flow includes：Target needed for being determined according to the test index of off-line algorithm
After field, the value of aiming field is extracted from the data result of journal file form, if extracting
Success, then perform the flow of assembling；If extraction is unsuccessful, error is extracted in report.
Wherein, the flow of assembling includes：The value of aiming field is inserted in preset table to should
The record value position of aiming field, obtains the sample data of form.
Further, needed to pre-set aiming field before step 103, specifically, the target
Field could be arranged to test index needed for universal field, needed for may be arranged as test index
Universal field and User Defined field.
It should be noted that the aiming field included in preset table is basis is tested when institute
Using test index come what is determined, be analyzed by test index, acquisition referred to according to test
Mark universal field involved when being tested, for example：The business that ID and user are browsed
Product mark etc..In general, the universal field involved by conventional test index be it is relatively-stationary,
So can both may be used using same form.If according to testing requirement, test index is to be related in form
Non-existent custom field, then user form can be modified, User Defined field is added
It is added in form.
Step 104, sample data is estimated according to test index, obtains test result.
Specifically, being internally integrated each offline test index and corresponding test journey in AEC
Sequence, treatment is estimated to sample data using the required corresponding test program of test index, from
And obtain test result.In general, conventional test index include coverage rate, renewal property and
Accuracy rate etc..For each test index, with the test journey that at least one pair of is answered inside AEC
Sequence, for the test program for, in this step, using sample data as the defeated of test program
Enter, the output of the test program is then obtained test result.
For example：For this test index of renewal property, can be used for for same on-line Algorithm program
Tested in data result not in the same time, so that in a step 102, can respectively in difference
Moment obtains data result, and then in step 103, for the data knot not obtained in the same time
Fruit extract the operation of aiming field, so that at least two sample datas are obtained, and then in step 104
In, for this at least two sample data, according to renewal property, this test index is tested.Specifically,
Using at least different notebook data as the input of renewal property test program, obtained renewal can be based on
Difference journey of the on-line Algorithm program in data result not in the same time is weighed in the output of test program
Degree.
In the present embodiment, set by by the network behavior data of network object and the network object
After for input data, input data is processed using on-line Algorithm program, obtain data knot
Really, and then from the data result value of aiming field is extracted, sample data, Ran Hougen is obtained
Sample data is estimated according to test index, obtain test result, due to only need previously according to
Existing test index sets aiming field, and sets input data, both refers to using the test
Mark is tested on-line Algorithm program, and without writing the process of simulation scenario in the prior art,
So as to improve on-line Algorithm program test efficiency.
Embodiment two
The present embodiment additionally provides another test more careful relative to method of testing in Fig. 1
Method, Fig. 2 is the schematic flow sheet of the method for testing that the embodiment of the present invention two is provided, such as Fig. 2 institutes
Show, including：
Step 201, determine the target service that on-line Algorithm program is layouted.
Specifically, generally, the target service that on-line Algorithm program is layouted is predetermined
Alright, the position layouted according to needed for on-line Algorithm program carries out test to it will more be pressed close to
Situation of line algorithm routine when actually used, the test result for being obtained also will be more accurate.
Step 202, the business diary of the target service is judged whether, if so, then performing step
203, otherwise perform step 204.
Specifically, the business diary of the target service is judged whether, if the target service is original
There are business, i.e., the business being currently running on current line, the then business that may there is the target service
Daily record, if the target service is a new business, i.e., does not have the business of operation, then on current line
May not there is the business diary of the target service.The business day of each business can in advance be collected
Will, pre-processes to each business diary, obtains the network row of network object and network object
For data are preserved, extracted by business keyword and obtain network object and network object
Network behavior data, if can be drawn into, illustrate the business diary in the presence of the target service, instead
Do not exist then.
For example：Run in mobile phone Taobao it is poly- to calculate be then a just business for stable operation on line,
There is business diary in the business, the described mark for including but is not limited to user in business diary,
The information such as the time of origin of buying behavior and the mark of purchase commodity.
If step 203, the business diary that there is the target service that on-line Algorithm program is layouted, from
The network behavior number for obtaining network object and network object is extracted in the business diary of target service
According to.
By obtaining the network behavior data of real each network object from business diary, and by its
It is used for test process as input data, not only causes that test result is more accurate, and eliminate
The process of input data is write, testing efficiency is further increased.
If the business diary of step 204, the target service layouted in the absence of on-line Algorithm program,
The network behavior number for obtaining network object and network object is extracted from the business diary of existing business
According to.
If specifically, the business diary of the target service layouted in the absence of on-line Algorithm program,
Network object and network object can be extracted from the business diary of existing all or part of business
Network behavior data.The selection of specific business, can be foundation with the target service that can fit,
To obtain more accurately test result.
Step 205, by the network behavior data of network object and network object be set to be input into number
According to according to input data generation test request.
Specifically, after can input data be assembled into test request, being carried out to test request
Encryption, so as to obtain the test request by encrypting.
Step 206, distribute test request to the server cluster for running online algorithm routine, and from clothes
Business device cluster is obtained to process the input data in test request using on-line Algorithm program and obtained
The data result for obtaining.
Specifically, due to the collection for data result, and for the data processing of data result
Need to be related to substantial amounts of calculating, thus data processing performance is had higher requirements, for this performance
On consideration, can by following steps using mapping reduction (MapReduce) software frame realize,
One model of generation, the model is used to perform：Extracted in business diary and obtain network object and net
The network behavior data of network object；Generation and distribution test request；Obtain data result and extraction
The value of aiming field in data result.
Step 207, from data result extract aiming field value.
Specifically, aiming field can be set in advance as test index needed for universal field and user
Custom field, parses according to aiming field to the data result of journal file form, from number
According to the value that aiming field is extracted in result.
It should be noted that aiming field be user before test, in advance mark.User can
Protected with by the request method of on-line Algorithm program, the business diary of target service and aiming field
Exist in configuration file, generate an operation that can be repeated (job).
Step 208, the record value position that the value of aiming field is inserted correspondence aiming field in form
Put, obtain the sample data of form.
Specifically, because test index is the test index based on off-line algorithm program, so that
Data result is converted to the sample data of the structuring form suitable for the test index.Tool
Body, the structuring form can be to be suitable to be input into hadoop, MapReduce, Dremel, Apache
The tables of data of Spark distributed calculating platforms.By input or wound on Distributed Computing Platform
The mode of building obtains the structuring form, and in the structuring form, will be extracted in step 207
To the value of corresponding aiming field write as the train value of structuring form, so as to obtain sample
Notebook data.
Step 209, sample data is estimated according to test index, obtains test result.
For clear explanation the present embodiment, the present embodiment additionally provides two kinds of application scenarios.
Wherein, as a kind of possible application scenarios, target service is stable operation in mobile phone Taobao
Business A, it is necessary to new on-line Algorithm program is the former on-line Algorithm journey run in business A
The upgrading of sequence.In order to ensure that new on-line Algorithm program version iteration can lift the scene effect of business A
Really, it is necessary to be tested before new on-line Algorithm program reaches the standard grade use, the on-line Algorithm journey is assessed
The effect of sequence.Using the method in the present embodiment, user only needs to be carried out simply in AEC platforms
Configuration, including：The business diary and target word of the request method, business A of on-line Algorithm program
Section and test index.These configurations are stored in a job, when performing this job, model can
Sample data is generated with according to job.And then commented by the test index precipitated in AEC platforms
Estimate, obtain test result.If test passes through, replaced using new on-line Algorithm program in business A
Change former on-line Algorithm program；Otherwise, it is necessary to continue to modify new on-line Algorithm program.
Used as alternatively possible application scenarios, target service is present non-existent business B, is needed
A new on-line Algorithm program is run in this new business B.Using the method in the present embodiment,
User needs the selection existing business approximate with business B in advance or directly chooses all to have industry
Business, then user equally only needs simply to be configured in AEC platforms, including：On-line Algorithm
The request method of program, the business diary of selected business and aiming field and test index.Will
These configurations are stored in a job, and when performing this job, model can generate sample according to job
Notebook data.And then be estimated by the test index precipitated in AEC platforms, obtain test result.
If likewise, test passes through, this new on-line Algorithm program is run in new business B；Otherwise,
Need to continue to modify new on-line Algorithm program.
In the present embodiment, set by by the network behavior data of network object and the network object
After for input data, input data is processed using on-line Algorithm program, obtain data knot
Really, and then from the data result value of aiming field is extracted, sample data, Ran Hougen is obtained
Sample data is estimated according to test index, obtain test result, due to only need previously according to
Existing test index sets aiming field, and sets input data, both refers to using the test
Mark is tested on-line Algorithm program, and without writing the process of simulation scenario in the prior art,
So as to improve on-line Algorithm program test efficiency.In addition, obtaining true by from business diary
Each network object network behavior data, and as input data be used for test process, no
Only so that test result is more accurate, and the process for writing input data is eliminated, further carried
Testing efficiency high.
Embodiment three
Fig. 3 is the structural representation of the test device that the embodiment of the present invention three is provided, such as Fig. 3 institutes
Show, including：Setup module 31, processing module 32, extraction module 33 and test module 34.
Setup module 31, for the network behavior data of network object and the network object to be set
It is set to input data.
Specifically, can be by being previously recorded in the network behavior of produced network object in business
Come network object and the network behavior data of network object needed for getting.Further, since industry
Just record the network behavior data of each network object in business daily record, setup module 31 can by from
The network behavior data for obtaining network object and network object are extracted in business diary.Specifically in industry
In the selection of business, the business that tested on-line Algorithm program is layouted can be paid the utmost attention to, that is,
The business that on-line Algorithm program is applied to.
Further, setup module 31, are additionally operable to universal field and/or use according to needed for test index
Family custom field sets the aiming field.
Processing module 32, for being processed the input data using on-line Algorithm program, is obtained
Obtain data result.
Specifically, processing module 32 generates test request according to input data, to operation on-line Algorithm
The server cluster distribution test request of program, and then obtain data result from server cluster.Should
Data result is that server cluster is carried out using on-line Algorithm program to the input data in test request
What treatment was obtained.
Extraction module 33, the value for extracting aiming field from the data result, obtains sample
Notebook data.
Specifically, aiming field of the extraction module 33 according to included in default form, from data
The value of aiming field is extracted in result, target word is corresponded to during the value of aiming field is inserted into form
The record value position of section, obtains the sample data of form.
Test module 34, for being estimated to the sample data according to test index, is surveyed
Test result.
Specifically, test index corresponding test program of the test module 34 needed for is to sample number
According to being estimated treatment.
In the present embodiment, set by by the network behavior data of network object and the network object
After for input data, input data is processed using on-line Algorithm program, obtain data knot
Really, and then from the data result value of aiming field is extracted, sample data, Ran Hougen is obtained
Sample data is estimated according to test index, obtain test result, due to only need previously according to
Existing test index sets aiming field, and sets input data, both refers to using the test
Mark is tested on-line Algorithm program, and without writing the process of simulation scenario in the prior art,
So as to improve on-line Algorithm program test efficiency.
Example IV
Fig. 4 is the structural representation of the test device that the embodiment of the present invention four is provided, real upper one
Apply on the basis of the test device that example is provided, the test device of the present embodiment is further included：The
One obtains module 35 and second obtains module 36.
First obtains module 35, if for there is the target service that the on-line Algorithm program is layouted
Business diary, then from the business diary of the target service extract obtain network object and institute
State the network behavior data of network object.
Second obtains module 36, if for the target industry layouted in the absence of the on-line Algorithm program
The business diary of business, then extract from the business diary of existing business and obtain network object and described
The network behavior data of network object.
Further, processing module 32, including：Generation unit 321, Dispatching Unit 322 and acquisition
Unit 323.
Generation unit 321, for generating test request according to the input data.
Dispatching Unit 322, for described to the server cluster distribution for running the on-line Algorithm program
Test request.
Acquiring unit 323, the on-line Algorithm program pair is used for being obtained from the server cluster
Input data in the test request is processed obtained data result.
Further, extraction module 33, including：Extraction unit 331 and biography value cell 332.
Extraction unit 331, for extracting the target from the data result of journal file form
The value of field.
Value cell 332 is passed, it is described for the value of the aiming field to be inserted into correspondence in preset table
The record value position of aiming field, obtains the sample data of form.
It should be noted that each functional module of device that the present embodiment is provided is used to perform Fig. 2
The method for being provided, each functional module is implemented referring to the associated description in embodiment of the method,
This is repeated no more in the present embodiment.
In the present embodiment, set by by the network behavior data of network object and the network object
After for input data, input data is processed using on-line Algorithm program, obtain data knot
Really, and then from the data result value of aiming field is extracted, sample data, Ran Hougen is obtained
Sample data is estimated according to test index, obtain test result, due to only need previously according to
Existing test index sets aiming field, and sets input data, both refers to using the test
Mark is tested on-line Algorithm program, and without writing the process of simulation scenario in the prior art,
So as to improve on-line Algorithm program test efficiency.In addition, obtaining true by from business diary
Each network object network behavior data, and as input data be used for test process, no
Only so that test result is more accurate, and the process for writing input data is eliminated, further carried
Testing efficiency high.
One of ordinary skill in the art will appreciate that：Realize the whole of above-mentioned each method embodiment
Or part steps can be completed by the related hardware of programmed instruction.Foregoing program can be with
It is stored in a computer read/write memory medium.Upon execution, execution includes the program
The step of stating each method embodiment；And foregoing storage medium includes：ROM, RAM, magnetic
Dish or CD etc. are various can be with the medium of store program codes.
Finally it should be noted that：Various embodiments above is merely illustrative of the technical solution of the present invention,
Rather than its limitations；Although being described in detail to the present invention with reference to foregoing embodiments,
It will be understood by those within the art that：It can still be remembered to foregoing embodiments
The technical scheme of load is modified, or which part or all technical characteristic are carried out etc.
With replacement；And these modifications or replacement, the essence of appropriate technical solution is departed from this
Invent the scope of each embodiment technical scheme.
Claims (12)
1. a kind of method of testing, it is characterised in that including：
The network behavior data of network object and the network object are set to input data；
The input data is processed using on-line Algorithm program, obtains data result；
The value of aiming field is extracted from the data result, sample data is obtained；
The sample data is estimated according to test index, obtains test result.
2. method of testing according to claim 1, it is characterised in that described from data result
The middle value for extracting aiming field, obtains sample data, including：
The value of the aiming field is extracted from the data result of journal file form；
The record that the value of the aiming field inserts the correspondence aiming field in preset table is taken
Value position, obtains the sample data of form.
3. method of testing according to claim 1, it is characterised in that described from the data
The value of aiming field is extracted in result, before obtaining sample data, is also included：
Universal field needed for the test index and/or User Defined field are set to the mesh
Marking-up section.
4. method of testing according to claim 1, it is characterised in that described by network object
And before the network behavior data of the network object are set to input data, also include：
If there is the business diary of the target service that the on-line Algorithm program is layouted, from described
The network behavior for obtaining network object and the network object is extracted in the business diary of target service
Data.
5. method of testing according to claim 1, it is characterised in that described by network object
And before the network behavior data of the network object are as input data, also include：
If the business diary of the target service layouted in the absence of the on-line Algorithm program, from
There is the network behavior number of extraction acquisition network object and the network object in the business diary of business
According to.
6. the method for testing according to claim any one of 1-5, it is characterised in that the profit
The input data is processed with online algorithm routine, obtains data result, including：
Test request is generated according to the input data；
Distribute the test request to the server cluster for running the on-line Algorithm program；
Obtained using the on-line Algorithm program in the test request from the server cluster
Input data is processed obtained data result.
7. a kind of test device, it is characterised in that including：
Setup module, for the network behavior data of network object and the network object to be set
It is input data；
Processing module, for being processed the input data using on-line Algorithm program, is obtained
Data result；
Extraction module, the value for extracting aiming field from the data result, obtains sample
Data；
Test module, for being estimated to the sample data according to test index, is tested
As a result.
8. test device according to claim 7, it is characterised in that the extraction module,
Including：
Extraction unit, for extracting the target word from the data result of journal file form
The value of section；
Value cell is passed, for the value of the aiming field to be inserted into the correspondence mesh in preset table
The record value position of marking-up section, obtains the sample data of form.
9. test device according to claim 7, it is characterised in that
The setup module, is additionally operable to the universal field needed for the test index and/or user certainly
Define field and be set to the aiming field.
10. test device according to claim 7, it is characterised in that the test device,
Also include：
First obtains module, if for there is the target service that the on-line Algorithm program is layouted
Business diary, then extract from the business diary of the target service and obtain network object and described
The network behavior data of network object.
11. test devices according to claim 7, it is characterised in that the test device,
Also include：
Second obtains module, if for the target service layouted in the absence of the on-line Algorithm program
Business diary, then from the business diary of existing business extract obtain network object and the net
The network behavior data of network object.
12. test device according to claim any one of 7-11, it is characterised in that described
Processing module, including：
Generation unit, for generating test request according to the input data；
Dispatching Unit, for distributing the survey to the server cluster for running the on-line Algorithm program
Examination request；
Acquiring unit, for being obtained using the on-line Algorithm program to institute from the server cluster
State the input data in test request and processed obtained data result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510975342.XA CN106909499A (en) | 2015-12-22 | 2015-12-22 | Method of testing and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510975342.XA CN106909499A (en) | 2015-12-22 | 2015-12-22 | Method of testing and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106909499A true CN106909499A (en) | 2017-06-30 |
Family
ID=59200820
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510975342.XA Pending CN106909499A (en) | 2015-12-22 | 2015-12-22 | Method of testing and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106909499A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108920377A (en) * | 2018-07-16 | 2018-11-30 | 杭州安恒信息技术股份有限公司 | A kind of log playback test method, system, device and readable storage medium storing program for executing |
| CN109918293A (en) * | 2019-01-29 | 2019-06-21 | 平安科技（深圳）有限公司 | System detection method and device, electronic equipment, computer readable storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060286537A1 (en) * | 2005-05-31 | 2006-12-21 | Mandella George V | System and method for improving performance using practice tests |
| CN101355457A (en) * | 2008-06-19 | 2009-01-28 | 腾讯科技（北京）有限公司 | Test method and test equipment |
| CN102779087A (en) * | 2011-05-06 | 2012-11-14 | Sap股份公司 | Systems and methods for business process logging |
| CN103023710A (en) * | 2011-09-21 | 2013-04-03 | 阿里巴巴集团控股有限公司 | Safety test system and method |
| CN103178982A (en) * | 2011-12-23 | 2013-06-26 | 阿里巴巴集团控股有限公司 | Method and device for analyzing log |
| CN103246355A (en) * | 2012-02-06 | 2013-08-14 | 百度在线网络技术（北京）有限公司 | On-line input method evaluation method, system and device |
| CN104035869A (en) * | 2014-06-19 | 2014-09-10 | 科大讯飞股份有限公司 | Application evaluation method, terminal, and server |
-
2015
- 2015-12-22 CN CN201510975342.XA patent/CN106909499A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060286537A1 (en) * | 2005-05-31 | 2006-12-21 | Mandella George V | System and method for improving performance using practice tests |
| CN101355457A (en) * | 2008-06-19 | 2009-01-28 | 腾讯科技（北京）有限公司 | Test method and test equipment |
| CN102779087A (en) * | 2011-05-06 | 2012-11-14 | Sap股份公司 | Systems and methods for business process logging |
| CN103023710A (en) * | 2011-09-21 | 2013-04-03 | 阿里巴巴集团控股有限公司 | Safety test system and method |
| CN103178982A (en) * | 2011-12-23 | 2013-06-26 | 阿里巴巴集团控股有限公司 | Method and device for analyzing log |
| CN103246355A (en) * | 2012-02-06 | 2013-08-14 | 百度在线网络技术（北京）有限公司 | On-line input method evaluation method, system and device |
| CN104035869A (en) * | 2014-06-19 | 2014-09-10 | 科大讯飞股份有限公司 | Application evaluation method, terminal, and server |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108920377A (en) * | 2018-07-16 | 2018-11-30 | 杭州安恒信息技术股份有限公司 | A kind of log playback test method, system, device and readable storage medium storing program for executing |
| CN109918293A (en) * | 2019-01-29 | 2019-06-21 | 平安科技（深圳）有限公司 | System detection method and device, electronic equipment, computer readable storage medium |
| CN109918293B (en) * | 2019-01-29 | 2024-05-03 | 平安科技（深圳）有限公司 | System test method and device, electronic equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11430013B2 (en) | Configurable relevance service test platform | |
| US11093370B1 (en) | Impact analysis for software testing | |
| Silva et al. | Using vistrails and provenance for teaching scientific visualization | |
| CN104317618B (en) | A kind of firmware partition treating method and apparatus | |
| CN108121795A (en) | User's behavior prediction method and device | |
| CN108595583A (en) | Dynamic chart class page data crawling method, device, terminal and storage medium | |
| CN107408043A (en) | System and method for the intelligence tool in sequence streamline | |
| CN110162516A (en) | A kind of method and system that the data based on mass data processing are administered | |
| Idris | Python data analysis | |
| CN110008397B (en) | Recommendation model training method and device | |
| CN104657274B (en) | software interface test method and device | |
| CN109872015A (en) | Method and device for behavioral data assessment | |
| CN109388376A (en) | Risk of software development appraisal procedure, device, equipment and readable storage medium storing program for executing | |
| CN103914507A (en) | File management apparatus and file management method | |
| CN110414989A (en) | Method for detecting abnormality and device, electronic equipment and computer readable storage medium | |
| US11308504B2 (en) | Product test orchestration | |
| CN109871312A (en) | A kind of interface test method, device, equipment and readable storage medium storing program for executing | |
| Lenhard | Disciplines, models, and computers: The path to computational quantum chemistry | |
| CN108460068A (en) | Method, apparatus, storage medium and the terminal that report imports and exports | |
| JPWO2019142345A1 (en) | Security information processing equipment, information processing methods and programs | |
| CN106909499A (en) | Method of testing and device | |
| Bellini | The forward search interactive outlier detection in cointegrated VAR analysis | |
| Chircu et al. | Cloud computing for big data entrepreneurship in the supply chain: using SAP HANA for pharmaceutical track-and-trace analytics | |
| CN106294700A (en) | The storage of a kind of daily record and read method and device | |
| Jeet et al. | Learning Quantitative Finance with R |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170630 |