CN106294118A - Messaging device and information processing method - Google Patents

Abstract

The disclosure provides a kind of messaging device and information processing method.This messaging device includes: extraction unit, for extracting the application related information relevant with application to be tested；Acquiring unit, for applying the test resource information of tester and described application related information based on candidate, applies from described candidate and obtains mating of matching with described application to be tested tester and apply tester；And recommendation unit, for the test-taking techniques according to described coupling application tester, recommend to perform application tester to the publisher of described application to be tested, in order to described execution application tester carries out application test to described application to be tested from described coupling application tester.Messaging device and information processing method according to the disclosure at least can recommend to carry out application to be tested, to the publisher of application to be tested, the application tester that application is tested based on the test-taking techniques and test resource of applying tester.

Description

Messaging device and information processing method

Technical field

The present invention relates to field of information processing, particularly relate to the field of application test, particularly to one Messaging device, information processing method and electronic installation for mass-rent test.

Background technology

Along with popularizing of the Internet, especially mobile Internet are along with popularizing that smart mobile phone is applied, Make have every day thousands of application to be developed for use in the user terminal including smart mobile phone, But, owing to lacking the effective method of testing for application, the quality that market is widely applied at present It not the most the highest, and the demand of user cannot be met.In prior art, generally use mass-rent mould Formula realize application test, with solve tester use simulator or prototype test application time be difficult to right Mistake carries out positioning and analyze the problem testing the reason that makes a mistake.But, due to each mass-rent work Test resource and test-taking techniques that people has are different, the test resource required for each application to be tested And the test-taking techniques of mass-rent workman is the most different, therefore in general mass-rent test, task publisher The mass-rent workman being suitable to each application to be tested can not be easily found.

Summary of the invention

The brief overview about the present invention given below, in order to provide about some of the present invention The basic comprehension of aspect.Should be appreciated that this general introduction is not that the exhaustive about the present invention is summarized. It is not intended to determine the key of the present invention or pith, is not the model of the intended limitation present invention Enclose.Its purpose is only to provide some concept in simplified form, more detailed in this, as discuss after a while The thin preamble described.

In view of the drawbacks described above of prior art, an object of the present invention is to provide a kind of information processing and sets Standby, information processing method and electronic installation, at least to overcome existing problem.

According to an aspect of this disclosure, it is provided that a kind of messaging device, including: extraction unit, For extracting the application related information relevant with application to be tested；Acquiring unit, for answering based on candidate By test resource information and the described application related information of tester, apply tester from described candidate What middle acquisition matched with described application to be tested mates application tester；And recommendation unit, it is used for According to the test-taking techniques of described coupling application tester, treat to described from described coupling application tester The publisher of test application recommends to perform application tester, in order to described execution application tester is to described Application to be tested carries out application test.

According to another aspect of the present disclosure, it is provided that a kind of information processing method, including: extract with to be measured The application related information that examination application is relevant；Test resource information and the institute of tester is applied based on candidate State application related information, apply acquisition tester to match with described application to be tested from described candidate Coupling application tester；And the test-taking techniques according to described coupling application tester, from described Join in application tester and recommend to perform application tester to the publisher of described application to be tested, in order to institute State execution application tester and described application to be tested is carried out application test.

According to another aspect of the disclosure, additionally providing a kind of electronic equipment, this electronic equipment includes Messaging device as above.

According to the other side of the disclosure, additionally provide one and computer is used as above believe The program of breath processing equipment.

According to the another aspect of the disclosure, additionally provide corresponding computer-readable recording medium, this meter On calculation machine readable storage medium storing program for executing, storage has the computer program that can be performed, this computer by calculating equipment Program can make calculating equipment perform above-mentioned information processing method upon execution.

The above-mentioned messaging device according to disclosure embodiment and method and electronic installation, at least can Enough obtain one of following benefit: qualified execution can be recommended to answer to the publisher of application to be tested With tester, application to be tested is carried out application to test；The task of performing application tester can be completed Situation is evaluated, with the test-taking techniques about this execution application tester of storage in more new database Information.

By the detailed description below in conjunction with accompanying drawing most preferred embodiment of this disclosure, these of the disclosure And other advantages will be apparent from.

Accompanying drawing explanation

The disclosure can be by with reference to preferably being managed below in association with the description given by accompanying drawing Solve, employ same or analogous reference the most in all of the figs to represent same or like Parts.Described accompanying drawing comprises in this manual and is formed this together with detailed description below A part for description, and be used for being further illustrated by preferred embodiment of the present disclosure and explaining this Disclosed principle and advantage.Wherein:

Fig. 1 is a kind of example schematically showing the messaging device according to disclosure embodiment The block diagram of structure.

Fig. 2 is the block diagram of a kind of exemplary construction schematically showing the acquiring unit in Fig. 1.

Fig. 3 is to schematically show the matching degree in Fig. 2 to obtain a kind of example arrangement of subelement Block diagram.

Fig. 4 is the block diagram of a kind of exemplary construction schematically showing the recommendation unit in Fig. 1.

Fig. 5 is the another kind of exemplary construction illustrating the messaging device according to disclosure embodiment Block diagram.

Fig. 6 is the schematic diagram of the example of the traversing operation tree schematically showing application to be tested.

Fig. 7 is the another kind of exemplary construction illustrating the messaging device according to disclosure embodiment Block diagram.

Fig. 8 is the flow chart schematically showing the information processing method according to disclosure embodiment.

Fig. 9 shows and can be used to realize the messaging device according to disclosure embodiment and information A kind of structure diagram of the possible hardware configuration of processing method.

Detailed description of the invention

Hereinafter in connection with accompanying drawing, the one exemplary embodiment of the present invention is described.In order to clear and For the sake of Jian Ming, all features of actual embodiment are not the most described.But, it should Solve, must make a lot specific to embodiment during developing any this practical embodiments Determine, in order to realize the objectives of developer, such as, meet that relevant to system and business Restrictive conditions, and these restrictive conditions a bit may change along with the difference of embodiment. Additionally, it also should be appreciated that, although development is likely to be extremely complex and time-consuming, but to benefit For those skilled in the art of present disclosure, this development is only routine task.

Here, also need to explanation a bit, in order to avoid having obscured this because of unnecessary details Bright, illustrate only in the accompanying drawings with according to the closely-related apparatus structure of the solution of the present invention and/or Process step, and eliminate other details little with relation of the present invention.

Fig. 1 is a kind of example knot schematically showing the messaging device according to disclosure embodiment The block diagram of structure.

As it is shown in figure 1, include according to the messaging device 1 for mass-rent test of the disclosure: carry Take unit 10, for extracting the application related information relevant with application to be tested；Acquiring unit 20, For test resource information based on candidate mass-rent workman (also referred to as applying tester) and described should By relevant information, obtain and mating that described application to be tested matches from described candidate mass-rent workman Mass-rent workman；And recommendation unit 30, for the test-taking techniques according to described coupling mass-rent workman, Recommend to perform mass-rent workman to the publisher of described application to be tested from described coupling mass-rent workman, with Toilet is stated execution mass-rent workman and described application to be tested is carried out application test.

According to the disclosure, application to be tested can be the application used on a personal computer, it is also possible to It it is the application for the such as mobile terminal of smart mobile phone, panel computer.

The application related information of application to be tested includes the equipment requirements letter needed for application to be tested operation Breath and environmental requirement information.Generally, when testing application message publisher and wanting to look for mass-rent workman, It can set corresponding testing requirement, including device context parameter and environmental context parameter etc..If Standby context parameters includes: the requirement of perception API (application programming interfaces), sdk (software development Tool kit) release requirement and equipment configuration, environmental context parameter includes language requirement, geography Position and network type (such as use which kind of net in 2G, 3G, 4G mobile radio network Network).Such as, for mobile terminal, it is possible to use Android testing tool should be used for extracting to be tested answering Essential information, including release requirement and the language requirement of perception API, sdk.

Below by application to be tested be information processing of this disclosure as a example by the application of mobile terminal Equipment is described in detail.

According to the disclosure, application to be tested can be deployed in TaaS (Testing as a Service, Testing service) in platform.TaaS platform provides context environmental aware application, comes for mass-rent workman Download and register to register its own test equipment for carrying out mass-rent test information, And the information of test environment, these information can be special as the resource of mass-rent workman by TaaS platform Levy and be saved in data base.

The test resource that mass-rent workman is had includes its test facility information of equipment, crowd used Job contract environmental information of test environment residing for people etc..According to the disclosure, facility information is the most permissible It is device context, including the performance parameter of test equipment, the memorizer that such as test equipment is used Size, screen size, screen resolution, perception API configuration, sdk release requirement and equipment configuration Deng.

Such as TaaS platform registration all mass-rent workmans can as candidate mass-rent workman, So as the application phase of test resource information and application to be tested of based on these candidate mass-rent workmans registration Matching degree between the information of pass, filters out coupling mass-rent workman.

Fig. 2 shows the block diagram of a kind of exemplary construction of the acquiring unit in Fig. 1.

As in figure 2 it is shown, acquiring unit 20 includes: matching degree obtains subelement 201, is used for obtaining institute State the survey that the test resource information that candidate mass-rent workman had includes with described application related information Test resource matching degree between examination resource requirement information；And coupling application tester obtains subelement 202, exceed the candidate mass-rent workman of predetermined threshold as with described for obtaining test resource matching degree The coupling mass-rent workman that application to be tested matches.

An embodiment according to the disclosure, test resource requirement information may include that test equipment is wanted Ask information and test environment requirement information.

More specifically, the one that Fig. 3 shows the matching degree acquisition subelement 201 in Fig. 2 is exemplary The block diagram of structure.

Include as it is shown on figure 3, matching degree obtains subelement 201: facility information similarity calculation module 2011, for obtaining the facility information of the test equipment that candidate mass-rent workman is held, and calculate described Facility information similarity between facility information and described test equipment requirements information；Environmental information is similar Degree computing module 2012, for obtaining the environmental information of test environment residing for candidate mass-rent workman, and Calculate the environmental information similarity between described environmental information and described test environment requirement information；And Matching degree computing module 2013, for according to described facility information similarity and described environmental information phase Like degree, calculate the test resource matching degree of each candidate mass-rent workman and described application to be tested.

According to embodiment of the disclosure, facility information similarity calculation module 2011 can be by accessing The memorizer of TaaS platform obtains that each mass-rent workman fills in when registration, for performing mass-rent The facility information of the test equipment of test.Similarly, environmental information similarity calculation module 2012 can Each mass-rent workman fills in, use is obtained when registration with the memorizer by access TaaS platform Environmental information in the test environment performing mass-rent test.

Can based on perception API (sensor), the release requirement (sdk) of sdk, memorizer (memory), In screen size (screenSize), screen resolution (resolution) these parameters at least one The individual equipment requirements information defining application to be tested and for performing the test equipment of mass-rent test Shown in facility information device, such as equation below (1):

Device=(sensor, sdk, memory, screenSize, resolution) (1)

Equipment letter at the test equipment obtained for each mass-rent workman for performing mass-rent test Breath device_iAfterwards, facility information similarity calculation module 2011 can calculate each mass-rent workman's The facility information device of test equipment_iWith test equipment requirements information device_requireBetween equipment letter Breath similarity similarity (device_require,device_i).For example, it is possible to set by obtaining facility information and test The characteristic vector of the standby above-mentioned parameter requiring information to include, carries out normalizing to characteristic vector the most again Change, thus calculate facility information similarity.

Such as can use equation below (2), calculate facility information similarity.

$similarity({\mathrm{device}}_{require},{\mathrm{divice}}_i)=\frac{{\mathrm{device}}_{require}*{\mathrm{device}}_i}{\left|{\mathrm{device}}_{require}\right|\left|{\mathrm{device}}_i\right|}---\left(2\right)$

Wherein, the i-th mass-rent workman during i represents all candidate mass-rent workmans.

According to the disclosure, can be based on geographical position (locale), scene (scenario) and network At least one in type (network) these parameters defines the environmental requirement letter of application to be tested Cease and for performing the facility information env of the test environment of mass-rent test, such as equation below (3) Shown in:

Env=(locale, scenario, network) (3)

Environment letter at the test equipment obtained for each mass-rent workman for performing mass-rent test Breath env_iAfterwards, environmental information similarity calculation module 2012 can calculate residing for each mass-rent workman Environmental information env_iInformation env is required with test environment_requireBetween facility information similarity similarity(env_require,env_i).For example, it is possible to by obtaining in environmental information and test environment requirement information Including the characteristic vector of above-mentioned parameter, the most again characteristic vector is normalized, thus calculates ring Environment information similarity.

Such as can use equation below (4), computing environment information similarity.

$similarity({\mathrm{env}}_{require},{\mathrm{env}}_i)=\frac{{\mathrm{env}}_{require}*{\mathrm{env}}_i}{\left|{\mathrm{env}}_{require}\right|\left|{\mathrm{env}}_i\right|}---\left(4\right)$

Wherein, the i-th mass-rent workman during i represents all candidate mass-rent workmans.

It will be understood by those skilled in the art that in addition to using above-mentioned formula, it is also possible to use ability Territory other methods calculating similarity known calculate the facility information similarity according to the disclosure and ring Environment information similarity.

Obtaining facility information similarity by facility information similarity calculation module 2011 and passing through After environmental information similarity calculation module 2012 obtains environmental information similarity, matching degree calculates mould Block 2013, based on this facility information similarity and environmental information similarity, calculates each candidate's mass-rent work People and the test resource matching degree of described application to be tested.

According to the disclosure, can be by considering between facility information matching degree and environmental information matching degree Significance level, is weighted combination to calculate each by facility information similarity and environmental information similarity Candidate mass-rent workman and the test resource matching degree of described application to be tested.For example, it is possible to according to as follows Formula (5) calculates the test resource (resouce of each candidate mass-rent workman_i) to be tested with described Test resource (resource needed for application_requireTest resource matching degree between) matchDegree(resource_require,resouce_i)。

matchDegree(resource_require,resouce_i)=α similarity (device_require,device_i)+

(5)

(1-α)*similarity(env_require,env_i)

Wherein, α represents the weight that facility information is shared in test resource, and it is between 0 to 1 Numerical value, can be configured it by user as required；Or based on experience value or limited number of time examination Test and other similar fashion is configured.

Then, coupling mass-rent workman obtain subelement 202 can be based on matching degree computing module 2013 Each candidate mass-rent workman calculated and the test resource matching degree of described application to be tested, choose test The higher candidate mass-rent workman of resource matched degree is as being able to carry out applying the coupling mass-rent of test assignment Workman.Such as coupling mass-rent workman obtains subelement 202 and can choose its test resource matching degree and exceed The candidate mass-rent workman of predetermined threshold γ is as coupling mass-rent workman.According to the disclosure, predetermined threshold γ Arbitrarily can be arranged by user for the matching degree requirement of test resource based on application to be tested.

Test resource matching degree is less than to the candidate mass-rent workman of predetermined threshold, it is generally recognized that it is had Some test resources can not well complete thinking of application test, therefore, by coupling mass-rent workman Obtain subelement 202 to filter this out.

Return to Fig. 1, after obtaining coupling mass-rent workman, it is recommended that unit 30 can be according to coupling The test-taking techniques of mass-rent workman, recommends to perform to the publisher of application to be tested from coupling mass-rent workman Mass-rent workman, in order to perform mass-rent workman and described application to be tested is carried out application test.

Fig. 4 is the block diagram of a kind of exemplary construction schematically showing the recommendation unit in Fig. 1.

As shown in Figure 4, it is recommended that unit 30 includes: test-taking techniques score computation subunit 301, use In based on described coupling mass-rent workman measuring technology under each field tests and its perform history The accuracy of application test, calculates the test-taking techniques score of described coupling mass-rent workman；And recommend son Unit 302, for test-taking techniques score based on described coupling mass-rent workman, from described coupling mass-rent In workman, the publisher to described application to be tested recommends to perform mass-rent workman.

According to the disclosure, test-taking techniques score computation subunit 301 can based on coupling mass-rent workman with Toward performing to apply the history of test assignment, according to described coupling application tester under each field tests Measuring technology score and its perform historical usage test accuracy, calculate coupling mass-rent workman Test-taking techniques score.

For example, it is possible to publisher is for this mass-rent after performing to apply test assignment according to coupling mass-rent workman The evaluation score of workman, the score of the error log produced during performing this application test assignment And the score of test coverage calculates this coupling mass-rent workman in this application test assignment Comprehensive score, as the measuring technology score of this application test assignment of execution, and calculates this coupling mass-rent Workman performs the meansigma methods of the measuring technology score of each test assignment and applies tester as this coupling Measuring technology score.For example, it is possible to calculate the survey of each mass-rent workman according to equation below (6) Examination technical merit techScore.

$techScore=\frac{1}{n}\underset{i=1}{\overset{n}{\Σ}}{\mathrm{typeScore}}_i---\left(6\right)$

Wherein, n represents all application test assignments that this mass-rent workman performs on this TaaS platform Quantity, i represents the application test assignment that this mass-rent workman performs.

It will be understood by those skilled in the art that TaaS platform can perform mass-rent workman every time to answer With calculating the measuring technology score performing this application test assignment after test assignment based on above-mentioned parameter, And save it in data base, in order to obtain this measuring technology when required by access data base and obtain Point.

Additionally, according to the disclosure, test-taking techniques score computation subunit 301 can also be for test class Type (such as ui testing, functional test) obtains the measuring technology score of mass-rent workman respectively. Generally, the publisher of application test assignment can specify the test of application to be tested when issuing test assignment Type.Therefore, it is recommended that subelement, can be according to mass-rent workman test under specified test-types Technical merit, calculates the test-taking techniques score of this mass-rent workman, thus pushes away according to this test-taking techniques score Recommend the mass-rent workman of the test assignment performing application to be tested.

Test-taking techniques score computation subunit 301 can be for each coupling application tester, based on it Measuring technology score and the accuracy of its execution historical usage test, such as according to equation below (7) Calculate test-taking techniques score skillScore of this coupling application tester.

SkillScore=100* [historyRightRate*c+techScore* (1-c)] (7)

Wherein, historyRightRate is to represent that mass-rent workman, in the history test assignment completed, obtains The ratio of the correct test result obtained；It such as can obtain from the data base of TaaS platform.c For representing the parameter of the accuracy performing historical usage test significance level in test-taking techniques score, It arbitrarily can be arranged according to practical situation by user.

An embodiment according to the disclosure, it is recommended that subelement 302 can be according to coupling mass-rent workman's Test-taking techniques score is ranked up from high in the end, and the list of the coupling mass-rent workman after sequence is presented To the publisher of application to be tested, to realize the recommendation to publisher.The publisher of application to be tested can To recommend in mass-rent workman's list that subelement 302 presents, select mass-rent workman's conduct that it is required The final mass-rent workman performing application test.

After application test publisher have selected mass-rent workman, task can be decided through consultation with this mass-rent workman Concluded price.According to embodiment of the disclosure, can be according to the complexity of application test, mass-rent workman Test-taking techniques and mass-rent workman resource matched degree at least one to the issue of application to be tested Person and mass-rent workman recommend to perform the cost of application test, in order to both sides are according to this cost negotiations knock-down price Lattice.

Fig. 5 is the another kind of exemplary construction illustrating the messaging device according to disclosure embodiment Block diagram.

As it is shown in figure 5, except with the messaging device 1 of Fig. 1 be similarly included extraction unit 10, Outside acquiring unit 20 and recommendation unit 30, messaging device 2 also includes: cost accounting unit 40, for test complexity based on application to be tested, the test-taking techniques of described execution application tester And test resource matching degree, adjust the described cost performing application tester, in order to described publisher Based on this cost, this execution test application person is carried out described application to be tested with performing application tester Application test ultimate cost hold consultation.

An embodiment according to the disclosure, the operation number that can include according to application to be tested and Movable number determines the test complexity of application to be tested.

The test determining this application to be tested is described in detail referring to the application to be tested shown in Fig. 6 The concrete process of complexity.

As shown in Figure 6, in order to assess the test complexity of application to be tested, TaaS platform is to be measured Examination application automatically generates user interface (UI) traversal test script, it is hereby achieved that UI traversal Operation tree.In this sets, each node represents an operation (such as: clicking operation)；Same One layer, and have identical father operation node be positioned in the same activity of application to be tested.? In example shown in Fig. 6 (wherein op1-op7 represents operation 1-7 respectively), application to be tested has 3 Individual loose-leaf and 7 operation nodes.

It is then possible to the number of operation node and the number of loose-leaf according to application to be tested are counted Calculate the test complexity of application to be tested.Such as, equation below (8) is used to calculate to be tested answering Test complexity complexity.

Complexity=score (Num_operation)*θ+score(Num_activity)*(1-θ) (8)

Wherein, score (Num_operation) for based on operating the score that node quantity determines；score(Num_activity) it is The score determined based on loose-leaf number；θ is for operating node quantity for application complexity to be tested The weight of impact, it the most arbitrarily can be set by user.

Table 1 shows the quantity divided rank according to loose-leaf and running node and distribution score To calculate the example of test complexity.

Table 1

For example, it is assumed that θ is 0.3, then can be calculated Fig. 6 according to formula (8) based on table 1 The value of the test complexity of shown application to be tested is 42.5.

Thus, cost accounting unit 40 can be complicated according to the test of application to be tested as determined above Degree, the test-taking techniques of mass-rent workman, the test resource matching degree of mass-rent workman adjust execution, and this is to be measured The cost of the test assignment of examination application.It is somebody's turn to do it is for instance possible to use equation below (9) calculates execution The cost recommandCost of test assignment.

RecommendCost=complexity*base_complexity*k1+skill*base_skill*k2+

(9)

matchDegree*base_{resouceMatching}*k3

Wherein, base_complexity、base_skill、base_{resouceMatching}Represent test complexity, test-taking techniques respectively The basic cost of factor each with test resource matching degree；K1, k2, k3 represent each factor respectively Cost coefficient.

Such as execution application to be tested is obtained according to mode as above at cost accounting unit 40 Test assignment cost after, to be tested application publisher can be based on cost accounting unit 40 core The cost calculated is held consultation with mass-rent workman.If consulting successfully, then by TaaS platform, this is treated The test assignment of test application is distributed to mass-rent workman.

After mass-rent workman has performed application test assignment every time, can be according to the feelings of its execution test assignment Condition, reappraises its measuring technology score, and this mass-rent work being more newly stored in data base The measuring technology score of people.

Fig. 7 is the another kind of exemplary construction illustrating the messaging device according to disclosure embodiment Block diagram.

As it is shown in fig. 7, except with the messaging device 1 of Fig. 1 be similarly included extraction unit 10, Outside acquiring unit 20 and recommendation unit 30, messaging device 3 also includes: updating block 50, For described application to be tested being carried out according to described execution mass-rent workman the test result of application test, Assess the test-taking techniques score of described execution mass-rent workman, and utilize the test-taking techniques score pair of this assessment The current test-taking techniques score of this execution mass-rent workman is updated.

More specifically, described updating block according to the publisher of described application to be tested for described execution Application tester carries out the evaluation of test report, the described execution application tester that application test is obtained Quantity and/or described execution of the error log generated when carrying out application test apply tester to exist To described application to be tested operating and movable test coverage when carrying out application test, assess institute State the measuring technology performing application tester, and perform application test based on the assessment of this measuring technology is described The test-taking techniques of person.

Specifically, mass-rent workman is utilizing its own test resource to perform application test assignment After, the test report of a text formatting can be write, have recorded the mistake of the application to be tested that they find And their recommendation on improvement for application to be tested of being given；Meanwhile, mass-rent workman cutting test Figure preserves, and uploads on platform.The publisher of application to be tested can examine the test report of mass-rent workman Accuse, useful to determine whether publisher, and test report is evaluated, thus obtain application After test assignment, publisher is for the evaluation score of this mass-rent workman.

More specifically, can be by by test report participle, then calculating the weight of each test-types Judge which kind of test-types is this test report belong to.It is for instance possible to use equation below (10) is come Calculate the weight of each test-types.

${\mathrm{weight}}_{typei}=\frac{count\left({\mathrm{words}}_{typei}\right)}{\underset{i=1}{\overset{m}{\Σ}}count\left({\mathrm{words}}_{typei}\right)}---\left(10\right)$

Wherein, weight_{type i}Represent the weight of i-th kind of test-types, count (words_{type i}) represent Represent the number of times that the key word of i-th kind of test-types occurs in test report；M represents test-types Quantity.

After calculating each type of weight, take that to have the type of weight limit to be tested as this The test-types of application.Then publisher can be that its marking is as performing to be somebody's turn to do according to the content of test report The evaluation score of the test assignment of application to be tested, such as, 80 points.

Additionally, when mass-rent workman performs to apply test assignment, usual test log and the test of workman Operation can be recorded, such as, if the application to be tested that publisher uploads is to use TaaS platform to carry The extension sdk compiling of confession, then the sdk extended will record the test operation of test log and workman, And uploaded on platform.Therefore can obtain according to the error detection of error log calculating mass-rent workman It is allocated as error log score.

For example, it is possible to the number of the error log produced in test process according to mass-rent workman calculates Error log score.Generally, the error log number of generation is the most, then show the survey of this mass-rent workman Examination ability is the strongest.Number according to error log and different grade classification and distribution score obtain Error log score, such as can be in the way of employing be similar with table 1.

Further, it is also possible to test operation coverage rate based on mass-rent workman calculates Test coverage score.

Such as, if the application to be tested that publisher uploads is the extension sdk using TaaS platform to provide Compiling, then workman's operating process in test process can be expanded sdk institute record.Thus, can Test coverage score is calculated with the coverage rate of coverage rate based on loose-leaf and operation.Such as, may be used To use equation below (11) to calculate Test coverage score coverageScore.

CoverageScore=[coverageRate_activity*b+coverageRate_operation*(1-b)]*100 (11)

Wherein, coverageRate_activityRepresent the coverage rate of loose-leaf, coverageRate_operationTable Showing the coverage rate of operation, b represents that the coverage rate of loose-leaf is shared when calculating Test coverage score Weight, it the most arbitrarily can be arranged by user.

If the coverage rate of the coverage rate of activity and/or operation is the highest, then the technology of mass-rent workman is described Ability is strong, it is possible to more easily find the mistake of application to be tested, thus the measuring technology of mass-rent workman Score is the highest.

Finally, updating block 50 can such as utilize equation below (12) based on above-mentioned parameter Calculate this mass-rent workman measuring technology score when performing the test assignment of this application to be tested techScore。

TechScore=evaluationScore*x+errorLogScore*y+coverageScor e* (1-x-y) (12)

Wherein, evaluationScore represents the application publisher to be tested test to performing this application to be tested The evaluation score of the mass-rent workman of task, errorLogScore represents error log score, CoverageScore represents Test coverage score, and x represents that evaluation score is when calculating measuring technology score Shared weight, y represents the weight that error log score is shared when calculating measuring technology score；x The most arbitrarily can be arranged by user with the value of y；Or based on experience value or limited number of time Test and other similar fashion are configured.

According to embodiment of the disclosure, determine it is for be tested at appraisal report based on publisher In the case of which kind of test-types that application performs, can be by calculated measuring technology as implied above Score is as mass-rent workman measuring technology score under this kind of test-types, in order to recommendation unit with After mass-rent workman when recommending, based on to be measured to subsequently of the measuring technology score under this test-types Examination application publisher recommends mass-rent workman more accurately.

(mass-rent is also referred to as performed the mass-rent workman obtaining the test assignment performing this application to be tested Workman) new measuring technology score after, it is possible to use this measuring technology score is to this execution mass-rent work The current test-taking techniques score of people is updated, in order to can be more accurately in task distribution next time Carry out the recommendation of mass-rent workman.

Additionally, updating block is also based on performing to be obtained after mass-rent workman performs test assignment every time Test accuracy is more newly stored in history accuracy in data base, this mass-rent workman historyRightRate.For example, it is possible to calculate history test accuracy according to equation below (13).

$historyRightRate=\frac{testRightTimes}{totalTestTimes}---\left(13\right)$

Wherein, totalTestTimes represents the sum of the test assignment that this mass-rent workman performs, testRightTimes Represent this mass-rent workman number of times of the task that test result is correct in its test assignment performed.

Updating block 50 can update for this mass-rent workman according to the history test accuracy updated The history test accuracy being stored in data base, in order to recommendation unit carried out performing mass-rent work in next time The history test accuracy updated is used to calculate the test-taking techniques of coupling mass-rent workman during the recommendation of people Score.

Cost accounting unit 40 and updating block 50 is included although Fig. 5 and Fig. 7 respectively illustrates Messaging device 2 and 3, it will be recognized to those skilled in the art that according to the information of the disclosure Processing equipment can also include cost accounting unit 40 and updating block 50 simultaneously, and this information processing sets Cost accounting unit 40 and the operation of updating block 50 in Bei are similar to the above, do not repeat them here.

An embodiment according to the disclosure, additionally provides a kind of information processing method.Below in conjunction with figure The 8 a kind of exemplary process describing information processing method.

As shown in Figure 8, open according to the handling process 800 of the information processing method that embodiment of the disclosure Start from S810, then perform the process of S820.

In step S820, extract the application related information relevant with application to be tested.Such as, may be used The process of the extraction unit 10 to be described referring for example to Fig. 1-7 by execution realizes step S820, At this, the descriptions thereof are omitted.Then S830 is performed.

In step S830, apply the test resource information of tester and described application based on candidate Relevant information, applies tester from described candidate and obtains and mating that described application to be tested matches Application tester.For example, it is possible to by performing the acquiring unit 20 described referring for example to Fig. 1-7 Processing and realize step S830, at this, the descriptions thereof are omitted.Then S840 is performed.

In step 840, according to the test-taking techniques of described coupling application tester, should from described coupling Recommend to perform application tester with publisher to described application to be tested in tester, in order to described in hold Row application tester carries out application test to described application to be tested.For example, it is possible to by performing such as Process with reference to the acquiring unit 30 of Fig. 1-7 description realizes step S840, and at this, the descriptions thereof are omitted. Then S850 is performed.

Handling process 800 ends at S850.

At this it is to be appreciated that the candidate mentioned in said method step applies tester, coupling application to survey Examination person, execution application tester correspond respectively to the candidate in the above-described embodiment with reference to Fig. 1-7 description Mass-rent workman, coupling mass-rent workman and execution mass-rent workman.

According to embodiment of the disclosure, the obtaining step at S830 may include that the described candidate of acquisition The test money that the test resource information that application tester is had and described application related information include Test resource matching degree between source requirement information；And acquisition test resource matching degree exceedes predetermined threshold The candidate of value applies tester to mate application tester as match with described application to be tested.

According to the disclosure, test resource requires that information can include testing equipment requirements information and test wrapper Border requires information, and the step obtaining test resource matching degree may include that acquisition candidate applies tester The facility information of the test equipment held, and calculate described facility information and described test equipment requirements Facility information similarity between information；Obtaining candidate applies the environment of test environment residing for tester to believe Breath, and it is similar to calculate the environmental information between described environmental information and described test environment requirement information Degree；And according to described facility information similarity and described environmental information similarity, calculate each candidate Application tester and the test resource matching degree of described application to be tested.

According to embodiment of the disclosure, the recommendation step at S830 may include that based on described coupling The measuring technology score of application tester and its history performing historical usage test test accuracy, Calculate the test-taking techniques score of described coupling application tester；And based on described coupling application tester Test-taking techniques score, from described coupling application tester push away to the publisher of described application to be tested Recommend execution application tester.

Additionally, also include according to the information processing method of the present invention: survey based on described application to be tested Examination complexity, the test-taking techniques of described execution application tester and test resource matching degree, adjust institute State the cost performing application tester, in order to described publisher and execution application tester are based on this cost This execution test application person is carried out described application to be tested applies the ultimate cost of test to assist Business.An embodiment according to the disclosure, the test complexity of application to be tested is according to described to be tested The operation number that application includes and movable number determine.

Information processing method according to the disclosure can also include: performs application tester couple according to described Described application to be tested carries out the test result of application test, assesses the described survey performing application tester Examination skill, and utilize the test-taking techniques of this assessment that the current test-taking techniques of this execution application tester is obtained Divide and be updated.An embodiment according to the disclosure, can be according to the issue of described application to be tested Person performs application tester carry out the evaluation, described of the test report that application test is obtained for described Perform application tester carry out application test time generate error log quantity and/or described in hold Row operates and the test of activity in applying tester when carrying out application test to described application to be tested Coverage rate, assesses the described measuring technology performing application tester, and assesses based on this measuring technology The described test-taking techniques performing application tester.

Compared with prior art, messaging device and information processing method according to the disclosure have At least with next advantage: can test resource based on application tester and test-taking techniques to be measured The publisher of examination application recommends qualified execution to apply tester to apply application to be tested Test；Can be after performing application tester and completing test assignment, to this execution application tester's Task performance is evaluated, and applies tester's with store in more new database about this execution The information of test-taking techniques.

Additionally, embodiment of the disclosure and additionally provide a kind of electronic installation, this electronic installation is configured bag Include messaging device 1 as above.This electronic installation can be such as any in following equipment A kind of: mobile phone；Computer；Panel computer；And personal digital assistant etc..Correspondingly, this electronics Device can have beneficial effect and the advantage of messaging device as above.

Messaging device (the such as information shown in Fig. 1-7 that above-mentioned basis embodiment of the disclosure Processing equipment) in each component units, subelement etc. can pass through software, firmware, hardware or its The mode of combination in any configures.In the case of being realized by software or firmware, can be situated between from storage Matter or network are installed to the machine with specialized hardware structure and are constituted this software or the program of firmware, this machine Device is when being provided with various program, it is possible to perform the various functions of above-mentioned each component units, subelement.

Fig. 9 shows and can be used to realize according to the messaging device that embodiment of the disclosure and letter A kind of structure diagram of the hardware configuration of the possible processing equipment of breath processing method.

In fig .9, CPU (CPU) 901 is deposited according in read only memory (ROM) 902 The program stored up or the program execution being loaded into random access memory (RAM) 903 from storage part 908 Various process.In RAM903, perform various process etc. always according to needs storage as CPU 901 Deng time required data.CPU 901, ROM 902 and RAM 903 connect each other via bus 904 Connect.Input/output interface 905 is also connected to bus 904.

Components described below is also connected to input/output interface 905: importation 906 (includes keyboard, Mus Mark etc.), output part 907 (include display, such as cathode ray tube (CRT), liquid crystal display Device (LCD) etc., and speaker etc.), storage part 908 (including hard disk etc.), communications portion 909 (including NIC such as LAN card, modem etc.).Communications portion 909 is via network Such as the Internet performs communication process.As required, driver 910 can be connected to input/output Interface 905.Detachable media 911 such as disk, CD, magneto-optic disk, semiconductor memory etc. Can be installed in as required in driver 910 so that the computer program read out can basis Needs are installed to store in part 908.

In the case of realizing above-mentioned series of processes by software, can from network such as the Internet or from Storage medium such as detachable media 1411 installs the program constituting software.

It will be understood by those of skill in the art that this storage medium is not limited to shown in Fig. 9 wherein Have program stored therein and equipment distributes the detachable media 911 of the program that provides a user with separately. The example of detachable media 911 comprises disk (comprising floppy disk), CD (comprises compact disc read-only memory (CD-ROM) and digital universal disc (DVD)), magneto-optic disk (comprising mini-disk (MD) (registered trade mark)) And semiconductor memory.Or, storage medium can be to wrap in ROM 902, storage part 908 Hard disk contained etc., wherein computer program stored, and it is distributed to user together with the equipment comprising them.

Additionally, the disclosure also proposed the program product that a kind of storage has the instruction code of machine-readable Product.When above-mentioned instruction code is read by machine and performs, above-mentioned basis can be performed and embodiment of the disclosure Image processing method.Correspondingly, for carrying such as disk, CD, the magnetic of this program product The various storage mediums of CD, semiconductor memory etc. are also included within the disclosure of the disclosure.

In description to disclosure specific embodiment above, describe for a kind of embodiment and/or The feature illustrated can make in one or more other embodiment in same or similar mode With, combined with the feature in other embodiment, or substitute the feature in other embodiment.

Additionally, the method for the presently disclosed embodiments be not limited to specifications described in or accompanying drawing Shown in time sequencing perform, it is also possible to according to other time sequencing, concurrently or independently Perform.Therefore, the execution sequence of the method described in this specification technical scope the most of this disclosure structure Become to limit.

It should be further understood that each operating process according to the said method of the disclosure can also be to be stored in The mode of the computer executable program in various machine-readable storage mediums realizes.

And, the purpose of the disclosure can also be accomplished by: storage has above-mentioned execution The storage medium of program code is supplied to system or equipment directly or indirectly, and this system or set Computer or CPU (CPU) in Bei read and perform said procedure code.

Now, as long as this system or equipment have the function of execution program, the then embodiment party of the disclosure Formula is not limited to program, and this program can also be arbitrary form, such as, and target program, solution Release the program that device performs or the shell script etc. being supplied to operating system.

These machinable mediums above-mentioned include but not limited to: various memorizeies and memory element, Semiconductor equipment, disk cell such as light, magnetic and magneto-optic disk, and other is suitable to Jie of storage information Matter etc..

It addition, customer image processing terminal is by the corresponding website being connected on the Internet, and will depend on Download according to the computer program code of the disclosure and be installed in image processing terminal then perform this journey Sequence, it is also possible to realize the presently disclosed embodiments.

To sum up, according to embodiment of the disclosure, present disclose provides following scheme, but be not limited to This:

Scheme 1, a kind of messaging device, including:

Extraction unit, for extracting the application related information relevant with application to be tested；

Acquiring unit, for applying the test resource information of tester and described application phase based on candidate Pass information, from described candidate apply tester obtain match with described application to be tested mate answer Use tester；And

Recommendation unit, for the test-taking techniques according to described coupling application tester, should from described coupling Recommend to perform application tester with publisher to described application to be tested in tester, in order to described in hold Row application tester carries out application test to described application to be tested.

Scheme 2, messaging device as described in scheme 1, wherein, described application to be tested is for using Application in mobile terminal.

Scheme 3, messaging device as described in scheme 1 or 2, wherein, described acquiring unit bag Include:

Matching degree obtains subelement, for obtaining the test resource that described candidate applies tester to be had The test resource that information and described application related information include requires the test resource between information Degree of joining；And

Coupling application tester obtains subelement, is used for obtaining test resource matching degree and exceedes predetermined threshold Candidate apply tester as match with described application to be tested mate application tester.

Scheme 4, messaging device as described in scheme 3, wherein, described test resource requires letter Breath includes testing equipment requirements information and test environment requirement information, and described matching degree obtains subelement bag Include:

Facility information similarity calculation module, the test applying tester to be held for obtaining candidate sets Standby facility information, and calculate the equipment between described facility information and described test equipment requirements information Information similarity；

Environmental information similarity calculation module, applies test environment residing for tester for obtaining candidate Environmental information, and calculate the environmental information between described environmental information and described test environment requirement information Similarity；And

Matching degree computing module, for similar with described environmental information according to described facility information similarity Degree, calculates each candidate and applies the test resource matching degree of tester and described application to be tested.

Scheme 5, messaging device as according to any one of scheme 1-4, wherein, described recommendation Unit includes:

Test-taking techniques score computation subunit, should for performing history based on described coupling application tester By measuring technology score and the history test accuracy of test, calculate described coupling application tester's Test-taking techniques score；And

Recommend subelement, for test-taking techniques score based on described coupling application tester, from described Coupling application tester recommends to perform application tester to the publisher of described application to be tested.

Scheme 6, messaging device as according to any one of scheme 1-5, also include cost accounting Unit, for test complexity based on described application to be tested, the survey of described execution application tester Examination skill and test resource matching degree, adjust the described cost performing application tester, in order to described This execution test application person is carried out described to be measured with performing application tester based on this cost by publisher The ultimate cost of the application test of examination application is held consultation.

Scheme 7, messaging device as described in scheme 6, wherein, the survey of described application to be tested Operation number and movable number that examination complexity includes according to described application to be tested determine.

Scheme 8, messaging device as according to any one of scheme 1-7, also include: updates single Unit, for according to the described test performing and applying tester that described application to be tested carries out application test As a result, assess the described test-taking techniques performing application tester, and utilize the test-taking techniques pair of this assessment The current test-taking techniques score of this execution application tester is updated.

Scheme 9, messaging device as described in scheme 8, wherein, described updating block is according to institute The publisher stating application to be tested applies tester to carry out what application test was obtained for described execution The error log that the evaluation of test report, described execution application tester generate when carrying out application test Quantity and/or described perform application tester carry out application test time to described application to be tested Middle operation and movable test coverage, assess the described measuring technology performing application tester, and Based on the described test-taking techniques performing application tester of this measuring technology assessment.

Scheme 10, a kind of information processing method for mass-rent test, including:

Extract the application related information relevant with application to be tested；

The test resource information of tester and described application related information is applied, from described based on candidate Candidate apply in tester obtain match with described application to be tested mate apply tester；And

According to the test-taking techniques of described coupling application tester, to institute from described coupling application tester The publisher stating application to be tested recommends to perform application tester, in order to described execution application tester couple Described application to be tested carries out application test.

Scheme 11, information processing method as described in scheme 10, wherein, described application to be tested is Application for mobile terminal.

Scheme 12, information processing method as described in scheme 11 or 12, wherein, obtaining step bag Include:

Obtain the test resource information letter relevant to described application that described candidate applies tester to be had The test resource that breath includes requires the test resource matching degree between information；And

Acquisition test resource matching degree exceedes the candidate of predetermined threshold and applies tester to treat as with described The coupling application tester that test application matches.

Scheme 13, information processing method as described in scheme 12, wherein, described test resource requirement Information includes testing equipment requirements information and test environment requirement information, obtains test resource matching degree Step includes:

Obtain the facility information of the test equipment that candidate applies tester to be held, and calculate described equipment Facility information similarity between information and described test equipment requirements information；

Obtain candidate and apply the environmental information of test environment residing for tester, and calculate described environmental information And the environmental information similarity between described test environment requirement information；And

According to described facility information similarity and described environmental information similarity, calculate each candidate application Tester and the test resource matching degree of described application to be tested.

Scheme 14, information processing method as described in scheme 13, wherein, it is recommended that step includes:

Perform the measuring technology score of historical usage test based on described coupling application tester and go through History test accuracy, calculates the test-taking techniques score of described coupling application tester；And

Recommend subelement, for test-taking techniques score based on described coupling application tester, from described Coupling application tester recommends to perform application tester to the publisher of described application to be tested.

Scheme 15, information processing method as according to any one of scheme 10-14, also include based on institute State the test complexity of application to be tested, the test-taking techniques of described execution application tester and test money Source matching degree, adjust described perform application tester cost, in order to described publisher with perform application Tester carries out the application test of described application to be tested based on this cost to this execution test application person Ultimate cost hold consultation.

Scheme 16, information processing method as described in scheme 15, the survey of wherein said application to be tested Operation number and movable number that examination complexity includes according to described application to be tested determine.

Scheme 17, information processing method as described in scheme 16, also include: should according to described execution With tester described application to be tested carried out the test result of application test, assesses and described perform application The test-taking techniques of tester, and utilize current to this execution application tester of the test-taking techniques of this assessment Test-taking techniques score is updated.

Scheme 18, a kind of electronic equipment, set including managing according to the information according to any one of scheme 1-9 Standby, wherein electronic equipment is mobile phone, computer, panel computer or personal digital assistant.

Scheme 19, a kind of information processing that computer is used as according to any one of scheme 1-9 set Standby program.

Scheme 20, a kind of computer-readable recording medium, on it, storage has and can be performed by calculating equipment Computer program, this program makes computer be used as at the information as according to any one of scheme 1-9 Reason equipment.

Finally, in addition it is also necessary to explanation, in the disclosure, the relation of such as first and second or the like Term is used merely to separate an entity or operation with another entity or operating space, and differs Provisioning request or imply these entities or operation between exist any this reality relation or order. And, term " includes ", " comprising " or its any other variant are intended to the bag of nonexcludability Contain, so that include that the process of a series of key element, method, article or equipment not only include those Key element, but also include other key elements being not expressly set out, or also include for this process, The key element that method, article or equipment are intrinsic.In the case of there is no more restriction, by statement " bag Include one ... " key element that limits, it is not excluded that including the process of described key element, method, article Or equipment there is also other identical element.

Although the most the disclosure being had been disclosed by the description of the specific embodiment of the disclosure, However, it is to be understood that those skilled in the art can design in the spirit and scope of the appended claims Various amendment of this disclosure, improvement or equivalent.These amendments, improvement or equivalent also should In being to be considered as included in the scope that the disclosure is claimed.

Claims (10)

1. for a messaging device for mass-rent test, including:

Extraction unit, for extracting the application related information relevant with application to be tested；

Acquiring unit, for applying the test resource information of tester and described application phase based on candidate Pass information, from described candidate apply tester obtain match with described application to be tested mate answer Use tester；And

Recommendation unit, for the test-taking techniques according to described coupling application tester, should from described coupling Recommend to perform application tester with publisher to described application to be tested in tester, in order to described in hold Row application tester carries out application test to described application to be tested.

2. messaging device as claimed in claim 1, wherein, described application to be tested is for using Application in mobile terminal.

3. messaging device as claimed in claim 1 or 2, wherein, described acquiring unit bag Include:

Matching degree obtains subelement, for obtaining the test resource that described candidate applies tester to be had The test resource that information and described application related information include requires the test resource between information Degree of joining；And

Coupling application tester obtains subelement, is used for obtaining test resource matching degree and exceedes predetermined threshold Candidate apply tester as match with described application to be tested mate application tester.

4. messaging device as claimed in claim 3, wherein, described test resource requires letter Breath includes testing equipment requirements information and test environment requirement information, and described matching degree obtains subelement bag Include:

Facility information similarity calculation module, the test applying tester to be held for obtaining candidate sets Standby facility information, and calculate the equipment between described facility information and described test equipment requirements information Information similarity；

Environmental information similarity calculation module, applies test environment residing for tester for obtaining candidate Environmental information, and calculate the environmental information between described environmental information and described test environment requirement information Similarity；And

Matching degree computing module, for similar with described environmental information according to described facility information similarity Degree, calculates each candidate and applies the test resource matching degree of tester and described application to be tested.

5. the messaging device as according to any one of claim 1-4, wherein, described recommendation Unit includes:

Test-taking techniques score computation subunit, should for performing history based on described coupling application tester By measuring technology score and the history test accuracy of test, calculate described coupling application tester's Test-taking techniques score；And

Recommend subelement, for test-taking techniques score based on described coupling application tester, from described Coupling application tester recommends to perform application tester to the publisher of described application to be tested.

6. the messaging device as according to any one of claim 1-5, also includes cost accounting Unit, for test complexity based on described application to be tested, the survey of described execution application tester Examination skill and test resource matching degree, adjust the described cost performing application tester, in order to described This execution test application person is carried out described to be measured with performing application tester based on this cost by publisher The ultimate cost of the application test of examination application is held consultation.

7. messaging device as claimed in claim 6, wherein, the survey of described application to be tested Operation number and movable number that examination complexity includes according to described application to be tested determine.

8. the messaging device as according to any one of claim 1-7, also includes: update single Unit, for according to the described test performing and applying tester that described application to be tested carries out application test As a result, assess the described test-taking techniques performing application tester, and utilize the test-taking techniques pair of this assessment The current test-taking techniques score of this execution application tester is updated.

9. messaging device as claimed in claim 8, wherein, described updating block is according to institute The publisher stating application to be tested applies tester to carry out what application test was obtained for described execution The error log that the evaluation of test report, described execution application tester generate when carrying out application test Quantity and/or described perform application tester carry out application test time to described application to be tested Middle operation and movable test coverage, assess the described measuring technology performing application tester, and Based on the described test-taking techniques performing application tester of this measuring technology assessment.

10. for an information processing method for mass-rent test, including:

Extract the application related information relevant with application to be tested；

The test resource information of tester and described application related information is applied, from described based on candidate Candidate apply in tester obtain match with described application to be tested mate apply tester；And

According to the test-taking techniques of described coupling application tester, to institute from described coupling application tester The publisher stating application to be tested recommends to perform application tester, in order to described execution application tester couple Described application to be tested carries out application test.