The choosing method and device of a kind of project testing
Technical field
The application is related to field of computer technology, more particularly to the choosing method and device of a kind of project testing.
Background technology
A/B tests are a kind of emerging front page optimization methods, the purpose of A/B tests and be intended that by A and B two or more
Optional program is supplied to user to be tested, and judges which kind of is to be selected by the user behavior data provided in user's test process
Scheme more meets behavioural habits and the requirement of user, so as to reach the purpose of the webpage indexs such as increase conversion ratio, registration rate.
When carrying out A/B tests, it will usually which the program code of two or more optional programs of test is arranged at accordingly
Application program in, while, it is necessary to set in the application program or the trigger switch of pre-buried optional program (or A/B switch),
When user needs to use optional program, it is necessary to select it from above-mentioned setting or pre-buried trigger switch (or A/B switches)
In a trigger switch, perform corresponding optional program so as to trigger, now, terminal can record the triggering of each trigger switch
Number, the data such as access times of optional program are sent to server as feedback data.Server statistics simultaneously calculate difference and treated
The utilization rate of scheme, and the result that the maximum optional program of utilization rate is tested as A/B are selected, i.e., as final embodiment party
Case.
However, need the program code of different optional programs being all arranged in application program in A/B tests, moreover,
The trigger switch of preset or pre-buried optional program is needed, so that the data volume of application program is larger, moreover, not every
The program code of optional program is all useful to a certain user, so, will certainly waste the downloading flow of user, moreover, treating
The flexibility for selecting scheme to implement is poor.
The content of the invention
The purpose of the embodiment of the present application is to provide the choosing method and device of a kind of project testing, to solve to need difference
The program code of optional program is all arranged in application program, in addition, it is desirable to the trigger switch of preset or pre-buried optional program
Cause the data volume of application program larger, so as to waste the downloading flow of user, and the flexibility that optional program is implemented is poor
Problem.
In order to solve the above technical problems, what the embodiment of the present application was realized in:
A kind of choosing method for project testing that the embodiment of the present application provides, methods described include:
Obtain targeted customer's feature corresponding to the predetermined item for needing progress optional program utilization rate test;
The targeted customer of the predetermined item is tested according to targeted customer's Feature Selection;
The data of the different optional programs of the predetermined item are sent to terminal corresponding to the targeted customer;
Obtain terminal corresponding to the targeted customer and be directed to the data that the optional program is fed back, according to the feedback coefficient
According to the utilization rate for the different optional programs for determining the predetermined item.
Alternatively, the data of the different optional programs by the predetermined item are sent to corresponding to the targeted customer
Terminal, including:
According to the number of optional program, the targeted customer is divided into multiple packets;
The data of different optional programs are sent to terminal corresponding to the targeted customer of respective packets respectively.
Alternatively, the utilization rate of the different optional programs that the predetermined item is determined according to the feedback data, bag
Include:
When reaching predetermined statistical condition, the different optional programs of the predetermined item are counted according to the feedback data
Utilization rate;
Wherein, the predetermined statistical condition include it is following in one or more:Current time is away to targeted customer couple
The time interval that the terminal answered sends data reaches preset value, and the quantity of the feedback data received reaches preset value.
Alternatively, the utilization rate of the different optional programs that the predetermined item is determined according to the feedback data it
Afterwards, methods described also includes:
The optional program that utilization rate in the different optional programs is exceeded to predetermined threshold is defined as the predetermined item
Embodiment.
Alternatively, the targeted customer that the acquisition needs to carry out corresponding to the predetermined item of optional program utilization rate test is special
Sign, including:
Receive the test request for being used to test the different optional program utilization rates of the predetermined item that management terminal is sent;
Wherein, targeted customer's feature corresponding to the predetermined item is carried in the test request.
Alternatively, targeted customer's feature include it is following in one or more:Age of user, sex, liveness, throwing
Money situation, the information of user's concern, the information of collection.
Alternatively, the predetermined item is application program, and the optional program of the predetermined item is the application program
Increment dynamic is wrapped.
A kind of selecting device for project testing that the embodiment of the present application provides, described device include:
Target signature acquisition module, for obtaining corresponding to the predetermined item for needing to carry out optional program utilization rate test
Targeted customer's feature;
Targeted customer chooses module, and the target for testing the predetermined item according to targeted customer's Feature Selection is used
Family;
Data transmission blocks, for the data of the different optional programs of the predetermined item to be sent into the targeted customer
Corresponding terminal;
Utilization rate determining module, it is directed to what the optional program was fed back for obtaining terminal corresponding to the targeted customer
Data, the utilization rate of the different optional programs of the predetermined item is determined according to the feedback data.
Alternatively, the data transmission blocks, including:
Grouped element, for the number according to optional program, the targeted customer is divided into multiple packets;
Data transmission unit, the targeted customer for the data of different optional programs to be sent to respective packets respectively are corresponding
Terminal.
Alternatively, the utilization rate determining module, for when reaching predetermined statistical condition, according to the feedback data
Count the utilization rate of the different optional programs of the predetermined item;
Wherein, the predetermined statistical condition include it is following in one or more:Current time is away to targeted customer couple
The time interval that the terminal answered sends data reaches preset value, and the quantity of the feedback data received reaches preset value.
Alternatively, described device also includes:
Embodiment determining module, for utilization rate in the different optional programs to be exceeded to the optional program of predetermined threshold
It is defined as the embodiment of the predetermined item.
Alternatively, the target signature acquisition module, for receive management terminal transmission be used for test the scheduled item
The test request of purpose difference optional program utilization rate;Wherein, carried in the test request corresponding to the predetermined item
Targeted customer's feature.
Alternatively, targeted customer's feature include it is following in one or more:Age of user, sex, liveness, throwing
Money situation, the information of user's concern, the information of collection.
Alternatively, the predetermined item is application program, and the optional program of the predetermined item is the application program
Increment dynamic is wrapped.
The technical scheme provided from above the embodiment of the present application, the embodiment of the present application carry out optional program by needing
The targeted customer of targeted customer's Feature Selection test predetermined item corresponding to the predetermined item of utilization rate test, then, will be pre-
The data for determining the different optional programs of project are sent to terminal corresponding to targeted customer, are getting terminal corresponding to targeted customer
After the data fed back for optional program, the utilization rate of the different optional programs of predetermined item is determined according to the feedback data,
So, can be when carrying out utilization rate test to multiple optional programs, it is not necessary to which the program code of different optional programs is whole
It is arranged in corresponding application program, moreover, also without the trigger switch of preset or pre-buried optional program, but it is based on target
User characteristics determines targeted customer, and the data of different optional programs then are sent respectively into targeted customer again is tested, from
And the downloading flow of user can be saved, improve the flexibility that optional program is implemented.
Brief description of the drawings
, below will be to embodiment or existing in order to illustrate more clearly of the embodiment of the present application or technical scheme of the prior art
There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments described in application, for those of ordinary skill in the art, do not paying the premise of creative labor
Under, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is a kind of choosing method embodiment of project testing of the application;
Fig. 2 is a kind of display interface schematic diagram of utilization rate test of the application;
Fig. 3 is the choosing method embodiment of the application another kind project testing;
Fig. 4 is a kind of structural representation of the selecting system of project testing of the application;
Fig. 5 is a kind of selecting device embodiment of project testing of the application;
Fig. 6 is a kind of selected equipment embodiment of project testing of the application.
Embodiment
The embodiment of the present application provides a kind of choosing method and device of project testing.
In order that those skilled in the art more fully understand the technical scheme in the application, it is real below in conjunction with the application
The accompanying drawing in example is applied, the technical scheme in the embodiment of the present application is clearly and completely described, it is clear that described implementation
Example only some embodiments of the present application, rather than whole embodiments.It is common based on the embodiment in the application, this area
The every other embodiment that technical staff is obtained under the premise of creative work is not made, it should all belong to the application protection
Scope.
Embodiment one
As shown in figure 1, the embodiment of the present application provides a kind of choosing method of project testing, the executive agent of this method can be with
For server or terminal, wherein, terminal can such as personal computer, the present embodiment illustrates by taking server as an example.The party
Method can apply to A/B tests (i.e. A/BTest) etc., and this method specifically may comprise steps of:
In step S101, the targeted customer for needing to carry out corresponding to the predetermined item of optional program utilization rate test is obtained
Feature.
Wherein, the test that utilization rate test can be user to the service condition of some or multiple schemes, for example, in the presence of
2 schemes, i.e. scheme 1 and scheme 2, user are 100 using the total degree of above-mentioned 2 schemes, wherein, the number of operational version 1
For 68, the number of operational version 2 is 32, then the utilization rate of scheme 1 is 68%, and the utilization rate of scheme 2 is 32%.Predetermined item can
To be any project, for example, the project of the style sheet of some webpage or the project for redirecting mode of some page etc..Target is used
Family feature can be user characteristics corresponding with predetermined item, and such as age is -40 years old 20 years old and/or sex is man.
In force, the software elements such as multiple webpages, button and/or link are frequently included in application program, these elements
Design can often include it is a variety of, if button can be suspended with that in any webpage of application program, can also be arranged at certain
Inside one webpage, or, the displaying pattern of button can be circular or rectangle, or, can be such as above-mentioned webpage
Different style sheets etc..Moreover, the design for being not only these elements can be including a variety of, relevant with above-mentioned element is some
The design of form or metamorphosis can also be including a variety of, for example, as some webpage jumps to the side of redirecting of next webpage
Formula (it is such as pivoted redirect, the formula of flying into redirects or venetian blind type conversion) etc..Whether the design of element or relevant with element
Some forms or metamorphosis, for wherein any one design object (i.e. predetermined item), a variety of set can be designed for it
Meter scheme (i.e. optional program).For a user, different designs attracts it degree different, for example, certain is pre-
Determining project includes two kinds of optional programs, i.e. option A and option b, option A has advantages below for a user:Triggering is simple,
It is easy to use, simplify user's operation, color is moderate and new style etc., and option b pattern keep constant, predetermined trigger mode and
Beautiful in colour, because user is when using optional program, some users may focus on convenience and pattern of scheme implementation etc.,
And other users may focus on scheme implementation and the pattern uniformity of the scheme of other projects in application program, and color
Deng, so, two schemes can exist uses user accordingly.In actual applications, often only needed for same predetermined item
A kind of preferably scheme is arranged in application program, and thus needs to select multiple optional programs, therefore, can be with
Utilization rate test is carried out to the different optional programs of same predetermined item, can using the higher optional program of wherein utilization rate as
The application scheme of the predetermined item is arranged in corresponding application program for users to use.
The application journey that exploitation is used to test the utilization rate of different optional programs in predetermined item can be pre-designed
Sequence (in order to can be described as test program with application program differentiation mentioned above, this application program).The test program can be pacified
Loaded in server, as shown in Fig. 2 it is special to include test event button, targeted customer in the display interface of the test program
Sign button, start to test button, pause test button, stop test button and the display interface of test result etc..When needs pair
When certain project (i.e. predetermined item) carries out utilization rate test, it may be determined that user needs the condition met, i.e. targeted customer's feature,
If the age is -50 years old 20 years old, or, liveness is more than predetermined value, and sex is female etc..It is then possible to click in test program
Test event button, test program can eject input frame, the project label of predetermined item can be inputted in the input frame,
For example, project name, bullets etc..After the completion of input, the determination button in pop-up box can be clicked on, test program can obtain
Take the project label of predetermined item.Targeted customer's feature key in test program can also be clicked on, test program can eject
Input frame, the information of targeted customer's feature can be inputted in the input frame.After the completion of input, it can click in pop-up box really
Determine button, test program can obtain targeted customer's feature.After the completion of aforesaid operations, it can click on and start to test button, now,
Test program can determine that being provided to user carries out targeted customer's feature corresponding to the predetermined item of utilization rate test.
In addition to aforesaid way, the project label of predetermined item and targeted customer's feature can also be established corresponding relation,
And the corresponding relation can be stored in the server, it can specifically pass through the test event button and mesh in above-mentioned test program
Mark user characteristics button and upload corresponding information, so as to establish above-mentioned corresponding relation.Above-mentioned corresponding relation, can be with the shape of form
Formula stores, as shown in table 1.
Table 1
When needing to test project A, the project label of test event key-press input predetermined item, example can be passed through
Such as, project B, after the completion of input, the determination button in pop-up box can be clicked on, starts to test button it is then possible to click on, this
When, server can obtain the project label of user's input, i.e. project B, server can be in corresponding pass as shown in Table 1 above
Targeted customer's feature corresponding to project B is searched in system, i.e. registration time length is no more than scheduled duration threshold value (such as 24 hours), this
Sample, server can get the targeted customer's feature for needing to carry out corresponding to the predetermined item of optional program utilization rate test.
In step s 102, the targeted customer of above-mentioned predetermined item is tested according to above-mentioned targeted customer's Feature Selection.
In force, in order to test disparity items, the user that can collect different user by all means is special
Sign, for example, the personal information filled in during user's registration, by way of purchase from user at purchase personal information or by having
Information that the modes such as prize question and answer obtain at user etc., after getting above- mentioned information, can be stored it in server, be serviced
The user characteristics stored in device is more, and the content of user characteristics is abundanter, then the result tested is more accurate.User can be identified
Storage corresponding with user characteristics is in the server.Wherein, user's mark can store in table form with user characteristics, such as table
Shown in 2.
Table 2
In force, after server gets targeted customer's feature, targeted customer's feature can be based on from the above-mentioned institute of table 2
The user characteristics to match with targeted customer's feature is searched in the corresponding relation shown, for example, targeted customer's feature includes the age
For -35 years old 20 years old, then server can search user characteristics of the age at -35 years old 20 years old from the corresponding relation of above-mentioned table 2, i.e.,
Age is 20 years old and the age is 32 years old, and the user characteristics found can be chosen for testing the targeted customer of predetermined item.Can
To further determine that user corresponding to the user characteristics found identifies by above-mentioned table 2, i.e. the age is 20 years old corresponding user 1,
Age is 32 years old corresponding user 2, then user 1 and user 2 are targeted customer.
In step s 103, the data of the different optional programs of above-mentioned predetermined item are sent into above-mentioned targeted customer to correspond to
Terminal.
Wherein, the data of the different optional programs of predetermined item can be sent in the form of packet, and the packet can be with
It is that each optional program is corresponding with a packet, the packet can be added by the application program belonging to predetermined item
Carrying row.The packet can be an AKU independently of the test bag of application program or the application program, this
Apply in embodiment for the ease of the test to predetermined item, the packet is a test bag independently of application program.
In force, can be in several ways by optional program after server determines user's mark of targeted customer
Data are sent to targeted customer, for example, the data of any optional program therein can be sent into all targeted customers
Corresponding terminal, after terminal corresponding to targeted customer receives the data, the data can be run, and it is corresponding to server feedback
Data, when data transmission after reach scheduled duration when, stop the test to the optional program.Then, then successively will be remaining
The data of each optional program are sent to terminal corresponding to all targeted customers, by processing procedure same as described above,
Server completes the transmission and test to the data of each optional program.
Except aforesaid way, it can also realize by other means, for example, server determines user's mark of targeted customer
Afterwards, user can be identified and multiple packets is divided into according to its corresponding user characteristics, can be by the user of each packet
The corresponding optional program of mark, for example, predetermined item includes 2 optional programs, it can mark and be and option b, it is determined that
Targeted customer user mark include 1000, then it can be divided into 2 packets according to corresponding user characteristics, can
So that labeled as packet 1 and packet 2, each packet includes 500 user's marks.It is then possible to the data of option A are sent to
The data of option b, can be sent to each in packet 2 by the terminal of targeted customer corresponding to each user mark in packet 1
The terminal of targeted customer corresponding to individual user's mark.
In step S104, obtain terminal corresponding to above-mentioned targeted customer and be directed to the data that above-mentioned optional program is fed back,
The utilization rate of the different optional programs of above-mentioned predetermined item is determined according to the feedback data.
In force, based on the example in above-mentioned steps S103, in the case of optional program is sent successively, targeted customer
After corresponding terminal receives the data of transmission, it can import in the application program installed in terminal, after the completion of importing, Ke Yiqi
The application program is moved, targeted customer can use corresponding optional program by application program, be treated whenever targeted customer triggers this
When selecting scheme, terminal can be recorded using information such as the times of the optional program, and can send it to server, server
The information received can be stored.When reaching scheduled duration after data transmission, server can count making for the optional program
With number, the display number for triggering webpage where the optional program execution mechanism, application program the number of starts etc., then, meter
Calculate the utilization rate of the optional program.Then, then successively the data of each remaining optional program are sent to all targets
Terminal corresponding to user, by said process, the utilization rate of every kind of optional program can be calculated in server.
In the case of packet transmission optional program, when reaching scheduled duration after data transmission, server can count
The display number of webpages where the access times of various optional programs, the various optional program execution mechanisms of triggering, application program
Number of starts etc., then, calculate the utilization rate of every kind of optional program.
By the comparison of the utilization rate to different optional programs, an optional program can be therefrom chosen (for example, utilization rate
Maximum optional program etc.) actual application scheme as predetermined item, the optional program of selection can be set to arrive and apply journey
In the updated data package of sequence.The data of the optional program can be loaded into when application program is updated in application program,
So, user's can carries out data interaction using the application program of the optional program with server.
The embodiment of the present application provides a kind of choosing method of project testing, by needing to carry out optional program utilization rate test
Predetermined item corresponding to targeted customer's Feature Selection test predetermined item targeted customer, then, by predetermined item not
Data with optional program are sent to terminal corresponding to targeted customer, and side to be selected is directed to getting terminal corresponding to targeted customer
After the data that case is fed back, the utilization rate of the different optional programs of predetermined item, so, Ke Yi are determined according to the feedback data
When carrying out utilization rate test to multiple optional programs, it is not necessary to be all arranged at the program code of different optional programs accordingly
In application program, moreover, also without the trigger switch of preset or pre-buried optional program, but determined based on targeted customer's feature
Targeted customer, the data of different optional programs are then sent respectively to targeted customer again and tested, so as to save use
The downloading flow at family, improve the flexibility that optional program is implemented.
Embodiment two
As shown in figure 3, the embodiment of the present application provides a kind of choosing method of project testing, the executive agent of this method can be with
For server or terminal, wherein, terminal can such as personal computer, the present embodiment illustrates by taking server as an example.
A kind of selecting system of project testing is provided in the embodiment of the present application, as shown in figure 4, the selection system of the project testing
Management terminal, server and the terminal of targeted customer can be included in system, wherein, management terminal can be used for performing server
The equipment that is controlled of operation, specific such as mobile phone, tablet personal computer or personal computer.The project that the embodiment of the present application provides
The choosing method of test can apply to A/B tests (i.e. A/BTest) etc., and this method specifically may comprise steps of:
In step S301, the different optional program utilization rates for being used to test predetermined item that management terminal is sent are received
Test request;Wherein, targeted customer's feature corresponding to predetermined item is carried in the test request.
In force, a variety of different optional programs can be included for predetermined item, such as 2 kinds of optional programs, 3 kinds it is to be selected
Scheme or 4 kinds of optional programs etc., different optional programs has corresponding merits and demerits.For tester or exploit person
For member, it is not easy to judge that any optional program more meets the use habit of user, thus need to provide optional program
Tested to user, to determine the embodiment of predetermined item.For different optional programs, corresponding data can be set
Bury a little, you can statistics codes are set with the key point in application program, service conversion, independent ID in statistics codes can be with
Ensuring the data of collection will not repeat (clicking rate for such as buying button).It can be a little one or more that the data, which are buried,
It is individual, such as 2 or 3.
Developer can be based on offer multiple optional programs and corresponding data bury a little, write each optional program
Base of program code, the program code of corresponding experiment version can be created based on base of program code, it is then possible to according to pre-
Determine the test code that business demand corresponding to project creates corresponding optional program, can be by the test code of different optional programs
It is packaged into corresponding packet.The packet can be specifically that dynamic is wrapped, and can be supplied to the packet tester to carry out
Test, specifically, as shown in Fig. 2 the project label of predetermined item can be uploaded by the test program installed in management terminal
With predetermined item corresponding to targeted customer's feature, complete aforesaid operations after, can click on start test button, management terminal obtain
Targeted customer's feature corresponding to the project label and predetermined item that tester uploads, can be based on above- mentioned information generation test please
Ask, and the test request can be sent to server, now, server can receive the predetermined item of management terminal transmission
Different optional programs test request.
In step s 302, the targeted customer of above-mentioned predetermined item is tested according to above-mentioned targeted customer's Feature Selection.
Wherein, targeted customer's feature include it is following in one or more:Age of user, sex, liveness, investment feelings
Condition, the information of user's concern, the information of collection.
Above-mentioned steps S302 specific processing may refer to the related content of step S102 in above-described embodiment one, herein not
Repeat again.
In step S303, according to the number of optional program, above-mentioned targeted customer is divided into multiple packets.
In force, in order that the targeted customer that each optional program must be tested can be evenly distributed to it is corresponding to be selected
Scheme, targeted customer can be divided into multiple packets (i.e. crowd divides bucket), be less than 30 days for example, targeted customer is registration time length
New user, if optional program includes 2, the quantity of targeted customer is 320, then targeted customer can be divided into two
Packet, each packet include 160 targeted customers.In addition, if targeted customer's feature of targeted customer is including two or more
Mutually contradictory targeted customer's feature, then can be according to the number of optional program, by mutually contradictory targeted customer's feature
Targeted customer corresponding to each targeted customer's feature is divided into multiple packets, then, then the packet by different target user characteristics
Merge, obtain the multiple packets to match with the number of optional program, for example, targeted customer included liveness more than 30 days
User and registration time length be less than the new user of 30 days, if optional program includes 2, the quantity of targeted customer is 400, its
In, the quantity of user of the liveness more than 30 days is 300, and the quantity of new user of the registration time length less than 30 days is 100, then can be with
300 users of the liveness more than 30 days are divided into 2 groups, each packet includes 150 targeted customers, can be by 100
Registration time length was divided into 2 groups less than the new user of 30 days, and each packet includes 50 targeted customers, it is then possible to by difference
The packet of targeted customer's feature merges, i.e. 150+50, and after being merged a packet includes 150 liveness more than 30
It user and 50 new users, another packet is identical with the packet, so can be obtained by two packets, and each divides
Group composition it is identical, the result obtained in the optional program of subsequent contrast's predetermined item has preferable accuracy, avoid by
It is different in the constituent of each packet so that the accuracy and reliability of the result subsequently obtained are poor.If targeted customer
Targeted customer's feature include three or more mutually contradictory targeted customer's features, then can be based on above-mentioned related content at
Reason, will not be repeated here.
In step s 304, the data of different optional programs are sent to corresponding to the targeted customer of respective packets eventually respectively
End.
In force, predetermined item can be application program, and the optional program of predetermined item can be the increasing of application program
Amount dynamic is wrapped, and so, the data of optional program can realize that increment dynamic mainly may be used in wrapping by way of increment dynamic is wrapped
With including herein below:Dynamic.dex, resource.diff and META-INFO, wherein, dynamic.dex is used to test
Program code logic, resource.diff is used for experimental arrangement code application resource, such as drawable, layout or string
Deng signing messages of the META-INFO for representing increment dynamic bag.Be provided with server for data push and pull
Mechanism, i.e. Sync mechanism, after targeted customer is by predetermined account login service device, Sync mechanism is triggered, and generation is up to ask
Ask, server obtains the relevant information for the packet for needing to send based on the upstream request, wherein version number, application can be included
The version number of program, the download address of packet, the check code (such as MD5 values) etc. of packet.It may determine that above-mentioned each data
Whether bag is in application state, if being in application state, Sync mechanism quilts are rolled back to by currently processed by rollback mechanism
Processing during triggering, if being not in application state, it may determine that whether packet is empty, if sky, then judges application
Whether the version number of program is the version number initialized, if sky, then judges whether the version number of application program uses with target
The version number for the application program installed in the terminal at family is consistent, if the version number of application program is not the version number of initialization,
Or judge application program version number and terminal in the version number of application program installed it is inconsistent, then will can currently grasp
It is transferred to processing when Sync mechanism is triggered.If the version number of application program is the version number of initialization, and is judged
The version number of application program of the version number of application program with being installed in terminal is consistent, then judges whether above-mentioned packet is sky,
If sky, it is determined that whether the packet is full dose data, if the packet is increment, dynamic is wrapped, and will can currently be grasped
Processing when Sync mechanism is triggered is transferred to, if the packet is full dose data, may determine that corresponding business is
No processing, if handled, current operation can be transferred to processing when Sync mechanism is triggered, it is such as untreated, then
It may be inserted into data base access download state.If above-mentioned packet is not sky, judge whether dynamic version strategy is correct, such as
Fruit is correct, then judges whether flowing water version is correct, if correctly, whether judgement currently has packet download, if it is not,
Data base access download state is may be inserted into, if there is currently the packet downloaded, judges that current delta dynamic is wrapped
Version number whether newly in the packet version number of download, if it is, the packet that pause is downloaded, may be inserted into database makes
Obtain current delta dynamic bag and enter download state.So, above-mentioned processing mode is passed through, you can realize the download of increment dynamic bag.
In addition, the processing based on above-mentioned steps S303, can wrap the increment dynamic of optional program according to its group result
Terminal corresponding to the targeted customer of respective packets is sent to, for example, the example based on above-mentioned steps S303, each packet includes
150 users of the liveness more than 30 days and 50 new users, 2 optional programs, i.e. option A and option b then can be by schemes
A increment dynamic bag is sent to terminal corresponding to 150 users of the liveness more than 30 days and 50 new terminals corresponding to user,
It is sent to terminal corresponding to remaining user of 150 liveness more than 30 days likewise, the increment dynamic of option b is wrapped and remains
The new terminal corresponding to user of remaining 50.
It should be noted that predetermined item can be not only application program, can also be for a certain business demand
The project of formulation, such as project of the project of webpage pattern or button form, the embodiment of the present application are not limited predetermined item.
In step S305, obtain terminal corresponding to above-mentioned targeted customer and be directed to the data that above-mentioned optional program is fed back.
In force, after the terminal of targeted customer receives the increment dynamic bag of server transmission, the increment can be loaded
Dynamic is wrapped.It is provided with data in wrapping due to increment dynamic to bury a little, when user, which triggers the data, to be buried, terminal can gather accordingly
Data, such as trigger data buries a displaying number for a webpage where number a little, the access times of application program, data are buried,
And server can be sent to using the data collected as feedback data, server can receive and store the feedback data.
For example, the example based on above-mentioned steps S304, the increment dynamic bag of option A is sent to a new terminal corresponding to user, and this is new
The terminal of user can gather corresponding data and send after the data in detecting that the new user triggers increment dynamic bag are buried a little
To server.
In step S306, when reaching predetermined statistical condition, above-mentioned predetermined item is counted according to above-mentioned feedback data
Different optional programs utilization rate.
Wherein, predetermined statistical condition include it is following in one or more:Between the time that current time is sent away from data
Every reaching preset value, and the quantity of the feedback data received reaches preset value.The preset value that time interval reaches specifically can be such as 7
It or 10 days etc., the preset value that the quantity of feedback data reaches specifically can such as 10GB or 100GB.In addition, statistical condition is also
It can be statistics request that the management terminal received is sent etc..
In force, by taking the preset value that time interval reaches as an example, if current time away from increment dynamic bag send when
Between interval reach 7 days, then obtain the feedback data of the different optional programs of predetermined item, it is clear data can be carried out to feedback data
Wash, interference data and hash are removed, it is then possible to the parameters data in feedback data be extracted, as data bury an institute
Number a little etc. is buried in the displaying number and trigger data of webpage, the use of optional program can be calculated by above-mentioned data
Rate.For example, option A:It is 1000 that data, which bury a displaying number for place webpage, and the number that trigger data buries a little is 200, option b:
It is 1200 that data, which bury a displaying number for place webpage, and the number that trigger data buries a little is 600, then the utilization rate of option A is
20%, the utilization rate of option b is 50%.
In step S307, by utilization rate in above-mentioned different optional programs exceed predetermined threshold optional program be defined as on
The embodiment for stating predetermined item.
Wherein, predetermined threshold can determine according to actual conditions, specific such as 20%, 30% or 50%.Embodiment can
Think the scheme determined by the selection to multiple optional programs in predetermined item, embodiment can be as predetermined item
Unique formal scheme.
In force, the example based on above-mentioned steps S306, if predetermined threshold is 20%, in option A and option b,
The only utilization rate of option b is more than 20%, then the embodiment that option b can be arranged to above-mentioned predetermined item, it is then possible to
The program code of option b is arranged in the packet of application program updating, so, journey is applied when the terminal of user receives this
After the packet of sequence upgrading, the program code of option b can be set into application program, now, each user will make
Use option b.
The embodiment of the present application provides a kind of choosing method of project testing, by needing to carry out optional program utilization rate test
Predetermined item corresponding to targeted customer's Feature Selection test predetermined item targeted customer, then, by predetermined item not
Data with optional program are sent to terminal corresponding to targeted customer, and side to be selected is directed to getting terminal corresponding to targeted customer
After the data that case is fed back, the utilization rate of the different optional programs of predetermined item, so, Ke Yi are determined according to the feedback data
When carrying out utilization rate test to multiple optional programs, it is not necessary to be all arranged at the program code of different optional programs accordingly
In application program, moreover, also without the trigger switch of preset or pre-buried optional program, but determined based on targeted customer's feature
Targeted customer, the data of different optional programs are then sent respectively to targeted customer again and tested, so as to save use
The downloading flow at family, improve the flexibility that optional program is implemented.
Embodiment three
The choosing method of the project testing provided above for the embodiment of the present application, based on same thinking, the application is implemented
Example also provides a kind of selecting device of project testing, as shown in Figure 5.
The selecting device of the project testing includes:Target signature acquisition module 501, targeted customer choose module 502, number
According to sending module 503 and utilization rate determining module 504, wherein:
Target signature acquisition module 501, need the predetermined item institute of progress optional program utilization rate test right for obtaining
The targeted customer's feature answered;
Targeted customer chooses module 502, for testing the mesh of the predetermined item according to targeted customer's Feature Selection
Mark user;
Data transmission blocks 503, for the data of the different optional programs of the predetermined item to be sent into the target
Terminal corresponding to user;
Utilization rate determining module 504, it is anti-for optional program institute for obtaining terminal corresponding to the targeted customer
The data of feedback, the utilization rate of the different optional programs of the predetermined item is determined according to the feedback data.
In the embodiment of the present application, the data transmission blocks 503, including:
Grouped element, for the number according to optional program, the targeted customer is divided into multiple packets;
Data transmission unit, the targeted customer for the data of different optional programs to be sent to respective packets respectively are corresponding
Terminal.
In the embodiment of the present application, the utilization rate determining module 504, for when reaching predetermined statistical condition, according to
The feedback data counts the utilization rate of the different optional programs of the predetermined item;
Wherein, the predetermined statistical condition include it is following in one or more:Current time is away to targeted customer couple
The time interval that the terminal answered sends data reaches preset value, and the quantity of the feedback data received reaches preset value.
In the embodiment of the present application, described device also includes:
Embodiment determining module, for utilization rate in the different optional programs to be exceeded to the optional program of predetermined threshold
It is defined as the embodiment of the predetermined item.
In the embodiment of the present application, the target signature acquisition module 501, for receive management terminal transmission be used for test
The test request of the different optional program utilization rates of the predetermined item;Wherein, carried in the test request described predetermined
Targeted customer's feature corresponding to project.
In the embodiment of the present application, targeted customer's feature include it is following in one or more:Age of user, sex,
Liveness, investment situation, the information of user's concern, the information of collection.
In the embodiment of the present application, the predetermined item is application program, and the optional program of the predetermined item is answered to be described
Wrapped with the increment dynamic of program.
The embodiment of the present application provides a kind of selecting device of project testing, by needing to carry out optional program utilization rate test
Predetermined item corresponding to targeted customer's Feature Selection test predetermined item targeted customer, then, by predetermined item not
Data with optional program are sent to terminal corresponding to targeted customer, and side to be selected is directed to getting terminal corresponding to targeted customer
After the data that case is fed back, the utilization rate of the different optional programs of predetermined item, so, Ke Yi are determined according to the feedback data
When carrying out utilization rate test to multiple optional programs, it is not necessary to be all arranged at the program code of different optional programs accordingly
In application program, moreover, also without the trigger switch of preset or pre-buried optional program, but determined based on targeted customer's feature
Targeted customer, the data of different optional programs are then sent respectively to targeted customer again and tested, so as to save use
The downloading flow at family, improve the flexibility that optional program is implemented.
Example IV
The selecting device of the project testing provided above for the embodiment of the present application, based on same thinking, the application is implemented
Example also provides a kind of selected equipment of project testing, as shown in Figure 6.
The selected equipment of the project testing can be the server that above-described embodiment provides.
The selected equipment of project testing can produce bigger difference because configuration or performance are different, can include one or
More than one processor 601 and memory 602, one or more storages can be stored with memory 602 and apply journey
Sequence or data.Wherein, memory 602 can be of short duration storage or persistently storage.The application program for being stored in memory 602 can be with
Including one or more modules (diagram is not shown), each module can include to one in the selected equipment of project testing
Family computer executable instruction.Further, processor 601 could be arranged to communicate with memory 602, in project testing
Selected equipment on perform memory 602 in series of computation machine executable instruction.The selected equipment of project testing can be with
Including one or more power supplys 603, one or more wired or wireless network interfaces 604, one or more
Input/output interface 605, one or more keyboards 606.
Specifically in the present embodiment, the selected equipment of project testing includes memory, and one or more
Program, one of them or more than one program storage is in memory, and one or more than one program can include one
Individual or more than one module, and each module can include can perform the series of computation machine in the selected equipment of project testing
Instruction, and it is configured to that either more than one computing device this or more than one program bag contain and be used to carry out by one
Following computer executable instructions:
Obtain targeted customer's feature corresponding to the predetermined item for needing progress optional program utilization rate test;
The targeted customer of the predetermined item is tested according to targeted customer's Feature Selection;
The data of the different optional programs of the predetermined item are sent to terminal corresponding to the targeted customer;
Obtain terminal corresponding to the targeted customer and be directed to the data that the optional program is fed back, according to the feedback coefficient
According to the utilization rate for the different optional programs for determining the predetermined item.
Alternatively, the executable instruction when executed, can also make the processor:
According to the number of optional program, the targeted customer is divided into multiple packets;
The data of different optional programs are sent to terminal corresponding to the targeted customer of respective packets respectively.
Alternatively, the executable instruction when executed, can also make the processor:
When reaching predetermined statistical condition, the different optional programs of the predetermined item are counted according to the feedback data
Utilization rate;
Wherein, the predetermined statistical condition include it is following in one or more:Current time is away to targeted customer couple
The time interval that the terminal answered sends data reaches preset value, and the quantity of the feedback data received reaches preset value.
Alternatively, the executable instruction when executed, can also make the processor:
The optional program that utilization rate in the different optional programs is exceeded to predetermined threshold is defined as the predetermined item
Embodiment.
Alternatively, the executable instruction when executed, can also make the processor:
Receive the test request for being used to test the different optional program utilization rates of the predetermined item that management terminal is sent;
Wherein, targeted customer's feature corresponding to the predetermined item is carried in the test request.
In the embodiment of the present application, targeted customer's feature include it is following in one or more:Age of user, sex,
Liveness, investment situation, the information of user's concern, the information of collection.
In the embodiment of the present application, the predetermined item is application program, and the optional program of the predetermined item is answered to be described
Wrapped with the increment dynamic of program.
The embodiment of the present application provides a kind of selected equipment of project testing, by needing to carry out optional program utilization rate test
Predetermined item corresponding to targeted customer's Feature Selection test predetermined item targeted customer, then, by predetermined item not
Data with optional program are sent to terminal corresponding to targeted customer, and side to be selected is directed to getting terminal corresponding to targeted customer
After the data that case is fed back, the utilization rate of the different optional programs of predetermined item, so, Ke Yi are determined according to the feedback data
When carrying out utilization rate test to multiple optional programs, it is not necessary to be all arranged at the program code of different optional programs accordingly
In application program, moreover, also without the trigger switch of preset or pre-buried optional program, but determined based on targeted customer's feature
Targeted customer, the data of different optional programs are then sent respectively to targeted customer again and tested, so as to save use
The downloading flow at family, improve the flexibility that optional program is implemented.
In the 1990s, the improvement for a technology can clearly distinguish be on hardware improvement (for example,
Improvement to circuit structures such as diode, transistor, switches) or software on improvement (improvement for method flow).So
And as the development of technology, the improvement of current many method flows can be considered as directly improving for hardware circuit.
Designer nearly all obtains corresponding hardware circuit by the way that improved method flow is programmed into hardware circuit.Cause
This, it cannot be said that the improvement of a method flow cannot be realized with hardware entities module.For example, PLD
(Programmable Logic Device, PLD) (such as field programmable gate array (Field Programmable Gate
Array, FPGA)) it is exactly such a integrated circuit, its logic function is determined by user to device programming.By designer
Voluntarily programming comes a digital display circuit " integrated " on a piece of PLD, without asking chip maker to design and make
Special IC chip.Moreover, nowadays, substitution manually makes IC chip, this programming is also used instead mostly " patrols
Volume compiler (logic compiler) " software realizes that software compiler used is similar when it writes with program development,
And the source code before compiling also write by handy specific programming language, this is referred to as hardware description language
(Hardware Description Language, HDL), and HDL is also not only a kind of, but have many kinds, such as ABEL
(Advanced Boolean Expression Language)、AHDL(Altera Hardware Description
Language)、Confluence、CUPL(Cornell University Programming Language)、HDCal、JHDL
(Java Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby
Hardware Description Language) etc., VHDL (Very-High-Speed are most generally used at present
Integrated Circuit Hardware Description Language) and Verilog.Those skilled in the art also should
This understands, it is only necessary to method flow slightly programming in logic and is programmed into integrated circuit with above-mentioned several hardware description languages,
Can is readily available the hardware circuit for realizing the logical method flow.
Controller can be implemented in any suitable manner, for example, controller can take such as microprocessor or processing
Device and storage can by the computer of the computer readable program code (such as software or firmware) of (micro-) computing device
Read medium, gate, switch, application specific integrated circuit (Application Specific Integrated Circuit,
ASIC), the form of programmable logic controller (PLC) and embedded microcontroller, the example of controller include but is not limited to following microcontroller
Device:ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320, are deposited
Memory controller is also implemented as a part for the control logic of memory.It is also known in the art that except with
Pure computer readable program code mode realized beyond controller, completely can be by the way that method and step is carried out into programming in logic to make
Controller is obtained in the form of gate, switch, application specific integrated circuit, programmable logic controller (PLC) and embedded microcontroller etc. to come in fact
Existing identical function.Therefore this controller is considered a kind of hardware component, and various for realizing to including in it
The device of function can also be considered as the structure in hardware component.Or even, can be by for realizing that the device of various functions regards
For that not only can be the software module of implementation method but also can be the structure in hardware component.
System, device, module or the unit that above-described embodiment illustrates, it can specifically be realized by computer chip or entity,
Or realized by the product with certain function.One kind typically realizes that equipment is computer.Specifically, computer for example may be used
Think personal computer, laptop computer, cell phone, camera phone, smart phone, personal digital assistant, media play
It is any in device, navigation equipment, electronic mail equipment, game console, tablet PC, wearable device or these equipment
The combination of equipment.
For convenience of description, it is divided into various units during description apparatus above with function to describe respectively.Certainly, this is being implemented
The function of each unit can be realized in same or multiple softwares and/or hardware during application.
It should be understood by those skilled in the art that, embodiments of the invention can be provided as method, system or computer program
Product.Therefore, the present invention can use the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware
Apply the form of example.Moreover, the present invention can use the computer for wherein including computer usable program code in one or more
The computer program production that usable storage medium is implemented on (including but is not limited to magnetic disk storage, CD-ROM, optical memory etc.)
The form of product.
The present invention is the flow with reference to method according to embodiments of the present invention, equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that can be by every first-class in computer program instructions implementation process figure and/or block diagram
Journey and/or the flow in square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided
The processors of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that produced by the instruction of computer or the computing device of other programmable data processing devices for real
The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which produces, to be included referring to
Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or
The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, so as in computer or
The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in individual square frame or multiple square frames.
In a typical configuration, computing device includes one or more processors (CPU), input/output interface, net
Network interface and internal memory.
Internal memory may include computer-readable medium in volatile memory, random access memory (RAM) and/or
The forms such as Nonvolatile memory, such as read-only storage (ROM) or flash memory (flash RAM).Internal memory is computer-readable medium
Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer-readable instruction, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), moved
State random access memory (DRAM), other kinds of random access memory (RAM), read-only storage (ROM), electric erasable
Programmable read only memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read-only storage (CD-ROM),
Digital versatile disc (DVD) or other optical storages, magnetic cassette tape, the storage of tape magnetic rigid disk or other magnetic storage apparatus
Or any other non-transmission medium, the information that can be accessed by a computing device available for storage.Define, calculate according to herein
Machine computer-readable recording medium does not include temporary computer readable media (transitory media), such as data-signal and carrier wave of modulation.
It should also be noted that, term " comprising ", "comprising" or its any other variant are intended to nonexcludability
Comprising so that process, method, commodity or equipment including a series of elements not only include those key elements, but also wrapping
Include the other element being not expressly set out, or also include for this process, method, commodity or equipment intrinsic want
Element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that wanted including described
Other identical element also be present in the process of element, method, commodity or equipment.
It will be understood by those skilled in the art that embodiments herein can be provided as method, system or computer program product.
Therefore, the application can be using the embodiment in terms of complete hardware embodiment, complete software embodiment or combination software and hardware
Form.Deposited moreover, the application can use to can use in one or more computers for wherein including computer usable program code
The shape for the computer program product that storage media is implemented on (including but is not limited to magnetic disk storage, CD-ROM, optical memory etc.)
Formula.
The application can be described in the general context of computer executable instructions, such as program
Module.Usually, program module includes performing particular task or realizes routine, program, object, the group of particular abstract data type
Part, data structure etc..The application can also be put into practice in a distributed computing environment, in these DCEs, by
Task is performed and connected remote processing devices by communication network.In a distributed computing environment, program module can be with
In the local and remote computer-readable storage medium including storage device.
Each embodiment in this specification is described by the way of progressive, identical similar portion between each embodiment
Divide mutually referring to what each embodiment stressed is the difference with other embodiment.It is real especially for system
For applying example, because it is substantially similar to embodiment of the method, so description is fairly simple, related part is referring to embodiment of the method
Part explanation.
Embodiments herein is the foregoing is only, is not limited to the application.For those skilled in the art
For, the application can have various modifications and variations.All any modifications made within spirit herein and principle, it is equal
Replace, improve etc., it should be included within the scope of claims hereof.