CN107402881A - The choosing method and device of a kind of project testing - Google Patents

The choosing method and device of a kind of project testing Download PDF

Info

Publication number
CN107402881A
CN107402881A CN201710245490.5A CN201710245490A CN107402881A CN 107402881 A CN107402881 A CN 107402881A CN 201710245490 A CN201710245490 A CN 201710245490A CN 107402881 A CN107402881 A CN 107402881A
Authority
CN
China
Prior art keywords
targeted customer
predetermined item
program
optional
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710245490.5A
Other languages
Chinese (zh)
Inventor
李记锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Advanced New Technologies Co Ltd
Advantageous New Technologies Co Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201710245490.5A priority Critical patent/CN107402881A/en
Publication of CN107402881A publication Critical patent/CN107402881A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management

Abstract

The embodiment of the present application discloses the choosing method and device of a kind of project testing, and this method includes:Obtain targeted customer's feature corresponding to the predetermined item for needing progress optional program utilization rate test;The targeted customer of the predetermined item is tested according to targeted customer's Feature Selection;The data of the different optional programs of the predetermined item are sent to terminal corresponding to the targeted customer;Obtain terminal corresponding to the targeted customer and be directed to the data that the optional program is fed back, the utilization rate of the different optional programs of the predetermined item is determined according to the feedback data.Utilize the embodiment of the present application, can be when carrying out utilization rate test to multiple optional programs, the program code of different optional programs need not be all arranged in corresponding application program, and, also without the trigger switch of preset or pre-buried optional program, so as to save the downloading flow of user, the flexibility that optional program is implemented is improved.

Description

The choosing method and device of a kind of project testing
Technical field
The application is related to field of computer technology, more particularly to the choosing method and device of a kind of project testing.
Background technology
A/B tests are a kind of emerging front page optimization methods, the purpose of A/B tests and be intended that by A and B two or more Optional program is supplied to user to be tested, and judges which kind of is to be selected by the user behavior data provided in user's test process Scheme more meets behavioural habits and the requirement of user, so as to reach the purpose of the webpage indexs such as increase conversion ratio, registration rate.
When carrying out A/B tests, it will usually which the program code of two or more optional programs of test is arranged at accordingly Application program in, while, it is necessary to set in the application program or the trigger switch of pre-buried optional program (or A/B switch), When user needs to use optional program, it is necessary to select it from above-mentioned setting or pre-buried trigger switch (or A/B switches) In a trigger switch, perform corresponding optional program so as to trigger, now, terminal can record the triggering of each trigger switch Number, the data such as access times of optional program are sent to server as feedback data.Server statistics simultaneously calculate difference and treated The utilization rate of scheme, and the result that the maximum optional program of utilization rate is tested as A/B are selected, i.e., as final embodiment party Case.
However, need the program code of different optional programs being all arranged in application program in A/B tests, moreover, The trigger switch of preset or pre-buried optional program is needed, so that the data volume of application program is larger, moreover, not every The program code of optional program is all useful to a certain user, so, will certainly waste the downloading flow of user, moreover, treating The flexibility for selecting scheme to implement is poor.
The content of the invention
The purpose of the embodiment of the present application is to provide the choosing method and device of a kind of project testing, to solve to need difference The program code of optional program is all arranged in application program, in addition, it is desirable to the trigger switch of preset or pre-buried optional program Cause the data volume of application program larger, so as to waste the downloading flow of user, and the flexibility that optional program is implemented is poor Problem.
In order to solve the above technical problems, what the embodiment of the present application was realized in:
A kind of choosing method for project testing that the embodiment of the present application provides, methods described include:
Obtain targeted customer's feature corresponding to the predetermined item for needing progress optional program utilization rate test;
The targeted customer of the predetermined item is tested according to targeted customer's Feature Selection;
The data of the different optional programs of the predetermined item are sent to terminal corresponding to the targeted customer;
Obtain terminal corresponding to the targeted customer and be directed to the data that the optional program is fed back, according to the feedback coefficient According to the utilization rate for the different optional programs for determining the predetermined item.
Alternatively, the data of the different optional programs by the predetermined item are sent to corresponding to the targeted customer Terminal, including:
According to the number of optional program, the targeted customer is divided into multiple packets;
The data of different optional programs are sent to terminal corresponding to the targeted customer of respective packets respectively.
Alternatively, the utilization rate of the different optional programs that the predetermined item is determined according to the feedback data, bag Include:
When reaching predetermined statistical condition, the different optional programs of the predetermined item are counted according to the feedback data Utilization rate;
Wherein, the predetermined statistical condition include it is following in one or more:Current time is away to targeted customer couple The time interval that the terminal answered sends data reaches preset value, and the quantity of the feedback data received reaches preset value.
Alternatively, the utilization rate of the different optional programs that the predetermined item is determined according to the feedback data it Afterwards, methods described also includes:
The optional program that utilization rate in the different optional programs is exceeded to predetermined threshold is defined as the predetermined item Embodiment.
Alternatively, the targeted customer that the acquisition needs to carry out corresponding to the predetermined item of optional program utilization rate test is special Sign, including:
Receive the test request for being used to test the different optional program utilization rates of the predetermined item that management terminal is sent; Wherein, targeted customer's feature corresponding to the predetermined item is carried in the test request.
Alternatively, targeted customer's feature include it is following in one or more:Age of user, sex, liveness, throwing Money situation, the information of user's concern, the information of collection.
Alternatively, the predetermined item is application program, and the optional program of the predetermined item is the application program Increment dynamic is wrapped.
A kind of selecting device for project testing that the embodiment of the present application provides, described device include:
Target signature acquisition module, for obtaining corresponding to the predetermined item for needing to carry out optional program utilization rate test Targeted customer's feature;
Targeted customer chooses module, and the target for testing the predetermined item according to targeted customer's Feature Selection is used Family;
Data transmission blocks, for the data of the different optional programs of the predetermined item to be sent into the targeted customer Corresponding terminal;
Utilization rate determining module, it is directed to what the optional program was fed back for obtaining terminal corresponding to the targeted customer Data, the utilization rate of the different optional programs of the predetermined item is determined according to the feedback data.
Alternatively, the data transmission blocks, including:
Grouped element, for the number according to optional program, the targeted customer is divided into multiple packets;
Data transmission unit, the targeted customer for the data of different optional programs to be sent to respective packets respectively are corresponding Terminal.
Alternatively, the utilization rate determining module, for when reaching predetermined statistical condition, according to the feedback data Count the utilization rate of the different optional programs of the predetermined item;
Wherein, the predetermined statistical condition include it is following in one or more:Current time is away to targeted customer couple The time interval that the terminal answered sends data reaches preset value, and the quantity of the feedback data received reaches preset value.
Alternatively, described device also includes:
Embodiment determining module, for utilization rate in the different optional programs to be exceeded to the optional program of predetermined threshold It is defined as the embodiment of the predetermined item.
Alternatively, the target signature acquisition module, for receive management terminal transmission be used for test the scheduled item The test request of purpose difference optional program utilization rate;Wherein, carried in the test request corresponding to the predetermined item Targeted customer's feature.
Alternatively, targeted customer's feature include it is following in one or more:Age of user, sex, liveness, throwing Money situation, the information of user's concern, the information of collection.
Alternatively, the predetermined item is application program, and the optional program of the predetermined item is the application program Increment dynamic is wrapped.
The technical scheme provided from above the embodiment of the present application, the embodiment of the present application carry out optional program by needing The targeted customer of targeted customer's Feature Selection test predetermined item corresponding to the predetermined item of utilization rate test, then, will be pre- The data for determining the different optional programs of project are sent to terminal corresponding to targeted customer, are getting terminal corresponding to targeted customer After the data fed back for optional program, the utilization rate of the different optional programs of predetermined item is determined according to the feedback data, So, can be when carrying out utilization rate test to multiple optional programs, it is not necessary to which the program code of different optional programs is whole It is arranged in corresponding application program, moreover, also without the trigger switch of preset or pre-buried optional program, but it is based on target User characteristics determines targeted customer, and the data of different optional programs then are sent respectively into targeted customer again is tested, from And the downloading flow of user can be saved, improve the flexibility that optional program is implemented.
Brief description of the drawings
, below will be to embodiment or existing in order to illustrate more clearly of the embodiment of the present application or technical scheme of the prior art There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are only this Some embodiments described in application, for those of ordinary skill in the art, do not paying the premise of creative labor Under, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is a kind of choosing method embodiment of project testing of the application;
Fig. 2 is a kind of display interface schematic diagram of utilization rate test of the application;
Fig. 3 is the choosing method embodiment of the application another kind project testing;
Fig. 4 is a kind of structural representation of the selecting system of project testing of the application;
Fig. 5 is a kind of selecting device embodiment of project testing of the application;
Fig. 6 is a kind of selected equipment embodiment of project testing of the application.
Embodiment
The embodiment of the present application provides a kind of choosing method and device of project testing.
In order that those skilled in the art more fully understand the technical scheme in the application, it is real below in conjunction with the application The accompanying drawing in example is applied, the technical scheme in the embodiment of the present application is clearly and completely described, it is clear that described implementation Example only some embodiments of the present application, rather than whole embodiments.It is common based on the embodiment in the application, this area The every other embodiment that technical staff is obtained under the premise of creative work is not made, it should all belong to the application protection Scope.
Embodiment one
As shown in figure 1, the embodiment of the present application provides a kind of choosing method of project testing, the executive agent of this method can be with For server or terminal, wherein, terminal can such as personal computer, the present embodiment illustrates by taking server as an example.The party Method can apply to A/B tests (i.e. A/BTest) etc., and this method specifically may comprise steps of:
In step S101, the targeted customer for needing to carry out corresponding to the predetermined item of optional program utilization rate test is obtained Feature.
Wherein, the test that utilization rate test can be user to the service condition of some or multiple schemes, for example, in the presence of 2 schemes, i.e. scheme 1 and scheme 2, user are 100 using the total degree of above-mentioned 2 schemes, wherein, the number of operational version 1 For 68, the number of operational version 2 is 32, then the utilization rate of scheme 1 is 68%, and the utilization rate of scheme 2 is 32%.Predetermined item can To be any project, for example, the project of the style sheet of some webpage or the project for redirecting mode of some page etc..Target is used Family feature can be user characteristics corresponding with predetermined item, and such as age is -40 years old 20 years old and/or sex is man.
In force, the software elements such as multiple webpages, button and/or link are frequently included in application program, these elements Design can often include it is a variety of, if button can be suspended with that in any webpage of application program, can also be arranged at certain Inside one webpage, or, the displaying pattern of button can be circular or rectangle, or, can be such as above-mentioned webpage Different style sheets etc..Moreover, the design for being not only these elements can be including a variety of, relevant with above-mentioned element is some The design of form or metamorphosis can also be including a variety of, for example, as some webpage jumps to the side of redirecting of next webpage Formula (it is such as pivoted redirect, the formula of flying into redirects or venetian blind type conversion) etc..Whether the design of element or relevant with element Some forms or metamorphosis, for wherein any one design object (i.e. predetermined item), a variety of set can be designed for it Meter scheme (i.e. optional program).For a user, different designs attracts it degree different, for example, certain is pre- Determining project includes two kinds of optional programs, i.e. option A and option b, option A has advantages below for a user:Triggering is simple, It is easy to use, simplify user's operation, color is moderate and new style etc., and option b pattern keep constant, predetermined trigger mode and Beautiful in colour, because user is when using optional program, some users may focus on convenience and pattern of scheme implementation etc., And other users may focus on scheme implementation and the pattern uniformity of the scheme of other projects in application program, and color Deng, so, two schemes can exist uses user accordingly.In actual applications, often only needed for same predetermined item A kind of preferably scheme is arranged in application program, and thus needs to select multiple optional programs, therefore, can be with Utilization rate test is carried out to the different optional programs of same predetermined item, can using the higher optional program of wherein utilization rate as The application scheme of the predetermined item is arranged in corresponding application program for users to use.
The application journey that exploitation is used to test the utilization rate of different optional programs in predetermined item can be pre-designed Sequence (in order to can be described as test program with application program differentiation mentioned above, this application program).The test program can be pacified Loaded in server, as shown in Fig. 2 it is special to include test event button, targeted customer in the display interface of the test program Sign button, start to test button, pause test button, stop test button and the display interface of test result etc..When needs pair When certain project (i.e. predetermined item) carries out utilization rate test, it may be determined that user needs the condition met, i.e. targeted customer's feature, If the age is -50 years old 20 years old, or, liveness is more than predetermined value, and sex is female etc..It is then possible to click in test program Test event button, test program can eject input frame, the project label of predetermined item can be inputted in the input frame, For example, project name, bullets etc..After the completion of input, the determination button in pop-up box can be clicked on, test program can obtain Take the project label of predetermined item.Targeted customer's feature key in test program can also be clicked on, test program can eject Input frame, the information of targeted customer's feature can be inputted in the input frame.After the completion of input, it can click in pop-up box really Determine button, test program can obtain targeted customer's feature.After the completion of aforesaid operations, it can click on and start to test button, now, Test program can determine that being provided to user carries out targeted customer's feature corresponding to the predetermined item of utilization rate test.
In addition to aforesaid way, the project label of predetermined item and targeted customer's feature can also be established corresponding relation, And the corresponding relation can be stored in the server, it can specifically pass through the test event button and mesh in above-mentioned test program Mark user characteristics button and upload corresponding information, so as to establish above-mentioned corresponding relation.Above-mentioned corresponding relation, can be with the shape of form Formula stores, as shown in table 1.
Table 1
When needing to test project A, the project label of test event key-press input predetermined item, example can be passed through Such as, project B, after the completion of input, the determination button in pop-up box can be clicked on, starts to test button it is then possible to click on, this When, server can obtain the project label of user's input, i.e. project B, server can be in corresponding pass as shown in Table 1 above Targeted customer's feature corresponding to project B is searched in system, i.e. registration time length is no more than scheduled duration threshold value (such as 24 hours), this Sample, server can get the targeted customer's feature for needing to carry out corresponding to the predetermined item of optional program utilization rate test.
In step s 102, the targeted customer of above-mentioned predetermined item is tested according to above-mentioned targeted customer's Feature Selection.
In force, in order to test disparity items, the user that can collect different user by all means is special Sign, for example, the personal information filled in during user's registration, by way of purchase from user at purchase personal information or by having Information that the modes such as prize question and answer obtain at user etc., after getting above- mentioned information, can be stored it in server, be serviced The user characteristics stored in device is more, and the content of user characteristics is abundanter, then the result tested is more accurate.User can be identified Storage corresponding with user characteristics is in the server.Wherein, user's mark can store in table form with user characteristics, such as table Shown in 2.
Table 2
In force, after server gets targeted customer's feature, targeted customer's feature can be based on from the above-mentioned institute of table 2 The user characteristics to match with targeted customer's feature is searched in the corresponding relation shown, for example, targeted customer's feature includes the age For -35 years old 20 years old, then server can search user characteristics of the age at -35 years old 20 years old from the corresponding relation of above-mentioned table 2, i.e., Age is 20 years old and the age is 32 years old, and the user characteristics found can be chosen for testing the targeted customer of predetermined item.Can To further determine that user corresponding to the user characteristics found identifies by above-mentioned table 2, i.e. the age is 20 years old corresponding user 1, Age is 32 years old corresponding user 2, then user 1 and user 2 are targeted customer.
In step s 103, the data of the different optional programs of above-mentioned predetermined item are sent into above-mentioned targeted customer to correspond to Terminal.
Wherein, the data of the different optional programs of predetermined item can be sent in the form of packet, and the packet can be with It is that each optional program is corresponding with a packet, the packet can be added by the application program belonging to predetermined item Carrying row.The packet can be an AKU independently of the test bag of application program or the application program, this Apply in embodiment for the ease of the test to predetermined item, the packet is a test bag independently of application program.
In force, can be in several ways by optional program after server determines user's mark of targeted customer Data are sent to targeted customer, for example, the data of any optional program therein can be sent into all targeted customers Corresponding terminal, after terminal corresponding to targeted customer receives the data, the data can be run, and it is corresponding to server feedback Data, when data transmission after reach scheduled duration when, stop the test to the optional program.Then, then successively will be remaining The data of each optional program are sent to terminal corresponding to all targeted customers, by processing procedure same as described above, Server completes the transmission and test to the data of each optional program.
Except aforesaid way, it can also realize by other means, for example, server determines user's mark of targeted customer Afterwards, user can be identified and multiple packets is divided into according to its corresponding user characteristics, can be by the user of each packet The corresponding optional program of mark, for example, predetermined item includes 2 optional programs, it can mark and be and option b, it is determined that Targeted customer user mark include 1000, then it can be divided into 2 packets according to corresponding user characteristics, can So that labeled as packet 1 and packet 2, each packet includes 500 user's marks.It is then possible to the data of option A are sent to The data of option b, can be sent to each in packet 2 by the terminal of targeted customer corresponding to each user mark in packet 1 The terminal of targeted customer corresponding to individual user's mark.
In step S104, obtain terminal corresponding to above-mentioned targeted customer and be directed to the data that above-mentioned optional program is fed back, The utilization rate of the different optional programs of above-mentioned predetermined item is determined according to the feedback data.
In force, based on the example in above-mentioned steps S103, in the case of optional program is sent successively, targeted customer After corresponding terminal receives the data of transmission, it can import in the application program installed in terminal, after the completion of importing, Ke Yiqi The application program is moved, targeted customer can use corresponding optional program by application program, be treated whenever targeted customer triggers this When selecting scheme, terminal can be recorded using information such as the times of the optional program, and can send it to server, server The information received can be stored.When reaching scheduled duration after data transmission, server can count making for the optional program With number, the display number for triggering webpage where the optional program execution mechanism, application program the number of starts etc., then, meter Calculate the utilization rate of the optional program.Then, then successively the data of each remaining optional program are sent to all targets Terminal corresponding to user, by said process, the utilization rate of every kind of optional program can be calculated in server.
In the case of packet transmission optional program, when reaching scheduled duration after data transmission, server can count The display number of webpages where the access times of various optional programs, the various optional program execution mechanisms of triggering, application program Number of starts etc., then, calculate the utilization rate of every kind of optional program.
By the comparison of the utilization rate to different optional programs, an optional program can be therefrom chosen (for example, utilization rate Maximum optional program etc.) actual application scheme as predetermined item, the optional program of selection can be set to arrive and apply journey In the updated data package of sequence.The data of the optional program can be loaded into when application program is updated in application program, So, user's can carries out data interaction using the application program of the optional program with server.
The embodiment of the present application provides a kind of choosing method of project testing, by needing to carry out optional program utilization rate test Predetermined item corresponding to targeted customer's Feature Selection test predetermined item targeted customer, then, by predetermined item not Data with optional program are sent to terminal corresponding to targeted customer, and side to be selected is directed to getting terminal corresponding to targeted customer After the data that case is fed back, the utilization rate of the different optional programs of predetermined item, so, Ke Yi are determined according to the feedback data When carrying out utilization rate test to multiple optional programs, it is not necessary to be all arranged at the program code of different optional programs accordingly In application program, moreover, also without the trigger switch of preset or pre-buried optional program, but determined based on targeted customer's feature Targeted customer, the data of different optional programs are then sent respectively to targeted customer again and tested, so as to save use The downloading flow at family, improve the flexibility that optional program is implemented.
Embodiment two
As shown in figure 3, the embodiment of the present application provides a kind of choosing method of project testing, the executive agent of this method can be with For server or terminal, wherein, terminal can such as personal computer, the present embodiment illustrates by taking server as an example.
A kind of selecting system of project testing is provided in the embodiment of the present application, as shown in figure 4, the selection system of the project testing Management terminal, server and the terminal of targeted customer can be included in system, wherein, management terminal can be used for performing server The equipment that is controlled of operation, specific such as mobile phone, tablet personal computer or personal computer.The project that the embodiment of the present application provides The choosing method of test can apply to A/B tests (i.e. A/BTest) etc., and this method specifically may comprise steps of:
In step S301, the different optional program utilization rates for being used to test predetermined item that management terminal is sent are received Test request;Wherein, targeted customer's feature corresponding to predetermined item is carried in the test request.
In force, a variety of different optional programs can be included for predetermined item, such as 2 kinds of optional programs, 3 kinds it is to be selected Scheme or 4 kinds of optional programs etc., different optional programs has corresponding merits and demerits.For tester or exploit person For member, it is not easy to judge that any optional program more meets the use habit of user, thus need to provide optional program Tested to user, to determine the embodiment of predetermined item.For different optional programs, corresponding data can be set Bury a little, you can statistics codes are set with the key point in application program, service conversion, independent ID in statistics codes can be with Ensuring the data of collection will not repeat (clicking rate for such as buying button).It can be a little one or more that the data, which are buried, It is individual, such as 2 or 3.
Developer can be based on offer multiple optional programs and corresponding data bury a little, write each optional program Base of program code, the program code of corresponding experiment version can be created based on base of program code, it is then possible to according to pre- Determine the test code that business demand corresponding to project creates corresponding optional program, can be by the test code of different optional programs It is packaged into corresponding packet.The packet can be specifically that dynamic is wrapped, and can be supplied to the packet tester to carry out Test, specifically, as shown in Fig. 2 the project label of predetermined item can be uploaded by the test program installed in management terminal With predetermined item corresponding to targeted customer's feature, complete aforesaid operations after, can click on start test button, management terminal obtain Targeted customer's feature corresponding to the project label and predetermined item that tester uploads, can be based on above- mentioned information generation test please Ask, and the test request can be sent to server, now, server can receive the predetermined item of management terminal transmission Different optional programs test request.
In step s 302, the targeted customer of above-mentioned predetermined item is tested according to above-mentioned targeted customer's Feature Selection.
Wherein, targeted customer's feature include it is following in one or more:Age of user, sex, liveness, investment feelings Condition, the information of user's concern, the information of collection.
Above-mentioned steps S302 specific processing may refer to the related content of step S102 in above-described embodiment one, herein not Repeat again.
In step S303, according to the number of optional program, above-mentioned targeted customer is divided into multiple packets.
In force, in order that the targeted customer that each optional program must be tested can be evenly distributed to it is corresponding to be selected Scheme, targeted customer can be divided into multiple packets (i.e. crowd divides bucket), be less than 30 days for example, targeted customer is registration time length New user, if optional program includes 2, the quantity of targeted customer is 320, then targeted customer can be divided into two Packet, each packet include 160 targeted customers.In addition, if targeted customer's feature of targeted customer is including two or more Mutually contradictory targeted customer's feature, then can be according to the number of optional program, by mutually contradictory targeted customer's feature Targeted customer corresponding to each targeted customer's feature is divided into multiple packets, then, then the packet by different target user characteristics Merge, obtain the multiple packets to match with the number of optional program, for example, targeted customer included liveness more than 30 days User and registration time length be less than the new user of 30 days, if optional program includes 2, the quantity of targeted customer is 400, its In, the quantity of user of the liveness more than 30 days is 300, and the quantity of new user of the registration time length less than 30 days is 100, then can be with 300 users of the liveness more than 30 days are divided into 2 groups, each packet includes 150 targeted customers, can be by 100 Registration time length was divided into 2 groups less than the new user of 30 days, and each packet includes 50 targeted customers, it is then possible to by difference The packet of targeted customer's feature merges, i.e. 150+50, and after being merged a packet includes 150 liveness more than 30 It user and 50 new users, another packet is identical with the packet, so can be obtained by two packets, and each divides Group composition it is identical, the result obtained in the optional program of subsequent contrast's predetermined item has preferable accuracy, avoid by It is different in the constituent of each packet so that the accuracy and reliability of the result subsequently obtained are poor.If targeted customer Targeted customer's feature include three or more mutually contradictory targeted customer's features, then can be based on above-mentioned related content at Reason, will not be repeated here.
In step s 304, the data of different optional programs are sent to corresponding to the targeted customer of respective packets eventually respectively End.
In force, predetermined item can be application program, and the optional program of predetermined item can be the increasing of application program Amount dynamic is wrapped, and so, the data of optional program can realize that increment dynamic mainly may be used in wrapping by way of increment dynamic is wrapped With including herein below:Dynamic.dex, resource.diff and META-INFO, wherein, dynamic.dex is used to test Program code logic, resource.diff is used for experimental arrangement code application resource, such as drawable, layout or string Deng signing messages of the META-INFO for representing increment dynamic bag.Be provided with server for data push and pull Mechanism, i.e. Sync mechanism, after targeted customer is by predetermined account login service device, Sync mechanism is triggered, and generation is up to ask Ask, server obtains the relevant information for the packet for needing to send based on the upstream request, wherein version number, application can be included The version number of program, the download address of packet, the check code (such as MD5 values) etc. of packet.It may determine that above-mentioned each data Whether bag is in application state, if being in application state, Sync mechanism quilts are rolled back to by currently processed by rollback mechanism Processing during triggering, if being not in application state, it may determine that whether packet is empty, if sky, then judges application Whether the version number of program is the version number initialized, if sky, then judges whether the version number of application program uses with target The version number for the application program installed in the terminal at family is consistent, if the version number of application program is not the version number of initialization, Or judge application program version number and terminal in the version number of application program installed it is inconsistent, then will can currently grasp It is transferred to processing when Sync mechanism is triggered.If the version number of application program is the version number of initialization, and is judged The version number of application program of the version number of application program with being installed in terminal is consistent, then judges whether above-mentioned packet is sky, If sky, it is determined that whether the packet is full dose data, if the packet is increment, dynamic is wrapped, and will can currently be grasped Processing when Sync mechanism is triggered is transferred to, if the packet is full dose data, may determine that corresponding business is No processing, if handled, current operation can be transferred to processing when Sync mechanism is triggered, it is such as untreated, then It may be inserted into data base access download state.If above-mentioned packet is not sky, judge whether dynamic version strategy is correct, such as Fruit is correct, then judges whether flowing water version is correct, if correctly, whether judgement currently has packet download, if it is not, Data base access download state is may be inserted into, if there is currently the packet downloaded, judges that current delta dynamic is wrapped Version number whether newly in the packet version number of download, if it is, the packet that pause is downloaded, may be inserted into database makes Obtain current delta dynamic bag and enter download state.So, above-mentioned processing mode is passed through, you can realize the download of increment dynamic bag.
In addition, the processing based on above-mentioned steps S303, can wrap the increment dynamic of optional program according to its group result Terminal corresponding to the targeted customer of respective packets is sent to, for example, the example based on above-mentioned steps S303, each packet includes 150 users of the liveness more than 30 days and 50 new users, 2 optional programs, i.e. option A and option b then can be by schemes A increment dynamic bag is sent to terminal corresponding to 150 users of the liveness more than 30 days and 50 new terminals corresponding to user, It is sent to terminal corresponding to remaining user of 150 liveness more than 30 days likewise, the increment dynamic of option b is wrapped and remains The new terminal corresponding to user of remaining 50.
It should be noted that predetermined item can be not only application program, can also be for a certain business demand The project of formulation, such as project of the project of webpage pattern or button form, the embodiment of the present application are not limited predetermined item.
In step S305, obtain terminal corresponding to above-mentioned targeted customer and be directed to the data that above-mentioned optional program is fed back.
In force, after the terminal of targeted customer receives the increment dynamic bag of server transmission, the increment can be loaded Dynamic is wrapped.It is provided with data in wrapping due to increment dynamic to bury a little, when user, which triggers the data, to be buried, terminal can gather accordingly Data, such as trigger data buries a displaying number for a webpage where number a little, the access times of application program, data are buried, And server can be sent to using the data collected as feedback data, server can receive and store the feedback data. For example, the example based on above-mentioned steps S304, the increment dynamic bag of option A is sent to a new terminal corresponding to user, and this is new The terminal of user can gather corresponding data and send after the data in detecting that the new user triggers increment dynamic bag are buried a little To server.
In step S306, when reaching predetermined statistical condition, above-mentioned predetermined item is counted according to above-mentioned feedback data Different optional programs utilization rate.
Wherein, predetermined statistical condition include it is following in one or more:Between the time that current time is sent away from data Every reaching preset value, and the quantity of the feedback data received reaches preset value.The preset value that time interval reaches specifically can be such as 7 It or 10 days etc., the preset value that the quantity of feedback data reaches specifically can such as 10GB or 100GB.In addition, statistical condition is also It can be statistics request that the management terminal received is sent etc..
In force, by taking the preset value that time interval reaches as an example, if current time away from increment dynamic bag send when Between interval reach 7 days, then obtain the feedback data of the different optional programs of predetermined item, it is clear data can be carried out to feedback data Wash, interference data and hash are removed, it is then possible to the parameters data in feedback data be extracted, as data bury an institute Number a little etc. is buried in the displaying number and trigger data of webpage, the use of optional program can be calculated by above-mentioned data Rate.For example, option A:It is 1000 that data, which bury a displaying number for place webpage, and the number that trigger data buries a little is 200, option b: It is 1200 that data, which bury a displaying number for place webpage, and the number that trigger data buries a little is 600, then the utilization rate of option A is 20%, the utilization rate of option b is 50%.
In step S307, by utilization rate in above-mentioned different optional programs exceed predetermined threshold optional program be defined as on The embodiment for stating predetermined item.
Wherein, predetermined threshold can determine according to actual conditions, specific such as 20%, 30% or 50%.Embodiment can Think the scheme determined by the selection to multiple optional programs in predetermined item, embodiment can be as predetermined item Unique formal scheme.
In force, the example based on above-mentioned steps S306, if predetermined threshold is 20%, in option A and option b, The only utilization rate of option b is more than 20%, then the embodiment that option b can be arranged to above-mentioned predetermined item, it is then possible to The program code of option b is arranged in the packet of application program updating, so, journey is applied when the terminal of user receives this After the packet of sequence upgrading, the program code of option b can be set into application program, now, each user will make Use option b.
The embodiment of the present application provides a kind of choosing method of project testing, by needing to carry out optional program utilization rate test Predetermined item corresponding to targeted customer's Feature Selection test predetermined item targeted customer, then, by predetermined item not Data with optional program are sent to terminal corresponding to targeted customer, and side to be selected is directed to getting terminal corresponding to targeted customer After the data that case is fed back, the utilization rate of the different optional programs of predetermined item, so, Ke Yi are determined according to the feedback data When carrying out utilization rate test to multiple optional programs, it is not necessary to be all arranged at the program code of different optional programs accordingly In application program, moreover, also without the trigger switch of preset or pre-buried optional program, but determined based on targeted customer's feature Targeted customer, the data of different optional programs are then sent respectively to targeted customer again and tested, so as to save use The downloading flow at family, improve the flexibility that optional program is implemented.
Embodiment three
The choosing method of the project testing provided above for the embodiment of the present application, based on same thinking, the application is implemented Example also provides a kind of selecting device of project testing, as shown in Figure 5.
The selecting device of the project testing includes:Target signature acquisition module 501, targeted customer choose module 502, number According to sending module 503 and utilization rate determining module 504, wherein:
Target signature acquisition module 501, need the predetermined item institute of progress optional program utilization rate test right for obtaining The targeted customer's feature answered;
Targeted customer chooses module 502, for testing the mesh of the predetermined item according to targeted customer's Feature Selection Mark user;
Data transmission blocks 503, for the data of the different optional programs of the predetermined item to be sent into the target Terminal corresponding to user;
Utilization rate determining module 504, it is anti-for optional program institute for obtaining terminal corresponding to the targeted customer The data of feedback, the utilization rate of the different optional programs of the predetermined item is determined according to the feedback data.
In the embodiment of the present application, the data transmission blocks 503, including:
Grouped element, for the number according to optional program, the targeted customer is divided into multiple packets;
Data transmission unit, the targeted customer for the data of different optional programs to be sent to respective packets respectively are corresponding Terminal.
In the embodiment of the present application, the utilization rate determining module 504, for when reaching predetermined statistical condition, according to The feedback data counts the utilization rate of the different optional programs of the predetermined item;
Wherein, the predetermined statistical condition include it is following in one or more:Current time is away to targeted customer couple The time interval that the terminal answered sends data reaches preset value, and the quantity of the feedback data received reaches preset value.
In the embodiment of the present application, described device also includes:
Embodiment determining module, for utilization rate in the different optional programs to be exceeded to the optional program of predetermined threshold It is defined as the embodiment of the predetermined item.
In the embodiment of the present application, the target signature acquisition module 501, for receive management terminal transmission be used for test The test request of the different optional program utilization rates of the predetermined item;Wherein, carried in the test request described predetermined Targeted customer's feature corresponding to project.
In the embodiment of the present application, targeted customer's feature include it is following in one or more:Age of user, sex, Liveness, investment situation, the information of user's concern, the information of collection.
In the embodiment of the present application, the predetermined item is application program, and the optional program of the predetermined item is answered to be described Wrapped with the increment dynamic of program.
The embodiment of the present application provides a kind of selecting device of project testing, by needing to carry out optional program utilization rate test Predetermined item corresponding to targeted customer's Feature Selection test predetermined item targeted customer, then, by predetermined item not Data with optional program are sent to terminal corresponding to targeted customer, and side to be selected is directed to getting terminal corresponding to targeted customer After the data that case is fed back, the utilization rate of the different optional programs of predetermined item, so, Ke Yi are determined according to the feedback data When carrying out utilization rate test to multiple optional programs, it is not necessary to be all arranged at the program code of different optional programs accordingly In application program, moreover, also without the trigger switch of preset or pre-buried optional program, but determined based on targeted customer's feature Targeted customer, the data of different optional programs are then sent respectively to targeted customer again and tested, so as to save use The downloading flow at family, improve the flexibility that optional program is implemented.
Example IV
The selecting device of the project testing provided above for the embodiment of the present application, based on same thinking, the application is implemented Example also provides a kind of selected equipment of project testing, as shown in Figure 6.
The selected equipment of the project testing can be the server that above-described embodiment provides.
The selected equipment of project testing can produce bigger difference because configuration or performance are different, can include one or More than one processor 601 and memory 602, one or more storages can be stored with memory 602 and apply journey Sequence or data.Wherein, memory 602 can be of short duration storage or persistently storage.The application program for being stored in memory 602 can be with Including one or more modules (diagram is not shown), each module can include to one in the selected equipment of project testing Family computer executable instruction.Further, processor 601 could be arranged to communicate with memory 602, in project testing Selected equipment on perform memory 602 in series of computation machine executable instruction.The selected equipment of project testing can be with Including one or more power supplys 603, one or more wired or wireless network interfaces 604, one or more Input/output interface 605, one or more keyboards 606.
Specifically in the present embodiment, the selected equipment of project testing includes memory, and one or more Program, one of them or more than one program storage is in memory, and one or more than one program can include one Individual or more than one module, and each module can include can perform the series of computation machine in the selected equipment of project testing Instruction, and it is configured to that either more than one computing device this or more than one program bag contain and be used to carry out by one Following computer executable instructions:
Obtain targeted customer's feature corresponding to the predetermined item for needing progress optional program utilization rate test;
The targeted customer of the predetermined item is tested according to targeted customer's Feature Selection;
The data of the different optional programs of the predetermined item are sent to terminal corresponding to the targeted customer;
Obtain terminal corresponding to the targeted customer and be directed to the data that the optional program is fed back, according to the feedback coefficient According to the utilization rate for the different optional programs for determining the predetermined item.
Alternatively, the executable instruction when executed, can also make the processor:
According to the number of optional program, the targeted customer is divided into multiple packets;
The data of different optional programs are sent to terminal corresponding to the targeted customer of respective packets respectively.
Alternatively, the executable instruction when executed, can also make the processor:
When reaching predetermined statistical condition, the different optional programs of the predetermined item are counted according to the feedback data Utilization rate;
Wherein, the predetermined statistical condition include it is following in one or more:Current time is away to targeted customer couple The time interval that the terminal answered sends data reaches preset value, and the quantity of the feedback data received reaches preset value.
Alternatively, the executable instruction when executed, can also make the processor:
The optional program that utilization rate in the different optional programs is exceeded to predetermined threshold is defined as the predetermined item Embodiment.
Alternatively, the executable instruction when executed, can also make the processor:
Receive the test request for being used to test the different optional program utilization rates of the predetermined item that management terminal is sent; Wherein, targeted customer's feature corresponding to the predetermined item is carried in the test request.
In the embodiment of the present application, targeted customer's feature include it is following in one or more:Age of user, sex, Liveness, investment situation, the information of user's concern, the information of collection.
In the embodiment of the present application, the predetermined item is application program, and the optional program of the predetermined item is answered to be described Wrapped with the increment dynamic of program.
The embodiment of the present application provides a kind of selected equipment of project testing, by needing to carry out optional program utilization rate test Predetermined item corresponding to targeted customer's Feature Selection test predetermined item targeted customer, then, by predetermined item not Data with optional program are sent to terminal corresponding to targeted customer, and side to be selected is directed to getting terminal corresponding to targeted customer After the data that case is fed back, the utilization rate of the different optional programs of predetermined item, so, Ke Yi are determined according to the feedback data When carrying out utilization rate test to multiple optional programs, it is not necessary to be all arranged at the program code of different optional programs accordingly In application program, moreover, also without the trigger switch of preset or pre-buried optional program, but determined based on targeted customer's feature Targeted customer, the data of different optional programs are then sent respectively to targeted customer again and tested, so as to save use The downloading flow at family, improve the flexibility that optional program is implemented.
In the 1990s, the improvement for a technology can clearly distinguish be on hardware improvement (for example, Improvement to circuit structures such as diode, transistor, switches) or software on improvement (improvement for method flow).So And as the development of technology, the improvement of current many method flows can be considered as directly improving for hardware circuit. Designer nearly all obtains corresponding hardware circuit by the way that improved method flow is programmed into hardware circuit.Cause This, it cannot be said that the improvement of a method flow cannot be realized with hardware entities module.For example, PLD (Programmable Logic Device, PLD) (such as field programmable gate array (Field Programmable Gate Array, FPGA)) it is exactly such a integrated circuit, its logic function is determined by user to device programming.By designer Voluntarily programming comes a digital display circuit " integrated " on a piece of PLD, without asking chip maker to design and make Special IC chip.Moreover, nowadays, substitution manually makes IC chip, this programming is also used instead mostly " patrols Volume compiler (logic compiler) " software realizes that software compiler used is similar when it writes with program development, And the source code before compiling also write by handy specific programming language, this is referred to as hardware description language (Hardware Description Language, HDL), and HDL is also not only a kind of, but have many kinds, such as ABEL (Advanced Boolean Expression Language)、AHDL(Altera Hardware Description Language)、Confluence、CUPL(Cornell University Programming Language)、HDCal、JHDL (Java Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby Hardware Description Language) etc., VHDL (Very-High-Speed are most generally used at present Integrated Circuit Hardware Description Language) and Verilog.Those skilled in the art also should This understands, it is only necessary to method flow slightly programming in logic and is programmed into integrated circuit with above-mentioned several hardware description languages, Can is readily available the hardware circuit for realizing the logical method flow.
Controller can be implemented in any suitable manner, for example, controller can take such as microprocessor or processing Device and storage can by the computer of the computer readable program code (such as software or firmware) of (micro-) computing device Read medium, gate, switch, application specific integrated circuit (Application Specific Integrated Circuit, ASIC), the form of programmable logic controller (PLC) and embedded microcontroller, the example of controller include but is not limited to following microcontroller Device:ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320, are deposited Memory controller is also implemented as a part for the control logic of memory.It is also known in the art that except with Pure computer readable program code mode realized beyond controller, completely can be by the way that method and step is carried out into programming in logic to make Controller is obtained in the form of gate, switch, application specific integrated circuit, programmable logic controller (PLC) and embedded microcontroller etc. to come in fact Existing identical function.Therefore this controller is considered a kind of hardware component, and various for realizing to including in it The device of function can also be considered as the structure in hardware component.Or even, can be by for realizing that the device of various functions regards For that not only can be the software module of implementation method but also can be the structure in hardware component.
System, device, module or the unit that above-described embodiment illustrates, it can specifically be realized by computer chip or entity, Or realized by the product with certain function.One kind typically realizes that equipment is computer.Specifically, computer for example may be used Think personal computer, laptop computer, cell phone, camera phone, smart phone, personal digital assistant, media play It is any in device, navigation equipment, electronic mail equipment, game console, tablet PC, wearable device or these equipment The combination of equipment.
For convenience of description, it is divided into various units during description apparatus above with function to describe respectively.Certainly, this is being implemented The function of each unit can be realized in same or multiple softwares and/or hardware during application.
It should be understood by those skilled in the art that, embodiments of the invention can be provided as method, system or computer program Product.Therefore, the present invention can use the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware Apply the form of example.Moreover, the present invention can use the computer for wherein including computer usable program code in one or more The computer program production that usable storage medium is implemented on (including but is not limited to magnetic disk storage, CD-ROM, optical memory etc.) The form of product.
The present invention is the flow with reference to method according to embodiments of the present invention, equipment (system) and computer program product Figure and/or block diagram describe.It should be understood that can be by every first-class in computer program instructions implementation process figure and/or block diagram Journey and/or the flow in square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided The processors of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce A raw machine so that produced by the instruction of computer or the computing device of other programmable data processing devices for real The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which produces, to be included referring to Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, so as in computer or The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one The step of function of being specified in individual square frame or multiple square frames.
In a typical configuration, computing device includes one or more processors (CPU), input/output interface, net Network interface and internal memory.
Internal memory may include computer-readable medium in volatile memory, random access memory (RAM) and/or The forms such as Nonvolatile memory, such as read-only storage (ROM) or flash memory (flash RAM).Internal memory is computer-readable medium Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method Or technology come realize information store.Information can be computer-readable instruction, data structure, the module of program or other data. The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), moved State random access memory (DRAM), other kinds of random access memory (RAM), read-only storage (ROM), electric erasable Programmable read only memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read-only storage (CD-ROM), Digital versatile disc (DVD) or other optical storages, magnetic cassette tape, the storage of tape magnetic rigid disk or other magnetic storage apparatus Or any other non-transmission medium, the information that can be accessed by a computing device available for storage.Define, calculate according to herein Machine computer-readable recording medium does not include temporary computer readable media (transitory media), such as data-signal and carrier wave of modulation.
It should also be noted that, term " comprising ", "comprising" or its any other variant are intended to nonexcludability Comprising so that process, method, commodity or equipment including a series of elements not only include those key elements, but also wrapping Include the other element being not expressly set out, or also include for this process, method, commodity or equipment intrinsic want Element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that wanted including described Other identical element also be present in the process of element, method, commodity or equipment.
It will be understood by those skilled in the art that embodiments herein can be provided as method, system or computer program product. Therefore, the application can be using the embodiment in terms of complete hardware embodiment, complete software embodiment or combination software and hardware Form.Deposited moreover, the application can use to can use in one or more computers for wherein including computer usable program code The shape for the computer program product that storage media is implemented on (including but is not limited to magnetic disk storage, CD-ROM, optical memory etc.) Formula.
The application can be described in the general context of computer executable instructions, such as program Module.Usually, program module includes performing particular task or realizes routine, program, object, the group of particular abstract data type Part, data structure etc..The application can also be put into practice in a distributed computing environment, in these DCEs, by Task is performed and connected remote processing devices by communication network.In a distributed computing environment, program module can be with In the local and remote computer-readable storage medium including storage device.
Each embodiment in this specification is described by the way of progressive, identical similar portion between each embodiment Divide mutually referring to what each embodiment stressed is the difference with other embodiment.It is real especially for system For applying example, because it is substantially similar to embodiment of the method, so description is fairly simple, related part is referring to embodiment of the method Part explanation.
Embodiments herein is the foregoing is only, is not limited to the application.For those skilled in the art For, the application can have various modifications and variations.All any modifications made within spirit herein and principle, it is equal Replace, improve etc., it should be included within the scope of claims hereof.

Claims (14)

1. a kind of choosing method of project testing, methods described include:
Obtain targeted customer's feature corresponding to the predetermined item for needing progress optional program utilization rate test;
The targeted customer of the predetermined item is tested according to targeted customer's Feature Selection;
The data of the different optional programs of the predetermined item are sent to terminal corresponding to the targeted customer;
Obtain terminal corresponding to the targeted customer and be directed to the data that the optional program is fed back, it is true according to the feedback data The utilization rate of the different optional programs of the fixed predetermined item.
2. according to the method for claim 1, the data of the different optional programs by the predetermined item are sent to institute Terminal corresponding to targeted customer is stated, including:
According to the number of optional program, the targeted customer is divided into multiple packets;
The data of different optional programs are sent to terminal corresponding to the targeted customer of respective packets respectively.
3. method according to claim 1 or 2, described to determine that the difference of the predetermined item is treated according to the feedback data The utilization rate of scheme is selected, including:
When reaching predetermined statistical condition, according to making for the different optional programs of the feedback data statistics predetermined item With rate;
Wherein, the predetermined statistical condition include it is following in one or more:Current time is away to corresponding to targeted customer The time interval that terminal sends data reaches preset value, and the quantity of the feedback data received reaches preset value.
It is 4. according to the method for claim 3, described that the different to be selected of the predetermined item is determined according to the feedback data After the utilization rate of scheme, methods described also includes:
Utilization rate in the different optional programs is defined as to the implementation of the predetermined item more than the optional program of predetermined threshold Scheme.
5. according to the method for claim 1, the acquisition needs to carry out the predetermined item institute of optional program utilization rate test Corresponding targeted customer's feature, including:
Receive the test request for being used to test the different optional program utilization rates of the predetermined item that management terminal is sent;Its In, targeted customer's feature corresponding to the predetermined item is carried in the test request.
6. according to the method for claim 1, targeted customer's feature include it is following in one or more:User's year Age, sex, liveness, investment situation, the information of user's concern, the information of collection.
7. according to the method for claim 1, the predetermined item is application program, and the optional program of the predetermined item is The increment dynamic of the application program is wrapped.
8. a kind of selecting device of project testing, described device include:
Target signature acquisition module, for obtaining the target corresponding to the predetermined item for needing progress optional program utilization rate test User characteristics;
Targeted customer chooses module, for testing the targeted customer of the predetermined item according to targeted customer's Feature Selection;
Data transmission blocks, it is corresponding for the data of the different optional programs of the predetermined item to be sent into the targeted customer Terminal;
Utilization rate determining module, the number for being directed to the optional program for obtaining terminal corresponding to the targeted customer and being fed back According to determining the utilization rates of the different optional programs of the predetermined item according to the feedback data.
9. device according to claim 8, the data transmission blocks, including:
Grouped element, for the number according to optional program, the targeted customer is divided into multiple packets;
Data transmission unit, for being respectively sent to the data of different optional programs corresponding to the targeted customer of respective packets eventually End.
10. device according to claim 8 or claim 9, the utilization rate determining module, reach predetermined statistical condition for working as When, according to the utilization rate of the different optional programs of the feedback data statistics predetermined item;
Wherein, the predetermined statistical condition include it is following in one or more:Current time is away to corresponding to targeted customer The time interval that terminal sends data reaches preset value, and the quantity of the feedback data received reaches preset value.
11. device according to claim 10, described device also include:
Embodiment determining module, the optional program for utilization rate in the different optional programs to be exceeded to predetermined threshold determine For the embodiment of the predetermined item.
12. device according to claim 8, the target signature acquisition module, for receiving the use of management terminal transmission In the test request for the different optional program utilization rates for testing the predetermined item;Wherein, carried in the test request State targeted customer's feature corresponding to predetermined item.
13. device according to claim 8, targeted customer's feature include it is following in one or more:User's year Age, sex, liveness, investment situation, the information of user's concern, the information of collection.
14. device according to claim 8, the predetermined item is application program, the optional program of the predetermined item Wrapped for the increment dynamic of the application program.
CN201710245490.5A 2017-04-14 2017-04-14 The choosing method and device of a kind of project testing Pending CN107402881A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710245490.5A CN107402881A (en) 2017-04-14 2017-04-14 The choosing method and device of a kind of project testing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710245490.5A CN107402881A (en) 2017-04-14 2017-04-14 The choosing method and device of a kind of project testing

Publications (1)

Publication Number Publication Date
CN107402881A true CN107402881A (en) 2017-11-28

Family

ID=60404699

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710245490.5A Pending CN107402881A (en) 2017-04-14 2017-04-14 The choosing method and device of a kind of project testing

Country Status (1)

Country Link
CN (1) CN107402881A (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108399088A (en) * 2018-01-19 2018-08-14 北京奇艺世纪科技有限公司 Page display method, user terminal, page server and style configuration server
CN108446222A (en) * 2018-03-05 2018-08-24 百度在线网络技术(北京)有限公司 Application testing method, device and equipment
CN108664397A (en) * 2018-05-03 2018-10-16 北京奇虎科技有限公司 A kind of user's shunt method and device for application test
CN108874660A (en) * 2018-05-03 2018-11-23 北京奇虎科技有限公司 A kind of application testing method and device
CN109299014A (en) * 2018-09-28 2019-02-01 北京云测信息技术有限公司 A method of the adjust automatically flow in version test
CN110018952A (en) * 2018-01-10 2019-07-16 武汉斗鱼网络科技有限公司 A kind of test method, storage medium, equipment and the system of JS code
CN110058992A (en) * 2018-12-25 2019-07-26 阿里巴巴集团控股有限公司 A kind of official documents and correspondence template staining effect method, apparatus and electronic equipment
CN110245070A (en) * 2019-05-07 2019-09-17 平安科技(深圳)有限公司 Test user's screening technique, device, computer equipment and storage medium
CN110290024A (en) * 2019-06-26 2019-09-27 北京百度网讯科技有限公司 The online preceding test method of strategy, device and equipment
CN111294253A (en) * 2020-01-15 2020-06-16 腾讯科技(深圳)有限公司 Test data processing method and device, computer equipment and storage medium
CN111352678A (en) * 2018-12-20 2020-06-30 阿里巴巴集团控股有限公司 Information processing method and device
CN111352624A (en) * 2018-12-20 2020-06-30 阿里巴巴集团控股有限公司 Interface display method, information processing method and device
CN111679986A (en) * 2020-06-11 2020-09-18 湖南快乐阳光互动娱乐传媒有限公司 Software testing method and device and electronic equipment
CN111950821A (en) * 2019-05-15 2020-11-17 腾讯科技(深圳)有限公司 Test method, test device and server
CN112579422A (en) * 2019-09-27 2021-03-30 腾讯科技(深圳)有限公司 Scheme testing method and device, server and storage medium
CN113254349A (en) * 2021-06-22 2021-08-13 中国平安人寿保险股份有限公司 AB test processing method, device, equipment and storage medium based on cloud function
CN113791975A (en) * 2021-08-25 2021-12-14 网易(杭州)网络有限公司 Game testing method and device, computer equipment and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104102576A (en) * 2013-04-12 2014-10-15 阿里巴巴集团控股有限公司 Multi-version test method and device
US20150026522A1 (en) * 2013-07-19 2015-01-22 Dawnray Young Systems and methods for mobile application a/b testing
CN104462116A (en) * 2013-09-17 2015-03-25 腾讯科技(深圳)有限公司 Data selecting method and device
CN104866484A (en) * 2014-02-21 2015-08-26 阿里巴巴集团控股有限公司 Data processing method and device
CN104881734A (en) * 2015-05-11 2015-09-02 广东小天才科技有限公司 Method, device and system for guiding product improvement based on gray release
CN105099988A (en) * 2014-04-24 2015-11-25 阿里巴巴集团控股有限公司 Method used for supporting gray releasing, access method, devices and system
CN106096021A (en) * 2016-06-24 2016-11-09 合信息技术(北京)有限公司 A kind of static page gray scale dissemination method and system
CN106202088A (en) * 2015-05-04 2016-12-07 阿里巴巴集团控股有限公司 A kind of method and system mating business scenario

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104102576A (en) * 2013-04-12 2014-10-15 阿里巴巴集团控股有限公司 Multi-version test method and device
US20150026522A1 (en) * 2013-07-19 2015-01-22 Dawnray Young Systems and methods for mobile application a/b testing
CN104462116A (en) * 2013-09-17 2015-03-25 腾讯科技(深圳)有限公司 Data selecting method and device
CN104866484A (en) * 2014-02-21 2015-08-26 阿里巴巴集团控股有限公司 Data processing method and device
CN105099988A (en) * 2014-04-24 2015-11-25 阿里巴巴集团控股有限公司 Method used for supporting gray releasing, access method, devices and system
CN106202088A (en) * 2015-05-04 2016-12-07 阿里巴巴集团控股有限公司 A kind of method and system mating business scenario
CN104881734A (en) * 2015-05-11 2015-09-02 广东小天才科技有限公司 Method, device and system for guiding product improvement based on gray release
CN106096021A (en) * 2016-06-24 2016-11-09 合信息技术(北京)有限公司 A kind of static page gray scale dissemination method and system

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110018952A (en) * 2018-01-10 2019-07-16 武汉斗鱼网络科技有限公司 A kind of test method, storage medium, equipment and the system of JS code
CN110018952B (en) * 2018-01-10 2022-12-27 武汉斗鱼网络科技有限公司 JS code testing method, JS code storage medium, JS code testing equipment and JS code testing system
CN108399088A (en) * 2018-01-19 2018-08-14 北京奇艺世纪科技有限公司 Page display method, user terminal, page server and style configuration server
CN108446222A (en) * 2018-03-05 2018-08-24 百度在线网络技术(北京)有限公司 Application testing method, device and equipment
CN108664397A (en) * 2018-05-03 2018-10-16 北京奇虎科技有限公司 A kind of user's shunt method and device for application test
CN108874660A (en) * 2018-05-03 2018-11-23 北京奇虎科技有限公司 A kind of application testing method and device
CN109299014A (en) * 2018-09-28 2019-02-01 北京云测信息技术有限公司 A method of the adjust automatically flow in version test
CN109299014B (en) * 2018-09-28 2021-10-08 北京云测信息技术有限公司 Method for automatically adjusting flow in version test
CN111352678A (en) * 2018-12-20 2020-06-30 阿里巴巴集团控股有限公司 Information processing method and device
CN111352624A (en) * 2018-12-20 2020-06-30 阿里巴巴集团控股有限公司 Interface display method, information processing method and device
CN110058992A (en) * 2018-12-25 2019-07-26 阿里巴巴集团控股有限公司 A kind of official documents and correspondence template staining effect method, apparatus and electronic equipment
CN110058992B (en) * 2018-12-25 2023-10-27 创新先进技术有限公司 Text template effect feedback method and device and electronic equipment
CN110245070A (en) * 2019-05-07 2019-09-17 平安科技(深圳)有限公司 Test user's screening technique, device, computer equipment and storage medium
CN111950821A (en) * 2019-05-15 2020-11-17 腾讯科技(深圳)有限公司 Test method, test device and server
CN111950821B (en) * 2019-05-15 2023-07-25 腾讯科技(深圳)有限公司 Test method, device and server
CN110290024A (en) * 2019-06-26 2019-09-27 北京百度网讯科技有限公司 The online preceding test method of strategy, device and equipment
CN112579422A (en) * 2019-09-27 2021-03-30 腾讯科技(深圳)有限公司 Scheme testing method and device, server and storage medium
CN111294253A (en) * 2020-01-15 2020-06-16 腾讯科技(深圳)有限公司 Test data processing method and device, computer equipment and storage medium
CN111679986A (en) * 2020-06-11 2020-09-18 湖南快乐阳光互动娱乐传媒有限公司 Software testing method and device and electronic equipment
CN111679986B (en) * 2020-06-11 2023-09-22 湖南快乐阳光互动娱乐传媒有限公司 Software testing method and device and electronic equipment
CN113254349A (en) * 2021-06-22 2021-08-13 中国平安人寿保险股份有限公司 AB test processing method, device, equipment and storage medium based on cloud function
CN113791975A (en) * 2021-08-25 2021-12-14 网易(杭州)网络有限公司 Game testing method and device, computer equipment and storage medium
CN113791975B (en) * 2021-08-25 2023-09-12 网易(杭州)网络有限公司 Game testing method, game testing device, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
CN107402881A (en) The choosing method and device of a kind of project testing
CN107040582A (en) A kind of data processing method and device
CN107644286A (en) Workflow processing method and device
CN107844400A (en) The method of calibration and device of a kind of daily record data
CN103959745B (en) The method and apparatus of supervision application program resource consumption
CN109657138A (en) A kind of video recommendation method, device, electronic equipment and storage medium
CN110889039B (en) Method and device for pushing books in reading application
CN108282518A (en) A kind of customer terminal webpage generation method and device
CN109598576A (en) Service recommendation method, device and equipment
CN107678938A (en) The adjustment method and equipment of a kind of application program
CN107644100A (en) Information processing method, device and system and computer-readable recording medium
CN110018920A (en) A kind of detection method, device and the equipment of page presentation exception
CN108228861A (en) For performing the method and system of the Feature Engineering of machine learning
WO2012024311A1 (en) Placement of hyperlinks in documents
CN108207119A (en) To damaging the identification based on machine learning of network connection
CN108491326A (en) Behavioral test recombination method, device and storage medium
CN110244899A (en) Electronic contract on-line processing method, Online Processing System and terminal
CN106161627A (en) Method and device for pushed information
CN107273300A (en) A kind of applied program testing method and device
CN109117442A (en) A kind of application recommended method and device
CN109460546A (en) List generation method, device and electronic equipment
CN108363578A (en) Application program packaging method, electronic device and computer storage media
CN107092678A (en) A kind of method, device and equipment for obtaining application active degree
CN109002385A (en) Method for testing pressure and device for data flow system
CN110298007A (en) User behavior statistical method, device, electronic equipment and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20200921

Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands

Applicant after: Innovative advanced technology Co.,Ltd.

Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands

Applicant before: Advanced innovation technology Co.,Ltd.

Effective date of registration: 20200921

Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands

Applicant after: Advanced innovation technology Co.,Ltd.

Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands

Applicant before: Alibaba Group Holding Ltd.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20171128