CN106911515A - Method of testing and device based on user grouping - Google Patents
Method of testing and device based on user grouping Download PDFInfo
- Publication number
- CN106911515A CN106911515A CN201710166597.0A CN201710166597A CN106911515A CN 106911515 A CN106911515 A CN 106911515A CN 201710166597 A CN201710166597 A CN 201710166597A CN 106911515 A CN106911515 A CN 106911515A
- Authority
- CN
- China
- Prior art keywords
- packet
- user
- product
- service
- customer identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0893—Assignment of logical groups to network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
Abstract
The present invention provides a kind of method of testing and device based on user grouping, by obtaining the customer identification number for unique mark user identity.User is grouped according to the customer identification number.According to the corresponding service of each packet of group result distribution and/or product, to test the allocated service of each packet and/or product.Thus, it is possible to be grouped to user uniformly at random, reduce the influence that user's difference is produced to evaluating result, the contrast test assessment result for obtaining has good representativeness and accuracy.
Description
Technical field
The present invention relates to internet works software technical field, in particular to a kind of method of testing based on user grouping
And device.
Background technology
AB tests are a kind of products perfection methods, while allowing a certain proportion of sampling client to different services and/or product
Product, or the different editions (A/B/n) of same service and/or product conduct interviews, and then compare the service of each group correspondence distribution
And/or the actual effect of product, the best service of last Selection effect and/or product are formally distributed to whole clients.
In now with technology, the contrast test that region or time period are grouped is mainly based upon.Because different regions are used
The behavioural characteristic at family, economic setting, use habit is different, and the user behavior of different time sections there is also difference, based on region
Or the contrast test that the time period is grouped, it is difficult to ensure the accuracy of test result.And the use based on region or time period
Family is grouped, it is difficult to accomplish for different types of user to be assigned randomly to each packet, the test result randomness for obtaining and representative
Property is poor.
The content of the invention
In order to overcome above-mentioned deficiency of the prior art, the present invention to provide a kind of method of testing and dress based on user grouping
Put, it is grouped at random according to customer identification number to user, thus obtained product test assessment result has good generation
Table and accuracy.
The first object of the present invention is to provide a kind of method of testing based on user grouping, and methods described includes：
Obtain the customer identification number for unique mark user identity；
User is grouped according to the customer identification number；
According to the corresponding service of each packet of group result distribution and/or product, so as to the clothes allocated to each packet
Business and/or product are tested.
The second object of the present invention is to provide a kind of test device based on user grouping, and described device includes：
Acquisition module, for obtaining the customer identification number for unique mark user identity；
Grouping module, for being grouped to user according to the customer identification number；
Distribute module, for according to the corresponding service of each packet of group result distribution and/or product, so as to each point
The allocated service of group and/or product are tested.
In terms of existing technologies, the invention has the advantages that：
The present invention provides a kind of method of testing and device based on user grouping, and unique mark user's body is used for by obtaining
The customer identification number of part.User is grouped according to the customer identification number.It is right according to each packet of group result distribution
The service answered and/or product, to test the allocated service of each packet and/or product.Thereby, it is possible to random uniform
Ground is grouped to user, reduces the influence that user's difference is produced to evaluating result, and the contrast test assessment result for obtaining has
Good representativeness and accuracy.
Brief description of the drawings
Technical scheme in order to illustrate more clearly the embodiments of the present invention, below will be attached to what is used needed for embodiment
Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, thus be not construed as it is right
The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, can also be according to this
A little accompanying drawings obtain other related accompanying drawings.
Fig. 1 is the block diagram of the server that present pre-ferred embodiments are provided.
One of the step of Fig. 2 is the method for testing based on user grouping of first embodiment of the invention offer flow chart.
Fig. 3 is the sub-step flow chart of the step S110 shown in Fig. 2 that first embodiment of the invention is provided.
Fig. 4 is the sub-step flow chart of the step S120 shown in Fig. 2 that first embodiment of the invention is provided.
Fig. 5 is the sub-step flow chart of the step S130 shown in Fig. 2 that first embodiment of the invention is provided.
The two of the step of Fig. 6 is the method for testing based on user grouping of first embodiment of the invention offer flow chart.
The functional block diagram of the test device based on user grouping that Fig. 7 is provided for second embodiment of the invention.
The sub-function module figure of the grouping module that Fig. 8 is provided for second embodiment of the invention.
The sub-function module figure of the distribute module that Fig. 9 is provided for second embodiment of the invention.
Icon：100- servers；110- memories；120- processors；130- mixed-media network modules mixed-medias；200- is based on user grouping
Test device；210- acquisition modules；220- grouping modules；222- determination sub-modules；224- calculating sub modules；226- is grouped submodule
Block；228- first preserves submodule；230- distribute modules；231- acquisition submodules；233- distribution sub modules；235- second is preserved
Submodule；237- setting up submodule；240- test modules；250- selecting modules.
Specific embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
A part of embodiment of the present invention, rather than whole embodiments.Present invention implementation generally described and illustrated in accompanying drawing herein
The component of example can be arranged and designed with a variety of configurations.Based on the embodiment in the present invention, ordinary skill
The every other embodiment that personnel are obtained under the premise of creative work is not made, belongs to the scope of protection of the invention.
Based on the embodiment in the present invention, it is all that those of ordinary skill in the art are obtained under the premise of creative work is not made
Other embodiment, belongs to the scope of protection of the invention.
It should be noted that：Similar label and letter represents similar terms in following accompanying drawing, therefore, once a certain Xiang Yi
It is defined in individual accompanying drawing, then it need not be further defined and explained in subsequent accompanying drawing.Additionally, term " the
One ", " second " etc. is only used for distinguishing description, and it is not intended that indicating or implying relative importance.
The present invention provides a kind of method of testing based on user grouping, and methods described is applied to server 100, refer to figure
1, Fig. 1 is the block diagram of the server 100 that present pre-ferred embodiments are provided.The server 100 includes memory
110th, the test device 200 based on user grouping, processor 120 and mixed-media network modules mixed-media 130.
The memory 110, processor 120 and mixed-media network modules mixed-media 130 are directly or indirectly electrically connected with each other, with reality
The transmission or interaction of existing data.For example, these elements can be realized by one or more communication bus or holding wire each other
It is electrically connected with.Be stored with the test device 200 based on user grouping in memory 110, the test dress based on user grouping
Put 200 include at least one the memory 110 can be stored in the form of software or firmware (firmware) in software work(
Can module, software program and module of the processor 120 by operation storage in memory 110, so as to perform various
Application of function and data processing.
Wherein, the memory 110 may be, but not limited to, random access memory (Random Access
Memory, RAM), read-only storage (Read Only Memory, ROM), programmable read only memory (Programmable
Read-Only Memory, PROM), erasable read-only memory (Erasable Programmable Read-Only
Memory, EPROM), electricallyerasable ROM (EEROM) (Electric Erasable Programmable Read-Only
Memory, EEPROM) etc..Wherein, memory 110 be used for storage program, the processor 120 after execute instruction is received,
Perform described program.Further, the software program and module in above-mentioned memory 110 may also include operating system, and it can
Including the various component softwares for management system task (such as memory management, storage device control, power management etc.) and/or
Drive, and can be in communication with each other with various hardware or component software, so as to provide the running environment of other software component.
The processor 120 can be a kind of IC chip, the disposal ability with signal.Above-mentioned processor
120 can be general processor, including central processing unit (Central Processing Unit, CPU), network processing unit
(Network Processor, NP) etc..Can realize or perform disclosed each method in the embodiment of the present invention, step and
Logic diagram.General processor can be microprocessor or the processor can also be any conventional processor etc..
Mixed-media network modules mixed-media 130 is used for the communication connection set up between server 100 and user terminal by network.
It is appreciated that the structure described in Fig. 1 is only to illustrate, server 100 may also include more more than shown in Fig. 1 or more
Few component, or with the configuration different from shown in Fig. 1.Each component shown in Fig. 1 can use hardware, software or its group
Close and realize.
First embodiment
Refer to Fig. 2, Fig. 2 be first embodiment of the invention provide the method for testing based on user grouping the step of flow
One of figure.
The method of testing idiographic flow based on user grouping is described in detail below.
Step S110, obtains the customer identification number for unique mark user identity.
In the present embodiment, the customer identification number is used to carry out unique mark to user identity.The customer identification number
It is the character string that can be identified by server 100, calculated for a string, server 100 is carried out at calculating by customer identification number
Manage to complete the packet to user.
Fig. 3 is referred to, Fig. 3 is the sub-step flow chart of the step S110 shown in Fig. 2 that first embodiment of the invention is provided.
Step S110 includes sub-step S111, sub-step S113 and sub-step S115.
Sub-step S111, obtains the customer identification information for accessing user.
In the present embodiment, server 100 obtains the customer identification information for accessing the user terminal that user is used, described
User terminal can be mobile device (such as, mobile phone), PC equipment etc..The customer identification information may be, but not limited to, and use
The MAC Address of family terminal, sequence number (sequence number when such as, mobile phone dispatches from the factory) of user terminal etc. uniquely can enter to user identity
The identification information of line identifier.
In the present embodiment, when user is connected to network, during request web services, server 100 can be known to the user of user
Other information is obtained.
Sub-step S113, the customer identification information is converted, and obtains the corresponding customer identification number of the user.
In the present embodiment, because the customer identification information of different user has a larger difference, server 100 need to
Family identification information is converted, and customer identification information is converted into the customer identification number that server 100 can be identified, calculate
(the computable character string of server 100).
Sub-step S115, the customer identification number is saved in database.
In the present embodiment, the customer identification number is saved in database, in order to carry out packet transaction to user.
Step S120, is grouped according to the customer identification number to user.
Fig. 4 is referred to, Fig. 4 is the sub-step flow chart of the step S120 shown in Fig. 2 that first embodiment of the invention is provided.
The step S120 includes sub-step S121, sub-step S123, sub-step S125 and sub-step S127.
Sub-step S121, hash algorithm is determined according to default packet configuration ratio.
In the present embodiment, the default packet configuration ratio can the specific setting of situation according to the actual requirements, according to different
Default packet configuration ratio, it is necessary to corresponding hash algorithm is calculated, to complete the packet to user.Below by illustrating
It is bright：
Default packet configuration ratio if necessary to carry out average packet, i.e. two groups of A, B to user is 50%:50%, then it is right
The hash algorithm answered can be set as, but be not limited to：Customer identification number mod 2.
In the present embodiment, mod is integer modulo operation, i.e. dividend divided by the remainder after divisor, such as 10 mod 3
=1,20 mod 6=2 etc..
In the present embodiment, hash algorithm (Hash) is also referred to as doing hashing algorithm, and exactly the input value of random length is led to
Hashing algorithm is crossed, the output valve of regular length is transformed into, the output valve is exactly hashed value.This conversion is a kind of compression mapping,
Namely the space of hashed value is generally much less than the space of input value, and different input values may hash to identical output
Value.It is exactly briefly a kind of letter of the eap-message digest data that the message data of random length is compressed to a certain regular length
Number.
Sub-step S123, carries out being calculated corresponding hashed value according to the hash algorithm to the customer identification number.
In the present embodiment, if the default packet configuration ratio of two groups of A, B is 50%:50%, then corresponding hash algorithm
May be set to：Customer identification number mod 2.It is 0 or 1 with this hashed value for obtaining.
In the present embodiment, the default packet configuration ratio if necessary to two groups of A, B of control is different, can be according to preset configuration
The setting situation of ratio chooses divisor, and customer identification number is carried out into complementation computing (mod computings) to the divisor chosen.For example, will use
Family identification number mod 10 can obtain the hashed value of 0-9.
Sub-step S125, is grouped than corresponding hash rule based on the default packet configuration to the hashed value,
Obtain group result.
In the present embodiment, if the default packet configuration ratio of two groups of A, B is 50%:50%, corresponding hash algorithm is：With
Family identification number mod 2, the hashed value for obtaining is 0 or 1.The user that hashed value is 0 is assigned into A groups, by the user that hashed value is 1
Assign to B groups, it is possible to achieve user is evenly distributed.
In the present embodiment, if the default packet configuration ratio of two groups of A, B is 10%:90%, corresponding hash algorithm is：With
Family identification number mod 10, can obtain the hashed value of 0-9.Can be 0 to be divided into A groups by hashed value, hashed value is divided into B groups for 1-9's.
Sub-step S127, each corresponding group name information of packet and configuration are saved in packet configuration file than information.
In the present embodiment, the packet configuration file be stored with each packet group name information, and and each group it is right
The default packet configuration percent information answered (such as, how many ratio is A groups, and how many ratio are B groups).The group name information is just
Made a distinction in each packet, the group name information of each packet can be set using artificial mode.
In the present embodiment, the packet configuration file can use .xml files.Xml is extensible markup language (mark
The subset of quasi- generalized markup language), it is a kind of simple data storage language, using a series of simple mark description data,
It is extremely simple and be easy to grasp and use and these marks can be set up with convenient mode.
Step S130, according to the corresponding service of each packet of group result distribution and/or product, so as to each packet quilt
The service of distribution and/or product are tested.
Fig. 5 is referred to, Fig. 5 is the sub-step flow chart of the step S130 shown in Fig. 2 that first embodiment of the invention is provided.
The step S130 includes sub-step S131, sub-step S133, sub-step S135 and sub-step S137.
Sub-step S131, the packet where obtaining user.
In the present embodiment, believed by asking a web services (such as, abGroup is serviced) to obtain user grouping result
Breath, to obtain the grouping information where user.
Sub-step S133, based on the packet where the user, is calculated by the corresponding default proposed algorithm of the packet
Service and/or product for grouping user distribution.
In the present embodiment, each packet configuration has corresponding default proposed algorithm, with the service to different editions and/or
Product is recommended.Because the corresponding default proposed algorithm of each packet is different, it is achieved in recommending not different grouping user
Same service and/or product.
In the present embodiment, the service and/or product may be, but not limited to, UI (User Interface, Yong Hujie
Face) and recommendation list.UI refers to the operation interface of user, and UI designs refer mainly to the pattern and aesthetic measure at interface.Recommendation list
Refer to recommending the product list of user's access, for example, being " inventory must be bought ", " happiness of user's recommendation in Taobao interface
The recommended products list informations such as love inventory ".
In the present embodiment, be different grouping distribution service and/or product can be it is similar service and/or product not
Same version, is legacy version of the B component with UI for example, being redaction of the component A with UI, or, it is that component A matches somebody with somebody first version
Recommendation list, is recommendation list of the B component with the second edition；Can also be inhomogeneous service and/or product, for example, being A groups
Distribution UI, is that B component matches somebody with somebody recommendation list.Be different grouping distribution UI and recommendation list according to different default proposed algorithm meters
Obtain, the default proposed algorithm can be set according to the actual requirements.
Sub-step S135, is saved in each packet right respectively by the recommended service of each packet correspondence and/or product information
In the recommended configuration file answered.
In the present embodiment, each packet one recommended configuration file of correspondence, the recommended configuration file is used to store each
The recommended service of packet and/or product information.The recommended configuration file is deposited in database.
Sub-step S137, sets up and indicates configuration file.
In the present embodiment, the instruction configuration file each corresponding recommended configuration file of packet that is stored with is stored in number
According to the positional information in storehouse.The instruction configuration file plays lookup indicative function, is easy to the recommended configuration being grouped to each
File is searched.
Refer to Fig. 6, Fig. 6 be first embodiment of the invention provide the method for testing based on user grouping the step of flow
The two of figure.Methods described also includes step S140 and step S150.
Step S140, service and/or product to distributing to each packet are tested, to every kind of service and/or product
Effect be estimated, obtain the assessment result of each packet.
In the present embodiment, the described pair of service for distributing to each packet and/or product carry out test and refer to：Each
The user that the service of packet and/or product are distributed to the packet uses, and gathers multiple users of the packet to allocated clothes
Business and/or the service condition of product, in order to carry out follow-up recruitment evaluation.
In the present embodiment, server 100 obtains the user of each packet to the service being allocated and/or the access of product
Daily record behavior and/or Consumer's Experience evaluation.Evaluation index is obtained according to the access log behavior and/or Consumer's Experience evaluation.
The effect of every kind of service and/or product is estimated based on evaluation index.The evaluation index can include click volume, use
At least one in duration, conversion ratio and user satisfaction.
In the present embodiment, the Consumer's Experience evaluation can be server 100 provide a user with to be allocated clothes
The experience scoring of business and/or product.Server 100 is scored by the experience of user and can obtained to distributing to the user
Service and/or product user satisfaction situation.
Step S150, selection assessment result reaches the service of default evaluation criteria and/or product is distributed to all users.
In the present embodiment, the situation that the described pair of service for reaching default evaluation criteria and/or product are issued includes：
Certain group service best to assessment result and/or product are issued, are carried out group to optimal service in multiple packet and/or product
Close issue and to multiple packet in without maintain close ties with and influence each other service and/or product be combined issue etc..
Illustrated below by citing.
1. the situation that pair assessment result best certain group service and/or product is issued：
Purchase conversion ratio=(user numbers of user number/all access products of purchase product) × 100%.For example, A
The recommended service of group and/or purchase conversion ratio=(the 10/1000) × 100%=1% of product；The recommended service of B groups and/or product
The purchase conversion ratio of product=(30/1000) × 100%=3%.It can thus be appreciated that the recommended service of B groups and/or Product evaluation effect
Fruit is better than A groups.After testing assessment, the corresponding recommended service of B groups and/or product should be distributed to all users.
2. optimal service and/or product are combined issue in pair multiple packets：
For example, A groups have used the V1.1 versions of 1 service and the V1.1 versions of 2 services；B groups have used V1.2 editions of 1 service
Sheet and the V1.2 versions of 2 services.By after test and recruitment evaluation, assessment result it is optimal be 1 service V1.1 versions and 2 clothes
The V1.2 versions of business, then can be combined issue to the V1.2 versions of the V1.1 versions of 1 service and 2 services.
3. pair in multiple packets without maintaining close ties with and the service of influencing each other and/or product are combined issue：
For example, being obtained by test and recruitment evaluation：A groups 1 service 2 services with B groups, or the service of A groups 1 and A groups 3
Do not maintained close ties between service and influenced each other, then 1 service can be combined hair with 2 services or 1 service with 3 services
Cloth.
In the present embodiment, the service and/or product for distributing to each packet may be, but not limited to, different service and/
Or the different editions of product, service of the same race and/or product etc..
Second embodiment
Refer to Fig. 7, the function of the test device 200 based on user grouping that Fig. 7 is provided for second embodiment of the invention
Module map.Described device includes：, acquisition module 210, grouping module 220, distribute module 230, test module 240 and selection mould
Block 250.
Acquisition module 210, for obtaining the customer identification number for unique mark user identity.
In the present embodiment, acquisition module 210 is used to perform the step S110 in Fig. 2, on the acquisition module 210
Specific descriptions are referred to the description of step S110 in Fig. 2.
Grouping module 220, for being grouped to user according to the customer identification number.
Refer to Fig. 8, the sub-function module figure of the grouping module 220 that Fig. 8 is provided for second embodiment of the invention.Described point
Group module 220 includes that determination sub-module 222, calculating sub module 224, packet submodule 226 and first preserve submodule 228.
Determination sub-module 222, for determining hash algorithm according to default packet configuration ratio.
In the present embodiment, determination sub-module 222 is used to perform the sub-step S121 in Fig. 4, on the determination submodule
The specific descriptions of block 222 are referred to the description of step S121 in Fig. 4.
Calculating sub module 224, it is corresponding for the customer identification number be calculated according to the hash algorithm
Hashed value.
In the present embodiment, calculating sub module 224 is used to perform the sub-step S123 in Fig. 4, on the calculating submodule
The specific descriptions of block 224 are referred to the description of step S123 in Fig. 4.
Packet submodule 226, for being entered to the hashed value than corresponding hash rule based on the default packet configuration
Row packet, obtains group result.
In the present embodiment, packet submodule 226 is used to perform the sub-step S125 in Fig. 4, on the packet submodule
The specific descriptions of block 226 are referred to the description of step S125 in Fig. 4.
First preserves submodule 228, for each corresponding group name information of packet and configuration to be saved in into packet than information
In configuration file.
In the present embodiment, the first preservation submodule 228 is used to perform the sub-step S127 in Fig. 4, on described first
The specific descriptions for preserving submodule 228 are referred to the description of step S127 in Fig. 4.
Distribute module 230, for according to the corresponding service of each packet of group result distribution and/or product, so as to right
The allocated service of each packet and/or product are tested.
Refer to Fig. 9, the sub-function module figure of the distribute module 230 that Fig. 9 is provided for second embodiment of the invention.Described point
Include that acquisition submodule 231, distribution sub module 233 and second preserve submodule 235 with module 230.
Acquisition submodule 231, the packet where for obtaining user.
In the present embodiment, acquisition submodule 231 is used to perform the sub-step S131 in Fig. 5, on the acquisition submodule
The specific descriptions of block 231 are referred to the description of step S131 in Fig. 5.
Distribution sub module 233, for based on the packet where the user, by the corresponding default proposed algorithm of the packet
Calculate the service for grouping user distribution and/or product.
In the present embodiment, distribution sub module 233 is used to perform the sub-step S133 in Fig. 5, on the distribution submodule
The specific descriptions of block 233 are referred to the description of step S133 in Fig. 5.
Second preserves submodule 235, for each corresponding recommended service of packet and/or product information to be protected respectively
It is stored in the corresponding recommended configuration file of each packet.
In the present embodiment, the second preservation submodule 235 is used to perform the sub-step S135 in Fig. 5, on described second
The specific descriptions for preserving submodule 235 are referred to the description of step S135 in Fig. 5.
Setting up submodule 237, configuration file is indicated for setting up.
In the present embodiment, setting up submodule 237 is used to perform the sub-step S137 in Fig. 5, and submodule is set up on described
The specific descriptions of block 237 are referred to the description of step S137 in Fig. 5.
Test module 240, for recommend each packet service and/or product test, to it is every kind of service and/
Or the effect of product is estimated, the Evaluated effect of each packet is obtained.
In the present embodiment, test module 240 is used to perform the step S140 in Fig. 6, on the test module 240
Specific descriptions are referred to the description of step S140 in Fig. 6.
Selecting module 250, all users are distributed to for the service for selecting Evaluated effect best and/or product version.
In the present embodiment, selecting module 250 is used to perform the step S150 in Fig. 6, on the selecting module 250
Specific descriptions are referred to the description of step S150 in Fig. 6.
In sum, the present invention provides a kind of method of testing and device based on user grouping, by obtaining for unique
Identify the customer identification number of user identity.User is grouped according to the customer identification number.According to the group result point
With the corresponding service of each packet and/or product, to test the allocated service of each packet and/or product.
The method and device that the present invention is provided can be grouped to user uniformly at random, reduce user's difference to test and appraisal
Resulting influence, the contrast test assessment result for obtaining has good representativeness and accuracy.Also, recommend calculating
When service and/or product, it is only necessary to calculate and store for A groups or B groups user distribution, reduce the calculating time, save storage
Space.
The preferred embodiments of the present invention are the foregoing is only, is not intended to limit the invention, for the skill of this area
For art personnel, the present invention can have various modifications and variations.It is all within the spirit and principles in the present invention, made any repair
Change, equivalent, improvement etc., should be included within the scope of the present invention.
Claims (12)
1. a kind of method of testing based on user grouping, it is characterised in that methods described includes：
Obtain the customer identification number for unique mark user identity；
User is grouped according to the customer identification number；
According to the group result distribution corresponding service of each packet and/or product, so as to the allocated service of each packet and/
Or product is tested.
2. method according to claim 1, it is characterised in that described to be grouped to user according to the customer identification number
The step of include：
Hash algorithm is determined according to default packet configuration ratio；
The customer identification number is carried out according to the hash algorithm be calculated corresponding hashed value；
The hashed value is grouped than corresponding hash rule based on the default packet configuration, group result is obtained.
3. method according to claim 2, it is characterised in that described corresponding according to each packet of group result distribution
The step of service and/or product, includes：
Packet where obtaining user；
Based on the packet where the user, calculated as the grouping user is distributed by the corresponding default proposed algorithm of the packet
Service and/or product, wherein, each packet configuration has corresponding default proposed algorithm, with to different services and/or product
It is allocated.
4. the method according to any one in claim 1-3, it is characterised in that the acquisition is used for unique mark user
The step of customer identification number of identity, includes：
Obtain the customer identification information for accessing user；
The customer identification information is converted, the corresponding customer identification number of the user is obtained.
5. the method according to any one in claim 1-3, it is characterised in that methods described also includes：
Service and/or product to distributing to each packet are tested, and the effect to every kind of service and/or product is commented
Estimate, obtain the assessment result of each packet；
Selection assessment result reaches the service of default evaluation criteria and/or product is distributed to all users.
6. method according to claim 5, it is characterised in that service and/or product to distributing to each packet are carried out
Test, is estimated to every kind of service and/or the effect of product, includes the step of the assessment result for obtaining each packet：
The user of each packet is obtained to the service being allocated and/or the access log behavior and/or Consumer's Experience evaluation of product；
Evaluation index is obtained according to the access log behavior and/or Consumer's Experience evaluation；
The effect of every kind of service and/or product is estimated based on evaluation index, wherein, the evaluation index includes clicking on
Measure, use at least one in duration, conversion ratio and user satisfaction.
7. a kind of test device based on user grouping, it is characterised in that described device includes：
Acquisition module, for obtaining the customer identification number for unique mark user identity；
Grouping module, for being grouped to user according to the customer identification number；
Distribute module, for according to the corresponding service of each packet of group result distribution and/or product, so as to each packet quilt
The service of distribution and/or product are tested.
8. device according to claim 7, it is characterised in that the grouping module includes：
Determination sub-module, for determining hash algorithm according to default packet configuration ratio；
Calculating sub module, for carrying out being calculated corresponding hashed value to the customer identification number according to the hash algorithm；
Packet submodule, for being grouped to the hashed value than corresponding hash rule based on the default packet configuration,
Obtain group result.
9. device according to claim 8, it is characterised in that the distribute module includes：
Acquisition submodule, the packet where for obtaining user；
Distribution sub module, for based on the packet where the user, being calculated by the corresponding default proposed algorithm of the packet
Service and/or product for grouping user distribution, wherein, each packet configuration has corresponding default proposed algorithm, with to not
Same service and/or product is allocated.
10. the device according to any one in claim 7-9, it is characterised in that the acquisition module is obtained for only
The mode of the customer identification number of one mark user identity includes：
Obtain the customer identification information for accessing user；
The customer identification information is converted, the corresponding customer identification number of the user is obtained.
11. device according to any one in claim 7-9, it is characterised in that described device also includes:
Test module, for testing the service and/or product of distributing to each packet, to every kind of service and/or product
Effect be estimated, obtain the assessment result of each packet；
Selecting module, for selecting, assessment result reaches the service of default evaluation criteria and/or product is distributed to all users.
12. devices according to claim 11, it is characterised in that the test module is to distributing to the service that each is grouped
And/or product is tested, the effect to every kind of service and/or product is estimated, and obtains the side of the assessment result of each packet
Formula includes：
The user of each packet is obtained to the service being allocated and/or the access log behavior and/or Consumer's Experience evaluation of product；
Evaluation index is obtained according to the access log behavior and/or Consumer's Experience evaluation；
The effect of every kind of service and/or product is estimated based on evaluation index, wherein, the evaluation index includes clicking on
Measure, use at least one in duration, conversion ratio and user satisfaction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710166597.0A CN106911515A (en) | 2017-03-20 | 2017-03-20 | Method of testing and device based on user grouping |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710166597.0A CN106911515A (en) | 2017-03-20 | 2017-03-20 | Method of testing and device based on user grouping |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106911515A true CN106911515A (en) | 2017-06-30 |
Family
ID=59193795
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710166597.0A Pending CN106911515A (en) | 2017-03-20 | 2017-03-20 | Method of testing and device based on user grouping |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106911515A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109672705A (en) * | 2017-10-16 | 2019-04-23 | 阿里巴巴集团控股有限公司 | A kind of client release selection method, apparatus and system |
| CN109995798A (en) * | 2017-12-29 | 2019-07-09 | Tcl集团股份有限公司 | A kind of method and its equipment of information push |
| CN110737699A (en) * | 2019-10-15 | 2020-01-31 | 秒针信息技术有限公司 | User sampling method, device, electronic equipment and storage medium |
| CN111679986A (en) * | 2020-06-11 | 2020-09-18 | 湖南快乐阳光互动娱乐传媒有限公司 | Software testing method and device and electronic equipment |
| CN112052153A (en) * | 2019-06-06 | 2020-12-08 | 腾讯科技（深圳）有限公司 | Product version testing method and device |
| CN113553384A (en) * | 2020-04-23 | 2021-10-26 | 北京三快在线科技有限公司 | Object classification method and device, storage medium and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130030868A1 (en) * | 2011-07-25 | 2013-01-31 | Cbs Interactive, Inc. | Scheduled Split Testing |
| CN104102576A (en) * | 2013-04-12 | 2014-10-15 | 阿里巴巴集团控股有限公司 | Multi-version test method and device |
| CN104281611A (en) * | 2013-07-08 | 2015-01-14 | 阿里巴巴集团控股有限公司 | User flow distribution method and device in website testing system |
| CN104298596A (en) * | 2014-09-30 | 2015-01-21 | 北京金山安全软件有限公司 | Random distribution method and device for test scheme and server |
| US20150227962A1 (en) * | 2014-02-11 | 2015-08-13 | Sears Brands, L.L.C. | A/b testing and visualization |
-
2017
- 2017-03-20 CN CN201710166597.0A patent/CN106911515A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130030868A1 (en) * | 2011-07-25 | 2013-01-31 | Cbs Interactive, Inc. | Scheduled Split Testing |
| CN104102576A (en) * | 2013-04-12 | 2014-10-15 | 阿里巴巴集团控股有限公司 | Multi-version test method and device |
| CN104281611A (en) * | 2013-07-08 | 2015-01-14 | 阿里巴巴集团控股有限公司 | User flow distribution method and device in website testing system |
| US20150227962A1 (en) * | 2014-02-11 | 2015-08-13 | Sears Brands, L.L.C. | A/b testing and visualization |
| CN104298596A (en) * | 2014-09-30 | 2015-01-21 | 北京金山安全软件有限公司 | Random distribution method and device for test scheme and server |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109672705A (en) * | 2017-10-16 | 2019-04-23 | 阿里巴巴集团控股有限公司 | A kind of client release selection method, apparatus and system |
| CN109672705B (en) * | 2017-10-16 | 2022-05-27 | 阿里巴巴集团控股有限公司 | Client version selection method, device and system |
| CN109995798A (en) * | 2017-12-29 | 2019-07-09 | Tcl集团股份有限公司 | A kind of method and its equipment of information push |
| CN109995798B (en) * | 2017-12-29 | 2021-05-04 | Tcl科技集团股份有限公司 | Information pushing method and equipment thereof |
| CN112052153A (en) * | 2019-06-06 | 2020-12-08 | 腾讯科技（深圳）有限公司 | Product version testing method and device |
| CN112052153B (en) * | 2019-06-06 | 2023-05-16 | 腾讯科技（深圳）有限公司 | Product version testing method and device |
| CN110737699A (en) * | 2019-10-15 | 2020-01-31 | 秒针信息技术有限公司 | User sampling method, device, electronic equipment and storage medium |
| CN113553384A (en) * | 2020-04-23 | 2021-10-26 | 北京三快在线科技有限公司 | Object classification method and device, storage medium and electronic equipment |
| CN111679986A (en) * | 2020-06-11 | 2020-09-18 | 湖南快乐阳光互动娱乐传媒有限公司 | Software testing method and device and electronic equipment |
| CN111679986B (en) * | 2020-06-11 | 2023-09-22 | 湖南快乐阳光互动娱乐传媒有限公司 | Software testing method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106911515A (en) | Method of testing and device based on user grouping | |
| US11968105B2 (en) | Systems and methods for social graph data analytics to determine connectivity within a community | |
| US10262145B2 (en) | Systems and methods for security and risk assessment and testing of applications | |
| US20150371163A1 (en) | Churn prediction in a broadband network | |
| CN107908686B (en) | Information pushing method and device, server and readable storage medium | |
| CN102480481B (en) | Method and device for improving security of product user data | |
| CN104102576A (en) | Multi-version test method and device | |
| US20100179927A1 (en) | Rating risk of proposed system changes | |
| CN110648172B (en) | Identity recognition method and system integrating multiple mobile devices | |
| CN106682949A (en) | Service recommending method and service information receiving method, device and system | |
| CN106487939A (en) | A kind of method and apparatus determining User IP subnet, a kind of electronic equipment | |
| CN109978580A (en) | Object recommendation method, apparatus and computer readable storage medium | |
| CN106354622B (en) | Test the methods of exhibiting and device of webpage | |
| US20130304547A1 (en) | Investment valuation projections in an on-demand system | |
| CN107545039B (en) | Keyword index acquisition method and device, computer equipment and storage medium | |
| CN109857791A (en) | A kind of batch data processing method and device | |
| CN104484357B (en) | Data processing method and device and visitation frequency information processing method and device | |
| CN104298596B (en) | Random distribution method and device for test scheme and server | |
| CN107967637A (en) | The recommendation method, apparatus and electronic equipment of a kind of merchandise items model | |
| KR20130091391A (en) | Server and method for recommending contents, and recording medium storing program for executing method of the same in computer | |
| CN110825609A (en) | Service testing method, device and system | |
| US10482279B2 (en) | Pattern-less private data detection on data sets | |
| CN106790160B (en) | Security level identification and method of calibration and device | |
| CN101534227A (en) | Network management software test method and system | |
| CN109981815B (en) | IP address selection method, terminal, server and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170630 |
|
| RJ01 | Rejection of invention patent application after publication |