CN109302301A - A kind of appraisal procedure and device of business game - Google Patents
A kind of appraisal procedure and device of business game Download PDFInfo
- Publication number
- CN109302301A CN109302301A CN201710613409.4A CN201710613409A CN109302301A CN 109302301 A CN109302301 A CN 109302301A CN 201710613409 A CN201710613409 A CN 201710613409A CN 109302301 A CN109302301 A CN 109302301A
- Authority
- CN
- China
- Prior art keywords
- user
- user group
- group
- business game
- statistic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5003—Managing SLA; Interaction between SLA and QoS
- H04L41/5009—Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/14—Network analysis or design
- H04L41/142—Network analysis or design using statistical or mathematical methods
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/51—Discovery or management thereof, e.g. service location protocol [SLP] or web services
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Algebra (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Mathematical Physics (AREA)
- Probability & Statistics with Applications (AREA)
- Pure & Applied Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application provides the appraisal procedure and device of a kind of business game, comprising: by user's random division to the first user group or second user group；Wherein, corresponding first business game of the first user group, corresponding second business game of second user group；Acquire the user behavior data sample of the first user group and second user group；Big data analysis is carried out to collected user behavior data sample, respectively obtains the first user group and second user group for statistic of the pre-set level under multiple index dimensions；Statistic of the pre-set level under multiple index dimensions is directed to by what visualization interface exported the first user group and second user group；Wherein, it is used to determine optimal business game in the first business game and the second business game in the statistic under multiple index dimensions for pre-set level.Using method provided herein, the accuracy and reliability that assessment user client optimization is tested using A/B can be effectively improved.
Description
Technical field
This application involves computer communication field more particularly to a kind of business game assessment technologies.
Background technique
A/B test is a kind of emerging product optimization business game appraisal procedure.In simple terms, A/B test is appreciated that
Are as follows: it is two schemes of the same target making, allows a part of user using A scheme, another part user uses B scheme, record
The lower service condition index for representing user, to judge which scheme is more reasonable.
With the continuous intensification of A/B testing research, the accuracy tested using A/B and improve business game assessment how is improved
The problem of just becoming industry constant quest with reliability.
Summary of the invention
In view of this, the application provides the appraisal procedure and device of a kind of business game, mentioned to improve using A/B test
The accuracy and reliability of high business game assessment.
Specifically, the application is achieved by the following technical solution:
According to a first aspect of the present application, a kind of appraisal procedure of business game is provided, which comprises
By user's random division to the first user group or second user group；Wherein, corresponding first industry of first user group
Business strategy, corresponding second business game of the second user group；
Acquire the user behavior data sample of first user group and the second user group；
Big data analysis is carried out to the collected user behavior data sample, respectively obtain first user group and
The second user group is directed to statistic of the pre-set level under multiple index dimensions；
By visualization interface export first user group and the second user group for pre-set level multiple
Statistic under index dimension；Wherein, described to be used for for statistic of the pre-set level under multiple index dimensions described the
Optimal business game is determined in one business game and second business game.
Optionally, the method also includes:
In the service request for receiving user, judge whether the user is grouped；
If the user is not grouped, execute described by user's random division to the first user group or second user group
Operation respond the service request of the user and after the completion of grouping；
If the user is grouped, the service request of the user is responded.
It is optionally, described by user's random division to the first user group or second user group, comprising:
Generate random value；
If the random value is less than preset value, the user is divided into first user group；
If the random value is more than or equal to the preset value, the user is divided into the second user group；Wherein,
Number of users of first preset value to characterize preset first user group.
Optionally, described that big data analysis is carried out to the collected user behavior data sample, it respectively obtains described
First user group and the second user group are directed to statistic of the pre-set level under multiple index dimensions, comprising:
According to the multiple index dimension, the user in first user group and the second user group is drawn respectively
It is divided into several user's subsets；
Respectively to the user behavior data sample of each user's subset of first user group and the second user group
Carry out big data analysis, respectively obtain first user group and each user's subset of the second user group for described pre-
If the statistic of index.
Optionally, the pre-set level includes net about vehicle order information.
According to a second aspect of the present application, a kind of assessment device of business game is provided, described device includes:
Grouped element is used for user's random division to the first user group or second user group；Wherein, first user
Corresponding first business game of group, corresponding second business game of the second user group；
Acquisition unit, for acquiring the user behavior data sample of first user group and the second user group；
Analytical unit respectively obtains institute for carrying out big data analysis to the collected user behavior data sample
The first user group and the second user group are stated for statistic of the pre-set level under multiple index dimensions
Output unit, for by visualization interface export first user group and the second user group for pre-
If statistic of the index under multiple index dimensions；Wherein, described to be directed to statistic of the pre-set level under multiple index dimensions
For determining optimal business game in first business game and second business game.
Optionally, described device further include:
Judging unit judges whether the user is grouped in the service request for receiving user；
The grouped element, if be not grouped specifically for the user, execute it is described by user's random division extremely
The operation of first user group or second user group, and after the completion of grouping, respond the service request of the user；
Response unit responds the service request of the user if be grouped for the user.
Optionally, the grouped element is further used for generating random value；If the random value is less than preset value,
The user is divided into first user group；If the random value is more than or equal to the preset value, by the user point
Enter the second user group；Wherein, number of users of first preset value to characterize preset first user group.
Optionally, the analytical unit is specifically used for according to the multiple index dimension, respectively by first user
User in group and the second user group is divided into several user's subsets；Respectively to first user group and described second
The user behavior data sample of each user's subset of user group carries out big data analysis, respectively obtain first user group and
The statistic for the pre-set level of each user's subset of second user group.
Optionally, the index includes net about vehicle order information.
The application proposes a kind of appraisal procedure of business game, and this method, which may particularly include, enters first for user's random division
User group or second user group, corresponding first business game of the first user group, corresponding second business game of second user group.Acquisition
The user behavior data sample of first user group and second user group, and can be to the collected user behavior data
Sample carries out big data analysis, respectively obtains first user group and the second user group for pre-set level in multiple fingers
Mark the statistic under dimension.First user group is exported by visualization interface and being directed to for the second user group presets finger
The statistic being marked under multiple index dimensions；Wherein, described to be used for for statistic of the pre-set level under multiple index dimensions
Optimal business game is determined in first business game and second business game.
On the one hand, due to using big data calculation method, collected mass users behavioral data sample is carried out big
Data analysis obtains each user group for the more accurate of statistic of the pre-set level under multiple index dimensions, to increase
The reliability of business game assessment.
On the other hand, it is commented when assessing business game using statistic of the pre-set level under multiple index dimensions
Estimate, due to introducing multiple index dimensions, so that server-side can calculate the statistic under each index dimension, so that pre-set level
That vertically segments is more careful, therefore greatly improves the accuracy of business game assessment.
The third aspect is grouped user due to the ratio number according to preset every group at random, when user is grouped
Afterwards, the subsequent all service requests of user are corresponding with grouping belonging to the user, to ensure that user uses client every time
The grouping consistency being grouped improves the reliability of business game assessment.
Detailed description of the invention
Fig. 1 is a kind of flow chart of business game assessment shown in one exemplary embodiment of the application；
Fig. 2 is the hardware of server-side where a kind of assessment device of business game shown in one exemplary embodiment of the application
Structure chart；
Fig. 3 is a kind of frame of the assessment device of business game corresponding with Fig. 2 shown in one exemplary embodiment of the application
Figure.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to
When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistent with the application.On the contrary, they be only with it is such as appended
The example of the consistent device and method of some aspects be described in detail in claims, the application.
It is only to be not intended to be limiting the application merely for for the purpose of describing particular embodiments in term used in this application.
It is also intended in the application and the "an" of singular used in the attached claims, " described " and "the" including majority
Form, unless the context clearly indicates other meaning.It is also understood that term "and/or" used herein refers to and wraps
It may be combined containing one or more associated any or all of project listed.
It will be appreciated that though various information, but this may be described using term first, second, third, etc. in the application
A little information should not necessarily be limited by these terms.These terms are only used to for same type of information being distinguished from each other out.For example, not departing from
In the case where the application range, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as
One information.Depending on context, word as used in this " if " can be construed to " ... when " or " when ...
When " or " in response to determination ".
The application proposes a kind of appraisal procedure of business game, and this method, which may particularly include, enters first for user's random division
User group or second user group, corresponding first business game of the first user group, corresponding second business game of second user group.Acquisition
The user behavior data sample of first user group and second user group, and can be to the collected user behavior data
Sample carries out big data analysis, respectively obtains first user group and the second user group for pre-set level in multiple fingers
Mark the statistic under dimension.First user group is exported by visualization interface and being directed to for the second user group presets finger
The statistic being marked under multiple index dimensions；Wherein, described to be used for for statistic of the pre-set level under multiple index dimensions
Optimal business game is determined in first business game and second business game.
On the one hand, due to using big data calculation method, collected mass users behavioral data sample is carried out big
Data analysis obtains each user group for the more accurate of statistic of the pre-set level under multiple index dimensions, to increase
The reliability of business game assessment.
On the other hand, it is commented when assessing business game using statistic of the pre-set level under multiple index dimensions
Estimate, due to introducing multiple index dimensions, so that server-side can calculate the statistic under each index dimension, so that pre-set level
That vertically segments is more careful, therefore greatly improves the accuracy of business game assessment.
The third aspect is grouped user due to the ratio number according to preset every group at random, when user is grouped
Afterwards, the subsequent all service requests of user are corresponding with grouping belonging to the user, to ensure that user uses client every time
The grouping consistency being grouped improves the reliability of business game assessment.
Below by taking the business game appraisal procedure that the application is proposed is applied in server-side as an example, this method is carried out detailed
Carefully illustrating, certain business game appraisal procedure can be applied in any equipment with computing capability, such as server,
Here only it is illustratively illustrated, it is not carried out specifically defined.
It is a kind of schematic diagram of business game appraisal procedure shown in one exemplary embodiment of the application referring to Fig. 1, Fig. 1,
This method may include step 101 to step 103.
Step 101: by user's random division to the first user group or second user group；Wherein, first user group pair
Answer the first business game, corresponding second business game of the second user group.
Wherein, above-mentioned server-side may include the service system of several species, and the service system is by several server structures
At.For example, above-mentioned server-side may include data-storage system, such as HDFS (Hadoop based on Hadoop framework
The distributed file system of Distributed File System, Hadoop), above-mentioned server-side may also include based on big data
Various dimensions indication computing system of analysis etc..
Above-mentioned user client, can refer to client software, and user can pass through the customer terminal webpage of the client software
Carry out some request services etc..The hardware carrier for carrying the client may include subscriber terminal equipment, such as mobile phone, IPAD etc..
Here the hardware for carrying the client is not carried out specifically defined.
Above-mentioned business game can be understood as realizing the strategy of a certain target service.The business game may include actually may be used
The strategy seen, for example some function on product is added to realize a certain target service, it also may include sightless plan
Slightly, the method etc. of the dynamic price adjustment such as in net about driving skills art.Only business game is illustratively illustrated herein, no
It is carried out specifically defined.
Above-mentioned first business game may include a kind of strategy for realizing a certain target service.For example the target service can
Dynamically to readjust prices, above-mentioned first business game can be 1 times of dynamic price adjustment etc..
Above-mentioned second business game, it is corresponding with above-mentioned first business game, it may include realizing above-mentioned same target service
Another kind strategy.For example, above-mentioned target service is that dynamic is readjusted prices, above-mentioned first business game is 1 times of dynamic price adjustment, this second
Business game can be 1.5 times of dynamic price adjustment.
Above-mentioned first user group, can be the control group in A/B test, and above-mentioned second user group can be the reality in A/B test
Test group.Certain first user group can also be the experimental group in A/B test, and second user group can be the control group in A/B test.This
In it is not carried out it is specifically defined.
In the embodiment of the present application, server-side can be grouped at random user according to preset every group of ratio number,
After user is grouped, the subsequent all service requests of user are corresponding with grouping belonging to the user, to ensure that user is every
The secondary grouping consistency being grouped using client improves the reliability of user client optimization.
When realizing, the operation of user service request is can be detected in client.
Wherein, the operation of user service request may include click, the sliding etc. that user opens client software and carries out
It is the objective function option for carrying out objective function and triggering that operation, which also may include user,.
For example, it is assumed that above-mentioned client is to ooze row client, the service request operation of user's triggering may include using
Open the operation for oozing row client in family.
In another example, it is assumed that above-mentioned client is to ooze row client, and the service of request is to call a taxi, the service of user's triggering
Request operation can be in the trigger action of the options such as user's click express.
Here only the service request operation that user triggers illustratively is illustrated, it is not limited specifically
It is fixed.
In the embodiment of the present application, after client detects the service request operation of user's triggering, client is produced
Service request, and the service request is sent to server-side.Wherein, the user information of the user is carried in the service request.
Server-side, can be by the user information carried in the service request after receiving the service request, and judging should
Whether user is grouped.
When realizing, server-side can record the user information being grouped.After receiving service request, clothes
Business end can search whether there is user information corresponding with the user in the user information of record being grouped.If
Record the user information being grouped in find user information corresponding with the user, it is determined that the user by into
Row grouping.If not finding user information corresponding with the user in the user information of record being grouped, really
The fixed user is not grouped.
In the embodiment of the present application, if server-side determines the user by carry out user grouping, server-side can respond user
Service request.
In the embodiment of the present application, if server-side determines that the user by carry out user grouping, not can be performed the use
Family random division to the first user group or second user group operation, and user grouping operation after, the service for responding user is asked
It asks.
When realizing, developer can preset the first ratio of total number of users shared by the first user group number, with
And the second ratio of total number of users shared by setting second user group number, the sum of the first ratio and the second ratio are 100%.
Developer can also set preset value, which can characterize the number of users of preset first user group.
For example, the preset value can remove the numerical value after percentage sign for the first ratio, for example, it is assumed that the first ratio is 60%,
So preset value can be 60.Certainly, preset value can also can characterize other of the number of users of preset first user group for other
Value, does not carry out it specifically defined here.
For being based on preset grouping strategy, user grouping operation is carried out to user, in an optional implementation manner,
Server-side can produce a random value.If the random value is less than the preset value, which can be divided into the first user group.Such as
The fruit random value is more than or equal to the preset value, then the user can be divided into second user group.
Certainly, other grouping strategies also can be used in server-side, are grouped at random to user, for example, it can be used
His random grouping algorithm, such as add salt hash algorithm to realize the purpose being grouped at random.Here only to preset grouping strategy
Illustratively illustrated, it is not carried out specifically defined.
After completing to the grouping of the user, server-side can respond the service request of the user.
Step 102: the user behavior data sample of first user group and second user group that client reports can be acquired
This.
In the embodiment of the present application, any behavior that user carries out on the client, for example click some function choosing-item etc.
Behavior all produces User action log, records user behavior data.
For example, it is assumed that above-mentioned client is to ooze row client, user can generate lower single clicking operation of " express "
Log as follows.
Log JASON:{ " event_id ": " fast_order_click "；"passenger_id":"115116"；
“test_group”:“treatment”,“city”:“beijing”,“gender”:“man”,“system_type”:“iOS”}
Wherein, event_id represents operation content, such as the fast_order_click in this example, indicates that order places an order；
Passenger_id represents 115116 in User ID, such as this example.
Test_group represents the treatment in user group, such as this example belonging to user, represents experimental group.
City represents Beijing such as the beijing in this example where city represents user.
Gender represents user's gender, such as the man in this example, represents male.
System_type represents the operating system of subscriber terminal equipment, such as the iOS system in this example.
Wherein, the content that above-mentioned log is recorded can be user behavior data sample, the correlation for the user in log
The information of type can be the feature of the user behavior data.For example, the feature of the user behavior data can be operation content, user
User group belonging to ID, user, city, user's gender and operating system of subscriber terminal equipment etc. where user.
The User action log that this can be recorded user behavior data sample by client is reported to server-side.Server-side exists
After receiving the User action log, which can be stored in HDFS file system.
In addition, server-side can also be based on the User action log, the user behavior number of User action log record is extracted
According to multiple features in sample, big data analysis is carried out to carry out user behavior data sample.
Step 103: big data analysis can be carried out to the collected user behavior data sample, respectively obtained described
First user group and the second user group are directed to statistic of the pre-set level under multiple index dimensions.
In the embodiment of the present application, server-side can be based on pre-set level, based on each spy in above-mentioned user behavior data
Sign carries out data analysis to the user behavior data of the first user group and second user group respectively, respectively obtains and use for first
Family group and second user group are directed to statistic of the pre-set level under multiple index dimensions.
Wherein, These parameters may include the order information of net about vehicle, for example, the order amount of placing an order, order response rate etc..This
In it is not carried out it is specifically defined.
These parameters dimension may include several customer attribute informations, it may include the gender of user, age, the end that user uses
The operating system of end equipment, city and combinations thereof etc. where user.
For example, it is assumed that pre-set level is the average amount of placing an order, multiple index dimensions may include city (such as Beijing) where user,
User's gender (such as male) and operating system (such as iOS) of subscriber terminal equipment these three dimensions.
When These parameters dimension is Beijing male, statistic of the pre-set level under the index dimension be can be understood as
The amount of placing an order that is averaged of Beijing male user, when the operating system for the terminal device that These parameters dimension is Beijing male and user is
IOS, statistic of the pre-set level under the index dimension can be understood as the behaviour of Beijing male and the terminal device of the user
Make the amount of placing an order that is averaged for the user that system is iOS.
It can thus be seen that counting statistic of the pre-set level under multiple index dimensions can compared with single dimension index
To the division that pre-set level is more refined, the pre-set level is more fully described, it is possible to improve system and decision
Accuracy.
In the embodiment of the present application, server-side is corresponding with visualization interface, and user can select more on the visualization interface
A index dimension and index.
When calculating the first user group and second user group is directed to statistic of the pre-set level under multiple index dimensions, with
For first user group, the user in the first user group is divided by multiple index dimensions that server-side can be selected according to user
Several user's subsets.Then server-side can carry out big data analysis to the corresponding user behavior data of user's subset, obtain
Each user's subset is directed to statistic of the selected index of user under multiple index dimensions in first user group.
Below with a specific example and the scene of combination net about vehicle, the calculating of above-mentioned various dimensions index is carried out detailed
Ground explanation.
For example, the index that user chooses on visualization interface is the averagely amount of placing an order, two indices dimension is had chosen, such as
The system of respectively Beijing male, Beijing male and subscriber terminal equipment is iOS.
The amount of placing an order is averaged for the statistic under the two index dimensions with the first user group of calculating, and server-side can base
In the index dimension of Beijing male, the user for meeting the index dimension, composition the first user are marked off from the first user group
Collection, then server-side can be iOS based on the system of Beijing male and subscriber terminal equipment, mark off and meet from the first user group
The user of the index dimension forms second user subset.Server-side can count first user's subset and second user subset respectively
The amount of placing an order that is averaged, the amount of placing an order that is averaged of first obtained user's subset, as averagely this pre-set level of the amount of placing an order is in Beijing
Statistic under this index dimension of male, the amount of placing an order that is averaged of obtained second user subset, as averagely the amount of placing an order this
Statistic of the pre-set level in the case where the system of Beijing male and subscriber terminal equipment is this index dimension of iOS.
Server-side can calculate second user group based on the above method and be directed to statistics of the pre-set level under multiple index dimensions
Amount.
Step 104: first user group can be exported by visualization interface and being directed to for the second user group is preset
Statistic of the index under multiple index dimensions；Wherein, the statistic for pre-set level under multiple index dimensions is used
In optimal business game determining in first business game and second business game.
In the embodiment of the present application, server-side can be exported above-mentioned first user group and above-mentioned second by visualization interface and be used
Family group is directed to statistic of the pre-set level under multiple index dimensions.
Since statistic of the pre-set level under multiple index dimensions represents user for the first business game and second
Business game like or satisfaction etc., developer can referring to for default based on the first user group and second user group
The statistic being marked under multiple index dimensions, to assess the first business game and the second business game, finally in the first business plan
Slightly and in the second business game select optimal business game.
The application proposes a kind of appraisal procedure of business game, server-side user's random division can be entered the first user group or
Second user group, corresponding first business game of the first user group, corresponding second business game of second user group.Server-side can acquire
The user behavior data sample of first user group and second user group, and can be to the collected user behavior data
Sample carries out big data analysis, respectively obtains first user group and the second user group for pre-set level in multiple fingers
Mark the statistic under dimension.Server-side can export the needle of first user group and the second user group by visualization interface
To statistic of the pre-set level under multiple index dimensions；Wherein, described to be directed to system of the pre-set level under multiple index dimensions
It measures for determining optimal business game in first business game and second business game.
On the one hand, since server-side uses big data calculation method, to collected mass users behavioral data sample
Big data analysis is carried out, each user group is obtained and is directed to the more accurate of statistic of the pre-set level under multiple index dimensions, from
And increase the reliability of business game assessment.
On the other hand, statistic of the server-side when assessing business game using pre-set level under multiple index dimensions
It is assessed, due to introducing multiple index dimensions, so that server-side can calculate the statistic under each index dimension, so that in advance
If index is vertically segmented more careful, therefore greatly improves the accuracy of business game assessment.
The third aspect, server-side can be grouped at random user, according to preset every group of ratio number when user's quilt
After grouping, the subsequent all service requests of user are corresponding with grouping belonging to the user, to ensure that user uses visitor every time
The grouping consistency that family end is grouped improves the reliability of business game assessment.
The embodiment of the assessment device of the application business game can be applied in server-side.Installation practice can pass through
Software realization can also be realized by way of hardware or software and hardware combining.Taking software implementation as an example, it anticipates as a logic
Device in justice is to be read computer program instructions corresponding in nonvolatile memory by the processor of server-side where it
Get what operation in memory was formed.For hardware view, as shown in Fig. 2, for where the assessment device of the application business game
A kind of hardware structure diagram of server-side, in addition to processor shown in Fig. 2, memory, network outgoing interface and nonvolatile memory
Except, the server-side in embodiment where device can also include other hardware generally according to the actual functional capability of the server-side, right
This is repeated no more.
Referring to FIG. 3, Fig. 3 is a kind of industry of business game corresponding with Fig. 2 shown in one exemplary embodiment of the application
The block diagram of the assessment device of business strategy.The device can include: grouped element 301, acquisition unit 302, analytical unit 303 and output
Unit 304.
Wherein, grouped element 301 are used for user's random division to the first user group or second user group；Wherein, described
First user group corresponds to the first business game, corresponding second business game of the second user group；
Acquisition unit 302, for acquiring the user behavior data sample of first user group and the second user group；
Analytical unit 303 is respectively obtained for carrying out big data analysis to the collected user behavior data sample
First user group and the second user group are directed to statistic of the pre-set level under multiple index dimensions
Output unit 304, for exporting the needle of first user group and the second user group by visualization interface
To statistic of the pre-set level under multiple index dimensions；Wherein, described to be directed to system of the pre-set level under multiple index dimensions
It measures for determining optimal business game in first business game and second business game.
Optionally, described device further include:
Judging unit 305 judges whether the user is grouped in the service request for receiving user；
The grouped element 301 executes described by user's random division if be not grouped specifically for the user
To the operation of the first user group or second user group, and after the completion of grouping, the service request of the user is responded；
Response unit 306 responds the service request of the user if be grouped for the user.
Optionally, the analytical unit is specifically used for according to the multiple index dimension, respectively by first user
User in group and the second user group is divided into several user's subsets；Respectively to first user group and described second
The user behavior data sample of each user's subset of user group carries out big data analysis, respectively obtain first user group and
The statistic for the pre-set level of each user's subset of second user group.
The analytical unit 303 is specifically used for according to the multiple index dimension, respectively by first user group and
User in the second user group is divided into several user's subsets；Respectively to first user group and the second user
The user behavior data sample of each user's subset of group carries out big data analysis, respectively obtains first user group and described
The statistic for the pre-set level of each user's subset of second user group.
Optionally, the index includes net about vehicle order information.
The function of each unit and the realization process of effect are specifically detailed in the above method and correspond to step in above-mentioned apparatus
Realization process, details are not described herein.
For device embodiment, since it corresponds essentially to embodiment of the method, so related place is referring to method reality
Apply the part explanation of example.The apparatus embodiments described above are merely exemplary, wherein described be used as separation unit
The unit of explanation may or may not be physically separated, and component shown as a unit can be or can also be with
It is not physical unit, it can it is in one place, or may be distributed over multiple network units.It can be according to actual
The purpose for needing to select some or all of the modules therein to realize application scheme.Those of ordinary skill in the art are not paying
Out in the case where creative work, it can understand and implement.
The foregoing is merely the preferred embodiments of the application, not to limit the application, all essences in the application
Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the application protection.
Claims (10)
1. a kind of appraisal procedure of business game, which is characterized in that the described method includes:
By user's random division to the first user group or second user group；Wherein, the corresponding first business plan of first user group
Slightly, corresponding second business game of the second user group；
Acquire the user behavior data sample of first user group and the second user group；
Big data analysis is carried out to the collected user behavior data sample, respectively obtains first user group and described
Second user group is directed to statistic of the pre-set level under multiple index dimensions；
By visualization interface export first user group and the second user group for pre-set level in multiple indexs
Statistic under dimension；Wherein, described to be used for for statistic of the pre-set level under multiple index dimensions in first industry
Optimal business game is determined in business strategy and second business game.
2. the method according to claim 1, wherein the method also includes:
In the service request for receiving user, judge whether the user is grouped；
If the user is not grouped, the behaviour by user's random division to the first user group or second user group is executed
Make, and after the completion of grouping, responds the service request of the user；
If the user is grouped, the service request of the user is responded.
3. method according to claim 1 or 2, which is characterized in that it is described by user's random division to the first user group or
Second user group, comprising:
Generate random value；
If the random value is less than preset value, the user is divided into first user group；
If the random value is more than or equal to the preset value, the user is divided into the second user group；Wherein, described
Number of users of first preset value to characterize preset first user group.
4. the method according to claim 1, wherein it is described to the collected user behavior data sample into
Row big data analysis respectively obtains first user group and the second user group for pre-set level in multiple index dimensions
Under statistic, comprising:
According to the multiple index dimension, the user in first user group and the second user group is divided into respectively
Several user's subsets；
The user behavior data sample of each user's subset of first user group and the second user group is carried out respectively
Big data analysis, respectively obtain first user group and each user's subset of the second user group for the default finger
Target statistic.
5. the method according to claim 1, wherein the pre-set level includes net about vehicle order information.
6. a kind of assessment device of business game, which is characterized in that described device includes:
Grouped element is used for user's random division to the first user group or second user group；Wherein, first user group pair
Answer the first business game, corresponding second business game of the second user group；
Acquisition unit, for acquiring the user behavior data sample of first user group and the second user group；
Analytical unit respectively obtains described for carrying out big data analysis to the collected user behavior data sample
One user group and the second user group are directed to statistic of the pre-set level under multiple index dimensions；
Output unit, for exporting referring to for default for first user group and the second user group by visualization interface
The statistic being marked under multiple index dimensions；Wherein, described to be used for for statistic of the pre-set level under multiple index dimensions
Optimal business game is determined in first business game and second business game.
7. device according to claim 6, which is characterized in that described device further include:
Judging unit judges whether the user is grouped in the service request for receiving user；
The grouped element executes described by user's random division to first if be not grouped specifically for the user
The operation of user group or second user group, and after the completion of grouping, respond the service request of the user；
Response unit responds the service request of the user if be grouped for the user.
8. device according to claim 6 or 7, which is characterized in that the grouped element is further used for generating random
Value；If the random value is less than preset value, the user is divided into first user group；If the random value is greater than
Equal to the preset value, then the user is divided into the second user group；Wherein, first preset value is default to characterize
First user group number of users.
9. device according to claim 6, which is characterized in that the analytical unit is specifically used for according to the multiple finger
Dimension is marked, the user in first user group and the second user group is divided into several user's subsets respectively；Point
The user behavior data sample of other each user's subset to first user group and the second user group carries out big data
Analysis, respectively obtains the system for the pre-set level of first user group and each user's subset of the second user group
Metering.
10. device according to claim 6, which is characterized in that the index includes net about vehicle order information.
Priority Applications (9)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710613409.4A CN109302301A (en) | 2017-07-25 | 2017-07-25 | A kind of appraisal procedure and device of business game |
| EP18815494.2A EP3459208A4 (en) | 2017-07-25 | 2018-07-20 | Systems and methods for determining an optimal strategy |
| PCT/CN2018/096509 WO2019019958A1 (en) | 2017-07-25 | 2018-07-20 | Systems and methods for determining an optimal strategy |
| AU2018282441A AU2018282441A1 (en) | 2017-07-25 | 2018-07-20 | Systems and methods for determining an optimal strategy |
| JP2018567142A JP2019534487A (en) | 2017-07-25 | 2018-07-20 | System and method for determining optimal strategy |
| SG11201811512PA SG11201811512PA (en) | 2017-07-25 | 2018-07-20 | Systems and methods for determining an optimal strategy |
| CA3028291A CA3028291A1 (en) | 2017-07-25 | 2018-07-20 | Systems and methods for determining an optimal strategy |
| CN201880002583.8A CN109565452A (en) | 2017-07-25 | 2018-07-20 | System and method for determining optimal policy |
| US16/232,042 US10963830B2 (en) | 2017-07-25 | 2018-12-25 | Systems and methods for determining an optimal strategy |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710613409.4A CN109302301A (en) | 2017-07-25 | 2017-07-25 | A kind of appraisal procedure and device of business game |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109302301A true CN109302301A (en) | 2019-02-01 |
Family
ID=65167480
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710613409.4A Pending CN109302301A (en) | 2017-07-25 | 2017-07-25 | A kind of appraisal procedure and device of business game |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109302301A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111008086A (en) * | 2019-12-04 | 2020-04-14 | 集奥聚合(北京)人工智能科技有限公司 | Anti-fraud policy optimization method based on message queue |
| CN111460384A (en) * | 2020-03-31 | 2020-07-28 | 北京百度网讯科技有限公司 | Policy evaluation method, device and equipment |
| CN111813674A (en) * | 2020-07-06 | 2020-10-23 | 北京嘀嘀无限科技发展有限公司 | Method and device for pressure measurement of order splitting service, electronic equipment and storage medium |
| CN112150176A (en) * | 2019-06-28 | 2020-12-29 | 阿里巴巴集团控股有限公司 | Evaluation method, system and readable storage medium |
| CN113159815A (en) * | 2021-01-25 | 2021-07-23 | 腾讯科技（深圳）有限公司 | Information delivery strategy testing method and device, storage medium and electronic equipment |
| CN113448872A (en) * | 2021-07-22 | 2021-09-28 | 网易（杭州）网络有限公司 | Test execution method, device, equipment and storage medium |
| CN113609013A (en) * | 2021-08-03 | 2021-11-05 | 挂号网（杭州）科技有限公司 | Evaluation method and device for AB test, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101777147A (en) * | 2008-11-05 | 2010-07-14 | 埃森哲环球服务有限公司 | Forecast modeling |
| CN102149119A (en) * | 2011-04-27 | 2011-08-10 | 浪潮通信信息系统有限公司 | Speech service quality end-to-end analyzing method |
| CN102194164A (en) * | 2011-04-18 | 2011-09-21 | 上海实时数据软件有限公司 | Index-system-model-based agile business intelligence data construction method |
| CN103246597A (en) * | 2012-02-07 | 2013-08-14 | 腾讯科技（深圳）有限公司 | Parameter testing method and device |
| CN105763476A (en) * | 2014-12-19 | 2016-07-13 | 电信科学技术研究院 | Method and apparatus for customizing data business service strategies |
| US20170103133A1 (en) * | 2015-10-09 | 2017-04-13 | Alibaba Group Holding Limited | Recommendation method and device |
-
2017
- 2017-07-25 CN CN201710613409.4A patent/CN109302301A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101777147A (en) * | 2008-11-05 | 2010-07-14 | 埃森哲环球服务有限公司 | Forecast modeling |
| CN102194164A (en) * | 2011-04-18 | 2011-09-21 | 上海实时数据软件有限公司 | Index-system-model-based agile business intelligence data construction method |
| CN102149119A (en) * | 2011-04-27 | 2011-08-10 | 浪潮通信信息系统有限公司 | Speech service quality end-to-end analyzing method |
| CN103246597A (en) * | 2012-02-07 | 2013-08-14 | 腾讯科技（深圳）有限公司 | Parameter testing method and device |
| CN105763476A (en) * | 2014-12-19 | 2016-07-13 | 电信科学技术研究院 | Method and apparatus for customizing data business service strategies |
| US20170103133A1 (en) * | 2015-10-09 | 2017-04-13 | Alibaba Group Holding Limited | Recommendation method and device |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112150176A (en) * | 2019-06-28 | 2020-12-29 | 阿里巴巴集团控股有限公司 | Evaluation method, system and readable storage medium |
| CN111008086A (en) * | 2019-12-04 | 2020-04-14 | 集奥聚合(北京)人工智能科技有限公司 | Anti-fraud policy optimization method based on message queue |
| CN111460384A (en) * | 2020-03-31 | 2020-07-28 | 北京百度网讯科技有限公司 | Policy evaluation method, device and equipment |
| CN111460384B (en) * | 2020-03-31 | 2023-09-08 | 北京百度网讯科技有限公司 | Policy evaluation method, device and equipment |
| CN111813674A (en) * | 2020-07-06 | 2020-10-23 | 北京嘀嘀无限科技发展有限公司 | Method and device for pressure measurement of order splitting service, electronic equipment and storage medium |
| CN111813674B (en) * | 2020-07-06 | 2021-02-23 | 北京嘀嘀无限科技发展有限公司 | Method and device for pressure measurement of order splitting service, electronic equipment and storage medium |
| CN113159815A (en) * | 2021-01-25 | 2021-07-23 | 腾讯科技（深圳）有限公司 | Information delivery strategy testing method and device, storage medium and electronic equipment |
| CN113448872A (en) * | 2021-07-22 | 2021-09-28 | 网易（杭州）网络有限公司 | Test execution method, device, equipment and storage medium |
| CN113448872B (en) * | 2021-07-22 | 2022-04-29 | 网易（杭州）网络有限公司 | Test execution method, device, equipment and storage medium |
| CN113609013A (en) * | 2021-08-03 | 2021-11-05 | 挂号网（杭州）科技有限公司 | Evaluation method and device for AB test, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109302301A (en) | A kind of appraisal procedure and device of business game | |
| CN109308552A (en) | A kind of business game appraisal procedure, device and electronic equipment | |
| CN110378749B (en) | Client similarity evaluation method and device, terminal equipment and storage medium | |
| US9996409B2 (en) | Identification of distinguishable anomalies extracted from real time data streams | |
| CN102158879B (en) | Essential factor lost score data processing method and equipment | |
| US11113720B2 (en) | System and a method for surveying advertisements in mobile applications | |
| US20130004933A1 (en) | Increasing confidence in responses to electronic surveys | |
| CN108268624B (en) | User data visualization method and system | |
| CN113543178A (en) | Service optimization method, device, equipment and storage medium based on user perception | |
| CN107515915A (en) | User based on user behavior data identifies correlating method | |
| WO2014127051A1 (en) | Churn prediction in a broadband network | |
| CN108280644B (en) | Group membership data visualization method and system | |
| KR20120007889A (en) | Method, system and recording medium for verifying effect of advertisement | |
| CN110377521A (en) | A kind of target object verification method and device | |
| CN109670112A (en) | A kind of generation method, device, storage medium and the terminal of user's portrait ID | |
| US10740118B1 (en) | Monitoring mobile device usage | |
| CN117237016A (en) | Method and device for adjusting advertisement putting strategy, computer equipment and storage medium | |
| US9571360B2 (en) | Method and score management node for supporting service evaluation | |
| CN112953904B (en) | Abnormality detection method, abnormality detection device, server, and storage medium | |
| CN108710574A (en) | Ui testing method and apparatus | |
| CN114390105B (en) | Enterprise user distribution method and equipment based on test | |
| CN107895279A (en) | User force based on user bill determines method and device | |
| CN116186119A (en) | User behavior analysis method, device, equipment and storage medium | |
| CN110472852A (en) | A kind of experience assessment implementation management method of electrical power services application | |
| CN103905488A (en) | Mobile terminal advertisement putting method and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190201 |
|
| RJ01 | Rejection of invention patent application after publication |