CN109753424A - The method and apparatus of AB test - Google Patents
The method and apparatus of AB test Download PDFInfo
- Publication number
- CN109753424A CN109753424A CN201711077000.1A CN201711077000A CN109753424A CN 109753424 A CN109753424 A CN 109753424A CN 201711077000 A CN201711077000 A CN 201711077000A CN 109753424 A CN109753424 A CN 109753424A
- Authority
- CN
- China
- Prior art keywords
- testing scheme
- testing
- dimension
- sub
- scheme
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Debugging And Monitoring (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The present invention provides a kind of AB method and apparatus of test, can change with can be realized various dimensions and flexibly the AB test of configuration.This method comprises: constructing dimension extractor according to the default testing requirement of access method, system；AB testing scheme is configured according to the default testing requirement of the access method, system, then the unique identification information of the AB testing scheme is back to the access method, system, wherein, configuration AB testing scheme includes: the one or more sub- testing schemes of default testing requirement configuration according to the access method, system, corresponding dimension extractor is selected for every sub- testing scheme, and sets corresponding dimension matching value；After the service request for receiving access method, system, corresponding AB testing scheme is obtained according to the unique identification information for the AB testing scheme for including in the service request, judge whether the service request meets the sub- testing scheme of the AB testing scheme, and exports judging result.
Description
Technical field
The present invention relates to the method and apparatus that field of computer technology more particularly to a kind of AB are tested.
Background technique
In order to preferably improve product quality and user experience, many big companies generally use gray scale in product design
Publication or AB measuring technology.Specific AB testing scheme (including one or more sub- testing schemes in AB testing scheme) determines
Product publication is carried out later, and the data for collecting every seed testing scheme compare, and choose optimal sub- testing scheme and improve production
Product.
In the prior art carry out AB test technical solution approximately as:
1, it is pre- that the formation such as the user crowd of this AB testing needle pair, a certain function of product, specific user behavior are set
If AB testing scheme；
2, product development personnel carry out product development according to preset AB testing scheme；
3, product test with it is online.
However, being commonly present after AB testing scheme is run on line in the prior art, testing scheme is undesirable, the function of test
Can be single, user divides the situation of inaccuracy.In realizing process of the present invention, inventor's discovery at least exists such as in the prior art
Lower problem:
(1) AB testing scheme dimension is single, and variable dimension is smaller, and scheme scalability is poor；
(2) period for forming AB testing scheme is long, and it is long that AB testing scheme changes release cycle again after determining；
(3) AB testing scheme does not support flexible configuration.
Summary of the invention
In view of this, the embodiment of the present invention provides a kind of AB method and apparatus of test, with can be realized various dimensions and
The AB test of configuration can flexibly be changed.
To achieve the above object, according to an aspect of an embodiment of the present invention, a kind of method of AB test is provided.
A kind of method of AB test of the embodiment of the present invention includes: the default testing requirement construction dimension according to access method, system
Spend extractor；AB testing scheme is configured according to the default testing requirement of the access method, system, then by the AB testing scheme
Unique identification information be back to the access method, system, wherein configuration AB testing scheme include: according to the access method, system
The one or more sub- testing schemes of default testing requirement configuration, select corresponding dimension extractor for every sub- testing scheme,
And set corresponding dimension matching value；After the service request for receiving access method, system, wrapped according in the service request
The unique identification information of the AB testing scheme contained obtains corresponding AB testing scheme, and it is described to judge whether the service request meets
The sub- testing scheme of AB testing scheme, and export judging result.
It optionally, include: according to access method, system according to the default testing requirement construction dimension extractor of access method, system
Default testing requirement, select existing dimension extractor, and save；And/or customized dimension extractor.
Optionally, selecting corresponding dimension extractor for every sub- testing scheme includes: for every sub- testing scheme selection
Corresponding one or more dimension extractor.
Optionally, the sub- testing scheme for judging whether the service request meets the AB testing scheme includes: to judge institute
State one of them the sub- testing scheme whether service request meets the AB testing scheme, comprising: utilize the sub- testing scheme
In include dimension extractor extract the dimension values of respective dimensions in the service request, by the dimension values and the sub- test
Corresponding dimension matching value is matched in scheme, if the equal successful match of all dimension values extracted in the sub- testing scheme,
Then the service request meets the sub- testing scheme, otherwise continues to judge whether the service request meets the test side AB
Its minor testing scheme of case, until sub- testing scheme all in the AB testing scheme is completed to match.
Optionally, the method also includes: when default testing requirement changes, repaired according to the testing requirement after variation
Change and/or add corresponding sub- testing scheme in AB testing scheme.
To achieve the above object, according to another aspect of an embodiment of the present invention, a kind of device of AB test is provided.
A kind of device of AB test of the embodiment of the present invention includes: dimension extractor constructing module, for according to access side
The default testing requirement of system constructs dimension extractor；AB testing scheme configuration module, for according to the access method, system
Default testing requirement configures AB testing scheme, and the unique identification information of the AB testing scheme is then back to the access side
System, wherein configuration AB testing scheme includes: the one or more sons of default testing requirement configuration according to the access method, system
Testing scheme selects corresponding dimension extractor for every sub- testing scheme, and sets corresponding dimension matching value；The test side AB
Case matching module, for being surveyed according to the AB for including in the service request after the service request for receiving access method, system
The unique identification information of examination scheme obtains corresponding AB testing scheme, judges whether the service request meets the test side AB
The sub- testing scheme of case, and export judging result.
Optionally, the dimension extractor constructing module is also used to: according to the default testing requirement of access method, system, selection
Existing dimension extractor, and save；And/or customized dimension extractor.
Optionally, the AB testing scheme configuration module is also used to: for every sub- testing scheme selection it is corresponding one or
Multiple dimension extractors.
Optionally, the AB testing scheme matching module is also used to: judging whether the service request meets the AB and survey
The sub- testing scheme of one of them of examination scheme, comprising: using described in the dimension extractor extraction for including in the sub- testing scheme
The dimension values of respective dimensions in service request carry out the dimension values with dimension matching value corresponding in the sub- testing scheme
Matching, if the equal successful match of all dimension values extracted in the sub- testing scheme, the service request meet the sub- survey
Otherwise examination scheme continues to judge its minor the testing scheme whether service request meets the AB testing scheme, until institute
Sub- testing scheme all in AB testing scheme is stated to complete to match.
Optionally, the AB testing scheme configuration module is also used to: when default testing requirement changes, according to variation
Corresponding sub- testing scheme in AB testing scheme is modified and/or added to testing requirement afterwards.
To achieve the above object, according to an embodiment of the present invention in another aspect, providing a kind of electronic equipment.
The a kind of electronic equipment of the embodiment of the present invention includes: one or more processors；Storage device, for storing one
Or multiple programs, when one or more of programs are executed by one or more of processors, so that one or more of
The method that processor realizes the AB test of the embodiment of the present invention.
To achieve the above object, another aspect according to an embodiment of the present invention, provides a kind of computer-readable medium.
A kind of computer-readable medium of the embodiment of the present invention, is stored thereon with computer program, and described program is processed
The method of the AB test of the embodiment of the present invention is realized when device executes.
One embodiment in foregoing invention has the following advantages that or the utility model has the advantages that because using taking out from AB testing scheme
As going out different dimension extractors, extract the dimension matching value of the dimension in service request and the dimension in sub- testing scheme into
The matched technological means of row, so the period for overcoming formation AB testing scheme in the prior art is long, after AB testing scheme determines
The long technical problem of release cycle is changed again, and then reaches the test function point for being abstracted every sub- testing scheme, and realize
General test dimension function, reduces the technical effect of the overlapping development of different AB testing schemes；By the test side AB
Every sub- testing scheme can be divided into multiple dimensions in case, and according to the testing requirement of every sub- testing scheme select one or
Multiple dimension extractors, so as to realize various dimensions, flexibly configurable AB test；By according to the test need changed
Modification or the sub- testing scheme of addition are asked, so as to be changed in real time to AB testing scheme, so that AB testing scheme was realized
Complexity is substantially reduced, and the test period of AB testing scheme significantly reduces, and is produced so as to obtain test data faster
Product are perfect.
Further effect possessed by above-mentioned non-usual optional way adds hereinafter in conjunction with specific embodiment
With explanation.
Detailed description of the invention
Attached drawing for a better understanding of the present invention, does not constitute an undue limitation on the present invention.Wherein:
Fig. 1 is the schematic diagram of the main flow of the method for AB test according to an embodiment of the present invention；
Fig. 2 is adapted for realizing the system architecture schematic diagram of the method for the AB test of the embodiment of the present invention；
Fig. 3 is the schematic diagram of the dimension extractor constructing module of the method for AB test according to an embodiment of the present invention；
Fig. 4 is the schematic diagram of the AB testing scheme registration center of the method for AB test according to an embodiment of the present invention；
Fig. 5 is the schematic diagram of the main modular of the device of AB test according to an embodiment of the present invention；
Fig. 6 is that the embodiment of the present invention can be applied to exemplary system architecture figure therein；
Fig. 7 is adapted for the structural representation of the computer system for the terminal device or server of realizing the embodiment of the present invention
Figure.
Specific embodiment
Below in conjunction with attached drawing, an exemplary embodiment of the present invention will be described, including the various of the embodiment of the present invention
Details should think them only exemplary to help understanding.Therefore, those of ordinary skill in the art should recognize
It arrives, it can be with various changes and modifications are made to the embodiments described herein, without departing from scope and spirit of the present invention.Together
Sample, for clarity and conciseness, descriptions of well-known functions and structures are omitted from the following description.
The present embodiments relate to the AB test method of product, specially a kind of support various dimensions can configure test in real time
The technical solution of the AB test of scheme, it removes the common point of AB testing scheme, to determine the access method, system (embodiment of the present invention
Middle access method, system specifically can be Web application and be also possible to APP application.It is applied if it is Web, then access method, system is main
It is that service requesting information is constructed according to http request；It is applied if it is APP, then access method, system can pass through HTTP API
Mode make requests.The particular content that the service requesting informations of difference access method, systems construction include is different) business ask
It asks and meets which of sub- testing scheme.
In addition, can have one or more dimensions in every sub- testing scheme in AB testing scheme in the embodiment of the present invention
Degree, each dimension can be changed by way of configuring.It has been abstracted the test function point of every sub- testing scheme as a result, and
General test dimension function is realized, the overlapping development of different AB testing schemes is greatly reduced, so as to realize efficiently
, the AB testing schemes of various dimensions.
In the embodiment of the present invention, different dimension extractors is taken out from AB testing scheme, extracts service request neutron
Testing scheme corresponds to the dimension values of dimension, is matched with the matching value of the dimension configured in AB testing scheme configuration module,
To determine which sub- testing scheme is service request meet, to realize the matching of efficiently AB testing scheme.
AB testing scheme is changed in real time by the AB testing scheme configuration module for providing configurable, so as to so as to
It realizes and AB testing scheme is adjusted flexibly promptly according to testing requirement.
Foregoing description is the key technology of the embodiment of the present invention, is also exactly lacked in the AB testing scheme of the prior art
's.
AB testing scheme in the embodiment of the present invention is various dimensions, needs to be advised according to user when AB testing scheme designs
Mould, the behavioural characteristic of user, different function classifications etc. are different to test dimension to determine specific testing scheme.
It mainly may include four parts for realizing the AB of the embodiment of the present invention device tested, be that dimension is extracted respectively
Device constructing module, AB testing scheme configuration module, AB testing scheme preserving module are (i.e. hereafter in " the AB testing scheme note referred to
Volume " center ") and AB testing scheme matching module.
Fig. 1 is the schematic diagram of the main flow of the method for AB test according to an embodiment of the present invention.As shown in Figure 1, this hair
The method of the AB test of bright embodiment mainly includes the following steps:
Step S101: dimension extractor is constructed according to the default testing requirement of access method, system.The purpose of this step is
General dimension extractor is constructed according to the AB testing requirement of access method, system, to reduce the repetitive operation of subsequent development,
Facilitate the configuration for carrying out AB testing scheme and flexibly change.
Specifically, construction dimension extractor may include the following two kinds mode: according to the default test of access method, system
Demand selects existing dimension extractor；And/or customized dimension extractor.Under normal conditions, existing AB test dimension mentions
The text type extractor that provides the foundation in device constructing module and digital type-collection device are taken, also, based on this can be with
Derive browser UserAgent extractor, required parameter extractor, user scope extractor etc..In addition, the embodiment of the present invention
In, it, can also be according to the customized dimension of testing requirement when aforementioned general dimension extractor is insufficient for the demand of AB test
Spend extractor.
After the construction that step S101 completes dimension extractor, the configuration of AB testing scheme is carried out since step S102
With the realization of AB test.
Step S102: AB testing scheme is configured according to the default testing requirement of the access method, system, then by the AB
The unique identification information of testing scheme is back to the access method, system, wherein configuration AB testing scheme includes: to connect according to
The one or more sub- testing schemes of default testing requirement configuration for entering method, system, select corresponding dimension for every sub- testing scheme
Extractor, and set corresponding dimension matching value.
In the embodiment of the present invention, AB testing scheme may include one or more sub- testing schemes.Also, every height test
It can also include one or more test dimensions in scheme.Therefore, in the embodiment of the present invention, for every sub- testing scheme selection pair
The one or more dimension extractors answered, and set corresponding dimension matching value.
When default testing requirement changes, it can also modify and/or add according to the testing requirement after variation and is corresponding
Sub- testing scheme.Such as increase test dimension, reduce test dimension, or increase sub- testing scheme etc..
Step S103: after the service request for receiving access method, system, according to the AB for including in the service request
The unique identification information of testing scheme obtains corresponding AB testing scheme, judges whether the service request meets the AB test
The sub- testing scheme of scheme, and export judging result.
After the configuration for completing the AB testing scheme of step S102, so that it may be asked to the business of the access method, system received
Ask the matching for carrying out AB testing scheme.
Specifically, the sub- testing scheme for judging whether the service request meets the AB testing scheme includes: judgement
Whether the service request meets one of them sub- testing scheme of the AB testing scheme, comprising: utilizes the sub- test side
The dimension extractor for including in case extracts the dimension values of respective dimensions in the service request, by the dimension values and the sub- survey
Corresponding dimension matching value is matched in examination scheme, if all dimension values extracted in the sub- testing scheme match at
Function, then the service request meets the sub- testing scheme, otherwise continues to judge whether the service request meets the AB and survey
Its minor testing scheme of examination scheme, until sub- testing scheme all in the AB testing scheme is completed to match.
Fig. 2 is adapted for realizing the system architecture schematic diagram of the method for the AB test of the embodiment of the present invention.
As shown in Fig. 2, using the embodiment of the present invention AB test device realize various dimensions, AB testing scheme it is movable
The AB test method of state configuration mainly includes following process:
Step 1: being used to select the dimension extractor of dimension: the construction of dimension extractor in access method, system construction AB scheme
Be it is closely related with specific AB testing scheme, the realization key of dimension extractor is a certain Xiang Wei obtained in sub- testing scheme
Angle value.For example: AB testing scheme includes sub- testing scheme A and sub- testing scheme B.The A scheme of AB testing scheme is to use
50% user of mobile phone QQ browser shows product new function when accessing mobile phone category commodity, B scheme is not meet above-mentioned condition
In the case where do not show new function.
Dimension involved in AB testing scheme mainly has at this time: browser dimension, user scope dimension, commodity category dimension
Degree.Wherein, the effect of browser dimension extractor be extract user use browser mark, specific configuration method can with but not
It is limited to be the UserAgent attribute value obtained from the Http of user request in head Header；User scope dimension extractor
Specific configuration method can be, but not limited to: if the value of certain cookie represents user scope value in access method, system, use
Family range extractor seeks to obtain the value of the cookie；The construction of commodity category dimension extractor equally can be according to access
The category information of method, system context acquisition commodity.
Step 2: registration dimension extractor: registering dimension extractor to AB testing scheme registration center.Access method, system exists
After the construction for completing dimension extractor, the information by the dimension extractor of construction is needed to be saved and registered.The present invention is real
It applies in example, can be to AB testing scheme registration center and send message to register dimension extractor.AB testing scheme note herein
Volume center is with store function, it can as AB testing scheme preserving module.
Step 3: access method, system configures AB testing scheme, meeting after configuration successful by access AB testing scheme configuration module
Unique mark of this AB testing scheme is returned, such as can be, but not limited to be number.With the example in abovementioned steps 1 continue into
Row explanation, is configured as follows: A Scheme Choice browser extractor, and configurable dimension matching value is QQBrowser；Selection
User scope extractor, and configuring dimension matching value is 0-51；Commodity category extractor is selected, and configuring dimension matching value is hand
Machine category.
Step 4: accessing method, system according to the unique identification of AB testing scheme, such as number, match mould to AB testing scheme
Block sends business request information, and AB testing scheme matching module returns to the name of corresponding sub- testing scheme after being matched
Claim information.Such as access method, system is configured with and numbers the AB testing scheme for being 1, there are two sub- testing schemes in the AB testing scheme
Name, respectively " A " and " B ", then AB testing scheme matching module can return to " A " or " B ".Still with abovementioned steps
It is illustrated for AB testing scheme in 1: when user is using mobile phone QQ browser scheme access mobile phone commodity and in 50% model
When enclosing interior, then AB scheme matching module can return to the message that user has hit sub- testing scheme A.
In following business scenario, AB testing scheme can be configured dynamically:
Business scenario 1: after the configuration of AB testing scheme finishes, step 1-3 can be skipped over, only according to step 4
Complete the judgement of AB testing scheme.
Business scenario 2: dimension matching value of certain the sub- testing scheme A of modification AB testing scheme in a certain dimension.Such as
Browser mark is configured to Chrome browser, and the matching value of A scheme browser extractor need to be only modified according to step 3.
Business scenario 3: dynamic modification AB testing scheme.Such as increases test dimension, a certain dimension of removal or increase son and survey
Examination scheme C etc..AB testing scheme is modified according to step 3 and is saved, new service request after saving successfully specifically, can be
It will be matched according to the AB testing scheme newly configured.
In addition, service request is to refer to the accession to the primary access of the user of method, system, such as user has browsed certain in Fig. 2
Webpage.When configuration output refers to user's requested webpage, web page server (i.e. access method, system) is requested according to this customer service
Message is sent to AB test device of the invention, AB test device of the invention can be according to the test side AB of access method, system configuration
Case, exports whether this service request meets certain sub- testing scheme or belong to which sub- testing scheme.
In addition, the request monitoring in Fig. 2 is recorded by AB testing scheme registration center, mainly record accesses method, system
Information to facilitate carry out subsequent statistical.
Four chief components of the device of the AB test of the embodiment of the present invention involved in abovementioned steps 1-4.Below
The function realization of this four chief components is described in detail:
1, dimension extractor constructing module:
Fig. 3 is the schematic diagram of the dimension extractor constructing module of the method for AB test according to an embodiment of the present invention.Such as Fig. 3
Shown, dimension extractor constructing module provides most basic text type extractor and digital type-collection device, as base
Plinth can derive browser UserAgent extractor, required parameter extractor, user scope extractor, and according to access
The customized extractor of the testing requirement of method, system.
(1) access method, system realizes specific test dimension extractor as needed, and in AB testing scheme registration center
The dimension extractor that middle registration is realized.If there are corresponding dimension extractors in dimension extractor constructing module, each to access
Method, system can be used in conjunction with, if it does not, each access method, system oneself is needed to realize customized dimension extractor.Dimension
The building method of extractor referring in previous constructions AB scheme be used to select dimension extractor step 1.
(2) dimension extractor constructing module obtains all dimension extractors constructed in access method, system, and is receiving
To after the acquisition dimension extractor request of AB testing scheme configuration module, dimension extractor information is returned.
(3) dimension extractor is divided into two major classes type: the extraction of text configurable text type extractor and numeric type
Device.
2, AB testing scheme configuration module:
(1) all extractions that current AB testing scheme configuration module is supported are obtained from AB test dimension extractor system
Device.
(2) AB testing scheme is added according to the default testing requirement of access side, and is tested in every height of AB testing scheme
Corresponding test dimension, i.e. selection a certain kind or several dimension extractors are added in scheme, and are configured to matched dimension
With value.
(3) AB testing scheme is generated.The request of registration AB testing scheme is sent to AB testing scheme registration center, and to connecing
Enter method, system and return to the unique identification of this time AB testing scheme of configuration, such as can be, but not limited to number.
(4) existing AB testing scheme is modified.It is registered that inquiry access method, system is sent to AB testing scheme registration center
AB testing scheme, a selection wherein strip testing scheme, modification saves, and concrete operations are the same as (1) and (2).
3, AB testing scheme registration center
Fig. 4 is the schematic diagram of the AB testing scheme registration center of the method for AB test according to an embodiment of the present invention.Such as Fig. 4
Shown, AB testing scheme registration center stores the specifying information of all AB testing schemes, and provide registration dimension extractor, with
And it obtains, save, the function of modification AB testing scheme.
(1) registration request for receiving AB testing scheme configuration module, saves AB testing scheme, and return to AB testing scheme
Unique identification.
(2) AB testing scheme registration center receives the request that access method, system inquires registered AB testing scheme, returns
The scheme and number of registration.
4, AB testing scheme matching module
Which sub- test is some business request information of AB testing scheme matching module concrete decision access method, system correspond to
The title of scheme.Business request information specifically refers to the http request that access method, system is sent to AB testing scheme matching module.
The request path of the http request refers to that the server path of AB testing scheme matching module, required parameter are AB testing schemes
Unique identification such as number, and access side's information (in the embodiment of the present invention, apply if it is Web, then access side by access method, system
It include the http request of user in information；If access method, system is APP application, access side's information includes client system
System, the information such as client release number).
(1) access method, system is obtained according to the unique identification for the AB testing scheme to be used from AB testing scheme registration center
The AB testing scheme of setting loops through every sub- testing scheme of AB testing scheme.Every sub- testing scheme is according to configuration
Dimension extractor extract dimension values, matched with the dimension matching value of configuration, each dimension extractor according to matching rule into
Row matching.If whole dimension extractor successful match in certain sub- testing scheme, illustrate that input request meets the sub- test
Otherwise scheme continues to match, until having traversed all sub- testing schemes, return to default scheme.Matched purpose determines herein
Service request specifically meets which sub- testing scheme in the AB testing scheme under the unique identification, and returns to the sub- testing scheme
The character string of title, e.g. sub- testing scheme A or sub- testing scheme B or other schemes.
(2) dimension lifts the principle of device matching configuration dimension: in the embodiment of the present invention, the extractor of text type supports packet
Contain, canonical, phase etc. matching logic；The dimension extractor of numeric type supports the matching logic for meeting magnitude range.For example, literary
The matching rule of this type can be the dimension matching that dimension values acquired by dimension extractor include dimension extractor configuration
Value (can match multiple, regular expression also can be used and matched), numeric type matching rule are then that extractor obtains
Dimension values in the range of the dimension matching value of configuration, such as number 50, Configuration Values 25-74 are extracted, then indicating
With success.
The method of AB test according to an embodiment of the present invention can be seen that because using taking out not from AB testing scheme
Same dimension extractor, the dimension extracted in service request are matched with the dimension matching value of the dimension in sub- testing scheme
Technological means, so overcome in the prior art formed AB testing scheme period it is long, AB testing scheme determine after change weight
The long technical problem of new release cycle, and then reach the test function point for being abstracted every sub- testing scheme, and realize general
Test dimension function, reduce the technical effect of the overlapping development of different AB testing schemes；By every in AB testing scheme
A sub- testing scheme can be divided into multiple dimensions, and according to the one or more dimensions of the testing requirement of every sub- testing scheme selection
Extractor is spent, so as to realize various dimensions, flexibly configurable AB test；By being modified according to the testing requirement changed
Or the sub- testing scheme of addition, so as to be changed in real time to AB testing scheme, so that the complexity that AB testing scheme is realized
It is substantially reduced, the test period of AB testing scheme significantly reduces, perfect so as to obtain test data progress product faster.
Fig. 5 is the schematic diagram of the main modular of the device of AB test according to an embodiment of the present invention；Enter shown in figure, the present invention
Embodiment AB test device 500 specifically include that dimension extractor constructing module 501, AB testing scheme configuration module 502 with
And AB testing scheme matching module 503.
Wherein, dimension extractor constructing module 501, for being mentioned according to the default testing requirement construction dimension of access method, system
Take device；AB testing scheme configuration module 502, for configuring the test side AB according to the default testing requirement of the access method, system
Then the unique identification information of the AB testing scheme is back to the access method, system by case, wherein configuration AB testing scheme
Include: the one or more sub- testing schemes of default testing requirement configuration according to the access method, system, is every height test side
Case selects corresponding dimension extractor, and sets corresponding dimension matching value；AB testing scheme matching module 503, for connecing
After the service request for receiving access method, system, according to the unique identification information for the AB testing scheme for including in the service request
Corresponding AB testing scheme is obtained, judges whether the service request meets the sub- testing scheme of the AB testing scheme, and is defeated
Judging result out.
Dimension extractor constructing module 501 can also be used in: according to the default testing requirement of access method, system, select existing
Dimension extractor；And/or it customized dimension extractor and saves.
AB testing scheme configuration module 502 can also be used in: select corresponding one or more dimensions for every sub- testing scheme
Spend extractor.
AB testing scheme matching module 503 can also be used in: judge whether the service request meets the AB testing scheme
One of them sub- testing scheme, comprising: extract the business using the dimension extractor for including in the sub- testing scheme and ask
The dimension values for seeking middle respective dimensions match the dimension values with corresponding dimension matching value in the sub- testing scheme,
If the equal successful match of all dimension values extracted in the sub- testing scheme, the service request meet the sub- test side
Otherwise case continues to judge its minor the testing scheme whether service request meets the AB testing scheme, until the AB
All sub- testing schemes are completed to match in testing scheme.
AB testing scheme configuration module 502 can also be used in: when default testing requirement changes, according to the survey after variation
Corresponding sub- testing scheme in the modification of examination demand and/or addition AB testing scheme.
From the above, it can be seen that because being extracted using different dimension extractors is taken out from AB testing scheme
The dimension matching value of the dimension in dimension and sub- testing scheme in service request carries out matched technological means, so overcoming
The period for forming AB testing scheme in the prior art is long, and AB testing scheme is changed again the long technology of release cycle and asked after determining
Topic, and then reach the test function point for being abstracted every sub- testing scheme, and realize general test dimension function, reduce
The technical effect of the overlapping development of different AB testing schemes；It is more by the way that every sub- testing scheme in AB testing scheme can be divided into
A dimension, and one or more dimension extractors are selected according to the testing requirement of every sub- testing scheme, so as to realize
Various dimensions, flexibly configurable AB test；By modifying according to the testing requirement changed or adding sub- testing scheme, thus
AB testing scheme can be changed in real time, so that the complexity that AB testing scheme is realized is substantially reduced, AB testing scheme
Test period significantly reduces, perfect so as to obtain test data progress product faster.
Fig. 6 is shown can be using the AB test method of the embodiment of the present invention or the exemplary system architecture of AB test device
600。
As shown in fig. 6, system architecture 600 may include terminal device 601,602,603, network 604 and server 605.
Network 604 between terminal device 601,602,603 and server 605 to provide the medium of communication link.Network 604 can be with
Including various connection types, such as wired, wireless communication link or fiber optic cables etc..
User can be used terminal device 601,602,603 and be interacted by network 604 with server 605, to receive or send out
Send message etc..Various telecommunication customer end applications, such as the application of shopping class, net can be installed on terminal device 601,602,603
(merely illustrative) such as the application of page browsing device, searching class application, instant messaging tools, mailbox client, social platform softwares.
Terminal device 601,602,603 can be the various electronic equipments with display screen and supported web page browsing, packet
Include but be not limited to smart phone, tablet computer, pocket computer on knee and desktop computer etc..
Server 605 can be to provide the server of various services, such as utilize terminal device 601,602,603 to user
The shopping class website browsed provides the back-stage management server (merely illustrative) supported.Back-stage management server can be to reception
To the data such as information query request analyze etc. processing, and by processing result (such as target push information, product letter
Breath -- merely illustrative) feed back to terminal device.
It should be noted that AB test method provided by the embodiment of the present invention is generally executed by server 605, accordingly
Ground, AB test device are generally positioned in server 605.
It should be understood that the number of terminal device, network and server in Fig. 6 is only schematical.According to realization need
It wants, can have any number of terminal device, network and server.
Below with reference to Fig. 7, it illustrates the computer systems 700 for the terminal device for being suitable for being used to realize the embodiment of the present invention
Structural schematic diagram.Terminal device shown in Fig. 7 is only an example, function to the embodiment of the present invention and should not use model
Shroud carrys out any restrictions.
As shown in fig. 7, computer system 700 includes central processing unit (CPU) 701, it can be read-only according to being stored in
Program in memory (ROM) 702 or be loaded into the program in random access storage device (RAM) 703 from storage section 708 and
Execute various movements appropriate and processing.In RAM 703, also it is stored with system 700 and operates required various programs and data.
CPU 701, ROM 702 and RAM 703 are connected with each other by bus 704.Input/output (I/O) interface 705 is also connected to always
Line 704.
I/O interface 705 is connected to lower component: the importation 706 including keyboard, mouse etc.；It is penetrated including such as cathode
The output par, c 707 of spool (CRT), liquid crystal display (LCD) etc. and loudspeaker etc.；Storage section 708 including hard disk etc.；
And the communications portion 709 of the network interface card including LAN card, modem etc..Communications portion 709 via such as because
The network of spy's net executes communication process.Driver 710 is also connected to I/O interface 705 as needed.Detachable media 711, such as
Disk, CD, magneto-optic disk, semiconductor memory etc. are mounted on as needed on driver 710, in order to read from thereon
Computer program be mounted into storage section 708 as needed.
Particularly, disclosed embodiment, the process described above with reference to flow chart may be implemented as counting according to the present invention
Calculation machine software program.For example, embodiment disclosed by the invention includes a kind of computer program product comprising be carried on computer
Computer program on readable medium, the computer program include the program code for method shown in execution flow chart.?
In such embodiment, which can be downloaded and installed from network by communications portion 709, and/or from can
Medium 711 is dismantled to be mounted.When the computer program is executed by central processing unit (CPU) 701, system of the invention is executed
The above-mentioned function of middle restriction.
It should be noted that computer-readable medium shown in the present invention can be computer-readable signal media or meter
Calculation machine readable storage medium storing program for executing either the two any combination.Computer readable storage medium for example can be --- but not
Be limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or any above combination.Meter
The more specific example of calculation machine readable storage medium storing program for executing can include but is not limited to: have the electrical connection, just of one or more conducting wires
Taking formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type may be programmed read-only storage
Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device,
Or above-mentioned any appropriate combination.In the present invention, computer readable storage medium can be it is any include or storage journey
The tangible medium of sequence, the program can be commanded execution system, device or device use or in connection.And at this
In invention, computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal,
Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including but unlimited
In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can
Any computer-readable medium other than storage medium is read, which can send, propagates or transmit and be used for
By the use of instruction execution system, device or device or program in connection.Include on computer-readable medium
Program code can transmit with any suitable medium, including but not limited to: wireless, electric wire, optical cable, RF etc. are above-mentioned
Any appropriate combination.
Flow chart and block diagram in attached drawing are illustrated according to the system of various embodiments of the invention, method and computer journey
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part of one module, program segment or code of table, a part of above-mentioned module, program segment or code include one or more
Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box
The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical
On can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wants
It is noted that the combination of each box in block diagram or flow chart and the box in block diagram or flow chart, can use and execute rule
The dedicated hardware based systems of fixed functions or operations is realized, or can use the group of specialized hardware and computer instruction
It closes to realize.
Being described in module involved in the embodiment of the present invention can be realized by way of software, can also be by hard
The mode of part is realized.Described module also can be set in the processor, for example, can be described as: a kind of processor packet
Include dimension extractor constructing module, AB testing scheme configuration module and AB testing scheme matching module.Wherein, the name of these modules
Claim not constituting the restriction to the module itself under certain conditions, for example, dimension extractor constructing module can also be described
For " for constructing the module of dimension extractor according to the default testing requirement of access method, system ".
As on the other hand, the present invention also provides a kind of computer-readable medium, which be can be
Included in equipment described in above-described embodiment；It is also possible to individualism, and without in the supplying equipment.Above-mentioned calculating
Machine readable medium carries one or more program, when said one or multiple programs are executed by the equipment, makes
Obtaining the equipment includes: to construct dimension extractor according to the default testing requirement of access method, system；According to the access method, system
Default testing requirement configures AB testing scheme, and the unique identification information of the AB testing scheme is then back to the access side
System, wherein configuration AB testing scheme includes: the one or more sons of default testing requirement configuration according to the access method, system
Testing scheme selects corresponding dimension extractor for every sub- testing scheme, and sets corresponding dimension matching value；It is receiving
It accesses after the service request of method, system, is obtained according to the unique identification information for the AB testing scheme for including in the service request
Corresponding AB testing scheme, judges whether the service request meets the sub- testing scheme of the AB testing scheme, and exports and sentence
Disconnected result.
Technical solution according to an embodiment of the present invention, because being extracted using different dimensions is taken out from AB testing scheme
Device, the dimension matching value for extracting the dimension in service request and the dimension in sub- testing scheme carry out matched technological means,
So the period for overcoming formation AB testing scheme in the prior art is long, it is long that AB testing scheme changes release cycle again after determining
The technical issues of, and then reach the test function point for being abstracted every sub- testing scheme, and realize general test dimension function
Can, reduce the technical effect of the overlapping development of different AB testing schemes；By every sub- testing scheme in AB testing scheme
Multiple dimensions can be divided into, and one or more dimension extractors are selected according to the testing requirement of every sub- testing scheme, from
And it can be realized various dimensions, flexibly configurable AB test；It is surveyed by the way that son is modified or added according to the testing requirement changed
Examination scheme, so as to be changed in real time to AB testing scheme, so that the complexity that AB testing scheme is realized is substantially reduced, AB
The test period of testing scheme significantly reduces, perfect so as to obtain test data progress product faster.
Above-mentioned specific embodiment, does not constitute a limitation on the scope of protection of the present invention.Those skilled in the art should be bright
It is white, design requirement and other factors are depended on, various modifications, combination, sub-portfolio and substitution can occur.It is any
Made modifications, equivalent substitutions and improvements etc. within the spirit and principles in the present invention, should be included in the scope of the present invention
Within.
Claims (12)
1. a kind of method of AB test characterized by comprising
Dimension extractor is constructed according to the default testing requirement of access method, system；
AB testing scheme is configured according to the default testing requirement of the access method, system, then by the unique of the AB testing scheme
Identification information is back to the access method, system, wherein configuration AB testing scheme includes: according to the default of the access method, system
The one or more sub- testing schemes of testing requirement configuration select corresponding dimension extractor for every sub- testing scheme, and set
Corresponding dimension matching value；
After the service request for receiving access method, system, according to the unique of the AB testing scheme for including in the service request
Identification information obtains corresponding AB testing scheme, judges whether the service request meets the sub- test side of the AB testing scheme
Case, and export judging result.
2. the method according to claim 1, wherein constructing dimension according to the default testing requirement of access method, system
Extractor includes:
According to the default testing requirement of access method, system, existing dimension extractor is selected；And/or
Customized dimension extractor.
3. the method according to claim 1, wherein selecting corresponding dimension extractor for every sub- testing scheme
It include: to select corresponding one or more dimension extractors for every sub- testing scheme.
4. the method according to claim 1, wherein judging whether the service request meets the test side AB
The sub- testing scheme of case includes:
Judge whether the service request meets one of them sub- testing scheme of the AB testing scheme, comprising: described in utilization
The dimension extractor for including in sub- testing scheme extracts the dimension values of respective dimensions in the service request, by the dimension values with
Corresponding dimension matching value is matched in the sub- testing scheme, if all dimension values extracted in the sub- testing scheme are equal
Successful match, then the service request meets the sub- testing scheme, otherwise continues to judge whether the service request meets institute
Its minor testing scheme of AB testing scheme is stated, until sub- testing scheme all in the AB testing scheme is completed to match.
5. the method according to claim 1, wherein the method also includes: when default testing requirement becomes
When change, corresponding sub- testing scheme in AB testing scheme is modified and/or added according to the testing requirement after variation.
6. a kind of device of AB test characterized by comprising
Dimension extractor constructing module, for constructing dimension extractor according to the default testing requirement of access method, system；
AB testing scheme configuration module, for configuring AB testing scheme according to the default testing requirement of the access method, system, so
The unique identification information of the AB testing scheme is back to the access method, system afterwards, wherein configuring AB testing scheme includes:
According to the one or more sub- testing schemes of default testing requirement configuration of the access method, system, for every sub- testing scheme selection
Corresponding dimension extractor, and set corresponding dimension matching value；
AB testing scheme matching module, for receive access method, system service request after, according to the service request
In include the unique identification information of AB testing scheme obtain corresponding AB testing scheme, judge whether the service request meets
The sub- testing scheme of the AB testing scheme, and export judging result.
7. device according to claim 6, which is characterized in that the dimension extractor constructing module is also used to:
According to the default testing requirement of access method, system, existing dimension extractor is selected, and save；And/or
Customized dimension extractor.
8. device according to claim 6, which is characterized in that the AB testing scheme configuration module is also used to: being each
Sub- testing scheme selects corresponding one or more dimension extractors.
9. device according to claim 6, which is characterized in that the AB testing scheme matching module is also used to:
Judge whether the service request meets one of them sub- testing scheme of the AB testing scheme, comprising: described in utilization
The dimension extractor for including in sub- testing scheme extracts the dimension values of respective dimensions in the service request, by the dimension values with
Corresponding dimension matching value is matched in the sub- testing scheme, if all dimension values extracted in the sub- testing scheme are equal
Successful match, then the service request meets the sub- testing scheme, otherwise continues to judge whether the service request meets institute
Its minor testing scheme of AB testing scheme is stated, until sub- testing scheme all in the AB testing scheme is completed to match.
10. device according to claim 6, which is characterized in that the AB testing scheme configuration module is also used to: when default
When testing requirement changes, corresponding son test in AB testing scheme is modified and/or added according to the testing requirement after variation
Scheme.
11. a kind of electronic equipment characterized by comprising
One or more processors；
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processors are real
Now such as method as claimed in any one of claims 1 to 5.
12. a kind of computer-readable medium, is stored thereon with computer program, which is characterized in that described program is held by processor
Such as method as claimed in any one of claims 1 to 5 is realized when row.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711077000.1A CN109753424B (en) | 2017-11-06 | 2017-11-06 | AB test method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711077000.1A CN109753424B (en) | 2017-11-06 | 2017-11-06 | AB test method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109753424A true CN109753424A (en) | 2019-05-14 |
| CN109753424B CN109753424B (en) | 2022-08-12 |
Family
ID=66401018
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711077000.1A Active CN109753424B (en) | 2017-11-06 | 2017-11-06 | AB test method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109753424B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110597706A (en) * | 2019-08-02 | 2019-12-20 | 贝壳技术有限公司 | Method and device for testing application program interface data abnormity |
| CN111181858A (en) * | 2019-12-24 | 2020-05-19 | 浙江大华技术股份有限公司 | Method, system, computer device and storage medium for gray scale distribution |
| CN111708711A (en) * | 2020-06-23 | 2020-09-25 | 湖南快乐阳光互动娱乐传媒有限公司 | AB test method and device, storage medium and electronic equipment |
| CN112242911A (en) * | 2019-07-17 | 2021-01-19 | 腾讯科技（深圳）有限公司 | Network flow based test method and device, storage medium and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104052809A (en) * | 2014-06-17 | 2014-09-17 | 北京京东尚科信息技术有限公司 | Distribution control method and device for web testing |
| US20150012852A1 (en) * | 2013-07-08 | 2015-01-08 | Kobo Incorporated | User interface tool for planning an ab type of test |
| CN104348679A (en) * | 2013-08-08 | 2015-02-11 | 阿里巴巴集团控股有限公司 | Bucket testing method, device and system |
| CN106341290A (en) * | 2016-08-31 | 2017-01-18 | 北京城市网邻信息技术有限公司 | Flow distribution server |
| CN106598741A (en) * | 2016-12-16 | 2017-04-26 | 飞狐信息技术（天津）有限公司 | Distributed type A/B test method, system and video recommendation system for personalized recommendation system |
-
2017
- 2017-11-06 CN CN201711077000.1A patent/CN109753424B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150012852A1 (en) * | 2013-07-08 | 2015-01-08 | Kobo Incorporated | User interface tool for planning an ab type of test |
| CN104348679A (en) * | 2013-08-08 | 2015-02-11 | 阿里巴巴集团控股有限公司 | Bucket testing method, device and system |
| CN104052809A (en) * | 2014-06-17 | 2014-09-17 | 北京京东尚科信息技术有限公司 | Distribution control method and device for web testing |
| CN106341290A (en) * | 2016-08-31 | 2017-01-18 | 北京城市网邻信息技术有限公司 | Flow distribution server |
| CN106598741A (en) * | 2016-12-16 | 2017-04-26 | 飞狐信息技术（天津）有限公司 | Distributed type A/B test method, system and video recommendation system for personalized recommendation system |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112242911A (en) * | 2019-07-17 | 2021-01-19 | 腾讯科技（深圳）有限公司 | Network flow based test method and device, storage medium and electronic equipment |
| CN112242911B (en) * | 2019-07-17 | 2022-08-12 | 腾讯科技（深圳）有限公司 | Network flow based test method and device, storage medium and electronic equipment |
| CN110597706A (en) * | 2019-08-02 | 2019-12-20 | 贝壳技术有限公司 | Method and device for testing application program interface data abnormity |
| CN111181858A (en) * | 2019-12-24 | 2020-05-19 | 浙江大华技术股份有限公司 | Method, system, computer device and storage medium for gray scale distribution |
| CN111708711A (en) * | 2020-06-23 | 2020-09-25 | 湖南快乐阳光互动娱乐传媒有限公司 | AB test method and device, storage medium and electronic equipment |
| CN111708711B (en) * | 2020-06-23 | 2023-04-07 | 湖南快乐阳光互动娱乐传媒有限公司 | AB test method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109753424B (en) | 2022-08-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107451109A (en) | Report form generation method and system | |
| CN109753424A (en) | The method and apparatus of AB test | |
| CN108805594A (en) | Information-pushing method and device | |
| CN109683998A (en) | Internationalize implementation method, device and system | |
| CN110472207A (en) | List generation method and device | |
| CN109426593A (en) | The method and apparatus of automatic evaluation system performance | |
| CN110019125A (en) | The method and apparatus of data base administration | |
| CN109614402A (en) | Multidimensional data query method and device | |
| CN108776692A (en) | Method and apparatus for handling information | |
| CN110377522A (en) | The test method for scene of trading, calculates equipment and medium at device | |
| CN107885873A (en) | Method and apparatus for output information | |
| CN109634833A (en) | A kind of Software Defects Predict Methods and device | |
| CN108958959A (en) | The method and apparatus for detecting hive tables of data | |
| CN107480205A (en) | A kind of method and apparatus for carrying out data partition | |
| CN109002440A (en) | Method, apparatus and system for big data multidimensional analysis | |
| CN107784076A (en) | The method and apparatus of visualization structure user behavior data | |
| CN109901987A (en) | A kind of method and apparatus generating test data | |
| CN109241033A (en) | The method and apparatus for creating real-time data warehouse | |
| CN110471848A (en) | A kind of method and apparatus of dynamic returned packet | |
| CN110019437A (en) | A kind of method and system exporting data | |
| CN107908662A (en) | The implementation method and realization device of search system | |
| CN109002385A (en) | Method for testing pressure and device for data flow system | |
| CN109063142A (en) | Web page resources method for pushing and server | |
| CN110309142A (en) | The method and apparatus of regulation management | |
| CN107562941A (en) | Data processing method and its system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |