CN107273290A - The A/B method of testings and device of a kind of Page Service - Google Patents
The A/B method of testings and device of a kind of Page Service Download PDFInfo
- Publication number
- CN107273290A CN107273290A CN201710444537.0A CN201710444537A CN107273290A CN 107273290 A CN107273290 A CN 107273290A CN 201710444537 A CN201710444537 A CN 201710444537A CN 107273290 A CN107273290 A CN 107273290A
- Authority
- CN
- China
- Prior art keywords
- test
- page
- masterplate
- packet
- page request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Abstract
The invention discloses a kind of A/B method of testing devices of Page Service, it is related to field of computer technology.Methods described, including：Receive the page request that client is sent；The test elements in initial masterplate are filtered according to preset rules according to the page request, obtain testing masterplate；According to the test masterplate generation test page；The response of the test page as the page request is sent to the client.Solve existing A/B test process to take and dumb, and be easily caused the technical problem that error rate rises, risk increases.Achieving reduces modification operation, reduces operation and takes, improves the beneficial effect of test flexibility and accuracy rate.
Description
Technical field
The present invention relates to field of computer technology, and in particular to a kind of A/B method of testing devices of Page Service.
Background technology
A/B tests are a kind of emerging front page optimization methods, can be used for the webpage indexs such as increase conversion ratio, registration rate.
A/B tests are substantially experiments between a separate type group, and the technical costs and resources costs that A/B tests were carried out in the past are of a relatively high,
But a series of appearance of present professional visualized experiment instruments, A/B tests have increasingly becomed the conventional method of web information flow.
A/B is tested, in simple terms, is exactly to formulate two schemes (such as two pages) for same test target, is allowed a part of user
Using A schemes, another part user uses B schemes, records the service condition of user, see which scheme more meets design.
At present when using A/B tests, it is necessary first to set up a test page (variation page), this page
May be in Header font, background color is different with original page (control page) in terms of wording, then by this two
The individual page is pushed to all browses user in a random way simultaneously.Next user's conversion ratio of two pages is counted respectively,
The quality of two kinds of designs can clearly be recognized.
But in existing A/B test process, code logic will be correspondingly changed during modification test cases every time, and then
Cause test process time-consuming and dumb, and modification code also results in the problem of error rate rises, risk increases.
The content of the invention
In view of the above problems, it is proposed that the present invention so as to provide one kind overcome above mentioned problem or at least in part solve on
State a kind of A/B method of testings of Page Service of problem and a kind of A/B test devices of corresponding Page Service.
According to one aspect of the present invention there is provided a kind of A/B method of testings of Page Service, including：
Receive the page request that client is sent；
The test elements in initial masterplate are filtered according to preset rules according to the page request, obtain testing mould
Version；
According to the test masterplate generation test page；
The response of the test page as the page request is sent to the client.
Alternatively, it is described that the test elements in initial masterplate were carried out according to preset rules according to the page request
Filter, the step of obtaining test masterplate, including：
The first filtration parameter needed for the preset rules is obtained from the page request；
According to default rule of classification, the packet belonging to each test elements is determined；
According to first filtration parameter, default filtering rule corresponding with each packet is utilized respectively to initial masterplate
In test elements filtered, obtain test masterplate.
Alternatively, it is described according to first filtration parameter, it is utilized respectively default filtering corresponding with each packet and advises
Then the test elements in initial masterplate are filtered, the step of obtaining test masterplate, including：
For each packet, using default filtering rule corresponding with the packet, judge in each packet whether
In the presence of the target detection element matched with first filtration parameter；
If there is the target detection element matched with first filtration parameter in current group, by current group
Described in other test elements beyond target detection element filtered；
If the target detection element matched with first filtration parameter is not present in current group, will currently it divide
Other test elements in group in addition to test elements are given tacit consent to are filtered.
Alternatively, it is described according to default rule of classification, the step of determining the packet belonging to each test elements, bag
Include：
According to the component identification of each test elements, component identification identical test elements are divided into same packet.
Alternatively, the test elements in initial masterplate were carried out according to preset rules according to the page request described
Before filter, the step of obtaining test masterplate, in addition to：
According to the page request, the introductory die matched with the page request is searched from default initial template library
Version.
Alternatively, sent in the response using the test page as the page request to the step of the client
After rapid, in addition to：
User's conversion ratio of the test page is counted from the client；
User's conversion ratio highest test page is selected as the released version of the page request.
According to another aspect of the present invention, a kind of A/B test devices of Page Service are disclosed, including：
Page request receiving module, the page request for receiving client transmission；
Original template filtering module, for first to the test in initial masterplate according to preset rules according to the page request
Element is filtered, and obtains testing masterplate；
Test page generation module, for according to the test masterplate generation test page；
Test page sending module, for the response of the test page as the page request to be sent to the visitor
Family end.
Alternatively, the original template filtering module, including：
First filtration parameter acquisition submodule, for obtaining first needed for the preset rules from the page request
Filtration parameter；
Submodule is grouped, for according to default rule of classification, determining the packet belonging to each test elements；
Original template filter submodule, it is corresponding with each packet for according to first filtration parameter, being utilized respectively
Default filtering rule the test elements in initial masterplate are filtered, obtain test masterplate.
Alternatively, the original template filter submodule, including：
Target detection element judging unit, for for each packet, utilizing default filtering corresponding with the packet
Rule, judges in each packet with the presence or absence of the target detection element matched with first filtration parameter；
First filter element, if for there is the target detection matched with first filtration parameter in current group
Element, then filtered other test elements beyond target detection element described in current group；
Second filter element, if surveyed for the target matched with first filtration parameter to be not present in current group
Element is tried, then is filtered other test elements in current group in addition to test elements are given tacit consent to.
Alternatively, the packet submodule, is additionally operable to the component identification according to each test elements, by component identification phase
Same test elements are divided into same packet.
Alternatively, in addition to：
Initial masterplate matching module, for according to the page request, searched from default initial template library with it is described
The initial masterplate of page request matching.
Alternatively, in addition to：
User's conversion ratio statistical module, user's conversion ratio for counting the test page from the client；
Released version determining module, for selecting user's conversion ratio highest test page as the page request
Released version.
According to a kind of A/B method of testings of Page Service of the present invention, the page request of client transmission can be received；Root
The test elements in initial masterplate are filtered according to preset rules according to the page request, obtain testing masterplate；According to institute
State test masterplate generation test page；The response of the test page as the page request is sent to the client.
Thus solve in existing A/B test process, will correspondingly change code logic during modification test cases every time, and then cause
Test process is time-consuming and dumb, and modification code also results in the problem of error rate rises, risk increases.Achieve reduction
Modification operation, reduces that operation is time-consuming, improves the beneficial effect of test flexibility and accuracy rate.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention,
And can be practiced according to the content of specification, and in order to allow above and other objects of the present invention, feature and advantage can
Become apparent, below especially exemplified by the embodiment of the present invention.
Brief description of the drawings
By reading the detailed description of hereafter preferred embodiment, various other advantages and benefit is common for this area
Technical staff will be clear understanding.Accompanying drawing is only used for showing the purpose of preferred embodiment, and is not considered as to the present invention
Limitation.And in whole accompanying drawing, identical part is denoted by the same reference numerals.In the accompanying drawings：
Fig. 1 shows a kind of step flow chart of the A/B method of testings of Page Service according to an embodiment of the invention；
Fig. 2 shows a kind of step flow chart of the A/B method of testings of Page Service according to an embodiment of the invention；
Fig. 3 shows a kind of structural representation of the A/B test devices of Page Service according to an embodiment of the invention.
And
Fig. 4 shows a kind of structural representation of the A/B test devices of Page Service according to an embodiment of the invention.
Embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although showing the disclosure in accompanying drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
Limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
Complete conveys to those skilled in the art.
Embodiment one
A kind of A/B method of testings of Page Service provided in an embodiment of the present invention are discussed in detail.
Reference picture 1, shows a kind of step flow chart of the A/B method of testings of Page Service in the embodiment of the present invention.
Step 110, the page request that client is sent is received.
In actual applications, it is necessary to send page request to clothes by client when user accesses certain page if desired
Business device, is shown with obtaining the corresponding page in client.In embodiments of the present invention, for the different exhibitions to the same page
Show that style is tested, the different displaying styles to application one page face can be sent to different client users, but still
So need after the page request of client transmission is received, just the page can be fed back to client.Therefore, of the invention real
Apply in example.Firstly the need of the page request for receiving client transmission.Moreover, page request therein is for needing to be tested
The page page request, the web-page requests of browser can be included, the page of application program (Application, APP) please
Ask, etc..And typically can be with respective client client information, such as client ip (Internet in page request
Protocol, Internet protocol) address, client sequence number, client current user information, etc..
Step 120, the test elements in initial masterplate are filtered according to preset rules according to the page request, obtained
To test masterplate.
It has been observed that in actual applications, A/B tests are exactly to formulate two schemes for same test target in simple terms
(such as two pages), allows a part of user to use A schemes, and another part user uses B schemes, records the use feelings of user
Condition, sees which scheme more meets design.So in embodiments of the present invention, same test target can be understood as same
Network access address, same URL (Uniform Resource Locator, URL) or it is same APP
Same position page, etc..Moreover, in embodiments of the present invention, at least two sides can be formulated for same test target
Case, for example, prepare at least two page responses, etc. for same networking reference address, this embodiment of the present invention do not limited
It is fixed.In embodiments of the present invention, can according to demand it be set before this step, or before either step before this step
The test elements quantity finally retained in test masterplate after the species of the test elements included in fixed initial masterplate, and filtering
And species, this embodiment of the present invention is not limited.
In embodiments of the present invention, page test job personnel can pre-set the introductory die for current test address
Version, can include multiple test elements for needing to be tested in initial masterplate.Test elements therein can also be according to need
Ask before this step, or the either step before this step is set, and this embodiment of the present invention is not limited.
For example, for a certain page to be tested, it is assumed that it includes two sub-regions, respectively subregion A and region B,
Wherein two kinds can be divided into for the exhibition method of the displaying content in the A of region, then region A can be directed in initial masterplate
Displaying content exhibition method set two test elements A1 and A2；And for a user for the displaying in the B of region
The exhibition method of content can also be divided into two kinds, then region B displaying content can be equally directed in initial masterplate
Exhibition method set two test elements B1 and B2.A1 and A2 therein be for subregion A two kinds of exhibition schemes, B1 and
B2 is two kinds of exhibition schemes for subregion B, then A1 and A2 can not then be appeared in same test masterplate simultaneously, B1 and B2
It can not appear in simultaneously in same test masterplate.
Therefore, in embodiments of the present invention, it is necessary to according to page request according to preset rules to the test in initial masterplate
Element is filtered, and obtains testing masterplate.Preset rules therein can be according to demand before this step, or this step
Set before either step before, this embodiment of the present invention is not limited.
For example, preset rules can be set to be first ranked up to the test elements in initial masterplate, or be packet after
And sort, the IP address in the page request that then basis is received, by sequence number in initial masterplate and IP address tail number
Inconsistent test elements are filtered, or by sequence number and IP address tail number parity in each packet in initial masterplate not
Consistent test elements filter, etc..This embodiment of the present invention is not limited.
Step 130, according to the test masterplate generation test page.
, then can be according to test masterplate generation test sheets to obtaining testing masterplate after the test elements filtering in initial masterplate
Face.In embodiments of the present invention, during the test elements set in initial masterplate, while each test elements can be set initial
Displaying details in masterplate, such as display location, displaying size etc..
So in embodiments of the present invention, then can be according to the test masterplate generation obtained after filtering to be asked as the page
Seek the test page of response.Specifically test page can be generated according to test masterplate in method using any one, to this
The embodiment of the present invention is not limited.
Step 140, the response of the test page as the page request is sent to the client.
After corresponding test page is generated, in order to detect that respective client end subscriber is converted to the user of the test page
Situation, further analyzes user's conversion ratio of the test page, then needs to regard the test page of generation as the page received
The response of request is back to corresponding client.In embodiments of the present invention, it is possible to use any available means are by test page
The response asked as respective page is sent to relative client, and this embodiment of the present invention is not limited.
In embodiments of the present invention, the page request of client transmission can be received；According to the page request according to pre-
If rule filters the test elements in initial masterplate, obtain testing masterplate；According to the test masterplate generation test sheets
Face；The response of the test page as the page request is sent to the client.Thus existing A/B tests are solved
During, code logic will be correspondingly changed during modification test cases every time, and then cause test process time-consuming and dumb,
And modification code also results in the problem of error rate rises, risk increases.Achieving reduces modification operation, reduces operation
It is time-consuming, improve the beneficial effect of test flexibility and accuracy rate.
Embodiment two
A kind of A/B method of testings of Page Service provided in an embodiment of the present invention are discussed in detail.
Reference picture 1, shows a kind of step flow chart of the A/B method of testings of Page Service in the embodiment of the present invention.
Step 210, the page request that client is sent is received.
Step 220, according to the page request, search what is matched with the page request from default initial template library
Initial masterplate.
In actual applications, A/B tests can be carried out for multiple different targets simultaneously.So in the embodiment of the present invention
In, an initial template library can be pre-set, can be comprising multiple for the initial of different test targets in initial template library
Masterplate.And the page request of client transmission is usually the page request of a certain test target of correspondence, then of the invention real
Apply in example, then the page request that can be sent according to the client received is searched and the page request from initial template library
The initial masterplate of matching.
The corresponding test target of page request specifically can be first obtained, is then searched and the test from initial template library
The corresponding initial masterplate of target, then the initial masterplate is the initial masterplate matched with page request.Can certainly basis
The initial masterplate that the page request that other specification is searched with being currently received from default initial template library is matched, to this this hair
Bright embodiment is not limited.
Step 230, the first filtration parameter needed for the preset rules is obtained from the page request.
It has been observed that in embodiments of the present invention, it is necessary to be carried out according to page request to the test elements in initial masterplate
Filter, the first filtration parameter that specifically can be in page request is filtered to the test elements in initial masterplate.Wherein
The first filtration parameter can be the device numbering of client, the IP address of client, the user profile of client user, etc.
It can include user's mark, age of user, user's sex, user's occupation etc. Deng, user profile therein.In present invention implementation
In example, the first filtration parameter can be set according to demand before this step, or before either step before this step
Particular content, this embodiment of the present invention is not limited.
For example, being carried out if necessary to the parity of the device numbering according to client to the test elements in initial masterplate
Filter, then can then set the equipment for obtaining the corresponding client of client for sending the page request from page request to compile
Number, and due to the device numbering according to client last i.e. can determine client device numbering parity,
Therefore last position in the device numbering for the corresponding client of client for directly obtaining the page request can also be set, or
Person is last several, etc..
Step 240, according to default rule of classification, the packet belonging to each test elements is determined.
It has been observed that there may be multiple test elements for same display area in initial masterplate, namely in filtering
The multiple test elements that can not occur simultaneously in same test masterplate afterwards.In embodiments of the present invention, mutually will can not
The test elements appeared in same test masterplate are divided into one group., then can be according to so when being filtered to test elements
Packet is filtered, and only one test elements of reservation in same packet.So, in embodiments of the present invention, need first
The packet belonging to each test elements is determined according to default rule of classification.
In embodiments of the present invention, each test elements can be divided according to the corresponding display area of each test elements
Group.For example, foregoing test elements A1, A2, B1 and B2, wherein A1 and A2 correspond to corresponding to same display area A, B1 and B2
Same display area B, then can be then one group by A1 and A2 points, while being one group by B1 and B2 points.In addition, of the invention real
Apply in example, the packets of each test elements can also be determined using other modes, specifically can be before this step, or this step
Rule of classification is set according to demand before either step before rapid, and this embodiment of the present invention is not limited.
Alternatively, in embodiments of the present invention, the step 240 further may include：
Sub-step 241, according to the component identification of each test elements, component identification identical test elements are divided into
Same packet.
In embodiments of the present invention, when setting each test elements, the element mark of each test elements can also be set simultaneously
Know, then then component identification identical test elements can be divided into by same packet according to the component identifications of each test elements.
, wherein it is desired to ensure that the component identification of the test elements of different grouping is different.
For example, for foregoing test elements A1, A2, B1 and B2, test elements A1 and A2 element can be pre-set
A is designated, and B1 and B2 component identification is set for b, then can be then one group by A1 and A2 points, while being by B1 and B2 points
One group.
Wherein, the component identification of each test elements can be set according to demand, and set each test elements
During component identification, the component identification of the test elements of the same display area of correspondence can be set identical, and the different show areas of correspondence
The component identification of the test elements in domain is different.
Step 250, according to first filtration parameter, it is utilized respectively default filtering rule pair corresponding with each packet
Test elements in initial masterplate are filtered, and obtain testing masterplate.
In embodiments of the present invention, then can be according to the first filtering rule to first after the first filtration parameter is obtained
Test elements in beginning masterplate are filtered.But in embodiments of the present invention, the default filtering corresponding to different packets is advised
Then can be with not quite identical, then can be then utilized respectively corresponding with each packet default according to the first filtration parameter of acquisition
Filtering rule is filtered to the test elements in initial masterplate, obtains testing masterplate.Wherein, it is corresponding with each packet to preset
Filtering rule can be set according to demand before this step, or before either step before this step, to this
Inventive embodiments are not limited, and correspondingly can be with completely the same with the default filtering rule of different grouping, can also be endless
It is complete consistent, this embodiment of the present invention is not also limited.
For example, the test elements included in the corresponding initial masterplate of the page request being currently received be foregoing A1, A2,
B1 and B2, wherein, A1 and A2 belong to same packet, and B1 and B2 belong to another packet, it is assumed that point constituted for A1 and A2
The corresponding default filtering rule of group is that A1 is distributed into the client that device numbering is odd number, and A2 is distributed into device numbering for occasionally
Several clients；And the default filtering rule for the B1 and B2 packets constituted is that B2 is distributed into the visitor that device numbering is odd number
Family end, the client that device numbering is even number is distributed to by B1.It is assumed that the corresponding equipment of the page request now obtained is compiled
Number it is 0011, then the test elements included after now filtering in obtained test masterplate are A1 and B2.
Certainly, in embodiments of the present invention, the first filtration parameter for different grouping acquisition can also be set also endless
It is exactly the same.For example, the first filtration parameter setting for client that the packet for above-mentioned A1 and A2 compositions can be set to obtain
Standby numbering, and the first filtration parameter that the packet constituted for above-mentioned B1 and B2 is obtained is the IP address of client, then this
When still can be that A1 is distributed into device numbering is odd number for the corresponding default filtering rule of packet that A1 and A2 are constituted
Client, the client that device numbering is even number is distributed to by A2；And for the corresponding default filtering of packet of B1 and B2 compositions
Rule could be arranged to B1 distributing to the client that IP address tail number is odd number, and it is even number that B2 is distributed into IP address tail number
Client.If that the device numbering of the client obtained for the packet that A1 and A2 is constituted is 0011, and for above-mentioned
The IP address for the client that the packet that B1 and B2 is constituted is obtained is 119.57.117.177, then the test obtained after now filtering
The test elements included in masterplate are A1 and B1.
Alternatively, in embodiments of the present invention, the step 250 can further include：
Sub-step 251, for each packet, using default filtering rule corresponding with the packet, judges each described
With the presence or absence of the target detection element matched with first filtration parameter in packet.
Sub-step 252, if there is the target detection element matched with first filtration parameter in current group,
Other test elements beyond target detection element described in current group are filtered.
Sub-step 253, if the target detection element matched with first filtration parameter is not present in current group,
Then other test elements in current group in addition to test elements are given tacit consent to are filtered.
In actual applications, it is also possible to in a certain packet, using default filtering rule corresponding with the packet without
Method obtains the target detection element matched with the first filtration parameter in the packet, then now can not then be obtained from the packet
The target detection element being retained in test masterplate is needed, so as to can further influence displaying to the effect of the test page of client
Really.
Therefore, in embodiments of the present invention, an acquiescence test elements can be pre-set for each packet, when for
A certain packet using corresponding default filtering rule confirmation needs by this be grouped in whole test elements filtered, then then
Acquiescence test elements that can be in the packet are used as the target detection element for needing to be retained in test masterplate.Acquiescence therein is surveyed
Trying element can be set according to demand before this step, or before either step before this step, to this
Inventive embodiments are not limited.
So, in embodiments of the present invention, when the test elements in each packet are filtered, each point can be first directed to
Group, using default filtering rule corresponding with each packet, judges in each packet with the presence or absence of the mesh matched with the first filtration parameter
Mark test elements.If there is the target detection element matched with the first filtration parameter in current group, by current group
Other test elements beyond middle target detection element are filtered.And join if be not present in current group with the first filtering
The target detection element of number matching, then filtered other test elements in current group in addition to test elements are given tacit consent to.
Step 260, according to the test masterplate generation test page.
Step 270, the response of the test page as the page request is sent to the client.
Step 280, user's conversion ratio of the test page is counted from the client.
In actual applications, the purpose that test target carries out A/B tests is to determine the most suitable test target
Test page.So in embodiments of the present invention, sent by test page to client, can further count the survey
Try user's conversion ratio of the page.User's conversion ratio therein, which can be understood as receiving in the user of the test page, turns into the survey
Try the ratio of page regular user, the user of namely regular user/the receive test page, regular user therein can be wrapped
The user that clicking operation is carried out to test page is included, or to test page consume the user of operation, or is being surveyed
Try the page and carry out user of user's registration etc..In embodiments of the present invention, can be according to demand before this step, either
The type of regular user is set before either step before this step, this embodiment of the present invention is not limited.
Moreover, in embodiments of the present invention, in order to calculate user's conversion ratio of each test page, can count respectively pre-
If the user that each test page is received in the period is converted into the ratio of regular user, and then can obtain each test page
User's conversion ratio.Preset time period therein can be according to demand before this step, or any step before this step
Set before rapid, this embodiment of the present invention is not limited.
Step 290, user's conversion ratio highest test page is selected as the released version of the page request.
It has been observed that user's conversion ratio of a certain test page is higher, then explanation receives user's transfer of the test page
The probability for turning to regular user is higher, can further illustrate that the test page is bigger to the attraction of user, then in meter
Calculate after the user's conversion ratio for obtaining each test page, then can select user's conversion ratio highest test page as corresponding page
The released version asked is requested in person, namely user's conversion ratio highest test page can be selected to be surveyed as respective page request is corresponding
Try the released version of target.After the released version of test target is determined, then receive any client transmission again
The page request for the test target after, directly can be back to relative client using the released version as response.
In embodiments of the present invention, the page request of client transmission can be received；According to the page request according to pre-
If rule filters the test elements in initial masterplate, obtain testing masterplate；According to the test masterplate generation test sheets
Face；The response of the test page as the page request is sent to the client.Thus existing A/B tests are solved
During, code logic will be correspondingly changed during modification test cases every time, and then cause test process time-consuming and dumb,
And modification code also results in the problem of error rate rises, risk increases.Achieving reduces modification operation, reduces operation
It is time-consuming, improve the beneficial effect of test flexibility and accuracy rate.
Moreover, in embodiments of the present invention, first needed for the preset rules can be obtained from the page request
Filtration parameter；According to default rule of classification, the packet belonging to each test elements is determined；Joined according to the described first filtering
Number, is utilized respectively default filtering rule corresponding with each packet and the test elements in initial masterplate is filtered, obtain
Test masterplate.Also, for each packet, using default filtering rule corresponding with the packet, judge each packet
In with the presence or absence of the target detection element that is matched with first filtration parameter；If existed and described first in current group
The target detection element of filtration parameter matching, then enter other test elements beyond target detection element described in current group
Row filtering；If the target detection element matched with first filtration parameter is not present in current group, will currently it divide
Other test elements in group in addition to test elements are given tacit consent to are filtered.So as to further improve the test masterplate obtained
Accuracy rate.
In addition, in embodiments of the present invention, can also be searched according to the page request from default initial template library
The initial masterplate matched with the page request.So as to carry out A/B tests for multiple test targets simultaneously, further may be used
To improve the efficiency of test.
Further, in embodiments of the present invention, the user that the test page can also be counted from the client turns
Rate；User's conversion ratio highest test page is selected as the released version of the page request.So as to accurate
Determine the released version of each test target.
For embodiment of the method, in order to be briefly described, therefore it is all expressed as to a series of combination of actions, but this area
Technical staff should know that the embodiment of the present invention is not limited by described sequence of movement, because according to present invention implementation
Example, some steps can be carried out sequentially or simultaneously using other.Secondly, those skilled in the art should also know, specification
Described in embodiment belong to necessary to preferred embodiment, the involved action not necessarily embodiment of the present invention.
Embodiment three
A kind of A/B test devices of Page Service provided in an embodiment of the present invention are discussed in detail.
Reference picture 3, shows a kind of structural representation of the A/B test devices of Page Service in the embodiment of the present invention.
Page request receiving module 310, the page request for receiving client transmission.
Original template filtering module 320, for according to the page request according to preset rules to the survey in initial masterplate
Examination element is filtered, and obtains testing masterplate.
Test page generation module 330, for according to the test masterplate generation test page.
Test page sending module 340, for the response of the test page as the page request to be sent to institute
State client.
In embodiments of the present invention, the page request of client transmission can be received；According to the page request according to pre-
If rule filters the test elements in initial masterplate, obtain testing masterplate；According to the test masterplate generation test sheets
Face；The response of the test page as the page request is sent to the client.Thus existing A/B tests are solved
During, code logic will be correspondingly changed during modification test cases every time, and then cause test process time-consuming and dumb,
And modification code also results in the problem of error rate rises, risk increases.Achieving reduces modification operation, reduces operation
It is time-consuming, improve the beneficial effect of test flexibility and accuracy rate.
Example IV
A kind of A/B test devices of Page Service provided in an embodiment of the present invention are discussed in detail.
Reference picture 4, shows a kind of structural representation of the A/B test devices of Page Service in the embodiment of the present invention.
Page request receiving module 410, the page request for receiving client transmission.
Initial masterplate matching module 420, for according to the page request, being searched and institute from default initial template library
State the initial masterplate of page request matching.
Original template filtering module 430, for according to the page request according to preset rules to the survey in initial masterplate
Examination element is filtered, and obtains testing masterplate.
Alternatively, in embodiments of the present invention, the original template filtering module 430, can further include：
First filtration parameter acquisition submodule 431, needed for for obtaining the preset rules from the page request
First filtration parameter.
Submodule 432 is grouped, for according to default rule of classification, determining the packet belonging to each test elements.
Alternatively, in embodiments of the present invention, the packet submodule 432, is additionally operable to according to each test elements
Component identification identical test elements are divided into same packet by component identification.
Original template filter submodule 433, for according to first filtration parameter, being utilized respectively and each packet pair
The default filtering rule answered is filtered to the test elements in initial masterplate, obtains testing masterplate.
Alternatively, in embodiments of the present invention, the original template filter submodule 433, can further include：
Target detection element judging unit, for for each packet, utilizing default filtering corresponding with the packet
Rule, judges in each packet with the presence or absence of the target detection element matched with first filtration parameter.
First filter element, if for there is the target detection matched with first filtration parameter in current group
Element, then filtered other test elements beyond target detection element described in current group.
Second filter element, if surveyed for the target matched with first filtration parameter to be not present in current group
Element is tried, then is filtered other test elements in current group in addition to test elements are given tacit consent to.
Test page generation module 440, for according to the test masterplate generation test page.
Test page sending module 450, for the response of the test page as the page request to be sent to institute
State client.
User's conversion ratio statistical module 460, user's conversion ratio for counting the test page from the client.
Released version determining module 470, for selecting user's conversion ratio highest test page as the page
The released version of request.
In embodiments of the present invention, the page request of client transmission can be received；According to the page request according to pre-
If rule filters the test elements in initial masterplate, obtain testing masterplate；According to the test masterplate generation test sheets
Face；The response of the test page as the page request is sent to the client.Thus existing A/B tests are solved
During, code logic will be correspondingly changed during modification test cases every time, and then cause test process time-consuming and dumb,
And modification code also results in the problem of error rate rises, risk increases.Achieving reduces modification operation, reduces operation
It is time-consuming, improve the beneficial effect of test flexibility and accuracy rate.
Moreover, in embodiments of the present invention, first needed for the preset rules can be obtained from the page request
Filtration parameter；According to default rule of classification, the packet belonging to each test elements is determined；Joined according to the described first filtering
Number, is utilized respectively default filtering rule corresponding with each packet and the test elements in initial masterplate is filtered, obtain
Test masterplate.Also, for each packet, using default filtering rule corresponding with the packet, judge each packet
In with the presence or absence of the target detection element that is matched with first filtration parameter；If existed and described first in current group
The target detection element of filtration parameter matching, then enter other test elements beyond target detection element described in current group
Row filtering；If the target detection element matched with first filtration parameter is not present in current group, will currently it divide
Other test elements in group in addition to test elements are given tacit consent to are filtered.So as to further improve the test masterplate obtained
Accuracy rate.
In addition, in embodiments of the present invention, can also be searched according to the page request from default initial template library
The initial masterplate matched with the page request.So as to carry out A/B tests for multiple test targets simultaneously, further may be used
To improve the efficiency of test.
Further, in embodiments of the present invention, the user that the test page can also be counted from the client turns
Rate；User's conversion ratio highest test page is selected as the released version of the page request.So as to accurate
Determine the released version of each test target.
For device embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, it is related
Part illustrates referring to the part of embodiment of the method.
Algorithm and display be not inherently related to any certain computer, virtual system or miscellaneous equipment provided herein.
Various general-purpose systems can also be used together with based on teaching in this.As described above, construct required by this kind of system
Structure be obvious.In addition, the present invention is not also directed to any certain programmed language.It is understood that, it is possible to use it is various
Programming language realizes the content of invention described herein, and the description done above to language-specific is to disclose this hair
Bright preferred forms.
In the specification that this place is provided, numerous specific details are set forth.It is to be appreciated, however, that the implementation of the present invention
Example can be put into practice in the case of these no details.In some instances, known method, structure is not been shown in detail
And technology, so as not to obscure the understanding of this description.
Similarly, it will be appreciated that in order to simplify the disclosure and help to understand one or more of each inventive aspect, exist
Above in the description of the exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention：It is i.e. required to protect
The application claims of shield features more more than the feature being expressly recited in each claim.More precisely, such as following
Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,
Thus the claims for following embodiment are expressly incorporated in the embodiment, wherein each claim is in itself
All as the separate embodiments of the present invention.
Those skilled in the art, which are appreciated that, to be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more equipment different from the embodiment.Can be the module or list in embodiment
Member or component be combined into a module or unit or component, and can be divided into addition multiple submodule or subelement or
Sub-component.In addition at least some in such feature and/or process or unit exclude each other, it can use any
Combination is disclosed to all features disclosed in this specification (including adjoint claim, summary and accompanying drawing) and so to appoint
Where all processes or unit of method or equipment are combined.Unless expressly stated otherwise, this specification (including adjoint power
Profit is required, summary and accompanying drawing) disclosed in each feature can or similar purpose alternative features identical, equivalent by offer come generation
Replace.
Although in addition, it will be appreciated by those of skill in the art that some embodiments described herein include other embodiments
In included some features rather than further feature, but the combination of the feature of be the same as Example does not mean in of the invention
Within the scope of and form different embodiments.For example, in the following claims, times of embodiment claimed
One of meaning mode can be used in any combination.
The present invention all parts embodiment can be realized with hardware, or with one or more processor run
Software module realize, or realized with combinations thereof.It will be understood by those of skill in the art that can use in practice
Microprocessor or digital signal processor (DSP) are according to embodiments of the present invention to realizeThe A/B tests of Page ServiceEquipment
In some or all parts some or all functions.The present invention is also implemented as described herein for performing
The some or all equipment or program of device (for example, computer program and computer program product) of method.So
Realization the present invention program can store on a computer-readable medium, or can have one or more signal shape
Formula.Such signal can be downloaded from internet website and obtained, and either be provided or with any other shape on carrier signal
Formula is provided.
It should be noted that the present invention will be described rather than limits the invention for above-described embodiment, and ability
Field technique personnel can design alternative embodiment without departing from the scope of the appended claims.In the claims,
Any reference symbol between bracket should not be configured to limitations on claims.Word "comprising" is not excluded the presence of not
Element or step listed in the claims.Word "a" or "an" before element does not exclude the presence of multiple such
Element.The present invention can be by means of including the hardware of some different elements and coming real by means of properly programmed computer
It is existing.In if the unit claim of equipment for drying is listed, several in these devices can be by same hardware branch
To embody.The use of word first, second, and third does not indicate that any order.These words can be explained and run after fame
Claim.
Claims (12)
1. a kind of A/B method of testings of Page Service, it is characterised in that including：
Receive the page request that client is sent；
The test elements in initial masterplate are filtered according to preset rules according to the page request, obtain testing masterplate；
According to the test masterplate generation test page；
The response of the test page as the page request is sent to the client.
2. according to the method described in claim 1, it is characterised in that it is described according to the page request according to preset rules to first
Test elements in beginning masterplate are filtered, the step of obtaining test masterplate, including：
The first filtration parameter needed for the preset rules is obtained from the page request；
According to default rule of classification, the packet belonging to each test elements is determined；
According to first filtration parameter, default filtering rule corresponding with each packet is utilized respectively in initial masterplate
Test elements are filtered, and obtain testing masterplate.
3. method according to claim 2, it is characterised in that described according to first filtration parameter, be utilized respectively with
The corresponding default filtering rule of each packet is filtered to the test elements in initial masterplate, obtains the step of test masterplate
Suddenly, including：
For each packet, using default filtering rule corresponding with the packet, judge to whether there is in each packet
The target detection element matched with first filtration parameter；
If there is the target detection element matched with first filtration parameter in current group, by institute in current group
Other test elements beyond target detection element are stated to be filtered；
If the target detection element matched with first filtration parameter is not present in current group, by current group
Other test elements in addition to test elements are given tacit consent to are filtered.
4. method according to claim 2, it is characterised in that described according to default rule of classification, determines each survey
The step of trying the packet belonging to element, including：
According to the component identification of each test elements, component identification identical test elements are divided into same packet.
5. according to the method described in claim 1, it is characterised in that it is described according to the page request according to preset rules pair
Test elements in initial masterplate are filtered, before the step of obtaining test masterplate, in addition to：
According to the page request, the initial masterplate matched with the page request is searched from default initial template library.
6. according to the method described in claim 1, it is characterised in that regard the test page as the page request described
Response send to after the step of the client, in addition to：
User's conversion ratio of the test page is counted from the client；
User's conversion ratio highest test page is selected as the released version of the page request.
7. a kind of A/B test devices of Page Service, it is characterised in that including：
Page request receiving module, the page request for receiving client transmission；
Original template filtering module, for being entered according to the page request according to preset rules to the test elements in initial masterplate
Row filtering, obtains testing masterplate；
Test page generation module, for according to the test masterplate generation test page；
Test page sending module, for the response of the test page as the page request to be sent to the client
End.
8. device according to claim 7, it is characterised in that the original template filtering module, including：
First filtration parameter acquisition submodule, first needed for for obtaining the preset rules from the page request filters
Parameter；
Submodule is grouped, for according to default rule of classification, determining the packet belonging to each test elements；
Original template filter submodule, it is corresponding pre- with each packet for according to first filtration parameter, being utilized respectively
If filtering rule filters the test elements in initial masterplate, obtain testing masterplate.
9. device according to claim 8, it is characterised in that the original template filter submodule, including：
Target detection element judging unit, for for each packet, using default filtering rule corresponding with the packet,
Judge in each packet with the presence or absence of the target detection element matched with first filtration parameter；
First filter element, if for there is the target detection matched with first filtration parameter member in current group
Element, then filtered other test elements beyond target detection element described in current group；
Second filter element, if for the target detection matched with first filtration parameter member to be not present in current group
Element, then filtered other test elements in current group in addition to test elements are given tacit consent to.
10. device according to claim 8, it is characterised in that the packet submodule, is additionally operable to according to each test
Component identification identical test elements are divided into same packet by the component identification of element.
11. device according to claim 7, it is characterised in that also include：
Initial masterplate matching module, for according to the page request, being searched and the page from default initial template library
Ask the initial masterplate of matching.
12. device according to claim 7, it is characterised in that also include：
User's conversion ratio statistical module, user's conversion ratio for counting the test page from the client；
Released version determining module, for selecting user's conversion ratio highest test page as the hair of the page request
Cloth version.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710444537.0A CN107273290B (en) | 2017-06-13 | 2017-06-13 | A/B test method and device for page service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710444537.0A CN107273290B (en) | 2017-06-13 | 2017-06-13 | A/B test method and device for page service |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107273290A true CN107273290A (en) | 2017-10-20 |
| CN107273290B CN107273290B (en) | 2020-07-03 |
Family
ID=60067564
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710444537.0A Active CN107273290B (en) | 2017-06-13 | 2017-06-13 | A/B test method and device for page service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107273290B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108804318A (en) * | 2018-05-24 | 2018-11-13 | 北京金山安全软件有限公司 | Page element testing method and device, electronic equipment and storage medium |
| CN109471795A (en) * | 2018-10-16 | 2019-03-15 | 平安普惠企业管理有限公司 | It is grouped test method, device, computer equipment and storage medium |
| CN109947648A (en) * | 2019-03-19 | 2019-06-28 | 贺莉娟 | For the binding test method in length and breadth of WEB system requirements specification |
| CN110209579A (en) * | 2019-05-28 | 2019-09-06 | Oppo广东移动通信有限公司 | Test method and electronic device |
| CN110928613A (en) * | 2019-09-29 | 2020-03-27 | 京东数字科技控股有限公司 | Method and device for acquiring page data, electronic equipment and readable storage medium |
| CN111177561A (en) * | 2019-12-31 | 2020-05-19 | 北京奇艺世纪科技有限公司 | Test method and device |
| CN111538653A (en) * | 2020-04-07 | 2020-08-14 | 北京达佳互联信息技术有限公司 | Scheme testing method and device, electronic equipment and storage medium |
| CN111913998A (en) * | 2020-09-11 | 2020-11-10 | 北京百度网讯科技有限公司 | Data processing method, device, equipment and storage medium |
| CN113132294A (en) * | 2019-12-30 | 2021-07-16 | 中国移动通信集团四川有限公司 | Data packet filtering method, system and device |
| CN117407888A (en) * | 2023-12-14 | 2024-01-16 | 远江盛邦（北京）网络安全科技股份有限公司 | Single-page application program page fuzzy test method and device and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104102576A (en) * | 2013-04-12 | 2014-10-15 | 阿里巴巴集团控股有限公司 | Multi-version test method and device |
| CN105450461A (en) * | 2014-06-05 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Shunting method and network equipment |
| US20160125749A1 (en) * | 2014-10-30 | 2016-05-05 | Linkedin Corporation | User interface for a/b testing |
| CN106096021A (en) * | 2016-06-24 | 2016-11-09 | 合信息技术（北京）有限公司 | A kind of static page gray scale dissemination method and system |
-
2017
- 2017-06-13 CN CN201710444537.0A patent/CN107273290B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104102576A (en) * | 2013-04-12 | 2014-10-15 | 阿里巴巴集团控股有限公司 | Multi-version test method and device |
| CN105450461A (en) * | 2014-06-05 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Shunting method and network equipment |
| US20160125749A1 (en) * | 2014-10-30 | 2016-05-05 | Linkedin Corporation | User interface for a/b testing |
| CN106096021A (en) * | 2016-06-24 | 2016-11-09 | 合信息技术（北京）有限公司 | A kind of static page gray scale dissemination method and system |
Non-Patent Citations (1)
| Title |
|---|
| 那些数据驱动的优化: "[译]对AngularJS模板的A_B测试", 《博客园》 * |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108804318A (en) * | 2018-05-24 | 2018-11-13 | 北京金山安全软件有限公司 | Page element testing method and device, electronic equipment and storage medium |
| CN109471795A (en) * | 2018-10-16 | 2019-03-15 | 平安普惠企业管理有限公司 | It is grouped test method, device, computer equipment and storage medium |
| CN109947648A (en) * | 2019-03-19 | 2019-06-28 | 贺莉娟 | For the binding test method in length and breadth of WEB system requirements specification |
| CN109947648B (en) * | 2019-03-19 | 2022-04-29 | 贺莉娟 | Longitudinal and transverse combination test method for WEB system requirement specification |
| CN110209579A (en) * | 2019-05-28 | 2019-09-06 | Oppo广东移动通信有限公司 | Test method and electronic device |
| CN110209579B (en) * | 2019-05-28 | 2023-06-06 | Oppo广东移动通信有限公司 | Test method and electronic device |
| CN110928613A (en) * | 2019-09-29 | 2020-03-27 | 京东数字科技控股有限公司 | Method and device for acquiring page data, electronic equipment and readable storage medium |
| CN113132294A (en) * | 2019-12-30 | 2021-07-16 | 中国移动通信集团四川有限公司 | Data packet filtering method, system and device |
| CN113132294B (en) * | 2019-12-30 | 2022-05-13 | 中国移动通信集团四川有限公司 | Data packet filtering method, system and device |
| CN111177561A (en) * | 2019-12-31 | 2020-05-19 | 北京奇艺世纪科技有限公司 | Test method and device |
| CN111177561B (en) * | 2019-12-31 | 2023-08-15 | 北京奇艺世纪科技有限公司 | Test method and device |
| CN111538653A (en) * | 2020-04-07 | 2020-08-14 | 北京达佳互联信息技术有限公司 | Scheme testing method and device, electronic equipment and storage medium |
| CN111538653B (en) * | 2020-04-07 | 2023-08-18 | 北京达佳互联信息技术有限公司 | Method and device for testing scheme, electronic equipment and storage medium |
| CN111913998A (en) * | 2020-09-11 | 2020-11-10 | 北京百度网讯科技有限公司 | Data processing method, device, equipment and storage medium |
| CN117407888A (en) * | 2023-12-14 | 2024-01-16 | 远江盛邦（北京）网络安全科技股份有限公司 | Single-page application program page fuzzy test method and device and electronic equipment |
| CN117407888B (en) * | 2023-12-14 | 2024-03-15 | 远江盛邦（北京）网络安全科技股份有限公司 | Single-page application program page fuzzy test method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107273290B (en) | 2020-07-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107273290A (en) | The A/B method of testings and device of a kind of Page Service | |
| US10789089B2 (en) | Dynamic application migration between cloud providers | |
| CN104239571B (en) | It is a kind of to carry out using the method and apparatus recommended | |
| CN104410691B (en) | A kind of website accelerated method and system based on content distributing network | |
| CN106776989A (en) | A kind of info web methods of exhibiting and device | |
| CN105740304B (en) | Visual page editing method and device and A/B testing method and device | |
| CN105956161A (en) | Information recommendation method and apparatus | |
| US8850398B1 (en) | Automated testing of application programs from an application program ecosystem | |
| CN104301311B (en) | The method and apparatus of DNS screen data contents | |
| CN106130756B (en) | A kind of method and device of prediction access content clicking rate | |
| CN106656741A (en) | Information push method and system | |
| CN106681921A (en) | Method and device for achieving data parameterization | |
| CN110110201A (en) | A kind of content recommendation method and system | |
| CN108616525A (en) | Website access method and device, electronic equipment and storage medium | |
| CN110347946A (en) | A kind of page display method, device, computer equipment and storage medium | |
| CN107239970A (en) | A kind of Behavior-based control daily record determines the method and system of ad click rate | |
| CN103530390B (en) | The method and apparatus of webpage capture | |
| TWI581115B (en) | Active preference learning method and system | |
| CN107957938A (en) | A kind of method and system for obtaining website test data | |
| CN110120971A (en) | A kind of gray scale dissemination method, device and electronic equipment | |
| CN116781563A (en) | Evaluation device, evaluation method and evaluation system for webpage service fine granularity | |
| CN110020237A (en) | Webpage jump method and device | |
| CN109075987A (en) | Optimize digital assembly analysis system | |
| CN106202297A (en) | Identify the method and device of user interest | |
| CN103617261A (en) | Picture content attribute identification method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |