CN112015635A - Page testing method, page testing device, electronic equipment and storage medium - Google Patents

Page testing method, page testing device, electronic equipment and storage medium Download PDF

Info

Publication number
CN112015635A
CN112015635A CN201910471829.2A CN201910471829A CN112015635A CN 112015635 A CN112015635 A CN 112015635A CN 201910471829 A CN201910471829 A CN 201910471829A CN 112015635 A CN112015635 A CN 112015635A
Authority
CN
China
Prior art keywords
test
page
tested
pages
testing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910471829.2A
Other languages
Chinese (zh)
Inventor
刘殿宇
魏亮亮
朱志国
方正栋
孙庆光
王祖文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Jingdong Shangke Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Priority to CN201910471829.2A priority Critical patent/CN112015635A/en
Publication of CN112015635A publication Critical patent/CN112015635A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management

Abstract

The disclosure provides a page testing method, a page testing device, electronic equipment and a computer readable storage medium, and belongs to the technical field of computers. The method comprises the following steps: acquiring a reference page and a plurality of test elements and/or test element combinations associated with the reference page; modifying the reference page according to each test element and/or test element combination to obtain a plurality of pages to be tested; and testing the plurality of pages to be tested. The method and the device can enrich the page test result and improve the flexibility of page test.

Description

Page testing method, page testing device, electronic equipment and storage medium
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a page testing method, a page testing apparatus, an electronic device, and a computer-readable storage medium.
Background
With the wide popularization of internet technology in daily life, information communication based on the internet becomes more and more frequent, and the development of web pages as one of the main modes of internet information communication is more and more diversified. In order to ensure that a page displayed to a user can meet the requirements of the user, achieve the beneficial effects of attracting the user, increasing the viscosity of the user and the like, the page is usually tested.
The existing page testing method generally puts a designated page to a user, and judges whether the designated page achieves the expected effect or not according to the behavior data of the user on the designated page. However, with the above method, only qualitative conclusions about the effect of the designated page can be obtained, for example, the designated page is popular or unpopular, and the content of the test result is relatively single. When the designated page does not reach the expected effect, the designated page is difficult to be effectively adjusted in a targeted manner according to the test result, and the test efficiency is low.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
The disclosure provides a page testing method, a page testing device, an electronic device and a computer readable storage medium, thereby overcoming the problems of single testing result and lack of pertinence in the existing page testing method at least to a certain extent.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows, or in part will be obvious from the description, or may be learned by practice of the disclosure.
According to one aspect of the present disclosure, there is provided a page testing method, including: acquiring a reference page and a plurality of test elements and/or test element combinations associated with the reference page; modifying the reference page according to each test element and/or test element combination to obtain a plurality of pages to be tested; and testing the plurality of pages to be tested.
In an exemplary embodiment of the present disclosure, the testing the plurality of pages to be tested includes: testing the plurality of pages to be tested through the test object to obtain test data of each page to be tested; and obtaining a test result of each page to be tested based on the test data.
In an exemplary embodiment of the present disclosure, the test object includes a plurality of test objects, the method further includes: dividing the plurality of test objects into a plurality of test object sets according to the attributes of the test objects; the step of testing the plurality of pages to be tested through the test object to obtain test data of each page to be tested comprises the following steps: determining a target test object set from the plurality of test object sets; and testing the multiple pages to be tested through the test objects in the target test object set to obtain test data of each page to be tested.
In an exemplary embodiment of the present disclosure, the testing the multiple pages to be tested by the test object in the target test object set to obtain test data of each page to be tested includes: acquiring a plurality of object subsets of the target test object set, wherein the intersection of any two object subsets is an empty set, and the object subsets and the pages to be tested have one-to-one correspondence; and putting each page to be tested to the corresponding object subset so as to test the multiple pages to be tested and obtain the test data of each page to be tested.
In an exemplary embodiment of the present disclosure, the obtaining the plurality of object subsets of the target test object set includes: determining the putting proportion of each page to be tested; and dividing the target test object set into a plurality of object subsets according to the putting proportion.
In an exemplary embodiment of the present disclosure, the obtaining a test result of each page to be tested based on the test data includes: and determining the test result of each page to be tested based on the test data and the release proportion.
In an exemplary embodiment of the disclosure, the modification manner of modifying the reference page includes any one or more of the following combinations: altering the test elements and/or test element combinations within the reference page; within the reference page, pruning the test elements and/or test element combinations; and adding the test elements and/or test element combinations in the reference page.
In an exemplary embodiment of the present disclosure, the obtaining a reference page and a plurality of test elements and/or test element combinations associated with the reference page includes: acquiring a reference page and a plurality of test elements associated with the reference page, and acquiring all element subsets of the test element set by taking the test elements as a test element set; and respectively taking the test elements in each element subset as a test element combination to obtain the plurality of test element combinations.
According to an aspect of the present disclosure, there is provided a page testing apparatus including: the system comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring a reference page and a plurality of test elements and/or test element combinations related to the reference page; the modification module is used for modifying the reference page according to each test element and/or test element combination to obtain a plurality of pages to be tested; and the testing module is used for testing the plurality of pages to be tested.
In an exemplary embodiment of the present disclosure, the test module includes: the data acquisition unit is used for testing the plurality of pages to be tested through the test object to obtain test data of each page to be tested; and the result determining unit is used for obtaining the test result of each page to be tested based on the test data.
In an exemplary embodiment of the present disclosure, the test object includes a plurality of test objects, and the page testing apparatus further includes: the object dividing module is used for dividing the plurality of test objects into a plurality of test object sets according to the attributes of the test objects; the data acquisition unit includes: a target set determining unit, configured to determine a target test object set from the plurality of test object sets; and the data acquisition subunit is used for testing the multiple pages to be tested through the test objects in the target test object set to obtain test data of each page to be tested.
In an exemplary embodiment of the present disclosure, the data acquisition subunit includes: the object subset acquisition subunit is configured to acquire a plurality of object subsets of the target test object set, where an intersection of any two object subsets is an empty set, and the object subsets and the pages to be tested have a one-to-one correspondence relationship; and the data acquisition subunit is used for delivering each page to be tested to the corresponding object subset so as to test the multiple pages to be tested and obtain the test data of each page to be tested.
In an exemplary embodiment of the present disclosure, the object subset acquisition subunit includes: the proportion determining subunit is used for determining the putting proportion of each page to be tested; and the object subset dividing subunit is used for dividing the target test object set into a plurality of object subsets according to the putting proportion.
In an exemplary embodiment of the present disclosure, the result determination unit includes: and determining the test result of each page to be tested based on the test data and the release proportion.
In an exemplary embodiment of the disclosure, the modification manner of modifying the reference page includes any one or more of the following combinations: altering the test elements and/or test element combinations within the reference page; within the reference page, pruning the test elements and/or test element combinations; and adding the test elements and/or test element combinations in the reference page.
In an exemplary embodiment of the present disclosure, the obtaining module includes: the device comprises an element acquisition unit, a processing unit and a display unit, wherein the element acquisition unit is used for acquiring a reference page and a plurality of test elements related to the reference page; an element subset obtaining unit, configured to obtain all element subsets of the test element set by using the plurality of test elements as the test element set; and the element combination obtaining unit is used for taking the test elements in each element subset as a test element combination to obtain the plurality of test element combinations.
According to an aspect of the present disclosure, there is provided an electronic device including: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the method of any one of the above via execution of the executable instructions.
According to an aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any one of the above.
Exemplary embodiments of the present disclosure have the following advantageous effects:
the method comprises the steps of obtaining a reference page and a plurality of test elements and/or test element combinations related to the reference page, modifying the reference page according to the test elements and/or the test element combinations to obtain a plurality of pages to be tested, and accordingly performing page testing. On one hand, the exemplary embodiment provides a new page testing method, which modifies a test element or a test element combination through a reference page to obtain a series of pages to be tested, tests the pages, not only can obtain an optimal page, but also can determine which test element or test element combination can improve the display effect of the page, so that the page testing results are enriched; on the other hand, the test elements or the test element combinations related to the page test to be tested can be determined and adjusted according to actual requirements, so that the flexibility and pertinence of the page test are improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty.
FIG. 1 schematically illustrates a flow chart of a page testing method in the present exemplary embodiment;
FIG. 2 schematically illustrates a sub-flow diagram of a page testing method in the present exemplary embodiment;
FIG. 3 schematically illustrates a sub-flow diagram of another page testing method in the present exemplary embodiment;
FIG. 4 schematically illustrates a sub-flow diagram of yet another page testing method in the present exemplary embodiment;
FIG. 5 is a flowchart schematically illustrating another page test method in the present exemplary embodiment;
FIG. 6 is a block diagram schematically showing the structure of a page test apparatus in the present exemplary embodiment;
fig. 7 schematically illustrates an electronic device for implementing the above method in the present exemplary embodiment;
fig. 8 schematically illustrates a computer-readable storage medium for implementing the above-described method in the present exemplary embodiment.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
The exemplary embodiment of the present disclosure first provides a page test method, wherein a page refers to a platform for carrying various information, which may be various types of pages, such as H5(HTML5, application under standard universal markup language) page, native page, or Web page, etc. The application scenario of the method of the embodiment may be as follows: before an enterprise publishes a new page, testing a plurality of pages to predict the publishing effect of the new page; or testing the published page, adjusting the page according to the test result, and the like.
The exemplary embodiment is further described with reference to fig. 1, and as shown in fig. 1, the page testing method may include the following steps S110 to S130:
step S110, a reference page and a plurality of test elements and/or test element combinations associated with the reference page are obtained.
The reference page may be an initial page created, the test element refers to information content that can be presented in the reference page, for example, information such as text, picture, video, audio, table, hyperlink, or navigation bar, and the test element combination is a combination of the above information contents, for example, an information combination of "text + picture", "text + video", or "text + picture + video", and the like. The plurality of test elements and/or test element combinations associated with the reference page may indicate that the test elements and/or test element combinations have an association relationship with the reference page, and specifically may be test elements and/or test element combinations already included in the reference page, for example, if a picture and a video are preset in a reference page, the picture and the video have an association relationship with the reference page. Or the content of the reference page, which can be applied to the test elements and/or test element combinations in the reference page, for example, the reference page of a promotional activity is established, the reference page includes text information and moving pictures related to the activity introduction, and then the information of commodity links, pictures, videos and the like related to the activity can be regarded as the test elements having an association relationship with the reference page, and the combination form can be regarded as the test element combinations having an association relationship with the reference page.
In the exemplary embodiment, the association relationship between the test element and/or the test element combination and the reference page may be embodied as the position relationship between the test element and/or the test element combination and the reference page, for example, in the reference page of the above-mentioned promotional activity, text information about the activity introduction is provided in the header area of the reference page, or a commodity link and a picture related to the activity are provided in which window position in the reference page.
In the exemplary embodiment, the reference page may be set up by a developer as required, wherein one or more test elements may be set up in the reference page in advance, for example, a text message including event content, event product image information, and the like may be set up by an enterprise in order to issue an interactive page related to a promotional event. In addition, the reference page may also be an existing history page selected from the system as the reference page. For example, an enterprise may choose pages of the same type of activity as base pages, and so on.
In an exemplary embodiment, step S110 may include the steps of:
acquiring a reference page and a plurality of test elements associated with the reference page;
taking a plurality of test elements as a test element set, and acquiring all element subsets of the test element set;
and respectively taking the test elements in each element subset as a test element combination to obtain a plurality of test element combinations.
In the exemplary embodiment, the test element combination may be determined by the test elements, and specifically, N test elements associated with the reference page may be determined first, through which all test element combinations including one test element may be determined, all test element combinations including two test elements may be determined, … …, all test element combinations including N-1 test elements may be determined, and all test element combinations including N test elements may be determined. I.e. all possible combinations of N test elements, i.e. all element subsets, including all single test element combinations, all two test element combinations … … up to all test element combinations can be traversed. For example, when there are three test elements of text, picture, and video, seven test element combinations of "text", "picture", "video", "text + picture", "text + video", "picture + video", and "text + picture + video" may be determined. The total number of test element combinations can be calculated by the following formula:
Figure BDA0002081038330000071
where C is the symbol of the combination and N is the number of all test elements.
And step S120, modifying the reference page according to each test element and/or test element combination to obtain a plurality of pages to be tested.
The pages to be tested are pages which are obtained based on the modification of the reference page and are used for testing, so that certain similarity exists between each page to be tested and the reference page, and particularly, the reference page can also be used as the page to be tested for testing. In the present exemplary embodiment, the modification may include various ways, for example, the content of the test element and/or the combination of test elements may be modified, or the position of the test element and/or the combination of test elements may be modified, the number of the test elements and/or the combination of test elements may be modified, and the like. It should be noted that the larger the number of modified test elements and/or test element combinations is, the larger the difference between the page to be tested obtained by modifying the reference page and the reference page is.
Specifically, in an exemplary embodiment, the modification manner for modifying the reference page may include any one or more of the following combinations:
changing the test elements and/or test element combinations in the reference page;
within the reference page, pruning the test elements and/or test element combinations; and
within the reference page, test elements and/or test element combinations are added.
The change of the test element and/or the test element combination may refer to changing information such as content, position, and the like of the test element and/or the test element combination, taking the change of the test element as an example, a reference page includes three test elements of text a1, picture B1, and video C1, and the change of the test element may be changing picture B1 to picture B2, or moving text a1 from a current position to another specified position, or swapping the positions of text a1 and picture B1, and the like. The change test element combination is similar to the change test element, for example, the position of the text a1+ the picture B1 may be changed, or the text a2+ the picture B2 may be changed, and the like, which is not specifically limited by the present disclosure.
The deletion of the test elements and/or test element combinations may perform a deletion operation on the test elements and/or test element combinations included in the reference page, such as deleting the text a1 in the reference page, or deleting the text a1+ video C1, and so on. Adding the test elements and/or the test element combinations may be adding test elements and/or test element combinations that are not in the reference page, for example, adding table D1 or table D1+ navigation E1 in the reference page, or adding existing test elements and/or test element combinations in the reference page, for example, adding picture B2, or picture B2+ video C2 in the reference page, or the like, and the positions where the test elements and/or the test element combinations are added may be set as needed, for example, adding picture B2 to the area around picture B1, or randomly setting the added test elements and/or test elements in multiple areas of the reference page, which is not specifically limited by the present disclosure.
Step S130, testing a plurality of pages to be tested.
The obtained multiple pages to be tested are tested to obtain the test result of each page to be tested, so that the page or pages to be tested is/are determined to be the better page. Specifically, test data in each Page to be tested may be counted by delivering a plurality of pages to be tested to a specific group of people, for example, PV (Page View), UV (Unique Visitor), registration amount, IP number, consultation amount, volume of transaction, or user residence time of each Page to be tested. Through calculation and analysis of the test data, the test result of each page to be tested can be obtained.
It should be noted that, in the exemplary embodiment, each page to be tested is obtained by modifying the reference page, and therefore, the test result obtained by testing each test page may reflect which page is the better page, and may also determine which test element or elements can bring a better effect to the page to be tested. For example, for a page 1 to be tested (the test elements comprise a text A1, a picture B1 and a video C1), a page 2 to be tested (the test elements comprise a text A2, a picture B1 and a video C1) and a page 3 to be tested (the test elements comprise a text A3, a picture B1 and a video C1), the test result shows that the page 3 to be tested is the optimal page, and the setting of the text A3 can be determined to bring a better display effect to the page through the test result, namely the page to be tested provided with the text A3 is more attractive to users.
Based on the above description, in the present exemplary embodiment, the reference page and the plurality of test elements and/or test element combinations associated with the reference page are obtained, and the reference page is modified according to each test element and/or test element combination to obtain a plurality of pages to be tested, so as to perform the page test. On one hand, the exemplary embodiment provides a new page testing method, which modifies a test element or a test element combination through a reference page to obtain a series of pages to be tested, tests the pages, not only can obtain an optimal page, but also can determine which test element or test element combination can improve the display effect of the page, so that the page testing results are enriched; on the other hand, the test elements or the test element combinations related to the page test to be tested can be determined and adjusted according to actual requirements, so that the flexibility and pertinence of the page test are improved.
In an exemplary embodiment, step S130 may include the steps of:
step S210, testing a plurality of pages to be tested through a test object to obtain test data of each page to be tested;
step S220, obtaining the test result of each page to be tested based on the test data.
In this exemplary embodiment, part or all of users of a certain platform may be used as test objects, for example, users that are active in the last half year of a certain platform may be used as test objects, or users with internal test qualification may be used as test objects by issuing an internal test notification. The test data refers to data capable of reflecting behaviors of the user in the page to be tested, such as click rate, browsing amount, volume of transaction, purchase amount, sharing amount or residence time, and through analysis of the test data, preference degree, viscosity and the like of the user on the page to be tested can be determined.
In the exemplary embodiment, a specific user group may be selected as a test object, a plurality of pages to be tested are delivered to the user group, and test data of each page to be tested is counted. For example, 1000 users are selected as test objects, and the page 1 to be tested, the page 2 to be tested, and the page 3 to be tested are randomly released to the 1000 users, so that the test data of the three pages can be obtained through statistics. Based on the test data, a test result for each page to be tested may be determined. The test result may be an evaluation result for reflecting the superiority and inferiority of the effect of each page to be tested, and according to the test result, which page or pages to be tested is/are the better page may be determined, and further which test element and/or combination of test elements in the better page is/are the better test element and/or combination of test elements may be determined. Specifically, the test result may be a specific numerical value used to represent the test evaluation value of each page to be tested, for example, test data (such as browsing amount, click amount, etc.) is directly used as the test result. The test result may also be calculated according to each test data through a specific formula, for example, a weighted calculation is performed on each statistical test data to obtain a test result.
Considering that different attributes of the test objects may cause certain influence on the test data, and further influence the test result, for example, a page to be tested is a page related to a female topic, and if most of the test objects are male, the accuracy of the test result is influenced.
In view of the foregoing, in an exemplary embodiment, the test objects are a plurality of test objects, and the page testing method may further include the following steps:
step S310, dividing a plurality of test objects into a plurality of test object sets according to the attributes of the test objects;
further, step S210 may include the steps of:
step S320, determining a target test object set from a plurality of test object sets;
step S330, testing a plurality of pages to be tested through the test objects in the target test object set to obtain test data of each page to be tested.
Wherein the attributes of the test object may reflect characteristics of one or more dimensions of the test object, for example, the attributes of the user may be province, city, source, first visit time, registration time, first purchase time, last visit time, gender, membership grade, year of birth, month of birth, etc. The test object set refers to that a plurality of test objects can be divided into different sets according to the attributes of the test objects, and the test objects in each set can have similar or identical attributes. In the dividing, the dividing may be performed according to a certain attribute, for example, the plurality of users may be divided into two user sets, namely a male user set and a female user set, according to the attribute of gender. The user group can also be divided according to a plurality of attributes, for example, according to a plurality of attributes such as province, city, last shopping time, last access time and the like, the user group can be divided into a north wide and deep user set, a recent unregistered user set, a user set with a recent successful transaction and the like. It should be noted that, when dividing a plurality of test objects into a plurality of test object sets, the same test object may be divided into a plurality of different attribute sets, for example, a certain user belongs to both a north wide and deep user set and a user set with a recent successful transaction. In addition, in order to ensure the validity of the page test, it may also be set that each test object can only be divided into a unique test object set, which is not specifically limited by the present disclosure.
In the exemplary embodiment, a specific set may be selected from a plurality of test object sets for testing a plurality of pages to be tested, where the specific set is a target test object set. The target test object set may be any one of a plurality of test object sets, or one of the sets may be selected from the plurality of test object sets as needed. In particular, a plurality of specific sets may be selected from the plurality of test object sets as the target test object set, for example, a female user set and a north wide and deep user set may be selected as the target test object set. According to the exemplary embodiment, the pages to be tested are put into the target test object set, so that the obtained test data is more targeted and reliable, and the accuracy of the test result is improved.
In an exemplary embodiment, step S330 may include the steps of:
step S410, a plurality of object subsets of a target test object set are obtained, wherein the intersection of any two object subsets is an empty set, and the object subsets and pages to be tested have one-to-one correspondence.
Step S420, putting each page to be tested to the corresponding object subset, so as to test the multiple pages to be tested, and obtain test data of each page to be tested.
Considering that when a plurality of pages to be tested are delivered to a target test object set, the pages to be tested received by each test object may not be unique, for example, when pages to be tested 1, pages to be tested 2, and pages to be tested 3 are delivered to 1000 users at random, it may happen that some users receive pages to be tested 1, some users receive pages to be tested 1 and pages to be tested 2, some users may receive pages to be tested 1, pages to be tested 2, and pages to be tested 3 at the same time, or a few users do not receive pages to be tested, and the like, thereby affecting test data of the pages to be tested. Therefore, in the present exemplary embodiment, the target test object set may be divided into multiple sets of objects, i.e., object subsets, and the intersection of any two object subsets is an empty set, which may ensure that no duplication occurs between the test objects of the respective object subsets, i.e., users appearing in a certain object subset will not be classified into other object subsets. In order to ensure that more accurate test data is obtained, each page to be tested can be put in the corresponding object subset, that is, the test object in each object subset receives the same page to be tested. In addition, the object subsets have a one-to-one correspondence relationship with the pages to be tested, which means that each page to be tested is uniquely delivered to one object subset. For example, the target test object set may be divided into a user subset a, a user subset b, and a user subset c, and the page 1 to be tested, the page 2 to be tested, and the page 3 to be tested are respectively delivered to the three user subsets, specifically, the page 1 to be tested is displayed to the user subset a, the page 2 to be tested is displayed to the user subset b, and the page 3 to be tested is displayed to the user subset c, so as to ensure that the test data of the page 1 to be tested is collected by the user subset a, the test data of the page 2 to be tested is collected by the user subset b, and the test data of the page 3 to be tested is collected by the.
It should be noted that the number of the object subsets may be the same as or different from the number of the pages to be tested, as long as it is ensured that each page to be tested corresponds to one object subset. The corresponding relationship between the page to be tested and the object subset may be set in advance, for example, the page to be tested 1 is shown to the user subset a, the page to be tested 2 is shown to the user subset b, the page to be tested 3 is shown to the user subset c, and the like, or may be adjusted as needed, for example, the page to be tested 1 is shown to the user subset b, the page to be tested 2 is shown to the user subset c, and the page to be tested 3 is shown to the user subset a, and the like, which is not specifically limited by the disclosure.
In an exemplary embodiment, the step S410 of obtaining a plurality of object subsets of the target test object set may include the following steps:
determining the putting proportion of each page to be tested;
and dividing the target test object set into a plurality of object subsets according to the delivery proportion.
In the exemplary embodiment, since the plurality of pages to be tested are obtained by modifying the reference page, the pages to be tested have a certain similarity, and the test data of each page to be tested is usually not the same, a tester may preset a launch proportion and launch the page to be tested to the test object in a certain proportion. For example, a user can pay attention to picture information in a page more easily, so that a page to be tested containing the picture information or a page to be tested with a large picture position setting area can be set to have a large delivery ratio. Based on the method, the pages to be tested with better possible effect can be presented to more users so as to enhance the page display effect. For example, before a certain enterprise formally puts in an active page, a page 1 to be tested, a page 2 to be tested, and a page 3 to be tested can be used, a page test is performed by an internal test user, a tester pre-estimates that the display effect of the page 1 to be tested is better, if the page 1 to be tested is 2 times lower than the page 2 to be tested, and the page 3 to be tested is weaker in effect, the putting ratios of the page 1 to be tested, the page 2 to be tested, and the page 3 to be tested are respectively set to be 5:3:2, and the test result shows that the page 1 to be tested is better in. Based on the method, more users can see the page 1 to be tested in advance before the page 1 to be tested is put in official form, and popularization of later-period activity pages is facilitated. In the exemplary embodiment, setting a launch proportion for a page to be tested may be regarded as a pre-determination of a page test result, and a tester may set a higher launch proportion for a page to be tested that may have a better effect or a potential value, so as to perform a focused test.
In an exemplary embodiment, step S130 may include the steps of:
and determining the test result of each page to be tested based on the test data and the release proportion.
In the exemplary embodiment, the test result may be determined by the test data and the launch proportion of each page to be tested, the test data may include data of multiple dimensions such as click rate, browsing volume, volume of bargain, purchase amount, sharing volume or residence time, and based on this, different weights may be given to the test data of each dimension, where the weights may reflect the evaluation value of the test data, and the test result may be determined by the launch proportion of each page to be testedThe higher the weight of the data is, the greater the influence of the test data on the result of the page to be tested is, in this exemplary embodiment, a uniform weight may be set for each dimension of the test data in advance, or the weight may be set by self-definition as needed, for example, considering that a transaction behavior of a user in the page has a higher evaluation value than a browsing behavior, and a higher weight may be set for a transaction amount. The test result of each page to be tested can be determined according to the test data, the data weight and the release proportion of each dimension, and the test result can be determined by a formula:
Figure BDA0002081038330000131
determining, wherein C is the test result of the page to be tested, D1、D2…DnFor test data of different dimensions, Q1Q2 … Qn is the weight corresponding to each dimension test data, P is the putting proportion of the page to be tested, for example, the putting proportion of the page to be tested 1 is 80%, the browsing volume is 500, the volume of bargain is 300, the putting proportion of the page to be tested 2 is 20%, the browsing volume is 150, the volume of bargain is 100, and the weights of the browsing volume and the volume of bargain can be set to be 0.4 and 0.6, respectively, then according to the above calculation formula, the test result of the page to be tested 1 is 475, the test result of the page to be tested 2 is 600, which indicates that the page to be tested 1 is the better page. In the present exemplary embodiment, the number of test objects may also be introduced, by the formula:
Figure BDA0002081038330000132
and determining, wherein N is the total number of the tested objects. For example, in the above example, setting that the page 1 to be tested and the page 2 to be tested are released to 1000 users, the test result of the page 1 to be tested is 0.475, and the test result of the page 2 to be tested is 0.600, which is consistent with the above results, and the page 1 to be tested exhibits a better release effect. In addition, there may be other calculation methods for determining the test result of the page to be tested according to the test data and the release ratio, which is not specifically limited in this disclosure.
Fig. 5 is a flowchart illustrating a page testing method according to the exemplary embodiment, which includes the following steps:
step S510: acquiring a reference page;
step S520: determining a plurality of pages to be tested according to the reference page;
step S530: determining the putting proportion of each page to be tested;
step S540: obtaining a test object;
step S550: classifying the test objects according to the attributes of the test objects;
step S560: dividing the test objects into a plurality of sets;
step S570; determining a target test object set from the sets, and putting each page to be tested according to the putting proportion to obtain test data of each page to be tested;
step S580: and determining a test result of the page test according to the test data.
In this exemplary embodiment, the above process may be completed by the test setup system and the page test system, and specifically, the test setup system may be used to set up and release the page to be tested. After acquiring the reference page, the test establishing system can obtain a plurality of pages to be tested according to the test elements and/or the test element combinations, number the pages, set the putting proportion of each test page, test the pages as a group of pages, and send the pages to the page test system through a Remote Procedure Call (RPC) service; the page testing system can be used for performing page testing, specifically, the page testing system can be divided into a plurality of testing object sets according to the attributes of the testing objects, a target testing object set is determined, the page testing is performed through the target testing object set, the testing data of each page to be tested is obtained, and therefore the page testing result is determined according to the testing data. The target test object set may be any one of a plurality of test object sets, or a specific one of the plurality of test object sets may be selected as necessary. It should be noted that the steps S510 and S540 are two independent processes, and may be performed simultaneously, and the order of the processes is not specifically limited in this disclosure.
Exemplary embodiments of the present disclosure also provide a page testing apparatus. Referring to fig. 6, the apparatus 600 may include an acquisition module 610, a modification module 620, and a test module 630. The obtaining module 610 is configured to obtain a reference page and a plurality of test elements and/or test element combinations associated with the reference page; a modifying module 620, configured to modify the reference page according to each test element and/or test element combination, respectively, to obtain multiple pages to be tested; the testing module 630 is configured to test a plurality of pages to be tested.
In an exemplary embodiment, the test module may include: the data acquisition unit is used for testing a plurality of pages to be tested through the test object to obtain test data of each page to be tested; and the result determining unit is used for obtaining the test result of each page to be tested based on the test data.
In an exemplary embodiment, the test object may include a plurality of test objects, and the page test apparatus further includes: the object dividing module is used for dividing the plurality of test objects into a plurality of test object sets according to the attributes of the test objects; the data acquisition unit includes: the target set determining unit is used for determining a target test object set from a plurality of test object sets; and the data acquisition subunit is used for testing the multiple pages to be tested through the test objects in the target test object set to obtain the test data of each page to be tested.
In an exemplary embodiment, the data acquisition subunit may include: the object subset acquisition subunit is used for acquiring a plurality of object subsets of a target test object set, wherein the intersection of any two object subsets is an empty set, and the object subsets and pages to be tested have one-to-one correspondence; and the data acquisition subunit is used for delivering each page to be tested to the corresponding object subset so as to test the multiple pages to be tested and obtain the test data of each page to be tested.
In an exemplary embodiment, the object subset acquisition subunit may include: the proportion determining subunit is used for determining the putting proportion of each page to be tested; and the object subset dividing subunit is used for dividing the target test object set into a plurality of object subsets according to the delivery proportion.
In an exemplary embodiment, the result determination unit may include: and determining the test result of each page to be tested based on the test data and the release proportion.
In an exemplary embodiment, the modification manner of modifying the reference page may include any one or more of the following: changing the test elements and/or test element combinations in the reference page; within the reference page, pruning the test elements and/or test element combinations; and adding test elements and/or test element combinations in the reference page.
In an exemplary embodiment, the obtaining module may include: the element acquisition unit is used for acquiring a reference page and a plurality of test elements related to the reference page; the element subset acquisition unit is used for acquiring all element subsets of the test element set by taking a plurality of test elements as the test element set; and the element combination acquisition unit is used for taking the test elements in each element subset as a test element combination to obtain a plurality of test element combinations.
The specific details of each module/unit have been described in detail in the corresponding method embodiment, and therefore are not described herein again.
Exemplary embodiments of the present disclosure also provide an electronic device capable of implementing the above method.
As will be appreciated by one skilled in the art, aspects of the present disclosure may be embodied as a system, method or program product. Accordingly, various aspects of the present disclosure may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
An electronic device 700 according to such an exemplary embodiment of the present disclosure is described below with reference to fig. 7. The electronic device 700 shown in fig. 7 is only an example and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 7, electronic device 700 is embodied in the form of a general purpose computing device. The components of the electronic device 700 may include, but are not limited to: the at least one processing unit 710, the at least one memory unit 720, a bus 730 connecting different system components (including the memory unit 720 and the processing unit 710), and a display unit 740.
Where the memory unit stores program code, the program code may be executed by the processing unit 710 such that the processing unit 710 performs the steps according to various exemplary embodiments of the present disclosure as described in the above-mentioned "exemplary methods" section of this specification. For example, the processing unit 710 may execute steps S110 to S130 shown in fig. 1, or may execute steps S210 to S220 shown in fig. 2, or the like.
The storage unit 720 may include readable media in the form of volatile memory units, such as a random access memory unit (RAM)721 and/or a cache memory unit 722, and may further include a read only memory unit (ROM) 723.
The memory unit 720 may also include programs/utilities 724 having a set (at least one) of program modules 725, such program modules 725 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
Bus 730 may be any representation of one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
The electronic device 700 may also communicate with one or more external devices 900 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 700, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 700 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 750. Also, the electronic device 700 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the internet) via the network adapter 760. As shown, the network adapter 760 communicates with the other modules of the electronic device 700 via the bus 730. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 700, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the exemplary embodiments of the present disclosure.
Exemplary embodiments of the present disclosure also provide a computer-readable storage medium having stored thereon a program product capable of implementing the above-described method of the present specification. In some possible embodiments, various aspects of the disclosure may also be implemented in the form of a program product comprising program code for causing a terminal device to perform the steps according to various exemplary embodiments of the disclosure described in the above-mentioned "exemplary methods" section of this specification, when the program product is run on the terminal device.
Referring to fig. 8, a program product 800 for implementing the above method according to an exemplary embodiment of the present disclosure is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
Furthermore, the above-described figures are merely schematic illustrations of processes included in methods according to exemplary embodiments of the present disclosure, and are not intended to be limiting. It will be readily understood that the processes shown in the above figures are not intended to indicate or limit the chronological order of the processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, e.g., in multiple modules.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functions of two or more modules or units described above may be embodied in one module or unit according to an exemplary embodiment of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is to be limited only by the terms of the appended claims.

Claims (11)

1. A page testing method is characterized by comprising the following steps:
acquiring a reference page and a plurality of test elements and/or test element combinations associated with the reference page;
modifying the reference page according to each test element and/or test element combination to obtain a plurality of pages to be tested;
and testing the plurality of pages to be tested.
2. The method of claim 1, wherein said testing said plurality of pages under test comprises:
testing the plurality of pages to be tested through the test object to obtain test data of each page to be tested;
and obtaining a test result of each page to be tested based on the test data.
3. The method of claim 2, wherein the test object comprises a plurality of test objects, the method further comprising:
dividing the plurality of test objects into a plurality of test object sets according to the attributes of the test objects;
the step of testing the plurality of pages to be tested through the test object to obtain test data of each page to be tested comprises the following steps:
determining a target test object set from the plurality of test object sets;
and testing the multiple pages to be tested through the test objects in the target test object set to obtain test data of each page to be tested.
4. The method of claim 3, wherein the testing the plurality of pages to be tested by the test objects in the target test object set to obtain test data of each page to be tested comprises:
acquiring a plurality of object subsets of the target test object set, wherein the intersection of any two object subsets is an empty set, and the object subsets and the pages to be tested have one-to-one correspondence;
and putting each page to be tested to the corresponding object subset so as to test the multiple pages to be tested and obtain the test data of each page to be tested.
5. The method of claim 4, wherein obtaining a plurality of object subsets of the set of target test objects comprises:
determining the putting proportion of each page to be tested;
and dividing the target test object set into a plurality of object subsets according to the putting proportion.
6. The method of claim 5, wherein obtaining a test result for each page to be tested based on the test data comprises:
and determining the test result of each page to be tested based on the test data and the release proportion.
7. The method according to claim 1, wherein the modification manner of the reference page comprises any one or more of the following combinations:
altering the test elements and/or test element combinations within the reference page;
within the reference page, pruning the test elements and/or test element combinations; and
adding the test elements and/or test element combinations within the reference page.
8. The method of claim 1, wherein obtaining the reference page and the plurality of test elements and/or test element combinations associated with the reference page comprises:
acquiring a reference page and a plurality of test elements associated with the reference page;
taking the plurality of test elements as a test element set, and acquiring all element subsets of the test element set;
and respectively taking the test elements in each element subset as a test element combination to obtain the plurality of test element combinations.
9. A page testing apparatus, comprising:
the system comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring a reference page and a plurality of test elements and/or test element combinations related to the reference page;
the modification module is used for modifying the reference page according to each test element and/or test element combination to obtain a plurality of pages to be tested;
and the testing module is used for testing the plurality of pages to be tested.
10. An electronic device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the method of any of claims 1-8 via execution of the executable instructions.
11. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method of any one of claims 1 to 8.
CN201910471829.2A 2019-05-31 2019-05-31 Page testing method, page testing device, electronic equipment and storage medium Pending CN112015635A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910471829.2A CN112015635A (en) 2019-05-31 2019-05-31 Page testing method, page testing device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910471829.2A CN112015635A (en) 2019-05-31 2019-05-31 Page testing method, page testing device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN112015635A true CN112015635A (en) 2020-12-01

Family

ID=73506868

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910471829.2A Pending CN112015635A (en) 2019-05-31 2019-05-31 Page testing method, page testing device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN112015635A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112612563A (en) * 2020-12-16 2021-04-06 上海哔哩哔哩科技有限公司 Page test data generation method and device and computer equipment
CN112965916A (en) * 2021-04-09 2021-06-15 中国工商银行股份有限公司 Page testing method, page testing device, electronic equipment and readable storage medium
CN113094286A (en) * 2021-05-11 2021-07-09 北京字节跳动网络技术有限公司 Page testing method and device, storage medium and electronic equipment
CN113094286B (en) * 2021-05-11 2024-05-10 北京字节跳动网络技术有限公司 Page test method and device, storage medium and electronic equipment

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112612563A (en) * 2020-12-16 2021-04-06 上海哔哩哔哩科技有限公司 Page test data generation method and device and computer equipment
CN112965916A (en) * 2021-04-09 2021-06-15 中国工商银行股份有限公司 Page testing method, page testing device, electronic equipment and readable storage medium
CN112965916B (en) * 2021-04-09 2024-03-08 中国工商银行股份有限公司 Page testing method, page testing device, electronic equipment and readable storage medium
CN113094286A (en) * 2021-05-11 2021-07-09 北京字节跳动网络技术有限公司 Page testing method and device, storage medium and electronic equipment
CN113094286B (en) * 2021-05-11 2024-05-10 北京字节跳动网络技术有限公司 Page test method and device, storage medium and electronic equipment

Similar Documents

Publication Publication Date Title
Mei et al. Conducting online surveys in China
US8787820B2 (en) Content creation in an online learning environment
KR20120094485A (en) Multimode online advertisements and online advertisement exchanges
US20110179116A1 (en) System and method for providing personality-based content and advertisements
JP2012203902A (en) Computer mounting method, system and program for mounting challenge/response type test
US20110276397A1 (en) Social media enabled advertising
CN103503012A (en) Providing advertisements on a social network
CN110474944B (en) Network information processing method, device and storage medium
Bailey et al. Examining user-developer feedback loops in the ios app store
Bosch et al. Using emojis in mobile web surveys for Millennials? A study in Spain and Mexico
CN112015635A (en) Page testing method, page testing device, electronic equipment and storage medium
US20140040046A1 (en) Systems and Methods for Acquiring a Captive Customer Base Within a Cloud Environment
Vitálišová et al. Promotion as a tool of smart governance in cities
US20190012698A1 (en) Method and System for Creating Virtual Focus Group Campaigns
US10282357B1 (en) Dynamic resampling for ranking viewer experiences
CN111885139B (en) Content sharing method, device and system, mobile terminal and server
CN114745594A (en) Method and device for generating live playback video, electronic equipment and storage medium
Pocatilu Developing an M-Learning Application for iOS.
Fakhri et al. Designing Digital Mading Information and Communication System (DMICS) as a Website-based Trusted Information Provider and Management Service
RU2671618C1 (en) Online method of creating advertising pages on site and managing their contents (options)
US11902223B2 (en) Intelligent assistant content generation
CN111625162B (en) Information list generation method and device
KR102274430B1 (en) Apparatus for disseminating advertisement posts using social networks and system including the same
CN111367517B (en) Information generation method and device
Huang et al. Design and Implementation of Campus Information Aggregation Platform

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination