CN112966180A

CN112966180A - Request processing method, device, equipment, medium and program product

Info

Publication number: CN112966180A
Application number: CN202110248657.XA
Authority: CN
Inventors: 王超
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2021-03-05
Filing date: 2021-03-05
Publication date: 2021-06-15
Anticipated expiration: 2041-03-05

Abstract

The disclosure discloses a request processing method, a request processing device, a request processing apparatus, a request processing medium and a program product, and relates to the technical field of computers, in particular to the technical field of experiments. The specific implementation scheme is as follows: obtaining an object request from a current object; and selecting a target experiment aiming at the current object from a plurality of experiments in response to the object request based on preset matching information, wherein the plurality of experiments comprise at least one first experiment and a plurality of second experiments, the first experiment is mutually exclusive with other experiments in the plurality of experiments, and the second experiment is an experiment except the first experiment in the plurality of experiments; wherein the matching information includes: the matching relationship between the first object set and the first experiment and the matching relationship between the second object set and the second experiment are obtained, the first object set comprises partial objects in a preset plurality of objects, and the second object set comprises other objects except the partial objects in the plurality of objects.

Description

Request processing method, device, equipment, medium and program product

Technical Field

Relate to computer technical field, especially relate to experiment technical field.

Background

Before the program product is released, a plurality of improvement schemes can be set for the program product, and the improvement schemes are tested to observe the change of object feedback caused by the change of a certain characteristic of the program product, so that a scheme with a better improvement effect on the characteristic can be selected. Among them, some experiments are mutually exclusive in object traffic, that is, the same object cannot participate in two mutually exclusive experiments at the same time. There is no solution in the related art to the complicated mutual exclusion problem.

Disclosure of Invention

The present disclosure provides a request processing method, apparatus, device, storage medium and program product.

According to an aspect of the present disclosure, there is provided a request processing method performed by an electronic device, including: obtaining an access request from a current object; and selecting a target experiment aiming at the current object from a plurality of experiments in response to the access request based on preset matching information, wherein the plurality of experiments comprise at least one first experiment and a plurality of second experiments, the first experiment is mutually exclusive with other experiments in the plurality of experiments, and the second experiment is an experiment except the first experiment in the plurality of experiments; wherein the matching information includes: the matching relationship between the first object set and the first experiment and the matching relationship between the second object set and the second experiment are obtained, the first object set comprises partial objects in a preset plurality of objects, and the second object set comprises other objects except the partial objects in the plurality of objects.

According to another aspect of the present disclosure, there is provided a request processing apparatus including: the acquisition module is used for acquiring an access request from a current object; the selection module is used for responding to the access request and selecting a target experiment aiming at the current object from a plurality of experiments based on preset matching information, wherein the plurality of experiments comprise at least one first experiment and a plurality of second experiments, the first experiment is mutually exclusive with other experiments in the plurality of experiments, and the second experiment is an experiment except the first experiment in the plurality of experiments; wherein the matching information includes: the matching relationship between the first object set and the first experiment and the matching relationship between the second object set and the second experiment are obtained, the first object set comprises partial objects in a preset plurality of objects, and the second object set comprises objects except the partial objects in the plurality of objects.

According to another aspect of the present disclosure, there is provided an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method as above.

According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method as above.

According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the method as above.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

FIG. 1 schematically illustrates an exemplary system architecture to which a request processing method may be applied, according to an embodiment of the disclosure;

FIG. 2 is a schematic diagram that schematically illustrates a manner in which object traffic is distributed, in accordance with an embodiment of the present disclosure;

FIG. 3 schematically illustrates a flow diagram of a request processing method according to an embodiment of the present disclosure;

FIG. 4 schematically shows a schematic diagram of a way in which a subject matches an experiment according to an embodiment of the disclosure;

FIG. 5 schematically shows a schematic diagram of experimental partitioning according to an embodiment of the present disclosure;

FIG. 6 schematically shows a schematic diagram of experimental partitioning according to another embodiment of the present disclosure;

fig. 7 schematically illustrates a schematic diagram of subject assignment according to an embodiment of the present disclosure;

FIG. 8 is a block diagram of a request processing device used to implement an embodiment of the present disclosure;

FIG. 9 illustrates a schematic block diagram of an example electronic device that can be used to implement embodiments of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.

All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.

Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).

An embodiment of the present disclosure provides a request processing method performed by an electronic device, including: obtaining an access request from a current object; and selecting a target experiment aiming at the current object from a plurality of experiments in response to the access request based on preset matching information, wherein the plurality of experiments comprise at least one first experiment and a plurality of second experiments, the first experiment is mutually exclusive with other experiments in the plurality of experiments, and the second experiment is an experiment except the first experiment in the plurality of experiments; wherein the matching information includes: the matching relationship between the first object set and the first experiment and the matching relationship between the second object set and the second experiment are obtained, the first object set comprises partial objects in a preset plurality of objects, and the second object set comprises other objects except the partial objects in the plurality of objects.

Fig. 1 schematically illustrates an exemplary system architecture 100 to which a request processing method may be applied, according to an embodiment of the disclosure. It should be noted that fig. 1 is only an example of a system architecture to which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, and does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.

As shown in fig. 1, the system architecture 100 according to this embodiment may include

terminal devices

101, 102, 103, a network 104 and a server 105. The network 104 serves as a medium for providing communication links between the

terminal devices

101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired and/or wireless communication links, and so forth.

The objects may interact with the server 105 over the network 104 using the

terminal devices

101, 102, 103 to receive or send messages or the like. The

terminal devices

101, 102, 103 may have installed thereon various communication client applications, such as a shopping-like application, a web browser application, a search-like application, an instant messaging tool, a mailbox client, and/or social platform software, etc. (by way of example only). The object may be, for example, a user.

The

terminal devices

101, 102, 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.

The server 105 may be a server providing various services, such as a background management server (for example only) providing support for websites browsed by objects using the

terminal devices

101, 102, 103. The background management server may analyze and perform other processing on the received data such as the access request, and feed back a processing result (e.g., a webpage, information, or data obtained or generated according to the access request) to the terminal device.

It should be noted that the request processing method provided by the embodiment of the present disclosure may be generally executed by the server 105. Accordingly, the request processing device provided by the embodiment of the present disclosure may be generally disposed in the server 105. The request processing method provided by the embodiment of the present disclosure may also be executed by a server or a server cluster different from the server 105 and capable of communicating with the

terminal devices

101, 102, 103 and/or the server 105. Accordingly, the request processing apparatus provided by the embodiment of the present disclosure may also be disposed in a server or a server cluster different from the server 105 and capable of communicating with the

terminal devices

101, 102, 103 and/or the server 105.

For example, the object may submit an access request to the server 105 through any one of the

terminal devices

101, 102, or 103 (for example, the terminal device 101 is not limited thereto), and the server 105 may process the access request submitted by the object according to the request processing method of the embodiment of the present disclosure to obtain a target experiment corresponding to the access request, so that the object participates in the target experiment.

It should be understood that the number of terminal devices, networks and control devices in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and control devices, as desired for implementation.

In the embodiment of the disclosure, some characteristics of the program product can be improved to form a plurality of improved schemes, and some objects experience the improved schemes to obtain the feedback of the use condition of the objects, so that the improved schemes with better effect can be obtained according to the analysis of the use condition of the objects. The characteristics may include, for example, characteristics for display effects of the page, such as improvements in page background color, font, and the like. The feasibility and effectiveness of the strategy represented by the experiment are judged by carrying out subdivision and random experiments on the object flow and monitoring and tracking the experiment effect.

The overall procedure of the experiment may be: 1) the assumption is made that: before the experiment, a developer can consider which variables are improved and how the variables are improved, so that the experience of the object can be improved. 2) Determining a scheme: given the assumptions and expectations, a specific experimental scenario may be determined, such as determining which of the variables (and values of the variables) of the experiment are, for example, the variables (and values thereof) may be: font (black/red), page background (black/red). In addition, it is also necessary to consider whether conflicts exist between some experiments, for example, when the background is black, the font may not be black, which ensures that no intersection exists between the experimental objects of the two experiments, that is, the traffic of the experiment is mutually exclusive, where the traffic may refer to an access request, and the "experiment mutual exclusion" appearing below may refer to the traffic of the experiment is mutually exclusive, that is, no intersection may occur between the participating objects of the experiment. 3) Function development: and after the scheme is determined, carrying out function research and development, and adding a program segment corresponding to the improved scheme into a program product. For example, if experiments for black, green, and blue backgrounds are added on the basis of the original white background of the program product, a black background module X2, a green background module X3, and a blue background module X4 may be added on the basis of the original white background module X1 in the program product, and when an access request is received, an object is assigned to one of the modules X1 to X4. 4) Configuration experiment: after the function development is completed, specific experimental information including flow information, variable information and the like can be configured on the experimental platform. 5) And (4) checking experimental data: and after the experiment is on line, generating an on-line log, and counting the behavior data of the object according to the log, such as the behavior data of the object, such as the browsing amount and the click amount of the statistical object. 6) And (4) outputting a conclusion: after the experiment is carried out for a period of time, an experimental conclusion can be made according to experimental data of each group.

In view of the mutual exclusion problem mentioned in the above description, the inventors found that there exists a scenario of joint experiments, for example, existing experiments A, B, C and D, where experiment a is an experiment for the overall background color of a page; experiment B is an experiment for font color, experiment C is an experiment for form border, and experiment D is an experiment for virtual key color. For this situation, a needs to be mutually exclusive with B, C and D, and B, C and D do not need to be mutually exclusive between them, which may be referred to as a joint experiment scenario, that is, when multiple experiments are performed simultaneously, there is at least one first experiment, the first experiment is mutually exclusive with other experiments except itself, but there is no need for mutual exclusion between other groups of experiments except the at least one first experiment, and the other experiments except the at least one first experiment may be referred to as second experiments. Taking the above experiments A, B, C and D as examples, if a needs to be mutually exclusive with B, C and D, respectively, and B, C and D do not need to be mutually exclusive, experiment a is a first experiment, and B, C and D are each a second experiment; if A needs to be mutually exclusive with B, C and D, respectively, and B needs to be mutually exclusive with A, C and D, respectively, and there is no requirement for mutual exclusion between C and D, then experiments A and B are each a first experiment and C and D are each a second experiment.

In order to avoid intersection between the participating objects of the mutually exclusive experiments, the experiments with mutual exclusion can be all put in an experiment layer to equally divide the full amount of experiment objects, wherein the concept of the experiment layer is introduced for convenience of explanation and understanding. The experimental layer may have a total number of subjects, each of the plurality of experiments in the experimental layer occupying a portion of the total number of subjects, and one subject may participate in one experiment in the experimental layer but not in other experiments in the layer.

Fig. 2 schematically shows a schematic diagram of an object traffic distribution manner according to an embodiment of the present disclosure.

As shown in fig. 2, if a needs to be mutually exclusive from B, C and D, respectively, A, B, C and D can be placed in one experiment layer 201, the four experiments share the whole number of experimental objects, and no intersection exists between any two experimental objects. For example, the total number of the subjects is u1 to u20, where u1 to u5 can be assigned to experiment a, u6 to u10 can be assigned to experiment B, u11 to u15 can be assigned to experiment C, and u16 to u20 can be assigned to experiment D. When a subject initiates a request, the subject can participate in one experiment (e.g., experiment a) in the experiment layer 201, and cannot participate in other experiments (B, C and D) in the experiment layer 201, so that the traffic mutual exclusion between experiment a and other experiments is realized. However, this object allocation method has the following problems: the experiments B, C and D do not need to be mutually exclusive, that is, the object traffic between the experiments B, C and D can be multiplexed, that is, one object can participate in the experiments B, C and D at the same time, however, the above allocation scheme does not have intersection between the participating objects between the experiments B, C and D, which results in the reduction of the objects participating in each experiment. If there are too many mutually exclusive experiments, the allocated traffic per experiment may be too small to meet the experiment requirements.

The embodiment of the disclosure further provides an access request processing method, which can solve the problem of mutual exclusion in complex experiments and solve the problems existing in the above scheme, so that the purpose of not repeatedly using the same object in mutually exclusive experiments can be achieved, the object can be reused in non-mutually exclusive experiments, and the utilization rate of the object flow is improved.

In the embodiment of the disclosure, the mutual exclusion relationship among the experiments can be set manually by the experimenter, that is, the experimenter can determine in advance whether any two experiments need mutual exclusion.

The embodiment of the present disclosure provides a request processing method, and the following describes a request processing method according to an exemplary embodiment of the present disclosure with reference to fig. 3 to 7 in conjunction with an application scenario of fig. 1.

FIG. 3 schematically shows a flow diagram of a request processing method according to an embodiment of the present disclosure.

As shown in fig. 3, the request processing method 300 of the embodiment of the present disclosure may include, for example, operations S310 to S320.

In operation S310, an access request from a current object is obtained.

In operation S320, a target experiment for a current object is selected from a plurality of experiments based on preset matching information in response to an access request, wherein the plurality of experiments include at least one first experiment and a plurality of second experiments, the first experiment is mutually exclusive with other experiments in the plurality of experiments, and the second experiment is an experiment other than the first experiment in the plurality of experiments. Wherein the matching information includes: the matching relationship between the first set of objects and the first experiment and the matching relationship between the second set of objects and the second experiment. The first object set comprises a part of objects in the preset plurality of objects, and the second object set comprises other objects except the part of objects in the plurality of objects.

In the embodiment of the disclosure, before the experiment is performed, the corresponding relationship between the object and the experiment may be matched in advance, so that after the experiment is started, the target experiment in which the object needs to participate may be found according to the pre-matched corresponding relationship.

In one example, the plurality of experiments may refer to experiments A, B, C and D, where experiment a requires mutual exclusion with B, C and D, respectively, and no mutual exclusion is required between B, C and D, then experiment a is a first experiment and B, C and D are each a second experiment.

Fig. 4 schematically shows a schematic diagram of a way of matching a subject to an experiment according to an embodiment of the present disclosure.

As shown in fig. 4, in the total number of subjects, experiment a alone may occupy a part of the subjects, which is the first set of subjects. For example, experiment a may be placed in experiment layer 401 and experiment layer 401 may be assigned a first set of objects, and when an object in the first set of objects sends an access request, the object may be assigned to experiment layer 401 to participate in experiment a. The term "full-scale experiment subject" may mean that a part of subjects selected from the platform-registered subjects is used for an experiment, and the part of subjects participating in the experiment may be referred to as full-scale experiment subjects. The full number of subjects may be, for example, subjects u1 to u10, and the first set of subjects may be, for example, subjects u1 to u 4. The remaining experimental subjects u 5-u 10, except for the first set of subjects, may constitute a second set of subjects, and the subjects in the second set of subjects may be multiplexed in the second experiment B, C and D. For example, the second experiments B, C and D are located in one

experiment layer

402, 403, and 404, respectively, the second object set may be allocated to each

experiment layer

402, 403, and 404, and when an object in the second object set sends an access request, the object may be allocated to the three experiment layers to participate in the experiments B, C and D at the same time, so as to implement multiplexing of object traffic.

In another example, if A needs to be mutually exclusive with B, C and D, respectively, and B needs to be mutually exclusive with A, C and D, respectively, while C and D do not need to be mutually exclusive, then experiments A and B are mutually exclusive with the rest of the experiments except for themselves, so experiments A and B are each a first experiment and experiments C and D are each a second experiment. In this case, experiments a and B need to be placed in one experimental layer to equally divide the objects of the first set of objects, and experiments C and D each occupy one experimental layer to multiplex the objects of the second set of objects. Based on this approach, experiment a and experiment B divide the objects of the first set of objects, so there is no intersection between the participating objects of experiment a and experiment B, and also no intersection between the participating objects of experiment a/B and experiment C/D, whereas experiments C and D may multiplex the remaining experimental objects except the first set of objects.

In the embodiment of the disclosure, after an experiment is started, when an access request of a certain object is received, whether the object is an experimental object is checked, if so, a target experiment corresponding to the object is found according to preset matching information of the object and the experiment in response to the access request, so that the object participates in the target experiment.

According to the embodiment of the disclosure, the objects required by the first experiment are selected aiming at the first experiment which is mutually exclusive with other experiments in the combined experiment scene, and then other objects except the objects required by the first experiment in the total amount of experiment objects are multiplexed into other second experiments, so that the purpose that the same experiment object is not repeatedly used in mutually exclusive experiments can be realized, the multiplexing of the experiment objects can be realized in the non-mutually exclusive experiments, the utilization rate of object flow is improved, and the object demand of each experiment is met.

According to an embodiment of the present disclosure, selecting a target experiment for a current subject from a plurality of experiments includes: selecting one first experiment from at least one first experiment as a target experiment under the condition that the current object belongs to a first object set; in a case where the current subject belongs to the second set of subjects, a plurality of second experiments are taken as target experiments.

Following the first example described above, experiment a is the first experiment, experiment a alone occupies objects of the first set of objects, B, C and D are each a second experiment, B, C and D multiplex objects of the second set of objects. If the current object belongs to the first object set, the target experiment corresponding to the current object is experiment a, that is, the current object needs to participate in experiment a. If the current object belongs to the second object set, the target experiments corresponding to the current object are experiments B, C and D, that is, the current object needs to participate in experiments B, C and D simultaneously.

Following the second example described above, experiments a and B are each a first experiment, experiments a and B divide the objects of the first set of objects, experiments C and D are each a second experiment, and experiments C and D multiplex the objects of the second set of objects. If the current object belongs to the first object set, the target experiment corresponding to the current object is experiment a or experiment B, that is, the current object needs to participate in one of experiments a and B. If the current object belongs to the second object set, the target experiments corresponding to the current object are experiments C and D, that is, the current object needs to participate in the experiments C and D at the same time.

According to the embodiment of the disclosure, the current object may participate in one experiment in the first experiments, and the same object may be prevented from being used between mutually exclusive first experiments, or the current object may participate in each experiment in the second experiments, and the object multiplexing between the non-mutually exclusive second experiments may be realized.

According to an embodiment of the present disclosure, the request processing method further includes: generating a display page based on the target experiment; and outputting the display page to the current object.

Following the first example described above, experiment a was the first experiment and experiments B, C and D were each a second experiment. For example, experiment a is an experiment performed on the overall background color of the page, e.g., having two colors of black/blue; experiment B is an experiment for font color, e.g. with two colors black/blue; experiment C is an experiment performed on form borders, e.g. with two colors black/blue; experiment D is an experiment performed for a virtual key color, for example, having two colors of black/blue.

If the target experiment corresponding to the current object is experiment a, when the page is generated, the background color of the page can be changed from original white to black or blue, and the colors of the font, the form frame and the virtual keys are still the original colors. And after the improved page is generated, the page is displayed to the object through the terminal equipment so as to observe the change of the use condition of the object caused by the change of the background color of the page.

If the target experiments corresponding to the current object are experiments B, C and D, when the page is generated, the background color of the font, the form border and the virtual keys may be changed from the original color to black or blue, and the background color still adopts the original white color. And after the improved page is generated, the page is displayed to the object through the terminal equipment so as to observe the change of the use condition of the object caused by the color change of the font, the form frame and the virtual key.

According to an embodiment of the present disclosure, the request processing method may further include: forming a first set of objects, wherein forming the first set of objects comprises: (1) obtaining subject conditions for each first experiment; (2) selecting a plurality of candidate objects which meet the object condition of any one first experiment from a plurality of preset objects; (3) a predetermined number of objects are selected from the plurality of candidate objects to form a first set of objects.

For example, each experiment may have a respective subject condition, which may refer to a target subject of the experiment, e.g., a subject of a different age group, an android/IOS subject, etc. In the process of selecting the first set of subjects, a subject that meets the subject condition of any first experiment may be selected as a candidate from the total number of experimental subjects. And selecting a preset number of objects from the candidate objects to form a first object set, wherein the preset number can be calculated according to a preset proportion, and the number of the objects in the first object set can account for about 10% -20% of the total number of the experimental objects. The remaining objects outside the first set of objects may form a second set of objects. The first set of objects selected based on the above manner may satisfy the object condition and the number condition required for the first experiment.

If the current object belongs to the first object set, a first experiment that the current object meets can be determined, and then the object is made to participate in the experiment that meets the object condition.

According to an embodiment of the present disclosure, all of the first experiments are divided into a plurality of first control experiments (the control experiments may also be referred to as experiment branches) according to different values of the experiment variables. The matching information further includes: and carrying out one-to-one corresponding matching relation between a plurality of first sub-object sets obtained by dividing the first object set and a plurality of first comparison experiments, wherein the objects in any two first sub-object sets do not have an intersection.

According to an embodiment of the present disclosure, each second experiment is divided into a plurality of second control experiments according to different values of the experimental variables. The matching information further includes: and the matching relation between the plurality of second sub-object sets obtained by dividing the second object set and the plurality of second comparison experiments in a one-to-one correspondence manner is obtained.

Fig. 5 schematically shows a schematic diagram of an experimental partitioning approach according to an embodiment of the present disclosure.

Continuing with the first example above, experiment a is the first experiment and experiments B, C and D are each a second experiment, as shown in fig. 5. For example, experiment A was divided into 5 control experiments (A1-A5) with 5 background colors for experiment A, each control experiment corresponding to one background color. Accordingly, the experimental layer 501 in which experiment a is located may be divided into 5 intervals, each interval corresponding to a portion of the objects in the first set of objects, and each interval corresponding to a control experiment, where the objects in the different intervals do not intersect.

If experiments B, C and D also each have 5 conversion colors, experiments B, C and D can be divided into 5 control experiments (B1-B5, C1-C5, D1-D5), respectively, and for each second experiment, the second set of objects can be divided into 5 subsets, one for each control experiment. Accordingly, the experimental layers 501 to 504 where the experiments B, C and D are located can be divided into 5 intervals, and one interval corresponds to one control experiment. There is no object intersection between the subsets belonging to the same second experiment, i.e. one object may participate in multiple second experiments, but only in one control experiment in each second experiment.

Fig. 6 schematically shows a schematic diagram of an experimental partitioning approach according to another embodiment of the present disclosure.

As shown in fig. 6, following the second example described above, experiment a and experiment B are each a first experiment, and experiment C and experiment D are each a second experiment. If the experiment a has 3 background colors and the experiment B has 2 font colors, the experiment a is divided into 3 control experiments (a 1-A3) according to the 3 background colors of the experiment a, and the experiment B is divided into 2 control experiments (B1-B2) according to the 2 font colors of the experiment B, then the first experiment is divided into 5 control experiments in total, the experiment layer 601 needs to be divided into 5 intervals, that is, the first object set is divided into 5 subsets, and each subset corresponds to one control experiment.

If experiments C and D each have 5 shifted colors, experiments C and D can be divided into 5 control experiments (C1-C5, D1-D5), respectively. For each second experiment, the second set of objects may be divided into 5 subsets, one for each control experiment. Accordingly, the experimental layers 501 to 504 where the experiments B, C and D are located can be divided into 5 intervals, and one interval corresponds to one control experiment.

According to the embodiment of the disclosure, in the case that each experiment has multiple control experiments, the first and second object sets are divided into multiple subsets, so that no intersection is generated between the participating objects of different control experiments of the same experiment, and a chaotic condition that one object corresponds to two page background colors, for example, is avoided.

According to an embodiment of the present disclosure, selecting a predetermined number of objects from a plurality of candidate objects to form a first object set includes at least one of the following ways (1) to (2):

(1) a predetermined number of objects are randomly extracted from the plurality of candidate objects to form a first set of objects.

(2) Selecting objects with object behavior similarity satisfying a preset similarity condition from a plurality of candidate objects to form a first object set.

For example, in forming the first set of objects, after selecting candidate objects satisfying the object condition from the total number of experimental objects, a predetermined number of objects may be randomly selected from the candidate objects to form the first set of objects. And each experimental layer can be bound with a random salt value, and in the process of interval division of each experimental layer, the random salt value can uniformly scatter the experimental objects of the experimental layer into different intervals.

For another example, in the process of forming the first object set, after selecting candidate objects satisfying the object condition from the total number of experimental objects, a predetermined number of objects with high object behavior similarity may be extracted from the candidate objects to form the first object set, for example, three objects need to be extracted from the objects 1 to 10 to form the first object set, where the object behavior similarity of the

objects

1, 2, and 4 is high, and then the

objects

1, 2, and 4 may be extracted into the experimental layer corresponding to the first experiment. The object behaviors include behaviors such as clicking, searching and browsing, and the high similarity of the object behaviors can mean that behavior indexes such as the clicking amount, the searching amount and the browsing amount of the object are close. Based on the scheme, the objects with similar behaviors can be screened out according to the behavior indexes of the objects to participate in the first experiment, so that the flow distribution can be more scientific, and the realization effect is more referential.

In the embodiment of the present disclosure, the first set of objects may also be selected from the full-scale experimental objects, and the process of forming the first set of objects from the full-scale object sampling and allocating the objects to different control experimental intervals may also be performed in an orthogonal manner. For example, an orthogonal table about the combination mode of each control experiment may be obtained by using an orthogonal experiment method, and then the control experiment combination corresponding to each experimental object may be determined according to the orthogonal table, and accordingly, an object group (object group may also be referred to as a sub-object set) matching each control experiment may also be obtained. A predetermined number of objects are uniformly extracted from each object group of the second experiment to form a first object set. The orthogonality of the experiment may not be affected based on this approach.

Fig. 7 schematically shows a schematic diagram of a subject assignment according to an embodiment of the present disclosure.

As shown in FIG. 7, for example, experiments A, B, C, D and E are the first experiment, experiment A is mutually exclusive with the rest of experiments, and experiments B, C, D and E are not mutually exclusive. The experiments A, B, C, D and E were divided into 5 control experiments (A1-A5, B1-B5, C1-C5, D1-D5, and E1-E5), and each control experiment was assigned to each 5 cells from left to right in the figure. The control experiment combination corresponding to each experimental object can be determined according to an orthogonal experiment method for the existing total experimental objects 1-25. For example, subject 1 corresponds to the control experimental combination: a1, B1, C1, D1 and E1; subject 6 corresponds to the control experiment combination: a2, B2, C4, D5 and E3; subject 16 corresponds to the control experimental combination: a4, B3, C2, D4 and E5. Accordingly, a matched object for each control experiment can be obtained, e.g., objects 1, 10, 15, 20, and 25 for control experiment B1; control experiment C2 matched subjects were

subjects

2, 9, 15, 16 and 22; the subjects matched for control experiment E5 were

subjects

5, 8, 12, 16 and 25. In extracting the first set of objects, the objects may be extracted uniformly from each object grouping of the second experiment, for example, one object from each of the 5 object groupings of experiment B, resulting in the first set of

objects

1, 6, 11, 16, and 25, and the extracted

objects

1, 6, 11, 16, and 25 are also located in different groupings of experiments C, D and E, respectively. The object allocation of the first object set, the second object set and each subset obtained based on the method can meet the orthogonality of the experiment, so that the experiment can be completed efficiently and quickly.

In the embodiment of the disclosure, in the process of performing object traffic distribution by using the pre-configured matching information, an access request is received, hash modulo is performed on an object identifier of a current object, and whether the current object hits a first experiment or a second experiment is calculated by using the hash modulo and according to the matching information, that is, a target experiment in which the current object needs to participate is determined. And judging which specific control experiment under the target experiment the current object needs to participate in. If the objects of the control experiments are randomly distributed in the matching information configuration process, after the target experiment corresponding to the current object is determined, the current object is randomly distributed to one of the control experiments. If the object of each contrast experiment is determined by an orthogonal experiment method in the matching information configuration process, after the target experiment corresponding to the current object is determined, the current object can be allocated to the corresponding contrast experiment according to the matching relation between the configured object and each contrast experiment, and the specific experiment branch configuration of the hit experiment can be judged and issued by combining with the KV dictionary of the orthogonal sampling.

Another aspect of the embodiments of the present disclosure also provides a test data processing apparatus for controlling device execution.

FIG. 8 is a block diagram of a request processing device used to implement an embodiment of the present disclosure.

As shown in fig. 8, the test data processing apparatus 800 includes an acquisition module 810 and a selection module 820.

The obtaining module 810 is configured to obtain an access request from a current object; and

the selecting module 820 is configured to select a target experiment for a current object from a plurality of experiments in response to the access request based on preset matching information, where the plurality of experiments include at least one first experiment and a plurality of second experiments, the first experiment is mutually exclusive with other experiments in the plurality of experiments, and the second experiment is an experiment other than the first experiment in the plurality of experiments.

Wherein the matching information includes: the matching relationship between the first object set and the first experiment and the matching relationship between the second object set and the second experiment are obtained, the first object set comprises partial objects in a preset plurality of objects, and the second object set comprises other objects except the partial objects in the plurality of objects.

According to an embodiment of the disclosure, the selection module is further configured to: selecting one first experiment from at least one first experiment as a target experiment under the condition that the current object belongs to a first object set; in a case where the current subject belongs to the second set of subjects, a plurality of second experiments are taken as target experiments.

According to an embodiment of the present disclosure, the request processing apparatus further includes a page module, where the page module is configured to: generating a display page based on the target experiment; and outputting the display page to the current object.

According to an embodiment of the present disclosure, the request processing apparatus further includes a forming module configured to: obtaining subject conditions for each first experiment; selecting a plurality of candidate objects which meet the object condition of any one first experiment from a plurality of preset objects; a predetermined number of objects are selected from the plurality of candidate objects to form a first set of objects.

According to an embodiment of the disclosure, the forming module is further configured to perform at least one of the following operations: randomly extracting a predetermined number of objects from a plurality of candidate objects to form a first object set; dividing a plurality of candidate objects into a plurality of candidate object sets, and extracting the same number of candidate objects from each candidate object set to form a first object set; selecting objects with object behavior similarity satisfying a preset similarity condition from a plurality of candidate objects to form a first object set.

According to an embodiment of the disclosure, each first experiment is divided into a plurality of first control experiments according to different values of experiment variables; the matching information further includes: and carrying out one-to-one corresponding matching relation between a plurality of first sub-object sets obtained by dividing the first object set and a plurality of first comparison experiments, wherein the objects in any two first sub-object sets do not have an intersection.

According to an embodiment of the disclosure, each second experiment is divided into a plurality of second control experiments according to different values of the experiment variables; the matching information further includes: and the matching relation between the plurality of second sub-object sets obtained by dividing the second object set and the plurality of second comparison experiments in a one-to-one correspondence manner is obtained.

Any number of modules, sub-modules, units, sub-units, or at least part of the functionality of any number thereof according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of or a suitable combination of software, hardware, and firmware implementations. Alternatively, one or more of the modules, sub-modules, units, sub-units according to embodiments of the disclosure may be at least partially implemented as a computer program module, which when executed may perform the corresponding functions.

It should be noted that the request processing device portion in the embodiment of the present disclosure corresponds to the request processing method portion in the embodiment of the present disclosure, and the description of the request processing device portion specifically refers to the request processing method portion, and is not repeated herein.

The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.

FIG. 9 illustrates a schematic block diagram of an example electronic device 900 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 9, the apparatus 900 includes a computing unit 901, which can perform various appropriate actions and processes in accordance with a computer program stored in a Read Only Memory (ROM)902 or a computer program loaded from a storage unit 908 into a Random Access Memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the device 900 can also be stored. The calculation unit 901, ROM 902, and RAM 903 are connected to each other via a bus 904. An input/output (I/O) interface 905 is also connected to bus 904.

A number of components in the device 900 are connected to the I/O interface 905, including: an input unit 906 such as a keyboard, a mouse, and the like; an output unit 907 such as various types of displays, speakers, and the like; a storage unit 908 such as a magnetic disk, optical disk, or the like; and a communication unit 909 such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 909 allows the device 900 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.

The computing unit 901 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of the computing unit 901 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The computing unit 901 executes the respective methods and processes described above, such as the request processing method. For example, in some embodiments, the request processing method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 908. In some embodiments, part or all of the computer program may be loaded and/or installed onto device 900 via ROM 902 and/or communications unit 909. When the computer program is loaded into the RAM 903 and executed by the computing unit 901, one or more steps of the request processing method described above may be performed. Alternatively, in other embodiments, the computing unit 901 may be configured to perform the request processing method by any other suitable means (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with an object, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to an object; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which objects can provide input to the computer. Other kinds of devices may also be used to provide for interaction with an object; for example, feedback provided to the subject can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the object may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., an object computer having a graphical object interface or a web browser through which objects can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, and the present disclosure is not limited herein.

The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.

Claims

1. A request processing method performed by an electronic device, comprising:

obtaining an access request from a current object; and

selecting a target experiment aiming at the current object from a plurality of experiments in response to the access request based on preset matching information, wherein the plurality of experiments comprise at least one first experiment and a plurality of second experiments, the first experiment is mutually exclusive with other experiments in the plurality of experiments, and the second experiment is an experiment in the plurality of experiments except the first experiment;

wherein the matching information comprises: the method comprises the steps of matching relationships between a first object set and the first experiment and between a second object set and the second experiment, wherein the first object set comprises partial objects in a preset plurality of objects, and the second object set comprises other objects except the partial objects in the plurality of objects.

2. The method of claim 1, wherein the selecting a target experiment for the current subject from a plurality of experiments comprises:

selecting one first experiment from the at least one first experiment as the target experiment in case the current object belongs to a first set of objects;

taking the plurality of second experiments as the target experiments in case the current object belongs to a second set of objects.

3. The method of claim 1, further comprising:

generating a display page based on the target experiment; and

and outputting the display page to the current object.

4. The method of any of claims 1 to 3, further comprising: forming the first set of objects, wherein the forming the first set of objects comprises:

obtaining subject conditions for each of the first experiments;

selecting a plurality of candidate objects which meet the object condition of any one first experiment from the preset plurality of objects;

selecting a predetermined number of objects from the plurality of candidate objects to form the first set of objects.

5. The method of claim 4, wherein the selecting a predetermined number of objects from the plurality of candidate objects to form the first set of objects comprises at least one of:

randomly extracting a predetermined number of objects from the plurality of candidate objects to form the first set of objects;

and selecting objects with object behavior similarity meeting a preset similarity condition from the candidate objects to form the first object set.

6. The method according to any one of claims 1 to 3, wherein the at least one first experiment is divided into a plurality of first control experiments according to different values of experimental variables;

the matching information further includes: and carrying out one-to-one corresponding matching relation between a plurality of first sub-object sets obtained by dividing the first object set and the plurality of first comparison experiments, wherein objects in any two first sub-object sets do not have an intersection.

7. The method of claim 6, wherein each of the second experiments is divided into a plurality of second control experiments according to different values of the experimental variables;

the matching information further includes: and obtaining a one-to-one corresponding matching relationship between a plurality of second sub-object sets obtained by dividing the second object set and the plurality of second comparison experiments.

8. A request processing apparatus comprising:

the acquisition module is used for acquiring an access request from a current object; and

a selection module, configured to select, in response to the access request, a target experiment for the current object from multiple experiments based on preset matching information, where the multiple experiments include at least one first experiment and multiple second experiments, the first experiment is mutually exclusive with other experiments in the multiple experiments, and the second experiment is an experiment other than the first experiment in the multiple experiments;

wherein the matching information comprises: the method comprises the steps of matching relationships between a first object set and the first experiment and between a second object set and the second experiment, wherein the first object set comprises partial objects in a preset plurality of objects, and the second object set comprises objects in the plurality of objects except for the partial objects.

9. The apparatus of claim 8, wherein the selection module is further configured to:

10. The apparatus of claim 8, further comprising a page module to:

generating a display page based on the target experiment; and

and outputting the display page to the current object.

11. The apparatus of any of claims 8 to 10, further comprising a forming module to:

obtaining subject conditions for each of the first experiments;

12. The apparatus of claim 11, wherein the forming module is further configured to perform at least one of:

13. The apparatus according to any one of claims 8 to 10, wherein the at least one first experiment is divided into a plurality of first control experiments according to different values of experimental variables;

14. The apparatus of claim 13, wherein each of the second experiments is divided into a plurality of second control experiments according to different values of the experimental variable;

15. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.

16. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-7.

17. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-7.