CN116383533A - AB experiment shunting processing method, device, medium and equipment - Google Patents
AB experiment shunting processing method, device, medium and equipment Download PDFInfo
- Publication number
- CN116383533A CN116383533A CN202310355972.1A CN202310355972A CN116383533A CN 116383533 A CN116383533 A CN 116383533A CN 202310355972 A CN202310355972 A CN 202310355972A CN 116383533 A CN116383533 A CN 116383533A
- Authority
- CN
- China
- Prior art keywords
- experiment
- target
- configuration data
- page
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000002474 experimental method Methods 0.000 title claims abstract description 210
- 238000003672 processing method Methods 0.000 title claims abstract description 20
- 230000004044 response Effects 0.000 claims abstract description 77
- 238000000034 method Methods 0.000 claims abstract description 61
- 238000012545 processing Methods 0.000 claims abstract description 17
- 238000009877 rendering Methods 0.000 claims description 27
- 238000003032 molecular docking Methods 0.000 claims description 26
- 230000008569 process Effects 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 15
- 238000009933 burial Methods 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 9
- 238000004458 analytical method Methods 0.000 description 4
- 238000004806 packaging method and process Methods 0.000 description 4
- 238000007405 data analysis Methods 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 235000014510 cooky Nutrition 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000005111 flow chemistry technique Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 210000001503 joint Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000011064 split stream procedure Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9574—Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Abstract
The application provides an AB experiment shunting processing method, an AB experiment shunting processing device, a AB experiment shunting processing medium and AB experiment shunting processing equipment, wherein the AB experiment shunting processing method comprises the following steps: sending a page access request to a server; receiving a page access response returned by a server, wherein the page access response comprises a target barrel mark, and the target barrel mark is a target barrel mark of at least one AB experiment hit according to a user mark; based on triggering of an experiment buried point, reading experiment configuration data cached in advance locally, and inquiring target experiment configuration data corresponding to the target barrel identification according to the target barrel identification; and uploading the target experiment configuration data to a server. The method and the device can save network overhead and improve experimental efficiency.
Description
Technical Field
The application relates to the technical field of computers, in particular to an AB experiment shunting processing method, an AB experiment shunting processing device, an AB experiment shunting processing medium and AB experiment shunting processing equipment.
Background
The AB experiment (AB test) is to build two or more versions for the application or system, in the same time dimension, the visitor groups with the same or similar structures are respectively accessed to different versions according to a certain rule, then a data collection tool is used for collecting a plurality of groups of user data and business data, and finally the best version is evaluated to be formally adopted by combining business indexes. In the AB experiment, user traffic is distributed to the AB experimental version to be analyzed by a splitting algorithm (splitting rule) to support subsequent data analysis. Therefore, how to save network overhead and improve experimental efficiency in the splitting process is a technical problem that needs to be solved by those skilled in the art.
Disclosure of Invention
In view of this, the application provides an AB experiment shunting processing method, device, medium and electronic equipment, and mainly aims to save network overhead and improve experiment efficiency.
According to one aspect of the present application, there is provided an AB experiment splitting processing method, for a client, including:
sending a page access request to a server;
receiving a page access response returned by a server, wherein the page access response comprises a target barrel mark, and the target barrel mark is a target barrel mark of at least one AB experiment hit according to a user mark;
based on triggering of an experiment buried point, reading experiment configuration data cached in advance locally, and inquiring target experiment configuration data corresponding to the target barrel identification according to the target barrel identification;
and uploading the target experiment configuration data to a server.
In one implementation, before the sending the page access request to the server, the method further includes:
responding to an application starting operation, and requesting to access an experimental platform of a server through a preset platform docking tool;
receiving the experimental configuration data issued by the experimental platform through the platform docking tool;
And caching the experimental configuration data locally.
In one implementation, after receiving the page access response returned by the server, the method further includes:
and acquiring a page file matched according to the target barrel identification, and performing page rendering according to the page file.
In one implementation manner, the reading the locally pre-cached experiment configuration data based on the triggering of the experiment buried point includes:
triggering an experiment buried point in the page rendering process or the page access process;
and starting a preset application embedded point tool to read the experimental configuration data from a local cache based on the triggering of the experimental embedded point.
In one implementation, the method further comprises:
analyzing the page access response, determining whether the page access response contains a field which indicates that only the sub-bucket identification is carried, and if so, identifying the value of the field which only carries the sub-bucket identification;
and determining whether the target experiment configuration data is required to be read from the local cache and matched according to the value of the field only carrying the barrel identification.
In one implementation, the experimental configuration data comprises sub-bucket identification information, sub-bucket content information and data structure information;
The step of inquiring the target experiment configuration data corresponding to the target barrel identification according to the target barrel identification comprises the following steps: and inquiring the sub-bucket content information and the data structure information corresponding to the target sub-bucket identification according to the target sub-bucket identification.
According to one aspect of the present application, an AB experiment splitting processing method is provided, which is used for a server, and includes:
receiving a page access request sent by a client;
returning a page access response to the client, wherein the page access response comprises a target sub-bucket identifier, so that the client searches experiment configuration data cached in advance locally based on the target sub-bucket identifier to acquire target experiment configuration data, and the target sub-bucket identifier is a target sub-bucket identifier of at least one AB experiment hit according to a user identifier;
and receiving target experiment configuration data uploaded by the client.
In one implementation manner, before the receiving the page access request sent by the server, the method further includes:
receiving an experiment platform access request sent by a server, wherein the server responds to an application starting operation and sends the experiment platform access request through a preset platform docking tool;
And issuing the experimental configuration data to the platform docking tool through the experimental platform, so that the client caches the experimental configuration data locally.
In one implementation manner, after the receiving the page access request sent by the server, the method further includes:
analyzing a user identifier according to the page access request;
according to the user identification, searching out sub-barrel identification information corresponding to the user identification in the experimental platform;
and packaging the barrel identification in the header of the page access response message.
In one implementation, the method further comprises:
determining a page file according to the target barrel mark;
and providing the page file to the client so that the client performs page rendering based on the page file.
In one implementation, the method further comprises:
and setting a field which only carries the barrel mark in the page access response, and setting the value of the field only carrying the barrel mark to indicate whether the client needs to read and match target experiment configuration data from a local cache according to the value.
In one implementation, the method further comprises: and configuring and storing the experimental configuration data on an experimental platform, wherein the experimental configuration data comprises barrel identification information, barrel content information and data structure information.
According to an aspect of the present application, there is provided an AB experiment split stream processing apparatus, for a client, including:
the system comprises a page request unit, a server side and a server side, wherein the page request unit is used for sending a page access request to the server side and receiving a page access response returned by the server side, the page access response comprises a target sub-bucket identifier, and the target sub-bucket identifier is a target sub-bucket identifier of at least one AB experiment hit according to a user identifier;
the data acquisition unit is used for reading the experiment configuration data cached in advance locally based on the triggering of the experiment buried point, and searching the target experiment configuration data corresponding to the target barrel mark according to the target barrel mark;
and the data reporting unit is used for uploading the target experiment configuration data to a server.
In one implementation, the method further comprises:
the platform interface unit is used for responding to the application starting operation and requesting to access the experimental platform of the server through a preset platform docking tool; receiving the experimental configuration data issued by the experimental platform through the platform docking tool;
and the caching unit caches the experimental configuration data to the local.
In one implementation, the apparatus further comprises:
And the page rendering unit is used for acquiring page files matched according to the target barrel identification and performing page rendering according to the page files.
In one implementation manner, the data reading unit is specifically configured to trigger an experiment buried point in a page rendering process or a page access process; and starting a preset application embedded point tool to read the experimental configuration data from a local cache based on the triggering of the experimental embedded point.
In one implementation, the method further comprises:
the field analysis execution unit is used for analyzing the page access response, determining whether the page access response contains a field which only carries the sub-bucket identification, and if so, identifying the value of the field only carrying the sub-bucket identification; and determining whether the data acquisition unit needs to read and match target experiment configuration data from a local cache according to the value of the field only carrying the barrel identification.
In one implementation, the experimental configuration data comprises sub-bucket identification information, sub-bucket content information and data structure information;
the data acquisition unit is specifically configured to: and inquiring the sub-bucket content information and the data structure information corresponding to the target sub-bucket identification according to the target sub-bucket identification.
According to an aspect of the present application, there is provided an AB experiment shunting processing device, configured to a server, including:
the page response unit is used for receiving a page access request sent by the client and returning a page access response to the client, wherein the page access response comprises a target sub-bucket identifier, so that the client searches experiment configuration data cached in advance locally based on the target sub-bucket identifier to acquire the target experiment configuration data, and the target sub-bucket identifier is a target sub-bucket identifier of at least one AB experiment hit according to the user identifier;
and the data receiving unit is used for receiving the target experiment configuration data uploaded by the client.
In one implementation, the method further comprises:
the platform response unit is used for receiving the experiment platform access request sent by the server, wherein the server responds to the application starting operation and sends the experiment platform access request through a preset platform docking tool; and issuing the experimental configuration data to the platform docking tool through the experimental platform, so that the client caches the experimental configuration data locally.
In one implementation, the method further comprises:
the hit unit is configured to parse out a user identifier according to the page access request, and find out sub-bucket identification information corresponding to the user identifier in the experimental platform according to the user identifier; and packaging the barrel identification in the header of the page access response message.
In one implementation, the apparatus further comprises:
and the page rendering control unit is used for determining a page file according to the target barrel identification and providing the page file for the client so that the client performs page rendering based on the page file.
In one implementation manner, the page response unit is further configured to set a field that only carries the bucket identifier in the page access response, and set a value of the field that only carries the bucket identifier, so as to indicate whether the client needs to read and match the target experiment configuration data from the local cache according to the value.
In one implementation, the method further comprises:
the data configuration unit is used for configuring and storing the experimental configuration data on the experimental platform, wherein the experimental configuration data comprises barrel identification information, barrel content information and data structure information.
According to one aspect of the present application, there is provided a storage medium having a computer program stored therein, wherein the computer program is configured to perform the above-described AB experiment split-flow processing method at run-time.
According to one aspect of the present application there is provided an electronic device comprising a memory having stored therein a computer program and a processor arranged to run the computer program to perform the method of AB experimental diversion processing described above.
By means of the technical scheme, the AB experiment shunting processing method, device, medium and equipment provided by the application carry the target sub-bucket ID in the page access response returned by the server, so that the network transmission pressure is reduced, the experiment configuration data are cached locally at the client in advance, and when the experiment embedding point is triggered, the target experiment configuration data corresponding to the target sub-bucket ID are searched from the cache. Because the information quantity of the target barrel ID is obviously reduced compared with the information quantity of all experimental configuration data, the network transmission pressure can be effectively reduced; in addition, as the information quantity transmitted for each AB experiment is greatly reduced, more AB experiments can be supported at one time for the current page access operation, and the AB experiment efficiency is effectively improved. The foregoing description is only an overview of the technical solutions of the present application, and may be implemented according to the content of the specification in order to make the technical means of the present application more clearly understood, and in order to make the above-mentioned and other objects, features and advantages of the present application more clearly understood, the following detailed description of the present application will be given.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute an undue limitation to the application. In the drawings:
Fig. 1 shows an implementation scenario schematic diagram of an AB experiment shunting processing method provided in an embodiment of the present application;
fig. 2 shows a flow chart of an AB experiment shunting processing method provided in an embodiment of the present application;
fig. 3 shows a schematic diagram of an AB experiment shunting treatment method according to an embodiment of the present application;
FIG. 4 shows a flowchart of another AB experiment diversion processing method provided in an embodiment of the present application;
fig. 5 shows a schematic structural diagram of an AB experiment shunting treatment device according to an embodiment of the present application;
fig. 6 shows a schematic structural diagram of another AB experiment shunting treatment device according to an embodiment of the present application.
Detailed Description
In order to make the present application solution better understood by those skilled in the art, the following description will be made in detail and with reference to the accompanying drawings in the embodiments of the present application, it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application. It should be noted that, in the case of no conflict, the embodiments and features in the embodiments may be combined with each other.
The AB experiment uses data driving to advance the product iteration, verify the algorithm effect, obtain the output and other modes, generally uses different schemes such as products, pages, algorithms and the like as different experiment versions of the AB experiment, and divides a part of user traffic from the whole user traffic into the different experiment versions. On the basis, different experimental schemes are set for different experimental versions, and experimental index effects are observed and analyzed to obtain experimental conclusion.
In the AB experiment, user traffic is distributed to the AB experimental version to be analyzed by a splitting algorithm (splitting rule) to support subsequent data analysis. The splitting algorithm of the AB experiment needs to ensure that the allocated user traffic in each experimental version meets the expectations, and the allocated user traffic meets the consistency, uniformity and independence, so that the effectiveness of the AB experiment can be ensured.
Taking an APP product AB experiment as an example, when a client user enters an APP page, a server hits experimental configuration data according to a distribution algorithm, the server determines an experimental configuration scheme according to the experimental configuration data, wherein the experimental configuration scheme comprises the steps of issuing a page file corresponding to the configuration scheme, performing page rendering on the client, monitoring through experimental buried points, collecting user data and service data through a buried point data collecting tool when the user accesses the page and performs various operations, and reporting the user data and the service data to the server, so that the best version is finally evaluated to be formally adopted by combining service indexes.
The inventor of the application finds that in the research process, a server side generally makes and maintains an experimental configuration scheme through an experimental platform, when a user enters a page, server equipment of the server side can process a page access request, analyze a user identifier according to the page access request, and acquire experimental configuration data through the experimental platform by using the user identifier, wherein the experimental configuration data can be divided into two parts from data function division, one part is experimental content information and is mainly used for defining experimental content, and the experimental content information comprises values and meanings of various fields for defining experimental related data, and has larger general information quantity; the other part is experimental buried point information, and the buried point information of each experiment comprises a data structure with a top-bottom relationship, wherein the data structure consists of data items such as experiment name information, experiment ID, experiment content parameter information, sub-bucket name information, sub-bucket ID, page name information, page parameter information and the like. After the experimental configuration data is obtained from the experimental platform, the server equipment transmits the corresponding page file to the client according to the experimental content information of the experimental configuration data, so that the processing such as page rendering is performed. The inventor further found in the study that, each time the user performs the page access, the server device returns the experimental configuration data in the page access response, which leads to data transmission pressure, especially for the current page access request, often hits a plurality of experiments or even tens of experiments, and as mentioned before, the information amount of the experimental content information in the experimental configuration data is larger, especially in general, the experimental configuration data is carried by the header of the transmission protocol message, and the header often has limitation on the transmission data amount, thus leading to poor transmission efficiency and even network congestion or failure.
In addition, the inventor analyzes the experimental configuration data to find that the embedded point information of the experimental configuration data has a certain data structure, and can withdraw from all the data structures only by extracting the information of the lowest stage of the structure, specifically, on the basis of determining the sub-bucket ID, all the embedded point information can be known (the experimental ID and the sub-bucket ID can be understood as tree structure relation), so that from the angle analysis, the experimental configuration data can comprise sub-bucket ID information, sub-bucket content information and data structure information, when the sub-bucket ID information is known, the determination of the page file can be performed according to the sub-bucket ID and the page rendering can be performed according to the sub-bucket ID, and other experimental configuration data does not need to be returned to the client in the page access response.
Based on the analysis, the embodiment of the application provides an AB experiment shunting processing method, by pre-caching experiment configuration data in a client, the server equipment does not need to acquire and issue all experiment configuration data from an experiment platform at each time at a server side and send the experiment configuration data to the client, so that network overhead is saved, data transmission efficiency and success rate of page opening and processing are improved, and normal and efficient implementation of an AB experiment shunting algorithm is ensured.
Referring to fig. 1, a schematic diagram of an implementation scenario of an AB experiment shunting processing method provided in an embodiment of the present application is shown. The scenario shows a client and a server.
The server side comprises server equipment, an experiment platform and a bottom layer buried point tool. The server device may be understood as a server corresponding to an experimental object such as an APP or an applet, and is configured to process a request of a client. The experiment platform is used for initiating the AB experiment and making an experiment scheme for the AB experiment, for example, the AB experiment comprises experiment versions, the user flow ratio distributed by each experiment version, the experiment life cycle, the experiment index and the like, and in addition, the AB experiment platform can also determine the user flow distribution scheme for the AB experiment. The experimental configuration data is saved in an experimental platform. And the bottom layer embedded point tool is used for receiving relevant experimental configuration data reported by the client.
The client may be understood as a terminal (mobile phone, computer, etc.) used by a user, and the client shown by the client may be understood as an experimental object such as APP or applet installed or used in the user terminal. The client is further provided with a platform docking tool and an application embedded point tool. The platform docking tool is communicated with an experiment platform of the server, and experiment configuration data are obtained from the experiment platform and are cached locally at the client. The application burial point tool is started based on the triggering of the experiment burial point and is used for recording related data captured by the experiment burial point and reporting the related data to the bottom burial point tool of the server side, and particularly, the application burial point tool acquires the target sub-bucket ID from the page access response and acquires the experiment configuration data from the platform docking tool, so that the corresponding target experiment configuration data is matched according to the target sub-bucket ID.
Referring to fig. 2, a flowchart of an AB experiment splitting processing method provided in an embodiment of the present application is shown, and the flowchart is used for a client, and includes the following steps S201 to S205.
S201: and sending a page access request to the server.
When a user uses the APP at the terminal, a certain page is entered through clicking operation, namely, at the moment, the client responds to the clicking operation of the user and sends a page access request to the server, and the page access request carries a user identifier. The user identification may be user information such as user UID, nickname, gender, country, region, city, and may also include device information such as page type, browser parameters. In one example, the user parameter is a cookie id. The server equipment of the server side analyzes the user identification according to the page access request; and searching experimental configuration data hit by the user identification in the experimental platform according to the user identification.
As previously analyzed, in order to overcome the problem that the server side carries large data amount of experimental configuration data in each page access response to the client side, in the embodiment of the present application, it is proposed to buffer the experimental configuration data to the client side locally before the page access, so before the page access request is sent to the server side, the method may further include the following steps:
11: responding to an application starting operation, and requesting to access an experimental platform of a server through a preset platform docking tool;
12: receiving experimental configuration data issued by an experimental platform through a platform docking tool;
13: the experimental configuration data is cached locally.
For example, when the APP is started, the experiment platform of the server is accessed through a preset platform docking tool, and the experiment platform issues preset experiment configuration data to the platform docking tool, so that the platform docking tool stores the experiment configuration data in a cache. The platform docking tool can be realized through an SDK (software development kit), and similarly, the application point burying tool and the bottom layer point burying tool can also be realized through the SDK.
S202: and receiving a page access response returned by the server, wherein the page access response comprises a target sub-bucket ID, and the target sub-bucket ID is the target sub-bucket ID of at least one AB experiment hit according to the user identification.
As analyzed before, when a user enters a page, a server device at a server end processes the page access request, analyzes a user identifier according to the page access request, and obtains experimental configuration data by using the user identifier to an experimental platform. As described above, the experimental configuration data includes the sub-bucket ID information, the sub-bucket content information, and the data structure information, and the information amounts of the sub-bucket content information and the data structure information are large, so in the embodiment of the present application, all the experimental configuration data is not carried in the page access response returned to the client, but only the minimum unit identifier of the experimental configuration data, for example, the experimental sub-bucket ID. Compared with the original method for carrying all experimental configuration data, particularly under the fact that the experimental content information quantity is large, the embodiment of the application can effectively save the information quantity transmitted in the page access response, so that pressure is not brought to network transmission in the process of returning the sub-bucket ID through the page access response, and the success rate of page access and AB experiments can be improved.
In one implementation, in response to page access via the MTOP (Mobile Transport over Packet ) communication protocol, the total field size of the MTOP Header cannot exceed 1 kbyte, otherwise errors are reported, so in this case, the implementation of the AB experiment is severely limited by the way that all experimental configuration data is carried in the original way. By adopting the method of the embodiment of the application, the MTOP Header carries the bucket ID, and the problem caused by the limitation of the Header can be effectively avoided because the transmitted data volume is obviously reduced.
It can be understood that after receiving the page access response returned by the server, the following steps may be further performed at the client:
21: acquiring page files matched according to the barrel IDs;
22: and rendering the page according to the page file.
In one implementation, the experimental platform at the server hits the experimental configuration scheme according to the user identification through the splitting algorithm, and then determines the corresponding page file through the experimental configuration scheme. For example, M page files may be pre-stored at the server for the purpose of testing the same page AB. These pages may be referred to as a pages, B pages, or n pages. The client may obtain the page file from the server. The page rendering may employ client rendering or server rendering. In the client rendering mode, for example, the client sends a request to the server, obtains the page file data, generates the DOM through JS, inserts the HTML page, and finally renders the DOM to the user. In the server rendering mode, the server device completes the splicing of the HTML and then sends the HTML to the browser, the browser analyzes the HTML and loads a small amount of necessary JS, and the JS is executed to activate the page.
S203: based on the triggering of the experiment buried point, the experiment configuration data cached in advance locally is read, and the target experiment configuration data corresponding to the target barrel ID is matched according to the target barrel ID.
Buried points, also known as Event Tracking (Event Tracking), refer to the process of capturing, processing and transmitting for a particular user action or Event. Buried points are used to collect user behavior data, such as what buttons a user wants to know clicked on within the APP, what pages to see, what operations to do, etc., and can be implemented by buried points. In this embodiment of the present application, the experimental embedding point may be understood as a code implanted into a page or a button for performing an AB experiment, so as to monitor a user behavior and collect and report.
In one implementation, the method for reading the locally pre-cached experimental configuration data based on the triggering of the experimental buried point may specifically include the following steps:
31: triggering an experiment buried point in the page rendering process or the page access process;
32: based on the triggering of the experimental buried points, starting a preset application buried point tool to read experimental configuration data from a local cache.
In one implementation manner, according to the target bucket ID, the target experimental configuration data corresponding to the target bucket ID is matched, which may specifically include the following steps: and inquiring the sub-bucket content information and the data structure information corresponding to the target sub-bucket ID according to the target sub-bucket ID.
In one implementation, whether the scheme is adopted can be indicated by adding a field in the page access response, for example, a field for indicating that "only the bucket identification is carried" is added, when the field result is "true", the field indicates that only the target bucket ID is carried in the page access response, the target experimental configuration data needs to be read from the local cache and matched, and when the field result is "false", the field can be processed according to the prior art scheme.
S204: and uploading the target experiment configuration data to the server.
In one implementation, the application embedded point tool of the client is in butt joint with the bottom embedded point tool of the server, and the application embedded point tool stores the target experiment configuration data into the bottom embedded point tool for data analysis of the subsequent AB experiment.
Referring to fig. 3, a schematic diagram of an AB experiment splitting processing method provided by the embodiment of the present application is shown, in the schematic diagram, description is mainly made from an execution sequence, and each module is not divided according to a client and a server, where an application point burying tool, a platform docking tool, a cache and the like are located at the client, and a server device, an experiment platform, a bottom layer point burying tool and the like are located at the server.
S301: when the APP is started, the client accesses the experiment platform interface and requests to access the experiment platform of the server;
s302: the server side issues experimental configuration data to an experimental platform tool in an experimental platform access response (response);
s303: the experiment platform tool caches the experiment configuration data;
s304: the user enters a page, and the page requests a server equipment interface;
s305: the server equipment accesses the experiment platform and hits experiment configuration data according to the user identification;
s306: the server equipment returns a page access response (response), wherein the MTOP Header carries the target barrel ID;
s307: when the experimental embedded point is triggered based on page rendering, transmitting the target barrel ID in the MTOP Header into an application embedded point tool;
s308: acquiring experiment configuration data of a local cache in an application point burying tool, and decomposing a target barrel ID to match corresponding target experiment configuration data;
s309: and storing the target experiment configuration data into the bottom layer buried point tool by using the buried point tool.
Illustrated in a specific example.
The experimental configuration scheme assuming a user identification hit includes the following data:
the bucket ID is expressed as: "394332_1569540_1_2.394324_1569524_1_4".
The data structure is expressed as:
MTOP-x-jvs-ut-v2{ ' a2ogi.11834775': 394332_1569540_1_2.394324_1569524_1_4', ' a2ogi.b68407963': 39758_1578972_1_11.394324_1569524_1_4.369612_1502892_1_6 ', ' a2ogi.11834809': 394324_1569524_1_4.3975428_1578972_1_11 ' }, wherein the current page structure is represented by SPM using an SPM data structure, e=a2ogi.11834809 representing a bill of lading. The data structure defines the relation of the upper and lower levels (tree structure) of data items such as experiment names, experiment IDs, sub-bucket names, experiment IDs and the like, and the combination of the sub-bucket IDs and the data structure can be understood as buried point information.
Sub-bucket content information (sub-bucket data): the values and meanings of all fields of the experimental related data are defined, and the general information quantity of experimental content information is larger and is omitted here.
Since the total length of the MTOP Header is limited to 4k and the field size is limited to 1k, the problem due to Header limitation can be effectively solved by only carrying the target bucket ID in the MTOP Header without transmitting all experimental configuration data.
Therefore, according to the AB experiment shunting processing method provided by the embodiment of the application, the target barrel ID is carried in the page access response returned by the server, so that the network transmission pressure is reduced, the experiment configuration data is cached locally at the client in advance, and when the experiment embedding point is triggered, the target experiment configuration data corresponding to the target barrel ID is searched from the cache. Because the information quantity of the target barrel ID is obviously reduced compared with the information quantity of all experimental configuration data, the network transmission pressure can be effectively reduced; in addition, as the information quantity transmitted for each AB experiment is greatly reduced, more AB experiments can be supported at one time for the current page access operation, and the AB experiment efficiency is effectively improved.
Referring to fig. 4, a flowchart of another AB experiment splitting processing method provided in an embodiment of the present application is shown, where the method is used at a server, and includes the following steps:
s401: receiving a page access request sent by a client;
s402: returning a page access response to the client, wherein the page access response comprises a target sub-bucket identifier, so that the client searches experiment configuration data cached in advance locally based on the target sub-bucket identifier to acquire target experiment configuration data, and the target sub-bucket identifier is a target sub-bucket identifier of at least one AB experiment hit according to a user identifier;
s403: and receiving target experiment configuration data uploaded by the client.
In one implementation manner, before the receiving the page access request sent by the server, the method further includes:
s4001: receiving an experiment platform access request sent by a server, wherein the server responds to an application starting operation and sends the experiment platform access request through a preset platform docking tool;
s4002: and issuing the experimental configuration data to the platform docking tool through the experimental platform, so that the client caches the experimental configuration data locally.
In one implementation manner, after the receiving the page access request sent by the server, the method further includes:
s41, according to the page access request, analyzing out a user identification;
s42, according to the user identification, searching out sub-bucket identification information corresponding to the user identification from the experiment platform;
s43: and packaging the barrel identification in the header of the page access response message.
In one implementation, the method further comprises:
s44: determining a page file according to the target barrel mark;
s45: and providing the page file to the client so that the client performs page rendering based on the page file.
In one implementation, the method further comprises:
s46: and setting a field which only carries the barrel mark in the page access response, and setting the value of the field only carrying the barrel mark to indicate whether the client needs to read and match target experiment configuration data from a local cache according to the value.
In one implementation, the method further comprises:
s47: and configuring and storing the experimental configuration data on an experimental platform, wherein the experimental configuration data comprises barrel identification information, barrel content information and data structure information.
With respect to the corresponding embodiment of fig. 4, reference may be made to fig. 1-3 and the related description, which are not repeated here.
Referring to fig. 5, a schematic structural diagram of an AB experiment shunting processing device provided in an embodiment of the present application is shown, where the device is used for a client, and includes:
the page request unit 501 is configured to send a page access request to a server, and receive a page access response returned by the server, where the page access response includes a target bucket identifier, and the target bucket identifier is a target bucket identifier of at least one AB experiment hit according to a user identifier;
the data acquisition unit 502 is configured to read local pre-cached experimental configuration data based on triggering of an experimental buried point, and find out target experimental configuration data corresponding to a target sub-bucket identifier according to the target sub-bucket identifier;
and the data reporting unit 503 is configured to upload the target experiment configuration data to a server.
In one implementation, the method further comprises:
a platform interface unit 504, configured to request, in response to an application start operation, access to an experimental platform of the server through a preset platform docking tool; receiving the experimental configuration data issued by the experimental platform through the platform docking tool;
And the caching unit 505 caches the experiment configuration data locally.
In one implementation, the apparatus further comprises:
and the page rendering unit 506 is configured to obtain a page file matched according to the target bucket identifier, and perform page rendering according to the page file.
In one implementation manner, the data obtaining unit 502 is specifically configured to trigger an experiment buried point in a page rendering process or a page access process; and starting a preset application embedded point tool to read the experimental configuration data from a local cache based on the triggering of the experimental embedded point.
In one implementation, the method further comprises:
the field analysis execution unit 507 is configured to analyze the page access response, determine whether the page access response includes a field that indicates that only the bucket identifier is carried, and if so, identify a value of the field that only the bucket identifier is carried; and determining whether the data acquisition unit 502 needs to read and match the target experiment configuration data from the local cache according to the value of the field only carrying the bucket identifier.
In one implementation, the experimental configuration data comprises sub-bucket identification information, sub-bucket content information and data structure information;
The data acquisition unit 502 is specifically configured to: and inquiring the sub-bucket content information and the data structure information corresponding to the target sub-bucket identification according to the target sub-bucket identification.
Referring to fig. 6, a schematic structural diagram of another AB experiment shunting processing device provided in an embodiment of the present application is shown, where the device is used at a service end, and includes:
the page response unit 601 is configured to receive a page access request sent by a client, and return a page access response to the client, where the page access response includes a target bucket identifier, so that the client searches for locally pre-cached experimental configuration data based on the target bucket identifier, and obtains target experimental configuration data, where the target bucket identifier is a target bucket identifier of at least one AB experiment hit according to a user identifier;
and the data receiving unit 602 is configured to receive the target experiment configuration data uploaded by the client.
In one implementation, the method further comprises:
a platform response unit 603, configured to receive an experiment platform access request sent by a server, where the server responds to an application start operation and sends the experiment platform access request through a preset platform docking tool; and issuing the experimental configuration data to the platform docking tool through the experimental platform, so that the client caches the experimental configuration data locally.
In one implementation, the method further comprises:
a hit unit 604 is configured to parse out a user identifier according to the page access request, and find out sub-bucket identification information corresponding to the user identifier in the experiment platform according to the user identifier; and packaging the barrel identification in the header of the page access response message.
In one implementation, the apparatus further comprises:
the page rendering control unit 605 is configured to determine a page file according to the target bucket identifier, and provide the page file to the client, so that the client performs page rendering based on the page file.
In one implementation manner, the page response unit 601 is further configured to set a field that only carries the bucket identifier in the page access response, and set a value of the field that only carries the bucket identifier, so as to indicate whether the client needs to read and match the target experiment configuration data from the local cache according to the value.
In one implementation, the method further comprises:
the data configuration unit 606 is configured to configure and store the experimental configuration data on the experimental platform, where the experimental configuration data includes the sub-bucket identification information, the sub-bucket content information, and the data structure information.
Embodiments of the present application also provide a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the method embodiments described above when run.
Alternatively, in the present embodiment, the above-described storage medium may be configured to store a computer program for performing the steps of:
(1) Sending a page access request to a server;
(2) Receiving a page access response returned by a server, wherein the page access response comprises a target barrel mark, and the target barrel mark is a target barrel mark of at least one AB experiment hit according to a user mark;
(3) Based on triggering of an experiment buried point, reading experiment configuration data cached in advance locally, and inquiring target experiment configuration data corresponding to the target barrel identification according to the target barrel identification;
(4) And uploading the target experiment configuration data to a server.
Or alternatively, the process may be performed,
(1) Receiving a page access request sent by a client;
(2) Returning a page access response to the client, wherein the page access response comprises a target sub-bucket identifier, so that the client searches experiment configuration data cached in advance locally based on the target sub-bucket identifier to acquire target experiment configuration data, and the target sub-bucket identifier is a target sub-bucket identifier of at least one AB experiment hit according to a user identifier;
(3) And receiving target experiment configuration data uploaded by the client.
Alternatively, in the present embodiment, the storage medium may include, but is not limited to: a usb disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing a computer program.
Embodiments of the present application also provide an electronic device comprising a memory having stored therein a computer program and a processor arranged to run the computer program to perform the steps of any of the method embodiments described above.
(1) Sending a page access request to a server;
(2) Receiving a page access response returned by a server, wherein the page access response comprises a target barrel mark, and the target barrel mark is a target barrel mark of at least one AB experiment hit according to a user mark;
(3) Based on triggering of an experiment buried point, reading experiment configuration data cached in advance locally, and inquiring target experiment configuration data corresponding to the target barrel identification according to the target barrel identification;
(4) And uploading the target experiment configuration data to a server.
Or alternatively, the process may be performed,
(1) Receiving a page access request sent by a client;
(2) Returning a page access response to the client, wherein the page access response comprises a target sub-bucket identifier, so that the client searches experiment configuration data cached in advance locally based on the target sub-bucket identifier to acquire target experiment configuration data, and the target sub-bucket identifier is a target sub-bucket identifier of at least one AB experiment hit according to a user identifier;
(3) And receiving target experiment configuration data uploaded by the client.
Optionally, the electronic device may further include a transmission device and an input/output device, where the transmission device is connected to the processor, and the input/output device is connected to the processor.
Alternatively, in the present embodiment, the above-described processor may be configured to execute the following steps by a computer program:
alternatively, specific examples in this embodiment may refer to examples described in the foregoing embodiments and optional implementations, and this embodiment is not described herein.
The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.
In the foregoing embodiments of the present application, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed technology content may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, such as the division of the units, is merely a logical function division, and may be implemented in another manner, for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in whole or in part in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server device, a network device, or the like) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely a preferred embodiment of the present application and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present application and are intended to be comprehended within the scope of the present application.
Claims (10)
1. The AB experiment shunting processing method is characterized by being used for a client and comprising the following steps:
sending a page access request to a server;
receiving a page access response returned by a server, wherein the page access response comprises a target barrel mark, and the target barrel mark is a target barrel mark of at least one AB experiment hit according to a user mark;
based on triggering of an experiment buried point, reading experiment configuration data cached in advance locally, and inquiring target experiment configuration data corresponding to the target barrel identification according to the target barrel identification;
and uploading the target experiment configuration data to a server.
2. The method of claim 1, further comprising, prior to said sending the page access request to the server:
responding to an application starting operation, and requesting to access an experimental platform of a server through a preset platform docking tool;
receiving the experimental configuration data issued by the experimental platform through the platform docking tool;
and caching the experimental configuration data locally.
3. The method of claim 1, wherein after receiving the page access response returned by the server, the method further comprises:
And acquiring a page file matched according to the target barrel identification, and performing page rendering according to the page file.
4. A method according to claim 3, wherein the reading of the locally pre-cached experimental configuration data based on the triggering of the experimental burial point comprises:
triggering an experiment buried point in the page rendering process or the page access process;
and starting a preset application embedded point tool to read the experimental configuration data from a local cache based on the triggering of the experimental embedded point.
5. The method as recited in claim 1, further comprising:
analyzing the page access response, determining whether the page access response contains a field which indicates that only the sub-bucket identification is carried, and if so, identifying the value of the field which only carries the sub-bucket identification;
and determining whether the target experiment configuration data is required to be read from the local cache and matched according to the value of the field only carrying the barrel identification.
6. The AB experiment shunting processing method is characterized by being used for a server and comprising the following steps:
receiving a page access request sent by a client;
returning a page access response to the client, wherein the page access response comprises a target sub-bucket identifier, so that the client searches experiment configuration data cached in advance locally based on the target sub-bucket identifier to acquire target experiment configuration data, and the target sub-bucket identifier is a target sub-bucket identifier of at least one AB experiment hit according to a user identifier;
And receiving target experiment configuration data uploaded by the client.
7. AB experiment reposition of redundant personnel processing apparatus, its characterized in that is used for the customer end, includes:
the system comprises a page request unit, a server side and a server side, wherein the page request unit is used for sending a page access request to the server side and receiving a page access response returned by the server side, the page access response comprises a target sub-bucket identifier, and the target sub-bucket identifier is a target sub-bucket identifier of at least one AB experiment hit according to a user identifier;
the data acquisition unit is used for reading the experiment configuration data cached in advance locally based on the triggering of the experiment buried point, and searching the target experiment configuration data corresponding to the target barrel mark according to the target barrel mark;
and the data reporting unit is used for uploading the target experiment configuration data to a server.
8. AB experiment reposition of redundant personnel processing apparatus, its characterized in that is used for the server, includes:
the page response unit is used for receiving a page access request sent by the client and returning a page access response to the client, wherein the page access response comprises a target sub-bucket identifier, so that the client searches experiment configuration data cached in advance locally based on the target sub-bucket identifier to acquire the target experiment configuration data, and the target sub-bucket identifier is a target sub-bucket identifier of at least one AB experiment hit according to the user identifier;
And the data receiving unit is used for receiving the target experiment configuration data uploaded by the client.
9. A storage medium having a computer program stored therein, wherein the computer program is arranged to perform the method of any of claims 1 to 5 when run.
10. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to run the computer program to perform the method of any of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310355972.1A CN116383533A (en) | 2023-04-04 | 2023-04-04 | AB experiment shunting processing method, device, medium and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310355972.1A CN116383533A (en) | 2023-04-04 | 2023-04-04 | AB experiment shunting processing method, device, medium and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116383533A true CN116383533A (en) | 2023-07-04 |
Family
ID=86974643
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310355972.1A Pending CN116383533A (en) | 2023-04-04 | 2023-04-04 | AB experiment shunting processing method, device, medium and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116383533A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116627789A (en) * | 2023-07-19 | 2023-08-22 | 支付宝(杭州)信息技术有限公司 | Model detection method and device, electronic equipment and storage medium |
-
2023
- 2023-04-04 CN CN202310355972.1A patent/CN116383533A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116627789A (en) * | 2023-07-19 | 2023-08-22 | 支付宝(杭州)信息技术有限公司 | Model detection method and device, electronic equipment and storage medium |
| CN116627789B (en) * | 2023-07-19 | 2023-11-03 | 支付宝(杭州)信息技术有限公司 | Model detection method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107943951B (en) | Method and system for retrieving block chain service information | |
| CN111522922B (en) | Log information query method and device, storage medium and computer equipment | |
| CN102752288B (en) | Method and device for identifying network access action | |
| CN104067274A (en) | System and method for improving access to search results | |
| CN105049287A (en) | Log processing method and log processing devices | |
| CN108632219B (en) | Website vulnerability detection method, detection server, system and storage medium | |
| CN103618696B (en) | Method and server for processing cookie information | |
| CN113687974B (en) | Client log processing method and device and computer equipment | |
| CN103428042A (en) | Method and system for carrying out stress test on server | |
| CN109413017B (en) | Method and system for managing heterogeneous firewall | |
| CN116383533A (en) | AB experiment shunting processing method, device, medium and equipment | |
| CN112562820B (en) | Processing method and device for detecting record, electronic equipment and storage medium | |
| CN109669795A (en) | Crash info processing method and processing device | |
| CN102904774B (en) | Terminal, server and server performance test methods | |
| KR20180074774A (en) | How to identify malicious websites, devices and computer storage media | |
| CN107707607A (en) | Using access method, device, computer equipment and storage medium | |
| CN105159992A (en) | Method and device for detecting page contents and network behaviors of application program | |
| CN113449339A (en) | Log collection method, system, computer device and computer readable storage medium | |
| CN111159590A (en) | Serial connection method and device based on front-end and back-end service call links | |
| CN110941530A (en) | Method and device for acquiring monitoring data, computer equipment and storage medium | |
| CN102932421A (en) | Cloud back-up method and device | |
| CN109978114A (en) | Data processing method, device, server and storage medium | |
| CN113473166A (en) | Data storage system and method | |
| CN109815351B (en) | Information query method and related product | |
| CN116109322A (en) | Data acquisition method, data acquisition device, and computer-readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |