CN111245738A

CN111245738A - Flow dyeing method

Info

Publication number: CN111245738A
Application number: CN202010018573.2A
Authority: CN
Inventors: 蔺昊; 钟远君
Original assignee: Shenzhen Inveno Technology Co ltd
Current assignee: Shenzhen Inveno Technology Co ltd
Priority date: 2020-01-08
Filing date: 2020-01-08
Publication date: 2020-06-05
Anticipated expiration: 2040-01-08
Also published as: CN111245738B

Abstract

The flow dyeing method provided by the invention comprises the following steps: dividing the flow to be processed into a plurality of levels according to a preset layering rule; acquiring a characteristic value in flow to be processed; in each level, the flow to be treated is stained in combination with the characteristic values to obtain an experiment number. According to the flow dyeing method, the flow is layered in a multilayer mode, and can be shunted according to the characteristics of the users, so that the number of parallel experiments can be increased, and more detailed experiments can be performed on different types of users.

Description

Flow dyeing method

Technical Field

The invention belongs to the technical field of big data processing, and particularly relates to a flow dyeing method.

Background

The flow dyeing refers to setting a corresponding flow dyeing rule according to a flow protocol, dyeing and marking the specified flow, and carrying the mark in the whole calling chain. By coloring traffic, specific traffic can be tracked and routed.

The flow dyeing is widely applied to an AB TEST experiment, the AB TEST experiment is used for making two schemes for an optimization target, one part of users can use the scheme A, the other part of users can use the scheme B, then user data generated by the two schemes are collected, and the advantages and disadvantages of the two schemes are judged according to the user data, so that decision is made on selection of the schemes, and the conversion rate is improved. In the above process, flow dyeing is required, see fig. 1 and 2, i.e. different flows (or different users) are dyed to different experimental numbers. And finally, evaluating which experimental configuration has the best effect according to the effect and the index of different experimental configurations.

However, in the existing AB TEST experiment, it is required to ensure that two groups of experiments have sufficient flow, and if too many experiments are carried out at the same time, the flow of each group of experiments is reduced, so that the reliability of the experiment effect evaluation is reduced. And the prior art takes all the flow rates as one layer, thus reducing the number of experiments performed simultaneously. In addition, the prior art can only shunt according to some simple traffic characteristics (such as models and application versions), and cannot shunt according to the characteristics of users.

Disclosure of Invention

Aiming at the defects in the prior art, the invention provides a flow dyeing method, which is used for layering flow in a multilayer mode and can also be used for shunting according to user characteristics.

A flow dyeing method comprising the steps of:

dividing the flow to be processed into a plurality of levels according to a preset layering rule;

acquiring a characteristic value in flow to be processed;

in each level, the flow to be treated is stained in combination with the characteristic values to obtain an experiment number.

Preferably, the hierarchical rule specifically includes:

classifying the traffic to be processed into four levels: a UI layer, an algorithm layer, a content layer, and an advertisement layer.

Preferably, the obtaining of the experiment number specifically includes:

different experiment numbers of the four levels of output are obtained respectively.

Preferably, the hierarchical rule further classifies the pending traffic as an independent traffic layer.

Preferably, the obtaining of the experiment number specifically includes:

four identical experiment numbers of the independent flow layer outputs were obtained.

Preferably, the staining the flow to be processed in combination with the characteristic value in each level to obtain an experiment number specifically includes:

setting a plurality of dyeing characteristic values and corresponding experiment numbers thereof in each level;

when the characteristic value of the flow to be processed is obtained, the dyeing characteristic value which is consistent with the characteristic value in the level is identified, and the experiment number corresponding to the dyeing characteristic value is output as the dyeing result of the flow to be processed in the level.

Preferably, after dividing the traffic to be processed into a plurality of levels according to a preset hierarchical rule, the method further includes:

and carrying out Hash operation on each level, so that the flow to be processed can be distributed to different experiment numbers for dyeing according to the preset proportion dyeing configuration.

Preferably, the performing hash operation on each level so that the flow to be processed can be distributed to different experiment numbers according to a preset proportion dyeing rule to perform dyeing specifically includes:

setting a plurality of experiment numbers and a dyeing range containing a plurality of numerical values in each level;

assigning all values in the staining range to different experiment numbers in each level according to the proportion staining configuration to obtain a staining value for each experiment number;

when the level receives the flow to be processed, a random number is output by using a random algorithm;

calculating the random number to enable the calculated random number to fall into the dyeing range of the level;

and identifying the dyeing numerical value which is consistent with the calculated random number, and outputting an experiment number corresponding to the dyeing numerical value as a dyeing result of the flow to be processed at the level.

Preferably, in each level, assigning all values in the staining range to different experiment numbers according to the proportion staining configuration to obtain the staining values of each experiment number specifically comprises:

obtaining the dyeing proportion of each experiment number according to the proportion dyeing configuration;

the numerical values in the dyeing range are successively assigned to different experiment numbers in turn according to the dyeing ratios of the different experiment numbers to obtain the dyeing numerical value of each experiment number.

According to the technical scheme, the flow dyeing method provided by the invention has the advantages that the flow is layered in a multilayer mode, the flow can be shunted according to the characteristics of users, the number of parallel experiments can be increased, and more detailed experiments can be carried out on different types of users.

Drawings

In order to more clearly illustrate the detailed description of the invention or the technical solutions in the prior art, the drawings that are needed in the detailed description of the invention or the prior art will be briefly described below. Throughout the drawings, like elements or portions are generally identified by like reference numerals. In the drawings, elements or portions are not necessarily drawn to scale.

Fig. 1 is a data interaction diagram of a prior art staining method provided in the background art.

Fig. 2 is a flow chart of a prior art dyeing method provided in the background art.

Fig. 3 is a flowchart of a flow dyeing method according to an embodiment of the present invention.

Fig. 4 is a schematic view of a hierarchy of traffic hierarchies provided in an embodiment of the present invention.

Fig. 5 is a flowchart of a method for offloading according to user characteristics according to a second embodiment of the present invention.

Fig. 6 is a flowchart of a method for fractional dyeing according to a second embodiment of the present invention.

Fig. 7 is a data interaction diagram of an experiment number application provided in the third embodiment of the present invention.

FIG. 8 is an external module of the experiment number application provided by the third embodiment of the present invention

Detailed Description

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The following examples are only for illustrating the technical solutions of the present invention more clearly, and therefore are only examples, and the protection scope of the present invention is not limited thereby. It is to be noted that, unless otherwise specified, technical or scientific terms used herein shall have the ordinary meaning as understood by those skilled in the art to which the invention pertains.

It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

It is also to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the specification of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to a determination" or "in response to a detection". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".

The first embodiment is as follows:

a flow dyeing method, see fig. 3, comprising the following steps:

acquiring a characteristic value in flow to be processed;

Specifically, in order to solve the problems that experiments are increased and the flow is reduced easily due to single-layer dyeing in the prior art, the method divides the flow into a plurality of levels and uses a multi-layer mode to layer the flow. Meanwhile, dyeing can be combined with user characteristics, shunting is carried out according to the user characteristics, and the number of parallel experiments can be increased, so that more detailed experiments can be carried out on different types of users. The method can be implemented in a web page or SaaS.

Referring to fig. 4, the method can group traffic into four levels: a UI layer, an algorithm layer, a content layer, and an advertisement layer. Or to classify traffic as a separate traffic layer. When the flow is classified into four levels, the method outputs four different experiment numbers after staining the flow. When the flow is classified as an independent flow layer, the method outputs four identical experiment numbers after dyeing the flow. Wherein the staining procedure is the same for each level. The hierarchy of the traffic hierarchy is determined according to the service range of the user and the customer group.

Example two:

example two dyeing methods are provided on the basis of example one.

1. And (4) characteristic dyeing.

In each level, the staining the flow to be processed by combining the characteristic value to obtain an experiment number specifically comprises:

Specifically, the method may perform the coloring according to a feature value generated during the use process, such as a user feature (e.g., a user click, a user request), a region feature, and the like generated during the use process of the user. For example, in the algorithm layer, an experiment number 1001 corresponding to the staining feature value a (using algorithm a) and an experiment number 1002 corresponding to the staining feature value B (using algorithm B) are set. When the flow to be processed a is received, identifying that the characteristic value of the flow to be processed a is the use algorithm a, and then after the flow to be processed a is dyed by the algorithm layer, outputting an experiment number of 1001.

For example, an experiment number 2001 corresponding to the staining characteristic value a (using a red UI) and an experiment number 2002 corresponding to the staining characteristic value B (using a black UI) are set in the UI layer. Then, when the flow rate a to be processed is received, the characteristic value of the flow rate a to be processed is identified as using a black UI, and then the experiment number output after the flow rate a to be processed is dyed by the UI layer is 2001. It can be seen that the same flow to be treated can be dyed through a plurality of levels respectively.

Fig. 5 provides a method for splitting according to user characteristics, where when receiving a to-be-processed flow with a user identifier, user data is obtained by redis, and then the to-be-processed flow with the user data is calculated by user characteristic configuration to obtain the user characteristics. And finally, judging whether the user characteristics are matched with the dyeing characteristic values or not, and if so, outputting corresponding experiment numbers. In the matching process, the method is divided into two types of independent flow layer dyeing matching and other level dyeing matching.

2. And (4) performing percentage dyeing.

Referring to fig. 6, after dividing the traffic to be processed into a plurality of levels according to the preset hierarchical rule, the method further includes:

Specifically, the occupancy dyeing configuration is used to set the dyeing occupancy of each experiment number, for example, when the flow occupancy of experiment number a is set to 30%, the flow occupancy of experiment number B is set to 70%, that is, it means that 30% of the flow is allocated to experiment number a, and 70% of the flow is allocated to experiment number B. The user can set the dyeing proportion of each experiment number according to the self requirement, so that the method can shunt the flow according to the proportion dyeing configuration. According to the method, Hash operation is carried out on each level according to the proportion dyeing configuration, so that the flow is distributed to different experiment numbers according to the proportion dyeing configuration. When performing the hash operation, the independent traffic layer and other layers need to be separately operated.

a: setting a plurality of experiment numbers and a dyeing range containing a plurality of numerical values in each level;

b: assigning all values in the staining range to different experiment numbers in each level according to the proportion staining configuration to obtain a staining value for each experiment number; the method specifically comprises the following steps:

Specifically, the method provides a simple shunting method, by setting the dyeing range, assigning the numerical values in the dyeing range to different experiment numbers, and controlling the dyeing ratio of the experiment numbers by assigning different numbers of numerical values to different experiment numbers. For example: assuming that there are 1000 numbers in the staining range, 300 numbers are assigned to experiment A, and the remaining 700 numbers are assigned to experiment B, it is indicated that experiment A requires 30% flow and experiment B requires 70% flow. This embodiment also provides a more convenient assignment method, which assigns the values in the dyeing range to different experiment numbers sequentially and continuously according to the dyeing ratios of the different experiment numbers. For example, the first 300 of 1000 values in the staining range are assigned to experiment A, and the last 700 are assigned to experiment B, so that the values are sequentially assigned, easy to manage and not easy to confuse.

C: when the level receives the flow to be processed, a random number is output by using a random algorithm;

specifically, when the stochastic algorithm is sufficiently random, the effect of the final split is closer to the occupancy staining configuration. For example, the sha1 algorithm may be used to obtain a 32-bit 16-ary number, which is then left to 1000 to obtain a value of 0-999.

D: calculating the random number to enable the calculated random number to fall into the dyeing range of the level;

e: and identifying the dyeing numerical value which is consistent with the calculated random number, and outputting an experiment number corresponding to the dyeing numerical value as a dyeing result of the flow to be processed at the level.

Specifically, for example, assuming that when the flow to be processed is received, a sha1 algorithm is used to obtain a 16-bit number, and then the number is left for 1000 to obtain 246, and the experiment number corresponding to the number is experiment number a, then the experiment number output by the flow to be processed is experiment number a. If the balance of the random number is 1000 to obtain 850, and the experiment number corresponding to the numerical value is the experiment number B, the experiment number output by the flow to be processed is the experiment number B.

For the sake of brief description, the method provided by the embodiment of the present invention may refer to the corresponding contents in the foregoing method embodiments.

Example three:

example three the application of the experimental number is added on the basis of the above examples.

Fig. 7 illustrates, as an example, a news client, an application of the above-described staining results, including the following steps:

step 1: the user opens the news client for the first time.

Step 2: the news client requests information (with user characteristics such as user id, model, application version, etc.) from the information server.

And step 3: the information server requests a coloring service (with user characteristics).

And 4, step 4: the staining service returns the experiment number according to the user characteristics (4, this step has not been able to stain user characteristics due to initial use).

And 5: the information server determines the dyeing configuration used by the user according to the received experiment number (for example, using the recommendation algorithm a, or using the UI a for UI display), and then returns the corresponding content to the user.

Step 6: user data (such as click times and display times) generated after the user uses the application is reported to the log service, and then the log service processes the user data offline to obtain user day-level data (such as daily request, display, click times and times) and stores the user day-level data in redis.

And 7: and repeating the steps 1-3 when the user uses the application again. In the process 4, the dyeing service may perform more detailed dyeing (i.e., perform user characteristic dyeing) according to the user day-level data.

And 8: and (5) repeating the steps 1-6.

Fig. 8 provides an external connection module of a dyeing service, including:

an Apollo module. And (4) dyeing centers. The experiment number used to configure each layer and the corresponding staining configuration (e.g., UI layer has 2 experiment numbers, 1001, 1002, algorithm layer has 3 experiment numbers, 2001, 2002, 2003, where 1001 needs 30% flow, 1002 needs 70% flow, 2001 needs to be a new user, 2002 needs 10% flow, 2003 needs 90% flow).

And a Redis module for storing the user day level data obtained in FIG. 7.

Eureka module, registry. The dyeing service is registered in the service, and other services (such as information service) of the registry can know the address of the dyeing service, so that a request can be sent to the dyeing service.

The falcon-agent module is used for collecting various monitoring indexes of the dyeing service, such as the number of received requests, the consumed time of each request, the number of times of abnormal service occurrence and the like.

And the alarm module sends alarm information to related personnel when certain index collected by the falcon-agent module exceeds a threshold (for example, the time consumption exceeds 10 ms).

And the Grafana (monitoring UI) module displays all indexes collected by the falcon-agent module in real time through a graphical interface.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the present invention, and they should be construed as being included in the following claims and description.

Claims

1. A flow dyeing method, comprising the steps of:

acquiring a characteristic value in flow to be processed;

2. The flow-dyeing method according to claim 1,

the hierarchical rule specifically includes:

3. Flow dyeing process according to claim 2,

the obtaining of the experiment number specifically comprises:

4. Flow dyeing process according to claim 2,

the layering rules also categorize the pending flows as independent flow layers.

5. Flow dyeing process according to claim 4,

the obtaining of the experiment number specifically comprises:

6. The flow dyeing method according to any one of claims 1 to 5, wherein the dyeing the flow to be treated in combination with the characteristic value in each level to obtain an experiment number specifically comprises:

7. The flow dyeing method according to any one of claims 1 to 5, characterized in that after the flow to be treated is divided into a plurality of levels according to a preset layering rule, the method further comprises:

8. The flow dyeing method according to claim 7, wherein the performing hash operation on each level so that the flow to be processed can be branched into different experiment numbers according to a preset proportion dyeing rule to perform dyeing specifically comprises:

9. The flow-rate dyeing method according to claim 8, wherein the assigning, in each level, all the values in the dyeing range to different experimental numbers according to the proportion dyeing configuration to obtain the dyeing value of each experimental number specifically comprises: