CN112148973B - Data processing method and device for information push - Google Patents

Data processing method and device for information push Download PDF

Info

Publication number
CN112148973B
CN112148973B CN202010921701.4A CN202010921701A CN112148973B CN 112148973 B CN112148973 B CN 112148973B CN 202010921701 A CN202010921701 A CN 202010921701A CN 112148973 B CN112148973 B CN 112148973B
Authority
CN
China
Prior art keywords
information
user
prediction model
determining
target user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010921701.4A
Other languages
Chinese (zh)
Other versions
CN112148973A (en
Inventor
李思苇
万拓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jingdong Technology Holding Co Ltd
Original Assignee
Jingdong Technology Holding Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jingdong Technology Holding Co Ltd filed Critical Jingdong Technology Holding Co Ltd
Priority to CN202010921701.4A priority Critical patent/CN112148973B/en
Publication of CN112148973A publication Critical patent/CN112148973A/en
Application granted granted Critical
Publication of CN112148973B publication Critical patent/CN112148973B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9535Search customisation based on user profiles and personalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The application relates to a data processing method and a device for information push, wherein the method comprises the following steps: determining a target user needing information pushing by using a determining module; the method comprises the steps that a record acquisition module is used for acquiring first history record information corresponding to a target user; determining the user type and the user characteristics of the target user according to the first historical record information by using a user information determining module; the application information acquisition module acquires candidate push information corresponding to the target user according to the user characteristics; a model acquisition module is used for acquiring a pre-trained prediction model corresponding to the user type; and obtaining a predicted recommendation result corresponding to the candidate push information by using a result obtaining module. According to the application, all characteristic information of the user can be combined during recommendation, rather than sorting according to one attribute, a more accurate recommendation result can be obtained, and the information click rate and the order forming rate of the pushing user are improved; meanwhile, grouping and sorting are not needed, so that the recommendation efficiency can be greatly improved, and the cost of manpower and material resources is saved.

Description

Data processing method and device for information push
Technical Field
The application relates to the technical field of Internet, in particular to a data processing method and device for information push.
Background
The activity recommendation, namely, carrying out activity display related to products or contents on different resource positions aiming at a user browsing the APP, so as to achieve a certain operation conversion purpose.
At present, the activity display needs to be configured and adjusted by special operators, after the users are classified into different types according to priority, the users are manually matched and displayed during the activity, and different activities are displayed to different layered users. When large-scale activities are required to be held, more users are involved, the complexity of products and the diversity of activities are involved, and a great deal of manpower and time are required to discuss the activity display priority and the front crowd layering. When the activity is replaced and iterated, the process is carried out again, so that the efficiency of the activity display iteration is low and the display error is easy to cause because of logic loopholes.
In addition, although the campaign recommendation has some more mature development on the advertisement exposure flow and some APP advertisement positions, in the non-advertisement field and some scenes needing to combine the finance and financial properties of users, the campaign recommendation related technologies mostly adopt front-end user grouping, are shown at the front end of the resource positions after being manually ordered according to the priority, and have not yet appeared the technology for automatically recommending the campaign.
As can be seen from the above, in the prior art, the front-end users are used for sorting in groups, which requires a lot of manpower, so that the efficiency is low; in addition, users are grouped only through different attribute information of the users, so that all characteristics of the users cannot be considered in the advertisement pushing mode, the pertinence is low, and the problem of low click rate of advertisements is further caused.
Aiming at a plurality of technical problems existing in the related art, no effective solution is provided at present.
Disclosure of Invention
In order to solve the technical problems or at least partially solve the technical problems, the application provides a data processing method and device for information push.
In a first aspect, an embodiment of the present application provides a data processing method for information push, including:
determining a target user needing information pushing by using a determining module;
the application record acquisition module acquires first history record information corresponding to the target user;
determining the user type and the user characteristics of the target user according to the first historical record information by using a user information determining module;
an application information acquisition module acquires candidate push information corresponding to the target user according to the user characteristics;
A model acquisition module is used for acquiring a pre-trained prediction model corresponding to the user type;
the application result acquisition module is used for acquiring an expected recommendation result corresponding to the candidate push information according to the user characteristics, the push information characteristics and the prediction model; the push information features are used for characterizing the candidate push information.
Optionally, as with the data processing methods previously described,
the application information acquisition module acquires candidate push information corresponding to the target user according to the user characteristics, and the application information acquisition module comprises:
matching by using a matching unit according to the user characteristics to obtain an associated user which meets the preset matching degree with the target user;
acquiring second history information corresponding to the associated user by using a first acquisition unit;
and determining the candidate push information interacted with the associated user according to the second historical record information by using a candidate push information determining unit.
Optionally, in the foregoing data processing method, the determining, by using a user information determining module, a user type of the target user according to the first history information includes:
a second obtaining unit is used for obtaining the feature type and the activity degree of the target user according to the first history information; the feature types include: demographic attributes, financial characteristics, click-to-transaction conversion characteristics, historical browsing characteristics, real-time search characteristics, real-time browsing characteristics; the liveness includes: transaction frequency, click frequency;
Analyzing the feature types and the liveness by using an analysis unit through a preset user type division strategy to obtain a life cycle corresponding to the target user;
and determining the user type according to the life cycle corresponding to the target user by using a user type determining unit.
Optionally, in the foregoing data processing method, the candidate push information includes at least two, and the method further includes:
calculating the estimated recommendation result corresponding to each candidate push information according to a preset calculation strategy by using a score acquisition module to obtain a recommendation score corresponding to each candidate push information; the predicted recommended results include: click probability, transaction probability, and predicted transaction amount;
pushing the N candidate push information with the highest recommendation scores to the target user by using a push module; wherein N is an integer not less than 1.
Optionally, in the foregoing data processing method, the pushing module is configured to push the N candidate push messages with the highest recommendation scores to the target user, where the pushing module includes:
uploading target pushing information to an activity pool corresponding to the target user by using a resource bit display unit; the target user obtains target pushing information in the activity pool through a user side; the N candidate push information with the highest recommendation score comprises the target push information;
And respectively determining keyword information in each target push information by using a transmitting unit, writing the keyword information into a corresponding position in a preset template, generating push information corresponding to each target push information, and transmitting the push information to the target user.
Optionally, in the foregoing data processing method, the application result obtaining module obtains an estimated recommendation result of the candidate push information according to the user feature, the push information feature and the prediction model, including:
a target prediction model determining unit is used for configuring the prediction model according to the push information characteristics to obtain a target prediction model corresponding to the candidate push information;
and the application result determining unit inputs the user characteristics into the target prediction model to predict, so as to obtain the predicted recommendation result.
Optionally, the data processing method as described above further includes:
a third acquisition unit is used for acquiring third historical record information corresponding to the candidate user according to a preset training data acquisition strategy; the third history information is not used for training the prediction model, the candidate user comprises the target user, and the candidate user is consistent with the user type of the target user;
Randomly dividing the third historical record information by using a dividing unit to obtain training set supplementary data and verification set supplementary data;
and training the prediction model through the training set supplementary data by using a first updating unit, and obtaining a first updated prediction model when the trained prediction model is verified through the verification set supplementary data and the preset performance requirement is met.
Optionally, the data processing method as described above further includes:
acquiring newly uploaded information to be processed by using a fourth acquisition unit;
determining the characteristics to be processed in the information to be processed by using a characteristics to be processed determining unit;
determining new features which are not in the prediction model in the features to be processed by using a new feature determination unit;
and applying a second updating unit to perform feature addition on the prediction model according to the new features to obtain a second updated prediction model.
Optionally, a data processing method as described above further includes
In a second aspect, an embodiment of the present application provides a data processing apparatus for information push, including:
the determining module is used for determining a target user needing information pushing;
the record acquisition module is used for acquiring first history record information corresponding to the target user;
The user information determining module is used for determining the user type and the user characteristics of the target user according to the first historical record information;
the information acquisition module is used for acquiring candidate push information corresponding to the target user according to the user characteristics;
the model acquisition module is used for acquiring a pre-trained prediction model corresponding to the user type;
the result acquisition module is used for acquiring a predicted recommendation result corresponding to the candidate push information according to the user characteristics, the push information characteristics and the prediction model; the push information features are used for characterizing the candidate push information.
Optionally, in the foregoing data processing apparatus, the information acquisition module includes:
the matching unit is used for matching according to the user characteristics to obtain an associated user which meets the preset matching degree with the target user;
the first acquisition unit is used for acquiring second history record information corresponding to the associated user;
and the candidate push information determining unit is used for determining the candidate push information interacted with the associated user according to the second historical record information.
Optionally, the data processing apparatus as described above, the user information determining module includes:
The second acquisition unit is used for acquiring the feature type and the liveness of the target user according to the first history information; the feature types include: demographic attributes, financial characteristics, click-to-transaction conversion characteristics, historical browsing characteristics, real-time search characteristics, real-time browsing characteristics; the liveness includes: transaction frequency, click frequency;
the analysis unit is used for analyzing the characteristic types and the liveness through a preset user type division strategy to obtain a life cycle corresponding to the target user;
and the user type determining unit is used for determining the user type according to the life cycle corresponding to the target user.
Optionally, in the foregoing data processing apparatus, the candidate push information includes at least two candidate push information, and further includes:
the score acquisition module is used for calculating the expected recommendation result corresponding to each candidate push information according to a preset calculation strategy to obtain a recommendation score corresponding to each candidate push information; the predicted recommended results include: click probability, transaction probability, and predicted transaction amount;
the pushing module is used for pushing the N candidate pushing information with the highest recommendation scores to the target user; wherein N is an integer not less than 1.
Optionally, the data processing apparatus as described above, the result obtaining module includes:
the target prediction model determining unit is used for configuring the prediction model according to the push information characteristics to obtain a target prediction model corresponding to the candidate push information;
and the result determining unit is used for inputting the user characteristics into the target prediction model for prediction to obtain the predicted recommendation result.
Optionally, the data processing apparatus as described above further includes: a first model updating module; the first model updating module includes:
the third acquisition unit is used for acquiring third historical record information corresponding to the candidate user according to a preset training data acquisition strategy; the third history information is not used for training the prediction model, the candidate user comprises the target user, and the candidate user is consistent with the user type of the target user;
the dividing unit is used for randomly dividing the third historical record information to obtain training set supplementary data and verification set supplementary data;
the first updating unit is used for training the prediction model through the training set supplementary data, and obtaining a first updated prediction model when the trained prediction model is verified through the verification set supplementary data and the preset performance requirement is met.
Optionally, the data processing apparatus as described above further includes: a second model updating module; the second model updating module includes:
a fourth obtaining unit, configured to obtain newly uploaded information to be processed;
the to-be-processed feature determining unit is used for determining to-be-processed features in the to-be-processed information;
a new feature determining unit configured to determine new features that are not present in the prediction model among the features to be processed;
and the second updating unit is used for adding the characteristics of the prediction model according to the new characteristics to obtain a second updated prediction model.
In a third aspect, an embodiment of the present application provides an electronic device, including: the device comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
the memory is used for storing a computer program;
the processor is configured to implement a processing method according to any one of the preceding claims when executing the computer program.
In a fourth aspect, an embodiment of the present application provides a non-transitory computer readable storage medium, wherein the non-transitory computer readable storage medium stores computer instructions that cause the computer to perform the processing method according to any one of the preceding claims.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages: all characteristic information of the users can be combined during recommendation, rather than sorting according to one attribute, more accurate recommendation results can be obtained, and the information click rate and the order forming rate of the pushing users are improved; meanwhile, grouping and sorting are not needed, so that the recommendation efficiency can be greatly improved, and the cost of manpower and material resources is saved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the application or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, and it will be obvious to a person skilled in the art that other drawings can be obtained from these drawings without inventive effort.
Fig. 1 is a flow chart of a data processing method for information push according to an embodiment of the present application;
fig. 2 is a schematic flow chart of a data processing method for information push according to another embodiment of the present application;
Fig. 3 is a schematic flow chart of a data processing method for information push according to another embodiment of the present application;
FIG. 4 is a block diagram of a data processing device for pushing information according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Fig. 1 is a data processing method for information push provided in an embodiment of the present application, including steps S1 to S6 as follows:
s1, determining a target user needing information pushing by using a determining module.
Specifically, the target user is a user who needs to push information by the method in this embodiment, and in general, since the features of each user are different, the information to be pushed is different.
S2, acquiring first history information corresponding to the target user by using a record acquisition module.
Specifically, the operation performed by the user on the pushed information may be recorded and stored in a data table corresponding to the user according to a time sequence, and the history information of each user may include, but is not limited to: login time, offline time, browse records, order records, and so forth. The first history information is history information corresponding to the target user, and thus the first history information may also include, but is not limited to, the above-described information.
And S3, determining the user type and the user characteristics of the target user according to the first historical record information by using a user information determining module.
Specifically, after the first history information is obtained, the first history information may be analyzed and categorized according to the following user characteristics, including but not limited to: for related page view records of different types of activities, user liveness (e.g. number of log-in per day), mall transaction attributes (e.g. average transaction amount per unit), basic attributes (e.g. region, gender, age, etc.), probability of clicking on a pushed activity (e.g. average number of activity information pushed followed by one click), click-to-transaction conversion probability (e.g. number of activity information clicked followed by one transaction). And, the feature image of the target user can be obtained through the user features, and then the user type of the target user can be determined through the feature image.
And S4, acquiring candidate push information corresponding to the target user according to the user characteristics by using an information acquisition module.
Specifically, after the user characteristics are obtained, candidate push information corresponding to the target user can be obtained through user characteristic matching.
The candidate push information is push information obtained through preliminary screening; and in general, the candidate push information needs to be further filtered to obtain at least one push information with the highest probability of being clicked or made into a list.
S5, a model acquisition module is used for acquiring a pre-trained prediction model corresponding to the user type.
That is, each user type has a predictive model corresponding thereto; each prediction model can be classified and stored in a database according to different user types in advance, and a mapping table between the prediction model and the user types is established so as to quickly retrieve the required model from the corresponding storage position.
S6, obtaining a predicted recommendation result corresponding to the candidate push information according to the user characteristics, the push information characteristics and the prediction model by using a result obtaining module; the push information feature is used to characterize the candidate push information.
Specifically, after each newly generated push information to be pushed to the user is obtained, the push information can be normalized and labeled to obtain a normalized push information database. When the push information is active, one of the alternative ways of tagging may be to tag according to the type of activity, the point of interest of the activity, and the goal of the activity, where the type of activity may include: 1. small vault, 2. Collection, 3. Bank, 4. East, 5. Fund, 6. Gold, 7. Comprehensive, 8. Others; the activity benefit points may include: 1. the method comprises the steps of ticket collecting/filling, 2, buying gifts (red package/additional information/Beijing paste), 3, putting aside, 4, paying lottery, 5, ranking, 6, explosion products, 7, function recommendation and the like; the activity targets may include: 1. the method comprises the following steps of first trading of the large financial resource, 2, new drawing of the large financial resource thousand-yuan, 3, new drawing of the large financial resource thousand-yuan, 4, 5, recall of the large financial resource thousand-yuan, 6, first trading of the class, 7, GMV lifting of the thousand-yuan user (Gross Merchandise Volume, total amount of the transaction (within a certain period of time)), 8, GMV lifting of the ten thousand-yuan user, 9, GMV lifting of the high net value user, 10, active lifting of the user and the like. The first transaction may be a first order transaction of a user who has registered with the corresponding platform but has not performed a transaction; the pulling can be that the user is not registered in the corresponding platform and is attracted to register or access; recall may be when a user has not accessed or transacted a platform for a preset period of time (e.g., one year, etc.), attracting him to access or transact again.
Wherein, the prediction model generally comprises all the features, but one piece of push information does not necessarily comprise all the features, so that the push information features can influence the coefficients of different factors in the prediction model; by way of example: when an activity has no benefit point and is only used for carrying out pre-consumption education on a user, and telling the user what to do with the product, the type features and the size features of the related benefit point are missing, and during training, missing values of the related features in the prediction model can be filled according to actual conditions, wherein the missing values can be filled into null values, modes, median and the like according to specific conditions.
Therefore, according to the scheme in the embodiment, different prediction models are matched for different types of users, so that the prediction model with the best prediction effect can be matched for the different types of users, and further the push information which is the most in line with the characteristics of the users can be finally screened out, and the purposes of improving the information click rate, single rate and the like of each user are achieved.
As shown in fig. 2, in some embodiments, as the foregoing data processing method, step S4 uses an information obtaining module to obtain candidate push information corresponding to the target user according to the user characteristics, including steps S41 to S43 as follows:
And S41, using a matching unit, and matching according to the user characteristics to obtain the associated user which meets the preset matching degree with the target user.
Specifically, the user features may include all features related to the target user, and after determining the features included in each user through the history information, a mapping relationship between the user and the features may be established and stored in the user information database.
One of the alternative implementations of this step may be: inquiring in a user information database through various characteristics included in the user characteristics to obtain an associated user meeting a preset matching degree with a target user; the preset matching degree may be: similarity among all the features respectively included by each user; by way of example: when user I includes the features: A. b, C, D, E; when user II includes the features: A. b, C, D, F; the similarity between user I and user II is 80%; when the preset matching degree is 70%, the user II is the associated user of the user I.
S42, acquiring second history information corresponding to the associated user by using the first acquisition unit.
Specifically, the second history information is history information corresponding to the associated user; as history information of each user is recorded under normal conditions; therefore, the corresponding second history information can be obtained by inquiring and then reading the identification information of the associated user from the preset database.
And S43, utilizing a candidate push information determining unit to determine candidate push information interacted with the associated user according to the second historical record information.
Specifically, according to the second history record information, history push information that the associated user clicks or forms a list can be obtained; and taking the historical push information as candidate push information. Further, because the life cycle of the user can be changed, although the current user characteristics meet the requirements, the feature similarity between the associated user and the target user still meets the requirements at the moment of pushing a certain historical pushing information cannot be guaranteed; therefore, the pushing time of the candidate pushing information can be limited, so that the candidate pushing information capable of improving the click rate or the single rate is screened.
In some embodiments, as the foregoing data processing method, step S3 uses the user information determining module to determine the user type of the target user according to the first history information, including steps S31 to S33 as follows:
s31, acquiring the feature type and the activity degree of the target user according to the first history information by using a second acquisition unit; the feature types include: demographic attributes, financial characteristics, click-to-transaction conversion characteristics, historical browsing characteristics, real-time search characteristics, real-time browsing characteristics; the liveness includes: transaction frequency, click frequency.
Specifically, the feature types included in the history information may be selectively recorded according to the needs of the actual application or generated according to the recorded data. By way of example: information such as age, gender, occupation, income and the like in the population attribute can be selected through recorded requirements; the financial characteristics can be generated by processing the recorded information according to the amount of the bill, the financial type (such as insurance, gold, etc.), etc.
Liveness may be derived from the total number of clicks or transactions between segments between units. To characterize the activity of the target user in each time period.
S32, analyzing the feature types and the liveness by using an analysis unit through a preset user type division strategy to obtain a life cycle corresponding to the target user.
S33, determining the user type according to the life cycle corresponding to the target user by using a user type determining unit.
Specifically, the lifecycle is used to characterize the state of a target user in a particular platform. By way of example: for users in lead-in period, the main aim is to promote the first transaction of the users on the platform due to insufficient transaction behavior; for a user in a growth period, the platform has certain use viscosity, and the main targets are to promote the transaction times and activity; users for maturity are then encouraged to grow GMV and stay with AUM (Asset Under Management, asset management scale). Thus, the obtained feature types may include: transaction amount, first transaction information, etc.; liveness may include: transaction frequency.
Alternatively, the user types of the target user may be divided according to the lifecycle of the target user. The partitioning may be followed by the derivation for different user types: and different targets such as user account opening, platform first transaction, transaction amount improvement, user liveness and the like are promoted.
As shown in fig. 3, in some embodiments, as the foregoing data processing method, the candidate push information includes at least two candidate push information, and further includes steps S7 to S8 as follows:
s7, calculating the estimated recommendation result corresponding to each candidate push information by using a score acquisition module according to a preset calculation strategy to obtain a recommendation score corresponding to each candidate push information; the predicted recommended results include: click probability, transaction probability, and predicted transaction amount.
That is, a plurality of models may be included in the preset model for predicting the click probability, the transaction probability, the predicted transaction amount, and the like, respectively. And the number and the types of the models can be selected according to the required results. Alternatively, the importance ranking of a feature can be obtained by a tree splitting algorithm according to the optimal splitting feature, the optimal splitting point of the feature and the splitting times of the feature, and the importance ranking is shown in the following formula:
Wherein,for the traditional linear regression model formula->The relation between any two features can be considered on the basis of a regression model; v i Is with feature x i Corresponding auxiliary vector, v j Is with feature x j A corresponding auxiliary vector; x is x i x j Representing characteristic x i And x j When x is a combination of i And x j All non-zero, combined characteristic x i x j Meaning it is only significant; n represents the feature dimension, and the result y (x) obtained by the method can solve the regression problem and the classification problem, and avoid the influence of data sparseness on model learning.
After each predicted result is obtained, a recommendation score for pushing each candidate push information to the target user is obtained by processing (such as normalization, weighting and the like) each result; in general, the higher the recommendation score, the higher the probability that the candidate push information is clicked or transacted successfully.
S8, pushing N candidate push information with highest recommendation scores to a target user by using a push module; wherein N is an integer not less than 1.
Specifically, the number N may be selected according to the number of information to be pushed. The method comprises the following steps: and screening the highest N candidate push information in all the candidate push information according to the recommendation scores, and pushing the N candidate push information to the target user.
For example, when the push information is activity information, a CTR (Click Through Rate) estimation method may be used to input the user characteristics of the target user into a prediction model for prediction, so as to obtain the user characteristics corresponding to each activity information: the activity exposes to click probabilities, click to transaction conversion probabilities. Multiplying the normalized activity exposure-to-click probability and the click-to-transaction conversion probability corresponding to each activity information to obtain a final recommendation score for each activity information, and further, adjusting coefficients of the activity exposure-to-click probability and the click-to-transaction conversion probability according to specific operation requirements to realize combination of a model and an operation idea, and finally automatically displaying the optimal recommendation combination on a target user side.
Common algorithms for CTR prediction include LR (Logistic Regression, logistic regression analysis), FM (Factorization Machines, factorizer; a matrix-decomposition-based machine learning algorithm proposed by Steffen render, which is most characterized by good learning ability for sparse data, GBDT (Gradient Boosting Decision Tree gradient-lifted iterative decision tree), and the like.
Optionally, in the optional data processing method, step S8 uses a pushing module to push N candidate pushing information with highest recommendation scores to the target user, including:
uploading target pushing information to an activity pool corresponding to a target user by using a resource bit display unit; so that the target user can acquire target push information in the activity pool through the user side; the N candidate push information with the highest recommendation score comprises target push information;
and respectively determining keyword information in each target push information by using a transmitting unit, writing the keyword information into a corresponding position in a preset template, generating push information corresponding to each target push information, and transmitting the push information to a target user. Specifically, when the push information is the activity information, the purpose of pushing the activity information to the target user may be accomplished as follows:
1. resource bit recommendation display: and uploading target pushing information to an activity pool by related personnel through a resource bit display unit, outputting optimal activities based on a single user dimension at two layouts of a main target and an auxiliary target through a CTR model and other conversion models, and displaying at a user side.
2. Offline Push/short message recommendation display: a sending unit is used for obtaining keyword information in each target push information according to a preset keyword extraction strategy, determining the corresponding relation between each keyword information and the position in the preset template, and finally writing the keyword information into the preset template; and the optimal activities can be output through a unified recommendation model and linked with an interface template Push or template short message, so that thousands of people and thousands of faces of documents and connection display are performed for activity recommendation. The text and the links in the short message are unified standardized configuration when the operation uploading activities are carried out, the conversion model is called at the bottom layer, the text and the links matched with the activities are called in real time according to the activities with the highest scores corresponding to different users, the short message or push is reached, and the probability of successful conversion of the activities is further improved.
In some embodiments, as in the foregoing data processing method, the step S6 uses a result obtaining module to obtain, according to the user characteristics, the push information characteristics and the prediction model, a predicted recommended result corresponding to the candidate push information, and includes the following steps S61 and S62:
and S61, configuring the prediction model according to the push information characteristics by using a target prediction model determining unit to obtain a target prediction model corresponding to the candidate push information.
And S62, inputting the user characteristics into a target prediction model by using a result determining unit to predict, and obtaining a predicted recommendation result.
Specifically, all feature items are preset in a prediction model in general, and it can be determined that features a included in the push information features configure each feature in the prediction model to obtain a target prediction model corresponding to the candidate push information. And then the predicted recommendation result of the pushing information for the target user can be predicted according to the configured target prediction model.
For example, the missing values of the relevant features in the prediction model can be filled according to actual conditions, wherein the missing values can be filled into null values, modes, median and the like according to specific conditions; after filling, a target prediction model corresponding to the candidate push information can be obtained; furthermore, before prediction, integral feature processing, such as data normalization, data cleaning, and model prediction after filling in missing values, can be performed.
After the target prediction model is obtained, the user features can be input into the target prediction model to obtain a final predicted recommendation result.
In some embodiments, the data processing method as described above further includes the following steps P1 to P3:
Step P1, a third acquisition unit is used for acquiring third historical record information corresponding to a candidate user according to a preset training data acquisition strategy; the third history information is not used to train the predictive model, the candidate user includes the target user, and the candidate user is consistent with the user type of the target user.
Specifically, the training data acquisition strategy is used for acquiring history information which is not used for training the model; and is noted as third history information for distinguishing from the history information in the foregoing embodiment.
The training data acquisition strategy may be: determining the last training time of the prediction model, and acquiring third historical record information acquired after the training time; or, each training is performed at intervals of a preset time period, and then third history information in a latest preset time period in time is acquired; other acquisition methods are also possible, and are not listed here.
And step P2, randomly dividing the third historical record information by using a dividing unit to obtain training set supplementary data and verification set supplementary data.
And step P3, training the prediction model through the training set supplementary data by using a first updating unit, and obtaining a first updated prediction model when the trained prediction model is verified through the verification set supplementary data and the preset performance requirement is met.
That is, the third history information is divided into training set supplemental data and verification set supplemental data.
After training the prediction model through the training set supplementary data, verifying the trained prediction model through the verification set supplementary data, and obtaining a first updated prediction model when the performance requirement is met; the first updated prediction model is a prediction model trained by real-time latest training data.
Therefore, the model can be automatically optimized by adopting the method in the embodiment, and the accuracy of prediction can be continuously improved while prediction is performed.
In some embodiments, the data processing method as described above further includes steps Q1 to Q4 as follows:
step Q1. uses the fourth obtaining unit to obtain the newly uploaded information to be processed.
In particular, the information to be processed is newly uploaded and can be used for information pushed to the user. Further, the information to be processed may be stored in the corresponding database according to the time sequence after being uploaded, so the manner of obtaining the information to be processed may be: and reading the information to be processed from the database according to a certain period (day/week/month).
And step Q2, determining the characteristics to be processed in the information to be processed by using a characteristics to be processed determining unit.
Specifically, the feature to be processed is a feature corresponding to the information to be processed; one alternative implementation may be: when the information to be processed is generated, the contents and the fields in the information are normalized, so that the purpose of obtaining the corresponding characteristics of the contents by analyzing the contents and the fields is achieved.
Step Q3. uses a new feature determination unit to determine new features of the features to be processed that are not present in the predictive model.
Specifically, all the features in the prediction model can be obtained, and then the features to be processed are traversed one by one among the features included in the model to obtain new features.
And step Q4, using a second updating unit to perform feature addition on the prediction model according to the new features to obtain a second updated prediction model.
Specifically, after the new feature is obtained, the prediction model needs to be correspondingly modified according to the new feature, so that the prediction model can be used for predicting push information including the new feature. One method of feature addition may be: a feature factor corresponding to the new feature is obtained and then added to the predictive model.
Further, after the second updated prediction model is obtained, the result of the prediction of the model may be monitored for a certain period (day/week/month) to timely feed back and adjust the recommended result.
By the method in the embodiment, the prediction model can be optimized and adjusted regularly according to the updating of the push information, so that the problem that good prediction performance cannot be achieved for some push information comprising new features is avoided, and the prediction model can guarantee that accurate prediction results are given out from time to time.
As shown in fig. 4, according to another aspect of the present application, an embodiment of the present application further provides a data processing apparatus for information push, including:
the determining module 1 is used for determining a target user needing information pushing;
the record acquisition module 2 is used for acquiring first history record information corresponding to the target user;
a user information determining module 3, configured to determine a user type and a user characteristic of the target user according to the first history information;
the information acquisition module 4 is used for acquiring candidate push information corresponding to the target user according to the user characteristics;
the model acquisition module 5 is used for acquiring a pre-trained prediction model corresponding to the user type;
the result acquisition module 6 is used for acquiring a predicted recommendation result corresponding to the candidate push information according to the user characteristics, the push information characteristics and the prediction model; the push information feature is used to characterize the candidate push information.
In particular, the specific process of implementing the functions of each module in the apparatus of the embodiment of the present application may be referred to the related description in the method embodiment, which is not repeated herein.
According to another embodiment of the present application, there is also provided an electronic apparatus including: as shown in fig. 5, the electronic device may include: the device comprises a processor 1501, a communication interface 1502, a memory 1503 and a communication bus 1504, wherein the processor 1501, the communication interface 1502 and the memory 1503 are in communication with each other through the communication bus 1504.
A memory 1503 for storing a computer program;
the processor 1501 is configured to execute the program stored in the memory 1503, thereby implementing the steps of the method embodiment described above.
The buses mentioned for the above electronic devices may be peripheral component interconnect standard (Peripheral Component Interconnect, PCI) buses or extended industry standard architecture (Extended Industry Standard Architecture, EISA) buses, etc. The bus may be classified as an address bus, a data bus, a control bus, etc. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.
The communication interface is used for communication between the electronic device and other devices.
The Memory may include random access Memory (Random Access Memory, RAM) or may include Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.
The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but also Digital signal processors (Digital SignalProcessing, DSP), application specific integrated circuits (APPlication Specific Integrated Circuit, ASIC), field-programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
The embodiment of the application also provides a non-transitory computer readable storage medium, which stores computer instructions that cause a computer to execute the steps of the method embodiment.
It should be noted that in this document, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing is only a specific embodiment of the invention to enable those skilled in the art to understand or practice the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. The data processing method for information push is characterized by comprising the following steps:
determining a target user needing information pushing by using a determining module;
the application record acquisition module acquires first history record information corresponding to the target user;
a user information determining module is used for determining the user type and the user characteristics of the target user according to the first historical record information;
an application information acquisition module acquires candidate push information corresponding to the target user according to the user characteristics;
a model acquisition module is used for acquiring a pre-trained prediction model corresponding to the user type;
The application result acquisition module is used for acquiring an expected recommendation result corresponding to the candidate push information according to the user characteristics, the push information characteristics and the prediction model; the push information features are used for characterizing the candidate push information.
2. The data processing method according to claim 1, wherein the application information obtaining module obtains candidate push information corresponding to the target user according to the user characteristics, including:
a matching unit is used for matching according to the user characteristics to obtain an associated user which meets the preset matching degree with the target user;
acquiring second history information corresponding to the associated user by using a first acquisition unit;
and determining the candidate push information interacted with the associated user according to the second historical record information by using a candidate push information determining unit.
3. The data processing method according to claim 1, wherein the employing user information determining module determines the user type of the target user based on the first history information, comprising:
a second obtaining unit is used for obtaining the feature type and the activity degree of the target user according to the first history information; the feature types include: demographic attributes, financial characteristics, click-to-transaction conversion characteristics, historical browsing characteristics, real-time search characteristics, real-time browsing characteristics; the liveness includes: transaction frequency, click frequency;
Analyzing the feature types and the liveness by using an analysis unit through a preset user type division strategy to obtain a life cycle corresponding to the target user;
and determining the user type according to the life cycle corresponding to the target user by using a user type determining unit.
4. The data processing method according to claim 1, wherein the candidate push information includes at least two, the method further comprising:
calculating the estimated recommendation result corresponding to each candidate push information according to a preset calculation strategy by using a score acquisition module to obtain a recommendation score corresponding to each candidate push information; the predicted recommended results include: click probability, transaction probability, and predicted transaction amount;
pushing the N candidate push information with the highest recommendation scores to the target user by using a push module; wherein N is an integer not less than 1.
5. The data processing method according to claim 1, wherein the application result obtaining module obtains an estimated recommendation result with the candidate push information according to the user feature, the push information feature, and the prediction model, and includes:
A target prediction model determining unit is used for configuring the prediction model according to the push information characteristics to obtain a target prediction model corresponding to the candidate push information;
and the application result determining unit inputs the user characteristics into the target prediction model to predict, so as to obtain the predicted recommendation result.
6. The data processing method according to claim 1, characterized by further comprising:
a third acquisition unit is used for acquiring third historical record information corresponding to the candidate user according to a preset training data acquisition strategy; the third history information is not used for training the prediction model, the candidate user comprises the target user, and the candidate user is consistent with the user type of the target user;
randomly dividing the third historical record information by using a dividing unit to obtain training set supplementary data and verification set supplementary data;
and training the prediction model through the training set supplementary data by using a first updating unit, and obtaining a first updated prediction model when the trained prediction model is verified through the verification set supplementary data and the preset performance requirement is met.
7. The data processing method according to claim 1, characterized by further comprising:
acquiring newly uploaded information to be processed by using a fourth acquisition unit;
determining the characteristics to be processed in the information to be processed by using a characteristics to be processed determining unit;
determining new features which are not in the prediction model in the features to be processed by using a new feature determination unit;
and applying a second updating unit to perform feature addition on the prediction model according to the new features to obtain a second updated prediction model.
8. A data processing apparatus for information push, comprising:
the determining module is used for determining a target user needing information pushing;
the record acquisition module is used for acquiring first history record information corresponding to the target user;
the user information determining module is used for determining the user type and the user characteristics of the target user according to the first historical record information;
the information acquisition module is used for acquiring candidate push information corresponding to the target user according to the user characteristics;
the model acquisition module is used for acquiring a pre-trained prediction model corresponding to the user type;
The result acquisition module is used for acquiring a predicted recommendation result corresponding to the candidate push information according to the user characteristics, the push information characteristics and the prediction model; the push information features are used for characterizing the candidate push information.
9. An electronic device, comprising: the device comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
the memory is used for storing a computer program;
the processor being adapted to implement the processing method of any of claims 1-7 when executing the computer program.
10. A non-transitory computer readable storage medium storing computer instructions that cause the computer to perform the processing method of any of claims 1-7.
CN202010921701.4A 2020-09-04 2020-09-04 Data processing method and device for information push Active CN112148973B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010921701.4A CN112148973B (en) 2020-09-04 2020-09-04 Data processing method and device for information push

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010921701.4A CN112148973B (en) 2020-09-04 2020-09-04 Data processing method and device for information push

Publications (2)

Publication Number Publication Date
CN112148973A CN112148973A (en) 2020-12-29
CN112148973B true CN112148973B (en) 2023-11-07

Family

ID=73889780

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010921701.4A Active CN112148973B (en) 2020-09-04 2020-09-04 Data processing method and device for information push

Country Status (1)

Country Link
CN (1) CN112148973B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113763112A (en) * 2021-02-25 2021-12-07 北京沃东天骏信息技术有限公司 Information pushing method and device
CN115225702B (en) * 2021-04-19 2023-08-08 北京达佳互联信息技术有限公司 Information pushing method and device, electronic equipment and storage medium
CN114285896B (en) * 2021-12-28 2023-07-07 建信金融科技有限责任公司 Information pushing method, device, equipment, storage medium and program product
CN115082132B (en) * 2022-08-18 2022-11-04 网娱互动科技(北京)股份有限公司 Promotion method and system based on point reward

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109460513A (en) * 2018-10-31 2019-03-12 北京字节跳动网络技术有限公司 Method and apparatus for generating clicking rate prediction model
CN109460512A (en) * 2018-10-25 2019-03-12 腾讯科技(北京)有限公司 Recommendation information processing method, device, equipment and storage medium
CN110263242A (en) * 2019-01-04 2019-09-20 腾讯科技(深圳)有限公司 Content recommendation method, device, computer readable storage medium and computer equipment
CN110276446A (en) * 2019-06-26 2019-09-24 北京百度网讯科技有限公司 The method and apparatus of model training and selection recommendation information
CN110399550A (en) * 2019-03-14 2019-11-01 腾讯科技(深圳)有限公司 A kind of information recommendation method and device
CN110400169A (en) * 2019-07-02 2019-11-01 阿里巴巴集团控股有限公司 A kind of information-pushing method, device and equipment
CN110413877A (en) * 2019-07-02 2019-11-05 阿里巴巴集团控股有限公司 A kind of resource recommendation method, device and electronic equipment

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9465876B2 (en) * 2013-09-09 2016-10-11 International Business Machines Corporation Managing content available for content prediction
US10713716B2 (en) * 2017-08-04 2020-07-14 Airbnb, Inc. Verification model using neural networks
CN108921221B (en) * 2018-07-04 2022-11-18 腾讯科技(深圳)有限公司 User feature generation method, device, equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109460512A (en) * 2018-10-25 2019-03-12 腾讯科技(北京)有限公司 Recommendation information processing method, device, equipment and storage medium
CN109460513A (en) * 2018-10-31 2019-03-12 北京字节跳动网络技术有限公司 Method and apparatus for generating clicking rate prediction model
CN110263242A (en) * 2019-01-04 2019-09-20 腾讯科技(深圳)有限公司 Content recommendation method, device, computer readable storage medium and computer equipment
CN110399550A (en) * 2019-03-14 2019-11-01 腾讯科技(深圳)有限公司 A kind of information recommendation method and device
CN110276446A (en) * 2019-06-26 2019-09-24 北京百度网讯科技有限公司 The method and apparatus of model training and selection recommendation information
CN110400169A (en) * 2019-07-02 2019-11-01 阿里巴巴集团控股有限公司 A kind of information-pushing method, device and equipment
CN110413877A (en) * 2019-07-02 2019-11-05 阿里巴巴集团控股有限公司 A kind of resource recommendation method, device and electronic equipment

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于序列特征的点击率预测模型;朱思涵;浦剑;;华东师范大学学报(自然科学版)(第04期);全文 *

Also Published As

Publication number Publication date
CN112148973A (en) 2020-12-29

Similar Documents

Publication Publication Date Title
CN112148973B (en) Data processing method and device for information push
US10991048B1 (en) Curated sentiment analysis in multi-layer, machine learning-based forecasting model using customized, commodity-specific neural networks
CN105989004B (en) Information delivery preprocessing method and device
CN109783730A (en) Products Show method, apparatus, computer equipment and storage medium
WO2017190610A1 (en) Target user orientation method and device, and computer storage medium
US20190213194A1 (en) System and method for information recommendation
WO2019072128A1 (en) Object identification method and system therefor
CN111095330B (en) Machine learning method and system for predicting online user interactions
JP2019215778A (en) Service provision system, advertisement related service provision system, user side facility and user side advertisement facility
CN111429214B (en) Transaction data-based buyer and seller matching method and device
CN111582932A (en) Inter-scene information pushing method and device, computer equipment and storage medium
CN111429161B (en) Feature extraction method, feature extraction device, storage medium and electronic equipment
CN111680213B (en) Information recommendation method, data processing method and device
CN113424207B (en) System and method for efficiently training understandable models
CN110209944B (en) Stock analyst recommendation method and device, computer equipment and storage medium
Boz et al. Reassessment and monitoring of loan applications with machine learning
CN112084376A (en) Map knowledge based recommendation method and system and electronic device
CN113822390B (en) User portrait construction method and device, electronic equipment and storage medium
Ram et al. Fake reviews detection using supervised machine learning
WO2018002664A1 (en) Data aggregation and performance assessment
CN110162714A (en) Content delivery method, calculates equipment and computer readable storage medium at device
Gulhane et al. TensorFlow Based Website Click through Rate (CTR) Prediction Using Heat maps
Sharma Identifying Factors Contributing to Lead Conversion Using Machine Learning to Gain Business Insights
US11887168B2 (en) Predicting the value of an asset using machine-learning techniques
US20230306279A1 (en) Guided feedback loop for automated information categorization

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Room 221, 2 / F, block C, 18 Kechuang 11th Street, Daxing District, Beijing, 100176

Applicant after: Jingdong Technology Holding Co.,Ltd.

Address before: Room 221, 2 / F, block C, 18 Kechuang 11th Street, Daxing District, Beijing, 100176

Applicant before: Jingdong Digital Technology Holding Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant