CN109284236B - Data preheating method and device, electronic equipment and storage medium - Google Patents
Data preheating method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN109284236B CN109284236B CN201810989079.3A CN201810989079A CN109284236B CN 109284236 B CN109284236 B CN 109284236B CN 201810989079 A CN201810989079 A CN 201810989079A CN 109284236 B CN109284236 B CN 109284236B
- Authority
- CN
- China
- Prior art keywords
- preheating
- candidate
- preset
- merchant
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0877—Cache access modes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
Abstract
The embodiment of the application discloses a data preheating method, belongs to the technical field of computers, and solves the problem that the utilization rate of cache resources is low during data preheating in the prior art. The method comprises the following steps: the method comprises the steps of obtaining a current business object accessed by a target merchant, determining a candidate preheating business object corresponding to the current business object, determining the heat value of the target merchant to the candidate preheating business object according to any one or more of the obtained self information of the target merchant, the peer information of the target merchant and the preset attribute information of the candidate preheating business object, and executing data preheating operation on the data of the candidate preheating business object of which the heat value meets the preset condition. According to the data preheating method and device, data preheating is started through real-time behaviors according to merchants, and timeliness of the data is improved. The heat value of each business object by the merchant is determined by combining the data of the merchant, and the business object with the heat value meeting the preset condition is selected for data preheating, so that cache can be saved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a data preheating method and apparatus, an electronic device, and a storage medium.
Background
Data preheating means that data is cached in a memory from a disk in advance, and when the data is used, the purpose of improving the data reading speed is achieved. Such as services that provide merchant information, the merchant data is typically persisted in a database (disk storage) and when a request is received that is invoked via an interface, the merchant information is retrieved from the database and the results are returned. In order to improve the performance of the request interface, the merchant information is often cached in the memory, and when the request is made, the merchant information can be directly read from the memory, so that the overall reading performance is improved. The existing data preheating scheme is based on pre-calculation and caching of full data. Namely, acquiring the full amount of service data through timing task scheduling; and then carrying out distributed computation, and carrying out distributed storage on the computed data.
The inventor finds that the data preheating method in the prior art has at least the following defects through research on the prior art: the preheating of the full data can cause the waste of cache resources, the utilization rate of the cache resources is low, the data is loaded at regular time, the timeliness of the data is limited by the loading period, and the problem of poor data timeliness possibly exists.
Disclosure of Invention
The application provides a data preheating method which is beneficial to improving the efficiency of data preheating and the timeliness of preheating data.
In a first aspect, an embodiment of the present application provides a data preheating method, including:
acquiring a current business object accessed by a target merchant;
determining a candidate preheating service object corresponding to the current service object;
determining the heat value of the candidate preheating service object by the target merchant according to any one or more of the acquired self information of the target merchant, the peer information of the target merchant and the preset attribute information of the candidate preheating service object;
and executing data preheating operation on the data of the candidate preheating service object with the heat value meeting the preset condition.
In a second aspect, an embodiment of the present application provides a data pre-heating apparatus, including:
the current business object determining module is used for acquiring a current business object accessed by a target merchant;
a candidate preheating service object determining module, configured to determine a candidate preheating service object corresponding to the current service object;
the candidate preheating business object heat value determining module is used for determining the heat value of the candidate preheating business object by the target merchant according to any one or more of the acquired self information of the target merchant, the peer information of the target merchant and the preset attribute information of the candidate preheating business object;
and the data preheating module is used for executing data preheating operation on the data of the candidate preheating service object with the heat value meeting the preset condition.
In a third aspect, an embodiment of the present application further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the data preheating method according to the embodiment of the present application when executing the computer program.
In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, performs the steps of the data preheating method described in the present application.
The data preheating method provided by the embodiment of the application determines the candidate preheating business object corresponding to the current business object by acquiring the current business object accessed by the target merchant, and determines the heat value of the candidate preheating business object by the target merchant according to the acquired self information of the target merchant, the peer information of the target merchant and any one or more of the preset attribute information of the candidate preheating business object, wherein the heat value meets the preset condition, the data preheating operation is performed, so that the problems that the waste of cache resources, the low utilization rate of the cache resources and the poor data timeliness in the prior art are caused by the full-data preheating are solved. According to the data preheating method, data preheating is started according to the real-time behavior of the merchant, and timeliness of data preheating is improved. The heat value of each candidate preheating business object by the merchant is determined by combining the associated data of the merchant, and the candidate preheating business object with the heat value meeting the preset condition is selected for data preheating, so that cache can be saved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a flow chart of a data preheating method according to a first embodiment of the present application;
FIG. 2 is a flow chart of a data preheating method according to the second embodiment of the present application;
FIG. 3 is a schematic structural diagram of a data preheating device according to a third embodiment of the present application;
fig. 4 is a second schematic structural diagram of a data preheating device according to a third embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Example one
As shown in fig. 1, a data preheating method provided in an embodiment of the present application includes: step 110 to step 140.
The business object in the embodiment of the present application may be understood as a functional module of an application.
In some embodiments of the present application, by monitoring and analyzing the address of the business object of the target merchant accessing the service end in real time, the current business object accessed by the target merchant can be determined. For example, when the target merchant operates at the client, an http request is sent to the server in real time, and information such as a merchant identifier of the target merchant, a request path of the merchant, request operation content of the merchant, and the like is carried in http request information. And after receiving the http request, the server analyzes the http request, feeds back the http request to the client according to the corresponding data of the request path, and stores the merchant identification, the request path, the request operation content and other information as an access log of the merchant. Then, the current business object accessed by the target merchant, such as a to-be-replied comment function module of the comment application, is determined by analyzing the access log of the merchant.
For the function module of the application, each function module is used as an entrance, and at least one other function module can be accessed. For example, for hotel services, a sales query module, an information configuration module and a comment processing module can be accessed through a home page. That is, each business object would correspond to at least one candidate warm-up business object. The candidate preheat business object is typically another business object accessible through the business object. In the embodiment of the application, which candidate preheating business objects correspond to a certain business object is predefined according to business requirements.
In some embodiments of the present application, the self information of the target merchant, the fellow merchant of the target merchant, and other merchants at least includes basic information and business information of the merchants. Wherein the basic information is stored in the merchant system, further comprising: the business object is a business object, and the business object is a business object of a business. The service information is stored in the service system, and further comprises: sales information, evaluation information, product information, and the like, for example: including the order sales, the evaluation score, the number of reviews to be returned, and the number of products that can be sold.
In some embodiments of the application, specific types of merchant information to be considered when calculating a heat value of a merchant for a certain business object and a calculation weight corresponding to certain specific information may be set in advance according to business requirements; then, according to the type of the merchant information which needs to be considered for calculating the heat value of a certain business object, corresponding information is obtained from a corresponding data service system, and the heat value of the business object is calculated according to the obtained information and the corresponding weight.
In some embodiments of the present application, a threshold of the heat value may be preset, where the preset condition is: and the hot value of the target merchant to the candidate preheating business object is greater than the hot value threshold. That is, the heat value of each candidate preheating service object by the target merchant is respectively determined, and if the heat value of a certain candidate preheating service object a by the target merchant is greater than the heat value threshold, the target merchant is considered to have a high possibility of entering the candidate preheating service object a, and the data of the candidate preheating service object a is loaded into a cache in advance to preheat the data.
The data preheating method provided by the embodiment of the application determines the candidate preheating business object corresponding to the current business object by acquiring the current business object accessed by the target merchant, and determines the heat value of the candidate preheating business object by the target merchant according to the acquired self information of the target merchant, the peer information of the target merchant and any one or more of the preset attribute information of the candidate preheating business object, wherein the heat value meets the preset condition, the data preheating operation is performed, so that the problems that the waste of cache resources, the low utilization rate of the cache resources and the poor data timeliness in the prior art are caused by the full-data preheating are solved. According to the data preheating method provided by the embodiment of the application, the candidate preheating business objects are determined according to the real-time behaviors of the merchants, the heat value of each candidate preheating business object by the merchants is further determined by combining the associated data of the merchants, and the candidate preheating business objects with the heat values meeting the preset conditions are selected for data preheating, so that cache can be saved. Meanwhile, data preheating is carried out in real time according to the operation of the target merchant, so that the timeliness of the data can be improved.
Example two
An embodiment of the present application provides a data preheating method, as shown in fig. 2, the method includes: step 210 to step 270.
The business object in the embodiment of the present application may be understood as a functional module of an application.
In some embodiments of the present application, by monitoring and analyzing the address of the business object of the target merchant accessing the service end in real time, the current business object accessed by the target merchant can be determined. In some embodiments of the present application, the step of obtaining the current business object accessed by the target merchant includes: acquiring current accessed real-time operation information of a target merchant by analyzing an access log of the target merchant; and determining the request service object in the real-time operation information as the current service object.
Taking the distributed service cluster as an example, when a target merchant operates at a client, the target merchant interacts with a server through an http protocol at a network layer, and a network is routed to specific services through a Nginx. Nginx records all requested information and sends the information to kafka unified gather summary. Because nginnx belongs to the cluster service, the log data of all clusters needs to be reported to kafka, so that the integrity of the processing information can be ensured. Because kafka has the characteristic of high throughput, the access log of the merchant can be collected in real time. In some embodiments of the present application, the log reported by Nginx to kafka may include: the merchant identification of the target merchant, the accessed service address, the request operation content, the access time, the access path and the like. After all the access logs are collected by the kafka, the collected access logs are pushed to a storm of a real-time data processing service in a unified mode, and the storm analyzes a large amount of data.
Storm converts each log data into json format, acquires preset key information in each log, and then accurately identifies real-time operation information of a target merchant through a regular expression. For example, after each piece of log data is converted into json format data, the following key information may be extracted: merchant account information (including merchant identification), the currently requested service address, the currently requested service module, and parameters. In a large amount of log data, how to analyze and match required module data is a key. In some embodiments of the present invention, each module has a fixed request address, and the request module information in each log can be analyzed through a regular expression.
After the current request module information of the target merchant is obtained through analysis, the target merchant and the current request module information of the target merchant are pushed to a message system through a message mechanism, and the current real-time operation information of the target merchant is monitored through the message system by each system service. Each system service can take the monitored request business object in the real-time operation information of the target merchant as the current business object.
Acquiring current accessed real-time operation information of a target merchant by analyzing an access log of the target merchant; and when the request service object in the real-time operation information is determined as the current service object, the timeliness of data acquisition can be improved, and the timeliness of data preheating is improved only in one step.
For a specific implementation of determining the candidate preheating service object corresponding to the current service object, refer to embodiment one, which is not described in detail in this embodiment. In this embodiment, assuming that the current service object is a comment module, the determining of the candidate preheating service object corresponding to the current service object includes: the system comprises a comment replying module, a merchant information editing module and a home page.
Each calculation factor corresponds to a preset information item included in any one of the basic information of the target merchant, the business information of the target merchant, the heat value of the candidate preheating business object by the same-party merchant of the target merchant, and the attribute information of the candidate preheating business object. For example, a certain calculation factor corresponds to a store level in the basic information of the merchant.
In some embodiments of the present application, the self information includes basic information and business information, the peer information is the basic information and the business information of the peer merchant of the target merchant, and the basic information further includes a historically calculated heat value for a business object; the step of determining the heat value of the candidate preheating service object by the target merchant according to any one or more of the acquired self information of the target merchant, the peer information of the target merchant and the preset attribute information of the candidate preheating service object includes: acquiring a list of calculation factors required for calculating the heat value of the candidate preheating service object and weights corresponding to the calculation factors, wherein each calculation factor corresponds to a preset information item included in any one of basic information of the target merchant, service information of the target merchant, the heat value of a peer merchant of the target merchant to the candidate preheating service object and attribute information of the candidate preheating service object; determining a normalized numerical value for each of said calculation factors; and carrying out weighted summation on the normalized numerical value of each calculation factor in the list of calculation factors by using corresponding weight to obtain the heat value of the candidate preheating business object by the target merchant.
In some embodiments of the present application, the basic information includes: a merchant identification, and any one or more of the following items of information: information items such as a trade circle identifier, a city identifier, a store type, a store grade and the like; the service information includes: information items such as order information, sales information, comment information, and the like; the attribute information of the business object includes: whether the core module is in operation or not, whether the operation is promoted or not, whether a new hand is used for guiding or not and the like.
In some embodiments of the present application, each business object is preset with a configuration list of calculation factors (i.e., categories of information that need to be relied on) required for calculating a heat value of a merchant for the business object, and the configuration list further includes a weight corresponding to each calculation factor. In specific implementation in the embodiment of the present application, a list of calculation factors required for calculating the heat value of the candidate preheating service object and weights corresponding to the calculation factors are obtained through preset service object configuration information. For example, a list of calculation factors for calculating the heat value of the candidate preheat service object, i.e., the reply comment module, may be obtained through configuration information, where the list includes 5 calculation factors, and the 5 calculation factors respectively correspond to: the system comprises a store level, a heat value of a peer merchant to a reply comment module, a number of comments to be replied, a number of bad comments and attribute information, wherein the weight corresponding to the store level is 0.05, the weight corresponding to the heat value of the peer merchant to the reply comment module is 0.2, the weight corresponding to the number of comments to be replied is 0.4, the weight corresponding to the number of bad comments is 0,2, and the weight corresponding to the attribute information is 0.8. During specific implementation, the configuration information of the service object can be set according to the service requirement, and then, the service object is preheated according to the heat value obtained by the calculation of the configured calculation factor and the weight, so that the requirement of service popularization is met, and the retention rate and the conversion rate of each service module are improved.
And 240, acquiring the numerical value of the preset information item corresponding to the calculation factor.
After determining the calculation factors and the weights required for calculating the heat value of each candidate preheating service object, further determining the normalized value of each calculation factor. In some embodiments of the present application, the step of determining a normalized numerical value for each of the calculation factors comprises: acquiring a numerical value of a preset information item corresponding to the calculation factor; and carrying out normalization processing on the numerical value of the preset information item to obtain a normalized numerical value corresponding to the calculation factor. Wherein obtaining the value of the preset information item corresponding to the calculation factor further comprises: when the preset information item corresponding to the calculation factor is the basic information of the target merchant, determining the numerical value of the preset information item corresponding to the calculation factor through a preset merchant system; when the preset information item corresponding to the calculation factor is the business information of the target merchant, determining the numerical value of the preset information item corresponding to the calculation factor through a preset business system; when the preset information item corresponding to the calculation factor is the heat value of the peer merchant of the target merchant to the candidate preheating service object, acquiring the numerical value of the preset information item corresponding to the calculation factor through a preset merchant system; when the preset information item corresponding to the calculation factor is the attribute information of the candidate preheating service object, determining the numerical value of the preset information item corresponding to the calculation factor through preset configuration information; and carrying out normalization processing on the numerical value of the preset information item to obtain a normalized numerical value corresponding to the calculation factor.
In some embodiments of the present application, pre-heating the business object with the candidate includes: for example, when calculating the popularity value of the target merchant a to the reply comment module, assuming that the calculation factor required for calculating the popularity value of the reply comment module corresponds to: the method comprises the steps of obtaining information corresponding to a calculation factor, wherein the weight corresponding to the store level is 0.05, the weight corresponding to the heat value of the trader in the same department to a reply comment module is 0.2, the weight corresponding to the comment number to be replied is 0.4, the weight corresponding to the difference comment is 0 or 2, and the weight corresponding to the attribute information is 0.8.
Specifically, in this embodiment, the store level is the basic information of the target merchant, so that the basic information of the target merchant can be acquired by the merchant system, and the store level of the target merchant is further determined. Wherein the basic information may include: merchant identification, business circle identification, city identification, store type, store level, and calculated merchant heat value to business object. The popularity value of the reply comment module of the same-party merchant is the basic information of the merchant, so that the calculated popularity value of the merchant to the business object, which is included in the basic information of the target merchant, can be obtained through a merchant system. In specific implementation, the interface of the merchant system is called through the merchant identifier of the same-party merchant, so that the basic information of the same-party merchant can be obtained, such as the calculated heat value of the current candidate preheating business object by the same-party merchant. The basic information of the same-party merchant and the target merchant both belong to merchants of the system, and have the same category of basic information.
In this embodiment, the number of comments to be replied and the number of bad comments belong to business data, and an interface of a business system may be called through a merchant identifier of the target merchant, so that business information of the target merchant may be obtained, that is, values of information items of the number of comments to be replied and the number of bad comments of the target merchant, and the like may be obtained. In some implementations of the present application, the traffic information includes: order information, sales information, review information, etc., wherein each information item may also include more subdivided information items. For example, the order information may further include a deal order quantity information item, a cancel order quantity information item, and the like.
In some embodiments of the present application, the attribute information of the business object includes: whether the core module is in operation or not, whether the operation is promoted or not, whether a new hand is used for guiding or not and the like. Specifically, in this embodiment, attribute information is preset in configuration information of each candidate preheating service object, and the attribute information of the candidate preheating service object can be obtained through the preset configuration information. For example, the attribute information obtained from the reply comment module is: (1,0, 1), namely, the comment replying module is a core module, is not in operation and popularization, and is guided by a novice.
When the calculation factor corresponds to the heat value of the co-operating merchant of the target merchant to the preheating service object, firstly, determining the co-operating merchant of the target merchant according to any one or more of a business circle identifier, a city identifier, a store type and a store grade included in the basic information of the target merchant. Then, basic information of the same-party merchant is further determined. In some embodiments of the present application, if the hot value of the candidate pre-heated service object by the peer merchant is pre-calculated, the hot value of the candidate pre-heated service object by the peer merchant may be directly obtained from the basic information of the peer merchant. If the heat value of the candidate preheating service object by the same-party merchant is not calculated in advance, the heat value of the candidate preheating service object by the same-party merchant can be set to 0, or the heat value of the candidate preheating service object by the same-party merchant is calculated in real time according to the basic information, the service information and the preset attribute information of the candidate preheating service object of the same-party merchant. The specific implementation of calculating the heat value of the candidate preheating business object by the same-party merchant in real time according to the basic information, the business information and the preset attribute information of the candidate preheating business object of the same-party merchant refers to the specific implementation of calculating the heat value of the candidate preheating business object by the target merchant, and the difference is that the information of the same-party merchant is not considered.
And 250, carrying out normalization processing on the numerical value of the preset information item to obtain a normalized numerical value corresponding to the calculation factor.
In some embodiments of the application, the basic information, the service information, the attribute information of the candidate preheating service object, and the heat value of the candidate preheating service object, which has been calculated by the same-party merchant of the target merchant, of the target merchant corresponding to the calculation factor are obtained through a merchant system and a service system, and have different dimensions, so that the numerical values of part or all of the information items corresponding to the calculation factor need to be normalized to ensure that the data corresponding to each calculation factor is treated equally, and the accuracy of the calculated heat value is improved.
For example, for the number x 'of comments to be replied, the number of comments to be replied is normalized to be within an interval of (0,1) by the formula x' ═ x-min)/(max-min, where min represents the minimum value within the x variation interval and max represents the maximum value within the x variation interval. And then, taking the value of the number of comments to be replied after normalization processing as the normalized value of the number of comments to be replied, and calculating a heat value. As another example, the merchant system classifies the hotel grades into 7 categories, each designated 1-7, with higher numbers representing higher grades. 1 represents the general economy, 7 represents the high star type, and if the value of the store level information of the target merchant is 2, the normalized value of the store level after the normalization processing is (2-1)/(7-1) ═ 0.16667.
In some embodiments of the present application, after determining the normalization value corresponding to each calculation factor, a product of the weight corresponding to each calculation factor and the normalization value corresponding to the calculation factor may be used as a single-item heat value of the calculation factor, then, the single-item heat values of each calculation factor in the list of calculation factors are accumulated, and the accumulated sum is used as the heat value of the target merchant for the candidate pre-heated business object.
Specifically, in this embodiment, if 5 calculation factors, namely, the store level, the hot value of the peer merchant to the comment replying module, the number of comments to be replied, the number of bad comments, and the normalized numerical values corresponding to the attribute information, which are required for calculating the hot value of the comment replying module, are respectively: 0.16667, 0.01, 0.32, 0.02 and 0.8, the weight corresponding to the store level is 0.05, the weight corresponding to the popularity value of the commenting module by the same-party merchant is 0.2, the weight corresponding to the number of comments to be replied is 0.4, the weight corresponding to the number of bad comments is 0,2, the weight corresponding to the attribute information is 0.8, and then the popularity value of the target merchant to the commenting module is:
0.16667*0.05+0.01*0.2+0.32*0.4+0.02*0.2+0.8*0.8＝3.5417。
In some embodiments of the present application, a threshold of the heat value may be preset, where the preset condition is: and the hot value of the target merchant to the candidate preheating business object is greater than the hot value threshold. That is, the heat value of each candidate preheating service object by the target merchant is respectively determined, and if the heat value of a certain candidate preheating service object a by the target merchant is greater than the heat value threshold, the target merchant is considered to have a high possibility of entering the candidate preheating service object a, and the data of the candidate preheating service object a is loaded into a cache in advance to preheat the data. For example, the popularity values of the target merchant to the candidate preheating business object, i.e. the reply comment module, the merchant information editing module and the home page, are respectively: 3.5417, 0.75, 2.675, if the preset hot value threshold is 2.0, the candidate preheating service objects whose hot values satisfy the preset condition include: and the comment replying module and the home page, so that the data of the comment replying module and the home page are pre-loaded into the cache.
When the target merchant accesses the reply comment module or the home page, the module data is directly loaded from the cache, and the requirement of the merchant can be quickly responded.
The merchant system and the business system in the embodiment of the application are existing systems for providing merchant data services, and support interface calling with merchant identifiers as parameters, and detailed description thereof is omitted here.
The data preheating method provided by the embodiment of the application determines a candidate preheating service object corresponding to a current service object accessed by a target merchant by obtaining the current service object, further obtains a list of calculation factors required for calculating the heat value of the candidate preheating service object and weights corresponding to the calculation factors, then obtains a normalized numerical value of a preset information item corresponding to the calculation factors, and performs weighted summation on the normalized numerical value of each calculation factor in the list of the calculation factors by corresponding weights to obtain the heat value of the candidate preheating service object by the target merchant, and finally performs data preheating operation on the data of the candidate preheating service object with the heat value meeting preset conditions, thereby solving the problems that the waste of cache resources and the low utilization rate of the cache resources caused by preheating of full data in the prior art, and, there may be a problem of poor data timeliness. According to the data preheating method provided by the embodiment of the application, the candidate preheating business objects are determined according to the real-time behaviors of the merchants, the heat value of each candidate preheating business object by the merchants is further determined by combining the associated data of the merchants, and the candidate preheating business objects with the heat values meeting the preset conditions are selected for data preheating, so that cache can be saved. Meanwhile, data preheating is carried out in real time according to the operation of the target merchant, so that the timeliness of the data can be improved. In addition, the calculation of the heat value adopts the self information of the target merchant and the information of the same-party merchant, so that the accuracy of the calculated heat value can be improved. By adopting the data preheating method disclosed by the embodiment of the application, for a new merchant without historical data, the heat value of the new merchant to the candidate preheating business object can be determined according to the information of the same-party merchant, so that the preheating of the data of the new merchant is realized.
According to the data preheating method provided by the embodiment of the application, the interest characteristics of a certain functional module of a merchant are constructed by using some historical data (based on the access data, the service data and the merchant information stored by the system) and the same-row data (the interest characteristic result values of the merchants in the same city, the same business circle and the same type), wherein the interest characteristics are the heat value, the functional module interested by the target merchant can be accurately predicted, and the data preheating efficiency is improved.
EXAMPLE III
An embodiment of the present application provides a data pre-heating apparatus, as shown in fig. 3, the apparatus includes:
a current business object determining module 310, configured to obtain a current business object accessed by a target merchant;
a candidate preheating service object determining module 320, configured to determine a candidate preheating service object corresponding to the current service object;
a candidate preheating service object heat value determining module 330, configured to determine, according to any one or more of the obtained self information of the target merchant, the peer information of the target merchant, and the preset attribute information of the candidate preheating service object, a heat value of the candidate preheating service object by the target merchant;
the data preheating module 340 is configured to perform a data preheating operation on the data of the candidate preheating service object whose heat value meets a preset condition.
Optionally, as shown in fig. 4, the candidate preheating service object heat value determining module 330 further includes:
a calculation factor and weight determining sub-module 3301, configured to obtain a list of calculation factors required for calculating the heat value of the candidate preheating service object and weights corresponding to the calculation factors, where each calculation factor corresponds to a preset information item included in any one of basic information of the target merchant, service information of the target merchant, a heat value of a peer merchant of the target merchant to the candidate preheating service object, and attribute information of the candidate preheating service object;
a calculation factor value determination sub-module 3302 configured to determine a normalized value of each calculation factor;
and the heat value operator module 3303 is configured to perform weighted summation on the normalized numerical value of each calculation factor in the list of calculation factors by using a corresponding weight, so as to obtain a heat value of the candidate preheating business object by the target merchant.
Optionally, as shown in fig. 4, the calculation factor value determining sub-module 3302 further includes:
a first calculation factor value determining unit 33021, configured to determine, by a preset merchant system, a value of a preset information item corresponding to the calculation factor when the preset information item corresponding to the calculation factor is basic information of the target merchant;
a second calculation factor value determining unit 33022, configured to determine, by using a preset service system, a value of a preset information item corresponding to the calculation factor when the preset information item corresponding to the calculation factor is service information of the target merchant;
a third calculation factor value determining unit 33023, configured to obtain, by a preset merchant system, a value of a preset information item corresponding to the calculation factor when the preset information item corresponding to the calculation factor is a heat value of the peer merchant of the target merchant to the candidate preheating service object;
a fourth calculation factor value determining unit 33024, configured to determine, when the preset information item corresponding to the calculation factor is attribute information of the candidate preheating service object, a value of the preset information item corresponding to the calculation factor according to preset configuration information;
a normalization unit 33025, configured to perform normalization processing on the numerical value of the preset information item, so as to obtain a normalized numerical value corresponding to the calculation factor.
Optionally, the calculation factor and weight determination submodule 3301 is further configured to:
and acquiring a list of calculation factors required for calculating the heat value of the candidate preheating service object and weights corresponding to the calculation factors through preset service object configuration information.
Optionally, the current business object determining module 310 is further configured to:
acquiring current accessed real-time operation information of a target merchant by analyzing an access log of the target merchant;
and determining the request service object in the real-time operation information as the current service object.
The data preheating device disclosed in the embodiment of the present application is used for implementing the data preheating method described in the embodiment of the present application, each module, sub-module, and unit of the device are used for implementing corresponding steps of the method, and specific implementation manners of each module, sub-module, and unit refer to corresponding steps of the method part, which is not described herein again.
The data preheating device provided by the embodiment of the application determines the candidate preheating service object corresponding to the current service object by acquiring the current service object accessed by the target merchant, and determines the heat value of the candidate preheating service object by the target merchant according to the acquired self information of the target merchant, the peer information of the target merchant and any one or more of the preset attribute information of the candidate preheating service object, wherein the heat value meets the preset condition, the data preheating operation is performed, the waste of cache resources caused by preheating of full data in the prior art is solved, the utilization rate of the cache resources is low, and the problem of poor data timeliness possibly exists. The data preheating device provided by the embodiment of the application determines the candidate preheating business objects according to the real-time behaviors of the merchants, further determines the heat value of each candidate preheating business object by the merchants according to the associated data of the merchants, and selects the candidate preheating business objects with the heat values meeting the preset conditions to preheat data, so that the cache can be saved. Meanwhile, data preheating is carried out in real time according to the operation of the target merchant, so that the timeliness of the data can be improved.
In addition, the calculation of the heat value adopts the self information of the target merchant and the information of the same-party merchant, so that the accuracy of the calculated heat value can be improved. By adopting the data preheating device disclosed by the embodiment of the application, for a new merchant without historical data, the heat value of the new merchant to the candidate preheating business object can be determined according to the information of the same-party merchant, so that the preheating of the data of the new merchant is realized.
Correspondingly, the present application further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the data preheating method according to the first embodiment and the second embodiment when executing the computer program. The electronic device can be a PC, a mobile terminal, a personal digital assistant, a tablet computer and the like.
The present application further provides a computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, carries out the steps of the data preheating method according to the first and second embodiments of the present application.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The above detailed description is provided for a data preheating method and device, and a specific example is applied in the detailed description to explain the principle and the implementation of the present application, and the description of the above example is only used to help understanding the method and the core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Claims (10)
1. A method for pre-heating data, comprising:
acquiring a current business object accessed by a target merchant;
determining a candidate preheating service object corresponding to the current service object, wherein the candidate preheating service object is other service objects which can enter through the current service object;
determining the heat value of the candidate preheating business object by the target merchant according to the acquired self information of the target merchant, the peer information of the target merchant and the preset attribute information of the candidate preheating business object;
and executing data preheating operation on the data of the candidate preheating service object with the heat value meeting the preset condition.
2. The method according to claim 1, wherein the step of determining the hot value of the candidate preheated business object by the target merchant according to the acquired self information of the target merchant, the peer information of the target merchant and the preset attribute information of the candidate preheated business object comprises:
acquiring a list of calculation factors required for calculating the heat value of the candidate preheating service object and weights corresponding to the calculation factors, wherein each calculation factor corresponds to a preset information item included in any one of basic information of the target merchant, service information of the target merchant, the heat value of a peer merchant of the target merchant to the candidate preheating service object and attribute information of the candidate preheating service object;
determining a normalized numerical value for each of said calculation factors;
and carrying out weighted summation on the normalized numerical value of each calculation factor in the list of calculation factors by using corresponding weight to obtain the heat value of the candidate preheating business object by the target merchant.
3. The method of claim 2, wherein said step of determining a normalized numerical value for each of said calculation factors comprises:
when the preset information item corresponding to the calculation factor is the basic information of the target merchant, determining the numerical value of the preset information item corresponding to the calculation factor through a preset merchant system;
when the preset information item corresponding to the calculation factor is the business information of the target merchant, determining the numerical value of the preset information item corresponding to the calculation factor through a preset business system;
when the preset information item corresponding to the calculation factor is the heat value of the peer merchant of the target merchant to the candidate preheating service object, acquiring the numerical value of the preset information item corresponding to the calculation factor through a preset merchant system;
when the preset information item corresponding to the calculation factor is the attribute information of the candidate preheating service object, determining the numerical value of the preset information item corresponding to the calculation factor through preset configuration information;
and carrying out normalization processing on the numerical value of the preset information item to obtain a normalized numerical value corresponding to the calculation factor.
4. The method according to claim 2 or 3, wherein the step of obtaining the list of calculation factors required for calculating the heat value of the candidate preheating service object and the weights corresponding to the calculation factors comprises:
and acquiring a list of calculation factors required for calculating the heat value of the candidate preheating service object and weights corresponding to the calculation factors through preset service object configuration information.
5. A data pre-heating apparatus, comprising:
the current business object determining module is used for acquiring a current business object accessed by a target merchant;
a candidate preheating service object determining module, configured to determine a candidate preheating service object corresponding to the current service object, where the candidate preheating service object is another service object that can be entered through the current service object;
the candidate preheating business object heat value determining module is used for determining the heat value of the candidate preheating business object by the target merchant according to the acquired self information of the target merchant, the peer information of the target merchant and the preset attribute information of the candidate preheating business object;
and the data preheating module is used for executing data preheating operation on the data of the candidate preheating service object with the heat value meeting the preset condition.
6. The apparatus of claim 5, wherein the candidate warm-up business object heat value determination module further comprises:
a calculation factor and weight determination submodule, configured to obtain a list of calculation factors required for calculating the heat value of the candidate preheating service object and weights corresponding to the calculation factors, where each calculation factor corresponds to a preset information item included in any one of basic information of the target merchant, service information of the target merchant, a heat value of a peer merchant of the target merchant to the candidate preheating service object, and attribute information of the candidate preheating service object;
the calculation factor value determining submodule is used for determining the normalized value of each calculation factor;
and the heat value operator module is used for weighting and summing the normalized numerical value of each calculation factor in the list of the calculation factors by corresponding weight to obtain the heat value of the candidate preheating business object by the target merchant.
7. The apparatus of claim 6, wherein the calculation factor value determination submodule further comprises:
the first calculation factor value determining unit is used for determining the value of the preset information item corresponding to the calculation factor through a preset merchant system when the preset information item corresponding to the calculation factor is the basic information of the target merchant;
a second calculation factor value determining unit, configured to determine, through a preset service system, a value of a preset information item corresponding to the calculation factor when the preset information item corresponding to the calculation factor is service information of the target merchant;
a third calculation factor value determining unit, configured to obtain, by a preset merchant system, a value of a preset information item corresponding to the calculation factor when the preset information item corresponding to the calculation factor is a heat value of a peer merchant of the target merchant to the candidate preheating service object;
a fourth calculation factor value determining unit, configured to determine, when the preset information item corresponding to the calculation factor is attribute information of the candidate preheating service object, a value of the preset information item corresponding to the calculation factor according to preset configuration information;
and the normalization unit is used for performing normalization processing on the numerical value of the preset information item to obtain a normalization numerical value corresponding to the calculation factor.
8. The apparatus of claim 6 or 7, wherein the calculation factor and weight determination submodule is further configured to:
and acquiring a list of calculation factors required for calculating the heat value of the candidate preheating service object and weights corresponding to the calculation factors through preset service object configuration information.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the data pre-heating method of any one of claims 1 to 4 when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, is adapted to carry out the steps of the data preheating method of one of the claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810989079.3A CN109284236B (en) | 2018-08-28 | 2018-08-28 | Data preheating method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810989079.3A CN109284236B (en) | 2018-08-28 | 2018-08-28 | Data preheating method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109284236A CN109284236A (en) | 2019-01-29 |
| CN109284236B true CN109284236B (en) | 2020-04-17 |
Family
ID=65184037
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810989079.3A Active CN109284236B (en) | 2018-08-28 | 2018-08-28 | Data preheating method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109284236B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111176560B (en) * | 2019-12-17 | 2022-02-18 | 腾讯科技（深圳）有限公司 | Cache management method and device, computer equipment and storage medium |
| CN112099921A (en) * | 2020-09-27 | 2020-12-18 | 中国建设银行股份有限公司 | Java application system preheating method and system based on JVM |
| CN113849532A (en) * | 2021-09-24 | 2021-12-28 | 中国第一汽车股份有限公司 | Cache preheating method and device, computer equipment and storage medium |
| CN115858418B (en) * | 2023-02-09 | 2023-05-05 | 成都有为财商教育科技有限公司 | Data caching method and system |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107291718A (en) * | 2016-03-30 | 2017-10-24 | 阿里巴巴集团控股有限公司 | Page resource put-on method and device |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102521260B (en) * | 2011-11-18 | 2014-04-02 | 华为技术有限公司 | Data preheating method and device |
| CN103309818B (en) * | 2012-03-09 | 2015-07-29 | 腾讯科技（深圳）有限公司 | Store method and the device of data |
| CN104965793B (en) * | 2014-09-26 | 2016-10-12 | 浙江大华技术股份有限公司 | A kind of cloud storage data node device |
| CN106407210B (en) * | 2015-07-29 | 2019-11-26 | 阿里巴巴集团控股有限公司 | A kind of methods of exhibiting and device of business object |
| CN106021126B (en) * | 2016-05-31 | 2021-06-11 | 腾讯科技（深圳）有限公司 | Cache data processing method, server and configuration equipment |
| CN107688443A (en) * | 2017-09-18 | 2018-02-13 | 郑州云海信息技术有限公司 | A kind of method of data storage, system and relevant apparatus |
| CN107704573A (en) * | 2017-09-30 | 2018-02-16 | 山东浪潮通软信息科技有限公司 | A kind of intelligent buffer method coupled with business |
| CN108062418B (en) * | 2018-01-05 | 2022-07-22 | 北京奇艺世纪科技有限公司 | Data searching method and device and server |
-
2018
- 2018-08-28 CN CN201810989079.3A patent/CN109284236B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107291718A (en) * | 2016-03-30 | 2017-10-24 | 阿里巴巴集团控股有限公司 | Page resource put-on method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109284236A (en) | 2019-01-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109284236B (en) | Data preheating method and device, electronic equipment and storage medium | |
| US8700551B2 (en) | Systems and methods for identifying provider noncustomers as likely acquisition targets | |
| US20140012800A1 (en) | Apparatus and method for providing application for processing big data | |
| CN110716979A (en) | House buying intention client mining method, device and server | |
| CN108052824B (en) | Risk prevention and control method and device and electronic equipment | |
| CN105260913A (en) | CTR estimation method and system, and DSP server used for Internet advertisement putting | |
| CN111754241A (en) | User behavior perception method, device, equipment and medium | |
| CN112508581A (en) | Commission order risk control method, system, computer equipment and storage medium | |
| TWI662506B (en) | Method for distributing customer services based on question forecasts | |
| CN110070392B (en) | User loss early warning method and device | |
| CN111951008A (en) | Risk prediction method and device, electronic equipment and readable storage medium | |
| CN111144987A (en) | Abnormal shopping behavior limiting method, limiting assembly and shopping system | |
| US20220277270A1 (en) | Methods and systems for creating software ecosystem activity score from multiple sources | |
| CN111190513B (en) | Visual event analysis method and device, computer equipment and storage medium | |
| CN113434765A (en) | Client return visit method, system, equipment and storage medium | |
| CN111708757B (en) | Data resource processing method, device and system, storage medium and electronic equipment | |
| CN113971592B (en) | Supervision evaluation method, system and device for promotion information release main body | |
| CN115189901B (en) | Method and device for identifying abnormal request, server and storage medium | |
| CN113592549B (en) | Conversion rate prediction method and device and electronic equipment | |
| CN109241084B (en) | Data query method, terminal equipment and medium | |
| CN116128078A (en) | Shopping reservation system based on electronic commerce | |
| CN116012105A (en) | Method and device for analyzing consumption behaviors of electric business | |
| CN117254983A (en) | Method, device, equipment and storage medium for detecting fraud-related websites | |
| CN116091067A (en) | Method, system, equipment and medium for identifying resale ticket account number | |
| CN117151837A (en) | Client risk query method, intelligent terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |