CN109284236A - Data preheating method, device, electronic equipment and storage medium - Google Patents
Data preheating method, device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN109284236A CN109284236A CN201810989079.3A CN201810989079A CN109284236A CN 109284236 A CN109284236 A CN 109284236A CN 201810989079 A CN201810989079 A CN 201810989079A CN 109284236 A CN109284236 A CN 109284236A
- Authority
- CN
- China
- Prior art keywords
- preheating
- business object
- candidate
- factor
- calculating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0877—Cache access modes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Thermotherapy And Cooling Therapy Devices (AREA)
- Treatment Of Fiber Materials (AREA)
Abstract
Data preheating method disclosed in the embodiment of the present application, belongs to field of computer technology, solves the problems, such as that cache resources utilization rate is low when data preheating in the prior art.The described method includes: obtaining the current business object of target businessman access, determine the corresponding candidate preheating business object of the current business object, according to any one or more in the preset attribute information of the self information of the target businessman of acquisition, the peer message of the target businessman and the candidate preheating business object, determine the target businessman to the hot value of the candidate preheating business object, the data for meeting the candidate preheating business object of preset condition to the hot value, execute data warm-up operation.The application promotes the timeliness of data by the real-time behavior according to businessman, log-on data preheating.By in conjunction with merchant data determine businessman to the hot value of each business object, and select hot value meet preset condition business object carry out data preheating, caching can be saved.
Description
Technical field
This application involves field of computer technology, more particularly to a kind of data preheating method, device, electronic equipment and deposit
Storage media.
Background technique
Data preheating, refer to data in advance from disk buffering to memory in, when using data, reach and improve data and read
Take the purpose of speed.Such as provide Business Information service, the general persistence of merchant data in the database (disk storage), when
When receiving the request called by interface, can then it be returned the result from database retrieval Business Information.It is connect to promote request
The performance of mouth often in memory Business Information caching in request, then can read businessman's letter directly from memory
Breath, promotes whole reading performance.Existing data preheat scheme, are the precomputation based on full dose data and caching.Pass through
Timed task scheduling, obtains the business datum of full dose;Distributed computing is carried out again, and the data after calculating are done into distribution and are deposited
Storage.
Inventor by the prior art the study found that data preheating method in the prior art at least exist it is following lack
Fall into: full dose data, which preheat, will cause the wastes of cache resources, and cache resources utilization rate is low, and timing loads data, data when
Effect property is limited by loading cycle, it is understood that there may be the problem of data age difference.
Summary of the invention
The application provides a kind of data preheating method, helps to promote the efficiency of data preheating and the timeliness of warmable data
Property.
In a first aspect, the embodiment of the present application provides a kind of data preheating method includes:
Obtain the current business object of target businessman access;
Determine the corresponding candidate preheating business object of the current business object;
According to the self information of the target businessman of acquisition, the peer message of the target businessman and the candidate preheating
Any one or more in the preset attribute information of business object determines the target businessman to the candidate preheating business pair
The hot value of elephant;
The data for meeting the candidate preheating business object of preset condition to the hot value, execute data preheating behaviour
Make.
Second aspect, the embodiment of the present application provide a kind of data preheating device, comprising:
Current business object determining module, for obtaining the current business object of target businessman access;
Candidate's preheating business object determining module, for determining the corresponding candidate preheating business pair of the current business object
As;
Candidate's preheating business object hot value determining module, for according to the self information of the target businessman of acquisition,
The peer message of the target businessman and the candidate preheat any one or more in the preset attribute information of business object,
Determine the target businessman to the hot value of the candidate preheating business object;
Data warm-up block, the number of the candidate preheating business object for meeting preset condition to the hot value
According to execution data warm-up operation.
The third aspect the embodiment of the present application also provides a kind of electronic equipment, including memory, processor and is stored in institute
The computer program that can be run on memory and on a processor is stated, the processor realizes this when executing the computer program
Apply for data preheating method described in embodiment.
Fourth aspect, the embodiment of the present application provide a kind of computer readable storage medium, are stored thereon with computer journey
Sequence, when which is executed by processor the step of data preheating method described in the embodiment of the present application.
Data preheating method provided by the embodiments of the present application, by obtaining the current business object of target businessman access, really
The corresponding candidate preheating business object of the current business object is determined, according to the self information of the target businessman of acquisition, institute
Any one or more in the peer message of target businessman and the preset attribute information of the candidate preheating business object is stated, really
The fixed target businessman meets the time of preset condition to the hot value to the hot value of the candidate preheating business object
The data of choosing preheating business object, execute data warm-up operation, and solving full dose data preheating in the prior art will cause caching
The waste of resource, cache resources utilization rate is low, and, it is understood that there may be the problem of data age difference.The embodiment of the present application mentions
The data preheating method of confession improves the timeliness of data preheating by the real-time behavior according to businessman, log-on data preheating.It is logical
The associated data crossed in conjunction with businessman determines that businessman preheats the hot value of business object to each candidate, and it is default to select hot value to meet
The candidate preheating business object of condition carries out data preheating, can save caching.
Detailed description of the invention
Technical solution in ord to more clearly illustrate embodiments of the present application, below will be in embodiment or description of the prior art
Required attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is only some realities of the application
Example is applied, it for those of ordinary skill in the art, without any creative labor, can also be attached according to these
Figure obtains other attached drawings.
Fig. 1 is the data preheating method flow chart of the embodiment of the present application one;
Fig. 2 is the flow chart of the data preheating method of the embodiment of the present application two;
Fig. 3 is one of data preheating device structural schematic diagram of the embodiment of the present application three;
Fig. 4 is the second structural representation of the data preheating device of the embodiment of the present application three.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete
Site preparation description, it is clear that described embodiment is some embodiments of the present application, instead of all the embodiments.Based on this Shen
Please in embodiment, every other implementation obtained by those of ordinary skill in the art without making creative efforts
Example, shall fall in the protection scope of this application.
Embodiment one
A kind of data preheating method provided by the embodiments of the present application, as shown in Figure 1, this method comprises: step 110 is to step
140。
Step 110, the current business object of target businessman access is obtained.
Business object in the embodiment of the present application can be understood as the functional module of application.
In some embodiments of the present application, the business object of server-side is accessed by monitoring and analyzing target businessman in real time
Address, can determine the current business object of target businessman access.For example, target businessman is in client operation, meeting
Http request is sent to server-side in real time, the merchant identification of the target businessman is carried in http request information, businessman asks
Ask path, the information such as request operation content of businessman.After server-side receives the http request, parses the http and ask
It asks, feeds back to the corresponding data of request path described in the client, and store the merchant identification and request path, request behaviour
Make access log of the information such as content as businessman.Then, by analyzing the access log of the businessman, the target quotient is determined
The current business object of family's access, such as a comment functional module to be replied of comment application.
Step 120, the corresponding candidate preheating business object of the current business object is determined.
For the functional module of application, using each functional module as entrance, it can enter at least one other
Functional module.For example, sales volume enquiry module, information collocation module, comment processing can be entered by homepage for hotel service
Module.That is, each business object can correspond at least one candidate's preheating business object.The candidate preheats business object
Other business objects that can be entered by the business object.In embodiments herein, which some business object corresponds to
Candidate's preheating business object is pre-defined according to business demand.
Step 130, according to the self information of the target businessman of acquisition, the peer message of the target businessman and described
Candidate preheats any one or more in the preset attribute information of business object, determines the target businessman to described candidate pre-
The hot value of hot business object.
In some embodiments of the present application, target businessman, the target businessman the colleague businessmans such as businessman itself letter
Breath includes at least the essential information and business information of businessman.Wherein, essential information is stored in merchant system, further comprises:
Merchant identification, shops's grade, shops's mark, shops's type, shops's information, urban sign, commercial circle mark, calculated businessman couple
The hot value etc. of business object.Business information storage further comprises from operation system: sales volume information, evaluation information,
Product information etc., such as: including order sales volume, evaluation score, review number to be replied, product number can be sold.
In some embodiments of the present application, it can be arranged previously according to business demand and calculate businessman to some business object
Hot value when Business Information in need of consideration specific type and the corresponding calculating weight of a certain specifying information;Then, according to
The type of the hot value Business Information in need of consideration of some business object is calculated, obtains corresponding letter to corresponding data service system
Breath, and according to the hot value of the information and the corresponding weight calculation business object that get.
Step 140, the data that the candidate preheating business object of preset condition is met to the hot value, execute data
Warm-up operation.
In some embodiments of the present application, hot value threshold value, the preset condition can be preset are as follows: the target
Businessman is greater than the hot value threshold value to the hot value of candidate preheating business object.That is, to the target businessman to each candidate
The hot value of preheating business object is judged respectively, if the target businessman is to the heat of some candidate's preheating business object A
Angle value is greater than the hot value threshold value, then it is assumed that and a possibility that target businessman preheats business object A into the candidate is larger,
Then the data that the candidate preheats business object A are loaded into caching in advance and do data preheating.
Data preheating method provided by the embodiments of the present application, by obtaining the current business object of target businessman access, really
The corresponding candidate preheating business object of the current business object is determined, according to the self information of the target businessman of acquisition, institute
Any one or more in the peer message of target businessman and the preset attribute information of the candidate preheating business object is stated, really
The fixed target businessman meets the time of preset condition to the hot value to the hot value of the candidate preheating business object
The data of choosing preheating business object, execute data warm-up operation, and solving full dose data preheating in the prior art will cause caching
The waste of resource, cache resources utilization rate is low, and, it is understood that there may be the problem of data age difference.The embodiment of the present application mentions
The data preheating method of confession determines candidate preheating business object by the real-time behavior according to businessman, and further combined with businessman
Associated data determine that businessman to the hot value of each candidate preheating business object, and selects hot value to meet the candidate of preset condition
It preheats business object and carries out data preheating, caching can be saved.Simultaneously as according to the operation real-time perfoming data of target businessman
Preheating, therefore the timeliness of data can be promoted.
Embodiment two
The embodiment of the present application provides a kind of data preheating method, as shown in Fig. 2, this method comprises: step 210 is to step
270。
Step 210, the current business object of target businessman access is obtained.
Business object in the embodiment of the present application can be understood as the functional module of application.
In some embodiments of the present application, the business object of server-side is accessed by monitoring and analyzing target businessman in real time
Address, can determine the current business object of target businessman access.In some embodiments of the present application, the acquisition
The step of current business object of target businessman access, comprising: by analyzing the access log of target businessman, obtain the target
The real-time operation information of businessman's current accessed;Determine the requested service object in the real-time operation information as current business pair
As.
In a distributed manner for service cluster, target businessman is in client operation, by http agreement in network layer and clothes
Being engaged in, end is interactive, and network can be routed to specific service by Nginx.Nginx has recorded all solicited messages, and information is sent
Summarize to unified collect of kafka.Because Nginx belongs to cluster service, need to report the daily record data of all clusters to kafka,
It just can ensure that processing information integrity in this way.Since kafka has the characteristics of height is handled up, the access day of businessman can be collected in real time
Will.In some embodiments of the present application, Nginx report to kafka log may include: target businessman merchant identification,
Address of service, request operation content, access time, access path of access etc..Kafka after being collected into all access logs,
The access log that will be collected into uniformly pushes to real time data processing service storm, the parsing of mass data is done by storm.
Storm obtains the default key message in every log by the way that every daily record data is converted into json format,
Then, by regular expression, it is accurately identified the real-time operation information of target businessman.For example, every daily record data is converted into
After json formatted data, following key message: the service of Merchant ID information (including merchant identification), current request can be extracted
Address, current request service module and parameter.In a large amount of daily record data, how to parse and match the module datas of needs and be
One key.In this very light some embodiment, each module has fixed request address, can be solved by regular expression
The request module information in every log is precipitated.
After parsing obtains the current request module information of the target businessman, by message mechanism by the target businessman
And the current request module information of the target businessman is pushed to message system, is listened to by each system service by message system
The current real-time operation information of target businessman.Each system service can be by the real-time operation of the target businessman listened to
Requested service object in information is as current business object.
By analyzing the access log of target businessman, the real-time operation information of the target businessman current accessed is obtained;And
When determining the requested service object in the real-time operation information as current business object, the timeliness for obtaining data can be promoted
Property, an only step promotes the timeliness of data preheating.
Step 220, the corresponding candidate preheating business object of the current business object is determined.
Determine the specific embodiment of the corresponding candidate preheating business object of the current business object referring to embodiment one,
This embodiment is not repeated.In the present embodiment, it is assumed that current business object is comment module, and determining current business object is corresponding
Candidate preheating business object include: to reply comment module, Business Information editor module, homepage.
Step 230, list and the institute of the calculating factor of hot value needs for calculating the candidate preheating business object are obtained
It states and calculates the corresponding weight of the factor.
Wherein, each calculating factor pair answers the essential information of the target businessman, the business of target businessman letter
It ceases, the colleague businessman of the target businessman preheats business object to the hot value of the candidate preheating business object, the candidate
Attribute information information in any one information presupposed information item for including.For example, a certain base for calculating factor corresponding merchant
Shops's grade in this information.
In some embodiments of the present application, the self information includes essential information and business information, colleague's letter
Breath is the essential information and the business information of the colleague businessman of the target businessman, and the essential information further comprises
The hot value to business object that history calculates;The self information of the target businessman according to acquisition, the target quotient
The peer message of family and the candidate preheat any one or more in the preset attribute information of business object, determine the mesh
The step of marking hot value of the businessman to the candidate preheating business object, comprising: obtain and calculate the candidate preheating business object
Hot value need the calculating factor list and the corresponding weight of the calculating factor, wherein each calculating factor pair
Answer the essential information of the target businessman, the business information of the target businessman, the target businessman colleague businessman to described
Any one packet in the information of the attribute information of the hot value of candidate's preheating business object, the candidate preheating business object
The presupposed information item included;Determine each normalization numerical value for calculating the factor;With corresponding weight to the calculating factor
Each normalization numerical value for calculating the factor is weighted summation in list, obtains the target businessman to the candidate preheating
The hot value of business object.
In some embodiments of the present application, the essential information includes: merchant identification, and it is following any one or it is more
A item of information: the items of information such as commercial circle mark, urban sign, shops's type, shops's grade;The business information includes: order letter
The items of information such as breath, sales volume information, comment information;Whether the attribute information of business object includes: whether nucleus module, pushes away in operation
Extensively, whether there are the items of information such as new hand's guidance.
In some embodiments of the present application, each business object, which is previously provided with, calculates businessman to the heat of the business object
The required configured list for calculating the factor (classification for the information for needing to rely on), further includes every in the configured list when angle value
The corresponding weight of a calculating factor.In the embodiment of the present application when it is implemented, by preset business object configuration information, obtain
Calculate the list and the corresponding weight of the calculating factor of the calculating factor of the hot value needs of the candidate preheating business object.
For example, available to the calculating candidate preheating business object by configuration information -- reply the meter of the hot value of comment module
Calculating includes 5 calculating factors in the list of the factor, and the 5 calculating factor respectively corresponds: shops's grade, colleague businessman are to reply
It comments on the hot value of module, comment number, attribute information wait reply comment number, difference, wherein the corresponding weight of shops's grade is
0.05, colleague businessman is 0.2 to the corresponding weight of hot value for replying comment module, is wait reply the corresponding weight of comment number
0.4, it is 0,2 that difference, which comments several corresponding weights, and the corresponding weight of the attribute information is 0.8.When it is implemented, can be according to business
The configuration information of business object is arranged in demand, then, it is carried out according to the hot value that the calculating factor and weight calculation of configuration obtain
Business object preheating, is more in line with the demand of promoting service, facilitates the retention ratio, the conversion ratio that promote each business module.
Step 240, the numerical value for calculating the corresponding presupposed information item of the factor is obtained.
After the calculating factor required for the hot value for calculating each candidate preheating business object and weight has been determined, into
One step determines each normalization numerical value for calculating the factor.In some embodiments of the present application, the determination is each described
The step of calculating the normalization numerical value of the factor, comprising: obtain the numerical value for calculating the corresponding presupposed information item of the factor;To described
The numerical value of presupposed information item is normalized, and obtains the corresponding normalization numerical value for calculating the factor.Wherein, described in acquisition
The numerical value for calculating the corresponding presupposed information item of the factor further comprises: when the corresponding presupposed information item of the calculating factor is
When the essential information of the target businessman, the corresponding presupposed information item of the calculating factor is determined by preset merchant system
Numerical value;When the corresponding presupposed information item of the calculating factor is the business information of the target businessman, by preset
Operation system determines the numerical value of the corresponding presupposed information item of the calculating factor;When the corresponding default letter of the calculating factor
When breath item is that the colleague businessman of the target businessman preheats the hot value of business object to the candidate, pass through preset businessman system
System obtains the numerical value for calculating the corresponding presupposed information item of the factor;When the corresponding presupposed information item of the calculating factor is
When the attribute information of the candidate preheating business object, determine that the calculating factor is corresponding default by preset configuration information
The numerical value of item of information;The numerical value of the presupposed information item is normalized, the corresponding normalizing for calculating the factor is obtained
Change numerical value.
It include: to reply comment module, Business Information volume with candidate's preheating business object in some embodiments of the present application
For collecting module, homepage, when calculating the target businessman A to the hot value for replying comment module, it is assumed that determine described in calculating
Calculating factor pair needed for replying the hot value of comment module is answered: shops's grade, colleague businessman are to the temperature for replying comment module
Value comments number, attribute information wait reply comment number, difference, wherein the corresponding weight of shops's grade is 0.05, and go together businessman couple
The corresponding weight of hot value for replying comment module is 0.2, is 0.4 wait reply the corresponding weight of comment number, difference is commented several corresponding
Weight is 0,2, and the corresponding weight of the attribute information is 0.8, then firstly the need of obtaining the corresponding information of the calculating factor.
For the present embodiment, shops's grade is therefore the essential information of target businessman can pass through businessman
System obtains the essential information of the target businessman, further determines that shops's grade of the target businessman.Wherein, described basic
Information may include: merchant identification, commercial circle mark, urban sign, shops's type, shops's grade, calculated businessman to business
The hot value of object.Therefore the colleague businessman can pass through the essential information that the hot value for replying comment module is businessman
Merchant system obtains the calculated businessman that includes in the essential information of the target businessman to the hot value of business object.Specifically
When implementation, the interface of merchant system is called by the merchant identification for the businessman that goes together, and can be obtained the basic letter of the colleague businessman
The hot value of breath, such as calculated colleague businessman to current candidate preheating business object.The essential information of the colleague businessman
The businessman of system is belonged to the target businessman, the essential information with the same category.
It is described to comment number to belong to business datum wait reply comment number, difference in the present embodiment, it can pass through the target businessman's
Merchant identification calls the interface of operation system, can be obtained the business information of the target businessman, it can get the mesh
Mark businessman's comments on number, the poor value for commenting the items of information such as number wait reply.In some implementations of the application, the business information packet
It includes: the items of information such as order information, sales volume information, comment information, wherein each item of information can also include the letter more segmented
Cease item.For example, order information can further include conclusion of the business quantity on order item of information, quantity information item etc. of cancelling an order.
In some embodiments of the present application, the attribute information of the business object include: whether nucleus module, whether
Operation is promoted, whether has the items of information such as new hand's guidance.For the present embodiment, each candidate preheating business object is being configured
It is previously provided with attribute information in information, is believed by the attribute of the available candidate preheating business object of preset configuration information
Breath.For example, getting the attribute information for replying comment module are as follows: (1,0,1), i.e., the described reply comment module is core mould
Block is not promoted in operation, there is new hand's guidance.
When the calculating factor pair answers the colleague businessman of the target businessman to the hot value for preheating business object,
First according to include in the essential information of the target businessman commercial circle mark, urban sign, shops's type, in shops's grade
The colleague businessman of any one or more determination target businessman.Then, the basic letter of the colleague businessman is further determined that
Breath.In some embodiments of the present application, if precalculating the colleague businessman to the candidate preheating business object
Hot value then can directly obtain the colleague businessman to the candidate preheating business from the essential information of the colleague businessman
The hot value of object.If not calculating the hot value that the colleague businessman preheats business object to the candidate in advance,
0 can be set by hot value of the colleague businessman to the candidate preheating business object, alternatively, according to the colleague businessman
Essential information, business information, the preset attribute information of the candidate preheating business object calculate the colleague businessman couple in real time
The hot value of the candidate preheating business object.According to the essential information of the colleague businessman, business information, the candidate preheating
The preset attribute information of business object calculates the colleague businessman to the tool of the hot value of the candidate preheating business object in real time
Body embodiment is referring to the calculating target businessman to the specific embodiment of the hot value of the candidate preheating business object, area
Other point is not consider the information of the colleague businessman of the colleague businessman.
Step 250, the numerical value of the presupposed information item is normalized, obtains returning for the corresponding calculating factor
One changes numerical value.
In some embodiments of the present application, the corresponding mesh of the calculating factor is being obtained by merchant system and operation system
Mark the essential information of businessman, business information, the attribute information of candidate preheating business object, the target businessman colleague businessman
The hot value to the candidate preheating business object being computed, has different dimensions, therefore, it is also desirable to the calculating
Factor pair some or all of answers the numerical value of item of information to be normalized, to guarantee the corresponding data quilt of each calculating factor
Fair play promotes the accuracy for the hot value being calculated.
For example, for will comment number be replied by formula x '=(x-min)/(max-min) wait reply comment number x '
It normalizes in the section of (0,1), wherein min indicates the minimum value in x constant interval, and max is indicated in x constant interval most
Big value.Later, by it is described wait reply comment number normalized after numerical value, as wait reply comment number normalization numerical value,
For calculating hot value.For another example hotel's grade is divided into 7 kinds by merchant system, it is expressed as 1-7, numerical value is higher, represent etc.
Grade is higher.1 represents general economic type, 7 represent it is high star-like, if the numerical value that shops's class information of target businessman is thought is 2,
After normalized, the normalization numerical value of shops's grade is (2-1)/(7-1)=0.16667.
Step 260, with corresponding weight to the normalization number for calculating the factor each in the list for calculating the factor
Value is weighted summation, obtains the target businessman to the hot value of the candidate preheating business object.
It, can be with after determining the corresponding normalization numerical value of each calculating factor in some embodiments of the present application
Individual event of each product for calculating the corresponding weight of factor normalization numerical value corresponding with the calculating factor as the calculating factor
Then the individual event hot value for calculating the factor each in the list for calculating the factor is added up, is obtained cumulative by hot value
Sum as the target businessman to the hot value of the candidate preheating business object.
For the present embodiment, if calculate it is described reply comment module hot value needed for 5 calculate because
Son --- shops's grade, colleague businessman are to replying the hot value of comment module, comment several and attribute information pair wait reply comment number, difference
The normalization numerical value answered is respectively as follows: 0.16667,0.01,0.32,0.02 and 0.8, and the corresponding weight of shops's grade is
0.05, colleague businessman is 0.2 to the corresponding weight of hot value for replying comment module, is wait reply the corresponding weight of comment number
0.4, it is 0,2 that difference, which comments several corresponding weights, and the corresponding weight of the attribute information is 0.8, then the target businessman is to described time
The hot value reexamined by module are as follows:
0.16667*0.05+0.01*0.2+0.32*0.4+0.02*0.2+0.8*0.8=3.5417.
Step 270, the data that the candidate preheating business object of preset condition is met to the hot value, execute data
Warm-up operation.
In some embodiments of the present application, hot value threshold value, the preset condition can be preset are as follows: the target
Businessman is greater than the hot value threshold value to the hot value of candidate preheating business object.That is, to the target businessman to each candidate
The hot value of preheating business object is judged respectively, if the target businessman is to the heat of some candidate's preheating business object A
Angle value is greater than the hot value threshold value, then it is assumed that and a possibility that target businessman preheats business object A into the candidate is larger,
Then the data that the candidate preheats business object A are loaded into caching in advance and do data preheating.For example, the target businessman is to institute
State candidate preheating business object --- reply comment module, Business Information editor module, homepage hot value be respectively as follows:
3.5417,0.75,2.675, if preset heat value threshold value is 2.0, hot value meets the candidate preheating of preset condition
Business object includes: to reply comment module and homepage, therefore, the data for replying comment module and homepage is loaded previously into caching
In.
When target businessman, which accesses, replys comment module or homepage, the loading module data directly from caching can be quick
Respond the demand of businessman.
Merchant system and operation system in the embodiment of the present application are to provide the existing system of businessman's data service, support with
Merchant identification is called as the interface of parameter, and specific embodiment, details are not described herein again.
Data preheating method provided by the embodiments of the present application, by obtaining the current business object of target businessman access, really
Determine the corresponding candidate preheating business object of the current business object further to obtain and calculate candidate's preheating business pair
The list and the corresponding weight of the calculating factor for the calculating factor that the hot value of elephant needs, then obtain the calculating factor pair
The normalization numerical value for the presupposed information item answered, and with corresponding weight to it is described calculate the factor list in each calculating because
The normalization numerical value of son is weighted summation, obtains the target businessman to the hot value of the candidate preheating business object, most
Afterwards, the data that the candidate preheating business object of preset condition is met to the hot value, execute data warm-up operation, solve
The preheating of full dose data will cause the waste of cache resources in the prior art, and cache resources utilization rate is low, and, it is understood that there may be
The problem of data age difference.Data preheating method provided by the embodiments of the present application is determined by the real-time behavior according to businessman
Candidate's preheating business object, and determine businessman to the temperature of each candidate preheating business object further combined with the associated data of businessman
Value, and the candidate preheating business object for selecting hot value to meet preset condition carries out data preheating, can save caching.Meanwhile
Due to preheating according to the operation real-time perfoming data of target businessman, the timeliness of data can be promoted.Also, due to temperature
The calculating of value uses the information of the self information of target businessman and the businessman that goes together, and can promote the standard for the hot value being calculated
True property.It can be same according to it for the new businessman of not historical data using data preheating method disclosed in the embodiment of the present application
The information of family of doing business determines the new businessman to the hot value of candidate preheating business object, to realize the preheating of new merchant data.
Data preheating method provided by the embodiments of the present application (has been stored using some historical datas of businessman based on system
Access data, business datum, Business Information), colleague data (same to city, same to commercial circle, same type businessman interest characteristics result
Value) businessman is constructed to the interest characteristics of some functional module, wherein and the interest characteristics are exactly hot value described herein,
The efficiency of data preheating can be promoted with the interested functional module of Accurate Prediction target businessman.
Embodiment three
The embodiment of the present application provides a kind of data preheating device, as shown in figure 3, described device includes:
Current business object determining module 310, for obtaining the current business object of target businessman access;
Candidate's preheating business object determining module 320, for determining the corresponding candidate preheating industry of the current business object
Business object;
Candidate's preheating business object hot value determining module 330, for itself letter according to the target businessman of acquisition
In the preset attribute information of breath, the peer message of the target businessman and the candidate preheating business object any one or it is more
Kind, determine the target businessman to the hot value of the candidate preheating business object;
Data warm-up block 340, the candidate for meeting preset condition to the hot value preheat business object
Data execute data warm-up operation.
Optionally, as shown in figure 4, the candidate preheating business object hot value determining module 330 further comprises:
It calculates the factor and weight determines submodule 3301, for obtaining the hot value for calculating the candidate preheating business object
The list of the calculating factor needed and the corresponding weight of the calculating factor, wherein each calculating factor pair answers the mesh
Mark the essential information of businessman, the business information of the target businessman, the target businessman colleague businessman candidate preheated to described
What any one information included in the information of the attribute information of the hot value of business object, the candidate preheating business object is default
Item of information;
It calculates factor value and determines submodule 3302, for determining each normalization numerical value for calculating the factor;
Hot value computational submodule 3303, by by corresponding weight to it is described calculate the factor list in it is each it is described in terms of
The normalization numerical value for calculating the factor is weighted summation, obtains the target businessman to the temperature of the candidate preheating business object
Value.
Optionally, as shown in figure 4, the calculating factor value determines submodule 3302, further comprise:
First calculates factor value determination unit 33021, for working as the corresponding presupposed information item of the calculating factor
For the target businessman essential information when, the corresponding presupposed information item of the calculating factor is determined by preset merchant system
Numerical value;
Second calculates factor value determination unit 33022, for working as the corresponding presupposed information item of the calculating factor
For the target businessman business information when, the corresponding presupposed information item of the calculating factor is determined by preset operation system
Numerical value;
Third calculates factor value determination unit 33023, for working as the corresponding presupposed information item of the calculating factor
When preheating the hot value of business object to the candidate for the colleague businessman of the target businessman, obtained by preset merchant system
Take the numerical value of the corresponding presupposed information item of the calculating factor;
4th calculates factor value determination unit 33024, for working as the corresponding presupposed information item of the calculating factor
When preheating the attribute information of business object for the candidate, determine that the calculating factor is corresponding pre- by preset configuration information
If the numerical value of item of information;
Normalization unit 33025 is normalized for the numerical value to the presupposed information item, obtains corresponding described
Calculate the normalization numerical value of the factor.
Optionally, the calculating factor and weight determine that submodule 3301 is further used for:
By preset business object configuration information, the hot value needs for calculating the candidate preheating business object are obtained
Calculate the list and the corresponding weight of the calculating factor of the factor.
Optionally, the current business object determining module 310, is further used for:
By analyzing the access log of target businessman, the real-time operation information of the target businessman current accessed is obtained;
Determine the requested service object in the real-time operation information as current business object.
Data preheating device is disclosed in the embodiment of the present application for realizing data preheating side described in the embodiment of the present application
Method, each module, submodule and the unit of described device, for realizing the corresponding steps of the method, each module, submodule and list
The specific embodiment of member is referring to the corresponding steps of method part, and details are not described herein again.
Data preheating device provided by the embodiments of the present application, by obtaining the current business object of target businessman access, really
The corresponding candidate preheating business object of the current business object is determined, according to the self information of the target businessman of acquisition, institute
Any one or more in the peer message of target businessman and the preset attribute information of the candidate preheating business object is stated, really
The fixed target businessman meets the time of preset condition to the hot value to the hot value of the candidate preheating business object
The data of choosing preheating business object, execute data warm-up operation, and solving full dose data preheating in the prior art will cause caching
The waste of resource, cache resources utilization rate is low, and, it is understood that there may be the problem of data age difference.The embodiment of the present application mentions
The data preheating device of confession determines candidate preheating business object by the real-time behavior according to businessman, and further combined with businessman
Associated data determine that businessman to the hot value of each candidate preheating business object, and selects hot value to meet the candidate of preset condition
It preheats business object and carries out data preheating, caching can be saved.Simultaneously as according to the operation real-time perfoming data of target businessman
Preheating, therefore the timeliness of data can be promoted.
Also, since the calculating of hot value uses the information of the self information of target businessman and the businessman that goes together, Ke Yiti
Rise the accuracy for the hot value being calculated.Using data preheating device disclosed in the embodiment of the present application, for no history number
According to new businessman, can be determined according to its information for going together businessman the new businessman to the hot value of candidate preheating business object, from
And realize the preheating of new merchant data.
Correspondingly, present invention also provides a kind of electronic equipment, including memory, processor and it is stored in the memory
Computer program that is upper and can running on a processor, the processor are realized when executing the computer program as the application is real
Apply data preheating method described in example one and embodiment two.The electronic equipment can help for PC machine, mobile terminal, individual digital
Reason, tablet computer etc..
Present invention also provides a kind of computer readable storage mediums, are stored thereon with computer program, which is located
Manage the step of realizing the data preheating method as described in the embodiment of the present application one and embodiment two when device executes.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with
The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.For Installation practice
For, since it is basically similar to the method embodiment, so being described relatively simple, referring to the portion of embodiment of the method in place of correlation
It defends oneself bright.
A kind of data preheating method provided by the present application and device are described in detail above, tool used herein
The principle and implementation of this application are described for body example, the above embodiments are only used to help understand this Shen
Method and its core concept please;At the same time, for those skilled in the art, according to the thought of the application, specific real
Apply in mode and application range that there will be changes, in conclusion the content of the present specification should not be construed as the limit to the application
System.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can
It realizes by means of software and necessary general hardware platform, naturally it is also possible to pass through hardware realization.Based on such reason
Solution, substantially the part that contributes to existing technology can embody above-mentioned technical proposal in the form of software products in other words
Come, which may be stored in a computer readable storage medium, such as ROM/RAM, magnetic disk, CD, including
Some instructions are used so that a computer equipment (can be personal computer, server or the network equipment etc.) executes respectively
Method described in certain parts of a embodiment or embodiment.
Claims (10)
1. a kind of data preheating method characterized by comprising
Obtain the current business object of target businessman access;
Determine the corresponding candidate preheating business object of the current business object;
According to the self information of the target businessman of acquisition, the peer message of the target businessman and the candidate preheating business
Any one or more in the preset attribute information of object determines the target businessman to the candidate preheating business object
Hot value;
The data for meeting the candidate preheating business object of preset condition to the hot value, execute data warm-up operation.
2. the method according to claim 1, wherein itself letter of the target businessman according to acquisition
In the preset attribute information of breath, the peer message of the target businessman and the candidate preheating business object any one or it is more
Kind, determine the step of target businessman is to the candidate hot value for preheating business object, comprising:
Obtain the list for calculating the calculating factor that the candidate hot value for preheating business object needs and the calculating factor pair
The weight answered, wherein each calculating factor pair answers the essential information of the target businessman, the business of target businessman letter
It ceases, the colleague businessman of the target businessman preheats business object to the hot value of the candidate preheating business object, the candidate
Attribute information information in any one information presupposed information item for including;
Determine each normalization numerical value for calculating the factor;
The normalization numerical value for calculating the factor each in the list for calculating the factor is weighted with corresponding weight and is asked
With obtain the target businessman to the hot value of the candidate preheating business object.
3. according to the method described in claim 2, it is characterized in that, each normalization numerical value for calculating the factor of the determination
The step of, comprising:
When the corresponding presupposed information item of the calculating factor is the essential information of the target businessman, pass through preset quotient
Family's system determines the numerical value of the corresponding presupposed information item of the calculating factor;
When the corresponding presupposed information item of the calculating factor is the business information of the target businessman, pass through preset industry
Business system determines the numerical value of the corresponding presupposed information item of the calculating factor;
When the colleague businessman that the corresponding presupposed information item of the calculating factor is the target businessman is to the candidate preheating
When the hot value of business object, the numerical value of the corresponding presupposed information item of the calculating factor is obtained by preset merchant system;
When the corresponding presupposed information item of the calculating factor is the attribute information of the candidate preheating business object, pass through
Preset configuration information determines the numerical value of the corresponding presupposed information item of the calculating factor;
The numerical value of the presupposed information item is normalized, the corresponding normalization numerical value for calculating the factor is obtained.
4. method according to any one of claims 1 to 3, which is characterized in that the acquisition calculates the candidate preheating industry
Be engaged in object the calculating factor that needs of hot value list and the calculating factor corresponding weight the step of, comprising:
By preset business object configuration information, obtains and calculate the calculating that the hot value of the candidate preheating business object needs
The list of the factor and the corresponding weight of the calculating factor.
5. a kind of data preheating device characterized by comprising
Current business object determining module, for obtaining the current business object of target businessman access;
Candidate's preheating business object determining module, for determining the corresponding candidate preheating business object of the current business object;
Candidate's preheating business object hot value determining module, for according to the self information of the target businessman of acquisition, described
The peer message of target businessman and the candidate preheat any one or more in the preset attribute information of business object, determine
Hot value of the target businessman to the candidate preheating business object;
Data warm-up block, the data of the candidate preheating business object for meeting preset condition to the hot value, holds
Row data warm-up operation.
6. device according to claim 5, which is characterized in that the candidate preheating business object hot value determining module into
One step includes:
It calculates the factor and weight determines submodule, by obtaining based on the hot value needs for calculating the candidate preheating business object
Calculate the list and the corresponding weight of the calculating factor of the factor, wherein each calculating factor pair answers the target businessman's
Essential information, the business information of the target businessman, the target businessman colleague businessman to the candidate preheating business object
Hot value, the candidate preheating business object attribute information information in any one information presupposed information item for including;
It calculates factor value and determines submodule, for determining each normalization numerical value for calculating the factor;
Hot value computational submodule, for described calculating the factor to each in the list for calculating the factor with corresponding weight
Normalization numerical value is weighted summation, obtains the target businessman to the hot value of the candidate preheating business object.
7. device according to claim 6, which is characterized in that the calculating factor value determines submodule, further wraps
It includes:
First calculates factor value determination unit, for being the target when the corresponding presupposed information item of the calculating factor
When the essential information of businessman, the numerical value of the corresponding presupposed information item of the calculating factor is determined by preset merchant system;
Second calculates factor value determination unit, for being the target when the corresponding presupposed information item of the calculating factor
When the business information of businessman, the numerical value of the corresponding presupposed information item of the calculating factor is determined by preset operation system;
Third calculates factor value determination unit, for being the target when the corresponding presupposed information item of the calculating factor
When the colleague businessman of businessman is to the candidate hot value for preheating business object, passes through preset merchant system and obtain the calculating
The numerical value of the corresponding presupposed information item of the factor;
4th calculates factor value determination unit, for being the candidate when the corresponding presupposed information item of the calculating factor
When preheating the attribute information of business object, the corresponding presupposed information item of the calculating factor is determined by preset configuration information
Numerical value;
Normalization unit is normalized for the numerical value to the presupposed information item, obtains the corresponding calculating factor
Normalization numerical value.
8. according to the described in any item devices of claim 5 to 7, which is characterized in that the calculating factor and weight determine submodule
Block is further used for:
By preset business object configuration information, obtains and calculate the calculating that the hot value of the candidate preheating business object needs
The list of the factor and the corresponding weight of the calculating factor.
9. a kind of electronic equipment, including memory, processor and it is stored on the memory and can runs on a processor
Computer program, which is characterized in that the processor realizes Claims 1-4 any one when executing the computer program
The data preheating method.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
The step of data preheating method described in Claims 1-4 any one is realized when execution.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810989079.3A CN109284236B (en) | 2018-08-28 | 2018-08-28 | Data preheating method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810989079.3A CN109284236B (en) | 2018-08-28 | 2018-08-28 | Data preheating method and device, electronic equipment and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109284236A true CN109284236A (en) | 2019-01-29 |
CN109284236B CN109284236B (en) | 2020-04-17 |
Family
ID=65184037
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810989079.3A Active CN109284236B (en) | 2018-08-28 | 2018-08-28 | Data preheating method and device, electronic equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109284236B (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111176560A (en) * | 2019-12-17 | 2020-05-19 | 腾讯科技(深圳)有限公司 | Cache management method and device, computer equipment and storage medium |
CN112099921A (en) * | 2020-09-27 | 2020-12-18 | 中国建设银行股份有限公司 | Java application system preheating method and system based on JVM |
CN115858418A (en) * | 2023-02-09 | 2023-03-28 | 成都有为财商教育科技有限公司 | Data caching method and system |
WO2023046059A1 (en) * | 2021-09-24 | 2023-03-30 | 中国第一汽车股份有限公司 | Cache warmup method and apparatus, and computer device and storage medium |
CN116016648A (en) * | 2022-12-28 | 2023-04-25 | 北京沃东天骏信息技术有限公司 | Service preheating method and device |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102521260A (en) * | 2011-11-18 | 2012-06-27 | 华为技术有限公司 | Data preheating method and device |
CN103309818A (en) * | 2012-03-09 | 2013-09-18 | 腾讯科技(深圳)有限公司 | Method and device for storing data |
CN104965793A (en) * | 2014-09-26 | 2015-10-07 | 浙江大华技术股份有限公司 | Cloud storage data node apparatus |
CN106021126A (en) * | 2016-05-31 | 2016-10-12 | 腾讯科技(深圳)有限公司 | Cache data processing method, server and configuration device |
CN106407210A (en) * | 2015-07-29 | 2017-02-15 | 阿里巴巴集团控股有限公司 | Display method and device of business object |
CN107291718A (en) * | 2016-03-30 | 2017-10-24 | 阿里巴巴集团控股有限公司 | Page resource put-on method and device |
CN107688443A (en) * | 2017-09-18 | 2018-02-13 | 郑州云海信息技术有限公司 | A kind of method of data storage, system and relevant apparatus |
CN107704573A (en) * | 2017-09-30 | 2018-02-16 | 山东浪潮通软信息科技有限公司 | A kind of intelligent buffer method coupled with business |
CN108062418A (en) * | 2018-01-05 | 2018-05-22 | 北京奇艺世纪科技有限公司 | A kind of data search method, device and server |
-
2018
- 2018-08-28 CN CN201810989079.3A patent/CN109284236B/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102521260A (en) * | 2011-11-18 | 2012-06-27 | 华为技术有限公司 | Data preheating method and device |
CN103309818A (en) * | 2012-03-09 | 2013-09-18 | 腾讯科技(深圳)有限公司 | Method and device for storing data |
CN104965793A (en) * | 2014-09-26 | 2015-10-07 | 浙江大华技术股份有限公司 | Cloud storage data node apparatus |
CN106407210A (en) * | 2015-07-29 | 2017-02-15 | 阿里巴巴集团控股有限公司 | Display method and device of business object |
CN107291718A (en) * | 2016-03-30 | 2017-10-24 | 阿里巴巴集团控股有限公司 | Page resource put-on method and device |
CN106021126A (en) * | 2016-05-31 | 2016-10-12 | 腾讯科技(深圳)有限公司 | Cache data processing method, server and configuration device |
CN107688443A (en) * | 2017-09-18 | 2018-02-13 | 郑州云海信息技术有限公司 | A kind of method of data storage, system and relevant apparatus |
CN107704573A (en) * | 2017-09-30 | 2018-02-16 | 山东浪潮通软信息科技有限公司 | A kind of intelligent buffer method coupled with business |
CN108062418A (en) * | 2018-01-05 | 2018-05-22 | 北京奇艺世纪科技有限公司 | A kind of data search method, device and server |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111176560A (en) * | 2019-12-17 | 2020-05-19 | 腾讯科技(深圳)有限公司 | Cache management method and device, computer equipment and storage medium |
CN111176560B (en) * | 2019-12-17 | 2022-02-18 | 腾讯科技(深圳)有限公司 | Cache management method and device, computer equipment and storage medium |
CN112099921A (en) * | 2020-09-27 | 2020-12-18 | 中国建设银行股份有限公司 | Java application system preheating method and system based on JVM |
WO2023046059A1 (en) * | 2021-09-24 | 2023-03-30 | 中国第一汽车股份有限公司 | Cache warmup method and apparatus, and computer device and storage medium |
CN116016648A (en) * | 2022-12-28 | 2023-04-25 | 北京沃东天骏信息技术有限公司 | Service preheating method and device |
CN115858418A (en) * | 2023-02-09 | 2023-03-28 | 成都有为财商教育科技有限公司 | Data caching method and system |
Also Published As
Publication number | Publication date |
---|---|
CN109284236B (en) | 2020-04-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
AU2020276284C1 (en) | Continuous data sensing of functional states of networked computing devices to determine efficiency metrics for servicing electronic messages asynchronously | |
CN109284236A (en) | Data preheating method, device, electronic equipment and storage medium | |
US10235430B2 (en) | Systems, methods, and apparatuses for detecting activity patterns | |
US8374912B2 (en) | System and method for managing and optimizing advertising campaigns managed on the internet | |
US10110687B2 (en) | Session based web usage reporter | |
CN108431852A (en) | Computer resource ranking for interconnected users profile | |
CN104765689B (en) | A kind of interface capability data supervise method and apparatus in real time | |
CN111079015A (en) | Recommendation method and device, computer equipment and storage medium | |
CN111917878A (en) | Message processing method, device, equipment and storage medium | |
CN108564462A (en) | Acquisition methods, terminal device and the medium of collage-credit data | |
CN113064866A (en) | Power business data integration system | |
CN113157947A (en) | Knowledge graph construction method, tool, device and server | |
CN108074033A (en) | Processing method, system, electronic equipment and the storage medium of achievement data | |
CN108132868A (en) | A kind of data monitoring method, device, computing device and storage medium | |
CN109858965A (en) | A kind of user identification method and system | |
CN109241084A (en) | Querying method, terminal device and the medium of data | |
CN114429364A (en) | Business data management method and device, storage medium and electronic equipment | |
CN107291539A (en) | Cluster program scheduler method based on resource significance level | |
CN109033173A (en) | It is a kind of for generating the data processing method and device of multidimensional index data | |
CN109711849B (en) | Ether house address portrait generation method and device, electronic equipment and storage medium | |
CN110990706B (en) | Corpus recommendation method and device | |
CN114595473A (en) | Access data processing method and device, electronic equipment and computer readable medium | |
CN105590232A (en) | Client relation generation method and apparatus, and electronic device | |
US9990599B1 (en) | Method and system for multidisciplinary research collaboration | |
CN102129455A (en) | Patent retrieval method and system based on cloud storage |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |