CN109284236A - Data preheating method, device, electronic equipment and storage medium - Google Patents

Data preheating method, device, electronic equipment and storage medium Download PDF

Info

Publication number
CN109284236A
CN109284236A CN201810989079.3A CN201810989079A CN109284236A CN 109284236 A CN109284236 A CN 109284236A CN 201810989079 A CN201810989079 A CN 201810989079A CN 109284236 A CN109284236 A CN 109284236A
Authority
CN
China
Prior art keywords
preheating
business object
candidate
factor
calculating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810989079.3A
Other languages
Chinese (zh)
Other versions
CN109284236B (en
Inventor
覃文讲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Sankuai Online Technology Co Ltd
Original Assignee
Beijing Sankuai Online Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sankuai Online Technology Co Ltd filed Critical Beijing Sankuai Online Technology Co Ltd
Priority to CN201810989079.3A priority Critical patent/CN109284236B/en
Publication of CN109284236A publication Critical patent/CN109284236A/en
Application granted granted Critical
Publication of CN109284236B publication Critical patent/CN109284236B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/08Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0877Cache access modes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/08Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0866Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061Improving I/O performance

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Thermotherapy And Cooling Therapy Devices (AREA)
  • Treatment Of Fiber Materials (AREA)

Abstract

Data preheating method disclosed in the embodiment of the present application, belongs to field of computer technology, solves the problems, such as that cache resources utilization rate is low when data preheating in the prior art.The described method includes: obtaining the current business object of target businessman access, determine the corresponding candidate preheating business object of the current business object, according to any one or more in the preset attribute information of the self information of the target businessman of acquisition, the peer message of the target businessman and the candidate preheating business object, determine the target businessman to the hot value of the candidate preheating business object, the data for meeting the candidate preheating business object of preset condition to the hot value, execute data warm-up operation.The application promotes the timeliness of data by the real-time behavior according to businessman, log-on data preheating.By in conjunction with merchant data determine businessman to the hot value of each business object, and select hot value meet preset condition business object carry out data preheating, caching can be saved.

Description

Data preheating method, device, electronic equipment and storage medium
Technical field
This application involves field of computer technology, more particularly to a kind of data preheating method, device, electronic equipment and deposit Storage media.
Background technique
Data preheating, refer to data in advance from disk buffering to memory in, when using data, reach and improve data and read Take the purpose of speed.Such as provide Business Information service, the general persistence of merchant data in the database (disk storage), when When receiving the request called by interface, can then it be returned the result from database retrieval Business Information.It is connect to promote request The performance of mouth often in memory Business Information caching in request, then can read businessman's letter directly from memory Breath, promotes whole reading performance.Existing data preheat scheme, are the precomputation based on full dose data and caching.Pass through Timed task scheduling, obtains the business datum of full dose;Distributed computing is carried out again, and the data after calculating are done into distribution and are deposited Storage.
Inventor by the prior art the study found that data preheating method in the prior art at least exist it is following lack Fall into: full dose data, which preheat, will cause the wastes of cache resources, and cache resources utilization rate is low, and timing loads data, data when Effect property is limited by loading cycle, it is understood that there may be the problem of data age difference.
Summary of the invention
The application provides a kind of data preheating method, helps to promote the efficiency of data preheating and the timeliness of warmable data Property.
In a first aspect, the embodiment of the present application provides a kind of data preheating method includes:
Obtain the current business object of target businessman access;
Determine the corresponding candidate preheating business object of the current business object;
According to the self information of the target businessman of acquisition, the peer message of the target businessman and the candidate preheating Any one or more in the preset attribute information of business object determines the target businessman to the candidate preheating business pair The hot value of elephant;
The data for meeting the candidate preheating business object of preset condition to the hot value, execute data preheating behaviour Make.
Second aspect, the embodiment of the present application provide a kind of data preheating device, comprising:
Current business object determining module, for obtaining the current business object of target businessman access;
Candidate's preheating business object determining module, for determining the corresponding candidate preheating business pair of the current business object As;
Candidate's preheating business object hot value determining module, for according to the self information of the target businessman of acquisition, The peer message of the target businessman and the candidate preheat any one or more in the preset attribute information of business object, Determine the target businessman to the hot value of the candidate preheating business object;
Data warm-up block, the number of the candidate preheating business object for meeting preset condition to the hot value According to execution data warm-up operation.
The third aspect the embodiment of the present application also provides a kind of electronic equipment, including memory, processor and is stored in institute The computer program that can be run on memory and on a processor is stated, the processor realizes this when executing the computer program Apply for data preheating method described in embodiment.
Fourth aspect, the embodiment of the present application provide a kind of computer readable storage medium, are stored thereon with computer journey Sequence, when which is executed by processor the step of data preheating method described in the embodiment of the present application.
Data preheating method provided by the embodiments of the present application, by obtaining the current business object of target businessman access, really The corresponding candidate preheating business object of the current business object is determined, according to the self information of the target businessman of acquisition, institute Any one or more in the peer message of target businessman and the preset attribute information of the candidate preheating business object is stated, really The fixed target businessman meets the time of preset condition to the hot value to the hot value of the candidate preheating business object The data of choosing preheating business object, execute data warm-up operation, and solving full dose data preheating in the prior art will cause caching The waste of resource, cache resources utilization rate is low, and, it is understood that there may be the problem of data age difference.The embodiment of the present application mentions The data preheating method of confession improves the timeliness of data preheating by the real-time behavior according to businessman, log-on data preheating.It is logical The associated data crossed in conjunction with businessman determines that businessman preheats the hot value of business object to each candidate, and it is default to select hot value to meet The candidate preheating business object of condition carries out data preheating, can save caching.
Detailed description of the invention
Technical solution in ord to more clearly illustrate embodiments of the present application, below will be in embodiment or description of the prior art Required attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is only some realities of the application Example is applied, it for those of ordinary skill in the art, without any creative labor, can also be attached according to these Figure obtains other attached drawings.
Fig. 1 is the data preheating method flow chart of the embodiment of the present application one;
Fig. 2 is the flow chart of the data preheating method of the embodiment of the present application two;
Fig. 3 is one of data preheating device structural schematic diagram of the embodiment of the present application three;
Fig. 4 is the second structural representation of the data preheating device of the embodiment of the present application three.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete Site preparation description, it is clear that described embodiment is some embodiments of the present application, instead of all the embodiments.Based on this Shen Please in embodiment, every other implementation obtained by those of ordinary skill in the art without making creative efforts Example, shall fall in the protection scope of this application.
Embodiment one
A kind of data preheating method provided by the embodiments of the present application, as shown in Figure 1, this method comprises: step 110 is to step 140。
Step 110, the current business object of target businessman access is obtained.
Business object in the embodiment of the present application can be understood as the functional module of application.
In some embodiments of the present application, the business object of server-side is accessed by monitoring and analyzing target businessman in real time Address, can determine the current business object of target businessman access.For example, target businessman is in client operation, meeting Http request is sent to server-side in real time, the merchant identification of the target businessman is carried in http request information, businessman asks Ask path, the information such as request operation content of businessman.After server-side receives the http request, parses the http and ask It asks, feeds back to the corresponding data of request path described in the client, and store the merchant identification and request path, request behaviour Make access log of the information such as content as businessman.Then, by analyzing the access log of the businessman, the target quotient is determined The current business object of family's access, such as a comment functional module to be replied of comment application.
Step 120, the corresponding candidate preheating business object of the current business object is determined.
For the functional module of application, using each functional module as entrance, it can enter at least one other Functional module.For example, sales volume enquiry module, information collocation module, comment processing can be entered by homepage for hotel service Module.That is, each business object can correspond at least one candidate's preheating business object.The candidate preheats business object Other business objects that can be entered by the business object.In embodiments herein, which some business object corresponds to Candidate's preheating business object is pre-defined according to business demand.
Step 130, according to the self information of the target businessman of acquisition, the peer message of the target businessman and described Candidate preheats any one or more in the preset attribute information of business object, determines the target businessman to described candidate pre- The hot value of hot business object.
In some embodiments of the present application, target businessman, the target businessman the colleague businessmans such as businessman itself letter Breath includes at least the essential information and business information of businessman.Wherein, essential information is stored in merchant system, further comprises: Merchant identification, shops's grade, shops's mark, shops's type, shops's information, urban sign, commercial circle mark, calculated businessman couple The hot value etc. of business object.Business information storage further comprises from operation system: sales volume information, evaluation information, Product information etc., such as: including order sales volume, evaluation score, review number to be replied, product number can be sold.
In some embodiments of the present application, it can be arranged previously according to business demand and calculate businessman to some business object Hot value when Business Information in need of consideration specific type and the corresponding calculating weight of a certain specifying information;Then, according to The type of the hot value Business Information in need of consideration of some business object is calculated, obtains corresponding letter to corresponding data service system Breath, and according to the hot value of the information and the corresponding weight calculation business object that get.
Step 140, the data that the candidate preheating business object of preset condition is met to the hot value, execute data Warm-up operation.
In some embodiments of the present application, hot value threshold value, the preset condition can be preset are as follows: the target Businessman is greater than the hot value threshold value to the hot value of candidate preheating business object.That is, to the target businessman to each candidate The hot value of preheating business object is judged respectively, if the target businessman is to the heat of some candidate's preheating business object A Angle value is greater than the hot value threshold value, then it is assumed that and a possibility that target businessman preheats business object A into the candidate is larger, Then the data that the candidate preheats business object A are loaded into caching in advance and do data preheating.
Data preheating method provided by the embodiments of the present application, by obtaining the current business object of target businessman access, really The corresponding candidate preheating business object of the current business object is determined, according to the self information of the target businessman of acquisition, institute Any one or more in the peer message of target businessman and the preset attribute information of the candidate preheating business object is stated, really The fixed target businessman meets the time of preset condition to the hot value to the hot value of the candidate preheating business object The data of choosing preheating business object, execute data warm-up operation, and solving full dose data preheating in the prior art will cause caching The waste of resource, cache resources utilization rate is low, and, it is understood that there may be the problem of data age difference.The embodiment of the present application mentions The data preheating method of confession determines candidate preheating business object by the real-time behavior according to businessman, and further combined with businessman Associated data determine that businessman to the hot value of each candidate preheating business object, and selects hot value to meet the candidate of preset condition It preheats business object and carries out data preheating, caching can be saved.Simultaneously as according to the operation real-time perfoming data of target businessman Preheating, therefore the timeliness of data can be promoted.
Embodiment two
The embodiment of the present application provides a kind of data preheating method, as shown in Fig. 2, this method comprises: step 210 is to step 270。
Step 210, the current business object of target businessman access is obtained.
Business object in the embodiment of the present application can be understood as the functional module of application.
In some embodiments of the present application, the business object of server-side is accessed by monitoring and analyzing target businessman in real time Address, can determine the current business object of target businessman access.In some embodiments of the present application, the acquisition The step of current business object of target businessman access, comprising: by analyzing the access log of target businessman, obtain the target The real-time operation information of businessman's current accessed;Determine the requested service object in the real-time operation information as current business pair As.
In a distributed manner for service cluster, target businessman is in client operation, by http agreement in network layer and clothes Being engaged in, end is interactive, and network can be routed to specific service by Nginx.Nginx has recorded all solicited messages, and information is sent Summarize to unified collect of kafka.Because Nginx belongs to cluster service, need to report the daily record data of all clusters to kafka, It just can ensure that processing information integrity in this way.Since kafka has the characteristics of height is handled up, the access day of businessman can be collected in real time Will.In some embodiments of the present application, Nginx report to kafka log may include: target businessman merchant identification, Address of service, request operation content, access time, access path of access etc..Kafka after being collected into all access logs, The access log that will be collected into uniformly pushes to real time data processing service storm, the parsing of mass data is done by storm.
Storm obtains the default key message in every log by the way that every daily record data is converted into json format, Then, by regular expression, it is accurately identified the real-time operation information of target businessman.For example, every daily record data is converted into After json formatted data, following key message: the service of Merchant ID information (including merchant identification), current request can be extracted Address, current request service module and parameter.In a large amount of daily record data, how to parse and match the module datas of needs and be One key.In this very light some embodiment, each module has fixed request address, can be solved by regular expression The request module information in every log is precipitated.
After parsing obtains the current request module information of the target businessman, by message mechanism by the target businessman And the current request module information of the target businessman is pushed to message system, is listened to by each system service by message system The current real-time operation information of target businessman.Each system service can be by the real-time operation of the target businessman listened to Requested service object in information is as current business object.
By analyzing the access log of target businessman, the real-time operation information of the target businessman current accessed is obtained;And When determining the requested service object in the real-time operation information as current business object, the timeliness for obtaining data can be promoted Property, an only step promotes the timeliness of data preheating.
Step 220, the corresponding candidate preheating business object of the current business object is determined.
Determine the specific embodiment of the corresponding candidate preheating business object of the current business object referring to embodiment one, This embodiment is not repeated.In the present embodiment, it is assumed that current business object is comment module, and determining current business object is corresponding Candidate preheating business object include: to reply comment module, Business Information editor module, homepage.
Step 230, list and the institute of the calculating factor of hot value needs for calculating the candidate preheating business object are obtained It states and calculates the corresponding weight of the factor.
Wherein, each calculating factor pair answers the essential information of the target businessman, the business of target businessman letter It ceases, the colleague businessman of the target businessman preheats business object to the hot value of the candidate preheating business object, the candidate Attribute information information in any one information presupposed information item for including.For example, a certain base for calculating factor corresponding merchant Shops's grade in this information.
In some embodiments of the present application, the self information includes essential information and business information, colleague's letter Breath is the essential information and the business information of the colleague businessman of the target businessman, and the essential information further comprises The hot value to business object that history calculates;The self information of the target businessman according to acquisition, the target quotient The peer message of family and the candidate preheat any one or more in the preset attribute information of business object, determine the mesh The step of marking hot value of the businessman to the candidate preheating business object, comprising: obtain and calculate the candidate preheating business object Hot value need the calculating factor list and the corresponding weight of the calculating factor, wherein each calculating factor pair Answer the essential information of the target businessman, the business information of the target businessman, the target businessman colleague businessman to described Any one packet in the information of the attribute information of the hot value of candidate's preheating business object, the candidate preheating business object The presupposed information item included;Determine each normalization numerical value for calculating the factor;With corresponding weight to the calculating factor Each normalization numerical value for calculating the factor is weighted summation in list, obtains the target businessman to the candidate preheating The hot value of business object.
In some embodiments of the present application, the essential information includes: merchant identification, and it is following any one or it is more A item of information: the items of information such as commercial circle mark, urban sign, shops's type, shops's grade;The business information includes: order letter The items of information such as breath, sales volume information, comment information;Whether the attribute information of business object includes: whether nucleus module, pushes away in operation Extensively, whether there are the items of information such as new hand's guidance.
In some embodiments of the present application, each business object, which is previously provided with, calculates businessman to the heat of the business object The required configured list for calculating the factor (classification for the information for needing to rely on), further includes every in the configured list when angle value The corresponding weight of a calculating factor.In the embodiment of the present application when it is implemented, by preset business object configuration information, obtain Calculate the list and the corresponding weight of the calculating factor of the calculating factor of the hot value needs of the candidate preheating business object. For example, available to the calculating candidate preheating business object by configuration information -- reply the meter of the hot value of comment module Calculating includes 5 calculating factors in the list of the factor, and the 5 calculating factor respectively corresponds: shops's grade, colleague businessman are to reply It comments on the hot value of module, comment number, attribute information wait reply comment number, difference, wherein the corresponding weight of shops's grade is 0.05, colleague businessman is 0.2 to the corresponding weight of hot value for replying comment module, is wait reply the corresponding weight of comment number 0.4, it is 0,2 that difference, which comments several corresponding weights, and the corresponding weight of the attribute information is 0.8.When it is implemented, can be according to business The configuration information of business object is arranged in demand, then, it is carried out according to the hot value that the calculating factor and weight calculation of configuration obtain Business object preheating, is more in line with the demand of promoting service, facilitates the retention ratio, the conversion ratio that promote each business module.
Step 240, the numerical value for calculating the corresponding presupposed information item of the factor is obtained.
After the calculating factor required for the hot value for calculating each candidate preheating business object and weight has been determined, into One step determines each normalization numerical value for calculating the factor.In some embodiments of the present application, the determination is each described The step of calculating the normalization numerical value of the factor, comprising: obtain the numerical value for calculating the corresponding presupposed information item of the factor;To described The numerical value of presupposed information item is normalized, and obtains the corresponding normalization numerical value for calculating the factor.Wherein, described in acquisition The numerical value for calculating the corresponding presupposed information item of the factor further comprises: when the corresponding presupposed information item of the calculating factor is When the essential information of the target businessman, the corresponding presupposed information item of the calculating factor is determined by preset merchant system Numerical value;When the corresponding presupposed information item of the calculating factor is the business information of the target businessman, by preset Operation system determines the numerical value of the corresponding presupposed information item of the calculating factor;When the corresponding default letter of the calculating factor When breath item is that the colleague businessman of the target businessman preheats the hot value of business object to the candidate, pass through preset businessman system System obtains the numerical value for calculating the corresponding presupposed information item of the factor;When the corresponding presupposed information item of the calculating factor is When the attribute information of the candidate preheating business object, determine that the calculating factor is corresponding default by preset configuration information The numerical value of item of information;The numerical value of the presupposed information item is normalized, the corresponding normalizing for calculating the factor is obtained Change numerical value.
It include: to reply comment module, Business Information volume with candidate's preheating business object in some embodiments of the present application For collecting module, homepage, when calculating the target businessman A to the hot value for replying comment module, it is assumed that determine described in calculating Calculating factor pair needed for replying the hot value of comment module is answered: shops's grade, colleague businessman are to the temperature for replying comment module Value comments number, attribute information wait reply comment number, difference, wherein the corresponding weight of shops's grade is 0.05, and go together businessman couple The corresponding weight of hot value for replying comment module is 0.2, is 0.4 wait reply the corresponding weight of comment number, difference is commented several corresponding Weight is 0,2, and the corresponding weight of the attribute information is 0.8, then firstly the need of obtaining the corresponding information of the calculating factor.
For the present embodiment, shops's grade is therefore the essential information of target businessman can pass through businessman System obtains the essential information of the target businessman, further determines that shops's grade of the target businessman.Wherein, described basic Information may include: merchant identification, commercial circle mark, urban sign, shops's type, shops's grade, calculated businessman to business The hot value of object.Therefore the colleague businessman can pass through the essential information that the hot value for replying comment module is businessman Merchant system obtains the calculated businessman that includes in the essential information of the target businessman to the hot value of business object.Specifically When implementation, the interface of merchant system is called by the merchant identification for the businessman that goes together, and can be obtained the basic letter of the colleague businessman The hot value of breath, such as calculated colleague businessman to current candidate preheating business object.The essential information of the colleague businessman The businessman of system is belonged to the target businessman, the essential information with the same category.
It is described to comment number to belong to business datum wait reply comment number, difference in the present embodiment, it can pass through the target businessman's Merchant identification calls the interface of operation system, can be obtained the business information of the target businessman, it can get the mesh Mark businessman's comments on number, the poor value for commenting the items of information such as number wait reply.In some implementations of the application, the business information packet It includes: the items of information such as order information, sales volume information, comment information, wherein each item of information can also include the letter more segmented Cease item.For example, order information can further include conclusion of the business quantity on order item of information, quantity information item etc. of cancelling an order.
In some embodiments of the present application, the attribute information of the business object include: whether nucleus module, whether Operation is promoted, whether has the items of information such as new hand's guidance.For the present embodiment, each candidate preheating business object is being configured It is previously provided with attribute information in information, is believed by the attribute of the available candidate preheating business object of preset configuration information Breath.For example, getting the attribute information for replying comment module are as follows: (1,0,1), i.e., the described reply comment module is core mould Block is not promoted in operation, there is new hand's guidance.
When the calculating factor pair answers the colleague businessman of the target businessman to the hot value for preheating business object, First according to include in the essential information of the target businessman commercial circle mark, urban sign, shops's type, in shops's grade The colleague businessman of any one or more determination target businessman.Then, the basic letter of the colleague businessman is further determined that Breath.In some embodiments of the present application, if precalculating the colleague businessman to the candidate preheating business object Hot value then can directly obtain the colleague businessman to the candidate preheating business from the essential information of the colleague businessman The hot value of object.If not calculating the hot value that the colleague businessman preheats business object to the candidate in advance, 0 can be set by hot value of the colleague businessman to the candidate preheating business object, alternatively, according to the colleague businessman Essential information, business information, the preset attribute information of the candidate preheating business object calculate the colleague businessman couple in real time The hot value of the candidate preheating business object.According to the essential information of the colleague businessman, business information, the candidate preheating The preset attribute information of business object calculates the colleague businessman to the tool of the hot value of the candidate preheating business object in real time Body embodiment is referring to the calculating target businessman to the specific embodiment of the hot value of the candidate preheating business object, area Other point is not consider the information of the colleague businessman of the colleague businessman.
Step 250, the numerical value of the presupposed information item is normalized, obtains returning for the corresponding calculating factor One changes numerical value.
In some embodiments of the present application, the corresponding mesh of the calculating factor is being obtained by merchant system and operation system Mark the essential information of businessman, business information, the attribute information of candidate preheating business object, the target businessman colleague businessman The hot value to the candidate preheating business object being computed, has different dimensions, therefore, it is also desirable to the calculating Factor pair some or all of answers the numerical value of item of information to be normalized, to guarantee the corresponding data quilt of each calculating factor Fair play promotes the accuracy for the hot value being calculated.
For example, for will comment number be replied by formula x '=(x-min)/(max-min) wait reply comment number x ' It normalizes in the section of (0,1), wherein min indicates the minimum value in x constant interval, and max is indicated in x constant interval most Big value.Later, by it is described wait reply comment number normalized after numerical value, as wait reply comment number normalization numerical value, For calculating hot value.For another example hotel's grade is divided into 7 kinds by merchant system, it is expressed as 1-7, numerical value is higher, represent etc. Grade is higher.1 represents general economic type, 7 represent it is high star-like, if the numerical value that shops's class information of target businessman is thought is 2, After normalized, the normalization numerical value of shops's grade is (2-1)/(7-1)=0.16667.
Step 260, with corresponding weight to the normalization number for calculating the factor each in the list for calculating the factor Value is weighted summation, obtains the target businessman to the hot value of the candidate preheating business object.
It, can be with after determining the corresponding normalization numerical value of each calculating factor in some embodiments of the present application Individual event of each product for calculating the corresponding weight of factor normalization numerical value corresponding with the calculating factor as the calculating factor Then the individual event hot value for calculating the factor each in the list for calculating the factor is added up, is obtained cumulative by hot value Sum as the target businessman to the hot value of the candidate preheating business object.
For the present embodiment, if calculate it is described reply comment module hot value needed for 5 calculate because Son --- shops's grade, colleague businessman are to replying the hot value of comment module, comment several and attribute information pair wait reply comment number, difference The normalization numerical value answered is respectively as follows: 0.16667,0.01,0.32,0.02 and 0.8, and the corresponding weight of shops's grade is 0.05, colleague businessman is 0.2 to the corresponding weight of hot value for replying comment module, is wait reply the corresponding weight of comment number 0.4, it is 0,2 that difference, which comments several corresponding weights, and the corresponding weight of the attribute information is 0.8, then the target businessman is to described time The hot value reexamined by module are as follows:
0.16667*0.05+0.01*0.2+0.32*0.4+0.02*0.2+0.8*0.8=3.5417.
Step 270, the data that the candidate preheating business object of preset condition is met to the hot value, execute data Warm-up operation.
In some embodiments of the present application, hot value threshold value, the preset condition can be preset are as follows: the target Businessman is greater than the hot value threshold value to the hot value of candidate preheating business object.That is, to the target businessman to each candidate The hot value of preheating business object is judged respectively, if the target businessman is to the heat of some candidate's preheating business object A Angle value is greater than the hot value threshold value, then it is assumed that and a possibility that target businessman preheats business object A into the candidate is larger, Then the data that the candidate preheats business object A are loaded into caching in advance and do data preheating.For example, the target businessman is to institute State candidate preheating business object --- reply comment module, Business Information editor module, homepage hot value be respectively as follows: 3.5417,0.75,2.675, if preset heat value threshold value is 2.0, hot value meets the candidate preheating of preset condition Business object includes: to reply comment module and homepage, therefore, the data for replying comment module and homepage is loaded previously into caching In.
When target businessman, which accesses, replys comment module or homepage, the loading module data directly from caching can be quick Respond the demand of businessman.
Merchant system and operation system in the embodiment of the present application are to provide the existing system of businessman's data service, support with Merchant identification is called as the interface of parameter, and specific embodiment, details are not described herein again.
Data preheating method provided by the embodiments of the present application, by obtaining the current business object of target businessman access, really Determine the corresponding candidate preheating business object of the current business object further to obtain and calculate candidate's preheating business pair The list and the corresponding weight of the calculating factor for the calculating factor that the hot value of elephant needs, then obtain the calculating factor pair The normalization numerical value for the presupposed information item answered, and with corresponding weight to it is described calculate the factor list in each calculating because The normalization numerical value of son is weighted summation, obtains the target businessman to the hot value of the candidate preheating business object, most Afterwards, the data that the candidate preheating business object of preset condition is met to the hot value, execute data warm-up operation, solve The preheating of full dose data will cause the waste of cache resources in the prior art, and cache resources utilization rate is low, and, it is understood that there may be The problem of data age difference.Data preheating method provided by the embodiments of the present application is determined by the real-time behavior according to businessman Candidate's preheating business object, and determine businessman to the temperature of each candidate preheating business object further combined with the associated data of businessman Value, and the candidate preheating business object for selecting hot value to meet preset condition carries out data preheating, can save caching.Meanwhile Due to preheating according to the operation real-time perfoming data of target businessman, the timeliness of data can be promoted.Also, due to temperature The calculating of value uses the information of the self information of target businessman and the businessman that goes together, and can promote the standard for the hot value being calculated True property.It can be same according to it for the new businessman of not historical data using data preheating method disclosed in the embodiment of the present application The information of family of doing business determines the new businessman to the hot value of candidate preheating business object, to realize the preheating of new merchant data.
Data preheating method provided by the embodiments of the present application (has been stored using some historical datas of businessman based on system Access data, business datum, Business Information), colleague data (same to city, same to commercial circle, same type businessman interest characteristics result Value) businessman is constructed to the interest characteristics of some functional module, wherein and the interest characteristics are exactly hot value described herein, The efficiency of data preheating can be promoted with the interested functional module of Accurate Prediction target businessman.
Embodiment three
The embodiment of the present application provides a kind of data preheating device, as shown in figure 3, described device includes:
Current business object determining module 310, for obtaining the current business object of target businessman access;
Candidate's preheating business object determining module 320, for determining the corresponding candidate preheating industry of the current business object Business object;
Candidate's preheating business object hot value determining module 330, for itself letter according to the target businessman of acquisition In the preset attribute information of breath, the peer message of the target businessman and the candidate preheating business object any one or it is more Kind, determine the target businessman to the hot value of the candidate preheating business object;
Data warm-up block 340, the candidate for meeting preset condition to the hot value preheat business object Data execute data warm-up operation.
Optionally, as shown in figure 4, the candidate preheating business object hot value determining module 330 further comprises:
It calculates the factor and weight determines submodule 3301, for obtaining the hot value for calculating the candidate preheating business object The list of the calculating factor needed and the corresponding weight of the calculating factor, wherein each calculating factor pair answers the mesh Mark the essential information of businessman, the business information of the target businessman, the target businessman colleague businessman candidate preheated to described What any one information included in the information of the attribute information of the hot value of business object, the candidate preheating business object is default Item of information;
It calculates factor value and determines submodule 3302, for determining each normalization numerical value for calculating the factor;
Hot value computational submodule 3303, by by corresponding weight to it is described calculate the factor list in it is each it is described in terms of The normalization numerical value for calculating the factor is weighted summation, obtains the target businessman to the temperature of the candidate preheating business object Value.
Optionally, as shown in figure 4, the calculating factor value determines submodule 3302, further comprise:
First calculates factor value determination unit 33021, for working as the corresponding presupposed information item of the calculating factor For the target businessman essential information when, the corresponding presupposed information item of the calculating factor is determined by preset merchant system Numerical value;
Second calculates factor value determination unit 33022, for working as the corresponding presupposed information item of the calculating factor For the target businessman business information when, the corresponding presupposed information item of the calculating factor is determined by preset operation system Numerical value;
Third calculates factor value determination unit 33023, for working as the corresponding presupposed information item of the calculating factor When preheating the hot value of business object to the candidate for the colleague businessman of the target businessman, obtained by preset merchant system Take the numerical value of the corresponding presupposed information item of the calculating factor;
4th calculates factor value determination unit 33024, for working as the corresponding presupposed information item of the calculating factor When preheating the attribute information of business object for the candidate, determine that the calculating factor is corresponding pre- by preset configuration information If the numerical value of item of information;
Normalization unit 33025 is normalized for the numerical value to the presupposed information item, obtains corresponding described Calculate the normalization numerical value of the factor.
Optionally, the calculating factor and weight determine that submodule 3301 is further used for:
By preset business object configuration information, the hot value needs for calculating the candidate preheating business object are obtained Calculate the list and the corresponding weight of the calculating factor of the factor.
Optionally, the current business object determining module 310, is further used for:
By analyzing the access log of target businessman, the real-time operation information of the target businessman current accessed is obtained;
Determine the requested service object in the real-time operation information as current business object.
Data preheating device is disclosed in the embodiment of the present application for realizing data preheating side described in the embodiment of the present application Method, each module, submodule and the unit of described device, for realizing the corresponding steps of the method, each module, submodule and list The specific embodiment of member is referring to the corresponding steps of method part, and details are not described herein again.
Data preheating device provided by the embodiments of the present application, by obtaining the current business object of target businessman access, really The corresponding candidate preheating business object of the current business object is determined, according to the self information of the target businessman of acquisition, institute Any one or more in the peer message of target businessman and the preset attribute information of the candidate preheating business object is stated, really The fixed target businessman meets the time of preset condition to the hot value to the hot value of the candidate preheating business object The data of choosing preheating business object, execute data warm-up operation, and solving full dose data preheating in the prior art will cause caching The waste of resource, cache resources utilization rate is low, and, it is understood that there may be the problem of data age difference.The embodiment of the present application mentions The data preheating device of confession determines candidate preheating business object by the real-time behavior according to businessman, and further combined with businessman Associated data determine that businessman to the hot value of each candidate preheating business object, and selects hot value to meet the candidate of preset condition It preheats business object and carries out data preheating, caching can be saved.Simultaneously as according to the operation real-time perfoming data of target businessman Preheating, therefore the timeliness of data can be promoted.
Also, since the calculating of hot value uses the information of the self information of target businessman and the businessman that goes together, Ke Yiti Rise the accuracy for the hot value being calculated.Using data preheating device disclosed in the embodiment of the present application, for no history number According to new businessman, can be determined according to its information for going together businessman the new businessman to the hot value of candidate preheating business object, from And realize the preheating of new merchant data.
Correspondingly, present invention also provides a kind of electronic equipment, including memory, processor and it is stored in the memory Computer program that is upper and can running on a processor, the processor are realized when executing the computer program as the application is real Apply data preheating method described in example one and embodiment two.The electronic equipment can help for PC machine, mobile terminal, individual digital Reason, tablet computer etc..
Present invention also provides a kind of computer readable storage mediums, are stored thereon with computer program, which is located Manage the step of realizing the data preheating method as described in the embodiment of the present application one and embodiment two when device executes.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.For Installation practice For, since it is basically similar to the method embodiment, so being described relatively simple, referring to the portion of embodiment of the method in place of correlation It defends oneself bright.
A kind of data preheating method provided by the present application and device are described in detail above, tool used herein The principle and implementation of this application are described for body example, the above embodiments are only used to help understand this Shen Method and its core concept please;At the same time, for those skilled in the art, according to the thought of the application, specific real Apply in mode and application range that there will be changes, in conclusion the content of the present specification should not be construed as the limit to the application System.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can It realizes by means of software and necessary general hardware platform, naturally it is also possible to pass through hardware realization.Based on such reason Solution, substantially the part that contributes to existing technology can embody above-mentioned technical proposal in the form of software products in other words Come, which may be stored in a computer readable storage medium, such as ROM/RAM, magnetic disk, CD, including Some instructions are used so that a computer equipment (can be personal computer, server or the network equipment etc.) executes respectively Method described in certain parts of a embodiment or embodiment.

Claims (10)

1. a kind of data preheating method characterized by comprising
Obtain the current business object of target businessman access;
Determine the corresponding candidate preheating business object of the current business object;
According to the self information of the target businessman of acquisition, the peer message of the target businessman and the candidate preheating business Any one or more in the preset attribute information of object determines the target businessman to the candidate preheating business object Hot value;
The data for meeting the candidate preheating business object of preset condition to the hot value, execute data warm-up operation.
2. the method according to claim 1, wherein itself letter of the target businessman according to acquisition In the preset attribute information of breath, the peer message of the target businessman and the candidate preheating business object any one or it is more Kind, determine the step of target businessman is to the candidate hot value for preheating business object, comprising:
Obtain the list for calculating the calculating factor that the candidate hot value for preheating business object needs and the calculating factor pair The weight answered, wherein each calculating factor pair answers the essential information of the target businessman, the business of target businessman letter It ceases, the colleague businessman of the target businessman preheats business object to the hot value of the candidate preheating business object, the candidate Attribute information information in any one information presupposed information item for including;
Determine each normalization numerical value for calculating the factor;
The normalization numerical value for calculating the factor each in the list for calculating the factor is weighted with corresponding weight and is asked With obtain the target businessman to the hot value of the candidate preheating business object.
3. according to the method described in claim 2, it is characterized in that, each normalization numerical value for calculating the factor of the determination The step of, comprising:
When the corresponding presupposed information item of the calculating factor is the essential information of the target businessman, pass through preset quotient Family's system determines the numerical value of the corresponding presupposed information item of the calculating factor;
When the corresponding presupposed information item of the calculating factor is the business information of the target businessman, pass through preset industry Business system determines the numerical value of the corresponding presupposed information item of the calculating factor;
When the colleague businessman that the corresponding presupposed information item of the calculating factor is the target businessman is to the candidate preheating When the hot value of business object, the numerical value of the corresponding presupposed information item of the calculating factor is obtained by preset merchant system;
When the corresponding presupposed information item of the calculating factor is the attribute information of the candidate preheating business object, pass through Preset configuration information determines the numerical value of the corresponding presupposed information item of the calculating factor;
The numerical value of the presupposed information item is normalized, the corresponding normalization numerical value for calculating the factor is obtained.
4. method according to any one of claims 1 to 3, which is characterized in that the acquisition calculates the candidate preheating industry Be engaged in object the calculating factor that needs of hot value list and the calculating factor corresponding weight the step of, comprising:
By preset business object configuration information, obtains and calculate the calculating that the hot value of the candidate preheating business object needs The list of the factor and the corresponding weight of the calculating factor.
5. a kind of data preheating device characterized by comprising
Current business object determining module, for obtaining the current business object of target businessman access;
Candidate's preheating business object determining module, for determining the corresponding candidate preheating business object of the current business object;
Candidate's preheating business object hot value determining module, for according to the self information of the target businessman of acquisition, described The peer message of target businessman and the candidate preheat any one or more in the preset attribute information of business object, determine Hot value of the target businessman to the candidate preheating business object;
Data warm-up block, the data of the candidate preheating business object for meeting preset condition to the hot value, holds Row data warm-up operation.
6. device according to claim 5, which is characterized in that the candidate preheating business object hot value determining module into One step includes:
It calculates the factor and weight determines submodule, by obtaining based on the hot value needs for calculating the candidate preheating business object Calculate the list and the corresponding weight of the calculating factor of the factor, wherein each calculating factor pair answers the target businessman's Essential information, the business information of the target businessman, the target businessman colleague businessman to the candidate preheating business object Hot value, the candidate preheating business object attribute information information in any one information presupposed information item for including;
It calculates factor value and determines submodule, for determining each normalization numerical value for calculating the factor;
Hot value computational submodule, for described calculating the factor to each in the list for calculating the factor with corresponding weight Normalization numerical value is weighted summation, obtains the target businessman to the hot value of the candidate preheating business object.
7. device according to claim 6, which is characterized in that the calculating factor value determines submodule, further wraps It includes:
First calculates factor value determination unit, for being the target when the corresponding presupposed information item of the calculating factor When the essential information of businessman, the numerical value of the corresponding presupposed information item of the calculating factor is determined by preset merchant system;
Second calculates factor value determination unit, for being the target when the corresponding presupposed information item of the calculating factor When the business information of businessman, the numerical value of the corresponding presupposed information item of the calculating factor is determined by preset operation system;
Third calculates factor value determination unit, for being the target when the corresponding presupposed information item of the calculating factor When the colleague businessman of businessman is to the candidate hot value for preheating business object, passes through preset merchant system and obtain the calculating The numerical value of the corresponding presupposed information item of the factor;
4th calculates factor value determination unit, for being the candidate when the corresponding presupposed information item of the calculating factor When preheating the attribute information of business object, the corresponding presupposed information item of the calculating factor is determined by preset configuration information Numerical value;
Normalization unit is normalized for the numerical value to the presupposed information item, obtains the corresponding calculating factor Normalization numerical value.
8. according to the described in any item devices of claim 5 to 7, which is characterized in that the calculating factor and weight determine submodule Block is further used for:
By preset business object configuration information, obtains and calculate the calculating that the hot value of the candidate preheating business object needs The list of the factor and the corresponding weight of the calculating factor.
9. a kind of electronic equipment, including memory, processor and it is stored on the memory and can runs on a processor Computer program, which is characterized in that the processor realizes Claims 1-4 any one when executing the computer program The data preheating method.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor The step of data preheating method described in Claims 1-4 any one is realized when execution.
CN201810989079.3A 2018-08-28 2018-08-28 Data preheating method and device, electronic equipment and storage medium Active CN109284236B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810989079.3A CN109284236B (en) 2018-08-28 2018-08-28 Data preheating method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810989079.3A CN109284236B (en) 2018-08-28 2018-08-28 Data preheating method and device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN109284236A true CN109284236A (en) 2019-01-29
CN109284236B CN109284236B (en) 2020-04-17

Family

ID=65184037

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810989079.3A Active CN109284236B (en) 2018-08-28 2018-08-28 Data preheating method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN109284236B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111176560A (en) * 2019-12-17 2020-05-19 腾讯科技(深圳)有限公司 Cache management method and device, computer equipment and storage medium
CN112099921A (en) * 2020-09-27 2020-12-18 中国建设银行股份有限公司 Java application system preheating method and system based on JVM
CN115858418A (en) * 2023-02-09 2023-03-28 成都有为财商教育科技有限公司 Data caching method and system
WO2023046059A1 (en) * 2021-09-24 2023-03-30 中国第一汽车股份有限公司 Cache warmup method and apparatus, and computer device and storage medium
CN116016648A (en) * 2022-12-28 2023-04-25 北京沃东天骏信息技术有限公司 Service preheating method and device

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102521260A (en) * 2011-11-18 2012-06-27 华为技术有限公司 Data preheating method and device
CN103309818A (en) * 2012-03-09 2013-09-18 腾讯科技(深圳)有限公司 Method and device for storing data
CN104965793A (en) * 2014-09-26 2015-10-07 浙江大华技术股份有限公司 Cloud storage data node apparatus
CN106021126A (en) * 2016-05-31 2016-10-12 腾讯科技(深圳)有限公司 Cache data processing method, server and configuration device
CN106407210A (en) * 2015-07-29 2017-02-15 阿里巴巴集团控股有限公司 Display method and device of business object
CN107291718A (en) * 2016-03-30 2017-10-24 阿里巴巴集团控股有限公司 Page resource put-on method and device
CN107688443A (en) * 2017-09-18 2018-02-13 郑州云海信息技术有限公司 A kind of method of data storage, system and relevant apparatus
CN107704573A (en) * 2017-09-30 2018-02-16 山东浪潮通软信息科技有限公司 A kind of intelligent buffer method coupled with business
CN108062418A (en) * 2018-01-05 2018-05-22 北京奇艺世纪科技有限公司 A kind of data search method, device and server

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102521260A (en) * 2011-11-18 2012-06-27 华为技术有限公司 Data preheating method and device
CN103309818A (en) * 2012-03-09 2013-09-18 腾讯科技(深圳)有限公司 Method and device for storing data
CN104965793A (en) * 2014-09-26 2015-10-07 浙江大华技术股份有限公司 Cloud storage data node apparatus
CN106407210A (en) * 2015-07-29 2017-02-15 阿里巴巴集团控股有限公司 Display method and device of business object
CN107291718A (en) * 2016-03-30 2017-10-24 阿里巴巴集团控股有限公司 Page resource put-on method and device
CN106021126A (en) * 2016-05-31 2016-10-12 腾讯科技(深圳)有限公司 Cache data processing method, server and configuration device
CN107688443A (en) * 2017-09-18 2018-02-13 郑州云海信息技术有限公司 A kind of method of data storage, system and relevant apparatus
CN107704573A (en) * 2017-09-30 2018-02-16 山东浪潮通软信息科技有限公司 A kind of intelligent buffer method coupled with business
CN108062418A (en) * 2018-01-05 2018-05-22 北京奇艺世纪科技有限公司 A kind of data search method, device and server

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111176560A (en) * 2019-12-17 2020-05-19 腾讯科技(深圳)有限公司 Cache management method and device, computer equipment and storage medium
CN111176560B (en) * 2019-12-17 2022-02-18 腾讯科技(深圳)有限公司 Cache management method and device, computer equipment and storage medium
CN112099921A (en) * 2020-09-27 2020-12-18 中国建设银行股份有限公司 Java application system preheating method and system based on JVM
WO2023046059A1 (en) * 2021-09-24 2023-03-30 中国第一汽车股份有限公司 Cache warmup method and apparatus, and computer device and storage medium
CN116016648A (en) * 2022-12-28 2023-04-25 北京沃东天骏信息技术有限公司 Service preheating method and device
CN115858418A (en) * 2023-02-09 2023-03-28 成都有为财商教育科技有限公司 Data caching method and system

Also Published As

Publication number Publication date
CN109284236B (en) 2020-04-17

Similar Documents

Publication Publication Date Title
AU2020276284C1 (en) Continuous data sensing of functional states of networked computing devices to determine efficiency metrics for servicing electronic messages asynchronously
CN109284236A (en) Data preheating method, device, electronic equipment and storage medium
US10235430B2 (en) Systems, methods, and apparatuses for detecting activity patterns
US8374912B2 (en) System and method for managing and optimizing advertising campaigns managed on the internet
US10110687B2 (en) Session based web usage reporter
CN108431852A (en) Computer resource ranking for interconnected users profile
CN104765689B (en) A kind of interface capability data supervise method and apparatus in real time
CN111079015A (en) Recommendation method and device, computer equipment and storage medium
CN111917878A (en) Message processing method, device, equipment and storage medium
CN108564462A (en) Acquisition methods, terminal device and the medium of collage-credit data
CN113064866A (en) Power business data integration system
CN113157947A (en) Knowledge graph construction method, tool, device and server
CN108074033A (en) Processing method, system, electronic equipment and the storage medium of achievement data
CN108132868A (en) A kind of data monitoring method, device, computing device and storage medium
CN109858965A (en) A kind of user identification method and system
CN109241084A (en) Querying method, terminal device and the medium of data
CN114429364A (en) Business data management method and device, storage medium and electronic equipment
CN107291539A (en) Cluster program scheduler method based on resource significance level
CN109033173A (en) It is a kind of for generating the data processing method and device of multidimensional index data
CN109711849B (en) Ether house address portrait generation method and device, electronic equipment and storage medium
CN110990706B (en) Corpus recommendation method and device
CN114595473A (en) Access data processing method and device, electronic equipment and computer readable medium
CN105590232A (en) Client relation generation method and apparatus, and electronic device
US9990599B1 (en) Method and system for multidisciplinary research collaboration
CN102129455A (en) Patent retrieval method and system based on cloud storage

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant