CN103312544A - Method, equipment and system for controlling terminals during log file reporting - Google Patents

Method, equipment and system for controlling terminals during log file reporting Download PDF

Info

Publication number
CN103312544A
CN103312544A CN2013102369285A CN201310236928A CN103312544A CN 103312544 A CN103312544 A CN 103312544A CN 2013102369285 A CN2013102369285 A CN 2013102369285A CN 201310236928 A CN201310236928 A CN 201310236928A CN 103312544 A CN103312544 A CN 103312544A
Authority
CN
China
Prior art keywords
user behavior
terminal
sign
clouds
uploaded state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2013102369285A
Other languages
Chinese (zh)
Other versions
CN103312544B (en
Inventor
周娣
刘鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Juhaokan Technology Co Ltd
Original Assignee
Qingdao Hisense Media Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Hisense Media Network Technology Co Ltd filed Critical Qingdao Hisense Media Network Technology Co Ltd
Priority to CN201310236928.5A priority Critical patent/CN103312544B/en
Publication of CN103312544A publication Critical patent/CN103312544A/en
Application granted granted Critical
Publication of CN103312544B publication Critical patent/CN103312544B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Transfer Between Computers (AREA)
  • Computer And Data Communications (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention discloses a method, equipment and a system for controlling terminals during log file reporting, and relates to the field of information transmission. The method, the equipment and the system are used for solving the problem of waste of network flow used by terminals during log reporting. The method includes enabling the cloud equipment to acquire historical log files in network elements of the cloud system; analyzing the acquired historical log files to obtain user behavior data; storing user behavior identities corresponding to the obtained user behavior data in a cloud user behavior identity list; determining a reporting state corresponding to a certain user behavior identity in a preset user behavior identity set list according to the cloud user behavior identity list when a terminal user behavior reporting state list request transmitted by a terminal is received; transmitting a terminal user behavior reporting state list to the terminal. The method, the equipment and the system have the advantage that the problem of the waste of the network flow generated when terminals report logs is solved.

Description

A kind of control terminal reports the method, apparatus and system of journal file
Technical field
The present invention relates to field of information transmission, relate in particular to the method, apparatus and system that a kind of control terminal reports journal file.
Background technology
Process more and more hotter today in large data, operator and manufacturer are more detailed, deep for the analysis of user behavior, become in a minute the trend of present field of information transmission with data, this just requires operator and manufacturer can collect enough detailed user behavior track data.Terminal equipment (such as mobile phone, Pad, TV etc.) is in the process of operation, can produce a large amount of user behavior track datas, after abundant user behavior track data is collected by operator and manufacturer, can be according to user's demand, constantly improve product function, and then promote user's experience.Nowadays, this terminal equipment of competence exertion was intelligent after terminal equipment need to connect by the network high in the clouds corresponding with its backstage.Yet, when terminal equipment uploads to high in the clouds with the user behavior track data by network, need to expend a large amount of network traffics of terminal equipment.Simultaneously, because the restriction of the impact of the network environment of present various complexity and terminal use's network traffics expense, the network traffics that how reduce terminal equipment on the basis of the integrality that guarantees the terminal equipment uploading data become present urgent problem.
In the prior art, the method that the daily record of terminal equipment reports can report high in the clouds by following dual mode:
Mode one: referring to Fig. 1, the terminal equipment collector journal also reports high in the clouds:
Step 10: terminal equipment compresses the journal file after obtaining compressing to whole journal files that terminal equipment produces;
In the step 10, in the process of terminal equipment operation, can produce a large amount of user behavior datas (being the daily record file), in the time of wherein may comprising the same application of terminal equipment operation, can produce identical user behavior data (being the daily record file), compress whole user behavior data that terminal produces this moment, can obtain the user behavior data (being the daily record file) of a large amount of repetitions.Therefore, although step 10 can guarantee the integrality of the user behavior data (being the daily record file) of terminal equipment, this moment, terminal equipment can carry out repeated compression to a large amount of identical user behavior datas (being the daily record file).
Step 11: terminal equipment receives the reporting policy that is sent by high in the clouds, journal file is compressed the journal file after obtaining compressing according to described reporting policy;
In the step 11, terminal equipment receives a kind of reporting policy for this terminal equipment that is sent by high in the clouds, this reporting policy can only be directed to the terminal equipment of this model, this just needs high in the clouds is the different reporting policy of terminal equipment formulation of each model, and this reporting policy is in case formulate difficult change.That is to say, terminal equipment in the step 11 can only compress the journal file that defines in this reporting policy, this journal file that user behavior produced that just causes not defined by reporting policy can be not compressed, can not be uploaded to high in the clouds yet, the user behavior data (being the daily record file) that has caused terminal equipment to upload is imperfect, simultaneously, the user behavior data (being the daily record file) that whole terminal equipments is uploaded can not be collected in high in the clouds.Along with the increase of the model of terminal equipment, step 11 need to be that the terminal equipment of each model is formulated reporting policy, and this almost can't realize in practical operation.
Step 12: according to the network connection state in terminal equipment and high in the clouds, send the journal file after the compression to high in the clouds;
In the step 12, judge the network connection state in terminal equipment and high in the clouds, if terminal equipment is connected with high in the clouds, then terminal equipment is uploaded journal file after the compression to high in the clouds; If terminal equipment is not connected with high in the clouds, then terminal equipment is not uploaded journal file after the compression to high in the clouds;
Wherein, if terminal equipment is connected with high in the clouds, then terminal equipment is uploaded journal file after the compression to high in the clouds, the user behavior data (being the daily record file) that comprises a large amount of repetitions after the compression in the step 10, can cause this moment a large amount of identical journal files to repeat to upload, cause the flow waste of terminal equipment; And, in the process of journal file after terminal equipment is uploaded compression to high in the clouds, in case network connection is interrupted, terminal equipment will be after network connection be recovered so, again upload the journal file after whole compressions, when not interrupting comprising network connection, be uploaded to the journal file after the compression in high in the clouds.Thereby caused the journal file after a large amount of identical compressions to repeat to upload.
Mode two: high in the clouds obtains the journal file of terminal equipment by network connection;
After networking with terminal equipment beyond the clouds, the journal file of each application of high in the clouds each terminal of active obtaining (using such as system applies, cpu processor or third party).That is to say, terminal equipment is not collected the journal file that this terminal equipment self generates, but directly collect this journal file by high in the clouds, in case the some application in the terminal equipment have generated journal file, just collect this journal file by network in high in the clouds.Because high in the clouds and terminal equipment have carried out the reduction that a large amount of mutual (being the journal file that each application of each terminal of network active obtaining is passed through in high in the clouds) can bring user's operating experience in the steps A, and the network traffics of a large amount of terminal of waste, simultaneously, high in the clouds in the mode two can not be collected the journal file of each application of each equipment in actual applications, therefore can cause the data that this moment, high in the clouds obtained imperfect.
To sum up, there are the following problems in the prior art:
The journal file of pass-through mode one or two pairs of terminal equipments of mode is collected, and can cause a large amount of wastes of the network traffics of terminal equipment.
Summary of the invention
The method, apparatus and system that the embodiment of the invention provides a kind of control terminal to report journal file, the problem of the waste of employed network traffics when being used for solving the terminal to report daily record.
A kind of control terminal reports the method for journal file, and the method comprises:
Historical log file in the network element of equipment collection high in the clouds, high in the clouds system is analyzed the historical log file that collects, and obtains user behavior data, and user behavior sign corresponding to each user behavior data that obtains is stored in the user behavior identification list of high in the clouds;
High in the clouds equipment is after the terminal use's behavior uploaded state list request that receives the terminal transmission, for each the user behavior sign in the user behavior sign aggregate list that sets in advance, determine uploaded state corresponding to this user behavior sign according to above-mentioned high in the clouds user behavior identification list, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign;
High in the clouds equipment is tabulated to above-mentioned terminal transmitting terminal user behavior uploaded state, comprises each user behavior sign and uploaded state corresponding to each user behavior sign in the above-mentioned user behavior sign aggregate list in this terminal use's behavior uploaded state tabulation.
A kind of high in the clouds equipment, this high in the clouds equipment comprises:
Log file intellectual analysis unit, the historical log file that is used for the network element of collection high in the clouds system, the historical log file that collects is analyzed, obtained user behavior data, user behavior sign corresponding to each user behavior data that obtains is stored in the user behavior identification list of high in the clouds;
The user behavior control unit, be used for after the terminal use's behavior uploaded state list request that receives the terminal transmission, for each the user behavior sign in the user behavior sign aggregate list that sets in advance, determine uploaded state corresponding to this user behavior sign according to above-mentioned high in the clouds user behavior identification list, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign;
Data transmission unit, be used for to above-mentioned terminal transmitting terminal user behavior uploaded state tabulation, comprise each user behavior sign and uploaded state corresponding to each user behavior sign in the above-mentioned user behavior sign aggregate list in this terminal use's behavior uploaded state tabulation.
A kind of journal file reporting system, this system comprises:
High in the clouds equipment, the historical log file that is used for the network element of collection high in the clouds system, the historical log file that collects is analyzed, obtained user behavior data, user behavior sign corresponding to each user behavior data that obtains is stored in the user behavior identification list of high in the clouds; After the terminal use's behavior uploaded state list request that receives the terminal transmission, for each the user behavior sign in the user behavior sign aggregate list that sets in advance, determine uploaded state corresponding to this user behavior sign according to described high in the clouds user behavior identification list, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign; To described terminal transmitting terminal user behavior uploaded state tabulation, comprise each user behavior sign and uploaded state corresponding to each user behavior sign in the described user behavior sign aggregate list in this terminal use's behavior uploaded state tabulation;
Terminal is used for to high in the clouds equipment transmitting terminal user behavior uploaded state list request; Receive terminal use's behavior uploaded state tabulation that high in the clouds equipment sends; According to described terminal use's behavior uploaded state tabulation, carry out reporting of user behavior data.
Among the present invention, historical log file in the network element of equipment collection high in the clouds, high in the clouds system, the historical log file that collects is analyzed, obtained user behavior data, user behavior sign corresponding to each user behavior data that obtains is stored in the user behavior identification list of high in the clouds; Terminal is to high in the clouds equipment transmitting terminal user behavior uploaded state list request; High in the clouds equipment is after the terminal use's behavior uploaded state list request that receives the terminal transmission, for each the user behavior sign in the user behavior sign aggregate list that sets in advance, determine uploaded state corresponding to this user behavior sign according to above-mentioned high in the clouds user behavior identification list, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign; High in the clouds equipment is tabulated to above-mentioned terminal transmitting terminal user behavior uploaded state, comprises each user behavior sign and uploaded state corresponding to each user behavior sign in the above-mentioned user behavior sign aggregate list in this terminal use's behavior uploaded state tabulation; Terminal receives terminal use's behavior uploaded state tabulation that high in the clouds equipment sends, and terminal is tabulated according to above-mentioned terminal use's behavior uploaded state, carries out reporting of user behavior data.As seen, high in the clouds equipment is analyzed the historical log file in the network element of high in the clouds system among the present invention, obtain user behavior data, and terminal use's behavior uploaded state tabulation that will carry the uploaded state of user behavior sign corresponding to above-mentioned user behavior data sends to terminal, in order to the user behavior data that does not obtain in the indicating terminal to report high in the clouds system network element, thereby constructed the user behavior strobe utility, the user behavior data that this user behavior strobe utility can avoid terminal to report high in the clouds equipment to obtain from historical log file, thereby the network traffics that produced when having reduced the terminal to report daily record.
Description of drawings
Fig. 1 is the method flow schematic diagram that terminal reports journal file in the prior art according to reporting policy;
The control terminal that Fig. 2 provides for the embodiment of the invention reports the method flow schematic diagram of journal file;
The report method schematic flow sheet of the terminal journal file that Fig. 3 provides for the embodiment of the invention;
The schematic flow sheet of the historical log file of high in the clouds device analysis that Fig. 4 provides for the embodiment of the invention;
The high in the clouds equipment that Fig. 5 provides for the embodiment of the invention is determined the schematic flow sheet of uploaded state;
The journal file reporting system structural representation that Fig. 6 provides for the embodiment of the invention
The high in the clouds device structure schematic diagram that Fig. 7 provides for the embodiment of the invention;
The terminal structure schematic diagram that Fig. 8 provides for the embodiment of the invention.
Embodiment
The network traffics that produce in order to reduce the terminal to report daily record time, the embodiment of the invention provides a kind of control terminal to report the method for journal file, in this method, historical log file in the network element of equipment collection high in the clouds, high in the clouds system, the historical log file that collects is analyzed, obtain user behavior data, user behavior sign corresponding to each user behavior data that obtains is stored in the user behavior identification list of high in the clouds; High in the clouds equipment is after the terminal use's behavior uploaded state list request that receives the terminal transmission, for each the user behavior sign in the user behavior sign aggregate list that sets in advance, determine uploaded state corresponding to this user behavior sign according to above-mentioned high in the clouds user behavior identification list, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign; High in the clouds equipment is tabulated to above-mentioned terminal transmitting terminal user behavior uploaded state; Terminal receives terminal use's behavior uploaded state tabulation that high in the clouds equipment sends, and according to above-mentioned terminal use's behavior uploaded state tabulation, carries out reporting of user behavior data.
Referring to Fig. 2, the control terminal that provides for the embodiment of the invention reports the method for journal file, may further comprise the steps:
Step 20: the historical log file in the network element of high in the clouds equipment collection high in the clouds system, the historical log file that collects is analyzed, obtain user behavior data, user behavior sign corresponding to each user behavior data that obtains is stored in the user behavior identification list of high in the clouds;
Step 21: high in the clouds equipment is after the terminal use's behavior uploaded state list request that receives the terminal transmission, for each the user behavior sign in the user behavior sign aggregate list that sets in advance, determine uploaded state corresponding to this user behavior sign according to above-mentioned high in the clouds user behavior identification list, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign;
Step 22: high in the clouds equipment is tabulated to above-mentioned terminal transmitting terminal user behavior uploaded state, comprises each user behavior sign and uploaded state corresponding to each user behavior sign in the above-mentioned user behavior sign aggregate list in this terminal use's behavior uploaded state tabulation;
Better, before step 20, high in the clouds equipment identifies aggregate list with user behavior and sends to terminal; Be used to indicate terminal user behavior is identified, the user behavior that inquiry is corresponding with this user behavior sign; When high in the clouds equipment sends the terminal use's behavior uploaded state tabulation that carries certain user's behavior sign to terminal, terminal need to be inquired about user behavior sign in the above-mentioned user behavior sign aggregate list and the corresponding relation of user behavior, and then obtains the user behavior data that high in the clouds equipment needs which user behavior generation of terminal to report;
In the step 20, because the network element of high in the clouds system and terminal carrying out service can produce the historical log file of a large amount of and this traffic aided when processing, the user behavior data that can comprise great amount of terminals in this history log file, high in the clouds equipment can extract the user behavior data that obtains terminal from historical log file, and then utilize the user behavior data that from historical log file, extracts that the user behavior of terminal is analyzed, therefore do not need terminal to report again the user behavior data that from historical log file, has extracted, thereby can save the employed network traffics of terminal to report user behavior data, avoid terminal owing to uploading the waste of the network traffics that unnecessary user behavior data brings.
In the step 20, high in the clouds user behavior identification list comprises: user behavior corresponding to the user behavior data that high in the clouds equipment obtains indirectly according to historical log file sign can also comprise the extended attributes such as the behavior classification of this user behavior sign or terminal type;
In the step 20, the historical log file in the equipment acquisition network element of high in the clouds specifically can be according to the predefined time interval, the historical log file in the network element of collection high in the clouds system;
In the step 20, high in the clouds equipment is analyzed the historical log file that collects, and obtains user behavior data, and specific implementation can be as follows:
High in the clouds equipment each historical log file to collecting, judge that whether the file size of this history log file is less than predetermined threshold value, if, utilize the elementary parsing module of constructing in advance to extract the characteristic information of this history log file, the characteristic information that extracts is stored in the relational database as user behavior data;
Wherein, the elementary parsing module of structure is used for extracting the characteristic information of historical log file in advance, and this elementary parsing module carries out the parsing of primary stage to historical log file, is applicable to the less system of data volume or file; The above-mentioned relation database can comprise mysql, oracle or other relational databases;
If file that should history log file is greater than predetermined threshold value, then utilize the senior parsing module of structure in advance to extract the characteristic information of this history log file, and the characteristic information that extracts is stored in the database based on distributed system as user behavior data;
Wherein, the elementary parsing module of structure is used for extracting the characteristic information of historical log file in advance, this senior parsing module carries out the automatic parsing of advanced stage to historical log file, be applicable to the file type that the larger system of data volume or file and primary stage can not resolve; Database based on distributed system comprises: distributed file system HDFS, non-relational database mongodb or relational database etc.
In the step 20, the user behavior sign that each user behavior data that high in the clouds equipment will obtain is corresponding is stored in the user behavior identification list of high in the clouds, and specific implementation can be as follows:
High in the clouds equipment each user behavior data to obtaining, in above-mentioned user behavior sign aggregate list, search user behavior sign corresponding to user behavior that is complementary with this user behavior data, the user behavior sign that finds is identified as user behavior corresponding to this user behavior data;
In the step 21, user behavior sign aggregate list comprises: whole user behavior data (the user behavior content of different terminals type), the identifier declaration that user behavior identifies and each user behavior identifies that each user behavior data is corresponding; Wherein, the user behavior content is used for execution user name, time of implementation and the title of this user behavior of record, and the user behavior sign is used for representing that every kind identifies the user behavior of unique coupling with this user behavior; Identifier declaration is convenient to manage a large amount of user behavior signs; As seen, in this user behavior sign aggregate list, for each user behavior has defined a user behavior sign corresponding with it, being used to indicate high in the clouds equipment or terminal identifies different user behaviors, search user behavior corresponding to each user behavior sign, and then can historical log file or the user behavior data that this user behavior produces be gathered or analyze;
In the step 21, high in the clouds equipment is determined uploaded state corresponding to this user behavior sign for each the user behavior sign in the user behavior sign aggregate list that sets in advance according to above-mentioned high in the clouds user behavior identification list, and specific implementation can be as follows:
High in the clouds equipment is for each the user behavior sign in the user behavior sign aggregate list that sets in advance, determine whether to comprise in the user behavior identification list of above-mentioned high in the clouds this user behavior sign, if, determine that then uploaded state corresponding to this user behavior sign is: this terminal does not need to report the user behavior data relevant with user behavior corresponding to this user behavior sign, otherwise determine that uploaded state corresponding to this user behavior sign is: this terminal need to report with this user behavior and identify the relevant user behavior data of corresponding user behavior;
In the step 22, the tabulation of terminal use's behavior uploaded state specifically comprises: each the user behavior sign in the user behavior sign aggregate list and uploaded state corresponding to each user behavior sign; The tabulation of terminal use's behavior uploaded state is used to indicate terminal and gathers the user behavior data that certain user behavior produces; This terminal use's behavior uploaded state tabulation can also comprise: the extended attributes such as the behavior classification of each user behavior sign or terminal type; Being used to indicate dissimilar terminal gathers the user behavior data that different classes of user behavior produces;
In the step 22, high in the clouds equipment will send to terminal use's behavior uploaded state tabulation of above-mentioned terminal and back up;
Wherein, after the tabulation of equipment structure terminal use behavior uploaded state, high in the clouds equipment is tabulated to terminal use's behavior uploaded state and is backed up beyond the clouds; Being convenient to high in the clouds equipment reviews the change historical record of uploaded state corresponding to certain user behavior.
Referring to Fig. 3, the report method of terminal journal file is provided for the embodiment of the invention, may further comprise the steps:
Step 30: terminal is to high in the clouds equipment transmitting terminal user behavior uploaded state list request;
Step 31: terminal receives terminal use's behavior uploaded state tabulation that high in the clouds equipment sends, comprise each user behavior sign and uploaded state corresponding to each user behavior sign in the user behavior sign aggregate list that sets in advance in the tabulation of this terminal use's behavior uploaded state, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign;
Step 32: terminal is tabulated according to above-mentioned terminal use's behavior uploaded state, carries out reporting of user behavior data;
Better, before step 30, terminal receives the user behavior sign aggregate list that high in the clouds equipment sends;
Wherein, terminal can receive the user behavior sign aggregate list that high in the clouds equipment sends when start, also can call the user behavior sign aggregate list that is pre-configured in the terminal; This user behavior sign aggregate list is used to indicate terminal user behavior is identified, the user behavior that inquiry is corresponding with this user behavior sign; When high in the clouds equipment sends the terminal use's behavior uploaded state tabulation that carries certain user's behavior sign to terminal, terminal need to be inquired about user behavior sign in the above-mentioned user behavior sign aggregate list and the corresponding relation of user behavior, and then obtains the user behavior data that high in the clouds equipment needs which user behavior generation of terminal to report;
In the step 30, terminal is to high in the clouds equipment transmitting terminal user behavior uploaded state list request, and specific implementation can be as follows:
Terminal is rear to high in the clouds equipment transmitting terminal user behavior uploaded state list request in each start; Perhaps, terminal every setting-up time to high in the clouds equipment transmitting terminal user behavior uploaded state list request; Perhaps, terminal is in each report of user behavioral data forward direction high in the clouds equipment transmitting terminal user behavior uploaded state list request;
Wherein, terminal is in each report of user behavioral data forward direction high in the clouds equipment transmitting terminal user behavior uploaded state list request, and specific implementation can be as follows:
Terminal is compressed the user behavior data that needs report, if the file size of the user behavior data after the compression greater than the writing time of setting the user behavior data after byte threshold value or the compression greater than the setting-up time threshold value, then in the network connection state of terminal and high in the clouds equipment when being connected, to high in the clouds equipment transmitting terminal user behavior uploaded state list request; If the file size of the user behavior data after the compression less than the writing time of setting the user behavior data after byte threshold value or the compression less than the setting-up time threshold value, then the user behavior data of terminal after to compression backs up; Wherein, terminal is to judging file size or the writing time of the user behavior data after compressing, be terminal regularly or quantitative report user behavior data after the compression to high in the clouds equipment, can reduce this moment terminal user behavior data write indegree and terminal and high in the clouds equipment alternately.
In the step 32, terminal is tabulated according to above-mentioned terminal use's behavior uploaded state, carries out reporting of user behavior data, and specific implementation can be as follows:
Terminal is after generating the user behavior data that need to report, in above-mentioned user behavior sign aggregate list, search the user behavior sign that the user behavior corresponding with this user behavior data is complementary, in above-mentioned terminal use's behavior uploaded state tabulation, search this user behavior sign, if the uploaded state of this user behavior sign correspondence is for reporting, then report this user behavior data to high in the clouds equipment, if the uploaded state of this user behavior sign correspondence does not then report this user behavior data to high in the clouds equipment for not reporting;
The below is specifically described the present invention:
Embodiment one:
Step 1, high in the clouds equipment set in advance user behavior sign aggregate list; At least comprise in this user behavior sign aggregate list user behavior data corresponding to the user behavior of terminal of each type and with the user behavior sign of the unique coupling of this user behavior, this user behavior sign aggregate list can be as shown in table 1 below:
Figure BDA00003346997400111
Table 1
When high in the clouds equipment sets in advance this user behavior sign aggregate list, can also comprise that other adeditive attributes (such as behavior classification, terminal type etc.) are convenient to high in the clouds equipment and collect user behavior data, this user behavior sign aggregate list also can be as shown in table 2 below:
Table 2
Wherein, high in the clouds is when setting in advance user behavior sign aggregate list, can be each the unique user behavior sign that is complementary with this user behavior of user behavior definition that need to collect, if terminal has produced the New Consumers behavior or a New Consumers behavior need to be collected in high in the clouds, high in the clouds equipment is user behavior sign corresponding with it of this user behavior definition in this user behavior identification list, same, user behavior sign corresponding to a certain user behavior also can be deleted or revise to high in the clouds equipment.
When above-mentioned user behavior sign aggregate list can be started shooting for the first time in terminal (being the initialization start), send to terminal by high in the clouds equipment; Also can be pre-configured in the terminal equipment, if this moment, this user behavior sign aggregate list need to be carried out appending, revise or deleting of user behavior, the user behavior sign aggregate list after can will being upgraded by high in the clouds equipment sends to terminal.High in the clouds equipment identifies aggregate list with user behavior and sends to terminal in the embodiment of the invention when terminal is started shooting for the first time.
Step 2, terminal receive the user behavior sign aggregate list that high in the clouds equipment sends;
High in the clouds equipment can send above-mentioned user behavior sign aggregate list to terminal when starting up of terminal, also can identify aggregate list by pre-configured user behavior in terminal; Same, terminal can receive the user behavior sign aggregate list that high in the clouds equipment sends when start, also can call the user behavior sign aggregate list that is pre-configured in the terminal; This user behavior sign aggregate list is used to indicate terminal user behavior is identified, the user behavior that inquiry is corresponding with this user behavior sign; When high in the clouds equipment sends the terminal use's behavior uploaded state tabulation that carries certain user's behavior sign to terminal, terminal need to be inquired about user behavior sign in the above-mentioned user behavior sign aggregate list and the corresponding relation of user behavior, and then obtains the user behavior data that high in the clouds equipment needs which user behavior generation of terminal to report;
Step 3, the historical log file in the network element of high in the clouds equipment collection high in the clouds system;
Historical log file in the network element of high in the clouds system (as, the journal file of log4j output, the running log file of tomcat record and access log etc.), comprise various terminal use's behavioral datas in this type of historical log file, the user behavior that can reflect terminal, high in the clouds equipment extracts the user behavior data that can reflect terminal use's behavior from this history log file, namely high in the clouds equipment can indirectly obtain the user behavior data of terminal, simultaneously, terminal equipment do not need to report this type of to obtain the user behavior data of getting by the high in the clouds equipment room again, reduced the waste that terminal equipment repeats to report the network traffics of journal file.Wherein, because the network element of high in the clouds system and terminal carrying out service can produce the historical log file of a large amount of and this traffic aided when processing, the user behavior data that can comprise great amount of terminals in this history log file, high in the clouds equipment can extract the user behavior data that obtains terminal from historical log file, and then utilize the user behavior data that from historical log file, extracts that the user behavior of terminal is analyzed, therefore do not need terminal to report again the user behavior data that from historical log file, has extracted, thereby can save the employed network traffics of terminal to report user behavior data, avoid terminal owing to uploading the waste of the network traffics that unnecessary user behavior data brings.Then, high in the clouds equipment is according to predefined time interval t, gathers the historical log file in the network element of high in the clouds system.For example, when predefined time interval t=60 minute, the historical log file of high in the clouds equipment in the network element that gathered the high in the clouds system in 60 minutes then; Time interval t can dynamic adjustments, when predefined time interval t=30 minute, and the historical log file that high in the clouds equipment can be in 30 minutes acquisition network element.
Step 4, after the historical log file in the equipment acquisition network element, high in the clouds equipment is analyzed the historical log file that collects, and obtains user behavior data beyond the clouds.
Referring to Fig. 4, equipment each historical log file (this history log file is the unified historical log file that is stored in the Analysis server of high in the clouds in the step 3) to collecting in high in the clouds judges that whether the size of this history log file is less than predetermined threshold value;
If, the file size of this history log file is less than predetermined threshold value, then utilize the in advance characteristic information of elementary parsing module 400 this history of extraction log files of structure, and the characteristic information that extracts is stored in the relational database 402 as user behavior data; Wherein, elementary parsing module 400 is used for the parsing to the primary stage of historical log file, is applicable to the less system of data volume or file; Relational database 402 comprises mysql, oracle or other relational databases.
If, the file size of this history log file is greater than predetermined threshold value, then utilize the senior parsing module 401 of structure in advance to extract the characteristic information of this history log files, and the characteristic information that extracts is stored in the database 403 based on distributed system as user behavior data; Wherein, senior parsing module 401 is used for the parsing to the advanced stage of historical log file, is applicable to the file type that the larger system of data volume or file and primary stage can not resolve; Database 403 based on distributed system comprises distributed file system HDFS, non-relational database mongodb or relational database etc.; Typical HDFS can support GB to other large file of TB level, mongodb is a non-relational database of storing based on distributed document, can store the data type of more complicated, therefore use the data type that can process more complicated based on the database 403 of distributed system, can also the larger file of deal with data size.
As seen, step 4 is distributed different parsing module and storage medium according to the data characteristics of historical log file, data volume size, constructs historical log document storage management system.
In the step 4, according to business processing flow and business module, relevant business datum is gathered, analyzes, the characteristic information that obtains historical log file is as shown in table 3:
Terminal equipment type User behavior Number of times
DEV_A Start 1
DEV_A Report daily record 1
Table 3
Characteristic information in the table 3 specifically is expressed as: terminal equipment type is in the terminal of DEV_A, and the user behavior of start has been carried out 1 time; Terminal equipment type is in the terminal of DEV_A, reports the user behavior of daily record to carry out 1 time.
The characteristic information of the historical log file that extracts is as shown in table 4:
Terminal equipment type Apply Names User behavior Number of times
DEV_A APP1 Start 1
DEV_A APP1 Upgrading 1
Table 4
Characteristic information in the table 4 specifically is expressed as: terminal equipment type is in the terminal of DEV_A, and the user behavior that starts APP1 has been carried out 1 time; Terminal equipment type is in the terminal of DEV_A, and the user behavior of upgrading APP1 has been carried out 1 time.
As seen, the characteristic information of table 3 has reflected the user behavior for terminal, and the characteristic information of table 4 has reflected for the user behavior of using APP1, that is to say, high in the clouds equipment is analyzed the historical log file that collects, and obtains the various user behaviors that user behavior data can reflect terminal.
Step 5, high in the clouds equipment each user behavior data to obtaining, in above-mentioned user behavior sign aggregate list, (be in the step 1, the user behavior sign aggregate list that high in the clouds equipment sets in advance) searches user behavior sign corresponding to user behavior that is complementary with this user behavior data, the user behavior sign that finds is identified as user behavior corresponding to this user behavior data, and this user behavior sign is stored in the user behavior identification list of high in the clouds;
High in the clouds equipment each user behavior data to obtaining, in above-mentioned user behavior sign aggregate list, search user behavior sign corresponding to user behavior that is complementary with this user behavior data, for example, high in the clouds equipment is for the characteristic information of the table 4 in the above-mentioned steps four, search corresponding with it user behavior sign in above-mentioned user behavior sign aggregate list, the user behavior that finds sign is respectively: user behavior corresponding to user behavior that starts APP1 is designated 1.0_1; User behavior corresponding to user behavior of upgrading APP1 is designated 1.1_1.
At this moment, high in the clouds equipment is designated 1.0_1 and user behavior with user behavior and is designated 1.1_1 and is stored in the user behavior identification list of high in the clouds.
Step 6, terminal is to high in the clouds equipment transmitting terminal user behavior uploaded state list request;
Wherein, terminal can be in each report of user behavioral data forward direction high in the clouds equipment transmitting terminal user behavior uploaded state list request; Better, to high in the clouds equipment transmitting terminal user behavior uploaded state list request, perhaps, terminal is rear to high in the clouds equipment transmitting terminal user behavior uploaded state list request in each start every setting-up time (this setting-up time t is predetermined threshold value) for terminal;
In the embodiment of the invention, terminal is in each report of user behavioral data forward direction high in the clouds equipment transmitting terminal user behavior uploaded state list request;
At first, the size of terminal user behavior data that needs are reported maybe need the user behavior data that reports writing time judge:
If the size of the user behavior data that need to report is greater than a certain predetermined threshold value, and the network connection state of terminal and high in the clouds equipment is for being connected, and then terminal is to high in the clouds equipment transmitting terminal user behavior uploaded state list request;
If the writing time of the user behavior data that need to report is greater than a certain predetermined threshold value, and the network connection state of terminal and high in the clouds equipment is for being connected, and then terminal is to high in the clouds equipment transmitting terminal user behavior uploaded state list request;
Otherwise, then terminal backs up the user behavior data that need to upload, wait for that the network connection state of terminal and high in the clouds equipment is for after being connected, again to high in the clouds equipment transmitting terminal user behavior uploaded state list request, be terminal regularly or quantitative to high in the clouds equipment transmitting terminal user behavior uploaded state list request, reduce terminal write indegree and terminal and high in the clouds equipment alternately;
Step 7, referring to Fig. 5, the high in the clouds equipment that provides for the embodiment of the invention is determined the schematic flow sheet of uploaded state, after high in the clouds equipment receives terminal use's behavior uploaded state tabulation 500 requests of terminal transmission, for each the user behavior sign in the user behavior sign aggregate list 501 that sets in advance, determine uploaded state 503 corresponding to this user behaviors sign according to above-mentioned high in the clouds user behavior identification list 502, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign;
High in the clouds equipment determines whether to comprise in the above-mentioned high in the clouds user behavior identification list 502 this user behavior sign for each the user behavior sign in the user behavior sign aggregate list 501 that sets in advance,
If comprise this user behavior sign in the above-mentioned high in the clouds user behavior identification list 502, then uploaded state corresponding to this user behavior sign is made as: do not report, namely this terminal does not need to report the user behavior data relevant with user behavior corresponding to this user behavior sign; At this moment, extracted the user behavior data corresponding with this user behavior sign in the historical log file in the network element of high in the clouds equipment, just uploaded state corresponding to this user behavior sign is made as not report and can avoids terminal owing to the waste of the network traffics that repeat to report journal file to cause.
If do not comprise this user behavior sign in the above-mentioned high in the clouds user behavior identification list 502, then uploaded state corresponding to this user behavior sign is made as: report, namely this terminal need to report with this user behavior and identify the relevant user behavior data of corresponding user behavior; At this moment, can't indirectly extract in the historical log file in the network element of high in the clouds equipment with this user behavior and identify the relevant user behavior data of corresponding user behavior, therefore, need terminal to identify the relevant user behavior data of corresponding user behavior with this user behavior and send to high in the clouds equipment.
Hence one can see that, and the user behavior that obtains in the step 5 is designated uploaded state corresponding to 1.0_1 for not reporting, and is designated 1.0_1 because comprised this user behavior in the above-mentioned high in the clouds user behavior identification list 502; Same, user behavior is designated uploaded state corresponding to 1.1_1 for not reporting.
Step 8, high in the clouds equipment is tabulated to above-mentioned terminal transmitting terminal user behavior uploaded state, and, high in the clouds equipment backs up this terminal transmitting terminal user behavior uploaded state, comprises each user behavior sign and uploaded state corresponding to each user behavior sign in the above-mentioned user behavior sign aggregate list in this terminal use's behavior uploaded state tabulation;
At this moment, the tabulation of high in the clouds equipment structure terminal use behavior uploaded state, comprise each user behavior sign and uploaded state corresponding to each user behavior sign in the above-mentioned user behavior sign aggregate list in this terminal use's behavior uploaded state tabulation, that is to say each user behavior sign and unique uploaded state corresponding with it of comprising in this terminal use's behavior uploaded state tabulation; Further, beyond the clouds in the process of equipment structure terminal use behavior uploaded state tabulation, high in the clouds equipment can also be to being this terminal use's behavior uploaded state tabulation reservation manual control interface, beyond the clouds after the tabulation of equipment structure terminal use behavior uploaded state, high in the clouds equipment can change some or uploaded state corresponding to certain user's behavior sign, is convenient to high in the clouds equipment and obtains more user behavior information from each terminal.Beyond the clouds after the tabulation of equipment structure terminal use behavior uploaded state, high in the clouds equipment is tabulated to terminal use's behavior uploaded state and is backed up, be that the change historical record that high in the clouds equipment is tabulated to terminal use's behavior uploaded state backs up, being convenient to high in the clouds equipment reviews the accuracy of the data of terminal to report, that is to say, when high in the clouds device discovery terminal to report the relevant user behavior data of user behavior data that has been extracted from the network element indirect of high in the clouds system by high in the clouds equipment, high in the clouds equipment can call terminal use's behavior uploaded state tabulation of having backed up, and uploaded state corresponding to this user behavior sign reviewed; Further, high in the clouds equipment is Json form or xml form with the format conversion of terminal use's behavior uploaded state tabulation, and terminal use's behavior uploaded state tabulation of the tabulation of terminal use's behavior uploaded state of Json form or xml form sent to each terminal, be convenient to each terminal and can accurately receive and identify this terminal use's behavior uploaded state tabulation.
For example, the user behavior sign that comprises in terminal use's behavior uploaded state tabulation of this moment and the uploaded state corresponding with this user behavior sign (because the embodiment of the invention can not be enumerated all user behavior signs, therefore only following 4 kinds of user behaviors sign being illustrated) as shown in table 5 below herein:
The user behavior sign Uploaded state
1.0_1 Do not report
1.1_1 Do not report
1.0_2 Report
2.0_1 Report
Table 5
Step 9, terminal receives terminal use's behavior uploaded state tabulation that high in the clouds equipment sends, comprise each user behavior sign and uploaded state corresponding to each user behavior sign in the user behavior sign aggregate list that sets in advance in the tabulation of this terminal use's behavior uploaded state, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign;
At this moment, terminal receives terminal use's behavior uploaded state tabulation (for example, terminal use's behavior uploaded state tabulation of above-mentioned table 4 expression) of form Json or the xml of high in the clouds equipment transmission.
Step 10, terminal is tabulated according to described terminal use's behavior uploaded state, carries out reporting of user behavior data;
Wherein, terminal is after generating the user behavior data that need to report, in above-mentioned user behavior sign aggregate list, search the user behavior sign that the user behavior corresponding with this user behavior data is complementary, in above-mentioned terminal use's behavior uploaded state tabulation, search this user behavior sign, if the uploaded state of this user behavior sign correspondence is for reporting, then report this user behavior data to high in the clouds equipment, if the uploaded state of this user behavior sign correspondence does not then report this user behavior data to high in the clouds equipment for not reporting;
At this moment, after the user behavior data of starting terminal application A PP1 generates, this terminal (is in the step 2 in above-mentioned user behavior sign aggregate list, terminal receives the user behavior sign aggregate list that high in the clouds equipment sends) in, search user behavior corresponding to this user behavior and be designated 1.0_1, then, terminal (is in the step 9 in the tabulation of terminal use's behavior uploaded state, terminal receives terminal use's behavior uploaded state tabulation that high in the clouds sends) middle uploaded state corresponding to this user behavior sign 1.0_1 of inquiring about be not for reporting, and this moment, terminal then abandoned the user behavior data that starts application A PP1 production; After the user behavior data of terminal staging application A PP1 generates, this terminal (is in the step 2 in above-mentioned user behavior sign aggregate list, terminal receives the user behavior sign aggregate list that high in the clouds equipment sends) in, search user behavior corresponding to this user behavior and be designated 1.1_1, then, terminal (is in the step 9 in the tabulation of terminal use's behavior uploaded state, terminal receives terminal use's behavior uploaded state tabulation that high in the clouds sends) middle uploaded state corresponding to this user behavior sign 1.1_1 of inquiring about be not for reporting, and this moment, terminal then abandoned the user behavior data that starts application A PP1 production; After the user behavior data of terminal downloads application A PP1 generates, this terminal (is in the step 2 in above-mentioned user behavior sign aggregate list, terminal receives the user behavior sign aggregate list that high in the clouds equipment sends) in, search user behavior corresponding to this user behavior and be designated 1.0_2, then, terminal (is in the step 9 in the tabulation of terminal use's behavior uploaded state, terminal use's behavior uploaded state tabulation that terminal reception high in the clouds sends) this user behavior of inquiry identifies uploaded state corresponding to 1.0_2 for reporting in, this moment, terminal was collected the user behavior data that down load application program APP1 generates, and this user behavior data is reported high in the clouds; Same, terminal abnormal withdraws from after the user behavior data generation of application A PP1, this terminal (is in the step 2 in above-mentioned user behavior sign aggregate list, terminal receives the user behavior sign aggregate list that high in the clouds equipment sends) in, search user behavior corresponding to this user behavior and be designated 2.0_1, then, terminal (is in the step 9 in the tabulation of terminal use's behavior uploaded state, terminal use's behavior uploaded state tabulation that terminal reception high in the clouds sends) this user behavior of inquiry identifies uploaded state corresponding to 2.0_1 for reporting in, this moment, terminal was collected the user behavior data that down load application program APP1 generates, and this user behavior data is reported high in the clouds;
Wherein, the terminal mode of collecting the user behavior data that different user behaviors generates is divided into active collection and passive collection:
The user behavior data that the user behavior data of terminal active collection is the user behavior data that generates of the system bottom data of the user behavior data that generates of the common information of terminal, terminal or the third party uses generation, the user behavior data that generates such as the misoperation of application program, the user behavior data that the terminal system misoperation generates etc.
The user behavior data of the passive collection of terminal is the user behavior data that generates of the application program of the user behavior data that generates of the exclusive application of terminal, terminal independent development etc., and user behavior data, the video playback that generates such as the application shop in the intelligent television used the user behavior data that the user behavior data that generates or terminal launch generate etc.The user behavior data of the passive collection of terminal is mainly the feedback that high in the clouds equipment is wished user's behaviour in service of obtaining, such as the customer group of terminal to the customer group of the feedback of the satisfaction of a certain function items among the APP1, terminal to the feedback of the demand degree of a certain function among the APP1 etc., the feedback of the feedback of above-mentioned user's satisfaction or demand degree can be for a certain terminal equipment, for the function of a certain application program or for the feedback of each operating knob in a certain application program, the page or concrete media content.
As seen, high in the clouds equipment with indicating terminal active collection or passive collection user behavior data, has formed terminal use's behavior strobe utility by to each terminal transmitting terminal user behavior uploaded state tabulation.Above-mentioned terminal use's behavior strobe utility obtains user behavior information by system broadcasts, application program operation tabulation, be convenient to the change of user behavior information of the public information of active collection terminal, simultaneously during passive collection user behavior information, avoided the mutual of each application program and high in the clouds equipment, improved terminal to report speed, avoided the malicious attack of high in the clouds equipment to terminal; Further, this user behavior strobe utility guarantees that high in the clouds equipment can obtain complete terminal use's behavioral data, prevent simultaneously the user behavior data that repeated obtain high in the clouds equipment had obtained, the waste (valid data of terminal are not lost, and the invalid data of terminal does not repeat to upload) of the network traffics that produced when having reduced terminal to high in the clouds equipment report of user behavioral data.
Wherein, terminal is uploaded to high in the clouds equipment before the user behavior data, and terminal is compressed the user behavior data that needs report, the network traffics that produce in the time of can further saving the terminal to report user behavior data by this step.
Further, if report in the process of log daily record to high in the clouds equipment in terminal, network connection between terminal and the high in the clouds equipment disconnects, this moment terminal to have uploaded the part uploaded state in the tabulation of terminal use's behavior uploaded state be the user behavior data that reports, high in the clouds equipment is after receiving above-mentioned user behavior data, continue execution in step three, namely historical log file is analyzed or resolved, and then when equipment is tabulated to terminal transmitting terminal user behavior uploaded state next time beyond the clouds, uploaded state corresponding to user behavior data that terminal had reported before network connection interrupted is made as and do not report, and the visible embodiment of the invention can effectively be saved the network traffics that the terminal to report daily record produces.
Referring to Fig. 6, be a kind of journal file reporting system that the embodiment of the invention provides, this system is implemented as follows:
High in the clouds equipment 60, the historical log file that is used for the network element of collection high in the clouds system, the historical log file that collects is analyzed, obtained user behavior data, user behavior sign corresponding to each user behavior data that obtains is stored in the user behavior identification list of high in the clouds; After the terminal use's behavior uploaded state list request that receives the terminal transmission, for each the user behavior sign in the user behavior sign aggregate list that sets in advance, determine uploaded state corresponding to this user behavior sign according to described high in the clouds user behavior identification list, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign; To described terminal transmitting terminal user behavior uploaded state tabulation, comprise each user behavior sign and uploaded state corresponding to each user behavior sign in the described user behavior sign aggregate list in this terminal use's behavior uploaded state tabulation;
Terminal 61 is used for to high in the clouds equipment transmitting terminal user behavior uploaded state list request; Receive terminal use's behavior uploaded state tabulation that high in the clouds equipment sends; According to described terminal use's behavior uploaded state tabulation, carry out reporting of user behavior data.
Referring to Fig. 7, be a kind of high in the clouds equipment that the embodiment of the invention provides, this equipment can be applied in the above-mentioned journal file reporting system, and equipment is implemented as follows:
Log file intellectual analysis unit 70, the historical log file that is used for the network element of collection high in the clouds system, the historical log file that collects is analyzed, obtained user behavior data, user behavior sign corresponding to each user behavior data that obtains is stored in the user behavior identification list of high in the clouds;
Log file intellectual analysis unit 70, be used for each the historical log file to collecting, judge that whether the file size of this history log file is less than predetermined threshold value, if, utilize the elementary parsing module of constructing in advance to extract the characteristic information of this history log file, the characteristic information that extracts is stored in the relational database as user behavior data; Otherwise the senior parsing module that utilization is constructed in advance extracts the characteristic information of this history log file, and the characteristic information that extracts is stored in the distributed file system as user behavior data;
Further, log file intellectual analysis unit 70, also be used for each user behavior data to obtaining, in above-mentioned user behavior sign aggregate list, search user behavior sign corresponding to user behavior that is complementary with this user behavior data, the user behavior sign that finds is identified as user behavior corresponding to this user behavior data;
Further, log file intellectual analysis unit 70 also is used for according to the predefined time interval, the historical log file in the network element of collection high in the clouds system;
User behavior control unit 71, be used for after the terminal use's behavior uploaded state list request that receives the terminal transmission, for each the user behavior sign in the user behavior sign aggregate list that sets in advance, determine uploaded state corresponding to this user behavior sign according to above-mentioned high in the clouds user behavior identification list, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign;
Further, user behavior control unit 71, be used for each the user behavior sign for the user behavior sign aggregate list that sets in advance, determine whether to comprise in the user behavior identification list of above-mentioned high in the clouds this user behavior sign, if, determine that then uploaded state corresponding to this user behavior sign is: this terminal does not need to report the user behavior data relevant with user behavior corresponding to this user behavior sign, otherwise determine that uploaded state corresponding to this user behavior sign is: this terminal need to report with this user behavior and identify the relevant user behavior data of corresponding user behavior;
Data transmission unit 72, be used for to above-mentioned terminal transmitting terminal user behavior uploaded state tabulation, comprise each user behavior sign and uploaded state corresponding to each user behavior sign in the above-mentioned user behavior sign aggregate list in this terminal use's behavior uploaded state tabulation;
Further, data transmission unit 72 is used for before the historical log file of equipment acquisition network element beyond the clouds above-mentioned user behavior sign aggregate list being sent to terminal;
Further, data transmission unit 72 also backs up for terminal use's behavior uploaded state tabulation that will send to above-mentioned terminal.
Referring to Fig. 8, be a kind of terminal that the embodiment of the invention provides, this equipment can be applied in the above-mentioned journal file reporting system, and equipment is implemented as follows:
Request of data unit 80 is used for to high in the clouds equipment transmitting terminal user behavior uploaded state list request;
Further, request of data unit 80 also is used for after each start to high in the clouds equipment transmitting terminal user behavior uploaded state list request; Perhaps, every setting-up time to high in the clouds equipment transmitting terminal user behavior uploaded state list request; Perhaps, in each report of user behavioral data forward direction high in the clouds equipment transmitting terminal user behavior uploaded state list request;
Further, request of data unit 80, the user behavior data that is used for needs are reported compresses, if the file size of the user behavior data after the compression greater than the writing time of setting the user behavior data after byte threshold value or the compression greater than the setting-up time threshold value, then in the network connection state of terminal and high in the clouds equipment when being connected, to high in the clouds equipment transmitting terminal user behavior uploaded state list request;
User behavior collector unit 81, be used for receiving terminal use's behavior uploaded state tabulation that high in the clouds equipment sends, comprise each user behavior sign and uploaded state corresponding to each user behavior sign in the user behavior sign aggregate list that sets in advance in the tabulation of this terminal use's behavior uploaded state, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign;
Further, user behavior collector unit 81 also is used for receiving the above-mentioned user behavior sign aggregate list that high in the clouds equipment sends;
Data report unit 82, are used for carrying out reporting of user behavior data according to above-mentioned terminal use's behavior uploaded state tabulation;
Further, data report unit 82, also be used for after generating the user behavior data that need to report, in above-mentioned user behavior sign aggregate list, search the user behavior sign that the user behavior corresponding with this user behavior data is complementary, in above-mentioned terminal use's behavior uploaded state tabulation, search this user behavior sign, if the uploaded state of this user behavior sign correspondence is for reporting, then report this user behavior data to high in the clouds equipment, if the uploaded state of this user behavior sign correspondence does not then report this user behavior data to high in the clouds equipment for not reporting;
To sum up, beneficial effect of the present invention comprises:
In the scheme that the embodiment of the invention provides, high in the clouds equipment obtains user behavior data according to historical log file, and to the tabulation of terminal transmitting terminal user behavior uploaded state, indicating terminal to report user behavior data; Terminal is carried out reporting of user behavior data according to this terminal use's behavior uploaded state tabulation to high in the clouds equipment.Because the network element of high in the clouds system and terminal carrying out service can produce the historical log file of a large amount of and this traffic aided when processing, the user behavior data that can comprise great amount of terminals in this history log file, high in the clouds equipment can extract the user behavior data that obtains terminal from historical log file, and then utilize the user behavior data that from historical log file, extracts that the user behavior of terminal is analyzed, therefore do not need terminal to report again the user behavior data that from historical log file, has extracted, thereby can save the employed network traffics of terminal to report user behavior data, avoid terminal owing to uploading the waste of the network traffics that unnecessary user behavior data brings.As seen, the waste of the network traffics that the present invention produces in the time of can effectively reducing the terminal to report daily record, can reduce simultaneously terminal user behavior data write indegree and terminal and high in the clouds equipment alternately.
The present invention is that reference is described according to flow chart and/or the block diagram of method, equipment (system) and the computer program of the embodiment of the invention.Should understand can be by the flow process in each flow process in computer program instructions realization flow figure and/or the block diagram and/or square frame and flow chart and/or the block diagram and/or the combination of square frame.Can provide these computer program instructions to the processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device producing a machine, so that the instruction of carrying out by the processor of computer or other programmable data processing device produces the device that is used for realizing in the function of flow process of flow chart or a plurality of flow process and/or square frame of block diagram or a plurality of square frame appointments.

Claims (11)

1. a control terminal reports the method for journal file, it is characterized in that, the method comprises:
History log log file in the network element of equipment collection high in the clouds, high in the clouds system, the historical log file that collects is analyzed, obtain user behavior data, user behavior sign corresponding to each user behavior data that obtains is stored in the user behavior identification list of high in the clouds;
High in the clouds equipment is after the terminal use's behavior uploaded state list request that receives the terminal transmission, for each the user behavior sign in the user behavior sign aggregate list that sets in advance, determine uploaded state corresponding to this user behavior sign according to described high in the clouds user behavior identification list, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign;
High in the clouds equipment is tabulated to described terminal transmitting terminal user behavior uploaded state, comprises each user behavior sign and uploaded state corresponding to each user behavior sign in the described user behavior sign aggregate list in this terminal use's behavior uploaded state tabulation.
2. the method for claim 1 is characterized in that, described high in the clouds equipment is analyzed the historical log file that collects, and obtains user behavior data, specifically comprises:
High in the clouds equipment each historical log file to collecting, judge that whether the file size of this history log file is less than predetermined threshold value, if, utilize the elementary parsing module of constructing in advance to extract the characteristic information of this history log file, the characteristic information that extracts is stored in the relational database as user behavior data; Otherwise, utilize the senior parsing module of structure in advance to extract the characteristic information of this history log file, and the characteristic information that extracts be stored in the database based on distributed system as user behavior data.
3. the method for claim 1 is characterized in that, the user behavior sign that described each user behavior data that will obtain is corresponding is stored in the user behavior identification list of high in the clouds, specifically comprises:
High in the clouds equipment each user behavior data to obtaining, in described user behavior sign aggregate list, search user behavior sign corresponding to user behavior that is complementary with this user behavior data, the user behavior sign that finds is identified as user behavior corresponding to this user behavior data.
4. the method for claim 1, it is characterized in that, each user behavior sign in the described user behavior sign aggregate list for setting in advance is determined uploaded state corresponding to this user behavior sign according to described high in the clouds user behavior identification list, specifically comprises:
High in the clouds equipment is for each the user behavior sign in the user behavior sign aggregate list that sets in advance, determine whether to comprise in the user behavior identification list of described high in the clouds this user behavior sign, if, determine that then uploaded state corresponding to this user behavior sign is: this terminal does not need to report the user behavior data relevant with user behavior corresponding to this user behavior sign, otherwise determine that uploaded state corresponding to this user behavior sign is: this terminal need to report with this user behavior and identify the relevant user behavior data of corresponding user behavior.
5. such as arbitrary described method among the claim 1-4, it is characterized in that, further comprise:
High in the clouds equipment will send to terminal use's behavior uploaded state tabulation of described terminal and back up.
6. a high in the clouds equipment is characterized in that, this high in the clouds equipment comprises:
Log file intellectual analysis unit, the historical log file that is used for the network element of collection high in the clouds system, the historical log file that collects is analyzed, obtained user behavior data, user behavior sign corresponding to each user behavior data that obtains is stored in the user behavior identification list of high in the clouds;
The user behavior control unit, be used for after the terminal use's behavior uploaded state list request that receives the terminal transmission, for each the user behavior sign in the user behavior sign aggregate list that sets in advance, determine uploaded state corresponding to this user behavior sign according to described high in the clouds user behavior identification list, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign;
Data transmission unit, be used for to described terminal transmitting terminal user behavior uploaded state tabulation, comprise each user behavior sign and uploaded state corresponding to each user behavior sign in the described user behavior sign aggregate list in this terminal use's behavior uploaded state tabulation.
7. high in the clouds as claimed in claim 6 equipment is characterized in that, described log file intellectual analysis unit is used for:
To each the historical log file that collects, judge that whether the file size of this history log file is less than predetermined threshold value, if, utilize the elementary parsing module of constructing in advance to extract the characteristic information of this history log file, the characteristic information that extracts is stored in the relational database as user behavior data; Otherwise the senior parsing module that utilization is constructed in advance extracts the characteristic information of this history log file, and the characteristic information that extracts is stored in the distributed file system as user behavior data.
8. high in the clouds as claimed in claim 6 equipment is characterized in that, described log file intellectual analysis unit is used for:
To each user behavior data that obtains, in described user behavior sign aggregate list, search user behavior sign corresponding to user behavior that is complementary with this user behavior data, the user behavior sign that finds is identified as user behavior corresponding to this user behavior data.
9. high in the clouds as claimed in claim 6 equipment is characterized in that, described user behavior control unit is used for:
For each the user behavior sign in the user behavior sign aggregate list that sets in advance, determine whether to comprise in the user behavior identification list of described high in the clouds this user behavior sign, if, determine that then uploaded state corresponding to this user behavior sign is: this terminal does not need to report the user behavior data relevant with user behavior corresponding to this user behavior sign, otherwise determine that uploaded state corresponding to this user behavior sign is: this terminal need to report with this user behavior and identify the relevant user behavior data of corresponding user behavior.
10. such as arbitrary described high in the clouds equipment among the claim 6-9, it is characterized in that, described data transmission unit also is used for:
The terminal use's behavior uploaded state tabulation that sends to described terminal is backed up.
11. a journal file reporting system is characterized in that, this system comprises:
High in the clouds equipment, the historical log file that is used for the network element of collection high in the clouds system, the historical log file that collects is analyzed, obtained user behavior data, user behavior sign corresponding to each user behavior data that obtains is stored in the user behavior identification list of high in the clouds; After the terminal use's behavior uploaded state list request that receives the terminal transmission, for each the user behavior sign in the user behavior sign aggregate list that sets in advance, determine uploaded state corresponding to this user behavior sign according to described high in the clouds user behavior identification list, this uploaded state represents whether this terminal needs to report the user behavior data relevant with user behavior corresponding to this user behavior sign; To described terminal transmitting terminal user behavior uploaded state tabulation, comprise each user behavior sign and uploaded state corresponding to each user behavior sign in the described user behavior sign aggregate list in this terminal use's behavior uploaded state tabulation;
Terminal is used for to high in the clouds equipment transmitting terminal user behavior uploaded state list request; Receive terminal use's behavior uploaded state tabulation that high in the clouds equipment sends; According to described terminal use's behavior uploaded state tabulation, carry out reporting of user behavior data.
CN201310236928.5A 2013-06-14 2013-06-14 A kind of control terminal reports the method, apparatus and system of journal file Active CN103312544B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310236928.5A CN103312544B (en) 2013-06-14 2013-06-14 A kind of control terminal reports the method, apparatus and system of journal file

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310236928.5A CN103312544B (en) 2013-06-14 2013-06-14 A kind of control terminal reports the method, apparatus and system of journal file

Publications (2)

Publication Number Publication Date
CN103312544A true CN103312544A (en) 2013-09-18
CN103312544B CN103312544B (en) 2015-12-02

Family

ID=49137346

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310236928.5A Active CN103312544B (en) 2013-06-14 2013-06-14 A kind of control terminal reports the method, apparatus and system of journal file

Country Status (1)

Country Link
CN (1) CN103312544B (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103838659A (en) * 2014-02-17 2014-06-04 大唐移动通信设备有限公司 Method and device for controlling system logs
CN105099740A (en) * 2014-05-15 2015-11-25 中国移动通信集团浙江有限公司 Log management system and log collection method
CN105357549A (en) * 2015-11-09 2016-02-24 天津网络广播电视台有限公司 Data collection system and data collection method for set-top box
CN105701122A (en) * 2014-11-28 2016-06-22 深圳市腾讯计算机系统有限公司 Log collection method, apparatus and system
CN105915365A (en) * 2015-12-25 2016-08-31 乐视致新电子科技(天津)有限公司 Method, server and client for controlling reporting of crash data
CN106598832A (en) * 2015-10-16 2017-04-26 富士通株式会社 Device and method for processing running context of application in crowdsourcing test
CN106899643A (en) * 2015-12-21 2017-06-27 阿里巴巴集团控股有限公司 A kind of user journal storage method and equipment
CN103905446B (en) * 2014-03-31 2017-08-01 广州华多网络科技有限公司 Report the method and terminal, the method for statistical information and server of information
CN108769809A (en) * 2018-05-28 2018-11-06 成都市极米科技有限公司 Domestic consumer's behavioral data acquisition method, device and computer readable storage medium based on smart television
CN110120964A (en) * 2018-02-07 2019-08-13 北京三快在线科技有限公司 User behavior monitoring method and device and calculating equipment
CN111092879A (en) * 2019-12-13 2020-05-01 杭州迪普科技股份有限公司 Log association method and device, electronic equipment and storage medium
CN113641639A (en) * 2021-07-09 2021-11-12 北京百度网讯科技有限公司 Log reporting method and device, electronic equipment and storage medium
CN114257502A (en) * 2020-09-21 2022-03-29 华为终端有限公司 Log reporting method and device

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106126348A (en) * 2016-06-07 2016-11-16 青岛海信移动通信技术股份有限公司 A kind of method and device reporting collection data

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1553724A1 (en) * 2004-01-09 2005-07-13 Alcatel Alarm log file reporting using XML tagging
CN1719918A (en) * 2004-07-07 2006-01-11 华为技术有限公司 Substation diary reporting system and method
CN102164043A (en) * 2010-10-27 2011-08-24 青岛海信传媒网络技术有限公司 Log reporting method and terminal
CN102882705A (en) * 2012-09-03 2013-01-16 青岛海信传媒网络技术有限公司 Method for reporting log through terminal equipment and log reporting system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1553724A1 (en) * 2004-01-09 2005-07-13 Alcatel Alarm log file reporting using XML tagging
CN1719918A (en) * 2004-07-07 2006-01-11 华为技术有限公司 Substation diary reporting system and method
CN102164043A (en) * 2010-10-27 2011-08-24 青岛海信传媒网络技术有限公司 Log reporting method and terminal
CN102882705A (en) * 2012-09-03 2013-01-16 青岛海信传媒网络技术有限公司 Method for reporting log through terminal equipment and log reporting system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
付巍: "基于无线传感器网络的移动终端用户行为识别研究", 《中国优秀硕士学位论文全文数据库》 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103838659A (en) * 2014-02-17 2014-06-04 大唐移动通信设备有限公司 Method and device for controlling system logs
CN103838659B (en) * 2014-02-17 2017-09-01 大唐移动通信设备有限公司 The control method and device of a kind of system journal
CN103905446B (en) * 2014-03-31 2017-08-01 广州华多网络科技有限公司 Report the method and terminal, the method for statistical information and server of information
CN105099740A (en) * 2014-05-15 2015-11-25 中国移动通信集团浙江有限公司 Log management system and log collection method
CN105701122A (en) * 2014-11-28 2016-06-22 深圳市腾讯计算机系统有限公司 Log collection method, apparatus and system
CN105701122B (en) * 2014-11-28 2020-06-16 深圳市腾讯计算机系统有限公司 Log collection method, device and system
CN106598832A (en) * 2015-10-16 2017-04-26 富士通株式会社 Device and method for processing running context of application in crowdsourcing test
CN105357549A (en) * 2015-11-09 2016-02-24 天津网络广播电视台有限公司 Data collection system and data collection method for set-top box
CN106899643A (en) * 2015-12-21 2017-06-27 阿里巴巴集团控股有限公司 A kind of user journal storage method and equipment
WO2017107438A1 (en) * 2015-12-25 2017-06-29 乐视控股(北京)有限公司 Method for controlling reporting of crash data, server and client
CN105915365A (en) * 2015-12-25 2016-08-31 乐视致新电子科技(天津)有限公司 Method, server and client for controlling reporting of crash data
CN110120964A (en) * 2018-02-07 2019-08-13 北京三快在线科技有限公司 User behavior monitoring method and device and calculating equipment
CN110120964B (en) * 2018-02-07 2022-07-08 北京三快在线科技有限公司 User behavior monitoring method and device and computing equipment
CN108769809A (en) * 2018-05-28 2018-11-06 成都市极米科技有限公司 Domestic consumer's behavioral data acquisition method, device and computer readable storage medium based on smart television
CN108769809B (en) * 2018-05-28 2021-06-29 成都极米科技股份有限公司 Smart television-based home user behavior data acquisition method and device and computer-readable storage medium
CN111092879B (en) * 2019-12-13 2022-05-31 杭州迪普科技股份有限公司 Log association method and device, electronic equipment and storage medium
CN111092879A (en) * 2019-12-13 2020-05-01 杭州迪普科技股份有限公司 Log association method and device, electronic equipment and storage medium
CN114257502A (en) * 2020-09-21 2022-03-29 华为终端有限公司 Log reporting method and device
CN114257502B (en) * 2020-09-21 2023-08-22 华为终端有限公司 Log reporting method and device
CN113641639A (en) * 2021-07-09 2021-11-12 北京百度网讯科技有限公司 Log reporting method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN103312544B (en) 2015-12-02

Similar Documents

Publication Publication Date Title
CN103312544B (en) A kind of control terminal reports the method, apparatus and system of journal file
CN110908879B (en) Reporting method, reporting device, reporting terminal and recording medium of buried point data
CN103209087B (en) Distributed information log statistical processing methods and system
WO2021169268A1 (en) Data processing method, apparatus and device, and storage medium
CN104899325A (en) APP (application) acquired data collection method, terminal, server and system
CN111309550A (en) Data acquisition method, system, equipment and storage medium of application program
CN111813573B (en) Communication method of management platform and robot software and related equipment thereof
CN103853743A (en) Distributed system and log query method thereof
CN108334557B (en) Aggregated data analysis method and device, storage medium and electronic equipment
CN108228322B (en) Distributed link tracking and analyzing method, server and global scheduler
CN102222112B (en) Resource management device and resource management method
CN110928681A (en) Data processing method and device, storage medium and electronic device
CN111400393A (en) Data processing method and device based on multi-application platform and storage medium
CN114205641A (en) Video data processing method and device
CN108829735B (en) Synchronization method, device, server and storage medium for parallel execution plan
WO2022048201A1 (en) Data processing method and apparatus, and electronic device and storage medium
CN112764988B (en) Data segment acquisition method and device
CN110134547B (en) Middleware-based repeated data deleting method and related device
CN115114316A (en) Processing method, device, cluster and storage medium for high-concurrency data
CN113515425A (en) Method and device for dynamically reporting data
CN112506886A (en) Multi-source service operation log acquisition method and system
CN113064787B (en) Method and system for collecting logs based on BMC virtual media technology
CN111143280B (en) Data scheduling method, system, device and storage medium
CN111143057B (en) Heterogeneous cluster data processing method and system based on multiple data centers and electronic equipment
CN110809013B (en) Monitoring data acquisition method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20170118

Address after: 266100 Shandong Province, Qingdao city Laoshan District Songling Road No. 399

Patentee after: Poly Polytron Technologies Inc

Address before: 266071 Laoshan, Qingdao province Hongkong District No. East Road, room 248, room 131

Patentee before: Hisense Media Networks Co., Ltd.