CN102457893A - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN102457893A CN102457893A CN2010105273172A CN201010527317A CN102457893A CN 102457893 A CN102457893 A CN 102457893A CN 2010105273172 A CN2010105273172 A CN 2010105273172A CN 201010527317 A CN201010527317 A CN 201010527317A CN 102457893 A CN102457893 A CN 102457893A
- Authority
- CN
- China
- Prior art keywords
- business datum
- data
- terminal
- module
- association analysis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data processing method and a device. The data processing method comprises the following steps: receiving a first service data reported by a terminal and a second service data reported by a service device, and then performing correlation analysis on the service according to the first service data and the second service data. According to the data processing method and device disclosed by the invention, the service data reported by the terminal and the service data reported by the service device are subjected to the correlation analysis and a more powerful data basis for optimizing a data service and analyzing a user action is supplied.
Description
Technical field
The present invention relates to communication technical field, especially relate to a kind of data processing method and equipment.
Background technology
Development along with mobile data services; The particularly extensive use of the third generation (3G) mobile communication; How when guaranteeing networking; Promote rapidly data service quality, satisfy the growing demand of user to professional diversity of data and high reliability, become the problem that operator need solve.Wherein, professional for data, order whether the mode of quitting the subscription of is convenient, the user uses whether business experience is friendly, whether the client end response of data service is rapid etc. all can have influence on the use of user to business, thus the traffic affecting utilization rate.
But because data service is of a great variety, the quality of quality does not have unified standard, and the client that the terminal is surveyed is also owing to can there be a plurality of versions in reasons such as customization; Therefore, carry out data service quality analysis and user behavior analysis difficulty relatively.
In the prior art, the mode of carrying out data service quality analysis and user behavior analysis comprises:
(1) active user's behavioural analysis system relies on the background support system, carries out mining analysis according to the information such as ticket that user's various demographic informations, historical set meal, telephone expenses situation and each business platform provide.
(2) client and the UI (User Interface, user interface) of business platform survey at the terminal carry out correlation analysis through modes such as customer surveys.
(3) in network monitoring and field tests, can use the pattern of " test terminal+drive test software ", under this pattern, network, signal power to be tested through the use test terminal pins, the data that collect the test terminal on the backstage are analyzed.
In realizing process of the present invention, the inventor finds to exist at least in the prior art following problem:
The behavior that the user surveys at the terminal can't combine with back-end data, causes analysis result inaccurate.
Summary of the invention
The embodiment of the invention provides a kind of data processing method and equipment, with data on the combination terminal and the data on the service apparatus business is analyzed.
In order to achieve the above object, the embodiment of the invention provides a kind of data processing method, comprising:
Second business datum that reception reports from first business datum and the service apparatus of terminal to report; And it is professional according to said first business datum and the said second business datum association analysis.
The embodiment of the invention provides a kind of data processing equipment, comprising:
The terminal parameter collection module is used to receive first business datum from terminal to report;
Platform parameter collection module is used to receive second business datum that reports from service apparatus;
The association analysis module is used for according to said first business datum of said terminal parameter collection module reception and the said second business datum association analysis business of said platform parameter collection module reception.
The embodiment of the invention provides a kind of terminal, comprising:
Clock synchronization module is used for the time at terminal and the time of service apparatus are carried out synchronously;
The monitoring Executive Module is used for the first corresponding business datum of capturing service, and said first business datum is beaten timestamp;
The reporting parameters module is used to said first business datum that reports said monitoring Executive Module to gather.
The embodiment of the invention provides a kind of service apparatus, comprising:
Clock synchronization module is used for the time of service apparatus and the time at terminal are carried out synchronously;
The parameter acquisition module is used for the professional second corresponding business datum of acquisition terminal; And said second business datum beaten timestamp;
The reporting parameters module is used to said second business datum that reports said parameter acquisition module to gather.
Compared with prior art, the embodiment of the invention has the following advantages at least:
Business datum through business datum and service apparatus to terminal to report report is carried out association analysis, can optimize the business on the terminal, and is that data service optimization and user behavior analysis provide stronger data basis.
Description of drawings
In order to be illustrated more clearly in technical scheme of the present invention; The accompanying drawing of required use is done to introduce simply in will describing embodiment below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills; Under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the system architecture sketch map of the data processing method that provides of the embodiment of the invention;
Fig. 2 is the schematic flow sheet of the data processing method that provides of the embodiment of the invention;
Fig. 3 is that embodiment of the invention terminal collection user uses professional corresponding service data, and this business datum is reported the schematic flow sheet of task analyzer;
Fig. 4 is the schematic flow sheet that uses the Aho-Corasic method in the multi-mode identification in the embodiment of the invention multi-model matching method;
Fig. 5 business datum that to be embodiment of the invention task analyzer report according to the business datum and the service apparatus of terminal to report is analyzed the schematic flow sheet of the business on this terminal;
Fig. 6 is a system acquisition sketch map under a kind of application scenarios of providing of the embodiment of the invention;
Fig. 7 is the equipment structure chart of a kind of data processing method of providing of the embodiment of the invention;
Fig. 8 is the structure chart at a kind of terminal of providing of the embodiment of the invention;
Fig. 9 is the structure chart of a kind of service apparatus of providing of the embodiment of the invention.
Embodiment
In the prior art, when carrying out data service quality analysis and user behavior analysis, real-time is poor (when going wrong in the data service use, can't orient that client goes wrong or background server goes wrong; And realize owing to Trouble Report depends on the artificial mode of complaining of user; Situation when reproduction fault that therefore can not be real-time takes place causes precision of analysis to reduce), (for example can't pinpoint the problems comprehensively; Network rate is low; Client bug, problem such as the background process flow process is slow), and analysis user behavior that can't be correct.To the problems referred to above; A kind of data processing method and equipment are provided in the embodiment of the invention; The information that task analyzer reports through receiving terminal and service apparatus, and combine the information of terminal to report and the information that service apparatus reports to carry out association analysis, analyze related service through data mining technology; And according to analysis result related service is optimized, reach the target of the professional and user behavior of intellectual analysis.
To combine the accompanying drawing among the present invention below, the technical scheme among the present invention is carried out clear, intactly description, obviously, described embodiment only is a part of embodiment of the present invention, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills are not making the every other embodiment that is obtained under the creative work prerequisite, all belong to the scope of the present invention's protection.
The embodiment of the invention provides a kind of data processing method, and this method is applied to comprise in the system of terminal, service apparatus and task analyzer, system architecture sketch map as shown in Figure 1.Wherein:
(1) terminal: can need the business datum of collection as required to the customization of different service test assignment, and business datum is reported task analyzer.Wherein, this business datum comprises but is not limited to business conduct data, service exception data (in the professional use unusual), user behavior data (user behavior relevant with business), contextual information etc.
Concrete, through on the terminal, using professional behavior to monitor and record, can collect business datum, and the business datum that collects is reported through wireless network the user.
In the embodiment of the invention, the functional module that is positioned on the terminal includes but not limited to: protocal analysis and multi-mode matching module, monitoring configuration module, reporting parameters module, monitoring Executive Module, clock synchronization module etc.Above-mentioned each functional module can be the part of TMP, and certainly, in the practical application, the above-mentioned functions module can merge, and also can further split.
A, monitoring configuration module: i.e. the configuration module of end side monitoring scheme can customize or dynamically update in advance.Wherein, this monitoring configuration module is used for confirming business datum that monitoring program need be gathered and mode that business datum is reported etc.In the practical application, the monitoring configuration module can also be confirmed the monitoring scheme of end side through the configuration mode of analyzing task analyzer, repeats no more at this.
The business datum of this collection is specially: parameters such as the business of acquisition terminal, signaling, incident, user behavior type; This is specially the mode that business datum reports: the mode (for example, reporting frequency etc.) that the business datum at the terminal that collects is reported.
B, reporting parameters module: the terminal is collecting various parameters (business datum) afterwards, need under specified requirements, this business datum be reported task analyzer through modes such as wireless network or data wires.
Wherein, this specified requirements reports mode for the monitoring configuration module configures, includes but not limited to: call time in the appointment, specify and report frequency, specify reported event (trigger event) etc.
C, monitoring Executive Module: be used for gathering various parameters (business datum), and be that the business datum that collects is beaten timestamp according to the acquisition mode of monitoring configuration module configures.
Concrete, when the monitoring configuration module configures needed the parameters such as business, signaling, incident, user behavior type of acquisition terminal, then monitoring Executive Module needed parameters such as the business of acquisition terminal, signaling, incident, user behavior type.
D, clock synchronization module: be used for the time at terminal and the time of each service apparatus are carried out synchronously.
Concrete, the mode that clock synchronization module can adopt GPS (Global Positioning System, global positioning system) to aim at is carried out synchronously; Perhaps, it is synchronous etc. to use the mode of aiming at same clock alignment system to carry out.
E, protocal analysis and multi-mode matching module: be used to adopt based on the mode of protocal analysis and obtain various data flow, and adopt multi-mode matching mode one-off scanning data flow, coupling pre-sets the serial data of incident, the output matching result.
(2) access way: terminal (for example, the TMP on the terminal) can report task analyzer with business datum through wireless network.
Concrete, the terminal can report task analyzer with the business datum that collects through wireless network according to pre-configured mode; Perhaps,
The terminal business datum with collecting of (or according to test plan) in real time reports task analyzer through wireless network; Perhaps,
For the service exception of appointment, the terminal can report the service exception related data that collects the service apparatus or the task analyzer of appointment as requested.
(3) service apparatus: be used for the business datum (for example, the business datum at terminal and user behavior etc.) of acquisition terminal, and the business datum that collects is reported task analyzer.
In the embodiment of the invention, the functional module that is positioned on the service apparatus includes but not limited to: parameter acquisition module, reporting parameters module and clock synchronization module etc.Certainly, in the practical application, the above-mentioned functions module can merge, and also can further split.
A, parameter acquisition module are used for the business datum of acquisition terminal.
Wherein, after collecting the business datum of user on this service apparatus, also need stamp timestamp, and preserve the corresponding business data for the corresponding business data.
B, reporting parameters module are used under specified requirements, the business datum that collects (parameter) being reported task analyzer.
Wherein, this specified requirements includes but not limited to: call time in the appointment, specify and report frequency, specify reported event (trigger event) etc.
C, clock synchronization module are used for the time of service apparatus self is carried out synchronously.
Concrete, the mode that clock synchronization module can adopt GPS to aim at is carried out synchronously; Perhaps, it is synchronous etc. to use the mode of aiming at same clock alignment system to carry out.
(4) task analyzer: be used for the business datum analysis-by-synthesis related service that business datum and service apparatus according to terminal to report report, and related service be optimized according to analysis result.
Concrete; The characteristics of carrying out to current telecommunication service are in the embodiment of the invention, through on the terminal, using professional behavior to monitor and record to the user; And the business datum that collects reported task analyzer through wireless network; And the business datum that the joint business device collects carries out association analysis, with the analysis-by-synthesis related service, reaches the target of the professional and user behavior of intellectual analysis.
In the embodiment of the invention, the functional module that is positioned on the task analyzer includes but not limited to: terminal parameter collection module, platform parameter collection module, association analysis module, output module.Certainly, in the practical application, the above-mentioned functions module can merge, and also can further split.
A, terminal parameter collection module: be used to receive the information of each terminal to report, comprise the business datum that the terminal collects in the information of each terminal to report.
B, platform parameter collection module: be used to receive the information that each service apparatus reports, comprise the business datum that service apparatus collects in the information that each service apparatus reports.
C, association analysis module: be used for carrying out related merging with the business datum that each service apparatus reports, and the information after will handling is as the foundation of Real-time Alarm, service optimization and customer analysis according to the business datum of terminal to report.
D, output module: be used for the analysis result of association analysis module is outputed to output equipment, so that display analysis result more intuitively.For example, output to screen display device and carry out screen display, perhaps, output to PRN device and print output etc., so that display analysis result more intuitively.
It should be noted that in the embodiment of the invention, task analyzer can be used as functional module and is integrated on the service apparatus, and the business datum analysis-by-synthesis related service that the business datum and the service apparatus of terminal to report is reported based on the service apparatus corresponding service; Task analyzer also can be used as individual entities, and the business datum analysis-by-synthesis related service that reports (independent service apparatus or a plurality of service apparatus) based on the business datum (data of a plurality of business or the data of separate operation) and the service apparatus of terminal to report.
Based on the functional module in each device in the said system and each device, as shown in Figure 2 in the method that the embodiment of the invention provides, this method may further comprise the steps:
In this step, the terminal is gathered the user and used professional corresponding service data, and this business datum is reported the process of task analyzer, and is as shown in Figure 3, further may further comprise the steps:
Concrete, the terminal is after starting and initiating process of service execution, and TMP will move in the backstage, and the professional whole implementation of monitoring.At this moment, various parameters (for example, gathering various parameters according to the relevant configuration of monitoring configuration module) can be gathered in the terminal, and are that the parameter that collects is beaten timestamp.Wherein, use business to the user in the monitoring range, TMP can use professional parameter (for example, specifying the parameter of signalling interactive process, the information such as time that the user key-press behavior takes place) according to this user of configuration record of monitoring configuration module.
In the embodiment of the invention, the parameter that needs to gather includes but not limited to:
Specify the parameter of signalling interactive process;
The time that the user key-press behavior takes place;
The information of related network layer, like CELL ID (cell ID), LAC ID (Location Area Code, Location Area Code), adjacent cell relation information etc.;
The information of relevant operation layer comprises note, multimedia message etc.;
Location information of terminals is like GPS (Global Positioning System, global position determination system) geographical location information etc.
It should be noted that the above-mentioned parameter that needs to gather is the business datum that task analyzer need gathered and report in the terminal.For example, the information of related network layer is the contextual information in the business datum.
In the embodiment of the invention, can adopt multi-pattern matching algorithm to generate reporting information, in practical application, also can adopt other algorithms to generate reporting information, repeat no more in the embodiment of the invention based on protocal analysis.
Use in the professional implementation in monitor user '; Will monitor lot of data; And in monitoring scheme (the monitoring configuration module confirms that monitoring program needs information such as the business, signaling, incident, user behavior type of acquisition terminal); Pointed out to report the business datum of task analyzer, therefore, through using multi-pattern matching algorithm based on protocal analysis; Can from the mass data that monitors, filter out the business datum that need report task analyzer, and the business datum that filters out is generated reporting information.
In sum; Owing to, use in the professional implementation data that obtain in the observation process for each record in monitor user ' based on the unlatching of the multi-pattern matching algorithm of protocal analysis; All can directly screen, with the final business datum of confirming to send to task analyzer.
Concrete, set in end side and to have reported mode (can by the setting of monitoring configuration module) after collecting business datum, then report mode according to this, the terminal can judge whether to take place trigger event.For example, when on having set appointment, calling time, then call time on can judging whether to have arrived and specifying in the terminal; When having set the appointment reported event, then the terminal can judge whether to have taken place the appointment reported event.
In practical application, this trigger event includes but not limited to: specify reported event to trigger (as collecting the triggering after unusual), call time in the appointment (as regularly triggering), specify report that frequency triggers, the tester is manual triggers etc.
Wherein, this terminal can send to task analyzer with the business datum that needs report through wireless network, PS (packet domain) or INTERNET (the Internet).
In the embodiment of the invention, after the business datum that needs are reported sent to task analyzer, the relevant information of preservation also can be removed in the terminal.Preferably, the relevant information of preserving can be removed in the terminal after the affirmation information that receives the task analyzer answer.
It should be noted that; In order to guarantee the accuracy of business datum; Can also the time at terminal and the time of each service apparatus be carried out synchronously, at this moment, the mode that can adopt the GPS mode to aim at is carried out synchronously or to use the mode of aiming at same clock alignment system to carry out synchronous etc.
In the embodiment of the invention, when the terminal is tested, need a lot of agreements of collection analysis and incident, much relevant agreement with application.Therefore, the interaction data of the application outside a lot of signalings is arranged in the data that collect, and these data need not preserved.In addition, considering in the data of eating dishes without rice or wine that the terminal obtains has a large amount of PS numeric field data amounts, can't all data flow to be analyzed all be kept at end side, and the detection of trigger event can influence the accuracy of test parameter.In order to address the above problem, can adopt the multi-mode matching mode that the data of gathering are carried out real-time protocal analysis in the embodiment of the invention.
Concrete; Through using the multi-mode matching mode; Only need the quick scanning that various data are carried out once from left to right be got final product during control and measuring, need not preserve data, make the test monitoring program can find trigger event fast; And fast search can, thereby reduce just in the influence of test assignment.
In addition, in the embodiment of the invention, consider that the terminal has multiple incident, more than 20 kind of anomalous event that is caused by chip for example arranged, these incidents can be the sign of one or several field, and length is very short; Also can be for having only the protocal analysis incident of certain applications layer, length can be slightly long; Therefore, the multi-model matching method in the embodiment of the invention can also use the Aho-Corasic method in the multi-mode identification, and schematic flow sheet as shown in Figure 4 may further comprise the steps:
Step 401 is set the protocol events character string.
Concrete, in protocal analysis, use the Aho-Corasic method before, need from the incident corresponding protocols, take out and have significant identification strings (being the incident character string), and with the generation of the appearance presentation of events of this incident character string.
In addition, in practical application, be positioned at the program of end side, can also n incident character string to be matched be set in advance according to the needs of test.
Step 402, preliminary treatment generates function of state.
Through the incident string assemble is carried out preliminary treatment, generate 3 function: goto (transfer) function, failure (inefficacy) function and output (output) function.Wherein, transfer function goto is illustrated in the next state that arrives behind the character that reads in next data flow to be compared under the current state.Inefficacy function f ailure is used for indicating under certain state, the next state that when the character that reads in does not match, should transfer to.The effect of output function output is in matching process, when coupling occurring, to export the incident that matches.
Function of state through generating can generate multimodal state machine, can use multi-pattern matching algorithm to carry out protocal analysis then, and find corresponding character string.
The data flow that step 403, scanning collection arrive.
Concrete, after having constructed 3 functions, i.e. scan data stream successively, and read the character of input one by one.
Step 404 judges whether input function is empty, if, forward step 403 to, otherwise, forward step 405 to.
Step 405, the output match event.
Concrete, from state 0 beginning, according to the character of current state and input, and adopt goto and failure function to transfer to next state, when the output function of the state of arrival is not empty.Then can export match event.
In the embodiment of the invention, service apparatus can report task analyzer with the business datum that collects under specified requirements.Wherein, this specified requirements includes but not limited to: call time in the appointment, specify and report frequency, specify reported event (trigger event) etc.
Concrete, after the business datum that the business datum and the service apparatus that receive from terminal to report report, task analyzer can the analysis-by-synthesis related service, and according to analysis result related service is optimized.
In this step, task analyzer is analyzed the business on this terminal according to the business datum that the business datum and the service apparatus of terminal to report reports, and is as shown in Figure 5, further may further comprise the steps:
Concrete, task analyzer is set up database according to the business datum of terminal to report with the business datum that each service apparatus collection reports.
Concrete, the process that data are integrated includes but not limited to: data source is chosen, data cleansing, denoising, data etc. fill a vacancy.In the embodiment of the invention, be example to analyze certain professional incident of quitting the subscription of, data source is chosen and is meant that taking-up is quit the subscription of the relevant parameter of incident with analysis from database.Wherein, some data possibly be (for example, has at short notice and repeatedly quit the subscription of incident etc.) of imperfect, mistake or repetition in these parameters, at this moment, need carry out data to relevant parameter and please wash, and filters those undesirable parameters.In addition, too depart from the data (for example, the duration of call less than 1 second business event etc.) of normal value to some, also need be with related data as noise remove.The data that fill a vacancy are primarily aimed at some due loss of learning in the data, must be with its completion.
It should be noted that in the practical application that the FAQs of data includes but not limited to: data imperfect (some interested attribute lacks property value, or only comprises aggregate data); Packet noisy (comprise mistake perhaps " isolated point ", for example negative appears in the time delay of certain point); Data are inconsistent etc.
Concrete, the data of task analyzer to putting in order can be segmented data according to concrete business diagnosis purpose and task; And rejecting redundant data; Theme to guarantee database is clear, and improves the efficient of data mining algorithm, reduces system resources consumption.
Continuation is an example to quit the subscription of incident; Be concerned about emphatically during analysis that the parameter that terminal and business platform in preceding 24 hours report takes place the incident of quitting the subscription of; At this moment, then can be from put this partial data in order with extracting in the original database, form about what this incident possibly was correlated with and quit the subscription of subject data.
Concrete, the business datum that task analyzer can report according to the business datum and the service apparatus of terminal to report (having carried out above-mentioned processing procedure related data afterwards) is carried out data mining.
In the practical application; Task analyzer can adopt FP (Frequent Pattern)-Growth method that data are carried out strong Mining Association Rules; Wherein, the FP-Growth method is excavated Frequent Item Sets through progressively formation condition pattern base and condition frequent pattern tree (fp tree), does not produce candidate.
With the streaming media service is example; When network condition was not good, then video can't normal play, and waits for too long will occur or situation such as often go offline; It is discontented and quit the subscription of situation to business experience to occur the user this moment possibly; In the embodiment of the invention, can find that through the operational trials of reality the treatment mechanism that streaming media playing is waited under the abominable situation of different terminals reply network is different, and different mechanism will cause user experience different.
In addition; Not difference concerning task analyzer can produce bigger influence to user's impression in order to know which kind of situation, (for example can adopt association analysis method; The analytical method of similar FP-Growth etc.) obtains taking place customer complaint or when quitting the subscription of incident; Playing appears in the terminal waits for support and confidence level long or that go offline, and its support and confidence level are high more, and it is then big more that the user is experienced influence.
For example, for two incident A, the incidence relation between the B can be considered support: the probability that incident A, B occur simultaneously through support and confidence level; Confidence level: when incident A occurs, incident B probability of occurrence.Wherein, for streaming media service, be example with the relation of end side incident A (broadcast wait timeout), incident B (going offline) and service apparatus side incident C (user quits the subscription of) in certain period, the index of compute associations rule A-＞C and B-＞C is as shown in table 1.
Table 1
| Correlation rule | Support | Confidence level |
| A→C | n1 | n2 |
| B→C | n3 | n4 |
Wherein, when support n1＞n3 and confidence level n2＞n4, show then that when incident A produces the probability that incident C produces is bigger, and explanation incident A is bigger to the influence of user's impression, in the practical business appearance that should note reducing incident A in service.
In sum; In the embodiment of the invention; Task analyzer carries out association analysis through the business datum that business datum and service apparatus to terminal to report report, and can optimize the business on the terminal, and is that data service optimization and user behavior analysis provide stronger data basis.
Further,, can the parameter that collect be reported through wireless network, realize doing test whenever and wherever possible through the mode of monitor client is installed on the terminal.End side adopts the multi-model matching method based on protocal analysis to come the collection event parameter, only needs single pass and need not preserve all data that the terminal obtains.Through terminal and business platform acquisition parameter and be reported to analysis platform simultaneously, come the analysis user behavior to carry out service optimization through data mining method.
In order more clearly to set forth the technical scheme that the embodiment of the invention provides, be example below in conjunction with certain business on the business platform, the processing procedure of task analyzer is further explained.
Should be with under the scene, be that example describes with the factor that adopts FP-Growth method mining analysis to influence user satisfaction in its certain period.
At first, import a database, comprise certain professional and all available correlative factor historical data in this database, and confirm a minimum support.
Secondly, structure FP-Tree (each Transaction Information item in the Transaction Information table is sorted according to support, and it is the tree of root node with NuLL that the data item in each affairs is inserted into successively by descending).
1) scan database is one time, and supported degree is greater than all set F of frequent of minimum support, and by each support descending of frequent, the result is designated as L.
2) scan database is once more formed frequent mode and is inserted FP-Tree by frequent order among the L frequent in each bar record.
At last, FP-Tree is carried out data mining obtain correlation rule, its concrete mining process is following:
Be input as a Tree who sets up with the FP-Tree algorithm, be output as all frequent collection.
1),, generates frequent collection output then to each combination of node in this path if this tree only comprises single path.
2) if this tree contains mulitpath; It then is frequent mode (the initial suffix pattern) beginning of l by length; Construct its condition pattern base (comprising the set of the prefix path that occurs with the suffix pattern among the FP-Tree); Structural environment is set (with condition pattern base new FP-Tree of structure principle formation according to FP-Tree) then, and recursively on this tree, excavates.Export frequent integrated mode, be connected realization through the suffix pattern with the frequent mode that the condition tree produces, resulting frequent mode is the correlation rule between professional and its correlative factor.
In order more clearly to set forth the technical scheme that the embodiment of the invention provides; The data service of using to have client software below in conjunction with user on the business platform is example; Processing procedure to task analyzer is further explained, promptly introduces the situation of end side and service apparatus image data and the method for Conjoint Analysis in detail.
Should be with under the scene, system acquisition sketch map as shown in Figure 6, the data service of use has a client; The user can be in this client configuration work; In use, received an irrelevant multimedia message information, the user has checked after this information; Get back to this client again and continue professional the use, after finishing using, withdraw from client.
Should be with under the scene, T0-T9 is the parameter and the time of origin of the incident of end side user behavior that can collect or client, t0-t3 is the service apparatus user behavior that can collect or the parameter and the time of origin of server end incident.
After these data all were reported to task analyzer, task analyzer can be with these records according to analysiss of sorting of Time And Event type, and obtained more complete user and use professional behavior and the various parameters of business in client.
(1) can obtain partial results according to the reported data of end side has:
The client terminal start-up time: T1-T0;
The user lands total time once: T2-T1 in client;
The user does a configuration information in client and submits the total time of accomplishing: T9-T8 to;
The user is the total time of a configuration operation stop: T8-T3-(T7-T6) in client.
(2) can obtain partial results according to the reported data of business platform has:
Client of business platform processing lands and needs the time: t1-t0;
Business platform is handled client's configuration modification needs the time: t3-t2;
This user has done constantly at this day t0 and has landed once, t2 time adjustment configuration information once.
(3) terminal and the business platform association analysis partial results of coming out has:
The network transfer delay that professional client lands: t0-T1 and T2-t1;
Professional user's configuration network transfer delay t2-T8 and T9-t3 once that accomplish.
Based on the inventive concept same with said method, a kind of data processing equipment also is provided in the embodiment of the invention, wherein, this data processing equipment is above-mentioned task analyzer, and is as shown in Figure 7, this equipment comprises:
Terminal parameter collection module 11 is used to receive first business datum from terminal to report;
Platform parameter collection module 12 is used to receive second business datum that reports from service apparatus;
Association analysis module 13, the business on the said terminal of the said second business datum association analysis that said first business datum that is used for receiving according to said terminal parameter collection module 11 and said platform parameter collection module 12 receive.
Said association analysis module 13 specifically is used for said first business datum and said second business datum are carried out data preparation; And first business datum and second business datum after adopting association analysis method to the data arrangement are carried out association analysis.
Said association analysis module 13 is further used for said first business datum and said second business datum are carried out the data integration; And the data after according to business diagnosis purpose and task data being integrated are carried out subject data and are selected.
The mode that said data are integrated comprises one or more of following mode: data source is chosen; Data cleansing; Denoising; Data fill a vacancy.
In the embodiment of the invention, this equipment also comprises:
Optimal module 14 is used for according to the result of the association analysis of said association analysis module 13 said business being optimized.
Output module 15 is used for the result of association analysis is outputed to output equipment, is shown the result of said association analysis by said output equipment.
Wherein, each module of apparatus of the present invention can be integrated in one, and also can separate deployment.Above-mentioned module can be merged into a module, also can further split into a plurality of submodules.
Based on the inventive concept same with said method, a kind of terminal also is provided in the embodiment of the invention, as shown in Figure 8, comprising:
Reporting parameters module 23, said first business datum that is used to report said monitoring Executive Module to gather is given task analyzer.
Wherein, each module of apparatus of the present invention can be integrated in one, and also can separate deployment.Above-mentioned module can be merged into a module, also can further split into a plurality of submodules.
Based on the inventive concept same with said method, a kind of service apparatus also is provided in the embodiment of the invention, as shown in Figure 9, comprising:
Reporting parameters module 33, said second business datum that is used to report said parameter acquisition module to gather is given task analyzer.
Wherein, each module of apparatus of the present invention can be integrated in one, and also can separate deployment.Above-mentioned module can be merged into a module, also can further split into a plurality of submodules.
Through the description of above execution mode, those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential general hardware platform, can certainly pass through hardware, but the former is better execution mode under a lot of situation.Based on such understanding; The part that technical scheme of the present invention contributes to prior art in essence in other words can be come out with the embodied of software product; This computer software product is stored in the storage medium; Comprise some instructions with so that computer equipment (can be personal computer, server, the perhaps network equipment etc.) carry out the described method of each embodiment of the present invention.
It will be appreciated by those skilled in the art that accompanying drawing is the sketch map of a preferred embodiment, module in the accompanying drawing or flow process might not be that embodiment of the present invention is necessary.
It will be appreciated by those skilled in the art that the module in the device among the embodiment can be distributed in the device of embodiment according to the embodiment description, also can carry out respective change and be arranged in the one or more devices that are different from present embodiment.The module of the foregoing description can be merged into a module, also can further split into a plurality of submodules.
The invention described above embodiment sequence number is not represented the quality of embodiment just to description.
More than disclosedly be merely several specific embodiment of the present invention, still, the present invention is not limited thereto, any those skilled in the art can think variation all should fall into protection scope of the present invention.
Claims (12)
1. a data processing method is characterized in that, comprising:
Second business datum that reception reports from first business datum and the service apparatus of terminal to report; And it is professional according to said first business datum and the said second business datum association analysis.
2. the method for claim 1 is characterized in that, and is professional according to said first business datum and the said second business datum association analysis, comprising:
Said first business datum and said second business datum are carried out data preparation; And first business datum and second business datum after adopting association analysis method to the data arrangement are carried out association analysis.
3. method as claimed in claim 2 is characterized in that, said first business datum and said second business datum are carried out data preparation, comprising:
Said first business datum and said second business datum are carried out the data integration; And the data after according to business diagnosis purpose and task data being integrated are carried out subject data and are selected.
4. method as claimed in claim 3 is characterized in that, the mode that said data are integrated comprises one or more of following mode: data source is chosen; Data cleansing; Denoising; Data fill a vacancy.
5. the method for claim 1 is characterized in that, and is professional according to said first business datum and the said second business datum association analysis, also comprises afterwards:
Result according to association analysis is optimized said business; Perhaps,
The result of association analysis is outputed to output equipment, show the result of said association analysis by said output equipment.
6. the method for claim 1 is characterized in that, said reception also comprises from second business datum that first business datum and the service apparatus of terminal to report reports before:
Carry out the time of self and the time of said service apparatus synchronously at said terminal; And said first business datum beaten timestamp;
Said service apparatus carries out the time of self and the time at said terminal synchronously; And said second business datum beaten timestamp.
7. a data processing equipment is characterized in that, comprising:
The terminal parameter collection module is used to receive first business datum from terminal to report;
Platform parameter collection module is used to receive second business datum that reports from service apparatus;
The association analysis module is used for according to said first business datum of said terminal parameter collection module reception and the said second business datum association analysis business of said platform parameter collection module reception.
8. equipment as claimed in claim 7 is characterized in that,
Said association analysis module specifically is used for said first business datum and said second business datum are carried out data preparation; And first business datum and second business datum after adopting association analysis method to the data arrangement are carried out association analysis.
9. equipment as claimed in claim 8 is characterized in that,
Said association analysis module is further used for said first business datum and said second business datum are carried out the data integration; And the data after according to business diagnosis purpose and task data being integrated are carried out subject data and are selected.
10. equipment as claimed in claim 7 is characterized in that, also comprises:
Optimal module is used for according to the result of the association analysis of said association analysis module said business being optimized;
Output module is used for the result of association analysis is outputed to output equipment, is shown the result of said association analysis by said output equipment.
11. a terminal is characterized in that, comprising:
Clock synchronization module is used for the time at terminal and the time of service apparatus are carried out synchronously;
The monitoring Executive Module is used for the first corresponding business datum of capturing service, and said first business datum is beaten timestamp;
The reporting parameters module is used to said first business datum that reports said monitoring Executive Module to gather.
12. a service apparatus is characterized in that, comprising:
Clock synchronization module is used for the time of service apparatus and the time at terminal are carried out synchronously;
The parameter acquisition module is used for the professional second corresponding business datum of acquisition terminal; And said second business datum beaten timestamp;
The reporting parameters module is used to said second business datum that reports said parameter acquisition module to gather.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010105273172A CN102457893A (en) | 2010-10-26 | 2010-10-26 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010105273172A CN102457893A (en) | 2010-10-26 | 2010-10-26 | Data processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102457893A true CN102457893A (en) | 2012-05-16 |
Family
ID=46040422
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010105273172A Pending CN102457893A (en) | 2010-10-26 | 2010-10-26 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102457893A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102915423A (en) * | 2012-09-11 | 2013-02-06 | 中国电力科学研究院 | System and method for filtering electric power business data on basis of rough sets and gene expressions |
| CN104660438A (en) * | 2013-11-25 | 2015-05-27 | 中兴通讯股份有限公司 | Problem positioning processing method and device |
| CN105847083A (en) * | 2016-03-22 | 2016-08-10 | 乐视云计算有限公司 | Business centralized monitoring method and system |
| CN106056221A (en) * | 2016-05-27 | 2016-10-26 | 大连楼兰科技股份有限公司 | FP-Tree sequence pattern mining and fault code classification-based vehicle remote diagnosis and spare part retrieval method |
| CN106056223A (en) * | 2016-05-27 | 2016-10-26 | 大连楼兰科技股份有限公司 | Platform for vehicle remote diagnosis and spare part retrieval |
| CN110084695A (en) * | 2019-04-03 | 2019-08-02 | 平安普惠企业管理有限公司 | A kind of data transfering method and relevant device |
| CN111797848A (en) * | 2019-04-09 | 2020-10-20 | 成都鼎桥通信技术有限公司 | User classification method, device, equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1494268A (en) * | 2002-10-31 | 2004-05-05 | ��Ϊ��������˾ | Collection method of subscriber network use data |
| US20080109380A1 (en) * | 2006-11-02 | 2008-05-08 | Vhs, Llc | System, Report, and Computer-Readable Medium for Analyzing a Stock Portfolio |
| CN101184106A (en) * | 2007-11-30 | 2008-05-21 | 北京航空航天大学 | Associated transaction processing method of mobile database |
| CN101184306A (en) * | 2007-12-14 | 2008-05-21 | 中国移动通信集团广东有限公司 | Mobile phone survey report and system for signaling data collection, process and correlation analysis |
| CN101616428A (en) * | 2009-04-15 | 2009-12-30 | 北京协成致远网络科技有限公司 | A kind of mobile data service monitoring analysis system and its implementation |
| CN101751422A (en) * | 2008-12-08 | 2010-06-23 | 北京摩软科技有限公司 | Method, mobile terminal and server for carrying out intelligent search at mobile terminal |
| CN101789929A (en) * | 2009-04-30 | 2010-07-28 | 广东国笔科技股份有限公司 | Online business management network and operation method thereof |
| CN101790147A (en) * | 2009-01-23 | 2010-07-28 | 华为技术有限公司 | Method and system for correlating charging information |
-
2010
- 2010-10-26 CN CN2010105273172A patent/CN102457893A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1494268A (en) * | 2002-10-31 | 2004-05-05 | ��Ϊ��������˾ | Collection method of subscriber network use data |
| US20080109380A1 (en) * | 2006-11-02 | 2008-05-08 | Vhs, Llc | System, Report, and Computer-Readable Medium for Analyzing a Stock Portfolio |
| CN101184106A (en) * | 2007-11-30 | 2008-05-21 | 北京航空航天大学 | Associated transaction processing method of mobile database |
| CN101184306A (en) * | 2007-12-14 | 2008-05-21 | 中国移动通信集团广东有限公司 | Mobile phone survey report and system for signaling data collection, process and correlation analysis |
| CN101751422A (en) * | 2008-12-08 | 2010-06-23 | 北京摩软科技有限公司 | Method, mobile terminal and server for carrying out intelligent search at mobile terminal |
| CN101790147A (en) * | 2009-01-23 | 2010-07-28 | 华为技术有限公司 | Method and system for correlating charging information |
| CN101616428A (en) * | 2009-04-15 | 2009-12-30 | 北京协成致远网络科技有限公司 | A kind of mobile data service monitoring analysis system and its implementation |
| CN101789929A (en) * | 2009-04-30 | 2010-07-28 | 广东国笔科技股份有限公司 | Online business management network and operation method thereof |
Non-Patent Citations (1)
| Title |
|---|
| 陈旭翔 等: "集团客户关联的监测分析研究", 《电信工程技术与标准化》 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102915423A (en) * | 2012-09-11 | 2013-02-06 | 中国电力科学研究院 | System and method for filtering electric power business data on basis of rough sets and gene expressions |
| CN104660438A (en) * | 2013-11-25 | 2015-05-27 | 中兴通讯股份有限公司 | Problem positioning processing method and device |
| CN105847083A (en) * | 2016-03-22 | 2016-08-10 | 乐视云计算有限公司 | Business centralized monitoring method and system |
| CN106056221A (en) * | 2016-05-27 | 2016-10-26 | 大连楼兰科技股份有限公司 | FP-Tree sequence pattern mining and fault code classification-based vehicle remote diagnosis and spare part retrieval method |
| CN106056223A (en) * | 2016-05-27 | 2016-10-26 | 大连楼兰科技股份有限公司 | Platform for vehicle remote diagnosis and spare part retrieval |
| CN110084695A (en) * | 2019-04-03 | 2019-08-02 | 平安普惠企业管理有限公司 | A kind of data transfering method and relevant device |
| CN110084695B (en) * | 2019-04-03 | 2023-11-28 | 上海七猫文化传媒有限公司 | Data transfer method and related equipment |
| CN111797848A (en) * | 2019-04-09 | 2020-10-20 | 成都鼎桥通信技术有限公司 | User classification method, device, equipment and storage medium |
| CN111797848B (en) * | 2019-04-09 | 2023-10-24 | 成都鼎桥通信技术有限公司 | User classification method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102457893A (en) | Data processing method and device | |
| CN110245078B (en) | Software pressure testing method and device, storage medium and server | |
| CN106250424B (en) | A kind of searching method, the apparatus and system of log context | |
| WO2017041406A1 (en) | Failure positioning method and device | |
| CN100384162C (en) | Automatization testing device and method for service system | |
| JPH06291765A (en) | Generating method for event-driven interface and event vector | |
| US9497451B2 (en) | Cable network data analytics system | |
| US20140325278A1 (en) | Method and system for interactive and automated testing between deployed and test environments | |
| WO2015005962A1 (en) | System and method for identifying problems on a network | |
| CN107179995A (en) | A kind of performance test methods of application program of computer network | |
| CN111614483A (en) | Link monitoring method and device, storage medium and computer equipment | |
| CN111400127B (en) | Service log monitoring method and device, storage medium and computer equipment | |
| US10775751B2 (en) | Automatic generation of regular expression based on log line data | |
| CN102075366A (en) | Method and equipment for processing data in communication network | |
| US8166162B2 (en) | Adaptive customer-facing interface reset mechanisms | |
| CN108243033A (en) | A kind of method given a mark to video quality, cloud server terminal and system | |
| CN106713011A (en) | Method and system for obtaining test data | |
| CN111741007B (en) | Financial business real-time monitoring system and method based on network layer message analysis | |
| CN111198806B (en) | Service call data statistical analysis method and system based on service open platform | |
| CN111405603B (en) | Time delay acquisition method, testing device and computer storage medium | |
| CN110969082A (en) | Clock synchronization test inspection method and system | |
| US9143414B2 (en) | Scenario, call, and protocol data unit hierarchical comparator | |
| CN114610689B (en) | Recording and analyzing method for request log in distributed environment | |
| US11706468B1 (en) | CPE monitor and data collection with signature-based event analysis | |
| CN111124846B (en) | Online positioning time length counting method and device and positioning service system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20120516 |