CN103729380A - Data processing method, system and device - Google Patents
Data processing method, system and device Download PDFInfo
- Publication number
- CN103729380A CN103729380A CN201210392430.3A CN201210392430A CN103729380A CN 103729380 A CN103729380 A CN 103729380A CN 201210392430 A CN201210392430 A CN 201210392430A CN 103729380 A CN103729380 A CN 103729380A
- Authority
- CN
- China
- Prior art keywords
- page interactive
- page
- log
- processing server
- type coding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9574—Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention provides a data processing method, system and device. The data processing method is used for solving the problems that in the prior art, the web page optimization effect is poor, and loading speed and pushing speed of web pages are low. According to the method, an acquisition server receives log generation requests sent by website users, determines type codes corresponding to operating type information according to the operating type information of page interaction operation carried in the log generation requests, generates page interaction logs based on the determined type codes, and sends the generated page interaction logs to a processing server for processing. Through the method, the acquisition server can collect the page interaction operation on the web pages by the website users and generate the corresponding page interaction logs, so the generated page interaction logs can provide accurate reference frames for subsequent web page optimization, and accordingly the web page optimization effect is improved and the loading speed and the pushing speed of the optimized web pages are improved.
Description
Technical field
The application relates to the communications field, relates in particular to a kind of data processing method, system and device.
Background technology
For the ease of data analysis user, check and follow the tracks of the service condition of website user to Website page, can utilize journal file to record the related content of website user's operation.
At present, the daily record of recording the related content of website user's operation is mainly page access daily record, and page access daily record is for recording website user's page access operation.Concrete, when loading in the client that each page is used website user, can use client script language (js, javascript) send a request to log server, log server generates corresponding page access daily record according to this request, the page access daily record generating can comprise website user's local cookie information, and the information of header (header) parameter/session (session) parameter that will obtain with reference to (refer) field/URL(uniform resource locator) (url), follow-up can according to the relevant information in page access daily record complete page browsing amount (pv)/independent visitor (uv) acquiescence calculate.
Website user, also comprises and does not much need the page interactive operation by internet the operation of Website page except comprising the accessing operation by internet.For example, website user clicks a drop-down option frame on Website page, and selects certain option in the option representing in this drop-down option frame.This operation that in upper example, website user carries out not is by the accessing operation of another Website page of internet access, but the page interactive operation of carrying out in original Website page.Certainly, what website user carried out in a Website page represents, clicks, waits for, and reporting an error etc. of Website page can be considered as page interactive operation, and these page interactive operations have great importance for the optimization of Website page.For example, for a Website page, if seldom have website user to certain element (as: certain button in this Website page, or certain option in drop-down option frame) carry out page interactive operation, this element can be deleted from this Website page, to improve loading and the pushing speed of this Website page.
But, in prior art, only website user has been carried out to record to the accessing operation of Website page, ignore the page interactive operation significant to the optimization of Website page, caused the follow-up poor effect that Website page is optimized, affected loading and the pushing speed of Website page.
Summary of the invention
The embodiment of the present application provides a kind of data processing method, system and device, and poor effect Website page being optimized for solving prior art causes loading and the lower problem of pushing speed of Website page.
A kind of data processing method that the embodiment of the present application provides, comprising:
Acquisition server receives the daily record generation request that website user sends when carrying out page interactive operation, and wherein, described daily record generates the action type information of carrying described page interactive operation in request; And
According to the corresponding relation of predefined action type information and type coding, determine the type coding corresponding to action type information of described page interactive operation; And
Described type coding based on determining generates page interactive log corresponding to described page interactive operation;
Described acquisition server sends to processing server to process the described page interactive log generating.
A kind of data processing method that the embodiment of the present application provides, comprising:
Processing server receives the page interactive log that acquisition server sends, wherein, described page interactive log is that the daily record that described acquisition server sends when carrying out page interactive operation according to the website user who receives generates request, determine that described daily record generates the type coding corresponding to action type information of the described page interactive operation of carrying in request, and the described type coding generation based on determining;
Described processing server is processed the described page interactive log receiving.
A kind of data handling system that the embodiment of the present application provides, comprising:
Acquisition server, the daily record generation request sending when carrying out page interactive operation for receiving website user, wherein, described daily record generates the action type information of carrying described page interactive operation in request, according to the corresponding relation of predefined action type information and type coding, determine the type coding corresponding to action type information of described page interactive operation, described type coding based on determining generates page interactive log corresponding to described page interactive operation, and the described page interactive log generating is sent to processing server;
Processing server, for processing the described page interactive log receiving.
A kind of data processing equipment that the embodiment of the present application provides, comprising:
Receiver module, the daily record generation request sending when carrying out page interactive operation for receiving website user, wherein, described daily record generates the action type information of carrying described page interactive operation in request;
Determination module, for according to the corresponding relation of predefined action type and type coding, determines the type coding corresponding to action type information of described page interactive operation;
Generation module, generates page interactive log corresponding to described page interactive operation for the described type coding based on determining;
Sending module, for sending to processing server to process the described page interactive log generating.
A kind of data processing equipment that the embodiment of the present application provides, comprising:
Receiver module, the page interactive log sending for receiving acquisition server, wherein, described page interactive log is that the daily record that described acquisition server sends when carrying out page interactive operation according to the website user who receives generates request, determine that described daily record generates the type coding corresponding to action type information of the described page interactive operation of carrying in request, and the described type coding generation based on determining;
Processing module, for processing the described page interactive log receiving.
The embodiment of the present application provides a kind of data processing method, system and device, the method acquisition server receives the daily record generation request that website user sends when carrying out page interactive operation, according to this daily record, generate the action type information of the page interactive operation of carrying in request, determine the type coding corresponding to action type information of this page interactive operation, and the type coding based on definite generates page interactive log corresponding to this page interactive operation, send to processing server to process the page interactive log of generation.Pass through said method, acquisition server can gather the page interactive operation that website user carries out Website page, and generate corresponding page interactive log, therefore the page interactive log generating can provide reference frame accurately for the optimization of follow-up Website page, and then improve the effect that Website page is optimized, improve loading and the pushing speed of the Website page after optimizing.
Accompanying drawing explanation
The data handling procedure that Fig. 1 provides for the embodiment of the present application;
The data handling system structural representation that Fig. 2 provides for the embodiment of the present application;
The specific implementation structural representation of the data handling system that Fig. 3 provides for the embodiment of the present application;
The first data processing equipment structural representation that Fig. 4 provides for the embodiment of the present application;
The second data processing equipment structural representation that Fig. 5 provides for the embodiment of the present application.
Embodiment
Owing to only website user having been carried out to record to the accessing operation of Website page in prior art, but ignored the page interactive operation significant to the optimization of Website page, therefore follow-up, lack and optimize accurately reference frame when Website page is optimized, cause effect of optimization not good, Website page after optimization probably still comprises the element of numerous redundancies, thereby reduces loading and the pushing speed of Website page.The embodiment of the present application gathers the page interactive operation of website user to Website page by acquisition server, and generate corresponding page interactive operation, thereby for follow-up Website page optimization provides reference frame accurately, can effectively improve the effect that follow-up Website page is optimized, improve loading and the pushing speed of the Website page after optimizing.
Below in conjunction with Figure of description, the application's scheme is described.
Fig. 1 is the data handling procedure that the embodiment of the present application provides, and specifically comprises the following steps:
S101: acquisition server receives the daily record generation request that website user sends when carrying out page interactive operation, and wherein, this daily record generates the action type information of carrying this page interactive operation in request.
In the embodiment of the present application, can be scheduled to the action type of the page interactive operation that need to be recorded by acquisition server, for example, the element in the predetermined website page need to carry out record by acquisition server when having been carried out clicking operation by website user.Concrete, need the action type of the page interactive operation of record to be scheduled to as required by data analysis user.
After being scheduled to need the action type of page interactive operation of record, can to website user's page interactive operation, be monitored by Website page, when monitoring website user and carried out predetermined page interactive operation, by the current client (being also the client of the current use of website user) that represents this Website page, to acquisition server, send daily record and generate request, this daily record of transmission generates the action type information of carrying the page interactive operation monitoring in request.
S102: according to the corresponding relation of predefined action type information and type coding, determine the type coding corresponding to action type information of this page interactive operation.
In the embodiment of the present application, in order effectively to reduce collection difficulty and the complexity of page interactive operation, and improve the extensibility of the collection of page interactive operation, can be a unique type coding of the corresponding setting of each action type information in advance, in order to represent corresponding page interactive operation, therefore, acquisition server receives daily record and generates while asking, can determine the corresponding type coding of action type information of the page interactive operation that this website user carries out, definite the type coding can represent which kind of page interactive operation this website user has carried out.
S103: the type coding based on definite generates page interactive log corresponding to this page interactive operation.
Acquisition server has been determined after the corresponding type coding of action type information of the page interactive operation that this website user carries out, can generate page interactive log corresponding to this page interactive operation based on the type coding, in the page interactive log generating, comprise the type coding of determining by above-mentioned steps S102, with so that data analysis user can be according to the type coding comprising in this page interactive log, know which kind of page interactive operation website user has carried out.
S104: send to processing server to process this page interactive log generating.
After acquisition server has generated page interactive log, can send to processing server to process this page interactive log.Wherein, processing server can be according to the type coding comprising in page interactive log, page interactive log is added up, and statistics is offered to data analysis user, also can directly the page interactive log of generation be offered to data analysis user, with thinking that follow-up Website page optimization provides reference frame accurately, improve the effect that Website page is optimized, improve loading and the pushing speed of the Website page after optimizing.
Preferably, in order further to improve the effect that follow-up Website page is optimized, further to improve loading and the pushing speed of the Website page after optimization, the embodiment of the present application, except making data analysis user know which kind of page interactive operation website user has carried out, also will make data analysis user know website user has specifically carried out this page interactive operation to which element in Website page.
Concrete, when which element in can pre-settled Website page has been performed page interactive operation, need to record and generate page interactive log by acquisition server, and still by Website page, these elements are monitored, once monitor website user, these elements have been carried out to page interactive operation, by the current client (being also the client of the current use of website user) that represents this Website page, to acquisition server, sent daily record and generate request.Now, this daily record that acquisition server receives generates in request except carrying the action type information of the page interactive operation monitoring, also carry the operating position information of this page interactive operation, the operating position information of this page interactive operation is exactly the positional information that has been performed the element of this page interactive operation.Because the each element in general Website page has a unique position, therefore this operating position information can unique expression website user specifically have been carried out page interactive operation to which element in Website page.
When daily record that acquisition server receives generates while carrying the action type information of page interactive operation and operating position information in request, the method that in step S103 shown in Fig. 1, acquisition server generates page interactive log is specially: according to predefined operating position information and position encoded corresponding relation, determine corresponding position encoded of the operating position information of this page interactive operation, and the coding of the type based on definite and page interactive log corresponding to this this page interactive operation of position encoded generation.
Wherein, the type coding corresponding with being in advance each action type information setting is similar, also can be that in Website page, each locational element is set the position encoded of correspondence in advance, thereby, when website user has carried out page interactive operation to an element in Website page, the daily record that acquisition server can receive the positional information of carrying this element generates request, also carry the log request of the operating position information of this page interactive operation, and then it is corresponding position encoded to determine this operating position information.
Preferably, in the embodiment of the present application, acquisition server can generate page interactive log with the form of attribute string, concrete, can adopt following form to generate page interactive log:
/code.nums1.nums2....numn/?key1=value1&key2=value2…&keym=valuem。
Wherein, code.nums1.nums2....numn is definite position encoded, can be described as positioning string, key1=value1 & key2=value2 ... & keym=valuem is definite type coding, can be described as content strings.And, code, nums1 in positioning string, nums2 ... numn can be the coding that opsition dependent scope represents operating position information from big to small step by step.Concrete, when the page interactive operation occurring in only to a Website page gathers and records, code can be the coding corresponding to type of service of the business that provides of Website page that page interactive operation occurs in, nums1, nums2 ... numn can be element residing channel, functional area, the link position etc. in this Website page that have been performed this page interactive operation successively; When the page interactive operation occurring in to multiple Website pages gathers and records, code can be also the page iden-tity (page iden-tity that each Website page is corresponding unique) of the Website page that occurs in of page interactive operation, nums1, nums2 ... numn can be still element residing channel, functional area, the link position etc. in this Website page that have been performed this page interactive operation successively.
For example, suppose acquisition server generate page interactive log be :/xiaobai.2.3.6 type=[d*], positioning string is wherein /xiaobai.2.3.6, " xiaobai " in positioning string represents that this page interactive operation occurs in page iden-tity for the Website page of " xiaobai ", and the element that " 2.3.6 " in positioning string represents to be performed this page interactive operation is arranged in the 6th, the 3rd region of second channel link position of this Website page.Also,, from above-mentioned positioning string, this page interactive operation occurs in the 6th, the 3rd region of second channel link position in the Website page that page iden-tity is " xiaobai ".Content strings in above-mentioned page interactive log be type=[d*], the action type that represents this page interactive operation be type=[d*].By this page interactive log, data analysis user can be known: page iden-tity for the 6th, the 3rd region of second channel link position in the Website page of " xiaobai " on, there is single job type and be type=[d*] page interactive operation.
Certainly, in actual applications, in order better to optimize Website page, except allowing data analysis user know which element in Website page has been performed the page interactive operation of which kind of type, also need to allow data analysis user know specifically which website user has carried out this page interactive operation.Therefore, in the embodiment of the present application, when the client of using by website user when Website page sends daily record and generates request to acquisition server, the client that can use by website user, and adopt HTML (Hypertext Markup Language) (Hyper Text Transport Protocol, HTTP) to send daily record generation request to acquisition server.Because the daily record that adopts HTTP to send generates the local cookie information of carrying website user in request, and this cookie information can be unique this website user of sign, therefore acquisition server, when generating page interactive log, can also carry daily record and generate the cookie information in request in page interactive log.
By including cookie information, type coding, position encoded page interactive log, data analysis user can be known: which website user has carried out the page interactive operation of which kind of type to which element in Website page.
It should be noted that, although can adopt the collection of server website user's of existing Apache (apache) page interactive operation and generate page interactive log, but because different application need to be supported by different apache servers, therefore adopt apache server generation page interactive log just need in each apache server, all be scheduled to the action type of the page interactive operation that will gather, and being performed the element of page interactive operation, this will increase the complexity that gathers page interactive operation.In addition, due to the different application of different apache server supports, and that the form of page interactive log that apache server generates is the application supported to it is relevant, the form of the page interactive log that therefore different apache servers generates is not identical yet, and, the agreement that the client that website user uses sends to the daily record generation request of apache server to adopt is also not quite similar, therefore sending to the daily record of different apache servers to generate also can be different for the user ID that identifies same website user in request, this also can increase the difficulty of these each page interactive logs that generated by different apache servers of subsequent treatment.
And the said method providing by the embodiment of the present application, the action type that only need to be scheduled to the page interactive operation of a less important collection in acquisition server, and be performed the element of page interactive operation, than the method that adopts apache server, effectively reduce the complexity that gathers page interactive operation.And, acquisition server is only for gathering page interactive operation and generating page interactive log, do not support any application, therefore, can adopt unified form to generate page interactive log, client also can adopt unified http protocol, and the daily record that sends the cookie information for identifying website user of carrying to acquisition server generates request, and this has also reduced the difficulty of subsequent processing page interactive log simultaneously.
In the embodiment of the present application, acquisition server has generated after page interactive log by said method, can send to processing server to process page interactive log.Concrete, according to the difference of application scenarios, the embodiment of the present application provides following two kinds of different disposal routes:
Scene one, processing server have sent subscribe request to acquisition server in advance, in this subscribe request, carry type coding that processing server will subscribe to and/or position encoded, in order to acquisition server subscription package containing respective type coding and/or position encoded page interactive log.Now, this processing server can be called Subscriber.
Accordingly, acquisition server is according to the type coding comprising in the page interactive log generating and/or position encoded, determine the processing server that meets specified requirements, and this page interactive log is sent to the processing server of determining, make this processing server that the page interactive log receiving is offered to data analysis user, wherein, the processing server that meets specified requirements is: to acquisition server, subscribed to the type coding and/or this position encoded processing server.Also be, acquisition server has generated after page interactive log, according to the type coding comprising in this page interactive log and/or position encoded, if determine that this page interactive log meets the subscribe request of certain processing server, this page interactive log is sent to this processing server, this processing server directly provides this page interactive log to data analysis user.
Scene two, data analysis user have set the time interval of Batch sending in advance in acquisition server, in processing server, set in advance disposal route, acquisition server is according to the time interval of setting, the all page interactive logs that generate in current time interval are sent to processing server, processing server is processed the each page interactive log receiving according to default disposal route, and take type coding and/or position encodedly each page interactive log after treatment is saved to database as index.
Wherein, default disposal route can be: for same type coding, and the quantity of the page interactive log that statistics comprises same type coding, or, for same position encoded, the quantity that statistics comprises same position encoded page interactive log.Now, processing server can be called statistical server, for adding up the quantity of page interactive operation of same type, or the quantity of adding up the page interactive operation that the element in same Website page is performed.Certainly, the disposal route of page interactive log being not limited in to above-mentioned two kinds, can also be the combination of above-mentioned two kinds of methods, or other disposal routes, just repeats no longer one by one here.
Processing server receive acquisition server according to each page interactive log of sending of the time interval of setting after, can to each page interactive log, carry out processing in batches according to default disposal route.Follow-up take type coding and/or position encodedly each page interactive log after treatment is saved to database as index, the page interactive operation that can make data analysis user inquire about easily the page interactive operation of certain type and/or certain element is carried out in database.
In addition, data analysis user is in database during query page interactive log, database can be according to the corresponding all types of codings of this data analysis user's search access right and/or each position encoded, to this data analysis user, provide and comprise respective type coding and/or position encoded page interactive log, the page interactive log providing is this data analysis user and has the page interactive log of search access right.
The data processing method providing for the embodiment of the present application above, based on same thinking, the embodiment of the present application also provides a kind of data handling system, as shown in Figure 2.
Fig. 2 is the data handling system structural representation that the embodiment of the present application provides, and specifically comprises:
Described acquisition server 201 specifically for, according to described daily record, generate the operating position information of the described page interactive operation of carrying in request, and predefined operating position information and position encoded corresponding relation, determine corresponding position encoded of the operating position information of described page interactive operation, based on described type coding and page interactive log corresponding to the described page interactive operation of described position encoded generation determined.
Described acquisition server 201 specifically for, according to the described type coding comprising in the described page interactive log generating and/or described position encoded, determine the processing server 202 that meets specified requirements, and described page interactive log is sent to the processing server 202 of determining, wherein, the processing server 202 that meets specified requirements is: subscribed to described type coding and/or described position encoded processing server 202; Or, according to the time interval of setting, all page interactive logs that generate are sent to processing server 202 in current time interval;
Described processing server 202 specifically for, the page interactive log receiving is offered to data analysis user; Or, according to default disposal route, the each page interactive log receiving is processed, and take type coding and/or position encodedly each page interactive log after treatment is saved to database as index, make data analysis user by the each page interactive log of described data base querying.
The specific implementation structural representation of the data handling system that Fig. 3 provides for the embodiment of the present application, in Fig. 3 is subdivided into processing server Subscriber and statistical server.
As shown in Figure 3, the page interactive log that data analysis user first need to gather by the predetermined acquisition server of registration center (need to gather the page interactive operation of which kind of type, or need to gather page interactive operation which element is carried out), by registration center, preset the disposal route of statistical server processing page interactive log.When website user carries out page interactive operation to Website page, the client that Website page is used by website user sends daily record to acquisition server and generates request, and acquisition server generates request based on this daily record and generates corresponding page interactive log.Then, acquisition server sends to by this page interactive log the Subscriber of having subscribed to this page interactive log on the one hand, send to statistical server to process this page interactive log on the other hand, statistical server is processed after this page interactive log, take the type coding that comprises in this page interactive log and/or position encoded as index, this page interactive log is saved to database.When data analysis user is in database during query page interactive log, database is inquired about corresponding page interactive log, and the page interactive log inquiring is represented to this data analysis user by representing server.
Fig. 4 is the first data processing equipment structural representation that the embodiment of the present application provides, and specifically comprises:
Sending module 404, for sending to processing server to process the described page interactive log generating.
Described generation module 403 specifically for, according to the described daily record receiving, generate the operating position information of the described page interactive operation of carrying in request, and predefined operating position information and position encoded corresponding relation, determine corresponding position encoded of the operating position information of described page interactive operation, and described type coding and page interactive log corresponding to the described page interactive operation of described position encoded generation based on determining.
Described generation module 403 specifically for, adopt following form to generate described page interactive log :/code.nums1.nums2....numn/ key1=value1 & key2=value2 ... & keym=valuem, wherein, code.nums1.nums2....numn is determine described position encoded, key1=value1 & key2=value2 ... & keym=valuem is the described type coding of determining.
Described sending module 404 specifically for, according to the described type coding comprising in the described page interactive log generating and/or described position encoded, determine the processing server that meets specified requirements, and described page interactive log is sent to the processing server of determining, make described processing server that the described page interactive log receiving is offered to data analysis user, wherein, the processing server that meets specified requirements is: to described acquisition server, subscribed to described type coding and/or described position encoded processing server; Or, according to the time interval of setting, the all page interactive logs that generate in current time interval are sent to processing server, described processing server is processed the each page interactive log receiving according to default disposal route, and take type coding and/or position encodedly each page interactive log after treatment is saved to database as index.
The first data processing equipment shown in concrete above-mentioned Fig. 4 can be arranged in acquisition server.
Fig. 5 is the second data processing equipment structural representation that the embodiment of the present application provides, and specifically comprises:
Described processing module 502 specifically for, the described page interactive log receiving is offered to data analysis user; Or, according to default disposal route, the described page interactive log receiving is processed, and take the described type coding that comprises in described page interactive log as index is saved to database by each page interactive log after treatment, make data analysis user by page interactive log described in described data base querying.
The second data processing equipment shown in concrete above-mentioned Fig. 5 can be arranged in processing server.
The embodiment of the present application provides a kind of data processing method, system and device, the method acquisition server receives the daily record generation request that website user sends when carrying out page interactive operation, according to this daily record, generate the action type information of the page interactive operation of carrying in request, determine the type coding corresponding to action type information of this page interactive operation, and the type coding based on definite generates page interactive log corresponding to this page interactive operation, send to processing server to process the page interactive log of generation.Pass through said method, acquisition server can gather the page interactive operation that website user carries out Website page, and generate corresponding page interactive log, therefore the page interactive log generating can provide reference frame accurately for the optimization of follow-up Website page, and then improve the effect that Website page is optimized, improve loading and the pushing speed of the Website page after optimizing.
Those skilled in the art should understand, the application's embodiment can be provided as method, system or computer program.Therefore, the application can adopt complete hardware implementation example, completely implement software example or the form in conjunction with the embodiment of software and hardware aspect.And the application can adopt the form at one or more upper computer programs of implementing of computer-usable storage medium (including but not limited to magnetic disk memory, CD-ROM, optical memory etc.) that wherein include computer usable program code.
The application is with reference to describing according to process flow diagram and/or the block scheme of the method for the embodiment of the present application, equipment (system) and computer program.Should understand can be by the flow process in each flow process in computer program instructions realization flow figure and/or block scheme and/or square frame and process flow diagram and/or block scheme and/or the combination of square frame.Can provide these computer program instructions to the processor of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing device to produce a machine, the instruction that makes to carry out by the processor of computing machine or other programmable data processing device produces the device for realizing the function of specifying at flow process of process flow diagram or multiple flow process and/or square frame of block scheme or multiple square frame.
These computer program instructions also can be stored in energy vectoring computer or the computer-readable memory of other programmable data processing device with ad hoc fashion work, the instruction that makes to be stored in this computer-readable memory produces the manufacture that comprises command device, and this command device is realized the function of specifying in flow process of process flow diagram or multiple flow process and/or square frame of block scheme or multiple square frame.
These computer program instructions also can be loaded in computing machine or other programmable data processing device, make to carry out sequence of operations step to produce computer implemented processing on computing machine or other programmable devices, thereby the instruction of carrying out is provided for realizing the step of the function of specifying in flow process of process flow diagram or multiple flow process and/or square frame of block scheme or multiple square frame on computing machine or other programmable devices.
Although described the application's preferred embodiment, once those skilled in the art obtain the basic creative concept of cicada, can make other change and modification to these embodiment.So claims are intended to be interpreted as comprising preferred embodiment and fall into all changes and the modification of the application's scope.
Obviously, those skilled in the art can carry out various changes and modification and the spirit and scope that do not depart from the application to the application.Like this, if within these of the application are revised and modification belongs to the scope of the application's claim and equivalent technologies thereof, the application is also intended to comprise these changes and modification interior.
Claims (15)
1. a data processing method, is characterized in that, comprising:
Acquisition server receives the daily record generation request that website user sends when carrying out page interactive operation, and wherein, described daily record generates the action type information of carrying described page interactive operation in request; And
According to the corresponding relation of predefined action type information and type coding, determine the type coding corresponding to action type information of described page interactive operation; And
Described type coding based on determining generates page interactive log corresponding to described page interactive operation;
Described acquisition server sends to processing server to process the described page interactive log generating.
2. the method for claim 1, is characterized in that, described daily record generates the operating position information that also carries described page interactive operation in request;
Described type coding based on determining generates page interactive log corresponding to described page interactive operation, specifically comprises:
According to predefined operating position information and position encoded corresponding relation, determine corresponding position encoded of the operating position information of described page interactive operation; And
Based on described type coding and page interactive log corresponding to the described page interactive operation of described position encoded generation determined.
3. method as claimed in claim 2, is characterized in that, adopts following form to generate described page interactive log:
/ code.nums1.nums2....numn/ key1=value1 & key2=value2 ... & keym=valuem, wherein, code.nums1.nums2....numn is determine described position encoded, key1=value1 & key2=value2 ... & keym=valuem is the described type coding of determining.
4. method as claimed in claim 2, is characterized in that, sends to processing server to process the described page interactive log generating, and specifically comprises:
According to the described type coding comprising in the described page interactive log generating and/or described position encoded, determine the processing server that meets specified requirements, and described page interactive log is sent to the processing server of determining, make described processing server that the described page interactive log receiving is offered to data analysis user, wherein, the processing server that meets specified requirements is: to described acquisition server, subscribed to described type coding and/or described position encoded processing server; Or
According to the time interval of setting, the all page interactive logs that generate in current time interval are sent to processing server, described processing server is processed the each page interactive log receiving according to default disposal route, and take type coding and/or position encodedly each page interactive log after treatment is saved to database as index.
5. a data processing method, is characterized in that, comprising:
Processing server receives the page interactive log that acquisition server sends, wherein, described page interactive log is that the daily record that described acquisition server sends when carrying out page interactive operation according to the website user who receives generates request, determine that described daily record generates the type coding corresponding to action type information of the described page interactive operation of carrying in request, and the described type coding generation based on determining;
Described processing server is processed the described page interactive log receiving.
6. method as claimed in claim 5, is characterized in that, described processing server is processed the described page interactive log receiving, and specifically comprises:
Described processing server offers data analysis user by the described page interactive log receiving; Or
Described processing server is processed the described page interactive log receiving according to default disposal route, and take the described type coding that comprises in described page interactive log as index is saved to database by each page interactive log after treatment, make data analysis user by page interactive log described in described data base querying.
7. a data handling system, is characterized in that, comprising:
Acquisition server, the daily record generation request sending when carrying out page interactive operation for receiving website user, wherein, described daily record generates the action type information of carrying described page interactive operation in request, according to the corresponding relation of predefined action type information and type coding, determine the type coding corresponding to action type information of described page interactive operation, described type coding based on determining generates page interactive log corresponding to described page interactive operation, and the described page interactive log generating is sent to processing server;
Processing server, for processing the described page interactive log receiving.
8. system as claimed in claim 7, it is characterized in that, described acquisition server specifically for, according to described daily record, generate the operating position information of the described page interactive operation of carrying in request, and predefined operating position information and position encoded corresponding relation, determine corresponding position encoded of the operating position information of described page interactive operation, based on described type coding and page interactive log corresponding to the described page interactive operation of described position encoded generation determined.
9. system as claimed in claim 8, it is characterized in that, described acquisition server specifically for, according to the described type coding comprising in the described page interactive log generating and/or described position encoded, determine the processing server that meets specified requirements, and described page interactive log is sent to the processing server of determining, wherein, the processing server that meets specified requirements is: subscribed to described type coding and/or described position encoded processing server; Or, according to the time interval of setting, all page interactive logs that generate are sent to processing server in current time interval;
Described processing server specifically for, the page interactive log receiving is offered to data analysis user; Or, according to default disposal route, the each page interactive log receiving is processed, and take type coding and/or position encodedly each page interactive log after treatment is saved to database as index, make data analysis user by the each page interactive log of described data base querying.
10. a data processing equipment, is characterized in that, comprising:
Receiver module, the daily record generation request sending when carrying out page interactive operation for receiving website user, wherein, described daily record generates the action type information of carrying described page interactive operation in request;
Determination module, for according to the corresponding relation of predefined action type and type coding, determines the type coding corresponding to action type information of described page interactive operation;
Generation module, generates page interactive log corresponding to described page interactive operation for the described type coding based on determining;
Sending module, for sending to processing server to process the described page interactive log generating.
11. devices as claimed in claim 10, it is characterized in that, described generation module specifically for, according to the described daily record receiving, generate the operating position information of the described page interactive operation of carrying in request, and predefined operating position information and position encoded corresponding relation, determine corresponding position encoded of the operating position information of described page interactive operation, and described type coding and page interactive log corresponding to the described page interactive operation of described position encoded generation based on determining.
12. devices as claimed in claim 11, it is characterized in that, described generation module specifically for, adopt following form to generate described page interactive log :/code.nums1.nums2....numn/ key1=value1 & key2=value2 ... & keym=valuem, wherein, code.nums1.nums2....numn is determine described position encoded, key1=value1 & key2=value2 ... & keym=valuem is the described type coding of determining.
13. devices as claimed in claim 11, it is characterized in that, described sending module specifically for, according to the described type coding comprising in the described page interactive log generating and/or described position encoded, determine the processing server that meets specified requirements, and described page interactive log is sent to the processing server of determining, make described processing server that the described page interactive log receiving is offered to data analysis user, wherein, the processing server that meets specified requirements is: to described acquisition server, subscribed to described type coding and/or described position encoded processing server, or, according to the time interval of setting, the all page interactive logs that generate in current time interval are sent to processing server, described processing server is processed the each page interactive log receiving according to default disposal route, and take type coding and/or position encodedly each page interactive log after treatment is saved to database as index.
14. 1 kinds of data processing equipments, is characterized in that, comprising:
Receiver module, the page interactive log sending for receiving acquisition server, wherein, described page interactive log is that the daily record that described acquisition server sends when carrying out page interactive operation according to the website user who receives generates request, determine that described daily record generates the type coding corresponding to action type information of the described page interactive operation of carrying in request, and the described type coding generation based on determining;
Processing module, for processing the described page interactive log receiving.
15. devices as claimed in claim 14, is characterized in that, described processing module specifically for, the described page interactive log receiving is offered to data analysis user; Or, according to default disposal route, the described page interactive log receiving is processed, and take the described type coding that comprises in described page interactive log as index is saved to database by each page interactive log after treatment, make data analysis user by page interactive log described in described data base querying.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210392430.3A CN103729380B (en) | 2012-10-16 | 2012-10-16 | A kind of data processing method, system and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210392430.3A CN103729380B (en) | 2012-10-16 | 2012-10-16 | A kind of data processing method, system and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103729380A true CN103729380A (en) | 2014-04-16 |
| CN103729380B CN103729380B (en) | 2018-11-20 |
Family
ID=50453458
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210392430.3A Active CN103729380B (en) | 2012-10-16 | 2012-10-16 | A kind of data processing method, system and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103729380B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017117912A1 (en) * | 2016-01-04 | 2017-07-13 | 百度在线网络技术（北京）有限公司 | Data acquisition method, apparatus and device, and computer storage medium |
| CN107256220A (en) * | 2017-04-25 | 2017-10-17 | 北京微影时代科技有限公司 | Data logging generation method, device and electronic equipment |
| CN107797908A (en) * | 2017-11-07 | 2018-03-13 | 南威软件股份有限公司 | A kind of behavioral data acquisition method of website user |
| CN108681805A (en) * | 2018-03-30 | 2018-10-19 | 平安科技（深圳）有限公司 | Task statistical method and device |
| CN109408754A (en) * | 2018-11-07 | 2019-03-01 | 北京字节跳动网络技术有限公司 | Processing method, device, electronic equipment and the storage medium of web page operation data |
| CN109656797A (en) * | 2018-12-20 | 2019-04-19 | 浙江口碑网络技术有限公司 | The correlating method and device of daily record data |
| CN111143729A (en) * | 2019-12-11 | 2020-05-12 | 中国平安财产保险股份有限公司 | Optimization method, device, equipment and storage medium based on single-page application |
| CN111459756A (en) * | 2020-03-30 | 2020-07-28 | 深圳市金蝶天燕云计算股份有限公司 | Log processing method and related equipment |
| CN114726752A (en) * | 2022-04-22 | 2022-07-08 | 深圳市科脉技术股份有限公司 | Log information processing method, device, terminal and storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101079824A (en) * | 2006-06-15 | 2007-11-28 | 腾讯科技（深圳）有限公司 | A generation system and method for user interest preference vector |
| CN101179569B (en) * | 2007-02-15 | 2011-04-06 | 腾讯科技（深圳）有限公司 | Method, device and system for obtaining tourism log of electronic pet |
| CN101616153B (en) * | 2009-07-02 | 2012-11-21 | 阿里巴巴集团控股有限公司 | Web page based method, system and device for interacting operation information |
| CN102385549A (en) * | 2010-09-02 | 2012-03-21 | 北京无限立通通讯技术有限责任公司 | Log processing system, log processing method and log storage sub-system |
-
2012
- 2012-10-16 CN CN201210392430.3A patent/CN103729380B/en active Active
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017117912A1 (en) * | 2016-01-04 | 2017-07-13 | 百度在线网络技术（北京）有限公司 | Data acquisition method, apparatus and device, and computer storage medium |
| CN107256220A (en) * | 2017-04-25 | 2017-10-17 | 北京微影时代科技有限公司 | Data logging generation method, device and electronic equipment |
| CN107797908A (en) * | 2017-11-07 | 2018-03-13 | 南威软件股份有限公司 | A kind of behavioral data acquisition method of website user |
| CN108681805A (en) * | 2018-03-30 | 2018-10-19 | 平安科技（深圳）有限公司 | Task statistical method and device |
| CN109408754A (en) * | 2018-11-07 | 2019-03-01 | 北京字节跳动网络技术有限公司 | Processing method, device, electronic equipment and the storage medium of web page operation data |
| CN109656797A (en) * | 2018-12-20 | 2019-04-19 | 浙江口碑网络技术有限公司 | The correlating method and device of daily record data |
| CN111143729A (en) * | 2019-12-11 | 2020-05-12 | 中国平安财产保险股份有限公司 | Optimization method, device, equipment and storage medium based on single-page application |
| CN111143729B (en) * | 2019-12-11 | 2023-09-15 | 中国平安财产保险股份有限公司 | Optimization method, device, equipment and storage medium based on single page application |
| CN111459756A (en) * | 2020-03-30 | 2020-07-28 | 深圳市金蝶天燕云计算股份有限公司 | Log processing method and related equipment |
| CN114726752A (en) * | 2022-04-22 | 2022-07-08 | 深圳市科脉技术股份有限公司 | Log information processing method, device, terminal and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103729380B (en) | 2018-11-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103729380A (en) | Data processing method, system and device | |
| US12010191B2 (en) | Methods and apparatus to share online media impressions data | |
| US11682032B2 (en) | Methods and apparatus to estimate population reach from different marginal ratings and/or unions of marginal ratings based on impression data | |
| US8924457B2 (en) | Client browser acceleration by having server removed and executed script embedded in web page | |
| TWI557571B (en) | Method, computer-storage media, and server for optimizing web crawling with user history | |
| US20190102351A1 (en) | Generating configuration information for obtaining web resources | |
| US9554323B2 (en) | Generating sequenced instructions for connecting through captive portals | |
| US11188443B2 (en) | Method, apparatus and system for processing log data | |
| CN104915398A (en) | Method and device for webpage point burying | |
| US20130185429A1 (en) | Processing Store Visiting Data | |
| CN104283723A (en) | Network access log processing method and device | |
| CN105022619A (en) | Code processing method and device | |
| CN107370628B (en) | Log processing method and system based on embedded points | |
| CN105138675A (en) | Database auditing method and device | |
| CN113783860B (en) | Message processing method, device, equipment and storage medium based on visual configuration | |
| CN110943876B (en) | URL state detection method, device, equipment and system | |
| CN104468248A (en) | Service performance monitoring method, reverse proxy server, statistical analysis server and system | |
| CN105450771A (en) | Information push and information push optimization methods, servers and systems | |
| CN111124858A (en) | Embedded point-free plug-in data processing method and system, terminal device and storage medium | |
| CN116028192A (en) | Multi-source heterogeneous data acquisition method, device and storage medium | |
| CN107483294B (en) | Method and device for monitoring network request | |
| US20220067078A1 (en) | Aggregation system, Response Summary Process, and Method of Use | |
| CN105721205B (en) | A kind of method for pushing and router of APP download link | |
| WO2017101494A1 (en) | Information collection method, gateway device and server | |
| CN111078975A (en) | Multi-node incremental data acquisition system and acquisition method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1194173 Country of ref document: HK |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211104 Address after: Room 554, floor 5, building 3, No. 969, Wenyi West Road, Wuchang Street, Yuhang District, Hangzhou City, Zhejiang Province Patentee after: TAOBAO (CHINA) SOFTWARE CO.,LTD. Address before: Cayman Islands Grand Cayman capital building, a four storey No. 847 mailbox Patentee before: ALIBABA GROUP HOLDING Ltd. |
|
| TR01 | Transfer of patent right |