CN111240847A

CN111240847A - Data processing method, device, medium and computing equipment

Info

Publication number: CN111240847A
Application number: CN202010062478.2A
Authority: CN
Inventors: 宋俊刚; 李木; 张俊峰; 张家铭; 李彦鸿; 王慧; 彭志龙; 王飞龙; 桂聪; 贾玉龙; 肖惠琴; 孙磊; 吕明; 李伟; 吴超; 孙英远; 曾祥林; 焦文斌; 缑艳青
Original assignee: Netease Media Technology Beijing Co Ltd
Current assignee: Netease Media Technology Beijing Co Ltd
Priority date: 2020-01-19
Filing date: 2020-01-19
Publication date: 2020-06-05
Anticipated expiration: 2040-01-19
Also published as: CN111240847B

Abstract

An embodiment of the present invention provides a data processing method, including: establishing a shared working thread, wherein the shared working thread is used for receiving the reported data of a plurality of pages, responding to the data reporting request of each page, and receiving and storing the reported data of each page through the shared working thread; and reporting the reported data of each page to a server through the shared working thread. By sharing the working thread, the reporting data of a plurality of pages can be received and reported to the server, so that the technical problems of resource waste and low communication efficiency of the client and the server caused by the fact that each page is respectively established and maintained in reporting connection with the server can be avoided, the resources of the client and the server are saved, and the technical effect of improving the performance of the server is achieved. In addition, the embodiment of the invention also provides a data processing device, a medium and a computing device.

Description

Data processing method, device, medium and computing equipment

Technical Field

The embodiment of the invention relates to the technical field of networks, in particular to a data processing method, a data processing device, a data processing medium and a computing device.

Background

This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.

When a user accesses a website using a browser application (e.g., IE browser, google browser) on a client, multiple pages, such as web pages, of the website are typically opened. In order to monitor the user's behavior and to more clearly understand the behavior habits of the user, the user needs to report various information data generated by performing an interactive operation on a web page or triggering a specific event (e.g., closing the web page event) to a server for processing and analysis, so as to analyze the user's behavior.

The related art also provides some schemes for reporting data to the server. For example, each page uses instant communication modes such as socket, ajax polling and the like to realize real-time reporting of data.

Disclosure of Invention

However, in the process of implementing the inventive concept, the inventors found that the data reporting scheme provided by the related art has the following disadvantages:

when a plurality of pages are opened, each page needs to maintain a reporting connection for data reporting. That is, as many pages are simultaneously performing user behavior analysis, how many connections for data reporting need to be established, which consumes a large amount of connections, increases consumption of client resources and server resources, and loses performance of the server and the browser.

In this context, embodiments of the present invention are intended to provide a data processing method, and an apparatus, a medium, and a computing device thereof.

In a first aspect of embodiments of the present invention, there is provided a data processing method, including: and establishing a shared working thread, wherein the shared working thread is used for receiving the reported data of a plurality of pages, responding to the data reporting request of each page, receiving and storing the reported data of each page through the shared working thread, and reporting the reported data of each page to a server through the shared working thread.

In an embodiment of the present invention, the plurality of pages have an association relationship.

In an embodiment of the present invention, the creating a shared work thread includes: in response to an open request for a page, detecting whether a shared worker thread already exists for the page, and in the absence of the shared worker thread, creating the shared worker thread.

In an embodiment of the present invention, the method further includes: and recording reporting time stamps corresponding to the reporting data of the pages through the shared working thread.

In an embodiment of the present invention, the method further includes: and determining whether the pages are closed or not based on the latest reporting timestamp.

In an embodiment of the present invention, the determining whether there is a closed page in the pages based on the latest reporting timestamp includes: the method comprises the steps of obtaining a current timestamp, determining opening time corresponding to each page based on the current timestamp and the latest reporting timestamp, detecting whether a page exceeding preset time exists in the opening time corresponding to each page, and determining that the closed page exists in each page under the condition that the page exceeding the preset time exists in the opening time corresponding to each page.

In an embodiment of the present invention, the reporting data includes page identification data and user behavior data, and the receiving and storing the reporting data of each page by the shared working thread includes: and generating a page list based on the page identification data, and storing the page list and the user behavior data of each page in an associated manner.

In an embodiment of the present invention, the method further includes: acquiring a current timestamp and reporting timestamps corresponding to the reporting data of the pages, determining whether overtime pages exist in the page list or not based on the reporting timestamps and the current timestamps, and deleting the user behavior data of the overtime pages under the condition that the overtime pages exist.

In an embodiment of the present invention, the reporting the report data of each page to a server through the shared work thread includes: and reporting the page identification data of the closed page to a server under the condition of determining that the closed page exists in each page.

In an embodiment of the present invention, the reporting the report data of each page to a server through the shared work thread includes: and reporting the page identification data and the user behavior data of each page to a server through the shared working thread.

In a second aspect of embodiments of the present invention, there is provided a data processing apparatus comprising: the system comprises a creating module configured to create a shared working thread, a processing module configured to respond to a data reporting request of each page and receive and store the reported data of each page through the shared working thread, and a reporting module configured to report the reported data of each page to a server through the shared working thread.

In an embodiment of the present invention, the creating module includes: the device comprises a first detection submodule and a creation submodule, wherein the first detection submodule is configured to respond to an opening request of a page and detect whether a shared working thread aiming at the page exists, and the creation submodule is configured to create the shared working thread under the condition that the shared working thread does not exist.

In an embodiment of the present invention, the apparatus further includes: and the recording module is configured to record the reporting time stamps corresponding to the reporting data of the pages through the shared working thread.

In an embodiment of the present invention, the apparatus further includes: the device comprises an acquisition module and a determination module, wherein the acquisition module is configured to acquire the latest reporting timestamp corresponding to each page based on the reporting timestamp corresponding to the reporting data of each page, and the determination module is configured to determine whether the page which is closed exists in each page based on the latest reporting timestamp.

In an embodiment of the present invention, the determining module includes: the device comprises a first obtaining submodule configured to obtain a current timestamp, a first determining submodule configured to determine an opening duration corresponding to each page based on the current timestamp and the latest reporting timestamp, a second detecting submodule configured to detect whether a page exceeding a preset duration exists in the opening durations corresponding to the pages, and a second determining submodule configured to determine that the closed page exists in each page under the condition that the page exceeding the preset duration exists in the opening durations corresponding to the pages.

In an embodiment of the present invention, the reported data includes page identifier data and user behavior data, and the processing module includes: the generating submodule is configured to generate a page list based on the page identification data, and the storing submodule is configured to store the page list and the user behavior data of each page in an associated manner.

In an embodiment of the present invention, the apparatus further includes: the system comprises a first obtaining submodule configured to obtain a current time stamp and reporting time stamps corresponding to reporting data of all pages, a second obtaining submodule configured to obtain the current time stamp and the reporting time stamps corresponding to the reporting data of all the pages, a third determining submodule configured to determine whether overtime pages exist in the page list or not based on the reporting time stamps and the current time stamps, and a deleting submodule configured to delete user behavior data of the overtime pages under the condition that the overtime pages exist.

In an embodiment of the present invention, the reporting module is configured to report the page identifier of the closed page to a server when it is determined that the closed page exists in the pages.

In an embodiment of the present invention, the reporting module is configured to report the page identifier data and the user behavior data of each page to a server through the shared working thread.

In a third aspect of embodiments of the present invention, there is provided a medium storing computer-executable instructions for implementing any one of the above-described methods when executed by a processing unit.

In a fourth aspect of embodiments of the present invention, there is provided a computing device comprising: a processing unit; and a storage unit storing computer-executable instructions that, when executed by the processing unit, are adapted to implement any of the above-described methods.

Drawings

The above and other objects, features and advantages of exemplary embodiments of the present invention will become readily apparent from the following detailed description read in conjunction with the accompanying drawings. Several embodiments of the invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:

fig. 1 schematically shows an application scenario diagram of a data processing method and apparatus according to an embodiment of the present invention;

FIG. 2 schematically shows a flow diagram of a data processing method according to an embodiment of the invention;

FIG. 3 schematically shows a flow chart of a data processing method according to another embodiment of the invention;

FIG. 4 schematically shows a flow chart of a data processing method according to another embodiment of the invention;

fig. 5 schematically shows a flow chart of a data processing method according to another embodiment of the invention:

FIG. 6 schematically shows a block diagram of a data processing apparatus according to an embodiment of the present invention;

FIG. 7 schematically shows a block diagram of a data processing apparatus according to another embodiment of the present invention;

FIG. 8 schematically shows a schematic diagram of a computer-readable storage medium product for implementing a data processing method according to an embodiment of the present invention; and

fig. 9 schematically shows a block diagram of a computing device for implementing a data processing method according to an embodiment of the present invention.

In the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.

Detailed Description

The principles and spirit of the present invention will be described with reference to a number of exemplary embodiments. It is understood that these embodiments are given solely for the purpose of enabling those skilled in the art to better understand and to practice the invention, and are not intended to limit the scope of the invention in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

As will be appreciated by one skilled in the art, embodiments of the present invention may be embodied as a system, apparatus, device, method, or computer program product. Thus, the present invention may be embodied in the form of: entirely hardware, entirely software (including firmware, resident software, micro-code, etc.), or a combination of hardware and software.

According to the embodiment of the invention, a data processing method and device, a medium and computing equipment are provided.

In this context, it is to be understood that the terms to which the invention relates include the following.

Shared worker: is an API interface of the standard specification of HTML5, representing a particular type of worker.

User behavior data: and the information data such as the interaction action and the event of the user on the web page comprise the original data such as residence time, hop rate, access times, page clicking, sliding, scrolling and the like.

And (3) reporting data: and reporting the user behavior data such as the user behavior actions, the events and the like collected in each web page to a user behavior analysis server for analysis.

User behavior analysis service: and the method is used for receiving, processing and analyzing the reported user behavior data on each web page.

A log server: and the server side for operating the user behavior analysis service is mainly used for receiving, processing and analyzing the user behavior data.

Moreover, any number of elements in the drawings are by way of example and not by way of limitation, and any nomenclature is used solely for differentiation and not by way of limitation.

The principles and spirit of the present invention are explained in detail below with reference to several representative embodiments of the invention.

Summary of The Invention

An embodiment of the present invention provides a data processing method, including: firstly, a shared working thread is created, and the shared working thread is used for receiving the reported data of a plurality of pages. And then, responding to the data reporting request of each page, and receiving and storing the reported data of each page through the shared working thread. And finally, reporting the reported data of each page to a server through the shared working thread.

Having described the general principles of the invention, various non-limiting embodiments of the invention are described in detail below.

Application scene overview

First, an application scenario of the data processing method and apparatus according to the embodiment of the present invention is described in detail with reference to fig. 1.

Fig. 1 schematically shows an application scenario according to an embodiment of the present invention. It should be noted that fig. 1 is only an example of an application scenario in which the embodiment of the present invention may be applied to help those skilled in the art understand the technical content of the present invention, but does not mean that the embodiment of the present invention may not be applied to other devices, systems, environments or scenarios.

As shown in fig. 1, the application scenario 100 according to this embodiment may include

terminal devices

101, 102, 103, a network 104 and a server 105. The network 104 serves as a medium for providing communication links between the

terminal devices

101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

The user may use the

terminal devices

101, 102, 103 to interact with the server 105 via the network 104 to receive or send messages or the like. The

terminal devices

101, 102, 103 may have installed thereon various communication client applications, such as shopping-like applications, web browser applications, search-like applications, instant messaging tools, mailbox clients, social platform software, etc. (by way of example only).

The

terminal devices

101, 102, 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.

The server 105 may be a server providing various services, such as a background management server (for example only) providing support for websites browsed by users using the

terminal devices

101, 102, 103. The background management server may analyze and perform other processing on the received data such as the user request, and feed back a processing result (e.g., a webpage, information, or data obtained or generated according to the user request) to the terminal device.

It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

Exemplary method

In the following, in connection with the application scenario of fig. 1, a data processing method according to an exemplary embodiment of the present invention is described with reference to fig. 2. It should be noted that the above application scenarios are merely illustrated for the convenience of understanding the spirit and principles of the present invention, and the embodiments of the present invention are not limited in this respect. Rather, embodiments of the present invention may be applied to any scenario where applicable. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the invention. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present invention.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.

All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.

Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.). Where a convention analogous to "A, B or at least one of C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system of at least one of A, B or C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).

Fig. 2 schematically shows a flow chart of a data processing method according to an embodiment of the invention.

As shown in fig. 2, the data processing method may include operations S210 to S230.

In operation S210, a shared worker thread is created.

According to an embodiment of the present invention, the shared worker thread is configured to receive the report data of each page of the plurality of pages that establish the connection with the shared worker thread. After the shared working thread is created, a plurality of pages can be connected with the shared working thread, so that the shared working thread can receive the reported data of all the pages connected with the shared working thread and report the data to a server. In specific implementation, one shared work thread allows a plurality of pages to be shared, each page is linked to a certain port number of the shared work thread, and the shared work thread is communicated through the port.

As an alternative embodiment, multiple pages connected to the shared work thread may have an association relationship, where the association relationship is used to characterize that the multiple pages belong to the same website, where the website identities belonging to the same website include, but are not limited to, the same website identity to which the multiple pages belong, and the website identity may be a first-level Domain Name (Domain Name) of the website. The first-level domain name is also called the top-level domain name, such as baidu.

As an alternative embodiment, the multiple pages that establish connections with the shared worker thread may not have an association relationship, i.e., the multiple pages belong to different websites.

A user may open one or more browser windows through a browser, and each browser window may contain one or more pages therein. Therefore, multiple pages belonging to the same website or not belonging to the same website may be distributed in the same browser window, or may be distributed in different browser windows, which is not limited in the present invention. And the opening of a plurality of pages belonging to the same website or not is also sequential. Whether in the same browser window or in a different browser window, a shared worker thread is created when the first page is opened.

In specific implementation, when a first page of a plurality of pages having an association relationship is opened, a corresponding shared work thread may be established for a same website to which the plurality of pages belong, and all pages opened by a user and belonging to the website are connected with the shared work thread corresponding to the website, so that the shared work thread may receive report data of all pages connected with the shared work thread and report the data to a server. When a first page of the plurality of pages having no association is opened, a shared worker thread may be created in the browser of the currently opened page. After the shared worker thread is created, connections between the plurality of pages and the shared worker thread are established.

As an alternative embodiment, when a first page of a plurality of pages having an association relationship is opened, a shared work thread may also be created in the browser. In specific implementation, in response to an operation of opening a current page, a website identifier to which the current page belongs is obtained, and whether a shared working thread corresponding to the website identifier to which the current page belongs exists is detected. And if not, establishing a corresponding shared working thread for the website identification of the current page in the browser of the current page, and establishing connection for the current page and the shared working thread. And if the current page exists, establishing connection between the current page and the shared working thread.

According to the embodiment of the invention, the shared working thread has the functions of network request, page list management, multi-page real-time data storage, request timestamp management and the like.

It should be noted that once the shared work thread is created, the shared work thread will only end work if all the pages that have established connection with the shared work thread are closed.

In operation S220, in response to the data reporting request of each page, the reporting data of each page is received and stored through the shared working thread.

According to the embodiment of the invention, under the condition that a user executes interactive operation and triggers an event on a page, a large amount of information data is generated, the information data can be reported to a sharing working thread through a port of the sharing working thread, and the sharing working thread can store the reported data after receiving the reported data.

In operation S230, the report data of each page is reported to the server through the shared working thread.

According to the embodiment of the invention, the reporting data of each page can be reported to the server through the shared working thread based on the reporting strategy.

As an alternative embodiment, the reporting policy may be a real-time reporting policy. Based on the real-time reporting strategy, the sharing working thread can report the reported data of each page to the server in real time, namely, the reported data is reported to the server as long as the reported data from the page exists. For example, when multiple pages have an association relationship, the report data of any page may be received and then immediately reported to the server.

Based on the real-time reporting strategy, the reported data can be reported to the server in time, so that the timeliness of the reported data is high.

As an alternative, the reporting policy may be a periodic reporting policy. Based on the regular reporting strategy, the shared working thread can report the reported data of each page to the server regularly, namely the reported data can be reported to the server in batch under the condition that the preset time condition is met. Specifically, a time interval may be preset, and the report data may be reported to the server in batch when the time interval is satisfied. For example, the time interval may be 30 minutes, and the sharing worker thread reports the received report data to the server every 30 minutes. It should be noted that the time interval may be set by itself. For example, the time interval may be set according to the operation condition of the user on a plurality of pages, and the time interval may be set to be short if the operation is frequent, and may be set to be long if the operation is small.

As an alternative, the reporting policy may be a quantitative reporting policy. Based on the quantitative reporting strategy, the sharing working thread can report the reported data of each page to the server quantitatively, namely the reported data can be reported to the server in batch in a centralized manner under the condition that the data volume of the reported data meets the preset data volume.

Based on a timing or quantitative reporting strategy, the reported data can be reported to the server in a batch and concentrated manner, so that the data reporting times are reduced, and the data reporting efficiency is improved.

According to the embodiment of the invention, the report data of a plurality of pages can be received and reported to the server by using the shared working thread, so that the technical problems of resource waste and low communication efficiency of the client and the server caused by the fact that each page is respectively established and maintained in the report connection with the server can be avoided, the resources of the client and the server are saved, and the performance of the server is improved.

As an alternative embodiment, creating a shared worker thread includes: responding to an opening request of a page, and detecting whether a shared work thread aiming at the page exists or not; and creating the shared worker thread in the absence of the shared worker thread.

As described above, a shared work thread is commonly used by a plurality of pages, and therefore, when each page is opened, it is necessary to determine whether the shared work thread is already established, and if not, the page creates the shared work thread. And if the shared working thread exists, receiving and storing the reported data of each page through the existing shared working thread.

By detecting whether the shared working thread exists or not and only creating the shared working thread under the condition of no shared working thread, the repeated establishment of the shared working thread can be avoided, so that a plurality of pages which are connected with the shared working thread share one shared working thread, the number of reported connections is reduced, and the resource consumption of the client and the server is reduced.

Fig. 3 schematically shows a flow chart of a data processing method according to another embodiment of the invention.

As an alternative embodiment, as shown in fig. 3, the data processing method may further include, in addition to the foregoing operations S210 to S230, operation S310: and recording reporting time stamps corresponding to the reporting data of all the pages through the shared working thread.

According to the embodiment of the invention, page Identification (ID) data reported by a page is received in response to an opening request of the page, and a page list is managed based on the page ID.

By recording the reporting time stamps corresponding to the reporting data of all the pages, the ordered management of the multiple pages communicated with the shared working thread can be realized.

The page closing event is triggered when a browser tab and a window leave a current page (refresh or close), is a very basic and useful event, and is also a relatively important user behavior, and the capture of the page closing event is often utilized in the aspects of user behavior analysis, user experience, business function and the like.

In the related art, monitoring for a page closing event may use an onbeforunload event of a window, but support of each browser for the onbeforunload event is different from implementation of a trigger condition, so that partial closing behavior is not triggered or triggered repeatedly, and compatibility is poor. For example, a Firefox browser may ignore the event and automatically close the page without user confirmation.

The monitoring for the page closing event can also utilize a parent-child page mode, that is, a user opens a child page window in a window. Open () the way a sub-page is opened, often seen as an ad window or malicious behavior, with the risk of being masked by a browser plug-in or a masking ad plug-in, so that the sub-page cannot be opened.

According to an embodiment of the present invention, a plurality of pages may be monitored for close events by the created shared worker thread.

As an alternative embodiment, as shown in fig. 3, the data processing method may further include operation S320 and operation S330, in addition to the aforementioned operations S210 to S230 and operation S310.

In operation S320, the latest reporting timestamp corresponding to each page is obtained based on the reporting timestamp corresponding to the reporting data of each page.

In operation S330, it is determined whether there is a page that has been closed among the respective pages based on the latest reporting timestamp.

According to the embodiment of the invention, the created sharing working thread is utilized to receive the page ID reported by each page in a circulating way, the last reporting time stamp is generated based on the page ID reported in the circulating way, and the page ID and the last reporting time stamp are added into the page list. Whether a closed page exists in the multiple pages can be judged based on the last reporting timestamp, which page of the multiple pages is closed can be determined according to the page ID, and then subsequent reporting or other services to the server side are further executed on the closed page.

As an alternative embodiment, determining whether there are pages that have been closed in the respective pages based on the latest reporting timestamp comprises: acquiring a current timestamp; determining the starting time length corresponding to each page based on the current timestamp and the latest reporting timestamp; detecting whether a page exceeding a preset time length exists in the starting time lengths corresponding to the pages; and determining that the closed pages exist in each page under the condition that the pages exceeding the preset time length exist in the opening time length corresponding to each page.

As an alternative embodiment, reporting the report data of each page to the server through the shared working thread includes: and reporting the page identification data of the closed page to a server under the condition of determining that the closed page exists in each page.

According to the embodiment of the invention, the overtime condition of the last reported timestamp of each page can be compared and judged, so that whether the page is closed or not can be judged. Specifically, the shared working thread may cyclically check the page list, and compare and judge the last reporting timestamp and the current timestamp of each page in the page list data. And judging whether the page is closed or not according to the time difference between the last reported timestamp and the current timestamp.

For example, if the last reported timestamp of a certain page ID times out for a certain time (e.g., 100ms), the page is determined to be closed. If there is no timeout, i.e., less than a certain time (e.g., 100ms), the page is judged to be normally not closed.

By the embodiment of the invention, the shared working thread can be used for monitoring and analyzing the page closing event, capturing the behavior action of closing the page in time and executing data reporting or other required business processing.

Fig. 4 schematically shows a flow chart of a data processing method according to another embodiment of the invention. As shown in fig. 4, by sharing the working thread, the page close event on multiple pages of the browser (B) can be monitored, and the data related to the page close event can be reported to the processing server of the server (S). When implemented, operations S410 to S460 may be included.

In operation S410, a new page is opened in the browser.

In operation S420, it is determined whether a shared worker thread exists. If not, operation S430 is performed to establish a shared work thread. If so, operation S440 is performed to register the page list. In specific implementation, all pages in an open state (for example, page 1, page 2, page 3, … …, and page n, where n is an integer greater than 1) may circularly report their page IDs in real time through the shared work thread, the shared work thread receives the page ID reported by each page, generates a last reporting timestamp, and adds the page ID and the last reporting timestamp to a page list (the page list is shown in fig. 4).

In operation S450, according to the page list generated by performing operation S440, the shared working thread circularly checks the page list, and by comparing the last reporting timestamp and the current timestamp of each page in the page list, it is detected whether a page is closed in the multiple pages, that is, a closing event monitoring service is performed. If yes, operation S460 is performed to report the data to the server (S). For example, if it is detected that page 3 is closed, the page identification data of page 3 is reported to the processing server. If not, the process returns to perform operation S440 to register the page list. For example, if the closing of page 1, page 2 and page n is not detected, operation S440 is performed, the page list is registered, and the next time the time arrives, operation 450 is performed.

The specific implementation modes of establishing a shared working thread and reporting page closing data in the data processing method provided by the invention will be described in detail below by taking the page 1, the page 2, the page 3 and the page 4 with the website identification as the website to which the website belongs and the first-level domain name baidu.com as an example.

In specific implementation, in response to opening page 1 in the IE browser, it is first detected whether there is a shared worker thread a corresponding to the website identity. And if so, establishing connection between the page 1 and the shared working thread A. If the page does not exist, the shared working thread A is created, then the page 1 is connected with the shared working thread A, the page 1 can circularly report the page ID of the page 1 once at a certain time interval through the shared working thread A, and the shared working thread A can generate and record the last reporting timestamp T1 of the page 1 according to the corresponding reporting timestamp of each reporting of the page 1. Next, in response to opening page 2 in the browser, it is first detected whether there is a shared worker thread a corresponding to the website identification. Since shared worker thread a was already established when page 1 was opened. Therefore, only the newly opened page 2 needs to be connected with the shared working thread a, the page 2 can circularly report its own page ID once at a certain time interval through the shared working thread a, and the shared working thread a can generate and record the last reporting timestamp T2 of the page 2 according to the corresponding reporting timestamp of each reporting of the page 2. Likewise, in response to opening page 3 and page 4 in the browser, there is already a shared worker thread A. Therefore, only the newly opened page 3 and page 4 need to be connected with the shared working thread a respectively, the page 3 and page 4 can report their own page IDs at a certain time interval in a circulating manner, and the shared working thread a can generate and record the last reporting timestamp T3 of the page 3 and the last reporting timestamp T4 of the page 4 according to the corresponding reporting timestamps reported by the page 3 and the page 4 each time. The shared working thread a may also determine whether the page is closed by detecting whether a time interval between the last reporting timestamp and the current timestamp corresponding to each page exceeds a preset time threshold. In specific implementation, if the time interval exceeds the preset time threshold, it may be determined that the page is closed. And if the time interval does not exceed the preset time threshold, determining that the page is normally not closed.

For example, if the preset time threshold is 100ms, the time interval between the last reporting timestamp T1 of the page 1 and the current timestamp is 80 ms, the time interval between the last reporting timestamp T2 of the page 2 and the current timestamp is 50 ms, the time interval between the last reporting timestamp T3 of the page 3 and the current timestamp is 120 ms, and the time interval between the last reporting timestamp T4 of the page 4 and the current timestamp is 60 ms. It can be determined that the page 3 is closed and the page ID of the page 3 is reported to the server because the time interval (120 ms) between the last reporting timestamp T3 and the current timestamp of the page 3 exceeds the preset time threshold (100 ms). And the time interval (80 ms) between the last reporting timestamp T1 of the page 1 and the current timestamp, the time interval (50 ms) between the last reporting timestamp T2 of the page 2 and the current timestamp, and the time interval (60 ms) between the last reporting timestamp T4 of the page 4 and the current timestamp do not exceed the preset time threshold (100 ms), it may be determined that the page 1, the page 2, and the page 4 are not closed.

As an alternative embodiment, the report data includes page identification data and user behavior data, and the operation S220 (receiving and storing the report data of each page through the shared working thread) includes: based on the page identification data, a page list and associated memory page lists and user behavior data of the respective pages are generated.

According to the embodiment of the invention, the page identification is used as the unique identification of the page and is used for distinguishing other pages. The shared working thread can accurately identify the user behavior data corresponding to each page by maintaining the page list, so that the user behavior is analyzed and processed according to the display content and the user behavior data of the page, and the behavior habit of the user is determined.

As an alternative embodiment, the method further comprises: acquiring a current timestamp and a reporting timestamp corresponding to the reporting data of each page; determining whether an overtime page exists in the page list or not based on the reporting timestamp and the current timestamp; and deleting the user behavior data of the timeout page in the case that the timeout page exists.

It should be noted that the time interval between the reporting timestamp for determining whether the time is out and the current timestamp may be shorter than the time interval between the reporting timestamp for determining whether the time is off and the current timestamp.

According to the embodiment of the invention, the shared working thread is deleted according to the user behavior data corresponding to the overtime page, so that the occupation of the shared working thread is released, and the resources are saved.

As an alternative embodiment, reporting the report data of each page to the server through the shared working thread includes: and reporting the page identification data and the user behavior data of each page to a server through a shared working thread. According to embodiments of the present invention, user behavior analysis includes, but is not limited to, the following analysis: the source area, the incoming road domain name and the page of the user; the residence time of the user on the website, the number of revisions, the number of new visitors, the number of revisions and the number of days of revisions; the method comprises the steps that a registered user and a non-registered user analyze browsing habits between the registered user and the non-registered user; search engines, keywords, associated keywords and in-station keywords used by the user; what portal format (advertisement or website portal link) the user selects; a user accesses a website flow and is used for analyzing whether the page structure design is reasonable or not; distributing data of a webpage hotspot graph and data of a webpage overlay on a page by a user; the access volume condition of the user in different time periods; user preference for font color of web sites, and the like.

Fig. 5 schematically shows a flow chart of a data processing method according to another embodiment of the invention. As shown in fig. 5, by sharing the working thread, in addition to monitoring the page close event on multiple pages of the browser end (B) and reporting data related to the page close event to the processing server of the server end (S), the user behavior data may be reported to the log server of the server end (S) under the condition of collecting user behaviors of multiple pages, so that after receiving the user behavior data, the log server discovers the rule of the user accessing the platform such as the website and the like by processing and analyzing the user behavior data. In a specific implementation, the operations S510 to S530 may be included in addition to the operations S410 to S440 (which are not described herein again).

In operation S510, user behavior data is collected. Each page collects user behavior analysis data such as user behavior actions and events on the own page. User behavior data includes, but is not limited to, one or more of a user's dwell time on a page, number of visits, number of page clicks, number of swipes, and number of scrolls. After the user behavior data are collected by the multiple pages, the reporting data which need to be reported to the server through the shared working thread are entrusted to the shared working thread.

In operation S520, the shared worker thread sends a request for reporting data to the server (S).

In operation S530, the user behavior data delegated to be reported on each page is reported to the server, so that the server system can analyze the user behavior based on the reported user behavior data.

The embodiment of sequentially opening page 1, page 2, page 3, and page 4 with the first-level domain name baidu.com of the website to which the website identifier belongs in the IE browser and establishing the shared work thread a corresponding to the website identifier is continuously used, and a specific implementation manner for reporting user behavior data in the data processing method provided by the present invention is described in detail.

In specific implementation, when a user behavior occurs on the page 1, collecting the stay time and the access times of the user on the page 1 as entrusted reporting data of the page 1; when a user behavior occurs on the page 2, acquiring the click times and the sliding times of the user on the page 2 as entrusted reporting data of the page 2; when a user behavior occurs on the page 3, acquiring the sliding times and rolling times of the user on the page 3 as entrusted reporting data of the page 3; when a user behavior occurs on the page 4, the retention time, the access times, the page click times, the sliding times and the rolling times of the user on the page 4 are collected to be used as entrusted reporting data of the page 4. Because the shared working thread A is stored with the page list and the user behavior data of each page in a correlated manner, the shared working thread A can report the entrusted data, namely the user behavior data, corresponding to each page to the log server by sending a report data request.

In the embodiment of the invention, the page 1, the page 2, the page 3 and the page 4 do not need to establish connection with a log server any more, but establish connection with a shared working thread, and can delegate all the delegated reporting data to the shared working thread for storage and reporting to the server, thereby achieving the technical effects of improving the page communication efficiency, reducing the number of requests, reducing the number of connections and reducing the resource consumption of the client and the server.

It should be noted that, the present invention does not limit the specific content of the delegated reporting data of the multiple pages establishing connection with the shared working thread, and each page can determine the data to be reported according to the actual situation.

Through reporting page identification data and user behavior data to the server, make the server based on page identification data and user behavior data received, carry out user behavior analysis and processing, can let the enterprise know user's behavioral habits more in detail, clearly to find out the problem that enterprise marketing environment such as website, popularization channel exists, help the enterprise to send out the page of high conversion rate, make the marketing of enterprise more accurate, effective, improve the business conversion rate, thereby promote the advertising income of enterprise.

Exemplary devices

Having described exemplary manners of exemplary embodiments of the present invention, a data processing apparatus for implementing the above-described data processing method according to exemplary embodiments of the present invention will be explained in detail next.

Fig. 6 schematically shows a block diagram of a data processing device according to an embodiment of the present invention.

As shown in fig. 6, the data processing apparatus 600 may include a creating module 610, a processing module 620, and a reporting module 630.

The creating module 610 is configured to, for example, execute the foregoing operation S210, and create a shared work thread, where the shared work thread is used to receive the report data of multiple pages.

The processing module 620 is configured to, for example, execute the foregoing operation S220, and receive and store the report data of each page through the shared working thread in response to the data report request of each page.

The reporting module 630 is configured to, for example, execute the operation S230, and report the reported data of each page to the server through the shared working thread.

In one embodiment of the invention, multiple pages have an associative relationship.

In one embodiment of the invention, the creation module 610 includes: the first detection submodule is configured to respond to an opening request of a page and detect whether a shared working thread aiming at the page exists or not; and a creation sub-module configured to create the shared worker thread in the absence of the shared worker thread.

By detecting whether the shared working thread exists or not and only creating the shared working thread under the condition of no shared working thread exists, repeated establishment of the shared working thread can be avoided, so that a plurality of pages with incidence relations can share one shared working thread, the number of reported connections is reduced, and the resource consumption of the client and the server is reduced.

Fig. 7 schematically shows a block diagram of a data processing device according to another embodiment of the invention.

As shown in fig. 7, the reporting data includes page identifier data, and the data processing apparatus 700 may include, in addition to the creating module 610, the processing module 620, and the reporting module 630, a recording module 710 configured to record reporting timestamps corresponding to the reporting data of each page through the shared working thread.

Through the reporting time stamps corresponding to the reporting data recorded in each page, the ordered management of a plurality of pages communicated with the shared working thread can be realized.

As shown in fig. 7, the data processing apparatus 700 may further include an obtaining module 720 and a determining module 730, in addition to the creating module 610, the processing module 620, the reporting module 630 and the recording module 710.

The obtaining module 720 is configured to obtain the latest reporting timestamp corresponding to each page based on the reporting timestamp corresponding to the reporting data of each page.

The determining module 730 is configured to determine whether there is a page that has been closed in each page based on the latest reporting timestamp.

In one embodiment of the invention, the determining module 730 includes: a first obtaining sub-module configured to obtain a current timestamp; the first determining submodule is configured to determine starting time lengths corresponding to the pages based on the current timestamp and the latest reporting timestamp; the second detection submodule is configured to detect whether pages exceeding a preset time length exist in the starting time lengths corresponding to the pages; and the second determining submodule is configured to determine that closed pages exist in each page under the condition that pages exceeding the preset time length exist in the starting time length corresponding to each page.

In an embodiment of the present invention, the reporting data includes page identifier data and user behavior data, and the processing module 620 includes: the generation submodule is configured to generate a page list based on the page identification data; and the storage submodule is configured to associate the storage page list and the user behavior data of each page.

In one embodiment of the invention, the processing module 620 further comprises: the second obtaining submodule is configured to obtain a current timestamp and reporting timestamps corresponding to the reporting data of all the pages; the third determining submodule is configured to determine whether an overtime page exists in the page list or not based on the reporting timestamp and the current timestamp; and the deleting submodule is configured to delete the user behavior data of the timeout page under the condition that the timeout page exists.

In an embodiment of the present invention, the reporting module 630 is configured to report the page identifier of the page that has been closed to the server when it is determined that the page that has been closed exists in the pages.

In an embodiment of the present invention, the reporting module 630 is configured to report the page identifier data and the user behavior data of each page to the server through the shared working thread.

According to an exemplary embodiment of the invention, any number of the modules, sub-modules, or at least part of the functionality of any number thereof may be implemented in one module. Any one or more of the modules, sub-modules according to exemplary embodiments of the present invention may be implemented by being divided into a plurality of modules. Any one or more of the modules, sub-modules according to exemplary embodiments of the present invention may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of three implementations, or in any suitable combination of any of these. Alternatively, one or more of the modules, sub-modules according to exemplary embodiments of the invention may be at least partly implemented as computer program modules, which, when executed, may perform corresponding functions.

For example, any number of the creating module 610, the processing module 620, the reporting module 630, the recording module 710, the obtaining module 720, the determining module 730, the first obtaining sub-module, the first determining sub-module, the second detecting sub-module, the second determining sub-module, the generating sub-module, the storing sub-module, the second obtaining sub-module, the third determining sub-module, and the deleting sub-module may be combined and implemented in one module, or any one of the modules may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to an exemplary embodiment of the present invention, at least one of the creating module 610, the processing module 620, the reporting module 630, the recording module 710, the obtaining module 720, the determining module 730, the first obtaining sub-module, the first determining sub-module, the second detecting sub-module, the second determining sub-module, the generating sub-module, the storing sub-module, the second obtaining sub-module, the third determining sub-module, and the deleting sub-module may be at least partially implemented as a hardware circuit, such as Field Programmable Gate Arrays (FPGAs), Programmable Logic Arrays (PLAs), systems on a chip, systems on a substrate, systems on a package, Application Specific Integrated Circuits (ASICs), or in hardware or firmware in any other reasonable manner by integrating or packaging circuits, or in any one of three implementations, software, hardware and firmware, or in any suitable combination of any of them. Alternatively, at least one of the creating module 610, the processing module 620, the reporting module 630, the recording module 710, the obtaining module 720, the determining module 730, the first obtaining sub-module, the first determining sub-module, the second detecting sub-module, the second determining sub-module, the generating sub-module, the storing sub-module, the second obtaining sub-module, the third determining sub-module, and the deleting sub-module may be at least partially implemented as a computer program module, and when the computer program module is executed by a computer, the functions of the corresponding modules may be executed.

It should be noted that the data processing apparatus portion in the embodiment of the present invention corresponds to the data processing method portion in the embodiment of the present invention, and the description of the data processing apparatus portion may specifically refer to the data processing method portion, which is not described herein again.

Exemplary Medium

Having described exemplary apparatus of exemplary embodiments of the present invention, media storing computer-executable instructions for implementing the data processing methods of fig. 2-5 when executed by a processing unit of exemplary embodiments of the present invention are described next with reference to fig. 8.

In some possible embodiments, various aspects of the present invention may also be implemented in a program product including program code for causing a device to perform operations (or steps) in a data processing method according to various exemplary embodiments of the present invention described in the above-mentioned "exemplary methods" section of this specification when the program product is run on the device, for example, the device may perform operation S210 as shown in fig. 2 to create a shared worker thread. In operation S220, in response to the data reporting request of each page, the reporting data of each page is received and stored through the shared working thread. In operation S230, the report data of each page is reported to the server through the shared working thread.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

As shown in fig. 8, a data processing program product 80 according to an embodiment of the present invention is depicted, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a device, such as a personal computer. However, the program product of the present invention is not limited in this respect, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, or device.

A readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, or device.

Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).

Exemplary computing device

Having described the methods, media, and apparatus of exemplary embodiments of the present invention, a computing device of an exemplary embodiment of the present invention is next described with reference to fig. 9, and includes a processing unit and a storage unit, the storage unit storing computer-executable instructions, which when executed by the processing unit, are used to implement the data processing methods of fig. 2-5.

The embodiment of the invention also provides the computing equipment. As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.

In some possible embodiments, a computing device according to the present invention may include at least one processing unit, and at least one memory unit. Wherein the storage unit stores program code which, when executed by the processing unit, causes the processing unit to perform the steps of the data processing method according to various exemplary embodiments of the present invention described in the above-mentioned "exemplary methods" section of the present specification. For example, the processing unit may perform operation S210 as shown in fig. 2, creating a shared worker thread. In operation S220, in response to the data reporting request of each page, the reporting data of each page is received and stored through the shared working thread. In operation S230, the report data of each page is reported to the server through the shared working thread.

A computing device 90 for data processing according to this embodiment of the invention is described below with reference to fig. 9. The computing device 90 shown in FIG. 9 is only one example and should not be taken to limit the scope of use and functionality of embodiments of the present invention.

As shown in fig. 9, computing device 90 is embodied in the form of a general purpose computing device. Components of computing device 90 may include, but are not limited to: the at least one processing unit 901, the at least one memory unit 902, and the bus 903 connecting the various system components (including the memory unit 902 and the processing unit 901).

The bus 903 includes an address bus, a data bus, and a control bus.

The storage unit 902 may include readable media in the form of volatile memory, such as a Random Access Memory (RAM)9021 and/or a cache memory 9022, and may further include a Read Only Memory (ROM) 9023.

Storage unit 902 may also include a program/utility 9025 having a set (at least one) of program modules 9024, such program modules 9024 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.

Computing device 90 may also communicate with one or more external devices 904 (e.g., keyboard, pointing device, bluetooth device, etc.), which may be through an input/output (I/0) interface 905. Moreover, computing device 90 may also communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via network adapter 906. As shown, network adapter 906 communicates with the other modules of computing device 90 via bus 903. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with computing device 90, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.

It should be noted that although in the above detailed description several units/modules or sub-units/modules of the apparatus are mentioned, such a division is merely exemplary and not mandatory. Indeed, the features and functionality of two or more of the units/modules described above may be embodied in one unit/module according to embodiments of the invention. Conversely, the features and functions of one unit/module described above may be further divided into embodiments by a plurality of units/modules.

Moreover, while the operations of the method of the invention are depicted in the drawings in a particular order, this does not require or imply that the operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.

While the spirit and principles of the invention have been described with reference to several particular embodiments, it is to be understood that the invention is not limited to the particular embodiments disclosed, nor is the division of the aspects, which is for convenience only as the features in these aspects may not be combined to benefit from the present disclosure. The invention is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims

1. A method of data processing, comprising:

creating a shared working thread, wherein the shared working thread is used for receiving the reported data of a plurality of pages;

responding to the data reporting request of each page, and receiving and storing the reported data of each page through the shared working thread; and

and reporting the reported data of each page to a server through the shared working thread.

2. The method of claim 1, wherein:

the plurality of pages have an association relationship.

3. The method of claim 1, wherein the creating a shared worker thread comprises:

in response to an open request for a page, detecting whether a shared worker thread already exists for the page: and

creating the shared worker thread in the absence of the shared worker thread.

4. The method of claim 1, wherein the method further comprises:

and recording reporting timestamps corresponding to the reporting data of the pages through the shared working thread.

5. The method of claim 4, wherein the method further comprises:

acquiring the latest reporting timestamp corresponding to each page based on the reporting timestamp corresponding to the reporting data of each page; and

and determining whether the pages which are closed exist in the pages or not based on the latest reporting timestamp.

6. The method of claim 5, wherein the determining whether there are pages of the respective pages that have been closed based on the latest reporting timestamp comprises:

acquiring a current timestamp;

determining the starting time length corresponding to each page based on the current timestamp and the latest reporting timestamp;

detecting whether a page exceeding a preset time length exists in the starting time lengths corresponding to the pages; and

and determining that the closed pages exist in the pages under the condition that the pages exceeding the preset time length exist in the opening time lengths corresponding to the pages.

7. The method of claim 1, wherein the reporting data includes page identification data and user behavior data, and the receiving and storing the reporting data of each page by the shared worker thread includes:

generating a page list based on the page identification data; and

and storing the page list and the user behavior data of each page in an associated manner.

8. A data processing apparatus comprising:

the system comprises a creating module, a sending module and a receiving module, wherein the creating module is configured to create a shared working thread, and the shared working thread is used for receiving reported data of a plurality of pages;

the processing module is configured to respond to the data reporting request of each page, and receive and store the reported data of each page through the shared working thread; and

and the reporting module is configured to report the reported data of each page to a server through the shared working thread.

9. A medium storing computer executable instructions for implementing the method of any one of claims 1 to 7 when executed by a processing unit.

10. A computing device, comprising:

a processing unit; and

a storage unit storing computer-executable instructions for implementing the method of any one of claims 1 to 7 when executed by the processing unit.