WO2020151241A1

WO2020151241A1 - Information non-trace exposure collection method and device

Info

Publication number: WO2020151241A1
Application number: PCT/CN2019/106783
Authority: WO
Inventors: 胡晓; 李勇睿; 许夏骏; 胡孟亮
Original assignee: 苏宁云计算有限公司; 苏宁易购集团股份有限公司
Priority date: 2019-01-23
Filing date: 2019-09-19
Publication date: 2020-07-30
Also published as: CN111475756A; CA3168957A1; CN111475756B

Abstract

An information non-trace exposure collection method and device, the method comprising the following steps: S1, acquiring non-trace exposure configuration information from a server and writing same into a memory, and searching, according to the non-trace exposure configuration information, for the content of an area where non-trace exposure is started and setting a relevant exposure rule; S2, searching for all the areas, where the non-trace exposure has been started, on a page, capturing an exposure element onload event of the areas where the non-trace exposure has been started, and acquiring exposure information according to exposure elements; S3, writing the exposure information to the memory by means of an analog stack; and S4, sending and reporting, according to the exposure rule, the exposure information written into the memory. The current intrusion to a service thereof in an exposure point burying process can be solved, and it is almost possible to collect page information exposure without a service buried point, thereby greatly reducing the threshold of information exposure collection; and the process of reporting exposure information is regulated, thereby solving problems, such as HTTP request blocking and web page freezing and crashing, caused by high concurrency.

Description

Method and device for seamless exposure and collection of information

Technical field

The present invention relates to the technical field of information collection, in particular to a method and device for seamless exposure and collection of information.

Background technique

At present, the most common method for web-side information exposure is to manually embed points through JS, that is, when the node or information that needs to be exposed reaches the relevant scene of the business regulations, the pre-defined method is called (this method is generally provided in JS) Global method) complete real-time reporting. This approach has the following problems:

1. The related operations of information exposure invade the business logic of the page, which brings a lot of inconvenience to the development of normal business logic;

2. Since the reporting of exposure information needs to send an HTTP request (usually the call of a pre-defined method will generate an HTTP request), in practice we found that the scene and number of calls of the pre-defined method are very confusing This leads to a surge in HTTP requests at a specific point in time, which exceeds the concurrency that the browser can withstand, resulting in serious problems such as HTTP request blocking, page crashes, and flashbacks.

Summary of the invention

In order to solve the problems of the prior art, the embodiments of the present invention provide a method and device for seamless exposure and collection of information, so as to overcome the problems of high intrusion of exposure buried points and high-frequency HTTP requests in the prior art.

In order to solve one or more of the above technical problems, the technical solution adopted by the present invention is:

In one aspect, a method for seamless exposure and collection of information is provided. The method includes the following steps:

S1: Obtain the traceless exposure configuration information from the server and write it into the memory, search for the content of the area where traceless exposure is enabled according to the traceless exposure configuration information, and set relevant exposure rules;

S2: Searching for all areas on the page where the seamless exposure has been turned on, capturing the exposure element onload events of the areas where the seamless exposure has been turned on, and obtaining exposure information according to the exposure elements;

S3: Write the exposure information into the memory in a simulated stack mode;

S4: Send and report the exposure information written in the memory according to the exposure rule.

Further, after all the areas on the search page that have been enabled for seamless exposure, it also includes:

It is determined whether the traceless exposure of the page is turned on, and if it is turned on, the onload event of the exposure element in the area where the traceless exposure is turned on is captured, and the exposure information is obtained according to the exposure element, otherwise no processing is performed.

Further, the step S3 specifically includes:

Search for the information of the exposure element of the onload event, and bubble upward to search for the exposure information carried by the exposure element, and write the exposure information into the memory.

Further, the step S4 specifically includes:

S4.1: Query whether there is exposure information in the memory, if not, end the process, otherwise, go to step S4.2;

S4.2: Query whether the timer is turned on, if yes, proceed directly to step S4.3, otherwise, proceed to step S4.3 after turning on the timer;

S4.3: Splicing and reporting the exposure information according to the flow control rules in the exposure rules, and delete the sent exposure information from the memory;

S4.4: Query whether there is exposure information in the memory, if so, return to step S4.3, otherwise, the process ends after closing the timer.

Further, the method further includes:

Configure the traceless exposure switch on the corresponding page to enable or disable traceless exposure collection in real time.

In another aspect, a device for seamless exposure and collection of information is provided, which includes:

A setting module, which is used to obtain the traceless exposure configuration information from the server and write it into the memory, search for the content of the area where traceless exposure is turned on according to the traceless exposure configuration information, and set relevant exposure rules;

The search module is configured to search for all areas on the page where the seamless exposure has been turned on, capture the exposure element onload events of the areas where the seamless exposure has been turned on, and obtain exposure information according to the exposure elements;

The storage module is used to write the exposure information into the memory in a simulated stack mode;

The reporting module is configured to send and report the exposure information written in the memory according to the exposure rule.

Further, the search module includes:

The judging unit is used to judge whether to turn on the traceless exposure of the page, if it is enabled, capture the exposure element onload event of the area where the traceless exposure has been turned on, and obtain the exposure information according to the exposure element, otherwise no processing is performed .

Further, the storage module is specifically used for:

Further, the reporting module includes:

The first query unit is used to query whether there is exposure information in the memory;

The second query unit is used to query whether the timer is on;

The information reporting unit is configured to splice and report the exposure information according to the flow control rules in the exposure rules, and delete the sent exposure information from the memory.

Further, the device further includes:

The configuration module is used to configure the traceless exposure switch of the corresponding page, and turn on or off traceless exposure collection in real time.

The beneficial effects brought about by the technical solutions provided by the embodiments of the present invention are:

1. According to the method and device for seamless exposure collection of information provided by the embodiments of the present invention, by capturing the onload event of the element in the automatic exposure area, the business side only needs to configure the switch of whether to open the exposure and the exposure in the corresponding background management page. The frequency is sufficient, and there is no need to manually call the exposure method of the corresponding collection script, thereby eliminating the intrusion of your own business, and almost achieving the collection of page information exposure under the condition that the business has no buried points, thus greatly reducing the information exposure collection threshold;

2. The method and device for seamless exposure collection of information provided by the embodiments of the present invention send HTTP requests in a first-in-first-out order by simulating stack storage, which solves the problem of HTTP request blocking caused by high concurrency, web page jams, crashes, etc. problem. Moreover, the rules of the exposure information reporting module can be configured in real time to deal with different business scenarios.

Description of the drawings

In order to explain the technical solutions in the embodiments of the present invention more clearly, the following will briefly introduce the accompanying drawings used in the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained from these drawings without creative work.

Fig. 1 is a flow chart showing a method for collecting information traceless exposure according to an exemplary embodiment;

Fig. 2 is another flowchart showing a method for collecting information traceless exposure according to an exemplary embodiment;

Fig. 3 is a schematic diagram showing the structure of an information traceless exposure collection device according to an exemplary embodiment.

detailed description

In order to make the objectives, technical solutions, and advantages of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only Some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

The method and device for non-trace exposure collection of information provided by the embodiments of the present invention circumvent and perform unified management and control in response to the high intrusiveness of exposure buried points and high-frequency HTTP requests existing in the current WEB information exposure technology. First of all, in the method and device for seamless exposure collection of information provided by the embodiments of the present invention, there will be no case where the business code and the code of the exposure buried point are coupled together in the implementation of the traditional exposure collection technology. Then, the HTTP request is sent in an orderly first-in, first-out manner through the simulated stack storage method, which solves the problems of HTTP request blocking and other problems that occur with traditional exposure technology. Moreover, the flow control for reporting the exposure information is added to the embodiment of the present invention to meet the needs of various business scenarios such as big promotion and non-big promotion.

Fig. 1 is a flowchart of a method for collecting information traceless exposure according to an exemplary embodiment. Referring to Fig. 1, the method includes the following steps:

S1: Obtain the traceless exposure configuration information from the server and write it into the memory, search for the content of the region where the traceless exposure is enabled according to the traceless exposure configuration information, and set related exposure rules.

Specifically, the traceless exposure configuration information is obtained from the server at the first time when the page is loaded and written into the memory. Then search for the content of the area where the seamless exposure is turned on according to the seamless exposure configuration information, and set the relevant exposure rule Rn according to the seamless exposure configuration information. Among them, relevant exposure rules include at least flow control rules, collection rules, etc. It should be noted here that in the embodiment of the present invention, the exposure rule supports real-time configuration, that is, the user can configure the exposure rule in real time according to actual business scenarios.

S2: Search for all areas on the page where the seamless exposure has been turned on, capture the exposure element onload events of the areas where the seamless exposure has been turned on, and obtain exposure information according to the exposure elements.

Specifically, when the page is loaded, search for the area on the page that has been opened for seamless exposure, and capture the onload event of the exposed element downward (the onload event will be triggered in a specific scene, such as the page or image immediately after it is loaded), Then obtain the exposure information according to the exposure element. When it is detected that the onload event corresponding to the exposure element is triggered, the corresponding collection method is triggered, and the corresponding exposure information is collected according to the collection rule. That is, according to the captured exposure elements, search for various attributes carried by itself, and position information in the current page DOM node, and bubble upward to query the pre-set rule information on the parent node, record and report.

As a preferred implementation manner, in the embodiment of the present invention, it is also necessary to set a callback method for the onload event, in which the corresponding exposure scheme is set according to the above-mentioned relevant exposure rules.

S3: Write the exposure information into the memory in a simulated stack mode.

As a preferred implementation manner, in the embodiment of the present invention, writing the exposure information simulation stack mode to the memory specifically includes:

Specifically, after detecting that the onload event corresponding to the exposure element is triggered, the callback is triggered to search for the information of the exposure element that currently triggers the onload event, and bubble upward to search for the exposure information carried by the corresponding exposure element, and then write the exposure information into the memory In storage.

Specifically, in order to solve the problems of HTTP request blocking page crashes and crashes that occur in the traditional exposure technology, in the embodiment of the present invention, the HTTP request is issued in an orderly first-in-first-out manner through the simulated stack storage method, and the exposure information is reported in this section. Flow control rules are added, and the exposure information is sent out in batches, regularly and quantitatively.

As a preferred implementation manner, in the embodiment of the present invention, after all the areas on the search page that have been enabled for seamless exposure, the following further includes:

It is determined whether the traceless exposure of the page is turned on, and if it is turned on, the onload event of the exposure element in the area where the traceless exposure is turned on is captured, and the exposure information is obtained according to the exposure element, otherwise no processing is performed. It should be noted here that in the embodiment of the present invention, the basis for judging whether to open the traceless exposure of the page can be: traversing the document object model (DOM) nodes of the page, searching for areas with the traceless exposure attribute (SAP-MODID), and It is considered that the area of non-marking exposure is turned on. This operation is to turn on the traceless exposure front desk or main switch. If the SAP-MODID cannot be queried, there will be no subsequent exposure operation.

Specifically, the user can determine whether to open the seamless exposure of the page according to actual needs.

As a preferred implementation manner, in the embodiment of the present invention, the step S4 specifically includes:

S4.1: Query whether there is exposure information in the memory, if not, end the process, otherwise, perform step S4.2.

Specifically, in the embodiment of the present invention, the cache record of exposure data (ie, exposure information) is sent and reported in batches, and before the exposure information is reported, it is necessary to query whether there is data (ie, exposure information) in the memory.

S4.2: Query whether the timer is turned on, if yes, proceed directly to step S4.3, otherwise, proceed to step S4.3 after turning on the timer.

Specifically, the time interval of the timer can be set according to the actual needs of the user, for example, the time interval of the timer is set to 100ms.

S4.3: The exposure information is spliced and reported according to the flow control rules in the exposure rules, and the sent exposure information is deleted from the memory.

Specifically, in the embodiment of the present invention, the set exposure rules include flow control rules, and the exposure information is spliced and reported according to the flow control rules. For example, every 100ms the exposure information in the previous memory is sent out, and a maximum of 10 HTTP requests are sent. After the exposure information is sent, the sent exposure information will be deleted from the memory.

Specifically, each time the exposure information is sent out, check again whether there is exposure information in the memory. If so, return to step S4.3, continue to splice and report the exposure information according to the flow control rules, otherwise, first turn off the timer and then end Process.

As a preferred implementation manner, in an embodiment of the present invention, the method further includes:

Specifically, in the embodiment of the present invention, a traceless exposure switch corresponding to the page can be configured in the background management page, and the traceless exposure switch can be turned on or off in real time according to user requirements.

Fig. 2 is another flow chart of a method for collecting information traceless exposure according to an exemplary embodiment. The following illustrates the specific implementation of the present invention with reference to Fig. 2 as an example:

For example, suppose that three areas of a page A need to be exposed without trace, namely:'popular goods','life tribes', and'ranking lists', and the ID corresponding to the automatic exposure is "99348015073", that is, ID1 is " 99348015073". When the page is loaded, the collection method will search for ID1 and capture all DOM elements (ie exposure elements) that support the onload event under the ID1 area, assuming DOMS1. The acquisition method continues to search for the automatic exposure rule R1 in the page. Set the callback method of the onload event of DOMS1. In this callback method, set the corresponding exposure scheme according to the exposure rule R1.

When the user browses to the ID1 area on the page, assume that the product cards that need to be exposed in the ID1 area include: P1, P2, P3, P4... The product card loaded in the current page (that is, being browsed by the user) will automatically trigger the corresponding The onload event triggers the corresponding collection method, and the exposure diary collection starts. Then the exposure information is collected according to different collection rules. The collected exposure information of P1 may include: P1 parent node A, A.herf, A.title... after encoding, it is _infoA. P1's _infoA log report format G1 is as follows: //www.xxx.xxx/salog.gif? _infoA. Then according to the flow control rules, the exposure information of P1 is reported according to G1, for example, 10 pieces are sent every 100ms.

When there are many similar P1 product cards Pn on the page, flow control rules can be configured in real time to report exposure information. For example, set to send 10 messages every 1000ms, etc.

Fig. 3 is a schematic structural diagram of an information traceless exposure collection device according to an exemplary embodiment. Referring to Fig. 3, the device includes:

A setting module, configured to obtain the traceless exposure configuration information from the server and write it into the memory, search for the content of the region where traceless exposure is enabled according to the traceless exposure configuration information, and set relevant exposure rules;

Specifically, in order to solve the problems of HTTP request blocking page crashes and crashes that occur in the traditional exposure technology, in the embodiment of the present invention, the reporting module sends HTTP requests in an orderly first-in-first-out manner by simulating stack storage, and reports the exposure information. This block has joined the flow control rules, and the exposure information is sent out in batches, regularly and quantitatively.

As a preferred implementation manner, in this embodiment of the present invention, the search module includes:

As a preferred implementation manner, in the embodiment of the present invention, the storage module is specifically used for:

As a preferred implementation manner, in the embodiment of the present invention, the reporting module includes:

The second query unit is used to query whether the timer is on;

As a preferred implementation manner, in an embodiment of the present invention, the device further includes:

The configuration module is used to configure the traceless exposure switch of the corresponding page, and enable or disable traceless exposure collection in real time.

In summary, the beneficial effects brought about by the technical solutions provided by the embodiments of the present invention are:

It should be noted that when the information traceless exposure collection device provided in the above embodiment triggers the traceless exposure collection service, only the division of the above-mentioned functional modules is used as an example for illustration. In practical applications, the above-mentioned functions can be allocated by Different functional modules are completed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the information traceless exposure collection device provided by the above-mentioned embodiment belongs to the same concept as the embodiment of the information traceless exposure collection method, that is, the method is based on the information traceless exposure collection device. For the specific implementation process, please refer to the method embodiments. I won't repeat it here.

Those of ordinary skill in the art can understand that all or part of the steps in the above embodiments can be implemented by hardware, or by a program instructing related hardware to complete. The program can be stored in a computer-readable storage medium. The storage medium mentioned can be a read-only memory, a magnetic disk or an optical disk, etc.

The above descriptions are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection of the present invention. Within range.

Claims

A method for seamless exposure and collection of information, characterized in that the method includes the following steps:

S1: Obtain the traceless exposure configuration information from the server and write it into the memory, search for the content of the area where traceless exposure is enabled according to the traceless exposure configuration information, and set relevant exposure rules;

S2: Searching for all areas on the page where the seamless exposure has been turned on, capturing the exposure element onload events of the areas where the seamless exposure has been turned on, and obtaining exposure information according to the exposure elements;

S3: Write the exposure information into the memory in a simulated stack mode;

S4: Send and report the exposure information written in the memory according to the exposure rule.
The method for collecting information traceless exposure according to claim 1, characterized in that, after searching all areas on the page for which traceless exposure has been turned on, the method further comprises:

It is determined whether the traceless exposure of the page is turned on, and if it is turned on, the onload event of the exposure element in the area where the traceless exposure is turned on is captured, and the exposure information is obtained according to the exposure element, otherwise no processing is performed.
The method according to claim 1 or 2, wherein the step S3 specifically includes:

Search for the information of the exposure element of the onload event, and bubble upward to search for the exposure information carried by the exposure element, and write the exposure information into the memory.
The method for collecting information traceless exposure according to claim 1 or 2, wherein the step S4 specifically includes:

S4.1: Query whether there is exposure information in the memory, if not, end the process, otherwise, go to step S4.2;

S4.2: Query whether the timer is turned on, if yes, proceed directly to step S4.3, otherwise, proceed to step S4.3 after turning on the timer;

S4.3: Splicing and reporting the exposure information according to the flow control rules in the exposure rules, and delete the sent exposure information from the memory;

S4.4: Query whether there is exposure information in the memory, if so, return to step S4.3, otherwise, the process ends after closing the timer.
The method for collecting information traceless exposure according to claim 1 or 2, wherein the method further comprises:

Configure the traceless exposure switch on the corresponding page to enable or disable traceless exposure collection in real time.
An information seamless exposure collection device, characterized in that the device comprises:

A setting module, configured to obtain the traceless exposure configuration information from the server and write it into the memory, search for the content of the region where traceless exposure is enabled according to the traceless exposure configuration information, and set relevant exposure rules;

The search module is configured to search for all areas on the page where the seamless exposure has been turned on, capture the exposure element onload events of the areas where the seamless exposure has been turned on, and obtain exposure information according to the exposure elements;

The storage module is used to write the exposure information into the memory in a simulated stack mode;

The reporting module is configured to send and report the exposure information written in the memory according to the exposure rule.
The information seamless exposure collection device according to claim 6, wherein the search module comprises:

The judging unit is used to judge whether to turn on the traceless exposure of the page, if it is enabled, capture the exposure element onload event of the area where the traceless exposure has been turned on, and obtain the exposure information according to the exposure element, otherwise no processing is performed .
The information traceless exposure collection device according to claim 6 or 7, wherein the storage module is specifically used for:

Search for the information of the exposure element of the onload event, and bubble upward to search for the exposure information carried by the exposure element, and write the exposure information into the memory.
The information seamless exposure collection device according to claim 6 or 7, wherein the reporting module comprises:

The first query unit is used to query whether there is exposure information in the memory;

The second query unit is used to query whether the timer is on;

The information reporting unit is configured to splice and report the exposure information according to the flow control rules in the exposure rules, and delete the sent exposure information from the memory.
The information traceless exposure collection device according to claim 6 or 7, wherein the device further comprises:

The configuration module is used to configure the traceless exposure switch of the corresponding page, and enable or disable traceless exposure collection in real time.