CN113377634A

CN113377634A - Monitoring method for backtracking user operation, user operation backtracking method and device

Info

Publication number: CN113377634A
Application number: CN202110574182.3A
Authority: CN
Inventors: 江涛; 杨勇伦; 杨元祖
Original assignee: Beijing Ape Force Education Technology Co ltd
Current assignee: Beijing Ape Force Education Technology Co ltd
Priority date: 2021-05-25
Filing date: 2021-05-25
Publication date: 2021-09-10

Abstract

The application discloses a monitoring method for backtracking user operation, a user operation backtracking method and equipment, wherein the method comprises the following steps: acquiring a target information set under the condition that a target event occurs to a monitoring object related to a target page; and uploading the target information set to a server, so that after the backtracking client is pulled from the server to the target information set, corresponding simulation operation is executed according to the target information set, wherein the simulation operation is used for simulating and executing the target operation based on the target information set, and the target operation is an operation for triggering a target event. Aiming at various user operations, an event does not need to be corresponded to the operation effect corresponding to the user operation, an application program programming interface for realizing triggered event distribution does not need to exist on a backtracking side, and the backtracking client only needs to combine and simulate various information collected by the monitoring client, so that the operation effect corresponding to the previous operation behavior of the user is restored.

Description

Monitoring method for backtracking user operation, user operation backtracking method and device

Technical Field

The present application relates to the field of communications technologies, and in particular, to a monitoring method for backtracking user operations, a user operation backtracking method, and a device.

Background

With the development of science and technology, resources on the network are more and more abundant, and a user can open a webpage and further browse contents in the webpage. The user may perform various operations within the web page, such as a click operation, a select operation, a copy operation, and so forth. Event dispatching refers to dispatching of a snooper to response code for execution by the snooper.

In the prior art, if the operation effect corresponding to the user operation is to be restored and displayed, the operation effect corresponding to the user operation must be corresponded to an event, and an application programming interface for realizing triggered event distribution must exist on the backtracking side. Corresponding operation effects exist in each user operation, but not all operation effects correspond to events. Alternatively, the listener may listen to events triggered by user actions, but does not provide an application programming interface for the triggered event dispatch implementation on the trace-back side. Therefore, in the above two cases, the backtracking side cannot show the operation effect corresponding to the user operation.

Disclosure of Invention

The invention provides a monitoring method for backtracking user operation, a user operation backtracking method and equipment, which are used for solving the technical problem that the backtracking side cannot show the operation effect corresponding to the user operation when the operation effect has no corresponding event or the backtracking side does not provide an application programming interface for realizing triggered event distribution in the prior art.

In a first aspect, the present invention provides a monitoring method for backtracking user operations, which is applied to a monitoring client, and the method includes:

under the condition that a target event occurs to a monitoring object related to a target page, acquiring a target information set, wherein the monitoring object comprises elements in the target page, a mouse in the target page and the size of the target page, and the target information set comprises event information of the target event, information of the monitoring object and codes of the target page;

uploading the target information set to a server, so that after a backtracking client is pulled from the server to the target information set, a corresponding simulation operation is executed according to the target information set, wherein the simulation operation is used for simulating and executing a target operation based on the target information set, and the target operation is an operation for triggering the target event.

In some embodiments, before the step of obtaining a target set of information, the method further comprises:

determining a first element located in a preset area in the target page as the monitoring object, wherein the preset area is a whole area of the target page or a partial area contained in the target page, and the first element comprises a button, an input frame, a picture, a pull-down menu or an icon.

In some embodiments, the determining that the first element located in the preset region in the target page is the listening object includes:

determining a distance between two adjacent first elements in a plurality of first elements under the condition that the first elements exist in a preset area in the target page;

and under the condition that the distance between two adjacent first elements in the plurality of first elements is smaller than a preset distance, determining the plurality of first elements as the monitoring object.

In some embodiments, the monitoring object is a mouse, the target event is a mouse movement event, and the event information of the target event includes a type of the target event, position information of the mouse during movement, and time information related to the position information.

In some embodiments, the monitored object is the size of the target page, the target event is a page size change event, and the event information of the target event includes the type of the target event, the occurrence time of the page size change event, and a change size corresponding to the page size change event.

In some embodiments, the monitored object is an element in the target page, the target events are a mouse entry event and a mouse exit event, and the event information of the target event includes a type of the target event, an occurrence time of the mouse entry event, and an occurrence time of the mouse exit event.

In a second aspect, the present invention provides a user operation backtracking method, which is applied to a backtracking client, and the method includes:

pulling a target information set from a server, wherein the target information set is acquired by a monitoring client and uploaded to the server when a target event occurs in a monitoring object related to a target page, and the target information set comprises event information of the target event, information of the monitoring object and a code of the target page;

and executing corresponding simulation operation according to the target information set, and displaying effect data, wherein the simulation operation is used for simulating and executing target operation based on the target information set, and the target operation is the operation for triggering the target event.

In some embodiments, the performing the corresponding simulation operation according to the target information set and displaying the effect data includes:

when the target event is determined to be a mouse moving event according to the event information of the target event, determining a mouse moving track according to the code of the target page, the position information of the mouse in the moving process, which is contained in the event information of the target event, and the time information related to the position information;

and displaying the mouse moving track.

when the target event is determined to be a page size change event according to the event information of the target event, adjusting the size of a preset element according to the occurrence time of the page size change event and the change size corresponding to the page size change event, wherein the occurrence time of the page size change event is included in the event information of the target event, and the preset element after the size adjustment is displayed, wherein the preset element is used for displaying the target page according to the code of the target page.

when the target event is determined to be a mouse entering event and a mouse moving-out event according to the event information of the target event, executing corresponding simulated stay operation at the monitored object in the target page according to the code of the target page, the information of the monitored object, the mouse entering event and the mouse moving-out event, and obtaining effect data;

and displaying the effect data.

In some embodiments, the performing, according to the code of the target page, the information of the monitored object, the mouse entry event, and the mouse exit event, a corresponding simulated staying operation at the monitored object in the target page to obtain effect data includes:

calculating the absolute value of the time difference value of the occurrence time of the mouse entering event and the occurrence time of the mouse moving-out event;

and under the condition that the absolute value of the time difference is greater than the preset time length, executing corresponding simulated stay operation at the monitoring object in the target page according to the code of the target page and the information of the monitoring object, and obtaining the effect data.

In some embodiments, the effect data is pop-up window effect data, drop-down box effect data, or flicker effect data.

In a third aspect, the present invention provides a listening client, including:

the acquisition module is used for acquiring a target information set under the condition that a target event occurs to a monitored object related to a target page, wherein the monitored object comprises elements in the target page, a mouse in the target page and the size of the target page, and the target information set comprises event information of the target event, information of the monitored object and codes of the target page;

and the uploading module is used for uploading the target information set to a server so that a backtracking client executes corresponding simulation operation according to the target information set after pulling the target information set from the server, wherein the simulation operation is used for simulating and executing target operation based on the target information set, and the target operation is an operation for triggering the target event.

In a fourth aspect, the present invention provides a backtracking client, including:

the system comprises a pulling module, a sending module and a receiving module, wherein the pulling module is used for pulling a target information set from a server, the target information set is acquired by a monitoring client when a target event of a monitoring object related to a target page is detected and is uploaded to the server, and the target information set comprises event information of the target event, information of the monitoring object and a code of the target page;

and the execution module is used for executing corresponding simulation operation according to the target information set and displaying effect data, wherein the simulation operation is used for simulating and executing target operation based on the target information set, and the target operation is the operation for triggering the target event.

In a fifth aspect, the present invention provides a storage medium, where the storage medium includes a stored program, where the apparatus on which the storage medium is located is controlled to execute the monitoring method for backtracking the user operation according to the first aspect and execute the user operation backtracking method according to the second aspect when the program runs.

In a sixth aspect, the present invention provides an apparatus comprising at least one processor, and at least one memory, bus connected to the processor; the processor and the memory complete mutual communication through the bus; the processor is configured to call a program instruction in the memory, execute the monitoring method for backtracking the user operation according to the first aspect, and execute the user operation backtracking method according to the second aspect.

In a seventh aspect, the present invention provides a system, including a server, a monitoring client for implementing the monitoring method for backtracking user operations according to the first aspect, and a backtracking client for implementing the user operation backtracking method according to the second aspect;

the server is used for receiving the target information set uploaded by the monitoring client.

As can be seen from the foregoing technical solutions, the monitoring method for backtracking user operations provided in the embodiments of the present invention is applied to a monitoring client, and acquires a target information set when a target event occurs in a monitored object related to a target page, where the monitored object includes an element in the target page, a mouse in the target page, and a size of the target page, and the target information set includes event information of the target event, information of the monitored object, and a code of the target page; uploading the target information set to a server, so that after a backtracking client is pulled from the server to the target information set, a corresponding simulation operation is executed according to the target information set, wherein the simulation operation is used for simulating and executing a target operation based on the target information set, and the target operation is an operation for triggering the target event. Thus, the target information set may include event information of the target event, information of the interception object, and code of the target page. Aiming at various user operations, an event does not need to be corresponded to the operation effect corresponding to the user operation, an application programming interface for realizing the triggered event dispatch does not need to exist at a backtracking side, a backtracking client side can carry out composite dispatch only by utilizing the combination of the event information of a target event, the information of a monitored object and the code of a target page, namely, the operation effect corresponding to the previous operation behavior of the user is restored by combining and simulating a plurality of information collected by the monitoring client side. Compared with the mode that the operation effect corresponding to the user operation needs to meet a plurality of preconditions if the operation effect corresponding to the user operation needs to be restored and displayed in the prior art, the method and the device can realize that the simulation operation can be carried out by taking the target information set as the basis of the simulation operation in the subsequent backtracking under the condition that no corresponding event exists or the backtracking side has no application programming interface for realizing the triggered event dispatch, thereby restoring and displaying the operation effect corresponding to the operation of the user, and solving the problem that the conventional backtracking mode cannot restore and display the operation effect corresponding to the certain user operation in the current backtracking process.

Drawings

Fig. 1 is a flowchart of a monitoring method for backtracking user operations according to an embodiment of the present disclosure;

fig. 2 is a flowchart of a user operation backtracking method according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of a mouse moving track according to an embodiment of the present disclosure;

fig. 4 is a schematic diagram of a drop-down frame effect provided in an embodiment of the present application;

fig. 5 is a structural diagram of a listening client according to an embodiment of the present application;

fig. 6 is a structural diagram of a backtracking client according to an embodiment of the present application;

FIG. 7 is a block diagram of a system provided in an embodiment of the present application;

FIG. 8 is a block diagram of an apparatus provided in an embodiment of the present application;

fig. 9 is a block diagram of another apparatus provided in an embodiment of the present application.

Detailed Description

In order to better understand the technical solutions provided by the embodiments of the present specification, the technical solutions of the embodiments of the present specification are described in detail below with reference to the drawings and specific embodiments, and it should be understood that the specific features in the embodiments and examples of the present specification are detailed descriptions of the technical solutions of the embodiments of the present specification, and are not limitations on the technical solutions of the embodiments of the present specification, and the technical features in the embodiments and examples of the present specification may be combined with each other without conflict.

In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element. The term "two or more" includes the case of two or more.

Referring to fig. 1, fig. 1 is a flowchart of a monitoring method for backtracking user operations, which is applied to a monitoring client. As shown in fig. 1, the method comprises the following steps:

step 101, under the condition that a target event occurs to a monitored object related to a target page, acquiring a target information set, wherein the monitored object includes an element in the target page, a mouse in the target page and a size of the target page, and the target information set includes event information of the target event, information of the monitored object and a code of the target page.

In step 101, a user may open a target page at a listening client. In the case of opening the target page, the monitored object may be determined according to the target page. The listening object may include an element in the target page, a mouse in the target page, and a size of the target page. The elements within the target page may be buttons, input boxes, pictures, drop down menus or icons, etc. within the target page.

Whether the target event occurs to the monitoring object can be detected. For example, when the monitored object is a mouse, whether an event occurs in the mouse can be detected; when the monitoring object is an element in the target page, whether the element in the target page has an event or not can be detected; when the monitoring object is the size of the target page, whether an event occurs in the size of the target page can be detected.

It should be noted that, when detecting whether an event occurs to a monitored object, there may be two ways. One way is as follows: directly setting a monitor aiming at a monitored object, and detecting whether the monitored object has an event or not through the monitor corresponding to the monitored object; the other mode is as follows: setting a total listener to listen to global events, that is, listening to all events or a certain kind of events occurring on a target page through the total listener, and then judging whether events occurring on a monitored object exist in all events or a certain kind of events.

In the case that a target event of the monitored object is detected, a target information set can be obtained. The target information set may include event information of a target event, information of a listening object, and code of a target page.

It should be noted that the target events can be divided into various types, for example:

click, a Click event that may collect coordinate information of the clicked element.

Scroll, a Scroll event that can collect the amount of displacement of Scroll height versus Scroll width.

Resize, page size change event, which may record changes in browser window size, etc.

Mouseover, a mouse movement event that may record coordinate information of a mouse.

Mouseenter event, which may record that a mouse entered an element.

Mouseaway, a mouse-out event that may record that the mouse left an element.

Keydown, the keyboard enters an event that is triggered when a key is pressed.

Keyup, a keyboard enters an event that triggers when a key is released.

Cut, a Cut event, which represents a Cut of selected textual content out of the elements selected by the current page activation.

Copy, Copy event, which represents copying selected text content from the element selected by the current page activation to the sticky pad.

Paste event, which indicates pasting the content in the Paste board to the cursor.

Focus, a Focus event, which is used in the Focus of an input element.

And 102, uploading the target information set to a server, so that a backtracking client executes corresponding simulation operation according to the target information set after pulling the target information set from the server, wherein the simulation operation is used for simulating and executing target operation based on the target information set, and the target operation is an operation for triggering the target event.

In step 102, the target information set may be uploaded to the server, so that after the backtracking client pulls the target information set from the server, the corresponding simulation operation is executed according to the target information set. And the simulation operation is used for simulating and executing a target operation based on the target information set, wherein the target operation is an operation for triggering a target event.

It should be noted that, in the prior art, if it is desired to restore and display the operation effect corresponding to the user operation, it is required that the operation effect corresponding to the user operation is required to correspond to an event, and an application programming interface for realizing triggered event dispatch must exist on the backtracking side. The corresponding operation effect exists in each kind of user operation, but not all operation effects correspond to events, that is, not all operation effects correspond to events that can be collected by the application programming interface, or although the listener can listen to events triggered by the user operation, the application programming interface for realizing triggered event dispatch is not provided on the backtracking side. Therefore, in the above two cases, the backtracking side cannot show the operation effect corresponding to the user operation.

In the present application, the target information set may include event information of the target event, information of the listening object, and a code of the target page. Aiming at various user operations, an event does not need to be corresponded to the operation effect corresponding to the user operation, an application programming interface for realizing the triggered event dispatch does not need to exist at a backtracking side, a backtracking client side can carry out composite dispatch only by utilizing the combination of the event information of a target event, the information of a monitored object and the code of a target page, namely, the operation effect corresponding to the previous operation behavior of the user is restored by combining and simulating a plurality of information collected by the monitoring client side. Compared with the mode that the operation effect corresponding to the user operation needs to meet a plurality of preconditions if the operation effect corresponding to the user operation needs to be restored and displayed in the prior art, the method and the device can realize that the simulation operation can be carried out by taking the target information set as the basis of the simulation operation in the subsequent backtracking under the condition that no corresponding event exists or the backtracking side has no application programming interface for realizing the triggered event dispatch, thereby restoring and displaying the operation effect corresponding to the operation of the user, and solving the problem that the conventional backtracking mode cannot restore and display the operation effect corresponding to the certain user operation in the current backtracking process.

In some embodiments, before step 101, further comprising:

In a specific implementation process, a first element located in a preset area in a target page may be determined as a listening object. The preset area may be a whole area of the target page or a partial area included in the target page. The first element may include a button, an input box, a picture, a drop-down menu, or an icon. Thus, since many elements may be contained in the target page, not all elements are what the user wants to listen to. Therefore, only the first element located in a partial region in the target page can be automatically determined as the monitored object, that is, only a partial element located at a specified position in the target page can be determined as the monitored object.

In a specific implementation process, when a plurality of first elements exist in a preset area in a target page, the distance between two adjacent first elements in the plurality of first elements can also be determined. In a case where a distance between two adjacent first elements among the plurality of first elements is smaller than a preset distance, it may be determined that the plurality of first elements are the listening objects. It should be noted that, if a plurality of elements exist in the preset region in the target page and the distance between two adjacent elements in the plurality of elements is smaller than the preset distance, it is indicated that the plurality of elements are sequentially and uniformly arranged in the preset region, and the plurality of elements are likely to be navigation elements. If the navigation element is exactly the element which the user wants to monitor, the method can automatically determine a plurality of first elements which are possibly the navigation element and exist in the preset area in the target page as the monitoring object, and can ensure that the determined monitoring object is exactly the object which the user wants to monitor.

In a specific implementation process, after the target page is opened, the user may further add a listening tag to a second element included in the target page. The second element may be a button, an input box, a picture, a drop-down menu, or an icon. Next, the second element with the listening tag added in the target page may be determined as a listening object. Therefore, the user can set some elements contained in the target page as the monitoring objects in a mode of adding the monitoring tags, namely, the user can select which elements in the target page are set as the monitoring objects according to the needs of the user, and the method is simple in operation steps, convenient and fast.

In a specific implementation process, the monitored object may be a mouse, and at this time, the target event is a mouse movement event. The event information of the target event may include the type of the target event, position information of the mouse during movement, and time information related to the position information. Therefore, the backtracking client can determine and display the mouse moving track according to the code of the target page, the position information of the mouse in the moving process contained in the event information of the target event and the time information related to the position information. The mouse is convenient to use in the backtracking process, and a user can timely know the position of the mouse and the moving trend of the mouse at the current moment.

In a specific implementation process, the monitored object may be the size of a target page, and at this time, the target event is a page size change event. The event information of the target event may include a type of the target event, an occurrence time of the page size change event, and a change size corresponding to the page size change event.

It should be noted that, in the prior art, if it is desired to restore and display the operation effect corresponding to the user operation, it is required that the operation effect corresponding to the user operation is required to correspond to an event, and an application programming interface for realizing triggered event dispatch must exist on the backtracking side. Corresponding operation effects exist in each user operation, but not all operation effects correspond to events. Alternatively, the listener may listen to events triggered by user actions, but does not provide an application programming interface for the triggered event dispatch implementation on the trace-back side. Therefore, in the above two cases, the backtracking side cannot show the operation effect corresponding to the user operation.

In the application, the backtracking client may adjust the size of the preset element according to the occurrence time of the page size change event included in the event information of the target event and the change size corresponding to the page size change event. And the preset element is used for displaying the target page according to the code of the target page. At this time, the operation effect corresponding to the zooming operation of the restored display page can be realized.

In a specific implementation process, the monitored object may be an element in a target page, and at this time, the target events are Mouseenter and Mouseleave. Wherein, Mouseenter is a mouse entry event, which can record that the mouse enters an element; mouseaway is a mouse-out event that can record that a mouse has moved out of an element. The event information of the target event may include the type of the target event, the occurrence time of the mouse-in event, and the occurrence time of the mouse-out event.

In the application, the backtracking client can execute corresponding simulated stay operation at the monitored object in the target page according to the code of the target page, the information of the monitored object, the mouse entering event and the mouse moving-out event so as to show the obtained page effect. At this time, the operation effect corresponding to the original stopping operation can be restored and displayed.

Referring to fig. 2, fig. 2 is a flowchart of a user operation backtracking method provided by the present invention, which is applied to a backtracking client. As shown in fig. 2, the method comprises the following steps:

step 201, a target information set is pulled from a server, wherein the target information set is acquired by a monitoring client and uploaded to the server when the monitoring client detects that a target event occurs to a monitored object related to a target page, and the target information set includes event information of the target event, information of the monitored object and a code of the target page.

In step 201, the backtracking client may pull the target information set from the server. The target information set can be obtained and uploaded to the server side when a target event occurs in a monitored object related to the target page is detected. The target information set may contain event information of the target event, information of the listening object, and code of the target page.

As previously described, the listening object may contain elements within the target page, a mouse within the target page, and a size of the target page. The elements within the target page may be buttons, input boxes, pictures, drop down menus or icons, etc. within the target page. When the monitored object is a mouse, the target event can be a mouse moving event; when the monitored object is an element in the target page, the target event can be a mouse entering event and a mouse moving-out event; when the monitored object is the size of the target page, the target event may be a page size change event.

Step 202, according to the target information set, executing a corresponding simulation operation, and displaying effect data, wherein the simulation operation is used for simulating and executing a target operation based on the target information set, and the target operation is an operation for triggering the target event.

In step 202, the backtracking client may execute a corresponding simulation operation according to the target information set, and display the effect data, where the simulation operation is used to simulate execution of a target operation based on the target information set, and the target operation is an operation that triggers a target event.

In the present application, the target information set may include event information of a target event, information of a listening object, and a code of a target page. Aiming at various user operations, an event does not need to be corresponded to the operation effect corresponding to the user operation, an application programming interface for realizing the triggered event dispatch does not need to exist at a backtracking side, a backtracking client side can carry out composite dispatch only by utilizing the combination of the event information of a target event, the information of a monitored object and the code of a target page, namely, the operation effect corresponding to the previous operation behavior of the user is restored by combining and simulating a plurality of information collected by the monitoring client side. Compared with the mode that the operation effect corresponding to the user operation needs to meet a plurality of preconditions if the operation effect corresponding to the user operation needs to be restored and displayed in the prior art, the method and the device can realize that the simulation operation can be carried out by taking the target information set as the basis of the simulation operation in the subsequent backtracking under the condition that no corresponding event exists or the backtracking side has no application programming interface for realizing the triggered event dispatch, thereby restoring and displaying the operation effect corresponding to the operation of the user, and solving the problem that the conventional backtracking mode cannot restore and display the operation effect corresponding to the certain user operation in the current backtracking process.

In some embodiments, in step 202, further comprising:

and displaying the mouse moving track.

In a specific implementation process, when the target event is determined to be a mouse moving event according to the event information of the target event, the backtracking client can determine and display a mouse moving track according to the code of the target page, the position information of the mouse in the moving process, which is contained in the event information of the target event, and the time information related to the position information. The mouse is convenient to use in the backtracking process, and a user can timely know the position of the mouse and the moving trend of the mouse at the current moment. Fig. 3 is a schematic diagram of a mouse moving track.

In some embodiments, in step 202, further comprising:

In a specific implementation process, when the target event is determined to be a page size change event according to the event information of the target event, the backtracking client may adjust the size of the preset element according to the occurrence time of the page size change event included in the event information of the target event and a change size corresponding to the page size change event, and display the preset element after the size adjustment. And the preset element is used for displaying the target page according to the code of the target page. At this time, the operation effect corresponding to the zooming operation of the restored display page can be realized. Further, the preset element may be an element set under an iframe-based framework.

In some embodiments, in step 202, further comprising:

and displaying the effect data.

It should be noted that, in the prior art, if it is desired to restore and display the operation effect corresponding to the user operation, it is required that the operation effect corresponding to the user operation is required to correspond to an event, and an application programming interface for realizing triggered event dispatch must exist on the backtracking side. Not all operational effects correspond to events. Therefore, in this case, the backtracking side cannot show the operation effect corresponding to the user operation.

In the specific implementation process of the application, when the target event is determined to be a mouse entering event and a mouse moving-out event according to the event information of the target event, the backtracking client may execute a corresponding simulated stay operation at the monitored object in the target page according to the code of the target page, the information of the monitored object, the mouse entering event and the mouse moving-out event, so as to display the obtained effect data. At this time, the operation effect corresponding to the original stopping operation can be restored and displayed.

In a specific implementation process, the absolute value of the time difference between the occurrence time of the mouse entering event and the occurrence time of the mouse moving-out event can be calculated. Then, when the absolute value of the time difference is greater than the preset time, a corresponding simulated stay operation may be executed at the monitored object in the target page according to the code of the target page and the information of the monitored object, so as to obtain effect data. It should be noted that, when the absolute value of the time difference between the occurrence time of the mouse entering event and the occurrence time of the mouse moving-out event is greater than the preset time length, it indicates that the user has controlled the mouse to stay at the monitored object for a certain time, and at this time, the user really wants to see the effect data displayed by the monitored object. If the absolute value of the time difference between the occurrence time of the mouse entering event and the occurrence time of the mouse moving out event is less than the preset time length, the user only controls the mouse to rapidly slide over the monitored object, and the user does not see the requirement of the effect data corresponding to the monitored object. Therefore, the preset time length can be set, and only when the absolute value of the time difference between the occurrence time of the mouse entering event and the occurrence time of the mouse moving-out event is greater than the preset time length, the corresponding simulated stay operation can be executed at the monitored object. Because the target page can trigger corresponding effect data at the corresponding position where the mouse stays based on the code of the target page, the corresponding effect data can be obtained and displayed only by performing simulated stay operation at the monitored object on the target page based on the code of the target page, namely performing operation similar to the original stay operation. The corresponding simulation stay operation can be avoided being executed at each monitored object stroked by the mouse of the user, and the computing resources are saved.

Further, if the user performs a series of other operations in the target page before the occurrence time of the mouse entry event, a series of other events may be triggered accordingly, and each other event corresponds to time information and position information. At this time, the backtracking client may calculate a position distance and a time difference between two other events adjacent to each other, and may further calculate a moving speed of the mouse in the process of moving from the occurrence position of one other event to the occurrence position of another other event adjacent to each other. If the user wants to control the mouse to stay on an element in the target page, the moving speed of the mouse in the process of moving to the element is reduced. Therefore, the mouse moving speed between any two adjacent other events can be compared in the process of approaching the element by the mouse. If the mouse moving speed between any two adjacent events at any position is judged to show a gradually reduced trend, which indicates that the user really wants to see the effect data displayed by the element, at the moment, aiming at the element, if a mouse entering event and a mouse moving-out event are detected, corresponding simulated stopping operation can be executed at the element to obtain and display the effect data; if it is determined that the mouse movement speed between any two adjacent events does not show a gradually decreasing trend but shows a relatively uniform trend, it indicates that the user does not really see the requirement of the effect data shown by the element, and at this time, for the element, even if the event that the user controls the mouse to rapidly move across the element is detected, the user does not really have a will to stay at the element. At which point the corresponding simulated dwell operation may not be performed at that element. Therefore, the corresponding simulation stay operation can be avoided being executed at each monitored object stroked by the mouse of the user, and the computing resource is saved.

In a specific implementation process, the page effect may be pop window effect data, drop-down frame effect data, or flicker effect data. The pop-up window effect data can be a window popped up at the monitored object for displaying information related to the monitored object; the drop-down box effect data may provide options for the user to select; the flicker effect data may be to exhibit a flicker effect at the listening object. Fig. 4 is a schematic diagram of a pull-down box effect. In fig. 4, the mouse is moved to the position of the avatar, i.e., the drop-down box effect is triggered. The drop-down box displays "personal hub", "account setting", "account switching", and "log out".

As described in the previous embodiment, the target events may be divided into various types. For keyboard input events, such as Keydown and Keyup, if the input content is a pure letter input, it can be served separately; if no input content is available, only simple shortcut key input is available, and the input content can be independently distributed; if there is both pure alphabetic input and shortcut key input, the assignment may be ignored. For Cut, a Cut event, dispatch can be omitted; dispatch and the like may also be ignored for Copy events.

As can be seen from the foregoing technical solutions, the user operation backtracking method provided in the embodiments of the present invention is applied to a backtracking client, and pulls a target information set from a server, where the target information set is obtained by a monitoring client by opening a target page and is uploaded to the server when a target event occurs in a monitored object related to the target page, and the target information set includes event information of the target event, information of the monitored object, and a code of the target page; and executing corresponding simulation operation according to the target information set, wherein the simulation operation is used for simulating and executing target operation based on the target information set, and the target operation is an operation for triggering the target event. Thus, the target information set may include event information of the target event, information of the interception object, and code of the target page. Aiming at various user operations, an event does not need to be corresponded to the operation effect corresponding to the user operation, an application programming interface for realizing the triggered event dispatch does not need to exist at a backtracking side, a backtracking client side can carry out composite dispatch only by utilizing the combination of the event information of a target event, the information of a monitored object and the code of a target page, namely, the operation effect corresponding to the previous operation behavior of the user is restored by combining and simulating a plurality of information collected by the monitoring client side. Compared with the mode that the operation effect corresponding to the user operation needs to meet a plurality of preconditions if the operation effect corresponding to the user operation needs to be restored and displayed in the prior art, the method and the device can realize that the simulation operation can be carried out by taking the target information set as the basis of the simulation operation in the subsequent backtracking under the condition that no corresponding event exists or the backtracking side has no application programming interface for realizing the triggered event dispatch, thereby restoring and displaying the operation effect corresponding to the operation of the user, and solving the problem that the conventional backtracking mode cannot restore and display the operation effect corresponding to the certain user operation in the current backtracking process.

Referring to fig. 5, fig. 5 is a structural diagram of a listening client according to the present invention. As shown in fig. 5, the listening client includes an obtaining module 501 and an uploading module 502, where:

an obtaining module 501, configured to obtain a target information set when a target event occurs in a monitored object related to a target page, where the monitored object includes an element in the target page, a mouse in the target page, and a size of the target page, and the target information set includes event information of the target event, information of the monitored object, and a code of the target page;

an uploading module 502, configured to upload the target information set to a server, so that after the backtracking client pulls the target information set from the server, a corresponding simulation operation is executed according to the target information set, where the simulation operation is used to simulate and execute a target operation based on the target information set, and the target operation is an operation that triggers the target event.

The monitoring client can implement each process implemented by the monitoring client in the method embodiment of fig. 1, and is not described herein again to avoid repetition. And, the target information set may include event information of the target event, information of the interception object, and code of the target page. Aiming at various user operations, an event does not need to be corresponded to the operation effect corresponding to the user operation, an application programming interface for realizing the triggered event dispatch does not need to exist at a backtracking side, a backtracking client side can carry out composite dispatch only by utilizing the combination of the event information of a target event, the information of a monitored object and the code of a target page, namely, the operation effect corresponding to the previous operation behavior of the user is restored by combining and simulating a plurality of information collected by the monitoring client side. Compared with the mode that the operation effect corresponding to the user operation needs to meet a plurality of preconditions if the operation effect corresponding to the user operation needs to be restored and displayed in the prior art, the method and the device can realize that the simulation operation can be carried out by taking the target information set as the basis of the simulation operation in the subsequent backtracking under the condition that no corresponding event exists or the backtracking side has no application programming interface for realizing the triggered event dispatch, thereby restoring and displaying the operation effect corresponding to the operation of the user, and solving the problem that the conventional backtracking mode cannot restore and display the operation effect corresponding to the certain user operation in the current backtracking process.

Referring to fig. 6, fig. 6 is a structural diagram of a backtracking client according to the present invention. As shown in fig. 6, the backtracking client includes a pulling module 601 and an executing module 602, where:

a pulling module 601, configured to pull a target information set from a server, where the target information set is obtained by a monitoring client when detecting that a target event occurs in a monitored object related to a target page and is uploaded to the server, and the target information set includes event information of the target event, information of the monitored object, and a code of the target page;

an executing module 602, configured to execute a corresponding simulation operation according to the target information set, and display effect data, where the simulation operation is used to simulate, based on the target information set, an execution target operation, and the target operation is an operation that triggers the target event.

The backtracking client can implement each process implemented by the backtracking client in the method embodiment of fig. 2, and is not described herein again to avoid repetition. And, the target information set may include event information of the target event, information of the interception object, and code of the target page. Aiming at various user operations, an event does not need to be corresponded to the operation effect corresponding to the user operation, an application programming interface for realizing the triggered event dispatch does not need to exist at a backtracking side, a backtracking client side can carry out composite dispatch only by utilizing the combination of the event information of a target event, the information of a monitored object and the code of a target page, namely, the operation effect corresponding to the previous operation behavior of the user is restored by combining and simulating a plurality of information collected by the monitoring client side. Compared with the mode that the operation effect corresponding to the user operation needs to meet a plurality of preconditions if the operation effect corresponding to the user operation needs to be restored and displayed in the prior art, the method and the device can realize that the simulation operation can be carried out by taking the target information set as the basis of the simulation operation in the subsequent backtracking under the condition that no corresponding event exists or the backtracking side has no application programming interface for realizing the triggered event dispatch, thereby restoring and displaying the operation effect corresponding to the operation of the user, and solving the problem that the conventional backtracking mode cannot restore and display the operation effect corresponding to the certain user operation in the current backtracking process.

Referring to fig. 7, fig. 7 is a block diagram of a system provided by the present invention. The system 700 includes a server 702, a monitoring client 701 that implements the monitoring method for backtracking the user operation in the foregoing embodiment, and a backtracking client 703 that implements the user operation backtracking method in the foregoing embodiment.

The server 702 is configured to receive a target information set uploaded by the monitoring client 701.

An embodiment of the present invention provides a storage medium, on which a program is stored, where the program, when executed by a processor, implements a monitoring method for tracing back a user operation and a user operation tracing back method.

The embodiment of the invention provides a processor, which is used for running a program, wherein a monitoring method for backtracking user operation and a user operation backtracking method are executed when the program runs.

An embodiment of the present invention provides a device 80, as shown in fig. 8, the device includes at least one processor 801, at least one memory 802 connected to the processor, and a bus 803; the processor 801 and the memory 802 complete communication with each other through the bus 803; the processor 801 is configured to call program instructions in the memory to perform the above-described snooping method for backtracking user operations.

The device herein may be a server, a PC, a PAD, a mobile phone, etc.

The present application further provides a computer program product adapted to perform a program for initializing the following method steps when executed on a flow management device: under the condition that a target event occurs to a monitoring object related to a target page, acquiring a target information set, wherein the monitoring object comprises elements in the target page, a mouse in the target page and the size of the target page, and the target information set comprises event information of the target event, information of the monitoring object and codes of the target page; uploading the target information set to a server, so that after a backtracking client is pulled from the server to the target information set, a corresponding simulation operation is executed according to the target information set, wherein the simulation operation is used for simulating and executing a target operation based on the target information set, and the target operation is an operation for triggering the target event.

Further, before the step of obtaining the target information set, the method further includes:

Further, the determining that the first element located in the preset area in the target page is the monitored object includes:

Further, the monitoring object is a mouse, the target event is a mouse moving event, and the event information of the target event includes the type of the target event, the position information of the mouse in the moving process, and the time information related to the position information.

Further, the monitoring object is the size of the target page, the target event is a page size change event, and the event information of the target event includes the type of the target event, the occurrence time of the page size change event, and the change size corresponding to the page size change event.

Further, the monitored object is an element in the target page, the target events are a mouse entry event and a mouse exit event, and the event information of the target event includes the type of the target event, the occurrence time of the mouse entry event and the occurrence time of the mouse exit event.

An embodiment of the present invention provides an apparatus 90, as shown in fig. 9, the apparatus includes at least one processor 901, at least one memory 902 connected to the processor, and a bus 903; the processor 901 and the memory 902 complete communication with each other through the bus 903; the processor 901 is used to call the program instructions in the memory to execute the above-mentioned user operation backtracking method.

The device herein may be a server, a PC, a PAD, a mobile phone, etc.

The present application further provides a computer program product adapted to perform a program for initializing the following method steps when executed on a flow management device: pulling a target information set from a server, wherein the target information set is acquired by a monitoring client and uploaded to the server when a target event occurs in a monitoring object related to a target page, and the target information set comprises event information of the target event, information of the monitoring object and a code of the target page; and executing corresponding simulation operation according to the target information set, and displaying effect data, wherein the simulation operation is used for simulating and executing target operation based on the target information set, and the target operation is the operation for triggering the target event.

Further, the executing the corresponding simulation operation according to the target information set and displaying the effect data includes:

and displaying the mouse moving track.

and displaying the effect data.

Further, the executing, according to the code of the target page, the information of the monitored object, the mouse entry event, and the mouse exit event, a corresponding simulated staying operation at the monitored object in the target page to obtain effect data includes:

Further, the effect data is pop-up window effect data, drop-down frame effect data or flicker effect data.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable flow management apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable flow management apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a device includes one or more processors (CPUs), memory, and a bus. The device may also include input/output interfaces, network interfaces, and the like.

The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip. The memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A monitoring method for backtracking user operation is applied to a monitoring client, and is characterized in that the method comprises the following steps:

2. The method of claim 1, wherein prior to the step of obtaining a target set of information, the method further comprises:

3. The method of claim 2, wherein the determining that the first element located in the preset region in the target page is the listening object comprises:

4. The method according to any one of claims 1 to 3, wherein the monitored object is a mouse, the target event is a mouse movement event, and the event information of the target event comprises the type of the target event, the position information of the mouse during movement and time information related to the position information.

5. The method according to any one of claims 1 to 3, wherein the monitored object is the size of the target page, the target event is a page size change event, and the event information of the target event includes the type of the target event, the occurrence time of the page size change event, and the change size corresponding to the page size change event.

6. The method of any one of claims 1 to 3, wherein the interception object is an element in the target page, the target events are a mouse-in event and a mouse-out event, and the event information of the target events comprises the type of the target event, the occurrence time of the mouse-in event, and the occurrence time of the mouse-out event.

7. A user operation backtracking method is applied to a backtracking client, and is characterized by comprising the following steps:

8. The method of claim 7, wherein said performing corresponding simulation operations and displaying effect data according to the set of target information comprises:

and displaying the mouse moving track.

9. The method of claim 7, wherein said performing corresponding simulation operations and displaying effect data according to the set of target information comprises:

10. The method of claim 7, wherein said performing corresponding simulation operations and displaying effect data according to the set of target information comprises:

and displaying the effect data.

11. The method of claim 10, wherein the performing a corresponding simulated hover operation at the listening object within the target page based on the code of the target page, the information of the listening object, the mouse-in event, and the mouse-out event to obtain effect data comprises:

12. The method of claim 10 or 11, wherein the effect data is popup effect data, drop-down box effect data, or blinking effect data.

13. A listening client, comprising:

14. A backtracking client, comprising:

15. A storage medium, characterized in that the storage medium comprises a stored program, wherein when the program runs, the device on which the storage medium is located is controlled to execute the monitoring method for backtracking user operation according to any one of claims 1 to 6, and execute the user operation backtracking method according to any one of claims 7 to 12.

16. An apparatus comprising at least one processor, and at least one memory, bus connected to the processor; the processor and the memory complete mutual communication through the bus; the processor is configured to call the program instructions in the memory, execute the snooping method for backtracking user operations according to any one of claims 1 to 6, and execute the user operation backtracking method according to any one of claims 7 to 12.

17. A system, comprising a server, a listening client implementing the listening method for backtracking user operations according to any one of claims 1 to 6, and a backtracking client implementing the user operation backtracking method according to any one of claims 7 to 12;