CN112182473A - Page operation behavior playback method and device, computer equipment and storage medium - Google Patents

Page operation behavior playback method and device, computer equipment and storage medium Download PDF

Info

Publication number
CN112182473A
CN112182473A CN202011379400.XA CN202011379400A CN112182473A CN 112182473 A CN112182473 A CN 112182473A CN 202011379400 A CN202011379400 A CN 202011379400A CN 112182473 A CN112182473 A CN 112182473A
Authority
CN
China
Prior art keywords
page
browser
log file
file
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011379400.XA
Other languages
Chinese (zh)
Other versions
CN112182473B (en
Inventor
丁光现
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Weikun Shanghai Technology Service Co Ltd
Original Assignee
Weikun Shanghai Technology Service Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Weikun Shanghai Technology Service Co Ltd filed Critical Weikun Shanghai Technology Service Co Ltd
Priority to CN202011379400.XA priority Critical patent/CN112182473B/en
Publication of CN112182473A publication Critical patent/CN112182473A/en
Application granted granted Critical
Publication of CN112182473B publication Critical patent/CN112182473B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
    • G06F16/1815—Journaling file systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/74—Browsing; Visualisation therefor
    • G06F16/743—Browsing; Visualisation therefor a collection of video files or sequences
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60—Protecting data
    • G06F21/602—Providing cryptographic facilities or services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60—Protecting data
    • G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/06—Asset management; Financial planning or analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/08—Insurance

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Data Mining & Analysis (AREA)
  • Development Economics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Economics (AREA)
  • Bioethics (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • General Business, Economics & Management (AREA)
  • Computer Security & Cryptography (AREA)
  • Technology Law (AREA)
  • Strategic Management (AREA)
  • Marketing (AREA)
  • Human Computer Interaction (AREA)
  • Operations Research (AREA)
  • Human Resources & Organizations (AREA)
  • Game Theory and Decision Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Debugging And Monitoring (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the application discloses a page operation behavior playback method and device, computer equipment and a storage medium. The method comprises the following steps: acquiring an operation behavior of a user on a page of a first browser; generating at least one log file according to the operation behavior, wherein the page information corresponding to different log files is different; loading a page corresponding to the at least one log file in a second browser, and recording a screen of the page corresponding to the at least one log file through a screen recording function of the second browser to generate a video file; and playing the video file to play back the operation behavior of the user on the page of the first browser. The method and the device for playing back the operation behavior of the user on the page are added.

Description

Page operation behavior playback method and device, computer equipment and storage medium
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a method and an apparatus for playing back a page operation behavior, a computer device, and a storage medium.
Background
In the high-risk and strong-supervision financial fields such as insurance, private fund raising and the like, the investment behavior of a user in the investment process needs to be recorded so as to deal with the later supervision examination, judicial evidence-raising and other processes.
Currently, a playback (rrweb) component records a sequence of operations of a user on a page as log data, and a playback module of the rrweb plays back the serialized log data at a later stage, so that a technical basis is provided for screen recording and visual playback of investment behaviors of the user.
However, the playback module of the rrweb component plays back the log data, and the playback can be completed in the browser by means of other resource files in the browser, such as js or css resource files. Therefore, when other resource files in the browser are changed or updated, the log data serialized through the rrweb cannot be played back before, and the rrweb can reply the log data only by means of a specific playing component of the browser.
Therefore, the mode of playing back the investment behavior of the user through the rrweb is single, the requirement on the playback time is strict, and the monitoring precision of the investment behavior is low.
Disclosure of Invention
The embodiment of the application provides a page operation behavior playback method and device, computer equipment and a storage medium. By generating the video file, the manner of playback of the investment behavior of the user can be increased, and the supervision accuracy can be improved.
In a first aspect, an embodiment of the present application provides a page operation behavior playback method, including:
acquiring an operation behavior of a user on a page of a first browser;
generating at least one log file according to the operation behavior, wherein the page information corresponding to different log files is different;
loading a page corresponding to the at least one log file in a second browser, and recording a screen of the page corresponding to the at least one log file through a screen recording function of the second browser to generate a video file;
and playing the video file to play back the operation behavior of the user on the page of the first browser.
In a second aspect, an embodiment of the present application provides a page operation behavior playback device, including:
the acquisition unit is used for acquiring the operation behavior of a user on the page of the first browser;
the processing unit is used for generating at least one log file according to the operation behavior, and the page information corresponding to different log files is different;
the processing unit is further configured to load a page corresponding to the at least one log file in a second browser, and record a screen of the page corresponding to the at least one log file through a screen recording function of the second browser to generate a video file;
the processing unit is further configured to play the video file to play back an operation behavior of the user on a page of the first browser.
In a third aspect, embodiments provide a computer device comprising a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, the programs including instructions for performing the steps in the method according to the first aspect.
In a fourth aspect, embodiments of the present application provide a computer-readable storage medium, which stores a computer program, where the computer program makes a computer execute the method according to the first aspect.
In a fifth aspect, embodiments of the present application provide a computer program product comprising a non-transitory computer-readable storage medium storing a computer program, the computer being operable to cause a computer to perform the method according to the first aspect.
The embodiment of the application has the following beneficial effects:
it can be seen that, in the embodiment of the application, the operation behaviors of the user on the page in the investment process are serialized into the log file, the log file is played back, and the screen recording function is started in the playback process, so that a video file for recording the operation behaviors of the user in the investment process is generated. The playing of the video file does not need to depend on a special browser and a playback module, so that the mode of playing back the investment behavior of the user is increased, the influence of the resource change of the browser is avoided, the investment behavior of the user at any time can be played back, and the monitoring precision is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a page operation behavior playback method according to an embodiment of the present application;
fig. 2 is a schematic flowchart of another method for replaying page operation behaviors according to an embodiment of the present application;
fig. 3 is a schematic flowchart of another method for replaying page operation behaviors according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a computer device according to an embodiment of the present application;
fig. 5 is a block diagram illustrating functional units of a device for playing back page operation behaviors according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," "third," and "fourth," etc. in the description and claims of this application and in the accompanying drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, result, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
Referring to fig. 1, fig. 1 is a schematic flowchart of a page operation behavior playback method according to an embodiment of the present application. The method comprises the following steps:
101: and acquiring the operation behavior of the user on the page of the first browser.
Wherein the operation behavior is the investment behavior of the user in the investment process.
Illustratively, the operation behavior of the user on the page of the first browser can be obtained through the front end, for example, the operation behavior of the user on the page of the first browser is monitored through the rrweb. Wherein the operation behavior comprises a click behavior on a page, a scroll behavior of a page view, an information input behavior, and the like.
102: and generating at least one log file according to the operation behavior, wherein the page information corresponding to different log files is different.
Illustratively, an initial webpage opened in the first browser by a user is detected, and page information of the initial webpage is serialized into a first log file through an rrweb, wherein the page information comprises a page structure and page content; then, the change of the current page relative to the first browser is monitored in real time through the rrweb, and the content of the change is serialized into a new log file, so that at least one log file is obtained.
Specifically, when a user opens a page in a first browser or app and jumps to a page (e.g., h5 page) of the first browser, an initial page is opened, and the rrweb records all information on the dom node of the initial page, where the recorded information is page information corresponding to the initial page. Then, serializing all information on the dom node into a first log file, wherein the first log file contains the page structure of the initial page and all content information (namely page content) on the page; and then, monitoring the change of the dom node of the current page of the first browser in real time through the rrweb, and serializing the dom node which changes relative to the current page each time into a second log file under the condition of monitoring the change of the dom node of the current page each time. And finally, forming the at least one log file by the first log file and the second log file serialized with each dom node change.
Wherein the change of the page of the first browser may be caused by a change of a page structure of the page and/or a change of page information. Illustratively, the initial page change includes DOM node change (creation and destruction of nodes, attribute change of DOM nodes, text change), mouse interaction, page or page element scrolling, current page window size change, user input, mouse movement (specifically, the visual position of the mouse), for example, when a user clicks a button, the action is recorded as a second log file.
It should be understood that although the second log file records the changed content of each time relative to the current page, in the process of performing deserialization on the second log file, the deserialization is performed in combination with the page information of the previous page, and then the page corresponding to the second log file is a different page from the previous page, that is, the page information corresponding to the different log files in the at least one log file is different.
In addition, a time stamp is added to the log file in the process of serializing the log file, and the time stamp is used for recording the generation time of the log file, namely the occurrence time of the page corresponding to the log file, so that the playback can be performed according to the occurrence time of each log file.
Where serializing page information into a log file via the rrweb is prior art and deserializing a log file into pages is also prior art and will not be described further.
103: and loading a page corresponding to the at least one log file in a second browser, and recording a screen of the page corresponding to the at least one log file through a screen recording function of the second browser to generate a video file.
For example, when it is detected that the operation behavior of the user on the first browser is ended, the backend may open a second browser through a plug-in (e.g., puppeteer component), load a page corresponding to the at least one log file through the second browser, and start a screen recording function of the second browser to record a screen of the page corresponding to the at least one log file, so as to generate a video file.
Illustratively, the loading, by the back end, of the page corresponding to the at least one log file through the second browser is to use a playback module of the rrweb to play back the page corresponding to each log file in the at least one log file. Specifically, the back end performs deserialization on each log file in the at least one log file to obtain a page corresponding to each log file; and then, forming a complete page by the page corresponding to each log file according to the generation time of each log file. And under the condition that the complete page is loaded, starting a screen recording function of a second browser, recording the complete page through the screen recording function, rolling the complete page in the recording process, and under the condition that the last frame of the complete page is recorded, finishing the recording to generate the video file.
In addition, in the process of recording the complete page, only the effective information in the complete page can be recorded, wherein the effective information is all the information except the head information in the complete page. Because the header information is link information of a page corresponding to each log file or other opened windows, the header information is invalid for analysis of investment behavior, and in order to reduce the memory of the generated video file, the header information may not be recorded.
104: and playing the video file to play back the operation behavior of the user on the page of the first browser.
Illustratively, the page operation behavior playback device can play the video file through a self-contained play component to play back the operation behavior of the user on the page of the first browser. Of course, the page operation behavior playback device may also send the video file to other terminal devices, for example, a terminal device of a regulatory authority, and the other terminal devices play the video file and play back the operation behavior of the user on the page of the first browser.
It can be seen that, in the embodiment of the application, the operation behaviors of the user on the page in the investment process are serialized into the log file, the log file is played back, and the screen recording function is started in the playback process, so that a video file for recording the operation behaviors of the user in the investment process is generated. The playing of the video file does not need to depend on a special browser and a playback module, so that the mode of playing back the investment behavior of the user is increased, and the monitoring precision of the investment behavior is improved.
In some possible embodiments, before playing the video file, the method further comprises: if the video file is encrypted, the video file can be played only by decrypting the video file by using the identity information under the condition of playing the video file.
Illustratively, in the case where the user logs in to the first browser, the video file may be encrypted using login information of the user, wherein the login information includes at least one of: the user's mobile phone number, nickname or login password; and under the condition that the user logs in the first browser, prompting the user to input identity information, carrying out Hash transformation on the identity information input by the user, and encrypting the video file by using information obtained by Hash transformation.
Therefore, the video file is encrypted, so that the transmission safety of the video file can be improved in the process of transmitting the video file, and the video file cannot be tampered.
In some possible embodiments, the implementation process of playing the video file to play back the operation behavior of the user on the page of the first browser may further be: obtaining the memory size of each log file in at least one log file, wherein the memory size of each log file is used for representing the importance degree of each log file; determining a first number of target log files in the at least one log file according to the memory size of each log file; acquiring video frames corresponding to the first number of target log files in the video file; and forming a new video file by the video frames corresponding to the first number of target log files, and playing the new video file to play back the operation behavior of the user on the page of the first browser.
Illustratively, since the investment behavior is complex during the investment process, the change of the page is complicated, and the generated video file is relatively large. Therefore, the memory size of the log file reflects the change degree of the page to a certain extent, that is, the memory size of each log file is used for representing the importance degree of each log file. For example, the change of the page information of the first page is large relative to the initial page, for example, the first page is obtained by skipping to the initial page, which means that the first page is an important node in the investment process of a user. Therefore, the log files of the first quantity determined according to the size of the memory are the key nodes of the first quantity in the investment process of the user. Therefore, in the process of playing back the video, the key nodes with the first number can be played back, so that the playback speed is increased, and the user experience is improved.
In some possible embodiments, after generating the video file, the method further comprises:
adding a timestamp and an effective duration to the video file;
determining the effective date of the video file according to the timestamp and the effective duration;
and deleting the video file when the video file reaches the effective date.
The effective duration may be determined according to the investment amount of the user in the current investment process, for example, the larger the investment is, the longer the effective duration is.
Therefore, when the video file reaches the effective date, the video file can be deleted, so that the storage space is saved, and the video file corresponding to the operation behaviors of other users can be saved.
In some possible embodiments, before playing the video file, the method further comprises:
determining node information of the user in the investment process according to each log file;
determining a video segment corresponding to each log file in the video file, and using the node information of the user corresponding to each log file in the investment process as a video theme added to the video segment corresponding to each log file, for example, adding the video theme in a bullet screen form.
It can be seen that in the embodiment, the video theme is added to the video file, so that the node information of the user in the investment process can be clearly known in the playback process, and the viewing experience of the user is improved.
Referring to fig. 2, fig. 2 is a schematic flowchart of another page operation behavior playback method according to an embodiment of the present application. The same contents in this embodiment as those in the embodiment shown in fig. 1 will not be repeated here. This embodiment comprises the steps of:
201: and acquiring the operation behavior of the user on the page of the first browser.
202: and generating at least one log file according to the operation behavior, wherein the page information corresponding to different log files is different.
203: and loading a page corresponding to the at least one log file in a second browser, and recording a screen of the page corresponding to the at least one log file through a screen recording function of the second browser to generate a video file.
204: and encrypting the video file by using the identity information of the user.
205: and decrypting the video file by using the identity information of the user, and playing the decrypted video file.
It can be seen that, in the embodiment of the application, the operation behaviors of the user on the page in the investment process are serialized into the log file, the log file is played back, and the screen recording function is started in the playback process, so that a video file for recording the operation behaviors of the user in the investment process is generated. The playing of the video file does not need to depend on a special browser and a playback module, so that the mode of playing back the investment behavior of the user is increased, and the monitoring precision of the investment behavior is improved. In addition, the video file is encrypted, so that the safety of the video file in the transmission process can be ensured.
Referring to fig. 3, fig. 3 is a schematic flowchart of another page operation behavior playback method according to an embodiment of the present application. The same contents in this embodiment as those in the embodiment shown in fig. 1 and 2 will not be repeated here. This embodiment comprises the steps of:
301: and acquiring the operation behavior of the user on the page of the first browser.
302: and generating at least one log file according to the operation behavior, wherein the page information corresponding to different log files is different.
303: and loading a page corresponding to the at least one log file in a second browser, and recording a screen of the page corresponding to the at least one log file through a screen recording function of the second browser to generate a video file.
304: and acquiring the memory size of each log file in the at least one log file, wherein the memory size of each log file is used for representing the importance degree of each log file.
305: and determining a first number of target log files in the at least one log file according to the memory size of each log file.
306: and acquiring video frames corresponding to the first number of target log files in the video file.
307: and forming a new video file by the video frames corresponding to the first number of target log files, and playing the new video file to play back the operation behavior of the user on the page of the first browser.
It can be seen that, in the embodiment of the application, the operation behaviors of the user on the page in the investment process are serialized into the log file, the log file is played back, and the screen recording function is started in the playback process, so that a video file for recording the operation behaviors of the user in the investment process is generated. The playing of the video file does not need to depend on a special browser and a playback module, so that the mode of playing back the investment behavior of the user is increased, and the monitoring precision of the investment behavior is improved. In addition, a new video file is generated according to the memory size of the log file, so that the playback efficiency of the operation behavior of the user can be improved and the viewing experience of the user can be improved under the condition of not losing information.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a computer device according to an embodiment of the present disclosure. As shown in fig. 4, a computer device 400 includes a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, the programs including instructions for performing the steps of:
acquiring an operation behavior of a user on a page of a first browser;
generating at least one log file according to the operation behavior, wherein the page information corresponding to different log files is different;
loading a page corresponding to the at least one log file in a second browser, and recording a screen of the page corresponding to the at least one log file through a screen recording function of the second browser to generate a video file;
and playing the video file to play back the operation behavior of the user on the page of the first browser.
In some possible embodiments, the program is specifically configured to execute the following steps in generating at least one log file according to the operation behavior:
serializing all document object model nodes corresponding to an initial page into a first log file through a replay recording component rrweb of the first browser, wherein the initial page is a page opened for the first time when entering the first browser;
monitoring a document object model node of a current page of the first browser in real time through the rrweb, and serializing the document object model node which changes relative to the current page each time into a second log file under the condition that the document object model node of the current page changes each time;
and composing the first log file and the second log file serialized for each change into the at least one log file.
In some possible embodiments, the log file includes a generation time of the log file, and in terms of loading a page corresponding to the at least one log file in a second browser, and recording a screen of the page corresponding to the at least one log file by using a screen recording function of the second browser to generate a video file, the program is specifically configured to execute instructions of the following steps:
deserializing each log file to obtain a page corresponding to each log file;
and according to the sequence of the generation time of each log file, forming a complete page by the page corresponding to each log file, performing rolling playing on the complete page, starting a screen recording function of the second browser, and recording the screen of the complete page to generate a video file.
In some possible embodiments, in the aspect of starting the screen recording function of the second browser to record the screen of the complete page and generate the video file, the program is specifically configured to execute the following instructions:
and starting a screen recording function of the second browser to record the effective information in the complete page to generate a video file, wherein the effective information is all the information except the head information in the complete page.
In some possible embodiments, before playing the video file, the program includes instructions for further performing the steps of:
encrypting the video file by using the identity information of the user;
in terms of playing the video file, the program is specifically configured to execute the following instructions:
and decrypting the video file by using the identity information of the user, and playing the decrypted video file.
In some possible embodiments, the program is specifically configured to, in encrypting the video file using the identity information, execute the following steps:
in the case that the user logs in the first browser, encrypting the video file by using login information of the user, wherein the login information comprises at least one of the following: the user's mobile phone number, nickname or login password;
and under the condition that the user does not log in the first browser, prompting the user to input identity information, carrying out Hash transformation on the identity information input by the user, and encrypting the video file by using information obtained by Hash transformation.
In some possible embodiments, in playing the video file to play back the user's operation behavior on the page of the first browser, the program is specifically configured to execute the following steps:
obtaining the memory size of each log file in the at least one log file, wherein the memory size of each log file is used for representing the importance degree of each log file;
determining a first number of target log files in the at least one log file according to the memory size of each log file;
acquiring video frames corresponding to the first number of target log files in the video file;
and forming a new video file by the video frames corresponding to the first number of target log files, and playing the new video file to play back the operation behavior of the user on the page of the first browser.
Referring to fig. 5, fig. 5 is a block diagram illustrating functional units of a device for playing back page operation behaviors according to an embodiment of the present application. The page operation behavior playback apparatus 500 includes: an acquisition unit 501 and a processing unit 502, wherein:
an obtaining unit 501, configured to obtain an operation behavior of a user on a page of a first browser;
a processing unit 502, configured to generate at least one log file according to the operation behavior, where page information corresponding to different log files is different;
the processing unit 502 is further configured to load a page corresponding to the at least one log file in a second browser, and record a screen of the page corresponding to the at least one log file through a screen recording function of the second browser, so as to generate a video file;
the processing unit 502 is further configured to play the video file to play back an operation behavior of the user on a page of the first browser.
In some possible embodiments, in terms of generating at least one log file according to the operation behavior, the processing unit 502 is specifically configured to:
serializing all document object model nodes corresponding to an initial page into a first log file through a replay recording component rrweb of the first browser, wherein the initial page is a page opened for the first time when entering the first browser;
monitoring a document object model node of a current page of the first browser in real time through the rrweb, and serializing the document object model node which changes relative to the current page each time into a second log file under the condition that the document object model node of the current page changes each time;
and composing the first log file and the second log file serialized for each change into the at least one log file.
In some possible embodiments, the log file includes a generation time of the log file, and in terms of loading a page corresponding to the at least one log file in a second browser, and recording a screen of the page corresponding to the at least one log file through a screen recording function of the second browser to generate a video file, the processing unit 502 is specifically configured to:
deserializing each log file to obtain a page corresponding to each log file;
and according to the sequence of the generation time of each log file, forming a complete page by the page corresponding to each log file, performing rolling playing on the complete page, starting a screen recording function of the second browser, and recording the screen of the complete page to generate a video file.
In some possible embodiments, in terms of starting the screen recording function of the second browser to record the complete page and generate a video file, the processing unit 502 is specifically configured to:
and starting a screen recording function of the second browser to record the effective information in the complete page to generate a video file, wherein the effective information is all the information except the head information in the complete page.
In some possible embodiments, before playing the video file, the processing unit 502 is further configured to:
encrypting the video file by using the identity information of the user;
in terms of playing the video file, the program is specifically configured to execute the following instructions:
and decrypting the video file by using the identity information of the user, and playing the decrypted video file.
In some possible embodiments, in terms of encrypting the video file using the identity information, the processing unit 502 is specifically configured to:
in the case that the user logs in the first browser, encrypting the video file by using login information of the user, wherein the login information comprises at least one of the following: the user's mobile phone number, nickname or login password;
and under the condition that the user does not log in the first browser, prompting the user to input identity information, carrying out Hash transformation on the identity information input by the user, and encrypting the video file by using information obtained by Hash transformation.
In some possible embodiments, in terms of playing the video file to play back the operation behavior of the user on the page of the first browser, the processing unit 502 is specifically configured to:
obtaining the memory size of each log file in the at least one log file, wherein the memory size of each log file is used for representing the importance degree of each log file;
determining a first number of target log files in the at least one log file according to the memory size of each log file;
acquiring video frames corresponding to the first number of target log files in the video file;
and forming a new video file by the video frames corresponding to the first number of target log files, and playing the new video file to play back the operation behavior of the user on the page of the first browser.
It should be understood that the page operation behavior playback device in the present application may include a smart Phone (e.g., an Android Phone, an iOS Phone, a Windows Phone, etc.), a tablet computer, a palm computer, a notebook computer, a Mobile Internet device MID (MID), a wearable device, or the like. The above page operation behavior playback device is merely an example, and is not exhaustive, and includes but is not limited to the above page operation behavior playback device. In practical applications, the page operation behavior playback apparatus may further include: intelligent vehicle-mounted terminal, computer equipment and the like.
Embodiments of the present application further provide a computer storage medium, where the computer storage medium stores a computer program, and the computer program is executed by a processor to implement part or all of the steps of any one of the page operation behavior playback methods as described in the above method embodiments.
Embodiments of the present application also provide a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute part or all of the steps of any one of the page operation behavior playback methods as described in the above method embodiments.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are exemplary embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may be implemented in the form of a software program module.
The integrated units, if implemented in the form of software program modules and sold or used as stand-alone products, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (10)

1. A page operation behavior playback method is characterized by comprising the following steps:
acquiring an operation behavior of a user on a page of a first browser;
generating at least one log file according to the operation behavior, wherein the page information corresponding to different log files is different;
loading a page corresponding to the at least one log file in a second browser, and recording a screen of the page corresponding to the at least one log file through a screen recording function of the second browser to generate a video file;
and playing the video file to play back the operation behavior of the user on the page of the first browser.
2. The method of claim 1, wherein generating at least one log file according to the operational behavior comprises:
serializing all document object model nodes corresponding to an initial page into a first log file through a rebroadcast recording component of the first browser, wherein the initial page is a page opened for the first time when entering the first browser;
monitoring a document object model node of a current page of the first browser in real time through the replay recording component, and serializing the document object model node which changes relative to the current page each time into a second log file under the condition that the document object model node of the current page changes each time;
and composing the first log file and the second log file serialized for each change into the at least one log file.
3. The method according to claim 1 or 2, wherein the log file includes a generation time of the log file, and the loading the page corresponding to the at least one log file in the second browser and recording the page corresponding to the at least one log file through a screen recording function of the second browser to generate the video file comprises:
deserializing each log file to obtain a page corresponding to each log file;
and according to the sequence of the generation time of each log file, forming a complete page by the page corresponding to each log file, performing rolling playing on the complete page, starting a screen recording function of the second browser, and recording the screen of the complete page to generate a video file.
4. The method of claim 3, wherein the initiating the screen recording function of the second browser to record the full page to generate a video file comprises:
and starting a screen recording function of the second browser to record the effective information in the complete page to generate a video file, wherein the effective information is all the information except the head information in the complete page.
5. The method of claim 4, wherein prior to playing the video file, the method further comprises:
encrypting the video file by using the identity information of the user;
the playing the video file includes:
and decrypting the video file by using the identity information of the user, and playing the decrypted video file.
6. The method of claim 5, wherein the encrypting the video file using the identity information comprises:
in the case that the user logs in the first browser, encrypting the video file by using login information of the user, wherein the login information comprises at least one of the following: the user's mobile phone number, nickname or login password;
and under the condition that the user does not log in the first browser, prompting the user to input identity information, carrying out Hash transformation on the identity information input by the user, and encrypting the video file by using information obtained by Hash transformation.
7. The method of claim 1, wherein the playing the video file to play back the user's operation behavior on the first browser page comprises:
obtaining the memory size of each log file in the at least one log file, wherein the memory size of each log file is used for representing the importance degree of each log file;
determining a first number of target log files in the at least one log file according to the memory size of each log file;
acquiring video frames corresponding to the first number of target log files in the video file;
and forming a new video file by the video frames corresponding to the first number of target log files, and playing the new video file to play back the operation behavior of the user on the page of the first browser.
8. A page operation behavior playback apparatus, comprising:
the acquisition unit is used for acquiring the operation behavior of a user on the page of the first browser;
the processing unit is used for generating at least one log file according to the operation behavior, and the page information corresponding to different log files is different;
the processing unit is further configured to load a page corresponding to the at least one log file in a second browser, and record a screen of the page corresponding to the at least one log file through a screen recording function of the second browser to generate a video file;
the processing unit is further configured to play the video file to play back an operation behavior of the user on a page of the first browser.
9. A computer device comprising a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps of the method of any of claims 1-7.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which is executed by a processor to implement the method according to any one of claims 1-7.
CN202011379400.XA 2020-12-01 2020-12-01 Page operation behavior playback method and device, computer equipment and storage medium Active CN112182473B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011379400.XA CN112182473B (en) 2020-12-01 2020-12-01 Page operation behavior playback method and device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011379400.XA CN112182473B (en) 2020-12-01 2020-12-01 Page operation behavior playback method and device, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN112182473A true CN112182473A (en) 2021-01-05
CN112182473B CN112182473B (en) 2021-02-19

Family

ID=73918330

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011379400.XA Active CN112182473B (en) 2020-12-01 2020-12-01 Page operation behavior playback method and device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN112182473B (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112347065A (en) * 2019-08-07 2021-02-09 中国船舶工业系统工程研究院 Record replay method and system for police preplan making process
CN113010825A (en) * 2021-03-09 2021-06-22 腾讯科技（深圳）有限公司 Data processing method and related device
CN113238742A (en) * 2021-06-17 2021-08-10 南方电网科学研究院有限责任公司 Method, device, terminal and medium for modifying and replaying direct-current control protection page program
CN113239388A (en) * 2021-06-18 2021-08-10 中国银行股份有限公司 Recording device and method for user operation behavior
CN113553529A (en) * 2021-07-26 2021-10-26 平安养老保险股份有限公司 Method and device for recording webpage behaviors, computer equipment and storage medium
CN113961534A (en) * 2021-12-21 2022-01-21 荣耀终端有限公司 Method and electronic equipment for generating log file
CN114861103A (en) * 2022-03-23 2022-08-05 易保网络技术(上海)有限公司 Page backtracking method and device, medium and electronic equipment thereof
CN115455327A (en) * 2022-08-05 2022-12-09 贝壳找房(北京)科技有限公司 Page template generation method, electronic device, storage medium and program product
US20230008023A1 (en) * 2021-07-08 2023-01-12 Bank Of America Corporation System and method for detecting errors in a task workflow from a video stream
CN116701810A (en) * 2023-07-29 2023-09-05 北京长亭科技有限公司 Website operation playback method and device
CN116739647A (en) * 2023-08-16 2023-09-12 深圳市加推科技有限公司 Marketing data intelligent analysis method and system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150304386A1 (en) * 2002-12-05 2015-10-22 Borland Software Corporation Systems and methods for context management
CN106681621A (en) * 2016-12-09 2017-05-17 北京超雷科技中心（有限合伙） Webpage evidence preservation system and method
CN110908971A (en) * 2019-11-08 2020-03-24 苏州浪潮智能科技有限公司 System log management method, device, storage medium and equipment
CN111241157A (en) * 2020-01-07 2020-06-05 支付宝(杭州)信息技术有限公司 Operation behavior backtracking method and device and electronic equipment
CN111488259A (en) * 2019-01-29 2020-08-04 阿里巴巴集团控股有限公司 Recording method for webpage and playback method for recorded file

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150304386A1 (en) * 2002-12-05 2015-10-22 Borland Software Corporation Systems and methods for context management
CN106681621A (en) * 2016-12-09 2017-05-17 北京超雷科技中心（有限合伙） Webpage evidence preservation system and method
CN111488259A (en) * 2019-01-29 2020-08-04 阿里巴巴集团控股有限公司 Recording method for webpage and playback method for recorded file
CN110908971A (en) * 2019-11-08 2020-03-24 苏州浪潮智能科技有限公司 System log management method, device, storage medium and equipment
CN111241157A (en) * 2020-01-07 2020-06-05 支付宝(杭州)信息技术有限公司 Operation behavior backtracking method and device and electronic equipment

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112347065A (en) * 2019-08-07 2021-02-09 中国船舶工业系统工程研究院 Record replay method and system for police preplan making process
CN112347065B (en) * 2019-08-07 2023-08-18 中国船舶工业系统工程研究院 Recording and replay method and system for police plan making process
CN113010825A (en) * 2021-03-09 2021-06-22 腾讯科技（深圳）有限公司 Data processing method and related device
CN113238742A (en) * 2021-06-17 2021-08-10 南方电网科学研究院有限责任公司 Method, device, terminal and medium for modifying and replaying direct-current control protection page program
CN113238742B (en) * 2021-06-17 2024-04-12 南方电网科学研究院有限责任公司 Direct current control page protection program modification playback method, device, terminal and medium
CN113239388A (en) * 2021-06-18 2021-08-10 中国银行股份有限公司 Recording device and method for user operation behavior
US20230008023A1 (en) * 2021-07-08 2023-01-12 Bank Of America Corporation System and method for detecting errors in a task workflow from a video stream
US11593428B2 (en) * 2021-07-08 2023-02-28 Bank Of America Corporation System and method for detecting errors in a task workflow from a video stream
CN113553529A (en) * 2021-07-26 2021-10-26 平安养老保险股份有限公司 Method and device for recording webpage behaviors, computer equipment and storage medium
CN113961534B (en) * 2021-12-21 2022-05-10 荣耀终端有限公司 Method and electronic equipment for generating log file
CN113961534A (en) * 2021-12-21 2022-01-21 荣耀终端有限公司 Method and electronic equipment for generating log file
CN114861103A (en) * 2022-03-23 2022-08-05 易保网络技术(上海)有限公司 Page backtracking method and device, medium and electronic equipment thereof
CN114861103B (en) * 2022-03-23 2023-11-10 易保网络技术(上海)有限公司 Page backtracking method and device, medium and electronic equipment
CN115455327A (en) * 2022-08-05 2022-12-09 贝壳找房(北京)科技有限公司 Page template generation method, electronic device, storage medium and program product
CN116701810B (en) * 2023-07-29 2023-12-15 北京长亭科技有限公司 Website operation playback method and device
CN116701810A (en) * 2023-07-29 2023-09-05 北京长亭科技有限公司 Website operation playback method and device
CN116739647A (en) * 2023-08-16 2023-09-12 深圳市加推科技有限公司 Marketing data intelligent analysis method and system

Also Published As

Publication number Publication date
CN112182473B (en) 2021-02-19

Similar Documents

Publication Publication Date Title
CN112182473B (en) Page operation behavior playback method and device, computer equipment and storage medium
US11321734B2 (en) Information processing method, server, and computer storage medium
CN106874389A (en) The moving method and device of data
US20150372885A1 (en) Method, apparatus, and system for tracing resource propagation
CN103281375B (en) A kind of contact management method of third-party application and device, system
CN111444415B (en) Barrage processing method, server, client, electronic equipment and storage medium
CN112445757A (en) Visual log storage and backtracking method and device and computer equipment
CN112788270B (en) Video backtracking method, device, computer equipment and storage medium
Davies et al. Forensic analysis of a Sony PlayStation 4: A first look
CN112148573A (en) Method and device for recording and playing back webpage operation process
US20160071144A1 (en) User activity attribution
Salamh et al. What’s on the horizon? An in-depth forensic analysis of android and iOS applications
CN112148571A (en) Method and device for recording and playing back webpage operation process
CN107741902A (en) Program application detection method and program application detection means
CN112035206B (en) Message processing method and device
CN111177623A (en) Information processing method and device
Raymer et al. Virtual reality forensics: Forensic analysis of Meta Quest 2
CN112905935A (en) Page recording method, page recording animation generation method, equipment and storage medium
CN107368558B (en) Data object returning method and device
Murias et al. A forensic analysis of streaming platforms on Android OS
CN113051095B (en) Method and device for reproducing operation errors of client, electronic equipment and storage medium
CN113901352A (en) Webpage operation playback method, device, equipment and storage medium
CN110262856B (en) Application program data acquisition method, device, terminal and storage medium
CN113836464A (en) Page data processing method and device, computer equipment and storage medium
CN113312134A (en) Operation reproduction method and apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant