CN112148573A - Method and device for recording and playing back webpage operation process - Google Patents

Method and device for recording and playing back webpage operation process Download PDF

Info

Publication number
CN112148573A
CN112148573A CN202010991032.8A CN202010991032A CN112148573A CN 112148573 A CN112148573 A CN 112148573A CN 202010991032 A CN202010991032 A CN 202010991032A CN 112148573 A CN112148573 A CN 112148573A
Authority
CN
China
Prior art keywords
data
webpage
operation process
web page
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010991032.8A
Other languages
Chinese (zh)
Inventor
路玉亭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Window Technology Co ltd
Original Assignee
Qingdao Window Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Window Technology Co ltd filed Critical Qingdao Window Technology Co ltd
Priority to CN202010991032.8A priority Critical patent/CN112148573A/en
Publication of CN112148573A publication Critical patent/CN112148573A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3438Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment monitoring of user actions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking

Abstract

The application discloses a webpage operation process recording method, which is applied to a webpage operation process recording device, and the method comprises the following steps: collecting data in the webpage snapshot data content and creating a webpage record data key frame; in the webpage operation process, calculating and generating webpage content change data based on the change of the webpage snapshot data and storing the webpage content change data; acquiring operation process verification data based on a webpage operation process; and generating webpage operation process record data according to the collected data. The application also discloses a webpage operation process playback method, which is applied to a webpage operation process playback device, reads and analyzes the webpage operation process recorded data, generates a playback instruction and executes playback, calculates and renders webpage content based on the webpage recorded data key frame and the webpage content change data, and restores the webpage operation process. The webpage operation process recording and playback method ensures authenticity and verifiability of recorded data, and the recorded data can be used as an effective operation credential.

Description

Method and device for recording and playing back webpage operation process
Technical Field
The invention relates to the field of data acquisition and verification and information security, in particular to a method and a device for recording and replaying a webpage operation process.
Background
With the development of the internet, more and more business operations are realized on the internet, but in the characteristics of internet operation, the safety, the normalization and the like of the operation process are concerned, so that the requirements of recording the webpage operation process and generating playback data and operation evidence are timely, such as online signing, examination, account opening, transaction and the like, the requirements of recording the operation process are required, such as online insurance transaction, the process of standard insurance application is realized, the misleading of sales is effectively restrained, the legal rights and interests of consumers are protected, the bank protection and supervision issues a notification about the retrospective management of the internet insurance sales behavior, the retrospective system of the internet insurance sales behavior is required to be formulated, the sales page is strictly controlled, and the restorable sales behavior can be realized.
In the recording method for the web page operation process in the prior art, each web page snapshot data or web page snapshot change data is recorded according to the change of the web page snapshot data in the web page operation process, the recorded data is generated into web page operation process playback data, in the execution playback process, the web page snapshot data is provided for a browser, and the web page is rendered to realize playback.
In the process of implementing the invention, the inventor finds that the prior art has at least the following problems: generating record data by recording each webpage snapshot data mode, and generating oversize record data files for webpages with larger webpage snapshot data, wherein some record data files are even more than those of the webpages adopting videos; if the mode of recording the difference data is adopted according to the change of the recorded web page snapshot, the generated recorded data cannot be played according to the specified position, for example, a piece of recorded data with the length of 10 minutes, when the user requires to play from the 8 th minute, all web page difference calculation parties contained in 0 to 8 minutes need to be executed at one time to obtain the required web page data, and the calculation amount is too large; more importantly, the recording data generated by the recording mode can be easily modified by a user, the recording content can be changed by forging a request, and the like, and cannot be used as an operation process evidence. Therefore, the problem of strictly recording the operation process of the web page and generating the playback data which can be used as the operation evidence is to be solved.
Disclosure of Invention
In view of the above-mentioned existing situation, the present application applies a web page and related technologies to solve the following problems: the data is recorded according to the operation process of the webpage, so that the recorded data can be used for playback, the file size is controllable, the control can be flexibly realized like video playing, such as fast forward, fast backward, playing according to a specified position and the like, and the recorded data can be used as effective evidence of the operation process.
In a first aspect, the present application provides a method for recording a web page operation process, which is applied to a device for recording a web page operation process, and the method includes:
collecting data in the webpage snapshot data content, and creating a webpage record data key frame based on the collected data; the webpage snapshot data content comprises one or more of webpage HTML data, DOM data, CSSOM data and webpage element object data; the webpage recording data key frame is used for providing complete webpage data for one moment during playback, at least one webpage recording data key frame is generated at the beginning moment of the webpage operation process recording, and the method further comprises the step of correspondingly generating a plurality of webpage recording data key frames based on webpage snapshot data content acquisition data at different moments;
calculating to generate webpage content change data based on the change of the webpage snapshot data content in the webpage operation process, and recording the time information of the change; the webpage content change data also comprises webpage element object change data contained in the webpage; the webpage content change data is used for calculating webpage content data, and in the playback process, the latest webpage content data is calculated and obtained based on the current webpage content data and the webpage content change data;
acquiring operation process verification data based on a webpage operation process; the operation process verification data is used for verifying the authenticity of data collected or recorded at a client, and comprises the steps of generating the operation process verification data according to webpage operation generated by the client and data to be verified, sending the operation process verification data to a verification server for real-time verification, or generating the operation process verification data by collecting the data at the client, wherein the operation process verification data can be used for restoring the process of the webpage operation and data change of the client, so that the authenticity of the data collected or recorded by the client can be verified;
and generating webpage operation process record data by one or more of the acquired webpage record data key frame data, the webpage content change data and the time information of the change of the webpage content change data and the operation process verification data, wherein the webpage operation process record data is used for verifying and replaying the webpage operation process.
According to the scheme provided by the embodiment of the application, the record is carried out based on the result data (namely the web page snapshot data) of the web page operation, and compared with the implementation mode of carrying out record based on the web page operation behaviors (user operation behaviors, server interaction and the like), the generated record data is more accurate.
According to the scheme provided by the embodiment of the application, the webpage operation process data are recorded in a mode of combining the webpage recording data key frame with the webpage change data, the webpage change data are differentiated data in the change process of the webpage snapshot data, and the generated recording data file has the advantage of small volume.
In addition, in the scheme provided by the embodiment of the application, the collected operation process verification data can verify the authenticity of the recorded webpage operation process record data, so that the webpage operation process record data finally generated by the scheme provided by the embodiment of the application can be used as effective evidence.
In an implementation manner of the present application, a method for generating key frame data of webpage record data includes the following two steps: recording complete webpage content data, and generating independent webpage record data key frame data, or generating difference webpage record data key frame data by recording difference information between the webpage record data key frame and a specified webpage record data key frame.
In the two different key frame generation modes, the independent webpage record data key frame data stores complete webpage snapshot data contents, so that the data contents can be conveniently and quickly acquired; the difference key frame only stores the difference data between the difference key frame and the appointed key frame, and the generated data volume is small, thereby being beneficial to storage. In the implementation scheme provided by the embodiment of the present application, the key frames with the above two properties are generally combined, that is, a part of independent key frames is created, and another part of differential key frames is created based on the independent key frames, so as to achieve the purposes of controlling data storage and rapidly providing data.
In one implementation manner of the application, in the webpage operation process, one or more of operation environment information of the webpage, webpage programs, request and interaction information of the webpage and the outside, data environment information of webpage operation and user operation behavior information are collected, operation process verification data capable of restoring the webpage operation and data change process of the client is generated, and the authenticity of the data collected or recorded by the client is verified according to the restored webpage operation and data change process of the client.
The various data collected by the implementation mode can be used for restoring the operation process of the webpage, and therefore, the data can be stored for verifying the operation process of the webpage.
In another implementation manner of the present application, the method for acquiring the operation process verification data based on the webpage operation process verifies the acquired webpage data and operation in real time, specifically:
in the webpage operation process, when the webpage snapshot data content changes and/or webpage operation is acquired, operation process verification data are calculated and generated based on the change of the webpage snapshot data content and/or the webpage operation, and the operation process verification data comprise webpage operation content and data content to be verified; and sending the operation process verification data to a verification server for verification, verifying the data content to be verified by the verification server based on the webpage operation contained in the verification server, thereby verifying the authenticity of the data collected or recorded by the client, and returning a verification result.
According to the method and the device, the webpage operation process is recorded in a mode of recording result data generated by webpage operation, and the webpage operation result data is generated in a client (namely a browser), so that the safety problem exists. According to the implementation mode, the authenticity of the recorded data of the webpage operation process in the processes of webpage snapshot data content change, webpage operation and webpage operation is ensured, the malicious modification of the webpage data of the client is effectively avoided, and the recorded data can be used as operation evidence to provide guarantee.
In an implementation manner of the present application, the method for determining a change of data content of the web snapshot further includes:
monitoring web page snapshot data content in the web page, and calculating web page content change data or creating a web page record data key frame when monitoring that the web page snapshot data content is changed;
monitoring is established in the webpage aiming at an HTML event, and when the HTML event is monitored, the content of webpage snapshot data is determined to be changed before and after the HTML event is executed, the webpage content change data is calculated or a webpage record data key frame is created;
and calculating the webpage content change data or creating the webpage record data key frame according to a preset time interval.
In the implementation of the application, the data of the webpage operation process is recorded on the basis of the change of the webpage snapshot content data, the above implementation modes provide three methods for triggering the execution of the data record, the first method establishes monitoring based on the webpage snapshot data, and the change of the webpage data content caused by any event or program can be acquired by the monitoring mode; secondly, monitoring is established by combining events generated in the webpage, so that the monitoring is beneficial to recording the change of webpage data by combining webpage operation, and meanwhile, support is provided for verifying the change of the webpage data according to the webpage operation; the third mode is special, and the webpage content change data is acquired periodically according to the time interval, so that special webpage objects such as video elements and canvas elements can be processed more favorably.
In one implementation manner of the application, the running environment information of the webpage is recorded, and webpage running environment data is generated, wherein the webpage running environment data is used for judging and setting the webpage running environment of the playback client when playback is executed; in the process of webpage operation, monitoring and recording browsing operation and browsing state information of the webpage, recording corresponding time information of the webpage, and generating browsing operation and browsing state data of the webpage, wherein the browsing operation and browsing state data of the webpage are used for correspondingly setting the browsing operation and browsing state of the webpage in the process of executing playback, and restoring the webpage browsing process.
In the implementation manner, recording the webpage running environment is beneficial to providing information support for judging and setting the running environment during playback of the webpage operation process, and the webpage running environment comprises browser information, viewport size and the like. The browsing operation of the webpage is a webpage operation which does not cause the change of the data content of the webpage, such as the movement of a user cursor, the change of a cursor, the sliding of the webpage, the change of the content in a webpage control, the change of the size of a viewport and the like.
In one implementation manner of the present application, one or more of the key frame data of the web page record data, the web page content change data, the resource file data related to the web page content, the operation process verification data, the operation process verification result data, the web page operation environment data, the web page browsing operation data, and the web page browsing status data are structurally stored to generate web page operation process record data, a message digest is generated for the web page operation process record data by using a message digest algorithm, and the message digest is displayed or stored; the message abstract is used for identifying the webpage operation process and verifying the consistency of the recorded data of the webpage operation process, and the storage mode comprises one or more of printing, local storage, server storage, third-party storage and block chain storage.
In the above implementation manner, the generation of the web page operation process record data and the generation of the message digest based on the web page operation process record data both occur in the "transaction area" of both parties, that is, the client browser, and when the web page operation process is finished, both the web page operator and the web page provider can obtain the data and the message digest of the operation process. The data recording and message digest generating process is fair, public and verifiable, so that effective operation evidence is obtained.
According to the implementation manner, preferably, in the process of recording the webpage operation, a message abstract is generated for the data recorded in the webpage operation process, and meanwhile, a message abstract algorithm and a calculation step corresponding to the generated message abstract are recorded.
In a possible implementation manner of the present application, when the data recorded in the web page operation process is changed, a message digest is generated for the data recorded in the web page operation process by using a message digest algorithm, and the message digest is added to a message digest history record, where the message digest history record includes a message digest record for verifying a corresponding web page operation step.
In the above implementation manner, the change of the web page operation process record data corresponds to various changes in web page operation, including web page operation, server interaction, web page program operation, and the like, the implementation manner generates a message digest corresponding to the web page operation process record data in each operation state, that is, generates an operation evidence for each operation state, and each message digest is generated on the basis of the previous message digest, which is favorable for generating an operation evidence which cannot be tampered, and each operation performed by data or a web page operator provided by a web page provider is a fixed operation evidence for history. In addition, the implementation mode is also beneficial to verifying each operation step and the webpage data.
In another possible implementation manner of the present application, in the web page operation process, a message summary generated from the current web page operation process record data or related data generated according to the message summary is displayed at the client, and an operation user is required to perform reading according to the displayed content;
collecting reading data according to the reading of the operation user, adding the reading data to the webpage operation process record data, and generating a new message abstract for the new webpage operation process record data again according to the new webpage operation process record data, wherein the new message abstract comprises authentication information of the identity of the operation user and the user operation.
In the possible implementation manners, the message abstract is generated according to the record data generated by the user in the webpage operation process, the message abstract represents the operation, and the user reads the abstract or the related information of the abstract to generate the message abstract again on the basis, so that confirmation information of who and what I confirm the operation made by I is formed, and the method is suitable for operation content of key business operation and identification of the operator.
In a second aspect, the present application further provides a method for playing back a webpage operation process, which is applied to a device for playing back a webpage operation process, and the method includes:
reading in the recorded data of the webpage operation process;
analyzing the web page operation process record data, analyzing one or more of web page record data key frame data, web page content change data, web page content related resource file data, web page operation environment data, web page browsing operation information and web page browsing state information contained in the web page operation process record data, and generating a playback instruction, wherein the steps of:
generating a playback instruction for judging and setting a webpage playback environment based on the webpage operation environment data;
generating a playback instruction for setting webpage content data based on the webpage recording data key frame data;
generating a playback instruction for modifying and/or setting the webpage content data based on the webpage content change data, and setting the execution time of the playback instruction according to the time information corresponding to the webpage content change data; when the webpage content change data is judged to contain webpage element object change data, generating a playback instruction for setting a corresponding webpage element object according to the webpage element object change data, and setting the execution time of the playback instruction according to the time information corresponding to the webpage content change data;
based on the webpage browsing operation data and the browsing state recording data, generating a playback instruction for setting the webpage browsing operation and the webpage browsing state according to the corresponding time information;
executing the playback instruction, including executing the playback instruction for judging and setting the webpage playback environment, and executing the playback instruction for setting the webpage content data; and executing the corresponding playback instruction according to the playback instruction for modifying and/or setting the webpage content data, the playback instruction for setting the webpage element object, the set webpage browsing operation and the time information contained in the playback instruction for setting the webpage browsing state.
According to the scheme provided by the embodiment of the application, the webpage operation process playback is executed by using the webpage operation process recorded data recorded in the first aspect, and the playback effect consistent with the recording process can be achieved.
In a possible implementation manner of the present application, in a webpage playback process, when a control instruction for setting a play position is received, the method further includes:
taking the time information corresponding to the playing position contained in the control instruction as a first moment, searching and obtaining a nearest webpage record data key frame as a first key frame in the initial direction of webpage playback playing, and taking the corresponding time information as a second moment;
calculating the webpage data of the first key frame according to the data generation mode of the first key frame, specifically, when the first key frame is determined to be an independent webpage record data key frame, acquiring webpage content data contained in the first key frame as the webpage data of the first key frame, when the first key frame is determined to be a difference key frame, recursively searching the webpage record data key frame which is subjected to difference calculation until the independent key frame is acquired, using the webpage content data contained in the independent key frame as basic webpage content data, according to the sequence of the webpage record data key frames acquired by recursive search, extracting difference information recorded by each webpage record data key frame one by one according to the sequence from back to front of the recursive search path, and restoring and calculating the webpage data according to the difference information of the extracted webpage record data key frames one by one on the basis of the basic webpage content data, finally, acquiring webpage content data of the first key frame;
searching and acquiring webpage change data with the execution time between a first time and a second time in the webpage change data to generate a webpage change data sequence, generating an execution sequence based on the webpage change records contained in the webpage change data sequence on the basis of the webpage data contained in the first key frame, executing webpage content data modification operation corresponding to the webpage change records according to the execution sequence, generating webpage content data corresponding to the first time, and displaying a webpage based on the webpage content data.
In the implementation mode, the webpage data content of the appointed playing position is obtained according to the key frame and the webpage change record, the calculation speed is high, the webpage data content can be obtained quickly, in addition, the playing control flexibility in the playback process is improved, and the playing control same as that of the video is realized.
In a possible implementation manner of the present application, after reading in the web page operation process record data, the method further includes, according to a message digest algorithm used in the web page operation record process and a step of generating the message digest, generating a message digest for verification corresponding to the web page operation process record data, comparing the message digest generated corresponding to the web page operation record process with the message digest generated corresponding to the web page operation record process, and verifying consistency of the web page operation process record data, or reading a prestored digest history record, and performing consistency verification on data of each step for playback according to the message digest record contained in the digest history record.
The possible implementation modes provide a method for verifying the recorded webpage operation process data, and simultaneously provide a method for verifying the recorded data of a single step contained in the webpage operation process recorded data, so that the verification result can be provided, and the analysis of the cause of the positioning problem is facilitated.
In a third aspect, the present application further provides a device for recording a web page operation process, where the device is used to implement any one of the methods for recording a web page operation process in the above first aspect.
In a fourth aspect, the present application further provides a device for playing back a webpage operation process, where the device is used to implement any one of the methods for playing back a webpage operation process in the second aspect above.
In a fifth aspect, the present application also provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method as defined in any one of the above first aspects, or cause the computer to perform the method as defined in any one of the above second aspects.
In a sixth aspect, the present application provides a computer readable storage medium having stored thereon a computer program which, when run on a computer, causes the computer to perform the method as defined in any one of the above first aspects or causes the computer to perform the method as defined in any one of the above second aspects.
Drawings
Fig. 1 is a schematic flowchart of a web page operation process record provided in an embodiment of the present application;
fig. 2 is a schematic diagram of a process for recording key frames and web page change data of different types of web page record data in a web page operation process according to an embodiment of the present application;
fig. 3 is a schematic view illustrating a flow of verifying data records in a web page operation process according to an embodiment of the present application;
fig. 4 is a schematic flowchart illustrating a process of verifying recorded data of a web page operation process in real time according to an embodiment of the present application;
fig. 5 is a schematic flowchart of acquiring recorded data of a web page operation process according to an embodiment of the present disclosure;
fig. 6 is a schematic flowchart illustrating a process of generating webpage operation process record data and a message digest thereof according to an embodiment of the present disclosure;
fig. 7 is a schematic flowchart of generating a summary history record according to an embodiment of the present disclosure;
fig. 8 is a schematic flowchart of a process for generating authentication information for a web page operation process and a user identity according to an embodiment of the present disclosure;
fig. 9 is a schematic flowchart of playback of a web page operation process according to an embodiment of the present application;
FIG. 10 is a schematic flowchart illustrating a process for calculating data of a web page according to a specified position during playback according to an embodiment of the present application;
fig. 11 is a schematic flowchart illustrating verification of recorded data of a web page operation process and verification of recorded data of a web page operation process in a single playback step according to an embodiment of the present application;
fig. 12 is a block diagram illustrating a structure of a web page operation process recording apparatus according to an embodiment of the present application;
fig. 13 is a block diagram illustrating a structure of a device for playing back a web page operation process according to an embodiment of the present application.
Detailed Description
The embodiments of the present application are in part illustrative of the present application and are not intended to be limiting of the present application.
Embodiments of the present application will now be described with reference to the accompanying drawings, and it is to be understood that the described embodiments are merely illustrative of some, but not all, embodiments of the present application. As can be known to those skilled in the art, with the development of technology and the emergence of new scenarios, the technical solution provided in the embodiments of the present application is also applicable to similar technical problems.
In the following, some terms in the present application are explained so that those skilled in the art can understand that:
1) the web page snapshot refers to result data generated by receiving and analyzing a web page by a browser in the web page browsing and operating processes, and is web page data directly or indirectly used for rendering by the browser in a browsing state, such as static web page data corresponding to web page display content. The web page snapshot includes data content, such as web page HTML data, DOM data, CSSOM data, web page element object data, and the like. The web page element object data is an element contained in a web page or data related to an object, such as a video element object, and the related data includes a video length, a current playing position, and the like. In addition, the data content included in the web page snapshot also includes resource file data included in the web page content data, such as CSS files, pictures and other resource files.
2) And the web page content change data is correspondingly recorded based on the web page snapshot data content change according to the recording form of the web page snapshot data content. If the web page snapshot data content is stored in the tree structure, the web page content change data is generated according to one or more of the node information, the change property and the change content which are changed in the tree structure, wherein the change property includes addition, deletion, modification and the like.
3) The information of the operating environment of the web page includes, but is not limited to, information such as the version, kernel, viewport size, etc. of the web page, such as the server, the client operating system, the web, the browser, the operating environment provided by the browser for the web page, the web page program, the time, the location, etc.
4) Browsing operation and browsing state information of a webpage, wherein the browsing operation of the webpage refers to webpage operation which does not cause change of webpage data content, such as user cursor movement, cursor change, page sliding, content change in a webpage control, size change of a viewport and the like; the browsing status information refers to related information of the web page in a certain browsing status, such as cursor position, cursor status, window size, page position information, and the like.
5) And/or, describing the association relationship of the associated objects, indicating that three relationships may exist. For example, a and/or B, may represent: three cases of a alone, B alone, and a and B together exist, and a character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
The application provides a webpage operation process recording method, which is used for recording the whole process of webpage browsing and operation of a user, generating recorded data capable of being used for playback and simultaneously generating effective operation evidence, and the following briefly explains the principle adopted by the method.
Firstly, analyzing the recording method of the prior art for the webpage operation process, the existing defects are mainly expressed in two aspects:
firstly, the recorded data is used for playback, and flexible control as video cannot be realized, and the main reason is that in the prior art, a web page operation process is recorded by a method for recording web page snapshot data and web page snapshot difference data, taking web page browsing and operation for 10 minutes as an example, an operator performs information filling, web page jumping, information submission and the like, which can cause hundreds of changes of web page snapshot content.
Secondly, the prior art lacks a security acquisition and verification mechanism in the process of recording data, so that the prior art is only suitable for common application scenes for generating user operation trajectory data, and has a major defect if the prior art is applied to more strict scenes such as internet insurance, fund transfer and the like.
In the embodiments provided in the present application, the above first problem is solved by recording a plurality of key frame data, and if 10 key frames are inserted as in the above example, the amount of computation can be reduced by about one order of magnitude, but the storage of key frames causes another problem that the amount of recorded data increases, and the key frame data stored as in the above example may increase by one order of magnitude, based on which the present application solves the above problem of recording too large data by using difference computation between key frames and storing difference data. When the finally generated recording data is used for playback, if the playing is required to be executed from the 9 th minute as in the above example, a key frame closest to the specified time point is searched, the webpage data of the key frame is firstly calculated according to the difference relation between the data stored in the key frame and other key frames, then the webpage content data of the specified time point is finally calculated according to the webpage content change data recorded between the key frame and the specified time point, and the webpage is displayed, so that the playing according to the specified position is realized, and the calculation amount is effectively reduced.
Analyzing the second problem existing in the prior art, if the second problem needs to be solved, acquiring the recorded data of the webpage operation process in a public and fair environment, wherein the acquired data can be approved by a webpage provider and a webpage operator; the collected data has no possibility of tampering, and a verification mechanism is provided to discover the operation in the collection process and the abnormity in the data. According to the scheme provided by the embodiment of the application, the data acquisition of the webpage operation process is carried out at the client (browser), and no processing related to the data acquisition and recording is allowed to be executed outside the client before the final operation evidence is not generated; according to each change of the webpage data or each webpage operation, an operation credential is generated for the recorded data by applying a message digest algorithm, each operation credential is established on the previous operation credential, and finally, an unmodified operation credential is generated, each credential generation is effective and fixed for the previous operation credential, and the above mechanism ensures that the webpage operation data is not allowed to be modified after being generated; in the process of acquiring the webpage data, two modes are provided to ensure the validity of the acquired data, firstly, the operation environment information, the webpage program, the request and interaction information of the webpage and the outside, the data environment information of the webpage operation, the user operation behavior information and the like of the webpage are acquired at the same time when the webpage operation process recording data is acquired, operation process verification data is generated and used for restoring the webpage operation process, the validity of the recorded webpage operation process recording data is verified according to the restored webpage operation process, secondly, when the webpage snapshot data content changes or the webpage operation is acquired, the operation process verification data is generated based on the webpage snapshot data content, the operation process verification data comprises related operation information and data content to be verified, and the operation process verification data is sent to a verification server for verification, and the verification server verifies the validity of the data to be verified according to the operation generated by the client and returns a verification result, so that the method is a mode for verifying the recorded data in the webpage operation process in real time.
Fig. 1 shows a schematic flow chart of a possible record of a web page operation process, which includes the following steps:
s101, collecting data in webpage snapshot data content, and creating a webpage record data key frame based on the collected data;
s102, calculating and generating webpage content change data based on the change of the webpage snapshot data content in the webpage operation process, and recording the time information of the change;
s103, collecting operation process verification data based on the webpage operation process;
and S104, storing the acquired data in a structured mode, and generating webpage operation process record data.
The following is detailed for the above steps:
in S101, the web page record data key frame is created in the web page operation process, and is used to store the web page snapshot data content in an operation state, and the complete web page snapshot data content can be obtained directly or through calculation according to the web page record data key frame. In the recording process of the webpage operation, a plurality of webpage recording data key frames can be created according to the recording requirements and the data characteristics of the webpage snapshot content, and the specific creation mode is as follows: the method comprises the steps of recording the starting time of an execution operation process, the starting time of webpage loading, completing the first loading of a webpage, jumping the webpage, exceeding a preset percentage of webpage data content, reaching a preset value of webpage operation times, reaching a preset value of webpage content change times, establishing according to a preset operation stage, establishing according to a preset time interval and the like.
In S102, the content of the web snapshot data changes, according to the type of the content of the web snapshot data, including HTML data changes, DOM changes, CSSOM changes, and the like, it should be noted that the content of the web element object also includes internal changes of the web element object, such as canvas elements, video elements, and the like, when the internal changes of the element occur (for example, the drawing content contained in canvas changes), the HTML, DOM, and the like corresponding to the web snapshot do not change, and therefore, the internal changes of the web element need to be recorded in a corresponding recording manner. And recording the time information of the change of the webpage snapshot data content, and setting the execution time of the corresponding playback instruction during playback.
It should be noted that at least one, and possibly a plurality of, above steps S101 may include a plurality of combinations of steps S101 and S102, each S102 having a corresponding step S101, but there is a case where there is a separate step S101 and there is no step S102 corresponding thereto.
In S103, the operation process verification data is mainly used to verify the validity of the data collected or recorded in the web page operation, S101 and S102, that is, to ensure that the web page snapshot content data and the web page content change data collected in the web page operation process are true and valid, or can be verified, and a specific verification manner is described in detail in the following embodiments. The operation process verifies the content contained in the data, such as the generated webpage operation data, the data used for verification, or the data generated based on the data, wherein the data used for verification contains the data content to be verified, and the data to be verified is verified by a verification terminal or a server according to the generated webpage operation to obtain the final verification result.
And S104, storing the acquired data to generate webpage operation process record data, wherein the storage mode comprises storage according to a tree structure, relational storage and the like, and the specific example is illustrated in the following embodiments. In addition, the method also comprises the steps of storing the webpage operation process record data, storing the related resource file records in the webpage record data key frame and the webpage content change data, and generating resource file record data, wherein the resource file record data comprises resource files such as CSS files and pictures.
In a preferred implementation of the above embodiment, a data model is established based on the structure of the web page snapshot data content, key frame (web page record data key frame) data is generated based on the data model, and web page content change data is generated based on the data model analysis. If the data model adopts a tree structure, key frame data in a JSON form is generated based on the data model, and when the webpage content changes, a webpage content change data record is recorded and generated based on the node information, change property, change content and the like which change in the data model corresponding to the webpage content change.
It should be noted that, the above steps of collecting the web page record data key frame data, collecting the web page content change data, collecting the operation process verification data, and generating the web page operation process record data are all performed at the client (the browser executing the web page operation) before the valid operation credential is not generated. In an optional implementation manner, according to the above, after the client generates the valid operation credential, the operation credential and/or the web page operation process record data are stored at the client and/or the server.
Optionally, the verification data of the web page operation process generated in S103 is sent to a verification server or a verification terminal for real-time verification, and the valid data of the web page operation process record is controlled and stored in S104 according to the verification result returned by the verification server or the verification terminal. It should be noted that, in this implementation, the web page operation procedure record data stored in S104 may not include the operation procedure verification data.
By the embodiment, the recording mode of combining the key frame data and the webpage content change data is adopted, the generated webpage operation process records data, and flexible playing control is supported; and verifying the data during the data recording process to ensure the recorded data to be true and effective, or acquiring data capable of verifying the webpage operation process during the data recording process to generate data capable of verifying the validity of the recorded data during the webpage operation process so as to ensure the recorded data to be verifiable.
In one possible implementation scenario, the data of the key frames recorded during the operation of the web page includes the following two ways: recording complete webpage content data, generating independent webpage record data key frame data, or recording difference data information between the webpage record data key frame and a specified webpage record data key frame, and generating difference webpage record data key frame data. Fig. 2 shows an example of recording key frames and web page changes (i.e. web page content changes) in the web page operation process, as shown in the figure, 4 key frames are generated according to the recording requirement, wherein, the key frame a and the key frame D are independent key frames, such key frames store complete web page data content, and in addition, the key frame B and the key frame C are differential key frames, i.e. the key frame B records the difference information with the key frame a, and the key frame C records the difference information with the key frame B. Between every two key frames, a plurality of web page change data may be included, for example, a web page change a and a web page change B are included between the key frame a and the key frame B, where the web page change a records the web page change on the basis of the key frame a, and the web page change B records the web page change on the basis of the web page change a.
The implementation principle of the above possible implementation scenarios has the following two advantages:
first, the generated data recorded in the operation process of the web page solves the problem of performing playback at a specified time point during playback, and facilitates flexible playback control as a video, as described in detail in relation to the related embodiments of the playback section.
And secondly, the storage capacity of data is reduced, and the storage is facilitated. According to the setting requirement of the independent key frame, the method is usually adopted when the webpage content data are changed greatly or completely, so that the data recorded by the independent key frame are necessary webpage content data, and in addition, the differentiated key frame and the webpage change data are recorded in a volume minimized mode, so that the aim of controlling the volume of the data is fulfilled as a whole.
In one possible implementation scenario, as shown in fig. 3, operation procedure verification data is collected based on a web operation procedure, and the following steps are performed:
s301, collecting running environment information of a webpage;
s302, collecting a webpage program;
s303, acquiring requests and interactive information between the webpage and the outside;
s304, collecting data environment information of webpage operation;
s305, collecting user operation behavior information;
and S306, generating webpage operation process verification data.
In the above implementation scenario, the information collected in S301 to S305 is used to generate verification data of the operation process, and when the verification data of the web page operation process is used for verification, the above various data are obtained through parsing, and the operation environment and the operation process of the web page operation performed by the user are restored based on the data, so as to verify the validity of each item of data included in the record data of the web page operation process. In some possible embodiments, the collecting of the verification data for the web page operation process includes one or more of S301 to S305, but is not limited to the information included in S301 to S305.
The web page operating environment information collected in step S301 is used to set an operating environment for performing verification, that is, to set relevant parameters and data thereof; the web page programs collected by the S302 include, but are not limited to, a front-end service program, a digital signature of a server-end service program, a recording program used for implementing the method of the present application, and the like; the web page and the external request and interaction information in S303 include, but are not limited to, interaction information between the web page and the server, request and interaction information between the web page and the local operating system, and request and interaction information between the web page and the support operating environment of the web page, such as requesting data from the server, obtaining data from the server, selecting a local file to upload, and the like; s304 acquired data environment information of the web page operation, which is intended to record the data environment of the browser when the web page operation starts or the recording starts to be executed, where the acquired data includes contents such as a local database, a local storage, and a cache stored in the browser; the user operation behavior in S305 is various operations performed on the web page by the user, including clicking, dragging, inputting, page sliding, and the like.
Through the method, the running environment, the external interaction, the user interaction, the data environment, the program and the like in the webpage operation process are subjected to multi-dimensional data acquisition, so that the necessary condition for constructing the verification execution running environment is met, the webpage operation process is conveniently restored in the verification execution running environment, and the recorded validity of the recorded webpage operation process recorded data is verified based on the restored result.
It should be noted that, the recording program for implementing the method of the present application is required to be implemented at a front end (client), so as to ensure that the implementation method of the present application is public and transparent. Based on the above implementation, the following effects can be obtained: for a webpage operator, a recording program applied to the webpage operation process is located at a client side and runs, and the program content of the recording program is public, so that the possibility that a webpage provider modifies the recorded data does not exist; for a webpage provider, the operation process verification data is used, the environment and the process of webpage operation performed by a webpage operator can be restored, and the validity of the recorded data is verified, so that the possibility that the webpage operator modifies the recorded data of the webpage operation process is eliminated. Thus, the recorded data is trusted for both parties.
According to the embodiment, a verification and verifiable mechanism is provided for the recorded data of the webpage operation process, the validity of the collected and recorded data of the webpage operation process is ensured, or the reason for obtaining the problem can be verified when the problem of the data of the relevant record is met, and the guarantee is provided for finally generating the evidence of the webpage operation process.
In another possible implementation scenario, during the operation of the web page, the operation occurring in the web page and the generated data change of the web page are verified in real time, as shown in fig. 4, the web page operation is performed at the web page operation client, and the real-time verification is performed by an independent verification server (or verification terminal), and the detailed steps are as follows:
s401, collecting webpage operation, webpage snapshot data content or changes thereof at a webpage operation client;
s402, operating a client on a webpage to generate verification data of the operation process;
s403, verifying the webpage operation and the webpage data content change of the client side according to the operation process verification data at the verification server;
s404, generating a verification result at the verification server;
s405, operating the client on the webpage, and judging a verification result;
s406, when the webpage operation and the recorded data are normal, the subsequent processing is executed at the webpage operation client;
s407, the web page operation and the recorded data are abnormal, and the abnormal processing is executed at the web page operation client.
It should be noted that the web page operations in S401 and the present application above are not simply understood as web page operations of user behaviors, which include but are not limited to various web page operation behaviors triggered by user behaviors, network interactions, programs, data, execution environments, and the like, such as button clicks, web page loading completion, execution of a program by a timer in a web page program, execution triggered by server pushing, and the like.
S402 generates operation process verification data according to the collected web page operation, web page snapshot data content, or changes thereof, where the generation requirement of the operation process verification data is that a verification end can complete verification operations according to web page operations that the verification end performs on a client and recorded web page operation process record data, for example, the operation process verification data may include web page operation information and data that the client performs, data used for verification, and the like, where the data used for verification includes data content to be verified, e.g., after the web page snapshot content data of the client changes, a message digest is generated for the latest web page operation process record data using a message digest algorithm, and the message digest is used as the data content to be verified.
And the verification server in S403 verifies the validity of the web page operation, the generated web page content data, and the generated web page operation process record data generated by the client according to the operation information and the data information for verification included in the operation process verification data. In a preferred implementation manner, a verification execution environment which runs synchronously with a webpage operation environment is simulated and established in a verification server, after operation process verification data is received, webpage operations contained in the verification execution environment are executed in the same way, and then the data to be verified is verified according to webpage data generated in the verification execution environment. If the generation manner of the operation procedure verification data corresponding to S402 is illustrated, the server side performing the verification performs the web page operation according to the same steps as the client side, generates the web page operation procedure record data, generates the message digest for the web page operation procedure record data, and compares the message digest with the message digest included in the data to be verified to complete the verification. The realization principle of the verification mode is that webpage operations of the client and the verification server are synchronously executed, webpage data finally recorded by the client is verified based on the webpage data of the server, preferably, for the request and interaction between the client and the business server, the verification server directly obtains server response data received by the client from the business server according to the webpage operations, and executes verification, thereby effectively preventing the client from damaging the webpage data of the client by forging webpage requests and forging server response data.
According to the above, the verification server verifies the authenticity of the client operation, the client webpage data and the recorded webpage operation process record data through the operation process verification data, so that the operation process verification data needs to meet the verification requirement of the verification server, and the operation process verification data includes data to be verified, including but not limited to the following modes: the webpage operation process records data or generates a message abstract for the data; recording the newly added data content of the data or the message abstract generated for the newly added data content in the webpage operation process; web page snapshot data content or a message abstract generated for the web page snapshot data content; web page content change data or a message digest generated for the web page content change data; and extracting data of one or more webpage elements according to the specification from the webpage snapshot data content or generating a message summary for the webpage elements. It should be noted that, the operation process verifies the web page operation information included in the data, and also includes data content related to the web page operation, such as for an input operation, including the input data content.
And executing S404 to generate a verification result and sending the verification result to the webpage operation client at the verification server, executing S405 to judge the verification result at the webpage operation client, if the verification is passed, executing subsequent processing by S406, and if the verification is not passed, executing abnormal processing by S406. Preferably, the verification result generated in S404 includes not only the result information of whether the verification is passed, but also the verification code information generated by the verification server based on the current verification, and ensures that the verification code cannot be generated based on the data of the client, for example, a message digest is generated together based on the verified data, the web page operation information, and the character string independently retained by the server. Optionally, the verification server sends the generated verification result to the service server at the same time. Optionally, the verification code information is stored in the webpage operation process record data at the client. In a preferred implementation manner of this embodiment, the subsequent operations executed in S406 are all executed based on the verification result information (e.g., the received verification code information) obtained in the previous step, such as: the verification result information is carried when the request is sent to the service server to indicate that the last step is verified and the request of my is received and processed, and the service server verifies the validity of the request of the client according to the verification result information sent when the verification server executes the verification of the last step. For another example, the web page operation client sends operation process verification data to the verification server, the operation process verification data is generated based on the last verification result information, and the verification server executes the verification operation on the basis of checking the historical verification validity.
In an optional implementation manner of this embodiment, the verification server and the client perform encryption transmission of the operation verification data and the verification result data in a public key, a private key, and a digital signature manner to ensure the security of data sent by the client and the verification server, the client performs identity verification, for example, the verification server generates the public key and the private key, the verification data sent by the client is encrypted by the public key, the verification server receives and decrypts the data by using the private key and performs verification, when sending the verification result data, the verification server generates a message digest for the sent verification data and encrypts the digest by using the private key to generate a digital signature, and sends the generated digital signature and the verification result data to the client together, the client decrypts the message digest by using the public key to obtain the digest, verifies the verification result data by using the digest, and further, the verification server authenticates the public key at a certificate center, and generating a digital certificate, attaching the digital certificate except the digital signature when sending the verification result data to the client, unlocking the digital certificate by using the public key of the certificate center after the client receives the verification result data, obtaining the public key of the verification server, further decrypting the abstract, and checking the received verification result data.
For example, a user name and a password are input at a client, a login button is clicked to log in, a system homepage is entered after the login is completed, the above process is analyzed, and 4 verification operations are performed:
the 1 st time, the user name is entered. The webpage operation information generated by the client is 'input operation generated on a user name webpage element', and additionally comprises input data content, new webpage operation process recording data is generated at the client according to the change of webpage snapshot content data after the input is completed, a message abstract algorithm is used for generating a message abstract for the new webpage operation process recording data, and the data are combined to generate operation process verification data; after receiving the data, the verification server synchronously executes input operation according to the input content in the verification execution running environment, generates new webpage operation process record data in the verification execution running environment, generates a message abstract for the new webpage operation process record data, compares the message abstract with a message abstract contained in the to-be-verified data content in the operation process verification data, and if the message abstract and the message abstract are the same, the verification is passed;
at 2 nd time, a password is entered. The mode of generating the verification data of the operation process and the verification process executed by the verification server are basically the same as the 1 st time;
and 3, logging in. The webpage operation information generated by the client is that 'clicking operation is performed on a login button, a webpage login request is sent to the server', the mode of generating operation process verification data and the verification process executed by the verification server are basically the same as those of the 1 st time and the 2 nd time, it needs to be noted that the sent webpage operation information data can contain the request content sent by the client to the service server, and preferably, the verification server verifies the content of the request according to the request information received by the service server;
and 4, loading the webpage after logging in, receiving webpage data returned by the service server by the client, and completing loading of the system homepage. The webpage operation generated by the client is 'receiving server response data and loading webpage', new webpage operation process record data is generated at the client according to the change of webpage snapshot content data after the webpage loading is finished, a message abstract is generated for the new webpage operation process record data, and the data are combined to generate operation process verification data; after the verification server receives the data, in the operation environment for executing verification, according to the client request received by the service server and the data content sent to the client, log-in is simulated and the logged-in homepage is loaded, in the operation environment for executing verification, new webpage operation process record data is generated, a message abstract is generated for the new webpage operation process record data, the message abstract is compared with the message abstract contained in the data content to be verified in the operation process verification data, a verification code is generated according to the comparison result, the verification code is added into the verification result and sent to the client, the client receives the verification result data, and verification code information is written into the webpage operation process record data.
With reference to the above embodiments, a principle of performing real-time verification in the present application is briefly described, where the content included in the operation process verification data, the verification manner and step in the verification server, and the processing manner of the verification result data at the client are not unique, and the present application should not be limited by the examples in this embodiment. The principle of the real-time verification is that according to operation and data generated by the client, when operation process recorded data is effectively recorded, the validity of the operation process recorded data is verified by the verification server, so that the client can be prevented from tampering webpage data, forging server requests and the like, and the generated webpage operation process recorded data can be used as evidence.
In a possible implementation scenario, the recorded data of the web page operation process further includes an operating environment of the web page, a browsing operation of the web page, and browsing status information of the web page, as shown in fig. 5, the steps of:
s501, recording the running environment information of the webpage and generating webpage running environment data;
s502, acquiring the contained data content or the change of the webpage data content based on the webpage snapshot;
s503, monitoring and recording browsing operation and browsing state information of the webpage, and recording corresponding time information;
and S504, storing the acquired data in a structured mode, and generating webpage operation process record data.
According to the steps, when the operation process of the webpage is recorded and executed, S501, the information of the running environment of the webpage is recorded, the recorded information is beneficial to providing information support for judging and setting the running environment of the playback when the playback is executed, and the running environment of the webpage comprises browser information, viewport size and the like. In the process of webpage operation, steps S502 and S503 are executed, and based on the webpage operation process, webpage data content and its changes, browsing operation of the webpage, browsing state information of the webpage and corresponding time information are collected, and the time information is used for calculating corresponding execution time in the playback process. S502 collects data content included in the web page snapshot or changes in the web page data content, for example, changes in the DOM of the web page in the web page operation process are monitored by the MutationObserver based on changes in the DOM of the web page in the web page operation process, and web page DOM change information is generated; the browsing operation of the web page in S503 is a web page operation that does not cause a change in the data content of the web page, such as a user cursor movement, a cursor change, a page sliding, a content change in a web page control, a viewport size change, and the like, and the browsing state information of the web page in S503 is related information of the web page in a certain browsing state, such as a cursor position, a cursor state, a window size, page position information, and the like. Finally, the final web page operation procedure record data is generated by S504.
In the above embodiment, all elements in the process of the web page operation are completely recorded, and the web page operation process recording data is generated, so that complete data support is provided for the playback of the web page operation process.
In a possible implementation scenario, various data collected in the web page operation process are structurally stored to generate web page operation process record data, and a message digest is generated for the web page operation process record data, as shown in fig. 6, the steps are as follows:
s601, performing structured storage on one or more of key frame data 6001 of web page record data, web page content change data 6002, resource file data 6003 related to web page content, operation process verification data 6004, operation process verification result data 6005, web page running environment data 6006, and web page browsing operation and browsing state record data 6007, to generate web page operation process record data 6008;
s602, generating a message abstract for the data in the webpage operation process recorded data 6008 by adopting a message abstract algorithm, wherein the message abstract record is a webpage operation process recorded data message abstract 6009;
s603, store message digest web page operation process record data message digest 6009.
According to the embodiment, data in the webpage operation process are collected to generate webpage operation process record data, a message abstract is generated for the webpage operation process record data, and the message abstract of the webpage operation process record data is used as evidence of the webpage operation. It should be noted that, the above acquisition of the data of the web page operation process, the generation and storage of the data of the web page operation process record, and the generation and recording of the abstract need to be completed at the client. In addition, the data used for generating the web page operation process recording data in S601 includes, but is not limited to, one or more of 6001 to 6007. S602 generates a message digest for the data 6008, which includes generating a message digest for the entire data 6008, generating a message digest according to the partial data contained therein, generating a message digest step by step according to the data contained therein, and so on. The message digest stored in S603 is used to identify the current webpage operation process and verify the consistency of the data recorded in the webpage operation process, the storage mode includes, but is not limited to, printing, local storage, server storage, third-party storage, block chain storage, and the like, preferably, S603 records the message digest, and records a digest algorithm and a calculation step corresponding to the generation of the message digest.
According to the embodiment provided by the embodiment, the record data and the message abstract are generated in the 'transaction area' of the two parties, so that the fairness and the openness of the record of the webpage operation process are reflected, and finally, both the webpage operator and the provider can obtain effective operation evidence when the webpage operation process is finished.
In another possible implementation scenario of the present application, according to the generation process of the web page operation process record data, after changing the web page operation process record data each time, a message digest is generated for the current web page operation process record data, and according to the message digest generated each time, a digest history record is recorded and generated, as shown in fig. 7, the detailed steps are as follows:
s701, recording the change data to the webpage operation process record data when the webpage operation process record data are changed;
s702, generating a message abstract;
and S703, adding the message digest to a digest history record.
According to the above implementation steps, the change of the web page data in S701 corresponds to various changes in web page operation, such as web page operation, server interaction, web page program operation, and the like. S702 generates message digests corresponding to the webpage operation process record data in each operation state, namely, generates operation evidences for each operation state, and each message digest is generated on the basis of the previous message digest, thereby being beneficial to generating the operation evidences which cannot be tampered. Optionally, after the message digest is generated each time, the generated message digest is added to the recorded data of the webpage operation process, so that the recorded data and the data for verification are combined, which is beneficial to fixing the operation evidence. S703 adds the message digest to a digest history that can be used to verify each operation step and the web page data.
According to the above embodiment, each operating state corresponds to a message digest, wherein the generation of each message digest is based on its previous message digest, thereby generating proof of operation that is not tamperproof throughout the process.
In another possible implementation scenario of the present application, a message summary generated by the recorded data of the current web page operation process is displayed on a web page operation interface, and an operation user is required to perform reading according to the content of the message summary or the related content thereof, as shown in fig. 8, the detailed steps are as follows:
s801, displaying a message abstract generated by the record data of the current webpage operation process on a webpage operation interface;
s802, the operation user reports and reads according to the content of the message abstract or the content related to the message abstract;
s803, collecting the reading content and adding the reading content to the record data of the webpage operation process;
and S804, generating a new message abstract again according to the recorded data of the new webpage operation process.
According to the above embodiment, S803 collects the reading content and adds the reading content to the web page operation process record data, and S804 generates a new message digest again according to the new web page operation process record data, where the new message digest includes authentication information for the identity of the operation user and the user operation.
The method has the advantages that the message abstract is generated according to the operation process record data of the webpage, the message abstract can represent the operation, on the basis, the user reads the abstract or the related information of the abstract, the webpage operation process data is recorded again, and the message abstract is generated, namely the correlation authentication of the executed operation and the identity of the operator is formed, and the method is suitable for the operation content of the key business operation and the identity identification of the operator.
According to the webpage operation process recording method, the collected data are verified in the data collection process, the validity of the collected and recorded data is guaranteed, and the message abstract is generated in the whole process in the data recording process to prevent the recorded data from being tampered, so that the recorded data are guaranteed to be real and effective and can be used as effective evidence in the operation process.
To facilitate understanding of the methods provided by the above embodiments of the web page operation process record, fig. 12 shows a possible web page operation process record device, which includes a web page operation client, an authentication server (or an authentication terminal), wherein the web page operation client includes: a web page snapshot data reading module 1201, a web page snapshot data differentiation calculation module 1202, a web page browsing operation and browsing state information acquisition module 1203, an operation process verification data acquisition module 1204-1 (or an operation process verification data verification module 1204-2), a data storage module 1205, a message digest calculation module 1206, and a message digest storage module 1207; the authentication server includes: operational procedures and web page data validation module 1208. Those skilled in the art will appreciate that the structure of the web page operation process recording device shown in fig. 12 does not constitute a limitation to the web page operation process recording method of the present application, and the web page operation process recording device provided in the embodiments of the present application may include more or less modules than those shown in the drawings, or may combine some modules, or may be arranged in different modules.
The following describes each constituent module of the web page operation process recording apparatus in detail with reference to fig. 12:
the webpage operation client comprises the following modules:
a web page snapshot data reading module 1201, configured to read data in web page snapshot data content, or read data in web page snapshot data content when the monitored web page snapshot data content changes, or read data in web page snapshot data content of a changed portion based on the change;
a web snapshot data difference calculation module 1202, configured to calculate differences between web content data, such as an HTML content difference, a DOM difference, a CSSOM difference, and the like;
a webpage browsing operation and browsing state information collecting module 1203, configured to collect browsing operation information of a webpage, where the browsing operation information includes user cursor movement, cursor change, page sliding, content change in a webpage control, size change of a viewport, and the like; the system is used for collecting browsing state information of the webpage, such as cursor position, cursor state, window size, page position information and the like, and also comprises corresponding time information;
an operation process verification data acquisition module 1204-1, configured to acquire one or more of operation environment information of a web page, a web page program, request and interaction information of the web page and an external device, data environment information of web page operation, and user operation behavior information, and generate operation process verification data;
the operation process verification data verification module 1204-2 is configured to perform real-time verification on the webpage operation, the webpage data in the webpage operation process, or the recorded data, collect operation process verification data in the webpage operation process, and send the operation process verification data to the operation process of the verification server or the verification terminal and the webpage data verification module 1208 for performing real-time verification; meanwhile, receiving operation process verification result data returned by the module 1208;
the data storage module 1205 is configured to structurally generate and store web page operation process record data from one or more of the web page record data key frame data, the web page content change data, the web page content-related resource file data, the operation process verification result data, the web page operation environment data, the web page browsing operation and browsing state record data;
a message digest calculation module 1206, configured to generate a message digest for the data recorded in the webpage operation process, and add the generated message digest to a digest history according to the data change process of the webpage operation process;
a message digest storage module 1207, configured to store the message digest generated by the message digest calculation module 1206, and the digest history.
The authentication server or the authentication terminal comprises the following modules:
the operation process and web page data verification module 1208 is configured to receive the operation verification data sent by the operation process verification data verification module 1204-2, and verify validity of the operation and data included in the operation process and web page data.
FIG. 9 shows a flowchart of a possible playback of a web page operation process, including the steps of:
s901, reading in the recorded data of the webpage operation process;
s902, analyzing the recorded data of the webpage operation process;
s903, generating a playback instruction;
and S904, executing the playback instruction.
The following is detailed for the above steps:
the above steps are executed in a terminal for performing the webpage operation process playback, a playback program for playback and playback process control is loaded at first in the terminal, and playback is executed based on the webpage operation process recording data.
S901, reading in webpage operation process record data, optionally, verifying consistency of the webpage operation process record data according to a pre-stored abstract;
s902, analyzing the web page operation process record data, including analyzing the web page record data key frame data, web page content change data, web page content related resource file data, web page operation environment data, web page browsing operation and browsing state record data and the like contained in the web page operation process record data;
s903 generates a playback instruction including:
generating a playback instruction for judging and setting the playback environment of the playback terminal based on the webpage operation environment data;
generating a playback instruction for setting webpage content data based on the webpage recording data key frame data;
generating a playback instruction for modifying and/or setting the webpage content data based on the webpage content change data, and setting the execution time of the playback instruction according to the time information corresponding to the webpage content change data; when the webpage content change data is judged to contain webpage element object change data, a playback instruction for setting the corresponding webpage element object is generated according to the webpage element object change data, and the execution time of the playback instruction is set according to the time information corresponding to the webpage content change data;
recording data based on the webpage browsing operation and the browsing state, and generating a playback instruction for restoring the webpage browsing operation and setting the webpage browsing state according to the corresponding time information;
s904, executing a playback instruction, including executing the above-mentioned playback instruction for judging and setting the webpage playback environment and setting the playback instruction of the webpage content data; and executing the corresponding playback instruction according to the playback instruction for modifying and/or setting the webpage content data, the playback instruction for setting the webpage element object, the playback instruction for restoring the webpage browsing operation and the time information contained in the playback instruction for setting the webpage browsing state.
In a preferred implementation manner of the above embodiment, a web page content data model is created in an execution environment for playback, and is used for calculating a playback instruction and web page data for display, specifically: setting data in the webpage content data model based on data in the webpage record data key frame, correspondingly setting data in the webpage content data model based on the webpage content change data, generating webpage data for rendering a webpage based on the data stored in the webpage content data model, and generating a corresponding playback instruction based on the change in the webpage content data model, such as: and generating a corresponding playback instruction for setting the webpage element object according to the webpage element object content change data in the webpage content data model. The webpage content data model generally adopts a tree structure, and the step of setting data based on the webpage content change data comprises the steps of searching and obtaining a target modification node in the webpage content data model according to node information contained in the webpage content change data, and performing addition, deletion and replacement operation on the target node according to change property information contained in the webpage content change data in combination with the change content information contained in the webpage content change data; and generating a corresponding playback instruction based on the change in the webpage content data model, namely generating a playback instruction for setting webpage data based on the data of the node according to the time information corresponding to the webpage content change data and the changed node in the webpage content data model.
By the scheme provided by the embodiment, the webpage operation process playback is executed based on the webpage operation process recording data, and the playback effect consistent with the recording process is achieved.
In a possible implementation scenario of the present application, in a webpage playback process, when a control instruction for setting a play position is received, playback data is played according to a specified play position, and detailed steps are as follows:
s1001, receiving a control instruction for setting a playing position;
s1002, searching a nearest webpage recording data key frame in the initial direction of webpage playback and play;
s1003, calculating webpage data of the webpage record data key frame;
s1004, calculates the web page data specifying the playback position.
The above steps are described below with reference to examples:
if the web page operation process record data generated as shown in fig. 2 is played back, for example, if S1001 receives a control instruction for playing from a position of "web page change g", then the position is used as a first time, S1002 is executed to search for a closest web page record data key frame in the starting direction of web page playback playing, search for a difference key frame C, and obtain time information corresponding to the key frame as a second time; judging the property of the key frame C as a difference key frame, recursively searching the key frame appointed by key frame C difference calculation, firstly searching to obtain a difference key frame B, searching to obtain an independent key frame A according to the key frame B, judging the key frame A as an independent key frame, obtaining the data content recorded in the key frame A, calculating to obtain the complete webpage data of the key frame B based on the difference data stored in the key frame B and the content, calculating to obtain the complete webpage data of the key frame C based on the complete webpage data of the key frame B and the difference data stored in the key frame C, obtaining the webpage change data between a first time and a second time, namely webpage change f and webpage change g, setting the webpage data according to the webpage change content recorded in the webpage change f and the webpage change g in sequence based on the complete webpage data of the key frame C, And calculating to finally obtain webpage data of the position of the webpage change g, and displaying the webpage based on the final webpage content data.
According to the embodiment, the webpage data content of the appointed playing position is obtained based on the key frame and the webpage change record, the file size is small, the calculation speed is high, and the playing control can be flexibly carried out like a video.
In a possible implementation scenario of the present application, please refer to fig. 11, after the web page operation process record data is read in, the web page operation process record data or the data content contained in the web page operation process record data is verified, which includes two verification methods, which are described as follows:
as shown in part a of fig. 11, the web page operation process record data is verified:
S1101A, reading the web page operation process record data and the pre-stored message abstract;
S1102A, generating a message abstract for verification corresponding to the webpage operation process record data according to a message abstract algorithm used in the webpage operation record process and the generation step of the message abstract;
and S1103A, comparing the generated message digest for verification with a pre-stored message digest, and verifying the consistency of the web page operation process record data.
As in part B of fig. 11, the data for playback at each of the playback steps is verified:
S1101B, reading the message abstract record in the message abstract historical record stored in advance;
and S1102B, verifying the consistency of the recorded data of the webpage operation process for playback in the current state according to the message digest record.
According to the verification method provided by the embodiment, the part A verifies the recorded webpage operation process recording data, the part B verifies the webpage operation process recording data of a single step for playback, and both the two modes ensure the correctness of the webpage operation process recording data, are favorable for generating effective webpage operation process playback and are favorable for analyzing reasons for problems.
In step S1102B, optionally, the web page data included in the playback terminal is verified according to the data included in the web page operation process recording data for playback in the current state, that is, it is verified whether the web page content data in the web page playback process and the web page operation recording process are consistent.
According to the webpage operation process playback method, playback is executed according to the recorded data of the webpage operation process, meanwhile, methods for verifying and positioning the played back data are provided, and the original webpage operation process is guaranteed to be truly restored.
To facilitate understanding of the method provided by the above embodiments of web page operation process playback, fig. 13 shows a possible apparatus for web page operation process playback, the system comprising: a webpage operation process recording data reading module 1301, a webpage operation process recording data analyzing module 1302, a playback instruction generating module 1303, a playback instruction executing module 1304, and a data verifying module 1305. Those skilled in the art will appreciate that the structure of the apparatus for replaying web page operation process shown in fig. 13 does not constitute a limitation to the method for replaying web page operation process of the present application, and the apparatus for replaying web page operation process provided by the embodiment of the present application may include more or less modules than those shown in the figure, or may combine some modules, or may be arranged in different modules.
The following specifically describes each constituent module of the web page operation process playback apparatus with reference to fig. 13:
a web page operation process record data reading module 1301, configured to read web page operation process record data;
the web page operation process record data analyzing module 1302 is configured to analyze the web page operation process record data, and acquire web page record data key frame data, web page content change data, web page content-related resource file data, web page operation environment data, web page browsing operation and browsing state record data, and the like contained in the web page operation process record data;
a playback instruction generating module 1303, configured to generate a playback instruction, where the playback instruction includes a playback instruction for determining and setting a webpage playback environment, a playback instruction for setting webpage content data, a playback instruction for modifying and/or setting webpage content data, a playback instruction for setting a webpage element object, a playback instruction for restoring a webpage browsing operation, a playback instruction for setting a webpage browsing state, and the like, and the playback instruction further includes arranging the playback instruction and specifying an execution time of the execution instruction;
a playback instruction execution module 1304, configured to execute the playback instruction generated by the module 1303, where the playback instruction is executed according to the above arranged result and the specified execution time;
the data verification module 1305 is configured to verify consistency of the web page operation process record data corresponding to a single step included in the web page operation process record data.
An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored, and when the computer program runs on a computer, the computer is enabled to execute the method for recording and playing back a webpage operation process according to the foregoing embodiment.
In addition, the embodiment of the present application further provides a computer program product, which includes a computer program, and when the computer program product runs on a computer, the computer is enabled to execute the method for recording and playing back the webpage operation process described in the above embodiment.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the procedures or functions described in accordance with the present application are generated, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital subscriber line) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk), among others.
It is to be understood that some or all of the steps or operations in the above-described embodiments are merely examples, and other operations or variations of various operations may be performed by the embodiments of the present application. Further, the various steps may be performed in a different order presented in the above-described embodiments, and it is possible that not all of the operations in the above-described embodiments are performed.
The above description is only a specific implementation of the embodiments of the present application, but the scope of the embodiments of the present application is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the embodiments of the present application, and all the changes or substitutions should be covered by the scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application shall be subject to the protection scope of the claims.

Claims (15)

1. A method for recording a webpage operation process is applied to a webpage operation process recording device, and comprises the following steps:
collecting data in the webpage snapshot data content, and creating a webpage record data key frame based on the collected data; the webpage snapshot data content comprises one or more of webpage HTML data, DOM data, CSSOM data and webpage element object data; the webpage recording data key frame is used for providing complete webpage data for one moment during playback, at least one webpage recording data key frame is generated at the beginning moment of the webpage operation process recording, and the method further comprises the step of correspondingly generating a plurality of webpage recording data key frames based on webpage snapshot data content acquisition data at different moments;
calculating to generate webpage content change data based on the change of the webpage snapshot data content in the webpage operation process, and recording the time information of the change; the webpage content change data also comprises webpage element object change data contained in the webpage; the webpage content change data is used for calculating webpage content data, and in the playback process, the latest webpage content data is calculated and obtained based on the current webpage content data and the webpage content change data;
acquiring operation process verification data based on a webpage operation process; the operation process verification data is used for verifying the authenticity of data collected or recorded at a client, and comprises the steps of generating the operation process verification data according to webpage operation generated by the client and data to be verified, sending the operation process verification data to a verification server for real-time verification, or generating the operation process verification data by collecting the data at the client, wherein the operation process verification data can be used for restoring the process of the webpage operation and data change of the client, so that the authenticity of the data collected or recorded by the client can be verified;
and generating webpage operation process record data by one or more of the acquired webpage record data key frame data, the webpage content change data and the time information of the change of the webpage content change data and the operation process verification data, wherein the webpage operation process record data is used for verifying and replaying the webpage operation process.
2. The method of claim 1, wherein generating the keyframe data of the netpage record data further comprises:
recording complete webpage content data, and generating independent webpage record data key frame data, or generating difference webpage record data key frame data by recording difference information between the webpage record data key frame and a specified webpage record data key frame.
3. The method of claim 1, wherein the method of collecting the operation procedure verification data based on the operation procedure of the web page further comprises:
in the webpage operation process, one or more of operation environment information, webpage programs, webpage and external request and interaction information, webpage operation data environment information and user operation behavior information of the webpage are collected to generate operation process verification data capable of restoring the webpage operation and data change process of the client, and the authenticity of the data collected or recorded by the client is verified according to the restored webpage operation and data change process of the client.
4. The method of claim 1, wherein the method for collecting the operation process verification data based on the webpage operation process further comprises the following real-time verification modes:
in the webpage operation process, when the webpage snapshot data content changes and/or webpage operation is acquired, operation process verification data are calculated and generated based on the change of the webpage snapshot data content and/or the webpage operation, and the operation process verification data comprise webpage operation content and data content to be verified; and sending the operation process verification data to a verification server for verification, verifying the data content to be verified by the verification server based on the webpage operation contained in the verification server, thereby verifying the authenticity of the data collected or recorded by the client, and returning a verification result.
5. The method of claim 1, wherein determining the manner in which the data content of the web page snapshot changes comprises:
monitoring web page snapshot data content in the web page, and calculating web page content change data or creating a web page record data key frame when monitoring that the web page snapshot data content is changed;
monitoring is established in the webpage aiming at an HTML event, and when the HTML event is monitored, the content of webpage snapshot data is determined to be changed before and after the HTML event is executed, the webpage content change data is calculated or a webpage record data key frame is created;
and calculating the webpage content change data or creating the webpage record data key frame according to a preset time interval.
6. The method of claim 1, further comprising,
recording the running environment information of the webpage and generating webpage running environment data, wherein the webpage running environment data is used for judging and setting the webpage running environment of the playback client when playback is executed;
in the process of webpage operation, monitoring and recording browsing operation and browsing state information of the webpage, recording corresponding time information of the webpage, and generating browsing operation and browsing state data of the webpage, wherein the browsing operation and browsing state data of the webpage are used for correspondingly setting the browsing operation and browsing state of the webpage in the process of executing playback, and restoring the webpage browsing process.
7. The method of any one of claims 1 to 6, further comprising,
the method comprises the steps of structurally storing one or more of key frame data of webpage record data, change data of webpage content, resource file data related to the webpage content, operation process verification data, operation process verification result data, webpage operation environment data, webpage browsing operation data and webpage browsing state data to generate webpage operation process record data, generating a message abstract for the webpage operation process record data by using a message abstract algorithm, and displaying or storing the message abstract; the message abstract is used for identifying the webpage operation process and verifying the consistency of the recorded data of the webpage operation process, and the storage mode comprises one or more of printing, local storage, server storage, third-party storage and block chain storage.
8. The method of claim 7, further comprising generating a message digest for the web page operation process record data by using a message digest algorithm when the web page operation process record data is changed, and adding the message digest to a message digest history record, wherein the message digest history record includes message digest records for verifying corresponding web page operation steps.
9. The method of claim 8, wherein during the operation of the web page, further comprising,
displaying a message abstract generated by the current webpage operation process record data or related data generated according to the message abstract at the client, and requiring an operation user to read according to the displayed content;
collecting reading data according to the reading of the operation user, adding the reading data to the webpage operation process record data, and generating a new message abstract for the new webpage operation process record data again according to the new webpage operation process record data, wherein the new message abstract comprises authentication information of the identity of the operation user and the user operation.
10. A webpage operation process playback method is applied to a webpage operation process playback device, and comprises the following steps:
reading in the recorded data of the webpage operation process;
analyzing the web page operation process record data, analyzing one or more of web page record data key frame data, web page content change data, web page content related resource file data, web page operation environment data, web page browsing operation information and web page browsing state information contained in the web page operation process record data, and generating a playback instruction, wherein the steps of:
generating a playback instruction for judging and setting a webpage playback environment based on the webpage operation environment data;
generating a playback instruction for setting webpage content data based on the webpage recording data key frame data;
generating a playback instruction for modifying and/or setting the webpage content data based on the webpage content change data, and setting the execution time of the playback instruction according to the time information corresponding to the webpage content change data; when the webpage content change data is judged to contain webpage element object change data, generating a playback instruction for setting a corresponding webpage element object according to the webpage element object change data, and setting the execution time of the playback instruction according to the time information corresponding to the webpage content change data;
based on the webpage browsing operation data and the browsing state recording data, generating a playback instruction for setting the webpage browsing operation and the webpage browsing state according to the corresponding time information;
executing the playback instruction, including executing the playback instruction for judging and setting the webpage playback environment, and executing the playback instruction for setting the webpage content data; and executing the corresponding playback instruction according to the playback instruction for modifying and/or setting the webpage content data, the playback instruction for setting the webpage element object, the set webpage browsing operation and the time information contained in the playback instruction for setting the webpage browsing state.
11. The method of claim 10, wherein when receiving a control instruction for setting a play position during the playback of the web page, the method further comprises:
taking the time information corresponding to the playing position contained in the control instruction as a first moment, searching and obtaining a nearest webpage record data key frame as a first key frame in the initial direction of webpage playback playing, and taking the corresponding time information as a second moment;
calculating the webpage data of the first key frame according to the data generation mode of the first key frame, specifically, when the first key frame is determined to be an independent webpage record data key frame, acquiring webpage content data contained in the first key frame as the webpage data of the first key frame, when the first key frame is determined to be a difference key frame, recursively searching the webpage record data key frame which is subjected to difference calculation until the independent key frame is acquired, using the webpage content data contained in the independent key frame as basic webpage content data, according to the sequence of the webpage record data key frames acquired by recursive search, extracting difference information recorded by each webpage record data key frame one by one according to the sequence from back to front of the recursive search path, and restoring and calculating the webpage data according to the difference information of the extracted webpage record data key frames one by one on the basis of the basic webpage content data, finally, acquiring webpage content data of the first key frame;
searching and acquiring webpage change data with the execution time between a first time and a second time in the webpage change data to generate a webpage change data sequence, generating an execution sequence based on the webpage change records contained in the webpage change data sequence on the basis of the webpage data contained in the first key frame, executing webpage content data modification operation corresponding to the webpage change records according to the execution sequence, generating webpage content data corresponding to the first time, and displaying a webpage based on the webpage content data.
12. The method of claim 10, after reading in the web page operation procedure log data, further comprising:
and correspondingly generating a message abstract for verification for the recorded data of the webpage operation process according to a message abstract algorithm used in the webpage operation recording process and the generation step of the message abstract, comparing the message abstract with the message abstract correspondingly generated in the webpage operation recording process, and verifying the consistency of the recorded data of the webpage operation process, or reading a prestored abstract historical record and verifying the consistency of the data of each step for playback according to the message abstract record contained in the historical record.
13. A web page operation process recording device, which is used for implementing any one of the above web page operation process recording methods 1 to 9.
14. A web page operation process playback apparatus for implementing any one of the above 10 to 12 web page operation process playback methods.
15. A computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of any one of claims 1 to 9 or cause the computer to perform the method of any one of claims 10 to 12.
CN202010991032.8A 2020-09-21 2020-09-21 Method and device for recording and playing back webpage operation process Pending CN112148573A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010991032.8A CN112148573A (en) 2020-09-21 2020-09-21 Method and device for recording and playing back webpage operation process

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010991032.8A CN112148573A (en) 2020-09-21 2020-09-21 Method and device for recording and playing back webpage operation process

Publications (1)

Publication Number Publication Date
CN112148573A true CN112148573A (en) 2020-12-29

Family

ID=73893262

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010991032.8A Pending CN112148573A (en) 2020-09-21 2020-09-21 Method and device for recording and playing back webpage operation process

Country Status (1)

Country Link
CN (1) CN112148573A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112835776A (en) * 2021-02-22 2021-05-25 广州虎牙科技有限公司 Page event reproduction method, page event acquisition method, page event reproduction device and electronic equipment
CN113111283A (en) * 2021-02-23 2021-07-13 北京联合信任技术服务有限公司 Forensic server, forensic method, storage medium, and program product
CN113657076A (en) * 2021-08-17 2021-11-16 中国平安财产保险股份有限公司 Page operation record table generation method and device, electronic equipment and storage medium
CN114363684A (en) * 2021-12-15 2022-04-15 创盛视联数码科技(北京)有限公司 Document display method and device and storage medium
CN114861103A (en) * 2022-03-23 2022-08-05 易保网络技术(上海)有限公司 Page backtracking method and device, medium and electronic equipment thereof
CN116862678A (en) * 2023-09-04 2023-10-10 湖北微模式科技发展有限公司 Internet transaction behavior traceable system and method of full evidence chain

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108848082A (en) * 2018-05-31 2018-11-20 深圳市腾讯网络信息技术有限公司 Data processing method, device, storage medium and computer equipment
CN109145581A (en) * 2018-09-29 2019-01-04 武汉极意网络科技有限公司 Anti- simulation login method, device and server based on browser rendering performance
US20190171542A1 (en) * 2017-12-01 2019-06-06 Dynatrace Llc Method And System For Real-User Capable Detecting Of The Visual Completeness Of Browser Rendering Process
CN111488259A (en) * 2019-01-29 2020-08-04 阿里巴巴集团控股有限公司 Recording method for webpage and playback method for recorded file

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190171542A1 (en) * 2017-12-01 2019-06-06 Dynatrace Llc Method And System For Real-User Capable Detecting Of The Visual Completeness Of Browser Rendering Process
CN108848082A (en) * 2018-05-31 2018-11-20 深圳市腾讯网络信息技术有限公司 Data processing method, device, storage medium and computer equipment
CN109145581A (en) * 2018-09-29 2019-01-04 武汉极意网络科技有限公司 Anti- simulation login method, device and server based on browser rendering performance
CN111488259A (en) * 2019-01-29 2020-08-04 阿里巴巴集团控股有限公司 Recording method for webpage and playback method for recorded file

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112835776A (en) * 2021-02-22 2021-05-25 广州虎牙科技有限公司 Page event reproduction method, page event acquisition method, page event reproduction device and electronic equipment
CN113111283A (en) * 2021-02-23 2021-07-13 北京联合信任技术服务有限公司 Forensic server, forensic method, storage medium, and program product
CN113111283B (en) * 2021-02-23 2023-11-10 北京联合信任技术服务有限公司 Forensic server, forensic server method, storage medium, and program product
CN113657076A (en) * 2021-08-17 2021-11-16 中国平安财产保险股份有限公司 Page operation record table generation method and device, electronic equipment and storage medium
CN113657076B (en) * 2021-08-17 2023-08-22 中国平安财产保险股份有限公司 Page operation record table generation method and device, electronic equipment and storage medium
CN114363684A (en) * 2021-12-15 2022-04-15 创盛视联数码科技(北京)有限公司 Document display method and device and storage medium
CN114861103A (en) * 2022-03-23 2022-08-05 易保网络技术(上海)有限公司 Page backtracking method and device, medium and electronic equipment thereof
WO2023179327A1 (en) * 2022-03-23 2023-09-28 易保网络技术(上海)有限公司 Page backtracking method and apparatus, medium and electronic device
CN114861103B (en) * 2022-03-23 2023-11-10 易保网络技术(上海)有限公司 Page backtracking method and device, medium and electronic equipment
CN116862678A (en) * 2023-09-04 2023-10-10 湖北微模式科技发展有限公司 Internet transaction behavior traceable system and method of full evidence chain

Similar Documents

Publication Publication Date Title
CN112148573A (en) Method and device for recording and playing back webpage operation process
US8799456B2 (en) Fast device classification
US8306195B2 (en) Visual test automation tool for message-based applications, web applications and SOA systems
CN104488277B (en) For monitoring the method and apparatus of media presentation
US9313213B2 (en) System and method for detecting classes of automated browser agents
CN108667855B (en) Network flow abnormity monitoring method and device, electronic equipment and storage medium
JP2021501935A (en) Computer-implemented systems and methods for linking blockchain to a set of digital twins
CN103443781A (en) Data delivery
US10629242B2 (en) Recording user activity on a computer
US20080022213A1 (en) Website construction support system, website construction support method and recording medium with website construction support program recorded thereon
CN111638908A (en) Interface document generation method and device, electronic equipment and medium
CN112148571A (en) Method and device for recording and playing back webpage operation process
NL2027344B1 (en) System and method for detecting unauthorized activity at an electronic device
WO2020146698A1 (en) Systems and methods for enhanced host classification
US20130263156A1 (en) Operation log collection method and device
JP2017023348A (en) Game system, score processing program, management device for game system and score processing method
CN111539775A (en) Application program management method and device
US9560110B1 (en) Synchronizing shared content served to a third-party service
US20210144451A1 (en) Control method, content management system, recording medium, and data structure
Khanji et al. Forensic analysis of xbox one and playstation 4 gaming consoles
CN112131085A (en) Method, system and device for recording and playing back Internet business process
Noskov Smart City Webgis Applications: Proof of Work Concept For High-Level Quality-Of-Service Assurance
US11636527B2 (en) Personalization based on private profile models
CN114780434A (en) Data processing method and device, electronic equipment and computer readable storage medium
CN111078569B (en) Method and device for testing optical character recognition application and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Country or region after: China

Address after: 266041 room 602, unit 3, building 19, Jingyuan xinju, 1046 Jinshui Road, Licang District, Qingdao City, Shandong Province

Applicant after: Qingdao Huazi Biotechnology Co.,Ltd.

Address before: 266041 room 602, unit 3, building 19, Jingyuan xinju, 1046 Jinshui Road, Licang District, Qingdao City, Shandong Province

Applicant before: Qingdao Window Technology Co.,Ltd.

Country or region before: China