CN113254823A - Webpage data processing method and device - Google Patents

Webpage data processing method and device Download PDF

Info

Publication number
CN113254823A
CN113254823A CN202110523439.2A CN202110523439A CN113254823A CN 113254823 A CN113254823 A CN 113254823A CN 202110523439 A CN202110523439 A CN 202110523439A CN 113254823 A CN113254823 A CN 113254823A
Authority
CN
China
Prior art keywords
virtual object
page
initial
incremental
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110523439.2A
Other languages
Chinese (zh)
Inventor
高佩明
张园超
余锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang eCommerce Bank Co Ltd
Original Assignee
Zhejiang eCommerce Bank Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang eCommerce Bank Co Ltd filed Critical Zhejiang eCommerce Bank Co Ltd
Priority to CN202110523439.2A priority Critical patent/CN113254823A/en
Publication of CN113254823A publication Critical patent/CN113254823A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/11File system administration, e.g. details of archiving or snapshots
    • G06F16/128Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2458Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2474Sequence data queries, e.g. querying versioned data

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the specification provides a webpage data processing method and a webpage data processing device, wherein the webpage data processing method comprises the following steps: acquiring an initial object snapshot of a page view of a webpage, and creating a corresponding initial virtual object based on the initial object snapshot; under the condition that a page event of the page view is detected to be triggered, acquiring an incremental object snapshot and operation information of the page event; creating an incremental virtual object corresponding to the trigger time point of the page event based on the incremental object snapshot and the operation information; and carrying out serialization processing on the initial virtual object and the incremental virtual object, and uploading the processed serialization data to a storage system for storage.

Description

Webpage data processing method and device
Technical Field
The present disclosure relates to the field of data processing technologies, and in particular, to a method and an apparatus for processing webpage data.
Background
With the continuous development and popularization of the internet, the mode of providing online services based on the internet is gradually applied to various fields, more and more merchants provide online services for users in online platforms of various fields, and users often have certain concerns in the process of providing online services by merchants using online platforms, wherein the concerns refer to whether online services provided by merchants of online platforms can be effectively provided for a long time and whether better service quality can be maintained.
Disclosure of Invention
One or more embodiments of the present specification provide a web page data processing method. The webpage data processing method comprises the following steps: the method comprises the steps of obtaining an initial object snapshot of a page view of a webpage, and creating a corresponding initial virtual object based on the initial object snapshot. And acquiring the incremental object snapshot and the operation information of the page event under the condition that the page event of the page view is detected to be triggered. And creating an incremental virtual object corresponding to the trigger time point of the page event based on the incremental object snapshot and the operation information. And carrying out serialization processing on the initial virtual object and the incremental virtual object, and uploading the processed serialization data to a storage system for storage.
One or more embodiments of the present specification provide a method of playing back web page data, including: and receiving and storing the serialized data of the webpage uploaded by the browser. And if a playback instruction for the webpage in the target time period is detected, reading the serialized data corresponding to the target time period and performing deserialization processing. And performing time sequencing according to the triggering time points of the initial virtual object and the incremental virtual object obtained after the deserialization processing. And performing playback processing of the page view of the webpage on the initial virtual object and the incremental virtual object according to the sequencing order.
One or more embodiments of the present specification provide a web page data processing apparatus including: the system comprises an initial object creating module and a virtual object creating module, wherein the initial object creating module is configured to obtain an initial object snapshot of a page view of a webpage and create a corresponding initial virtual object based on the initial object snapshot. And the incremental snapshot acquisition module is configured to acquire an incremental object snapshot and operation information of the page event when the page event of the page view is detected to be triggered. And the incremental object creating module is configured to create an incremental virtual object corresponding to the trigger time point of the page event based on the incremental object snapshot and the operation information. And the serialization processing module is configured to perform serialization processing on the initial virtual object and the incremental virtual object, and upload the processed serialization data to a storage system for storage.
One or more embodiments of the present specification provide a web page data playback apparatus including: and the storage module is configured to receive and store the serialized data of the webpage uploaded by the browser. And the reading module is configured to read the serialized data corresponding to the target time period and perform deserialization processing if a playback instruction of the webpage in the target time period is detected. And the sequencing module is configured to perform time sequencing according to the triggering time points of the initial virtual object and the incremental virtual object obtained after the deserialization processing. A playback module configured to perform playback processing of the page view of the web page on the initial virtual object and the incremental virtual object in a sorting order.
One or more embodiments of the present specification provide a web page data processing apparatus including: a processor; and a memory configured to store computer-executable instructions that, when executed, cause the processor to: the method comprises the steps of obtaining an initial object snapshot of a page view of a webpage, and creating a corresponding initial virtual object based on the initial object snapshot. And acquiring the incremental object snapshot and the operation information of the page event under the condition that the page event of the page view is detected to be triggered. And creating an incremental virtual object corresponding to the trigger time point of the page event based on the incremental object snapshot and the operation information. And carrying out serialization processing on the initial virtual object and the incremental virtual object, and uploading the processed serialization data to a storage system for storage.
One or more embodiments of the present specification provide a web page data playback device including: a processor; and a memory configured to store computer-executable instructions that, when executed, cause the processor to: and receiving and storing the serialized data of the webpage uploaded by the browser. And if a playback instruction for the webpage in the target time period is detected, reading the serialized data corresponding to the target time period and performing deserialization processing. And performing time sequencing according to the triggering time points of the initial virtual object and the incremental virtual object obtained after the deserialization processing. And performing playback processing of the page view of the webpage on the initial virtual object and the incremental virtual object according to the sequencing order.
One or more embodiments of the present specification provide a storage medium storing computer-executable instructions that, when executed, implement the following: the method comprises the steps of obtaining an initial object snapshot of a page view of a webpage, and creating a corresponding initial virtual object based on the initial object snapshot. And acquiring the incremental object snapshot and the operation information of the page event under the condition that the page event of the page view is detected to be triggered. And creating an incremental virtual object corresponding to the trigger time point of the page event based on the incremental object snapshot and the operation information. And carrying out serialization processing on the initial virtual object and the incremental virtual object, and uploading the processed serialization data to a storage system for storage.
One or more embodiments of the present specification provide another storage medium storing computer-executable instructions that, when executed, implement the following: and receiving and storing the serialized data of the webpage uploaded by the browser. And if a playback instruction for the webpage in the target time period is detected, reading the serialized data corresponding to the target time period and performing deserialization processing. And performing time sequencing according to the triggering time points of the initial virtual object and the incremental virtual object obtained after the deserialization processing. And performing playback processing of the page view of the webpage on the initial virtual object and the incremental virtual object according to the sequencing order.
Drawings
In order to more clearly illustrate one or more embodiments or technical solutions in the prior art in the present specification, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present specification, and for those skilled in the art, other drawings can be obtained according to the drawings without inventive exercise;
FIG. 1 is a flowchart illustrating a method for processing data of a web page according to one or more embodiments of the present disclosure;
fig. 2 is a flowchart of a web page data processing method applied to a web page recording-playback scenario according to one or more embodiments of the present specification;
FIG. 3 is a flowchart illustrating a method for playing back webpage data according to one or more embodiments of the present disclosure;
fig. 4 is a flowchart illustrating a web page data playback method applied to a web page playback scenario according to one or more embodiments of the present specification;
FIG. 5 is a schematic diagram of a web page data processing apparatus according to one or more embodiments of the present disclosure;
FIG. 6 is a schematic diagram of a web page data playback device according to one or more embodiments of the present disclosure;
FIG. 7 is a schematic structural diagram of a web page data processing apparatus according to one or more embodiments of the present disclosure;
fig. 8 is a schematic structural diagram of a web page data playback device according to one or more embodiments of the present specification.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in one or more embodiments of the present disclosure, the technical solutions in one or more embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in one or more embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, and not all embodiments. All other embodiments that can be derived by a person skilled in the art from one or more of the embodiments described herein without making any inventive step shall fall within the scope of protection of this document.
An embodiment of a method for processing web page data provided in this specification:
referring to fig. 1, which shows a processing flow chart of a web page data processing method provided by the present embodiment, and referring to fig. 2, which shows a processing flow chart of a web page data processing method applied to a web page recording-playback scenario provided by the present embodiment.
Referring to fig. 1, the method for processing web page data provided in this embodiment is applied to a browser, and specifically includes steps S102 to S108.
Step S102, an initial object snapshot of a page view of a webpage is obtained, and a corresponding initial virtual object is created based on the initial object snapshot.
In the web page data processing method provided by the embodiment, all operations are reproduced in time sequence during playback by recording each operation on a web page, so as to realize 'scene reproduction'. Specifically, the operation information and the page view related to the user are restored, so that the access flow and the access operation submitted by the user in the access process are visually displayed through the page view, and meanwhile, the operation submitted by the user in the access process is synchronously and digitally displayed in the process of displaying the page view after restoration, so that the traceability of the access process of the user is realized, the perception degree and the trust degree of the user for the access traceability are improved, the memory consumption and the performance overhead are reduced by only recording the change data of the page event, and the storage efficiency is further improved by reducing the memory consumption.
The initial Object snapshot in this embodiment refers to memory data of the page view that is read quickly, for example, a snapshot of a full DOM (Document Object Model) of the page view is read. The initial virtual object refers to a virtual object created according to the memory data of the page view and the cursor position information, for example, a virtual DOM created according to the initial DOM snapshot.
In specific implementation, in order to record any operation of a user in a browser or an HTML5(HyperText Markup Language 5, HyperText 5.0) page and reduce memory loss in a recording process, DOM change and cursor position change caused by each step of operation of the user in the browser are recorded, and specifically, an initial DOM snapshot is obtained and stored in a virtual DOM form when a webpage is detected to be accessed; in an optional implementation manner provided by this embodiment, in a process of obtaining an initial object snapshot of a page view of a web page and creating a corresponding initial virtual object based on the initial object snapshot, the following steps are performed:
under the condition that the webpage is detected to be accessed, creating a full DOM snapshot of the page view, and reading cursor position information in the page view;
and creating an initial virtual DOM based on the full-volume DOM snapshot and the cursor position information.
Specifically, for a webpage needing to be subjected to operation recording, when the webpage is detected to be visited, a full-volume DOM snapshot of a top page of the webpage is created, a mouse position detection plug-in is called to read cursor position information in the webpage, and an initial virtual DOM of the top page is created according to the full-volume DOM snapshot and the cursor position information. It should be noted that, in order to ensure the integrity of the DOM data, the full DOM snapshots and the corresponding cursor position information may also be directly stored.
For example, in a case that it is detected that a specific webpage is accessed, a full-volume DOM snapshot is created for the specific homepage, cursor position information in the homepage is recorded by calling a mousecover plug-in, then an initial virtual DOM is created according to the full-volume DOM snapshot and the cursor position information, and the initial virtual DOM is stored in an index db (index Database).
Step S104, acquiring the incremental object snapshot and the operation information of the page event under the condition that the page event of the page view is detected to be triggered.
The page event comprises: a cursor position change event, a data entry event, a page view change event, a page zoom event, and/or a page element change event. The incremental object snapshot refers to memory data of the changed page view, which is read after a page event of the page view is triggered, for example, a DOM snapshot of the changed page view after the page event is triggered. The operation information refers to information corresponding to an operation that causes the page event to occur, such as cursor position change information, data input information, page view change information, page scaling information, and/or page element change information. And creating an incremental virtual object according to the incremental object snapshot and the operation information, namely creating a virtual object according to the memory data and the operation information of the current page view. For example, a virtual DOM is created from the DOM snapshot and the operation information of the changed page view.
In specific implementation, in order to ensure the integrity of "recorded" data, and in a case that it is detected that any page event is triggered, an object snapshot and operation information of a page view corresponding to the page event are obtained, in an optional implementation manner provided in this embodiment, in a process of obtaining an incremental object snapshot and operation information of the page event when it is detected that the page event of the page view is triggered, the following steps are performed:
under the condition that the page event is detected to be triggered, creating an incremental DOM snapshot of the page event, and generating the operation information according to the event number of the page event;
for example, after accessing a home page of a specific webpage, a user moves a cursor in a page view of the home page from a position A to a position B by moving a mouse, and when detecting that the cursor position changes, a browser creates a DOM snapshot for the page view of which the cursor is at the position B, records an event number of a cursor position change event and a time point of the event, and records position data of the position B by calling a mousecover plug-in.
And step S106, creating an incremental virtual object corresponding to the trigger time point of the page event based on the incremental object snapshot and the operation information.
The incremental virtual object refers to a virtual object created according to the memory data and the operation information of the current page view. For example, a virtual DOM is created from the DOM snapshot and the operation information of the changed page view. Specifically, when it is detected that the page event is triggered, an incremental DOM snapshot of the page event is created, and the operation information is generated according to the event number of the page event, so that in the process of creating the incremental virtual object, an incremental virtual DOM corresponding to the trigger time point is created based on the incremental DOM snapshot and the operation information.
According to the above example, a DOM snapshot is created according to the page view with the cursor at the position B, the event number of the cursor position change event, the time point of the event occurrence and the position data of the position B, and a virtual DOM is created and stored in the IndexedDB, wherein the time point of the event occurrence is the trigger time point corresponding to the virtual DOM.
The initial virtual object and the incremental virtual object stored in the index DB may be the created initial virtual object and the created incremental virtual object themselves, or may be serialized data obtained by performing serialization processing on the initial virtual object and the incremental virtual object.
In specific implementation, under the condition that operation backtracking is required, a playback instruction for a certain time period submitted by a user is obtained, and then the page view is played back according to the initial virtual object and/or the incremental virtual object of the time period, so that the perception degree of the user on the time point of playback content is improved by playing back the page view of the specified time period, and playback display of all the page views is avoided during each playback. In an optional implementation manner provided by this embodiment, during the playback and presentation process of the page view, the following operations need to be performed:
if a playback instruction for the webpage in a target time period is detected, reading a target virtual object corresponding to the target time period;
performing time sequencing according to trigger time points of a target initial virtual object and a target increment virtual object in the target virtual object;
and performing playback processing on the page view of the webpage on the target initial virtual object and the target incremental virtual object according to the sequencing order.
For example, if a playback instruction for a specific web page from 12 o ' clock in xx month xx day to 12 o ' clock in xx month xx day in xx year is detected, virtual DOMs stored in the indexedb and having trigger time points from 12 o ' clock in xx month xx day to 12 o ' clock in xx month xx day 12 o ' clock in xx year xx day are read, the read virtual DOMs are arranged in time sequence according to the trigger time points of the virtual DOMs, and the virtual DOMs are played back in sequence.
In a specific implementation, since the read target virtual object may include a target initial virtual object and/or a target incremental virtual object, in an optional implementation manner provided in this embodiment, in a process of performing playback processing on the target initial virtual object, a cursor display position is first determined according to cursor position information in the target initial virtual object; then constructing a corresponding initial page view based on the target initial virtual object, and rendering a cursor icon on the initial page view according to the cursor display position; and finally, displaying the rendered page view. For the target incremental virtual object, in an optional implementation manner provided in this embodiment, in the process of performing playback processing on the target incremental virtual object, first, a target incremental virtual object corresponding to any trigger time point in the target time period is compared with a target incremental virtual object corresponding to a previous trigger time point of the any trigger time point; and then constructing and displaying a page view of the webpage at any trigger time point according to a differentiation result obtained by comparison.
Specifically, after a target virtual object is read, firstly, the type of the target virtual object is identified, if the target virtual object is an initial virtual object, a corresponding initial page view is constructed according to the initial object, a cursor icon is rendered in the initial page view according to cursor position information in the initial virtual object, the rendered page view is displayed, if the target virtual object is an incremental virtual object, the incremental virtual object is compared with an incremental virtual object corresponding to a previous trigger time point, a differentiation result is generated according to the comparison result, the differentiation result is analyzed, and a corresponding page view is constructed according to the analysis result and displayed. It should be noted that, in the process of constructing the page view according to the incremental virtual object, the corresponding operation behavior is rendered in the page view according to the operation information in the incremental virtual object.
For example, reading a target virtual object which is divided into 12 points from 12 points on xx month xx day to 12 points on xx month xx day, firstly identifying whether the target virtual object which is divided into 12 points on xx month xx day is an initial virtual object, if so, determining a cursor display position according to cursor position information in the initial virtual object, constructing an initial page view based on the initial virtual object, rendering a cursor icon in the initial page view according to the cursor display position, and finally displaying the page view obtained by rendering; and if not, performing the processing on the incremental virtual object corresponding to the 12-point adjustment. And for the display of the incremental virtual object at the next trigger time point, comparing the incremental virtual object with the 12-point integral initial virtual object, determining a differentiation result, analyzing the differentiation result, and finally constructing and displaying a page view according to the analysis result.
In specific implementation, the initial virtual object is created when the page is accessed, and the incremental virtual object is created when the page event is triggered, so that in the playback presentation process, there is a case where trigger time points are discontinuous, and in order to ensure continuity of page presentation in the playback process, in an optional implementation manner provided in this embodiment, if the trigger time points are detected to be discontinuous, a page view of the web page at the discontinuous time points is first constructed according to a target incremental virtual object corresponding to a previous trigger time point and/or a subsequent trigger time point of the discontinuous time points; the page view is then presented upon detecting that the playback time point reaches the break time point.
For example, when detecting that no corresponding target virtual object exists between 12 o 'clock 01 min 09 sec of xx month xx day in xx year and 12 o' clock 01 min 15 sec of xx month xx day in xx year, and an incremental virtual object corresponding to a time point exists between 12 o 'clock 01 min 08 sec and 12 o' clock 01 min 16 sec, a page view between 12 o 'clock 01 min 09 sec and 12 o' clock 01 min 15 sec is constructed and displayed according to the incremental virtual object corresponding to the time point existing between 2 o 'clock 01 min 08 sec and 12 o' clock 01 min 16 sec.
After a user accesses a webpage, the user may need to log in an account through a home page of the webpage; in specific implementation, because there is a possibility that a user submitting a playback instruction is not the same user as a user logging in a web page, in order to ensure privacy security of a user accessing the web page, in an optional implementation manner provided in this embodiment, if it is detected that the target initial virtual object and/or the target incremental virtual object contain privacy data during construction and display of a page view, the privacy data is subjected to fuzzy processing when the page view is constructed based on the target initial virtual object and/or the target incremental virtual object; and displaying the blurred page views according to the sorting sequence.
For example, when a user accesses a home page of a webpage, the user inputs an account, a password and a short message verification code to log in the account, and the password and the short message verification code are subjected to fuzzy processing in the process of constructing a corresponding page view.
For another example, after the user logs in the web page, the name and the identity credential number of the user are displayed on the web page, and then the name and the identity credential number of the user are subjected to fuzzy processing in the process of constructing the corresponding page view.
In specific implementation, in order to improve the perception degree of the user on the playback progress and enable the user to select the play progress, in an optional implementation manner provided in this embodiment, a progress bar display area is constructed according to a target time period included in a playback instruction in the playback display process, and the user can change the play progress by dragging the progress bar, specifically, under the condition that the user changes the play progress, the following operations are performed:
if a playback progress instruction aiming at a target time point in the target time period is detected, reading a target virtual object corresponding to the target time point;
and constructing and displaying a page view corresponding to the target time point according to the target virtual object corresponding to the target time point.
For example, the program is played to 12 points 01 minutes 23 seconds in sequence, a playback progress instruction for 12 points 02 minutes 49 seconds, which is submitted by a user, is obtained, an increment virtual object for 12 points 02 minutes 49 seconds is read, a corresponding page view is constructed according to the increment virtual object, a cursor icon is rendered in the page view according to a cursor display position corresponding to the increment virtual object, and a corresponding operation behavior is rendered and displayed in the page view.
In addition, in order to further improve the perception degree of the user on the playback content, a play speed adjustment permission can be provided for the user, and specifically, the display speed of the playback content is adjusted according to the play speed selected by the user.
And step S108, carrying out serialization processing on the initial virtual object and the incremental virtual object, and uploading the processed serialization data to a storage system for storage.
The storage system comprises a server of the browser; in addition, a third-party system for data storage, such as a blockchain, is also included.
In specific implementation, in order to ensure the validity of data storage, ensure that the stored initial virtual object and the stored incremental virtual object are not tampered, and also avoid that a large amount of data is stored in a browser for a long time and occupies a memory of the browser, the created initial virtual object and the created incremental virtual object are uploaded to a storage system for storage, and due to the requirement of a data format in the process of transmitting the browser and the data, the data format adjustment needs to be performed on the initial virtual object and the incremental virtual object according to the format required by the browser, and then the format-adjusted initial virtual object and the format-adjusted incremental virtual object are uploaded to the storage system for storage. In an optional implementation manner provided by this embodiment, the initial virtual object and the incremental virtual object are serialized through the following steps, and the processed serialized data is uploaded to a storage system for storage:
serializing the initial virtual object and the incremental virtual object according to a preset time period;
compressing the serialized data;
and uploading the compression result to the storage system through a data transmission link for storage.
Specifically, in order to ensure the fluency of the uploading process, the serialized data obtained by the serialization processing is compressed, and then the compressed result is uploaded to the storage system through the data transmission link. In order to ensure the universality of the web page data processing method provided by this embodiment, this embodiment uploads the web page data to the server corresponding to the browser in the form of a web socket supported by almost all browsers, so that the serialization process of the initial virtual object and the incremental virtual object is performed, that is, the format of the initial virtual object and the format of the incremental virtual object are adjusted according to the format of the web socket of the browser.
For example, the browser presets that data is uploaded to the server every 10 seconds, and then the virtual DOM acquired every 10 seconds is serialized according to the format requirement of the web socket of the browser every 10 seconds, the serialized data after the serialization processing is compressed, and the compressed serialized data is uploaded to the server in the form of the web socket.
It should be noted that, since there is a playback instruction submitted by another terminal to the page view of the web page, at this time, the virtual object stored in the browser cannot be directly read from the browser, and the playback processing needs to be performed by the storage system. In an optional implementation manner provided by this embodiment, in the process of performing playback processing by the server, the server first receives and stores serialized data of a webpage uploaded by the browser; if a playback instruction for the webpage in a target time period is detected, reading serialized data corresponding to the target time period and performing deserialization processing; then, time sequencing is carried out according to the triggering time points of the initial virtual object and the incremental virtual object obtained after the deserialization processing; and finally, performing playback processing on the page views of the webpage on the initial virtual object and the incremental virtual object according to the sequencing order.
Specifically, when the server detects a playback instruction for the page view, it needs to decompress and deserialize the stored serialized data, and then sort the initial virtual objects and the incremental virtual objects obtained by deserializing according to the time sequence and perform playback processing.
The following takes an application of the web page data processing method provided in this embodiment in a web page recording-playback scenario as an example, and further describes the web page data processing method provided in this embodiment, referring to fig. 2, the web page data processing method applied in the web page recording-playback scenario specifically includes steps S202 to S216.
Step S202, under the condition that the web page is detected to be accessed, creating a full DOM snapshot of the page view and reading cursor position information in the page view.
And step S204, creating and storing an initial virtual DOM based on the full-volume DOM snapshot and the cursor position information.
Step S206, under the condition that the page event of the page view is detected to be triggered, an incremental DOM snapshot of the page event is created, and the operation information corresponding to the page event is obtained.
And S208, creating and storing an incremental virtual DOM corresponding to the trigger time point based on the incremental DOM snapshot and the operation information.
In step S210, if a playback instruction for the web page in the target time period is detected, a target virtual object corresponding to the target time period is read.
Step S212, time sorting is performed according to the trigger time point of each target virtual object.
Step S214, constructing a corresponding page view based on each target virtual object, and rendering a corresponding cursor icon in the page view.
And step S216, displaying the page view rendered with the cursor icon according to the sorting sequence.
To sum up, in the method for processing web page data provided in this embodiment, an initial object snapshot of a page view of a web page is first obtained, a corresponding initial virtual object is created based on the initial object snapshot, then, under a condition that a page event of the page view is detected to be triggered, an incremental object snapshot and operation information of the page event are obtained, an incremental virtual object corresponding to a trigger time point of the page event is created based on the incremental object snapshot and the operation information, and finally, the initial virtual object and the incremental virtual object are serialized, and the processed serialized data is uploaded to a storage system for storage, so that operation information acquisition is achieved on the basis of reducing memory loss.
The embodiment of the webpage data playback method provided by the specification comprises the following steps:
referring to fig. 3, which shows a processing flow chart of a webpage data playback method provided by the present embodiment, and referring to fig. 4, which shows a processing flow chart of a webpage data playback method applied to a webpage playback scenario provided by the present embodiment.
Referring to fig. 3, the method for playing back webpage data provided by this embodiment is applied to a server, and specifically includes steps S302 to S308.
Step S302, receiving and storing the serialized data of the webpage uploaded by the browser.
In the method for processing web page data provided by this embodiment, all operations are reproduced according to a time sequence during playback by recording each step of operation on a web page to realize scene reproduction, specifically, operation information and a page view related to a user are restored, so that an access flow and an access operation submitted by the user during an access process are visually displayed through the page view, and meanwhile, in a process of displaying the page view after restoration, the operation submitted by the user during the access process is synchronously and digitally displayed, so that the perception degree and the trust degree of the user for access traceability are improved while the traceability of the access process of the user is realized.
The serialized data described in this embodiment refers to data obtained by formatting and compressing a created virtual object by a browser.
In specific implementation, before receiving and storing serialized data of a webpage uploaded by a browser, the browser needs to execute the following steps:
acquiring an initial object snapshot of a page view of a webpage, and creating a corresponding initial virtual object based on the initial object snapshot;
under the condition that a page event of the page view is detected to be triggered, acquiring an incremental object snapshot and operation information of the page event;
creating an incremental virtual object corresponding to the trigger time point of the page event based on the incremental object snapshot and the operation information;
and carrying out serialization processing on the initial virtual object and the incremental virtual object, and uploading the processed serialization data to a storage system for storage.
The initial Object snapshot in this embodiment refers to memory data of the page view that is read quickly, for example, an initial DOM (Document Object Model) snapshot of the page view is read. The initial virtual object refers to a virtual object created according to the memory data of the page view and the cursor position information, for example, a virtual DOM created according to the initial DOM snapshot.
In specific implementation, in order to record any operation of a user in a browser or an HTML5(HyperText Markup Language 5, HyperText 5.0) page and reduce memory loss in a recording process, a DOM change and a cursor position change caused by each step of operation of the user in the browser are recorded, specifically, when the browser detects that a webpage is accessed, an initial DOM snapshot is obtained and stored in a virtual DOM form.
The page event described in this embodiment includes: a cursor position change event, a data entry event, a page view change event, a page zoom event, and/or a page element change event. The incremental object snapshot refers to memory data of the changed page view, which is read after a page event of the page view is triggered, for example, a DOM snapshot of the changed page view after the page event is triggered. The operation information refers to information corresponding to an operation that causes the page event to occur, such as cursor position change information, data input information, page view change information, page scaling information, and/or page element change information. And creating an incremental virtual object according to the incremental object snapshot and the operation information, namely creating a virtual object according to the memory data and the operation information of the current page view. For example, a virtual DOM is created from the DOM snapshot and the operation information of the changed page view. In specific implementation, in order to ensure the integrity of the "recorded" data, when browsing detects that any page event is triggered, the object snapshot and the operation information of the page view corresponding to the page event are obtained and a corresponding incremental virtual object is created.
During specific implementation, in order to ensure the validity of data storage, ensure that the stored initial virtual object and the stored incremental virtual object are not tampered, and also avoid that a large amount of data is stored in the browser for a long time and occupies a memory of the browser, the created initial virtual object and the created incremental virtual object are uploaded to a storage system for storage, and due to the requirement of a data format in the process of data transmission by the browser, the data format adjustment needs to be performed on the initial virtual object and the incremental virtual object according to the format required by the browser, and then the format-adjusted initial virtual object and the format-adjusted incremental virtual object are uploaded to the storage system for storage.
Specifically, in order to ensure the fluency of the uploading process, the browser compresses serialized data obtained by serialization processing, and then uploads a compression result to the storage system through the data transmission link. In order to ensure the universality of the web page data processing method provided by this embodiment, this embodiment uploads the web page data to the server corresponding to the browser in the form of a web socket supported by almost all browsers, so that the serialization process of the initial virtual object and the incremental virtual object is performed, that is, the format of the initial virtual object and the format of the incremental virtual object are adjusted according to the format of the web socket of the browser.
Step S304, if a playback instruction for the webpage in the target time period is detected, reading serialized data corresponding to the target time period and performing deserialization processing.
In specific implementation, the server receives serialized data which is uploaded by the browser and is subjected to serialization processing and compression, so that if a playback instruction for a webpage in a target time period is detected, the serialized data corresponding to the target time period is read from the stored serialized data for decompression, and the decompression result is subjected to deserialization processing to obtain a corresponding initial virtual object and an incremental virtual object.
For example, if a playback instruction for a specific web page from 12 o 'clock of xx month xx day to 12 o' clock 05 of xx month xx day of xx year is detected, stored serialized data with trigger time points from 12 o 'clock of xx month xx day to 12 o' clock 05 of xx month xx day of xx year is read, and the serialized data is decompressed and deserialized to obtain a target virtual object from 12 o 'clock of xx month xx day to 12 o' clock 05 of xx month xx day of xx year.
Step S306, time sequencing is carried out according to the triggering time points of the initial virtual object and the increment virtual object obtained after the deserialization processing.
In specific implementation, in order to ensure the validity of the played-back page view, the playback needs to be performed according to a time sequence, so that after the read serialized data is decompressed and deserialized, time sequencing is performed according to the obtained trigger time points of the initial virtual object and the incremental virtual object.
Step S308, performing playback processing of the page view of the web page on the initial virtual object and the incremental virtual object according to the sorting order.
In a specific implementation, because the virtual object obtained by the processing may include an initial virtual object and/or an incremental virtual object, in an optional implementation manner provided in this embodiment, in the process of performing playback processing on the target initial virtual object, a cursor display position is first determined according to cursor position information in the initial virtual object; then constructing a corresponding initial page view based on the initial virtual object, and rendering a cursor icon on the initial page view according to the cursor display position; and finally, displaying the rendered page view. For an incremental virtual object, in an optional implementation manner provided in this embodiment, in the process of performing playback processing on the incremental virtual object, first, an incremental virtual object corresponding to any trigger time point in the target time period is compared with an incremental virtual object corresponding to a previous trigger time point of the any trigger time point; and then constructing and displaying a page view of the webpage at any trigger time point according to a differentiation result obtained by comparison.
Specifically, after the virtual object is obtained, the type of the virtual object is firstly identified, if the virtual object is an initial virtual object, a corresponding initial page view is constructed according to the initial object, a cursor icon is rendered in the initial page view according to cursor position information in the initial virtual object, the rendered page view is displayed, if the target virtual object is an incremental virtual object, the incremental virtual object is compared with an incremental virtual object corresponding to a previous trigger time point, a differentiation result is generated according to the comparison result, the differentiation result is analyzed, and a corresponding page view is constructed according to the analysis result and displayed. It should be noted that, in the process of constructing the page view according to the incremental virtual object, the corresponding operation behavior is rendered in the page view according to the operation information in the incremental virtual object.
For example, reading a virtual object which is divided into 12 points from 12 o 'clock of xx month xx day to 12 points from 12 o' clock of xx month xx day, firstly identifying whether the virtual object which is divided into 12 points is an initial virtual object, if so, determining a cursor display position according to cursor position information in the initial virtual object, constructing an initial page view based on the initial virtual object, rendering a cursor icon in the initial page view according to the cursor display position, and finally displaying the page view obtained by rendering; and if not, performing the processing on the incremental virtual object corresponding to the 12-point adjustment. And for the display of the incremental virtual object at the next trigger time point, comparing the incremental virtual object with the 12-point integral initial virtual object, determining a differentiation result, analyzing the differentiation result, and finally constructing and displaying a page view according to the analysis result.
In addition, in an optional implementation manner provided by this embodiment, in the process of performing playback processing on the page views of the web page on the initial virtual object and the incremental virtual object according to the sorting order, first, a cursor display position is determined according to cursor position information in the initial virtual object, and a cursor icon is rendered according to the cursor display position in an initial page view constructed according to the initial virtual object; then displaying the initial page view rendered with the cursor icon; then comparing an incremental virtual object corresponding to a trigger time point next to the trigger time point corresponding to the initial virtual object with the initial virtual object; and finally, under the condition that the next trigger time point is detected to arrive, constructing and displaying a page view according to the differentiation result obtained by comparison.
In specific implementation, the initial virtual object is created when the page is accessed, and the incremental virtual object is created when the page event is triggered, so that in the playback presentation process, there is a case where trigger time points are discontinuous, and in order to ensure continuity of page presentation in the playback process, in an optional implementation manner provided in this embodiment, if the trigger time points are detected to be discontinuous, a page view of the web page at the discontinuous time points is first constructed according to the incremental virtual object corresponding to a previous trigger time point and/or a subsequent trigger time point of the discontinuous time points; the page view is then presented upon detecting that the playback time point reaches the break time point.
For example, when detecting that no corresponding virtual object exists between 12 o 'clock 01 minutes 09 seconds of xx month xx day of xx year and 12 o' clock 01 minutes 15 seconds of xx month xx day of xx year, and incremental virtual objects corresponding to time points exist between 12 o 'clock 01 minutes 08 seconds and 12 o' clock 01 minutes 16 seconds, constructing and displaying a page view between 12 o 'clock 01 minutes 09 seconds and 12 o' clock 01 minutes 15 seconds according to the incremental virtual objects corresponding to the time points existing between 2 o 'clock 01 minutes 08 seconds and 12 o' clock 01 minutes 16 seconds.
After a user accesses a webpage, the user may need to log in an account through a home page of the webpage; in specific implementation, because there is a possibility that a user submitting a playback instruction is not the same user as a user logging in a web page, in order to ensure privacy security of a user accessing the web page, in an optional implementation manner provided in this embodiment, in the process of constructing and displaying a page view, if it is detected that the initial virtual object and/or the incremental virtual object contain privacy data, the privacy data is subjected to fuzzy processing when constructing the page view based on the initial virtual object and/or the incremental virtual object; and displaying the blurred page views according to the sorting sequence.
For example, when a user accesses a home page of a webpage, the user inputs an account, a password and a short message verification code to log in the account, and the password and the short message verification code are subjected to fuzzy processing in the process of constructing a corresponding page view.
For another example, after the user logs in the web page, the name and the identity credential number of the user are displayed on the web page, and then the name and the identity credential number of the user are subjected to fuzzy processing in the process of constructing the corresponding page view.
In specific implementation, in order to improve the perception degree of the user on the playback progress and enable the user to select the play progress, in an optional implementation manner provided in this embodiment, a progress bar display area is constructed according to a target time period included in a playback instruction in the playback display process, and the user can change the play progress by dragging the progress bar, specifically, under the condition that the user changes the play progress, the following operations are performed:
if a playback progress instruction aiming at a target time point in the target time period is detected, reading a target virtual object corresponding to the target time point;
and constructing and displaying a page view corresponding to the target time point according to the target virtual object corresponding to the target time point.
For example, the program is played to 12 points 01 minutes 23 seconds in sequence, a playback progress instruction for 12 points 02 minutes 49 seconds, which is submitted by a user, is obtained, an increment virtual object for 12 points 02 minutes 49 seconds is read, a corresponding page view is constructed according to the increment virtual object, a cursor icon is rendered in the page view according to a cursor display position corresponding to the increment virtual object, and a corresponding operation behavior is rendered and displayed in the page view.
In addition, in order to further improve the perception degree of the user on the playback content, a play speed adjustment permission can be provided for the user, and specifically, the display speed of the playback content is adjusted according to the play speed selected by the user.
The following further describes the webpage data playback method provided in this embodiment by taking an application of the webpage data playback method provided in this embodiment in a webpage playback scenario as an example, referring to fig. 4, the webpage data playback method applied in the webpage playback scenario specifically includes steps S402 to S416.
In step S402, a playback instruction for the web page in the target time period is acquired.
Step S404, reading the serialized data corresponding to the target time period.
Step S406, deserializing the serialized data to obtain an initial virtual DOM and an incremental virtual DOM.
And step S408, sequencing the initial virtual DOM and the incremental virtual DOM according to the trigger time points of the initial virtual DOM and the incremental virtual DOM in the order from small to large.
Step S410, constructing a corresponding page view according to the initial virtual DOM and the incremental virtual DOM, and rendering a corresponding cursor icon in the page view.
Step S412, detecting whether the page view contains privacy data;
if yes, go to step S414 to step S416;
if not, go to step S416.
Step S414, performs a fuzzy process on the private data in the page view.
And step S416, displaying the corresponding page views according to the sorting sequence.
To sum up, in the webpage data playback method provided in this embodiment, serialized data of a webpage uploaded by a browser is received and stored, if a playback instruction for the webpage in a target time period is detected, the serialized data corresponding to the target time period is read and deserialized, then time sequencing is performed according to trigger time points of an initial virtual object and an incremental virtual object obtained after deserialization, and finally, playback processing of a page view of the webpage is performed on the initial virtual object and the incremental virtual object according to the sequencing order, so that "scene reproduction" is realized on the basis of reducing memory loss.
An embodiment of a web page data processing apparatus provided in this specification is as follows:
in the foregoing embodiment, a web page data processing method is provided, and correspondingly, a web page data processing apparatus is also provided, which is described below with reference to the accompanying drawings.
Referring to fig. 5, a schematic diagram of a web page data processing apparatus provided in this embodiment is shown.
Since the device embodiments correspond to the method embodiments, the description is relatively simple, and the relevant portions may refer to the corresponding description of the method embodiments provided above. The device embodiments described below are merely illustrative.
The present embodiment provides a web page data processing apparatus, including:
an initial object creation module 502 configured to obtain an initial object snapshot of a page view of a web page and create a corresponding initial virtual object based on the initial object snapshot;
an incremental snapshot obtaining module 504, configured to, in a case that it is detected that a page event of the page view is triggered, obtain an incremental object snapshot and operation information of the page event;
a delta object creating module 506 configured to create a delta virtual object corresponding to the trigger time point of the page event based on the delta object snapshot and the operation information;
a serialization processing module 508 configured to perform serialization processing on the initial virtual object and the incremental virtual object, and upload the processed serialization data to a storage system for storage.
An embodiment of a device for playing back webpage data provided by the present specification is as follows:
in the foregoing embodiment, a method for playing back webpage data is provided, and a device for playing back webpage data is provided, which is described below with reference to the accompanying drawings.
Referring to fig. 6, a schematic diagram of a web page data playback device provided in this embodiment is shown.
Since the device embodiments correspond to the method embodiments, the description is relatively simple, and the relevant portions may refer to the corresponding description of the method embodiments provided above. The device embodiments described below are merely illustrative.
The present embodiment provides a web page data playback apparatus including:
the storage module 602 is configured to receive and store serialized data of a webpage uploaded by a browser;
a reading module 604, configured to, if a playback instruction for the webpage in a target time period is detected, read serialized data corresponding to the target time period and perform deserialization processing;
a sorting module 606 configured to perform time sorting according to trigger time points of the initial virtual object and the incremental virtual object obtained after the deserialization processing;
a playback module 608 configured to perform playback processing of the page view of the web page for the initial virtual object and the incremental virtual object in the sorted order.
An embodiment of a web page data processing apparatus provided in this specification is as follows:
on the basis of the same technical concept, corresponding to the above-described web page data processing method, one or more embodiments of the present specification further provide a web page data processing device, where the web page data processing device is configured to execute the above-described web page data processing method, and fig. 7 is a schematic structural diagram of a web page data processing device provided in one or more embodiments of the present specification.
The embodiment provides a web page data processing device, which comprises:
as shown in fig. 7, the web page data processing apparatus may have a large difference due to different configurations or performances, and may include one or more processors 701 and a memory 702, where one or more stored applications or data may be stored in the memory 702. Memory 702 may be, among other things, transient storage or persistent storage. The application program stored in memory 702 may include one or more modules (not shown), each of which may include a series of computer-executable instructions in a web page data processing device. Still further, processor 701 may be configured to communicate with memory 702 to execute a series of computer-executable instructions in memory 702 on the web page data processing device. The web page data processing apparatus may also include one or more power supplies 703, one or more wired or wireless network interfaces 704, one or more input/output interfaces 705, one or more keyboards 706, and the like.
In a particular embodiment, a web page data processing apparatus comprises a memory, and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs may comprise one or more modules, and each module may comprise a series of computer-executable instructions for the web page data processing apparatus, and execution of the one or more programs by one or more processors comprises computer-executable instructions for:
acquiring an initial object snapshot of a page view of a webpage, and creating a corresponding initial virtual object based on the initial object snapshot;
under the condition that a page event of the page view is detected to be triggered, acquiring an incremental object snapshot and operation information of the page event;
creating an incremental virtual object corresponding to the trigger time point of the page event based on the incremental object snapshot and the operation information;
and carrying out serialization processing on the initial virtual object and the incremental virtual object, and uploading the processed serialization data to a storage system for storage.
The embodiment of the webpage data playback device provided by the specification is as follows:
on the basis of the same technical concept, corresponding to the above-described webpage data playback method, one or more embodiments of the present specification further provide a webpage data playback device, where the webpage data playback device is configured to execute the above-described webpage data playback method, and fig. 8 is a schematic structural diagram of the webpage data playback device provided in one or more embodiments of the present specification.
The embodiment provides a webpage data playback device, which comprises:
as shown in fig. 8, the web page data playback device may have a large difference due to different configurations or performances, and may include one or more processors 801 and a memory 802, and one or more stored applications or data may be stored in the memory 802. Wherein the memory 802 may be a transient storage or a persistent storage. The application program stored in memory 802 may include one or more modules (not shown), each of which may include a series of computer-executable instructions in a web page data playback device. Still further, the processor 801 may be configured to communicate with the memory 802 to execute a series of computer-executable instructions in the memory 802 on the web page data playback device. The web page data playback apparatus may also include one or more power supplies 803, one or more wired or wireless network interfaces 804, one or more input/output interfaces 805, one or more keyboards 806, and the like.
In a particular embodiment, a web page data playback device includes a memory, and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs may include one or more modules, and each module may include a series of computer-executable instructions for the web page data playback device, and execution of the one or more programs by one or more processors includes computer-executable instructions for:
receiving and storing serialized data of a webpage uploaded by a browser;
if a playback instruction for the webpage in a target time period is detected, reading serialized data corresponding to the target time period and performing deserialization processing;
time sequencing is carried out according to the triggering time points of the initial virtual object and the incremental virtual object obtained after the deserialization processing;
and performing playback processing of the page view of the webpage on the initial virtual object and the incremental virtual object according to the sequencing order.
An embodiment of a storage medium provided in this specification is as follows:
on the basis of the same technical concept, one or more embodiments of the present specification further provide a storage medium corresponding to the above-described web page data processing method.
The storage medium provided in this embodiment is used to store computer-executable instructions, and when executed, the computer-executable instructions implement the following processes:
acquiring an initial object snapshot of a page view of a webpage, and creating a corresponding initial virtual object based on the initial object snapshot;
under the condition that a page event of the page view is detected to be triggered, acquiring an incremental object snapshot and operation information of the page event;
creating an incremental virtual object corresponding to the trigger time point of the page event based on the incremental object snapshot and the operation information;
and carrying out serialization processing on the initial virtual object and the incremental virtual object, and uploading the processed serialization data to a storage system for storage.
It should be noted that the embodiment of the storage medium in this specification and the embodiment of the web page data processing method in this specification are based on the same inventive concept, and therefore, for specific implementation of this embodiment, reference may be made to implementation of the foregoing corresponding method, and repeated details are not described again.
Another storage medium embodiment provided in this specification is as follows:
on the basis of the same technical concept, one or more embodiments of the present specification further provide a storage medium corresponding to the above-described webpage data playback method.
The storage medium provided in this embodiment is used to store computer-executable instructions, and when executed, the computer-executable instructions implement the following processes:
receiving and storing serialized data of a webpage uploaded by a browser;
if a playback instruction for the webpage in a target time period is detected, reading serialized data corresponding to the target time period and performing deserialization processing;
time sequencing is carried out according to the triggering time points of the initial virtual object and the incremental virtual object obtained after the deserialization processing;
and performing playback processing of the page view of the webpage on the initial virtual object and the incremental virtual object according to the sequencing order.
It should be noted that the embodiment of the storage medium in this specification and the embodiment of the method for playing back the webpage data in this specification are based on the same inventive concept, and therefore, for specific implementation of this embodiment, reference may be made to implementation of the foregoing corresponding method, and repeated details are not described again.
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
In the 30 s of the 20 th century, improvements in a technology could clearly be distinguished between improvements in hardware (e.g., improvements in circuit structures such as diodes, transistors, switches, etc.) and improvements in software (improvements in process flow). However, as technology advances, many of today's process flow improvements have been seen as direct improvements in hardware circuit architecture. Designers almost always obtain the corresponding hardware circuit structure by programming an improved method flow into the hardware circuit. Thus, it cannot be said that an improvement in the process flow cannot be realized by hardware physical modules. For example, a Programmable Logic Device (PLD), such as a Field Programmable Gate Array (FPGA), is an integrated circuit whose Logic functions are determined by programming the Device by a user. A digital system is "integrated" on a PLD by the designer's own programming without requiring the chip manufacturer to design and fabricate application-specific integrated circuit chips. Furthermore, nowadays, instead of manually making an Integrated Circuit chip, such Programming is often implemented by "logic compiler" software, which is similar to a software compiler used in program development and writing, but the original code before compiling is also written by a specific Programming Language, which is called Hardware Description Language (HDL), and HDL is not only one but many, such as abel (advanced Boolean Expression Language), ahdl (alternate Hardware Description Language), traffic, pl (core universal Programming Language), HDCal (jhdware Description Language), lang, Lola, HDL, laspam, hardward Description Language (vhr Description Language), vhal (Hardware Description Language), and vhigh-Language, which are currently used in most common. It will also be apparent to those skilled in the art that hardware circuitry that implements the logical method flows can be readily obtained by merely slightly programming the method flows into an integrated circuit using the hardware description languages described above.
The controller may be implemented in any suitable manner, for example, the controller may take the form of, for example, a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an Application Specific Integrated Circuit (ASIC), a programmable logic controller, and an embedded microcontroller, examples of which include, but are not limited to, the following microcontrollers: the ARC625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320, the memory controller may also be implemented as part of the control logic for the memory. Those skilled in the art will also appreciate that, in addition to implementing the controller as pure computer readable program code, the same functionality can be implemented by logically programming method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Such a controller may thus be considered a hardware component, and the means included therein for performing the various functions may also be considered as a structure within the hardware component. Or even means for performing the functions may be regarded as being both a software module for performing the method and a structure within a hardware component.
The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functions of the units may be implemented in the same software and/or hardware or in multiple software and/or hardware when implementing the embodiments of the present description.
One skilled in the art will recognize that one or more embodiments of the present description may be provided as a method, system, or computer program product. Accordingly, one or more embodiments of the present description may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the description may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The description has been presented with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the description. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
One or more embodiments of the present description may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. One or more embodiments of the specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only an example of this document and is not intended to limit this document. Various modifications and changes may occur to those skilled in the art from this document. Any modifications, equivalents, improvements, etc. which come within the spirit and principle of the disclosure are intended to be included within the scope of the claims of this document.

Claims (24)

1. A webpage data processing method comprises the following steps:
acquiring an initial object snapshot of a page view of a webpage, and creating a corresponding initial virtual object based on the initial object snapshot;
under the condition that a page event of the page view is detected to be triggered, acquiring an incremental object snapshot and operation information of the page event;
creating an incremental virtual object corresponding to the trigger time point of the page event based on the incremental object snapshot and the operation information;
and carrying out serialization processing on the initial virtual object and the incremental virtual object, and uploading the processed serialization data to a storage system for storage.
2. The web page data processing method according to claim 1, wherein the obtaining an initial object snapshot of a page view of a web page and creating a corresponding initial virtual object based on the initial object snapshot comprises:
under the condition that the webpage is detected to be accessed, creating a full DOM snapshot of the page view, and reading cursor position information in the page view;
and creating an initial virtual DOM based on the full-volume DOM snapshot and the cursor position information.
3. The web page data processing method according to claim 1, wherein the acquiring, when it is detected that a page event of the page view is triggered, an incremental object snapshot and operation information of the page event includes:
under the condition that the page event is detected to be triggered, creating an incremental DOM snapshot of the page event, and generating the operation information according to the event number of the page event;
wherein the page event includes: a cursor position change event, a data entry event, a page view change event, a page zoom event, and/or a page element change event.
4. The web page data processing method according to claim 1, further comprising:
if a playback instruction for the webpage in a target time period is detected, reading a target virtual object corresponding to the target time period;
performing time sequencing according to trigger time points of a target initial virtual object and a target increment virtual object in the target virtual object;
and performing playback processing on the page view of the webpage on the target initial virtual object and the target incremental virtual object according to the sequencing order.
5. The web page data processing method according to claim 4, wherein performing playback processing of the page view of the web page on the target initial virtual object includes:
determining a cursor display position according to cursor position information in the target initial virtual object;
constructing a corresponding initial page view based on the target initial virtual object, and rendering a cursor icon on the initial page view according to the cursor display position;
and displaying the page view obtained after rendering.
6. The web page data processing method according to claim 4, wherein performing playback processing of the page view of the web page on the target incremental virtual object includes:
comparing a target increment virtual object corresponding to any trigger time point in the target time period with a target increment virtual object corresponding to a previous trigger time point of any trigger time point;
and constructing and displaying a page view of the webpage at any trigger time point according to the difference result obtained by comparison.
7. The web page data processing method according to claim 4, further comprising:
if the triggering time point is detected to be discontinuous, constructing a page view of the webpage at the discontinuous time point according to a target increment virtual object corresponding to a previous triggering time point and/or a next triggering time point of the discontinuous time point;
displaying the page view upon detecting that a playback time point reaches the break time point.
8. The web page data processing method according to claim 1, wherein the serializing the initial virtual object and the incremental virtual object, and uploading the processed serialized data to a storage system for storage includes:
serializing the initial virtual object and the incremental virtual object according to a preset time period;
compressing the serialized data;
and uploading the compression result to the storage system through a data transmission link for storage.
9. The web page data processing method according to claim 4, wherein the performing playback processing of the page view of the web page on the target initial virtual object and the target incremental virtual object in the sorted order includes:
if the target initial virtual object and/or the target incremental virtual object is detected to contain private data, carrying out fuzzy processing on the private data when a page view is constructed on the basis of the target initial virtual object and/or the target incremental virtual object;
and displaying the page views subjected to the fuzzy processing according to the sorting sequence.
10. The web page data processing method according to claim 4, further comprising:
if a playback progress instruction aiming at a target time point in the target time period is detected, reading a target virtual object corresponding to the target time point;
and constructing and displaying a page view corresponding to the target time point according to the target virtual object corresponding to the target time point.
11. The web page data processing method according to claim 3, wherein the creating of the incremental virtual object corresponding to the trigger time point of the page event based on the incremental object snapshot and the operation information comprises:
and creating an incremental virtual DOM corresponding to the trigger time point based on the incremental DOM snapshot and the operation information.
12. A method of web page data playback, comprising:
receiving and storing serialized data of a webpage uploaded by a browser;
if a playback instruction for the webpage in a target time period is detected, reading serialized data corresponding to the target time period and performing deserialization processing;
time sequencing is carried out according to the triggering time points of the initial virtual object and the incremental virtual object obtained after the deserialization processing;
and performing playback processing of the page view of the webpage on the initial virtual object and the incremental virtual object according to the sequencing order.
13. The web page data playback method according to claim 12, wherein performing playback processing of the page view of the web page on the initial virtual object includes:
determining a cursor display position according to the cursor position information in the initial virtual object;
constructing a corresponding initial page view based on the initial virtual object, and rendering a cursor icon on the initial page view according to the cursor display position;
and displaying the page view obtained by rendering.
14. The webpage data playback method of claim 12, wherein performing playback processing of the page view of the webpage on the incremental virtual object comprises:
comparing the increment virtual object corresponding to any trigger time point in the target time period with the increment virtual object corresponding to the previous trigger time point of any trigger time point;
and constructing and displaying a page view of the webpage at any trigger time point according to the difference result obtained by comparison.
15. The web page data playback method of claim 12, further comprising:
if the triggering time point is detected to be discontinuous, constructing a page view of the webpage at the discontinuous time point according to an incremental virtual object corresponding to a previous triggering time point and/or a next triggering time point of the discontinuous time point;
displaying the page view upon detecting that a playback time point reaches the break time point.
16. The webpage data playback method of claim 12, wherein performing playback processing of the page view of the webpage on the initial virtual object and the incremental virtual object in the sorted order comprises:
if the initial virtual object and/or the incremental virtual object are detected to contain private data, carrying out fuzzy processing on the private data when a page view is constructed on the basis of the initial virtual object and/or the incremental virtual object;
and displaying the page views subjected to the fuzzy processing according to the sorting sequence.
17. The web page data playback method of claim 12, further comprising:
if a playback progress instruction aiming at a target time point in the target time period is detected, reading a target virtual object corresponding to the target time point;
and constructing and displaying a page view corresponding to the target time point according to the target virtual object corresponding to the target time point.
18. The webpage data playback method of claim 12, wherein performing playback processing of the page view of the webpage on the initial virtual object and the incremental virtual object in the sorted order comprises:
determining a cursor display position according to cursor position information in the initial virtual object, and rendering a cursor icon according to the cursor display position in an initial page view constructed according to the initial virtual object;
displaying an initial page view rendered with the cursor icon;
comparing an incremental virtual object corresponding to a trigger time point next to the trigger time point corresponding to the initial virtual object with the initial virtual object;
and under the condition that the next trigger time point is detected to arrive, constructing and displaying a page view according to a differentiation result obtained by comparison.
19. A web page data processing apparatus comprising:
the system comprises an initial object creating module, a virtual object creating module and a virtual object creating module, wherein the initial object creating module is configured to acquire an initial object snapshot of a page view of a webpage and create a corresponding initial virtual object based on the initial object snapshot;
the incremental snapshot acquisition module is configured to acquire an incremental object snapshot and operation information of a page event when the page event of the page view is detected to be triggered;
a delta object creating module configured to create a delta virtual object corresponding to a trigger time point of the page event based on the delta object snapshot and the operation information;
and the serialization processing module is configured to perform serialization processing on the initial virtual object and the incremental virtual object, and upload the processed serialization data to a storage system for storage.
20. A web page data playback apparatus comprising:
the storage module is configured to receive and store the serialized data of the webpage uploaded by the browser;
the reading module is configured to read the serialized data corresponding to the target time period and perform deserialization processing if a playback instruction of the webpage in the target time period is detected;
the sequencing module is configured to perform time sequencing according to the triggering time points of the initial virtual object and the incremental virtual object obtained after the deserialization processing;
a playback module configured to perform playback processing of the page view of the web page on the initial virtual object and the incremental virtual object in a sorting order.
21. A web page data processing apparatus comprising:
a processor; and the number of the first and second groups,
a memory configured to store computer-executable instructions that, when executed, cause the processor to:
acquiring an initial object snapshot of a page view of a webpage, and creating a corresponding initial virtual object based on the initial object snapshot;
under the condition that a page event of the page view is detected to be triggered, acquiring an incremental object snapshot and operation information of the page event;
creating an incremental virtual object corresponding to the trigger time point of the page event based on the incremental object snapshot and the operation information;
and carrying out serialization processing on the initial virtual object and the incremental virtual object, and uploading the processed serialization data to a storage system for storage.
22. A web page data playback device comprising:
a processor; and the number of the first and second groups,
a memory configured to store computer-executable instructions that, when executed, cause the processor to:
receiving and storing serialized data of a webpage uploaded by a browser;
if a playback instruction for the webpage in a target time period is detected, reading serialized data corresponding to the target time period and performing deserialization processing;
time sequencing is carried out according to the triggering time points of the initial virtual object and the incremental virtual object obtained after the deserialization processing;
and performing playback processing of the page view of the webpage on the initial virtual object and the incremental virtual object according to the sequencing order.
23. A storage medium storing computer-executable instructions that when executed implement the following:
acquiring an initial object snapshot of a page view of a webpage, and creating a corresponding initial virtual object based on the initial object snapshot;
under the condition that a page event of the page view is detected to be triggered, acquiring an incremental object snapshot and operation information of the page event;
creating an incremental virtual object corresponding to the trigger time point of the page event based on the incremental object snapshot and the operation information;
and carrying out serialization processing on the initial virtual object and the incremental virtual object, and uploading the processed serialization data to a storage system for storage.
24. A storage medium storing computer-executable instructions that when executed implement the following:
receiving and storing serialized data of a webpage uploaded by a browser;
if a playback instruction for the webpage in a target time period is detected, reading serialized data corresponding to the target time period and performing deserialization processing;
time sequencing is carried out according to the triggering time points of the initial virtual object and the incremental virtual object obtained after the deserialization processing;
and performing playback processing of the page view of the webpage on the initial virtual object and the incremental virtual object according to the sequencing order.
CN202110523439.2A 2021-05-13 2021-05-13 Webpage data processing method and device Pending CN113254823A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110523439.2A CN113254823A (en) 2021-05-13 2021-05-13 Webpage data processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110523439.2A CN113254823A (en) 2021-05-13 2021-05-13 Webpage data processing method and device

Publications (1)

Publication Number Publication Date
CN113254823A true CN113254823A (en) 2021-08-13

Family

ID=77181745

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110523439.2A Pending CN113254823A (en) 2021-05-13 2021-05-13 Webpage data processing method and device

Country Status (1)

Country Link
CN (1) CN113254823A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114124487A (en) * 2021-11-10 2022-03-01 恒安嘉新(北京)科技股份公司 Method, device and equipment for realizing webpage access and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070255768A1 (en) * 2004-11-17 2007-11-01 Hitachi, Ltd. System and method for creating an object-level snapshot in a storage system
CN102163177A (en) * 2010-02-24 2011-08-24 株式会社日立制作所 Reduction of i/o latency for writable copy-on-write snapshot function
CN106777219A (en) * 2016-12-23 2017-05-31 北京亚细亚智业科技有限公司 For the data processing method and device of Visualized data centre
CN111898055A (en) * 2020-08-10 2020-11-06 冯帆 Screen recording and playback method for browser webpage
CN112068919A (en) * 2020-09-17 2020-12-11 北京五八信息技术有限公司 Webpage screen capture processing method and device, electronic equipment and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070255768A1 (en) * 2004-11-17 2007-11-01 Hitachi, Ltd. System and method for creating an object-level snapshot in a storage system
CN102163177A (en) * 2010-02-24 2011-08-24 株式会社日立制作所 Reduction of i/o latency for writable copy-on-write snapshot function
CN106777219A (en) * 2016-12-23 2017-05-31 北京亚细亚智业科技有限公司 For the data processing method and device of Visualized data centre
CN111898055A (en) * 2020-08-10 2020-11-06 冯帆 Screen recording and playback method for browser webpage
CN112068919A (en) * 2020-09-17 2020-12-11 北京五八信息技术有限公司 Webpage screen capture processing method and device, electronic equipment and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114124487A (en) * 2021-11-10 2022-03-01 恒安嘉新(北京)科技股份公司 Method, device and equipment for realizing webpage access and storage medium
CN114124487B (en) * 2021-11-10 2023-12-01 恒安嘉新(北京)科技股份公司 Webpage access realization method, device, equipment and storage medium

Similar Documents

Publication Publication Date Title
US10102306B2 (en) Patching base document object model (DOM) with DOM-differentials to generate high fidelity replay of webpage user interactions
CN110569428B (en) Recommendation model construction method, device and equipment
CN108334585A (en) A kind of spiders method, apparatus and electronic equipment
CN111881422B (en) Picture processing method and device based on block chain
CN112000563B (en) Recording method, device and equipment of user behaviors
CN107590228B (en) Page content processing method and mobile terminal
CN107479868B (en) Interface loading method, device and equipment
CN111753328B (en) Private data leakage risk detection method and system
CN111930810B (en) Data rule mining method and device
CN112631679A (en) Preloading method and device for micro-application
CN110602163B (en) File uploading method and device
CN107391534B (en) Page display method, page file return method, page display device, page file return device and computer storage medium
CN109145535A (en) A kind of front end page providing method and device
CN113254823A (en) Webpage data processing method and device
CN108664191B (en) System access method and device
CN112256696A (en) Form data processing method, device, equipment and storage medium
CN113176988B (en) Data recording method and device
CN110708270B (en) Abnormal link detection method and device
US9262304B2 (en) Methods and systems for testing interactions between mobile applications
KR101111956B1 (en) System for providing substance about monitoring of computing device and method thereof
CN113435950B (en) Bill processing method and device
CN114401012A (en) Resource processing method, device, equipment and medium
CN113946260A (en) Data processing method, device and equipment
CN114329152A (en) Application program generation method, device, equipment and medium based on browser engine
CN116136757A (en) Log output method and device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210813

RJ01 Rejection of invention patent application after publication