CN114692049A - Browser-based screen recording method and device, electronic equipment and storage medium - Google Patents
Browser-based screen recording method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114692049A CN114692049A CN202210323627.5A CN202210323627A CN114692049A CN 114692049 A CN114692049 A CN 114692049A CN 202210323627 A CN202210323627 A CN 202210323627A CN 114692049 A CN114692049 A CN 114692049A
- Authority
- CN
- China
- Prior art keywords
- screen recording
- page
- browser
- instruction
- generating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Abstract
The application relates to the field of security monitoring, in particular to a browser-based screen recording method and device, electronic equipment and a storage medium. The screen recording method based on the browser comprises the following steps: receiving an application program which is sent by a console and used for page screen recording; responding to an operation instruction triggered by a client, and generating a page interception instruction according to the application program and the operation instruction; and starting page interception of the browser through the page interception instruction, and generating a screen recording file according to the intercepted pages. The page intercepted by the method generates the screen recording video, so that various operation behaviors of a user through the client can be comprehensively monitored, the size of a monitoring file can be greatly reduced, and the occupation of a storage space is saved.
Description
Technical Field
The application relates to the field of security monitoring, in particular to a browser-based screen recording method and device, electronic equipment and a storage medium.
Background
In an enterprise-level network system, each employee in an enterprise has a respective client and an access account of an internal system of the enterprise. In view of security of the network system, enterprises often monitor clients of employees, and a common method is that the employees perform screen recording in the whole process from the time of starting the clients to the time of closing the clients, and send recorded video files to a background for storage. When potential safety hazards or risk warnings exist in a network system or data transaction, enterprise auditors can call video files stored in a background to conduct traceability audit so as to check whether any illegal operation behaviors exist in a client side.
In addition, in some strong supervision industries, the internet transaction of various commercial behaviors is often subjected to screen recording supervision, for example, for internet insurance transactions, the china insurance policy and supervision stipulates the 'retrospective management temporary method for insurance sales behavior' issued, insurance enterprises need to perfect the retrospective function of insurance application processes, and the whole-process recording retrospective of insurance process purchase by users is realized through audio recording and video recording.
Although the operation behavior of the staff at the client can be comprehensively recorded by the whole screen recording method in the technology, a large number of screen recording files are often generated by the whole screen recording, and particularly under the condition that a plurality of clients exist, a large storage space needs to be provided by a background, so that storage resources are seriously wasted. In addition, the auditor cannot be positioned to the accurate position when checking the potential safety hazard, and the auditing is usually started from the beginning of the video, so that the working efficiency is seriously influenced.
Disclosure of Invention
The application aims to provide a screen recording method and device based on a browser, electronic equipment and a storage medium, and further solves the problems of storage resource waste and low backtracking efficiency caused by the limitations and defects of the related technology at least to a certain extent.
According to one aspect of the application, a screen recording method based on a browser is provided, and comprises the following steps:
receiving an application program which is sent by a console and used for page screen recording;
responding to an operation instruction triggered by a client, and generating a page interception instruction according to the application program and the operation instruction;
and starting page interception of the browser through the page interception instruction, and generating a screen recording file according to the intercepted pages.
In an exemplary embodiment, the browser-based screen recording method further includes:
and sending the screen recording file to the console.
In an exemplary embodiment, before the sending the screen recording file to the console, the method further includes:
and compressing the screen recording file according to a JavaScript data compression technology.
In an exemplary embodiment, the generating a screen recording file according to the intercepted plurality of pages includes:
and generating screen recording files for the plurality of intercepted pages according to the time sequence of the intercepted pages.
In an exemplary embodiment, the application program presets duration information of the screen recording file to be generated, and the generating the screen recording file according to the plurality of intercepted pages includes:
determining the number of pages for generating a screen recording file according to the duration information; and generating the screen recording file according to the number of pages.
In an exemplary embodiment, if the operation instruction is a page copy instruction, generating a page intercept instruction according to the application program and the operation instruction in response to an operation instruction triggered by a client includes:
and responding to a page copying instruction triggered by a client, and generating a page intercepting instruction according to the application program and the page copying instruction.
In an exemplary embodiment, if the operation instruction is a page editing instruction, generating a page intercepting instruction according to the application program and the operation instruction in response to an operation instruction triggered by a client includes:
and responding to a page editing instruction triggered by a client, and generating a page intercepting instruction according to the application program and the page editing instruction. According to another aspect of the present application, there is provided a browser-based screen recording method, including the steps of:
sending an application program for page screen recording to a server, so that the server responds to an operation instruction triggered by a client, and generating a page interception instruction according to the application program and the operation instruction; and starting page interception of the browser through the page interception instruction, and generating a screen recording file according to the intercepted pages.
In an exemplary embodiment, the browser-based screen recording method further includes:
receiving a plurality of screen recording files sent by the server;
and merging the screen recording files according to the time sequence of generating the screen recording files.
According to another aspect of the present application, there is provided a browser-based screen recording method, including the steps of:
the control console sends an application program for page screen recording;
the method comprises the steps that a server receives an application program which is sent by a console and used for page screen recording through a gateway;
responding to an operation instruction triggered by a client, and generating a page interception instruction by the server according to the application program and the operation instruction;
and the server starts page interception of the browser through the page interception instruction and generates a screen recording file according to the intercepted pages.
In an exemplary embodiment, the browser-based screen recording method further includes:
and the console receives the multiple screen recording files sent by the server and combines the multiple screen recording files according to the time sequence of generating the screen recording files.
According to another aspect of the present application, there is provided a browser-based screen recording apparatus, including:
the receiving module is used for receiving an application program which is sent by the console and used for page screen recording;
the instruction module is used for responding to an operation instruction triggered by a client and generating a page interception instruction according to the application program and the operation instruction;
and the screen recording module is used for starting page interception of the browser through the page interception instruction and generating a screen recording file according to the intercepted pages.
According to another aspect of the present application, there is provided a browser-based screen recording apparatus, including:
the screen recording module is used for sending an application program for page screen recording to a server so that the server responds to an operation instruction triggered by a client and generates a page intercepting instruction according to the application program and the operation instruction; and starting page interception of the browser through the page interception instruction, and generating a screen recording file according to the intercepted pages.
According to another aspect of the present application, there is provided a browser-based screen recording system, including:
the console is used for sending an application program for page screen recording;
the client is used for receiving an operation instruction triggered by a user and sending the operation instruction to the server;
a gateway for communicating between the console and the server, the client and the server;
the server is used for receiving the application program which is sent by the console and used for page screen recording through the gateway; responding to an operation instruction received by the gateway, and generating a page interception instruction according to the application program and the operation instruction; starting page interception of the browser through the page interception instruction, and generating a screen recording file according to a plurality of intercepted pages; and sending the screen recording file to the console. According to another aspect of the present application, there is provided an electronic device including:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the above-described method.
According to another aspect of the present application, a computer-readable storage medium is provided, in which a computer program is stored, which computer program, when being executed by a processor, is adapted to carry out the above-mentioned method.
According to the browser-based screen recording method and device, the operation instruction triggered by the client in the web system is detected, the page under the specific operation instruction is captured, the screen recording video is generated by the page captured by the method, various operation behaviors of the user through the client can be comprehensively monitored, the size of the monitoring file can be greatly reduced, and therefore the occupation of storage space is saved. In addition, in the subsequent backtracking and auditing process, the pictures corresponding to the specific operation behaviors can be played in a targeted manner, so that the auditing efficiency and the system safety are improved.
Drawings
FIG. 1 is a schematic flowchart of a browser-based screen recording method according to an exemplary embodiment of the present application;
FIG. 2 is a schematic view of an application scenario of a browser-based screen recording method in an exemplary embodiment of the present application;
fig. 3 is a schematic structural diagram of a browser-based screen recording apparatus in an exemplary embodiment of the present application.
Detailed Description
In order to make the objects, features and advantages of the present application more apparent and understandable, embodiments and technical solutions of the present application will be clearly and completely described below with reference to the accompanying drawings. Example embodiments and examples, however, may be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments and examples are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments and examples to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments and examples. In the following description, numerous specific details are provided to give a thorough understanding of embodiments and examples of the application. One skilled in the relevant art will recognize, however, that the subject matter of the present application can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and so forth. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present application.
Furthermore, the drawings are merely schematic illustrations of the present application and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Although the steps of the methods in this application are depicted in the drawings in a particular order, this does not require or imply that the steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. The flow charts shown in the drawings are merely illustrative and do not necessarily include all steps. For example, some steps may be decomposed, and some steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
In an enterprise-level network system, each employee in an enterprise has a respective client and an access account of an internal system of the enterprise. In view of security of the network system, enterprises often monitor clients of employees, and a common method is that the employees perform screen recording in the whole process from the time of starting the clients to the time of closing the clients, and send recorded video files to a background for storage. When potential safety hazards or risk warnings exist in a network system or data transaction, enterprise auditors can call video files stored in a background to perform source audit so as to check whether any illegal operation behaviors exist in a client side.
In addition, in some strong supervision industries, the internet transaction of various commercial behaviors is often subjected to screen recording supervision, for example, for internet insurance transactions, the china insurance policy and supervision stipulates the 'retrospective management temporary method for insurance sales behavior' issued, insurance enterprises need to perfect the retrospective function of insurance application processes, and the whole-process recording retrospective of insurance process purchase by users is realized through audio recording and video recording.
Although the operation behavior of the staff at the client can be comprehensively recorded by the whole screen recording method in the technology, a large number of screen recording files are often generated by the whole screen recording, and particularly under the condition that a plurality of clients exist, a large storage space needs to be provided by a background, so that storage resources are seriously wasted. In addition, the auditor cannot be positioned to the accurate position when checking the potential safety hazard, and the auditing is usually started from the beginning of the video, so that the working efficiency is seriously influenced.
Based on the above problems in the related art, the present application creatively provides a browser-based screen recording method, including: receiving an application program which is sent by a console and used for page screen recording; receiving an application program which is sent by a console and used for page screen recording; responding to an operation instruction triggered by a client, and generating a page interception instruction according to the application program and the operation instruction; and starting page interception of the browser through the page interception instruction, and generating a screen recording file according to the intercepted pages. In the screen recording method, the screen recording of the browser is not recorded for the whole time period of the client, but only for the situation that each specific operation behavior of the client causes the change of the page, for example, when a user browses a webpage through the client, no operation is performed within two minutes, the user only needs to intercept the picture of the opened webpage, and when the user browses the webpage in the third minute, the user only needs to intercept the picture after page turning, and if the user selects a part of the picture in the fourth minute, the user only needs to intercept the picture of the selected operation, and the picture in the browser is intercepted by the method, or the video synthesized by the intercepted pictures, so that various operation behaviors of the user through the client can be comprehensively monitored, and the size of the monitoring file can be greatly reduced, so that the occupation of the storage space is saved. In addition, in the subsequent backtracking and auditing process, the pictures corresponding to the specific operation behaviors can be played in a targeted manner, so that the auditing efficiency and the system safety are improved.
The browser-based screen recording method provided by the application can be used for recording the displayed page through a display or other communication terminals, that is, the browser-based screen recording method can be implemented through terminal equipment, and the terminal equipment can execute each step in the method. The terminal devices may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., car navigation terminals), and fixed terminals such as digital TVs, desktop computers, and the like. The corresponding screen capture device may also be stored in each of the terminal devices. In the following, a web system application scenario composed of a client, a gateway (or a proxy protocol), and a server is taken as an example, and a detailed exemplary description is made for the screen capturing method of the display interface, but it should be understood that any exemplary embodiment should not be construed as a limiting explanation for the screen capturing method of the display interface.
An exemplary embodiment of the present application provides a browser-based screen recording method, and fig. 1 is a flowchart illustrating a browser-based screen recording method in an exemplary embodiment of the present application. As shown in fig. 1, the browser-based screen recording method includes the following steps:
step S11: receiving an application program which is sent by a console and used for page screen recording;
in an exemplary embodiment, the composition architecture of the web system is shown in fig. 2, a client (browser end) is connected to a server through a gateway (or proxy protocol), and a website management background (console) is connected to the web system through the gateway, and the console stores an application program for screen recording of the client. For example, the console may send an application program for screen recording to the web system when the client is started, or may preset other trigger conditions for sending the application program; optionally, the application program received by the web system through the gateway may be stored to the client for generating a page interception instruction when an operation instruction triggered by the client is detected; the application program can also be stored in the server, meanwhile, the triggering operation instruction of the client is transmitted to the server through the gateway, and the server generates a page intercepting instruction according to the application program and the operation instruction.
The application program may include information such as user information of the client, a visited network address (url), an internet protocol (ip), and a domain name, and may generate a page interception instruction under a preset trigger condition, where the trigger condition may be an operation behavior performed on the client by a mouse, a keyboard, or a touch screen. Optionally, the application program may include address information of one or more clients in the web system, and may also include address information of all clients in the web system, and may selectively record some or all of the clients in the system. Optionally, the application program may intercept all changed pages of the client, and the operation signal that causes the page to change may include a page opening operation, a page scrolling operation, a page turning operation, a page editing operation, and an operation of selecting or copying partial information in the page, and for the above operations, the corresponding page to be intercepted may be a changed specific page; still alternatively, the page operation signal may also be a signal for playing a certain video in the page, and the corresponding intercepted page may be each video frame page of the played video. It is to be understood that what is intercepted by the method is any page in the browser that changes, and signing the exemplary listed page operation signal should not be understood as limiting the functionality of the intercepted page of the application.
Specifically, an rrweb basic video component implementation of an application program used for screen recording is realized, wherein the rrweb component application program comprises three modules, namely an rrweb module, an rrweb-snapshot module and an rrweb-player module, in the picture capturing process, the first screen DOM model is firstly snapped through the rrweb module, a DOM Tree of the whole page is traversed and is converted into JSON (JavaScript object notation) structural data through nodeType mapping, and meanwhile, the incrementally changed data is synchronously converted into JSON (JavaScript object notation) data for storage; and secondly, updating the incremental data after the snapshot of the first screen, acquiring DOM incremental changes through a mutator observer, hijacking the method (attributes) in a global event monitoring and event (attribute) proxy mode, and storing the hijacked incremental change data into JSON data. The screen recording is realized by recording the page structure and the behavior, so that the data operability is stronger (for example, the JSON product can be encrypted, compressed, segmented, removed and the like), and the multi-mode transmission (for example, segmented transmission and transmission of a designated service scene) can be performed. Meanwhile, the use scenes of page recording are rich, and the method can be used for positioning problems, product use analysis, automatic test recording, important information (operation) backup, multi-user cooperation and other scenes. And the rrweb component generates an operation flow of user operation behaviors, converts the user behaviors into a jso text form, and sends the jso text form to the Nginx proxy module of the Web service area, wherein the Nginx proxy module is used for intercepting illegal requests and transparently transmitting the legal requests to other application services. Illustratively, the application program may be executed in a specific integrated development environment in the screen display interface, for example, an application program including a code editor, a compiler, a debugger, and a graphic user interface tool for providing a program development environment.
Step S13: responding to an operation instruction triggered by a client, and generating a page interception instruction according to the application program and the operation instruction;
firstly, an operation instruction triggered by a client can be realized in various ways, for example, for terminal devices such as a notebook computer and a desktop computer, the operation instruction can be realized by operating through external devices such as a mouse and a keyboard; for terminal devices such as tablet computers and smart phones, the implementation manner may be to operate through a touch interface thereof.
Secondly, the operation instruction also has various existing forms, for example, the operation instruction can be a browser page opening instruction, a page scrolling instruction, a page turning instruction, a page editing instruction, and an instruction for selecting or copying partial information in the page, and for the instruction, the corresponding page to be intercepted is a specific page which changes; still alternatively, the operation instruction may also be an instruction for playing a video in the browser, and the corresponding cut-out page is each video frame of the played video. It is to be understood that, the above exemplary listed operation instructions are not to be construed as limiting the functions of the intercepted page of the present application, which is intercepted by the method and is any page that changes in the browser. Illustratively, if the operation instruction is a page copy or edit operation, generating a page intercept instruction according to the application program and the operation instruction in response to an operation instruction triggered by a client includes: and responding to a page copying or editing instruction triggered by a client, and generating a page intercepting instruction according to the application program and the page copying or editing instruction. For example, if the mouse is detected to have a click, double click, movement or scroll wheel scroll action, the intercepting program may sequentially intercept a square area of a page where a mouse cursor is located, a whole area of the page where the cursor is located, a movement track of the cursor, and a movement track of the page. Specifically intercepting which kind of page, the user can edit through the console, after the editing is finished, sending the self-defined application program to the server, and intercepting the corresponding page when triggering corresponding operation. Therefore, accumulation of data volume caused by continuous interception can be avoided, and data collection and processing are facilitated.
Step S15: and starting page interception of the browser through the page interception instruction, and generating a screen recording file according to the intercepted pages.
In an exemplary embodiment, the generating a screen recording file according to the intercepted plurality of pages includes: and generating a screen recording file with preset time length according to the plurality of intercepted pages. The size and the playing time length of the screen recording file can be preset in an application program sent to the web system by the console. The appropriate file size and playing time are set, so that audit tracing can be performed by using the screen recording file in the follow-up process. For example, the duration of the screen recording file can be set to 1 hour by referring to the test result, data recovery, performance test, personnel behavior and other factors. For example, in a case where the web system includes a plurality of clients, different time lengths for screen recording files of the clients may be set by the application program. Illustratively, the generating a screen recording file according to the intercepted plurality of pages may include: and generating screen recording files for the plurality of intercepted pages according to the time sequence of the intercepted pages. For example, if the duration information of the screen recording file to be generated is preset in the application program, the generating the screen recording file according to the plurality of intercepted pages includes: determining the number of pages for generating a screen recording file according to the duration information; and generating the screen recording file according to the number of pages.
In an exemplary embodiment, the browser-based screen recording method may further include: and sending the screen recording file to the console. Illustratively, the screen recording file contains cookie and domain name information of the browser, wherein the cookie is a "small text file" and is information that is stored on the user's local terminal by the website for Session tracking to identify the user's identity, and is temporarily or permanently saved by the user's client computer. Illustratively, an expiration date can be set as the playing time of the screen recording file, the timed transmission of data can detect whether the current cookie exists or is within the expiration date, and if the current cookie is expired, the updating cookies are sequentially operated in a circulating mode. Under the condition that the web system comprises a plurality of clients, the console identifies the corresponding client and the starting and ending positions of the screen recording file according to the cookie and the domain name information contained in the received screen recording file, so that the dislocation of the video recovery fragment is avoided. Illustratively, the screen recording file contains time information of the intercepted page, for example, a time stamp of millisecond level of the page is set, and whether the first piece of data is distinguished in a first joining type field of each screen recording file.
In an exemplary embodiment, before the sending the screen recording file to the console, the method further includes: and compressing the screen recording file by using a JavaScript data compression technology. The JavaScript data compression technique compresses the size of a page in a screen recording file by adjusting the resolution or the drawing quality of the page. Specifically, firstly, a page image in an uploaded screen recording file is acquired, the page image is converted into a base64 format code, and the resolution and compression quality of the page image are adjusted through Canvas conversion compression, so that a corresponding new image is generated. The method has the advantages of simple operation, configurable parameters, self-defined file size, capability of cutting a designated area and the like when the JavaScript data compression technology is used for compressing the screen recording file.
The console may decompress the compressed video file after receiving it to obtain the original video file. Specifically, a plurality of screen recording files with consistent domain names, user information and cookies are obtained firstly, then sorting is carried out according to timestamps, all operation records of a client are restored by taking the screen recording file defined as type as an initial file, and information such as the user information, the domain names, the urls, the ip addresses, the time information and the operation instruction types contained in the screen recording files are inquired.
In an exemplary embodiment, the method further comprises marking the operation behavior of the client. Specifically, if the length of the copied characters is within 20 when the mouse is used for copying, the server determines the personal information sensitive content (identification number, mobile phone number) and account password of the copied characters, and collects, marks and sends the sensitive content at regular time if the characters are the sensitive content. When the length of the mouse copy character is more than 20, the page data is directly collected and sent, and the copied character does not need to be marked. In addition, the input content is collected and marked when the keyboard is input, and the marked content is sent to the server, so that auditors can pay key attention to sensitive information. If new content appears during the page sliding, page data can be collected and sent. It should be noted that, the user may configure the sensitive information to be marked through the console, for example, the name, the bank card number, and the like, and the sensitive information to be marked is not specifically limited in the present application. The specific manner of marking is not particularly limited, and may be, for example, bold, enlarged, highlighted, or the like.
Another exemplary embodiment of the present application provides a browser-based screen recording method, including the following steps:
sending an application program for page screen recording to a server, so that the server responds to an operation instruction triggered by a client, and generating a page interception instruction according to the application program and the operation instruction; and starting page interception of the browser through the page interception instruction, and generating a screen recording file according to the intercepted pages.
In an exemplary embodiment, the browser-based screen recording method may further include:
receiving the screen recording file sent by the server;
and merging the screen recording files according to the time sequence of generating the screen recording files.
Another exemplary embodiment of the present application provides a browser-based screen recording method, including the following steps:
the control console sends an application program for page screen recording;
the server receives an application program which is sent by the console and used for page screen recording through the gateway;
responding to an operation instruction triggered by a client, and generating a page interception instruction by the server according to the application program and the operation instruction;
and the server starts page interception of the browser through the page interception instruction and generates a screen recording file according to the intercepted pages.
In an exemplary embodiment, the browser-based screen recording method may further include: and the server sends the screen recording file to the console.
In an exemplary embodiment, the browser-based screen recording method may further include: and the console receives the screen recording files sent by the server and merges a plurality of screen recording files according to the time sequence of generating the screen recording files.
It should be noted that although several steps and embodiments of the browser-based screen recording method are mentioned in the above detailed description, such division is not mandatory. Indeed, two or more of the steps described above may be combined in the same embodiment in accordance with an embodiment of the invention. Conversely, various embodiments described above may be further divided into one or more steps to embody the implementation. It is not required or implied that the steps must be performed in the particular order or that all illustrated steps be performed to achieve the desired results. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step for execution, and/or one step may be broken down into multiple steps for execution, etc., which are not described in any limiting sense in this application.
Another exemplary embodiment of the present application provides a browser-based screen recording device, and fig. 3 is a schematic structural diagram of a browser-based screen recording device in an exemplary embodiment of the present application. As shown in fig. 3, the browser-based screen recording apparatus 30 includes:
the receiving module 32 is configured to receive an application program sent by the console and used for page screen recording;
the instruction module 34 is configured to respond to an operation instruction triggered by a client, and generate a page interception instruction according to the application program and the operation instruction;
and the screen recording module 36 is configured to start page interception for the browser through the page interception instruction, and generate a screen recording file according to the intercepted multiple pages.
Another exemplary embodiment of the present application provides a browser-based screen recording apparatus, including:
the screen recording module is used for sending an application program for page screen recording to the server, so that the server responds to an operation instruction triggered by the client, generates a page intercepting instruction according to the application program and the operation instruction, starts page intercepting on the browser through the page intercepting instruction, and generates a screen recording file according to the intercepted multiple pages.
The details of each module/unit in the above device have been described in detail in the corresponding method section, and are not described herein again. It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the application. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
According to another aspect of the present application, there is provided a browser-based screen recording system, including:
the console is used for sending an application program for page screen recording;
the client is used for receiving an operation instruction triggered by a user and sending the operation instruction to the server;
a gateway for communicating between the console and the server, the client and the server;
the server is used for receiving the application program which is sent by the console and used for page screen recording through the gateway; responding to an operation instruction received by the gateway, and generating a page interception instruction according to the application program and the operation instruction; starting page interception of the browser through the page interception instruction, and generating a screen recording file according to a plurality of intercepted pages; and sending the screen recording file to the console.
In addition to the above-described methods and apparatus, embodiments of the present application may also be a computer program product comprising computer program instructions that, when executed by a processor, cause the processor to perform the steps in the methods according to the various embodiments of the present application described in the "exemplary methods" section of this specification, above.
The computer program product may be written with program code for performing the operations of embodiments of the present application in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server.
Another embodiment of the present application provides an electronic device, which may be used to perform all or part of the steps of the method or the network control method described in this example embodiment. The device comprises: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to perform steps in a method according to various embodiments of the present application described in the "exemplary method" set forth above in the specification.
Another implementation of the present application provides a computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, cause the processor to perform the steps in the method according to various embodiments of the present application described in the "exemplary method" described above in this specification.
The computer-readable storage medium may take any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may include, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The foregoing describes the general principles of the present application in conjunction with specific embodiments, however, it is noted that the advantages, effects, etc. mentioned in the present application are merely examples and are not limiting, and they should not be considered essential to the various embodiments of the present application. Furthermore, the foregoing disclosure of specific details is provided for purposes of illustration and understanding only, and is not intended to limit the application to the details which are set forth in order to provide a thorough understanding of the present application.
The block diagrams of devices, apparatuses, systems referred to in this application are only given as illustrative examples and are not intended to require or imply that the connections, arrangements, configurations, etc. must be made in the manner shown in the block diagrams. These devices, apparatuses, devices, systems may be connected, arranged, configured in any manner, as will be appreciated by those skilled in the art. Words such as "including," "comprising," "having," and the like are open-ended words that mean "including, but not limited to," and are used interchangeably herein. The words "or" and "as used herein mean, and are used interchangeably with, the word" and/or, "unless the context clearly dictates otherwise. The word "such as" is used herein to mean, and is used interchangeably with, the phrase "such as but not limited to".
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.
Claims (16)
1. A screen recording method based on a browser is characterized by comprising the following steps:
receiving an application program which is sent by a console and used for page screen recording;
responding to an operation instruction triggered by a client, and generating a page interception instruction according to the application program and the operation instruction;
and starting page interception of the browser through the page interception instruction, and generating a screen recording file according to the intercepted pages.
2. The browser-based screen recording method according to claim 1, wherein the duration information of the screen recording file to be generated is preset in the application program, and the generating of the screen recording file according to the plurality of intercepted pages includes:
determining the number of pages for generating a screen recording file according to the duration information; and generating the screen recording file according to the number of pages.
3. The browser-based screen recording method according to claim 1, further comprising:
and sending the screen recording file to the console.
4. The browser-based screen recording method according to claim 3, further comprising, before the sending the screen recording file to the console:
and compressing the screen recording file according to a JavaScript data compression technology.
5. The browser-based screen recording method according to claim 1, wherein the generating of the screen recording file according to the intercepted plurality of pages comprises:
and generating screen recording files for the plurality of intercepted pages according to the time sequence of the intercepted pages.
6. The browser-based screen recording method according to claim 1, wherein if the operation instruction is a page copy instruction, generating a page interception instruction according to the application program and the operation instruction in response to an operation instruction triggered by a client comprises:
and responding to a page copying instruction triggered by a client, and generating a page intercepting instruction according to the application program and the page copying instruction.
7. The browser-based screen recording method of claim 1, wherein the operation instruction is a page editing instruction, and generating a page intercepting instruction according to the application program and the operation instruction in response to an operation instruction triggered by a client comprises:
and responding to a page editing instruction triggered by a client, and generating a page intercepting instruction according to the application program and the page editing instruction.
8. A screen recording method based on a browser is characterized by comprising the following steps:
sending an application program for page screen recording to a server, so that the server responds to an operation instruction triggered by a client, and generating a page interception instruction according to the application program and the operation instruction; and starting page interception of the browser through the page interception instruction, and generating a screen recording file according to the intercepted pages.
9. The browser-based screen recording method according to claim 8, further comprising:
receiving a plurality of screen recording files sent by the server;
and merging the screen recording files according to the time sequence of generating the screen recording files.
10. A screen recording method based on a browser is characterized by comprising the following steps:
the console sends an application program for page screen recording;
the server receives an application program which is sent by the console and used for page screen recording through a gateway;
responding to an operation instruction triggered by a client, and generating a page interception instruction by the server according to the application program and the operation instruction;
and the server starts page interception of the browser through the page interception instruction and generates a screen recording file according to the intercepted pages.
11. The browser-based screen recording method according to claim 10, further comprising:
and the console receives the multiple screen recording files sent by the server and combines the multiple screen recording files according to the time sequence of generating the screen recording files.
12. A screen recording device based on a browser is characterized by comprising:
the receiving module is used for receiving an application program which is sent by the console and used for page screen recording;
the instruction module is used for responding to an operation instruction triggered by a client and generating a page interception instruction according to the application program and the operation instruction;
and the screen recording module is used for starting page interception of the browser through the page interception instruction and generating a screen recording file according to the intercepted pages.
13. A screen recording device based on a browser is characterized by comprising:
the screen recording module is used for sending an application program for page screen recording to a server so that the server responds to an operation instruction triggered by a client and generates a page intercepting instruction according to the application program and the operation instruction; and starting page interception of the browser through the page interception instruction, and generating a screen recording file according to the intercepted pages.
14. A browser-based screen recording system, comprising:
the console is used for sending an application program for page screen recording;
the client is used for receiving an operation instruction triggered by a user and sending the operation instruction to the server;
a gateway for communicating between the console and the server, the client and the server;
the server is used for receiving the application program which is sent by the console and used for page screen recording through the gateway; responding to an operation instruction received by the gateway, and generating a page interception instruction according to the application program and the operation instruction; starting page interception of the browser through the page interception instruction, and generating a screen recording file according to a plurality of intercepted pages; and sending the screen recording file to the console.
15. An electronic device, comprising:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the browser-based screen recording method of claims 1-12.
16. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the browser-based screen recording method of claims 1-12.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210323627.5A CN114692049A (en) | 2022-03-29 | 2022-03-29 | Browser-based screen recording method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210323627.5A CN114692049A (en) | 2022-03-29 | 2022-03-29 | Browser-based screen recording method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114692049A true CN114692049A (en) | 2022-07-01 |
Family
ID=82140457
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210323627.5A Pending CN114692049A (en) | 2022-03-29 | 2022-03-29 | Browser-based screen recording method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114692049A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115086752A (en) * | 2022-07-21 | 2022-09-20 | 南京百家云科技有限公司 | Recording method, system and storage medium for browser page content |
| CN115499698A (en) * | 2022-09-16 | 2022-12-20 | 中信百信银行股份有限公司 | Single app screen recording method and system capable of executing without sense |
| CN115686334A (en) * | 2022-10-31 | 2023-02-03 | 荣耀终端有限公司 | Operation control method, electronic device and readable storage medium |
| CN116739647A (en) * | 2023-08-16 | 2023-09-12 | 深圳市加推科技有限公司 | Marketing data intelligent analysis method and system |
-
2022
- 2022-03-29 CN CN202210323627.5A patent/CN114692049A/en active Pending
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115086752A (en) * | 2022-07-21 | 2022-09-20 | 南京百家云科技有限公司 | Recording method, system and storage medium for browser page content |
| CN115086752B (en) * | 2022-07-21 | 2022-11-08 | 南京百家云科技有限公司 | Recording method, system and storage medium for browser page content |
| CN115499698A (en) * | 2022-09-16 | 2022-12-20 | 中信百信银行股份有限公司 | Single app screen recording method and system capable of executing without sense |
| CN115499698B (en) * | 2022-09-16 | 2024-03-26 | 中信百信银行股份有限公司 | Single app screen recording method and system without sense of execution |
| CN115686334A (en) * | 2022-10-31 | 2023-02-03 | 荣耀终端有限公司 | Operation control method, electronic device and readable storage medium |
| CN115686334B (en) * | 2022-10-31 | 2023-11-28 | 荣耀终端有限公司 | Operation control method, electronic device and readable storage medium |
| CN116739647A (en) * | 2023-08-16 | 2023-09-12 | 深圳市加推科技有限公司 | Marketing data intelligent analysis method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114692049A (en) | Browser-based screen recording method and device, electronic equipment and storage medium | |
| US9553918B1 (en) | Stateful and stateless cookie operations servers | |
| CA2656539C (en) | Method and apparatus for monitoring and synchronizing user interface events with network data | |
| US9219787B1 (en) | Stateless cookie operations server | |
| EP1264261B1 (en) | Monitoring operation of and interaction with services provided over a network | |
| CN107085549B (en) | Method and device for generating fault information | |
| CA3152018A1 (en) | Business parameter collecting method, device, computer equipment and storage medium | |
| CN112486708B (en) | Page operation data processing method and processing system | |
| WO2021129335A1 (en) | Operation monitoring method and apparatus, operation analysis method and apparatus | |
| US20190289085A1 (en) | System and method for tracking online user behavior across browsers or devices | |
| US20130263156A1 (en) | Operation log collection method and device | |
| CN111078519A (en) | Method and device for backtracking abnormal monitoring behaviors and electronic equipment | |
| CN106778264A (en) | The application program analysis method and analysis system of a kind of mobile client | |
| CN110580318A (en) | Information display method and device and storage medium | |
| CN111858255A (en) | User behavior acquisition method based on screenshot and related equipment | |
| CN104834588A (en) | Permanent residence cross site script vulnerability detection method and apparatus | |
| CN111177623A (en) | Information processing method and device | |
| CN112905936A (en) | Page recording animation generation method, page operation log query method and computer equipment | |
| CN102547786A (en) | 3G (the 3rd Generation Telecommunication) flow analysis method and device of vehicle-mounted device | |
| KR101111956B1 (en) | System for providing substance about monitoring of computing device and method thereof | |
| CN115586941A (en) | Mobile terminal RN page screen recording playback method and device | |
| CN114531345B (en) | Flow comparison result storage method, device, equipment and storage medium | |
| CN112035205A (en) | Data processing method, device, equipment and storage medium | |
| CN101674594A (en) | DNS-based mobile data service monitoring system and method | |
| CN111565311B (en) | Network traffic characteristic generation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |