CN113050904A - Screen sharing method and device - Google Patents
Screen sharing method and device Download PDFInfo
- Publication number
- CN113050904A CN113050904A CN202110417155.5A CN202110417155A CN113050904A CN 113050904 A CN113050904 A CN 113050904A CN 202110417155 A CN202110417155 A CN 202110417155A CN 113050904 A CN113050904 A CN 113050904A
- Authority
- CN
- China
- Prior art keywords
- screen sharing
- operation information
- user operation
- browser
- cache
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The application provides a screen sharing method and a screen sharing device, which can be used in the financial field or other fields, and the method comprises the following steps: receiving a screen sharing request; acquiring a full page snapshot according to the screen sharing request, and sending the full page snapshot to a receiving terminal; acquiring user operation information by using a change observer of a browser, storing the user operation information in a cache of the browser, and acquiring the user operation information in a preset time period from the cache of the browser at regular time; and sending the user operation information to the receiving terminal so that the receiving terminal applies the user operation information and the full page snapshot to finish screen sharing. According to the screen sharing method and device, the screen sharing efficiency and the screen sharing convenience degree can be improved, and then the user experience can be improved.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a screen sharing method and apparatus.
Background
With the development of information technology, networks have become an important means for information dissemination. The remote control and operation interaction is used as a new interaction mode, so that a user can realize the same interaction and watching and operation in different places without being personally on the scene, wherein screen sharing is an important application in data sharing, and screen sharing refers to displaying information displayed on a screen of a sharing terminal on a screen of a receiving terminal in real time.
Generally, a user sharing screen is realized based on an operating system API and a client support for screen sharing, and if only operations on a browser in the temporary sharing screen are needed, for example, a user synchronizes own operations to developers when operating a website and having problems, the screen sharing is realized through the operating system API and the client, and the problems of low efficiency, high complexity and the like exist.
Disclosure of Invention
Aiming at the problems in the prior art, the application provides a screen sharing method and device, which can improve the screen sharing efficiency and the convenience degree, and further improve the user experience.
In order to solve the technical problem, the present application provides the following technical solutions:
in a first aspect, the present application provides a screen sharing method, including:
receiving a screen sharing request;
acquiring a full page snapshot according to the screen sharing request, and sending the full page snapshot to a receiving terminal;
acquiring user operation information by using a change observer of a browser, storing the user operation information in a cache of the browser, and acquiring the user operation information in a preset time period from the cache of the browser at regular time;
and sending the user operation information to the receiving terminal so that the receiving terminal applies the user operation information and the full page snapshot to finish screen sharing.
Further, the periodically obtaining the user operation information in a preset time period from the cache of the browser includes:
and obtaining user operation information in a preset time period from the cache of the browser at regular time by applying a requestAnimationFrame method.
Further, after the change viewer of the application browser collects user operation information and stores the user operation information in the cache of the browser, and periodically obtains the user operation information in a preset time period from the cache of the browser, the method further includes:
if the screen sharing stopping instruction is received, stopping the screen sharing.
Further, the user operation information includes: at least one of mouse movement, mouse interaction, page scrolling, window changing, and user input information.
In a second aspect, the present application provides a screen sharing apparatus, including:
the snapshot receiving module is used for receiving a screen sharing request;
the snapshot sending module is used for obtaining the full-amount snapshot of the page according to the screen sharing request and sending the full-amount snapshot of the page to the receiving terminal;
the operation information receiving module is used for acquiring user operation information by using a change observer of the browser, storing the user operation information in a cache of the browser, and acquiring the user operation information in a preset time period from the cache of the browser at regular time;
and the screen sharing module is used for sending the user operation information to the receiving terminal so that the receiving terminal applies the user operation information and the full page snapshot to finish screen sharing.
Further, the operation information receiving module is configured to apply a requestAnimationFrame method, and periodically obtain user operation information within a preset time period from a cache of the browser.
Further, the screen sharing apparatus further includes:
and the termination module is used for terminating the screen sharing if receiving the screen sharing termination instruction.
Further, the user operation information includes: at least one of mouse movement, mouse interaction, page scrolling, window changing, and user input information.
In a third aspect, the present application provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the screen sharing method when executing the program.
In a fourth aspect, the present application provides a computer readable storage medium having stored thereon computer instructions that, when executed, implement the screen sharing method.
According to the technical scheme, the application provides a screen sharing method and device. Wherein, the method comprises the following steps: receiving a screen sharing request; acquiring a full page snapshot according to the screen sharing request, and sending the full page snapshot to a receiving terminal; acquiring user operation information by using a change observer of a browser, storing the user operation information in a cache of the browser, and acquiring the user operation information in a preset time period from the cache of the browser at regular time; the user operation information is sent to the receiving terminal, so that the receiving terminal applies the user operation information and the full-page snapshot to complete screen sharing, the screen sharing efficiency and the convenience degree can be improved, and further the user experience can be improved; specifically, the operation information can be conveniently and timely synchronized to the receiving terminal of the developer when the user encounters a problem, the developer can quickly locate the reason of the problem according to the operation of the user, the operation efficiency is improved, a client does not need to be installed, and the device is light in weight and convenient to use.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart illustrating a screen sharing method according to an embodiment of the present application;
FIG. 2 is a flow chart illustrating a screen sharing method according to another embodiment of the present application;
FIG. 3 is a schematic structural diagram of a screen sharing apparatus according to an embodiment of the present application;
FIG. 4 is a schematic structural diagram of a screen sharing system in an application example of the present application;
FIG. 5 is a first flowchart of a screen sharing method in an application example of the present application;
FIG. 6 is a second flowchart of a screen sharing method in an application example of the present application;
fig. 7 is a schematic block diagram of a system configuration of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in the present specification, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Based on this, in order to improve the efficiency and flexibility of screen sharing and further improve user experience, an embodiment of the present application provides a screen sharing apparatus, where the apparatus may be a server or a client device, and the client device may include a smart phone, a tablet electronic device, a network set-top box, a portable computer, a desktop computer, a Personal Digital Assistant (PDA), an in-vehicle device, an intelligent wearable device, and the like. Wherein, intelligence wearing equipment can include intelligent glasses, intelligent wrist-watch and intelligent bracelet etc..
In practical applications, the screen sharing part may be performed on the server side as described above, or all operations may be performed in the client device. The selection may be specifically performed according to the processing capability of the client device, the limitation of the user usage scenario, and the like. This is not a limitation of the present application. The client device may further include a processor if all operations are performed in the client device.
The client device may have a communication module (i.e., a communication unit), and may be communicatively connected to a remote server to implement data transmission with the server. The server may include a server on the task scheduling center side, and in other implementation scenarios, the server may also include a server on an intermediate platform, for example, a server on a third-party server platform that is communicatively linked to the task scheduling center server. The server may include a single computer device, or may include a server cluster formed by a plurality of servers, or a server structure of a distributed apparatus.
The server and the client device may communicate using any suitable network protocol, including network protocols not yet developed at the filing date of this application. The network protocol may include, for example, a TCP/IP protocol, a UDP/IP protocol, an HTTP protocol, an HTTPS protocol, or the like. Of course, the network Protocol may also include, for example, an RPC Protocol (Remote Procedure Call Protocol), a REST Protocol (Representational State Transfer Protocol), and the like used above the above Protocol.
It should be noted that the screen sharing method and apparatus disclosed in the present application may be used in the field of financial technology, and may also be used in any field other than the field of financial technology.
The following examples are intended to illustrate the details.
In order to improve the efficiency and convenience of screen sharing and further improve the user experience, the embodiment provides a screen sharing method in which the execution subject is a screen sharing device, as shown in fig. 1, the method specifically includes the following steps:
step 100: a screen sharing request is received.
Specifically, a screen sharing request sent by a front end of the screen sharing apparatus may be received for starting screen sharing.
Step 200: and acquiring a full page snapshot according to the screen sharing request, and sending the full page snapshot to a receiving terminal.
Specifically, the DOM initial state full volume of the browser of the screen sharing device may be obtained, and the DOM initial state full volume is taken as the page full volume snapshot; the full snapshot of the page can be sent to a receiving terminal via a service terminal, the service terminal includes but is not limited to a server, and the receiving terminal can be a terminal device, such as a computer, a tablet computer, a mobile phone, and the like; the service terminal may store a correspondence between the screen sharing device and the receiving terminal, and may determine the receiving terminal corresponding to the screen sharing device according to the correspondence.
Step 300: the method comprises the steps of collecting user operation information by using a change observer of a browser, storing the user operation information in a cache of the browser, and obtaining the user operation information in a preset time period from the cache of the browser at regular time.
Specifically, the user operation information includes: at least one of mouse movement, mouse interaction, page scrolling, window changing, and user input information; the mouse movement information may include: cursor position before and after mouse movement; the mouse interaction information may include: a left mouse button triggering identifier, a right mouse button triggering identifier, a left double-click identifier and the like are used for determining whether the mouse is triggered; the page scrolling information may include: the offset of the scroll bar relative to the information presentation page; the window change may include: the length and height of the viewing window before and after alteration.
The user operation information can be acquired from the cache of the browser at regular time according to a certain time interval, the time interval can be set according to actual needs, and the time interval can be preferably within the range of 50-100 milliseconds; the preset time period can be a time range from the last time of obtaining the user operation information to the current time of obtaining the user operation information; the user operation information is user operation information corresponding to user operation in a preset time period, namely an incremental snapshot; after the browser is started, the real-time operation information of the user can be collected based on a variation observer multimedia observer of the browser of the screen sharing device, and is uploaded to a server to be stored or synchronized to at least one receiving terminal in real time, and the receiving terminal can be provided with a browser with the same model as the screen sharing device, so that light-weight screen sharing and operation sharing can be achieved.
Step 400: and sending the user operation information to the receiving terminal so that the receiving terminal applies the user operation information and the full page snapshot to finish screen sharing.
Specifically, the user operation information may be transmitted to a receiving terminal via a service terminal; the full-scale snapshot of the page can be restored to the receiving terminal, and the page restored by the receiving terminal is adjusted according to the received user operation information, so that screen sharing is realized.
In order to avoid the delay of screen sharing and improve the reliability of screen sharing, in an embodiment of the present application, the obtaining, at regular time, user operation information in a preset time period from the cache of the browser in step 300 includes:
step 301: and obtaining user operation information in a preset time period from the cache of the browser at regular time by applying a requestAnimationFrame method.
In order to further improve the reliability of screen sharing, referring to fig. 2, in an embodiment of the present application, after step 300, the method further includes:
step 500: if the screen sharing stopping instruction is received, stopping the screen sharing.
Specifically, the sharing suspend instruction may be sent by the front end of the screen sharing device; the sharing stop command may be received after step 300, or the sharing stop command sent by the front end may be received at any stage of the screen sharing method, and if the sharing stop command is received, the screen sharing is stopped.
In terms of software, in order to improve the efficiency and convenience of screen sharing and further improve user experience, the present application provides an embodiment of a screen sharing device for implementing all or part of the content in the screen sharing method, and referring to fig. 3, the screen sharing device specifically includes the following content:
and the snapshot receiving module 10 is configured to receive a screen sharing request.
And the snapshot sending module 20 is configured to obtain a full-page snapshot according to the screen sharing request, and send the full-page snapshot to the receiving terminal.
The operation information receiving module 30 is configured to collect user operation information by using a change viewer of a browser, store the user operation information in a cache of the browser, and periodically obtain the user operation information within a preset time period from the cache of the browser.
Wherein the user operation information includes: at least one of mouse movement, mouse interaction, page scrolling, window changing, and user input information.
And the screen sharing module 40 is configured to send the user operation information to the receiving terminal, so that the receiving terminal applies the user operation information and the full-page snapshot to complete screen sharing.
In an embodiment of the present application, the operation information receiving module is configured to periodically obtain, from a cache of the browser, user operation information within a preset time period by applying a requestanimation frame method.
In an embodiment of the present application, the screen sharing apparatus further includes:
and the termination module is used for terminating the screen sharing if receiving the screen sharing termination instruction.
The embodiment of the screen sharing apparatus provided in this specification may be specifically configured to execute the processing procedure of the embodiment of the screen sharing method, and the functions of the embodiment of the screen sharing apparatus are not described herein again, and refer to the detailed description of the embodiment of the screen sharing method.
To further illustrate the present solution, the present application provides an application example of a screen sharing system, referring to fig. 4, in the application example, the screen sharing system includes: a shared terminal 1, a service terminal 2, and a reception terminal 3; the service terminal 2 is in communication connection with the sharing terminal 1 and the receiving terminal 3 respectively; the functions realized by the sharing terminal may be equivalent to those realized by the screen sharing apparatus.
Specifically, the sharing terminal is used for collecting user operation behaviors, serializing the operation behaviors and transmitting the serialized operation behaviors to the service terminal; the service terminal is used for managing the information of the shared terminal and the receiving terminals and pushing the operation information collected by the shared terminal to a plurality of correct receiving terminals; the receiving terminal is used for playing back the operation information pushed from the service terminal on the page.
In combination with the screen sharing system, the application provides an application example of a screen sharing method, which is specifically described as follows:
as shown in fig. 5, the following steps are performed on the sharing terminal side:
s101: and sending the full-page snapshot.
Specifically, when a user starts operation sharing, the sharing terminal firstly saves the full DOM initial state of a browser of the sharing terminal and takes the full DOM initial state as a full page snapshot; and synchronizing the full-scale snapshot of the page to each receiving terminal through one-time synchronization of the service terminal and the receiving terminals.
S102: and collecting user operation information.
Monitoring all events changing the view based on the current view state to form an incremental snapshot; the method comprises the steps of recording actions (including DOM change, mouse movement, mouse interaction, page scrolling, window size change and user input) of a shared terminal by using a browser's MutationObserver interface, and temporarily storing the actions into a LocalStorage browser cache.
S103: and serializing the user operation information.
Specifically, the behavior records, i.e., the user operation information, accumulated by the shared terminal in this time slice are serialized at regular time.
S104: and sending the user operation information.
Specifically, the serialized user operation information is sent to the service terminal, and the serialization refers to converting DOM data into a specific text format (e.g., JSON) for convenient transmission.
S105: and judging whether the sharing is finished, if so, finishing, and if not, returning to execute the step S102.
Specifically, whether the user terminates the operation sharing is judged, if yes, the recording is terminated, and if not, the next time slice is entered for repeating the operation.
As shown in fig. 6, the following steps are performed at the receiving terminal side:
s201: the full snapshot of the page is synchronized.
Specifically, when the receiving terminal starts to join in the sharing, the receiving terminal firstly synchronizes the full-page snapshot of the sharing terminal to the local so as to ensure that the subsequently obtained incremental snapshot can be correctly restored.
S202: and receiving user operation information.
Specifically, push information of the service terminal is received through a websocket communication protocol.
S203: judging whether sharing is finished or not, if so, finishing the sharing; otherwise, step S204 is executed.
S204: and correcting the user operation information.
Specifically, if the user operation information is serialized data, time correction is performed on the serialized data, and since an incremental snapshot needs to be asynchronously replayed at a correct time each time, a high-precision timer is required, and a native setTimeout may not be accurately executed after a set delay time due to main thread blocking, a continuously calibrated timer is provided based on a requestAnimationFrame method, so that the replay delay of the incremental snapshot is guaranteed not to exceed one frame.
S205: and restoring the user operation information to the page, and returning to execute the step S202.
The service terminal is used for storing the corresponding relation between the sharing terminal and the receiving terminal and synchronizing the user operation information sent by the sharing terminal to the corresponding receiving terminal. The shared terminal transmits the user operation information to the service terminal in a timing polling mode, and the service terminal actively pushes the received user operation information to the receiving terminal through a websocket communication protocol. The receiving terminal restores the user operation information to the page, returns to execute step S202, and waits for the service terminal to push again.
According to the description, the screen sharing method and the screen sharing device can improve the screen sharing efficiency and the convenience degree, and further improve the user experience; specifically, the operation information can be conveniently and timely synchronized to the receiving terminal of the developer when the user encounters a problem, the developer can quickly locate the reason of the problem according to the operation of the user, the operation efficiency is improved, a client does not need to be installed, and the device is light in weight and convenient to use.
In terms of hardware, in order to improve efficiency and flexibility of screen sharing and further improve user experience, the present application provides an embodiment of an electronic device for implementing all or part of contents in the screen sharing method, where the electronic device specifically includes the following contents:
a processor (processor), a memory (memory), a communication Interface (Communications Interface), and a bus; the processor, the memory and the communication interface complete mutual communication through the bus; the communication interface is used for realizing information transmission among the screen sharing device, the user terminal and other related equipment; the electronic device may be a desktop computer, a tablet computer, a mobile terminal, and the like, but the embodiment is not limited thereto. In this embodiment, the electronic device may be implemented with reference to the embodiment for implementing the screen sharing method and the embodiment for implementing the screen sharing apparatus in the embodiments, and the contents thereof are incorporated herein, and repeated details are not repeated.
Fig. 7 is a schematic block diagram of a system configuration of an electronic device 9600 according to an embodiment of the present application. As shown in fig. 7, the electronic device 9600 can include a central processor 9100 and a memory 9140; the memory 9140 is coupled to the central processor 9100. Notably, this fig. 7 is exemplary; other types of structures may also be used in addition to or in place of the structure to implement telecommunications or other functions.
In one or more embodiments of the present application, the screen sharing functionality can be integrated into the central processor 9100. The central processor 9100 may be configured to control as follows:
step 100: a screen sharing request is received.
Step 200: and acquiring a full page snapshot according to the screen sharing request, and sending the full page snapshot to a receiving terminal.
Step 300: the method comprises the steps of collecting user operation information by using a change observer of a browser, storing the user operation information in a cache of the browser, and obtaining the user operation information in a preset time period from the cache of the browser at regular time.
Step 400: and sending the user operation information to the receiving terminal so that the receiving terminal applies the user operation information and the full page snapshot to finish screen sharing.
As can be seen from the above description, the electronic device provided in the embodiments of the present application can improve the screen sharing efficiency and flexibility, and further improve the user experience.
In another embodiment, the screen sharing device may be configured separately from the central processor 9100, for example, the screen sharing device may be configured as a chip connected to the central processor 9100, and the screen sharing function is realized by the control of the central processor.
As shown in fig. 7, the electronic device 9600 may further include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is noted that the electronic device 9600 also does not necessarily include all of the components shown in fig. 7; further, the electronic device 9600 may further include components not shown in fig. 7, which may be referred to in the art.
As shown in fig. 7, a central processor 9100, sometimes referred to as a controller or operational control, can include a microprocessor or other processor device and/or logic device, which central processor 9100 receives input and controls the operation of the various components of the electronic device 9600.
The memory 9140 can be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information relating to the failure may be stored, and a program for executing the information may be stored. And the central processing unit 9100 can execute the program stored in the memory 9140 to realize information storage or processing, or the like.
The input unit 9120 provides input to the central processor 9100. The input unit 9120 is, for example, a key or a touch input device. Power supply 9170 is used to provide power to electronic device 9600. The display 9160 is used for displaying display objects such as images and characters. The display may be, for example, an LCD display, but is not limited thereto.
The memory 9140 can be a solid state memory, e.g., Read Only Memory (ROM), Random Access Memory (RAM), a SIM card, or the like. There may also be a memory that holds information even when power is off, can be selectively erased, and is provided with more data, an example of which is sometimes called an EPROM or the like. The memory 9140 could also be some other type of device. Memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application/function storage portion 9142, the application/function storage portion 9142 being used for storing application programs and function programs or for executing a flow of operations of the electronic device 9600 by the central processor 9100.
The memory 9140 can also include a data store 9143, the data store 9143 being used to store data, such as contacts, digital data, pictures, sounds, and/or any other data used by an electronic device. The driver storage portion 9144 of the memory 9140 may include various drivers for the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging applications, contact book applications, etc.).
The communication module 9110 is a transmitter/receiver 9110 that transmits and receives signals via an antenna 9111. The communication module (transmitter/receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, which may be the same as in the case of a conventional mobile communication terminal.
Based on different communication technologies, a plurality of communication modules 9110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, may be provided in the same electronic device. The communication module (transmitter/receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide audio output via the speaker 9131 and receive audio input from the microphone 9132, thereby implementing ordinary telecommunications functions. The audio processor 9130 may include any suitable buffers, decoders, amplifiers and so forth. In addition, the audio processor 9130 is also coupled to the central processor 9100, thereby enabling recording locally through the microphone 9132 and enabling locally stored sounds to be played through the speaker 9131.
As can be seen from the above description, the electronic device provided in the embodiment of the present application can improve the screen sharing efficiency and flexibility, and further improve the user experience.
An embodiment of the present application further provides a computer-readable storage medium capable of implementing all the steps in the screen sharing method in the foregoing embodiment, where the computer-readable storage medium stores thereon a computer program, and when the computer program is executed by a processor, the computer program implements all the steps in the screen sharing method in the foregoing embodiment, for example, when the processor executes the computer program, the processor implements the following steps:
step 100: a screen sharing request is received.
Step 200: and acquiring a full page snapshot according to the screen sharing request, and sending the full page snapshot to a receiving terminal.
Step 300: the method comprises the steps of collecting user operation information by using a change observer of a browser, storing the user operation information in a cache of the browser, and obtaining the user operation information in a preset time period from the cache of the browser at regular time.
Step 400: and sending the user operation information to the receiving terminal so that the receiving terminal applies the user operation information and the full page snapshot to finish screen sharing.
As can be seen from the above description, the computer-readable storage medium provided in the embodiments of the present application can improve the screen sharing efficiency and flexibility, and further improve the user experience.
In the present application, each embodiment of the method is described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. Reference is made to the description of the method embodiments.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The principle and the implementation mode of the present application are explained by applying specific embodiments in the present application, and the description of the above embodiments is only used to help understanding the method and the core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (10)
1. A screen sharing method, comprising:
receiving a screen sharing request;
acquiring a full page snapshot according to the screen sharing request, and sending the full page snapshot to a receiving terminal;
acquiring user operation information by using a change observer of a browser, storing the user operation information in a cache of the browser, and acquiring the user operation information in a preset time period from the cache of the browser at regular time;
and sending the user operation information to the receiving terminal so that the receiving terminal applies the user operation information and the full page snapshot to finish screen sharing.
2. The screen sharing method according to claim 1, wherein the periodically obtaining the user operation information in a preset time period from the cache of the browser comprises:
and obtaining user operation information in a preset time period from the cache of the browser at regular time by applying a requestAnimationFrame method.
3. The screen sharing method according to claim 1, wherein after the change viewer of the application browser collects user operation information and stores the user operation information in a cache of the browser, and periodically obtains the user operation information within a preset time period from the cache of the browser, the method further comprises:
if the screen sharing stopping instruction is received, stopping the screen sharing.
4. The screen sharing method according to claim 1, wherein the user operation information includes: at least one of mouse movement, mouse interaction, page scrolling, window changing, and user input information.
5. A screen sharing apparatus, comprising:
the snapshot receiving module is used for receiving a screen sharing request;
the snapshot sending module is used for obtaining the full-amount snapshot of the page according to the screen sharing request and sending the full-amount snapshot of the page to the receiving terminal;
the operation information receiving module is used for acquiring user operation information by using a change observer of the browser, storing the user operation information in a cache of the browser, and acquiring the user operation information in a preset time period from the cache of the browser at regular time;
and the screen sharing module is used for sending the user operation information to the receiving terminal so that the receiving terminal applies the user operation information and the full page snapshot to finish screen sharing.
6. The screen sharing apparatus of claim 5, wherein the operation information receiving module is configured to receive the operation information
And obtaining user operation information in a preset time period from the cache of the browser at regular time by applying a requestAnimationFrame method.
7. The screen sharing apparatus of claim 5, further comprising:
and the termination module is used for terminating the screen sharing if receiving the screen sharing termination instruction.
8. The screen sharing apparatus according to claim 5, wherein the user operation information includes: at least one of mouse movement, mouse interaction, page scrolling, window changing, and user input information.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the screen sharing method of any one of claims 1 to 4 when executing the program.
10. A computer readable storage medium having computer instructions stored thereon that, when executed, implement the screen sharing method of any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110417155.5A CN113050904A (en) | 2021-04-19 | 2021-04-19 | Screen sharing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110417155.5A CN113050904A (en) | 2021-04-19 | 2021-04-19 | Screen sharing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113050904A true CN113050904A (en) | 2021-06-29 |
Family
ID=76519817
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110417155.5A Pending CN113050904A (en) | 2021-04-19 | 2021-04-19 | Screen sharing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113050904A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114253497A (en) * | 2021-12-08 | 2022-03-29 | 科大讯飞股份有限公司 | Multi-screen interaction method, device, equipment, system and storage medium |
| WO2024082888A1 (en) * | 2022-10-19 | 2024-04-25 | 北京字跳网络技术有限公司 | Content sharing method and apparatus, and device and medium |
-
2021
- 2021-04-19 CN CN202110417155.5A patent/CN113050904A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114253497A (en) * | 2021-12-08 | 2022-03-29 | 科大讯飞股份有限公司 | Multi-screen interaction method, device, equipment, system and storage medium |
| WO2024082888A1 (en) * | 2022-10-19 | 2024-04-25 | 北京字跳网络技术有限公司 | Content sharing method and apparatus, and device and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021082584A1 (en) | Message exchange method and apparatus, readable medium, and electronic device | |
| CN111031058A (en) | Websocket-based distributed server cluster interaction method and device | |
| US20150163379A1 (en) | Time synchronization of video and data inside a mobile device | |
| CN103546453A (en) | Cross-device multimedia playing method and device | |
| CN113050904A (en) | Screen sharing method and device | |
| CN110809189B (en) | Video playing method and device, electronic equipment and computer readable medium | |
| CN103905835A (en) | Progress preview method, device and system for video player | |
| CN108900855B (en) | Live content recording method and device, computer readable storage medium and server | |
| CN112995759A (en) | Interactive service processing method, system, device, equipment and storage medium | |
| CN113645481B (en) | Video recording method, camera equipment, control terminal and video recording system | |
| CN111309747A (en) | Data synchronization method, system and device | |
| CN113893524B (en) | Cloud application processing system, method, device and equipment | |
| CN112969093A (en) | Interactive service processing method, device, equipment and storage medium | |
| CN112689012A (en) | Cross-network proxy communication method and device | |
| EP3040877A1 (en) | Method and system for processing associated content | |
| CN202444580U (en) | System, terminal and server capable of acquiring television program screenshot | |
| CN102387174A (en) | Micro-piece for automatically upgrading information of social network site and method thereof | |
| CN108809815B (en) | Method for updating unread number of session, session processing method, device and system | |
| CN110071959B (en) | Method and device for timing synchronization of third-party national standard resources | |
| CN112559158A (en) | Micro-service timing task scheduling method and device | |
| CN104639973B (en) | Information pushing method and device | |
| CN115082038A (en) | System integration method and device and electronic equipment | |
| CN112416641B (en) | Method for detecting restarting of controlled end node in master-slave architecture and master control end node | |
| CN115240850A (en) | Information processing method and device, wearable device and electronic device | |
| CN113596583A (en) | Video stream bullet time data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |