WO2019242054A1

WO2019242054A1 - Method and system for synchronous annotation of screen content between multiple devices

Info

Publication number: WO2019242054A1
Application number: PCT/CN2018/095599
Authority: WO
Inventors: 袁智鹏; 彭国锋
Original assignee: 广州华欣电子科技有限公司
Priority date: 2018-06-20
Filing date: 2018-07-13
Publication date: 2019-12-26
Also published as: CN108769782A

Abstract

Disclosed is a method for synchronous annotation of screen content between multiple devices, comprising a first terminal acquiring screen content, and sending the screen content to a server; a second terminal receiving the screen content sent by the server, and displaying the screen content by means of a display; the first terminal acquiring annotation information corresponding to the screen content, and sending the annotation information to the server; and the second terminal receiving the annotation information sent by the server, and superposing the annotation information on the screen content, and displaying the annotation information by means of the display. By means of the method, establishing a connection relationship between multiple devices, effectively achieving synchronous annotation of screen content between the multiple devices, better facilitating a user conference, and further improving working efficiency. A system for synchronous annotation of screen content between multiple devices also having the above-mentioned beneficial effects.

Description

Method and system for synchronously annotating screen contents among multiple devices

This application claims the priority of a Chinese patent application filed on June 20, 2018 with the Chinese Patent Office, application number 201810635671.3, and the invention name "A Method and System for Synchronous Annotation of Screen Content Between Multiple Devices", all of which passed Citations are incorporated in this application.

Technical field

The present application relates to the technical field of multi-device data interaction, in particular to a method for synchronously annotating screen content between multiple devices, and also relates to a system for synchronously annotating screen content between multiple devices.

Background technique

With the rapid development of computer networks, the information interaction technology between multiple devices has become increasingly mature. For example, related information can be transmitted between multiple devices through a local area network. Specifically, when information sharing and information interaction are required, multiple The device that is the sender of each device first sends the target information to be transmitted to the back-end server, and then the back-end server forwards it to other devices to further realize information sharing between multiple devices.

However, the above information interaction methods cannot meet the real-time synchronization and sharing of related information between multiple devices. When faced with multiple people working online and editing documents online, it is particularly important for information sharing between multiple devices to achieve synchronous sharing. For example, in a multi-person conference, if one user edits the documents in one of them through one of the devices, other users cannot know the editing information in time, which brings a lot of inconvenience to the user and reduces the conference. effectiveness.

Therefore, how to establish a connection between multiple devices and further implement synchronous annotation of screen content between multiple devices to improve work efficiency is a problem that needs to be solved by those skilled in the art.

Summary of the Invention

The purpose of this application is to provide a method for synchronously annotating screen content between multiple devices. This method establishes a connection relationship between multiple devices, effectively implements synchronous annotation of screen content between multiple devices, and is more convenient for user conferences to be further improved. Work efficiency; another object of the present application is to provide a system for synchronously annotating documents between multiple devices, all of which have the above beneficial effects.

In order to solve the above technical problems, the present application provides a method for synchronously annotating screen contents between multiple devices, and the method includes:

The first terminal acquires screen content and sends the screen content to a server;

The second terminal receives the screen content sent by the server, and displays the screen content through a display;

Acquiring, by the first terminal, annotation information corresponding to the screen content, and sending the annotation information to the server;

The second terminal receives the annotation information sent by the server, superimposes the annotation information on the screen content, and displays the annotation information through the display.

Preferably, after the first terminal acquires the screen content, the method further includes: the first terminal encodes the screen content to obtain the encoded screen content;

After the second terminal receives the screen content sent by the server, the method further includes: the second terminal decoding the encoded screen content to obtain the screen content.

Preferably, after the first terminal acquires the annotation information corresponding to the screen content, the method further includes: the first terminal packages the annotation information to obtain packaged annotation information;

After receiving the annotation information sent by the server, the second terminal further includes: parsing the packed annotation information by the second terminal to obtain the annotation information.

Preferably, when the number of the first terminals is multiple, the server receives the annotation information sent by each of the first terminals;

Performing fusion processing on each of the annotation information to obtain total annotation information;

Sending the total annotation information to the first terminal and the second terminal.

Preferably, the server saves the screen content and the annotation information to its own cache.

Preferably, the first terminal sends the screen content and the annotation information to the server through a wireless network;

Receiving, by the second terminal, the screen content and the annotation information sent by the server through the wireless network.

In order to solve the above technical problems, the present application also provides a system for synchronously annotating screen content between multiple devices, the system includes:

A first terminal, configured to obtain screen content and send the screen content to a server; obtain annotation information corresponding to the screen content, and send the annotation information to the server;

A second terminal, configured to receive the screen content sent by the server and display the screen content through a display; receive the annotation information sent by the server, superimpose the annotation information on the screen content, and Displaying the annotation information through the display;

The server is configured to receive the screen content and the annotation information sent by the first terminal, and send the screen content and the annotation information to the second terminal.

Preferably, the server is further configured to receive annotation information sent by each of the first terminals when the number of the first terminals is multiple; perform fusion processing on each of the annotation information to obtain total annotation information; The total annotation information is sent to the first terminal and the second terminal.

Preferably, the server is further configured to save the screen content and the annotation information to its own cache.

Preferably, the first terminal is specifically configured to send the screen content and the annotation information to the server through a wireless network;

The second terminal is specifically configured to receive the screen content and the annotation information sent by the server through the wireless network.

A method for synchronously annotating screen content between multiple devices provided in this application includes a first terminal acquiring screen content and sending the screen content to a server; a second terminal receiving the screen content sent by the server, and Displaying the screen content through a display; the first terminal acquiring the annotation information corresponding to the screen content and sending the annotation information to the server; the second terminal receiving the annotation information sent by the server , Superimposing the annotation information on the screen content, and displaying the annotation information through the display.

It can be seen that after the technical solutions provided in this application establish a connection between each user terminal and the server, the server first realizes the synchronous sharing of screen content between multiple devices, and then realizes the synchronous sharing of annotation information between multiple devices. The second terminal superimposes the annotation information and the screen content, thereby realizing the synchronous annotation of the screen content between multiple devices. During the multi-person conference, the simultaneous annotation of the screen content between the multiple devices is more conducive to the smooth progress of the user conference. To further improve work efficiency.

The system for synchronizing and annotating screen contents between multiple devices provided in the present application also has the above-mentioned beneficial effects, and details are not described herein again.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to explain the technical solutions in the embodiments of the present application or the prior art more clearly, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are merely It is an embodiment of the present application. For those of ordinary skill in the art, other drawings can be obtained according to the provided drawings without paying creative labor.

FIG. 1 is a schematic flowchart of a method for synchronously annotating screen content between multiple devices provided by this application;

FIG. 2 is a schematic flowchart of another method for synchronously annotating screen content between multiple devices provided by this application; FIG.

FIG. 3 is a schematic flowchart of still another method for synchronously annotating screen content between multiple devices provided by the present application; FIG.

4 is a schematic diagram of a system for simultaneously annotating screen content between multiple devices provided by the present application;

5 is a schematic structural diagram of a user terminal provided by this application;

FIG. 6 is a schematic structural diagram of a server provided by this application.

detailed description

The core of the present application is to provide a method for synchronously annotating screen content between multiple devices. This method establishes a connection relationship between multiple devices, and effectively implements synchronous annotation of screen content between multiple devices, which is more convenient for user meetings and further improves Work efficiency; another core of the present application is to provide a system for synchronously annotating screen contents among multiple devices, all of which have the above-mentioned beneficial effects.

In order to make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments These are part of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

Please refer to FIG. 1. FIG. 1 is a schematic flowchart of a method for synchronously annotating screen content between multiple devices provided by this application. The method may include:

S101: The first terminal acquires screen content and sends the screen content to a server;

S102: The second terminal receives the screen content sent by the server, and displays the screen content through the display;

Specifically, the user terminal that needs to share screen content annotations is used as the first terminal, and the user terminal that is shared with screen content annotations is used as the second terminal. After each user terminal establishes a connection with the server, the first terminal obtains the screen content of its own display. , And send it to the server, which will be processed by the server and then forwarded to the second terminal, the second terminal can display the screen content through its own display, thereby realizing the screen content between multiple devices Sync sharing.

In addition, the number of the first terminals and the second terminals does not affect the implementation of the technical solution, which is not specifically limited in this application.

Optionally, please refer to FIG. 2. FIG. 2 is a schematic flowchart of another method for synchronously annotating screen content between multiple devices provided in this application. As shown in steps S201 to S202, after the first terminal acquires screen content, It may also include the first terminal encoding the screen content to obtain the encoded screen content; after receiving the screen content sent by the server, the second terminal may further include the second terminal to decode the encoded screen content to obtain the screen content.

Specifically, after acquiring the screen content and before sending the screen content to the server, the first terminal may first encode the screen content to obtain the encoded screen content for information transmission, and then send the encoded screen content to the server. . Correspondingly, after receiving the encoded screen content sent by the server, the second terminal first decodes it to obtain displayable screen content, and finally displays it on its own display.

S103: The first terminal acquires the annotation information corresponding to the screen content, and sends the annotation information to the server;

S104: The second terminal receives the annotation information sent by the server, superimposes the annotation information on the screen content, and displays the annotation information on the display.

Specifically, after the screen content is synchronized and shared between the user terminals, the first terminal and the second terminal display the same interface, and at this time, the annotation information can be synchronized and shared. First, the first terminal creates a new transparent view on the display interface of its own display. When the user annotates the screen content on the display interface, the user can obtain the annotation information corresponding to the above screen content and send it to the server. It performs corresponding processing and then forwards it to the second terminal, and the second terminal can superimpose the received annotation information on the current screen content displayed on its own display to display the above annotation information based on the current screen content. That is, the synchronous sharing of annotation information between multiple devices can be achieved, and the synchronous annotation of screen contents between multiple devices can be further realized.

Optionally, please refer to FIG. 2, as shown in steps S203 to S204, after the first terminal obtains the annotation information corresponding to the screen content, the first terminal may further include the first terminal to perform the package processing on the annotation information to obtain the packaged annotation information; the second After receiving the annotation information sent by the server, the terminal may further include parsing the packed annotation information by the second terminal to obtain the annotation information.

Specifically, after acquiring the annotation information, before sending the annotation information to the server, the first terminal may first package and encapsulate the annotation information, obtain the package annotation information that can be transmitted, and then send the package annotation information to server. Correspondingly, after receiving the packaged annotation information sent by the server, the second terminal first analyzes it to obtain displayable annotation information, and finally superimposes it on the screen content currently displayed on its own display and displays it.

Optionally, the server saves the screen content and annotation information to its own cache.

Specifically, after receiving the above screen content and its corresponding annotation information, the server can save it to its own cache to implement the meeting record function; in addition, it can also according to different types of shared data, such as videos, documents, pictures It can be classified and saved according to different sources, and can also be classified and saved according to different sources of different annotation information, which is more convenient for users to carry out later work.

Optionally, the method for synchronously annotating screen content between multiple devices may further include: the first terminal sends screen content and annotation information to a server through a wireless network; and the second terminal receives screen content and annotation information sent by the server through a wireless network.

Specifically, a wireless connection can be established between each user terminal and the server, so that the first terminal can send screen content and annotation information to the server through the wireless network, and the second terminal can also receive the screen sent by the server through the wireless network. Content and annotation information. The specific implementation of the wireless connection is not limited in this application, and can be implemented through a wireless routing network, or by setting a wireless network card.

It should be noted that the above wireless connection method is only one implementation provided in this application, and is not unique. The user may also establish a wired connection between each user terminal and the server according to the actual situation, which is not limited in this application. .

The method for synchronously annotating screen content between multiple devices provided in the present application, after each user terminal establishes a connection with a server, firstly realize the synchronization and sharing of screen content between multiple devices through the server, and then synchronously share annotation information between multiple devices, and finally The second terminal as the receiver superimposes the annotation information and the screen content, thereby realizing the synchronous annotation of the screen content between multiple devices. During the multi-person conference, the simultaneous annotation of the screen content between the multiple devices is more beneficial. The smooth progress of user meetings has further improved work efficiency.

Based on the above embodiments, please refer to FIG. 3, which is a schematic flowchart of another method for synchronizing annotations on screen content between multiple devices provided by the present application.

As a preferred implementation example, when the number of the first terminals is multiple, the server receives the annotation information sent by each first terminal; performs fusion processing on each annotation information to obtain the total annotation information; and sends the total annotation information to the first Terminal and second terminal.

Specifically, when the number of the first terminals is multiple, that is, the above-mentioned screen content annotations that need to be shared synchronously come from different user terminals, in order to avoid conflicts, after the server receives the annotation information sent from each first terminal, First, each annotation information is fused to obtain the total annotation information, and then the total annotation information is sent to a second terminal for display. Specifically, taking the number of the first terminals as two as an example, please refer to FIG. 3. After the screen content is synchronized and shared, the first terminal 11 and the first terminal 12 respectively create new transparent views and collect annotation information of their respective displays. After the annotation information is packaged, it is sent to the server 13 through the network, and the server 13 performs fusion processing on each annotation information to obtain the total annotation information, and caches it, and further forwards the total annotation information to the first terminal 11, the first terminal 12, and the first terminal. The two terminals 14, whereby each user terminal superimposes the acquired total annotation information on the screen content currently displayed on its own display, and simultaneously displays it, thereby realizing the simultaneous annotation of the screen content among multiple devices.

In order to solve the above problem, please refer to FIG. 4, which is a schematic diagram of a system for synchronously annotating screen content between multiple devices provided by the present application. The system may include:

The first terminal 10 is configured to acquire the screen content and send the screen content to the server 20; acquire the annotation information corresponding to the screen content and send the annotation information to the server 20;

The second terminal 30 is configured to receive the screen content sent by the server 20 and display the screen content through the display; receive the annotation information sent by the server 20, superimpose the annotation information on the screen content, and display the annotation information through the display;

The server 20 is configured to receive the screen content and the annotation information sent by the first terminal 10, and send the screen content and the annotation information to the second terminal 30.

As a preferred embodiment, the first terminal 10 is further configured to encode the screen content to obtain the encoded screen content; the second terminal 30 is further configured to decode the encoded screen content to obtain the screen content.

As a preferred embodiment, the first terminal 10 is further configured to perform package processing on the annotation information to obtain the packaged annotation information; and the second terminal 30 is further configured to parse the packaged annotation information to obtain the annotation information.

As a preferred embodiment, the server 20 is further configured to receive annotation information sent by each first terminal 10 when the number of the first terminals 10 is multiple; perform fusion processing on each annotation information to obtain total annotation information; The annotation information is sent to the second terminal 30.

As a preferred embodiment, the server 20 is further configured to save the screen content and the annotation information to its own cache.

As a preferred embodiment, the first terminal 10 is specifically configured to send screen content and annotation information to the server 20 through a wireless network; the second terminal 30 is specifically configured to receive screen content and annotation information sent by the server 20 through a wireless network.

Based on the above embodiments, please refer to FIG. 5. FIG. 5 is a schematic structural diagram of a user terminal provided by this application. The user terminal may include a user input device 21, a client network connection device 22, and a display device 23. And a client application 24, in which the user input device 21 may include a mouse, a keyboard, a touch screen, etc., the application does not limit the selection of the user input device 21; further, the user may implement related information through the user input device 21 Input; the client network connection device 22 can realize the connection between the user terminal and the wireless network; the display device 23 can display the screen content and its annotation information; the client application program 24 can include a client data acquisition module 241, a client Data processing module 242 and annotation module 243, where client data acquisition module 241 is responsible for collecting screen content and annotation information, and client data processing module 242 is responsible for processing, packaging, encoding, and decoding screen content and annotation information. Module 243 can be used to make new transparent views for editing such as annotations Management.

Further, please refer to FIG. 6. FIG. 6 is a schematic structural diagram of a server provided by the present application. The server may include a server-side network connection device 31, a memory 32, and a server-side application program 33. Among them, the network server-side network connection device. 31 can be used to connect the server to the wireless network; memory 32 can realize the storage of screen content and its annotation information, and the server-side application program 33 includes a server-side data processing module 331, which can be used to implement the forwarding of screen content and its annotation information. Fusion processing of related data information.

For the introduction of the system provided in this application, please refer to the foregoing method embodiments, which are not described in this application.

Each embodiment in the specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other. As for the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant part may refer to the description of the method.

Professionals may further realize that the units and algorithm steps of the examples described in connection with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the hardware and software, Interchangeability. In the above description, the composition and steps of each example have been described generally in terms of functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. A professional technician can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

The steps of the method or algorithm described in connection with the embodiments disclosed herein may be directly implemented by hardware, a software module executed by a processor, or a combination of the two. Software modules can be placed in random access memory (RAM), memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disks, removable disks, CD-ROMs, or in technical fields Any other form of storage medium is known.

The method and system for synchronously annotating screen content between multiple devices provided in this application have been described in detail above. Specific examples are used herein to explain the principle and implementation of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core ideas. It should be noted that for those of ordinary skill in the art, without departing from the principles of the present application, several improvements and modifications can be made to the application, and these improvements and modifications also fall into the protection scope of the claims of the application.

Claims

A method for synchronously annotating screen content between multiple devices, which includes:

The first terminal acquires screen content and sends the screen content to a server;

The second terminal receives the screen content sent by the server, and displays the screen content through a display;

Acquiring, by the first terminal, annotation information corresponding to the screen content, and sending the annotation information to the server;

The second terminal receives the annotation information sent by the server, superimposes the annotation information on the screen content, and displays the annotation information through the display.
The method according to claim 1, wherein after the first terminal obtains the screen content, the method further comprises: the first terminal encodes the screen content to obtain the encoded screen content;

After the second terminal receives the screen content sent by the server, the method further includes: the second terminal decoding the encoded screen content to obtain the screen content.
The method according to claim 2, wherein after the first terminal obtains the annotation information corresponding to the screen content, the method further comprises: the first terminal packs the annotation information to obtain packed annotation information. ;

After receiving the annotation information sent by the server, the second terminal further includes: parsing the packed annotation information by the second terminal to obtain the annotation information.
The method according to any one of claims 1 to 3, further comprising:

When the number of the first terminals is multiple, the server receives the annotation information sent by each of the first terminals;

Performing fusion processing on each of the annotation information to obtain total annotation information;

Sending the total annotation information to the first terminal and the second terminal.
The method according to claim 4, further comprising:

The server saves the screen content and the annotation information to its own cache.
The method according to claim 5, wherein the first terminal sends the screen content and the annotation information to the server through a wireless network;

The second terminal receives the screen content and the annotation information sent by the server through the wireless network.
A system for synchronously annotating screen content between multiple devices, which includes:

A first terminal, configured to acquire screen content and send the screen content to a server; acquire annotation information corresponding to the screen content, and send the annotation information to the server;

A second terminal, configured to receive the screen content sent by the server and display the screen content through a display; receive the annotation information sent by the server, superimpose the annotation information on the screen content, and Displaying the annotation information through the display;

The server is configured to receive the screen content and the annotation information sent by the first terminal, and send the screen content and the annotation information to the second terminal.
The system according to claim 7, wherein the server is further configured to receive annotation information sent by each of the first terminals when the number of the first terminals is multiple; and for each of the annotation information Perform fusion processing to obtain total annotation information; and send the overall annotation information to the first terminal and the second terminal.
The system according to claim 8, wherein the server is further configured to save the screen content and the annotation information to a cache of itself.
The system according to claim 9, wherein the first terminal is specifically configured to send the screen content and the annotation information to the server through a wireless network;

The second terminal is specifically configured to receive the screen content and the annotation information sent by the server through the wireless network.