WO2017107499A1

WO2017107499A1 - Information remote synchronization method, terminal and system

Info

Publication number: WO2017107499A1
Application number: PCT/CN2016/093697
Authority: WO
Inventors: 王新
Original assignee: 广州视睿电子科技有限公司
Priority date: 2015-12-21
Filing date: 2016-08-05
Publication date: 2017-06-29
Also published as: CN105653221A

Abstract

An information remote synchronization method comprises: acquiring touch point information of a user on a local electronic whiteboard (S11); converting the touch point information into a binary byte data stream (S12); and transmitting the binary byte data stream to a remote electronic whiteboard so that the binary byte data stream is analyzed by the remote electronic whiteboard, and after that realizing a synchronous display (S13). With an information transmitting terminal, an information receiving terminal and an information remote synchronization system, it is possible to realize real-time synchronization of the information between electronic whiteboards, and take up less bandwidth.

Description

Information remote synchronization method, terminal and system

Technical field

The present invention relates to the field of remote synchronization technologies, and in particular, to an information remote synchronization method, terminal, and system.

Background technique

Web conferencing is a multimedia conferencing platform based on the network. It can use the Internet to realize data sharing between different locations and multiple users, and achieve face-to-face communication effects. At present, the conference system is not only limited to providing sharing functions of audio and video data, but also provides users with rich conference auxiliary functions, such as electronic whiteboard functions. The electronic whiteboard is a technology that uses a computer to simulate a normal whiteboard, allowing multiple users to work together in an electronic document through a network. The shared document is displayed on all users' screens at the same time, just as these users use a traditional whiteboard at the same time. . In the prior art, the remote synchronization of the electronic whiteboard mainly has two implementation modes: one is to intercept the entire screen that needs to be synchronized in the screen and send it to the remote end; the other is that when one party operates, the data of the whole process of the operation is packaged and sent at one time. Go to the other party, and the other party needs to wait for the operation to complete before receiving the data and then displaying it.

In the process of implementing the present invention, the inventor has found that the existing remote synchronization scheme has the following disadvantages: for the first technical solution, by transmitting the entire screen that needs to be synchronized in the screen to the remote end, a lot of useless redundant data is transmitted. It needs to occupy a large amount of network bandwidth; if the number of people is larger, the higher the network bandwidth requirement is, the timeliness cannot be guaranteed; for the second technical solution, it cannot satisfy the effect of multi-party real-time display, if one party operates for too long, then Other parties will have a state of suspended animation, and the user experience is very bad.

Summary of the invention

In view of the problems existing in the prior art, aspects of the embodiments of the present invention provide a remote information The step method, the terminal and the system can realize real-time synchronization of information between the electronic whiteboards, and occupy less bandwidth, and meet the use requirements.

An aspect of an embodiment of the present invention provides a method for remote information synchronization, including the following steps:

Obtaining touch point information of the user on the local electronic whiteboard;

Converting the touch point information into a binary byte data stream;

And transmitting the binary byte data stream to the remote electronic whiteboard, so that the remote electronic whiteboard parses the binary byte data stream to implement synchronous display.

As an improvement of the above solution, the electronic whiteboard establishes a connection between the server terminals;

And sending the binary byte data stream to the remote electronic whiteboard, so that the remote electronic whiteboard parses the binary byte data stream to implement synchronous display, specifically:

Transmitting the binary byte data stream to the server end, and forwarding, by the server end, the binary byte data stream to a remote electronic whiteboard, so that the remote electronic whiteboard performs the binary byte data stream Synchronous display after parsing.

As an improvement of the foregoing solution, the touch point information is serialized by using a protocol buffers tool to obtain the binary byte data stream;

Preferably, the touch point information includes a coordinate value of the touch point; or the touch point information includes a coordinate value and a pressure value of the touch point;

If the electronic whiteboard supports multi-touch, the touch point information further includes a touch ID, wherein the touch ID is a unique identification number of each touch point.

Another aspect of the embodiments of the present invention provides an information sending terminal, including:

An information obtaining unit, configured to acquire touch point information of the user on the local electronic whiteboard;

An information conversion unit, configured to convert the touch point information into a binary byte data stream;

And a data sending unit, configured to send the binary byte data stream to the remote electronic whiteboard, so that the remote electronic whiteboard parses the binary byte data stream to implement synchronous display.

Another aspect of the embodiments of the present invention provides a method for remote information synchronization, including the following steps:

Receiving a binary byte data stream sent by the remote electronic whiteboard; wherein the binary byte data stream is converted by the user's touch point information on the remote electronic whiteboard;

Parsing the binary byte data stream into corresponding touch point information;

The parsed touch point information is synchronously displayed on the local electronic whiteboard.

As an improvement of the above solution, the electronic whiteboard establishes a connection between the servers;

Receiving the binary byte data stream sent by the remote electronic whiteboard, specifically:

Receives a binary byte data stream sent by the server to the remote whiteboard.

As an improvement of the foregoing solution, the binary byte data stream is deserialized by using a protocol buffers tool to obtain corresponding touch point information;

Another aspect of the embodiments of the present invention further provides an information receiving terminal, including:

a data receiving unit, configured to receive a binary byte data stream sent by the remote electronic whiteboard; wherein the binary byte data stream is converted by the user's touch point information on the remote electronic whiteboard;

a data parsing unit, configured to parse the binary byte data stream into corresponding touch point information;

The information synchronization unit is configured to synchronously display the parsed touch point information on the local electronic whiteboard.

Another aspect of the embodiments of the present invention further provides an information remote synchronization system, including an information sending terminal and an information receiving terminal.

As an improvement of the foregoing solution, the information remote synchronization system further includes a server end; and the information sending terminal and the information receiving terminal establish a connection through the server end;

The server is configured to listen to a network connection request of the terminal and establish a connection with the terminal, and is further configured to receive the data stream sent by the information sending terminal, and forward the data stream to the information receiving terminal.

Preferably, the server and the terminal use an Internet-based TCP/IP communication protocol for communication.

The information remote synchronization method, terminal and system provided by the embodiments of the present invention have the following beneficial effects: when the user touches a touch event on the local electronic whiteboard, the information of each touch point is acquired; and each touch point is The information is converted into a binary byte data stream and sent to the remote electronic whiteboard, so that the remote electronic whiteboard parses the binary byte data stream to realize synchronous display. That is to say, when the information sharing between the electronic whiteboards is performed, it is not necessary to intercept the entire screen that needs to be synchronized, and transmit a lot of useless redundant data, or wait for all the data of the operation to be synchronized after waiting for one operation, so that the remote electronic whiteboard cannot be real-time. Displaying, but when acquiring the touch point information on the local electronic whiteboard, converting the touch point information into a binary byte data stream and transmitting the data to the remote electronic whiteboard, so that the remote electronic whiteboard parses the binary data stream to realize Simultaneous display, and the amount of data transmitted each time is small, consuming less network bandwidth, greatly improving the real-time performance of remote synchronization.

DRAWINGS

In order to more clearly illustrate the technical solutions of the present invention, the drawings used in the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention, which are common in the art. For the skilled person, other drawings can be obtained from these drawings without any creative work.

FIG. 1 is a schematic flow chart of an embodiment of an information remote synchronization method provided by the present invention.

FIG. 2 is a schematic structural diagram of an embodiment of an information transmitting terminal provided by the present invention.

FIG. 3 is a schematic flow chart of another embodiment of an information remote synchronization method provided by the present invention.

FIG. 4 is a schematic structural diagram of an embodiment of an information receiving and terminal provided by the present invention.

FIG. 5 is a schematic structural diagram of an embodiment of an information remote synchronization system provided by the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, instead of All embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

Please refer to FIG. 1 , which is a schematic flowchart diagram of an embodiment of a method for remotely synchronizing information provided by the present invention.

The present invention provides a method for remotely synchronizing information, including steps S11 to S13, as follows:

S11. Acquire a touch point information of the user on the local electronic whiteboard.

The touch point information includes coordinate values of the touched points.

In another embodiment, the touch point information may further include a coordinate value and a pressure value of the touch point.

It can be understood that, if the electronic whiteboard supports multi-touch, the touch point information further includes a touch ID, and the touch ID is a unique identification number of each touch point. When multi-touch occurs on the local electronic whiteboard, each touch point is assigned a unique ID, and each touch point information in the writing process of each touch point is tracked and acquired.

S12. Convert the touch point information into a binary byte data stream.

Preferably, the touch point information is serialized using a protocol buffers tool to obtain the binary byte data stream.

Protocol buffers, often referred to simply as protobuf, are open source projects that serialize structured data. The language library of the protobuf in the embodiment of the present invention includes but is not limited to languages such as C++, JAVA, and Python.

It should be noted that serialization is to transfer the object (ie, touch point information) into a byte stream (ie, a binary byte data stream); the serialization corresponds to the deserialization, that is, the byte stream. Parsing and deserializing the byte stream into the original object.

S13. Send the binary byte data stream to the remote electronic whiteboard, so that the remote electronic whiteboard parses the binary byte data stream to implement synchronous display.

In a specific implementation, after receiving the binary byte data stream, the remote electronic whiteboard parses the binary byte data stream through an application programming interface provided in a language library of the protobuf, and the binary byte data is The stream is deserialized into corresponding touch point information.

Preferably, before the step is implemented, the method further includes: forming a conference group; the conference group consists of at least two The electronic whiteboards are constructed by being connected to each other and can be used for, but not limited to, teaching, teleconference, and the like. The method for establishing a communication connection may be: initiating a meeting invitation by at least one electronic whiteboard by one electronic whiteboard; and forming a meeting group that can communicate with each other when at least one electronic whiteboard accepts the meeting invitation; wherein, the electronic whiteboard that initiates the meeting invitation The address of the invited whiteboard is saved. It is to be understood that the conference group may be formed in other manners, which are all within the scope of the present invention and are not limited herein.

In an embodiment of the present invention, the electronic whiteboards are connected through the server; wherein each electronic whiteboard only communicates with the server, and does not directly establish a connection with other electronic whiteboards; the server is used for monitoring the electronic whiteboard. And the network connection request is connected to the electronic whiteboard; and the step S13 is specifically:

In a specific implementation, preferably, the above information remote synchronization method may be performed by the information transmitting terminal. Obtaining information of each touch point when the user touches a touch event on the local electronic whiteboard; converting the information of each touch point into a binary byte data stream and transmitting the data to the remote electronic whiteboard, so that the remote electronic The whiteboard parses the binary data stream to realize synchronous display, and the amount of data transmitted each time is small, consuming less network bandwidth, and greatly improving the real-time performance of remote synchronization.

Correspondingly, the present invention further provides an information transmitting terminal, which can execute all the processes of the information remote synchronization method provided by the foregoing embodiments.

Referring to FIG. 2, it is a schematic structural diagram of an embodiment of an information sending terminal provided by the present invention.

The present invention provides an information transmitting terminal 20, which includes an information acquiring unit 21, an information converting unit 22, and a data transmitting unit 23, as follows:

The information acquiring unit 21 is configured to acquire touch point information of the user on the local electronic whiteboard;

The information conversion unit 22 is configured to convert the touch point information into a binary byte data stream;

The data sending unit 23 is configured to send the binary byte data stream to a remote electronic whiteboard. Synchronizing the display by parsing the binary byte data stream by the remote electronic whiteboard.

Preferably, the information acquiring unit 21, the information converting unit 22, and the data transmitting unit 23 may adopt the implementation manners of the steps S11 to S13 of the information remote synchronization method in the specific implementation, and therefore, the embodiment of the present invention does not Repeat the narrative.

In a specific implementation, when the information acquiring unit 21 monitors a touch event of the user on the local electronic whiteboard, the information of each touch point is acquired; the information conversion unit 22 converts the information of each touch point into The binary byte data stream is sent to the remote electronic whiteboard through the data sending unit 23, so that the remote electronic whiteboard parses the binary data stream to realize synchronous display, and the amount of data transmitted each time is small and occupied. Less network bandwidth greatly improves the real-time performance of remote synchronization.

Please refer to FIG. 3 , which is a schematic flowchart diagram of another embodiment of the information remote synchronization method provided by the present invention.

The present invention provides an information remote synchronization method of another embodiment, including steps S21 to S23, as follows:

S21. Receive a binary byte data stream sent by the remote electronic whiteboard.

The binary byte data stream is converted into touch point information of the user on the remote electronic whiteboard.

S22. Parse the binary byte data stream into corresponding touch point information.

S23. The parsed touch point information is synchronously displayed on the local electronic whiteboard.

Specifically, step S21 to step S23 may refer to step S11 to step S13 in the foregoing embodiment, and details are not described herein again.

It should be noted that, in an embodiment of the present invention, the electronic whiteboards are connected through the server; wherein each electronic whiteboard only communicates with the server, and does not directly establish a connection with other electronic whiteboards; The network connection request for monitoring the electronic whiteboard and establishing a connection with the electronic whiteboard; and receiving the data flow sent by the electronic whiteboard and forwarding the data flow to the other electronic whiteboard; the step S21 is specifically:

Receives a binary byte data stream sent by the server to the remote whiteboard.

In a specific implementation, preferably, the above information remote synchronization method may be performed by the information receiving terminal. Decomposing the binary byte data stream into corresponding touch point information by parsing the received binary byte data stream; and synchronously displaying the parsed touch point information on the local electronic whiteboard, thereby realizing Dynamically transform the data structure to meet the needs of fast display.

Correspondingly, the present invention further provides an information receiving terminal, which can perform all the processes of the information remote synchronization method provided by the foregoing embodiments.

Please refer to FIG. 4 , which is a schematic structural diagram of an embodiment of an information receiving terminal provided by the present invention.

The present invention provides an information receiving terminal 40, which includes a data receiving unit 41, a data analyzing unit 42, and an information synchronizing unit 43, as follows:

The data receiving unit 41 is configured to receive a binary byte data stream sent by the remote electronic whiteboard. The binary byte data stream is converted into touch point information of the user on the remote electronic whiteboard.

The data parsing unit 42 is configured to parse the binary byte data stream into corresponding touch point information.

The information synchronization unit 43 is configured to synchronously display the parsed touch point information on the local electronic whiteboard.

It is to be understood that the functions of the functional units of the information receiving terminal 40 in the embodiment of the present invention may be specifically implemented according to the method in the foregoing method embodiment. For the specific implementation process, reference may be made to the related description of the foregoing method embodiments, where Let me repeat.

In a specific implementation, the received binary byte data stream is parsed by the data parsing unit 42 to deserialize the binary byte data stream into corresponding touch point information; the information synchronization unit 43 is locally Simultaneous display of the parsed touch point information on the electronic whiteboard realizes dynamic conversion of the data structure and satisfies the requirement of fast display.

In addition, the present invention also provides an information remote synchronization system.

Referring to FIG. 5, it is a structure of an embodiment of an information remote synchronization system according to an embodiment of the present invention. In one diagram, the information remote synchronization system includes the information transmitting terminal 20 and the information receiving terminal 40.

In an embodiment of the present invention, the information remote synchronization system further includes a server end 30; the information sending terminal 20 and the information receiving terminal 40 establish a connection through the server end 30;

The server 30 is configured to listen to a network connection request of the terminal and establish a connection with the terminal, and is further configured to receive the data stream sent by the information sending terminal 20, and forward the data stream to the information receiving terminal 40.

Preferably, the server end 30 communicates with the terminal by using an Internet-based TCP/IP communication protocol. It is to be understood that other communication protocols may also be used for communication, which are all within the scope of the present invention and are not limited herein.

The invention disclosed herein is only a preferred embodiment of the present invention, and the scope of the present invention is not limited thereto, and those skilled in the art can understand all or part of the process of implementing the embodiments described herein. Equivalent variations of the claims of the invention are still within the scope of the invention.

A person skilled in the art can understand that all or part of the process of implementing the embodiments described herein can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium. The program, when executed, may include the flow of an embodiment of the methods as described herein. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

Claims

An information remote synchronization method, comprising the steps of:

Obtaining touch point information of the user on the local electronic whiteboard;

Converting the touch point information into a binary byte data stream;

And transmitting the binary byte data stream to the remote electronic whiteboard, so that the remote electronic whiteboard parses the binary byte data stream to implement synchronous display.
The information remote synchronization method according to claim 1, wherein the electronic whiteboard establishes a connection between the server terminals;

And sending the binary byte data stream to the remote electronic whiteboard, so that the remote electronic whiteboard parses the binary byte data stream to implement synchronous display, specifically:

Transmitting the binary byte data stream to the server end, and forwarding, by the server end, the binary byte data stream to a remote electronic whiteboard, so that the remote electronic whiteboard performs the binary byte data stream Synchronous display after parsing.
The information remote synchronization method according to claim 1 or 2, wherein the touch point information is serialized by using a protocol buffers tool to obtain the binary byte data stream;

Preferably, the touch point information includes a coordinate value of the touch point; or the touch point information includes a coordinate value and a pressure value of the touch point;

If the electronic whiteboard supports multi-touch, the touch point information further includes a touch ID, wherein the touch ID is a unique identification number of each touch point.
An information remote synchronization method, comprising the steps of:

Receiving a binary byte data stream sent by the remote electronic whiteboard; wherein the binary byte data stream is converted by the user's touch point information on the remote electronic whiteboard;

Parsing the binary byte data stream into corresponding touch point information;

The parsed touch point information is synchronously displayed on the local electronic whiteboard.
The information remote synchronization method according to claim 4, wherein the electronic whiteboard establishes a connection between the servers;

Receiving the binary byte data stream sent by the remote electronic whiteboard, specifically:

Receives a binary byte data stream sent by the server to the remote whiteboard.
The information remote synchronization method according to claim 4 or 5, wherein the binary byte data stream is deserialized by using a protocol buffers tool to obtain corresponding touch point information;

Preferably, the touch point information includes a coordinate value of the touch point; or the touch point information includes a coordinate value and a pressure value of the touch point;

If the electronic whiteboard supports multi-touch, the touch point information further includes a touch ID, wherein the touch ID is a unique identification number of each touch point.
An information transmitting terminal, comprising:

An information obtaining unit, configured to acquire touch point information of the user on the local electronic whiteboard;

An information conversion unit, configured to convert the touch point information into a binary byte data stream;

And a data sending unit, configured to send the binary byte data stream to the remote electronic whiteboard, so that the remote electronic whiteboard parses the binary byte data stream to implement synchronous display.
An information receiving terminal, comprising:

a data receiving unit, configured to receive a binary byte data stream sent by the remote electronic whiteboard; wherein the binary byte data stream is converted by the user's touch point information on the remote electronic whiteboard;

a data parsing unit, configured to parse the binary byte data stream into corresponding touch point information;

The information synchronization unit is configured to synchronously display the parsed touch point information on the local electronic whiteboard.
An information remote synchronization system, comprising the information transmission according to claim 7. A transmitting terminal and the information receiving terminal according to claim 8.
The information remote synchronization system according to claim 9, wherein the information remote synchronization system further comprises a server; and the information transmission terminal and the information receiving terminal establish a connection through the server;

The server is configured to listen to a network connection request of the terminal and establish a connection with the terminal, and is further configured to receive the data stream sent by the information sending terminal, and forward the data stream to the information receiving terminal.

Preferably, the server and the terminal use an Internet-based TCP/IP communication protocol for communication.