WO2016062004A1

WO2016062004A1 - Method and wireless terminal for screen sharing between wireless terminals

Info

Publication number: WO2016062004A1
Application number: PCT/CN2015/075068
Authority: WO
Inventors: 郝志坚; 李明
Original assignee: 中兴通讯股份有限公司
Priority date: 2014-10-24
Filing date: 2015-03-25
Publication date: 2016-04-28
Also published as: CN105592349A

Abstract

Provided are a method and wireless terminal for screen sharing between wireless terminals, said method comprising: a server device providing screen data performs a sustained capture of a screen, and sends the screen capture data to a client device; the client device displays the screen capture data, then obtains screen touch information, and returns the screen touch information to the server device; the server device responds to the screen touch information.

Description

Method for sharing screen between wireless terminals and wireless terminal

Technical field

This article covers the field of screen sharing between terminals.

Background technique

At present, smart phones are becoming more and more popular, their functions are becoming more and more abundant and intelligent, and the demand for high intelligence of smart phones is increasing day by day.

In daily life, people often share the contents of their respective terminals. For example, during a meeting, the speaker shares the contents of the computer with other participants through the projector; during normal work, the company employees upload the shared content to the server. For other employees to download and read; during the trip, people circulate the mobile phones to share pictures on their respective terminals.

The method of sharing content between the above terminals requires a third device, such as a projector or a server, or can be shared with one other member at a time, such as circulating a mobile phone to read a picture.

If you can use the smart phones that are becoming more and more popular to realize the sharing of their own terminal content, it will certainly facilitate people's lives, and at the same time save the economic cost of enterprises.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

The embodiments of the present invention provide a screen sharing method and a wireless terminal between wireless terminals to solve the technical problem of how to share the content of the respective terminals by using only the wireless terminals.

The embodiment of the invention provides a screen sharing method between wireless terminals, and the method includes:

The server device providing the screen data continuously screens the screen and sends the screen capture data to the client device;

The client device obtains screen touch information after displaying the screen capture data, and returns the screen touch information to the server device;

The server device responds to the screen touch information.

Optionally, the screen touch information obtained by the client device after displaying the screen capture data includes:

Gets the key of the button on the screen of the client touch screen or the touched button that controls the server-side device.

Optionally, the client device acquires coordinates of the screen touch point located on the client screen, including:

Obtaining an identifier i assigned to the touch point, the x-axis coordinate value client_x_i of the client screen, the y-axis coordinate value client_y_i, the client screen size, and the touch state information; wherein the client screen size includes: long client_screen_x And wide client_screen_y, the touch status information includes: press or lift.

Optionally, the server device responds to the screen touch information, including:

When the touch information is the coordinates of the screen touch point located on the client screen, the server device parses out the coordinates of the screen touch point sent by the client device on the client screen;

The server device obtains the native screen size, wherein the native screen size includes: long server_screen_x and wide server_screen_y;

The server-side device calculates the coordinate values Server_x_i and Server_y_i of the screen touch point i from the client device located at the local machine:

Server_x_i=server_screen_x*client_x_i/client_screen_x;

Server_y_i=server_screen_y*client_y_i/client_screen_y;

The server side device performs a response action according to the touch state at a point corresponding to the coordinate values Server_x_i and Server_y_i.

When the screen touch information is the key value of the touched button that controls the server device,

The server device performs a response action according to the button key value.

An embodiment of the present invention provides a server device that provides screen sharing, and the device includes:

Screen data transfer unit, set to continuously screen the screen and send screenshot data to Client device

Remote controlled unit, set to respond to screen touch information from remote clients.

Optionally,

The screen touch information from the remote client includes: a coordinate of the screen touch point located at the client screen or a key value of the touched button that controls the server end device;

The screen touch point is located at coordinates of the client screen, and includes: an identifier i assigned to the touch point, an x-axis coordinate value of the touch point i located on the client screen, client_x_i, a y-axis coordinate value client_y_i, a client screen size, and Touching the status information; wherein the client screen size comprises: a long client_screen_x and a wide client_screen_y, the touch status information comprising: pressing or lifting.

Optionally, the remote controlled unit is configured to respond to screen touch information from a remote client in the following manner:

When the screen touch information is the coordinates of the screen touch point located on the client screen, parsing out the coordinates of the screen touch point sent by the client device on the client screen;

Get the native screen size, where the native screen size includes: long server_screen_x and wide server_screen_y;

Calculate the coordinate values Server_x_i and Server_y_i from the screen touch point i from the client device:

Server_x_i=server_screen_x*client_x_i/client_screen_x;

Server_y_i=server_screen_y*client_y_i/client_screen_y;

A response action is made according to the touch state at a point corresponding to the coordinate values Server_x_i and Server_y_i.

Optionally, the remote controlled unit is configured to respond to screen touch information from the remote client by:

When the screen touch information is a key value of a touched button that controls the server device, a response action is made according to the button key value.

The embodiment of the invention further provides a client device for screen sharing, the device comprising:

a screen data receiving unit configured to receive screen capture data sent by the remote server device;

a remote control unit configured to display screen capture data and obtain screen touch information, and return the screen touch information to the remote server device.

Optionally, the remote control unit is configured to obtain screen touch information by:

Optionally, the remote control unit is configured to obtain coordinates of the screen touch point located on the client screen by:

The embodiment of the invention further provides a computer readable storage medium storing computer executable instructions for performing the above method.

In the above technical solution, the screen content of one wireless terminal can be shared to other wireless terminals, and further controlled by the screen touch of the other wireless terminals, the purpose of sharing the respective terminal contents with each other using only the wireless terminal is realized.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

1 is a flowchart of a method for sharing a screen between wireless terminals according to an embodiment of the present invention;

2 is a schematic diagram of a setting menu of applying a screen sharing process on a wireless terminal according to an embodiment of the present invention;

3 is a schematic diagram of a virtual button displayed on a screen of a client device according to an embodiment of the present invention;

4 is a block diagram of a component of a server device that provides screen sharing according to an embodiment of the present invention;

FIG. 5 is a block diagram of a component of a client device for screen sharing according to an embodiment of the present invention.

Embodiments of the invention

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that, in the case of no conflict, the features in the embodiments and the embodiments in the present application may be arbitrarily combined with each other.

FIG. 1 is a flowchart of a method for sharing a screen between wireless terminals according to an embodiment of the present invention.

Selecting a server-side device that provides shared content and a client device that receives the shared content, establishing a connection between the server-side device and the client device, wherein the connection manner includes: a Wifi connection, a Bluetooth connection, an infrared connection; optionally, a server end The device can select whether to allow the client to control the server device. Only after the server device allows the client to control the server device, the subsequent operations are performed;

A schematic diagram of a setting menu for applying a screen sharing process on a wireless terminal is shown in FIG. 2;

The S101 server device continuously screens its own screen and sends the screen capture data to the client device.

After the S102 client device displays the screen capture data, the screen touch information is acquired, and the screen touch information is returned to the server device;

Optionally, the acquiring, by the client device, the screen touch information after the screen capture data is obtained, including: acquiring coordinates of the screen touch point located on the client screen; and the coordinates of the screen touch point located on the client screen include: an identifier i assigned to the touch point, The touch point i is located at the x-axis coordinate value client_x_i of the client screen, the y-axis coordinate value client_y_i, the client screen size, and the touch state information; wherein the client screen size includes: a long client_screen_x and a wide client_screen_y, the touch state information Includes: Press or lift.

In order to facilitate the operation of the user, if the virtual button that exists in the form of a floating window is displayed on the client screen under the screen sharing process, the screen touch information acquired by the client device may further include: the paired server device that is touched The key value of the control button; the virtual button is as shown in FIG. 3, the virtual button is suspended on the screen of the client device, and when the “function trigger” button is clicked, the four buttons Back, Home, Menu and Power; the user can directly click the virtual button to issue a control command;

S103. The server device responds to the screen touch information.

Optionally, when the touch information is the coordinates of the screen touch point located on the client screen, the server side The device parses out the coordinates of the screen touch point sent by the client device on the client screen; obtains the native screen size, the native screen size: long server_screen_x and wide server_screen_y; calculating the screen touch point i from the client device is located in the present Machine coordinate values Server_x_i and Server_y_i:

Server_x_i=server_screen_x*client_x_i/client_screen_x;

Server_y_i=server_screen_y*client_y_i/client_screen_y;

Responding to the touch state at a point corresponding to the coordinate values Server_x_i and Server_y_i;

Optionally, when the screen touch information is a key value of the touched button that controls the server device, the server device performs a response action according to the button key value.

The above server device is not limited to one.

The above embodiment will be further described in detail below with an application example.

Select Smartphone A and Smartphone B, and use Smartphone A as a server device to allow external devices to control it, using Smartphone B as a client device. When the setting B is a client device shared by the screen, the virtual button on the client device that exists only in the form of a floating window under the screen sharing process is activated.

Step 1: Smartphone A and Smartphone B establish a connection;

Step 2: Smartphone A opens thread 1, takes a screenshot of its own screen, and compresses the screen capture data and sends it to smartphone B;

Step 3: The smart phone B displays the successfully received screen capture data on the screen, and sends a success message to the smart phone A, and performs step 4; at the same time, the smart phone B opens the thread 2 to determine whether the screen touch information is detected, if the detection To touch the information on the screen, perform step five;

Step 4: After receiving the success message, the smartphone A continues to use the thread 1 to take a screenshot of its own screen, and compresses the screen capture data and sends it to the smartphone B, and the smartphone B becomes The screen capture data received by the function is displayed on the screen, and the receiving success message is sent to the smartphone A, and step 4 is performed;

Step 5: The smartphone B determines whether the screen touch information is a key value of the virtual button, and if yes, performs step 6; if not, step 8 is performed;

Step six, the key value of the virtual button is packed into a byte, the first digit of the byte is marked with "1", and the key value is sent to the smart phone A;

Step 7: The smartphone A responds according to the button key value, and performs step 10;

Since the thread 1 continuously screens the screen of the smartphone A, after the screen data of the smartphone A is changed, the thread 1 can send the changed screen data to the smart phone B in time;

Step eight, the screen touch point is located on the client screen coordinates packed into a byte, the first bit of the byte is marked with "0", the coordinates are sent to the smart phone A;

The coordinates of the screen touch point located on the client screen include: an identifier i assigned to the touch point, an x-axis coordinate value client_x_i of the touch screen i located on the client screen, a y-axis coordinate value client_y_i, a client screen size, and touch state information; The client screen size includes: a long client_screen_x and a wide client_screen_y, and the touch state information includes: pressing or lifting;

Step 9: The smartphone A parses out the coordinates of the screen touch point sent by the client device on the client screen; obtains the screen size of the local machine, and the screen size of the machine includes: long server_screen_x and wide server_screen_y; calculating the screen touch from the client device The point i is located in the coordinates of the machine Server_x_i and Server_y_i:

Server_x_i=server_screen_x*client_x_i/client_screen_x;

Server_y_i=server_screen_y*client_y_i/client_screen_y;

A response action is performed according to the touch state at a point corresponding to the coordinate values Server_x_i and Server_y_i;

Step 10, the thread 2 of the smartphone A waits for the next screen touch information from the smartphone B.

FIG. 4 is a block diagram of a server-side device that provides screen sharing according to an embodiment of the present invention.

The server device includes:

The screen data transmission unit is configured to continuously screen the screen and send the screen capture data to the client device;

The screen touch point is located at coordinates of the client screen, and includes: an identifier i assigned to the touch point, an x-axis coordinate value of the touch point i located on the client screen, client_x_i, a y-axis coordinate value client_y_i, a client screen size, and Touching the status information; wherein the client screen size comprises: a long client_screen_x and a wide client_screen_y, the touch status information includes: pressing or lifting;

Optionally, when the screen touch information is the coordinates of the screen touch point located on the client screen, the remote controlled unit is configured to respond to the screen touch information from the remote client by: parsing out the client device The screen touch point is located at the coordinates of the client screen; the native screen size is: the long server_screen_x and the wide server_screen_y; the screen touch point i from the client device is calculated at the coordinate values of the machine Server_x_i and Server_y_i :

Server_x_i=server_screen_x*client_x_i/client_screen_x;

Server_y_i=server_screen_y*client_y_i/client_screen_y;

Optionally, when the screen touch information is a touched key value of a button that controls the server end device, the remote controlled unit is configured to respond to the screen touch information from the remote client by: The button key value responds.

In the above technical solution, the screen content of the server-side device can be shared to the client device, and further controlled by the screen touch of the client device, the purpose of sharing the respective terminal content with each other using only the wireless terminal is realized.

The client device includes:

a remote control unit configured to display screen capture data and obtain screen touch information, and return the screen touch information to the remote server device;

Obtaining a key value of a button of a screen touch point located at a client screen or a touched button that controls the server device;

The screen touch point is located at coordinates of the client screen, and includes: an identifier i assigned to the touch point, an x-axis coordinate value client_x_i of the touch screen i located on the client screen, a y-axis coordinate value client_y_i, a client screen size, and a touch state. Information; wherein the client screen size comprises: a long client_screen_x and a wide client_screen_y, the touch status information includes: pressing or lifting.

One of ordinary skill in the art will appreciate that all or a portion of the steps described above can be accomplished by a program that instructs the associated hardware, such as a read-only memory, a magnetic or optical disk, and the like. Optionally, all or part of the steps of the foregoing embodiments may also be implemented by using one or more integrated circuits. Accordingly, each module/unit in the foregoing embodiment may be implemented in the form of hardware, or may be implemented by using a software function module. Formal realization. It should be noted that the above description is an optional embodiment of the present invention and is not intended to limit the scope of protection of the present invention.

Industrial applicability

The screen sharing method and the wireless terminal between the wireless terminals provided by the embodiments of the present invention enable the screen content of one wireless terminal to be shared to other wireless terminals, and are also controlled by the screen touch of the other wireless terminals, thereby realizing the use of only the wireless terminal. It is possible to share the contents of their respective terminals with each other.

Claims

A screen sharing method between wireless terminals, the method comprising:

The server device providing the screen data continuously screens the screen and sends the screen capture data to the client device;

The client device obtains screen touch information after displaying the screen capture data, and returns the screen touch information to the server device;

The server device responds to the screen touch information.
The method of claim 1, wherein the obtaining, by the client device, the screen touch information after displaying the screen capture data comprises:

Gets the key of the button on the screen of the client touch screen or the touched button that controls the server-side device.
The method of claim 2, wherein the client device obtains coordinates of the screen touch point located on the client screen, including:

Obtaining an identifier i assigned to the touch point, the x-axis coordinate value client_x_i of the client screen, the y-axis coordinate value client_y_i, the client screen size, and the touch state information; wherein the client screen size includes: long client_screen_x And wide client_screen_y, the touch status information includes: press or lift.
The method of claim 3, wherein the server device responds to the screen touch information, comprising:

When the touch information is the coordinates of the screen touch point located on the client screen, the server device parses out the coordinates of the screen touch point sent by the client device on the client screen;

The server device obtains the native screen size, wherein the native screen size includes: long server_screen_x and wide server_screen_y;

The server-side device calculates the coordinate values Server_x_i and Server_y_i of the screen touch point i from the client device located at the local machine:

Server_x_i=server_screen_x*client_x_i/client_screen_x;

Server_y_i=server_screen_y*client_y_i/client_screen_y;

The server side device performs a response action according to the touch state at a point corresponding to the coordinate values Server_x_i and Server_y_i.
The method of claim 2, wherein the server device responds to the screen touch information, comprising:

When the screen touch information is the key value of the touched button that controls the server device,

The server device performs a response action according to the button key value.
A server-side device that provides screen sharing, the device comprising:

The screen data transmission unit is configured to continuously screen the screen and send the screen capture data to the client device;

Remote controlled unit, set to respond to screen touch information from remote clients.
The server device according to claim 6, wherein

The screen touch information from the remote client includes: a coordinate of the screen touch point located at the client screen or a key value of the touched button that controls the server end device;

The screen touch point is located at coordinates of the client screen, and includes: an identifier i assigned to the touch point, an x-axis coordinate value of the touch point i located on the client screen, client_x_i, a y-axis coordinate value client_y_i, a client screen size, and Touching the status information; wherein the client screen size comprises: a long client_screen_x and a wide client_screen_y, the touch status information comprising: pressing or lifting.
The server-side device of claim 7, wherein the remote controlled unit is configured to respond to screen touch information from a remote client in the following manner:

When the screen touch information is the coordinates of the screen touch point located on the client screen, parsing out the coordinates of the screen touch point sent by the client device on the client screen;

Get the native screen size, where the native screen size includes: long server_screen_x and wide server_screen_y;

Calculate the coordinate values Server_x_i and Server_y_i from the screen touch point i from the client device:

Server_x_i=server_screen_x*client_x_i/client_screen_x;

Server_y_i=server_screen_y*client_y_i/client_screen_y;

A response action is made according to the touch state at a point corresponding to the coordinate values Server_x_i and Server_y_i.
The server-side device according to claim 6, wherein said remote controlled unit is configured to respond to screen touch information from a remote client in the following manner:

When the screen touch information is a key value of a touched button that controls the server device, a response action is made according to the button key value.
A client device for screen sharing, the device comprising:

a screen data receiving unit configured to receive screen capture data sent by the remote server device;

a remote control unit configured to display screen capture data and obtain screen touch information, and return the screen touch information to the remote server device.
The device of claim 10, wherein the remote control unit is configured to acquire screen touch information in the following manner:

Gets the key of the button on the screen of the client touch screen or the touched button that controls the server-side device.
The apparatus of claim 11, wherein the remote control unit is configured to acquire coordinates of a screen touch point located on a client screen by:

Obtaining an identifier i assigned to the touch point, the x-axis coordinate value client_x_i of the client screen, the y-axis coordinate value client_y_i, the client screen size, and the touch state information; wherein the client screen size includes: long client_screen_x And wide client_screen_y, the touch status information includes: press or lift.
A computer readable storage medium storing computer executable instructions for performing the method of any one of claims 1 to 5.