WO2016062004A1 - Procédé et terminal sans fil pour un partage d'écran entre des terminaux sans fil - Google Patents

Procédé et terminal sans fil pour un partage d'écran entre des terminaux sans fil Download PDF

Info

Publication number
WO2016062004A1
WO2016062004A1 PCT/CN2015/075068 CN2015075068W WO2016062004A1 WO 2016062004 A1 WO2016062004 A1 WO 2016062004A1 CN 2015075068 W CN2015075068 W CN 2015075068W WO 2016062004 A1 WO2016062004 A1 WO 2016062004A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
client
server
touch
information
Prior art date
Application number
PCT/CN2015/075068
Other languages
English (en)
Chinese (zh)
Inventor
郝志坚
李明
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2016062004A1 publication Critical patent/WO2016062004A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home

Definitions

  • This article covers the field of screen sharing between terminals.
  • the method of sharing content between the above terminals requires a third device, such as a projector or a server, or can be shared with one other member at a time, such as circulating a mobile phone to read a picture.
  • a third device such as a projector or a server
  • the embodiments of the present invention provide a screen sharing method and a wireless terminal between wireless terminals to solve the technical problem of how to share the content of the respective terminals by using only the wireless terminals.
  • the embodiment of the invention provides a screen sharing method between wireless terminals, and the method includes:
  • the server device providing the screen data continuously screens the screen and sends the screen capture data to the client device;
  • the client device obtains screen touch information after displaying the screen capture data, and returns the screen touch information to the server device;
  • the server device responds to the screen touch information.
  • the screen touch information obtained by the client device after displaying the screen capture data includes:
  • the client device acquires coordinates of the screen touch point located on the client screen, including:
  • the server device responds to the screen touch information, including:
  • the server device parses out the coordinates of the screen touch point sent by the client device on the client screen;
  • the server device obtains the native screen size, wherein the native screen size includes: long server_screen_x and wide server_screen_y;
  • the server-side device calculates the coordinate values Server_x_i and Server_y_i of the screen touch point i from the client device located at the local machine:
  • Server_x_i server_screen_x*client_x_i/client_screen_x;
  • Server_y_i server_screen_y*client_y_i/client_screen_y;
  • the server side device performs a response action according to the touch state at a point corresponding to the coordinate values Server_x_i and Server_y_i.
  • the server device responds to the screen touch information, including:
  • the server device performs a response action according to the button key value.
  • An embodiment of the present invention provides a server device that provides screen sharing, and the device includes:
  • Screen data transfer unit set to continuously screen the screen and send screenshot data to Client device
  • Remote controlled unit set to respond to screen touch information from remote clients.
  • the screen touch information from the remote client includes: a coordinate of the screen touch point located at the client screen or a key value of the touched button that controls the server end device;
  • the screen touch point is located at coordinates of the client screen, and includes: an identifier i assigned to the touch point, an x-axis coordinate value of the touch point i located on the client screen, client_x_i, a y-axis coordinate value client_y_i, a client screen size, and Touching the status information; wherein the client screen size comprises: a long client_screen_x and a wide client_screen_y, the touch status information comprising: pressing or lifting.
  • the remote controlled unit is configured to respond to screen touch information from a remote client in the following manner:
  • the screen touch information is the coordinates of the screen touch point located on the client screen, parsing out the coordinates of the screen touch point sent by the client device on the client screen;
  • Get the native screen size where the native screen size includes: long server_screen_x and wide server_screen_y;
  • Server_x_i server_screen_x*client_x_i/client_screen_x;
  • Server_y_i server_screen_y*client_y_i/client_screen_y;
  • a response action is made according to the touch state at a point corresponding to the coordinate values Server_x_i and Server_y_i.
  • the remote controlled unit is configured to respond to screen touch information from the remote client by:
  • the screen touch information is a key value of a touched button that controls the server device
  • a response action is made according to the button key value.
  • the embodiment of the invention further provides a client device for screen sharing, the device comprising:
  • a screen data receiving unit configured to receive screen capture data sent by the remote server device
  • a remote control unit configured to display screen capture data and obtain screen touch information, and return the screen touch information to the remote server device.
  • the remote control unit is configured to obtain screen touch information by:
  • the remote control unit is configured to obtain coordinates of the screen touch point located on the client screen by:
  • the embodiment of the invention further provides a computer readable storage medium storing computer executable instructions for performing the above method.
  • the screen content of one wireless terminal can be shared to other wireless terminals, and further controlled by the screen touch of the other wireless terminals, the purpose of sharing the respective terminal contents with each other using only the wireless terminal is realized.
  • FIG. 1 is a flowchart of a method for sharing a screen between wireless terminals according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a setting menu of applying a screen sharing process on a wireless terminal according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a virtual button displayed on a screen of a client device according to an embodiment of the present invention.
  • FIG. 4 is a block diagram of a component of a server device that provides screen sharing according to an embodiment of the present invention
  • FIG. 5 is a block diagram of a component of a client device for screen sharing according to an embodiment of the present invention.
  • FIG. 1 is a flowchart of a method for sharing a screen between wireless terminals according to an embodiment of the present invention.
  • a server-side device that provides shared content and a client device that receives the shared content, establishing a connection between the server-side device and the client device, wherein the connection manner includes: a Wifi connection, a Bluetooth connection, an infrared connection; optionally, a server end
  • the device can select whether to allow the client to control the server device. Only after the server device allows the client to control the server device, the subsequent operations are performed;
  • FIG. 2 A schematic diagram of a setting menu for applying a screen sharing process on a wireless terminal is shown in FIG. 2;
  • the S101 server device continuously screens its own screen and sends the screen capture data to the client device.
  • the S102 client device displays the screen capture data, the screen touch information is acquired, and the screen touch information is returned to the server device;
  • the acquiring, by the client device, the screen touch information after the screen capture data is obtained including: acquiring coordinates of the screen touch point located on the client screen; and the coordinates of the screen touch point located on the client screen include: an identifier i assigned to the touch point, The touch point i is located at the x-axis coordinate value client_x_i of the client screen, the y-axis coordinate value client_y_i, the client screen size, and the touch state information; wherein the client screen size includes: a long client_screen_x and a wide client_screen_y, the touch state information Includes: Press or lift.
  • the screen touch information acquired by the client device may further include: the paired server device that is touched The key value of the control button; the virtual button is as shown in FIG. 3, the virtual button is suspended on the screen of the client device, and when the “function trigger” button is clicked, the four buttons Back, Home, Menu and Power; the user can directly click the virtual button to issue a control command;
  • the server device responds to the screen touch information.
  • the server side parses out the coordinates of the screen touch point sent by the client device on the client screen; obtains the native screen size, the native screen size: long server_screen_x and wide server_screen_y; calculating the screen touch point i from the client device is located in the present Machine coordinate values Server_x_i and Server_y_i:
  • Server_x_i server_screen_x*client_x_i/client_screen_x;
  • Server_y_i server_screen_y*client_y_i/client_screen_y;
  • the server device when the screen touch information is a key value of the touched button that controls the server device, the server device performs a response action according to the button key value.
  • the above server device is not limited to one.
  • the screen content of one wireless terminal can be shared to other wireless terminals, and further controlled by the screen touch of the other wireless terminals, the purpose of sharing the respective terminal contents with each other using only the wireless terminal is realized.
  • Smartphone A and Smartphone B use Smartphone A as a server device to allow external devices to control it, using Smartphone B as a client device.
  • the setting B is a client device shared by the screen
  • the virtual button on the client device that exists only in the form of a floating window under the screen sharing process is activated.
  • Step 1 Smartphone A and Smartphone B establish a connection
  • Step 2 Smartphone A opens thread 1, takes a screenshot of its own screen, and compresses the screen capture data and sends it to smartphone B;
  • Step 3 The smart phone B displays the successfully received screen capture data on the screen, and sends a success message to the smart phone A, and performs step 4; at the same time, the smart phone B opens the thread 2 to determine whether the screen touch information is detected, if the detection To touch the information on the screen, perform step five;
  • Step 4 After receiving the success message, the smartphone A continues to use the thread 1 to take a screenshot of its own screen, and compresses the screen capture data and sends it to the smartphone B, and the smartphone B becomes The screen capture data received by the function is displayed on the screen, and the receiving success message is sent to the smartphone A, and step 4 is performed;
  • Step 5 The smartphone B determines whether the screen touch information is a key value of the virtual button, and if yes, performs step 6; if not, step 8 is performed;
  • Step six the key value of the virtual button is packed into a byte, the first digit of the byte is marked with "1", and the key value is sent to the smart phone A;
  • Step 7 The smartphone A responds according to the button key value, and performs step 10;
  • the thread 1 Since the thread 1 continuously screens the screen of the smartphone A, after the screen data of the smartphone A is changed, the thread 1 can send the changed screen data to the smart phone B in time;
  • Step eight the screen touch point is located on the client screen coordinates packed into a byte, the first bit of the byte is marked with "0", the coordinates are sent to the smart phone A;
  • the coordinates of the screen touch point located on the client screen include: an identifier i assigned to the touch point, an x-axis coordinate value client_x_i of the touch screen i located on the client screen, a y-axis coordinate value client_y_i, a client screen size, and touch state information;
  • the client screen size includes: a long client_screen_x and a wide client_screen_y, and the touch state information includes: pressing or lifting;
  • Step 9 The smartphone A parses out the coordinates of the screen touch point sent by the client device on the client screen; obtains the screen size of the local machine, and the screen size of the machine includes: long server_screen_x and wide server_screen_y; calculating the screen touch from the client device
  • the point i is located in the coordinates of the machine Server_x_i and Server_y_i:
  • Server_x_i server_screen_x*client_x_i/client_screen_x;
  • Server_y_i server_screen_y*client_y_i/client_screen_y;
  • a response action is performed according to the touch state at a point corresponding to the coordinate values Server_x_i and Server_y_i;
  • Step 10 the thread 2 of the smartphone A waits for the next screen touch information from the smartphone B.
  • FIG. 4 is a block diagram of a server-side device that provides screen sharing according to an embodiment of the present invention.
  • the server device includes:
  • the screen data transmission unit is configured to continuously screen the screen and send the screen capture data to the client device;
  • Remote controlled unit set to respond to screen touch information from remote clients.
  • the screen touch information from the remote client includes: a coordinate of the screen touch point located at the client screen or a key value of the touched button that controls the server end device;
  • the screen touch point is located at coordinates of the client screen, and includes: an identifier i assigned to the touch point, an x-axis coordinate value of the touch point i located on the client screen, client_x_i, a y-axis coordinate value client_y_i, a client screen size, and Touching the status information; wherein the client screen size comprises: a long client_screen_x and a wide client_screen_y, the touch status information includes: pressing or lifting;
  • the remote controlled unit is configured to respond to the screen touch information from the remote client by: parsing out the client device
  • the screen touch point is located at the coordinates of the client screen;
  • the native screen size is: the long server_screen_x and the wide server_screen_y;
  • the screen touch point i from the client device is calculated at the coordinate values of the machine Server_x_i and Server_y_i :
  • Server_x_i server_screen_x*client_x_i/client_screen_x;
  • Server_y_i server_screen_y*client_y_i/client_screen_y;
  • the remote controlled unit is configured to respond to the screen touch information from the remote client by: The button key value responds.
  • the screen content of the server-side device can be shared to the client device, and further controlled by the screen touch of the client device, the purpose of sharing the respective terminal content with each other using only the wireless terminal is realized.
  • FIG. 5 is a block diagram of a component of a client device for screen sharing according to an embodiment of the present invention.
  • the client device includes:
  • a screen data receiving unit configured to receive screen capture data sent by the remote server device
  • a remote control unit configured to display screen capture data and obtain screen touch information, and return the screen touch information to the remote server device;
  • the remote control unit is configured to obtain screen touch information by:
  • the screen touch point is located at coordinates of the client screen, and includes: an identifier i assigned to the touch point, an x-axis coordinate value client_x_i of the touch screen i located on the client screen, a y-axis coordinate value client_y_i, a client screen size, and a touch state.
  • Information wherein the client screen size comprises: a long client_screen_x and a wide client_screen_y, the touch status information includes: pressing or lifting.
  • the embodiment of the invention further provides a computer readable storage medium storing computer executable instructions for performing the above method.
  • the screen sharing method and the wireless terminal between the wireless terminals provided by the embodiments of the present invention enable the screen content of one wireless terminal to be shared to other wireless terminals, and are also controlled by the screen touch of the other wireless terminals, thereby realizing the use of only the wireless terminal. It is possible to share the contents of their respective terminals with each other.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)
  • Telephonic Communication Services (AREA)

Abstract

L'invention concerne un procédé et un terminal sans fil pour le partage d'écran entre des terminaux sans fil, ledit procédé comprenant les étapes suivantes : un dispositif serveur, qui fournit des données d'écran, effectue une capture prolongée d'un écran et envoie les données de capture d'écran à un dispositif client ; le dispositif client affiche les données de capture d'écran, obtient ensuite des informations d'écran tactiles et renvoie les informations d'écran tactiles au dispositif serveur ; le dispositif de serveur répond aux informations d'écran tactiles.
PCT/CN2015/075068 2014-10-24 2015-03-25 Procédé et terminal sans fil pour un partage d'écran entre des terminaux sans fil WO2016062004A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410578256.0A CN105592349A (zh) 2014-10-24 2014-10-24 一种无线终端间屏幕共享的方法和无线终端
CN201410578256.0 2014-10-24

Publications (1)

Publication Number Publication Date
WO2016062004A1 true WO2016062004A1 (fr) 2016-04-28

Family

ID=55760169

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/075068 WO2016062004A1 (fr) 2014-10-24 2015-03-25 Procédé et terminal sans fil pour un partage d'écran entre des terminaux sans fil

Country Status (2)

Country Link
CN (1) CN105592349A (fr)
WO (1) WO2016062004A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109120880A (zh) * 2018-09-19 2019-01-01 电子科技大学 基于智能终端的实时会议批注方法及系统

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106354505A (zh) * 2016-08-29 2017-01-25 武汉启目科技有限公司 一种对分享得到的屏幕进行操作的方法
CN109783041A (zh) * 2018-12-29 2019-05-21 广州华欣电子科技有限公司 屏幕共享系统、方法及介质
CN110087126A (zh) * 2019-04-15 2019-08-02 广州视源电子科技股份有限公司 传屏方法和多屏互动装置、系统

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101802755A (zh) * 2007-09-18 2010-08-11 汤姆森许可贸易公司 机顶盒的用户界面
CN101888608A (zh) * 2010-07-20 2010-11-17 中兴通讯股份有限公司 远程控制方法、装置和系统
CN102752727A (zh) * 2012-05-30 2012-10-24 北京三星通信技术研究有限公司 终端远程向导方法及装置
CN103049190A (zh) * 2012-12-12 2013-04-17 北京奇虎科技有限公司 一种移动通信终端及控制设备操作的方法
CN103984494A (zh) * 2013-02-07 2014-08-13 上海帛茂信息科技有限公司 用于多种设备间的直觉式用户互动系统及方法
CN104135712A (zh) * 2014-07-30 2014-11-05 上海斐讯数据通信技术有限公司 一种移动终端近程控制方法及系统
CN104426990A (zh) * 2013-09-09 2015-03-18 联想(北京)有限公司 一种控制方法和装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120173622A1 (en) * 2011-01-04 2012-07-05 Samsung Electronics Co., Ltd. Social screen casting
CN102148874A (zh) * 2011-03-30 2011-08-10 北京彩讯科技股份有限公司 对网络计算机的远程多键盘鼠标控制方法
CN103093594B (zh) * 2011-11-01 2016-04-13 北京红云融通技术有限公司 触控式遥控器
CN102968274A (zh) * 2012-11-22 2013-03-13 广东欧珀移动通信有限公司 一种在移动设备中自由截屏的方法和系统
CN103037014A (zh) * 2012-12-30 2013-04-10 中山市嘉盛电子有限公司 一种车载系统

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101802755A (zh) * 2007-09-18 2010-08-11 汤姆森许可贸易公司 机顶盒的用户界面
CN101888608A (zh) * 2010-07-20 2010-11-17 中兴通讯股份有限公司 远程控制方法、装置和系统
CN102752727A (zh) * 2012-05-30 2012-10-24 北京三星通信技术研究有限公司 终端远程向导方法及装置
CN103049190A (zh) * 2012-12-12 2013-04-17 北京奇虎科技有限公司 一种移动通信终端及控制设备操作的方法
CN103984494A (zh) * 2013-02-07 2014-08-13 上海帛茂信息科技有限公司 用于多种设备间的直觉式用户互动系统及方法
CN104426990A (zh) * 2013-09-09 2015-03-18 联想(北京)有限公司 一种控制方法和装置
CN104135712A (zh) * 2014-07-30 2014-11-05 上海斐讯数据通信技术有限公司 一种移动终端近程控制方法及系统

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109120880A (zh) * 2018-09-19 2019-01-01 电子科技大学 基于智能终端的实时会议批注方法及系统

Also Published As

Publication number Publication date
CN105592349A (zh) 2016-05-18

Similar Documents

Publication Publication Date Title
US20220353228A1 (en) Dynamic configuration of application component tiles
RU2670786C9 (ru) Система, способ и аппарат для управления группировкой устройств
US20200059444A1 (en) Task management based on instant message
US10110549B2 (en) Method, server and electronic devices of synchronizing notification messages for electronic devices
KR102275033B1 (ko) 데이터 처리 방법 및 그 전자 장치
US10455542B2 (en) Method of synchronizing notification messages for electronic devices and electronic devices
US9807219B2 (en) Method and terminal for executing user instructions
US20170031640A1 (en) Method, device and system for starting target function
WO2015184770A1 (fr) Procédé, système et terminal de traitement d'informations
WO2016062004A1 (fr) Procédé et terminal sans fil pour un partage d'écran entre des terminaux sans fil
JP6283749B2 (ja) 機器接続を促す方法および装置
US20200186484A1 (en) Method and apparatus for processing image in application, terminal device and storage medium
US20230138804A1 (en) Enhanced video call method and system, and electronic device
JP2016527577A (ja) ユーザー指令の実行方法、実行装置、プログラム及び記憶媒体
JP2014175956A (ja) 伝送端末、伝送システム、プログラム
US20220166685A1 (en) Communication apparatus and control method for the same
CN114265641A (zh) 控制方法、电子设备及计算机可读存储介质
KR102461009B1 (ko) 테더링 서비스를 제공하는 방법 및 이를 사용하는 전자 장치
CN114285681A (zh) 一种会议发起的方法、会议响应的方法、装置及存储介质
JP2018525744A (ja) アプリケーション及びデータをタッチスクリーンコンピュータ間で相互共有する方法並びにこの方法を実施するコンピュータプログラム
KR102256290B1 (ko) 통신 그룹 생성 방법 및 장치
JP2015162040A (ja) 電子機器
WO2017201999A1 (fr) Procédé, dispositif, terminal et support d'informations de chiffrement de fichier
WO2019051836A1 (fr) Procédé et appareil de réponse à des informations
KR102277217B1 (ko) 블록을 설정하는 전자 장치 및 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15852319

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15852319

Country of ref document: EP

Kind code of ref document: A1